[Pasig-discuss] Hybrid cloud - HDS, DELL, others?

Wed Jun 7 12:02:21 EDT 2017

Actually, that's something that iRODS has done for over a decade, it's not a new thing.  It's worth a look, it's open source, and supported by a very robust consortium.  It has very powerful metadata management, policy management, etc that you won't find anywhere else.

www.irods.org

Michael Conway

Senior Data Scientist - RENCI, iRODS Consortium

Research Assistant - DataNet Federation Consortium

michael_conway at unc.edu

http://www.linkedin.com/in/michaelcconway<http://www.linkedin.com/in/michaelcconway>

UNC Chapel Hill, Chapel Hill, NC

________________________________
From: Pasig-discuss <pasig-discuss-bounces at asist.org> on behalf of Enrico Palmerino <epalmerino at starfishstorage.com>
Sent: Wednesday, June 7, 2017 11:34 AM
To: Jonathan Tilbury
Cc: pasig-discuss at mail.asis.org
Subject: Re: [Pasig-discuss] Hybrid cloud - HDS, DELL, others?

Hi Gail,

This sounds like something Starfish would be perfectly capable of handling.  We recently won best in show at Bio IT World, thanks to our metadata tracking across heterogenous environments including terrestrial and cloud, our policy engine, and our gateways into object stores including S3, any Swift interface, and Oracle Cloud to make moving and tracking files/objects in and out seamless.

Happy to setup a call to discuss further.

Best,

Enrico Palmerino  |  Managing Director  |  [http://starfishstorage.com/wp-content/uploads/2016/01/StarFishLogo.png]

epalmerino at starfishstorage.com<mailto:epalmerino at starfishstorage.com> | www.starfish.storage<http://www.starfish.storage> | (617) 603-0074 ext 700<tel:%28617%29%20603-0074%20ext%20701>

[http://www.starfishstorage.com/wp-content/uploads/2017/06/Best-of-Show-17-WINNER.png]

On Wed, Jun 7, 2017 3:27 AM, Jonathan Tilbury jonathan.tilbury at preservica.com<mailto:jonathan.tilbury at preservica.com> wrote:

Gail,

Preservica can be installed on-premise then a storage policy created that uses the metadata to decide which objects are stored where. The options for storage adapters include local disk storage via a mount point. Amazon S3, Amazon Glacier, Oracle Cloud Archive, Microsoft Azure, a remote Secure FTP drive and a few others.

The metadata can dictate the storage adapters in a large range of ways, for example certain confidential collections  held locally and the rest in Amazon S3, or presentation manifestations of files on local disk or S3 and the digital master preservation copies kept in Glacier. You could also tell it to put an additional copy of everything in Oracle Cloud Archive.

This storage policy option is also used in our Cloud Edition hosted in AWS and the SFTP adapter is often used to write an additional copy to a remote, or even local, location or to split the collection between S3 and Glacier.

Because Preservica also provides all the ingest processing, data management, integration APIs, online access and file format migration tools you would expect in a complete DP solution this may be overkill for your needs.

Jon

From: gail at trumantechnologies.com [mailto:gail at trumantechnologies.com]
Sent: 07 June 2017 00:14
To: Jonathan Tilbury <jonathan.tilbury at preservica.com>; pasig-discuss at mail.asis.org
Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others?

Hi Jon, please do send info. There are some front-end apps, so in this situation this is pretty much tiered storage that we're looking for with cloud as part of that tier.

Gail

Gail Truman

Truman Technologies, LLC

Certified Digital Archives Specialist, Society of American Archivists

Protecting the world's digital heritage for future generations

www.trumantechnologies.com<http://www.trumantechnologies.com>

facebook/TrumanTechnologies

https://www.linkedin.com/in/gtruman

+1 510 502 6497

-------- Original Message --------
Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others?
From: Jonathan Tilbury <jonathan.tilbury at preservica.com<mailto:jonathan.tilbury at preservica.com>>
Date: Tue, June 06, 2017 3:45 pm
To: "gail at trumantechnologies.com<mailto:gail at trumantechnologies.com>" <gail at trumantechnologies.com<mailto:gail at trumantechnologies.com>>,
"pasig-discuss at mail.asis.org<mailto:pasig-discuss at mail.asis.org>" <pasig-discuss at mail.asis.org<mailto:pasig-discuss at mail.asis.org>>

Gail,

Is it just storage you are looking for or a complete DP solution? Preservica can be set up to do exactly what you describe, using a storage policy that uses metadata to decide what is stored where, and we have several customers using this to split the collection between local and remote storage.  Of course they also use all the other things a DP solution can add including ingest tools, metadata management, access and format migration.

I’ll be in touch to send more information.

Jon

Jonathan Tilbury

Chief Technology Officer

Preservica

22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS

T: +44(0)1235 428949   M: +44(0)7808 950580   E: jonathan.tilbury at preservica.com<mailto:jonathan.tilbury at preservica.com>   W: www.preservica.com<http://www.preservica.com>   TW: @dPreservation

[PreservicaLogo]

This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately.

Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system.

Please consider the environment and do not print this e-mail unless you really need to.

From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com<mailto:gail at trumantechnologies.com>
Sent: 06 June 2017 22:41
To: pasig-discuss at mail.asis.org<mailto:pasig-discuss at mail.asis.org>
Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others?

Hi all, I'm trying to find the right solution for a customer use case where a subset of digital content and its metadata are stored locally (on premise) with another subset of data (and possibly copies of the on-premise local data) are stored in a public cloud. Since the public cloud will most likely present S3 interface/API I'm considering gateway products that can do the protocol conversion for the apps front-ending the data storage.

If it were a large digital collection I'd be quite serious about HDS' HCP and S10 object storage - but this is just 25 - 50 TB total.

If anyone on the alias has a similar setup, or is a vendor and wants to contact me, I'd like to get some pricing/config and use case info.

Thanks

Gail

Gail Truman

Truman Technologies, LLC

Certified Digital Archives Specialist, Society of American Archivists

Protecting the world's digital heritage for future generations

www.trumantechnologies.com<http://www.trumantechnologies.com>

facebook/TrumanTechnologies

https://www.linkedin.com/in/gtruman

+1 510 502 6497

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.asis.org/pipermail/pasig-discuss/attachments/20170607/86215112/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 7903 bytes
Desc: image001.png
URL: <http://mail.asis.org/pipermail/pasig-discuss/attachments/20170607/86215112/attachment-0001.png>