From debra.weiss at colorado.edu Mon Jun 5 18:23:44 2017 From: debra.weiss at colorado.edu (Debra Weiss) Date: Mon, 5 Jun 2017 22:23:44 +0000 Subject: [Pasig-discuss] Deadline extended - digital library software architect CU Boulder Libraries Message-ID: Hi All, Apologies for cross-posting: We've extended the deadline for applying for the digital library software architect position open at CU Boulder Libraries. The new deadline is Monday, June 19th. New information: - the position has been moved organizationally from campus IT to University Libraries which is reflected in the re-posting at https://cu.taleo.net/careersection/jobdetail.ftl?job=09351&lang=en - persons who applied to the initial posting do not need to re-submit their applications Thank you for forwarding the position announcement to anyone you think may be interested in applying. Debby Debra Weiss Director of Libraries Information Technology 184 UCB University of Colorado Boulder Libraries Boulder, CO 80309 303-492-3965 http://www.colorado.edu/libraries/ From cmmorris at duraspace.org Tue Jun 6 08:34:46 2017 From: cmmorris at duraspace.org (Carol Minton Morris) Date: Tue, 6 Jun 2017 08:34:46 -0400 Subject: [Pasig-discuss] NEWS RELEASE: HykuDirect Pilot Program and Hyku Beta Testing Underway Message-ID: June 6, 2017 Read it online: http://bit.ly/2rtHnta Contact: hyku-contact at googlegroups.com *HykuDirect Pilot Program and Hyku Beta Testing Underway* The Hydra-In-A-Box team is pleased to announce that Beta testing for local installs of Hyku repository have begun! Read all the details on our wiki and learn how your institution can participate through June 23. Hyku is a digital content repository that provides robust deposit workflows, standards-based metadata management, convenient collection organization, preservation support, as well as integrated search, discovery, and access capabilities. Pilot Institutions for the HykuDirect pilot program have also been selected, and the pilot is underway. HykuDirect, the fully hosted service version of Hyku repository software, handles all of the server and storage provisioning, all of the Hyku repository software installation, deployment, upgrades, and scaling. There was significant interest in the hosted service pilot program from all types of institutions. With thanks to all the institutions who volunteered, we had far more institutions interested than we could accommodate for a limited term pilot. Six institutions representing many different institution sizes and use cases were selected, and asked to contribute $1,000 each to help cover the cost of the pilot. The following institutions are piloting the HykuDirect service this summer: - Arizona State Library & Archives - Cleveland Public Library - University of Miami - New Hampshire Digital Project - PALCI - St. Lawrence University These institutions are providing valuable feedback to the hosted service team to help ensure a robust and competitive service will be available to all institutions beginning in the fall of 2017. Pricing and subscriptions for the new service will be available in late summer. Eric Williams-Bergen, Director of Digital Initiatives, St. Lawrence University Libraries explained his institution?s interest in participating in the HykuDirect Pilot Program: "As a small liberal arts college, we are excited to join the HykuDirect pilot and to manage our digital assets using a robust and technologically advanced open-source platform. We are also eager to explore the opportunities HykuDirect pilot presents for us to share knowledge and experiences with other partnering institutions.? Hyku and HykuDirect were made possible by a generous grant from the Institute of Museum and Library Services (IMLS) to fund the Hydra-In-A-Box project led by The Digital Public Library of America (DPLA), Stanford University, and DuraSpace. Together, and in collaboration with their communities, these organizations extended the existing best-in-class Samvera Community (formerly Project Hydra) codebase to build, bundle, and promote a feature-complete, robust digital repository system. *Stay Up-to-Date On the Latest Hyku and HykuDirect News* Learn more by following us on Twitter and reading the project blog You may already be receiving the Hydra-in-a-Box Update, but if not you can subscribe to receive monthly updates. Please be in touch with any questions by writing to us at hyku-contact at googlegroups.com. -------------- next part -------------- An HTML attachment was scrubbed... URL: From gail at trumantechnologies.com Tue Jun 6 17:40:50 2017 From: gail at trumantechnologies.com (gail at trumantechnologies.com) Date: Tue, 06 Jun 2017 14:40:50 -0700 Subject: [Pasig-discuss] =?utf-8?q?Hybrid_cloud_-_HDS=2C_DELL=2C_others=3F?= Message-ID: <20170606144050.b554e26909f2beaf9f8ddbf6be9a6600.094e619200.wbe@email09.godaddy.com> An HTML attachment was scrubbed... URL: From gail at trumantechnologies.com Tue Jun 6 19:13:43 2017 From: gail at trumantechnologies.com (gail at trumantechnologies.com) Date: Tue, 06 Jun 2017 16:13:43 -0700 Subject: [Pasig-discuss] =?utf-8?q?Hybrid_cloud_-_HDS=2C_DELL=2C_others=3F?= Message-ID: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 7903 bytes Desc: not available URL: From lw85381 at yahoo.com Tue Jun 6 20:04:13 2017 From: lw85381 at yahoo.com (Chris Wood) Date: Tue, 6 Jun 2017 17:04:13 -0700 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> Message-ID: <2302e895-0c30-f272-a8e7-a6a5c9826741@yahoo.com> Hi Jon: Take a look at the Oracle Public Cloud that has an Object Archive Service that is very reasonably priced. Lower than AWS with no penalty for reading back your own data. They support S3 as well as a software NFS gateway installed on your premise where you can export an NFS share directly to you applications and just copy the data into the appliance and it will move it to the cloud. It also cached recent files for local response times. The gateway is supplied for free. (Storage cloud) https://cloud.oracle.com/storage Information on ht NFS appliance and bulk data load is also available here. CW On 6/6/2017 4:13 PM, gail at trumantechnologies.com wrote: > Hi Jon, please do send info. There are some front-end apps, so in this > situation this is pretty much tiered storage that we're looking for > with cloud as part of that tier. > > Gail > > Gail Truman > Truman Technologies, LLC > Certified Digital Archives Specialist, Society of American Archivists > */Protecting the world's digital heritage for future generations/* > www.trumantechnologies.com > facebook/TrumanTechnologies > https://www.linkedin.com/in/gtruman > +1 510 502 6497 > > > -------- Original Message -------- > Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? > From: Jonathan Tilbury > > Date: Tue, June 06, 2017 3:45 pm > To: "gail at trumantechnologies.com > " >, > "pasig-discuss at mail.asis.org " > > > > Gail, > Is it just storage you are looking for or a complete DP solution? > Preservica can be set up to do exactly what you describe, using a > storage policy that uses metadata to decide what is stored where, > and we have several customers using this to split the collection > between local and remote storage. Of course they also use all the > other things a DP solution can add including ingest tools, > metadata management, access and format migration. > I?ll be in touch to send more information. > Jon > *Jonathan Tilbury* > *Chief Technology Officer* > *Preservica* > 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, > OX14 3YS > T: +44(0)1235 428949 M: +44(0)7808 950580 E: > jonathan.tilbury at preservica.com > W: www.preservica.com > TW: @dPreservation > PreservicaLogo > This message is commercial in confidence and may be privileged. It > is intended for the addressee(s) only. Access to this message by > anyone else is unauthorized and strictly prohibited. If you have > received this message in error, please inform the sender immediately. > Please note that messages sent or received by the Preservica > e-mail system may be monitored and stored in an information > retrieval system. > Please consider the environment and do not print this e-mail > unless you really need to. > *From:*Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] *On > Behalf Of *gail at trumantechnologies.com > > *Sent:* 06 June 2017 22:41 > *To:* pasig-discuss at mail.asis.org > *Subject:* [Pasig-discuss] Hybrid cloud - HDS, DELL, others? > Hi all, I'm trying to find the right solution for a customer use > case where a subset of digital content and its metadata are stored > locally (on premise) with another subset of data (and possibly > copies of the on-premise local data) are stored in a public cloud. > Since the public cloud will most likely present S3 interface/API > I'm considering gateway products that can do the protocol > conversion for the apps front-ending the data storage. > If it were a large digital collection I'd be quite serious about > HDS' HCP and S10 object storage - but this is just 25 - 50 TB total. > If anyone on the alias has a similar setup, or is a vendor and > wants to contact me, I'd like to get some pricing/config and use > case info. > Thanks > Gail > Gail Truman > Truman Technologies, LLC > Certified Digital Archives Specialist, Society of American Archivists > */Protecting the world's digital heritage for future generations/* > www.trumantechnologies.com > facebook/TrumanTechnologies > https://www.linkedin.com/in/gtruman > +1 510 502 6497 > > > > ---- > To subscribe, unsubscribe, or modify your subscription, please visit > http://mail.asis.org/mailman/listinfo/pasig-discuss > _______ > PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html > _______________________________________________ > Pasig-discuss mailing list > Pasig-discuss at mail.asis.org > http://mail.asis.org/mailman/listinfo/pasig-discuss -- ---------------------------------------------------- Chris Wood Storage & Data Management Office: 408-782-2757 (Home Office) Office: 408-276-0730 (Work Office) Mobile: 408-218-7313 (Preferred) Email: lw85381 at yahoo.com ---------------------------------------------------- -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 7903 bytes Desc: not available URL: From jonathan.tilbury at preservica.com Wed Jun 7 03:15:58 2017 From: jonathan.tilbury at preservica.com (Jonathan Tilbury) Date: Wed, 7 Jun 2017 07:15:58 +0000 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: <2302e895-0c30-f272-a8e7-a6a5c9826741@yahoo.com> References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> <2302e895-0c30-f272-a8e7-a6a5c9826741@yahoo.com> Message-ID: Chris, We also have an Oracle Cloud storage adapter to allow users to put an extra copy of the objects into Oracle Archive Service as general durable storage good practice. Whilst storage is very cheap indeed there is a download fee for the Archive service, but this is generally used as the storage of last resort for your second copy. Jon . From: Chris Wood [mailto:lw85381 at yahoo.com] Sent: 07 June 2017 01:04 To: gail at trumantechnologies.com; Jonathan Tilbury ; pasig-discuss at mail.asis.org Subject: Re: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi Jon: Take a look at the Oracle Public Cloud that has an Object Archive Service that is very reasonably priced. Lower than AWS with no penalty for reading back your own data. They support S3 as well as a software NFS gateway installed on your premise where you can export an NFS share directly to you applications and just copy the data into the appliance and it will move it to the cloud. It also cached recent files for local response times. The gateway is supplied for free. (Storage cloud) https://cloud.oracle.com/storage Information on ht NFS appliance and bulk data load is also available here. CW On 6/6/2017 4:13 PM, gail at trumantechnologies.com wrote: Hi Jon, please do send info. There are some front-end apps, so in this situation this is pretty much tiered storage that we're looking for with cloud as part of that tier. Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------- Original Message -------- Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? From: Jonathan Tilbury > Date: Tue, June 06, 2017 3:45 pm To: "gail at trumantechnologies.com" >, "pasig-discuss at mail.asis.org" > Gail, Is it just storage you are looking for or a complete DP solution? Preservica can be set up to do exactly what you describe, using a storage policy that uses metadata to decide what is stored where, and we have several customers using this to split the collection between local and remote storage. Of course they also use all the other things a DP solution can add including ingest tools, metadata management, access and format migration. I?ll be in touch to send more information. Jon Jonathan Tilbury Chief Technology Officer Preservica 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: 06 June 2017 22:41 To: pasig-discuss at mail.asis.org Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi all, I'm trying to find the right solution for a customer use case where a subset of digital content and its metadata are stored locally (on premise) with another subset of data (and possibly copies of the on-premise local data) are stored in a public cloud. Since the public cloud will most likely present S3 interface/API I'm considering gateway products that can do the protocol conversion for the apps front-ending the data storage. If it were a large digital collection I'd be quite serious about HDS' HCP and S10 object storage - but this is just 25 - 50 TB total. If anyone on the alias has a similar setup, or is a vendor and wants to contact me, I'd like to get some pricing/config and use case info. Thanks Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 ---- To subscribe, unsubscribe, or modify your subscription, please visit http://mail.asis.org/mailman/listinfo/pasig-discuss _______ PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html _______________________________________________ Pasig-discuss mailing list Pasig-discuss at mail.asis.org http://mail.asis.org/mailman/listinfo/pasig-discuss -- ---------------------------------------------------- Chris Wood Storage & Data Management Office: 408-782-2757 (Home Office) Office: 408-276-0730 (Work Office) Mobile: 408-218-7313 (Preferred) Email: lw85381 at yahoo.com ---------------------------------------------------- -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From jonathan.tilbury at preservica.com Wed Jun 7 03:27:03 2017 From: jonathan.tilbury at preservica.com (Jonathan Tilbury) Date: Wed, 7 Jun 2017 07:27:03 +0000 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> Message-ID: Gail, Preservica can be installed on-premise then a storage policy created that uses the metadata to decide which objects are stored where. The options for storage adapters include local disk storage via a mount point. Amazon S3, Amazon Glacier, Oracle Cloud Archive, Microsoft Azure, a remote Secure FTP drive and a few others. The metadata can dictate the storage adapters in a large range of ways, for example certain confidential collections held locally and the rest in Amazon S3, or presentation manifestations of files on local disk or S3 and the digital master preservation copies kept in Glacier. You could also tell it to put an additional copy of everything in Oracle Cloud Archive. This storage policy option is also used in our Cloud Edition hosted in AWS and the SFTP adapter is often used to write an additional copy to a remote, or even local, location or to split the collection between S3 and Glacier. Because Preservica also provides all the ingest processing, data management, integration APIs, online access and file format migration tools you would expect in a complete DP solution this may be overkill for your needs. Jon From: gail at trumantechnologies.com [mailto:gail at trumantechnologies.com] Sent: 07 June 2017 00:14 To: Jonathan Tilbury ; pasig-discuss at mail.asis.org Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi Jon, please do send info. There are some front-end apps, so in this situation this is pretty much tiered storage that we're looking for with cloud as part of that tier. Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------- Original Message -------- Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? From: Jonathan Tilbury > Date: Tue, June 06, 2017 3:45 pm To: "gail at trumantechnologies.com" >, "pasig-discuss at mail.asis.org" > Gail, Is it just storage you are looking for or a complete DP solution? Preservica can be set up to do exactly what you describe, using a storage policy that uses metadata to decide what is stored where, and we have several customers using this to split the collection between local and remote storage. Of course they also use all the other things a DP solution can add including ingest tools, metadata management, access and format migration. I?ll be in touch to send more information. Jon Jonathan Tilbury Chief Technology Officer Preservica 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: 06 June 2017 22:41 To: pasig-discuss at mail.asis.org Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi all, I'm trying to find the right solution for a customer use case where a subset of digital content and its metadata are stored locally (on premise) with another subset of data (and possibly copies of the on-premise local data) are stored in a public cloud. Since the public cloud will most likely present S3 interface/API I'm considering gateway products that can do the protocol conversion for the apps front-ending the data storage. If it were a large digital collection I'd be quite serious about HDS' HCP and S10 object storage - but this is just 25 - 50 TB total. If anyone on the alias has a similar setup, or is a vendor and wants to contact me, I'd like to get some pricing/config and use case info. Thanks Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From epalmerino at starfishstorage.com Wed Jun 7 11:34:18 2017 From: epalmerino at starfishstorage.com (Enrico Palmerino) Date: Wed, 07 Jun 2017 15:34:18 +0000 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> Message-ID: Hi Gail, This sounds like something Starfish would be perfectly capable of handling. ?We recently won best in show at Bio IT World, thanks to our metadata tracking across heterogenous environments including terrestrial and cloud, our policy engine, and our gateways into object stores including S3, any Swift interface, and Oracle Cloud to make moving and tracking files/objects in and out seamless. Happy to setup a call to discuss further. Best, Enrico Palmerino |? Managing Director| epalmerino at starfishstorage.com|www.starfish.storage|(617) 603-0074 ext 700 On Wed, Jun 7, 2017 3:27 AM, Jonathan Tilbury jonathan.tilbury at preservica.com wrote: Gail, Preservica can be installed on-premise then a storage policy created that uses the metadata to decide which objects are stored where. The options for storage adapters include local disk storage via a mount point. Amazon S3, Amazon Glacier, Oracle Cloud Archive, Microsoft Azure, a remote Secure FTP drive and a few others. The metadata can dictate the storage adapters in a large range of ways, for example certain confidential collections ?held locally and the rest in Amazon S3, or presentation manifestations of files on local disk or S3 and the digital master preservation copies kept in Glacier. You could also tell it to put an additional copy of everything in Oracle Cloud Archive. This storage policy option is also used in our Cloud Edition hosted in AWS and the SFTP adapter is often used to write an additional copy to a remote, or even local, location or to split the collection between S3 and Glacier. Because Preservica also provides all the ingest processing, data management, integration APIs, online access and file format migration tools you would expect in a complete DP solution this may be overkill for your needs. Jon From: gail at trumantechnologies.com [mailto:gail at trumantechnologies.com] Sent: 07 June 2017 00:14 To: Jonathan Tilbury ; pasig-discuss at mail.asis.org Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi Jon, please do send info. There are some front-end apps, so in this situation this is pretty much tiered storage that we're looking for with cloud as part of that tier. Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------- Original Message -------- Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? From: Jonathan Tilbury Date: Tue, June 06, 2017 3:45 pm To: "gail at trumantechnologies.com" , "pasig-discuss at mail.asis.org" Gail, Is it just storage you are looking for or a complete DP solution? Preservica can be set up to do exactly what you describe, using a storage policy that uses metadata to decide what is stored where, and we have several customers using this to split the collection between local and remote storage. ?Of course they also use all the other things a DP solution can add including ingest tools, metadata management, access and format migration. I?ll be in touch to send more information. Jon Jonathan Tilbury Chief Technology Officer Preservica 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 ? M: +44(0)7808 950580 ? E: jonathan.tilbury at preservica.com ??W: www.preservica.com ? TW: @dPreservation This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: 06 June 2017 22:41 To: pasig-discuss at mail.asis.org Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi all, I'm trying to find the right solution for a customer use case where a subset of digital content and its metadata are stored locally (on premise) with another subset of data (and possibly copies of the on-premise local data) are stored in a public cloud. Since the public cloud will most likely present S3 interface/API I'm considering gateway products that can do the protocol conversion for the apps front-ending the data storage. If it were a large digital collection I'd be quite serious about HDS' HCP and S10 object storage - but this is just 25 - 50 TB total. If anyone on the alias has a similar setup, or is a vendor and wants to contact me, I'd like to get some pricing/config and use case info. Thanks Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: not available URL: From michael_conway at unc.edu Wed Jun 7 12:02:21 2017 From: michael_conway at unc.edu (Conway, Mike) Date: Wed, 7 Jun 2017 16:02:21 +0000 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> , Message-ID: Actually, that's something that iRODS has done for over a decade, it's not a new thing. It's worth a look, it's open source, and supported by a very robust consortium. It has very powerful metadata management, policy management, etc that you won't find anywhere else. www.irods.org Michael Conway Senior Data Scientist - RENCI, iRODS Consortium Research Assistant - DataNet Federation Consortium michael_conway at unc.edu http://www.linkedin.com/in/michaelcconway UNC Chapel Hill, Chapel Hill, NC ________________________________ From: Pasig-discuss on behalf of Enrico Palmerino Sent: Wednesday, June 7, 2017 11:34 AM To: Jonathan Tilbury Cc: pasig-discuss at mail.asis.org Subject: Re: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi Gail, This sounds like something Starfish would be perfectly capable of handling. We recently won best in show at Bio IT World, thanks to our metadata tracking across heterogenous environments including terrestrial and cloud, our policy engine, and our gateways into object stores including S3, any Swift interface, and Oracle Cloud to make moving and tracking files/objects in and out seamless. Happy to setup a call to discuss further. Best, Enrico Palmerino | Managing Director | [http://starfishstorage.com/wp-content/uploads/2016/01/StarFishLogo.png] epalmerino at starfishstorage.com | www.starfish.storage | (617) 603-0074 ext 700 [http://www.starfishstorage.com/wp-content/uploads/2017/06/Best-of-Show-17-WINNER.png] On Wed, Jun 7, 2017 3:27 AM, Jonathan Tilbury jonathan.tilbury at preservica.com wrote: Gail, Preservica can be installed on-premise then a storage policy created that uses the metadata to decide which objects are stored where. The options for storage adapters include local disk storage via a mount point. Amazon S3, Amazon Glacier, Oracle Cloud Archive, Microsoft Azure, a remote Secure FTP drive and a few others. The metadata can dictate the storage adapters in a large range of ways, for example certain confidential collections held locally and the rest in Amazon S3, or presentation manifestations of files on local disk or S3 and the digital master preservation copies kept in Glacier. You could also tell it to put an additional copy of everything in Oracle Cloud Archive. This storage policy option is also used in our Cloud Edition hosted in AWS and the SFTP adapter is often used to write an additional copy to a remote, or even local, location or to split the collection between S3 and Glacier. Because Preservica also provides all the ingest processing, data management, integration APIs, online access and file format migration tools you would expect in a complete DP solution this may be overkill for your needs. Jon From: gail at trumantechnologies.com [mailto:gail at trumantechnologies.com] Sent: 07 June 2017 00:14 To: Jonathan Tilbury ; pasig-discuss at mail.asis.org Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi Jon, please do send info. There are some front-end apps, so in this situation this is pretty much tiered storage that we're looking for with cloud as part of that tier. Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------- Original Message -------- Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? From: Jonathan Tilbury > Date: Tue, June 06, 2017 3:45 pm To: "gail at trumantechnologies.com" >, "pasig-discuss at mail.asis.org" > Gail, Is it just storage you are looking for or a complete DP solution? Preservica can be set up to do exactly what you describe, using a storage policy that uses metadata to decide what is stored where, and we have several customers using this to split the collection between local and remote storage. Of course they also use all the other things a DP solution can add including ingest tools, metadata management, access and format migration. I?ll be in touch to send more information. Jon Jonathan Tilbury Chief Technology Officer Preservica 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: 06 June 2017 22:41 To: pasig-discuss at mail.asis.org Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? Hi all, I'm trying to find the right solution for a customer use case where a subset of digital content and its metadata are stored locally (on premise) with another subset of data (and possibly copies of the on-premise local data) are stored in a public cloud. Since the public cloud will most likely present S3 interface/API I'm considering gateway products that can do the protocol conversion for the apps front-ending the data storage. If it were a large digital collection I'd be quite serious about HDS' HCP and S10 object storage - but this is just 25 - 50 TB total. If anyone on the alias has a similar setup, or is a vendor and wants to contact me, I'd like to get some pricing/config and use case info. Thanks Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From lw85381 at yahoo.com Wed Jun 7 12:07:52 2017 From: lw85381 at yahoo.com (Chris Wood) Date: Wed, 7 Jun 2017 09:07:52 -0700 Subject: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? In-Reply-To: References: <20170606161343.b554e26909f2beaf9f8ddbf6be9a6600.1659faca04.wbe@email09.godaddy.com> <2302e895-0c30-f272-a8e7-a6a5c9826741@yahoo.com> Message-ID: <13db5487-379b-ce3c-312f-937734e5cfe9@yahoo.com> Thanks Jon. Good to know that. CW On 6/7/2017 12:15 AM, Jonathan Tilbury wrote: > > Chris, > > We also have an Oracle Cloud storage adapter to allow users to put an > extra copy of the objects into Oracle Archive Service as general > durable storage good practice. Whilst storage is very cheap indeed > there is a download fee for the Archive service, but this is generally > used as the storage of last resort for your second copy. > > Jon > > . > > *From:*Chris Wood [mailto:lw85381 at yahoo.com] > *Sent:* 07 June 2017 01:04 > *To:* gail at trumantechnologies.com; Jonathan Tilbury > ; pasig-discuss at mail.asis.org > *Subject:* Re: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? > > Hi Jon: > > Take a look at the Oracle Public Cloud that has an Object Archive > Service that is very reasonably priced. Lower than AWS with no penalty > for reading back your own data. They support S3 as well as a software > NFS gateway installed on your premise where you can export an NFS > share directly to you applications and just copy the data into the > appliance and it will move it to the cloud. It also cached recent > files for local response times. The gateway is supplied for free. > (Storage cloud) https://cloud.oracle.com/storage Information on ht NFS > appliance and bulk data load is also available here. > > CW > > On 6/6/2017 4:13 PM, gail at trumantechnologies.com > wrote: > > Hi Jon, please do send info. There are some front-end apps, so in > this situation this is pretty much tiered storage that we're > looking for with cloud as part of that tier. > > Gail > > Gail Truman > > Truman Technologies, LLC > > Certified Digital Archives Specialist, Society of American Archivists > > /*Protecting the world's digital heritage for future generations*/ > > www.trumantechnologies.com > > facebook/TrumanTechnologies > > https://www.linkedin.com/in/gtruman > > +1 510 502 6497 > > -------- Original Message -------- > Subject: RE: [Pasig-discuss] Hybrid cloud - HDS, DELL, others? > From: Jonathan Tilbury > > Date: Tue, June 06, 2017 3:45 pm > To: "gail at trumantechnologies.com > " > >, > "pasig-discuss at mail.asis.org > " > > > > Gail, > > Is it just storage you are looking for or a complete DP > solution? Preservica can be set up to do exactly what you > describe, using a storage policy that uses metadata to decide > what is stored where, and we have several customers using this > to split the collection between local and remote storage. Of > course they also use all the other things a DP solution can > add including ingest tools, metadata management, access and > format migration. > > I?ll be in touch to send more information. > > Jon > > *Jonathan Tilbury* > > *Chief Technology Officer* > > *Preservica* > > 22 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, > OX14 3YS > > T: +44(0)1235 428949 M: +44(0)7808 950580 E: > jonathan.tilbury at preservica.com > W: > www.preservica.com TW: > @dPreservation > > PreservicaLogo > > This message is commercial in confidence and may be > privileged. It is intended for the addressee(s) only. Access > to this message by anyone else is unauthorized and strictly > prohibited. If you have received this message in error, please > inform the sender immediately. > > Please note that messages sent or received by the Preservica > e-mail system may be monitored and stored in an information > retrieval system. > > Please consider the environment and do not print this e-mail > unless you really need to. > > *From:*Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] > *On Behalf Of *gail at trumantechnologies.com > > *Sent:* 06 June 2017 22:41 > *To:* pasig-discuss at mail.asis.org > > *Subject:* [Pasig-discuss] Hybrid cloud - HDS, DELL, others? > > Hi all, I'm trying to find the right solution for a customer > use case where a subset of digital content and its metadata > are stored locally (on premise) with another subset of data > (and possibly copies of the on-premise local data) are stored > in a public cloud. Since the public cloud will most likely > present S3 interface/API I'm considering gateway products that > can do the protocol conversion for the apps front-ending the > data storage. > > If it were a large digital collection I'd be quite serious > about HDS' HCP and S10 object storage - but this is just 25 - > 50 TB total. > > If anyone on the alias has a similar setup, or is a vendor and > wants to contact me, I'd like to get some pricing/config and > use case info. > > Thanks > > Gail > > Gail Truman > > Truman Technologies, LLC > > Certified Digital Archives Specialist, Society of American > Archivists > > */Protecting the world's digital heritage for future generations/* > > www.trumantechnologies.com > > facebook/TrumanTechnologies > > https://www.linkedin.com/in/gtruman > > +1 510 502 6497 > > > > > ---- > > To subscribe, unsubscribe, or modify your subscription, please visit > > http://mail.asis.org/mailman/listinfo/pasig-discuss > > _______ > > PASIG Webinars and conference material is athttp://www.preservationandarchivingsig.org/index.html > > _______________________________________________ > > Pasig-discuss mailing list > > Pasig-discuss at mail.asis.org > > http://mail.asis.org/mailman/listinfo/pasig-discuss > > > > -- > ---------------------------------------------------- > Chris Wood > Storage & Data Management > Office: 408-782-2757 (Home Office) > Office: 408-276-0730 (Work Office) > Mobile: 408-218-7313 (Preferred) > Email:lw85381 at yahoo.com > ---------------------------------------------------- -- ---------------------------------------------------- Chris Wood Storage & Data Management Office: 408-782-2757 (Home Office) Office: 408-276-0730 (Work Office) Mobile: 408-218-7313 (Preferred) Email: lw85381 at yahoo.com ---------------------------------------------------- -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: not available URL: From jfcarrano at gmail.com Mon Jun 12 09:40:10 2017 From: jfcarrano at gmail.com (Joe Carrano) Date: Mon, 12 Jun 2017 09:40:10 -0400 Subject: [Pasig-discuss] Fwd: NDSRDC 2017 Symposium speakers announced and registration open! In-Reply-To: References: Message-ID: Registration for NDSRDC 2017 now open! The National Digital Stewardship Residents of DC are pleased to open registration for their annual symposium, Blending Collaborations and Bridging Gaps: Digital Preservation Communities of Practice, occurring August 17, 2017 at the World Bank in Washington, DC. The NDSRDC 2017 symposium will emphasize community-supported efforts that have allowed for project-based or grant-funded digital stewardship activities to transition into long-term, sustainable services. Much like NDSR is funded in order to create a community of practice for digital preservation, the symposium will highlight work being done by both local and distributed communities to support preservation and access to electronic resources. This program is centered around ways these communities leverage both local and international connections to build more robust relationships and greater interoperability between their services. To see more details about the schedule and speakers see below or check out our website: ndsr2017.wordpress.com We hope to see you on August 17 at #ndsr2017! *Speakers and Rountable* We've got an all-star group to discuss digital preservation from multiple perspectives. They include: Keynote: T-Kay Sangwand, UCLA Library Speaker 2: Jessica Meyerson, Briscoe Center for American History, UT Austin Speaker 3: Matt Zumwalt, Protocol Labs Roundtable: - Guha Shankar, American Folklife Center, Library of Congress - Lauren Algee, District of Columbia Public Library - Joe Tropea, Maryland Historical Society *Registration* To register, please visit our Eventbrite page . *Thank you to our sponsors: Copyright ? 2017 National Digital Stewardship Residency, All rights reserved.* *Our mailing address is:* National Digital Stewardship Residency 101 Independence Ave SE Washington, DC 20540 Add us to your address book Want to change how you receive these emails? You can update your preferences or unsubscribe from this list [image: Email Marketing Powered by MailChimp] -------------- next part -------------- An HTML attachment was scrubbed... URL: From mireille_nappert at hotmail.com Mon Jun 12 10:42:33 2017 From: mireille_nappert at hotmail.com (Mireille Nappert) Date: Mon, 12 Jun 2017 14:42:33 +0000 Subject: [Pasig-discuss] TR: [Ica-l] PRONOM in practice webinar, 13 June In-Reply-To: References: Message-ID: Hello all, I believe this webinar could be of interest for some of you. Apologies for crosspostings. Mireille Nappert ________________________________ De : Becky McGuinness Envoy? : 12 juin 2017 04:30 ? : ica-l at mailman.srv.ualberta.ca Objet : [Ica-l] PRONOM in practice webinar, 13 June PRONOM is an online file format registry, maintained by The National Archives in the UK. It contains information about approximately 1500 different digital file formats. Identifying file formats in your collection is an essential first step for digital preservation. This webinar will provide an introduction to PRONOM, and explore the different types of file signature and how they contribute to identifying specific formats. In the second part of the webinar, you will gain an insight into the experience of creating a new signature from a digital archivist perspective. You will also see an example of adding a custom ID command to Fido as an interim solution in between PRONOM signature releases. Finally, there will be an opportunity to find out about future plans for PRONOM and how the community can contribute to this valuable resource. To find out more about PRONOM, visit: https://www.nationalarchives.gov.uk/PRONOM/Default.aspx Session Leads David Clipsham, National Archives of the UK Jenny Mitcham, University of York Sara Allain, Artefactual Registration Registration is open at: https://openpreservation.clickmeeting.com/pronom-in-practice/register. There are 50 places available, allocated on a first come, first served basis. The webinar will also be recorded for OPF members who cannot attend at this time. Time The webinar takes place at 16:00 BST / 17:00 CEST and will last approximately one hour. -- Becky McGuinness | Community Manager @openpreserve | Skype: becky.mcguinness1 Open Preservation Foundation http://openpreservation.org/ Open Preservation - Shared solutions for effective and ... openpreservation.org The Open Preservation Foundation. sustains technology and knowledge for the long-term management of digital cultural heritage. We provide our members with reliable ... To find out more about becoming an OPF member or software supporter visit: http://openpreservation.org/about/join/ Join - Open Preservation Foundation openpreservation.org Join. The Open Preservation Foundation is an international, not-for-profit membership organisation advancing shared solutions for effective and efficient digital ... -------------- next part -------------- An HTML attachment was scrubbed... URL: From wweber at archives.gov.sk.ca Wed Jun 14 12:23:13 2017 From: wweber at archives.gov.sk.ca (Weber, Warren SA) Date: Wed, 14 Jun 2017 16:23:13 +0000 Subject: [Pasig-discuss] The Provincial Archives of Saskatchewan extends its RFP deadline for the procurement of Archival Mangement/Digital Preservation Software Message-ID: <2D27AF58447B724AB78B3603E17D0467EC290452@SABEXC2.sab.archives.gov.sk.ca> To interested software vendors. The Provincial Archives of Saskatchewan (PAS) has extended its RFP submission deadline to July 18th for the procurement of archival management / digital preservation software. The amended RFP can be viewed at the Government of Saskatchewan's SaskTender website https://sasktenders.ca Thank you. Warren Weber Manager, Information Technology Corporate Services Provincial Archives of Saskatchewan p: 306-787-0705 f: 306-787-1975 e: wweber at archives.gov.sk.ca www.saskarchives.com [PAS-FINAL Email_Sig_96dpi] This e-mail and any files or attachments may contain confidential, personal and/or privileged information intended for a specific purpose and recipient and may not be otherwise retained, distributed, copied, used or modified. If you are not the intended recipient, please advise me immediately by return e-mail or telephone and destroy this entire transmission and any copies produced. Thank you. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 2048 bytes Desc: image001.gif URL: From dwilcox at duraspace.org Thu Jun 15 13:14:32 2017 From: dwilcox at duraspace.org (David Wilcox) Date: Thu, 15 Jun 2017 14:14:32 -0300 Subject: [Pasig-discuss] AVAILABLE NOW: Fedora and Samvera Camp Curriculum Message-ID: <1128A3C0-3DAE-4C49-8C9A-130990B2EBE3@duraspace.org> Find out what will be covered in the Fedora and Samvera (formerly Hydra) Camp in the curriculum?now available . The Camp will be held at Oxford University, Sept 4 - 8, 2017. Register here , and remember that an early bird discount will be offered until July 10. The camp is hosted by Oxford University? Oxford, UK and is supported by Jisc . View the draft five-day detailed schedule of topics and activities here . A reception and other social activities are in the planning stages?stay tuned! ? On day one an overview of Fedora and Samvera will be offered along with the basics of Fedora repository software, linked data best practices and object modeling with PCDM (Portland Common Data Model). ? Day two features an in-depth review of core Fedora services followed by an hands-on session, "Rails for Zombies" with a group exercise focused on content types. ? A Hyrax installation and walk-through kicks off day three. Afternoon sessions will be about the Hyrax metadata model and new object creation. Day four continues with a deeper dive into using Hyrax. ? Day five brings the previous four days of practices and ideas together for group discussions on how participants will use what they learned and potential roadblocks. Space is limited so register early ! -- David Wilcox Fedora Product Manager DuraSpace dwilcox at duraspace.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From arthurpasquinelli at gmail.com Thu Jun 15 17:40:48 2017 From: arthurpasquinelli at gmail.com (Arthur Pasquinelli) Date: Thu, 15 Jun 2017 14:40:48 -0700 Subject: [Pasig-discuss] Where to Find PASIG Content and Emails - FYI In-Reply-To: <7fbe0596-b737-3d17-6b77-5b3906641e89@gmail.com> References: <7fbe0596-b737-3d17-6b77-5b3906641e89@gmail.com> Message-ID: <61bf186f-d9e0-eed9-49da-7a708dc8ff6a@gmail.com> We have had recurring requests about past PASIG content and emails. You can find email archives via the footer at the bottom of a PASIG email. But here is an easy reference guide. 1. We have had some substantive email conversations on the *Discuss *email list. Archived discussion threads can be found at: http://mail.asis.org/pipermail/pasig-discuss/ 2. The *Announce* email archive is also available. These are specific to PASIG announcements over the years, which are generally event-related. http://mail.asis.org/pipermail/pasig-announce/ 3. The *main PASIG page* has the content from all the past conferences on it. You can also link to the upcoming Oxford PASIG event via this page. http://www.preservationandarchivingsig.org/index.html -------------- next part -------------- An HTML attachment was scrubbed... URL: From cmmorris at duraspace.org Mon Jun 19 08:40:10 2017 From: cmmorris at duraspace.org (Carol Minton Morris) Date: Mon, 19 Jun 2017 08:40:10 -0400 Subject: [Pasig-discuss] Open Repositories 2018 in Bozeman, Montana, USA Message-ID: *FOR IMMEDIATE RELEASE* June 19, 2017 Read it online: http://bit.ly/2srYlHi *Save the Dates for Open Repositories 2018, Bozeman, Montana, USA* *Bozeman, MT* Montana State University is pleased to announce the 13th annual Open Repositories conference June 4-7th, 2018 in Bozeman, Montana. We are excited to host Open Repositories 2018 in this beautiful place. We encourage you to discover more about Bozeman , Montana State University , the state of Montana , Glacier National Park , and Yellowstone National Park as we plan for the conference. Montana State University is a world-class research university tucked into a small mountain town just North of Yellowstone National Park. Home to both the rugged outdoors and exciting cultural activities downtown, Bozeman has something for everyone. The university is a mid-sized doctoral granting institution with a rich research enterprise, and the library is dedicated to repository innovation. OR2018 on the campus of Montana State University will be an invigorating educational meeting in the grandeur of the Rocky Mountains. The annual Open Repositories Conference brings together users and developers of open digital repository platforms from higher education, government, galleries, libraries, archives and museums. The Conference provides an interactive forum for delegates from around the world to come together and explore the global challenges and opportunities facing libraries and the broader scholarly information landscape. OR2018 web site: http://or2018.net -- Carol Minton Morris Communications and Marketing Director DuraSpace duraspace.org 607 592-3135 -------------- next part -------------- An HTML attachment was scrubbed... URL: From gail at trumantechnologies.com Wed Jun 21 15:47:38 2017 From: gail at trumantechnologies.com (gail at trumantechnologies.com) Date: Wed, 21 Jun 2017 12:47:38 -0700 Subject: [Pasig-discuss] =?utf-8?q?Arguments_for_keeping_an_onsite_copy_of?= =?utf-8?q?_digitally_preserved/stored_digital_content=3F?= Message-ID: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> An HTML attachment was scrubbed... URL: From neil at jefferies.org Wed Jun 21 16:06:29 2017 From: neil at jefferies.org (Neil Jefferies) Date: Wed, 21 Jun 2017 21:06:29 +0100 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <3062917688bb79bc5d9694e8195038c6@imap.plus.net> This paper: long term and third party are incompatible concepts. https://www.innosight.com/insight/creative-destruction-whips-through-corporate-america-an-innosight-executive-briefing-on-corporate-strategy/ Neil On 2017-06-21 20:47, gail at trumantechnologies.com wrote: > Experts, please share your thoughts. > > Are your institutions ready to "trust" the cloud for all copies of > data, or is there still an argument for an onsite copy? I usually lean > to keeping one onsite copy, but am I stuck in an old paradigm? From > earlier PASIG thread (started by Tim) it's clear other institutions > are keeping at least one copy on site. > > But how do you defend this decision? > > Gail > > Gail Truman > Truman Technologies, LLC > Certified Digital Archives Specialist, Society of American Archivists > > Protecting the world's digital heritage for future generations > www.trumantechnologies.com [1] > facebook/TrumanTechnologies > https://www.linkedin.com/in/gtruman > > +1 510 502 6497 > > > > Links: > ------ > [1] http://www.trumantechnologies.com > ---- > To subscribe, unsubscribe, or modify your subscription, please visit > http://mail.asis.org/mailman/listinfo/pasig-discuss > _______ > PASIG Webinars and conference material is at > http://www.preservationandarchivingsig.org/index.html > _______________________________________________ > Pasig-discuss mailing list > Pasig-discuss at mail.asis.org > http://mail.asis.org/mailman/listinfo/pasig-discuss From map6 at cornell.edu Wed Jun 21 16:11:09 2017 From: map6 at cornell.edu (Michelle A. Paolillo) Date: Wed, 21 Jun 2017 20:11:09 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: Hi Gail, I also tend to lean towards one onsite copy. Many cloud vendors are simply reselling Amazon services. As such, you may not really have appropriate diversity for commercially based threats if you have cloud copies only. If Amazon goes down, much of ?the cloud? goes down, regardless of who you bought it from. Best, Michelle From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: Wednesday, June 21, 2017 3:48 PM To: pasig-discuss at asis.org Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jmorley at stanford.edu Wed Jun 21 16:14:17 2017 From: jmorley at stanford.edu (Julian M. Morley) Date: Wed, 21 Jun 2017 20:14:17 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <3062917688bb79bc5d9694e8195038c6@imap.plus.net> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <3062917688bb79bc5d9694e8195038c6@imap.plus.net> Message-ID: We?re moving some of our archival content to cloud providers - but it?s providers, *plural*, and we fully intend to keep at least one, probably two online copies in facilities owned by Stanford. Data migrations are a fact of life, no matter what any one particular vendor says. So you have to design your systems to tolerate them, and even tolerate the sudden loss of any one provider. -- Julian M. Morley Technology Infrastructure Manager Digital Library Systems & Services Stanford University Libraries On 6/21/17, 1:06 PM, "Pasig-discuss on behalf of Neil Jefferies" wrote: >This paper: long term and third party are incompatible concepts. > >https://www.innosight.com/insight/creative-destruction-whips-through-corporate-america-an-innosight-executive-briefing-on-corporate-strategy/ > >Neil > > > > >On 2017-06-21 20:47, gail at trumantechnologies.com wrote: >> Experts, please share your thoughts. >> >> Are your institutions ready to "trust" the cloud for all copies of >> data, or is there still an argument for an onsite copy? I usually lean >> to keeping one onsite copy, but am I stuck in an old paradigm? From >> earlier PASIG thread (started by Tim) it's clear other institutions >> are keeping at least one copy on site. >> >> But how do you defend this decision? >> >> Gail >> >> Gail Truman >> Truman Technologies, LLC >> Certified Digital Archives Specialist, Society of American Archivists >> >> Protecting the world's digital heritage for future generations >> www.trumantechnologies.com [1] >> facebook/TrumanTechnologies >> https://www.linkedin.com/in/gtruman >> >> +1 510 502 6497 >> >> >> >> Links: >> ------ >> [1] http://www.trumantechnologies.com >> ---- >> To subscribe, unsubscribe, or modify your subscription, please visit >> http://mail.asis.org/mailman/listinfo/pasig-discuss >> _______ >> PASIG Webinars and conference material is at >> http://www.preservationandarchivingsig.org/index.html >> _______________________________________________ >> Pasig-discuss mailing list >> Pasig-discuss at mail.asis.org >> http://mail.asis.org/mailman/listinfo/pasig-discuss > >---- >To subscribe, unsubscribe, or modify your subscription, please visit >http://mail.asis.org/mailman/listinfo/pasig-discuss >_______ >PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html >_______________________________________________ >Pasig-discuss mailing list >Pasig-discuss at mail.asis.org >http://mail.asis.org/mailman/listinfo/pasig-discuss From dshr at stanford.edu Wed Jun 21 16:23:21 2017 From: dshr at stanford.edu (David Rosenthal) Date: Wed, 21 Jun 2017 13:23:21 -0700 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <4f0201d2-e504-ed54-c53e-e784373512de@stanford.edu> On 06/21/2017 12:47 PM, gail at trumantechnologies.com wrote: > Are your institutions ready to "trust" the cloud for all copies of data, or is > there still an argument for an onsite copy? I usually lean to keeping one onsite > copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by > Tim) it's clear other institutions are keeping at least one copy on site. #1 - See: http://www.lemonde.fr/pixels/visuel/2015/03/06/google-memorial-le-petit-musee-des-projets-google-abandonnes_4588392_4408996.html #2 - See https://aws.amazon.com/glacier/pricing/ and do the math. Glacier is cheap(-ish) provided you only access a small part of your data each month. If you need the whole thing, it costs a lot at a time when you're probably short of cash. David. From bogus at pobox.upenn.edu Wed Jun 21 16:42:25 2017 From: bogus at pobox.upenn.edu (Bogus, Ian) Date: Wed, 21 Jun 2017 20:42:25 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: As others are chiming in, diversity is key. Individual commercial providers often do not supply enforceable guarantees. Companies? priorities and services change, and we are talking about long-term management of assets. Amazon was founded in 1994. Amazon Web Services is just about a decade old. It?s a strong company now. It will probably be a strong company in 25 or 50 years. All agreements are out the window when a company goes out of business. Even if they offered to give you a dump, would you be in a position to accept that dump on short notice? Actively managing content from cloud services is either difficult, expensive, or both. Major format migrations will require mass retrievals and updates. Having an on-site copy is much easier to manage and control. An institution could decide put backups in commercial services to be accessed as critical events occur if they are willing to manage the costs of retrieval. I would also put out that non-traditional uses of digital content is quicker, easier, and more thorough on-site. Text-mining comes to mind as something that is easier when you have direct access to assets. More opportunities in this vein will become apparent as time goes on. Ian -- Ian Bogus MacDonald Curator of Preservation University of Pennsylvania Libraries 3420 Walnut Street, Room 610 Philadelphia, PA 19104-6206 T. 215.573.1376 F. 215.898.0559 bogus at pobox.upenn.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From jfarmer at cambridgecomputer.com Wed Jun 21 17:09:22 2017 From: jfarmer at cambridgecomputer.com (Jacob Farmer) Date: Wed, 21 Jun 2017 17:09:22 -0400 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <4f0201d2-e504-ed54-c53e-e784373512de@stanford.edu> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <4f0201d2-e504-ed54-c53e-e784373512de@stanford.edu> Message-ID: <2760ba265dd1e1e9d1ec413ff764f89c@mail.gmail.com> Included URL down below with a different perspective. This is a link to a 10TB hard drive on New Egg. A raw terabyte of disk capacity is less than $40 these days. You can put this in a cheap RAID system or in a server with a RAID card. Normally, I don't advocate low end, home-grown storage systems, but if you also have copies in the cloud, it is a very inexpensive insurance policy. Of course, a better solution would be to spend on the order of $100 or $150 per TB and get something enterprise class. There are tons of options. https://www.newegg.com/Product/Product.aspx?Item=N82E16822178997&cm_re=10t b-_-22-178-997-_-Product -----Original Message----- From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of David Rosenthal Sent: Wednesday, June 21, 2017 4:23 PM To: pasig-discuss at mail.asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? On 06/21/2017 12:47 PM, gail at trumantechnologies.com wrote: > Are your institutions ready to "trust" the cloud for all copies of > data, or is there still an argument for an onsite copy? I usually lean > to keeping one onsite copy, but am I stuck in an old paradigm? From > earlier PASIG thread (started by > Tim) it's clear other institutions are keeping at least one copy on site. #1 - See: http://www.lemonde.fr/pixels/visuel/2015/03/06/google-memorial-le-petit-mu see-des-projets-google-abandonnes_4588392_4408996.html #2 - See https://aws.amazon.com/glacier/pricing/ and do the math. Glacier is cheap(-ish) provided you only access a small part of your data each month. If you need the whole thing, it costs a lot at a time when you're probably short of cash. David. ---- To subscribe, unsubscribe, or modify your subscription, please visit http://mail.asis.org/mailman/listinfo/pasig-discuss _______ PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html _______________________________________________ Pasig-discuss mailing list Pasig-discuss at mail.asis.org http://mail.asis.org/mailman/listinfo/pasig-discuss From rruggaber1 at gmail.com Wed Jun 21 17:11:35 2017 From: rruggaber1 at gmail.com (Robin Lindley Ruggaber) Date: Wed, 21 Jun 2017 17:11:35 -0400 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: Gail, At UVa, we are planning to keep one copy local as a level 1/2 and to serve our need to conduct cost effective fixity checks, to serve high resolution copy request orders and to use as source for creating derivatives or serve as an access copy depending on format. Since we will have copies for most in the cloud, we can be more flexible about local storage and copies. Robin Typed on the go... > On Jun 21, 2017, at 3:47 PM, wrote: > > Experts, please share your thoughts. > > Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. > > But how do you defend this decision? > > Gail > > > > > > Gail Truman > Truman Technologies, LLC > Certified Digital Archives Specialist, Society of American Archivists > > Protecting the world's digital heritage for future generations > www.trumantechnologies.com > facebook/TrumanTechnologies > https://www.linkedin.com/in/gtruman > > +1 510 502 6497 > > > ---- > To subscribe, unsubscribe, or modify your subscription, please visit > http://mail.asis.org/mailman/listinfo/pasig-discuss > _______ > PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html > _______________________________________________ > Pasig-discuss mailing list > Pasig-discuss at mail.asis.org > http://mail.asis.org/mailman/listinfo/pasig-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonathan.tilbury at preservica.com Wed Jun 21 17:46:58 2017 From: jonathan.tilbury at preservica.com (Jonathan Tilbury) Date: Wed, 21 Jun 2017 21:46:58 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: Gail, Many of our customers choose to use our Cloud Edition to have their primary day-to-day copy in the cloud, but use an SFTP storage adapter to write one copy of all the objects and associated metadata (description, structure, preservation, audit trail) back home. This can combine the best of both worlds, the flexibility and value for money of a cloud hosted solution with a complete copy at a location of your choice. Jon From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of Michelle A. Paolillo Sent: 21 June 2017 21:11 To: pasig-discuss at asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, I also tend to lean towards one onsite copy. Many cloud vendors are simply reselling Amazon services. As such, you may not really have appropriate diversity for commercially based threats if you have cloud copies only. If Amazon goes down, much of ?the cloud? goes down, regardless of who you bought it from. Best, Michelle From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: Wednesday, June 21, 2017 3:48 PM To: pasig-discuss at asis.org Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From nickkrabbenhoeft at nypl.org Wed Jun 21 21:00:18 2017 From: nickkrabbenhoeft at nypl.org (Nick Krabbenhoeft) Date: Wed, 21 Jun 2017 21:00:18 -0400 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: Another aspect is institutional preference for capex vs. opex. For us, it can be easier to fund storage needs, at least for some of our copies, through capex purchases of local storage systems. -Nick Krabbenhoeft On Jun 21, 2017 5:50 PM, "Jonathan Tilbury" wrote: > Gail, > > > > Many of our customers choose to use our Cloud Edition to have their > primary day-to-day copy in the cloud, but use an SFTP storage adapter to > write one copy of all the objects and associated metadata (description, > structure, preservation, audit trail) back home. This can combine the best > of both worlds, the flexibility and value for money of a cloud hosted > solution with a complete copy at a location of your choice. > > > > Jon > > > > *From:* Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] *On Behalf > Of *Michelle A. Paolillo > *Sent:* 21 June 2017 21:11 > *To:* pasig-discuss at asis.org > *Subject:* Re: [Pasig-discuss] Arguments for keeping an onsite copy of > digitally preserved/stored digital content? > > > > Hi Gail, > > I also tend to lean towards one onsite copy. Many cloud vendors are > simply reselling Amazon services. As such, you may not really have > appropriate diversity for commercially based threats if you have cloud > copies only. If Amazon goes down, much of ?the cloud? goes down, > regardless of who you bought it from. > > Best, > > Michelle > > > > *From:* Pasig-discuss [mailto:pasig-discuss-bounces at asist.org > ] *On Behalf Of * > gail at trumantechnologies.com > *Sent:* Wednesday, June 21, 2017 3:48 PM > *To:* pasig-discuss at asis.org > *Subject:* [Pasig-discuss] Arguments for keeping an onsite copy of > digitally preserved/stored digital content? > > > > Experts, please share your thoughts. > > > > Are your institutions ready to "trust" the cloud for all copies of data, > or is there still an argument for an onsite copy? I usually lean to keeping > one onsite copy, but am I stuck in an old paradigm? From earlier PASIG > thread (started by Tim) it's clear other institutions are keeping at least > one copy on site. > > > > But how do you defend this decision? > > > > Gail > > > > > > > > > > > > Gail Truman > > Truman Technologies, LLC > > Certified Digital Archives Specialist, Society of American Archivists > > > > *Protecting the world's digital heritage for future generations* > > www.trumantechnologies.com > > facebook/TrumanTechnologies > > https://www.linkedin.com/in/gtruman > > > > +1 510 502 6497 <(510)%20502-6497> > > > > > > ---- > To subscribe, unsubscribe, or modify your subscription, please visit > http://mail.asis.org/mailman/listinfo/pasig-discuss > _______ > PASIG Webinars and conference material is at http://www. > preservationandarchivingsig.org/index.html > _______________________________________________ > Pasig-discuss mailing list > Pasig-discuss at mail.asis.org > http://mail.asis.org/mailman/listinfo/pasig-discuss > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From MEvans at historyassociates.com Wed Jun 21 21:11:25 2017 From: MEvans at historyassociates.com (Mark Evans) Date: Wed, 21 Jun 2017 21:11:25 -0400 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <6CDB3D1722247969.fe5fddf3-e807-4a10-9a9e-a99540685a78@mail.outlook.com> Quick comment on Nick' s comment about capex v opex. Many of the clients we work with, especially in the commercial sector find it easier to get budget approval for opex, hence subscription and cloud storage is a route they are increasingly turning to. However they still see the value and importance of a local copy, and a hybrid approach for storage is a popular solution. Get Outlook for Android On Wed, Jun 21, 2017 at 9:04 PM -0400, "Nick Krabbenhoeft" > wrote: Another aspect is institutional preference for capex vs. opex. For us, it can be easier to fund storage needs, at least for some of our copies, through capex purchases of local storage systems. -Nick Krabbenhoeft On Jun 21, 2017 5:50 PM, "Jonathan Tilbury" > wrote: Gail, Many of our customers choose to use our Cloud Edition to have their primary day-to-day copy in the cloud, but use an SFTP storage adapter to write one copy of all the objects and associated metadata (description, structure, preservation, audit trail) back home. This can combine the best of both worlds, the flexibility and value for money of a cloud hosted solution with a complete copy at a location of your choice. Jon From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of Michelle A. Paolillo Sent: 21 June 2017 21:11 To: pasig-discuss at asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, I also tend to lean towards one onsite copy. Many cloud vendors are simply reselling Amazon services. As such, you may not really have appropriate diversity for commercially based threats if you have cloud copies only. If Amazon goes down, much of ?the cloud? goes down, regardless of who you bought it from. Best, Michelle From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: Wednesday, June 21, 2017 3:48 PM To: pasig-discuss at asis.org Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 ---- To subscribe, unsubscribe, or modify your subscription, please visit http://mail.asis.org/mailman/listinfo/pasig-discuss _______ PASIG Webinars and conference material is at http://www.preservationandarchivingsig.org/index.html _______________________________________________ Pasig-discuss mailing list Pasig-discuss at mail.asis.org http://mail.asis.org/mailman/listinfo/pasig-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From lraymond at museum.vic.gov.au Wed Jun 21 22:53:26 2017 From: lraymond at museum.vic.gov.au (Raymond, Lee-Anne) Date: Thu, 22 Jun 2017 02:53:26 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <9e81f5667c5145c0975317e15da16260@Bullet.mv.vic.gov.au> Hi Gail, Such a big question and topic. In support of key arguments raised in support of ?on site? too - is to monitor and audit fixity and the control of masters angle. It can?t be about budget alone, if it has to be, supply your decision makes with as much detail in risk analysis as you can as a reality check. I?d have to support the hybrid with onsite argument/s fielded already with emphasis that it is one that ensures retaining control of master (original) and access/derivative supply without a third party delivery to manage/have an impact upon management of it. Retention and control over monitoring and auditing of fixity as a crucial responsibility ?within the walls? in concert with sovereignty over asset and its related data, being that, it relies ultimately on the integrity and stability of the solution. Cost, affordability and performance is obviously key to cloud services replacing onsite infrastructure but (goes without saying perhaps) it must tick all our local compliance requirements (which will differ State to State). Just for interest. At the dramatic end: A recent development here which has some bearing on who, if not ?the State?, owns/runs/has a stake in the infrastructure housing or servicing the data/assets of ?the State? http://www.abc.net.au/news/2017-06-20/security-concerns-over-defence-files-in-data-centres/8632360 - The contract will be exited as soon as practicable and legal to do so, at high cost. Best, Lee-Anne Lee-Anne Raymond Senior Coordinator, MV Images Museums Victoria PO Box 666 Melbourne, 3001 Australia t +61 3 8341 7714 f +61 3 8341 7573 museumsvictoria.com.au [museums victoria logo] This e-mail is solely for the named addressee and may be confidential. You should only read, disclose, transmit, copy, distribute, act in reliance on or commercialise the contents if you are authorised to do so. If you are not the intended recipient of this e-mail, please notify postmaster at museum.vic.gov.au by email immediately, or notify the sender and then destroy any copy of this message. Views expressed in this email are those of the individual sender, except where specifically stated to be those of an officer of Museum Victoria. Museum Victoria does not represent, warrant or guarantee that the integrity of this communication has been maintained nor that it is free from errors, virus or interference. From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: Thursday, 22 June 2017 5:48 AM To: pasig-discuss at asis.org Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 11891 bytes Desc: image001.png URL: From matthew.addis at arkivum.com Thu Jun 22 02:50:52 2017 From: matthew.addis at arkivum.com (Matthew Addis) Date: Thu, 22 Jun 2017 06:50:52 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: Hi Gail, I think this is a case of the perennial problem of how to balance cost, risk and accessibility when storing digital assets. As others have pointed out, cost includes budgeting issues, e.g. capex or opex, risk includes data security and sovereignty as well as risk of data corruption or loss, and access includes how quickly you can retrieve and use assets. It?s easy to find a solution for any two out of three of these factors, but all at once is hard - low cost, low risk and fast access. Not trusting the cloud is sensible and keeping at least one copy onsite is a practical way for many people to reduce risks and provide fast local access to their data. But it doesn?t necessarily have to be that way. The usual approach to managing risk of data loss is to have multiple copies of data in multiple geographic locations and not all with one vendor. Diversity is your friend and removing vendor dependencies and lock-in is really important. If you use multiple cloud providers or data storage facilities then it is possible to get a good balance of cost and risk without needing an onsite copy. As the trend continues towards cloud providers building in-territory data centres, the sovereignty issue is becoming less of a challenge, but of course can?t be eliminated in some cases where data security is paramount. This is all a long-winded way of saying that the question isn?t necessarily one of having an onsite copy or not, it?s one of how best to address cost, risk and access - with an onsite copy being one of the more common solutions (and often a good one), but it?s not the only one that?s viable. Indeed, in some cases where there isn?t in-house capacity to store data onsite or the capex/opex issues raise their head, then alternatives such as using multiple cloud providers can be more attractive. BTW, as a ?cloud provider? we too don?t ?trust' the cloud for all copies of the data that we store - including when we store it ourselves in our own data centres! It might sound odd, but in some respects we don?t trust ourselves let alone any single third-party cloud provider. Instead, we adopt a ?rely on nothing? type approach and we store a complete copy of our customer?s data offline with an independent escrow provider. This is an automatic and built in part of our service and not something that a customer opts into or has to remember to do. This gives our customers reassurance of no lock-in to us as a provider, but it also gives us our own fallback if there were ever to be issues with our own infrastructure or operations. Some of our customers keep an onsite copy as well as archiving their data with us - but many don?t - which is because their data is being held not just by us but by an independent third-party too. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom From: Pasig-discuss > on behalf of "gail at trumantechnologies.com" > Date: Wednesday, 21 June 2017 at 20:47 To: "pasig-discuss at asis.org" > Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From mmyers at tsl.texas.gov Thu Jun 22 09:42:03 2017 From: mmyers at tsl.texas.gov (Mark Myers) Date: Thu, 22 Jun 2017 13:42:03 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: In TX was use the cloud (Amazon Gov Cloud) as our primary storage system since that?s where our preservation system (Preservica) is built in. We also keep copies locally on external hard drives and RAIDs. We have the ?original? files as we receive them, push the files into the cloud and perform the preservation and normalization actions on them, then (eventually) copy the preservation files back down to another set of hard drives as well. The cloud also serves as our geographically dispersed redundancy. A side note, even if used the state of TX data center, they use the Azure cloud as dark storage as well. So it?s still ultimately cloud storage whether it?s managed through our preservation vendor under our direct control or through the state data center (which is actually managed and vended by Xerox). Lots Of Copies Keep Stuff Safe. Mark J. Myers Senior Electronic Records Specialist Texas State Library and Archives Commission 1201 Brazos Street Austin TX 78711-2516 Phone: 512-463-5434 mmyers at tsl.texas.gov www.tsl.texas.gov Texas Digital Archive From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of Matthew Addis Sent: Thursday, June 22, 2017 1:51 AM To: gail at trumantechnologies.com; pasig-discuss at asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, I think this is a case of the perennial problem of how to balance cost, risk and accessibility when storing digital assets. As others have pointed out, cost includes budgeting issues, e.g. capex or opex, risk includes data security and sovereignty as well as risk of data corruption or loss, and access includes how quickly you can retrieve and use assets. It?s easy to find a solution for any two out of three of these factors, but all at once is hard - low cost, low risk and fast access. Not trusting the cloud is sensible and keeping at least one copy onsite is a practical way for many people to reduce risks and provide fast local access to their data. But it doesn?t necessarily have to be that way. The usual approach to managing risk of data loss is to have multiple copies of data in multiple geographic locations and not all with one vendor. Diversity is your friend and removing vendor dependencies and lock-in is really important. If you use multiple cloud providers or data storage facilities then it is possible to get a good balance of cost and risk without needing an onsite copy. As the trend continues towards cloud providers building in-territory data centres, the sovereignty issue is becoming less of a challenge, but of course can?t be eliminated in some cases where data security is paramount. This is all a long-winded way of saying that the question isn?t necessarily one of having an onsite copy or not, it?s one of how best to address cost, risk and access - with an onsite copy being one of the more common solutions (and often a good one), but it?s not the only one that?s viable. Indeed, in some cases where there isn?t in-house capacity to store data onsite or the capex/opex issues raise their head, then alternatives such as using multiple cloud providers can be more attractive. BTW, as a ?cloud provider? we too don?t ?trust' the cloud for all copies of the data that we store - including when we store it ourselves in our own data centres! It might sound odd, but in some respects we don?t trust ourselves let alone any single third-party cloud provider. Instead, we adopt a ?rely on nothing? type approach and we store a complete copy of our customer?s data offline with an independent escrow provider. This is an automatic and built in part of our service and not something that a customer opts into or has to remember to do. This gives our customers reassurance of no lock-in to us as a provider, but it also gives us our own fallback if there were ever to be issues with our own infrastructure or operations. Some of our customers keep an onsite copy as well as archiving their data with us - but many don?t - which is because their data is being held not just by us but by an independent third-party too. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom From: Pasig-discuss > on behalf of "gail at trumantechnologies.com" > Date: Wednesday, 21 June 2017 at 20:47 To: "pasig-discuss at asis.org" > Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From a.guillermo at libnova.com Thu Jun 22 10:42:29 2017 From: a.guillermo at libnova.com (=?UTF-8?Q?Antonio_Guillermo_Mart=C3=ADnez_=28libnova=29?=) Date: Thu, 22 Jun 2017 16:42:29 +0200 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <22c28e012b0640bfa5c23221d76e41bb@mail.gmail.com> Hi Gail, We lean also for (at least) one local copy of the assets (if you can pay for it). We are not looking at the probability of the cloud operator closing unexpectedly (without time to migrate) or a massive technology problem, that we think would be unrealistic, but we are thinking about an economic problem for the owner of the assets, not being able to pay the cloud operator for the storage (Microsoft, Amazon, etc. ?if you don?t pay, data disappears almost immediately) or a security incident that affects the cloud data. Also the capex vs opex may not be an issue; today, there are companies (like LIBNOVA) offering on-premise storage as a service, with a standard massive storage devices with a very low cost per TB/year, paid as a service, totally opex. I would say that a combined approach would be the best and I would consider two scenarios: *Cloud approach,* with two copies in two providers: for instance, LIBSAFE Cloud uses Microsoft Azure as the main storage, but it is replicated over Amazon Glacier every day (from a Glacier-running instance). You could mimic this architecture easily. This way, even in the case you have a severe security problem with your main copy, the ?cloud backup? remains unaffected. We usually are recommending, when possible, for the owner of the assets to pay for the ?cloud backup? storage directly, so, even in the case the digital preservation provider collapses unexpectedly (and stops paying its ej. Azure bills), you have access to your information (as long as you continue paying for it). At least, if you are able to prepay for it, you also minimize the economic risk. *Hybrid approach,* If you can pay for it, minimizes most of the risks. Having your copies in the cloud and in your local infrastructure greatly decreases the involved risks. I would add that you need to pay attention to the synchronization method between two copies. Just replicating is not enough. We are using a home grown software (LIBNOVA Dark Storage Sync) that synchronizes copies checking hashes and takes care of retention periods in the customer storage side. A good thing of this software model is that we (from the cloud) are unable to delete or overwrite customer content (even if we want or if we have had a security incident with an attacker taking control over our infrastructure). Instead of LIBNOVA Cloud connecting to your internal storage, *your internal storage synchronizes with the cloud storage *(using a read only key). You can also easily mimic this approach in your architecture without using LIBSAFE. I have a technical paper and some diagrams that explains how this dark cloud sync works, that I can send you, if you are interested. There are also models like the one Matthew Addis (Arkivum) proposes (which I really like), with hybrid approaches and escrow services that are really worth investigating. Best regards, AG. ---- Antonio Guillermo Mart?nez Largo libnova ? Technology changes. Information prevails. www.libnova.com EMEA & LATAM: Paseo de la Castellana, 153 ? Madrid [t] +34 91 449 08 94 USA & CANADA: 14 NE First Ave (2nd Floor) - Miami, Florida 33132, USA [t]: +1 855-542-6682 *De:* Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] *En nombre de *Mark Myers *Enviado el:* Thursday, June 22, 2017 3:42 PM *Para:* Matthew Addis ; gail at trumantechnologies.com; pasig-discuss at asis.org *Asunto:* Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In TX was use the cloud (Amazon Gov Cloud) as our primary storage system since that?s where our preservation system (Preservica) is built in. We also keep copies locally on external hard drives and RAIDs. We have the ?original? files as we receive them, push the files into the cloud and perform the preservation and normalization actions on them, then (eventually) copy the preservation files back down to another set of hard drives as well. The cloud also serves as our geographically dispersed redundancy. A side note, even if used the state of TX data center, they use the Azure cloud as dark storage as well. So it?s still ultimately cloud storage whether it?s managed through our preservation vendor under our direct control or through the state data center (which is actually managed and vended by Xerox). Lots Of Copies Keep Stuff Safe. Mark J. Myers Senior Electronic Records Specialist Texas State Library and Archives Commission 1201 Brazos Street Austin TX 78711-2516 Phone: 512-463-5434 mmyers at tsl.texas.gov www.tsl.texas.gov Texas Digital Archive *From:* Pasig-discuss [mailto:pasig-discuss-bounces at asist.org ] *On Behalf Of *Matthew Addis *Sent:* Thursday, June 22, 2017 1:51 AM *To:* gail at trumantechnologies.com; pasig-discuss at asis.org *Subject:* Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, I think this is a case of the perennial problem of how to balance cost, risk and accessibility when storing digital assets. As others have pointed out, cost includes budgeting issues, e.g. capex or opex, risk includes data security and sovereignty as well as risk of data corruption or loss, and access includes how quickly you can retrieve and use assets. It?s easy to find a solution for any two out of three of these factors, but all at once is hard - low cost, low risk and fast access. Not trusting the cloud is sensible and keeping at least one copy onsite is a practical way for many people to reduce risks and provide fast local access to their data. But it doesn?t necessarily have to be that way. The usual approach to managing risk of data loss is to have multiple copies of data in multiple geographic locations and not all with one vendor. Diversity is your friend and removing vendor dependencies and lock-in is really important. If you use multiple cloud providers or data storage facilities then it is possible to get a good balance of cost and risk without needing an onsite copy. As the trend continues towards cloud providers building in-territory data centres, the sovereignty issue is becoming less of a challenge, but of course can?t be eliminated in some cases where data security is paramount. This is all a long-winded way of saying that the question isn?t necessarily one of having an onsite copy or not, it?s one of how best to address cost, risk and access - with an onsite copy being one of the more common solutions (and often a good one), but it?s not the only one that?s viable. Indeed, in some cases where there isn?t in-house capacity to store data onsite or the capex/opex issues raise their head, then alternatives such as using multiple cloud providers can be more attractive. BTW, as a ?cloud provider? we too don?t ?trust' the cloud for all copies of the data that we store - including when we store it ourselves in our own data centres! It might sound odd, but in some respects we don?t trust ourselves let alone any single third-party cloud provider. Instead, we adopt a ?rely on nothing? type approach and we store a complete copy of our customer?s data offline with an independent escrow provider. This is an automatic and built in part of our service and not something that a customer opts into or has to remember to do. This gives our customers reassurance of no lock-in to us as a provider, but it also gives us our own fallback if there were ever to be issues with our own infrastructure or operations. Some of our customers keep an onsite copy as well as archiving their data with us - but many don?t - which is because their data is being held not just by us but by an independent third-party too. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom *From: *Pasig-discuss on behalf of " gail at trumantechnologies.com" *Date: *Wednesday, 21 June 2017 at 20:47 *To: *"pasig-discuss at asis.org" *Subject: *[Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists *Protecting the world's digital heritage for future generations* www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From gail at trumantechnologies.com Thu Jun 22 17:50:07 2017 From: gail at trumantechnologies.com (gail at trumantechnologies.com) Date: Thu, 22 Jun 2017 14:50:07 -0700 Subject: [Pasig-discuss] =?utf-8?q?Arguments_for_keeping_an_onsite_copy_of?= =?utf-8?q?_digitally_preserved/stored_digital_content=3F?= Message-ID: <20170622145007.b554e26909f2beaf9f8ddbf6be9a6600.fefe8ee549.wbe@email09.godaddy.com> An HTML attachment was scrubbed... URL: From surface at oclc.org Thu Jun 22 08:30:47 2017 From: surface at oclc.org (Surface,Taylor) Date: Thu, 22 Jun 2017 12:30:47 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> Message-ID: <54C7A414-B197-4785-9D4A-C263CB54C3E0@oclc.org> We?ve been a cloud provider of digital preservation since 2001 with multiple copies stored in disparate systems and geographic locations. Through the years our users have opted to keep an onsite copy in some cases. The reasons vary by the specific situation of the organization and go to weighing the trade-offs of cost, risk, access, and IT expertise. A cloud-only user typically has the capability for preservation policy-making and operations. An onsite copy user typically has those capabilities and access or trust of in-house IT. Best, -- Taylor -- Taylor Surface OCLC ? Senior Product Manager 6565 Kilgour Place, Dublin, OH United States 43017 T +1-614-761-5145 From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of gail at trumantechnologies.com Sent: Wednesday, June 21, 2017 3:48 PM To: pasig-discuss at asis.org Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonathan.tilbury at preservica.com Fri Jun 23 04:25:18 2017 From: jonathan.tilbury at preservica.com (Jonathan Tilbury) Date: Fri, 23 Jun 2017 08:25:18 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <54C7A414-B197-4785-9D4A-C263CB54C3E0@oclc.org> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <54C7A414-B197-4785-9D4A-C263CB54C3E0@oclc.org> Message-ID: I agree with Gail, it has been very interesting hearing about everyone?s approach to keeping lots of copies locally and in different clouds. There is lots of good practice out there and I think good consensus on keeping things in different places with different vendors. All of this has been discussed from the perspective of permanent retention. The bigger data volumes requiring digital preservation are long term temporary which need deleting at the end of life. Also, some customers get take down requests and need to delete material from the collection in a controlled but prompt manner. With Preservica we try to balance these two conflicting pressures (long term secure preservation vs quick delete) with various approval cycles, recoverable delete for a defined period and control of backups. How do the architectures others have suggested cope with this balance? Jon Jonathan Tilbury Chief Technology Officer Preservica 32 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From matthew.addis at arkivum.com Fri Jun 23 04:40:38 2017 From: matthew.addis at arkivum.com (Matthew Addis) Date: Fri, 23 Jun 2017 08:40:38 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <54C7A414-B197-4785-9D4A-C263CB54C3E0@oclc.org> Message-ID: Hi jon, We do likewise with a range of approaches from fast crypto-delete through to certified physical media destruction, data lifecycle management with various levels of delete control from automated delete based on policies through to two-way authenticated change requests via our operations team. It all varies depending on what regulations and policies are in play. This aspect of managing long-term archives is starting to get a lot of attention at the moment not least because GDPR is less than a year away and people are finally starting to think about what?s required, including a subject's right to deletion as well as access. What?s also interesting to see is a trend towards auditable archives so organisations can prove that they have what they should as well as prove they haven?t retained what they shouldn?t. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom From: Pasig-discuss > on behalf of Jonathan Tilbury > Date: Friday, 23 June 2017 at 09:25 To: "pasig-discuss at asis.org" > Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? I agree with Gail, it has been very interesting hearing about everyone?s approach to keeping lots of copies locally and in different clouds. There is lots of good practice out there and I think good consensus on keeping things in different places with different vendors. All of this has been discussed from the perspective of permanent retention. The bigger data volumes requiring digital preservation are long term temporary which need deleting at the end of life. Also, some customers get take down requests and need to delete material from the collection in a controlled but prompt manner. With Preservica we try to balance these two conflicting pressures (long term secure preservation vs quick delete) with various approval cycles, recoverable delete for a defined period and control of backups. How do the architectures others have suggested cope with this balance? Jon Jonathan Tilbury Chief Technology Officer Preservica 32 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From matthew.addis at arkivum.com Fri Jun 23 05:04:36 2017 From: matthew.addis at arkivum.com (Matthew Addis) Date: Fri, 23 Jun 2017 09:04:36 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: <22c28e012b0640bfa5c23221d76e41bb@mail.gmail.com> References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <22c28e012b0640bfa5c23221d76e41bb@mail.gmail.com> Message-ID: +1 from me on worrying about what happens to data in the cloud if payments aren?t maintained. Something to look for in the contract! Reminds me of the SDSC storage service - I looked at their T&Cs a few years back and they had/have a graceful model (Arkivum provides something similar). For the first X months of payment being overdue, you still have full access to the service, including read/write of data. For the next X months of payment being overdue, you still have read access to your data, but you can?t add any new data. For the next X months of payment being overdue, you are blocked from accessing the data, but it?s still retained in case you want to restart using the service. This gives a graceful way to deal with budget issues that a customer might have - nothing that anything measured in months is still a relatively short period of times in preservation/archiving terms. More widely, this also raises the issue of other ways to deal with sustaining payment that perhaps doesn?t get enough attention, e.g. endowment/annuity, ring fenced money that drip feeds PAYG, paid-up data escrow as contingency etc. In other walks of life there are strategies to deal with non-payment risks, e.g. think about payment protection insurance, mortgages, annuities etc. I?d be very interested to know whether archives use any of these strategies when dealing with the risks of not being able to sustain payments on cloud services or anything else for that matter. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom From: "Antonio Guillermo Mart?nez (libnova)" > Date: Thursday, 22 June 2017 at 15:42 To: Mark Myers >, Matthew Addis >, "gail at trumantechnologies.com" >, "pasig-discuss at asis.org" > Subject: RE: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, We lean also for (at least) one local copy of the assets (if you can pay for it). We are not looking at the probability of the cloud operator closing unexpectedly (without time to migrate) or a massive technology problem, that we think would be unrealistic, but we are thinking about an economic problem for the owner of the assets, not being able to pay the cloud operator for the storage (Microsoft, Amazon, etc. ?if you don?t pay, data disappears almost immediately) or a security incident that affects the cloud data. Also the capex vs opex may not be an issue; today, there are companies (like LIBNOVA) offering on-premise storage as a service, with a standard massive storage devices with a very low cost per TB/year, paid as a service, totally opex. I would say that a combined approach would be the best and I would consider two scenarios: Cloud approach, with two copies in two providers: for instance, LIBSAFE Cloud uses Microsoft Azure as the main storage, but it is replicated over Amazon Glacier every day (from a Glacier-running instance). You could mimic this architecture easily. This way, even in the case you have a severe security problem with your main copy, the ?cloud backup? remains unaffected. We usually are recommending, when possible, for the owner of the assets to pay for the ?cloud backup? storage directly, so, even in the case the digital preservation provider collapses unexpectedly (and stops paying its ej. Azure bills), you have access to your information (as long as you continue paying for it). At least, if you are able to prepay for it, you also minimize the economic risk. Hybrid approach, If you can pay for it, minimizes most of the risks. Having your copies in the cloud and in your local infrastructure greatly decreases the involved risks. I would add that you need to pay attention to the synchronization method between two copies. Just replicating is not enough. We are using a home grown software (LIBNOVA Dark Storage Sync) that synchronizes copies checking hashes and takes care of retention periods in the customer storage side. A good thing of this software model is that we (from the cloud) are unable to delete or overwrite customer content (even if we want or if we have had a security incident with an attacker taking control over our infrastructure). Instead of LIBNOVA Cloud connecting to your internal storage, your internal storage synchronizes with the cloud storage (using a read only key). You can also easily mimic this approach in your architecture without using LIBSAFE. I have a technical paper and some diagrams that explains how this dark cloud sync works, that I can send you, if you are interested. There are also models like the one Matthew Addis (Arkivum) proposes (which I really like), with hybrid approaches and escrow services that are really worth investigating. Best regards, AG. ---- Antonio Guillermo Mart?nez Largo libnova ? Technology changes. Information prevails. www.libnova.com EMEA & LATAM: Paseo de la Castellana, 153 ? Madrid [t] +34 91 449 08 94 USA & CANADA: 14 NE First Ave (2nd Floor) - Miami, Florida 33132, USA [t]: +1 855-542-6682 De: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] En nombre de Mark Myers Enviado el: Thursday, June 22, 2017 3:42 PM Para: Matthew Addis >; gail at trumantechnologies.com; pasig-discuss at asis.org Asunto: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In TX was use the cloud (Amazon Gov Cloud) as our primary storage system since that?s where our preservation system (Preservica) is built in. We also keep copies locally on external hard drives and RAIDs. We have the ?original? files as we receive them, push the files into the cloud and perform the preservation and normalization actions on them, then (eventually) copy the preservation files back down to another set of hard drives as well. The cloud also serves as our geographically dispersed redundancy. A side note, even if used the state of TX data center, they use the Azure cloud as dark storage as well. So it?s still ultimately cloud storage whether it?s managed through our preservation vendor under our direct control or through the state data center (which is actually managed and vended by Xerox). Lots Of Copies Keep Stuff Safe. Mark J. Myers Senior Electronic Records Specialist Texas State Library and Archives Commission 1201 Brazos Street Austin TX 78711-2516 Phone: 512-463-5434 mmyers at tsl.texas.gov www.tsl.texas.gov Texas Digital Archive From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of Matthew Addis Sent: Thursday, June 22, 2017 1:51 AM To: gail at trumantechnologies.com; pasig-discuss at asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Hi Gail, I think this is a case of the perennial problem of how to balance cost, risk and accessibility when storing digital assets. As others have pointed out, cost includes budgeting issues, e.g. capex or opex, risk includes data security and sovereignty as well as risk of data corruption or loss, and access includes how quickly you can retrieve and use assets. It?s easy to find a solution for any two out of three of these factors, but all at once is hard - low cost, low risk and fast access. Not trusting the cloud is sensible and keeping at least one copy onsite is a practical way for many people to reduce risks and provide fast local access to their data. But it doesn?t necessarily have to be that way. The usual approach to managing risk of data loss is to have multiple copies of data in multiple geographic locations and not all with one vendor. Diversity is your friend and removing vendor dependencies and lock-in is really important. If you use multiple cloud providers or data storage facilities then it is possible to get a good balance of cost and risk without needing an onsite copy. As the trend continues towards cloud providers building in-territory data centres, the sovereignty issue is becoming less of a challenge, but of course can?t be eliminated in some cases where data security is paramount. This is all a long-winded way of saying that the question isn?t necessarily one of having an onsite copy or not, it?s one of how best to address cost, risk and access - with an onsite copy being one of the more common solutions (and often a good one), but it?s not the only one that?s viable. Indeed, in some cases where there isn?t in-house capacity to store data onsite or the capex/opex issues raise their head, then alternatives such as using multiple cloud providers can be more attractive. BTW, as a ?cloud provider? we too don?t ?trust' the cloud for all copies of the data that we store - including when we store it ourselves in our own data centres! It might sound odd, but in some respects we don?t trust ourselves let alone any single third-party cloud provider. Instead, we adopt a ?rely on nothing? type approach and we store a complete copy of our customer?s data offline with an independent escrow provider. This is an automatic and built in part of our service and not something that a customer opts into or has to remember to do. This gives our customers reassurance of no lock-in to us as a provider, but it also gives us our own fallback if there were ever to be issues with our own infrastructure or operations. Some of our customers keep an onsite copy as well as archiving their data with us - but many don?t - which is because their data is being held not just by us but by an independent third-party too. Cheers, Matthew Matthew Addis Chief Technology Officer tel: +44 1249 405060 mob: +44 7703 393374 email: matthew.addis at arkivum.com web: www.arkivum.com twitter: @arkivum This message is confidential unless otherwise stated. Arkivum Limited is registered in England and Wales, company number 7530353. Registered Office: 24 Cornhill, London, EC3V 3ND, United Kingdom From: Pasig-discuss > on behalf of "gail at trumantechnologies.com" > Date: Wednesday, 21 June 2017 at 20:47 To: "pasig-discuss at asis.org" > Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? Experts, please share your thoughts. Are your institutions ready to "trust" the cloud for all copies of data, or is there still an argument for an onsite copy? I usually lean to keeping one onsite copy, but am I stuck in an old paradigm? From earlier PASIG thread (started by Tim) it's clear other institutions are keeping at least one copy on site. But how do you defend this decision? Gail Gail Truman Truman Technologies, LLC Certified Digital Archives Specialist, Society of American Archivists Protecting the world's digital heritage for future generations www.trumantechnologies.com facebook/TrumanTechnologies https://www.linkedin.com/in/gtruman +1 510 502 6497 -------------- next part -------------- An HTML attachment was scrubbed... URL: From cmmorris at duraspace.org Fri Jun 23 07:31:15 2017 From: cmmorris at duraspace.org (Carol Minton Morris) Date: Fri, 23 Jun 2017 07:31:15 -0400 Subject: [Pasig-discuss] =?utf-8?q?THE_Research_Networking_Event=E2=80=932?= =?utf-8?q?017_VIVO_Conference?= Message-ID: *From the community organizers of the 2017 VIVO Conference* June 23, 2017 Read it online: http://bit.ly/2tyRbBq *THE Research Networking Event?Register for the 2017 VIVO Conference by June 30 and SAVE $100* The 2017 VIVO Conference is all about research networking. If this topic, and creating an integrated record of the scholarly work of your organization is of interest then the 2017 VIVO Conference is the place to be Aug 2-4 in New York City. Institutions with production VIVOs as well as those who are considering VIVO will be in attendance, present their work, and/or offer workshops. Workshops are included in registration price, AND you will save $100 by taking advantage of the advance registration price of $275 until June 30. Conference registration will increase to $375 after June 30. More information is online at the conference web site: http://vivoconference.org. Here?s what else is included: keynotes , invited speakers , contributed presentations , posters, round tables, vendors, and an opportunity to get to know VIVO experts. Plan to join us at VIVO 2017, hosted by Weill Cornell Medical College, 1300 York Street, New York, New York. New York City is easy to get to, there are lots of places to stay, and many things to do and see. Room discounts are available from the Bentley Hotel nearby?*hope to see you there!* -- Carol Minton Morris Communications and Marketing Director DuraSpace duraspace.org 607 592-3135 <(607)%20592-3135> -------------- next part -------------- An HTML attachment was scrubbed... URL: From mmyers at tsl.texas.gov Fri Jun 23 09:49:30 2017 From: mmyers at tsl.texas.gov (Mark Myers) Date: Fri, 23 Jun 2017 13:49:30 +0000 Subject: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? In-Reply-To: References: <20170621124738.b554e26909f2beaf9f8ddbf6be9a6600.b22a56e39e.wbe@email09.godaddy.com> <54C7A414-B197-4785-9D4A-C263CB54C3E0@oclc.org> Message-ID: Jon As you know, ? we use the delete feature as part of our regular processing workflow for file management. We technically aren?t deleting files from the repository as much as we are moving files around and deleting redundant copies, or empty container. We typically upload packages into an ?In Process? collection and then move sub-collections and DU?s (Deliverable Units for those not familiar with Preservica parlance) into other collections, then delete the empty container files. On even rarer occasions, we have to make mass updates to existing metadata for files and DU?s, and it?s easier to upload new objects (with the new metadata) and delete then old ones. We are very rarely actually removing files from the system, just changing what?s already there in some way. As for long-term temporary records, this is a major issue. In TX we don?t put non-permanent records into our Preservation system, but still have to advise agencies on what to do with long-term (10+ year records) they are forced to maintain. I know that other state archives struggle with this as well. I think the biggest hurdle (from a state government archive perspective) is more administrative ? it deals with issues of custody, access, and legal responsibility, and financing. I know several states have looked, and are looking, into digital records centers but it?s mostly the legal issues (records management, custody, access and control issues, etc.) that seem to be the impediment. For most state governments, legal custody and responsibility of permanent records are transferred to the archive with the records. We (the archive) owns them and become responsible for them. These records rarely change, allowing for normalization and migration. (the changes I mentioned previously concern metadata, not the object) And access is relatively simple ? either they are open or closed. For temporary records (even those with retention periods in the decades) they are still the legal responsibility of the creating agency. Many states operate records warehouses for long-term temporary records, but these are usually attached to some kind of fee-for-service pay structure, and legal responsibility doesn?t transfer. Access is another big issue. Records in the archives are generally more open to a broader audience, but the long-temporary records tend to have more restrictions, and differing restrictions than just being open or closed (may only be open to specific groups, or have differing levels of access). Also the whole idea of check-in/check-out, again, generally if there is an access request for records in long-term storage, that goes through the creating agency not the holder of records. And some records may still be active, or become active again after a long pause, in which case the items in the repository may change (which is something that happens very rarely with archival records.) All this provides more headache to having to administrate that type of system. Mark J. Myers Senior Electronic Records Specialist Texas State Library and Archives Commission 1201 Brazos Street Austin TX 78711-2516 Phone: 512-463-5434 mmyers at tsl.texas.gov www.tsl.texas.gov Texas Digital Archive From: Pasig-discuss [mailto:pasig-discuss-bounces at asist.org] On Behalf Of Jonathan Tilbury Sent: Friday, June 23, 2017 3:25 AM To: pasig-discuss at asis.org Subject: Re: [Pasig-discuss] Arguments for keeping an onsite copy of digitally preserved/stored digital content? I agree with Gail, it has been very interesting hearing about everyone?s approach to keeping lots of copies locally and in different clouds. There is lots of good practice out there and I think good consensus on keeping things in different places with different vendors. All of this has been discussed from the perspective of permanent retention. The bigger data volumes requiring digital preservation are long term temporary which need deleting at the end of life. Also, some customers get take down requests and need to delete material from the collection in a controlled but prompt manner. With Preservica we try to balance these two conflicting pressures (long term secure preservation vs quick delete) with various approval cycles, recoverable delete for a defined period and control of backups. How do the architectures others have suggested cope with this balance? Jon Jonathan Tilbury Chief Technology Officer Preservica 32 The Quadrant, Abingdon Science Park, Abingdon, Oxfordshire, OX14 3YS T: +44(0)1235 428949 M: +44(0)7808 950580 E: jonathan.tilbury at preservica.com W: www.preservica.com TW: @dPreservation [PreservicaLogo] This message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Preservica e-mail system may be monitored and stored in an information retrieval system. Please consider the environment and do not print this e-mail unless you really need to. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 7903 bytes Desc: image001.png URL: From gail at trumantechnologies.com Fri Jun 23 11:59:16 2017 From: gail at trumantechnologies.com (gail at trumantechnologies.com) Date: Fri, 23 Jun 2017 08:59:16 -0700 Subject: [Pasig-discuss] =?utf-8?q?Costs_of_Eprints=2C_Dspace=2C_Fedora/Hy?= =?utf-8?q?dra_IRs=3F?= Message-ID: <20170623085916.b554e26909f2beaf9f8ddbf6be9a6600.6ecd1bc653.wbe@email09.godaddy.com> An HTML attachment was scrubbed... URL: From cmmorris at duraspace.org Mon Jun 26 15:07:57 2017 From: cmmorris at duraspace.org (Carol Minton Morris) Date: Mon, 26 Jun 2017 15:07:57 -0400 Subject: [Pasig-discuss] NEW: Expanded Language Support in Hyku Message-ID: *From the Hyku team?The Digital Public Library of America , Stanford University , and DuraSpace * June 26, 2017 Read it online: http://bit.ly/2rUCdUM Contact: hyku-contact at googlegroups.com *Expanded Language Support in Hyku* It?s the week of Open Repositories 2017 , the annual international conference for delegates from research libraries and other institutions around the globe to meet up (this year in lovely Bribane, Australia), and share their latest challenges and advances. We can?t think of a better time to highlight Hyku?s support for a growing number of languages in the application UI. We are up to seven! With English as the starting point, we added Spanish, and soon thereafter Chinese, with the generous contributions of translations provided by native speakers in the Samvera community. Then we got a tip about i18n-tasks . This Ruby gem identifies any missing terms from languages specified in an application?s locale configuration file and then fills in the gaps with values obtained from Google Translate. This simple process makes it amazingly easy to add support for multiple languages. With this enhancement to Hyku, it is now possible to also read the UI in German, French, Italian, and Portuguese. The results have been pretty accurate, though on occasion the Google Translate results are a little off, not perfectly reflecting the nuance of meaning in certain UI terms (e.g., ?home? page is a starting point, not where the ?house? is located :), so a pass for quality control is necessary. We are grateful to those members of our community who have pitched in with corrections as they came across instances of mistranslation. (Keep them coming!) Expanded language support is fundamental for any repository service today that aims to serve a global audience of users. With the power of web services like Google Translate, language barriers can dissolve! -- Carol Minton Morris Communications and Marketing Director DuraSpace duraspace.org 607 592-3135 <(607)%20592-3135> -------------- next part -------------- An HTML attachment was scrubbed... URL: From Benson.Steven2 at mayo.edu Mon Jun 26 15:18:43 2017 From: Benson.Steven2 at mayo.edu (Benson, Steven J. (Steve)) Date: Mon, 26 Jun 2017 19:18:43 +0000 Subject: [Pasig-discuss] unsubscribe Message-ID: <9153c6$775bvb@ironport10.mayo.edu> unsubscribe -------------- next part -------------- An HTML attachment was scrubbed... URL: