Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands @overholt Yup, I’ve been a “Digital Archivist” for 30 years, personally and professionally. Only the process will save you. All media fails.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands IMHO i think of preserval as a biological thing: if it doesn’t get reproduced, it dies. people think because it’s digital it’s like etching it in stone when it’s far from that
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands agreed.
The question is what happens when we won't be able to afford renewing the medium. Who gets to choose what to keep and what to loose? -
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands Kodachrome is eternal.
-
@inthehands an example of how brittle this process is:
Most of Google Video is essentially gone forever. So is most of MySpace and countless irreplaceable songs. The main reason being that those interested in preserving it and those with the ability to preserve it just… did not intersect, which is the fate that usually happens to most data. Usenet’s archives are also very incomplete.
a large amount of British TV aimed at teens/young adults, especially that which contained the slightest bit of "pop music" from *1990s/00s* is likely permanently gone.
Not for lack of archiving technology (it was around in 1990s, including digital video storage by late 90s, but because there was so much arguing over over copyright that archives have been allowed to deteriorate or even deliberately bulk erased to prevent them falling into "the wrong hands" ( TV companies would rather destroy it than risk a lawsuit because hoarded master tapes ended up on YouTube)
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
Quote from #SciAm article on this topic back in the 1990s/early 2000s...
"Digital information lasts forever--or five years, whichever comes first." - Jeff Rothenberg
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands @darius smiling placidly in agreement and screaming internally as I remember yet again the 2 SyQuest 40MB bernoulli discs sitting in my garage
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands For audio, wax cylinders and gramophone records (and vinyl) have outlived all other media and look set to do so for centuries to come. Libraries and archives have tons of media that is essentially unplayable without the appropriate defunct hardware.
-
a large amount of British TV aimed at teens/young adults, especially that which contained the slightest bit of "pop music" from *1990s/00s* is likely permanently gone.
Not for lack of archiving technology (it was around in 1990s, including digital video storage by late 90s, but because there was so much arguing over over copyright that archives have been allowed to deteriorate or even deliberately bulk erased to prevent them falling into "the wrong hands" ( TV companies would rather destroy it than risk a lawsuit because hoarded master tapes ended up on YouTube)
@vfrmedia @inthehands You often can't find copies of shows even into the 00's because of this. And also pretty much all early-streaming stuff is gone with no copies (never recorded, not many people *could* due to space, and DRM actively prevented it at the time). Same with a lot of early-Internet video. A lot of early YouTube is also gone.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
We need the equivalent of stone tablets.
3D-printing using ECCs onto some kind of ceramic alloy that's super hard and super temperature resistant. -
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands
There were some real research systems looking into this, and it makes me incredibly sad that they basically have all stopped because it's not immediately profitable.Living archives are always the functional solution, but it should still be something people work on!
The concept of immutable records should at least be appealing....
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands that's effectively the same advice I naively gave to my SiL back when she was in library school -- keep it online, and copy it forward.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands We are still digging up ancient Sumerian receipts stored in cuneiform on baked clay.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
Buddhist non-attachment to old files is a pretty good strategy I find.
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands I’m no fan of theirs, but I heard recently about Microsoft’s Project Silica and found it a genuinely fascinating idea: https://www.microsoft.com/en-us/research/project/project-silica/
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
@inthehands less technology, more librarians and archivists
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
* [ see note ]
yes, I figured this out in 1990, which is why every 5 years or so I buy a bigger hard drive, which costs less, and just copy everything to the new hard drive
works for me
not elegant or very user friendly, but it is just me*getting shoulder strain patting myself on the back
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
All storage media are volatile. Some media are just more volatile than others.
-
My current solution on my desktop is a btrfs partition with a bunch of random drives and a nightly job that rebalances the data across them if it needs to be (time boxed to 1 hour per night, restarts the night after it ends)
Its not quite zero touch but it does mean that if I replace a drive then it will slowly get redundant copies of data over the next few nights. The big failure mode is that it is not resistant to multiple drives failing before the first one is rebalanced
@gbargoud @inthehands But isn't the fact that it's in your home another potential failure mode? A house fire can undo all your careful rebalancing in an hour. (Of course, you don't mention offsite storage; you could have a copy at your sister's or something.)
-
RE: https://glammr.us/@overholt/117049333496122205
Back in 1999 or so, I was on the team that helped Minnesota Public Radio choose a long-term storage format for their (extensive and valuable!!) audio archives, which they were about to digitize.
The conclusion we came to was that there was •no• storage medium that met their long-term preservation goals — true then, and almost certainly still true today. The best approach is perpetual and redundant forward copying of the data, from one physical storage device to another.
An archive isn’t a physical thing; it's a process.
I did the same for the Alberta Provincial Archives.
Same conclusion.
Most of their material was on microfilm, which was beginning to perish. Early 1980s.
