Migrating data without original checksums
The National Library (NLN) has been using SAM-FS (Oracle HSM) as a bit-repository since 2007. SAM-FS is soon reaching "EOL". The NLN has recently developed a front-end software solution called DPS (Digital Preservation Services). DPS uses HPSS from IBM as underlying bit-repository. DPS/HPSS is intended to replace SAM-FS as the preservation solution for digital objects. DPS requires that all objects must be delivered with associated checksums. In the old SAM-FS bit-repository, many objects lack checksums, especially material from the first years of its use. All objects in SAM-FS are stored in 3 instances. If differences were to be uncovered between the 3 instances, there are no checksums to verify which instance is correct. The total amount of data to be migrated from SAM-FS to DPS is approximately 14 Petabytes. It is estimated that about 1/3 of these data lacks checksums. Challenge: How could we ensure that objects migrated from SAM-FS to DPS are the same as those originally archived in SAM-FS when original checksums do not exist?
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2024-09-19
- DOI
- https://doi.org/10.5281/zenodo.13681582
- Primary Topic
- Digital and Traditional Archives Management
- Type
- article
- Field-Weighted Citation Impact
- 0.00