Home

DPR User Manual v1.5

1. ALL v Filter by status ALL b Exclude exported jobs Transfer Job Number gt scd Generate DPR reports This action is disabled when processing a job Transpor Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itcl a 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 A 2009 20000003 Export File Generated 25 03 2009 dpr Itcl 2009 20000004 Export File Generated 25 03 2009 dpr Itcl 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr l1 24 04 2009 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Restarted in QF 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 E Register a New Transfer Job in DPR Z Process Selected Job 3 Select the subject or subjects for the repor
2. Select Transfer Job to Process Filter by user ALL w Filter by status ALL v Exclude exported jobs Transfer Job Number gt Status Date Created Created By Transport Device Due Out of Quarantine Pre Quarantine Processin 27 03 dpr 11 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from m 5 dpr 11 2009 20000014 initialised from m View data ian Icl 2009 20000015 initialised from m ian Icl 2009 20000016 Export File Gener ZUJUU ZUUS ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 2009 20000030 Restarted in QF 07 05 2009 ian 2009 20000031 Restarted in QF 08 05 2009 ian Ic3 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000033 Export File Generated 08 05 2009 ian Ic3 2009 20000034 Restarted in QF 11 05 2009 dpr E Register a New Transfer Job in DPR Z Process Selected Job DPR User Manual v1 5 odt Page 80 of 106 4 Click Delete Transfer Job button S lt Digital
3. Actions Users Reports Settings Help Transfer Job 2009 20000031 Job Status Normalising complete Processing Status Paused Set Up Preservation Carrier for Transfer Job Creates the directory structure on the preservation output carrier Handle Stopped Transfer Job in PF Handling stopped transfer job Y PF Checksum Validation Beginning processing of step PF Checksum Validation 1 data object checksums successfully validated Set Up Preservation Carrier for Transfer Job Creates the directory structure on the preservation output carrier WW 11 5 Return for Reprocessing If the output from the previous facility is found to be incorrectly processed the transfer job can be halted in the current facility and sent back to be processed again This can be done during processing in PF or DR 1 Click Stop Job button Actions Users Reports Settings Help Transfer Job 2012 25363256 er TET Job Status i iy Error Processing Job we WS Processing Status The following errors occurred when processing the Copy To Digital Repository Copy To Digital F vou have the following options Copy the AIPs to th Stop the current step it can then be restarted E Stop processing the job Copying AIP 20120528 Operation Error Reason Input File Name AIP Name Stored Checksum Algorithm Check on Carrier java io FileNotFo homej toneill i
4. Reason for Reprocessing Output Location Preview is audio mp3 2 is audio flac 2 Audio normalisation testing Enter Carrier Location media X126 Carrier X126 A Browse Preview Copy AIP 4 Q Create Reprocessing Job b The reprocessing job has been created 10 Disconnect the carrier device from the network E Back To Job Selector The reprocessing job can now be imported into PF and processed in the same way that a normal transfer job is processed see section 5 Preservation DPR User Manual v1 5 odt Page 53 of 106 7 4 Copy for Access To retrieve AIPs from the repository 1 Log on to DPR at the DR workstation see section 2 Log On 2 Click the Perform DR Tasks button 3 Click the Show Copy for Access Panel button Actions Users Reports Settings Help Digital Repository Tasks Perform Reprocessing of AIPs O Reprocessing J Copy For Access I l Retrieve and View Data Change Item Numbers j Change Item Numbers Copy AIFs for Access View Data Model Back To Job Selector 4 Click the Enter Barcodes button Actions Users Reports Settings Help Copy Items for Access Enter Barcodes C Include the Binary AIPs Copy All AIPs Item Number Transfer Job Number Data Object File Na AIP Id AIP Ty Prinar AIP Sta Create Manifest File Include
5. Transfer Job Number gt Te Qn0n000 Export File Generated 23 03 2009 dpr Itc 1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Icl 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 d Register a New Transfer Job in DPR d Process Selected Job 3 2 4 Selecting a Transfer Job To select a transfer job for processing or to view the process details either e Click on the transfer job in
6. qp Import Job CT rerom 08 Tas B Process Selected Job 3 The Digital Repository Task window is displayed Reprocessing from the Archive Actions Users Reports Settings Help Digital Repository Tasks Perform Reprocessing of AIFs Reprocessing Copy AIPs for Access EA Copy For Access View Data Model Fay Retrieve and View Data Change Item Numbers Jf Change Item Numbers ad Back To Job Selector 7 3 Reprocessing from the Archive To create a reprocessing job 1 Connect a carrier device to the DR workstation 2 Log on to DPR see section 2 Log On 3 Click the Perform DR Tasks button 4 Click the Reprocessing button DPR User Manual v1 5 odt Page 49 of 106 Actions Users Reports Settings Help Digital Repository Tasks eee a SN n Copy For Access Perform Reprocessing of AIP Copy AIPs for Access View Data Model Fe Retrieve and View Data Change Item Numbers i Change Item Numbers amp Back To Job Selector 5 Define Selection Criteria A reprocessing job consists of a group of related data objects that need to go through the preservation process again To extract the data objects you need and add them to the reprocessing job you define one or more search criteria Each of the criteria is constructed from three components chosen from drop lists For example where AIP status is for replacement The first drop down list sets the main search c
7. via x Actions Users Reports Settings Help Select Transfer Job to Process Fiter by user Filter by status ALL E Transfer Job Number Status 7 Date Created Created By Transport Device Due Out of Quarantine 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 2000002 4 Initialised from manifest 07 05 2009 ian Ic3 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 2009 2000003 1 Pre Quarantine Processing Passed 08 05 2009 ian Ic3 05 06 2009 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr Dy Register a New Transfer Job in DPR d Process Selected Job DPR User Manual v1 5 odt Page 17 of 106 3 2 3 Sorting the Display Clicking the title bar of a column will sort the display in terms of the contents of that column Digital Preservation Recorder 4 0a 1006 Quarantine dpr v x Actions Users Reports Settings Help Sele ansfer Job to Process b Status Filter by user Filter by status ALL v Exclude exported jobs Date Created j Created By Transport Device Due Out of Quarantine
8. Criterion Description with no normalised AIP Where data objects were binary normalised only where normalisation failed Where data objects were identified but there was a normalisation error where normalisation type is Drop down list includes all available MIME types where data object name is Enter name of data object DPR User Manual v1 5 odt Page 38 of 106 3 Click the Update Table button to display the data objects in the transfer job Advanced Normalisation Options 3 Tools r Criteria Retrieve all data objects where normalisation failed Update Table Data Object Media ID File Extension Normaliser Normalised Output FileName Error Error Reason Select All ss s we C oro ed d Set Type Normalise Selected Normalise All Goss 4 Select each data object from the table 5 Click the Set Type button Advanced Normalisation Options x Tools Criteria Retrieve all data objects where normalisation failed Update Table Data Object Media ID File Extension Normaliser Normalised Output FileName Error Error Reason Select All m GIF Trick 1 zog 1 zog Type not recor hcmort wks 1 wks Type not recor trim x154 mbx 1 mbx Type not recor O xena test pst T pst Type not recor O O ss s eue i i ed ond eec ome man
9. Data Object File Name Media ID Transfer Job Item Number sack To Job Selector Back To Job Selector 3 Enter Transfer Job Number 4 Click the Retrieve button Digital Preservation Recorder 4 0a 1006 Digital Repository ian v x Actions Users Reports Settings Help Data Object Archival Information Package Transfer Job Reprocessing Job Y Retrieve Transfer Job Information Enter Transfer Job 2009 20000010 gt Results Job Number Status 2009 20000010 DR Processing Complete Back To Job Selector DPR User Manual v1 5 odt Page 62 of 106 The Transfer Job Information window is displayed Transfer Job Information y Transfer Job Information Transfer Job Number 2009 20000010 Date Created 2009 04 02 09 31 41 433 Created By dpr Number of Data Objects 177 Current Status DR Pracessing Complete Transtgs Iedi Racp ds pr OO O 0 m 2 ESI QF Records PF Records DR Records ee From the Transfer Job Information window you can do the following to view QF processing data click QF Records button to view PF processing data click PF Records button to view DR processing data click DR Records button 7 5 5 Reprocessing Job To retrieve preservation audit information on a reprocessing job 7 6 Change Item Numbers To change Item numbers 1 Log on to DPR 2 Click the perform DPR t
10. PF DR Carrier Import Transfer Job 3 Copy to Archive DPR User Manual v1 5 odt Page 12 of 106 1 5 Reporting Each DPR facility QF PF and DR can produce reports on transfer jobs that have been processed by that facility Reports can be made on transfer jobs by status user and time as well as some facility specific reports such as the Rejected Transfer Jobs report in QF 1 6 Metadata The DPR records metadata at several levels activity audit trail information for transfer jobs individual data object information individual AIP information Each DPR facility QF PF and DR records audit information for the processing done in that facility and also holds the data imported from the previous facilities The complete set of processing data is available from DR DR also holds metadata about each of the data objects stored in the Digital Archive 1 7 Access Copies of data objects stored in the Digital Archive can be obtained using the DR facility To gain access to an object or objects you need the item number barcode or transfer job number Data objects copied from the Digital Archive are provided in the format lt filename gt xena Xena or Xena Viewer software are required to read or extract xena files 1 8 Reprocessing If the need arises the DPR can access all archived objects of a particular MIME type and re process them through PF DPR User Manual v1 5 odt Page 13 of 106 2 Log On Each stage of DP
11. Internet standard allowing email to support attachments and non ASCII text Defines the kind of data formatting used by a particular data Object Normalisation Conversion of a data object into an open standards based format For example converting Microsoft Word format doc into Open Document text format odt Normalised files are created with an XML wrapper which contains the preservation metadata Output Carrier At any stage a DPR workstation will usually have two carrier devices attached The output carrier is the device that the processed objects are recorded into DPR User Manual v1 5 odt Page 4 of 106 PF See Preservation SeePreservationFacility Preservation er eed iens DAMNA stage of DPR workflow Includes binary normalisation normalisation and quality assurance Each file or MIME type is associated with specific software that is able to display the original un normalised version of that file Quarantine Before data can be normalised and archived it must be scanned for viruses and stored on an isolated carrier for 28 days before a second virus and checksum check See Quarantine Facility Quarantine Facility Initial stage of DPR workflow includes manifest file processing pre quarantine processing and post quarantine Program Association processing RecordSearch The National Archives records database Objects in the collection including data objects are identified by the
12. Retrieve all data objects L4 where normalisation failed v Normalise Selected Normalise All Update Table Data Object Media ID File Extension Normaliser Normalised Output FileName Error Error Reason Select All GIF Trick 1 zog 1 zog PlainT ext iv 20090526163 hcmort wks I wks Type not recor O trim x154 mbx 1 mbx Type not recor xena test pst T pst Type not recor lt lt lt Page 1 ofi gt gt gt Set Type Close If the normalisation is not successful re try normalisation as a different file type 8 To complete the normalisation process close the Advanced Normalisation dialog and save the results DPR User Manual v1 5 odt Page 40 of 106 5 2 4 Quality Assurance Process To perform the quality assurance process 1 Select the file to view all listed files must be reviewed in order to complete quality assurance 2 Click Open Original File button ir Quality Assurance A x Data Object Media ID MIME Type Normaliser QA State Comments Wess T TTC 772 vu ava Omero trash sxw 1 application vnd sun xml writer Office Untested manifest tsv 1 text csv CSV Untested corrupt NULL in EXIF tif 1 image J tiff Image Untested trash sxc ji application vnd sun xml calc Office Untested layout psd 1 image photoshop Legacy Im
13. The following sections describe how to deal with various errors that may be encountered in more detail DPR User Manual v1 5 odt Page 97 of 106 11 1 Virus Scanner If there is an error relating to the virus scanner click the Reset Step button and review the virus scanner installation and operation The most common reasons that a virus scanner error is displayed include the following either ClamAV or FakeScanner software is not installed the ClamAV daemon is not running the virus scanner port setting is not set correctly permissions on the target files are not sufficient to allow ClamAV to scan the files or the security policies of you operating system are preventing ClamAV from operating The following sections describe what to do in each of the above situations 11 1 1 Install the Correct Antivirus Software The DPR is designed to be compatible with ClamAV or FakeScanner only You must install either ClamAV or FakeScanner before using DPR Note FakeScanner is a testing tool which simulates the operation of a virus scanner it is not a fully functional virus scanner For information on installing ClamAV refer to the DPR wiki https sourceforge net apps mediawiki dpr index php title Installing ClamAV For information on installing FakeScanner see the DPE wiki https sourceforge net apps mediawiki dpr index php tilezFakeScanner 11 1 2 Start ClamAV Daemon If the ClamAV daemon is not running DPR c
14. at 2 Select Restart from the drop down list 3 Enter reasons for restarting the transfer job 4 Click OK button B Digital Preservation Recorder 4 0a 1006 Preservation dpr gt 38 Actions Users Reports Settings Help PF Checksum Validation Verify data object checksums on tha earria Properties Required for Handle Stopped Transfer Job in PF 1 data object checksums successfully validate Stop job action Restart Job vi Set Up Preservation Carrier for Creates the directory structure on Output carrier failure Reason for action uU o m DPR Updates the transfer job status 5 Take remedial action DPR User Manual v1 5 odt Page 102 of 106 6 To restart processing click Process button S lt Digital Preservation Recorder 4 0a 1006 Preservation dpr via x Actions Users Reports Settings Help Transfer Job 2009 20000031 Job Status Restarted in PF Processing Status Paused PF Checksum Validation Verify data object checksums on the carrier 1 data object checksums successfully validated Set Up Preservation Carrier for Transfer Job Creates the directory structure on the preservation output carrier X Handle Stopped Transfer Job in PF Handling stopped transfer job Y DPR will begin processing again from the first processing step Fr 7 j lt Digital Preservation Recorder 4 0a 1006 Preservation dpr o v A x
15. data from one stage to another Checksum A numerical value calculated from the contents of a data object By comparing a recently determined checksum with an older one you can tell if the data object has changed Checksum Checker Software that monitors the Digital Archive for data loss or corruption Required for the DR facility to compile reports from the Digital Archive ClamAV Open source anti virus software Controlling Agency The organisation that transfers the original data objects that are to be archived Also responsible for creating manifest file and item list Digital Archive Permanent storage for Digital Archival material The Digital Archive is accessed through the Digital Repository DR stage of DPR Data Object A single record file or document to be archived Once normalised it becomes an AIP A Submission Information Package SIP in OAIS terms Digital Preservation Software that manages the workflow for the National Recorder Archives digital archiving process Consists of three distinct stages Quarantine Facility Preservation Facility storage in the Digital Archive Digital Repository Third stage in the DPR workflow Copies normalised data from the Carrier Device into the Archive Also includes functions for managing and displaying DPR process metadata DPR See Digital Preservation Recorder DR See Digital Repository DPR User Manual v1 5 odt Page 3 of 106 Export File File
16. 2009 20000010 2009 04 02 09 31 41 433 dpr 177 DR Processing Complete Transfer Job Records Transfer Job QF Processing Reco Transfer Job PF Processing Reco Reprocessing Job Information A Show QF Records Show PF Records Job Number Job Status Created By Date Created AIP Information Section Status AIP Type Reprocessed 0090402094258982 AvaWable Binary Normalisation 0090402094345982 Aygflable Normalisation O DPR User Manual v1 5 odt Page 59 of 106 7 5 3 Archival Information Package To retrieve preservation audit information on an AIP 1 Access the Retrieve and View Data window see section 7 5 1 2 Click on the Archival Information Package tab Actions Users Peper Had Help j Digital Preservation Recorder 4 0a 1006 Digital Repository ian Retrieve Data Object Informati Search by Data Object Information Data Obj amp t Archival Information Package Transfer Job Reprocessing Job Y on Data Object Name Media Id Use Transfer Job Number Transferjob Number Select MIME Type Any mime type Y Perform Search Search Search By Item Number Enter Item Number Go Results Data Object File Name Media ID Transfer Job Item Number 3 Enter AIP ID 4 Click Search button Actions Users Reports Settin
17. Digital Preservation Recorder 6 0 0 User Manual Version 1 5 RKS 2013 1309 the arcnives Document Change Record Changed B Description of Changes 0 1 lan Little Initial Draft Complete Revision of previous document due to development of DPR version 4 0 m Little Functionality and User Interface April 2009 from DPR 4 0 release version lan E 2 Document Review July 2009 1 m coc INN Cunliffe Full review and edit including updates to April 2010 Glossary Overview and Xena configuration Made final 11 Allan Cunliffe Edited for consistent use of data object July 2010 1 n Allan Cunliffe Added information about ClamAV August 2010 troubleshooting selecting media directory Kirti Update Functionality and User Interface May 2012 Chennareddy changes from DPR 5 1 0 release version Kirti Update DR Configuration Settings from Feb 2013 Chennareddy DPR 5 1 2 release version 1 5 Kirti Update DR Configuration Settings from June 2013 Chennareddy DPR 6 0 0 release version DPR User Manual v1 5 odt Page 2 of 106 Glossary Term Definition AIP Archival Information Package A data object with metadata in a preservation format Barcode Number See Item Number Binary Normalisation Process to prepare a Data Object for archiving by adding an XML wrapper but not otherwise changing the original data Carrier Device As each stage of DPR QF PF and DR is completely isolated a physical storage device is required to transfer
18. text plain usr bin kate Norm text xml usr bin gedit Expo Local test 2 OK Cancel OOR J IOLI IOC 4p Import Job DPR User Manual v1 5 odt f Process Selected Job Page 91 of 106 4 Enter the MIME type and the location of the associated program r ES Digital Preservation Recorder 4 0a 1006 Preservation dpr Actions Users Reports Settings Help LJ e Configure Program Associations Select Transfer Job to Pr Transfer Job Number 1000 20003002 2009 20000001 2009 20000002 2009 20000003 2009 20000004 2009 20000005 2009 20000008 2009 20000010 2009 20000017 2009 20000030 2009 20000031 2009 20000033 2009 20000034 2009 20000035 2009 20000036 qj Import Job Exclude exported jobs C MIME Type Associated Program Add Device Reprocessing Job Export Fil application vnd ms excel usr bin ooffice 02 v Export Fil application wnd ms word usr bin ooffice J Export Fil usr bin sweep 1 Export Fil usr bin totem m Expor clin A hin mnutnm B Expo Add Program Association x E i Enter details for the new MIME type program association Expor MIME Type image gif LL Norm L Impor Program path Jusr bin gimp Browse Cancel L E d Process Select
19. 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000010 Expor File Generated 02 04 2009 dpr I1 2009 20000003 Expor File Generated 25 03 2009 dpr Itc1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 A 2009 20000017 Expor File Generated 20 04 2009 ian Ic1 Y ES Register a New Transfer Job in DPR C Qi mensem DPR User Manual v1 5 odt Page 29 of 106 4 Click Process button S Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Pre Quarantine Processing Passed Processing Status Paused New Transfer Job Step Create and initialise a new transfer job Read Manifest Step Load data objects from a manifest file Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Post Quarantine Processing Scan data objects for viruses and check their checksums Note You must provide a reason if you remove the transfer job from quarantine before the end of the 28 days 5 Click the OK button to continue ia LJ gt Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Pre Quarantine Processi Processing Status Processing Enter Reason For Leaving Early x This job is being removed from quara
20. 26 2003 Docket Mo 25 782 i E naa wrapper NAA Package EX The Xena Viewer may give the option to display the file using another program In this case the Show in LibreOffice org button DPR User Manual v1 5 odt Page 42 of 106 This may give a more accurate rendering of the normalised file File Edit View Insert Format Table Tools Window Help x D aa A euyve C Heading 1 v Arial Black 2211 v ars M MI ED id gg e Oy o 4 4 i zi BOW Faz 1 Performance model and fundamental nature of digital records Digital records challenge the idea that records are essentially objects for archivists to preserve arrange store and make accessible As archivists we are very comfortable with the concept of records as paper objects as original and unique physical artefacts A paper record can only be experienced at one place in time For researchers paper records can be experienced directly if they can read the language see figure 1 For archivists the problem of preserving records centres on the object once the object is preserved the record is preserved Researcher GOGH co 6 9 100 4 gt lt gt lt amp Page 7 25 Default English Australia INSRT STD Outline 1 4 Check that the normalised version against the original version see section 5 1 3 Quality Assurance 5 f the normalised file is an acceptable rendition of the original the click t
21. 5 odt Page 24 of 106 4 Quarantine Facility 4 1 Overview The purpose of the OF stage is to confirm that the data objects received on the input media match the contents of the manifest check that the data objects do not contain any virus or malware content check that data has not become corrupted during transfer prepare a transfer job for processing 4 2 Process The following steps describe QF processing steps in italics are performed or initiated by the user the others happen automatically 1 The user registers the transfer job and provides the data and manifest file on the input media 2 The data object checksums are checked against the manifest file 3 The data objects are scanned by anti virus software 4 The transfer job including the manifest and data objects is recorded to the output carrier device The user disconnects the output carrier device from the system and places it in secure shelf storage Quarantine lasts for 28 days during which the anti virus files are updated daily The user brings the output media device out of storage and re attaches it to the system The data objects are re scanned for viruses The user disconnects the output carrier device from the system It becomes the input carrier device for PF stage DPR User Manual v1 5 odt Page 25 of 106 4 2 1 Register Transfer Job To begin the archiving quarantine process 1 2 Actions Users Select Transfer Job to P
22. Co dpr 2009 20000011 Created Created T dpr 2009 20000042 Created Put into Quarantine dpr 2009 20000034 Created Created dpr 2009 20000002 Created Put into Quarantine Marked Co dpr 2009 20000012 Created dpr 2009 20000007 Created Restarted Created Put into Qu dpr 2009 20000041 Created Put into Quarantine Marked Co dpr 2009 20000039 Created Put into Quarantine Marked Co dpr 2009 20000037 Created Put into Quarantine Rejected dpr 2009 20000040 Created Put into Quarantine 7 dpr 2009 20000008 Created Put into Quarantine Marked Co dpr 2009 20000004 Created Put into Quarantine Marked Co A dpr 2009 20000003 Created Put into Quarantine Marked Co dpr 2009 20000048 Created Put into Quarantine Marked Co dpr 2009 20000043 Created Put into Quarantine Marked Co dpr 2009 20000038 Created dpr 2009 20000005 Created Put into Quarantine Marked Co dpr 2009 20000009 Created dpr 2009 20000010 Created Put into Quarantine Marked Co dpr 2009 20000006 Created Put into Quarantine Rejected user 2009 20000011 Put into Quarantine ian 2009 20000011 Restarted ian 2009 20000014 Created 6 If you choose to export the reports instead of viewing them then each report is saved as a separate file DPR User Manual v1 5 odt Page 71 of 106 9 Administration 9 1 Administer Users Access to each stage of the DPR is controlled by a user ID and password Each user ID has either b
23. Current Step button Actions Users Reports Settings Help Transfer Job 2012 12563526 Job Status Initialised from manifest Processing Status Processing New Transfer Job Step Create and initialise a new transfer job w Transfer job 2012 12563526 created and initialised successfully Read Manifest Step Load data objects from a ma i Exception During Step Processing x amp GS w 1 data objects successfully loaded fror The error below occurred when processing Pre Quarantine Processing Do you want to stop processing this job or stop this step You can try again after stopping Pre Quarantine Processin Pre Quarantine Processing exception Scan data objects for viruses a i O Details au gov naa digipres dpr task step ProcessingException Exception when Connecting to virus scanner attempting to connect to virus scanner on port 9999 at au gov naa digipres dpr task step PreQuarantineProcessingStep doProcessing Pre QuarantineProcessingStep java 251 at Stop Current Step 5 gg Pause 3 2 Take required remedial action 3 Click Process button to restart processing S lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr vA Actions Users Reports Settings Help Transfer Job 2009 20000038 Job Status Initialised from manifest Processing Status Paused New Transfer Job Step Create and initialise a new transfer job
24. Data Objects 1 Current Status Export File Generated Transfer Job Records QF Records DPR User Manual v1 5 odt M Page 87 of 106 10 Appendix A DPR Software Configuration The following sections describe the configuration requirements for each of the three facilities 10 1 Quarantine Facility The first time DPR is run on a QF workstation you must set up the connection to the virus scanner software To configure QF virus scanner settings 1 Log on to QF as an administrator see section 2 Log On 2 Select Configure Virus Scanner from the Settings Menu Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Select Transfer Jolh Transfer Jab Number T Status Date Created 2009 2000000 1 Export File Generated 23 03 2009 2009 20000002 Export File Generated 23 03 2009 2009 20000003 Export File Generated 25 03 2009 3 Enter a port number in the Virus Scanner Port field For the ClamAV antivirus software the default port is 3310 For the FakeScanner test program the port is 9999 2 Configure Virus Scanner x A virus Scanner Details Virus Scanner Port 9999 C oo ID Cancel 4 Click Done button to return to Se lect Transfer Job window DPR User Manual v1 5 odt Page 88 of 106 10 2 Preservation Facility In PF you must configure Xena settings and program associations 10 2 1 Xena Settings The first time
25. Files imageMagick convert exe Browse OK Cancel 9 Enter Location of tesseract executable The location of the tesseract executable depends on your operating system and method of installation for example C Program Files National Archives of Australia xena win32 tesseract exe 10 Enter Location of the Image Magic convert executable The location of the convert executable depends on your operating system and method of installation for example C Program Files National Archives of Australia xena win32 convert exe 11 Click OK button 12 Select Settings Xena Settings Office L4 Nm Properties for Office 2G Base directory of LibreOffice org installation fopt libreaffice Sleep time allowed for LibreOffice org to start seconds 13 Enter Base directory of LibreOffice Org installation LibreOffice is located in its own folder for example C Program Files LibreOffice Org 14 Optional Enter Sleep time allowed This defaults to 5 seconds This option allows you to tell Xena how long to wait before trying to load LibreOffice Org Some slower systems take longer to load LibreOffice Org which may result in Xena being unable to contact it to perform file conversion 15 Click OK button DPR User Manual v1 5 odt Page 90 of 106 r 10 2 2 Configure Program Associations During the Quality Assurance process see section 5 2 4 Quality Assurance DPR opens the original versions of
26. Ic1 2009 20000009 Initialised from manifest 31 03 2009 dpr l1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 2009 2000003 1 Pre Quarantine Processing Passed 08 05 2009 ian Ic3 05 06 2009 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000030 Export File Generated 07 05 2009 ian Ic3 2009 20000020 Export File Generated 07 05 2009 ian Ic3 E Register a New Transfer Job in DPR d Process Selected Job The Select Transfer Job to Process window displays all transfer jobs in the stage specific database QF PF or DR DPR User Manual v1 5 odt Page 14 of 106 2 2 Logon Details If you cannot connect to the database there may be something wrong with the connection details Check the correct details with your System Administrator DPR User Manual v1 5 odt S 2 Digi
27. Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Icl 2009 20000016 Export File Generated 20 04 2009 ian Icl 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 20093 200n0030n Restarted in OF OZ N5 2009 ian 3 ss Register a New Transfer Job in DPR d Process Selected Job 3 Hold down the control key and select the required reports with the mouse 4 Click the Show Report button to continue Actions Users Reports Settings Help Show Report Export to HTML y Select the Report to Produce Transfer Jobs that Failed in QF Transfer Jobs that were Rejected User Report User Report calendar month User Report financial year Export to CSV Back To Job Selector All selected reports are displayed in the same window DPR User Manual v1 5 odt Page 70 of 106 5 Click on the appropriate tab to view a specific report Transfer Jobs that Failed in QF User Report User Report financial year User Name Transfer Job Number Tasks Performed dpr 2009 20000001 Created Put into Quarantine Marked
28. Name An Approach to the Preservation of Digital Records June 2002 DOC Status Untested Comments Open Original File Open Normalised File 6 Close the viewer windows and repeat quality assurance for all remaining files DPR User Manual v1 5 odt Cancel Page 43 of 106 7 When you have reviewed all the files press the Done button to return to processing f j lt Quality Assurance x Data Object Media ID MIME Type Normaliser QA State Comments layout psd 1 image photoshop Legacy Image Passed 43 plugin xml 1 text xml XML Passed graffiti sxi 1 application wnd sun xml i Office Passed graffiti ppt 1 application vnd ms powe Office Passed Copy of test zip 1 application zip Zip Passed 3dgarro cur 1 image x win bitmap Legacy Image Passed source tar 1 application tar Tar Passed mbox 1 application mbox Email Passed salt ass graph docx 1 application word Office Passed aniagls gif 1 image gif Image Passed Report Outline bin 1 application macbinary MacBinary Passed trim x154 3 1 text html HTML Passed ACTInternationalOpen200 1 application wnd ms word Office Passed non quadriga bwf wav 1 audio wav Direct Audio Passed Book1 slk 1 text plain Office Passed weddetails mpp 1 application vnd ms project Microsoft Project Passed She s A Woman mp3 1 audio mp3 Converted Audio Passed Dell Wallpaper BMP 1 image bmp Image Passed libpst 0 5 1 tar gz al application g
29. Quarantine x oad data objects fromai Load data o bj ts from a t G This transfer job should now be placed into quarantine It is due out at 10 06 2009 Y 66 data objects successfully loadec P perm p Pre Quarantine Process Scan data objects for viruses check their checksums and set up the output carrier Y Pre quarantine processing successfully completed 66 data objects verified UU Paused 3 The transfer job is now in quarantine DPR User Manual v1 5 odt Page 28 of 106 5 Click Done button return to Select Transfer Job window l Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Pre Quarantine Processing Passed Processing Status Paused New Transfer Job Step Create and initialise a new transfer job YY Transfer job 2009 20000035 created and initialised successfully Read Manifest Step Load data objects from a manifest file Yy 66 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier y Pre quarantine processing successfully completed 66 data objects verified 6 Remove the input media and output carrier devices 7 Store the output carrier device in a secure location for the 28 day quarantine period 4 2 3 Post Quarantine To continue
30. Stopped Transfer Job in QF Transfer job 2009 20000037 created a Stop job action Read Manifest Step Load data objects from a mani Data objects missing from input media Reason for action 1 data objects successfully loaded from Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Transfer job stopped in pre quarantine processing DPR updates the transfer job status 5 To end processing click Done button B D Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Transfer job 2009 20000037 created and initialised successfully Read Manifest Step Load data objects from a manifest file 1 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Transfer job stopped in pre quarantine processing Handle Stopped Transfer Job in QF Handling stopped transfer job Transfer job rejected gt 38 6 Return the transfer to the controlling agency for remedial action DPR User Manual v1 5 odt Page 100 of 106 11 3 Reset Step If there is an error before data objects are processed and recorded For example e incorrect settings e error with a plugin or other related software Then the current processing step can be reset to allow remedial action before continuing 1 Click the Stop
31. Xena Files Enter Output Folder Location Browse Perform Copy Back To Job Selector 5 Enter the barcode item number of the item you wish to retrieve and click the Add button e you can add as many barcodes to the list as required the Clear button removes all barcodes from the list the Remove Selected button removes only selected highlighted barcode s Optional Enter barcodes via a barcode scanner e Click on the Barcode field Scan the physical barcode s DPR User Manual v1 5 odt Page 54 of 106 Each barcode scanned is automatically added to the list no need to click the Add button Use the Import button to import the barcodes from a list e Click on the Import button e Select the barcode list and click ok All barcodes for the list will be imported gt ee Enter RecordSearch Barcodes Enter RecordSearch barcodes by either using the entry field below or by using a barcode scanner The entry field must have focus in order to use a barcode scanner Barcode 28051057 Q Add 3 28051056 Import Clear Remove Selected CLex Coe yemesr Coe yemesr 6 To retrieve the listed Items from the archive click the OK button The Copy Items for Access window is displayed Actions Users Reports Settings Help Copy Items for Access Enter Barcodes Include the Binary AIFs C Copy All AIFs Item Number Transfer Job Nu Data Object File Primary AIP AIP Status 2
32. clicking the Change Item Numbers button NOTE these changes cannot be automatically undone Current Item Number i New Item Number Add Current Item Number d New Item Number Select All 1 2 m I3 4 Clear Selection 5 6 Remove i Change Item Numbers Back To Job Selector DPR User Manual v1 5 odt Page 64 of 106 6 Click OK button to confirm changes or Cancel to discard changes im ace Confirm Item Number Changes M ih x These changes will affect 44 data objects a subset of these data objects is shown below and cannot be automatically undone Are you Sure wou want to change the item numbers Current Item Bumber Wew Iter Wumber Transfer jab Filename z011r 05181503 test adt zZOIll 06017114397 madeupstile with la 2O11 06161640 miacdessup sftile txt zO0lz 1z57852 How Tungsten Licht 2O0LIZ 125379852 Joeralio 3DH W64 2UIl 12547852 hard drive tear down POLST 2547852 CellRenderers samp 201212547552 WHOSUWR EF 1 Awl 2012 1254 7552 SAMPLE Awl zZOlz 12547852 rcellk amp endererz sarml 1 2 1 2 1 2 1 z 1 z 1 2 1 2 1 2 1 2 1 2 eancel 7 Click OK on the confirmation dialogue box S The Item Numbers were successfulhy changed DPR User Manual v1 5 odt Page 65 of 106 8 Reports 8 1 Overview Each DPR facility is able to provide reports on the user and transfer job activity relevant to that facility 8 2 Available Reports The
33. different DPR environments provide reports on different data DPR Facility Available Reports All e User Reports e User Reports Calendar Month e User reports Financial Year OF only e Transfer Jobs that failed in QF e Transfer Jobs that were rejected PF only e Transfer Jobs that failed Normalisation e Transfer Jobs that failed Wrapping DR only e Barcodes Processed Barcodes Processed Calendar Month Barcodes Processed Quarter Barcodes Processed Financial Year DPR Statistics DPR Statistics Calendar Month DPR Statistics Calender Quarter DPR Statistics Financial Quarter DPR Statistics Financial Year Data Objects with no Normalised Record Normalised AIP MIME Type breakdown Transfer Jobs that failed in DR 8 3 Checksum Checker Checksum Checker is a piece of software that operates independently of DPR It monitors the contents of the Digital Archive for data loss or corruption DR cannot produce certain reports unless Checksum Checker is run regularly DPR User Manual v1 5 odt Page 66 of 106 8 4 Produce a Report To produce a report on activity on OF PF or DR 1 Log on to the DPR facility you want to produce a report from see section 2 Log On 2 Select Generate Report from the Reports menu S Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Help Reports Settings Select Tran cenerate Repos Filter by user
34. ian Search by Data Object Information Data Object Name Media Id Use Transfer Job Number Transferjob Number Select MIME Type Any mime type Perform Search Search Search By Item Number Enter Item Number Go Results Data Object File Name Media ID J Transfer Job Item Number Back To Job Selector 7 5 2 Data Object To retrieve preservation audit information on a data object 1 Access the Retrieve and View Data window see section 7 5 1 2 Click the Data Object tab 3 Search for required data object Enter the Data Object Name the input file name Optional Enter the Media Id Click Search button OR Click the Use Transfer Job checkbox Enter Transfer Job Number Optional Select MIME type to search for Click Search button OR Enter Item Number i e the Barcode Number This may also be scanned in with a Barcode scanner after selecting this field Click the Go button DPR User Manual v1 5 odt Page 58 of 106 ES Digital Preservation Recorder 4 0a 1006 Digital Repository ian Actions Users Reports Settings Help Data Object Archival Information Package T ransfer Job Reprocessing Job Retrieve Data Object Information Search by Data Object Information Data Object Name Media Id Use Transfer Job Number v Transferjob Number 2009 20000010 Sele
35. inta DF 23 03 2009 3 Select Repository location Ingest into the Repository can be set up in one of the two ways Option 1 ReadWrite file system directly Mount the Repository with read write permissions for all users Select option Read Write file system directly Enter the location of the repository in the Repository Base Directory field e Repository Settings c CJ GS D Configure Digital Repository Settings Repository Location Read write file system directly ow Repository Base Directory DPR Repositoary Read write using the DPR Server C5 Set Reprocessing Job Prefix Default prefix for Reprocessing Jobs 0000 Option 2 ReadWrite using DPR Server DPR server See section 10 3 1 is initiated on the server to copy files from the client to the Repository preventing user Read Write access to the Repository via the file system This option allows multiple repository locations that can be configured in the database See Section 10 3 2 DPR User Manual v1 5 odt Page 94 of 106 e Select option Read Write using DPR Server Enter Server Host Name Enter Server Port Enter Server Read Timeout minutes li a Repository Settings uu ky US Dy Configure Digital Repository Settings Repository Location Read write file system directly C Read write using the DPR Server Server Host Name localhost Server Port 30444 Server
36. item barcode number Reprocessing Job If the policy or technology for normalising a particular file type changes AIPs of that type can be retrieved from the Digital Archive and processed again according to the new circumstances A reprocessing job functions the same as a transfer job but contains AIPs from the archive Reprocessing Job Unique identifier for each reprocessing job Number Reprocess Transfer If a transfer job encounters a serious failure in PF or DR it Job can be returned to a previous DPR facility to be processed again Transfer Job A grouping of data objects for archiving A transfer initially comprises one or more data objects and a manifest file Transfer Job Number Unique identifier for each transfer job The transfer job number is allocated by RecordSearch Xena File normalisation software Xena functionality is integrated in to the PF stage of DPR Xena can also be used as a stand alone product DPR User Manual v1 5 odt Page 5 of 106 Related Documentation An Approach to the Preservation of Wr M Heslop Digital Records Simom Davis 2002 Andrew Wilson Checksum Checker User Manual Allan Cunliffe April 2010 2009 4025 Digital Preservation Recorder Andrew Keeling March 2007 Functional Requirements v 3 0 Digital Preservation Recorder User John Lovejoy August 2007 Manual v3 0 Digital Preservation Recorder User James Doig July 2007 R494782007 Requirements Digital Preservation Reco
37. recorded by QF and PF on the carrier device The Export File contains the Transfer Job s preservation metadata FakeScanner Software that simulates the behaviour of an anti virus program FakeScanner can be used to test DPR without the need for ClamAV Ingest Within the DPR workflow Ingest refers only to the process of copying a transfer job into the Digital Repository Input Media Storage media containing the initial transfer job data objects and manifest file from the controlling agency Input Carrier At any stage a DPR workstation will usually have two carrier devices attached The input carrier is the device that the objects to be processed are taken from Item Number The Item is the fundamental unit of archived material An Item is uniquely identified by the Item Number A single Item can include any number of data objects each of which is assigned the same item number The item number is the same as the item barcode number in RecordSearch Manifest File A machine readable list of data objects in a transfer job along with their allotted barcode number and a unique identifier The manifest file is created outside of the DPR workflow Metadata Data about other data DPR collects and makes available information about the following e contents of items data objects and AIPs e events in the processing of transfer jobs actions taken dates results user activity MIME type Multi purpose Internet Mail Extensions
38. such as odt then the normalised file will be identical to the binary normalised file 5 The user can use advanced normalisation to create normalised data objects for original data objects that the program could not identify process New checksums are calculated for the data objects The user views a selection of original and normalised objects to confirm that the normalised data object is a valid rendering of the original 8 The transfer job including the metadata and data objects is recorded to the output carrier device 9 The user disconnects the output carrier device from the system It becomes the input carrier device for the DR stage DPR User Manual v1 5 odt Page 34 of 106 5 2 1 Import Transfer Job To import a transfer job into the PF 1 Connect the input carrier device with the transfer job from QF to the PF workstation Connect the output carrier device to the workstation Log on to DPR see section 2 Log On 4 Click the Import Job Button LJ Digital Preservation Recorder 4 0a 1006 Preservation ian va x Actions Users Reports Settings Help Select Transfer Job to Process Filterbyuser ALL Filter by status ALL Exclude exported jobs C Transfer Job Number Status Date Created Created By Transport Device Reprocessing Job 1000 20003002 Export File Generated 27 03 2009 dpr X126A oops Itc2 iv 2009
39. the archiving process after the quarantine period 1 Retrieve the output carrier device from secure storage and connect it to the QF workstation 2 Log on to DPR see section 2 Log On 3 Select the transfer job and click Process Selected Job button ES Digital Preservation Recorder 4 0a 1006 Quarantine ian v x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL v Exclude exported jobs C Transfer Job Number Status 7 Date Created Created By Transport Device Due Out of Quarantine 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000035 Pre Quarantine Processin 13 05 2009 ian Local test 1 10 06 2009 2009 20000006 Rejected in QF 27 03 2009 dpr 11 24 04 2009 2009 2000003 1 Restarted in QF 08 05 2009 ian Ic3 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000034 Restarted in QF 11 05 2009 dpr 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000030 Restarted in QF 07 05 2009 ian 2009 20000011 Restarted in QF 02 04 2009 dpr I1 2009 20000023 Expor File Generated 07 05 2009 ian Ic3 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000001 Export File Generated 23 03 2009 dpr Itcl 2009 20000002 Export File Generated 23 03 2009 dpr Itcl
40. the transfer job from PF to the DR workstation 2 Log on to DPR see section 2 Log On DPR User Manual v1 5 odt Page 45 of 106 3 Click the Import Job Button Digital Preservation Recorder 4 0a 1006 Digital Repository ian va x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Transfer Job Number gt Status Date Created Created By Transport Device Reprocessing Job 1000 10000001 Reprocessing Job Sent To PF 31 03 2009 dpr vi 2009 20000001 Imported into DR 23 03 2009 dpr Itc2 2009 20000002 Imported into DR 23 03 2009 dpr Itc2 2009 20000003 DR Processing Complete 25 03 2009 dpr Itc2 2009 20000004 DR Processing Complete 25 03 2009 dpr Itc2 2009 20000010 DR Processing Complete 02 04 2009 dpr I2 LJ 2009 20001005 DR Processing Complete 26 03 2009 dpr I2 4 qp Import Job gt 35 Perform DR Tasks y Process Selected Joh4 4 Select the transfer job on the input carrier device Transfer job file format PF YYYY NNNNNNNN db4o r LJ Digital Preservation Recorder 4 0a 1006 Digital Repository ian Actions Users Reports Settings Help Select Transfer Job ti 9Pe jus ALL M Transfer Job Number gt Look In E local test carrier
41. 0000002 Imported into DR 23 03 2009 dpr Itc2 2009 20000003 DR Processing Complete 25 03 2009 dpr Itc2 2009 20000004 DR Processing Complete 25 03 2009 dpr Itc2 O 2009 20000010 DR Processing Complete 02 04 2009 dpr 12 2009 20000036 Imported into DR 13 05 2009 ian Ic2 O 2009 20001005 DR Processing Complete 26 03 2009 dpr I2 qp Import Job Ss Perform DR Tasks E QU Process Selected Job a DPR User Manual v1 5 odt Page 46 of 106 3 To begin the copy to archive process click Process button j e Digital Preservation Recorder 4 0a 1006 Digital Repository ian Actions Users Reports Settings Help Transfer Job 2009 20000036 Job Status Imported into DR Processing Status Paused Copy To Digital Repository Copy the AIPs to the repository and verify their checksums e calculates checksums for the AIPs on the input carrier and compares them to the checksums in the transfer job e copies the AIPs and the transfer job information into the Digital Archive e calculates checksums for the copied AIPs and compares them to the checksums in the transfer job 4 Toreturn to Select Transfer Job window click the Done button j Digital Preservation Recorder 4 0a 1006 Digital Repository ian Actions Users Reports Settings Help Transfer Job 2009 20000036 Job Status DR Processing Complete Processing Status Finished Copy To Di
42. 00002 Export File Generated 23 03 2009 dpr tcl 2009 2 0000003 Export File Generated 25 03 2009 dpr Itc 1 2009 20000004 Export File Generated 25 03 2009 dpr Itc 1 Guodmo sU Ga C s oo M rm amo a gm gos 3 Click Add User button S lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Add and Edit Users User Name First Name Last Name Active dpr Mr Bootstrap v user sample user v admin sample admin iv max max moo v johnl john v ian lan Little v john john lovejoy v jack Jack Burton v C mauser D Edit User Export User List Import User List Done 4 Complete all user details fields To give the user administrator permissions click the Administration Permission checkbox ES User details 8800 x Enter Details of New User User Details Confirm password esse User is active Permissions _ Administration Permission Cox Dena DPR User Manual v1 5 odt Page 73 of 106 5 Click the OK button The Add and Edit Users window is displayed 6 To return to the Select Transfer Job window click the Done button 9 1 2 Edit User To edit the details of an existing user 1 Log on to QF as an administrator see section 2 Log On 2 Select Users Administer Users l Digital Preservation Recorder 4 0a 1006 Quarantine dpr Act
43. 012 14528569 Testl 201205291059 Normalisation Availahle 2012 14528569 Test 201205291059 Normalisation Availahle Create Manifest File Include Xena Files Perform Copy amp J Back To Jab Selector 7 By default the panel will display the normalised AIPs for each Item number It will not display the binary normalised AIPs or AIPs which have been DPR User Manual v1 5 odt Page 55 of 106 reprocessed and replaced by newer versions e Click the Include Binary AIP checkbox to include the binary normalised AIPs e Click the Copy all AIPs checkbox to include all AIPs for the Item Number including binary and replaced AIPs Click the Create Manifest File Checkbox the manifest file will list all AIPs in the Job and includes the checksum for each one e Click the Include Xena Files checkbox to copy the Xena files themselves as well rather than just the data objects and preservation format files contained within Xena files 8 Enter the location of the output folder this is where the AIPs will be copied to This should be located on a carrier device Actions Users Reports Settings Help Copy Items for Access Enter Barcodes Include the Binary AIFs C Copy All AIPS Item Number Transfer Job Nu Data Object File Primary AIP AIP Status 2012 14528569 Testl 201205291059 Normalisation Available 2012 14528569 Test 201205291059 Normalisation Available Create Manifest File O Include X
44. 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Ditialisec from manifest 07 05 2009 ian Ic3 DPR User Manual v1 5 odt ss Process Selected Job Page 26 of 106 4 2 2 Pre Quarantine To perform pre quarantine processing 1 Enter new transfer job details e The Transfer Job Number is a unique identifier for the transfer job At the National Archives the transfer job number is obtained from the Transfer Location and Lending TLL module of RecordSearch Transfer job number format is YYYYINNNNNNNN Select the manifest file from the input device The manifest file format is Filename tsv e Select the location of the output carrier device Enter the name or number of the output carrier device e Select the directory that contains the files on the input carrier device If you used Manifest Maker to create this arrangement the containing directory is called Recoras If you have more than one media media1 media2 and SO On start by selecting the Records directory of medial 2 Click OK button ES Actions Users Reports Settings Help Job Status Processing Status Paused Enter New Transfer Job Details Transfer job number 2009 2 0000035 Manifest filename home
45. 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 2009 20000030 Export File Generated 07 05 2009 ian Ic3 2009 20000031 Pre Quarantine Processing Passed 08 05 2009 ian Ic3 05 06 2009 da 2009 20000032 Initialised from manifest 08 05 2009 ian 3 za 2009 20000033 Export File Generated 08 05 2009 ian Ic3 v ap Register a New Transfer Job in DPR CC Qi Process selected on 3 Page 18 of 106 3 3 Actions Menu The Actions menu is available from all DPR windows 3 3 1 Change Password To change your password 1 Select Actions Change Password S Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help gt Change Password 59 to Process Filter by user ALL Date Created 23 03 2009 2009 20000002 Export File Generated 23 03 2009 2009 20000003 Export File Generated 25 03 2009 2009 20000004 Export File Generated 25 03 2009 2009 20000005 Export File Generated 26 03 2009 2009 20000006 Rejected in OF 27 03 2009 2009 2000000 7 Fre Quarantine Processi 27 03 2009 2009 20000008 Restated in OF 2 03 2009 port File Generated 2 Complete the following fields Current Password New Password Confirm Password S Change Password Current password New password Confirm password Cancel i gt 3 To confirm changes and close the Change Password dialog click OK button DPR User Manual v1 5 odt Pa
46. 2 amp A Ej gg rt Device Reprocessing Job 1000 10000001 Repr v 2009 20000001 Impol 20003002 C3 2009 20000017 E PF 2009 20000005 db4o a 2009 20000002 Impot 20000001 C3 2009 20000035 PF 2009 20000010 db4o DD DET 20000002 C3 2009 20000036 E PF 2009 20000036 db40 2009 20000010 DR pry 20000003 E PF_1000_20003002 db40 2009 20001005 DR p 20000004 E PF 2009 20000001 db4o 20000005 E PF_2009_20000002 db4o0 20000008 E PF 2009 20000003 db4o 20000010 E PF 2009 20000004 db4o File Name PF 2009 20000036 db40 Files of Type AllFiles 11 O Import Job d Perform DR Tasks i Process Selected Job QB import djroetmDbRTals E Job 5 To import transfer Job click Open button 6 2 2 Copy to Archive To copy the AIPs into the Digital Archive 1 Log on to DPR at the DR workstation see section 2 Log On 2 To start processing select the transfer job and click Process Selected Job button S Digital Preservation Recorder 4 0a 1006 Digital Repository ian v A x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user Filter by status ALL Transfer Job Number gt Status Date Created Created By Transport Device Reprocessing Job 1000 10000001 Reprocessing Job Sent To PF 31 03 2009 dpr v 2009 20000001 Imported into DR 23 03 2009 dpr Itc2 2009 2
47. 2 Disconnect the output carrier device from the workstation It is now the input carrier device for the PF stage DPR User Manual v1 5 odt Page 31 of 106 5 Preservation Facility 5 1 Overview The purpose of the PF stage is to confirm that the data objects received from QF have not been altered or corrupted binary normalise each data object normalise each data object create checksums for the data objects perform quality assurance checks on data objects 5 1 1 Normalisation and AIPs The fundamental operation of DPR is to create two different types of Archival Information Packages AIPs for each data object in the transfer job The two types of AIPs stored in the Digital Archive are Binary Normalised AIP DPR creates a single Binary Normalised AIP where the data object is converted into base 64 encoding to enable the inclusion of XML metadata within the binary AIP The binary normalised AIP can be used to exactly re create the original object Normalised AIP DPR may create Normalised AIP s where the data object is converted to a selected preservation format When the normalisation process involves conversion into a new format quality assurance is required to check the success of the conversion see section 5 1 3 Quality Assurance DPR User Manual v1 5 odt Page 32 of 106 The following table describes the possible normalisation and quality assurance options Binary Normalisation Normalisation for
48. 2 vbBXDOrranster JoD aesti dE Pr d PvE o e tees 31 5 PRESERVATION FACILITY eie teteo eee ot obe aee e eee aeEN e erini EE ege bea YN ee Fee Pa a a eive ve evo oe Ea ees 32 SMNE CL VIC T P 32 o TA Normalisation and A IPS uio base Na SE e tva vae Inu toa dE eas Ua nS 32 3 1 2 Binary Quality ASS Ura Ce sisene aE E teo ub oem a T put Pets eus 33 5 19 Quality JASSIUFFIICG osi O iR MM eM U MM m IEEE 33 Da PIOUBSS etas da dro ROM On E M cu E EDU 34 o2 Import Transter JOD cecocsnt e ep tte bis B Hb Me M MIU 35 9 22 NOK MANNS AU OM soe oo put er tte Eo E editos dtu rx EE dM ODE Tia E E EIE 36 5 2 9 Advanced Normalisatiobusisone reo i EN ru Pa ORIS Ep UMEN WISI Ure ES 38 3 2 4 Quality Assurance Process eod eye Eb E epe be tea at ben ea p pu eti butud 41 52 5 EXPO JEEGBSEOT JOD scii satus esee o Uses Sue Sao a tei Ges usu Dad aU usa ndo 44 6 DIGITAL REPOSITORY cirian aara EEEE TREE SERE NE ER EROS 45 O T VELIE etas om Na id doo Mon tee eee ocean 45 D IDEOGOSS oec wastes A is buses esu ena nM bun M P I MM ain DUUM D OE MMEUMUE 45 O 2 1 Import TnS Ter JOD esce oret reote apri CO REO Fa uer Dette ses bU ea EI abis 45 0 2 2 CODV TOPIC IVC s etes ttes ERR nein bad MERE NEU HM MD Ed 46 7 DIGITAL REPOSITORY TASKS eorr eee aa eo eda beoe eae d eU eEEE eee eaa ee e P E EPE RO E aE 48 ZU Blu dn Is C PC aenseeee asus Gesden a ered aeae ae ae ee aeons 48 7 2 Access Digital Repository Task Panel eee
49. 20000001 Export File Generated 23 03 2009 dpr Itc1 Itc2 O 2009 20000002 Expor File Generated 23 03 2009 dpr Itc1 Itc2 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 Itc2 2009 20000004 Export File Generated 25 03 2009 dpr Itc 1 Itc2 Eg 2009 20000005 Export File Generated 26 03 2009 dpr 11 12 O 2009 20000008 Returned To QF Facility 27 03 2009 dpr 11 12 L 2009 20000010 Expor File Generated 02 04 2009 dpr 11 12 LJ 2009 20000017 Export File Generated 20 04 2009 ian Ic1 Ic3 X148 L1 2009 20000030 Normalising complete 07 05 2009 ian Ic3 Ic3 too O 2009 2000003 1 Imported into PF 07 05 2009 ian Ic3 O 2009 20000033 Normalising failed 08 05 2009 ian Ic3 Ic3 L 2009 20000034 Imported into PF 11 05 2009 dpr Ic3 El uL d Process Selected Job format is QF_YYYY_NNNNNNNN db4o window Select the transfer job on the input carrier device The transfer job file Click Open button to import transfer job return to Select Transfer Job A Digital Preservation Recorder 4 0a 1006 Preservation ian Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Exclude exported jobs C Transfer Job Number Status Date Created Created By Transport Device Reprocessing Job 1000 20003002 Export File
50. 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 v E Register a New Transfer Job in DPR Buttons specific to each facility are located at the lower left ES Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Select Transfer Job to Process Fiter by user Filter by status ALL v Exclude exported jobs C Transfer Job Number Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000001 2009 20000002 2009 20000003 2009 20000004 2009 20000005 2009 20000006 Export File Generated Export File Generated Export File Generated Export File Generated Export File Generated Rejected in QF 23 03 2009 23 03 2009 25 03 2009 25 03 2009 26 03 2009 27 03 2009 dpr dpr dpr dpr dpr dpr Itc1 Itc1 Itc1 Itc1 I1 I1 24 04 2009 2009 20000007 2009 20000008 2009 20000009 2009 20000010 2009 20000011 2009 20000012 2009 20000014 2009 20000015 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 Restarted in QF 27 03 2009 dpr Initialised from manifest 31 03 2009 dpr I1 Export File Generated 02 04 2009 dpr I1 Initialised from manifest 02 04 2009 dpr I1 Initialised from manifest 07 04 2009 dpr li Initialis
51. 20090402094252159 Binary Normalisation Available Binary 4 2 1 From the AIP Information window you can do the following e to view AIP contents click Open AIP button to view PF processing data click Show Preservation Processing Records button to view DR processing data click Show Repository Processing Records button e to view data object Data see above double click entry in Source Data Object table e to view data on data objects embedded in the currently displayed AIP double click entry in Embedded Objects table to view data on AIPs related to currently displayed AIP double click entry in Related AIP table DPR User Manual v1 5 odt Page 61 of 106 7 5 4 Transfer Job To retrieve preservation audit information on a transfer job 1 Access the Retrieve and View Data window see section 7 5 1 2 Click on the Transfer Job Tab Digital Preservation Recorder 4 0a 1006 Digital Repository ian v x Actions Users Reports Settings Help Data Object Archival Information Packa fje Transfer Job Rerocessing Job Y Retrieve Data Object Information Search by Data Object Information Data Object Name Media Id Use Transfer Job Number Transferjob Number Select MIME Type Any mime type Perform Search Search Search By Item Number Enter Item Number Go Results
52. Click the Preview button to see which objects will be included in the transfer job Create Reprocessing Job j lt Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Enter Job Number Selection Criteria 1000 20003003 Suggest Job Number Criteria Define a new search criteria where data object mime type is audio flac Add criteria where data object mime type where data object mime type Reprocessing Reason Reason for Reprocessing Output Location Preview is audio mp3 is audio flac F Audio normalisation testing Enter Carrier Location media X126 Carrier X126 A Browse Copy AIPs Q Create Reprocessing Job v E Back To Job Selector 9 Click the Create Reprocessing Job button to extract the data objects from the archive and copy them onto the carrier device j lt Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Create Reprocessing Job Enter Job Number Selection Criteria 1000 20003003 Suggest Job Number Criteria Define a new search criteria where data object mime type jis audio flac Add criteria where data object mime type where data object mime type Reprocessing Reason
53. DPR is run on a PF workstation you must enter the locations of the other software that DPR requires for normalising files The following Xena settings must be configured Audio Image Office Email To configure Xena settings 1 Log on to PF as an administrator see section 2 Log On 2 Select Settings Xena Settings Audio m1 Properties for Audio Location of flac executable C Program FilesxxenavWwin32xfac exe 3 Enter Location of flac executable The location of the flac executable depends on your operating system and method of installation for example if DPR was installed using the Digital Preservation Software Platform installer it may be in C Program Files National Archives of Australia Xena win32 flac exe 4 Click OK button 5 Select Settings Xena Settings Email m1 Properties for Email Location of readpst executable C Program Files Kena wins readpst exe 6 Enter Location of readpst executable The location of the readpst executable depends on your operating system and method of installation for example C Program Files National Archives of Australia xena win32 readpst exe 7 Click OK button DPR User Manual v1 5 odt Page 89 of 106 8 Select Settings Xena Settings Image 1 a Properties for Image Location of tesseract executable C Program Files Xena win32 tesseract exe Browse Location of the Image Magick convert executable C Program
54. E V E RPM 77 9 2 Administer Transfer JODS ioc sb pr i E T A 79 9 2 1 Change Transfer Job NuUmbe ccccccccccccccccccccccccccccccceceeansssercecsseasseeees 79 9 22 Delpte Transter JOD ucro pH DOE addc aD eae 80 9 2 9 I XDOLNE A EATISPOE JOD tactis tu ti opes od oimten ia A 81 924 Restart Transfer Jo Dunara PC em 82 92a REprocess ITansrem JOD en oo a E 84 9 9 View Metadafan ee ania E IMEEM E IN E 86 10 APPENDIX A DPR SOFTWARE CONFIGURATION eseseeccccccececcsssssssseseecessssecesssee 88 1O FOr ie F ae CY oos eo ec EODEM E DONUM ee eee 88 102 PRESET All OM FAC My m T P 89 10 21 CMe DOUG e esie tia cdententetacamamnscates tunedin edm aua decceeeiacet eases 89 10 2 2 Configure Program Associations n ac RR RR ERR CAR ER Tees 91 10 3 Digital REPOSO isse eo i met I Fu cds dutai tM M E DNE eic 94 11 APPENDIX B TROUBLESHOOTING e eee eee eee eee eee eene eee o eoo s sete ettet eese eese eee eee eua 95 T Ae VIEUS SCIE aee opa epe Derzeit testo cases Mio bump aeo LE Eb deese e 96 11 1 1 Install the Correct Antivirus Softwa e cccccccccccccccceeessecceeeeeeecceeeeeeeeeeas 96 111 2 Start C IamAV PACINO sat oe tec bored evens Yer Seote in Eo Suen rv es ded e N 96 11 1 3 Set the Correct Virus Scanner Port eese eene nnns 96 11 1 4 Alter the Permissions or Security Policy eeeeeeeeeeeee
55. Generated 27 03 2010 ir SX KA nnns Itc2 2009 20000001 Export File Gel 5 Open x O 2009 20000002 Export File Ge 2009 20000003 Export File Ge Look In C3 local test carrier 1 amp zd c BBE m 2009 20000004 Expor File Ge 2009 20000005 Export File Ge 10000008 C3 2009 20000016 E QF 2009 20000004 db4o EYAL Pe tines 0000009 C3 2009_20000017 E QF 2009_20000005 db4o0 L 3009720000017 Export File Celi 0000010 200920000018 E QF 2009 20000008 db4o 2009 20000030 Normalising c 10000011 C3 2009 20000034 E QF 2009 20000010 db4o E 2009 2000003 1 Imported into 0000012 C3 2009 20000035 E QF 2009 20000016 db40 r2 2009 20000033 Normalising fa 10000013 E QF_2009_20000001 db40 QF 2009 20000017 db40 a 2009 20000034 Imported into 10000014 E QF_2009_20000002 db40 QF 2009 20000035 db40 0000015 E QF 2009 20000003 db40 7 QF_user_list db4o File Name QF 2009 20000035 db40 All Files X D Files of Type QB impor Job QS Process Selected Job DPR User Manual v1 5 odt Page 35 of 106 5 2 2 Normalisation To perform preservation processing 1 Connect the input carrier device with the transfer job from QF to the PF workstation Connect the output carrier device to the PF workstation Log on to DPR see section 2 Log On Select transfer job and click Process Selected Job button to start processing S lt Digital Pr
56. National Archives 1 2 Structure The DPR is a software tool designed to closely reflect the physical infrastructure of the National Archives Digital Archive The process is based around three separate computer systems each with its own database and workstations These three systems are known as Quarantine Facility QF Preservation Facility PF Digital Repository DR The DR stage of processing transfers digital items to the Digital Archive for long term storage To maintain the security of the records the three facilities are not connected to the world at large or to each other In order to move transfer data from one facility to another it must be copied onto a carrier device typically a portable hard drive physically moved from one workstation to another and copied onto the next facility DPR User Manual v1 5 odt Page 10 of 106 1 3 Links with RecordSearch RecordSearch is the National Archives record management system Items in the Digital Archive have two links to RecordSearch transfer job number item number barcode number The transfer job number is represented by the year of entry followed by a slash and an eight digit number for example 2009 00290669 The transfer job number represents one or more items transferred into the Digital Archive at the same time The item barcode number identifies a single item on RecordSearch An item will normally be made up of many data objects Each data object within an it
57. Preservation Recorder 4 0a 1006 Quarantine ian 2 vA x Actions Users Reports Settings Help y Administer Transfer Job 2009 20000012 Transfer Job Number 2009 20000012 Date Created 2009 04 07 13 21 40 125 Created By dpr Number of Data Objects 57 Current Status Initialised from manifest E Delete Transfer Job R Reject Transfer Job O Restart Transfer Job Q Pe Back To Job Selector 5 Toconfirm click Yes button Delete transfer job X Are you sure you wish to delete the transfer job with job number 2009 20000012 The Select Transfer Job window is displayed Note The transfer job is only deleted from this particular facility If a transfer job exists in more than one facility you need to delete it from each facility 9 2 3 Export Transfer Job To export transfer job data from QF or PF to the next facility 1 Connect a carrier device to the appropriate workstation 2 Log on to DPR as an administrator see section 2 Log On 3 Right click on the appropriate transfer job in the table 4 Select Administer Job Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Exclude exported jobs Transfer Job Number gt i Sta
58. Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Restarted in OF 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 Export File G 9 ian Ic1 2009 20000017 Export File B Viewdata 9 ian Ic1 2009 20000020 Export File G Administer Job 9 ian Ic3 2009 20000021 Restarted in U7zT U2 z009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 yp Register a New Transfer Job in DPR d Process Selected Job Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Transfer Job Number Date Created Created By Number of Data Objects Current Status ords 2009 20000016 2009 04 20 09 37 08 028 ian 1 Export File Generated Transfer Jobe DPR User Manual v1 5 odt a E Back To Job Selector Page 86 of 106 The data is displayed in a separate window r l Transfer Job QF Processing Records Transfer Job QF Processing Records Quarantine Audit Data for Processing Attempt 1 Transfer Job Pre Quarantine Process
59. R processing uses a physically separate computer system You must log on to DPR at the appropriate workstation for the processing they need to do When the instructions in this manual say Log on to QF it means to use a QF workstation and to follow the steps below to log on to DPR When the instructions say Log on to QF as an Administrator it means that the task may only be performed by users with administrator permissions see section 9 1 Permissions 2 1 Log on to DPR 1 At the appropriate facility OF PF or DR open DPR Program 2 Type User Name and Password 3 Click the Logon button Digital Preservation Recorder 4 0a 1006 v A x User Details User name user M Enter your username Password eeeeeeee and password Details 4 The Select Transfer Job to Process window is displayed S lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr Yv A x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user AL Filter by status ALL Exclude exported jobs C Transfer Job Number Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000014 Initialised from manifest 16 04 2009 jan Ic1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 2009 20000015 Initialised from manifest 17 04 2009 ian
60. Read Timeout minutes Set Reprocessing Job Prefix Default prefix for Reprocessing Jobs 0000 4 Enter Default Prefix for Reprocessing jobs 2 ki Repository Settings a Us US D Configure Digital Repository Settings Repository Location Read write file system directly Read write using the DPR Server Y server Host Name Server Read Timeout minutes Set Reprocessing Job Prefix Default prefix for Reprocessing Jobs 5 Toreturn to the Select Transfer Job window click Done button 10 3 1 DPR Server configuration If Option 2 is used as specified in section 10 3 for setting up the Repository location then the DPR server will need to be set up and run on the server The DPR server will then copy files from the client to the Repository and renumber Repository directories on a change of Job Number Files needed for the DPR server are e dprclient jar e dprserver conf DPR User Manual v1 5 odt Page 95 of 106 dprserver log conf server sh for the Linux operating systems or server bat for the Windows environment All the above files are located in the same directory as the dprclient jar The following procedure describes how to start the DPR server 1 Copy the above mentioned files to a directory on the machine that will act as the server 2 The configuration file dprserver conf is used to configure the DPR server Depending on your set up you may need to modify the settings in the
61. Transfer job 2009 20000038 created and initialised successfully Read Manifest Step Load data objects from a manifest file 1 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Connecting to virus scanner DPR User Manual v1 5 odt Page 101 of 106 11 4 Restart Job If an error occurs when recording to an output device then the process can be restarted from the beginning of the facility 1 Click the Stop Job button Actions Users Reports Settings Help New Transfer Job Step Create and initialise a new transfer job Transfer job 2012 12563526 created and initialised successfully Read Manifest Step Load data objects from a ma w Exception During Step Processing 1 data objects successfully loaded fror The error below occurred when processing Pre Quarantine Processing z Do you want to stop processing this job or stop this step You can try again after stopping Pre Quarantine Processin Y ids E E 5 nag pena Pre Quarantine Processing exception Scan data objects for viruses E E Bt Q9 c Q9 Details au gov naa digipres dpr task step ProcessingException Exception when attempting to connect to virus scanner on port 9999 t Connecting to virus scanner a au gov naa digipres dpr task step PreQuarantineProcessingStep doProcessing Pre QuarantineProcessingStep java 251
62. age Untested plugin xml 1 text xml XML Untested graffiti sxi 1 application vnd sun xml impress Office Untested graffiti ppt 1 application wnd ms powerpoint Office Untested Copy of test zip 1 application zip Zip Untested 3 dgarro cur 1 image x win bitmap Legacy Image Untested source tar 1 application tar Tar Untested mbox 1 application mbox Email Untested salt ass graph docx 1 application word Office Untested aniagls gif 1 image gif Image Untested Report Outline bin 1 application macbinary MacBinary Untested education html 1 text html HTML Untested An Approach to the Preservation of 1 application vnd ms word Office Untested test wav al audio wav Direct Audio Untested device list2 txt 1 text plain Plaintext Untested weddetails mpp 1 application wnd ms project Microsoft Project Untested Current Data Object Name An Approach to the Preservation of Digital Records June 2002 DOC Status Untested Comments Open Original File Open Normalised File al Pass Fail Cancel If the file type selected does not have a program association specified see section 10 2 2 Configure Program Associations DPR will ask you to enter the location of the viewing program for example Notepad to view text Data Object Media ID MIME Type Normaliser QA State Comments trash sxw 1 application vnd sun xml writer Office Untested ma
63. an not ask it to perform a virus check of the media in a transfer job Ensure that the ClamAV daemon is running For information on installing ClamAV refer to the DPR wiki https sourceforge net apps mediawiki dpr index php title Installing ClamAV 11 1 3 Set the Correct Virus Scanner Port The Virus Scanner Settings in the QF facility must correctly reference the virus scanner port This port number will be different depending on the virus scanner being used See section 10 1 for more information DPR User Manual v1 5 odt Page 98 of 106 11 1 4 Alter the Permissions or Security Policy ClamAV must be able to interrogate the files in the Media directory of the transfer job This means that the permissions set on the directory must be appropriate that is readable and executable Some operating systems may run security software or policies which do not permit ClamAV to work as designed For Linux operating systems these include Apparmor or SELinux Refer to the DPR wiki for more information on permissions and security policies https sourceforge net apps mediawiki dpr index php tilez Troubleshooting ClamAV 11 2 Reject Job If there is an error in the data on the input media from the provider For example e virus or other malware detected Transfer job contents do not match manifest extra missing or damaged data objects e Data object checksums do not match And the only solution is to return the input m
64. are located at the top left of the window e Actions see section 3 Actions Menu Users see section 9 1 Administer Users Reports see section 8 Reports Settings see section 10 Software Configuration e Help Dig Recorder 4 0a 1006 Quarantine dpr vA Select Transfer lob to Pl cess Filter by user Filter by status Exclude exported jobs Transfer Job Number 7 Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr 1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Icl 2009 20000016 Export File Generated 20 04 2009 ian Icl 2009 20000017 Export File Generated 20 04 2009 ian Ic1
65. asic user permissions or administrator permissions The permission determines which DPR functions are available Function User Admin Facility Register New Transfer Job v v QF Import Transfer Job v v PF and DR Copy data for Access v v Create Reprocessing Job v v DR Retrieve amp View Data v v Process Transfer Job v v Generate Report v v QF PF Administer Transfer Job x v and DR Administer User IDs x v Configure Settings X v A user ID that is set as nactive may not access the DPR until their status is reset to Active by an administrator A user with administrator permission may Add new users to DPR and edit the settings of existing users A user ID set up or edited on one facility of the DPR is only valid on that facility The ID information must be exported to the other facilities Normally users are added or edited at the QF stage and exported to PF and DR DPR User Manual v1 5 odt Page 72 of 106 9 1 1 Add User To add a new user 1 Log on to QF as an administrator see section 2 Log On 2 Select Users Administer Users L l Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Select 3 Administer Users rocess Filter by user Filter by status ALL Transfer Job Number DPR user administration This action is disabled when processing a jab 2009 20000001 Export File Generated 23 03 2009 dpr Itc 1 2009 200
66. asks button 3 Click the Change Item Numbers button Actions Users Reports Settings Help y Digital Repository Tasks Perform Reprocessing of AIPs 3 Reprocessing Copy AIPs for Access Copy For Access View Data Model Fel Retrieve and View Data JE Change Item Numbers gt Change Item Numbers 49 Back To Job Selector DPR User Manual v1 5 odt Page 63 of 106 4 Enter the current and the new Item numbers and click on Add button e You can add as many changes as required Select All button will select all rows The Clear Selection button removes selection from the highlighted rows The Remove button will remove all selected highlighted Item number changes from the list Actions Users Reports Settings Help Create a list of item number changes by using the fields below Perform the changes by clicking the Change Item Numbers button NOTE these changes cannot be automatically undone Current Item Number 5 New Item Number 8 Current Item Number New Item Number Select al N Clear Selection Remove i Change Item Numbers Back To Job Selector 5 Click on the Change Item Numbers button A subset of the data objects that will be affected by the change will be displayed in the confirm Item Number Changes window Actions Users Reports Settings Help Create a list of item number changes by using the fields below Perform the changes by
67. ate transfer job in the table DPR User Manual v1 5 odt Page 82 of 106 4 Select Administer Job Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL wv Filter by status ALL y Exclude exported jobs L 5 Click Restart Transfer Job button Transfer Job Number gt Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr tel 2009 20000005 Expor File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Expor File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manife C dpr 11 2009 20000012 Initialised from manife View data dpr Hn 2009 20000014 Initialised from manire MN ian Icl 2009 20000015 Initialised from manife z JU ian Ic1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009
68. cessing Complete 25 03 2009 DR Processing Complete 02 04 2009 2009 20000036 DR Processing Complete 13 05 2009 m o f Cm Cw UR UR UR CC 2009 20001005 DR Processing Complete 26 03 2009 DPR User Manual v1 5 odt Page 104 of 106 11 6 Manifest File Error A manifest file error occurs if the manifest file associated with the incoming transfer job does not match the data objects contained in the input media 11 6 1 File missing from manifest If a transfer job is missing one or more data objects that are listed on the manifest there are three options Actions Users Reports Settings Help Transfer Job 2012 14252363 Job Status Initialised from manifest Processing Status Processing New Transfer Job Step Create and initialise a new transfer job v T pETeEdRUeIEde e Aaa Le RAES ae a Lo o m EJ File missing from media 2 O amp Read Manifest Step The following file could not be found on the media Load data objects from a Filename issues 4th Injury Paper 1 odt w Media ID 1 537 data objects successfully loa Media Location homej toneill testfiles Missingfilemanifest medial records Pre Quarantine Proces vou have the following options Sets Stop Job stop processing this transferjob Scan data objects for virt Change Media change the media location E Scanning issues 4th Injury Paper Mark as Missing mark this file as missing and continue pr
69. configuration file 3 From the command line go to the location of server sh shell script for Linux operating systems or server bat batch file for windows operating systems 4 Run the script to start the server The user profile that is used to run the server should have read write access to the Repository The DPR server component runs on port 30444 10 3 2 DR Database configuration If Option 2 is used as specified in section 10 3 the the repository location will need to be entered into the DR database This option allows multiple repository locations that can be added into the repository locations table in in the Digital Repository database Database table repository_locations values id integer repository id is active boolean true if repository is active false if inactive miminum_free_bytes specifies minimum bytes to spare on the repository location Path text repository location Priority interger specifies which repository to use first File Edit View Tools Help ea Y e 100 rows v pem id is active minimum free bytes path priority PK integer boolean bigint text integer 1 l FALSE 20000 DPR Repository1 2 M2 TRUE 20000 DPR Repository2 3 mM 3 FALSE 20000 DPR Repository3 4 4 4 TRUE 30000 DPR Repository4 5 M5 TRUE 4000 mnt Repository5 1 E Scratch pad DPR User Manual v1 5 odt Page 96 of 106 11 Appendix B Troubleshooting If DPR experiences an error or failure there are s
70. crea Media ID Filename Read Manifest Step 1 ihomejtoneill testfiles Extrafilesmanifest medial records Test Load data objects from a w 278 data objects successfully loa Pre Quarantine Proce Scan data objects for viru e Copying and checksumming yoga Export Stop Current Step Stop Job Continue Uu HERES R 2 Select one of three options to return processing to the start of the Pre Quarantine step see section 11 3 Reset Step click the Stop Current Step button f you think that there is something wrong with the input media or its contents click the Stop Job button to stop the transfer job The transfer job can then be restarted or rejected see section 11 2 Reject Transfer and 11 4 Restart Facility e to proceed with the Quarantine process including the additional data objects as part of the transfer job click the Continue button DPR User Manual v1 5 odt Page 106 of 106
71. ct MIME Type Perform Search Search By Item Number Any v Enter Item Number co Results images 02 prefs menu png 2009 20000010 64003 Data Object File Name Media ID Transfer Job Item Number content viewing html 1 2009 20000010 64001 content xenahelp html al 2009 20000010 64001 images O1 frontscreen png I 2009 20000010 64003 I s Ell 4 Double click the data object you want from the table Ka Back To Job Selector This displays the Data Object Information Panel window containing basic information about the data object You can access additional information about the processing of the data object Click Show QF records button for QF processing data Click Show PF records button for PF Processing Data e Double click an entry in the AIP Information Section to open a separate AIP information window see below Data Object Details Panel v Data Object Information Panel x Data Object Information Transfer Job Number File Name Transfer Job Media ID Mime Type Transfer Job Created By Transfer Job Creation Date Original Data Object Checksum Checksum Algorithm Transfer Job Information 2009 20000010 images O1 frontscreen png 1 image png dpr 2009 04 02 09 31 41 433 423b97557450f4c1f55ffe9535ca91c5 MD5 Transfer Job Number Date Created Created By Number of Data Objects Current Status
72. data objects using the appropriate program If DPR does not know which program to use to view a particular file type the user can specify it using the Choose Program Association dialog Associations between file types can be pre specified using Configure Program Associations To create a Program Association 1 Log on to PF as an administrator see section 2 Log On 2 Select Settings Configure Program Associations S Actions Users Reports Settings Help Digital Preservation Recorder 4 0a 1006 Preservation dpr Select Transfer Jolla ERE ena TEM v Filter by status ALL Exclude exported jobs Transfer Job Number gt eE Created Created By Transport Device Reprocessing Job 1000 20003002 Export File Generated 27 03 2009 dpr X126A oops Itc2 L4 2009 20000001 Export File Generated 23 03 2009 dpr Itc 1 Itc2 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 Itc2 2009 20000003 Export File Generated 25 03 2009 dpr Itc 1 Itc2 L 2009 20000004 Expor File Generated 25 03 2009 dpr Itc 1 Itc2 E 2009 20000005 Export File Generated 26 03 2009 dpr I1 12 2009 20000008 Returned To QF Facility 27 03 2009 dpr I1 12 L 2009 20000010 Export File Generated 02 04 2009 dpr 11 12 2009 20000017 Export File Generated 20 04 2009 ian Ic1 Ic3 X148 NW 2009 20000030 Normalising complete 07 05 2009 ia
73. debe e RM ss UNI EEP MM DM PL 16 PTS BIB Eo IIS Tcr 16 SEPA Fenn athe DII T M G 17 3 2 9 SOLUING the DISDIAV cto bee ia EDS ud erbe amen RN e Im EP REMINDER 18 3 2 4 Selecting a Transrer JOD enin ie c OR e eG Deren Good Rl b pl Oe 18 JO AGEIOBDSSIVIGETUL Gases tb d ir dba ea deci OTET dius uten ten aussen steels diea odium tens dtu unas 19 SRM GMa G OY SCUOLE NEMORE 19 SS PAS Bri HE 20 ee i CVO Lean ce RR TT Un Aas eae eae obo een eae 20 Sd Other Mens uidi ned tau eM MINI II MM MM E LE 21 370 PROCESS INE VIN COW M Rc 22 2 9 tart resume PFO COS SIN aos oeni Dies ee omoes A ee Ses sae eee dp etm Pigs E 23 2 9 2 Pause LOCOS SING iiieoo a TA eoru c dee col StU Ie IE LU ae 23 3 020 EXI UNE the Process WIBGOW e conce teeth putet ERE Pets pen e bcr pred eds Dude pea 24 3 0 Expahaine Error WIESSAGES coated Famula ue epe ivan Gesn na titus guid 24 4 OUARANTINE FACILITY hornii eee a eun E RoR e Eee Eebn ve reU e EUR teehee 25 AP MON CT VOW cen 25 4 PEOGCCSS usus ao id sve assiette lets EO EA A 25 4 2 1 Register Transfer JOD detenti eae Od teen ufi ec V due ata 26 4 2 Ves UA CG uoc rear ieis reser E de a OEC SMOD DILLO RO D pU IC COL OE 2 DPR User Manual v1 5 odt Page 7 of 106 a2 o OS Ca bald Lill D oec Let at deoa de PR UEM ETIN EEUU COE 29 Z
74. dpuser Desktop manifest tsv Browse Output carrier location media X126 local test carrier 1 Browse Output carrier ID Local test 1 Location of first media home dpuser Desktop File Type Samples Browse Lx ancel DPR User Manual v1 5 odt Page 27 of 106 3 If the transfer job consists of several media you will be prompted to select the records in each media device in turn i n Select Media Location m x Enter the location of the media with ID 2 of 5 jhomefalitesting medial records Browse Stop Processing OK Cancel Select the Records directory of the next media Click OK Repeat the above steps until the records of all media are processed DPR compares the contents of the input media to what is listed in the manifest file e calculates a checksum for each object on the input media and compares it to the checksum provided in the manifest file Scans the data objects for viruses or other malware e records the data objects and transfer job file onto the output carrier 4 Click OK button Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Pre Quarantine Processing Passed Processing Status Processing New Transfer Job Step Create and initialise a new transfer job Y Transfer job 2009 20000035 created and initialised successfully Read Manifest Step S Transfer Job Into
75. ed By Transport Device Due Out of Quarantine 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 2000002 4 Initialised from manifest 07 05 2009 ian Ic3 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 2009 20000031 Pre Quarantine Processing Passed 08 05 2009 ian Ic3 05 06 2009 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000001 Export File Generated 23 03 2009 dpr Itcl 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000030 Export File Generated 07 05 2009 ian Ic3 2009 20000020 Export File Generated 07 05 2009 ian Ic3 ap Register a New Transfer Job in DPR d Process Selected Job DPR User Manual v1 5 odt Page 16 of 106 3 2 2 Filtering the Display The display can be filtered so as to
76. ed Job 5 To confirm the addition click the OK button To edit an existing program association 1 Click the Edit button r ES Digital Preservation Recorder 4 0a 1006 Preservation dpr Actions Users Reports Settings Help Select Transfer Job to H l Configure Program Associations MN Am Transfer Job Number 7 MIME Type Associated Program Add 1Device 1000 20003002 Export A lapplication vnd ms excel usr bin ooffice Itc2 2009 20000001 Export application vmd ms word Jusr bin ooffice 2009 20000002 Export audio aiff Jusr bin sweep 2009 20000003 Export laudio mp3 Jusr bin totem Remove 2009 20000004 Export A laudio wav Jusr bin rhythmbox 2009 20000005 Export image gif usr bin gimp 2009 20000008 Returne image pcx usr bin gimp 2009 20000010 Export F image tiff usr bin gimp 2009 20000017 Export A limage unknown usr bin gimp 2009 20000030 Normali jtext plain Jusr bin kate 2009 20000031 Importet text xml usr bin gedit 2009 20000033 Normali 2009 20000034 Importe 2009 20000035 Normali cal test 2 2009 20000036 Export 3 Exclude exported jobs C Reprocessing Job OK I JO Bool qp Import Job k Z Process Selected Job d 2 Edit the MIME type and or program location r Digital Preservation Recorder 4 0a 1006 Preservation dpr id A Actions Users Reports Settings Help SI z Conf
77. ed from manifest 16 04 2009 ian Icl Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 2009 20000017 2009 20000020 2009 20000021 2009 20000022 2009 20000023 2009 20000024 Export File Generated Export File Generated Export File Generated Export File Generated Export File Generated Export File Generated hitialisec from manifest p P 55 Register a New Transfer Job in DPR DPR User Manual v1 5 odt 20 04 2009 20 04 2009 07 05 2009 07 05 2009 07 05 2009 07 05 2009 07 05 2009 ian ian ian ian ian ian ian Icl Ic1 Ic3 Ic3 Ic3 Ic3 Ic3 E Process Selected Job Page 21 of 106 3 5 Processing Window The Processing window displays the current processing step and all completed processing steps lj lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Transfer Job 2009 20000007 Job Status Pre Quarantine Processing Passed Processing Status Paused New Transfer Job Step Create and initialise a new transfer job Read Manifest Step Load data objects from a manifest file Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Handle Stopped Transfer Job in QF Stop processing on the Quarantine Facility Read Manifest Step Load data objects from a manifest file Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the out
78. edia to the controlling agency See also section 11 6 Manifest File Error 1 Click Stop Processing button iij Actions Users Reports Settings Help Transfer Job 2009 20000037 Job Status Initialised from manifest Processing Status Processing File missing from media A x New Transfer Job Step The following file could not be found on the media Create and initialise a new trj Filename simpleO1 txt w Media ID 1 Transfer job 2009 20000037 created Media Location home dpuser local testing test data transfer 09 Read Manifest Step You have the following options ES Um IRR OE T N Stop Processing stop processing this transferjob Load data objects from a ma Change Media change the media location YW Mark as Missing mark this file as missing and continue processing the manifest 1 data objects successfully loaded fro Stop Processing Change Media Mark as Missing Pre Quarantine Processi Scan data objects for viruses check their checksums and set up the output carrier e Scanning and copying simpleO1 txt on media 1 Wu il R 2 Select Reject Job 3 Enter reasons for rejecting the job DPR User Manual v1 5 odt Page 99 of 106 4 Click OK button r mS Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help New Transfer Job Step Create and initialise anewtra l B Properties Required for Handle
79. eeeeeeeeeeseseeeeeeeeeeeenn nnne nnns 49 7 3 Reprocessirig TOM THE ATCHIV ES ucuecceoveexe tee y ARES EEORAN SENE VES ETNE 50 PEO OL d TRITT PH 54 7 5 Retrieve and VIew Metaddtd s eo eu Gu a Ou ea eG Eoi rm E 57 7 5 1 Access the Retrieve and View Data WindOW cccccccccssssssssssssssssseseseeseeeeeees 57 RIP ABUCEOaM T 58 7 5 3 Archival Information Paek8ge coe vette ep DM up E IN CM UA 60 Ted 4 Transfer JOD etes incertis d Pese eh s taies devo imi tu uses va etu s Las sue testes es ved 62 7 99 REDOC CESS NMa JOD suettesdi nennen ctio lundi pudori nori eaa esed ruo Pv dud 63 AO Change Item NUMDEES rods escas a eia ione desean Mas edat ios eid ene ara tede bd ar mE 63 8 REPOR p E 66 NE au 66 0 2 AV alld REPONS seian a prie tad Rte d Ud ono N tai ieee owe di 66 O 9 Ghecksur CHECK El aces Odo v b up Idi Oi dE dt bd dantes 66 9 4 Produce d RepOEboceseasucaxedtetasve E eu atv ret ade Vest dias Cove orpt de Uva ieu 67 8 9 Prod ce Multiple RepOEFS educ aste vr durae res ap au ENS Uu duoi aed Veo ane Rum 70 9 ADMINISERAEION tein erede Gee ie couch cest eed Gee eec sat eed OD e ess easecene aes 72 IFAM UCI E SOS coute avico c M CUPNPIR dra od ao MPH don MH NEEDLE SUD 72 TRTA U G aena TP N 73 Oh 2 TG SOM RE cT 74 FEED iS Bui LIS hrinn TN needa ators 76 DPR User Manual v1 5 odt Page 8 of 106 Le legio Te cR aul ei OP
80. em is given the same item number 1 4 Digital Preservation Workflow The following list contains all stages in the digital preservation workflow 1 4 1 Controlling Agency The following need to be performed by the agency that provides the data to be archived 1 Copy data objects onto input media 2 Create manifest file listing data objects and providing Item Number and MD5 checksum for each data object 3 Create item list for upload into RecordSearch Note National Archives can provide agencies with the Manifest Maker software to perform these functions See Manifest Maker User Manual 1 4 2 Quarantine Facility The steps involved in the QF stage of processing are described in section 4 Quarantine Facility 1 4 3 Preservation Facility The steps involved in the PF stage of processing are described in section 5 Preservation Facility 1 4 4 Digital Repository The steps involved in the DR stage of processing are described in section 6 Digital Repository DPR User Manual v1 5 odt Page 11 of 106 1 4 5 Workflow Diagram The following diagram describes the DPR workflow across the three processing stages ManualTasks Automated Tasks Pre quarantine Register Transfer Job i Checksums Virus scan Post quarantine Checksums Virus scan Quarantine Export Transfer Job QF PF Carrier E Import Transfer Job Binary Normalisation Preservation Export Transfer Job
81. ena Files alder Location hamejtoneaill testfiles DR Back To Job Selector 9 Click the Perform Copy button to copy the AIPs to the output folder l The output will be sorted into folders by item barcode number DPR User Manual v1 5 odt Page 56 of 106 7 5 Retrieve and View Metadata DPR collects metadata on all the processing undergone by data in the archiving workflow Each DPR facility QF PF and DR produces audit information for the processing done in that facility DR holds all the audit information from the previous facilities as well as storing data on objects and AIPs 7 5 1 Access the Retrieve and View Data Window To open the Retrieve and View Data window 1 Log on to DPR at the DR workstation see section 2 Log On 2 Click the Perform DR Tasks button 3 Click the Retrieve and View Data button Actions Users Reports Settings Help 7 Digital Repository Tasks Perform Reprocessing of AIPs O Reprocessing Copy AIPs for Access Copy For Access mea View Data Model Retrieve and View Data 5 Ca OL lt lt b Change Item Numbers Change Item Numbers eT Back To Job Selector DPR User Manual v1 5 odt Page 57 of 106 4 The Retrieve and View Data window has four tabs Select a tab to display the options for that category of metadata Data Object Archival Information Package Transfer Job Reprocessing Job S Digital Preservation Recorder 4 0a 1006 Digital Repository
82. enen 97 112 Sq e OD EUER TEC E 97 Toes CS COL Da T T a EN 99 TCA R start Jo Derisa en e T EEEO ETT ETT 100 11 5 Return tor Reprocessing uooasascvetatia diet i dna a TOT CR UO 101 ILOG Manifes tE UCE OT ona A E TOO 103 11 6 1 File mussime TOM FBafttFes Esos ec oes ea lepore Pa e de Pap ded Reed OP a a 103 TEG Extra Tiles round Op INGO Ay sese evade estratos tese odii e m VM ters pta e OS 104 DPR User Manual v1 5 odt Page 9 of 106 1 Overview The DPR provides the workflow and functionality to convert store and retrieve data objects The National Archives process is based around three separate stages Quarantine Facility QF Preservation Facility PF Digital Repository DR The DPR uses Xena digital preservation software to convert files into preservation formats Xena Is another digital preservation tool developed by the National Archives 1 1 Methodology The National Archives approach to the preservation of data objects is to convert them into openly specified file formats to ensure access to their contents in the future The open formats are based on standards have full specifications that are publicly documented and are interoperable with a range of software applications The Digital Preservation Recorder DPR provides the workflow and functionality to convert store and retrieve data objects The use of open file formats allows others to build tools capable of presenting or re purposing data preserved by the
83. er Manual v1 5 odt disconnect the carrier device Page 85 of 106 9 3 View Metadata In each of the three facilities QF PF and DR you can view the metadata associated with each transfer job Each facility can display metadata created by its own processing as well as the metadata imported from previous facilities For example PF has metadata available from PF and QF processing but not DR DR has metadata from all the facilities plus the additional data available through the Retrieve and View Data feature see section 7 5 Retrieve and View Data To view transfer job metadata 1 Log on to the facility see section 2 Log On 2 Right click on the transfer job in the table 3 Select View Data S Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL v Exclude exported jobs C Transfer Job Number gt Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 a 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 ze 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr Itcl 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre
84. eservation Recorder 4 0a 1006 Preservation ian o Yv A x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Exclude exported jobs C Transfer Job Number 7 Status Date Created Created By Transport Device Reprocessing Job 1000 20003002 Expor File Generated 27 03 2009 dpr X126A oops Itc2 iv 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 Itc2 L 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 Itc2 O 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 Itc2 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 Itc2 2009 20000005 Export File Generated 26 03 2009 dpr 12712 B 2009 20000008 Returned To OF Facility 27 03 2009 dpr 12712 L 2009 20000010 Export File Generated 02 04 2009 dpr 11 12 55 2009 20000017 Export File Generated 20 04 2009 ian Ic1 Ic3 X148 LJ 2009 20000030 Normalising complete 07 05 2009 ian Ic3 Ic3 too 55 2009 20000031 Imported into PF 07 05 2009 ian Ic3 L 2009 20000033 Normalising failed 08 05 2009 ian Ic3 Ic3 2009 20000034 Imported into PF 11 05 2009 dpr a 2009 20000035 Imported into PF 13 05 2009 ian Local test 1 P Import Job E Process Selected Job A DPR calculates a checksum for each data object in the transfer job and compares it to the checksum provided in the transfer job file 5 Click Process button Digital Prese
85. everal different ways to deal with the problem Facility Situation Solution QF Exception when attempting to Review virus scanner installation and connect to virus scanner operation See section 11 1 QF Error in data on input media from Reject Job provider sucmAS Cease processing and return the transfer e Virus or other malware job to the provider Betecice See section11 2 e Data object checksums do not match OF PF and DR Error during processing such as Reset Step e Incorrect settings Abandons processing of current step and Error with Plugin or other returns to the end of the previously completed step related software See section11 3 OF PF and DR Error recording data to output media Restart Job Stops processing and restarts from the import transfer job step within the current facility See section 11 4 PF and DR Error reading data from input carrier Return for reprocessing Data corruption occurred during TA facili rocessing in previous facility Stops processing in current facility a p l new step is recorded Returned to QF PF for reprocessing Transfer Job must be reprocessed in the appropriate prior facility See section 11 5 QF Data on input media from provider DPR provides a list of the missing or does not match the manifest file additional data objects You can export this list for reference The options Reject Reset and Restart are then available See section 11 6
86. f the Digital Archive also stores metadata about the archived material This metadata can be accessed on data objects AIPs transfer jobs and reprocessing jobs Change Item Numbers Item numbers barcodes of the Data Objects stored in the Digital Archive can be corrected using the Change Item Numbers task Only users with administrator permissions will be able to perform this task 7 2 Access Digital Repository Task Panel 1 Log on to DPR at the DR workstation see section 2 Log On 2 Click the Perform DR Tasks button DPR User Manual v1 5 odt Page 48 of 106 S lt Digital Preservation Recorder 4 0a 1006 Digital Repository ian vA x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Transfer Job Number gt Status Date Created Created By Transport Device Reprocessing Job 1000 10000001 Reprocessing Job Sent 31 03 2009 dpr v 1000 20003002 Imported into DR 27 03 2009 dpr iv 2009 20000001 Imported into DR 23 03 2009 dpr Itc2 Es 2009 20000002 Imported into DR 23 03 2009 dpr Itc2 a 2009 20000003 DR Processing Complete 25 03 2009 dpr Itc2 E 2009 20000004 DR Processing Complete 25 03 2009 dpr Itc2 ve 2009 20000010 DR Processing Complete 02 04 2009 dpr I2 5 2009 20000036 DR Processing Complete 13 05 2009 ian Ic2 LJ 2009 20001005 DR Processing Complete 26 03 2009 dpr I2
87. fer Job To re process a transfer job that has completed processing on this facility Note This is only useful if the transfer job has been returned for reprocessing from another facility If not you will not be able to re import the transfer job into that facility 1 Connect a carrier device to the QF workstation 2 Log on to DPR as an administrator see section 2 Log On 3 Right click on the appropriate transfer job in the table 4 Select Administer Job DPR User Manual v1 5 odt ES Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL Exclude exported jobs C Transfer Job Number gt Status Date Created Created By Transport Device Due Out of Quarantine 6 Rejected in QF 20098 dpr II 2009 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Expor File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr 1 2009 20000012 Initialised from manifest 07 04 2009 dpr 1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Icl 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Expo
88. ge 19 of 106 3 3 2 Log Out To log out 1 Select Actions Log Out Digital Preservation Recorder 4 0a 1006 Quarantine dpr Reports Settings Actions Users Help e Change Password to Process Fiterbyuser ALL v 7 Log Out cd Date Created xport File Generated 23 03 2009 2009 20000002 Export File Generated 23 03 2009 2009 20000003 Export File Generated 25 03 2009 2009 20000004 Export File Generated 25 03 2009 2009 20000005 Export File Generated 26 03 2009 2009 20000006 Rejected in QF ef fO3 2009 2009 2 0000007 Pre Quarantine Processi 27 03 2009 2009 2 0000008 Restated in OF 27 03 2009 Filti This ends the current session and returns you to the Log On window 3 3 3 Quit To exit a facility 1 Select Actions Quit S Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help e Change Password to Process Fiterbyuser ALL ln Date Created ITE port File Generated 23 03 2009 2009 2000000 2 Export File Generated 23 03 2009 2009 20000003 Export File Generated 25 03 2009 2009 2 0000004 Export File Generated 25 03 2009 2009 20000005 Export File Generated 26 03 2009 2009 20000006 Rejected in OF of f03 2009 A009 2000000 Pre Quarantine Processi 27 03 2009 2009 2 0000008 Restated in QF 27103 2009 This ends the current session and closes the program DPR User Manual v1 5 odt Page 20 of 106 3 4 Other Menus The following menus
89. gital Repository Copy the AIPs to the repository and verify their checksums 2 AIPs successfully copied to repository Mark DR Processing Complete Mark DR Processing complete DR processing successfully marked complete 5 Disconnect the input carrier device from the network The archiving process is now complete DPR User Manual v1 5 odt Page 47 of 106 7 Digital Repository Tasks This section describes the tasks that you can perform within DR 7 1 Overview The DR facility has three supplementary functions accessed through the Digital Repository Task window Reprocessing Some kinds of data objects may not be able to be normalised to the required level of quality in the preservation process These objects are still stored in the Digital Archive in binary format Future enhancements to the normalisation functions may allow the opportunity to re visit these objects and perform preservation again to improved effect Copy for Access Data objects that are stored in the Digital Archive can be retrieved and copied onto a carrier device To access an object you need the item number barcode provided by the National Archives Record Handling Unit Both normalised objects and original binary normalised objects may be accessed Data Objects copied from the repository are in xena format which means they must be rendered using Xena or Xena Viewer software Retrieve and view metadata In addition to the archived data itsel
90. gs Help LJ Digital Preservation Recorder 4 0a 1006 Digital Repository ian E Back To Job Selector Search for archived AIPs by ID Data Object Archival Information Package Transfer Job Reprocessing Job Enter AIP ID 338187 Entries Extra Oa5 le Showing 1 of 29808 AIPs in Repository Results C 9 15 Status Type 20090402094338187 Entries Extra 0a5 1e184 Available Normalisation DPR User Manual v1 5 odt E Back To Job Selectord Page 60 of 106 5 Double click on the AIP that you want information on This displays the A P Information window vA x AIP Information S AIP Information for 20090402094338187 Entries Extra 0a51e184 AIP ID 20090402094338187 Entries Extra 0a5 1e184 AIP Information AIP Type Normalisation Status Available Date into Quest 2009 04 02T10 33 464 11 00 Creation Information Xena Version 4 2 1 Normaliser Name Plaintext Normaliser Version 4 2 1 AIP Records Preservation Processing reco Repository Processing recorm Source Data Objects I 3 Transfer Job File Name RecordSearch Barcode Mime Type Date Finalised 2009 20000010 Entries Extra 64000 text plain 02 04 2009 Embedded Qhieg Mime Type Normaliser Name Normaliser Version Related AIPs AIP Type Status Normaliser Name Normaliser Version i
91. he Pass button otherwise click the Fail button Data Object Media ID MIME Type Normaliser QA State Comments mMT I x rrragey sve AAT stro trash sxw 1 application wnd sun xml writer Office Untested manifest tsv 1 text csv CSV Untested multipage tif 1 image tiff Image Untested trash sxc 1 application wnd sun xml calc Office Untested layout psd 1 image photoshop Legacy Image Untested plugin xml 1 text xml XML Untested qraffiti sxi 1 application vnd sun xmLimpress Office Untested graffiti ppt 1 application vnd ms powerpoint Office Untested Copy of test zip 1 application zip Zip Untested 3 dgarro cur 1 image x win bitmap Legacy Image Untested source tar application tar Tar Untested mbox 1 application mbox Email Untested salt ass graph docx i application word Office Untested aniagls gif 1 image gif Image Untested Report_Outline bin 1 application macbinary MacBinary Untested trim x154 4 L text html HTML Untested An Approach to the Preservation 1 application wnd ms word Office Untested test wav 1 audio wav Direct Audio Untested CSS CSS i text plain Plaintext Untested weddetails mpp iL application vnd ms project Microsoft Project Untested She s A Woman mp3 1 audio mp3 Converted Audio Untested Dell Wallpaper BMP 1 image bmp Image Untested libpst 0 5 1 tar gz 1 application gzip GZip Untested datal2_3 nf 1 application rtf Office Untested output aif 1 audio aiff Direct Audio Untested Current Data Object
92. ian Ic3 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 E Register a New Transfer Job in DPR Z Process Selected Job LI Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help _y Administer Transfer Job 2009 20000011 Transfer Job Number Date Created Created By 2009 20000011 2009 04 02 11 04 05 828 dpr Number of Data Objects 3 Current Status Initialised from manifest Delete Transfer Job Q Reject Transfer Job O Restart Transfer Job Back To Job Selector 6 Enter the reason for re processing the transfer job 7 Click OK button Restart transfer job Enter the reason for restarting the transfer job 2009 200000 11 QF Processing problem pT O 5 0 0n camel DPR User Manual v1 5 odt Page 83 of 106 8 You will return to the Select Transfer Job window The transfer job now has a status of Restarted in xx Select the transfer job and click Process selected Job button to begin processing ij Digital Preservation Recorder 4 0a 1006 Quarantine ian v A x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL v Exclude exported jobs Transfer Job Number gt S
93. icking the red x to the right of the criteria listing Selection Criteria Criteria Define a new search criteria where data object mime type is audio flac where data object mime type is audio mp3 where data object mime type is audio flac Ey 7 Enter the reprocessing job details e Job Number format is NNNN NNNNNNNNN the first four digits default to the value set under the Update Repository Settings menu Click the Suggest Job Number button for a number incremented from the last reprocessing job number used Reason for Reprocessing Output Location location of the carrier device P j lt Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Create Reprocessing Job Enter Job Number 1000 20003003 Suggest Job Number Selection Criteria Criteria Define a new search criteria where data object mime type lis audio flac xj Add criteria where data object mime type is audio mp3 3 where data object mime type is audio flac F Reprocessing Reason Reason for Reprocessing Audio normalisation testing Output Location Enter Carrier Location media X126 Carrier X126 A Browse Preview Preview Copy AIPs Q Create Reprocessing Job v E Back To Job Selector DPR User Manual v1 5 odt Page 52 of 106 8 Optional
94. ier device from the workstation 4 Disconnect the output carrier device from the workstation The output carrier is now the input carrier device for the DR stage DPR User Manual v1 5 odt Page 44 of 106 6 Digital Repository 6 1 Overview The purpose of the DR stage is to confirm that the data objects match exactly what was processed in PF copy the transfer job including the manifest and all data objects into the Digital Archive for long term storage allow the retrieval of data objects AIPs from the Digital Archive provide access to metadata on the transfer job and data objects enable the selection of data objects for re processing The DR functions are supported by the Checksum Checker software This is a separate program that performs regular checks of the data stored in the Digital Archive 6 2 Process The DR stage can be described as follows steps in italics are performed or initiated by the user the others happen automatically 1 The user connects the input carrier device to the DR and imports the transfer Job 2 he data objects are checked against the checksums calculated in the preservation stage 3 The transfer job including the metadata and data objects is recorded to the Digital Archive The user disconnects the input carrier device from the system 5 The archiving process is now complete 6 2 1 Import Transfer Job To import a transfer job into the DR 1 Connect the input carrier device with
95. igure Program Associations a X Select Transfer Job to Pr Transfer Job Number 7 Exclude exported jobs C 1000 20003002 2009 20000001 2009 20000002 2009 20000003 2009 20000004 2009 20000005 2009 20000008 2009 20000010 2009 20000017 2009 20000030 2009 20000031 2009 20000033 2009 20000034 2009 20000035 2009 20000036 MIME Type Associated Program Add Device Reprocessing Job Export Fil application vnd ms excel usr bin ooffice gt v Export Fil application wnd ms word usr bin ooffice Edit r4 Export Fi 8udio aiff usr bin sweep Export Fil 8udio mp3 usr bin totem E Expa Edit Program Association Expo LI iex Modify the MIME type program association Expor MIME Type limage svg L Norm Lj Impor Program path Jusr bin gimp Browse Norm Impo Cancel Norma are g Export Fil E 4p Import Job Z Process Selected Job 3 To confirm the changes click the OK button DPR User Manual v1 5 odt Page 92 of 106 To delete an existing Program Association 1 Select the Program Association from the table 2 Click the Remove button r m Digital Preservation Recorder 4 0a 1006 Preservation dpr Actions Users Reports Settings Help Select Transfer Job to Transfer Job Number gt S Configure Program Associations x Exclude e
96. igure the normalisation settings Advanced normalisation is useful where Xena has a plugin able to normalise the data object but has misidentified it for some reason there is some data corruption or you want to use a specific normaliser plugin You can use advanced normalisation when e adata objects MIME type is not correctly identified e a data object includes corrupted file extension or data e you want to manually specify the normaliser used on a data object To perform advanced normalisation 1 Click the Advanced Normalisation button Actions Users Reports Settings Help Transfer Job 2012 14523636 Job Status Binary Normalising Complete Processing Status Processing PF Checksum Validation Verify data object checksums on the carrier 1 data object checksums successfully Normalisation Complete woe GS Set ti C The normalisation process finished successfully et Up Preservation Carrio can perform Advanced Normalisation or save the results Creates the directory structu Advanced Normalisatiori ontinue Preservation carrier set up successfully Binary Normalisation Binary normalise data objects 1 data objects successfully binary normalised Transfer Job Normalisation Performs preservation normalisation of all data objects Q X X X Normalising DS5C 0001 JPG Wu Pause C3 2 To narrow the list of data objects click the checkbox and select a search criterion from the drop down list
97. ing Data Carrier ID Icl Pre Quarantine Processing Status Passed Pre Quarantine Processing Completion Date 2009 04 20 11 16 53 212 Pre Quarantine Processing By ian Virus Checker Name FAKESCANNER Virus Checker Version 0 777 Virus Definitions Version 1234 Virus Definitions Current true Into Quarantine Information Put into Quarantine by ian Date into Quarantine 2009 04 20 11 16 53 212 Expected Date out 2009 05 18 00 00 00 0 Reason for quarantine period Out Of Quarantine Information Out of Quarantine By ian Out of Quarantine Date 2009 04 20 11 17 08 375 Expected Date out 2009 05 18 00 00 00 0 Resaon for early removal from quarantine FakeScanner testing Transfer Job Post Quarantine Processing Data Post Quarantine Processing Status Passed Post Quarantine Processing Completion Date 2009 04 20 11 17 08 003 Post Quarantine Processing By ian Virus Checker Name F AKESCANNER Virus Checker Version 0 777 Virus Definitions Version 1234 Virus Definitions Current true Marked Completed Information Marked Completed By ian Marked Completed Date 2009 04 20 11 17 08 399 Completion Comments Close Window 5 Click Close Window button 6 To return to the Select Transfer Job window click the Back to Job Selector button Actions Users Reports Settings Help Transfer Job Number 2009 20000016 Date Created 2009 04 20 09 37 08 028 Created By ian Number of
98. ions Users Reports Settings Help Select 22 Administer Users rocess Filter by user Filter by status ALL Transfer Job Number 2009 20000001 Export File Generated 23 03 2009 dpr Itc 1 2009 20000002 Export File Generated 23 03 2009 dpr tcl 2009 2 0000003 Export File Generated 25 03 2009 dpr Itc 1 20089 20000004 Export File Generated 25 03 2009 dpr Itc 1 ace aT 47e 4 TA 0 0 0 0 m m rn a4 o a4 4o 3 Select the appropriate user and click Edit User button lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr vA x Actions Users Reports Settings Help Add and Edit Users User Name First Name Last Name Active dpr Mr Bootstrap vi user sample user vi admin sample admin vi max max moo vi johnl john v ian lan Little v john john lovejoy L4 jack Jack Burton vi Add User CC emus 75 Export User List Import User List Done DPR User Manual v1 5 odt Page 74 of 106 4 Update User Details fields User details X x A Edit Details of Jack Burton User Details User Name jack Confirm password esses eese User is active Permissions Administration Permission Coe pes 5 Click the OK button The Add and Edit Users window is displayed 6 To return to the Select Transfer Job window click the Done button DPR User Manual v1 5 odt Page 75 of 106 9 1 3 Export User Lis
99. mat QA format Xena plugin exists for Original format Converted to open format Yes proprietary object type e g doc e g odt Xena plugin exists for Original format Original format NO approved open format object type e g Jpg e g Jpg No Xena plugin for object Original format Original format No YPE e g cad e g cad Xena plugin unable to Original format Not created No normalise object Try Advanced Normalisation 5 1 2 Binary Quality Assurance After binary normalisation the binary normalised objects are compared to the objects on the input carrier to check that they are encoded accurately This is an automated process 5 1 3 Quality Assurance The user must perform manual quality assurance on a subset of the data objects contained in the transfer job Only data objects that have been normalised are sampled for quality assurance The system samples data objects based on the proportion of objects of each MIME type found in the transfer job The system samples at least one and no more than twenty data objects from each MIME type present For an overview on what kinds of data objects are selected for quality assurance see section 5 1 1 Normalisation and AIPS This step requires the user to compare the original and normalised versions of the files to ensure that the normalisation process was successful The possible results of quality assurance are Pass or Fail only Recording a Fail result will cause the tra
100. n Ic3 Ic3 too Lj 2009 20000031 Imported into PF 07 05 2009 ian Ic3 2009 20000033 Normalising failed 08 05 2009 ian Ic3 Ic3 L 2009 20000034 Imported into PF 11 05 2009 dpr Ic3 2009 20000035 Normalising failed 13 05 2009 ian Local test 1 Local test 2 E 2009 20000036 Export File Generated 13 05 2009 ian Ic1 Ic2 a Import Job op Process Selected Job 3 To create a new program association click the Add button Digital Preservatio Actions Users Reports n Rec order 4 0a 1006 Settings Help ervation dpr Select Transfer Job to Process Fiter by user Transfer Job Number 7 1000 20003002 2009 20000001 2009 20000002 2009 20000003 2009 20000004 2009 20000005 2009 20000008 2009 20000010 2009 20000017 2009 20000030 2009 20000031 2009 20000033 2009 20000034 2009 20000035 2009 20000036 ALL Filter by status ALL 2 Exclude exported jobs X port Device Reprocessing Job S Configure Program Associations Expo Expo MIME Type Associated Program Expo japplication vnd ms excel usr bin ooffice Expo j application vnd ms word usr bin ooffice Expo jaudio aiff usr bin sweep Expo laudio mp3 usr bin totem Retu jaudio wav usr bin rhythmbox Expo image gif usr bin gimp Expo limage pcx usr bin gimp Nor image svg usr bin gimp Impo jimage tiff usr bin gimp Nor image unknown usr bin gimp Impo
101. n html format Page 68 of 106 6 Click the Export to CSV button to save the report in CSV format The Report is saved with the filename yyyy mm dd hh mm report type gt csv FJ 2009 05 12 14 53 55 User Report csv OpenOffice org Calc vA File Edit View Insert Format Tools Data Window Help i Daa hear om oj 1817 21 it g Nimbus Sans L 110 B o Ug z E LJ 36 000 00 E Al poi E Z username OOOO A SS E ransfer Job Number Tasks Performed 2009 20000004 Created Put into Quarantine Marked Completed 2009 20000009 Created 2009 20000034 Created Created 2009 20000006 Created Put into Quarantine Rejected 2009 20000003 Created Put into Quarantine Marked Completed 2009 20000007 Created Restarted Created Put into Quarantine 2009 2000001 1 Created Created 2009 20000008 Created Put into Quarantine Marked Completed Created 2009 20000001 Created Put into Quarantine Marked Completed 2009 2000001 0 Created Put into Quarantine Marked Completed 2009 20000012 Created 2009 20000002 Created Put into Quarantine Marked Completed 2009 20000005 Created Put into Quarantine Marked Completed 2009 2000001 1 Put into Quarantine ian 2009 20000016 Created Put into Quarantine Marked Completed 4 vSheetl ll zi Sheet 1 1 Default STD Sum 0 9 1009 7 f you select a Calendar Month Quarterly or Financial Year report choose the time frame fr
102. nce the DR processing is complete e Export Transfer Job The Transfer Job data is normally exported from QF and PF at the end of each respective workflow This data can be re exported if another copy is needed for any reason see section 11 Error Handling e Reprocess Transfer Job If a transfer job has been returned to QF from PF or returned to PF from DR see section 11 Error Handling the transfer job needs to be re processed e Restart Transfer Job If a transfer job has not completed processing in a facility it can be restarted within that facility Note As DPR operates on three separate networks deleting or changing a transfer job only affects the records on the current network 9 2 1 Change Transfer Job Number To change a transfer job Number 1 Log on to DR as an administrator see section 2 Log On 2 Right click on the appropriate transfer job in the table r S lt Digital Preservation Recorder 4 0a 1006 Digital Repository ian Yv A x Actions Users Reports Settings Help Select Transfer Job to Process Filter by user ALL Filter by status ALL _Transfer Job Numbers Status DateCreated CreatedBy Transport Device Reprocessing Job 1000 10000001 Reprocessing Job Sent To 31 03 2009 dpr vi 2009 20000001 Imported into DR 23 03 2009 dpr Itc2 2009 20000002 Imported into DR 23 03 2009 dpr Itc2 2009 20000003 DR mm o i dpr I
103. nifest tsv 1 text csv CSV Untested multipage tif 1 image tiff Image Untested trash sxc T application wvnd sun xml calc Office Untested layout psd 1 image photoshop Legacy Image Untested plugin xml T text xml XML Untested graffiti sxi T application wnd sun xml impress Office Untested graffiti ppt jJ application vnd ms powerpoint Office Untested Copy of test zip al application zip Zip Untested 3dgarro cur al image x win bitmap Legacy Image Untested source tar al application tar Tar Untested mbox 1 application mbox Email Untested salt ass graph docx 1 application word Office Untested aniagls gif 1 image gif Image Untested Report_Outline bin i i i i trim x154 4 Choose Program Association An Approach to the Pr test wav This mime type does not currently have an associated program css css Enter the full path of the program to be associated with it weddetails mpp She s A Woman mp3 MIME Type application vnd ms word Dell Wallpaper BMP 7 libpst 0 5 1 tar gz Program path datal2_3 nf output aif OK cancel Current Data Object Name An Approach to the Preservation of Digital Records June 2002 DOC Status Untested Comments Open Original File Open Normalised File Pass Fail Cancel DPR User Manual v1 5 odt Page 41 of 106 The appropriate program will open the original pre normalisation version of the file MET Approach to the Preservation of Digital Records June 2002 DOC Microsoft Word DBR i Bile Edit Vie
104. ns Users Reports Settings Help Select Transfer Job to Process Filter by user ALL w Filter by status ALL v Exclude exported jobs Transfer Job Number Status Date Created Created By Transport Device Due Out of Quarantine Rejected in OF 27 03 dpr I1 24 04 2009 a 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr l1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr l1 2009 20000012 Initialised from manifest 07 04 2009 dpr l1 2009 20000014 Initialised from manifest 16 04 2009 ian Icl 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Icl 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000024 Initialised from manifest 07 05 2009 ian Ic3 2009 20000030 Restarted in QF 07 05 2009 ian 2009 20000031 Restarted in QF 08 05 2009 ian Ic3 2 2009 20000032 Initialised from manifest 08 05 2009 ian 3 Es 2009 20000034 Restarted in QF 11 05 2009 dpr p i E Register a New Transfer Job in DPR C Qi Process selected job gt 9 Complete QF processing See section 4 Quarantine Facility and DPR Us
105. nsfer job to record that the normalisation process failed for that data object DPR User Manual v1 5 odt Page 33 of 106 Quality assurance is a necessarily subjective process It is up to the user to judge if any alteration to an object s content or appearance can be determined to be acceptable What is or is not acceptable must be considered in terms of the original creator s intent and the capabilities and requirements of the archive Is there any information in the original that is changed or lost in the normalised version This could be a loss or change in text in a document a loss of detail in an image or a drop in sound quality in a recording Is there any loss or change in formatting In a document is the numbering or paragraph format the same in the normalised version Many forms of document have additional data such as author time date stamps or update history Are these still present 5 2 Process The following steps describe PF processing steps in italics are performed or initiated by the user the others happen automatically 1 The user connects the input carrier device to the PF and imports the transfer Job 2 The data objects are checked against the checksums created in OF 3 The Xena software binary normalises each data object Normalised data objects are created for each original data object where the Xena software has a normaliser for that object type If the original data object is already in an open format
106. ntine before the due date A reason for doing so must be entered New Transfer Job Step Create and initialise a new transfer jo Details Really good reason Read Manifest Step Load data objects from a manifest fil Pre Quarantine Processing Scan data objects for viruses check t ok ance Post Quarantine Processing Scan data objects for viruses and check their checksums RO Quarantine processing is complete DPR User Manual v1 5 odt Page 30 of 106 4 2 4 Export Transfer Job To export a transfer Job 1 Click Done button return to Select Transfer Job window j lt Digital Preservation Recorder 4 0a 1006 Quarantine ian vA x Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Export File Generated Processing Status Finished New Transfer Job Step Create and initialise a new transfer job Read Manifest Step Load data objects from a manifest file Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier Post Quarantine Processing Scan data objects for viruses and check their checksums Post quarantine processing successfully completed 66 data objects verified Mark QF Processing Complete Mark processing complete on the Quarantine Facility and export transfer job information l I i QF processing successfully marked complete p O o 3 iD A QO
107. o Quarantine Created Created Put into Quarantine Marked Co Marked Co y Marked Co A Marked Co Rejected Put into Qu Marked Co E Marked Co Marked Co Restarted Put into Quarantine Marked Completed The report is saved with the filename yyyy mm dd hh mm report type html wQo 6 file home dpuser Desktop Stuff 2009 05 12 14 52 55 User Reporthtr Ww G w Google fal Most Visited v Smart Bookmarks v Getting Started A Latest Headlines v User Report User Name Transfer Job Number dpr dpr dpr dpr dpr dpr dpr dpr dpr dpr dpr dpr Done 2009 20000004 2009 20000009 2009 20000034 2009 20000006 2009 20000003 2009 20000007 2009 2000001 1 2009 20000008 2009 20000001 2009 2000001 0 2009 2000001 2 2009 20000002 DPR User Manual v1 5 odt Tasks Performed Created Put into Quarantine Marked Completed Created Created Created Created Put into Quarantine Rejected Created Put into Quarantine Marked Completed Created Restarted Created Put into Quarantine Created Created Created Put into Quarantine Marked Completed Created Created Put into Quarantine Marked Completed Created Put into Quarantine Marked Completed Created Created Put into Quarantine Marked Completed 4 Click the Show Report Button to display the report in a window DPR Report 5 Click the Export to HTML button to save the report i
108. ocessing the manifest Stop Job Change Media Mark as Missing UU Pause 3 e f you think that there is something wrong with the input media or its contents e click the Stop Job button to stop the transfer job The transfer job can then be reset restarted or rejected see sections 11 2 Reject Transfer 11 3 Reset Step and 11 4 Restart Facility If you are using the incorrect input media e click the Change Media button replace the input media and then continue processing e If you need to know which files are missing from the manifest e click the Mark as Missing button This will compile a list of all files missing from the carrier This list can be exported as a text file for reference You may then either reset or stop the transfer job DPR User Manual v1 5 odt Page 105 of 106 11 6 2 Extra files found on media If there are data objects on the input media that are not listed in the manifest file a list of the additional files is displayed 1 To save the list of additional data objects as a text file click the Export button Actions Users Reports Settings Help Transfer Job 2012 12523636 Job Status Initialised from manifest Processing Status Processing New Transfer Job Step Create and initialise a ne gy Extra files found on media v y S w i The following files were found on the media device but are not a part of the manifest Transfer job 2012 12523636
109. of 106 5 To return to the Add and Edit Users window click the Save button ire ie nnn x Save I checksum checker C3 local testing C3 Templates Cy Desktop manifest maker C3 Video Proje Documents Ca Music Videos 3 dpr PDF L3 xena 4 2 s dpr openjdk C3 Pictures Documents C3 Public Documents Cal RollingChecker 0903260943 E dpr ancha Source dpr anglerf Ge File Name QF user list 2009 05 08 151501 db4o Files of Type All Files 6 To return to the Select Transfer Job window click the Done button 7 Remove the carrier device 9 1 4 Import User List To import an updated list of users to a DPR facility QF PF or DR 1 Connect the carrier device holding the updated user list to the appropriate workstation 2 Log on to that facility as an administrator See section 2 Log On 3 Select Users Administer Users Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help Select Administer Users rocess Filter by user Filter by status ALL Transfer Job Number 2009 20000001 Export File Generated 23 03 2009 dpr Itc 1 2009 20000002 Export File Generated 23 03 2009 dpr Itc 1 2009 20000003 Export File Generated 25 03 2009 dpr Itc 1 20089 20000004 Export File Generated 25 03 2009 dpr Itc 1 Lr a a a i a4 o ee o 4 Click Import User List button r S lt Digital Preservation Recorder 4 0a 1006 Quarantine dpr v A x Ac
110. of the step Actions Users Reports Settings Help Transfer Job 2009 20000034 Job Status Initialised from manifest Processing Status Processing New Transfer Job Step Create and initialise a new transfer job Y Transfer job 2009 20000034 created and initialised successfully Read Manifest Step Load data objects from a manifest file w 66 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier O O0 DG Retrieving Data Object list DPR User Manual v1 5 odt Page 23 of 106 3 5 3 Exiting the Process Window When the system is not processing you can click the Done button to return to the Select Transfer Job window j lt Digital Preservation Recorder 4 0a 1006 Quarantine vA x Actions Users Reports Settings Help 2009 20000030 Job Status Pre Quarantine Processing Passed Processing Status Paused New Transfer Job Step Create and initialise a new transfer job w Transfer job 2009 20000030 created and initialised successfully Read Manifest Step Load data objects from a manifest file w 1 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier w Pre quarantine processing successfully completed 1 data objects verified 3 6 Expanding Error Messages Er
111. om the drop list s and click the OK button to confirm Calendar Month Flease select the calendar month for this repart e spo Quarterly Please select the quarter for this repart Financial Year Please select the financial year for this repart DPR User Manual v1 5 odt Page 69 of 106 8 5 Produce Multiple Reports To produce more than one report at a time 1 Log on to the relevant DPR facility see section 2 Log On 2 Select Generate Report from the Reports menu Actions Users Reports Settings Help Select Tran Aie Bas 5 Filter by user ALL Filter by status ALL v Exclude exported jobs Transfer Job Number gt Stat Generate DPR reports This action is disabled when processing a job Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itcl aj 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 T 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 T 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr pi 2009 20000010 Export File Generated 02 04 2009 dpr 11 2009 20000011 Restarted in QF 02 04 2009 dpr 11 2009 20000012
112. only show jobs by certain users or jobs with a particular status S Digital Preservation Recorder 4 0a 1006 Quarantine dpr v A x Actions Users Reports Settings Help Select Transfer Job to Process Fiter by user ilter by status Export File Generated Transfer Job Number Status Date Created B 2009 20000023 Export File Generated 07 05 2009 ian Ic3 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000016 Export File Generated 20 04 2009 ian Icl 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000030 Export File Generated 07 05 2009 ian Ic3 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000033 Export File Generated 08 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 yp Register a New Transfer Job in DPR Z Process Selected Job On QF and PF if you only want to display transfer jobs in process you can click the Exclude exported jobs checkbox This will hide all transfer jobs with a status of Export File Generated Digital Preservation Recorder 4 0a 1006 Quarantine dor
113. put carrier Post Quarantine Processing Scan data objects for viruses and check their checksums QJIX XJXIXIX Q Process R Done Each step is labelled with a status marker w Step completed successfully 3 Error in step Oo Step processing or ready to process DPR User Manual v1 5 odt Page 22 of 106 3 5 1 Start resume processing To start or resume processing click the Process button ii Digital Preservation Recorder 4 0a 1006 Quarantine vA x Actions Users Reports Settings Help 2009 20000030 Job Status Pre Quarantine Processing Passed Processing Status Paused New Transfer Job Step Create and initialise a new transfer job w Transfer job 2009 20000030 created and initialised successfully Read Manifest Step Load data objects from a manifest file w 1 data objects successfully loaded from manifest Pre Quarantine Processing Scan data objects for viruses check their checksums and set up the output carrier w Pre quarantine processing successfully completed 1 data objects verified C Process Xs Done 3 5 2 Pause Processing To halt processing at the end of the current step while DPR is processing a transfer job click the Pause button Note In order to maintain accurate data the Pause button does not take effect until the end of the current step If the transfer job is large it may take some time to reach the end
114. r Job 2009 20000016 Transfer Job Number Date Created 2009 20000016 2009 04 20 09 37 08 028 Created By ian Number of Data Objects 1 Current Status Export File Generated le Delete Transfer Job Q Q Reprocess Transfer Job ccu 6 Browse to carrier device location 7 Click Save button U Sme x Save In E local test carrier 1 ES Cy 2009 20000015 2009 20000017 E OF 2009 20000005 db4o E OF 2009 20000008 db4o 2009 20000018 OF 2009 20000010 db4o 2009 20000034 E OF 2009 20000016 db4o E oaF 2009 20000001 db4o QF 2009 20000017 db4o gr 2009 20000002 db4aoE OF user list dlb4o or 2009 20000003 db4o gr 2009 20000004 cdb4o File Mame QF 20089 20000015 db4o All Files Save Qancel Files of Type Back To Job Selector 8 To return to the Select Transfer Job window click Back to Job Selector button 9 Disconnect the carrier device 9 2 4 Restart Transfer Job To restart a transfer job that has not completed processing in a facility QF PF or DR Note If the transfer job has been stopped by an error process do not select Administer Transfer Job Select the transfer job and click the Process Selected Job button 1 Connect a carrier device to the appropriate workstation 2 Log on to DPR as an administrator see section 2 Log On 3 Right click on the appropri
115. rder lan Little July 2008 R598352008 Reference Specification Manifest Maker User Manual Allan Cunliffe March 2010 2009 4025 DPR User Manual v1 5 odt Page 6 of 106 Table of Contents 1 OVER VTE Wes secon nec 10 De A IVECTIIOGONO GY usate inti ta OS 10 1 7 5I Ga y e eee RR ee Rae TA A eR OG aCe eR te se ME OE nT te ere T 10 Pde ETS WAIN Recorasearcliss eee bolt ta oa dh Go deve ine da aes da veda deo e an Bas MR d 11 14 Digital Preservation WOFPKEOWSu5 5 eot anie EP PEE CMDE EDU Ee sata AON 11 TET COUDFOP HB AENG n desasdss Buchs ta bes Esau ep osa Rad bete Fo atu EN pd 11 LAZ Ouanne Faci i soo doo rtl A niae es da M ione su sns 11 14 5 Preservation PACIILY cmene ee Qeon ta died esuada Vento ee nem tee tod ed eite 11 14 4 Digital RepOoSITOEV recoin Ce REY oe v E OH SER MURS Pv ROV RU NE USD Ud Oed AU ER De dup uoti 11 14 5 Workflow DA FAIT nd acce cinia tene soria aees o TOE stt coteo adc eeu cuu 12 Tes CIO DUM D entes ooeste S eds URP Us Bass Se hdd ELO LU euS Dads I ML ache sae aeaen sees 13 URINE rer teaatoaehs 13 IAE veu me XM 13 iod ERC HO Scire ETE 13 2 LOGON T E 14 PN VLOS OMO DP qe P O 14 2D NOS OM BT rie RT Pc 15 3 BASIC INTERFACE EBEATURPBES 5 re Pete o Eee eee toes Poste E vac D Ee beoe EHE 16 SM BISHER TERRENCE 16 o 5elect Traldster Job WIBIOWLsci
116. riterion data object name type or status Selection Criteria Criteria Define a new search criteria mere data opjectname d Sd where data object name where data object mime type where AIP status The second drop down list sets whether your search is inclusive or exclusive For example you can search for all objects with status available or all objects with a status that are not available Selection Criteria Criteria Define a new search criteria where data object mime type lis M application gzip is The third field sets the detail of the object to be found Note The nature of this field depends on the selection made in the first drop down list If the first field is set to where data object name this field displays as a text field DPR User Manual v1 5 odt Page 50 of 106 Selection Criteria Criteria Define a new search criteria where data object mime type application qzip applications gzip application macbinary application mbox application msoautlook HEHTGCESNIDE Kaasan application octet stream Reason for Reprocessing application rtf application tar 6 Click the Add Criteria button to add the criteria you have set to the list Selection Criteria Criteria Define a new search criteria where data object mime type audia trips mr n Add criteria j DPR User Manual v1 5 odt Page 51 of 106 You can remove criteria from the list by cl
117. rocess Filter by user Filter by status ALL 3 4 Digital Preservation Recorder 4 0a 1006 Quarantine dpr Connect or insert the input media to a QF workstation Connect the output carrier device labelled with Carrier ID to the same workstation Log on to DPR see section 2 Log On Click Register a New Transfer Job button Reports Settings Help Exclude exported jobs es Register a New Transfer Job in DPR gt Transfer Job Number gt Status Date Created Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc1 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr I1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Icl 2009 20000015 Initialised from manifest 17 04 2009 ian I amp I 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20
118. ror messages are often displayed in table form B Normalisation Complete Y X The table below contains the list of errors that accurred during the normalisation pracess You cari Resolve issues by performing Advanced Normalisation allows manually choosing new normalisers gnore these issues and continue processing the jab Stop processing the jab Stop processing the step which can then be restarted Data Object Filename Media ID Error Reason digitaldelugerepositoriesz svq The current document is unable to create an element of digitaldelugerepasitories svgq The current document is unable to create an element of mixedmedia pst org xml sax SAXException Cannot find the readpst execu digitaldelugetransfer svg Image ras runlength enc ras The current document is unable to create an element of org xml sax SAXExceptionorg im4java core CommandExc Stap Job l l l digital deluge archive diagram svg 1 The current document is unable to create an element of l l To see the full text of an error message double click the table entry i uu Step Error Details v O x Data Object Filename mixedmedia pst Media ID il Error Reason org xml sax SAXException Cannot find the readpst executable Please check its location i javax mail MessagingException Cannot find the readpst executable Please check its loca Close Click the Close button to return to the error dialog DPR User Manual v1
119. rt File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File SE mueren ian Ic3 2009 20000022 Export File View data 09 ian Ic3 2009 20000023 Export File 09 ian Ic3 2009 20000024 Initialised fr 09 ian Ic3 2009 20000030 Restarted in QF 07 05 2009 ian 2009 20000031 Restarted in QF 08 05 2009 ian Ic3 2009 20000032 Initialised from manifest 08 05 2009 ian 3 2009 20000034 Restarted in QF 11 05 2009 dpr ap Register a New Transfer Job in DPR Z Process Selected Job Page 84 of 106 5 Click Reprocess Transfer Job button L j Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help y Administer Transfer Job 2009 20000021 Transfer Job Number Date Created Created By 2009 20000021 2009 05 07 09 19 17 032 ian Number of Data Objects 1 Current Status Export File Generated El Delete Transfer Job E Back To Job Selector 6 Enter the reason for re processing the transfer job 7 Click OK button x The Select Transfer Job window is displayed The transfer job now has a status of Restarted in QF To begin processing select the transfer job and click Process selected Job button Digital Preservation Recorder 4 0a 1006 Quarantine ian va x Actio
120. rvation Recorder 4 0a 1006 Preservation ian via x Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Imported into PF Processing Status Paused PF Checksum Validation Verify data object checksums on the carrier Cis Done 6 Enter carrier data e Select location of input carrier device Enter input carrier device ID e Select location of output carrier device Enter output carrier device ID DPR User Manual v1 5 odt Page 36 of 106 7 Click OK button to continue fr Actions Users Reports Settings Help Transfer Job 2009 20000035 Job Status Imported into PF Processing Status Processing PF Checksum Validation Verify data object checksum p 5 60 lt gt iex E S lt Properties Required for PF Checksum Validation x s I Input carrier location media X126 local test carrier 1 Browse Input carrier ID Local test 1 Output carrier location media X126 local test carrier 2 Browse Output carrier ID Local test 2 gg Pause C3 DPR e creates a binary normalised version of each data object in the transfer job see section 5 1 1 Normalisation and AIPS e performs binary quality assurance see section 5 1 2 Binary Quality Assurance e creates a normalised version for each data object that meets the normalisation conditions see section 5 1 1 Normalisation and AIP
121. s 8 Depending on the results of normalisation do one of the following if all files have normalised successfully advanced normalisation is not needed click the Continue button to store the results e continue to quality assurance see section 5 2 4 Quality Assurance tif files failed normalisation click the Advanced Normalisation button e continue to advanced normalisation see section 5 2 3 Advanced Normalisation Actions Users Reports Settings Help Transfer Job 2012 14523636 Job Status Binary Normalising Complete Processing Status Processing PF Checksum Validation Verify data object checksums on the carrier 1 data object checksums successfully Normalisation Complete MUS amp z The normalisation process finished successfully Set Up Preservation Carr You can perform Advanced Normalisation or save the results Creates the directory structu Advanced Normalisatia Continue gt Preservation carrier set up successfully Binary Normalisation Binary normalise data objects 1 data objects successfully binary normalised Transfer Job Normalisation Performs preservation normalisation of all data objects Oa Ge Ge Normalising DSC_0001 JPG Wu pausal 3 DPR User Manual v1 5 odt Page 37 of 106 5 2 3 Advanced Normalisation If the automatic normalisation process failed to identify or normalise one or more data objects use advanced normalisation to manually conf
122. s Seated Norma A cose 6 Select the correct MIME Type for the data object Advanced Normalisation Options Tools r Criteria Retrieve all data objects where normalisation failed w Update Table Data Object GIF Trick 1 zog hcmort wks trim x154 mbx xena test pst PRE Ee Choose New Type New Type ame x Media ID File Extension Error Reason zog wks mb ok Once pst Page 1 of1 gt gt gt Set Type Normalise Selected Normalise All Close DPR User Manual v1 5 odt Page 39 of 106 Tools Criteria Click the Normalise Selected button Advanced Normalisation Options Retrieve all data objects v where normalisation failed Data Object Update Table Media ID File Extension Normaliser Normalised Output FileName Error Error Reason Select All GIF Trick 1 zog 1 zog PlainText hcmort wks ni wks Type not recor iz trim x154 mbx 1 mbx Type not recor xena test pst 1 pst Type not recor lt lt Page 1 of 1 gt gt gt Set Type Normalise Selected Mormalise All Close DPR will attempt to normalise the data object using the manually entered file type S lt Advanced Normalisation Options Criteria
123. t To export an updated list of users for use on other DPR facilities 1 Log on to QF as an administrator see section 2 Log On 2 Select Users Administer Users Transfer job Number gt 2009 20000001 2009 20000002 2009 20000003 momom oam om o om o o o e Actions Users Reports Settings Help Select Administer Users rocess Export File Generated Export File Generated Export File Generated Export File Generated L l Digital Preservation Recorder 4 0a 1006 Quarantine dpr Filter by user 23 03 2009 23 03 2009 25 03 2009 25 03 2003 Filter by status ALL DPR user administration This action is disabled when processing a job Itc 1 Itc 1 Itc 1 Itc 1 3 Click Export User List Button 4 Select a carrier device as the location to save the user list The file name of the user list will default to XX user list YYYY MM DD TTTTTT db40 S Digital Preservation Recorder 4 0a 1006 Quarantine dpr Actions Users Reports Settings Help pA Add and Edit Users User Name First Name Last Name Active dpr Mr Bootstrap v juser sample user v ladmin sample admin v max max moo vA johnl john iv lian lan Little vi john john love joy vi jack Jack Burton vi Add User Edit User Export User List Aport User List Done where XX is the current DPR facility QF PF or DR DPR User Manual v1 5 odt Page 76
124. t s Note Each DPR facility has a different set of reports There are three options for producing the report Show Report Export to HTML Export to CSV S Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help y Select the Report to Produce Transfer Jobs that Failed in QF Transfer Jobs that were Rejected User Report User Report calendar month User Report financial year ShowRepon Export to HTML Export to CSV E Back To Job Selector DPR User Manual v1 5 odt Page 67 of 106 iJ lt User Report e y User Name User Report Mozilla Firefox Transfer Job Number 2009 20000002 2009 20000012 2009 20000034 2009 20000004 2009 20000011 2009 20000010 2009 20000005 2009 20000009 2009 20000003 2009 20000006 2009 20000007 2009 20000001 2009 20000008 2009 20000011 2009 20000020 2009 20000015 2009 20000031 2009 20000034 Ale Edit View History Bookmarks Tools Help v Tasks Performed Created Put into Quarantine Created Created Created Created Put into Quarantine Created Created Created Put into Quarantine Created Put into Quarantine Created Created Put into Quarantine Created Put into Quarantine Created Restarted Created Created Put into Quarantine Created Put into Quarantine Put into Quarantine Created Put int
125. tal Preservation Recorder 4 0a 1006 User Details User name Password Database Name Database User Name Database Password Details d Enter your username Connection Detai and password Hostname Port user Logon f localhost 5432 local test PF postgres i Abou Page 15 of 106 3 Basic Interface Features 3 1 Title Bar Each window displays program and user information software name and version e software build number e current facility user ID F ES Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help Select Transfer Job to Process Fierbvuser ALL F Transfer Job Number v Status Date Created 2009 20000001 Export File Generated 23 03 2008 2009 20000002 Export File Generated 23 03 2009 3 2 Select Transfer Job Window 3 2 1 Display The Select Transfer Job to Process window is the main interface for the Digital Preservation Recorder It displays all the transfer jobs currently in the database for that facility S Digital Preservation Recorder 4 0a 1006 Quarantine dpr v A x Actions Users Reports Settings Help Select Transfer Job to Process Fiter by user Filter by status ALL Exclude exported jobs Transfer Job Number Status Date Created Creat
126. tatus Date Created Created By Transport Device Due Out of Quarantine 2009 20000001 Export File Generated 23 03 2009 dpr Itc1 2009 20000002 Export File Generated 23 03 2009 dpr Itc 1 A 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 A 2009 20000004 Export File Generated 25 03 2009 dpr Itc1 p 2009 20000005 Export File Generated 26 03 2009 dpr I1 2 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 24 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr I1 24 04 2009 24 2009 20000008 Restarted in QF 27 03 2009 dpr A 2009 20000009 Initialised from manifest 31 03 2009 dpr I1 A 2009 20000010 Export File Generated 02 04 2009 dpr I1 A 2009 20000011 Restarted in QF 02 04 2009 dpr Hn E 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 A 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 A 2009 20000015 Initialised from manifest 17 04 2009 ian Ic 2 2009 20000016 Export File Generated 20 04 2009 ian Ic1 A 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Restarted in QF 07 05 2009 ian 2009 20000022 Export File Generated 07 05 2009 ian Ic3 E 2009 20000023 Export File Generated 07 05 2009 ian Ic3 he E Register a New Transfer Job in DPR D A 9 Complete current facility processing see sections 4 Quarantine Facility 5 Preservation Facility and 6 Digital Repository and disconnect the carrier device 9 2 5 Reprocess Trans
127. tc2 O 2009 20000004 DR Processing View data dpr Itc2 2009 20000010 DR Processing Administer Job fy dpr I2 2009 20001005 DR Processing Eerrrerece rore dpr 12 QP impon Job QS Perform DR Tasks A Process Selected Job 3 Select Administer Job DPR User Manual v1 5 odt Page 79 of 106 4 Click Change Job Number button S Digital Preservation Recorder 4 0a 1006 Digital Repository ian via x Actions Users Reports Settings Help 2 Administer Transfer Job 2009 20000003 Transfer Job Number 2009 20000003 Date Created 2009 03 25 13 41 58 31 Created By dpr Number of Data Objects 14524 Current Status DR Processing Complete lt gt Q E Back To Job Selector 5 Enter new Transfer Job Number ES Change Transfer Job number x Enter new Transfer Jab Number New Job Number 26009 20000004 cwm Ty 6 Click Confirm button 1 To return to the Select Transfer Job window click Back to Job Selector button 9 2 2 Delete Transfer Job To delete a transfer job 1 Log on to the appropriate facility as an administrator see section 2 Log On 2 Right click on the appropriate transfer job in the table 3 Select Administer Job l j lt Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help
128. tes 201205281139 b9dO3bc5b6f86 SHA 512 Stop Current Step f Stop Job UU Pause 3 DPR User Manual v1 5 odt Page 103 of 106 2 Select Return to xx from the drop list 3 Enter reason for returning for reprocessing 4 Click OK button l Digital Preservation Recorder 4 0a 1006 Digital Repository dpr L3 Actions Users Reports Settings Help Copy To Digital Repository Copy the AIPs to the repository a l Properties Required for Handle Stopped Transfer Job in DR Stop job action Reason for action AeA Processing is stopped 5 Click Done button l Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Copy To Digital Repository Copy the AIPs to the repository and verify their checksums X Handle Stopped Transfer Job in DR Handling stopped transfer job Y Transfer job status is now Returned to The transfer job can be re processed in the previous facility see section 9 2 5 Reprocess Transfer Job l Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Select Transfer Job to Process Status Date Created Created By Transport Device Reprocessing Job Reprocessing Job Sent To PF 31 03 2009 Imported into DR 27 03 2009 Imported into DR 23 03 2009 Imported into DR 23 03 2009 DR Processing Complete 25 03 2009 DR Pro
129. the table and then click the Process Selected Job button or e double click the transfer job entry in the table See section 3 5 Processing Window DPR User Manual v1 5 odt Digital Preservation Recorder 4 0a 1006 Quarantine dpr via x Actions Users Reports Settings Help Select Transfer Job to Process Fiter by user Filter by status ALL v Exclude exported jobs C Transfer Job Number Status Date Created Created By Transport Device Due Out of Quarantine 2009 20000005 Expor File Generated 26 03 2009 dpr M a 2009 20000006 Rejected in QF 27 03 2009 dpr l1 24 04 2009 2009 20000007 Pre Quarantine Processing Passed 27 03 2009 dpr 1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr l1 Em 2009 20000010 Export File Generated 02 04 2009 dpr l1 va 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr l1 2009 20000014 Initialised from manifest 16 04 2009 ian Ic1 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 Export File Generated 20 04 2009 ian Ic1 2009 20000017 Export File Generated 20 04 2009 ian Ic1 2009 20000020 Export File Generated 07 05 2009 ian Ic3 2009 20000021 Export File Generated 07 05 2009 ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated
130. tions Users Reports Settings Help Add and Edit Users User Name First Name Last Name Active dpr Mr Bootstrap v user sample user v admin sample admin v max max moo v johnl john v ian lan Little iv john john lovejoy v jack Jack Burton v Add User Edit User Export User List Import User List Done DPR User Manual v1 5 odt Page 77 of 106 5 Select the carrier device where the user list is saved 6 Select the user list to import The file name of the user list will be in the format XX user list YYYY MM DD TTTTTT db40 where XX is the originating DPR facility QF PF or DR Pai pen s Look In E QF user list 2009 05 08 151731 db4o scripts pe Samples schema drafts est tsv File Name QF user list 2009 05 08 151731 db4o Files of Type All Files Open I ancel 7 Click the Open button The Add and Edit Users window is displayed 8 To return to the Select Transfer Job window click the Done button DPR User Manual v1 5 odt Page 78 of 106 9 2 Administer Transfer Jobs A user with administrator permission may perform the following actions on a transfer job e Change Transfer Job Number The transfer job number may only be changed in DR and only if the transfer job has completed processing e Delete Transfer Job The transfer job cannot be deleted from DR stage o
131. tus Date Created Created By Transport Device _ Due Out of Quarantine 2009 20000001 Expor File Generated 23 03 2009 dpr Itc 1 a 2009 20000002 Expor File Generated 23 03 2009 dpr Itc1 zi 2009 20000003 Export File Generated 25 03 2009 dpr Itc1 2009 20000004 Export File Generated 25 03 2009 dpr Itc 1 2009 20000005 Export File Generated 26 03 2009 dpr I1 2009 20000006 Rejected in QF 27 03 2009 dpr I1 24 04 2009 2009 20000007 Pre Quarantine Processin 27 03 2009 dpr l1 24 04 2009 2009 20000008 Restarted in QF 27 03 2009 dpr 2009 20000009 Initialised from manifest 31 03 2009 dpr l1 2009 20000010 Export File Generated 02 04 2009 dpr I1 2009 20000011 Initialised from manifest 02 04 2009 dpr I1 2009 20000012 Initialised from manifest 07 04 2009 dpr I1 2009 20000014 Initialised from manifest 16 04 2009 ian Icl 2009 20000015 Initialised from manifest 17 04 2009 ian Ic1 2009 20000016 Export File Gene ian Ic1 2009 20000017 Export File Gene View data ian c1 2009 20000020 Export File Gene ian Ic3 2009 20000021 Export File Gene U77 US ZUUS ian Ic3 2009 20000022 Export File Generated 07 05 2009 ian Ic3 2009 20000023 Export File Generated 07 05 2009 ian Ic3 x E Register a New Transfer Job in DPR Ss Process Selected Job DPR User Manual v1 5 odt Page 81 of 106 5 Click Export Transfer Job button S lt Digital Preservation Recorder 4 0a 1006 Quarantine ian Actions Users Reports Settings Help y Administer Transfe
132. w Insert Format Tools Table Window Help Type a question for help j E a 7 fos i b ir An Approgch to the Preservation of Digitali Rexeds 1 Performance model and fundamental nature of digital records Digital records challenge the idea that records are essentially objects for archivists to preserve arrange store and make accessible As archivists we are very comfortable with the concept of records as paper objects as original and unique physical artefacts A paper record can only be experienced at one place in time For researchers paper records can be experienced directly if they can read the language see figure 1 For archivists the problem of preserving records centres on the object once the object is preserved the record is preserved Figure 1 Direct experience of a paper record Tc Ci d BM 4 Page 7 Sec 2 7 23 At 96cm In 1 Coll REC TRK EXT OVR English Aus 3 Click the Open Normalised File button The Xena Viewer will display the normalised version of the file Package NAA Xena Package Lo e ShowmlieOfieog IN THE SUPREME COURT 9F PHE ST OP NEW MEXICO IN THE MATTER OF DREW ALAN NEAL ESQ An Attorney Licensed to Practice Before the Courts of the State of New Mexico DISCIPLINARY PROCEEDING sally E Scott Mullins Albuquerque New Mexico tor Disciplinary Board Thomas A Tabet Rafael Padilla 4 Opinion Number 2003 NMSC 032 1 Filing Date November
133. xported jobs L MIME Type Associated Program Reprocessim ob 1000 20003002 application vnd ms excel usr bin ooffice Itc2 v 2009 20000001 application vnd ms word usr bin ooffice 2009 20000002 audio aiff usr bin sweep 2009 20000003 audio mp3 usr bin totem 2009 20000004 audio wav usr bin rhythmbox 2009 20000005 image gif usr bin gimp 2009 20000008 image pcx Jusr bin gimp 2009 20000010 image tiff usr bin gimp LI 2009 20000017 image unknown Jusr bin gimp 2009 20000030 text plain usr bin kate 2009 20000031 text xml usr bin gedit 2009 20000033 2009 20000034 2009 20000035 cal test 2 2009 20000036 Li qp Import Job D Process Selected Job DPR User Manual v1 5 odt Page 93 of 106 10 3 Digital Repository The first time DPR is run on a DR workstation you must enter the location of the digital repository where the AIPs are to be stored 1 Log on to DR as an administrator see section 2 Log On 2 Select Settings Update Repository Settings ES Digital Preservation Recorder 4 0a 1006 Digital Repository dpr Actions Users Reports Settings Help Select Transfer Jol Update Repository Settings Transfer job Number v Status Date Created 1o00 10000001 Reprocessing Job Sent To PF 31 03 2009 2009 20000001 Imported inta DR 23 03 2009 2009 20000002 Imported
134. zip GZip Passed ReadMe DPIO APACS 4 Li 1 application rtf Office Passed output aif al audio aiff Direct Audio Passed Current Data Object Name output aif Status Passed Comments 5 2 5 Export Transfer Job To export the transfer job 1 The transfer job has now finished the preservation stage 2 Toreturn to Select Transfer Job window click the Done button S lt Digital Preservation Recorder 4 0a 1006 Preservation ian Actions Users Reports Settings Help Transfer Job 2009 20000036 Job Status Export File Generated Processing Status Finished PF Checksum Validation Verify data object checksums on the carrier 1 data object checksums successfully validated Set Up Preservation Carrier for Transfer Job Creates the directory structure on the preservation output carrier Preservation carrier set up successfully Binary Normalisation Binary normalise data objects Transfer Job Normalisation Performs preservation normalisation of all data objects 1 data objects normalised successfully Transfer Job Quality Assurance Step Verifies that a selection of data objects were preservation normalised correctly All objects selected for quality assurance passed Mark PF Processing Complete PF processing successfully marked complete Mark processing complete on the Preservation Facility and export transfer job information 3 Disconnect the input carr

DPR User Manual v1.5

Contents

Download Pdf Manuals

Related Search

Related Contents