Home

REPOX User Manual

1. Arquivo Municipal de Lisboa arqMunicLx 4567 Portuguese Aggregator Refresh mmm n eh Dataset PEE Set Name OAI PMH Schemas Inoecst Tune l act Ingest DatelNevt Ingest Date Number of Records Ingest Status A p gina em http localhost 8088 diz mi m Are you sure you want to delete this Data Provider All its Data Sets Ingest Processs and Records will be deleted d Cancelar Figure 22 Pop up menu to confirm the deleting of the Data Provider To conclude the operation the administrator should select Ok When a Data Provider is deleted all of its Data Sets ingest processes and Records will be deleted 2 5 Data Set A Data Set is a set of metadata records provided by a Data provider A Data Set can be initially stored in an OAI PMH remote server in a folder of the file system of the server where the REPOX is running or available on line through a URL REPOX also makes it possible to harvest a data set from a Z39 50 server even if that is not its main purpose since this protocol was not designed for this purpose REPOX uses an expedite process that never can assure all the records will be harvested 2 5 1 Create a Data Set To create a Data Set select from the homepage Figure 23 the Data Provider that will provide it if the Data Provider is not created yet see 2 4 1 about how to do that Home Tasks Statistics Schema Mapper OAI PMH Tests Administra
2. Documentation and final prototype Appendix REPOX User Manual europeana connect Finally click on the pencil icon as showed in Figure 31 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arquivo Municipal de Lisboa e Arquivo Municipal de Lisboa arqMunicl x 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status OAI PMH afl Local Metadata Format ese OAI URL OAI Set ID Policy Record Set Description Name Name Code Language Transformations Number of Records Ingest http bd1 inesc id pt 8080 repoxel OAlHandler arquivocmlx ID Generated arquivocmlx arquivocmlx arquivocmlx 78965 PT d Schedule Ingest Export Records per file 1 v Schedule Export Scheduled Tasks Log Files Create Data Set Figure 31 Edit Data Set button This action calls the form already described in the section 2 5 2 2 5 3 Remove a Data Set To remove a Data Set select in the homepage the Data Provider to which it is associated Figure 32 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page degno Aggregator Name Provider TOS a Data Set OAI PMH Ingest ed Wen Number of Ingest S er See ID Name Schemas Type gt 3 Records Status Date Date
3. New Cancel Save Figure 25 Form to create a Data Set from a folder or URL The importing process Folder ingests a Data Set from files already existing in a specified folder The file formats that REPOX recognise for this purpose are IS02709 and XML Each Data Set is expected to be in a file with one of these formats which can also be compressed according to the ZIP format For the 1502709 format is possible to select the variant that is used standard variant from Albania variant from Ukraine and also the character encoding of the file The Figure 25 shows the form to create a new Data Set for this importing process e Metadata Format the format of the input metadata ese I80O2709 MarcXchange tel oai dc other e Folder Path or URL the folder path that contains the files or a URL to a specific file If an URL is given REPOX will download the file to a local folder e Record s root name the XML element name the tag name that holds the record in the file This field is optional as it only applies to XML files and not to ISO2709 14 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A Appendix REPOX User Manual europeana connect e ID policy defines how the record identifiers are assigned to apply only for data sets in XML files When importing records from a XML file it can happen that the records already have an element t
4. Portuguese Aggregator 4567 arquivocmlx OAI PMH Ndunicipal de Lisb pal de L de Lisbog Figure 32 Select the Data Provider from the homepage 20 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect Then click on the recycle bin icon showed on Figure 33 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa arqMunicl x 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status 43490 gV Egdauvocmk ee QOAPMHee 2 Type bg OAI PMH g Local Metadata Format ese OAI URL http bd1 inesc id pt 8080 repoxel OAIHandler OAI Set arquivocmlx ID Policy ID Generated Record Set arquivocmlx Description arquivocmlx Name arquivocmlx Name Code 78965 Language PT Transformations Number of Records og Ingest Ingest Now Schedule Ingest Export Records per file Export Now Schedule Export Scheduled Tasks Log Files Create Data Set Figure 33 Delete Data Set button A pop up menu is showed to confirm the deletion of the Aggregator Figure 34 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arqu
5. europeana connect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual BH co funded by the European Union The project is co funded by the European Union through the eContentplus programme http ec europa eu econtentplus Osterreichische E Nationalbibliothek EuropeanaConnect is coordinated by the Austrian National Library EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A Appendix REPOX User Manual i fs europeana Table of Contents Ne CU el EE E E EE EAE IAE A E A E E E E M 4 L4 Set EELER eener 4 1 1 1 ed e RE 4 ME MEE oc meco P RP 4 1 1 3 eier erter urpxisiinEpnaEINREPRA EEE REDE END EINE DNUEN EDEN 4 1 2 Download Source Code 4 1 3 Database Management System ssssssssssssssssseeee eene nnn nnn nnn nnns 4 14 CGompilaton nnne nnne mnnn nnne nnn nnne nnns annes n aane nns 5 TES Ke e E E 5 1 6 Configuration and Testing the lnstallaton 5 2 User ManU E 7 2 1 KOO m 7 2 2 Homepage essesseseesseee nee nne nnne nnne nna rsen sa rae rsen sa sn se sn se snas nnus 7 2S Tele 216 16 E 8 2 3 1 Sreateunddieddlgl setae deinen eerie Ru UeER MEME M een eee 8 2 3 2 View Aggredaior nennen nennen nnne nnn nn nenne nnne nnne annes rsen nens 9 2 3 9 Belgie aet zio MEME E a 9 2 3 4 REMOVE an Aggregator nennen nennen nnn nnn nnn n
6. If it is found REPOX presents the page showing the information of that entity 8 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration IMEEM REPOX Home Page Aggregator Aggregator Name Provider Data Set OAI PMH Last Ingest pM Number of Ingest Provider Name Ingest l ID Create ID Name Schemas Type Date Date Records Status 1499 EN pt sg Portuguese Aggregator 4567 a Arquivo arquivocmlx 2010 10 29 dry ee al de Lisboa Figure 56 Go to field 2 10 OAI PMH Server The OAI PMH server of the current REPOX installation can be tested For that click in OAI PMH Tests in the homepage Home Tasks Statistics Schema Mapper d OAI PMH Tests Administration Go to REPOX Home Page Aggregator Aggregator Name tier Data Set OAI PMH Ingest Last Ingest bate Number of Ingest Provider Name Ingest B ID Create Name Schemas Type Date Date Records Status 1499 EN pt sg Portuguese Aggregator 4567 es Arquivo arquivocmlx MH 2010 10 29 oE al de Lisboa Figure 57 OAI PMH Tests link 32 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual SC Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto OAI PMH Testing Parameters Response europeana connect http localhost 8080 repox OAIHar 20 10 07 01T15374 7Zhttp localhost S080 repox OAI
7. OAI PMH Tests Administration Goto REPOX Home Page Aggregator Aggregator Name Provider Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest 2 Provider Name ID Create ID Name Schemas Type Date Date Records Status Arquivo Municipal de Lisboa Figure 15 Selecting the Aggregator form the main list Next click on Create Data Provider link Figure 16 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Aggregator Portuguese Aggregator Gegen rains ptAgg Refresh 4567 Arquivo Municipal de Lisboa argMunicLx ARCHIVE Create Data Provider i Figure 16 Create Data Provider button REPOX will present a form with information related to the Data Provider Figure 17 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Create Data Provider Data Provider Country FYROM EN Provider Name Description Type MUSEUM el Name Code Homepage Figure 17 Create Data Provider form The form is composed by the following fields e Country the country of the Data Provider can be selected from a drop down list e Provider Name the data provider name a free text s Description a short description of the Data Provider a free text 11 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connec
8. 10 29 1499 e Type OAI PMH S Local Metadata Format ese OAI URL http bd1 inesc id pt 8080 repoxel OAIHandler OAI Set ID Policy Record Set Description Name Name Code Language Transformations Number of Records Ingest Export Scheduled Tasks Log Files arquivocmlx ID Generated arquivocmlx arquivocmlx arquivocmlx 78965 PT 1499 5 Ingest Now Schedule Ingest M Export Now Schedule Export Records per file 1 2010 101 20101029 174119 log Create Data Set Figure 40 Export data options Set the number of records that each file will contain using Records per File drop down list It is possible to export the records immediately clicking on the Export Now button In this case the result will be stored in a compressed ZIP file and the pathname presented to the user It is also possible to schedule the export process clicking on the Schedule Export button In this case REPOX will show a calendar window with the related options Figure 41 e Home Tasks Statistics Sc Arquivo Municipal de Lisboa arquivocmlix November 2010 December 2010 of Records Ingest Status 10 1499 A Mo Tu We Th Fr Sa Mo Tu We Th Fr Dataset ID Data Set Na 2 glg 5 l6 1 2 3 4 43490 2 ES arquiv 8 91 10 11 12 el 7 Bu 9 Type 4 15 16 17 18 19 13 14 15 16 17 Local Metadata Format 22 23 24 25 26 201 21 22 23 24 OAI URL 29 30 27 28 29 30 31 OAI Set ID
9. Appendix REPOX User Manual europeana connect lt bean id dataSource class com mchange v2 c3p0 ComboPooledDataSource gt lt property name driverClass value org postgresql Driver lt property name jdbcUrl value jdbc postgresql host port database property name user value ADMIN gt property name password value ADMIN gt bean For the property jdbcUrl replace host port database for the name of the PostgreSQL database that was previously created and change the values of user and password to reflect your server database configuration 1 4 Compilation HEPOX is compiled using Maven Instructions to download and learn how to install it can be found here http maven apache org download html Assuming Maven is installed type this in the command prompt in the REPOX HOME mvn clean mvn install Dmaven test skip true Maven will then compile REPOX and produce a file located at REPOX_Home target repox war Warl 1 5 Deployment After compilation copy the file REPOX _HOME target repox war to the web application server folder and deploy it using the application server administration tools Please be sure that the memory of the Java virtual machine in the application server is at least 512 MB 1024 MB recommended and that PostgreSQL is running 1 6 Configuration and Testing the Installation To test the installation connect to http server addre
10. Destination Format the destination format of the transformation In the actual version HEPOX is not controlling these terms so it is a free text e Transformation File XSL click on the Choose file Button to upload the XSLT file 29 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect 2 7 2 Visual Schema Mapper REPOX allows creating a schema transformation to OAI DC using a visual interface This is a limited functionality in this version but it can prove to be useful for many scenarios To define a schemas mapping click on the Choose File button showed on Figure 52 The process assumes that a file with at least one record in the original format is available to extract the XPath information To select that click on sample file and press Upload S Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Schema Mapper Map Schema Visually from Sample Submit an XML file or a zip file containing XML files That sample will be used to extract tags and create the Schema mapping Choose File lo file chosen H ioa Submit Transformation Identifier Description Source Format Destination Format Transformation File XSL Choose File No file chosen Figure 52 Choose file button HEPOX then presents an interface that allow
11. Policy Record Set Description Name First Run 02 11 2010 Records per file 1 M at 16 h O Frequency Once 2 Daily D Weekly D Every 1 v Months Name Code Language Transformations Number of Records Ingest Export Scheduled Tasks Log Files Figure 41 Window to schedule the export data process 24 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect Select from the calendar the day to start the exporting process Set the hour and the minutes from the two drop down lists Set the number of records per file and the full path of the folder that will contain the records Set the frequency of the process which can be once daily weekly or monthly If monthly is chosen the number interval months can be set Finally click on the Schedule button to save the task The result of an export will be stored in a compressed ZIP file and the pathname presented to the user 2 6 Ingesting Tasks The Tasks allows scheduling the ingesting tasks for each Data Set 2 6 1 Schedule Tasks To schedule an ingesting task for a Data Set select from the homepage the Data Set to which the Data Set is associated Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page Aggregator Aggregator Name Provider textes Data Set OAI PMH Ingest Last Ingest Numb
12. a record datafig dc rights 53 E E B group record datafield tag 517 record datafield 8 tag 5177 subfield G code dc source FR eh E 88 group record datafield Gtag 700 or tag 701 or amp tag 710 or tag 711 or Gta dc subject Z SY A 1 H BS group record datafield 8tag 600 or tag 601 or tag 605 or amp tag 606 or ta dc title 73 F b E E 3 group record datafield 9tag 6757 record datafield 9tag 675 subfield 9 code dc type B LJ Ss A Ok EIE E record datafield tag 205 or tag 207 or tag 300 or tag 303 or tag 304 o dc identifier xsi type lib ISBN Ca ES a UAN C H group record datafield tag 321 record datafield tag 32 1 subfield code dc identifier xsi type tib ISSN amp x M E amp record datafield 8tag 2107 subfield G code c dc identifier xsi type dcterms URI amp 3 E D E CS record datafield Gtag 2107 subfield G code a dc terms S E 88 group record datafield Gtag 7027 record datafield Gtag 7027 subfield amp code dc subject xsi type dcterms UDC amp 3 E 8 record datafield 8tag 712 or amp tag 722 subfield code a dc language xsi type dcterms 150639 2 FR E F3 record datafield tag 210 subfield code d E 8 record datafield tag 135 subfield code a D 5 amp record datafield amp tag 2007 subfield G code b A nues ield Gtaaz 336 hfiel
13. be used to transform the original data set from its initial format to a new one to be exposed trough the OAI PMH REPOX server The transformation rules must be stored in an XSLT file To add a new transformation click on the New button see Section 2 7 for more details on adding schema transformations OAI Set and Transformation fields are optional the others are mandatory 17 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect 2 5 1 3 Harvest by Z39 50 lt e Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Data provider Create Data Set Folder Data Set OAI PMH Address Port A Database User Password Charset Record Syntax unimarc Harvest Method Timestamp EN Earliest Date YYYYMMDD Geet A ID Policy D Generated Name Name Code Language AB Le Output Record Set no spaces Description Transformation Add Le New Cancel Save Figure 28 Form to create a Data Set from Z39 50 server The Figure 28 shows the importing process for Z39 50 The form to create a new Data Set for this process comprises the following fields e Address address of the 239 50 server e Port service port e Database name of the database that contains the records in the remote system e User username to access the Z39 50 ser
14. com javase downloads index jsp It may be required to have administrative rights in Windows or root permission in Linux to install it 1 1 3 Application server REPOX runs as a web application within a J2EE servlet container REPOX was tested on Apache Tomcat 6 x and Jetty 6 1 11 However it also might run properly on others J2EE servlet containers since they were not identified other dependencies 1 2 Download Source Code The REPOX source code S available in the SVN repository af http europeanalabs eu svn contrib repox branches repox_rhine The source code is located in the folder REPOX HOME 1 3 Database Management System The current version of REPOX requires the Derby and the PostgreSQL Database Management System If necessary in order to install it follow the link http www postgresql org download After this step it is necessary to create a database to contain the REPOX data After downloading the source code it is necessary to configure the PostgreSQL settings in the HEPOX configuration file in these recommended three steps 1 Create a copy of this file REPOX_HOME src main resources repox2sip applicationRepox context xml template alternate 2 Rename it to REPOX_HOME src main resources repox2sip applicationRepox context xml 3 Edit the file repox2sip applicationRepox context xml 4 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A
15. task deletion or on Cancel button to cancel the deletion operation 2 Schema Transformation Mapper 2 7 1 Add Schema Transformation To add a XSLT transformation file transform a Data Set from its original schema to another click on the Schema Mapper button on the top menu in the homepage Figure 50 Figure 50 Schema Mapper buttonFigure 50 Schema Mapper button 28 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype dr Appendix REPOX User Manual europeana connect Fill the Submit Transformation form presented in the Figure 51 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Schema Mapper Map Schema Visually from Sample Submit an XML file or a zip file containing XML files That sample will be used to extract tags and create the Schema mapping Choose File No file chosen Upload Submit Transformation Identifier Description Source Format Destination Format Transformation File XSL Choose File No file chosen Save Figure 51 Form to submit a schema transformation The form has the following fields e Identifier the identifier that uniquely identifies the transformation s Description the description of the transformation e Source Format the source format of the transformation In the actual version REPOX is not controlling these terms so it is a free text e
16. HandlerREPOX Repositoryhttp localhost S080 repox OAIHandler2 Omailto gilberto pedrosa Zist utl pt1970 01 OlpersistentY Y Y Y MM T Operations Identify ListMetadataFormats ListSets Listldentifiers ListRecords GetRecord OAICat Repository FrameworkJeffrey A L L L L RH Figure 58 OAI PMH testing page IDDgzipdeflateoairepox ist utl pturnrepox ist utl ptrLoC oai lcoal loc gov_loc gmd g3200 ct001491 OCLC s OA Re oclc orgOCL C 1 5 56http alceme oclc org oaicat oaicat icon gifhttp www oclc orgiresearch softwa The OAI PMH testing page allows the administrator to test several operations of the OAI PMH server of the current REPOX installation Figure 58 These operations are listed in the Operations box It is also possible to specify the parameters for these operations using the fields in the Parameters box 33 33
17. ID Create ID Name Schemas Type Date Date Records Status EN pt eg Arquivo Municipal de Lisboa Figure 10 Selecting the Aggregator form the main list Next click on the Edit button Figure 11 9 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Aggregator Portuguese Aggregator Portuguese Aggregator ptAgg Edit Refresh Country Provider ID Name Description Type Homepage Arquivo Municipal de Lisboa argMunicLx ARCHIVE Create Data Provider Figure 11 Aggregator Edit button REPOX will show as a result a form to edit the Aggregator as presented and described in the section 2 3 1 2 3 4 Remove an Aggregator To remove an Aggregator select its name from the homepage Figure 12 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page Aggregator Aggregator Name Provider DRE ME Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest r ID Create ID Name Schemas Type Date Date Records Status Portuguese Aggregator Arquivo Municipal de Lisboa Figure 12 Selecting the Aggregator form the main list Next click on the Delete button Figure 13 Home Tasks Statistics Schema Map
18. PMH requests europeana connect Derby Database Folder where to store the Derby database This database will be used to store the information about the harvested metadata records e Baseurn URN prefix of this REPOX instance the syntax is urn instance identifier e Administrator Email email to notify the administrator when ingestion processes are concluded e SMTP server for Administrator Email e REPOX Default Email Sender e Administrator Email Password After editing the form click on Change Settings to save change settings Then REPOX will show the main page The configuration properties also can be changed at any time using the Administration link Figure 2 Home Tasks Statistics Schema Mapper OAI PMH Tests REPOX Home Page mx Aggregator Aggregator Name Provider Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Provider Name su ID Create ID i Name Schemas Type Date Date EH PT Age Portuguese Aegresator 20 9 GF Arquivo G Es EE Municipal de Lisboa ese Figure 2 Administration link Records 6 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype dr Appendix REPOX User Manual europeana connect 2 User Manual 2 1 Login When REPOX starts after the initial configuration the first screen presented is the login Figure 3 4 Home Tasks
19. Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Authentication User ladmin Password Don t ask for my password for two weeks Submit Reset Figure 3 Login Screen In order to proceed the user must insert a valid username and password defined in 1 3 It is also possible to check the Don t ask for my password for two weeks checkbox for the system to remember the credentials The Reset button resets the two fields The first time the system is executed after the login the user will be redirected to the configuration page see section 1 6 for more details 2 2 Homepage After the login REPOX will then present the homepage Figure 4 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page mx Aggregator Aggregator Name Provider Data Set OAI PMH Ingest Last Ingest Next Ingest Number of i Provider Name ID Create ID Name Schemas Type Date Date Records Eg PT Aee Portuguese Asgregator 20 7 pam Arquivo record Municipal de Lisboa Figure 4 Main list of the REPOX system The REPOX homepage presents the registered list of Aggregators the Data Providers associated to them and the Data Sources of each Data Provider In each column the table shows e Aggregator s country it is presented the national flag of the country e Aggregator Id the name code of the aggregator e Aggregato
20. a connect OAI URL Processing This may take a while please wait OAI Set Metadata Format Mme 7000000000000 Name Code Language Output Record Set no spaces 0000000000000 Description O Transformation Add New Figure 27 Form to create a Data Set from OAI PMH server The importing process OAI PMH imports a Data Set from a OAI PMH server The Figure 27 shows the form to create a new Data Set for this process where the fields are 16 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A Appendix REPOX User Manual europeana UC ae e OAI URL the URL of the OAI server from which the data will be obtained The check button verifies the validity of the URL e OAI Set name of the Data Set on the OAI server A set is an optional construct for grouping items for the purpose of selective harvesting Repositories may organize items into sets If this field is not provided REPOX will ingest all records that exist in the OAI PMH server e Metadata Format the format of the Data Set to be harvested Name the name that identifies the Data Set Name Code the name code that identifies the Data Set e Language the language of the data values in the Data Set e Record Set the new name of the Record Set in the REPOX system s Description a description of the Data Set e Transformation A schema transformation that can
21. a transformation that can be used to transform the original data set from its initial format to a new one to be exposed trough the OAI PMH REPOX server The transformation rules must be stored in an XSLT file To add a new transformation click on the New button see Section 2 7 for more details on adding schema transformations The fields Metadata Format and Folder Path are mandatory all the others are optional If the ID Extracted is selected for ID Policy then the Identifier XPath field is also mandatory as it is the XML attribute from where the identifier will be extracted 15 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual Data Provider belgium Edit Data Source Metadata Format Folder Path Records root name ID Policy Identifier XPath Namespaces Namespace Prefix 1 Namespace URI 1 Namespace Prefix 2 Namespace URI 2 Record Set no spaces Description Transformation Data Source Current ese C Users GPedrosa Desktop belgium test europeana record ID Extracted europeanarecord dc identifier dc http purl org dc elements 1 1 europeana htip www europeana eu schemas ese Output belgium belgium New Create From Records Cancel Save Figure 26 Creating a Data Source using ID Extracted 2 5 1 2 Harvest by OAI PMH Data Provider Data provider Create Data Set Data 5et european
22. an Aggregator To create an Aggregator the administrator selects the Create link present in the third column of the home as showed in the Figure 6 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page a Aggregator Aggregator Name Provider Provider Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest e ID Create ID Name Name Schemas Type Date Date Records Status Figure 6 Create Aggregator In consequence REPOX presents a related form Figure 7 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Create Aggregator Aggregator Name Name Code Homepage Cancel Save Figure 7 Create Aggregator form 8 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect The Aggregator Name field must be filled with the name to be given to the Aggregator which can be any string or statement The Name Code field must be filed with a code assigned from the Ingestion team This code is used to identify the Aggregator The Homepage field should be filled with a URL that represents the Aggregator homepage The Aggregator Name field and Name Code field are required the Homepage field is optional 2 3 2 View Aggregator To view information about an Aggregator simply cli
23. ck on its name as showed in the Figure 8 e Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page a Aggregator Aggregator Name Provider Ee Ee Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest wmd ID Create ID Name Schemas Type Date Date Records Status EN ptAgg 4567 Arquivo Municipal de Lisboa Figure 8 Selecting the Aggregator form the main list HEPOX will show a screen presenting the information about that Aggregator Figure 9 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Aggregator Portuguese Aggregator Prize ed eden ptAgg Refresh 4567 t3 Arquivo Municipal de Lisboa argMuniclLx ARCHIVE Create Data Provider Figure 9 Screen showing the Aggregator information This screen contains a table showing the information about all the Data Providers associated with the selected Aggregator see 2 4 for how to register and manage the detailed information about Data Providers as also for the meaning of each field in the table The garbage icon deletes the current Data Provider 2 3 3 Edit an Aggregator To edit an Aggregator select it by its name from the homepage Figure 10 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page a Aggregator Aggregator Name Provider DEM Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest wmd
24. d Arodes a X Ew Ew pw x Eu El Figure 53 Connected tags 30 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect This interface also allows the user to add new tags using the New Tag buttons present on the top of each column This can be useful for tags not existing in the sample but that are expected to be found in new ingested data sets of this schema After connecting the tags click on Submit to create and register the new transformation 2 8 Statistics To view statistics of the current REPOX installation click on the Statistics button on the top menu in the homepage as showed in Figure 54 Home Tasks Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page Aggregator Aggregator Name Provider Data Set OAI PMH Ingest Last Ingest bei Number of Ingest Provider Name Ingest ID Create ID Name Schemas Type Date Date Records Status 1499 ptAgg Portuguese Aggregator 4567 Oa Arquivo arquivocmlx 2010 10 29 Opasne ica al de Lisboa Figure 54 Statistics button HEPOX will show a table presenting statistics Figure 55 SC Home Tasks Statistics Schema Mapper OAI PMH Tests Administration REPOX Statistics Aggregators Data Providers Data Sets Type OAI PMH Folder Metadata Format ese ID Policy ID Extracted 0 ID Generated 1 Reco
25. er of Ingest Pe Provider Name Ingest i s ID Create ID Name Schemas Type Date Date Records Status EN Ges Portuguese Aggregator 4567 e S Arquivo w arquivocmlx ere OAI PMH 2010 10 29 1499 unicipal de Lisboa ese Figure 42 Select Data Provider from the homepage Then click on the Schedule Ingest button as showed in Figure 43 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa arqMunicLx 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status 4 43490 a ES arquivocmlx ese OAI PMH ese 2010 10 29 1499 Type OAI PMH S Local Metadata Format ese OAI URL http bd1 inesc id pt 8080 repoxel OAIHandler OAI Set arquivocmlx ID Policy ID Generated Record Set arquivocmlx Description arquivocmlx Name arquivocmlx Name Code 78965 Language PT Transformations Number of Records 1499 X nest ingen No Schede nges Export Records per file T 7 xpa Schedule Export Scheduled Tasks Log Files 2010 101 20101029 174119 log Create Data Set Figure 43 Schedule Ingest button 25 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect REPOX will sh
26. essage 22 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect During the ingestion process the ingest status will display an icon showing activity Figure 38 Clicking on the refresh button will update the number of harvested records At the end of the ingestion process the icon will change according to the result of process There are three different possibilities e successful o the ingest process has successfully completed e error Q an error occurred during the ingest process warning E the ingest process has successfully completed but the system could not send an email to the administrator 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa s Arquivo Municipal de Lisboa arqMunicl x 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Je Type last Ingest Date Next Ingest Date Number of Records ums Statu OAI PMH a Local Metadata Format ese OAI URL OAI Set ID Policy Record Set Description Name Name Code Language Transformations Number of Records Ingest Export Scheduled Tasks Log Files http bd1 inesc id pt 8080 repoxel OAIHandler arquivocmlx ID Generated arquivocmlx arquivocmlx arquivocmlx 78965 PT oe Now Schedule Ingest Records pe
27. et from its initial format to a new one to be exposed trough the OAI PMH REPOX server The transformation rules must be stored in an XSLT file To add a new transformation click on the New button see Section 2 7 for more details on adding schema transformations The User and Password fields are optional all the others are mandatory 2 5 2 Edit a Data Set To edit a Data Provider select it by its name from the homepage Figure 29 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page Aggregator Aggregator Name Provider ue Data Set OAI PMH Ingest a Ae Number of Ingest Provider Name Ingest Ingest j ID Create Name Schemas Type Records Status Date Date es 0 ese Portuguese Aggregator 4567 ga i arquivocmlx E OAI PMH Figure 29 Select the Data Provider from the main list Then click on the arrow button to see the Data Set details Figure 30 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa arqMunicLx 4567 Portuguese Aggregator Refresh ent T Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status LP D 490 2 FR arquivocmlx ese OAI PMH ese 0 Create Data Set Figure 30 Arrow button to show the Data Set details 19 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure
28. gest Date Number of Records Ingest Status Create Data Set Figure 19 Edit Data Provider button This present the same form as already described in the section 2 4 1 2 4 3 Remove a Data Provider To remove a Data Provider select its name from the homepage Figure 20 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page E ID Create ID Name Schemas Type Date Date Records Status EN ptAgg Portuguese regator 4567 Arquivo Municipa de Lisboa Figure 20 Select Data Provider from the main list Next click on the Delete button in the Data Provider s details page Figure 21 12 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa e Arquivo Municipal de Lisboa argMunicl x 4567 Delete D Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status Create Data Set Figure 21 Delete Data Provider button A pop up menu is showed to confirm the deletion of the Aggregator Figure 22 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa
29. hat is a unique identifier or not For those cases it is possible to indicate the element to use as identifier or to ask REPOX to generate and assign it The options are o D generated in this case it is assumed that the records to import do not have a unique identifier A unique identifier is generated by REPOX and assigned to each record o ID extracted in this case it is assumed that the records to import already have an element with a unique identifier that can be extracted from the record using an XPath expression ex record id This is a common scenario as many bibliographic and other metadata descriptive formats have elements for the identifier When this option is choose new fields appear in the form as shown on Figure 26 In this case it is necessary to fill the Identifier XPath field with the XPath that points to the ID It is also necessary to add all the namespaces that appear in the XPath indicating their prefix and respective URI e Name the name that identifies the Data Set Name Code the name code is to be filed with a code assigned from the Ingestion team This code is used to identify the Data Set e Language the language of the data values in the Data Set e Record Set the name of the record set A set is an optional construct for grouping items for the purpose of selective harvesting Repositories may organize items into sets e Description a description of the Data Set e Transformation A schem
30. ivo Municipal de Lisboa Arquivo Municipal de Lisboa arqMunicl x 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status Local Metadata Fo OAI URL Are you sure you want to delete this Data Set This Data Set will be removed as well as the Ingest OAI Set Process and all the Records ID Policy Record Set Description Name Name Code Language Transformations Number of Records gest Export Records per file 1 e ExportNow Schedule Export Scheduled Tasks Log Files Create Data Set Figure 34 Pop up menu to confirm the deleting of the Data Set To conclude the operation the administrator should select Ok When a Data Set is deleted all related ingest processes and Records will be deleted 21 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect 2 5 4 Ingest a Data Set To start an ingesting process select in the homepage the Data Provider to which the Data Set is associated Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto REPOX Home Page Kleed Aggregator Name eid Data Set OAI PMH Ingest os igi Number of Ingest Provider Name Ingest Ingest Records Status Create Name Schemas Type Date Date Portug
31. nn nnns 10 c ER RN H ee RIT UU T m 11 2 4 1 Create a Data ele TE 11 2 4 2 Edit a Data Provider E 12 2 4 3 Remove a Data H Ge el 12 BO POU OH E 13 2 5 1 RRE NEUE m 13 2 5 2 Selten RE 19 2 5 3 Remove a RT EE 20 2 5 4 ale HR 22 2 5 5 Export a Data Get 23 2G MOESOL SKS areen E E T E E E E 25 2 6 1 See E 25 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A Appendix REPOX User Manual europeana 202 COSU RE 26 2 6 3 Selen 27 2 Schema Transtormation Mapper sereorsirmeaeeneiinneni ennea nEHkR cu ER EEEnPI M Enia a 29 2 7 1 Add Schema Transformattion lt c sscccccecccceeeccceeecceeeesceececeeeecseeesceeeeceeeenees 29 SEENEN 30 PA E e 31 2 9 Search for a specific Data Provider or Data Gei 32 PAO et E SCI E ER 3 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype A Appendix REPOX User Manual europeana connect 1 Installation 1 1 System Requirements 1 1 4 Operating System REPOX was successfully tested in the following operating systems Windows XP Windows Vista Windows 7 Linux Ubuntu and Mac OS X 10 5 8 No other operating systems supporting the Java Virtual Machine were tested 1 1 2 Java6 HEPOX is written in Java and assumes the Java 6 or higher virtual machine to run properly The URL to download the most recent version of Java IS http java sun
32. ow a window with a calendar Figure 44 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa record Dataset ID Data Set Nai June 2010 July 2010 t Date Number of Records 4 20 2 B record Su Mo Tu We Th Tu We Th Type OAI Local Metadata Format ese OAI URL http OAI Set avei ID Policy ID G 3 21 22 Record Set reco 27 29 Description Datz Name Ave Name Code avei First Run 16 06 2010 at 12 v h Language POR Incremental Ingest Full Ingest Transformations 1 8 15 Frequency Once Es Daily we Weekly Ee Every 1 v Months Scheduled Tasks Log Files Schedule Number of Records Figure 44 Window to program the task Next select from the calendar the day hour and the minutes from the two drop down lists Choose also Incremental or Full Ingest If Full Ingest is chosen REPOX will get all the records that exist in the source If Incremental Ingest is chosen REPOX will get only the new or modified records since the last ingest Set also the frequency of the process which can be once daily weekly or monthly If monthly is chosen a number of months can be set to apply between two runs Finally click on the Schedule button to save the schedule task 2 6 2 Consulting Tasks The list of scheduled tasks could be consulted by clicking on the Tasks button on the top menu in the homepage Fig
33. per OAI PMH Tests Administration Go to Aggregator Portuguese Aggregator Portuguese Aggregator ptAgg Refresh Country Provider ID Name Description Type Homepage Arquivo Municipal de Lisboa argMuniclx ARCHIVE Create Data Provider Figure 13 Aggregator Delete button A pop up menu is showed to confirm the deletion of the Aggregator Figure 14 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Aggregator Portuguese Aggregator Portuguese Aggregator ptAgg Edit Refresh BC ountry Provider ID Name Deccrintion Tyne Hamenage Data Provider FX Are you sure you want to delete this Aggregator All its Data Providers Data Sets Ingest Processs and Records will be deleted Figure 14 Pop up menu to confirm the deleting of the Aggregator To conclude the operation the administrator should select Ok 10 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect When an Aggregator is deleted all of its Data Providers Data Sets ingest processes and Records will be deleted 2 4 Data Provider A Data Provider is an entity that contributes with descriptive metadata for Europeana 2 1 1 Create a Data Provider To create a Data Provider select from the homepage the respective Aggregator Home Tasks Statistics Schema Mapper
34. r Name the name given to the aggregator in the system e Provider Id the name code of the provider s Provider Name the name given to the provider in the system 7 38 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect s Data Set Name the name given to the data set in the system e OAI PMH Schemas the data schemas available for each Data Set e Ingest Type data format type from which the data can be ingested Last Ingest Date date of the last time the data was ingested Next Ingest Date date of the next time the data will be ingested s Number of Records number of records for each ingest The Home link redirects in any moment the user to the homepage Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page Aggregator Aggregator Name Provider Data Set OAI PMH Ingest Last Ingest Next Ingest Number of ID Create ID Perede Same Name Schemas Type Date Date Records ES FPT Age Portuguese Aggregator 20 GH S Arauiva record OAI PMH Municipal de Lisboa ese Figure 5 Link to the homepage 2 3 Aggregator An Aggregator is an entity that aggregates Data Sets from Data Providers with the purpose of making them available also through the OAI PMH protocol The system administrator is allowed to register and manage Aggregators 2 3 1 Create
35. r file 1 v Schedule Export 2010 101 20101029 174119 log Create Data Set Figure 38 Refresh number of records button 2 5 5 Export a Data Set REPOX allows the user to export all the records from a Data Set to a compressed ZIP file To execute this functionality select the Data Set from the main list Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page Aggregator Aggregator Name Provider Pope Data Set OAI PMH Ingest Last Ingest bees Number of Ingest Provider Name Ingest J ID Create ID Name Schemas Type Date Date Records Status EN rue Portuguese Aggregator 4567 Ow xa quivo arquivocmlx ese OAI PMH 2010 10 29 1499 unicipal de Lisboa ese gt Wes Figure 39 Select Data Provider from the main list 23 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect The Export Data configuration options are showed in the Figure 40 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa arqMunicl x 4567 Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status 4 43490 2 Y 3 arquivocmlx ese OAI PMH ese 2010
36. rds 999 Averages Average records Data Provider 999 Average records Data Set 999 Countries ES PORTUGAL 999 Statistics Generation Date Wed Jun 16 14 58 31 BST 2010 Figure 55 Statistics table The table has several rows showing the data contained on the current REPOX installation e Aggregators indicates the total number of Aggregators Data Providers indicates the total number of Data Providers Data Sets indicates the total number of Data Sets e Type indicates the number of Data Sets of each import type OAI PHM Folder or 239 50 31 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect e Metadata Format indicates the number of Data Sets by metadata format e ID Policy indicates the total number of Data Sets by the ID Policy The policy can be ID Extracted or ID Generated e Records indicates the total number of harvested records e Averages indicates the average number of records by Data Provider and the average number of records by Data Set e Countries indicates the total number of records per country according to their Data Providers 2 9 Search for a specific Data Provider or Data Set The Go to field on the top menu of the homepage allows the administrator to search for a specific Data Provider or Data Set Figure 56 Simply type the name to search for and press the return button
37. s the matching the OAI tags with the tags of the given sample file Figure 53 The column on the left shows the tags from the OAI DC schema while the right column shows the tags and the respective XPath of the source format To match the tags simply connect the tags from one column to the other column Home Tasks Statistics Schema Mapper OAI PMH Tests Goto Map Schema Fields OAI DC TEL New Tag New Tag Show XPath Tag names info lc xmlns marcxchange v1 dc creator FR E p F3 record datafield tag 010 subfield code a dc contributor ETE 8 record datafield tag 01 1 subfield code a dc coverage FR E A E S group URN ISMN record datafield G tag 0137 subfield 9 code a dc date 53 E E ff group URN NBN record datafield tag 020 subfield code a dc description CS oN D E 88 group Publishers Numbers for Music record datafield tag 071 subfield code dc format CS Be O E 8 record datafield tag 255 subfield code x dc identifier FR D ee F p ff group URN LDN record datafield tag 021 record datafield tag 021 subfig dc language Fy F E E H group record datafield Gtag 8567 record datafield 9tag 8567 subfield code dc publisher 53 F A H group record datafield 8tag 2007 record datafield tag 200 subfield code dc relation 53 I E H group record record datafield tag 500 subfield Gcode
38. ss port repox The first time the system will redirect the user to the login page After authentication REPOX presents the configuration page Figure 1 Here the administrator must set up the folder used by HEPOX to store data 9 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Repository Folder Users mypath repoxfiles repository Folder of the REPOX Repository XML files Configuration Files Folder Users mypath repoxfiles configuration Folder of the REPOX XML Dynamic Configuration Files DataProviders Statistics OAI PMH Requests Folder Users mypath repoxfiles requests Folder for the temporary OAI PMH requests Derby Database Folder Users mypath repoxfiles database Database Derby Baseurn urn myhost pt URN prefix of this REPOX instance syntax is urn instance identifier Administrator Email admin repox eu SMTP Server for Administrator Email smtp repox eu REPOX Default Email Sender noreply repox eu Administrator Email Password eeecccccece Change properties Figure 1 The configuration page The form consists on the following fields e Repository Folder where the XML record files will be stored e Configuration Files Folder where the configuration XML will be stored e OAI PMH Requests Folder folder for the temporary OAI
39. t Type the type of the Data Provider the options in the actual version are MUSEUM ARCHIVE LIBRARY AUDIO VISUAL ARCHIVE RESEARCH EDUCATIONAL CROSS SECTOR PUBLISHER PRIVATE AGGREGATOR or UNKNKOWN e Name Code the name code value that identifies the Data Provider e Homepage the URL of the homepage of the Data Provider The fields Provider Name and Name Code are mandatory all the others are optional Edit the fields and click Save to save the changes 2 4 2 Edit a Data Provider To edit a Data Provider select its name from the homepage Figure 18 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to REPOX Home Page beta release a Aggregator Aggregator Name Provider D EE Data Set OAI PMH Ingest Last Ingest Next Ingest Number of Ingest wend ID Create ID Name Schemas Type Date Date Records Status EN pt gg Portuguese Aggregator 4567 Arquivo Municipa de Lisboa Figure 18 Select Data Provider from the main list As a consequence it is presented a new page with all the registered information about that Data Provider To edit that click on the Edit button Figure 19 e Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa s Arquivo Municipal de Lisboa arqMunicLx 4567 Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next In
40. tion Goto REPOX Home Page a Aggregator Aggregator Name Provider ENEE Data Set OAI PMH Ingest Last Ingest Next Ingest baroi of Ingest FF ID Name Schemas Type Date Date Records Status EN pt eg Portuguese Aggregator 4567 Arquivo Municipa de Lisboa Figure 23 Select the Data Set Next click on Create Data Set Figure 24 13 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype dr Appendix REPOX User Manual europeana connect e Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Data Provider Arquivo Municipal de Lisboa Arquivo Municipal de Lisboa argMunicl x 4567 Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status Figure 24 Create Data Set button In the next screen choose one of the options for the source of the Data Set Folder OAI PMH or Z39 50 and fill the respective form 2 5 1 1 Import From a File System Folder or URL 2s Home Tasks statistics schema Mapper OAI PMH Tests Administration Go to Data Provider Data Provider Create Data Set Data Set Metadata Format Current ese Folder Path or URL Records root name ID Policy ID Generated Name Name Code Language Le Output Record Set no spaces Description Transformation Add
41. uese Aggregator 4567 arquivocmlx OAI PMH Municipal de Lisb pal del de Lisboz Figure 35 Select the Data Provider in the homepage Click on the Ingest Now button to start ingesting the data immediately Figure 36 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arquivo Municipal de Lisboa e Arquivo Municipal de Lisboa arqMunicl x 4567 Edit Portuguese Aggregator Refresh Dataset ID Data Set Name OAI PMH Schemas Ingest Type Last Ingest Date Next Ingest Date Number of Records Ingest Status 2 FR arquivocmlx ese Type OAI PMH S Local Metadata Format ese OAI URL OAI Set ID Policy Record Set Description Name Name Code Language Transformations Number of Records Ingest Export Scheduled Tasks Log Files http bd1 inesc id pt 8080 repoxel OAlHandler arquivocmlx ID Generated arquivocmlx arquivocmlx arquivocmlx 78965 PT 0 ce p mmi ingest Now Schedule Ingest Records per file 1 Schedule Export Create Data Set Figure 36 Ingest Now button REPOX will show a message to confirm that the harvesting will start a few seconds Figure 37 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Data Provider Arquivo Municipal de Lisboa Harvest will start in a few seconds Arquivo Municipal de Lisboa arquimL X Figure 37 Starting harvest m
42. unning button shows a list of the tasks that are running in that moment 2 6 3 Edit and Delete Tasks To edit or delete a task click on the Tasks button on the top menu Figure 48 2 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect statistics Schema Mapper OAI PMH Tests Administration Goto Tasks Scheduled Calendar Scheduled List Running Parameters First Run Figure 48 Tasks button Clicking on a task a window with the task scheduling information is presented Figure 49 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Goto Tasks Scheduled Calendar Scheduled List Running Arquivo Municipal de Lisboa record June 2010 July 2010 Su Mo Tu We Th Fr Sa Tu We Th 1 Fl oe 16 1371 319 313 14 15 SE 21 22 23 24 25 26 21 3 Ari 28 29 30 dl 298 29 First Run 29 06 2010 at 17 h O v min Incremental Ingest amp Full Ingest Frequency Once Daily Weekly amp Every 1 Months Delete Schedule 17 00 record Figure 49 Window to edit or delete a task Change the scheduling information and click on Schedule button to save the task information Click on the Delete button if you want to delete the task A pop up menu appears in this case Click on the Ok button to confirm the
43. ure 45 2 Homex fasi Statistics Schema Mapper OAI PMH Tests Administration Goto Figure 45 Tasks button REPOX will then present a calendar showing all the programmed tasks Navigate through the months clicking on the arrows on the top of the calendar bounding the month and year The Figure 46 presents the calendar showing all the programmed tasks 26 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect 2 Home Tasks Statistics Schema Mapper OAI PMH Tests Administration Go to Tasks Scheduled Calendar Scheduled List Running lt lt SSC 2010 T mE Figure 46 Calendar showing the scheduled tasks Clicking on the Scheduled List button shows a list of the programmed tasks Z Home Tasks Statistics Schema Mapper OALPMH Tests Administration Goto Tasks Scheduled ien Scheduled List Running Type Par ameter 5 First Run Data Set Importer Data Set rec ord Once Starting 16 1 06 2010 at 42 0 Full Ingest false Full Ingest false Data Set Importer Data Set record Once Starting 24 06 2010 at 12 00 Full Ingest false Data Set Importer Data Set record Once Starting 21 06 2010 at 17 00 Data Set Importer Data Set record Every Thursday Starting 17 06 2010 at 12 00 Full Ingest false Figure 47 Scheduled tasks list The R
44. vice e Password password for the username e Charset The character encoding set of the data for example UTF 8 or ISO 8859 1 e Record Syntax The original syntax of the records It can be UNIMARC or MARC21 e Harvest Method the harvest method which can be Timestamp File one Id per file or Id Sequence e Earliest Date REPOX will harvest the records from the Z39 50 server until it reaches the records with the date specified on this field e ID policy defines how the record identifiers are assigned The options are 18 33 EuropeanaConnect D5 3 1 Europeana OAI PMH Infrastructure Documentation and final prototype Appendix REPOX User Manual europeana connect o D generated in this case it is assumed that the records to import do not have a unique identifier A unique identifier is generated by REPOX and assigned to each record o ID extracted the imported records have a unique identifier to be extracted from the Record using an XPath expression ex record id This is a common scenario as bibliographic metadata formats have tags for the identifier Name name of the Data Set Name Code the name code that identifies the data set Language the language of the data values in the Data Set e Record Set the new name of the record set on the REPOX system e Description a description of the Data Set e Transformation A schema transformation that can be used to transform the original data s

REPOX User Manual

Contents

Download Pdf Manuals

Related Search

Related Contents