Home

HARMOSEARCH D5.3 V1.0 Registry Evaluation Report

1. Id Name Description Expected Output Notes Explanation SR9 Metasearch go on Search Data gt Message says euromuse and modern Metasearch Contacted euromusemf are art select modern art providers 3 Test involved because in the exhibitions exhibitions as category euromuse and registry s data click on Search euromusemf description see below it states that File D5 3 Registry Evaluation Report Page 9 of 22 FP7 SME 1 262289 HARMOSEARCH Deliverable D5 3 NM HARMOSEARCH the future of information services O from euromusemf Total results 50 25 from Test and 25 from euromuse they have modern art exhibitions This does not mean that they necessarily have instances of such events in fact euromusemf has not Data management test on the Data Registry from Appendix B 3 This test case consists in a number of user operations which must be executed in seguence to verify that the registry behaves correctly P 3 12 and P 3 14 represent two data management tests while the seguence P 3 12 P 3 13 P 3 14 P 3 15 represents a workflow integration test Id Seque Name Description Expected Notes Expl nce Output anation P 3 12 P 3 12 Modify login with user euromuse Data provider A data links P 3 13 euromuse euromuse harmonet org configuration provider s t0 P 3 14 configuratio saved configurati P4145 P 3 15 nin the go in
2. Clean up go in Configurations gt Ouery Service click on Test click on the attached data provider Test Data Provider click on Delete Provider DO NOT DELETE THE PARTICIPANT There is no attached provider any more and in Metasearch Test is no more listed in the drop down menu Did you understand what the registry is responsible for na RY oueq y y ell It is responsible of the description of data providers and contents they deliver and allows to link to the providers a semantic relevance with respect to gueries I haven t understood if the registry contains also mechanism for indexing contents Only after an introduction and detailed explanation The association was more interested in the process as a whole Yes but only after introduction to harmosearch After introductio nand clarification with examples Is the function of the registry new to you ig AV No if it is meant as tool to collect and expose metadata on services and functionalities provided by organizations Unsure Do you have the impression that the registry is fundamental in a search process in accuracy of results in response time oueq y y ella g vj OUeglv v Surely is very important in relationship with semantic accuracy of the provided results while with respect to the response time would be needed to undesrstand how providers are accessed and their
3. Result file is correct Appendix B 3 Test cases RC3 Semantic Registry Actual Result Error message as expected Screen message as expected Operation status page has content as expected Error message as expected Screen message as expected Operation status page has content as expected Result file is correct 2 Z Actual Result o Actual Result was not able to test 2 Z Actual Result Message shown as expected Mail received Link tested Failed on euromuse Impossible to connect to provider Error message shown as expected Met expected output results message shown results downloadable file matches the test data file compared on a control sample basis JUMPED TO SCHEDULER task 120 2 Z Actual Result There is no provider to query that matches your search criteria Operation completed successfully on euromuse 8 14 Par Seguen ent ce Action Import Dat a Exchange S cheduler Scheduler Import using Simple Search Scheduler Schedule a data import correctly Appendix B 3 Test cases RC3 Semantic Registry Description perform an import through Simple Search setting all as data provider all as category 1 31 March as period A user schedules an import or a push operation to be executed on a regular base daily weekly or monthly log in with your user go on Exchange Data gt Scheduler and
4. Appendix B 2 Test cases for release candidate 2 Note The table Test cases of RC2 for the Semantic Registry corresponds to an excerpt of the file Test Case Release 2 Meta search xslx available in 07 Demonstration ActivitiesVRelease 2 on SVN repository In the selected test cases the Semantic Registry is invoked to filter out the data providers to be involved in the metasearch process on the basis of the domain locations and categories that are specified in the guery Appendix B 3 Test cases for release candidate 3 Note The table Test cases of RC3 for the Semantic Registry corresponds to an excerpt of the file Test Case Release 3 Portal xslx available in 07 Demonstration ActivitiesVRelease 3 on SVN repository An extra column has been added to this excerpt namely the Semantic Registry column where it is clarified how the Semantic Registry was involved in the test case and how the release providers interpreted the outcome of the test to check if the Semantic Registry behaved as expected Appendix B 4 Test cases for release candidate 4 Note The table Test cases of RC4 for the Semantic Registry corresponds to an excerpt of the file Test Case Release 4 Portal xslx available in 07 Demonstration ActivitiesVRelease 4 on SVN repository Appendix B 5 Test cases for release candidate 5 Note The table Test cases of RC5 for the Semantic Registry corresponds to an excerpt of the file Test Cas
5. biella 18 from euromuse euromuse and Test are the same provider thus Test would have some events in Italy But the registry excludes it from the metasearch because its Data Description says it hosts only events in Berlin Germany 2 4 IVNOILdO Modify GENERALISE Data Description of the Test data provider Description go in Configurations gt Ouery Service click on Test click on the attached data provider Test Data Provider at the bottom click on Edit Data Description select events click on Save Changes Expected Output Appendix B 6 External evaluation of Semantic Registry Notes Explanation Now the Data Description of the provider includes every search criteria and Test is involved in every metasearch of events o 18 2 2013 wnipyy JI Actual Result o 21 2 2013 21 2 2013 Actual Result 19 2 2013 Actual Result 21 2 2013 o Z Actual Result 22 2 2013 IVNOILdO Repeated Metasearch events in Italy go on Search Data gt Metasearch select Italy click on Search Message says Contacted providers 4 Test biella euromuse and euromusemf Total results 50 total 4 from euromusemf 10 from biella 18 from euromuse 18 from Test This time Test was not filtered by the semantic registry like it was when the Data Description was events in Berlin Germany
6. Documentation Annex D 4 3 Web Service APIs Specifications_v0 3 docx file available in SVN at 04_Query_Mapping metasearc h engine The expected outcome describes what should be present in the home at the end of all tests Two strings are returned The first says Operation completed successfully on biella and the second is a link to the imported file available on the Data Repository Operation Status reports about the successful completion and links to the Querybox where the result file is available check the timestamp Share Data is active with event mapping configured but accommodation mapping not Scheduled Share is active with event mapping configured but accommodation mapping not Import Data and Receive Data is active with accommodation mapping configured Receive Queries is active with Ouery mappings available and Ouery Service configured Semantic Registry filters out relevant data providers and provides access information of the data providers Sem Reg is invoked to check if the query service is configured 42 0W0Jd 49 0W0Jd o U2Ipauswnasnu Udipawuswnasnuj Uadipoawswnasnw u p awswn snw Appendix B 4 Test cases RC4 Semantic Registry 8 8 o o Output o iz Actual Result Actual Result XML Screen Actual Result 19 11 2012 Google Chrome 19 11 2012 Firefox 16 2 Actual Result is Actual Re
7. Registry returns Euromuse Biella and euromuse crawler Search Query Language Search All events within locations Retun all possible events in Berlin Output should be result list Same output as SO1 Alternative 1 In France Country instead of given city Alternative 2 in FRA IATA code for Frankfurt Alternative 3 in IT ISO code for Italy Alternative 4 in Berlin or Wien Alternative 5 in Berlin or Wien with a certain period Alternative 6 in Berlin at that date or Wien during that period Alternative 7 in Berlin at that date if there is no attraction in Berlin at that date Comment from CP alternative 2 HarmoNET tourism ontology uses the ISO 3166 two letter or A2 country codes and the full city name not the IATA code Comment from CP alternative 7 in this first version the query language is not able to handle queries joining different domains e g events and attractions Registry returns Euromuse and euromuse crawler wnipyy wnipyy wnipyy Search Query Language Search All events within locations Retun all possible events in France Same comment as SQ4 Registry returns Euromuse and euromuse crawler Search Query Language Search All events within locations Retun all possible events in Italy Same comment as SQ4 Registry returns Biella Same as 1 since countries use codes Remove from subsequent tests Search Query Language Search All events within locations
8. supported through the mechanism of external services While the former data modification Use cases in general do not change the contents of data elements purging a result set from unwanted characters changes the content not substantially translation typically involves a drastic change of content Examples are translation of textual descriptions to a different natural language or conversion of price information from a particular currency to another currency External services may provide such functionality Definition of the Harmosearch Query Language ontology Semantic registry component implementation of query language for the registry Metasearch core Engine implementation login user and accounts management file upload and dowload Crawler prototype based on microformat semantic annotations Providers Euromuse Events Museollitto Events Biella Events Attraction Facebook Events Attraction Consumers Harmosearch Labtrip Euromuse Teleatlas Subdomains Attraction Events Minimal search criteria Subdomain 0 2 Location City Country 0 1 Date Range 0 2 Category 0 If no response remove criteria C lt D lt L lt S Expected output HTML result list no paging Name summary date if present location media if present Whatever is present in response Mapping Tool first version to be demonstrated Events only KHM used for demo Biella Museollitto Subdomain Events Providers Biella Euromus
9. the Expected Output column may change in skipping the optional time because the metasearch is an online steps Clean up if necessary operation that gueries external data providers log in as testuser testuserOtest user password testuser go on Configurations gt Ouery Service click on the Data Provider s attached to your organisation if it they exists click on Delete Provider DO NOT DELETE THE PARTICIPANTI In order to understand better the tests at the bottom of the sheet there is a description of what the semantic registry knows about the data providers biella euromuse and euromusemf euromusemf is the local index that contains crawled Microformat metadata from the euromuse web site The evaluation starts with Test organization having no data provider attached 21 2 2013 o 2 Actual Result Andrea Albano consultant of ATL Biella executed the steps by himself 19 2 2013 Actual Result Demonstating Online going through the Harmosearch Portal supporting through phone For Saarl ndischer Museumsverband e V SMV Museums Association of Federal State Saarland Saarland 21 2 2013 o Z Actual Result Short Demonstration and explanation to Guy Frank Member of EGMUS European Group on Museum Statistics 22 2 2013 1 4 Actual Result Demonstrati ng practice For German Resistance Memorial Center GDW Berlin TYNOILdO Add
10. Output should be result list see SQ1 Same as SO1 Registry filters the data provider s to be involved in the search process Search Query Language Search All events within locations Retun all possible events in Germany Output should be result list see SQ1 Alternative 1 In Germany Country instead of given city Same as SO1 Registry filters the data provider s to be involved in the search process 2 Z Actual Result 1 data providers contacted euromuse 43 results Appendix B 3 Test cases RC3 Semantic Registry 2 Actual Result get results as expected think the expected info is wrong CP you are right corrected the expected output 2 Z Actual Result ok but tried on a different provider euromuse was working CP you are right corrected the expected output Actual Result Received 43 results selected provider all Second search provider biella not results gt message There is no provider to guery that matches your search criteria Third search provider euromuse 43 results 2 Actual Result 99 results from euromuse external service 246 results from euromusemf local index CP possible if you didn t restrict to search only on euromuse 2 Z Actual Result Results found 43 3 data providers contacted euromuse euromusemf biella 364 results 4 data providers contacted 364 results ok Just as a comment i
11. Retun all possible events in Berlin or Vienna Same comment as SQ4 Registry returns euromuse biella and euromuse crawler wnipyy wnipyy wnipyv Why he logical condition OR where inset probably implies or Otherwise why use OR here and AND in the next one gt Test case will be corrected Search Query Language Search All events within locations Retun all possible events in Berlin or Vienna within a certain period Same comment as SQ4 Registry returns euromuse biella and euromuse crawler o Search Ouery Language Search All events within locations Retun all possible events in Berlin at that date or Vienna during that period Same comment as SO4 Registry returns euromuse biella and euromuse crawler wnipyy wnipyy Pare nt Action Search Ouery Language Search All events for certain categories Description Retun all possible events in Berlin corresponding to modern art exhibitions Appendix B 1 Test Cases RC1 Semantic Registry Comment and alternatives Output should be result list Same output as SQ1 Alternative 1 in Berlin corresponding to modern art exhibitions or classical concerts Alternative 2 in Berlin or Wien corresponding to modern art exhibitions or classical concerts in Berlin or Wien corresponding to modern art exhibitions or classical concerts during Alternative 3 that period Alternative 4 in Berlin during that period or Wien at
12. Saarland assisted by Museumsmedien e Guy Frank Member of EGMUS European Group on Museum Statistics assisted by Museumsmedien e German Resistance Memorial Center GDW Berlin assisted by Museumsmedien e Andrea Albano consultant of ATL Biella assisted by Ectrl The approach that was adopted to collect such feedback consisted in presenting a show case which was followed by a short interview For the show case a sequence of operations on the HarmoSearch portal has been defined which was aimed at highlighting how the Semantic Registry reacts to given search queries and which consequences there are when a provider changes the description of the data it provides The sequence of operations was also functionally tested by the evaluation leader Afidium To keep the interview short as requested by the assisting partners it was decided to focus this external evaluation on the Data Registry The Service Registry was therefore evaluated only by the expert users partners of the project through the RC5 evaluation form The show case and results are attached in Appendix B 6 File D5 3 Registry Evaluation Report Page 14 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services 4 APPENDIX Table of content of the Appendix section APPENDIX A LIST OF REQUIREMENTS ccccceeeceeeceeeeeeeeeeeeeeneeeeeeaneeaae 16 APPENDIX B TEST CASE DOCUMENT KC 17 APPENDIX B 1 TEST CASES F
13. e Service Registry The part of the semantic registry concerned with registering information about service providers File D5 3 Registry Evaluation Report Page 4 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 Ej the future of information services Release candidate The development of the HarmoSearch semantic registry component followed an iterative approach Accordingly several versions of the semantic registry have been developed A release candidate denotes to the most recent version of the prototypical implementation of the component ready to be evaluated Internal evaluation Technical evaluation Defined in details in this document this evaluation consists of technical unit tests performed by developers in order to ensure the robustness of the developed software artifacts External evaluation Functional evaluation Defined in details in this document this evaluation consists in using the components of the HarmoSearch system in order to ensure that they meet the established reguirements and can be used by non technical users 1 3 RELATIONSHIP WITH OTHER DOCUMENTS Inputs to this document come from D2 1 Use Case Specification defines the main functionalities and reguirements of the overall HarmoSearch system D2 2 Architectural Design describes the basic architecture of the overall HarmoSearch system D5 1 Registry Reguirements Analysis provides a detailed reguirements analysis for the Semantic
14. 3 3 Par Seguen ent ce Action User Regist ration User Regist ration User Registration User registrates with valid data to a new organization user side Appendix B 3 Test cases RC3 Semantic Registry Description A new user creates an account by compiling the create user form He can choose an existing organization to be assigned to or he can create a new one insert your own data names and email address insert also the organization you belong to must not be already listed among the registered organizations Comment and alternatives Email address will be used to send notifications and should therefore be real and owned by the user In order to log into the system the new user and organisation need to be activated by an administrator After the activation which is notified via email to the user he can log into the portal and he is ranked as an adiminstrator of the new organization If the user writes a new org in the text box and also selects an existing organization from the combo box the combo box is not read Expected Output Success message on the screen An e mail is sent to the user to notify the registration and communicate the password 1 14 Semantic Registry Explain how the Semantic Registry is involved Organization is registered also in the Semantic Registry User Regist ration User Login User Login Metasearc h Metasearch User registrates with valid data to a
15. Configurations on is semantic gt Query Service and select modified registry Euromuse in Registry Data in the change a Management semantic category select the Euromuse registry Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition music with exhibition pop music P 3 13 P 3 12 Metasearch go in the Metasearch tab Error message Registry P 3 13 on execute a simple search on There is no filters out P 3 14 unregistered euromuse selecting provider that the data P 3 15 category exhibition music as category matches your provider s search criteria to be involved in the search process File D5 3 Registry Evaluation Report Page 10 of 22 FP7 SME 1 262289 HARMOSEARCH Deliverable D5 3 NM HARMOSEARCH the future of information services P 3 14 P 3 12 Modify login with user euromuse Data provider A data links P 3 13 euromuse euromuse harmonet org configuration provider s to P 3 14 configuratio saved configurati P 14 6 P 3 15 ninthe go in Configurations on is semantic gt Query Service and select modified registry Euromuse in Registry Data in the restore the Management semantic category select the Euromuse registry Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition pop mu
16. The first says Operation completed successfully on biella and the second is a link to the imported file available on the Data Repository Operation Status also reports about the successful completion and links to the Ouerybox where the result file is available check the timestamp The new service is in the workflow services list on the left Like 13 1 External service is registered within the Semantic Registry Jajowold Jayowolg ualpawsuwnasni Ualpawswnasnin Use external services Use external service in import log in with your account go on Exchange Data gt Import Data select euromuse as data provider Austria as country exhibition archeology as category include Permanet Events Filter as external service click on Add button click on Search Screen message and Operation Status report success of the import In Data Repository gt Ouerybox the just received file contains only 3 events out of 9 which would be returned without including the external service they all are permanent exhibitions In Subscribe to Service the max number of times is updated to 2 Access information to use the external service are held by the Semantic registry Jayowold ualpawsuwnasni as my user is registered as euromuse user and the euromusemf provider did not respond i shortly assigned the spk editor user the role of import with a mapping
17. description We don t think to save the previous page before and may loose every thing Browse Registry events in Berlin go on Search Data gt Browse Data Providers select events in Berlin 3 providers returned Test is listed as relevant data provider by the semantic registry together with euromuse and euromusemf Consistent with the Data Description of the data provider the semantic registry considers Test as relevant in a guery that looks for events in Berlin oueq y y ella NAS Udpawsunasnu SNW93 uswnasnu Ma9 valpawswnasnw Results o k but worked only for1 data provider Metasearch events in Berlin go on Search Data gt Metasearch select Germany and Berlin click on Search Message says Contacted providers 3 Total results 215 71 euromusemf 72 euromuse 72 Test All 3 data providers that are considered relevant are involved in the metasearch but very o slow it takes several minutes to get the results oueq y V ella g Dy no provider skipped it SNNOJ wsunasnu worked only for 1 data provider Browse Registry cultural events in Berlin go on Search Data gt Browse Data Providers select cultural events in Berlin 1 provider returned Test is the only relevant data provider listed by the semantic registry events in Berli
18. the respective configuratio configuration pages n J2 0W0Jd access policies the lock is not well linked to the navigation it should be a link to here http harmosearchdev harmonet org accesspolicies Par ent Action Metasearch Metasearch Metasearch on unregistered category Appendix B 5 Test cases RC5 Semantic Registry Metasearch role Description Comment and alternatives A user performs metasearch by using the search fields of the user interface go in Search Data gt Metasearch execute a simple search of events selecting agricolture as category No provider has registered providing events of this category Expected Output Semantic Registry Error message No provider registered that matches search criteria Registry filters out the providers 28 1 2013 JOJOWOJd 29 1 2013 Actual Result 1 2 2013 o wWsWNasnA Actual Result 11 2 2013 Who Actual Result Output XML Screen a 21 2 2013 1 3 Metasearch Remove Test from metasearch data providers log in as testuser testuser test user or the email you set password testuser go in Configurations gt Ouery Service click on the attached data provider uncheck METASEARCH from the operations click on Save Changes Registry still maintains the information about the provider which is however no more available for metasearch Test is no more available among the da
19. Euromuse Biella and euromuse crawler winipyy What about the optional fields gt Added in RQ Search Query Language Search All events Alternative 1 Retun all possible events preferences on output Same comment as SQ2 Registry returns Euromuse and euromuse crawler Search Query Language Search All events within time frame Retun all possible events within Date 1 Date 2 Output should be result list Same output as SO1 Alternative 1 give only Date 1 Alternative 2 give only date 2 Alternative 3 All events during that period and all attractions at that date in the same query Comment from CP alternative 3 in this first version the query language is not able to handle queries joining different domains e g events and attractions Registry returns Euromuse Biella and euromuse crawler wnipyy wnipyy think there is a missmatch betwwen from to and start end If it is the case true for all tests with dates In case of flexibility how would we express the flexibility gt Added in RQ Search Query Language Search All events within time frame alternative 1 Retun all possible events after Date 1 Same comment as SQ3 Registry returns Euromuse Biella and euromuse crawler Why do we keep the AND since there is only one criteria Search Query Language Search All events within time frame alternative 2 Retun all possible events before Date 2 Same comment as SQ3
20. Examples In the following some examples from the Appendixes are reported to clarify how the functional tests were structured and also to understand why sometimes a single step is not enough but a sequence of steps is needed to build up a complete functional test e g changing provider s configuration and then executing a metasearch Stand alone reaction test on the Data Registry from Appendix B 6 Premise The data provider Test is registered in the Registry having events in Berlin The other data providers would have events in Germany thus in Berlin but they have other categories of events not cultural Id Name Description Expected Output Notes Explanation SR4 Browse go on Search Data gt only 1 provider events in Berlin is Registry Browse Data Providers returned more generic than cultural select cultural events cultural events in events in in Berlin Test is the only Berlin thus Test is Berlin relevant data considered relevant for provider listed by the query the semantic registry Integrated workflow test on the Data Registry from Appendix B 6 Premise The data provider Test is registered in the Registry having events in Berlin euromuse and euromusemf are registered having events in a number of European countries and belonging to various categories among these also modern art exhibitions
21. Participant museolitto type mapping from local system to HTO 2 14 o T Z Actual Result tested last week after claudio sent us the credentials we could login EUTUTIEATEA ACCOUNT W an already exiistitng account werder museumsmedien after login we get an unexpected system error occurred Seguen ce Action Metasearch Metasearch on unregistered category Appendix B 3 Test cases RC3 Semantic Registry Description login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition pop music with exhibition music Comment and alternatives Please edit test case P 14 6 Expected Output 3 14 Semantic Registry Description of a data provider is modified within the Semantic Registry Metasearch Metasearch on unregistered category go in the Metasearch tab execute a simple search on euromuse selecting exhibition music as category returned 43 results the number may vary it is an online search Registry filters the data provider s to be involved in the search process Search Query Language Search All events Retun all possible events Output should be result list see SQ1 Same as SO1 Registry filters the data provider
22. The transparent tests are those that refer to the filtering out of data providers that have to be involved in a search process The direct tests are those that refer to the registration and update of data providers and of service providers 3 2 EVALUATION OF RC1 RC1 consisted in the implementation of a selection of components in the HarmoSearch system among these the first Semantic Registry prototype They were not yet integrated and a complete search was not yet possible With regards to the Semantic Registry the query language for the registry was implemented The functional test of this release candidate was done only by the release provider CPR and by the evaluation leader Afidium RC2 instead was the first time that other partners were involved in testing the Semantic Registry The results of the evaluation are attached in Appendix B 1 Test cases for release candidate 1 The Acceptance notes for RC1 are attached in Appendix C 1 3 3 EVALUATION OF RC2 RC2 consisted in the first release with integration of different components included the Semantic Registry in order to have a complete process of metasearch running File D5 3 Registry Evaluation Report Page 12 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services The Semantic Registry component has been tested as part of the metasearch process and three data providers were registered to this purpose i
23. and Metasearch Scenario Setup Harmonise Registration and Import Scenario Setup Batch transfer of Import Scenario static data Data Hosting Use Publishing and Subscription S Case Data Publishing Use Publishing and Subscription S Case Data Modification Scenario Data Cleansing Appendix A List of requirements for Semantic Registry 1 3 Requirement Create Organisation and users from HS admin Add new data source provide data to an account or update existing information Register data and services Allow new ways to access or submit data The data providers register on Harmonise and set up the data flow The data providers and the tourism portal register on Harmonise and setup the data flow This use case is very similar to the use case MS 1 though it does differ in details The goal of the use case is to transfer static information e g in case of accommodation accommodation name description location pictures amenities etc from the data providers to the portal in regular intervals This is to allow data providers to easily upload once or ona regular basis their data in the Harmonise portal This is to allow data providers to easily publish once or ona regular basis their data in the Harmonise network This is to allow data consumers to apply additional filter cleanse services on raw data HS admin can create validated users and associate them to any existing entity Define basic infor
24. comment as SQ5 Registry returns biella euromuse and euromuse crawler wnipiyy Could we not express category only once Search Query Language Search All events for certain categories Retun all possible events in Berlin during that period corresponding to modern art exhibitions or in Wien at that date concerning classical concerts Same comment as SQ5 Registry returns biella euromuse and euromuse crawler wnipiyy Parent Action Search Query Language Search all from Euromuse Description Return all possible information for all domains coming from Eurmuse Comment and alternatives Output should contain Name City event location event category domain and date range Optional content would be url telephone vignette user rating Comment from CP so far the metasearch engine does handle context information optional result fields language preferences etc so even if they are present in the query language then they are ignored Annex B 2 Test cases RC2 Semantic Registry Actual Result Registry O returns Euromuse Query Processor selecting euromuse from list O 1 XML file Metasearch W 10 results missing city location and event domain due to incomplete mapping Output XML Screen Registry screen Query Processor XML file s Metasearch screen Actual Result advance search sg1 xml returned 10 results with title short de
25. compiled evaluation documents Appendix C contains the acceptance reports File D5 3 Registry Evaluation Report Page 5 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 Fi the future of information services 2 CONTEXT 2 1 OVERVIEW OF THE SEMANTIC REGISTRY FUNCTIONALITIES The Semantic Registry deals with describing on a metadata level what actual information or services are provided by the different Harmonise participants It consists of two main sub components the Data Registry and the Service Registry The Data Registry is responsible for capturing information about the content provided by data providers This is done by storing metadata describing the content and associating it to the respective data providers The main task of the Data Registry is to be able to find HarmoSearch participants associated to specific data thus identifying the data providers who have content that can possibly satisfy a given search guery inside a metasearch process The Service Registry has the primary function to register describe and manage the external services offered by Harmonise participants The service itself and its basic effects are described at the time of service registration At this point the service provider makes the service and its technical implementation known to the Harmonise system A user interface integrated into the Harmonise platform is used for registering the service Furthermore a specialised user interfac
26. contents are indexed Yes in this case Do you have any improvements to suggest oueqly y lj91g AV Difficult to answer should be needed more knowledge of the system Seems guite difficult to understand how the association could use this in future But is eagerly interested in data exchange in general Could be interesting to to harmonise statistical data of museums from various European countries use in other context e g 3 4 Appendix B 6 External evaluation of Semantic Registry 18 2 2013 21 2 2013 19 2 2013 21 2 2013 22 2 2013 Z Actual Result o Description Expected Output Notes Explanation Actual Result Actual Result Actual Result Within the Within the semantic registry the Data semantic registry Description of euromuse and of the Data euromusemf is as follows Description of biella is as follows events belonging to the following categories events belonging to and in the following countries the following categories and in the following locations country Italy on exhibition music exhibition cross disciplinary city Biella ion non european art exhi i exl n contemporary art categories jon numismatics exhibi il exhibition pre and early history festival jon decorative arts exhi is n aplied arts business n architecture exhi n science and technology music iton non european cu
27. correspond The interpretation of the results has then been done by the release provider at the end of the evaluation session In fact only the developers could identify the source of the defect which might have occurred either within the operation that failed but could also be a consequence of some misbehaviour in the sequence of steps done before For each failed test it was identified if the problem was a functional defect excluding cases of server down incorrectness of the test execution misinterpretation of the result by the participant etc Each functional defect was then inserted into the bug tracking system so that the various issues were traced and the other partners were informed on the evolution of the bugs they had found False bugs were instead explained within the Excel file itself with a note File D5 3 Registry Evaluation Report Page 8 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services In the end also an interview based evaluation was done involving domain experts which are external to the project They were introduced to the overall HarmoSearch system and through a show case they were made familiar with a HarmoSearch workflow and with the role of the Semantic Registry At the end they were asked to provide some feedback Section 3 7 describes who was contacted and how this feedback was collected The results are reported in Appendix B 6 2 3 2
28. euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider edit the service access endpoint inserting http www euromuse net harmonise as service access endpoint no whitespaces Save changes pre condition Import Dat a Data provider is unavailable in import perform an import through Simple Search setting euromuse as data provider all as category Screen message is shown Operation stated You will receive an email notification To view the status and results go here In Operation Status tab the entry of the previous import reports for instance Failed on euromusemf Impossible to connect to provider Semantic Registry is invoked to get the information on how to access a data provider Import Dat a Data provider is unavailable in import login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider edit the service access endpoint inserting http www euromuse net harmonise guery guery php as service access endpoint no whitesapces Save changes post condition Import Dat a Import on unregistered category perform an import through Simple Search setting euromuse as data provider activity as category Error message There i
29. from hto to system identity xslt and a suscription to the permanent exhibition service and got the expected result Use external Delete external services service log in as testuser testuser test user or the email you set password testuser go on External Services gt Manage Services click Delete on the Permanet Events Filter service The service is no more listed in the workflow services panel External service is unregistered from the Semantic Registr JB 0WOJd o pouistunasniN Seguenc e Name Set up data provider Set up query service Pub5 1 Pub5 2 Scheduler Schedule a push correctly Appendix B 5 Test cases RC5 Semantic Registry Publisher role Description User specifies the basic configuration for a data provider Login with your user go in Configurations gt Query Service click on your organization s name go on panel Create and attach a new Data Provider and insert an id e g lt Your organization gt dataprovider no whitespaces click on Create and insert the following parameters any name for your provider the name of the collectionid that you used when uploading the data mapping for instance events http www euromuse net harmonise guery guery php as service access endpoint no whitespaces karin as username and password HTTPAdapter as Connector class select IMPORT and METAS
30. in data mapping from BLOCKING nstration_Activiti Harmonise Ontology to test Cannot convert The file in the inbox is different The file is the outbox is ok Filin es test 20data string to xs decimal Please check the listed after requesting the inbox is attached Tests 20outputs mapping file persmission the external 20121113_Filep _mapping file from local system to hto NOT BLOCKING ush_content_err spk_hto is correct and uploaded but there ok Not obvious that one has to push _ operation was successfull File in inbox would be better if opened in another tab or xml is no mapping hto_spk the add button _ data looked as expected _Event fields filter was not service was listed as described two events are shown Not possible to discard all the events from _actually the permanent exhibition was confirmation you get the message no listed and the temporary exhibition was item selected but actually that what i filtered out wanted Pa re Segu nt ence Action Exchange Ac commodati ons Exchange Ac commodatio ns Metasearch of accommodations Appendix B 4 Test cases RC4 Semantic Registry Description go on Metasearch select Accommodation as subdomain guesthouse as type tv room as facility click Search Comment and alternatives Expected Output 7 results are given Semantic Registry Semantic Registry filters out relevant data providers and
31. is in Appendix B 3 Test Case Release 3 Mapping Tool xslx Appendix C 4 Acceptance notes for RC4 of the Registry The following section is an excerpt addressing only the Semantic Registry of the document Acceptance Notes for Release 4 which is available in its complete version in D7 1 Compiled collection of acceptance notes SME Acceptance This section contains the list and status for each partner Di CHECK YES NO Conditional ES X O BUSINESS SOLUTIONS GMBH EN ECTRL SOLUTIONS SRL EC3 Networks GmbH Lehmann amp Werder Museumsmedien File D5 3_Registry_Evaluation_Report Page 20 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services DI CHECK YES NO Conditional AFIDIUM YES Other partner comments NO COMMENT Consortium acceptance The consortium thereby accepts this release and considers that it covers requirements Appendix Test Summary Attached to this document are the Excel files detailing the tests that were performed and justifying the level of acceptance for the delivery Test Case Release 4 Portal xslx an excerpt is in Appendix B 4 Test Case Release 4 Mapping Tool xslx Appendix C 5 Acceptance notes for RC5 of the Registry The following section is an excerpt addressing only the Semantic Registry of the document Acceptance Notes for Release 5 which is available in its complete version in D7 1 Co
32. new organization administrator side User Login User takes an overview of the availability of the services Metasearch Registry is unavailable in metasearch Prerequisite the previous test case user registration with correct data has been performed with success A user logs in into the HarmoSearch portal take a look on the Services Board portlet in the home page Auser performs metasearch by using the search fields of the user interface or by posting directly HarmoSearch queries in the Advanced Search text area Prerequisite the registry has been shut down select any kind of simple or advanced metasearch Post start the registry again This test case can only be tested by the system administrator You can further check by uploading the mapping file HTO_Euromuse xslt available in the test data folder from within Configurations gt Mapping Store in the row Upload mapping from Harmonise ontology to local system for importing receiving data and check again on the services board that the Import Data is now Active This test case can only be tested by the administrator An e mail is sent to the administrator to notify the new account and new organisation creation Status is Not Active for all services apart from Metasearch for which no permissions nor mappings need to be set Error message is shown Impossible to connect to the data registry Please contact the administrator Organization is regi
33. note Moreover the final fifth release was presented also to external domain experts who were asked to provide their feedback 2 3 TESTING THE SEMANTIC REGISTRY 2 3 1 Test cases The Semantic Registry target of this evaluation is a backend component which implements specialized functionalities that the final user in many cases only indirectly perceives Thus it is useful to clarify how the quality and success of this component has been tested There are several aspects that have been evaluated e Functional aspects defects or other issues that occurred during the test e Usability of the Semantic Registry e Look and feel e Documentation All of them have been evaluated through the External Evaluation Document an Excel file Among these the functional aspects have been tested through precise user operations on the portal based on a concrete business scenario The document contains a detailed description of the input as well as the expected output necessary to perform each step successfully In some cases the sequence of steps had to be done necessarily in the given order and without skipping anyone of them The functional tests can be further classified as follows File D5 3 Registry Evaluation Report Page 7 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 E the future of information services e Data management tests they refer to the registration update and deletion of either data or servic
34. please retry O results Comment CP the server was down can you please retry Search All events within locations Retun all possible events in Biella within 1 9 2011 31 12 201 1 or Wien within 1 1 2012 31 03 201 2 Output should be result list Same output as SQ1 Alternative 6 in Biella within a certain period or Wien within another period Registry O returns euromuse biella and euromuse crawler Query Processor selecting all three data providers O 2 XML file each Metasearch X 10 results not all the results of an OR query are displayed this bug has already been fixed for the third release Registry screen Query Processor XML file s Metasearch screen cannot choose 2 criteria in the simple search mask Metasearch 0 Results Comment CP the server was down can you please retry O results Comment CP the server was down can you please retry Parent Action Search Query Language Search All events for certain categories Description Retun all possible events in Biella corresponding to cultural Comment and alternatives Output should be result list Same output as SQ1 Annex B 2 Test cases RC2 Semantic Registry Actual Result Registry O returns biella Query Processor selecting biella as data provider O 1 XML file Metasearch W 4 results missing city location and domain due to incomplete
35. reguirements or to configuration issues that will be solved and tested in the next release Appendix Test Summary Attached to this document are the Excel files detailing the tests that were performed and justifying the level of acceptance for the delivery Test Case Release 2 MetaSearch xslx an excerpt is in Appendix B 2 Test Case Release 2 Mapping Tool xslx Appendix C 3 Acceptance notes for RC3 of the Registry The following section is an excerpt addressing only the Semantic Registry of the document Acceptance Notes for Release 3 which is available in its complete version in D7 1 Compiled collection of acceptance notes SME Acceptance File D5 3_Registry_Evaluation_Report Page 19 of 22 FP7 SME 1 262289 B HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services This section contains the list and status for each partner nm ence HR NO contol Other partner comments NO COMMENT Consortium acceptance The consortium thereby accepts this release and considers that it covers requirements on the portal The mapping tool is accepted as a prototype provided it is transformed in the next release to take into account the usability requirements Appendix Test Summary Attached to this document are the Excel files detailing the tests that were performed and justifying the level of acceptance for the delivery Test Case Release 3 Portal xslx an excerpt
36. result list see SO1 Alternative 1 give only Date 1 Comment from CP if you specify only the start date you will get all events which ends after the specified date independently from when they start Same as SO1 Like SO1 JOJOWOJd wswnasn sg3alt1 Search Query Lan Search All events within time frame alternative 2 Retun all possible events until 30 04 2013 Output should be result list see SO1 Alternative 2 give only date 2 Comment from CP if you specify only the end date you will get all events which starts before the specified date independently from when they end THEREFORE ALSO PAST EVENTS ARE RETRIEVED Same as SO1 Like SO1 JO OWOJd WsWNasn sq 3alt2 Par ent Action Search Query Lan Search All events within locations Appendix B 5 Test cases RC5 Semantic Registry Metasearch role Description Retun all possible events in Berlin Germany Comment and alternatives Output should be result list see SO1 Comment note that the results are not the same as if you insert the same parameters in Simple Search because in that case a further default search criteria is added namely from today on Expected Output Semantic Registry Same as SO1 Like SO1 O preja ek 4a 0WOdld biz o 29 1 2013 WUNIPLJ Malej Actual Result uisuinasnn bin Actual Result 11 2 2013 Actual Result Output XML Screen a 2 3 S
37. s to be involved in the search process Search Query Language Search All events within time frame Retun all possible events within 1 4 2012 30 04 2012 Output should be result list see SQ1 Comment from CP if you specify both start and end date you will get events whose time interval overlaps with the specified dates Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events within time frame alternative 1 Retun all possible events starting from 1 4 2012 Output should be result list see SQ1 Alternative 1 give only Date 1 Comment from CP if you specify only the start date you will get all events which ends after the specified date independently from when they start Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events within time frame alternative 2 Retun all possible events until 30 04 2012 Output should be result list see SQ1 Alternative 2 give only date 2 Comment from CP if you specify only the end date you will get all events which starts before the specified date independently from when they end THEREFORE ALSO PAST EVENTS ARE RETRIEVED Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events within locations Retun all possible events in Berlin Germany
38. select IMPORT Data as Operation euromuse as recipient exhibition art history as category each day at hh mm in scheduled options see comment click Schedule task Comment and alternatives The HarmoSearch portal server has GMT time You must therefore subtract 1 hour to the time you want the operation to be scheduled that is true if your time is GMT 1 Expected Output Screen message is shown Operation stated You will receive an email notification To view the status and results go here In Operation Status tab the entry of the previous import reports Operation completed successfully on euromuse In Data Repository gt Querybox the result files are available check the timestamp and they contain some results check with the example files import_results_Simple_Search_ data provider xml in the test folder After the time set in the scheduled options the result file is available in Querybox and contains some results In Operation Status the import operation is reported to be completed successfully on euromuse After some minutes you receive also a notification email 9 14 Semantic Registry Semantic Registry is invoked to get the information on how to access a data providers Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the provid
39. tried also with IT rome and succeed contacted proviers 2 received results 192 used SO5 alternative 3 Provider all Location Berlin Dates April 1 30 category modern art Results 3 from euromuse external service o also listing archived old exhibitions EUROMUSE should not deliver them 2 data providers contacted euromuse euromusemf 230 results 2 data providers contacted 230 results contacted proviers 2 received results 230 o k for Harmosearch but same as above 4 14 Par Seguen ent ce Action Search Query Language Search All events within locations Appendix B 3 Test cases RC3 Semantic Registry Description Retun all possible events in Frankfurt Comment and alternatives Output should be result list see SQ1 Alternative 2 in FRA IATA code for Frankfurt Comment from CP HarmoNET tourism ontology uses the ISO 3166 two letter or A2 country codes and the full city name not the IATA code Expected Output Same as SO1 5 14 Semantic Registry Registry filters the data provider s to be involved in the search process Search Query Language Search All events within locations Retun all possible events in Italy Output should be result list see SQ1 Alternative 3 in IT ISO code for Italy Same as SO1 Registry filters the data provider s to be involved in the search process Search Query Language Sear
40. 3 docx file available in SVN at 04_Query_Mapping meta search engine Operation Status reports about the success of the operation In Data Repository gt Ouerybox the file with the accommodations from biella is available with 10 accommodation results it looks like the file accommodation_results xml in the test folder After the time set in the scheduled options the result file is available in Ouerybox and contains some results In Operation Status the import operation is reported to be completed successfully on euromuse After some minutes you receive also a notification email Two strings are returned The first says Operation completed successfully on euromuse and the second is a link to the imported file available on the Data Repository Operation Status also reports about the successful completion and links to the Ouerybox where the result file is available check the timestamp Semantic Registry is involved to filter out the target data providers If biella had not accommodations or if b amp b accommodations were not included in the data description no query would have been submitted A message would report that biella does not match with the given search criteria Like 11 8 If euromuse had no data in the events domain the query would not have been submitted A message would inform that euromuse does not match with the given search criteria The Semantic Registry
41. B 3 Test cases RC3 Semantic Registry al Result Email received Operation logged and accessible through the Operation Status Panel E 2 Si Actual Result Actual Result Actual Result Actual Result Email received Operation logged and accessible through the Operation Status Panel Dit not work because put an XML string and not a file Claudio has been advised 14 14 Pa re Segu nt ence Action Test Set Up Test Set Up Basic configuration needed for the tests Create an account if you don t have one yet Appendix B 4 Test cases RC4 Semantic Registry Description User configures his account with mappings permissions and guery service click on Sign in click on Create Account insert your own data names and a valid email address select also the organization you belong to if not present insert the organization s name wait for the account activation email activation is done by an administrator and alternatives Expected Output Email which confirms that the account is active Semantic Registry The organization is registered also within the Semantic Registry 49 10W0Jd 12 11 2012 uUdIpawswnasnu 1 8 Actual Result no activation Claudio did it manually password and sentence ends with dot to me it is not clear where the password ends it seems not possible to copy amp paste the password Test Set Up
42. Biella within 1 4 2013 30 04 2013 or Berlin within 1 5 2013 31 05 2013 Output should be result list see SO1 Alternative 6 in Biella within a certain period or Wien within another period Same as SO1 Like SO1 JAJOWOJd Search Query Lan Search All events for certain categories Retun all possible events in Biella corresponding to cultural Output should be result list see SO1 Same as SO1 Like SO1 1810WOJd Search Query Lan Search All events for certain categories Retun all possible events in Berlin corresponding to modern art exhibitions or sculpture exhibitions Output should be result list see SO1 Alternative 1 in Berlin corresponding to modern art exhibitions or sculpture exhibitions Same as SO1 Like SO1 JRJOWOJd Search Query Lan Search Al events for certain categories Retun all possible events in Berlin or Biella corresponding to modern art exhibitions Output should be result list see SO1 Alternative 2 in Berlin or Biella or corresponding to modern art exhibitions Same as SO1 Like SO1 1810WOJd loads 51 events in berlin from euromuse contacts 2 data providers none are retrieved from biella or euromuemf Search Query Lan Search All events for certain categories Retun all possible events in Berlin or Biella corresponding to modern art exhibitions during that period Output should be result list see SO1 Alternative 3 in Berlin or Biella corresponding
43. EARCH as operation Event as Subdomain click on Save Changes click Edit Data Description and select events click on Save Changes User schedules pushing and publishing of events Prerequisite you have uploaded and configured the mapping of events from your local system to HarmoSearch the two mappings for the query and you have configured a query service for your organization log in with your user go on Exchange Data gt Scheduler and select PUSH Data as Operation Test as recipient exhibition ancient world as category schedule operation within the next 10 minutes click Schedule task Comment and alternatives In a scheduled push the user does not upload a file but he schedules a query to his associated data provider through which the system automatically exports the actual data to be sent from his system Therefore the user needs to register a query service and to upload a query mapping to use this functionality the server s system clock is CET Central European Time Expected Output If you go back to the view Harmonise Participant Details back to list the new data provider is attached to the your organization In Operation Status the push operation is reported to be completed successfully After some minutes you receive also a notification email Semantic Registry 28 1 2013 JajOwold Semantic Registry holds information about data providers what data they h
44. EVALUATION SESSIONS 3 1 THE FIVE RELEASE CANDIDATES This section gives a brief description of each release reporting the incremental development of the Semantic Registry Altogether 5 releases of the Semantic Registry have been provided Apart from the first release the evaluation of this component has always been done jointly with the evaluation of the HarmoSearch platform web portal release candidates The main reason for this is that the Semantic Registry is a backend even if stand alone component within the HarmoSearch system It addresses support functionalities that are aimed at improving the accuracy of the results and at reducing the response time of the system The functional tests which are based on concrete business scenarios i e realized as sequences of user operations on the portal must therefore be done in a broader context of a whole HarmoSearch workflow For the first releases when the component was not yet completely integrated into the overall HarmoSearch system a specific user interface i e a web portlet was provided which allowed to test the feedback of the registry directly by submitting some queries Later on some of the Semantic Registry test cases became transparent indirect tests within single steps of more complete scenarios which are reported in their completeness in D7 1 Compiled Collection of Acceptance Notes Here only excerpts of the overall evaluation document are reported and commented
45. Exchange P Set up guery service ublish Event Publish events on social networks Login with your user go in Configurations gt Ouery Service in panel Registry Data Management click on the name of your organization Participant Name Go on panel Create and attach a new Data Provider and insert an id e g lt Your organization name dataprovider no whitespaces click on Create and insert the following parameters any name for your provider the name of the collectionld that you used when uploading the mapping for instance events http www euromuse net harmonise guery guery php as service access endpoint no whitespaces karin as username and password no whitespaces HTTPAdapter as Connector class no whitespaces select METASEARCH and IMPORT as supported Query types Event as Subdomain click on Save Changes click Edit Data Description and select Events with location and category from the drop down list on the top click on Save Changes User publishes selected events on Facebook and on Twitter If you go back to the view Harmonise Participant Details back to list click on your organization s name the new data provider is attached to the your organization The information related to a data provider is registered within the Semantic Registry 42 0W0Jd udIpawsunasnu this does not seem to work click Edit Data Description and select Events with l
46. Language Search All events Alternative 1 Retun all possible events Alternative 1 Output should be Detailed EN contain Name City Date range summary detailed description url precise address and vignette price range All text should be English Comment from CP so far the metasearch engine does handle context information optional result fields language preferences etc so even if they are present in the query language then they are ignored Registry O returns Euromuse and euromuse crawler Query Processor selecting both data providers O 1 XML file each Metasearch W 269 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen Metasearch 269 Results Missing summary precise address price range according to the information given in the comment Registry returns Euromuse and euromuse crawler Query Processor OK Metasearch W 269 results missing city location and event domain due to incomplete mapping But Language Preference has some influence What is the subdomain testComplianceEvent Search Query Language Search All events within time frame Retun all possible events within Damm 31 12 2011 Output should be result list Same output as SQ1 Comment from CP if you specify both start and end date you will get events whose time interval overlaps with the specified dat
47. OR RELEASE CANDIDATE 1l 17 APPENDIX B 2 TEST CASES FOR RELEASE CANDIDATE Z A 17 APPENDIX B 3 TEST CASES FOR RELEASE CANDIDATE 3 17 APPENDIX BA TEST CASES FOR RELEASE CANDIDATE A 17 APPENDIX B 5 TEST CASES FOR RELEASE CANDIDATE BR 17 APPENDIX B 6 EXTERNAL EVALUATION OF THE SEMANTIC REGISTRY RC5 17 APPENDIX C ACCEPTANCE NOTES ee ees See Eege 18 APPENDIX C 1 ACCEPTANCE NOTES FOR RC1 OF THE REGISTRY 18 APPENDIX C 2 ACCEPTANCE NOTES FOR RC2 OF THE REGISTRY 19 APPENDIX C 3 ACCEPTANCE NOTES FOR RC3 OF THE REGISTRY 19 APPENDIX C 4 ACCEPTANCE NOTES FOR RC4 OF THE REGISTRY 20 APPENDIX C 5 ACCEPTANCE NOTES FOR RC5 OF THE REGISTRY 21 File D5 3 Registry Evaluation Report Page 15 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 E the future of information services APPENDIX A LIST OF REQUIREMENTS This section contains the final list of requirements that was incrementally built and updated It was used to validate the actual features of the Semantic Registry against the requirements per release File D5 3_Registry_Evaluation_Report Page 16 of 22 User Registration by Account management HS user Service Management Register service Service Management Configure service Data provision Harmonise Registration
48. Registry the chosen base technology and framework and gives an architectural overview of the Semantic Registry D3 2 Ontology for the registry model documents the ontology developed to model the information managed by the Semantic Registry knowledge about data and services provided by HarmoSearch participants D5 2 Registry Component reports on the implementation and deployment of the registry component within the HarmoSearch system D7 1 Compiled Collection of Acceptance Notes addresses the evaluation of the HarmoSearch platform web portal The Semantic Registry is a stand alone component which is however involved in all main user operations on the portal For that reason parts of the evaluation outcomes of the Semantic Registry may occur also in D7 1 This document instead focuses on the specific incremental development and evaluation iterations of the Registry 1 4 STRUCTURE OF THE DOCUMENT The document is structured as follows Section 2 describes the context first an introduction to the Semantic Registry is given then the evaluation process is summarized the complete description is provided in D7 1 Compiled Collection of Acceptance Notes and finally the specific definition and interpretation of the test cases for the Semantic Registry are explained with some examples Section 3 summarizes the content of each release candidate Appendix A provides the list of reguirements for each release candidate Appendix B contains the
49. WS HARMOSEARCH the future of information services FP7 SME 1 Project no 262289 HARMOSEARCH Harmonised Semantic Meta Search in Ween SEVENTH FRAMEWORK Distributed Heterogeneous Databases PROGRAMME D5 3 V1 0 Registry Evaluation Report Due date of deliverable 2013 02 28 Actual submission date 2013 03 08 Start date of project 2010 12 01 Duration 27 month Project funded by the European Commission within the Seventh Framework Programme Dissemination Level eu Jewe ye pa Restricted to other participants including the Commission Services ma Confidential only for members of the Consortium including the Commission Services File D5 3 Registry Evaluation Report Page 1 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services PROJECT ACRONYM HARMOSEARCH Project Title Harmonised Semantic Meta Search in Distributed Heterogeneous Databases Grant Agreement 262289 Starting date December 2010 Ending date February 2013 Deliverable Number D5 3 Version 1 0 Title of the Deliverable Registry Evaluation Report Lead Beneficiary Promoter Task WP related to the Deliverable WP 5 Task 5 3 Type Internal or Restricted or Public Public Author s Claudio Prandoni Marlis Valentini Partner s Contributing Promoter TU Wien SPK Afidium Museumsmedien HarmoNET X O eCTRL EC3 Networks CPR Contractual Date of Delivery to the CEC Februa
50. Z Actual Result 22 2 2013 Browse Registry events in Biella go on Search Data gt Browse Data Providers select events in Biella 3 providers returned But Test is NOT a relevant data provider listed by the semantic registry events in Berlin excludes events in Biella thus Test NOT is considered relevant for the guery Finally worked but the featur is buggy when performing several searches reload the page before validation clean the selected option keep the previous results USING CHROME o oueqly y elata AV NAS Uapawsunasnu portal slow SNW93 uswnasnu MAJ ualpawsuinasnu portal very slow o d pa o z gt E Metasearch events in Biella go on Search Data gt Metasearch select Italy and Biella click on Search Message says Contacted providers 3 biella euromuse and euromusemf Total results 10 total all from Biella euromuse and euromusemf are involved because in the registry s data description see below they have events in Italy thus in Biella This does not mean that they actually have instances of events in Biella Browse Registry modern art exhibitions go on Search Data gt Browse Data Providers select modern art exhibitions 3 providers returned Test is listed as relevant data provider by the semantic registry together with euromuse a
51. also provides the access information for the provider s query service o Jajowold Jajowold JajOWold o ualpawswnasnw ualpawswnasni ualpawswnasniN other results but also 10 and same format as my user is from eurmouse perform the test in euromusemf the file retrieved is empty see xml my user is euromuse user so i can only import from euromusemf but at no point am offered the possibility to set sender and receiver the only thing can choose in simple search is a data provider the first returned message is Operation COMPLETED www euro o muse net t horsten2 h armonise s chedule_e uromusem f 3101 xml Pa re Segue nt nce Action Import Web Services Import Accommodation s through Web Services Description Prerequistite you have configured the mapping for receiving accommodations perform an import with simpleSearch method using your organization s name as sender biella as receiver Accommodation as subdomain guesthouse as type and restaurant as facility Appendix B 5 Test cases RCS Semantic Registry Import role Comment and alternatives import Events Same documentation as Expected Output Two strings are returned The first says Operation completed successfully on biella and the second is a link to the imported file available on the Data Repository Operation Status also reports about the succe
52. as sudomain include Test Filter as external service click on Add button click on Send Operation Status reports that the operation is suspended awaiting confirmation Only one of the two events from the source file are listed in the page Exchange Data gt Confirm publishing the external service filtered out only the one that is a permanent exhibition The Semantic Registry is involved to get the information to access the external service 49 10W0Jd u p awswn snw Exchange Ex ternal Servic es Delete external service Logged in as testuser go on External Services gt Manage Services click Delete on the Test Filter service The service is no more listed in the workflow services panel External service is unregistered from the Semantic Registry 42 0W0Jd uUdIpawsunasnu Appendix B 4 Test cases RC4 Semantic Registry 6 8 o o Output iz Z Actual Result Actual Result XML Screen 19 11 2012 Firefox 16 17 11 2012 2 Actual Result Actual Result Actual Result bo 13 11 2012 Firefox 16 O 19 11 2012 Google Chrome a 16 11 2012 oueupe Wii only modified the url the name remains test filter so from now on i will assume test service is test filter _mail received number was decreased same as row 40 successfully https 46 37 22 116 repos harmo search 07 Demo _Failed on test Error
53. ataprovider no whitesapces click on Create and insert the following parameters any name for your provider default as Mapping Collection Identifier http www euromuse net harmonise guery guery php as service access endpoint no whitesapces karin as username and password no whitesapces org harmonise services connector service adapter HTTPAdapter as Connector class no whitesapces select METASEARCH and IMPORT as supported Query types Event as Subdomain click on Save Changes go in Data Description and select Events with location and category from the drop down menu on the top click on Save Changes Data provider configuration saved A data providered is registered in the Semantic Registry Configurati ons Query Service Delete a data provider from the semantic registry login with your user go in Configurations gt Query Service and select your organization in Registry Data Management select the Data Provider attached to your organisation if it exists click on Delete provider Data provider removed A data providered is unregistered from the Semantic Registry Configurati ons Query Service Modify euromuse configuration in the semantic registry change the Service Access Endpoint login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data pro
54. ave subdomain categories locations and how they can be accessed Ja 0WO0Jd 29 1 2013 o S Actual Result think the password shouldn t be in clear Edit Data Description is before save changes Yet if we click it before saving we loose any modification when going back think the button should be before the edit link or that we should keep fields up to date or a popup asking if we want to save link or discard before accessing the edit data screen the edit data description page isn t clear i don t know if i did something or if my selection had any impact or is validated 30 1 2013 1 2 o Actual Result The data provider profile is not clear to me assume as a publisher am a data provider for in order to publish all the events from the past rows theoretically provided the events The steps work if the order of things is followed but to fill in a form should require a user s manual Schedule publish with manual filter Prerequisite you have uploaded and configured the mapping of events from your local system to HarmoSearch the two mappings for the query and you have configured a query service for your organization go on Exchange Data gt Scheduler select Publish on social network as operation your social network s target one or more as recipient keep Filter manually selected subdomain Event country France city Paris category ex
55. ch All events within locations Retun all possible events in Biella or Berlin Output should be result list see SQ1 Alternative 4 in Biella or Berlin Same as SO1 Registry filters the data provider s to be involved in the search process Search Query Language Search All events within locations Retun all possible events in Biella or Berlin within 1 4 2012 30 04 2012 Output should be result list see SO1 Alternative 5 in Biella or Berlin within a certain period Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events within locations Retun all possible events in Biella within 1 4 2012 30 04 2012 or Berlin within 1 5 2012 31 05 2012 Output should be result list see SQ1 Alternative 6 in Biella within a certain period or Wien within another period Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events for certain categories Retun all possible events in Biella corresponding to cultural Output should be result list see SQ1 Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events for certain categories Retun all possible events in Berlin corresponding to modern art exhibitions or sculpture exhibitions Output should be result list see SQ1 Alternative 1 in Berlin corresp
56. ctual Result 13 11 2012 Firefox 16 O 19 11 2012 Google Chrome f 19 11 2012 Firefox 16 KA 16 11 2012 oueupy DA mail with failur message https 46 37 22 116 repos harmo search 07 Demo nstration Activiti es test 20data message that no query Tests 20outputs mapping has been uploaded BLOCKING pending confirmation did it properly 20121113_GK_R Ok probably forgot _uploaded the missing 1 received the notification mail with failure message Failed on 1 2_social to upload the 2nd mapping file now it works fine Afidium Missing mapping for the query structure from Harmonise publish file in 0 6 for _great feature also like the Ontology to Afidium failure pdf GREAT previous tests way the data is collected _first received an error pending NOT BLOCKING It would be nice to be able to edit amp duplicate scheduled operation instead of having to delete 8 start from scratch missing in test grid this was reguired worked fine _on the right yes for 2 10 11 12 13 _typo in the result left right _my account is euromuse so i chose cpr _error message was displayed and it send it ok _received notification mail Pa re Segu nt ence Action Exchange Ex ternal Servic es Modify service Appendix B 4 Test cases RC4 Semantic Registry Description Log in as testuser username is the emai you set with password testuser go on External Services gt Manag
57. cultural in that period and in Vienna corresponding to modern art exhibition or sculpture exhibition in the same period Registry O returns biella euromuse and euromuse crawler Query Processor selecting all three data providers O 2 XML file each Metasearch X 5 result not all the results of an OR query are displayed this bug has already been fixed for the third release Registry screen Query Processor XML file s Metasearch screen Metasearch 0 Results Comment CP the server was down can you please retry Search Query Language Search All events for certain categories Retun all possible events in Biella corresponding to cultural in that period and the events in Vienna corresponding to modern art exhibition in the same period Output should be result list Same output as SO1 Alternative 5 in Biella corresponding to cultural in that period and in Vienna corresponding to modern art exhibition in the same period Registry O returns biella euromuse and euromuse crawler Query Processor selecting all three data providers O 2 XML file each Metasearch X 10 result not all the results of an OR query are displayed this bug has already been fixed for the third Registry screen Query Processor XML file s Metasearch screen Metasearch 0 Results Comment CP the server was down can you please retry
58. e Crawler Consumers Euromuse Adriamuse Content Integration of the mapping tool into the system download install from portal Assisted mapping upload and mapping validation Enhance mapping tool to map the queries as well integration of user interface for registry have complete functional metasearch interface and API web service on one domain events Implement scheduling capacity including user interface to parameter the scheduler have reference list mapping methodology with one base reference list for mapping Define how to manage parameters on mapping language currency Integration of Crawler Setup of semi automatic procedure to periodically update indexes according to the providers configured in the semantic registry Register a new provider from the portal crawler and API Scenario and prototype to register and setup a new organisation providers and consumers Scenario and prototype to Improve usability of portal Biella XSD provided by Adriano Museollitto XSD provided by Claudio already svn Code_Repository server data mapping SML Museollitto gt No because not ready Facebook gt No because no answer feedback from Laptrip until you get us an easier way to get location data we will not use Teleatlas not interested in event information Euromuse no answer yet Feb 2012 im 2 3 lemented pe Authc Group RLA RL HS RELEASE RELEASE Semantic Registry Seman
59. e 31 12 2011 Searching startDate to 2008 12 31 i got the event Aboa Vetus permanent exhibition starting at 01 01 2011 Search All events within locations Retun all possible events in Vienna Austria Output should be result list Same output as SQ1 Registry O returns Euromuse and euromuse crawler Query Processor selecting both data providers O 1 XML file each Metasearch W 14 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen same as SO3 Metasearch 14 Results Field location empty gt validation difficult Exhibitions are in german so probably fine Semantic Registry OK changed to IT and to Biella worked as well returning biella But how is configured Querying for AT and Innsbruck got 10 results not in Innsbruck but for vienna i got correctly 14 results Parent Action Search Query Language Search All events within locations Description Retun all possible events in Austria Comment and alternatives Output should be result list Same output as SO1 Alternative 1 In Austria Country instead of given city Actual Result Registry O returns Euromuse and euromuse crawler Query Processor selecting both data providers O 1 XML file each Metasearch W 14 results missing city location and event domain due to incomplete mapping same nu
60. e Release 5 Portal xsl available in 07 Demonstration ActivitiesVRelease 5 on SVN repository Appendix B 6 External evaluation of the Semantic Registry RC5 Note The table External evaluation of Semantic Registry corresponds to a merge of the file External Evaluation Registry Release 5 xsl available in 07 Demonstration ActivitiesVRelease 5 on SVN repository File D5 3 Registry Evaluation Report Page 17 of 22 Action Search Ouery Language Search all Appendix B 1 Test Cases RC1 Semantic Registry Description Return all possible information for all domains Comment and alternatives Output should contain Name City event location event category domain and date range Optional content would be url telephone vignette user rating Expected outcome from Semantic Registry Registry returns Euromuse 23 08 2011 un piy Di 1 2 Actual Result We could have a test with all data o from one domain as suggested and as well all data for 2 domains with differnt output list am not sure it is very usefull though since we already mix subdomains in other tests Search Ouery Language Search All events Retun all possible events restriction on domain Output should be result list Same output as SO1 Alternative 1 Output should be Detailed EN contain Name City Date range summary detailed description url precise address and vignette price range All text should be English Registry returns
61. e Services clik Modify on Test Filter update the access URL with http harmosearchdev harmonet org ExternalService portlet permEvents check Authorization reguested checkbox click on Save Comment and alternatives Expected Output The service is now updated in the workflow services list There are no more authorized users Semantic Registry External service is updated within the Semantic Regsitry BER es VT gt 12 11 201 o uUdIpowswnasnu Actual Result 5 8 Exchange Ex ternal Servic es Use external service in import Prereguisite You have uploaded the mappings from Harmonise ontology to your system log in with your account go on Exchange Data gt Import Data select euromuse as data provider exhibition ancient world as category include Test Filter as external service click on Add button click on Search At the end of this test wait until the scheduled task of R2 10 is executed and check the outcome Screen message and Operation Status report success of the import In Subscribe to Service the max number of times is updated to 0 In the Scheduler page the Test Service is no more available among the External Services The Semantic Registry is involved to get the information to access the external service 1210U0Jd uaIpatuswnasnw Exchange Ex ternal Servic es Use external service in push Prereguisite Yo
62. e allows Harmonise participants to look up subscribe and use these services within specific workflows The Service Registry cooperates with the HarmoSearch Access Control component to handle the permissions to use such services To summarise the Semantic Registry has two primary functions e To facilitate searches by storing information about HarmoSearch data providers once a search query is issued to the HarmoSearch system the semantic registry matches the data provider descriptions against the search criteria specified in the query and returns all candidate data providers which may have relevant data with respect to this query e To allow to include external services at run time into the process workflow to refine the results of HarmoSearch queries metasearch scenario or to post process the data before being published publishing scenario 2 2 OVERVIEW OF THE EVALUATION METHODOLOGY The purpose of this evaluation report is to define the evaluation procedure for the Semantic Registry component Since HarmoSearch is an information and communication technology ICT research project the main deliverables are software artifacts Specific evaluation activities were used to determine if the HarmoSearch Semantic Registry met the expectations in regard of project execution usability and user satisfaction The activities that were performed during the entire project had been used to determine if the evaluation was effective and how the ac
63. e providers e Integrated workflow tests they correspond to the workflow operations on the portal namely metasearch import push and publishing which involve the Semantic Registry in a transparent way e Stand alone reaction tests they are realized through an ad hoc user interface that allows the user to query directly the Registry simulating an invocation to the component within a HarmoSearch workflow metasearch etc in order to check how it reacts to a given input Some examples may be e Data management tests o Registration of a new external service o Update of a data provider s access parameters e Integrated workflow tests o Launch an import on all providers restricted to a given category of events and to a particular location and the actual workflow only involves a selection of providers o Execute a metasearch without restrictions the Data Registry does not exclude any provider in that case and the system is able to connect to all providers query services having the Data Registry the access information stored in it o Execute a push including an external service into the workflow process e Stand alone reaction tests o Insert a query in the Browse Data Providers user interface and get the providers that the Data Registry has selected to be relevant for the given query For each step the participant had to compare his outcome with the expected outcome that was provided in the document reporting if these did
64. e success of the scheduled operation One event should be published on your social network the same that is returned with a metasearch using the same search parameters The new service is in the workflow services list on the left like above External service is registered within the Semantic Regsitry JBJOWOId 49 0W0Jd uUdIpawsuwnasnu uUaIpowuswnasnw Exchange Ex ternal Servic es Use external service that is unavailable Prereguisite You have uploaded the mapping from your system to Harmonise ontology logged in with your account go on Exchange Data gt Share Data select Push as operation choose euromuse 2 events vml as data file available from test folder euromuse as recipient Event as domain Include Test Service click on Add button click on Send Error message is shown on the screen Test Service is unavailable The error message is also reported in Operation Status and in a mail notification The Semantic Registry is involved to get the information to access the external service 42 0W0Jd uUdIpawsunasnu Error in external service Service is not available http harmosearchdev harmonet org ExternalService portlet testService Appendix B 4 Test cases RC4 Semantic Registry 4 8 o o Output iz Z Actual Result Actual Result XML Screen 17 11 2012 2 Actual Result Actual Result A
65. earch Query Lan Search All events within locations Retun all possible events in Germany Output should be result list see SO1 Alternative 1 In Germany Country instead of given city Comment note that the results are not the same as if you insert the same parameters in Simple Search because in that case a further default search criteria is added namely from today on Same as SO1 Like SO1 J810WOJd wswnasn sq4 alt 1 Search Query Lan Search All events within locations Retun all possible events in Italy Output should be result list see SO1 Alternative 3 in IT ISO code for Italy Comment note that the results are not the same as if you insert the same parameters in Simple Search because in that case a further default search criteria is added namely from today on Same as SO1 Like SO1 JBJOWOJd wsWnasn Search Query Lan Search All events within locations Retun all possible events in Biella or Berlin Output should be result list see SO1 Alternative 4 in Biella or Berlin Same as SO1 Like SO1 JBJOWOJd Search Query Lan Search Al events within locations Retun all possible events in Biella or Berlin within 1 4 2013 30 04 2013 Output should be result list see SO1 Alternative 5 in Biella or Berlin within a certain period Same as SO1 Like SO1 1810WOJd Search Query Lan Search All events within locations Retun all possible events in
66. earch process Search Query Language Exchange l mport Data Search Al events for certain categories Import Data Retun all possible events in Biella corresponding to cultural in that period and the events in Berlin corresponding to modern art exhibition in the same period A user imports data from some data providers by using the search fields of the user interface or by posting directly HarmoSearch gueries in the Advanced Search text area Output should be result list see SO1 Alternative 5 in Biella corresponding to cultural in that period and in Berlin corresponding to modern art exhibition in the same period Same as SO1 Registry filters the data provider s be involved in the search process Appendix B 3 Test cases RC3 Semantic Registry 6 14 o o o Actual Result xs E Actual Result Actual Result Actual Result Actual Result Actual Result Not available in this release Not available in this release changed SQL4 xml using Frankfurt and got wrong results 3 data providers contacted euromuse euromusemf biella 118 results 3 data providers contacted 117 results ok 117 contacted providers 3 received results Used SO4 alternative 3 117 results contacting 3 data providers 3 data providers contacted euromuse euromusemf biella 197 results 3 data providers contacted 194 results 1 Error Failed on biella Error in translating the que
67. een message and Operation Status report success of the import You also receive an email notification Semantic Registry Semantic Registry is involved to filter out the target data providers If euromuse had not exhibition ancient world events no guery would have been submitted A message would report that euromuse does not match with the given search criteria HEHE o J9 0WOJd HEHE Z Actual Result HHHHHHHH ualpawswnasni Actual Result XML Result Files should open in own window if you download them with left click o 2 Z Actual Result Output XML Screen HHHHHHHE 1 2 Import Events with Advanced Search perform an import through Advanced Search using SQ1_for_import xml Import all from Euromuse Operation Status and email confirm that the operation was successful In Data Repository gt Querybox the result file is available check with the example file import results Advanced Search xml in the test folder The Semantic Registry is involved to get the access parameters of euromuse s guery service J8 0W0Jd really think the XML file should open in another browser tab as browser read XML file clicking the download button just opens the XML in the same tab for now making user leave harmosearch for a page of code o Uaipauisuinasnin the exhibitions are not the same because the xml file in the repository is outdated the guery re
68. endix B 4 Test cases RC4 Semantic Registry Description Prereguisite you have uploaded and configured the mapping of events from your local system to HarmoSearch the two mappings for the guery and you have configured a guery service for your organization see the Seguence column C18 for the details go on Exchange Data gt Scheduler select Publish on social network as operation your social network s target one or more as recipient keep Filter manually selected subdomain Event country France city Paris category exhibition painting schedule the operation within the next 10 minutes wait until the operation is done Comment and alternatives don t select HarmoSearch event or HarmoSearch status but only Facebook my event Facebook my status Twitter my status you can refer to http www timeanddate com worldclock city html n 195 in order to know the server s system clock Expected Output In Operation Status the publish operation is reported as suspended and awaiting confirmation An email is sent that invites the user to log in and confirm the publishing of the selected events Some events should be available for publishing on your social network the same that are returned with a metasearch using the same search parameters Semantic Registry The Semantic Registry is involved to exclude the remote execution of the query if the selected l
69. eport Page 3 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 O the future of information services 1 INTRODUCTION 1 1 PURPOSE OF THE DOCUMENT The document is the final report on the evaluation process performed during the development of the Semantic Registry component The overall goal of the evaluation process is to incrementally improve the quality of the component At the beginning of the project a basic evaluation procedure was defined with a set of dedicated activities that have been performed every time a new prototypical release candidate has been released Overall 5 release candidates have been developed The evaluation procedure covered internal and external evaluations The internal evaluation was done by the developers and was focused on testing the developed software artifacts technical tests whereas the external evaluation addressed the functional quality of this component functional tests It is important to keep in mind that the Semantic Registry is a backend even if stand alone component of the HarmoSearch system and therefore its functions are mostly transparent to the final and non expert user of the portal 1 2 DEFINITION OF TERMS AND ABBREVIATIONS The following terms and definitions are used throughout this document e HarmoSearch system The system gathers all the components tools and features developed during the project It includes the HarmoSearch platform a web portal the s
70. er Scheduler Configurati ons Query Service Schedule a push correctly log in with your user go on Exchange Data gt Scheduler and select PUSH Data as Operation CPR as recipient exhibition ancient world as category each day at hh mm in scheduled options see comment click Schedule task The HarmoSearch portal server has GMT time You must therefore subtract 1 hour to the time you want the operation to be scheduled that is true if your time is GMT 1 In a scheduled push the user does not upload a file but he submits a query that allows the system to automatically export the data to be sent from his system therefore the user needs to register a query service and to upload a query mapping to use this functionality In Operation Status the push operation is reported to be completed successfully on CPR After some minutes you receive also a notification email Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the provider 2 Z Actual Result Screen message as expected Operation status page has content as expected Result files are correct Operation status page has content as expected Result file is present in Ouerybox and contains results Email has arrived 2 Z Actual Result Screen message as expected expected Res
71. es Registry O returns Euromuse Biella and euromuse crawler Query Processor selecting all three data providers O 1 XML file each Metasearch W 274 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen it returned 274 euromuse exhibitions Also dating in a range outside the query w Metasearch 274 Results Unclear from the description if the result should show exhibitions which are also only partly in the time frame of the search as it is the case or if only those should be shown which are open during the whole time of the search Does not look the time criteria are working searching to 2011 09 28 and from 2011 09 28 get Pergamon Panorama of the Ancient City Pergamon Which happens in the 30 09 2011 out of the period The semantics of the date search should be events which are available in the given timeframe Comment CP Pergamon Panorama of Search Query Language Search All events within time frame alternative 1 Retun all possible events starting from 1 9 2011 Output should be result list Same output as SQ1 Alternative 1 give only Date 1 Comment from CP if you specify only the start date you will get all events which ends after the specified date independently from when they start Registry O returns Euromuse Biella and euromuse crawler Query Processor selecting all t
72. heduled import and in the scheduled push and publishing e addition of plugging capacity for external services and integration of the related features in the graphic interface The results of the evaluation are attached in Appendix B 4 Test cases for release candidate 4 Release provider was Promoter The Acceptance notes for RC4 are attached in Appendix CA 3 6 EVALUATION OF RC5 In the last release of the overall system the Semantic Registry was not modified Only related usability and outlook were improved e improvement of the usability of user interfaces related to the registry Browse Data Registry and Query Service pages File D5 3 Registry Evaluation Report Page 13 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 E the future of information services e improvement of graphical layout Also external domain experts were involved in the evaluation of the last release The results of the evaluation are attached in Appendix B 5 Test cases for release candidate 5 and in Appendix B 6 External evaluation of the Semantic Registry RC5 Release provider was Promoter The Acceptance notes for RC5 are attached in Appendix C 5 3 7 EVALUATION WITH EXTERNAL DOMAIN EXPERTS The following domain experts have been involved in providing an external feedback on the final release of the Semantic Registry e Saarl ndischer Museumsverband e V SMV Museums Association of Federal State Saarland
73. her new reguirements and have been entered in the list of reguirements or to configuration issues that will be solved and tested in the next release Appendix Test Summary Attached to this document are the Excel files detailing the tests that were performed and justifying the level of acceptance for the delivery Test Case Release 1 Crawler xslx Test Case Release 1 Portal xslx Test Case Release 1 Ouery xslx reported in Appendix B 1 Test Case Release 1 Semantic Registry xslx reported in Appendix B 1 File D5 3 Registry Evaluation Report Page 18 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services Appendix C 2 Acceptance notes for RC2 of the Registry The following section is an excerpt addressing only the Semantic Registry of the document Acceptance Notes for Release 2 which is available in its complete version in D7 1 Compiled collection of acceptance notes SME Acceptance This section contains the list and status for each partner 1 X O BUSINESS SOLUTIONS GMBH Conditional m ci Other partner comments NO COMMENT Consortium acceptance The consortium thereby accepts the Metasearch Core Engine part of the release and considers that it covers reguirements However the mapping tool has been accepted with conditions Tests that did not pass corresponded to either new reguirements and have been entered in the list of
74. hibition painting schedule the operation within the next 10 minutes wait until the operation is done the server s system Clock is CET Central European Time In Operation Status the publish operation is reported as suspended and awaiting confirmation An email is sent that invites the user to log in and confirm the publishing of the selected events Some events should be available for publishing on your social network the same that are returned with a metasearch using the same search parameters J210Ul0Jd The Semantic Registry is involved to get access information of the guery service o double results again same as R4 Remove your data provider login with your user go in Configurations gt Query Service click on the Data Provider attached to your organisation if it exists click on Delete Provider DO NOT DELETE THE PARTICIPANT Data provider removed The data o provider is unregistered from the Semantic JajOWOld Registry o Appendix B 5 Test cases RC5 Semantic Registry Publisher role 2 2 Seguenc Comment Semantic o NEG Description and alternatives Expected Output Registry Z Actual Result 30 1 2013 o z Actual Result User takes overview of services Semantic o Registry is The status of the available involved to services should be shown check the active or not missing data configurations and links to provider s
75. hree data providers O 1 XML file each Metasearch W 274 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen selected 1 9 2011 results 0 selected from 1 9 2011 to 1 9 2011 the only way results 11 Dates are not in the search range i e exh in the range 19 11 2011 23 06 2013 in the output selected today 12 12 2011 results 77 also bugs in the output i e exh from 01 12 2012 to 24 02 2013 Metasearch 274 Results Showing results which have Opening not at the 1 9 2011 Searching endDate from 2013 12 01 got the event Aboa Vetus permanent exhibition closing at 31 12 2012 Search Query Language Search All events within time frame alternative 2 Retun all possible events until 31 12 2011 Output should be result list Same output as SQ1 Alternative 2 give only date 2 Comment from CP if you specify only the end date you will get all events which starts before the specified date independently from when they end Registry O returns Euromuse Biella and euromuse crawler Query Processor selecting all three data providers O 1 XML file each Metasearch W 274 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen results 0 Metasearch 274 Results Showing results which have Opening not at th
76. ice Web Servic es Modify euromuse configuration in the semantic registry restore the category Web Services login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition pop music with exhibition music Auser of an external system or the system itself invokes a push or an import operation on the HarmoSearch platform through a Web Service instead of through the GUI Data provider configuration saved A data provider s configuration is modified in the semantic registry Appendix B 3 Test cases RC3 Semantic Registry o o o Actual Result Actual Result Actual Result Actual Result Actual Result Actual Result 12 14 Par Seguen ent ce Action Web Servic es SimpleSearch import correctly through Web Service Appendix B 3 Test Description perform an import with simpleSearch method using your organization s name as sender euromuse as receiver and void not null search criteria cases RC3 Semantic Registry Comment and alternatives Same as P18 1 Expected Output The method returns a successful completion message Operation completed successfully on euro
77. ition in the same period Same as SO1 Like SO1 J810WOJd wswnasni Failed on euromuse Impossible to connect to provider 3 results loaded from euromuse none from biella provider might be down for now Appendix B 5 Test cases RC5 Semantic Registry Metasearch role 3 3 Output Par Comment Actual Actual XML Screen Expected Output Semantic Registry ent Action Description and alternatives Browse Data Providers Auser queries directly the semantic registry 29 1 2013 11 2 2013 2 Actual Result sl o z Result Z Result ok this confirms the warnings and bugs in rows 30 to 33 biella is not shown as provider of events in biella logged in with your account go on Search Data gt Browse Data Providers The Registry is directly Browse Data Find matching data select events in biella Alternative select any of the proposed gueries to the gueried through the ad hoc user interface M2 Providers providers click Check Provider registry JBJOWOJd wswnasn IVNOILdO This show case and functional test as reguired can be Description Expected Output Appendix B 6 External evaluation of Semantic Registry Notes Explanation 18 2 2013 3 o Actual Result Data Provider registers a new guery service browses the semantic registry and verifies its behaviour within the metasearch process Comment the number of results described in shortened by
78. le each Metasearch X 11 result not all the results of an OR query are displayed this bug has already been fixed for the third release Registry screen Query Processor XML file s Metasearch screen Metasearch 0 Results Comment CP the server was down can you please retry Search Query Language Search All events for certain categories Retun all possible events in Wien or Biella corresponding to modern art exhibitions or cultural during that period Output should be result list Same output as SO1 Alternative 3 in Wien or Biella corresponding to modern art exhibitions or cultural during that period Registry O returns biella euromuse and euromuse crawler Query Processor selecting all three data providers O 2 XML file each Metasearch X 11 result not all the results of an OR query are displayed this bug has already been fixed for the third release Registry screen Query Processor XML file s Metasearch screen Metasearch 0 Results Comment CP the server was down can you please retry Search Query Language Search All events for certain categories Retun all possible events in Biella corresponding to sport or cultural in that period and the events in Vienna corresponding to modern art exhibition or sculpture exhibition in the same period Output should be result list Same output as SO1 Alternative 4 in Biella corresponding to sport or
79. ltural history exhibi i exhibition ancient world trade fair jon european art before 1800 exhibition graphic art n prehistory exhibiti ion european art after 1800 exhi on literature exhibition arts and crafts film ion european cultural history exhibition modern art exhibition photograph cultural on arts and popular traditions exhi ion archeology exhibition natural science sport public spectacle 4 4 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 O the future of information services APPENDIX C ACCEPTANCE NOTES This section gathers all acceptance notes validated by the partners for each release Appendix C 1 Acceptance notes for RC1 of the Registry The following section is an excerpt addressing only the Semantic Registry of the document Acceptance Notes for Release 1 which is available in its complete version in D7 1 Compiled collection of acceptance notes SME Acceptance This section contains the list and status for each partner NR CHECK YES NO Conditional X O BUSINESS SOLUTIONS GMBH YES ECTRL SOLUTIONS SRL YES EC3 Networks GmbH YES Lehmann amp Werder Museumsmedien YES AFIDIUM YES Other partner comments NO COMMENT Consortium acceptance The consortium thereby accepts this release and considers that it covers requirements Tests that did not pass corresponded to eit
80. mapping Output XML Screen sa egistry screen Query Processor XML file s Metasearch screen Actual Result no output when ask for Biella Actual Result Metasearch 0 Results Comment CP the server was down can you please retry 3 12 2011 18 O results Comment CP the server was down can you please retry Search Query Language Search All events for certain categories Retun all possible events in Wien corresponding to modern art exhibitions or sculpture exhibitions Output should be result list Same output as SO1 Alternative 1 in Wien corresponding to modern art exhibitions or sculpture exhibitions Registry O returns euromuse and euromuse crawler Query Processor selecting both data providers O 1 XML file each Metasearch W 5 results missing city location and domain Registry screen Query Processor XML file s Metasearch screen Metasearch 0 Results Comment CP the server was down can you please retry Search Query Language Search All events for certain categories Retun all possible events in Wien or Biella or corresponding to modern art exhibitions or culture Output should be result list Same output as SO1 Alternative 2 in Wien or Biella or corresponding to modern art exhibitions or culture Registry O returns biella euromuse and euromuse crawler Query Processor selecting all three data providers O 2 XML fi
81. mation Registers the different types of data that will be made available and the corresponding services Microtormat HTML wrapper Semantic Cluster Names RSS import amp export and mapping THe Uata PrUVIUCI 21 EBIJLCI UN UIE re DIEU Dr E LIESE ALI ALCUUHIL cau aiiu DEL it up i e uploading the mappings for data translation and guery translation Furthermore the data providers also specify what kind of data they can supply i e what kind of search gueries they can answer After setting up the account all partners with whom a data flow can be established are configured on the Harmonise platform This means that for the portal the partners to whom a query is sent are specified and for the data providers those partners which are allowed to query are configured The data providers register on the Harmonise platform creating an account each and setting it up i e uploading the mappings for data translation and query translation Furthermore the data providers also specify what kind of data they can supply i e what kind of search queries they can answer After setting up the account all partners with whom a data flow can be established are configured on the Harmonise platform In this specific case the setup incorporates the information about what data is to be retrieved e g static accommodation data and what the requirements are for the transfer i e does not need to be delivered quickly The tourism portal sends a specific
82. mber of results as above because for testing purpose we limit to 10 the max number of results coming from Euromuse Output XML Screen Registry screen Query Processor XML file s Metasearch screen Annex B 2 Test cases RC2 Semantic Registry Actual Result Outputs info only if choosing category exhibition 10 events in Austria und Vienna from euromuse but 0 from euromuse mf Entries also outside the wished date range from 12 12 2011 on but past exhibitions in output Actual Result Metasearch 14 Results Field location empty gt validation difficult Exhibitions are in german so probably fine 2 3 but if searching for DE 0 results Search Query Language Search All events within locations Retun all possible events in Italy Output should be result list Same output as SO1 Alternative 3 in IT ISO code for Italy Registry O returns Biella Query Processor selecting Biella data provider O 1 XML file Metasearch W 5 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen From biella get no output selecting event all categories italy biella daterange today empty provider Biella Metasearch 5 Results Field location empty gt validation difficult Exhibitions are in italian so probably fine Semantic Registry OK query Processor ok But metasearch O results We a
83. ministrator lt support harmonet org gt organization TU Vienna Minor comment it would be nice to provide my own password 2 Z Actual Result as expected activation after notifying Claudio Two emails have arrived one asking to activate the user and another one asking to configure the new organization Content of services board as expected Error message as expected Error message as expected Two emails have arrived one asking to activate the user and another one asking to configure the new organization Content of services board as expected would have like the capacity to use a link to get more infomration on the different features porposed in the table like what is data mapping configuration because dscription provided minimal infomration on the row but nothing on the column It could just be text for instance Error message as expected definetly here explanation is needed ok but tried ona different provider euromuse was working Received only one email informing me that my account has been activated sender support harmonet org agree with David and Adriano Error message appeared tried it also with other providers euromuse biella all uploaded original file museoliitto2hto mapping xslt in the Mapping store Upload mapping for Museolitto Upload mapping from local system to Harmonise ontology for sending data success Mapping Files 16508 so xslt
84. mpiled collection of acceptance notes SME Acceptance This section contains the list and status for each partner DI CHECK YES NO Conditional ES X O BUSINESS SOLUTIONS GMBH ECTRL SOLUTIONS SRL EW EC3 Networks GmbH Lehmann amp Werder Museumsmedien AFIDIUM Other partner comments NO COMMENT Consortium acceptance The consortium thereby accepts this release and considers that it covers requirements except for the mapping tool that has only been accepted with conditions Appendix Test Summary File D5 3 Registry Evaluation Report Page 21 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services Attached to this document are the Excel files detailing the tests that were performed and justifying the level of acceptance for the delivery Tests passed well some minor suggestions for additional improvements were provided Those suggestions will be studied for potential improvements of the platform later on Test Case Release 5 Portal xsl an excerpt is in Appendix B 5 File D5 3 Registry Evaluation Report Page 22 of 22
85. muse In Operation Status tab the entry of the previous import reports also successful completion and links to the Querybox where the result file is available check the timestamp and it contains some results 13 14 Semantic Registry Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the provider Web Servic es AdvancedSearch import correctly through Web Service perform an import with advancedSearch method using your organization s name as sender and SQ1_for_import xml from test folder as xml guery Same as P18 1 The method returns a successful completion message Operation completed successfully on euromuse In Operation Status tab the entry of the previous import reports also successful completion and links to the Querybox where the result file is available check the timestamp and it contains some results check with the example file import_results_Advanced_Search xml in the test folder Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the provider 2 Z Actual Result Email received Operation logged and accessible through the Operation Status Panel Appendix
86. n is more generic than cultural events in Berlin thus Test is considered relevant for the query Finally worked but 7 the featur is buggy when performing several searches reload the page before validation clean the selected option keep the previous results USING CHROME o Ouegiy y ella g Dy NAS UBpawsunasnu ANS ualpawswnasnu SNW93 ualpawswnasnw MAJ ualpawsuinasnwi MA9 ualpawswnasnw portal very slow IVNOILdO events in Berlin Metasearch cultural Description go on Search Data gt Metasearch select Germany and Berlin select cultural as category click on Search Expected Output Message says Contacted providers 1 Total results 72 from Test Appendix B 6 External evaluation of Semantic Registry Notes Explanation Note that the search results are all n Berlin but the category seams not to match it means that the query of HarmoSeach looking for cultural events has been mapped for the Test data provider into a query that includes all categories either because cultural was mapped into all categories or because cultural was not mapped and the query service on Test which corresponds to euromuse did not consider that value category within its local search engine o 18 2 2013 winipyy EL Actual Result o EE 21 2 2013 Actual Result 19 2 2013 Actual Result 21 2 2013 e
87. n the Semantic Registry Biella event portal Euromuse portal and a particular webpage made available by Euromuse which contains events tagged via microformats and indexed by HarmoSearch crawler All partners participated to the evaluation The release provider was CPR With regards to the Semantic Registry the query language was tested again but from all partners This was also an integration test for this component The results of the evaluation are attached in Appendix B 2 Test cases for release candidate 2 The Acceptance notes for RC2 are attached in Appendix C 2 3 4 EVALUATION OF RC3 In RC3 the evolution of the Semantic Registry included e the development of a basic user interface for registering a data provider and updating its configuration description of provided data and parameters to access its guery service e the registration also within the Semantic Registry of a new organization when a new user account is created The results of the evaluation are attached in Appendix B 3 Test cases for release candidate 3 Release provider was CPR The Acceptance notes for RC3 are attached in Appendix C 3 3 5 EVALUATION OF RC4 The upgrades of the Semantic Registry in RC4 included e the registration of an accommodation data provider Biella accommodation portal and related graphical user interface e the filtering of accommodation data providers within a query process i e in the metasearch in the on demand and sc
88. nd euromusemf events in Berlin includes modern art exhibitions everywhere thus Test is considered relevant for the guery oueqly v NAS UdIpawswnasn SNW93 uswnasnu MAJ UdIpaustinasnu IVNOILdO art exhibitions Metasearch modern go on Search Data gt Metasearch select modern art exhibitions as category click on Search Message says Contacted providers 3 Test euromuse and euromusemf Total results 50 25 from Test and 25 from euromuse 0 from euromusemf euromuse and euromusemf are involved because in the registry s data description see below it states that they have modern art exhibitions This does not mean that they necessarily have instances of such events in fact euromusemf has not Browse Registry events in Italy go on Search Data gt Browse Data Providers select events in Italy 3 providers returned But Test is NOT a relevant data provider listed by the semantic registry events in Berlin excludes events in Italy thus Test NOT is considered relevant for the guery Ouegly y Elaig AV NAS uswnasnu SNW93 uswnasnu MAJ wswnasnw portal very slow Metasearch events in Italy go on Search Data gt Metasearch select italy click on Search Message says Contacted providers 3 biella euromuse and euromusemf Total results 32 total 4 from euromusemf 10 from
89. not possiblie to go to the next page the link was not active results load over 100 turn pages works this time around results do not contain all information expected two observations _exhibitions in UK no title available in the source intance uk exhibitions are filled only in the local language which is english anyway But the title are present _exhibitions in Finland missing Town and Country http www euromuse ne t thorsten2 harmosearch turn page p ng compare http www euromuse n et thorsten2 harmosearc h query_uk_ fin xml http www euromuse n et thorsten2 harmosearc h query_uk_ fin png o Search Query Lan Search All events Retun all possible events Output should be result list see SO1 Same as SO1 Like SO1 JAJOWOJd Vignette were not available Search Query Lan Search All events within time frame Retun all possible events within 1 4 2013 30 04 2013 Output should be result list see SO1 Comment from CP if you specify both start and end date you will get events whose time interval overlaps with the specified dates Same as SO1 Like SO1 J8 0UOJd WSWNASNIN UsWNaSNA the guery seems to be formulated wrong the startDate is related to the tag lt to gt the EndDate with the tag lt from gt Search Query Lan Search All events within time frame alternative 1 Retun all possible events starting from 1 4 2013 Output should be
90. ocation and category is not provided by your organization as well as to get the access parameters of the query service BER es VT 12 11 2012 udIpowswnasnu o Z 3 8 Actual Result Exchange Pu blish Events Exchange Ex ternal Servic es Exchange Ex ternal Servic es Schedule full automatic publish External Services User registers a new service that is open to all go on Exchange Data gt Scheduler select Publish on social network as operation your social network s target one or more as recipient unselect Filter manually checkbox subdomain Event country France city Paris category exhibition european cultural history Harmonise users provide online services that can be included in the HarmoSearch processes Log in as testuser username is the emai you set with password testuser go on External Services gt Manage Services register a new service on the Add Workflow Service panel with fields name Test Filter description Filters out some services keep Authorization reguired unchecked access URL http harmosearchdev harmonet org ExternalService portlet testService click on Set don t select HarmoSearch event or HarmoSearch status but only Facebook my event Facebook my status Twitter my status In Operation Status the publish operation is reported as completed An email is sent that informs on th
91. ocation and category from the drop down list on the top click on Save Changes always get some XML in the window but no success 13 11 2012 Firefox 16 2 wnipyy xD Actual Result CAN BE BLOCKING 1st connexion clicking the validate button doesn t work on Firefox 16 on the security question screen had to use enter key Output XML Screen Appendix B 4 Test cases RC4 Semantic Registry 2 dS seul Actual Result _euromuse screen name already taken _Activation requires email to claudio 17 11 2012 H oueupy Actual Result To be improved the menu bar on the top by removing private pages Go to menu item Add to portal ext properties the following layout user private layouts enabled fal se layout user public layouts enabled fals e breadcrumb show guest group false 19 11 2012 Firefox 16 2 wnipyy 19 Actual Result 19 11 2012 Google Chrome 2 8 Actual Result _registration worked as expected _registration mail received immediatelly after completing the registration _activation mail received after contacting Marlis _minor issue received a 404 Page not found error when clicking on my profile upper right corner Generally speaking this section looks quite unclear this needs user who really know what they re doing Help would be nice 1 No whitespaces gt this is not indicated on the page Is it blocking Plus it is possible
92. onding to modern art exhibitions or sculpture exhibitions Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events for certain categories Retun all possible events in Berlin or Biella corresponding to modern art exhibitions Output should be result list see SQ1 Alternative 2 in Berlin or Biella or corresponding to modern art exhibitions Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events for certain categories Retun all possible events in Berlin or Biella corresponding to modern art exhibitions during that period Output should be result list see SQ1 Alternative 3 in Berlin or Biella corresponding to modern art exhibitions during that period Same as SO1 Registry filters the data provider s be involved in the search process Search Query Language Search All events for certain categories Retun all possible events in Biella corresponding to sport or cultural in that period and the events in Berlin corresponding to modern art exhibition or sculpture exhibition in the same period Output should be result list see SQ1 Alternative 4 in Biella corresponding to sport or cultural in that period and in Berlin corresponding to modern art exhibition or sculpture exhibition in the same period Same as SO1 Registry filters the data provider s be involved in the s
93. provides access information of the data providers 09 11 2012 1210U0Jd 12 11 2012 uUdIpowswnasnu o 7 8 Actual Result 7 results Exchange Ac commodatio ns Import accommodations go on Exchange Data gt Import Data select Accommodation as subdomain b amp b as type biella as data provider click on Search like above J2910U01d Exchange Ac commodatio ns lookup through registry of data providers that have accommodations go in Configurations gt Ouery Service insert the query S07 any accommodation xmi from the test folder in the form Ouery to Provider Test click Check Provider Biella is returned as data provider for accommodations Semantic Registry is directly gueried 12910Ul01d Biella Exchange Ac commodatio ns Configuratio n Home Configuratio n Home Import of accommodations through Web Service Take oveview of configuration Prereguistite you have configured the mapping for receiving accommodations perform an import with simpleSearch method using your organization s name as sender biella as receiver Accommodation as subdomain guesthouse as type and restaurant as facility logged in with your account go on Home check the status of the services To be tested using Oxygen or XMLSpy or similar WSDL http harmosearchdev harmon et org WebAccessPortal portlet DataExchangeManager wsdl
94. query service for a new HarmoSearch data provider go in Configurations gt Ouery Service click on Test go on panel Create and attach a new Data Provider and insert an id e g TestDataprovider no whitespaces click on Create and insert the following parameters Test Data Provider as Provider Name events as collectionld http www euromuse net harmonise guery g uery php as service access endpoint no whitespaces karin as username and password HTTPAdapter as Connector class select METASEARCH as operation Event as Subdomain click on Save Changes click Edit Data Description and select events in Berlin click on Save Changes If you go back to the view Harmonise Participant Details back to list the new data provider is attached to your organization Test A new data provider is registered for Test organization The data provider is added by specifying where and how the online guery service is accessed An important step is the Data Description which is used by the semantic registry to filter the input gueries of a metasearch process selecting only the relevant providers to be involved Note also that the guery service registered here corresponds to the data provider of euromuse which is already a HarmoSearch provider Thus the results coming from Test will be the same as those from euromuse Still find confusing the screen change for the
95. query to Harmonise in regular intervals asking for batch transfer of static data of a predefined kind The time at which this batch import is triggered depends on the load of the tourism portal s servers The query can encompass specific constraints e g accommodations from Finland In addition the query can contain a time when the last update was done therefore indicating that only changes since this time are of relevance a so called delta update Each data item must have an ID which is unique within the scope of the data provider Harmonise translates the query to the local data format of the data providers and delivers it to the configured partners The partners respond to the query with sending the corresponding data taking the possibility of a delta update into account if possible The responses are sent back to the tourism portal through Harmonise Finally the tourism portal imports the data into its CMS and triggers further processing e g local duplicate detection A data provider wants to upload his data in the Harmonise network Data may be uploaded once manually or regularly scheduled A data provider wants to program regular batch uploads for static data for price and availability data for booking synchronization or allow retrieval via web services at certain times on events Each batch may contain one or several files There may be several batches of different frequencies User wants to be able to define batches e
96. raphical interface of portal Improve labels as well and add helpers Allow multiple mappings event mapping hotel mapping Mapping Tool mapping of reference list and editor improvements Simplification to data import by using an excel template for events and one for hotel Allow import of ics calendars Upload the file Provide simple minimal input format for events and hotels for data publication June 2012 Subdomain Events Providers Euromuse Web provider using the online form Biella Crawler using microformats or ics Museum Portal Berlin Consumers Scenario 1 publish Facebook HS and personna for events and status update Twitter HS and personal for events from Biella and Euromuse and web provider Scenario 2 metasearch B2C user on the event site Scenario 3 import qualified content Dummy consumer and later partners such as Pixmeaway ETC Portal finalise the basic requirements like user management and Expand the event scenario input from at least 2 sources have capacity to qualify and enrich publish in 2 or three distribution channels Have a cache to distribution ready and minimal scoring notions in place Complete Harmosearch Platform including the features and latest graphical layout data enhancement addition of keywords qualification rating February 2013 Technical intertace to integrate Integrate missing information in the response and config mapping id connector id Todo complemen
97. re also working in Biella so maybe there is some unexpected change Comment CP the server was down can you please retry Search Query Language Search All events within locations Retun all possible events in Biella or Wien Output should be result list Same output as SQ1 Alternative 4 in Biella or Wien Registry O returns euromuse biella and euromuse crawler Query Processor selecting all three data providers X 1 XML file each but Euromuse cannot understand multiple cities in the same query need to be splitted using the OR construct instead of the InSet condition see following test case Metasearch W 6 results missing city location and event domain due to incomplete mapping less than all events in Vienna because of incorrect query translation see above Registry screen Query Processor XML file s Metasearch screen cannot choose 2 criteria in the simple search mask Metasearch 6 Results Field location empty gt validation difficult Exhibitions are in italian or german so probably fine O results Comment CP the server was down can you please retry Search Query Language Search All events within locations Retun all possible events in Biella or Wien within 1 9 2011 31 12 201 1 Output should be result list Same output as SQ1 Alternative 5 in Biella or Wien or within a certain period Registry O returns euromuse biella and eurom
98. roviders contacted 50 results 50 contacted providers 2 received results Results found 50 2 data providers contacted euromuse euromusemf biella 3 results 2 data providers contacted 3 results contacted providers 3 received error message Failed on euromusenff Error in translating the query for the provider 3 received results Results found 3 3 data providers contacted euromuse euromusemf biella 25 results 3 data providers contacted 25 results 25 contacted providers 3 received results Results found 31 3 data providers contacted euromuse euromusemf biella 3 results 3 data providers contacted 3 results 3 contacted providers 3 received results Results found 5 Par Seguen ent ce Action Import Dat a Import with unavailable registry Appendix B 3 Test cases RC3 Semantic Registry Description Prerequisite the registry has been shut down perform any kind of simple or advanced import Post start the registry again Comment and alternatives This test case can only be tested by the system administrator Expected Output Error message is shown Impossible to connect to the data registry Please contact the administrator 7 14 Semantic Registry Integration of Semantic Registry in the platform is tested Import Dat a Data provider is unavailable in import login with user euromuse
99. ry 28 2013 Actual Date of Delivery to the CEC March 8 2013 PROJECT CO ORDINATOR Company name X O Name of representative Manfred Hackl Address Siebensterngasse 4 22 A 1070 Vienna Austria Phone number 43 676 842755 100 Fax number 43 676 842755 599 E mail manfred hackl xpluso com Project WEB site address www harmosearch org File D5 3 Registry Evaluation Report Page 2 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services TABLE OF CONTENTS 1 INERODUCTTO Nujni znana ka inaa i rekli ona kana ena kan deka k deka 4 1 1 PURPOSE OF THE DOCUMENT NNN 4 1 2 DEFINITION OF TERMS AND ABBREVIATIONS NNN 4 1 3 RELATIONSHIP WITH OTHER DOCUMENTS an 5 1 4 STRUCTURE OF THE DOCUMENT NNN NNN NNN 5 2 CONTEXT EE 6 2 1 OVERVIEW OF THE SEMANTIC REGISTRY FUNCTIONALITIES nn 6 2 2 OVERVIEW OF THE EVALUATION METHODOLOGY nn 6 2 3 TESTING THE SEMANTIC REGISTRY an 7 3 EVALUATION ETH el LE 12 3 1 THE FIVE RELEASE CANDIDATES nn 12 3 2 EVALUATION OF en WEE 12 3 3 EVAUUATIONVOF RCO EE 12 3 4 EVALUATION OF ROJ nn 13 3 5 EVALUATION OF RCA si aaa ENNEN vals dasa SEENEN SEA ee kel EE NEEN e E 13 3 6 EVALUATION OF ROB nn 13 3 7 EVALUATION WITH EXTERNAL DOMAIN EXPERTS nn 14 A APPENDIX nea ee E oa o a asa uda 15 APPENDIX A LIST OF REQUIREMENTS gege EE Ae E a E RE 16 APPENDIX B TEST CASE DOCUMENTS NNN 17 APPENDIX C ACCEPTANCE NOTES NNN 18 File D5 3_Registry_Evaluation_R
100. ry for the provider ok tried also to change Berlin in BAAAA so to search only for biella i got biella but also some wrong from euromuse Probably an error in euromuse o 197 contacted providers 3 received results Used SO4 alt A 197 results from euromuse euromusemf biella used SOL Alternative4 xml from EUROMUSE there are exhibitions listed sure not from Berlin 3 data providers contacted euromuse euromusemf biella 82 results 3 data providers contacted 84 results twice Tried again with 82 results 1 error Failed on euromusemf Error in translating the query for the provider working also dates looks ok 85 contacted providers 3 received results 3 data providers contacted euromuse euromusemf biella 76 results 3 data providers contacted 78 results OK contacted providers 3 received results 7 Results found 84 1 data providers contacted biella 1 result 1 data providers contacted biella 1 result ok 1 results The category is not shown mapping problem 1 contacted providers o 1 received results 1 data provider contacted O rest 2 data providers contacted euromuse euromusemf 149 results 2 data providers contacted 149 results 149 contacted providers o 2 received results 2 providers 99 results o Results found 149 2 data providers contacted euromuse euromusemf 50 results 2 data p
101. s important search by language 3 data providers contacted results were available as soon as the first provider delivered data Found results 364 Results found 345 from 3 data providers Is SOL2 xml the right file Was not clear to me Waiting for results Completed 2 of 3 contacted providers Failed see Errors Load available results Results found 363 3 data providers contacted euromuse euromusenf biella 112 results 4 data providers contacted 212 results 3 data proviers contacted used SQ3 query 112 results received Date range topic aleady discussed in RELEASE 2 think past exhibitions in the praxis should be automatically discarded and not shown i thought it was a good solution to set today as default starting date 3 data providers contacted euromuse euromusemf biella 113 results 4 data providers contacted 213 results 3 data providers contacted used SQ3 alternative 1 query 112 results received 3 data providers contacted euromuse euromusemf biella 363 results 4 data providers contacted 362 results 1 error Failed on CPR Impossible to connect to provider 3 providers contacted used SQ3 o alternative 2 guery 102 results received error message Failed on euromusemf Error in translating the guery for the provider 2 data providers contacted euromuse euromusemf 192 results 2 data providers contacted 92 results This one was guick ok
102. s no provider to query that matches your search criteria Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the Import Dat a Import all from euromuse with Advanced Search Add data mapping from HTO to local system pre condition Import Dat a Import all from euromuse with Advanced Search perform an import through Advanced Search using SQ1_for_import xml Screen message is shown Operation stated You will receive an email notification To view the status and results go here In Operation Status tab the entry of the previous import reports Operation completed successfully on euromuse In Data Repository gt Querybox the result file is available check the timestamp and it contains some results check with the example file import results Advanced Search xml in the test folder Semantic Registry is invoked to get the information on how to access a data provider as well as to filter out data providers if the search criteria do not match with the data description of the provider 2 Z Actual Result Error message as expected Screen message as expected Operation status page has content as expected Error message as expected Screen message as expected Operation status page has content as expected
103. scription in local language and english date range categories sometimes link but missing Organiser and location simple search sent returns the same Observations 1 If the query includes Paris Berlin Vienna Biella and Rome why is there a finnish exhibition in the output 2 Weblink why is it not the link to the euromuse net exhibition link Actual Result Metasearch 10 Results Should city be part of location or separate because it wasnt explicitly mentioned in the result 1 3 Registry returns Euromuse Query Processor returns the query all euromuse query Metasearch returns 10 results Search Query Language Search All events Retun all possible events Output should be result list Same output as SQ1 Registry O returns Euromuse Biella and euromuse crawler Query Processor selecting all three data providers O 1 XML file each Metasearch W 274 results missing city location and event domain due to incomplete mapping Registry screen Query Processor XML file s Metasearch screen Metasearch 274 Results this is not the same as SO1 as mentioned in the comment Registry returns all the providers Query processor converts the three queries Metasearch returns 274 results from thr three providers But search is slow tried to remove starting date and ending date from output fields but as output i got dates as well Output format looks not used right Search Query
104. sic with exhibition music P 3 15 P 3 12 Metasearch go in the Metasearch tab returned 43 Registry P 3 13 on execute a simple search on results filters out P 3 14 registered euromuse selecting the number the data P 3 15 category exhibition music as category may vary it is provider s an online to be search involved in the search process Integrated workflow test on the Service Registry from Appendix B 5 Import role Id Name Description Expected Output Notes Expl anation 14 4 Use log in with your account Screen message and Access external guon Exchange Datak Operation Status report information service i i success of the import to use the h gt Import Data in i i external i In Data Repository gt import select euromuse as data i service is Querybox the just received provider l held by the file contains only 3 events out Austria t Semantic ustria as country of 9 which would be returned i registry exhibition archeology as category include Permanet Events without including the external service they all are permanent exhibitions Filter as external service click on Add button click on Search In Subscribe to Service the max number of times is updated to 2 File D5 3 Registry Evaluation Report Page 11 of 22 FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 A the future of information services 3
105. ssful completion and links to the Ouerybox where the result file is available check the timestamp Semantic Registry Like 13 1 HHH Jayowodd HHH Z Actual Result HHHHHHHH g ualpawswnasni Actual Result Actual Result same as row 21 no possibility to set a receiver only to choos biella as data provider Message Operation COMPLETED You will receive an email notification To check result Output XML Screen 8 HHHHHHHE 2 2 Import Web Services Use external services Advanced Search import through Web Service Use external services Register new service that requires authorization perform an import with advancedSearch method using your organization s name as sender Event as subdomain and SQ1_for_import xml from test folder as xml guery User imports data including extenal services log in as testuser testuser test user or the email you set password testuser go on External Services gt Manage Services register a new service on the Add Workflow Service panel with fields name Permanent Events Filter description Takes only permanent events check the box Authorization reguired access URL http harmosearchdev harmonet org ExternalService portlet permEvents click on Set import Events Optional change the email of the preloaded testuser Same documentation as Two strings are returned
106. stered also in the Semantic Registry The Semantic Registry is invoked to check if the user account i e the organization he belongs to has a Query Service configured and is therefore a data provider Tests the integration of Semantic Registry in the platform Metasearch Metasearch on unregistered category login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition music with exhibition pop music Please edit test case P 14 5 Description of a data provider is modified within the Semantic Registry Metasearch Metasearch on unregistered category go in the Metasearch tab execute a simple search on euromuse selecting exhibition music as category Error message There is no provider to query that matches your search criteria Registry filters the data provider s to be involved in the search process 2 Z Actual Result Success message Confirmation email has arrived Appendix B 3 Test cases RC3 Semantic Registry 2 Actual Result Success message Confirmation email has arrived but went to spams Actual Result Actual Result Worked as expceted Mail arrived quickly after the registration sender HarmoNET Ad
107. sult 13 11 2012 Firefox 16 17 11 2012 _received 7 results successfully already done see R4 6 _dublicated _sq7 is not available are there any prerequisite to performe this testcase other than uploading mapping for receiving accommodations _was not able to fulfill the test case did the following _going to Exchange Data gt Import Data did not provide Don t have such xml editor only simple ones _in the import page i cannot define myself or me the fields described in the How doi perform such import from simple search biella as reciver biella only as data provider task description _share data ok _scheduled tasks were done with other user account there they are ok _typo social media configuration alt text is Scheduled share is not active Social Media vonfiguration Import data Scheduled Receive gueries is not active guerry mapping not configured _did not do the metasearch rows import events are also active Pa re Segue nt nce Action Import Events successful Description User imports data Prerequisite You have uploaded the mappings from Harmonise ontology to your system log in with your account go on Exchange Data gt Import Data select euromuse as data provider exhibition ancient world as category click on Search Appendix B 5 Test cases RC5 Semantic Registry Import role Comment and alternatives Expected Output Scr
108. sult gives updated result so it is successful Agree with David either open the file in a new tab or activate the download dialog of the browser it would be nice to see in the table how many results where retrieved in the file Import Scheduled Import Import Web Services Import Accommodation s successful Scheduled Import Schedule import Import Web Services Import Events through Web Services go on Exchange Data gt Import Data select Accommodation as subdomain b amp b as type biella as data provider click on Search User schedules regular automatic import operations log in with your user go on Exchange Data gt Scheduler and select IMPORT Data as Operation euromuse as data provider exhibition art history as category schedule the operation within the next 10 minutes click Schedule task User imports data through Web Services Prereguistite you have configured the mapping for receiving events perform an import with simpleSearch method using your organization s name as sender euromuse as receiver Event as subdomain and void not null search criteria the server s system clock is CET Central European Time To be tested using Oxygen or XMLSpy or similar WSDL http harmosearchdev har monet org WebAccessPort al portlet DataExchangeMana ger wsdl Documentation Annex D 4 3 Web Service APIs Specifications v0
109. t if required Implement access control Editing and entering data subdomain data description provider properties Improve a little for instance to specialise per users limit access Start with release 4 and update in release 5 Improve text allow configurable text via config files Start with release 4 and update in release 5 New external service in the portal define configure select consumers to show and licence agreement for service provider Anew crawler will be used and this will be performed What i snot included is the integration of the crawker configuration into the semantic registry This will be performed through an xml file only performed by an expert FP7 SME 1 262289 E HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services APPENDIX B TEST CASE DOCUMENTS This section gathers all the test cases that were filled for each release PDF files extracted from Excel documents Appendix B 1 Test cases for release candidate 1 Note The table Test cases of RC1 for the Semantic Registry corresponds to the merged files Test Case Release 1 Semantic Registry xslx and Test Case Release 1 Ouery xslx available in 07 Demonstration Activities Release 1 on SVN repository In the selected test cases the Semantic Registry is invoked to filter out the data providers to be involved in the metasearch process on the basis of the domain locations and categories that are specified in the guery
110. ta providers of a metasearch Ja OWOIg wsuunasn M1 Metasearch Search Query Languag Search Query Lan Metasearch successful Advanced Metasearch Search all from Euromuse log in with your account go in Search Data gt Metasearch and execute a Simple Search inserting exhibition ancient world as category You can try with any combination of search criteria The result may also be void Auser performs metasearch by posting directly HarmoSearch queries in the Advanced Search text area go in Search Data gt Metasearch and execute an Advanced Search inserting the SQ1 query available in the test folder the same for all following SQx tests This query searches for all possible information in all domains coming from Euromuse Output should contain title shoth description event location event category date range url vignette Registry filters out the providers to involve and returns the access information Some results are shown The metasearch process is asynchronous and the results can be visualised as soon as they become available In the result list it is possible to understand if the data comes from an external data source or from the local index Registry filters out the providers to involve and returns the access information Ja OWOIg JO 0WOJd wWsWNasn al wswNnasn 36 results are found in euromuse 8 were shown in the first page of results it was
111. tand alone Semantic Registry component the Mapping Tool and the Harmonise ontology e Platform The HarmoSearch platform is the graphical interface allowing non technical users to benefit from the HarmoSearch system s features It is realized as a Web portal that uses profiles roles mapping files and service subscription to let user import publish or search data using the system e Semantic Registry The Semantic Registry is a semantic index which contains knowledge about the HarmoSearch participants in particular about the data and the services they provide e HarmoSearch Participant A HarmoSearch participant is an actor in the HarmoSearch network typically an organization who can provide or consume data and services One HarmoSearch participant organization may correspond to several users registered on the platform web portal e Data Provider A source providing data in one of the subdomains of the Harmonise ontology at present events and accommodations Each HarmoSearch participant can operate several data providers e Service Provider A service provider offers an external service that can be integrated into a HarmoSearch workflow Such a service normally operates on the results of a HarmoSearch search query Each HarmoSearch participant can operate several service providers e Data Registry The part of the semantic registry concerned with describing data providers the content they offer and matching it against search queries
112. that date corresponding to modern art exhibitions or classical concerts Alternative 5 in Berlin during that period corresponding to modern art exhibitions or in Wien at that date concerning classical concerts Expected outcome from Semantic Registry Registry returns biella 23 08 2011 Wun piy S 2 2 Actual Result Should we not use a thesaurus or something like that for categories Otherwise how do we match terms Search Query Language Search All events for certain categories Retun all possible events in Bertlin corresponding to modern art exhibitions or classical concerts Same comment as SQ5 Registry returns euromuse and euromuse crawler Search Query Language Search All events for certain categories Retun all possible events in Berlin or Wien corresponding to modern art exhibitions or classical concerts Same comment as SQ5 Registry returns biella euromuse and euromuse crawler Search Query Language Search All events for certain categories Retun all possible events in Berlin or Wien corresponding to modern art exhibitions or classical concerts during that period Same comment as SQ5 Registry returns biella euromuse and euromuse crawler wnipyy wnipyy UNIPIJY Search Query Language Search All events for certain categories Retun all possible events in Berlin during that period or Wien at that date corresponding to modern art exhibitions or classical concerts Same
113. tic Registry Semantic Registry Semantic Registry HS Front End HS Front End Service Management Crawler Definition of the release Definition of the release Integrate in metasearch User interface to configure the registry Add features for the subscription scenario User interface to configure the registry GUI GUI Management Semi automatic refresh Appendix A List of requirements for Semantic Registry Requirement Apply the tools to enrich the system Fine tuning the system Subscribe to external services for the user to enter the location data category corresponding to its data Improve graphical interface Improve labels and helpers Implement the incluson of external services Subdomain Events Accomodation Providers Biella Euromuse Ec3Networks Afidium Consumers Harmosearch Facebook Twitter Foursquare move to release 5 Google Plus not because proved impossible only for events from Biella and Euromuse Extend HS portal to query and display results for hotels display category according to domain push the information to social networks Have a complete commercial portal with 1 operational subdomain event user friendly mapping tool Add plugging capacity for external services impact on user rights interface and payment and implement the process with validation of subscription and validation of licences Filtering external services will be added Improve g
114. tion of the release Definition of the release Definition of the release Appendix A List of reguirements for Semantic Registry Reguirement To allow data consumers to apply additional decision support services on data such as ranking or recommender systems To allow data consumers to apply additional data enrichment services on data To allow data consumers to apply additional translation services on data Definition of the key components for the Harmosearch platform Integration of the different components in order to have a metasearch running and have a first release of the mapping tool Have a complete system ready for commercial launch In general search is performed either to become aware of all relevant elements for further processing as for instance in market research see Use Case 3 Market Intelligence or for decision making see Use Case 1 Accommodation Meta Search In the latter case decision support such as ranking of result elements according to some relevance criteria may be provided as external service Data consumer may want that raw data is augmented with additional input For instance accommodation search data may be enriched with data provided from additional services such as rating agencies or user ratings weather forecast services or additional images Data enrichment may change the structure of the data for instance by adding additional XML elements to a result item This will be
115. to modern art exhibitions during that period Same as SO1 Like SO1 JBJ0WOJd WSWNOSNIN wswnasny uswnasny USWNOSNIA USUWNASNIA wswnasny USUN9SNIN loads 3 events in berlin mordern art in april from euromuse none from biella modern art contacted providers 2 should be euromuse and euromusemf but maybe beilla and euromusemf are temporarily down Search Query Lan Search All events for certain categories Retun all possible events in Biella corresponding to sport or cultural in that period and the events in Berlin corresponding to modern art exhibition or sculpture exhibition in the same period Output should be result list see SO1 Alternative 4 in Biella corresponding to sport or cultural in that period and in Berlin corresponding to modern art exhibition or sculpture exhibition in the same period Same as SO1 Like SO1 JBJOWOJd WSWNOSNIN loads berlin mordern art in april and berlin sculpture in april neither biella culture in april nor biella sport in april provider might be down for now Search All events for Search Query Lan certain categories Retun all possible events in Biella corresponding to cultural in that period and the events in Berlin corresponding to modern art exhibition in the same period Output should be result list see SO1 Alternative 5 in Biella corresponding to cultural in that period and in Berlin corresponding to modern art exhib
116. to create a provider id with whitespace if problematic then whitespace presence should result in an error Mapping Collection Identifier gt shouldn t this be a drop down list we don t have the names of collection ids on the screen we may not remember them all 3 Can t check if this worked click Edit Data Description and select Events with location and category from the drop down list on the top click on Save Changes Only xml description not 1st field is still present don t see it anywhere else Would be nice to have it on the dataprovider page with other info where there is the edit button Screenshot for whitespace https 46 37 22 116 repos harmo search 07_Demo nstration_Activiti es test 20data Tests 20outputs 20121113_GK_S pace in data provider png _ add success message on top of the page once the changes are saved _ move the delete option to the bottom of menu list ok but hide password with Make the page http harmosearchdev harmonet org configurations as a link to the first menu item for example Also the other tolevel menu items worked fine for me _remarks may be overwhelming for novice users since the procedure is not very intuitive Additional feedback e g when saving data or a short text describing the tasks may be helpful Pa re Segu nt ence Action Exchange Pu blish Events Schedule publish with manual filter App
117. tual users felt about the final release The following activities have been performed during the project File D5 3 Registry Evaluation Report Page 6 of 22 FP7 SME 1 262289 HE HARMOSEARCH E HARMOSEARCH Deliverable D5 3 the future of information services e During the development phase unit tests have been used evaluating dedicated parts of the developed source code e At the end of each development phase expert users performed a testing to evaluate the software guality perceived by the expert and end user The HarmoSearch Semantic Registry has been evaluated from two distinct perspectives e Internal evaluation o The internal evaluation is a technical evaluation which consists in unit tests and bug fixing and is conducted by the developers RTD partners e External evaluation o The external evaluation is a functional evaluation and aims at measuring the success and usability of the Semantic Registry It is conducted by three kind of users expert users that are internal project partners SME partners real users that are internal project partners class OTHER partners in HarmoSearch and domain experts that are not participating in the HarmoSearch project All partners of the project have been involved as participants in the external functional evaluation of the various Semantic Registry release candidates following the evaluation methodology described in details in the Deliverable D7 1 Compiled collection of acceptance
118. u have uploaded the mapping from local system to Harmonise ontology and you have subscribed to the service Event fields filter log in with your account go on Exchange Data gt Share Data select Push Data as operation select euromuse Wir essen Reis xmi as data file available from test folder select test as recipient Event as sudomain include Event fields filter as external service click on Add button click on Send Screen message and Operation Status report success of the push Logging in as testuser the file in inbox looks like push Wir essen Reiz filtered xml in the results test folder only id title date and location are taken If you did the same operation without the external service the result would be like push Wir essen Reis xm The Semantic Registry is involved to get the information to access the external service 1210U0Jd uUdIpatuswnasnw Exchange Ex ternal Servic es Use external service in publish Prereguisite You have uploaded the mapping from local system to Harmonise ontology and you have authorization to use the Test filter external service log in with your account go on Exchange Data gt Share Data select Publish on social network as operation keep Filter manually checked select euromuse 2 events vml as data file available from test folder select your social network s target one or more as recipient Event
119. ult files are correct expected contains results Email has arrived Operation status page has content as Operation status page has content as Result file is present in Ouerybox and Appendix B 3 Test cases RC3 Semantic Registry 2 Z Actual Result Actual Result Operation Status reports as expected Email received Email received Operation Status reports as expected o Actual Result This answers my comment before Configured at 16 00 for 16 10 server time at 16 10 operation succeded all euromuse exhibitions english in querybox from 33 current end date posterior today art history exhibitions the query outputed around 100 current and past exhbitions This should be hindered performed a scheduled query with same category but with date restriction next 30 days same number of exhibitions were outputed in the query 2 Z Actual Result which file to use 10 14 Appendix B 3 Test cases RC3 Semantic Registry 11 14 Par Seguen Comment ent ce Action Description and alternatives Expected Output Semantic Registry Configurati ons Query Service Register a new data provider in the semantic registry login with your user go in Configurations gt Query Service and select your organization in Registry Data Management Create and attach a new Data Provider assigning as id lt Your organization_name gt _d
120. use crawler Query Processor selecting all three data providers O 1 XML file each Metasearch W 6 results missing city location and event domain due to incomplete mapping wrong dates in the results coming from Euromuse but this seems to be a Euromuse problem Registry screen Query Processor XML file s Metasearch screen cannot choose 2 criteria in the simple search mask therefore tried two different but related test cases Test1 event exhibition Vienna 16 02 2012 euromuse Test2 event exhibition Berlin 16 02 2012 euromuse and all Date Range Start date end date 16 02 2012 in that time there are no temporary exhibitions in euromuse for Vienna The two exhibitions output have no dates to be expected as in our system for permanent exhibitions are start and end dates not compulsory Could the output be tricked into give out permanent exhibition or ongoing Directly related to this tried the same for Berlin but permanent exhibitions are not included in the output The 13 exhibitions are temporary exhibitions but in that date 16 02 2012 there are all in all 85 exhibitions Usability When clicking through result pages i e exhibitions in Berlin on 16 02 2012 13 entries 3 result pages the next page automatically sets at the bottom of the list could it not be the top Metasearch 0 Results Comment CP the server was down can you
121. vents A data provider wants to publish data in the Harmonise network This use case is similar to the Data Hosting PS 1 but in this case what is uploaded and stored in the Harmonise portal are not the real data but some meta data which are useful to describe what kind of data the data provider has to offer Data collected from several data providers may contain unwanted or redundant elements for a particular data consumer unwanted characters duplicates Harmonise system may support additional services as external services Services will not be provided by Harmosearch Implemented An organisation can have different representatives corresponding to different logins having the same right since the right are associated to the organisation At present only admin harmonet personnel can crezate users People from an organisation cannot create users The organization is added manually in the Semantic Registry Mnemo code Name associate keywords validity period policy public vs restricted free vs fee In case of restriction provide restriction criteria Data mapping for the query language between internal language and HS ontology can be uploaded Mapping is performed outside the platform first prototype RL3 RL pe Authc Group HS Data Modification Scenario Data Modification Scenario Data Modification Scenario RELEASE RELEASE RELEASE Decision support Data Enrichment Data Translation Defini
122. vider edit the service access endpoint inserting http www euromuse net harmonise as service access endpoint no whitespaces Save changes Data provider configuration saved A data provider s configuration is modified in the semantic registry Configurati ons Query Service Modify euromuse configuration in the semantic registry restore the Service Access Endpoint login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider edit the service access endpoint inserting http www euromuse net harmonise query query php as service access endpoint no whitesapces Save changes Data provider configuration saved A data provider s configuration is modified in the semantic registry Configurati ons Query Service Modify euromuse configuration in the semantic registry change a category login with user euromuse euromuse harmonet org euromuse go in Configurations gt Query Service and select Euromuse in Registry Data Management select the Euromuse Exhibitions data provider click on EDIT Data Description edit the text displayed in the text area changing exhibition music with exhibition pop music Data provider configuration saved A data provider s configuration is modified in the semantic registry Configurati ons Query Serv

HARMOSEARCH D5.3 V1.0 Registry Evaluation Report

Contents

Download Pdf Manuals

Related Search

Related Contents