TopoCheck User`s Manual
Contents
1. Value 7 Figure 22 Completeness Commission GUI 28 TopoCheck User s Manual Wp SINERGISE 7 VECTOR TAB GEOMETRY CHECKS W Check vector data Kick back Angle 55 t Kick back Distance 15 Spike Angle Min Ea Spike Angle Max 55 gt Spike Distance a Minimum Polygon Area 10 Minimum Segment Length 0 05 Maximum Sliver Area 5 Minimum Line Length 0 004 Minimum Point Distance 0 004 Grid Size 0 0 W Check for polygon boundary consistency W Verbose mode W Overwrite existing result files Figure 23 Geometry Validation Parameters This tab allows the user to set the parameters on each of the geometric tests for each of the datasets being tested The values of these parameters may be amended by typing direct into the relevant box or by using the up down spinner buttons to increment increase or decrease by pre set amounts The nature of each geometric test is described fully in Ref 3 The default values and units of measurement are described in Table 3 The aim of setting these parameters is to test the geometry of the selected dataset s and report on any instances where angles and maximum values have been exceeded and where there are values which are lower than minimum settings These anomalies are summarised as vector errors e g intersection gap sliver etc some of which constitute a mandatory fail in the data 29 TopoCheck User s Manual ZG SINERGISE If the selected dat2. Figure 2 TopoCheck command line window NOTE If the Java runtime environment s bin directory is not included in the system PATH variable TopoCheck will not start In Windows this can be fixed by opening the System Properties dialog and using the Environment Variables button in the Advanced tab the dialog is opened e g by right clicking on My Computer in Windows Explorer and selecting Properties TopoCheck User s Manual D SINERGISE 4 TOPOCHECK GUI MAIN PANEL When the GUI is first launched it looks like the example shown in Figure 3 The different parts of the GUI e g Datasets box tab areas may be increased or decreased as preferred ce SVT 01 15 n Data Source lt select working directory or DB connections Grecian Connections i ii i SIMMERS Selected Dataset lt select a dataset in the list below gt Tab for selecting attribution parameters Tab for selecting spatial Tab for overall dataset properties Selected directory interface Datasets sub panel Figure 3 TopoCheck Graphical User Interface The first task is to select a data source from which one or more datasets may be chosen for running TopoCheck geometric and attribute tests Until this is done none of the options on the GUI are active 4 1 Selecting a Data Source 4 1 1 SELECTING A DIRECTORY WITH SHAPEFILES Click on the Directory button and navigate to the relevant directory using t
3. The auto generated list is stored on the disk under a filename whose structure is X AUTO GENERATED where is the dataset name and X is the Attribute name For example all unique values for the Name attribute in the SSSI dataset are stored in sssi NAME AUTO GENERATED svt codeslist xml an example of the XML file is displayed in Listing 1 An example XML file for a domain code list Listing 1 An example XML file for a domain code list lt xml ve lt codesla lt codes gt lt item lt item lt item lt item lt item lt item lt item lt codes gt lt CodesL rsion 2 0 encoding UTF amp standalone yes gt st name s7teuntt CONDITION_AUTO GENERATED description url las tUpdatedOn 2008 07 20 gt code 1 label UNFAVOURABLE DECLINING description UNFAVOURABLE DECLINING 2256 Tnstances found during mining gt code 2 abel UNFAVOURABLE RECOVERING description UNFAVOURABLE RECOVERING 5261 instances found during mining gt code 3 abel FAVOURABLE description FAVOURABLE 10326 instances found during mining gt code 4 abel UNFAVOURABLE NO CHANGE description UNFAVOURABLE NO CHANGE 3510 Tnstances found during mining gt code 5 abel PART DESTROYED description PART DESTROYED 49 instances found during mining gt code 6 label DESTROYED description DESTROYED 42 instances found during mining gt code 7 label
4. LL SINERGISE TopoCheck User s Manual Client Spatial Validation Tool TopoCheck User s Manual Wp SINERGISE DOCUMENT HISTORY Rev Date Changed Modification reviewed 1 0 2008 07 21 mkadunc Created 1 1 2008 1 2 23 tcerovski Modified Added features from version Tal 1 2 2009 03 23 tcerovski Modified All sections to do with Metada CONFIDENTIALITY SCOPE AND AUDIENCE This document is classified as a public document As such it or parts thereof are openly accessible to anyone listed in the Audience section either in electronic or in any other form This document lists and describes the functions within the TopoCheck application The TopoCheck User Manual is targeted to the users of the TopoCheck application and developers involved in processing of the TopoCheck results TopoCheck User s Manual Wp SINERGISE TABLE OF CONTENTS T DOCUMENTATIONSTANDARDSS Su 6 2 BACKGROUND AND REOQUIREMENTS 6 2 1 Non functional requirements 6 2A Geometry VAR AIO a lee 7 23 PRU VAIO MORE o a 8 2 4 Tracking Metrics and Packaging sessessssseersssesssssesssseeossecesssecessseeessseeosssesosseeoss 9 3 PROGRAM INITIATION cecina a aa a Ai 11 4 TOPOCHECK GUI MAINPANELSSSSS inasai ainis 13 4 1 Selecting a Data SOMMES uaonmenononnt 13 41 1 Selecting a Directory with Shapefiles rm 13 41 2 S l cting Oracle DB OVS CU O enr 14 a RO TT eons eee 18 A3 The Datasets LsStiNGesssissiinonsnana o 19 5 DATASET TAB OVERALL DAT
5. a text field as mandatory it cannot be null blank or an empty string Similarly if a user marks a numeric field as mandatory it cannot be null blank Not A Number NaN or an empty string It can be zero only if there is no domain or if the domain range allows it to be In addition TopoCheck checks that no Oracle reserved words are used this is read from a list maintained in a file within TopoCheck that can be edited if necessary A007 TopoCheck ensures that the attribute values conform to the type and length specified in the attribute lookup file and if a domain is prescribed that the Wp SINERGISE TopoCheck User s Manual D SINERGISE values are bound within the domain code list and or values A008 Several domain code lists are pre defined as listed in SIP DP 011 SPIRE Data Standard v1 0 1 Data values Standard Country ISO 3166 1 Country Subdivision ISO 3166 2 Language ISO 639 2 Table 1 Data conformation to ISO standards A summary of the attribute validation results is included in the results summary table in XML format as detailed in the geometry section This is included in the packaged zip file after processing as long as there are no mandatory fails in the data A009 24 Tracking Metrics and Packaging TopoCheck reports a summary of the metrics from the input dataset which includes coordinate system and projection total area for polygons total perimeter maximum boundin
6. ateunit hiandatory v Alas U ssa Desenption Type mismatch Is O should be C Frekl CONDITION defined in settings Fle cannot be Pound in dbf File FRRORS Figure 27 Attribute errors are displayed below the attribute s properties Table 4 Attribute Checks Error Code Test Name Description Conformance 206 Null Value Mandatory field not populated Fail 220 Domain Field value is outside the domain range or code list Fail P2 Unique Value for a unique field is duplicated Fail 36 TopoCheck User s Manual Wp SINERGISE 8 1 Primary Key Each dataset must have a primary key which the tool can use as the feature identifier For shapefile datasets this is simply its ROW ID and cannot be changed by the user Oracle datasets are checked for primary key database constraints If such a constraint exists it is used as a primary key and cannot be changed If there is no such constraint user has to select one unique field to be used as a feature identifier first unique field is selected by default If there is no unique field in a dataset an error is displayed Figure 29 and this dataset cannot be processed until a unique identifier is defined F1 Check Attributes oil Perf Data Mini M Check Attributes Primary key No Primary Key or Unique field exists Primary key ROW ID Figure 29 Error when Figure 28 Selecting unique dataset has no feature field as identifier identif ter Uniqueness of
7. packaged in the dataset zip file for upload and two HTML files reporting details of the validation see Section 10 for details Wp SINERGISE 40 TopoCheck User s Manual Wp SINERGISE ED Summary C Last Attribute Validation Run on 2010 09 20T12 11 20 Errors Anomalies Found Domain 110736 Unique 32671 Total 143407 Last Vector Validation Run on 2010 09 20T12 11 20 Errors Anomalies Found Spikes 223 Gaps 28 Small Areas 9259 Slivers 289 Total 9799 am PS i t os LL hs QA Metrics Geometries 55368 Parts 55694 Vertices 545481 Total Circumference 2292895 150787 124 Total Area 5967346 267064206 Figure 33 Validation Summary TopoCheck User s Manual 10 OUTPUT FILES After running TopoCheck tool a number of result files are created and saved in the same directory as the parent dataset They fall into three categories attributes geometry and settings 10 1 ATTRIBUTES _attribute_errors dbf dbf file which lists any attribute errors found during the check For each error the following are recorded row number field value error type and error description Example 1 Domain Range Error In the example in Figure 34 the minimum value for the Area field was set to 100m After running TopoCheck tool on this dataset only one record no 141 was found to have an Area below this value The actual Area value is given plus the e
8. selected for any of the 11 aspects of data quality e g Completeness Commission it opens up a new GUI as shown in Figure 22 This GUI is the same for each of the 11 data quality elements Metadata Data Description Data Extent Data Access Data Supplier Data Quality Data Quality Spatial Resolution 30 Unit of Measure Lineage BESTORICAL BACREROCED Lorem pos nas ca error dicum cu weque tantas commas que Fosait terquates ura ad Id eam erans integre Hine omm malor vim no Eros habec nomummy per ea Vitae cirmod prompta sed ci Vim vide accosamus ex vim hins comes lacreet ei Eomero accusara voluptaria cam cm n gracce debinis vim sed ssm erroribus ca Ad mel dicans delicasissimi id cum libris intellegat cu umm antem contentiones an Te mei clita percipitur interesset omittan erroribus ut vel soluta utamur at est fisioan salutandi interpretaris qui te et exerci luptatum com Due sale nobis ex no dectus labitur ins Completeness nmi tor FRERE 2 Completeness Omission 1 Absolute External Positional Accuracy lt empty gt Gridded Data Positional Accuracy lt empty gt Relative Internal Positional Accuracy lt empty gt Figure 21 Data Quality GUI 2 TopoCheck User s Manual Wp SINERGISE Measure Identification Code Measure Description Evaluation Method Type Value Type Value Unit Error Statistic
9. the part and vertex identifiers might not be coincident with the shapefile s internal ordering e TYPE e g Short segments Overlaps Gaps etc e MESSAGE eg Segment too short 0 03456 Intersection detected Gap detected area is 1320 81648851512 etc For consistency with previous versions of the SVT and distributed error files the codes in the output XML file for each error are maintained as before and as listed in Table 3 i Identify PK E sssi vector emors Fe si ERA a 5 fi Selection Display Syenbology Fields Dedinton Query Labets Jons amp Relates Be Fr me ee i ee eee ee ee a amaaa o Ih Be Dio categones using unique values of one held Iipat B Value Field a 4 m lt Headingr TYPE GAP GaP OVERLAP OVERLAP ROTATION ROTATION 2 y SHORT_SEGMENTS SHORT SEGMENTS SLIVER SLIVER i A TOROLOGY TOPOLOGY 7 Add Atos AddVatues Remove Removeat Advanced ae i 4 y Ps i gt pen f SS ii ae i r 4 ai j F irure 24 Error shape Ye re presented a ppropri atel y and examined in ArcGls desk fap fools TopoCheck User s Manual D SINERGISE Lable 3 List of geometric checks Code Test Name Description Conformance 101 Loop backs Loop backs self intersections Termed Butterfly polygons Pass 102 Unclosed Unclosed Polygons Rings The start node and end node of the Fail Polygons polygon or ring is no
10. user defined feature identifiers will be checked before every validation of such dataset to ensure proper behavior of the tool If a non distinct value is found an error will be displayed and the validation process will not start 8 2 Domains On data mining an auto generated domain code list is created for each field in the dataset and stored as an XML file in the same directory location as the dataset However if the number of unique values for a field s domain list exceeds 100 then this code list is not created The auto generated code list is available by clicking the edit button next to the code list name see Figure 30 The code list is displayed in a dialog which allows editing of existing code values or adding new ones Figure 31 Clicking on the green arrow button next to the Domain Codes List label K TopoCheck User s Manual Z SINERGISE allows the user to select from the following list see Figure 32 e Browse from a pre existing file using the normal operating system file selection tools perhaps previously mined on a different dataset e None which resets that attribute to have no domain e Auto generated code list e 1 03166 1 or 1503166 2 for Country codes and Country subdivisions e 0639 2 for Language codes The predefined ISO codes lists cannot be edited but the auto mined or user specified ones can Ae Figure 30 The code list can be disabled by clicking the re
11. 918 peri Figure 36 Example vector_errors dbf file associated with vector_errors shp file The example in Figure 36 shows some typical geometry errors in a polygon shapefile The geometric parameters section 6 set by the user are used by TopoCheck tool to identify a range of geometry errors Changing the parameter values obviously changes the number of identified geometry errors For example increasing the maximum sliver area in TopoCheck tool increases the number of slivers identified in the data 10 3 Settings _svt_settings xml xml file created every time TopoCheck is run for a dataset This file holds the vector and attribute parameters used to run the tool lt soml yersion 1 0 encoding UTF 8 standalone yes 7 gt lt Settings gt egecsettings kickBackAngle 55 0 kickBackDistance 5 0 spheMin ngle 5 0 spikeMaxAngle 55 0 spikebrstance 2 0 minPoly4rea 10 0 maxSlverPenmeteroreaRabo 1 0 minsegmenttength 0 05 gndSize 0 0 mndireLength 00040 minPomtiistance O gt lt athrSettings object_type spire csvt settings FleldCheckSettings gt tem names REF_CODE alas descoptione typem mandatory false length 10 decmslss 0 domantine domanbdiaxe f gt lt itam nama NAME alias descnption typa C mandatory aise length 120 decimals 0 domainken domamMax f gt item name MEASURE alias descnpton type N mandatory Talse length 14 decimals 2 domainMin domamM
12. ASET PARAMETERS urnes 21 6 DATASET METADATA EDIEORS siana 24 7 VECTORTAB GEOMETRY CHECK S siisii oandien 29 8 ATTRIBUTE TAB AT TRIBUTE CHECKS 2 aiaa 34 8 1 Primary KEY rdias 37 o2 DON eee a 37 D SUMMARY RESULTS ARR a ai 40 OUPS E EEEE A EE 42 DI OR mr ner retin erie tee Cera seater seer ero ane 42 102 GEOM enone pene ee eer ere tote a Ome ets fe er eae rT ee ree ere een 42 WG cca ssc a states acetone 43 104 Results AA ee ee cee eee 43 11 PACKAGING TO ZIP eer eeeneneretearrts nantes aerate eerr arr ne ern er eee i 44 TopoCheck User s Manual Z SINERGISE TABLE OF FIGURES Figure All TES in HOO CTC ZIP package uma 11 Rouez Topocheckcommand MMe MIO nan ai 12 Figure 3 lopoCheckGrapnical UI SEF Int ressant 13 Figure 4 Dialog for configuring and selecting data source Connections nent 14 Foure 2 Didog TON CONS UIC OFCOM ICE OR DR nn iniaiaiai 15 Figure 6 Progress dialog displayed while scanning the database nn 15 Figure 7 Working Qatasets Slot 16 Foure g IMA Cate Mining dialog Tor new datasets sssiuismisnanidinnonnnsiuiieiiiuiiai eiaa 18 Re aE E E E a e E EOE A E A AE EE ES 18 Figure 10 Datasets in the selected directory structure are listed in the Datasets listing 19 Faure TE yaidatonr roges daO RP aA a A O tnraatn reso tt tOnOn Tt 19 Fgure 12 Buttons for running validation ans INA se Sn ateamenne 20 Rowe T Dara et IN IO MANOIR ea net 21 Figure TAs Metadati File anil Farane tE s cisicscsasiacsenieestasscnu vasvnsetagei
13. Decimals 16 Mandatory E Figure 25 Attribute Settings Tab Each attribute block can be collapsed or expanded by clicking on its green header The attribute type is automatically determined from the dataset encoding is represented by icon e g character ES number __ FASTING o date CS 34 TopoCheck User s Manual The Attributes tab displays a list of attributes for the selected dataset For each attribute it shows the following see Figure 26 Name Type date character number etc and length for character and number attributes It also displays the number of decimal points for areal number attribute type but not for type float values There is a Mandatory checkbox which specifies whether a field is mandatory A mandatory field is checked and found erroneous if any of the attributes in that field are Null blank NaN or contain an empty string On mining the data if TopoCheck finds all attributes have an entry it defaults the tick box to on There is a Unique checkbox If checked TopoCheck checks that values for that particular field are unique and reports an error if they are not On data mining if TopoCheck finds that all attribute entries in this field are distinct it defaults the Unique tick box to on There are two text input boxes One allows the user to enter an alternative name Alias the other to enter an attribute description Description This is purely for the benefit of the us
14. INE A Dian Temporal extent information Deksel etda Mir IDR Peter hihra Bii kimm il Ai s Link oi Eu rpe Ve DM atu Le Pare Vertical tent information Serf LE Maka ela ADULTE i Figure 18 Example of Add for multiple fields Vertical Extent Information on the Data Extent tab Similarly multiple data suppliers can be added on that particular tab i SINERGISE 26 TopoCheck User s Manual Gp SINERGISE 3 4 5 Mandatory fields are labelled in blue while optional fields are shown in black The user must always enter or select a value for a mandatory field If he does not then an error is given during the data validation phase Metadata Data Description Data Extent Date Access Da Title Alternative Title Figure 19 Example of Add Button and Mandatory Fields Field values may be controlled by the use of a drop down list Here the user selects an option from a range of permissible values e g from ISO standards or other This is often combined with the use of the Add button Figure 18 to enable the user to choose more than one value from the list Metadata Data Description Data Extent Data Access Data Supplier Data Quality Em a Data Access Use Constraints Figure 20 Example of Drop Down List Some GUls are nested within others The Data Quality GUI is shown in Figure 21 When the Edit button is
15. SO _3166 2 svt_preset_codeslist xml is javadbf 0 4 0 cSVT 1 jar is jts 1 8 0 cSVT 2 jar E LGPL_2 1 b l metaeditor jar i metaeditor_ext jar C NOTICE txt __ ojdbc_license txt is ojdbcl4_g 10 2 0 4 jar 1 run TopoCheck hi memory bat S run TopoCheck bat lai swingx 0 9 3 jar Figure 1 All files in TopoCheck ZIP package The program expects Java 6 to be installed on the user s machine It is run by double clicking the run TopoCheck bat file Alternatively you may set up a shortcut to this file and use that to start the program Either method brings up a command line window Figure 2 which has some background information and should not be closed This then launches TopoCheck graphical user interface GUI When running the program on a computer with sufficient memory it can be started with run TopoCheck_hi_memory bat file Running in hi memory mode will use up to 1 GB of computer memory and improve performance of the validation procedures Z SINERGISE TopoCheck User s Manual D SINERGISE e eS D sSinergise coUT STopoCheck u1 4 1 16 EuvaluationCopy java Desvt gaps fast IRUE Amxol2m AA Sof tRef LAUPOlicyMSPerMB 10006008066 K 4 4luausActAsServerClassMachinls le cp c UT jar jts 1 8 8 c3UI 2 jar javadbf 6 4 8 cSUT 1 jar fastutil 5 cSuUT 1 jar swingx 6 9 3 jar ojdbc14_g_10 2 60 4 jar metaeditor jar metaed itor_ext jar spire csut CSUTGui 455ME te
16. Wot assessed description Not assessed 76 instances found during mining gt hs te Gp SINERGISE 39 TopoCheck User s Manual 9 SUMMARY RESULTS TAB On running TopoCheck validation summary results are output to the DOS window if Verbose Mode checkbox is selected and a new tab Summary is added alongside the Dataset Vectors and Attributes tabs The Summary consists of three main sections e Attribute validation according to the attribute parameters specified e Geometry validation according to the input geometry parameters and e Summary QA metrics including the number of geometries vertices total circumference and area if relevant for point or line dataset this is omitted An example of the summary output is shown in Figure 33 Validation Summary for the SSSI dataset It displays the timestamp of the validation number of failures red square with a cross and warnings yellow triangle with an exclamation mark for individual check as well as the total count of anomalies If there were no mandatory failures and a zip package was prepared this is also noted in the GUI The results are shown automatically after the program has been run and are stored as part of TopoCheck data to be reviewed later If the dataset has changed since the last validation a warning is displayed to notify the user that the summary might be outdated All results are also saved in one XML output file which is
17. an the entire feature 114 Empty Parts Similar to null geometry One geometry in a multipart feature is Pass empty 115 Near Points A very short distance between two points Pass 116 Gaps Large areas holes not covered by any polygon Error in coverage Pass features where complete coverage of land is desired We Invalid Invalid coordinate numeric value NaN or Infinity Pass coordinate 118 Topologically Feature has an invalid topology NESTED_SHELLS Pass Invalid Feature DISCONNECTED_INTERIOR 119 Length of a linear feature is smaller than a specified length Pass Short Line 33 TopoCheck User s Manual D SINERGISE 8 ATTRIBUTE TAB ATTRIBUTE CHECKS The attributes of any particular dataset can be seen by e Clicking on the relevant dataset e Clicking on the Attributes tab e Scrolling up down to see the mined attribute values A typical interface is shown in Figure 25 There are three options above the list of attributes a Check Attributes checkbox a Perform Data Mining button and Primary key definition If Check Attributes is ticked off then attribute data checking will not be carried out during data validation B AiriDULES V Check Attributes Primary key ROW ID Area_SQM_S Number Length 33 Decimals 16 Mandatory E Unique E Alias Description Domain Range Min val Max val Domain Codes List lt None gt hd P Area SQM_R Number Length 33
18. aset s projection information indicates that the data is stored in a geographic coordinate reference system lat lon or in a system with units other than metres the parameters are still input in metres but are internally converted to appropriate units degrees or similar The geometric checks themselves are always performed in the datasets original coordinate systems without applying projections or unit conversions 30 TopoCheck User s Manual Wp SINERGISE Table 2 Parameters for Geometric Tests Check Vector Data If ticked on then vector tests will be run on this dataset when the Check Selected or Check All buttons are pressed Kick Back Angle The angle in degrees defined within the kick back as defined in Appendix A degrees The default is 5 but has a range between 0 1 and 55 Kick back Distance The length of the kick back in metres metres The default is 1 0 but has a range between 0 0001 15000 0 Spike Angle Min The minimum spike angle in degrees i e the angle below which a spike is degrees detected regardless of the length of adjacent line segments The default is 5 but has a range between 0 1 30 Spike Angle Max The maximum spike angle in degrees i e the angle below which a spike is degrees detected if the distance of the spike is less than specified The default is 55 but has a range between 0 1 90 RSS ga gg a Spike Distance The maximum length of the spike
19. ay gt item names LABEL alassa descoptions types C mandatory false lengths 140 decimslse 0 domainkim domantaxcs gt tom name HYPERLINK ahas dascription type C mandatern false length 16 decimals 0 domamnhin domamMax js lt attrSettngs gt Settings Fi gure 37 All the geometric and attribute parameters used by Topo Check tool are saved in this file 10 4Results Summaries OVI_Results xml sVi_Kesults ntml SVi_Results Shorr ht ml Summary XML and HTML files will be generated even if the testing fails and results are not packed to a zip file The report will be generated after every validation run irrespective of pass or fail The output file name will be prefixed with the dataset name An example of the output HTML is show in Figure 40 GG SINERGISE 43 TopoCheck User s Manual 11 PACKAGING TO ZIP Once TopoCheck tool has been run on a dataset and as long as no mandatory fails have been identified all relevant shapefiles code lists settings files and results are packaged into one compressed zip file for that particular dataset The zip file is not generated if either the geometry or attribute validation checks are not carried out In other words both geometry and attribute validation need to be carried out with no mandatory fails for the zip file to be generated Similarly the zip file will only be created if there are no standard failures which have to be fixed accordi
20. ch conform to the dataset As there are many options available in the GUI running batch mode will not be very useful unless there are repeated runs of similar files G002 TopoCheck performs a series of geometric tests on the input dataset s The tests are listed and described in the SPIRE Data Standard document SIP DP 011 SPIRE Data Standard v1 0 1 It also performs some TopoCheck specific tests these have error codes greater than 115 G003 TopoCheck validates the geometry based on a set of tolerances and projection parameters in line with the paper SPIRE Data Standards Implementation Rules Tolerance and Parameters v0 7 0 These tolerances can be changed and set by the user via TopoCheck user interface G004 The tolerances and parameters for a particular dataset may also be provided as input to TopoCheck in an XML file G005 The tolerances and parameters for a particular dataset may be saved into the afore mentioned XML file for re use G006 The relevant coordinate system and projection for each input file is read from the input dataset e g associated prj file for shapefile or spatial index for Oracle table and TopoCheck allows the appropriate tolerances and parameters to be input only in metres using the information in the prj file to convert to dataset units G007 TopoCheck outputs a shapefile showing the location type and description of each error found G008 TopoCheck also outputs a resu
21. d Parameters If you select the Browse option then you are asked to select an existing metadata file XML extension using the normal directory file selection GUI Once this metadata file has been loaded it is displayed as shown in Figure 15 with three buttons to enable the following actions e Openand Edit MetaData Document This opens the MetaData Editor see Chapter 6 to enable the user to view and edit existing metadata for the selected dataset e Update MetaData with Current Dataset Properties This option updates metadata by using properties of the currently loaded dataset e g projection and extent information A PRJ file must be present in order for the projection information to be read and data extent is only updated if the units of the dataset are geographic latitude longitude e Remove MetaData Document Reference This removes the currently loaded metadata document and the GUI returns to the state shown in Figure 14 Metadata File Flacq_buildings_090909 shpxml x Figure 15 Metadata Options on a Selected Metadata File Gp SINERGISE 22 TopoCheck User s Manual The Edit IF and Update ns both open the MetaData Editor which is described more fully in Chapter 6 Metadata Tab Dataset metadata CRS is mined from the projection information prj provided in the shapefile or from SRID defined in the Oracle spatial index If none is available a CRS of lt None gt is reported The Alternate Title Version a
22. d X button edited the pencil button or set to a predefined value green arrow using the buttons displayed to the right of the code list name 4 List of codes for Landuse_RA RAI BAL AUTO GEN Code Label Description 1 300 meadows and pastures 1300 0 ued instances found during mining 1 100 srable land 11000 1206 06 instances found 5 instances found during mining O O O O OOOO 1 211 vineyards 1271 0 303 instances found during mining 3 000 buildings and similar 3000 0 608 instances found dunng mining 1 222 ekst Orchards 1222 0 22 0 435 in instances found during mining 1600 0 10 instances found during mining a 4 500 pees chier SAME and forest hedges 1500 0 292 instances found during mining a 1 410 owergrown areas 1410 0 229 instances found during mining 7 000 hydrology 7000 0 212 instances found during mining 1 240 other permanent crops 1240 0 19 instances found dunng mining __2 000forest___ 2000 0 349 instances found during mining 1 190 green houses __1190 0 28 instances found during mining _ ee fa 1221intens Orchards 7 800 agriculture land with trees 1800 0 4 instances found during mining OOOO ining 1 160 hop fields 1160 0 instances found during mining Gan Gena Figure 31 Code list editing dialog Md Browse None Autogenerated 150 3166 1 150 3166 2 150 639 2 Fi gure 32 Code list selection menu 38 TopoCheck User s Manual
23. e Contact email Jataset Information Spire Dataset ID Geographical Extent Name Land use Coordinate Reference System Version Representation Type Version Date 2010 01 26 No of Features Filename _anduse shp No of Parts No of Vertices Total Area Total Perimeter Figure 40 The generated HIML report 46
24. e Validate This allows the user to validate all metadata values which he has entered and specifically to check that all mandatory fields have been filled in The user is then directed one by one through all mandatory fields which do not have a value and asked to provide one As already mentioned each of the six metadata tabs opens a different GUI for inputting editing metadata information These GUIs are to a certain extent self explanatory but some important generic comments about their behaviour and design are presented below 1 Add button to enable user to add more than one value for a field For example when the Add button is pressed after the Alternative Title field another data input field is opened to allow the user to add another data title in this case Test Dataset 3 Once this is added a Delete button enables this entry to be removed 2 Certain Add buttons refer to combined fields rather than individual ones For example on the Vertical Extent Information on the Data Extent tab the Add button allows the user to add a combination of any or all of Minimum Value Maximum Value Unit of Measure Vertical datum ig MersDans Ei a E ori Swe mise wot met ic rate Motadate Daja Cenarion Data Extent Cote Acumen Cake Seamer Dada Ghadir Data Extent r Spee AAEE Daar Laru Eat Bora regie Perth board intron Dih te arr La Este uo de D AL
25. ed by tables not views or synonyms that have a non composite primary key constraint and a spatial index on the geometry column If a database connection is lost during scanning analyzing or validation a dialog will be displayed counting down to retry connecting After ten failed attempts to re connect the application will wait for user input to retry or cancel the process TopoCheck User s Manual 4 2 Data Mining The first time a dataset is opened in TopoCheck the user is presented with an option to perform data mining Figure 8 The data mining procedure automatically determines the following properties of an attribute e Field properties name data type length and decimals e Domain boundaries by finding the minimum and maximum values e Domain code list if the field contains less than 100 unique values these are saved as the field s code list e Uniqueness when all field values are distinct e Obligation when none of the field values are empty the Mandatory property of an attribute is set to true Mining can be performed all non attributed dataset at once Clearly the first time the user uses TopoCheck there is considerable advantage in mining the data The mined parameters will be saved between runs in the directory where the data was placed If any datasets are updated in that data source the user can use previously stored mined parameters to check the updated dataset against so n
26. ed results file in html format e Supporting CSS cascading style sheet files and images Sinergise logos for html documents Because there were no geometry errors according to the parameters set in this case either fatal or not no error shapefiles or associated dbf files are included in the zip package Normally they would be as the example for the 3mile nautical limit dataset shows in Figure 39 Landuse cSVT_Results xml Landuse cSVT_Results html e Landuse cSVT_Results Short html _ html_report_sinergise_evaluation css Mi sinergise_bg_EC png SA sinergise_head_bg png Sa Sinergise_logo png Landuse_attribute_errors dbf Landuse_vector_errors dbf _ Landuse_vector_errors shp _ Landuse_vector_errors shx Landuse cSVT_validation_summary xml Landuse_RABA_ID_AUTO GENERATED svt_codeslist xml Landuse_STATUS_AUTO GENERATED svt_codeslist xml Landuse_VIR_AUTO GENERATED svt_codeslist xml Landuse svt_settings xml Figure 39 Contents of TopoUheck output file with errors in geometry Part of the shortened results file for a dataset is shown in Figure 40 All geometric and attribute errors non fatal ones as well as all validation parameters are listed in the output HTML document 45 TopoCheck User s Manual Wp SINERGISE Report Date 2010 11 1 39 Contact Name Test Duration PT00 01 Organisation Name SARCELLES TopoCheck v1 01 17 Address I i City County Post Cod
27. eed to be careful not to re mine the data as it will over write populated parameters from previous versions LA TapeCheck wLOL16 EVALUATION COPY Perform data mining Do you want to perform data mining on following layers Flacq_buildings_090909 datasets If the mining option is chosen a progress dialog is shown that goes through the mining of each dataset specified Figure 9 The attribution parameters for older versions of the datasets assuming the names have not changed are over written Note attribute mining can be carried out later in the Attributes tab After data source selection and the optional data mining the datasets in the selected directory are displayed in the Datasets section of the user interface Figure 8 Initial data mining dialog for new Figure 9 Data mining progress dialog i SINERGISE TopoCheck User s Manual 43 The Datasets Listing All datasets provided by the selected data source are added to the Datasets listing on the left hand side of the interface as shown above The list displays the title of the dataset or the name of the dataset if title is not available displayed in italic Clicking in the list selects a dataset for running TopoCheck tool and setting its Geometric and Attribution parameters The selected dataset s title is displayed as the Selected Dataset in the upper section of the GUL It is also highlighted in the list There are four buttons at the top o
28. er All values entered if saved are retrieved each time the dataset is selected For numeric and date fields there are two text boxes to view set minimum and maximum values for Domain Range These values are automatically filled in for the selected dataset upon data mining By changing the minimum and or maximum values acceptable for a numeric field TopoCheck tool then reports any records which fail this domain range check A fields values can be constrained to a Domain Code List Area_SQM_5 Number Length 33 Decimals 16 Mandatory Ei Unique W Alias Description Domain Range Min val Max val Domain Codes List ISO 3166 1 xE Fi gure 26 User interface for setting an individual attribute s parameters D SINERGISE 35 TopoCheck User s Manual Z SINERGISE After running the validation the results of the attribute checks listed in are summarised on screen if Verbose Mode is checked or in more detail in a dbf file _attribute_errors dbf If any of the dataset attribute fields contains an Oracle reserved word or if an incompatible attribution file was loaded for a dataset then no further checks will be possible on that Such a dataset is symbolised by a red warning icon in the Dataset sub panel and the problematic attribute is shown with a red ERROR warning in the Attributes sub panel Figure 27 LES LE LE lt UNKNOWN gt romsar rh LE he Et are W sec null Unknown 0 u
29. es 1 SIP DP 011 SPIRE Data Standard v1 0 2 SPIRE Data Standards Implementation Rules Tolerance and Parameters v0 7 3 Description of geometry errors and descriptions set of HTML and GIF files 2 BACKGROUND AND REQUIREMENTS Topocheck is an advanced and sophisticated development that has been designed to assist data providers and other users to test their data against a set of standards It is built to include the requirements listed in this section 2 1 Non functional requirements TopoCheck is a Java based program that has been implemented as a standalone application NF001 TopoCheck is freely redistributable and will run on the following platforms with the appropriate Java 6 run time environment NF002 e Windows 2000 e Windows XP Standard or Professional e Windows Vista e Unix e AIX e Linux TopoCheck is capable of processing files that contain a large number of features with complex geometry within an acceptable timeframe Processing time varies considerably between datasets depending on number of vertices and the topology of the dataset NF005 Z SINERGISE TopoCheck User s Manual 2 2 Geometry Validation Currently TopoCheck only works with input in the form of ESRI shapefiles G001 or with tables from Oracle database D001 TopoCheck can be run either interactively from a supplied GUI or in batch mode However batch mode only works on those datasets with settings provided whi
30. eters include e A Settings File that is associated with the dataset which could be a mined one e CRS Coordinate Reference System e Title e Alternate title e Version and Date e Contact details of the data provider including Organisation Address City County Postcode and Email address e Users may also specify a version and a date for the dataset Data Source C Users Marko D Selected Dataset Land use Dataset name Landuse Wh LPIS Parcels Settings File Landuse svt_settings xml Browse Metadata File lt None gt Gi Browse CRS lt None gt Title Land use Alternate Title Version and Date 4 2010 01 26 Contact Details Contact Name GERK Support Center Organisation Ministry for agriculture forestry and food Address Dunajska cesta 22 City Ljubljana County Ljubljana E PostCode 1000 Email Figure 13 Dataset information tab TopoCheck User s Manual The Settings File can be selected by using the Browse button and the normal directory file selection GUI The Metadata File and Parameters can be selected by using the Browse button Jto look at pre defined metadata or the New button to create a new metadata file Chapter 6 gives a fuller explanation of metadata entry and options BEIER Dataset name Flacq_buildings_090909 Settings File lt None gt Metadata File lt None gt Figure 14 Metadata File an
31. existing result files This option if ticked on will allow you to overwrite the existing result files on off should you run the tool on the same dataset again If you do not select this and previous results exist in the specified directory an error warning is given Existing files are not overwritten unless the user specifically requests it TopoCheck User s Manual Wp SINERGISE The results of this geometry check are summarised on screen or in more detail as a point shapefile vector errors shp where the location of each error is displayed and its type is denoted by an attribute These shapefiles have to be viewed and represented in your standard GIS desktop tools Each point has five attributes the first two FID and Shape being default shapefile attributes he three important attributes are e FEATURE in the form of lt FEATURE gt lt PART gt lt VERTEX gt eg 3122 2 5 he first number before is feature id number after the is part number and the number after the is the vertex number to which the error applies Some errors apply only to whole geometries so the part number and vertex number are omitted If an error applies to more than one geometry identifiers of geometries are joined with character Some errors do not apply to any geometry e g Gap detected in which case the FEATURE field is empty Note that due to automatic corrections of the feature geometries in case of invalid topology
32. f the Datasets sub panel which have active tooltips associated with them Figure 7 The first two green arrow buttons run the validation programs for geometric and attribute errors using the geometric and attribute parameters set in the Vectors and Attributes tabs The first option Check Selected runs the validation tool on only the dataset selected highlighted in the Datasets selection sub panel The second option Check All runs the tool on all the datasets listed in the Datasets sub panel Dataset E Flacq_buildings_090909 M Fiaca_seeds_090909 Fi gure 10 Datasets in the selected directory structure are listed in the Datasets listing After clicking either of first two buttons a validation progrees dialog window is open Figure 11 This may take a few seconds or minutes depending on size of datasets Figure 11 Validation progress dialog Wp SINERGISE TopoCheck User s Manual Wp SINERGISE The remaining two buttons enable saving the geometry and attribute parameters for a dataset into an external XML file This file may be retrieved whenever that dataset is re loaded into TopoCheck toolbox The first button Save Selected enables you to save parameters for the selected dataset only while the second option Save All saves parameters for all the datasets listed in the Datasets sub panel Check Selected and Check All buttons also save the parameters before running validation same as Save buttons B
33. g rectangle MBR total number of features and parts and total number of vertices This is compiled into the standard output file XML that can then be read and used on the load side to help verify that the data has loaded properly The metrics can also be viewed using the Summary tab in TopoCheck T001 For mandatory passes opoCheck tool packages the data for delivery into a single compressed zip file along with TopoCheck results and metrics in an XML file This does not happen if there are mandatory fails in the data T002 When a dataset is an Oracle table the data itself is not packed only results of validation TopoCheck User s Manual TopoCheck saves the application settings for each dataset along with the attribute look up table and any results and metrics files generated T004 New versions of the dataset with the same name will inherit the application settings of previous versions If users want to keep separate settings for each version they need to amend the dataset name to be different each time T005 D SINERGISE TopoCheck User s Manual 3 PROGRAM INITIATION All the files required except the Java 6 runtime libraries to run TopoCheck are included in the zip file Simply extract them to a suitable directory and you should see the files listed as in Figure 1 app_settings xml ls cSVT jar i fastutil 5 cSVT 1 jar ISO 639 2 svt_preset_codeslist xml IS0_3166 1 svt_preset_codeslist xml I
34. g will be displayed Figure 6 blocking all user actions In case of failing to connect to the database an error message dialog will be displayed reporting the cause of failure in which case the user should check if the connection parameters are correct and if the database server is accessible from his her location a r D Scanning connection for available datasets b Fi gure 6 Progress dialog displayed while scanning the database TopoCheck User s Manual When the scanning process is completed the progress dialog will close and the Datasets tab will be enabled and selected The left side of the panel lists available datasets found by the scanning process and the right side lists datasets selected for use For the data source configuration to be valid at least one dataset must be selected Four arrow buttons between the lists are used to select and deselect datasets Selecting or removing datasets from the working list can be also done later on existing data source configurations The procedure is the same as when creating a new configuration When the data source configuration is finished it can be saved for later use by clicking the Save button Saving the connection will validate if first and an error message will be displayed in case of invalid parameters If a configuration with the same name already exists this is also the case when editing an existing configuration the user will be prompted to confi
35. he usual operating system file directory selection interface The directory path used in any previous run is loaded as default Click the Open button to load all shapefiles in the selected directory location and all of its sub directories TopoCheck User s Manual Gp SINERGISE 4 1 2 SELECTING ORACLE DB CONNECTION Click on the Connection button to open the dialog Figure 4 for selecting or configuring data source connection 4 New Set aa comei T URL jdbc orade thin 192 168 2 18C Username username 1 Password TELLIT V Save Password Directory for results p jresults_folder Fi gure 4 Dialog for conf iguring and selecting data source connections Left side of the dialog lists all configurations saved by the user Clicking the list populates the fields on the right side with configuration values Connection configuration consists of the following items e Connection Name user specified name to identify the connection in the list e URL Specifies location of the database Clicking the Construct button will open a dialog Figure 5 that will help constructing the URL with specified connection parameters Hostname The host name where Oracle server is running Port The port number where Oracle is listening for connection Default is 1521 SID System ID of the Oracle server database instance While typing in the URL parameters the URL value wil
36. in metres only used when the angle is metres greater than minimum spike angle The default is 5m but has a range between 0 0001 15000m a RR SSRA Minimum Polygon Area The minimum size in square metres square metres The default is 10 square m but has a range between 0 00001 10000000 square m EE Minimum Segment Length metres The minimum length of a line segment in metres The default is 0 05m but has a range between 0 00001 10000000m Maximum Sliver Area The maximum size of a sliver in square metres The default is 5 square m but square metres has a range between 0 00001 10 000 000 000 square m a R Minimum Line Length The minimum length of a line in metres metres The default is 0 004m but has a range between 0 00001 10000000m ea a 9 ee ed Minimum Point Distance The minimum distance between 2 consecutive points in a linear or polygon metres shapefile in metres The default is 0 004m but has a range between 0 0001 10000000m RE Grid Size The snapping grid size in metres which will round all coordinates in the metres dataset to a specified value prior to processing Default is 0 0 which will cause no changes to the input coordinates Check for gaps and slivers If ticked on test for gaps and slivers will be performed otherwise this test on off will be skipped Verbose mode This option if ticked on will show progress in the DOS window on off Overwrite
37. l be updated automatically On pressing the OK button this value will be transferred into the URL field of the configuration dialog TopoCheck User s Manual Wp SINERGISE e Username and Password The Oracle server login username and password to use Ticking the Save Password checkbox will save the password in the configuration file e Directory for results Folder where validation results for all datasets in this data source will be placed Clicking the Browse opens the usual operating system directory selection interface _4 Construct Connection URL s a ms Hostname 192 168 2 180 Port 1521 GIS 1 idbc orade thin 192 168 2 180 1521 GIS1 KET Figure 5 Dialog for construction connection URL When creating a new data source configuration the user must select datasets for validation This requires connecting to database by clicking the Connect button which will start the database scanning process that will scan all tables views and synonyms in the user schema to find those that have a Geometry column and can therefore be used as a dataset for validation in TopoCheck If a table with more than one Geometry column is found the tool will split this table into more datasets each containing one of the Geometry fields and all other attribute fields Duration of the scanning process depends on the number of tables in the user schema During the process an indeterminate progress dialo
38. lts summary table in XML format containing the error location and descriptions as GML tags within the XML file G009 D SINERGISE TopoCheck User s Manual The XML file is provided alongside an HTML report that is consistent with the format of the previously distributed ESRI based SVT s output HTML reports G010 2 3 Attribute Validation An input attribute lookup table as described in SIP DP 011 SPIRE Data Standard v1 0 1 is available as part of the input in XML format A001 The attribute lookup table includes a description of any domains used with associated domain code lists and values detailed A002 The attribute lookup table also includes a mapping of short field names to long field names to accommodate the input of shapefile format A003 This attribute lookup table is read by the application and made visible to the user via the user interface where the user can edit the contents of this file A004 If this input table is not available or if the user selects this option then the application will mine the input dataset for the user and present the results via the same element of the user interface with the edit options and the ability to save for future use If the user is updating the dataset it is not expected that he will mine the data each time A005 TopoCheck carries out a series of attribute validation checks as described in SIP DP 011 SPIRE Data Standard v1 0 A006 If a user marks
39. nd all Contact Details are effectively freeform text fields with no validation Obviously as the user adds all these details he should save them regularly The saved parameters are retrieved whenever that dataset is selected again i SINERGISE 23 TopoCheck User s Manual D SINERGISE 6 DATASET METADATA EDITOR The metadata attached to a dataset is a considerable requirement Under accepted and emerging ISO standards metadata has several aspects On the main GUI when you click the B rowse button after Metadata File or the Edit and U pdate buttons on a previously selected metadata file you are presented with the following Metadata Editor Ce Cie Simm Geot el vate Metadata Data Descrpton Data Extent Data Access Data Suppter Data Quai Metadata Date of Update of Metadata Day Month Maisdsts Standard Hame Metedats Standard Version Frequency of Update Figure 16 Metadata Editor The Metadata Editor allows the user to create import edit and save various parameters relating to the metadata of the selected dataset There are five control buttons New Save Import Export and Validate which relate to metadata actions for the selected dataset There are also six tabs which relate to different pages or metadata categories for the dataset These include Metadata Data Description Data Extent Data Access Data Supplier and Data Quality 24 TopoCheck User
40. ng to the SPIRE data standard e g no unclosed polygons or no attributes exceeding set domains etc As an example TopoCheck tool was run on the Land use shapefile dataset Landuse shp and no mandatory fails were reported for either the geometry or attribute checks A zip file called Landuse svt_results_2010 10 22 zip was then created its contents are listed in Figure 38 Note that the current date is added to the end of the zip file name As there were no geometry errors no geometry error shapefile has been created or packaged Landuse cSVT_Results xml o Landuse cSVT_Results html Landuse cSVT_Results_Short htm html_report_sinergise_evaluation css SA sinergise_bg_EC png 5a sinergise_head_bg png Sa Sinergise_logo png __ Landuse_attribute_errors dbf Landuse cSVT_validation_summary xml Landuse_RABA_ID_AUTO GENERATED svt_codeslist xml Landuse_STATUS_ AUTO GENERATED svt_codeslist xml Landuse_VIR_AUTO GENERATED svt_codeslist xml Figure 38 Contents of TopoCheck output zip file without vector errors Wp SINERGISE 44 TopoCheck User s Manual i SINERGISE Files packaged in the zip include e The original shapefile not present when validating Oracle datasets e Any auto generated domain code lists in xml format e Settings file svt_settings xml which includes all dataset geometry and attribute parameters used during validation e Validation reports in both xml and html format e Shorten
41. ntisniss nis tlsegak doesnot tins casagelebnicntssh oideetesiaht 22 Figure 15 Metadata Options on a Selected Metadata File cesasssssssesessssesesonseesesenesessussassneesesssseussuesise 22 Pe TONET a E 116 ge enema eT er emo MrT ct Te ene inten E E E mn Ben oer err oe mY rete rea 24 mowe FM CD US 0 0 E 25 Figure 18 Example of Add for multiple fields Vertical Extent Information on the Data Extent tab 26 Figure 19 Example Or Add Button and Mandatory BIOS names J7 mowe 20 Pamp oi Drop Down Lirska ia ae ant 27 OS ER a a a a ot 27 PIGS 22 gt COP DIS n es CO MAISON GU dame intercalated 28 ue 2 Cote OS ae TE encn nena ete REE 29 Figure 24 Error shapefile represented appropriately and examined in ArcGIS desktop tools 32 POUA Ar e an D eega O Sy ute nn ane Pere mE ne Oe ene reer eee 34 Figure 26 User interface for setting an individual attribute s parameters nur 3 Figure 27 Attribute errors are displayed below the attribute s properties se 36 Figure 28 Selecting unique field as I PTII T nn nn annees 37 Figure 29 Error when dataset has no feature identifier urnes 37 Figure 30 The code list can be disabled by clicking the red X button edited the pencil button or set to a predefined value green arrow using the buttons displayed to the right of the code E et EAE AA EEE EAE E AEA AE AEA E EAEE 38 es CO AE EEA E EE 38 CNS 2 COUR ESSOR ne te ai aai 38 FOIS 33 vahdati ITNA nan ce nee ae one io en 41 HOW 24 Doman kange ENO casse
42. oth the Check all and Save all buttons are disabled if any of the listed datasets has errors i e is highlighted red Lb he CE La Fi gure 12 Buttons for running validation and saving datasets Any dataset that has Oracle reserved words in the attribute names is highlighted red and cannot be checked further until the issues are resolved Datasets that do not conform to the provided settings XML ice fields that are different to those in the settings in terms of field order presence name type length and number of decimals are also highlighted red and cannot be processed further If a user has kept the same dataset name but has changed the schema then he she should override the older inherited settings by performing data mining on the invalid dataset Datasets with no primary key assigned cannot be processed until one of its unique attribute fields is defined as a primary key see Section 8 1 If multiple geometry types e g points and polygons are found in a dataset it is considered invalid The Datasets section of the interface may be widened if required by moving the mouse over the dividing line on the right hand side of the list When it turns into a double sided arrow click and drag to enlarge the section 20 TopoCheck User s Manual Gp SINERGISE 5 DATASET TAB OVERALL DATASET PARAMETERS The Dataset tab allows the user to set various parameters relating to the selected dataset These param
43. rm overwriting an existing configuration Connection Datasets Available datasets Datasets to use IDKN_SDO A CSVT_12MILE CSVT_LNR D CSUT 12MILE PROJECT CSVT_NNR z EX ICSYT_AGREEMENT CSVT_5AC CSVT_RAMSAR ICSVT_SITEUNIT OBODI_SISTEM CSY T_SUBSURFACE INFRASTRUKTURA LINIJE is INFRASTRUKTURA TOCKE EE ua svt sus Save Fi gure 7 Working datasets selection tab To delete a configuration from the list of saved configurations load it first by selecting it in the list and then clicking the Delete button Deleting an unsaved configuration will have no effect When satisfied with the data source configuration the user will confirm the selection by clicking the OK button Clicking the Cancel button exits the dialog without selecting a data source After selecting an Oracle data source the tool will analyze all datasets to determine their properties last modification time number of records constraints and projection format During this process an indeterminate progress dialog will be displayed similar to one in Figure 6 Duration of the i SINERGISE TopoCheck User s Manual Gp SINERGISE analysis process depends on the number of datasets and their size When finished the Datasets list on the main GUI panel will be populated with datasets from the selected data source TopoCheck validation processes on Oracle datasets will perform significantly better when datasets are represent
44. rror type here Domain Range and a short description of why an error has occurred HW Attributes of els defra attribute errors EE Cress NAGE See DR 141 AREA 77 0 Pn RANG Value out of domain range oe 34 Domain Range Error Example 2 Domain Value Error In this example Figure 35 one of the values of the Name field Hurst Castle amp Lymington River Estuary does not appear in the Domain Code List Hi Attributes of sesi_attribule errors ja not in Coches Bel si NAME AUTO GENERATED Fi gure 35 Domain code list error 10 2 Geometry vector_errors shp point shapefile showing the location of each geometric error in the dataset More information on these errors is shown in the associated dbf file e g vector_errors dbf Each error is classified according to type and these include orientation gap short segment sliver Wp SINERGISE 42 TopoCheck User s Manual and topology In addition some types of error i e short segment topology also show the IDs of the features which are affected ES Attributes of sssi vector errors low FEATURE TYPE MESSAGE Op s7 t57 SHORT_SEGMENT Segment too short 0 03996655483951 047 __ 11928 TOPOLOGY Nested shels 218488141021 OVERLAP Intersection detected 313795013079 OVERLAP Possible intersection detected 4 GAP Gap detected area is 13323 014112104953 BL 5 SLIVER Sliver detected area is 0 0159496281 1213
45. s Manual i SINERGISE The metadata actions are described below e New This option creates a new empty metadata file which opens the Metadata tab and by default adds the current date The user can then use the other tabs e g Data Extent Data Quality to add further metadata information e Save This allows the user to save his metadata file to a specified directory location If the data has not been validated see below then the user is asked if he would like it to be validated before saving e Import This allows the user to import an existing metadata file When this is done all metadata elements on all six tabs are filled in from information residing in the imported XML file e Export This allows the user to export all existing metadata settings to a new metadata file If the metadata elements have passed validation see below then the user is asked to enter a name and location for the new output file In addition he has the option of setting the export format to either ISO 19139 or UK Gemini If any of the metadata elements do not pass validation then the user is informed of this then asked if he would like to export anyway If he responds No to this question he is then directed through the whole data validation process described below Look in exports gt Recent Tiems File name Network Files of type ML Document Figure 17 MetaData Export 25 TopoCheck User s Manual
46. t the same This means that the feature cannot be closed 103 Internal Requirement for the internal polygon and the external polygon to Pass Polygons with have the order of nodes or vertices in a specific rotation direction Incorrect The external polygon should be clockwise and the internal polygon Rotation should be counter clockwise 104 Duplicated A point that duplicates exactly the same X Y coordinates as another Pass Points point i a ne 105 Kick Backs Digitising error leading to an inconsistency in the line Pass RC SU ae een ee 106 Spikes Digitising error leading to a spike inconsistency in the line Similar to Pass kick backs 107 Small Areas A polygon feature should not be less than a specified area Pass 108 Slivers Very small gaps between the boundaries of adjacent polygon Pass features 109 Overlapping An overlap of one polygon or line feature onto another Pass Polygons 110 Duplicate A feature that duplicates exactly the same geometry and attribution Pass Features as another feature 111 Short Segments A very short distance between two nodes or vertices This distance is Pass specified and would be expected to be the same as the cluster tolerance on the dataset 1 12 Null Geometry No geometry is held against an attribute Table records with Null Pass Shape 113 Segment Similar to Ring Polygon rotation but at afiner granularity The Pass Orientation rotation between two nodes or vertices is checked rather th
47. tte sleet cates eddie anes ne ata bate 42 FOURS POI ES iain 1 6 eee nnn ett a a EEE nt mn nent tty er mre E eE Tritt ttt om 42 Figure 36 Example vector_errors dbf file associated With vector_errors shp file 43 Figure 37 All the geometric and attribute parameters used by TopoCheck tool are saved in this file 43 Figure 38 Contents of TopoCheck output zip file without vector errors re 44 Figure 39 Contents of TopoCheck output file with errors in geometry nent 45 Figure 40 The generated HTML report 46 TopoCheck User s Manual Z SINERGISE LIST OF TABLES Table 12 Data conformation to 50 standafdS nantaise 9 Table 2 Farameters for Geometric T SES aan tan 31 AS LEO OR tee ee ee 33 PO craton cae te eee erence eee ented 36 REFERENCED DOCUMENTS 1 Celostna grafi na podoba podjetja Sinergise FINAL Sinergise Corporate Identity Graphics Design Sinergise_CGP_screen pdf Adobe Caslon Pro Release Notes Adobe Systems Incorporated 2000 AdobeCaslonProReadme pdf 2 3 Myriad Pro Release Notes Adobe Systems Incorporated 2000 MyriadProReadme pdf TopoCheck User s Manual 1 DOCUMENTATION STANDARDS Please note that in all of this documentation the term error is used to describe a geometric or attribute anomaly It is not necessarily an error in the data as such it is a term used when one of the SPIRE data standard tests fails This document should be read in conjunction with the following referenc
Download Pdf Manuals
Related Search