Importing data to INTREPID (G03)
Contents
1. INTREPID User Manual Importing data to INTREPID G03 14 Library Help Top lt 4 Back gt Further things to consider During the import process you defined certain fields to be INTREPID Alias fields This tells INTREPID which fields are to be recognised as Fiducial Line X Y and so on If these fields are not defined as Alias fields during import you can define them as Alias fields after import This is easily done using the Project Manager Simply highlight the dataset name under the Project Manager Filename panel and select the Fields tab Current Aliases are displayed in the Alias column Select this column if you want to define a field as an Alias value INTREPID expects to see Aliases set for at least Linenumber X and Y Key points for this guided tour In this guided tour you have Used the Import tool to import some ASCII data and create an INTREPID Line dataset Used the Import Ascii Columns tool to import the same ASCII data and create an identical INTREPID Line dataset Gained some insight into how Alias and Group By concepts work in INTREPID Frequently Asked Questions Q I have a lot of files to import They all have a similar format Is there an easier way to do this A Yes The Import tool has batch options which make multiple file imports easy Q I have some data to import with a unusual column delimiter Can I import it A Yes The Import tool can handle a variety of non standard column delimiter2. Choose Apply INTREPID starts importing the data A progress bar tells you the state of the import process When the process is finished the message Import 2012 Intrepid Geophysics q Back gt INTREPID User Manual Importing data to INTREPID G03 12 Library Help Top 4 Back gt processing completed appears Choose OK Library Help Top 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 13 Library Help Top 4 Back gt 7 Change or confirm the X and Y alias assigments and the Datum and Projection of the dataset The GeoReference Vector dialog box appears Check that the X and Y aliases and the Datum and Projection information are correct This information can either be set here or can be provided from the DDF For this exercise the information was provided from the DDF Observe that when you choose the X Y Projection and Datum buttons a list of options appears For this exercise you don t need to change anything so choose Cancel to dismiss each list Geo Reference Yector w Xgda 4mga55 i Ygda 4mga55 Projection MGA55 __Datum GDA34 OK Cancel 8 Exit from the tool To exit from the Import tool choose Quit from the File menu 9 Use the INTREPID Project Manager to examine the dataset you have created 10 Move to the next exercise the Import Ascii Columns wizard Library Help Top 2012 Intrepid Geophysics 4 Back gt
3. lt 4 Back gt INTREPID User Manual Importing data to INTREPID G03 5 Library Help Top lt 4 Back gt The Ascii Import Wizard has determined that your data has records that end with newlines A GDF compliant DFN file was found and has been used to provide defaults for the Import Wizard Choose the file type that best describes your data Delimited Characters such as commas or tabs separate each field Fixed width Fields are aligned in columns with or without spaces between each field Header Records To Skip Library Help Top 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 6 Library Help Top Library Help Top lt 4 Back gt 3 Check original data type Check whether the original data type is set correctly The options are either Delimited or Fixed width For this exercise the data is Fixed Width so the default selection is OK Read the message at the top of the Import Ascii Columns main window INTREPID has determined that the input data is in a special ASCII format called ASEG GDEF2 format This is a data exchange standard which is well suited to airborne geophysical survey line data INTREPID automatically finds and use the alburydata dfn file to provide naming and formatting information for the data columns Choose Next to continue Change or confirm data field width settings This Import Ascii Columns window enables you to see
4. the Projection to be MGA55 When you have finished choose OK Y yodao4mqa55 Datum GDAS4 Projection MGASS m More Cancel In the Import Ascii Columns window select the ygda94mga55 column Check that the Alias for this column is set to Y and the Datum and Projection are set to GDA94 MGA55 Choose Next in the Import Ascii Columns window Specify the output dataset name Specify a name for the created dataset Choose Browse The INTREPID Open dialog box appears Type in a name for your dataset for example albury2 and choose Save As Proceed with the import Choose Finish in the Import Ascii Columns window INTREPID starts importing the data A progress bar tells you the state of the import process When the process is finished an Information box appears telling you that the data has been successfully imported The Import Ascii Columns tool creates a DDF of the format used in the import A copy of this is saved locally and in this case you will be prompted if you wish to overwrite the supplied DDF file Choose another name like alburydata2 ddf This is for your convenience should you wish to re import the data into INTREPID at a later date 10 Exit from the tool Choose OK to exit from the tool The generic import tool gives you access to a rich vein of exchange API supported formats These are designed to switch back and forth with commonly used formats from thridparty sources such as image proce
5. the file into the DDF editor From the File menu choose Load Data Description Format File and then choose From Current Directory The INTREPID Load Local DDF dialog box appears e Select the file alburydata ddf and choose Open When the DDF has imported it appears in the DDF editor Observe that the DDF can also store additional information such as e Undefined values e INTREPID Alias assignments INTREPID Datum and Projection assignments It also controls which fields are Group By fields defined at the bottom of the file e Choose OK to close the DDF editor File Options Help File C Intrepid V4 _ 5 sample_data guided_tours intrepi 10 20 30 40 50 12345678901234567890123456769012345676901234567690123456 1401351 1401351 1401351 1401351 1401351 140131 140131 1401351 1401351 970222 970222 970222 970222 970222 970222 970222 970222 970222 110792 110794 110796 110796 110600 110602 110604 110606 110606 59074 59074 59074 59074 59874 29874 29874 59874 598674 59263 59263 59263 59263 59263 29263 29263 39764 39764 MIMI BO BO A l A a 140131 _ TYPE LINE date 16 24 INTEGER 4 HMISSING 999 970222 110610 59074 39764 _ F Cancel Note the DDF editor has its own Help facility For more information on DDF refer to The INTREPID DDF format R08 At V5 0 we also support the GOOGLE protobuf syntax for DDF files Proceed with the import
6. to make this easy on import for both the general ASCII flat file case use the DDF or data description file and the ASCIIXYZ importer option header must have 6 componenets with XX YY ZZ XY YZ ZX in the names somewhere 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 2 Library Help Top Overview Library Help Top q Back gt Using INTREPID you can directly open read from and write to datasets in the following data storage formats INTREPID database DIR Geosoft database gdb ESRI shapes and MapInfo TAB files Oracle database PostgreSQL database ERMapper and INTREPID grid ers also gxf cdf zmap For all other formats you need to import the data and create a new INTREPID dataset INTREPID has two tools for importing data Import tool this versatile tool has many import options and can import data stored in a wide variety of formats Ascii Import Wizard this is specially designed for easy import of ASCII data and is similar in look and feel to the text file import feature of Microsoft Excel It has fewer options than the Import tool Location of sample data for Guided Tours We provide two complete sets of sample datasets one in INTREPID format and one in Geosoft format INTREPID works equally well with both formats When you want to open a dataset navigate to the directory containing the required data format Where insta
7. zip 19 02 2008 12 27 38 PM Dataset Resampler En f aves ig anomL_grid ers 27 03 2003 1 58 52 PM Bids EF cho6_1job 26 07 2012 4 27 24 PM E a algorithm a J bin EF cho7_1job 14 08 2008 11 23 42 AM i EF chog_1job 27 03 2003 1 38 52 PM i dasses BB contig EF chos _2 job 14 08 2008 11 23 42 AM a SA i EF chid_ijob 26 07 2012 4 27 24 PM fl credits a l F chii_2 job 25 07 2012 4 27 24 PM fe J dongledriver i fiters EF chi4_ijob 14 08 2008 11 23 42 AM h Bh font EF chi4_2 job 27 03 2003 1 38 52 PM 3 L EF chi4_3 job 27 03 2003 1 38 52 PM ioe EF chi4_4 job 27 03 2003 1 38 52 PM help I i images 148131 2 26 970222 53 116792 59574 63 59263 45 355 38 91 28 5 77888 485357 55 H Lernel 148131 2 26 978222 53 118794 59574 63 59263 54 355 38 91 38 9 77811 485354 97 ER 148131 2 26 978222 53 116796 59874 63 59263 63 355 48 91 49 0 77814 485352 06 nai lib 148131 2 26 970222 53 118795 59574 63 59263 71 355 48 51 58 9 77817 485349 14 fH db lut 148131 2 26 978222 53 116588 59574 63 59263 78 355 58 51 78 9 77819 485345 96 SAT braai 148131 2 26 970222 53 116582 59574 63 59263 87 355 58 91 72 9 77822 4853542 15 z 148131 2 26 970222 53 116584 59574 62 59263 95 355 58 51 58 9 77825 485339 23 E i manuals 148131 2 26 978272 53 118886 59574 62 59264 83 355 68 91 58 9 77528 485336 65 i i nut 148131 2 26 970222 53 1168588 59574 63 59264 18 355 68 51 58 5 77831 485333 14 Pop 148131 2 26 978222 53 116
8. 3 a3 ao uo 110792 110794 110796 110798 1108600 1108602 110604 110606 1108608 Cancel 398674 398674 390874 59874 59874 59874 398674 398674 539874 2012 Intrepid Geophysics 63 63 63 63 63 63 62 62 63 29263 3927635 29263 59263 59263 59263 3927635 39764 392764 _ 4 Back gt INTREPID User Manual Library Help Top Library Help Top Importing data to INTREPID G03 11 lt 4 Back gt 5 Create or import an existing DDF data description file The INTREPID Import tool requires you to define the names and positions of each data field in the input file This information is stored in a special file called the DDF Data Description File If you are importing some new data for the first time you need to create this DDF However INTREPID can help you get started by generating a simple skeleton DDF To generate a skeleton DDF in the Ascii Columns DDF editor From the File menu choose File Choose Generate Skeleton Data Description Format File and then Line Dataset A simple DDF appears in the editor The standard procedure you would follow is to edit this DDF to match the fields in your own input data file Then from the File menu you would choose Save Data Description Format File As and you save your DDF as a new file However for this exercise we don t need to create a DDF We already have an existing DDF for this data so all you need to do it to load
9. 8518 59874 62 59264 15 355 78 91 99 9 77833 485338 22 F J proj 148131 2 26 970222 53 116517 59874 62 59264 27 355 78 32 38 9 77836 485327 31 G sample _data 148131 2 26 970222 53 118514 59574 63 59264 35 355 78 32 78 9 775839 485323 92 ee abet 148131 2 26 976222 53 110816 59874 63 59264 43 355 88 53 88 9 77842 435321 28 7 148131 2 26 978222 53 110818 59874 63 59264 53 355 88 93 28 9 77844 485317 19 H a examples 148131 2 26 970222 53 1165278 59574 62 59264 62 355 98 935 68 9 77547 485314 81 em guided tours 149131 2 26 978222 53 110822 59574 62 59264 72 355 98 93 80 5 77858 485311 85 ne p ea le 148131 2 26 970222 53 116524 59574 62 59264 87 355 58 94 18 9 77853 4853 6 11 g 148131 2 26 978222 53 110826 59874 62 59264 91 355 78 54 58 5 77555 485382 82 agi intrepid _dat 148131 2 26 9570222 53 110828 59574 62 59264 99 355 78 54 58 9 77855 485297 18 i Griner 148131 2 26 970222 53 118538 59574 62 59265 87 355 68 535 88 9 77861 485291 58 i dk l 148131 2 26 978222 53 110832 59574 62 59265 15 355 58 55 08 9 77564 485288 89 Eales 148131 2 26 978222 53 116534 59874 62 59265 23 355 48 94 99 9 77867 485285 16 E temp 148131 2 26 970222 53 116536 59574 62 59265 38 355 38 95 88 O 77869 485278 18 2 Open the input file In the dialog box select the file alburydata alburydata dat and choose Open The Import Ascii Columns main window appears Library Help Top 2012 Intrepid Geophysics
10. EE Desktop 4 Unspecified 103 E Recent Places J albury 30 11 2012 2 39PM_ File folder J Downloads J ebagoola_A 30 11 2012 2 39PM_ File folder a ebagoola_B 30 11 2012 2 39PM_ File folder EI Libraries IJ ebagoola_F 30 11 2012 2 39PM_ File folder Sy ebagoola_s 30 11 2012 2 39PM File folder a Music J ebagoola_ST 30 11 2012 2 39PM File folder riae D euler_s 30 11 2012 2 39PM_ File folder E Videos J euler_ss 30 11 2012 2 39PM_ File folder d Gridmerge 30 11 2012 2 39PM_ File folder a Homegroup J polyA 30 11 2012 2 39PM_ File folder eee BB poe 5 12 201211 15AM_ File folder s E albury DIR 15 02 2008 10 52 DIR File 0KB ite Local Disk C E albury isi 30 11 2012 6 23 PM __ISIFile 4 KB Mia des fast D _ 2 allburydata dat 12 02 2008 4 01PM DAT File 21 680 KB L File name alburydata dat AN Files M The file name appears on the text in the Import Tool window Library Help Top 2012 Intrepid Geophysics lt 4 Back gt INTREPID User Manual Library Help Top Importing data to INTREPID G03 10 lt 4 Back gt 3 Specify the output dataset name Under File choose Specify Output Dataset The Save new Dataset as dialog box appears Type in the name of your new dataset albury1 and choose Open Note The button is Open not Save because you are just opening a dataset ready to receive the imported data Note Use the name alburyl1 because there is already a dataset we have supplied c
11. INTREPID User Manual Importing data to INTREPID G03 1 Library Help Top lt 4 Back gt Importing data to INTREPID G03 Top In this tutorial we import some ASCII data and create an INTREPID Line dataset We use two different INTREPID tools to perform the same operation So we repeat the same job twice The first example is a tool designed much more for those that like to point and click and is based upon the Excel import paradigm The second instance uses the genric Import tool capabale of dealing with many formats including the simple ASCII column case In this tour we import data in an ASCII format that is well suited to geophysical line data This is called ASEG GDF2 format Australian Government Surveys prescribe this format The data is from Albury Victoria The data custodians are Geoscience Victoria Department of Primary Industries Melbourne Australia The data is freely available through the Geoscience Australia GADDS Geophysical Archive Data Delivery System This is powered by the Jetstream tool from INTREPID Context of this guided tour Library Help Top In the context of your data processing cycle this tour represents an early stage in your processing cycle when you receive some data from an external source and you wish to use the INTREPID software to display or perform some additional work This example is quite simple and does not cover forming tensor or vector fields Special short cuts are provided
12. alled albury a Intrepid Import Tool qq File Input Vector Format Input Grid Format PostImport Utilities Help Actions Process Begin Name import Comments Intrepid Audit Stamp v4 5 0 HEAD for Windows x64 by BUSTER Build 0 0871 2 2012 Input C Intrepid 4_5 sample_datafquided_tours intrepid_datasets alburyd ata dat Output C Intre pidf 4 5 s ample_data guided_tours intrepid_datasets albury1_ DIR Parameters Begin Coordinate SystemT ype END Parameters End Process End Apply 4 Choose the input file format If you are importing Line or Point or Polygon data choose an option from the Input Vector Format list If you are importing a Grid dataset choose an option from the Input Grid Format list In this case we are importing Line data so from the Input Vector Format list choose Ascii Columns The AsciiColumns DDF editor appears DDF stands for data description format and in the popup below the bottom section is reserved for using this DDF language to describe each column one line for each column File Options Help File C Intrepid V4 5 sample_data guided_tours intrepi 10 20 30 40 50 a 123545676901234567690123456786901253456769012345678901253456 Library Help Top 140131 140131 140131 140131 140131 140131 140131 140131 140131 MMM BB Nd 26 26 26 26 26 26 26 26 26 970222 970222 970222 970222 970222 9702227 970222 970222 970222 ao ao uo 53 uo 53
13. he Column Info panel updates to show the properties for this column We also want to make the Linetype column a Group By field since it has only a single value for each line group in the dataset Check the Group By check box Next we want to set this column to be the INTREPID LineType alias From the Alias dropdown list select LineType Flight Fiducial Now select the next column Select Flight in the bottom Data Columns panel The next column now appears highlighted in blue and the Column Info panel updates to this column s information You can also make the Flight column a Group By field since it has only a single value for each line group in the dataset Select the Fid column Set this column to have the INTREPID Fiducial alias 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 8 Library Help Top Import tool Library Help Top q Back gt X Y projection datum Now use the scroll bar to scroll to the far right of the data Select the xgda94mga55 column Set this column to be the INTREPID X alias When you do this the Projection amp Datum selection box appears Here is where you define the X and Y Alias names and their associated Datum and Projection The Y Alias is currently wrong so you need to change it From the pull down list choose the Y Alias to be ygda94mga55 From the drop down list choose the Datum to be GDA94 From the drop down list choose
14. ll_pathis the path of your INTREPID installation the project directories for the Guided Tours sample data are install_path sample_data guided_tours intrepid_ datasets and install_path sample_data guided_tours geosoft_datasets For example if INTREPID is installed in C Program Files Intrepid Intrepid4 5 nnn then you can find the INTREPID format sample data at C Program Files Intrepid Intrepid4 5 nnn sample_data guided_tours intrepid datasets This is the default location for the sample data If you have installed INTREPID normally the data resides there If you have installed INTREPID elsewhere the exercises will work just as well Just use the appropriate pathnames For more information about installing the sample data see Sample datasets installing locating naming in INTREPID Guided Tours Introduction G01 For a more detailed description of INTREPID datasets see Introduction to the INTREPID database G20 For even more detail see INTREPID database file and data structures R05 Location of sample data for CookBooks Right next to the Guided tours data is a rich set of more exotic geophysics datasets and grids already prepared for the cookbook training sessions A casual user might 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 3 Library Help Top lt 4 Back gt also gain some trial and error insights into the capbilities of the software just by testi
15. ng the Project Manger s ability to preview and describe the attributes of each of the cookbook datasets Library Help Top 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 4 Library Help Top lt 4 Back gt Steps to follow Before you begin the tutorial locate the file alburydata zip in the directory install_path sample_data guided_tours intrepid datasets Unzip the file into a directory called alburydata Some unzip programs will create this directory by default Import Ascii Columns This is the most direct and simple method to get ASCII column data into an INTREPID binary format 1 Start the Project Manager and launch the Import Ascii Columns wizard Start the Project Manager Navigate to the directory install_path sample_data guided_tours intrepid_ datasets From the Dataset menu choose Import Ascii Columns Wizard The Open for AscilimportWizard dialog box appears Fl Project Manager alburydata dat ure Import _data guided _tours intrepid _datasets E 2 P Import Ascii Columns File name Last Modified Epon Bee 15 02 2008 10 52 42 AM a F albury1 DIR 08 12 2012 4 28 37 PM Subsection E TRE EATA H albburydata dat 12 02 2008 4 01 32 PM Merge Dataset a alburydata ddf 12 02 2008 4 16 12 PM Append Dataset _ alburydata des 15 02 2008 1 10 50 PM Remove Duplicates E alburydata din 12 02 2008 4 01 18 PM 4 alburydata
16. s Q I have forgotten the DDF syntax Are there some examples I can refer to A There are lots of examples of DDF files in the INTREPID installation examples area Q I find the DDF editor in the Import tool difficult to use Are there any other options A You may find it easier to create your DDF using a standard text editor and then import it into the DDF editor Library Help Top 2012 Intrepid Geophysics 4 Back gt
17. ssing packages etc Start the Project Manager and launch the Import Tool Start the Project Manager Navigate to the directory install_path sample_data guided_tours intrepid_ datasets From the 2012 Intrepid Geophysics q Back gt INTREPID User Manual Importing data to INTREPID G03 9 Library Help Top lt 4 Back gt Dataset menu launch the Import Tool m Project Manager help prepa meo File Input Vector Format Input Grid Format Post Import Utilities Help Actions Process Begin Name import Comments Intrepid Audit Stamp v4 5 0 HEAD for Windows x64 by BUSTER Build 0 0871 2 2012 Import Parameters Begin Import Ascii Columns ENR er pic Process End Export Subsection Merge Dataset Append Dataset Remove Duplicates Dataset Resarnpler ems 2 Open the input file From the Import tool from the File menu choose Open Input File The Select File or Dataset dialog box appears Select alburydata alburydata dat from the list of files and choose Open on Windows or Select on LINUX iis Intrepid Import Tool lajo X d Intr File Input Vector Format Input Grid Format Post Import Utilities Help Actions L vy Process Begin g Name import Local Disk C Intrepid gt V4 5 sample_data guided_tours intrepid_datasets gt Organize v New folder z vy Fl O A Favorites og Name p Date modified Type Size
18. t suits your data For this exercise we are importing Line data so leave the default choice as Lines The first data column is highlighed in blue in the bottom panel The properties and settings for this data column are displayed in the middle Column Info panel The Name Datatype and Missing properties for the columns have all been supplied from the input files However we want to make the Line column a Group By field since it is the primary identifier for the Line dataset Check the box to the right of the Group By text Next we want to set this column to be the INTREPID Line alias From the Alias dropdown list select LineNumber Column Info Mame LINE Datatype INTEGER 4 r Missing 999 GroupBy Alias LineNuml Datum Projection Quick review of the Group by concept An INTREPID Line dataset is made up of groups Each group represents one survey line of data Therefore the Line number is imported as a Group By field and it becomes the primary identifier for each group However other fields such as Date and Flight can also be imported as Group By fields provided they have only one value per line This helps to reduce the size of the dataset If a collection of data has no line structure we refer to it as point data An INTREPID Point dataset consists of a single group Line type Now select the next column Select Linetype in the bottom Data Columns panel The second column now appears highlighted in blue and t
19. the columns breaks and to change them if you wish There is a scroll bar at the bottom of the screen You can drag the scroll bar to the right to check that all the column breaks are located correctly For this exercise you do not need to change them Choose Next to continue Set up parameters for import of data fields This Import Ascii Columns window is where you set up parameters for the import process It 1s divided into three panels e Top panel Choose the type that best describes your data Middle panel Column Info Bottom panel Data columns Pine O Choose the file type that best describes your data Ponts Lines Polygons top panel Column Info Name LINE v Datatype NER y middle panel Missing 999 V GroupBy Alias LineNumber Datum Projection N bottom panel linetype flight date julian fid diurnal rawmag 26 970222 53 110792 59874 63 59263 45 26 970222 53 J110794 59874 63 59263 54 26 970222 53 110796 59874 63 59263 63 26 970222 53 110798 59874 63 59263 71 26 970222 53 110809 59874 63 59263 78 26 970222 53 110802 59874 63 59263 87 26 970222 53 110804 59874 62 59263 95 26 970222 53 110806 59874 62 59264 03 m Previous 2012 Intrepid Geophysics 4 Back gt INTREPID User Manual Importing data to INTREPID G03 7 Library Help Top Library Help Top 4 Back gt Line number In the top panel choose the data type that bes
Download Pdf Manuals
Related Search