ILWIS 3.6 Open GEONETCast Toolbox Plug-in User Manual
Contents
1. window for the appropriate Representation For the LAI FVC FAPAR LST standard lookup tables are available the DSSF and the DSLF can be visualized using a Pseudo Representation Check the values of the imported products Check also the import routines as given in the Geonetcast Toolbox under the options SAF Euro and SAF South America The import of these products is conducted much faster as only a single input file needs to be processed Also import a product from one of these regions so you have an idea of the area covered by these products The next product that will be imported is the Sea Surface Temperature SST that is produced by the Ocean and Sea Ice SAF OSI covering the Atlantic Ocean GEONECast dissemination details of this product are presented in the table below OSI SAF Sea Surface Temperature SST Temporal Resolution twice a day Start of recording day Image available from 00 00 and 12 00 UTC No of files 1 file Compressed and in GRIB format Combined GOES and MSG window S OSI_ FRA_ MULT MAPSST_FIELD 200905271200Z grb gz Value map degree Celcius having a georeference toolbox_batchroutines sstimport bat Select from the Geonetcast Toolbox menu the option SAF SST MSG GOES Combined twice and select for the Date stamp the previous day for the hhmm portion of the time stamp either midnight or midday OOOO or 1200 respectively Press OK to execute the import the output file2. MFE Direct M MPEF M MSG Satellite and Solar Zenith Azimuth MM RSS MPEF fF Real Time MSG Visualization and Animati FF SAF Africa M SAF Euro m SAF SST MSG GOES Combined MM SAF South America fF SPOT vGT4 Africa fF Toolbox Settings and Export Image Processing FEB Import Export FEB Interpolation gt gt gt gt Fl Fl T T T T T m m T m D m m m m m m m E E Ei FE QSEBS Tools FEB Raster Operations FER Rasterize lt lil LRIT MET Query None From the main ILWIS menu select Operation select Geonetcast toolbox and continue to select the various options available under this menu the arrow at the right hand indicates that there are various other options under this menu The Toolbox also appears under the Operation Tree double click the Geonetcast toolbox menu here the sign indicates that there are various functions available in these sub menu s Browse through the various options that have become available upon installation of the toolbox and make yourself familiar with the structure of the toolbox menu GEONETCast Toolbox plug in Source Directory When the toolbox plug in is installed a new sub directory is created under the main ILWIS Extension directory called Geonetcast Toolbox Use the Windows Explorer and browse to
3. a kind of user manual demonstrating the use of the toolbox to capture the data delivered by GEONETCast This document assumes a general knowledge on GEONETCast and the way the data is delivered via Digital Video Broadcast DVB More detailed information on installation and configuration of ILWIS 3 6 Open and the Geonetcast Toolbox plug in are provided in the Step by Step Installation Guide and the document First steps Configuring the Geonetcast toolbox under ILWIS see http www itc nl departments wrs geonetcast default aspx At this website also the links to the other freeware tools are provided that can be used Export routines of VISAT BEAM and BRAT allow import into ILWIS see the link under Other useful software tools The GEONETCast Toolbox plug in menu Install ILWIS3 6 on your system and copy the file toolbox zip into the ILWIS3 6 subdirectory Extensions Do not unzip the file Start ILWIS Once ILWIS is started the toolbox zip file is unzipped and the toolbox is installed as a plug in under ILWIS therefore the first startup sequence will take slightly more time Once ILWIS has started the GEONETCast toolbox menu can be observed an entry is created under the Operation Tree and it can be accessed through the context sensitive menu under Operations from the main ILWIS menu See the two figures below Geonetcast toolbox menu from Operation Tree and from the main ILWIS menu BL iwis Open C Itwi
4. fires having a georeference Toolbox batch routine toolbox_batchroutines rss_fira_import bat L 000 MSG1__ MPEF_RSS___ GII 000001___ datetimeUTC __ georeference toolbox_batchroutines rss_gilimport bat and toolbox_batchroutines rss_Kindeximport bat RSS MPEF Multi Sensor Precipitation Estimate MPEG 5 minutes Start of recording day Image available from 00 00 UTC No of segments band 4 segments in GRIB format Geographic coverage Partial MSG field of view from 15 70 North from 9 5 degree East File name pattern L 000 MSG1__ MPEF_RSS MPEG 000004__ datetime UTC __ Output generated Value map rain intensity per 5 minutes having a georeference Toolbox batch routine toolbox_batchroutines rss_mpegimport bat Before you continue delete the files that appear in the ILWIS Catalog Use the various import routines provided under RSS MPEP and display the results of the imported AMV FIRA GH K Index map views and MPEG map Note that for the FIRA the file size 1s mostly very small indicating that there is no fire detected for the area situated between 15 to 70 degree North latitude Before you specify a Date stamp for the FIRA import check the original file using Wordpad or Notepad If a FIRA import is executed and there are no fires listed in the import file an error message will appear Note that the output mapviews use the same naming convention as those generated by from MPEF the MPEG files have as name prefix RSS
5. routine can be used to display or hide the commands that are executed by the batch routine echo on displays the messages and echo off turns the command echoing off The sequence of processes resulting from the listing of batch commands are displayed in a separate Windows Command window when the echo is turned on In the batch routine use is made of routines that are provided in the sub directories Util UtilDir GDAL gdalDir and ILWIS ilwis exe is called from the main ILWIS directory IlwDir Most of the file name locations and executable are given between double quotes e g llwDir lwis exe to circumvent problems with spaces in directory file names etc The flag C calls ILWIS executes the command and terminates ILWIS The commands that are executed under ILWIS are identical as those you will find on the ILWIS command line Most of the batch routines have options to remove the temporary files created and is also deleting the original GEONETCast data that was retrieved from the input drive directory Util This sub directory is providing additional applications that are used for import of the GEONETCast original data and service objects Furthermore a few sub directories exist the directory Maps contains a few vector files with the country boundaries and mapviews the directory MSG_time is providing the 15 minutes time stamps used for the real time visualization In this directory also the Bufrtool decoder and the director
6. showing index values having a georeference Toolbox batch routine toolbox_batchroutines giiimport bat MPEF Multi Sensor Precipitation Estimate MPEG 15 minutes Image available from 00 00 UTC 4 segments in GRIB format Full MSG field of view from 0 degree L 000 MSG2__ MPEF MPEG____ 000001__ datetimeUTC __ Value map rain intensity per 15 minutes having a georeference Toolbox batch routine toolbox_batchroutines mpegimport bat In the FIRA import window specify the appropriate Date stamp in accordance with the file that was opened before and execute the import Refresh the ILWIS catalog and open the map view fire_fira Also open the newly created table called fire The last column in this table is used to classify the fires 1 Possible and 2 Probable fire Close any open maps or tables before you continue you can also select a number of maps and tables from the ILWIS Catalog and delete these select the relevant files right click the mouse button and select delete from the context sensitive menu Continue with the import of the MPEF GII specify an appropriate Date the current year month day for yyyymmdd and for hhmm 0700 and press show to execute the import This import routine is taking slightly more time as a number of raster maps are generated from tables that are transformed to point maps Once the import is complete open the map view called GI_indexmapsyyyymmddhhmm From the map view
7. the file name patterns used type of compression applied availability of first data set or product on a daily basis temporal frequency and number of data segments to reconstruct the image product Furthermore if relevant details of the output map s that are generated will be described like output filename geometric and radiometric characteristics Import of Meteosat Second Generation MSG 9 MSG 2 and MSG 8 RSS MSG 1 From the Geonetcast Toolbox select the option Geostationary MSG HRIT and then the sub menu MSG HRIT double click this icon twice to activate the Meteosat Second Generation Data Retriever From the menu select the option File and the Data Sources and check if the link to the data sources is correct For selection details of these Data Sources further information is provided in the document First steps Configuring the Geonetcast toolbox under ILWIS see http intranet itc nl departments wrs geonetcast default aspx The MSG Data Retriever allows for interactive setting of the various parameters to facilitate the import according to the need of the User both for MSG 8 Rapid Scanning Service RSS and MSG 9 which can be defined under the context sensitive option Satellite See also the figure below of the MSG Data Retriever Meteosat Second Generation Data Retriever File Help Satellite MSG2 Date Time range UTC From 5 22 2009 2 00 w To 5 22 2009 2 00 w Repeat Int
8. 9 21 41 5120 2009 21 41 5 20 2009 21 44 5 import D geonetcast EKE Configuration Settings 51202009 10 05 MODISFIRE a Geonetcast ToolboxUI dll 449 KB Application Extension Sf20 2009 14 03 Under the Geonetcast Toolbox directory two files can be found The file Geonetcast ToolboxUI dll is containing the User Interface menu structure of the toolbox and is creating the command syntax that is executed by ILWIS when performing a certain operation The file Geonetcast is containing the settings that are created when configuring the in and output directories for the various categories of data delivered by GEONETCast and stored on the archiving system See also the document First steps Configuring the Geonetcast toolbox under ILWIS see http intranet itc nl departments wrs geonetcast default aspx for a more detailed discussion on the configuration of the Directory Structure The advantage of this configuration option is that the directory structure which is mostly fixed at the server side only needs to be configured once and the output directory can be set according to the local user preferences These settings are used to generate the directory specification used in the command syntax so the user does not need to specify the in and output directories each time when applying the toolbox utilities Therefore the user does not need to specify in and output directories which saves not only time but also the frustra
9. Explorer Note the file size 1f the files are very small e g 1 or 2 KB there are hardly any fires Before you import a FIRA product open it in Wordpad or Notepad and check the content You can omit the first couple of header lines Temporal Resolution Start of recording day No of segments band Geographic coverage File name pattern L 000 MSG2__ MPEF CLM 000001__ datetimeUTC __ Output generated Class map using the CLM domain and representation and Value map having a georeference Toolbox batch routine toolbox_batchroutines clmimport bat Temporal Resolution Start of recording day No of segments band Geographic coverage File name pattern L 000 MSG2__ MPEF CTH 000001___ datetimeUTC __ Output generated Class map using the Elevclass domain and representation and Value map having a georeference Toolbox batch routine toolbox_batchroutines cthimport bat MPEF Active Fire Ascii FIRA Temporal Resolution Start of recording day No of segments band Geographic coverage File name pattern L 000 MSG2__ MPEF FIRA 000001___ datetimeUTC __ Output generated Map view with point map showing locations of possible and probable fires having a georeference Toolbox batch routine toolbox_batchroutines fira_import bat Temporal Resolution Start of recording day No of segments band Geographic coverage File name pattern L 000 MSG2__ MPEF GII 000001__ datetimeUTC __ Output generated Map view with several point maps
10. ILWIS 3 6 Open GEONET Cast Toolbox Plug in User Manual Part 1 Version 1 Ben Maathuis ITC Enschede May 2009 ITC Working with the ILWIS3 6 GEONET Cast Toolbox plug in Introduction The GEONETCast toolbox is making use of open source GIS and other freeware tools coupled to off the shelf hardware to capture the environmental data delivered to the Global User Community by GEONETCast The figure below is providing a general overview of the system design The Geonetcast toolbox approach AD pe mee GEONETCat Delivering Environmental Data to Users Worldwide WMO EUMETSAT The ITC GEONETCast Toolbox Approach using Open Source and Freeware Geonetcast Data Manager i OSTMQ DIASON2 N A RSS an nV METOP ae a The free vegetation extraction tool by VITO MPE Direct Pee Modis fire product lt __ BUFR Decoder Other Geostationary Services GRIB GRIB2 Meteosat Meteorological Products iw GDAL Translation a UNESCO Bilko 4 Web Mapping Services The GEONETCast Toolbox Key features are Geonetcast data management system for storage and retrieval of data 64 import routines for various satellites MPEF SAF and VGT products export routines to BILKO 2 for other Marine applications MSG 9 real time visualization for various predefined windows and a calculator to obtain solar and MSG zenith and azimuth angles for a specific UTC time The document is
11. Import of Products from the Satellite Application Facilities for Africa Europe and South America Satellite Application Facilities SAFs are specialised development and processing centres within the EUMETSAT Applications Ground Segment Utilising specialised expertise in Member States they complement the production of standard meteorological products as provided by MPEF Each SAF is led by the National Meteorological Service of a EUMETSAT Member State working with a consortium of cooperating entities such as other Meteorological Services government bodies and research institutes of Member and Cooperating States In the Geonetcast Toolbox you will find four menu items SAF Africa SAF Euro SAF South America and SAF SST MSG GOES Combined Using the first three menu options you are able to import products that are produced by the Land Surface Analysis SAF LSA the Sea Surface Temperature SST is produced by the Ocean and Sea Ice SAF OSD As the LSA SAF import routines for Africa Europe and South America offer the same functionality here attention is given to the import routines as provided under SAF Africa Originally the data for this continent are split into two regions Northern and Southern Africa respectively Upon import of the various products these two windows are merged and a new output map is created covering the whole African continent For Europe and South America a single file per product is dissemina
12. Level 1 5 data Has a separate option to define the data source directory for further details see also the document First steps Configuring the Geonetcast toolbox under ILWIS see http intranet itc nl departments wrs geonetcast default aspx RealtimeMSG Visualization This sub directory contains as set of utilities that are used to extract from MSG based on a selected window in near real time automatically the MSG images delivered by GEONETCast and displays these on the screen Based upon a Windows Task this operation is performed every 15 minutes Currently a number of standard windows are available covering Europe Northern Africa Southern Africa and Latin America The area of interest that is extracted can be easily modified to suit the user needs Automatically the import of the first three channels of MSG is performed based upon a time stamp that is adjusted for the time zone offset with respect to UTC and the fact that the time stamp of the MSG HRIT data is provided with reference to the start time of scanning After import a natural colour transform is performed the country boundaries are integrated a time stamp according to local time is added the colour composite image is exported and finally visualized using IrfanView RSS_MPEF Ilwis script to import data produced by the Meteorological Product Extraction Facility MPEF based on recordings from Meteosat 8 which scans the northen part of the field of view of MSG app
13. ackground is having a value of 160 this can be subsequently corrected if required More details about the availability of the LRIT data disseminated by GEONETCast and file name conventions used are provided in the tables below Study the tables and import a few images from these other geostationary satellites Refresh the catalog after the import has been completed Note that for MSG 2 the spectral and temporal resolution is quite different than with respect to the HRIT data imported before The time stamp needed for import can be obtained using the temporal resolution and start of recording day in the tables below Note that for the visible channels the time of the day Gn UTC in relation to the position of the sun should be considered No of segments band 10 segments 007 5 segments 064 and 5 segments 115 all channels have accompanied Pro files L 000 MTP___ MET7____ channel_057E 000001___ datetimeUTC C_ Byte images are having a georeference No of segments band 7 segments 007 6 segments 038 6 segments 068 6 segments 108 all channels have accompanied Pro files Geographic coverage Full MTSAT IR field of view from 140 degree East L 000 MSG2__ MTSATIR channel_140E 000001___ datetimeUTC C_ Byte images are having a georeference No of segments band 7 segments 007 7 segments 039 4 segments 068 7 segments 107 all channels have accompanied Pro files Geographic coverage Full Partial GOES 11 field of view fro
14. and fine tune the procedures even further The batch file mostly starts with setting of the required environment variables derived from the parameters that are entered when opening the program menu and those which are generated from the Geonetcast ToolboxUILdll and the settings specified in the Directory Settings in stored in the file Geonetcast An example is given below from Africa_albedoimport bat Setting the environment set longfilename From the menu user interface mostly specified as yearmonthdayhourminute in UTC time set shortfilename1 longfilename 0 12 Takes the first 12 characters from the start of the string e g when entering Date yyyymmddhhmm 200905221200 set InputDrive 2 From Directory Structure file Geonetcast Input Drive set InputDir 3 From Directory Structure file Geonetcast Input Directory set OutputDrive 4 From Directory Structure file Geonetcast Output Drive set OutputDir 5 From Directory Structure file Geonetcast Output Directory set gdalDir 6 Location of GDAL Directory from ToolboxUl dll set IwDir 7 Location of ILWIS Directory from ToolboxUl dll set UtilDir 8 Location of Utility Directory from ToolboxUI dll These environment variables are subsequently used in the batch file those between the signs e g YInputDrive InputDir refer to the selected input drive and input directory respectively The Echo command which is mostly used at the start of a batch
15. datetimeUTC_O_FY2C_FDI_VIS1KM_001_NOM HDF gz Byte image are having a georeference Z_SATE_C_BABJ_ datetimeUTC _O_FY2C_FDI_band_001_NOM HDF gz Byte image are having a georeference From the tables it can be observed that MSG LRIT availability is not in sync with the other satellites note that the temporal resolution is 1 2 hour with a shift of 15 minutes In order to construct a global thermal composite therefore this shift for MSG has been incorporated in the batch routine available at toolbox_batchroutines createTIR_ mosaic bat and therefore in this routine only a yyyymmddhh entry is required From the tables above it is clear that every hour a global thermal composite can be constructed Select from Geostationary LRIT the option LRIT TIR Composite and enter the relevant timestamp for yyyymmdd take the current day and to make a midnight composite select for the hh 00 The batch routine will import the geostationary observations from GOES West GOES East MSG 9 Meteosat 7 and MTSATIR transform these images into a global geographic projection and finally merges the images into a single composite The output file name will have the following format TIRyyyymmddhhmm When the processing is completed display the resulting composite using a Gray Representation Note that the output image is of a byte format the dark toned areas are the cold areas The bright toned regions are the warm areas see also the figure below Note t
16. e In the table click the name of ran Det a a Natta the column low1 the whole column will now appear blue and the formula used to obtain the column is given in lower left hand corner of the table window For the last column calculated the normal pressure at sea level is assumed to get an idea of the elevation above mean sea level of each of the wind vectors Close both the AMV mapview and the associated table window before you continue Select from the Geonetcast Toolbox menu the option MPEF and continue to select MPEF CLAT This is the so called Cloud Analysis Image In order to produce this Image also previous recordings are used and therefore the temporal resolution s different from the other products Details of the MPEF CLAI product are specified in the table that is given below MPEF Cloud Analysis Image CLAI Temporal Resolution 3 hours Start of recording day Image available from 02 45 UTC No of segments band 3 segments in GRIB format Geographic coverage Full MSG field of view from 0 degree File name pattern L 000 MSG2__ MPEF CLAI 000001___ datetimeUTC __ Output generated Class map using the CLAI domain and representation having a georeference Toolbox batch routine toolbox_batchroutines claiimport bat In the MPEF CLAI import window specify an appropriate Date the current year month day for yyyymmdd and for hhmm 0245 and press show to execute the import Upon completion o
17. e used for multi temporal visualization and the v CLM is a value map useful when you want to calculate using a cloud mask Display both maps for the class map use the default display options and for the value map select as Representation Pseudo Roam the mouse while keeping the left mouse button pressed over the maps to see the result of the import Take a look at the table provided below specifying the details of the Cloud Top Height product In ILWIS close any open maps or tables before you continue Select from the Geonetcast Toolbox menu the option MPEP and continue to select MPEF CTH Select for the Date the current year month day for yyyymmdd and for hhmm 0245 and press show to execute the import Two output files are created a file called cCTHyyyymmddhhmm and a file called vCTHyyyymmddhhmm The c CTH is as class map which can be used for multi temporal visualization and the v CTH is a value map useful when you want to calculate using the cloud top heights Display both maps using the default display settings for the class map and a pseudo Representation for the value map and check with the mouse the values classes Note that this product also has a spatial resolution of 9 km you can check the properties of the maps Close any open maps Continue with the import of the Active Fire Product Select for the present day a FIRA product that has been received through GEONETCast using the Windows
18. erval min 15 vr Select for Satellite MSG2 as Date Time range UTC select for date the previous day and for time 12 00 UTC As Repeat Interval min select Channels Use bounding box Series Multiple Channels in one File Multiple Times in one File Conversion fe Original DN Values C 8 bits Values C Radiometric mW m2 sr cm 1 1 C Radiometric W m2 sr um C Reflectance Temperature K Lon tat was m f 4984 aja Output Ignore Errors Format GeoTIFF File prefix Simple Filename ja Folder Browse Show command line Projection MSG Show Console Execute Exit 15 minutes Select from Series Multiple channels in one file and as Conversion use Original DN Values For Output select for Format Ilwis Raster Map for File prefix CC and select for Folder your working directory For Channels activate VIS006 VIS008 and IR_016 Press the Execute button to start the import If the import is completed move to the ILWIS main menu select Window and from the dropdown menu select Refresh The newly imported files should now appear with the prefix CC Given the import option Multiple Channels in one file in Ilwis also a maplist icon ig available next to the imported bands Double click the map list icon and from the menu select the Open as Colour Composite option and in the Dis
19. es for 15 MPE over Europe minutes only mm 15 minutes Import of secondary meteorological products RSS MPEF Unlike the previous MPEF products which all require input from recordings based upon MSG 9 the RSS MPEF is providing also MPEF products but at a higher temporal frequency but only for the northern part of the hemisphere as seen from geostationary perspective at 9 5 degree East recorded by MSG 8 Have a look again at the picture that is showing the field of view of Meteosat 8 RSS provided before in this document The import routines and the output generated are similar to the operations that have been conducted as described under Import of secondary meteorological products MPEF before A separate option is available to import the K index only as provided by the GH product Below a number of tables are provided showing the details of these products as distributed via GEONET Cast RSS MPEF Atmospheric Motion Vectors AMV 20 minutes Image available from 00 15 UTC Single segment in BUFR format Partial MSG field of view from 15 70 North from 9 5 degree East L 000 MSG1__ MPEF_RSS___ AMV 000001___ datetimeUTC __ Map view having a georeference toolbox_batchroutines rss_amvimport bat Temporal Resolution Start of recording day No of segments band Geographic coverage File name pattern L 000 MSG1__ MPEF_RSS FIRA 000001__ datetimeUTC __ Output generated Map view with point map showing locations of possible and probable
20. f the import select the map called CLAlyyymmddhhmm and press OK in the Display Options window to show the map Roam with the left mouse button pressed over the map to see the various classes that have been defined Note that the spatial resolution of this product is 9 km Move the mouse to the filename in the ILWIS catalog right click the mouse button move in the context sensitive menu to Properties click it to open the Properties Dialogue box to get the information about pixel size and number of lines columns Repeat the import procedure for the 0545 and 0845 CLAI products Upon completion of these import routines select from the ILWIS main menu the option File Create Maplist Add the 3 CLAI images to the maplist select the images in the left hand window and use the greater than symbol to drop them in the right hand file listing specify an appropriate output file name e g CLAI Double click the CLAI maplist Icon in the Catalog and display the images as an animated sequence 2 all other display options can be kept default press OK to see the results The other MPEF products apart from the CTH come with a temporal resolution of 15 minutes Details are provided in the tables below The CLM is the Cloud Mask Import a CLM of the present day at midnight at 00 00UTC Two output files are created a file called cCLMyyyymmddhhmm and a file called vCLMyyyymmddhhmm The c CLM is as class map which can b
21. faparimport bat Geographic coverage Euro North and South Africa South America File name pattern S LSA_ HDF5_LSASAF_MSG_LAI_ Region _date0000 bz2 Output generated Value map m2 m2 having a georeference Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_laiimport bat Check in the archive in the respective directory if the Albedo product of the LSA SAF is available see for the file name convention the table above If available open from the Geonetcast Toolbox SAF Africa the option SAF Albedo select the appropriate Date stamp note that for hhmm the specification is 0000 as the product is only available once a day see the file name pattern from the table above Execute the import and check the resulting map with the file prefix albedo_africayyyymmddhhmm Repeat the procedure above also for the other import routines as given under the option SAF Africa Note that the DSLF DSSF and LST products are available at 30 minutes intervals and the LAI FAPAR and FVC are only available once a day Take for the DSLF DSSF and LST products a mid day product eventually of the previous day for the vegetation products select for the hhmm time stamp 0000 Execute the import refresh the ILWIS catalog as well upon completion of the import The output file name convention used is identical as described above product_regionyyyymmddhhmm When displaying the various products look within the Display option
22. he coordinates given in the lower right hand corner of the map display window optionally a vector file can be added to the map display Note that sometimes for GOES West and GOES East only partial images are available ad 5 3 Thermal composite of various geostationary satellites Import of secondary meteorological products MPEF At EUMETSAT through the Meteorological Product Extraction Facility automatically other relevant meteorological products are extracted Open from the Geonetcast Toolbox the option MPEF The sub menu is providing 7 import routines of various products that are generated by MPEF and disseminated through GEONETCast Double click the option MPEF AMV Atmospheric Motion Vector Note that in the MPEF AMV import window the Input Directory might need to be adjusted as the data at least at ITC is stored in a year month day sub directory structure If this is the case close the import window open the Toolbox Settings and Export option and select the current day sub directory as the Input Directory in the Directory Structure settings and save these by pressing OK Once more open the MPEF AMV after adjusting the sub directory structure now note once more the specifications given for the Input Directory This should be the current day To specify the Date in yearmonthdayhourminute format details should be known about the availability of this product Further specifica
23. interval is accompanied by a PRO and EPI file describing further recording details like geometry and radiometry The MSG Data Retriever is using the Note that 6 is referring to the starting segment number this number increases for other segments same convention is used for file name pattern in the other tables coefficients from these files to apply the radiometric transformations and to obtain the geometric information Continue with the import of the various multi spectral channels of MSG 8 RSS and MSG 9 You have already imported the 12 00 UTC image bands 1 2 and 3 during the previous exercise the image with the CC prefix Use the same settings but uncheck the for the Channels the VIS006 VIS008 and IR_016 but now activate the Channel HRV Specify an new output name e g with prefix HRV and display the image when the import is complete Use as Representation Gray Browse the mouse over the image keeping the left mouse button pressed and check the values Repeat the procedure but now select as Satellite the MSGI RSS Also import of the same time a multi spectral image Bands VISO06 VIS008 and IR_016 and a HRV image HRV Display all of the images and note the differences in geometry of the MSGI RSS and MSG 2 The results should be identical to those given in the figure below Different field of views of MSG 1 left and MSG 2 right Multispectral at the top HRV at bottom Now select a therma
24. l channel from the Satellite MSG2 e g the IR_108 make sure that all other channels are unchecked specify an appropriate output map name e g with the prefix TIR use as Conversion the option Reflectance Temperature K and as Output format select Ilwis Raster Map Use the whole field of view Perform the import and display the resulting map using a Representation called Pseudo Browse with the left mouse button while keeping it pressed over the map Note the values what do they represent In a similar way also the other channels can be imported Note that for the visible channels VIS006 and VISOO8 the data will be transformed to reflectance if Conversion option Reflectance Temperature K 1s used Now you are going to continue and import a time series Uncheck now in the Data Retriever under Series the option Multiple channels in one file and check the option Multiple times in one file As Conversion use the option Original DN values as Output format specify Ilwis Raster Map For the Satellite select MSG2 and for the given day e g the previous day select the Time rang UTC from 00 00 to 23 00 and as Repeat Interval min select 60 Select in the map window a region covering the central part of Africa Now for every hour an image is imported and stored as a stack of images in an ILWIS map list For the settings see also the figure below MSG Data Retriever settings for m
25. m 135 degree West Wavelet compression of LRIT data File name pattern L 000 MSG2__ GOES11 channel_135W 000001___ datetimeUTC C_ Output generated 007 converted to Albedo other channels to Temperature K Albedo conversion 100 band_007 1023 Temperature conversion 330 5 160 1023 temperature_band 160 All imported images are having a georeference Toolbox batch routine toolbox_batchroutines importgoes11 bat LRIT GOES East from 75 degree West GOES 12 Temporal Resolution 1 hour Start of recording day Image available from 00 00 UTC No of bands 4 in total VIS 007 SWIR 039 WV 066 and TIR 107 micron No of segments band 7 segments 007 7 segments 039 7 segments 066 7 segments 107 all channels have accompanied Pro files Geographic coverage Full Partial GOES 12 field of view from 75 degree West Wavelet compression of LRIT data File name pattern L 000 MSG2__ GOES12 channel_135W 000001___ datetimeUTC C_ Output generated 007 converted to Albedo other channels to Temperature K Albedo conversion 100 band_007 1023 Temperature conversion 330 5 160 1023 temperature_band 160 All imported images are having a georeference Toolbox batch routine toolbox_batchroutines importgoes12 bat No of segments band 8 segments for all channels all channels have accompanied Pro and Epi files L 000 MSG2__ MSG2 channel ___ 000001___ datetimeUTC C_ Byte images are having a georeference Z_SATE_C_BABJ_
26. name convention is sstyyyymmddhhmm Display the imported SST image using for Display option the Representation called sst Add also a vector layer showing the country boundaries using for the Display options the option boundaries only and select a black boundary colour Note that the water temperatures are given in degree Celcius Further information on all Satellite Application Facilities is provided at the website from EUMETSAT http www eumetsat int Home Main What_We_Do SAFs Products List_by_SAF l en
27. nes that are provided under the sub directory toolbox_batchroutines Import Ilwis script to import Jason data that initializes the relevant batch routine that is provided under the sub directory toolbox_batchroutines Modisfire Ilwis script to import the MODIS Fire product that initialize the relevant batch routines that are provided under the sub directory toolbox_batchroutines using a batch loop routine procedure MPEdirect ILWIS script files that initiate a Java application that extracts the Multi Sensor Precipitation Estimate MPE from the EUMETSAT website available there for the most recent 24 hours derived from Meteosat 7 and Meteosat 9 The raw grib files are transferred to the local output directory and subsequently the batch routines are importing the data in ILWIS format To run this application no ground receiving station is required but a network connection is needed For Meteosat 7 MPE 48 files are retrieved and processed rainfall at a temporal resolution every half hour for MSG 9 96 files are retrieved and imported rainfall at a temporal resolution every 15 minutes using a batch loop routine procedure MPEF Ilwis script to import data produced by the Meteorological Product Extraction Facility MPEP initialize the relevant batch routine that are provided under the sub directory toolbox_batchroutines MSGDataRetriever A utility that is used to extract the compressed HRIT MSG 9 and MSG 8 Rapid Scanning Service
28. osat 7 The Input and Output Directories are properly specified the time should be entered as year month day hour minutes yyyymmddhhmm e g in this example 200905250700 Import of Geostationary LRIT satellite images L LRIT MET7 dl After entering the correct Date press OK A separate Windows Command Date yyyymmddhhmm 200305250700 screen will appear showing the status of Input Directory Z ALRIT sf A en CEL the import The data will be imported as byte maps in the case of Meteosat 7 show oee Cancel three output images will be created called Met7007_yyyymmddhhmm Met7064_yyyymmddhhmm and Met7115_yyyymmddhhmm These three channel represent the visible water vapour and TIR channels respectively Each of these images can be displayed using a Gray Representation Note that the images are imported as byte images You might need to refresh the ILWIS catalog select from the main ILWIS menu the option Window and Refresh For the other Geostationary LRIT options the same procedure is followed and the same output name convention 1s used satellitenamesatellitechannel_ date with the exception of GOES East and West Here the output file name syntax is satellitenamesatellitechannel_ a_date or satellitenamesatellitechannel_ t_date a refers to a conversion to Albedo in percentage from 0 100 and t indicates a transformation to temperature in Kelvin Upon import the temperature b
29. play Option window press OK the strech values can be kept default The imported image will be displayed as a colour composite band 3 in red band 2 in green and band 1 in blue Move the mouse over the image and press the left mouse button What do these values represent Before discussing the other settings that can be applied to import the HRIT data from MSG 8 RSS and MSG 9 first a more detailed inventory is presented on the data that is disseminated by GEONET Cast Please note that this full spatial and spectral resolution data is subject to copyright applicable to the data recorded less than 24 hours before present Terms and conditions are specified in the license that is signed by the organization that receives GEONETCast For details on the license check it with the local system administrator Details of HRIT MSG 8 RSS and MSG 9 data transmitted by GEONETCast 12 in total 11 low resolution 3 km 1 broadband high resolution 1 km 3 segments for low resolution channel segments 6 8 9 segments high resolution channel segments 16 24 H 000 MSG1__ MSG1_RSS___ channel___ 000006 __ datetimeUTC C_ H 000 MSG2__ MSG2_______ channel___ 000001___ datetimeUTC C_ For the whole field of view as recorded by the SEVIRI instrument onboard of MSG 9 on a daily basis 96 images are available and for the northern hemisphere as recorded by MSG 8 a total of 288 images are recorded and disseminated Each set of images of a specific temporal
30. roximately from 15 to 70 degree North latitude with a temporal resolution of 5 minutes initialize the relevant batch routine that is provided under the sub directory toolbox_batchroutines SAF Ilwis script to import data produced by the various Satellite Application Facilities SAF s initialize the relevant batch routine that are provided under the sub directory toolbox_batchroutines SPOTVEGETATION Ilwis script to import the routinely produced decadal data aggregated 10 day composites from the SPOT Vegetation initializes the relevant batch routines that are provided under the sub directory toolbox_batchroutines System This sub directory contains the necessary service objects that are used by ILWIS like georeferences domains colour lookup tables The content of this sub directory is copied to the main ILWIS System Directory when a new instance of ILWIS is Started with the toolbox plug in installed Toolbox_batchroutines This sub directory contains a large number of batch files that are the backbone of the import export routines that are offered by the Toolbox Mostly these batch routines are called from ILWIS scripts The progress of the batch routines can be followed by a command window that appears on the screen when a batch file is being executed providing the user with a good overview of the progress of a routine that is executed Users that are familiar with batch files can adapt these files to suit their specific needs
31. s36 Sel if File Edit Merens View Window Help DEM hydro processing ewes Geonetcast Toolbox Import AYHRR3 I i EK E Image Processing Import Jason 2 Eh SE D amp fn B pm i Import Export Geonetcast Data Manager i gm Interpolation Geostationary LRIT Fenyung 2Chigh iain QSEBS Tools Geostationary MSG HRIT Fenyung 2Clow Raster Operations MODIS Fire Product gt GOES EAST Rasterize MPE Direct gt GOES WEST SEBS Tools MPEF gt MET Statistics MSG Satellite and Solar Zenith Azimuth Angles MSG Table Operations R55 MPEF MTSAT IR vector Operations Real Time MSG Visualization and Animation TIR Composite Vectorize SAF Africa Visualization SAF Euro Script SAF SST MSG GOES Combined MODIS Fire Product _SAF South America gt MPE Direct SPOT YGT4 Africa gt MPEF Toolbox Settings and Export gt MSG Satellite and Solar Zenith Azimu R55 MPEF Real Time MSG Visualization and Animati SAF Africa SAF Euro SAF SST MSG GOES Combined SAF South America SPOT YGT4 Africa Toolbox Settings and Export FEB Image Processing FEB Import Export FE Interpolation FEB QSEBS Tools FE Raster Operations FEB Rasterize lt Operation Tree Operation List Navigator Edit 1 Create FEB DEM hydro processing A Geonetcast Toolbox Mm Import Metop AVHRR 3 from BEAM M Import Jason 2 from BRAT m Geonetcast Data Manager M Geostationary LRIT M Geostationary MSG HRIT M MODIS Fire Product A
32. ted via GEONETCast Details of the product as disseminated via GEONETCast is given in the various tables provided below The current set of import routines are based on products generated from MSG New pre operational products based on METOP EPS will also become available The Albedo product is still in pre operational phase and at the moment of writing 1s not disseminated via GEONET Cast Before you continue check the current operational status of the products that are produced by the LSA SAF available at http landsaf meteo pt S LSA_ HDF5_LSASAF_MSG_DSSF_Region_ datetimeUTC bz2 S LSA_ HDF5_LSASAF_MSG_DSLF_Region_ datetimeUTC bz2 Output generated Value map W m2 having a georeference Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_dslfimport bat S LSA_ HDF5_LSASAF_MSG_LST_ Region_ datetimeUTC bz2 Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_Istimport bat Geographic coverage Euro North and South Africa South America File name pattern S LSA HDF5 LSASAF MSG ALBEDO Region _date0000 bz2 Output generated Value map 0 100 having a georeference Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_albedoimport bat S LSA_ HDF5_LSASAF_MSG_FVC_ Region _date0000 bz2 Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_fvcimport bat S LSA_ HDF5_LSASAF_MSG_FAPAR_ Region _date0000 bz2 Toolbox batch routine toolbox_batchroutines africa_ same_ or euro_
33. this directory e g C Ilwis36 Extensions Geonetcast Toolbox note that C Ilwis36 is the harddisk Ilw s directory The directory structure that appears in theWindows Explorer should be similar to the figure that is given below Geonetcast Toolbox directory structure Geonetcast Toolbox MIE ar Back Address C lwis36 Extensions Geonetcast T wi oalbox x Folders Ej Desktop l B My Documents El q My Computer Se Local Disk 01 9 chinazo08 em curxpt 5 Documents and Settings ID Flexlm C geosfm E IC Ilwis36 E Extensions El C Geonetcast Toolbox IS angle oO Export D GDAL GeonetcastDbataflanac oO GEOSTATIONARY Ba Ka Search Er Folders Ek Mame al angle Export GD4L GeonetcastDataManager GEOSTATIONARY import MODISFIRE DO MPEdirect C MPEF DmssDatafetrievwer 9 Realtimemsayvisualization rss_mpef SAF OI S5POTVEGETATION System Dltoolbox_batchroutines uti Size Type File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder File Folder Date Modified 5120 2009 21 41 5 20 2009 21 41 5120 2009 21 41 5720 2009 21 41 5 20 2009 21 41 5120 2009 21 41 5120 2009 21 41 5 20 2009 21 41 5120 2009 21 41 5 20 2009 21 41 5 20 2009 21 41 5120 2009 21 41 5120 2009 21 41 5 20 2009 21 41 5 20 200
34. tion of typing errors especially when addressing data source locations at servers The various sub directories are containing the utilities that are used by the toolbox to perform the various operations that are offered see the introduction above for the overview Details of these sub directories are provided below Angle is containing the Java application that is calculating the MSG and solar azimuth and zenith angles a batch file lwis scripts and eventually some of the raw angle data files e g sataz_2009 04 25 12 which read like the satellite azimuth angle for year_month_day_ timeUTC Export Still empty will be used to store the utilities needed to implement the Web Mapping Services currently under development GDAL in the sub directory BIN the Geospatial Data Library routines are stored used for import and export of the various data sources available in GEONETCast GeonetcastDataManager The Java application and the configuration file txt used to capture the data delivered by GEONETCast and dumped onto the harddisk of the ground receiving station It stores the data in a structured manner on a storage device according to rules defined in the datamanager For further details see also the document First steps Configuring the Geonetcast toolbox under ILWIS see http intranet itc nl departments wrs geonetcast default aspx Geostationary A set of Ilwis scripts that initialize the relevant batch routi
35. tions of the MPEF products are subsequently provided in the tables below MPEF Atmospheric Motion Vectors AMV Temporal Resolution 1 hours Start of recording day Image available from 00 45 UTC No of segments band Single segment in BUFR format Full MSG field of view from 0 degree mam Map view having a georeference toolbox_batchroutines amvimport bat Select for the Date in the MPEF AMV import window the current year month day for yyyymmdd and for hhmm 0045 and press show to execute the import Upon import an ILWIS table is generated and a few calculations are performed in this table this process takes some time The output is a so called mapview shown in the Ilw s catalog by the following icon If not shown directly double click the mapview icon with the filename amvyyyymmddhhmm The imported map shows the direction of the wind the arrow length is scaled with respect to windspeed and the colours are representing the classified height of the wind vector blue low green moderately high and red high The result of the import should resemble the figure provided below From the ILWIS Catalog open the table that is created called amv_impyyyymmddhhmm Note that the data given for the columns X Y Pressure_pa WindDirection WindSpeed and Temperature are extracted from the original file The other columns are calculated using the batch import t S t amp 5 ne NN PA N Mg Fi 3 routin
36. ulti temporal import Meteosat Second Generation Data Retriever Press refresh from Ilw s Be Hee main menu select Satellite Ms Window Note the Date Time range UTC Channels v Use bounding box sequence of files that has From 5 25 2009 00 00 v L visoos Te omme jean YS been created In this case Repeatinterval miny eo Dros the band number s referring Dwv_os2 CI wv_073 Series R087 E q to the time O E band_1 1S Multiple Channels in one File R_097 v m in one File ay Da from 00 00 hr and band _24 Conversion R134 IS from 23 00 UTC To HRV Original DN Values O C 8 bits Values display the map list as an C Radiometric mW m2 sr cm 1 1 ana zi T EEN wos animated sequence of C Reflectance Temperature K Lon 6 375E 46 452 E 1984 En images double click the Output Ignore Errors Format ILS Raster Map Projection MSG v Iv Show Console created map list 1con File prefix TIR Simple Filename Folder D test_geont Execute and select the option lt 2 in lt the map display window Select as Representation Gray use the other settings as default and press OK Move the mouse while keeping the left button pressed over the map window Note the values what do they represent Repeat the above procedure but now uncheck the Conversion Original DN values and activate the Conversion option Reflectance Temperature K Specif
37. window select File and Open Pixel Information Move the mouse cursor over the map and look at the values that appear in the Pixel Information window Also open the newly created table called Gllyyyymmddhhmm The following columns appear x y k_index parcel lifted index to 500 hPa precipitable water kg m 2 KO_index and maximum buoyancy The values in this table are used to create the output maps that are visualized in the map view In the map view legend the various layers can be unchecked to visualize the map that is situated at a lower position in the legend Close any open maps and tables before you continue Select the option MPEF MPEG specify an appropriate Date the current year month day for yyyymmdd and for hhmm 0700 and press show to execute the import The output map created is called MPEGyyyymmddhhmm Display this map use as Representation mpe_single In your working directory there should also be a vector file used to show the country boundaries in the previous map views called country_samecode To add this vector file to the map display window press the icon situated on the menu bar of the map display window and select the vector file country_samecode in the Display Options select single Color and take the black colour and press OK Browse keeping the left mouse button pressed the mouse over the map and have a look at the a values The rain rates are rainfall intensiti
38. y Tables should be available The procedure how to obtain the decoder and the tables is provided in the document Step by Step Installation Guide see http intranet itc nl departments wrs geonetcast default aspx under Bufrtool After you have studied the content of the various sub directories and have opened some of the batch routines e g using notepad or wordpad in the sub directory toolbox_batchroutines close the Windows Explorer and any file that is still open Import of GEONET Cast data using the Toolbox The backbone of the GEONETCast system currently is the data recorded by geostationary satellites the derived secondary meteorological products MPEF and the derived environmental parameters produces by the Satellite Application Facilities SAF The toolbox is offering various routines to import these data sets in a GIS and you can use the generic GIS and RS functionality for further analysis The data disseminated by GEONETCast encompass more than those that can be imported by the toolbox during development of this utility most attention has been given to those data sets that have the highest relevance for environmental and water resources applications The description of the import routines that follows for the geostationary satellites the derived secondary meteorological products MPEF and the derived environmental parameters produces by the Satellite Application Facilities SAF will also provide further information on
39. y a new output map e g with the Prefix MultiTIR and press Execute in the Data Retriever Display this new sequence of images also as an animated sequence and check the map values What do they represent now Another set of exercises is available at a later stage providing a more in depth introduction to the MSG Data Retriever and the various options that exist to import the data according to the need of the user Import of Foreign Satellites Geostationary LRIT Next to the MSG HRIT data disseminated other recordings from geostationary satellites is also provided The satellites available are GOES East currently GOES 12 GOES West currently GOES 11 MTSATIR Fenyung 2C Meteosat 7 and also MSG 2 Meteosat 9 To import the various LRIT geostationary satellite images select from the Geonetcast Toolbox menu the option Geostationary LRIT Select one of the satellites that appear in the drop down list In the import menu that appears the date time in UTC of the specific satellite needs to be entered Check the settings for the Input and Output Directory these are most likely already correctly specified if this is not the case close the menu and open the Toolbox Settings and Export menu and select the Set Directory Structure option and specify the correct Input and Output Directories for the Geostationary LRIT and Fenyung satellites An example of an import routine is provided in the figure below using Mete
Download Pdf Manuals
Related Search