Home

SYSTEM USER`S MANUAL

1. Aa Edt Delete Figure 4 55 Scenes list view The tree like structure shows the name of each scene a brief description and the name of the author Right clicking over a scene will open the context sensitive menu and double clicking over it will open the scene The tool bar in the bottom part of the frame grants access to the same functionalities of the pop up menu 4 11 2 New scene Creating a new scene from the scratch is a simple process within ECSIM The information that defines a scene is grouped in five different tabs general data scene dimensions and resolutions atmosphere composition surfaces and clouds and aerosols 4 11 2 1 General data In this tab users can define the following characteristics Identifier Long string The name of the scene This identifier must be unique in the scenes directory because it is also the name under which shall be stored as an XML file The complete name of the file is shown in the right most text field File name This file name must be validated by the operating system Description Long string This is a brief description of the scene Pressing This is a scene control enter will insert a line break in the text showing good sky conditions over Dublin Author Medium The name of the author DMS string DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 a ECSIM Date 07 05
2. Identifier Medium string This is a unique identifier of the tool XML editor Description Long string A brief description of what this tool This tool will will do and need open an XML file for edition Action Medium string What the tool is going to do edit Extension Short string The type of files that this tool is going xml to be applied to Executable Long string Location of the binary file that is going gedit to be called to execute the product Parameters Long string The list of parameters that will follow f filel the executable No variables can be passed from the HMI 4 5 2 2 Edit tool E e xj Selecting this functionality the user can access and edit all the attributes of the selected tool 4 5 2 3 Delete tool Selecting this functionality the user can delete the selected tool ECSIM EarthCARE Simulator 4 5 3 a Abo ut ECSIM Copyright C 2007 Deimos Space S L Accessing this functionality the system will show a dialog PESIMIS Freerso ware wnucan redistribute E gt A it and or modifyit under the terms of the with the copyright and license scheme for the ECSIM GNU Lesser General Public License as published bythe Free Software Foundation platform either version 3 of the License or at your option any later version 4 5 4 Exit the system ECSIM is distributed in the hope that it will be useful but WITHOUT ANY WARRANTY 1 1 1 1 without even the
3. Configuration Parameters Output Tools Configuration files list Default file File instance Status E Configuration Ed Complete ci orbit dms 1 0 3 models orbit dms conf ecsim orbit config xml models orbit dms c Available 5 rad filter 1 0 D models rad filter conf rad filter config xml models rad filter co amp vailable 9 Cd Iw rad 1 0 D models Iw rad conf lw rad config msi mc xml models lw_rad conf Available Ef lid filter 1 0 D models lid filter conf lid filter config xml models lid filter con amp vailable J radar 1 0 Figure 4 43 Session Configuration files definition This window will present the list of models present in the simulation and will ask for the location of each needed configuration file At this stage the models cannot be changed nor deleted Double clicking on a file row the system will show a file browser to locate a specific configuration file Providing an existing file will update the status to Available 4 10 2 6 Parameters configuration This time the user is able to alter the contents of the configuration files to change the behaviour of the model Assumed that the model has been correctly integrated into the system and a valid configuration file is reported this tab shown in Figure 4 44 will present the list of model parameter and values grouped by model and simulation sorted in execution order DEIMOS Space S L 2007 DM
4. diff DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 121 of 121 Vidi EY End of document DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E
5. DEIMOS Space S L 2007 Alt z DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM O1 R Issue i 2 4 4 E EM Date 07 05 2008 System User s Manual Page E 103 of 121 mou EN 4 18 Error messages ECSIM platform controls its correct behaviour with an error handling system Users are informed about the nature of the error and a possible way to correct it Here is a list of different kinds of raised errors System Configuration Adding a new variable Validation error Follow the instructions to correct the value System Tools Accepting changes Tool addition failed You have chosen a duplicated identifier Please provide a different identifier Validation error Follow the instructions to correct the value Deleting a tool Database error Possible database failure Is your database running Executing a tool File IO error Follow the instructions Repository Descriptors Accepting changes Descriptor modification failed Possible database failure Is your database running Descriptor addition failed You have chosen a duplicated identifier Please provide another identifier Validation error Follow the instructions to correct the value Adding an IO file Validation error Follow the instructions to correct the value A descriptor shall not have associated two files with the same id DEIMOS Space S L 2007 Please ch
6. Simulations Ctrl l iM New simulation Sessions Ctrl S iM Mew session Figure 4 20 Repository menu Users can access to some of these operations at the models menu in the menu bar of the main window Figure 4 20 or in the correspondent context menu of the repository view Ctrl E EP Eon f New model version Ti Delete Code ECSIM DMS TEC SUM 01 R Issue 2 4 Date 07 05 2008 Page 48 of 121 Repository Scenes fi Executions File system Search object in repository Element identifier Ci Repository gt 3 Descriptors Models Scene scene creator xml 1 0 9 Platform 3 orbit dms 1 0 9 E Forward lid filter 1 0 Iw rad 1 0 rad filter 1 0 sw rad 1 0 J Instrument bbr 1 0 lidar 1 0 msi 1 0 radar 1 0 CJ Retrieval lid 12a 1 0 lid rad I2b 1 0 lw msi lid rad I2b 3d 1 0 msi 12a 1 0 rad 2a 1 0 9 E Simulations Backward Complete Forward Lidar Radar RadiativeTransfer SceneCreation Figure Models Repository view Figure 4 21 Model Pop up menu DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 49 of 121 sPACEJ 4 8 1 Model developers guideline ECSIM can integrate as a model almost every executable piece of code that follows the requirements described in RD ICD Given this situa
7. DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page a Er Scenes Executions File system Search results in executions Is 8j Repository Element identifier Session results E2E 20080328100633416 E2E 20080331110032526 Figure 4 68 Side bar Executions Users can access to the list of results known by the system in the executions view of the side bar or via the Executions menu Figure 4 69 from the main menu Executions a View Session results Ctri R gt Re run 1 Logs iis amp Generate report Figure 4 69 Results menu Delete Figure 4 70 Results pop up menu Operations involving results include the following Q List present the list of existing execution results O View consult the data of an existing execution result L Re run Starts a new session execution This new session is a replica of the former but shall create a new session folder Q Report generation shows a text report describing the execution QO Deletion delete an execution result from the system 4 13 1 Result view Accessing this functionality users can consult the result of a session execution Figure 4 71 shows a window very similar to a session editor but including more information DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Cod
8. DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 AS ECSIM Date 07 05 2008 sPACEJ System User s Manual Page 14 of 121 Figure 4 64 Scene Non fractal scattering TO oia 87 Figure 4 65 Scene Fractal scattering OM us en ru osastasachaes pncsceantapichace tas easdapstbachstasteaceabaubeeh Fa EP RER MESE pad 91 Figure 4 66 Scene COMPAS ia 92 Figure 4 07 Scene Merge uice ora m E bed iia diaria PA NEAN 93 Figure 4 08 Side Dar EXGCB DOFS idad E FUR BA EAE A EAM A RA BUE PINE UM Rab RAN ER E boas 94 Figure 4 69 Resulta 94 Riaure 2 70 Results PopUp MEL 94 Figure 4 7 1 Execution TESUIES aros aria sisas iaa 95 Hibtire 4 72 Result Rei eo ola ote eliana 96 Figure 4973 EXGCul OM TO rs 96 IP E DOES fetu a E p rib AU Dips qp c PU M Eu pedustu sea piay MP IM APA baie 97 F1gured 75 Logs list VIG Wi oie FERE EU TOP iia EPUM BAN RAN BRL AR ERE Bia 98 Figure 4 76 Tale Su Stem view oa e e ERR TER ER T EROR EC RES ae 99 aurea 7T MOEA POLI aa 100 Figure 5 1 End to end simulation Schema Luis ioo siii ai aos casa 115 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ra ECSIM Date 07 05 2008 e AN System User s Manual Page 15 of 121 S PAC EP 1 INTRODUCTION AND PURPOSE This document has been produced by DEIMOS within the frame of the ECSIM project and represents the Software User Manual for the ECSIM platform It provides not only a clear descript
9. Mixing Unsigned integer 0 zd The mixing represented by a change in the horizontal exponent may be anisotropy 0 no anisotropy 1 smoother in fallstreak orientation O Relative altitudes It is possible to define information about the size distribution of this scattering region Users can add or remove individual size distributions with the plus and minus buttons Users now can access to these individual parameters rel_alt Float 0 0 1 0 Relative altitude in km for this entry fall_speed Float DEIMOS Space S L 2007 Particle fall speed at the relative altitude In m s DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 90 of 121 S Exc EJ horizontal_exponent The height variation of the exponent of the horizontal power v_wind V wind velocity at the relative height Used to overwrite model winds when velocity_overwrite 1 In m s u wind U wind velocity at the relative height Used to overwrite model winds when velocity_overwrite 1 In m s mode wc mean Mean water content In g m Mode std dev Standard deviation of the natural logarithm of the water content In g m Mode reff mean Mean effective radius log normal distribution In microns Mode reff std dev Standard deviation of the natural logarithm of the effective radius log normal distri
10. S pd EJ 5 5 2 Pre conditions A previously defined session called E2E exists in the repository This session includes A A set of two already defined simulations named Complete and SceneCreation The former will create a XML description of a reconstructed scene from a forward and retrieval simulation and the later will create an UFF file out of the reconstructed scene The following set of input auxiliary and configuration files will be defined scene creator xml scene inp xml ECSIM HOME sessions E2E 0 Input Complete scene inp xml orbit dms Input scene uff Pending orbit dms orbit dms config xml ECSIM_HOME sessions E2E 0 Configuration Complete orbit_dms_config xml Iw rad Input uff adjust xml ECSIM_HOME sessions E2E 0 Complete uff_adjust xml lw_rad Input scene uff Pending lw_rad Input orbit xml Pending Iw rad Configuration Iw rad config xml ECSIM_HOME sessions E2E 0 Complete lw_rad_config xml rad_filter Input uff_adjust xml ECSIM_HOME sessions E2E 0 Complete uff_adjust xml rad_filter Input scene uff Pending rad_filter Input orbit xml Pending rad_filter rad filter config xml SECSIM HOME sessions E2E 0 Configuration Complete rad filter config xml lid filter Input uff adjust xml ECSIM_HOME sessions E2E 0 Complete uff_adjust xml lid_ filter Input scene uff Pending lid_ filter Input orbit xml Pending lid filter Configuration lid
11. minimize maximize restore and close operations If the user minimizes a frame it disappears from the working area but it can be restored from the available frames toolbar 4 4 Side bar On the left side of the main frame there is side bar grouping different views of the ECSIM areas Repository Scenes Executions and File system As you can see at the right upper corner of Figure 4 9 two little triangles can be touched to minimize or maximize the width of the side bar The dotted bar can also be dragged to dynamically change its width 4 5 System Selecting the System menu the users can access to the following functionalities DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 39 of 121 S PAC ES Tools Ctrl T B Show configuration Ctrl O GD About ECSIM Ctrl A a Cti X Figure 4 10 System menu Search object iri repository Element identifier These functionalities are given to control the general characteristics of the whole ECSIM system Ci Repository o 7 Descriptors gt C4 Models Ed Scene TY scene creator xml 1 0 c Platform 3 orbit dms 1 0 E Forward lid filter 1 0 Iw rad 1 0 rad filter 1 0 sw rad 1 0 5 Instrument bbr 1 0 lidar 1 0 msi 1 0 radar 1 0 o C Ret
12. status meaning that they will be produced by the action of the models execution Once a session has been executed and output files generated file instance column will show the absolute path of the generated file and the status will be Available 4 10 2 8 Specification of final product tools It is possible to add a list of product tools as post processing operations that is a series of executables to be called upon the execution completion For example Figure 4 46 shows a list of tools set to graphically compare the reflectivity of an original scene and a reconstructed one as a RADAR instrument may sense it Session setup Input Configuration Parameters Output Log List of tools A Tool Executable Parameters Extract 3D quantity extract tools product tools bin ext scene uff scene nc 0 100 Plot 3D plot tools pgplot tools bin plot scene nc Extinction O 10 O Figure 4 46 Session Product tools specification There are two ways to add tools to this list DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 73 of 121 SS wm E O Selecting a file from the input configuration or output files list Users can right click on a file marked as available or pending and a pop up menu will appear This menu will show a list of tools that can be applied to that certain file Th
13. Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 16 of 121 amp opos EY Human Machine Interface Hardware Interface Input Output Interface Control Document Integration Test Ice water content Royal Netherlands Meteorological Institute Large Eddy Simulation Long Wave 4 0 to 400 0 um Monte Carlo technique for Radiative transfer calculations Man Machine Interface Multiple Scattering Meteorological Service of Canada Reference Document Relational Data Base Management System Radiative Transfer System User Manual Short wave 0 2 to 4 0 um To Be Confirmed To Be Defined Decided Technical Note Unified Modelling Language 1 3 Definitions Auxiliary data These data refer to geophysical data produced by third parties and required as input for every kind of model e g ground albedo For the aim of EarthCARE the auxiliary data are not dynamic so they are constant through any given simulation As a special case auxiliary data also encompasses scattering libraries during the generation of UFF files DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 17 of 121 Se ae ER Batch mode It is the capability of the simulator to perform consecutive runs without a
14. Figure 4 42 Session Inputs definition Double clicking on the file instance column a file browser dialog will pop up The user can now navigate through file system directories to specify the desired file s location Note that at the time of DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 70 of 121 ae he E defining the simulations input files are defined from a general point of view e g a file with ground altitude It is in this step where a user can physically locate each file with the required data The Status column will show one of three different options for each file O Available green the file instance is present so the file is ready to be used for the model executions O Pending blue the file is not present but it will be generated for the model executions before needed O Missing red the file is not present and is not scheduled to be generated before needed Edit the file instance and change it so that it appears as an existing file File instance locations can be specified using absolute paths or SECSIM HOME relative paths 4 10 2 5 Provision of configuration files As it is done at the input data step the simulation needs to be provided with the location of configuration files needed by all the models involved in the simulation Figure 4 43 Session setup
15. elete iM New model Simulations Ctrl l Figure 4 37 Session pop up menu gt New simulation Sessions R New session Figure 4 36 Session menu Operations involving sessions include the following List present the list of existing sessions Creation capability to create a new session into the system Edition edit an existing session to enter changes Deletion delete a session from the system OoOcovooO Run Starts a new session execution O Script generation creates and stores a script describing the session 4 10 1 Session list Users can access to the session list selecting the List option from the Sessions menu Figure 4 38 shows an example of the session list window that is presented upon selection Below the table including the sessions existing in the system there is a tool bar with buttons to access to the different functions listed previously Users can thus select a certain session and perform the operations shown in the toolbar Data attributes shown in the session list table are session ID description and the name of the author that created the session DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 a ECSIM Date 07 05 2008 System User s Manual Page 67 of 121 Session identifier Description Author Sessions Backward Transforms the calibrated output of the instrume DMS KNM
16. field Users can change the number of log messages to be displayed For example if the Maximum number of rows displayed is set to 10 the list shall display the last 10 messages of the log session Users can also filter this list Users can select a field input a string that must contain this field and press the filter button Then another search is performed into the system and the results are shown on screen Only records fulfilling the filter restriction will be shown DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e A ECSIM Date 07 05 2008 System User s Manual Page 98 of 121 amp po ER N Listing log messages Filter Text to filter by Feldto erty Daem e Maximum number of rows displayed 1000 Log messages list Date andtime Type Message Session identifier Ej Dump log Figure 4 75 Logs list view Moreover users can access the dump log functionality at the bottom of the window Once selected users can select the name and location of the log destination file Then the list of logs shown by the window is stored in the file system 4 15 File system The last tab in the side bar named File system is a way to access the folder structure under the ECSIM HOME Organized in the tree like structure the user can easily locate every needed file This structure is refreshed every time an operation involving files is performed or once
17. 2008 System User s Manual Page 81 of 121 S PAC EF Editing scene scene inp General Dimensions Atmosphere Surface Clouds amp aerosols Unique identifier of the scene scene_inp File General description of the scene This is a scene Scene s author E accept cancel Figure 4 56 Scene General data 4 11 2 2 Scene dimensions In this frame users can define the X Y and Z O Editing x extensions of the scene and also specify the horizontal and vertical resolutions of the scene Top km 0 0 Step km 1 0 The horizontal resolution is fixed for the entire scene but it is possible to separate the vertical Ok Cancel resolutions in different layers managing the table shown in Figure 4 58 Figure 4 57 Scene Vertical resolution Clicking in the add or remove buttons marked with a document and a trash bin signs will respectively create a new vertical resolution layer or delete the selected one Once the add button is pressed a dialog will come up and the user can introduce this data Upper border of the resolution layer Local resolution of the layer This must be less than the difference between its top and the top of the previous layer Double clicking a resolution will also show this dialog and right clicking over it will show a context menu to edit the layer add a new layer or remove the selected one
18. COBIEUIIIOTU Go ete pe ote HEN aes vba Hp aet aerate 40 52 Tools accent RERO REN OR ete bv ea oam oup aba heals 42 qo NEW tool cocer tne eheu tuo erm dta potente e 42 A E 43 BS OD Delete 100i uie E E obae Re de EON rp ERE DEMO edema uf ewEta qus op EE node 43 253 OMNI A tenectutiuti iubeas reo ceca a a a saai 43 2 5 Eu COO SySIOD neos CO ECO O I EE NUES UunE E E MM LED 43 PA rras doood bir ASSANE OSa s na SE r SNS rE srra ai 44 A a ra a a aesa anoa aaa ieee 45 A Descriptor tato 45 4 7 2 DDeSserptor CO iii a a P ue EVIE 46 2 7 3 Descriptor COMMON id 47 4 74 Descriptor Ge let ON sic ie urbt tta ees Dreh esa e lloc recorta odie 47 T5 Modelos ehe uM LE EE 48 4 8 1 Model developers guideline o E 49 SERVII aa 49 gu dding A E A EIE RUE EON Md 50 del encadena 50 28 3 CODA DUO a 52 2 8 3 3 E aa 23 4 8 4 Model upgrade Now VEIA veo aS 54 LS e o en p EIE 55 48 6 Model deletion sa ads 25 Mit 55 A AS TROUT OO Upa 56 29 2 IMU AHOM CHCA ON E E E EIUS DS PUSIREURHEHER DW DR HER ERR REIR ETE 56 Z0 DA General DEGDOEUGS ied RO UE NR Ede NN ORUM EIUS E ENEE 57 92 2 NIodels A obses crac ut fall csncag penes sabsouecastantel tees cip ES aieo cus pop eid 58 4 9 3 Simulation creation example creating a forward simulation of the active instruments 39 4 9 3 1 Step 1 Entering the model tiara 59 4 9 3 2 Step 2 Selecting the first model of the simulation essere 60 4 9 3 3 Step 3 Selecting the remaining models
19. DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code Issue ra ECSIM Date System User s Manual Page ECSIM DMS TEC SUM 01 R 2 4 07 05 2008 82 of 121 S PAC m AN Editing scene scene inp 7 77777 77777 General Extent X Extent of scene km 10 0 Y Extent of scene km 10 0 Z Extent of scene km 100 0 Dimensions Atmosphere Surface Clouds amp aerosols Resolutions Horizontal resolution km 0 5 Vertical resolutions Number of vertical resolutions Element identifier Top km 7 vertical resolution 5 resolution resolution resolution resolution These vertical resolution layers are sorted in increasing order of their tops Figure 4 58 Scene Dimensions and resolutions 4 11 2 3 Atmosphere composition In this frame users can define the atmospheric gasses composition of the scene Users can specify some common gasses and even include series of extra gasses As seen in Figure 4 59 users can define the following attributes Temperature pressure profile An external file describing the composition of the atmosphere This file must follow the RD ICD directives Users can find a selection of profiles in ECSIM_HOME models aux standard_atmos profiles Mid latitude _summer xml CO mixing ratio Includes the CO in the calculations HO scale factor Includes the H20 in the calculatio
20. KNMI Figure 4 2 Main window appearance showing internal frames and scroll bars The MMI provides a menu bar Figure 4 3 at the upper side of the main frame to show some capabilities of the system DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e ECSIM Date 07 05 2008 System User s Manual Page 36 of 121 SPACE System Repository Scenes Executions Window Figure 4 3 Detail of main menu bar System Tools Ctrl T Show configuration Ctrl O GD About ECSIM Ctri A e Exit Ctrl X Figure 4 4 Detail of a menu showing menu items It is shown in Figure 4 4 that a menu item is an icon with graphically describes the function the name of the function and a quick access key combination Users can quickly access this functionality pressing this key combination or the letter underscored in the function name while the menu is rolled down There are also some contextual or pop up menus that users can access by clicking the right button of the mouse while over certain controls These pop up menus have the same appearance as menus rolling down the menu bar EP cin gt Run HE Generate script iW Delete Figure 4 5 Detail of a contextual menu It can be seen in Figure 4 5 that a pop up menu acts exactly like a menu at the main frame They also provide mouse and keyboard access to certain capabilities 4 2 Generic Fun
21. 01 R Issue 2 4 E A ECSIM Date 07 05 2008 a System User s Manual Page 59 of 121 S PAC EF Y Output Input Output is the set of files generated by a model Input is the set of files needed by a model OU Current simulation definition A tree showing the current structure of the models that will perform the simulation Models are shown ordered following the sequence that will be used later in the session execution Models are ordered by its family and internally into a family by the IO descriptors For example combined retrieval algorithms shall be executed after single instrument retrievals Users can select an individual model a range of models or a list of ranges using the left mouse button in combination with the shift and control buttons from the list of valid models Eventually the Previous stage and Next stage buttons are used to navigate through the models e g scenes instruments etc that define the simulation Upon selecting the next stage action selected models from the list of valid models will be included in the current simulation definition Pressing the previous stage button the simulation will be positioned in the previous stage and remark the previous selection of models 4 9 3 Simulation creation example creating a forward simulation of the active instruments This is an example that illustrates step by step the definition of the forward branch of
22. ED ed 49 igure 4 23 Model General Draperies au oett atte fer ven t e ta en ade tees 52 Rigure4 24 Model Con namato oss oo HERE RU RR ERE EREHAD PATRE FEN REGAT EN HA ITO UN EMEN neues 53 Figure 4 25 Model Input Output specification FUR RON ERE A RO NER IS ERR RET ERAS dp GRE ERN PUR 54 Fiore 4 20 mulattonS MON rial aaron rines pan 55 Figure 4 27 Simulation POpsup IMENU 1 ete te eventi e eee eS 55 Figuro 4 28 Silao ae 56 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 13 of 121 SPACEJ Figure 4 29 Figure 4 30 Figure 4 31 Figure 4 32 Figure 4 33 Figure 4 34 Figure 4 35 Figure 4 36 Figure 4 37 Figure 4 38 Figure 4 39 Figure 4 40 Figure 4 41 Figure 4 42 Figure 4 43 Figure 4 44 Figure 4 45 Figure 4 46 Figure 4 47 Figure 4 48 Figure 4 49 Figure 4 50 Figure 4 51 Figure 4 52 Figure 4 53 Figure 4 54 Figure 4 55 Figure 4 56 Figure 4 57 Figure 4 58 Figure 4 59 Figure 4 60 Figure 4 61 Figure 4 62 Figure 4 63 Simmulatton CEedblQt scis ertet ete ete pate e Oe Lb as AD LRL E AL RE pda 57 Defining a simulation initial model window esee 60 Defining a simulation selection of the first model seen 61 Defining a simulation presentation of consistent models see 62 Defining a simulation selec ng models
23. Performance Simulator for EarthCARE 1 0 ESIM VI REPORT Esa Contract 15346 01 NL MM The EarthCARE Simulator Users Guide and Final Report Issue 1 13 12 2004 AD SRD ECSIM DMS SRD 001 ECSIM System requirements document 1 5 AD ADD ECSIM DMS ADD 001 ECSIM High Level Architecture Document 1 3 2 2 Reference Documents RD UML ISBN 0 201 57168 4 The Unified Modelling Language User Guide Grady Booch James Rumbaugh Ivar Jacobson 2 1 1B RD DDVP RD TN ECSIM DMS DDVP 001 ECSIM DMS TN 001 ECSIM Design Development and Validation Plan Technical Note related to the proposed ECSIM Architecture December 13 2004 1 4 ES ESA NL MM ECSIM KNMI ICD 001 ECSIM DMS STS 001 RD SW contract 15346 01 EarthCare Simulator Users Guide and Final Report ECSIM Interface Control Document ECSIM System Tests Specification RD ICD RD STS 2 3 Standards ECSS 40 1B ECSS E 40 Part 1B ECSS E 40 Part 2B Software Part 1 Principles and requirements ECSS 40 2B Software Part 2 Document Requirements Definitions DRDs Annex 1 of AD SOW ECSS E 40 Tailoring STD SOW ECARE ETE SOW DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 21 of 121 3 1 Introduction The ob
24. Please input a valid identification to the session Validation error Follow the instructions to correct the value File IO Error Follow the instructions Repository Simulations Accepting changes Simulation modification failed DEIMOS Space S L 2007 Possible database failure Is your database running and configured DMS DQS QREO609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue i 2 4 a Date 07 05 2008 System User s Manual Page E 106 of 121 RAR ey Simulation addition failed You have chosen a duplicated identifier Please provide a different identifier Validation error Follow the instructions to correct the value Deleting a session Database error Possible database failure Is your database running and configured Executing a simulation Validation error Follow the instructions to correct the value Setting limits Validation error Follow the instructions to correct the value Executions Log Dumping the log File IO error Follow the instructions In general every time an input value is needed the platform will perform a validation process If the input does not comply with the needed format the user will be informed with a self explained message Errors not shown as part of the graphical interface are not controlled messages They correspond to messages from the standard output or error stream When executing a simulation models raise their
25. SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 e IT d System User s Manual Page 93 of 121 S PAC EP Merge scenes These scenes must be uff files First scene Second scene A Options z1 10 z2 10 buffl o buff2 This system product tool is defined in System Show configuration 9 Resulting scene Product tool tools product tools bin uff merger Ok Cancel Figure 4 67 Scene Merge Users can input the location and name of the input scenes first and second and provide the name and location of a resulting scene combination of the two others Once finished clicking on the Ok button will call the designated product tool to perform the merge operation 4 12 Executions As mentioned in section 4 6 ECSIM can be divided in three logical parts repository scenes and executions The third of these parts named executions represents the dynamic view of the system Here the executed sessions are stored with their input and output data Users can consult their results and log messages generated as well as re run sessions as needed 4 13 Results Once a session is executed an execution result whether it was successful or not is stored into the system into the lt sessions gt folder named as lt session_id gt lt starting_time gt Starting time is coded as YYYYMMDDHHmnmSSsss in local time 9 sae sss denotes miliseconds
26. a simulation 4 9 3 1 Step 1 Entering the model list tab The user has chosen in the General tab to indicate the forward branch of the simulation process from scene to instruments as appearing in Figure 4 30 The models tab panel will first show a list of available models to create a scene as the first processing step of an End to End simulation consists of the scene generation DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e a ECSIM Date 07 05 2008 System User s Manual Page 60 of 121 Creating a new simulation General properties Identifier active Author Dms Description with all active instruments CPR amp ATLID Instruments ATLID CPR LJ BBR msi Models schema Simulation Stages Scene Platform Forward Instrument Scene models available Current simulation definition Model identifier Type Description Author i Element identifier SCENE_CREA Scene Default scene KNMI a D Simulation definition Previous stage i gt Next stage E Accept Figure 4 30 Defining a simulation initial model window 4 9 3 2 Step 2 Selecting the first model of the simulation The user can now select one of the scene generator models from the list in the example there is only one available by means of the Next stage button to add it to the simulation s structure The result of this
27. activated by the correspondent button e File global This scattering region is defined via an external file that fulfils the RD ICD and the limits of the scene in the Z axis The location of this external file must be input in the text box besides or via the file chooser activated by the correspondent button Q Region dimensions Depending on the defined region type users can input two or three dimensional limits for the scattering region 4 11 2 5 2 Non fractal region attributes Size distribution type Options log normal or This is the type of the particle gamma gamma size distribution Scale type Options extinction and water This is the way the particle extinction content scale is measured O Relative altitudes It is possible to define information about the size distribution of this scattering region Users can add or remove individual size distributions with the plus and minus buttons Users now can access to these individual parameters Relative altitude Float 0 0 1 0 Relative altitude in km for this entry Mode ext or wc Float Scale value 1 m at 500nm if scale type is extinction or g m if water content Mode reff Float Effective radius in microns r where r D 2 and D is the particle maximum dimension Mode shape parameter Shape parameter of size distribution Mode r min Lower limit of particle sizes to include in microns Mode r max Upper limit o
28. compiler you used and the drivers you included Example values can be these O PGPLOT FFLAGS lifport PGPLOT_LIB 1X11 L GCC LIB lgcc lgfortran g traceback CB Library compiled with gfortran O PGPLOT FFLAGS lifport PGPLOT_LIB 1X11 L GCC_LIB lgcc Im lc lg2c g traceback CB Library compiled with g77 O PGPLOT FFLAGS lifport lpng PGPLOT_LIB 1X11 L GCC_LIB lgcc Im lc traceback CB Library compiled with ifort and including PNG driver Before the models are compiled you must copy your CFI installation folder to SECSIM HOME models orbit dms aux CFI DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 31 of 121 amp op om Eg Then you can compile the scientific models and tools with this sentence ECSIM models make all 3 4 4 Folder structure This section provides a general description of the ECSIM folder structure and its contents aux bin doc models A aux O channel definitions L msi lookup scattering libraries solar data standard atmos profiles surface files xml common model name gt O aux O bin O conf O src QO TEST DMS ECSIM home root Install Scripts for setup in Linux ecsim Starting up script for Linux ECSIM properties The configuration file ECSIMdb sql The original MySQL database scr
29. creation with all data corresponding to selected simulation already filled in In this occasion only the description can be changed Once the user has finished with the simulation edition the changes can be either accepted or cancelled making use of the corresponding buttons at the bottom side toolbar 4 9 5 Simulation deletion Users can select a certain simulation and choose the option to delete it The user needs to confirm the operation to completely delete the simulation from the repository Note that for consistency purposes DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 65 of 121 sPACEJ the deletion of a simulation implies also the removal of every session and its results that uses this simulation from the system 4 9 6 Simulation execution The execution of a simulation is accessed by either selecting Execute from the context menu at the repository view or selecting the option from the actions tools bar of the simulation list frame This functionality is meant to rapidly create a session from a given simulation Thus the system will show a window like the example presented in Figure 4 35 This window corresponds to a session creation but the selected simulation is already included in the simulations set and the description and author fields are filled with information extracted from the simulation Th
30. element s section A double click over the elements will activate the first associated command of the menu typically edition 4 7 Descriptors ECSIM has the possibility to define the set of input and output files called descriptors used to connect different models in simulation runs Users can access the list of nominal descriptors those provided in the default distribution inside the repository view of the side bar as seen in Figure 4 17 Accessing the corresponding menu of the main menu bar or the context menu of the side bar users can activate the following functionalities L List presents the list of existing descriptors O Creation creates a new descriptor into the system O Edition edits an existing descriptor to enter changes O Deletion deletes a descriptor from the system 4 7 1 Descriptor list Element identifier Repository 9 C Descriptors ATLID LO L1 ATLID L2a ATLID specifics ATLID CPR MSI INPUT BBR LO L1 BBR L2a CPR In CPR LO L1 CPR L2a CPR Specifics L2a LIDAR L2b L2b 3D MSI LO L1 MSI L2a MSI BBR INPUT Pointing SCENE description SCENE UFF S W LW specifics TOA SVV LVY fluxes o 3 Models gt C Simulations o 7 Sessions Figure 4 17 Descriptor Side bar Users can access to a window that provides a tree like structure with the list of descriptors known by the system just as in the side bar but with the additional information of i
31. identifier Simulations Backward Complete Forward Lidar Radar RadiativeTransfer SceneCreation Synergy Description Transform Simulates Forward b Simulates Simulates Generates Generates Combines DMS amp KNMIRetrieval DMS KNMIScene DMS amp KNMlIScene DMS amp KNMIScene DMS amp KNMIScene DMS amp KNMIForward DMS amp KNMIScene DMS amp KNMIScene Retrieval Retrieval Instrument Retrieval Retrieval Forward Scene Retrieval Figure 4 41 Session Simulations specification Users can also remove a desired simulation from the session s simulations set by just selecting it and clicking the remove button It is also possible to alter the simulations execution order Users can move up and down a selected simulation from the list 4 10 2 4 Provision of input data Selecting the first tab of the session setup Figure 4 42 the system will ask for the location of the input file list needed to start the simulation Session setup Configuration Parameters Input files list Default file File instance Ei Input ci Radar 9 J scene creator xml 1 0 3 scene inp xml scene xml Missing 9 J orbit dms 1 0 3 scene uff 9 rad filter 1 0 ecsim orbit xml uff adjust xml scene uff c radar 1 0 EA P scene uff Pending ecsim_orbit xml products uff adjust xml scene uff Pending Available Pending bt Anc ir
32. implied warranty of Upon the selection of this function ECSIM will ask to stop HERIDO Or SEPA every internal process and will end its execution This is the PARTICULAR PURPOSE See the GNU Lesser x B s General Public License for more details recommended way of ending the application You should have received a copy of the GNU Lesser General Public License along with this program If not see http www gnu org licenses gt Other models product tools and products plugged in this framework follows their own licensing scheme Ok Cancel DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 44 of 121 S P AC EJ 4 6 Repository The ECSIM system can be divided in three logical parts repository scenes and executions Scenes LP Pm Il Produces Executions Figure 4 15 ECSIM logical flow The first of these parts repository is involved in defining the static view of the system the definition of the ECSIM tool This is the place to access and define all the elements that later on will serve as bricks for the simulation executions LY Models executable entities that will perform the scientific or engineer calculations Q Descriptor to define which models can be linked in which way U Simulations sequences of models linked by the descriptors OU Sessions complex set of simu
33. intended to present independent modules of the simulator For example each time the user wishes to perform operations with the list of models of the system a model manager frame will pop up inside the bounds of the main window listing the list of models currently available within ECSIM N ECSIM EarthCARE simulator System Repository Scenes Executions Repository scenes Executions File system Search object in repository Element identifier 7 Repository a o 5 Descriptors 9 Models 9 Scene 3 scene creator xml 1 0 E Platform x 5 orbit dms 1 0 Working area c3 Forward lid filter 1 0 Iw rad 1 0 rad filter 1 0 sw rad 1 0 E Instrument bbr 1 0 lictar 1 0 msi 1 0 n radar 1 0 Side bar CJ Retrieval lid_l2a 1 0 lid_rad_l2b 1 0 hw_msi_lid_rad_12b_3d 1 0 msi I2a 1 0 rad I2a 1 0 pai oim Auxiliary panel ackwari Complete Forward Lidar deimos Figure 4 1 Main window appearance DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 35 of 121 S p EM All the windows have common operations to help their usability main window internal frames or dialogues can be closed resized maximized or minimized to fit the user s needs This main window shown in Figure 4 1 includes a
34. keyword L2 They are sometimes known as backward models Scene Ensemble of atmospheric data that defines the initial conditions of a simulation A scene is composed by four basic ingredients Q Ground It contains the ground type and associated properties e g if selected ocean the user does not need to input its albedo In addition the ground elevation is considered Other properties could be ice snow masks Atmosphere it includes the pressure temperature profile and the amount and distribution of several absorbing gases Aimed for Radar ocean issues it also includes wind speed O Aerosols small particles suspended in the atmosphere that are not either liquid water or solid ice and that are distributed homogeneously in a given 3D region Clouds collection of condensed liquid water or ice crystals with a regular or fractal spatial distribution Clouds and aerosols can overlap and intersect Note that scenes are understood generically as binary files with UFF format This is why within the ECSIM framework the words scene and UFF are used sometimes as synonyms DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 19 of 121 amp poA S ER Session A session is defined as an execution of a simulation an ordered set of simulations or an iterative execution of simulation s with different para
35. known data already filled The window shall present fields in write mode only the data that is susceptible to be modified only description and author If users want to change more attributes of a certain model other operations must be used model creation or new model version This frame is intended to let users modify data of a certain model Once they have finished with the edition they can accept or cancel the changes made with the buttons at the bottom side toolbar 4 8 6 Model deletion Users can select a certain model and choose the option to delete it Once users confirm the operation the model is erased from the repository and the file system Note that also every simulation session and its results that uses this model will also be erased from the system for consistency purposes 4 9 Simulations As defined in section 1 3 a simulation is understood as a list of models or even a model alone that is run sequentially and produces observable results Users can access to the list of simulation known by the system in the repository view of the side bar or via the Simulations menu Figure 4 26 from the main menu Repository E Edit Descriptors Ctri D gt Execute R New descriptor i Delete Models Ctrl M Figure 4 27 Simulation Pop up menu R New model Simulations Ctrl l R New simulation Sessions Ctrl S iM New session Figure 4 26 Simulatio
36. of 121 SPACEY This execution report consists in a textual description of the same data that users can access with the Result view functionality The only difference resides in that this textual information can be copied and pasted into another application outside the ECSIM system 4 13 4 Delete result Users can select a certain execution result and choose the option to delete it Once users confirm the operation the execution result is erased from the repository and the file system Log messages associated with this session execution result will also be erased 4 14 Logs Executing sessions has a secondary consequence a set of events are produced and stored for the system These events are described in detail in section 4 10 5 Users can access to the complete set of logs stored by the system in the Logs menu Figure 4 74 from the main menu Session results Ctri R E Logs Ctri L Figure 4 74 Logs menu 4 14 1 Log messages list The figure below shows a window with a list of log messages stored by the system As can be seen the table shows the computer date and time when the platform intercepted the event the type of the event a message describing the event the identifier of the session associated to the event and its detailed source model simulation session or system This list of events is sorted by default in increasing time order until filling the Maximum number of rows displayed
37. parameters rad freq 94 0 95 0 D parameters rad freq 94 0 c Complete 9 E orbit dms 1 0 parameters propagation step 0 5 1 rad filter 1 0 parameters rad freq 95 0 C Complete 9 E orbit dms 1 0 parameters propagation step 0 6 Ej rad filter 1 0 parameters rad freq 94 0 cI Complete 9 orbit dms 1 0 parameters propagation step 0 6 EJ rad filter 1 0 parameters rad freq 95 0 Ok Cancel Figure 4 49 Session creation Pre viewing the parameters iteration DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 76 of 121 SPACEY Readers must know that the ECSIM system can filter redundant models out of an execution process There is more information in chapter 4 10 5 4 10 3 Session edition It is possible to edit a given session and create a different one altering the information previously stored Consequently changes made to the session will not alter the previous but will create another When editing a session the system will show the same window as shown in the session creation But this time all the information concerning this session will fill every data field Once finished the user can cancel the changes or execute this new session pressing the Run button 4 10 4 Session deletion Users can select a certain session and choose the option to delete it Once
38. rebin e ncBrowse view e NetCDF differencer differentiate e plot 3d plot HE plot hor plot e plot profile plot HE plot slice plot Figure 4 77 IO file pop up menu Once you select the desired action a dialog will show up asking you for completing the executable command line Users can accept the default parameters the absolute path of the file or can add extra Users can also make use of the ECSIM environment variables described in section 3 5 1 writing the dollar symbol and its name For example SECSIM HOME or STD ATMOS Once accepted the parameters the external program will be executed in a separate thread so the ECSIM operations are not interrupted 4 16 Persistent storage Database and file system Most information systems must store information in a persistent way ECSIM system trusts in a relational database to store structural information and the file system to store the input output configuration files The following list shows which ECSIM elements are stored in database and which into the file system System Configuration File system SECSIM HOME ECSIM properties System Tools Database Repository Descriptors Database Repository Models Database Repository Simulations Database Repository Sessions Database Repository Session script File system sessions folder gt lt name gt lt name gt sh Scenes Scene description File system lt scenes_folder g
39. recon scene config xml 5 5 3 Steps O Select from the repository tab of the side bar a session named E2E Right click on it and select the Edit option OU Browse every field of the input configuration parameters output and tools tabs to edit the values you desire You can use the files in the table above to perform a sample full end to end simulation L Once everything is OK click on the Run button to start the execution O The execution will start and you can see its progress status L Once the simulation ends you can access to the scene comparison feature in the main menu and see a graphical comparison between the original scene and the reconstructed scene O Other operations you can do upon the execution s end are to check every other generated file or the final execution report where you can find detailed information about it 10 This is the way to use the output of a simulation as input for another DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 118 of 121 S PAC EJ 5 6 List of available scenes ECSIM distribution includes some scene definitions for testing purposes in the final delivery Here is their description O standard test scene Standard scene for testing purposes Defines two scattering regions one with a background sulfate areosol layer and another whi
40. results These tools must be well defined and accessible for the system The following set of input auxiliary and configuration files will be defined scene creator xml Input scene inp xml ECSIM_ HOME sessions Forward 0 Forward scene inp xml orbit dms Input scene uff Pending orbit dms Configuration orbit dms config xml ECSIM_HOME sessions Forward 0 Forward orbit_dms_config xml rad_ filter Input uff_adjust xml ECSIM_HOME products uff_adjust xml rad_filter Input scene uff Pending rad_filter Input orbit xml Pending rad filter Configuration rad filter config xml SECSIM HOME sessions Forward 0 Forward rad filter config xml radar Input rad filter out nc Pending radar Input orbit xml Pending radar Configuration radar config xml SECSIM HOME sessions Forward 0 Forward radar config xml DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 110 of 121 S P A C EJ 5 1 3 Steps O Select from the repository tab of the side bar a session named Forward Right click on it and select the Edit option L Browse every field of the input configuration parameters output and tools tabs to edit the values you desire You can use the files in the table above to perform a sample full end to end simulation L Once everything is as your wishes click on the Run but
41. that the radar instrument is executed three times one per each configuration so you can compare data from the three different situations 5 5 E2E simulation 5 5 1 Operation objectives The objective is to perform an end to end simulation for the EarthCARE simulating a real situation and the retrieval processing and then comparing the output obtained at ground segment with the original scene DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E 2 4 07 05 2008 115 of 121 ECSIM DMS TEC SUM 01 R Code Issue Date Page ECSIM System User s Manual S PAC EP i Ayer 10 ueppi ee swoue 3 awos MOY meg 100 JONPA uosueduoo uosueduloo 1 auas seusog von j E uoneuuojur JUBARIAL um e peejeuec sieyetueued ajy uoneun iuoc sjoquiAs uieiBeiq ssexosd S100 jonpoud ypa abejs aunsor uonnaexe au jo wed puooes sepes Aseuyq ajqeynoex3 AA uncausos paronujsuooey ining infit HH un Byuoo pe qzj pes py Isu juncByuoo gz pes pi fuxByuoo ez pes E uno sus Byuoo pe m e E yo edid qui Byuos saj per jux jsn pe yn ES junc dui aueos i quneByuos sayy pi ssaoqid uognoexe au jo ped 18114 ux 6guco ezi pi DMS DQS QREO0609 SUM 10 E End to end simulation schema DEIMOS Space S L 2007 Figure 5 1 Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 d e im jS System User s Manual Page 3 116 of 121
42. the earth of the instruments Note that actually there is no management of the physical dimensions of a platform or spacecraft All the instruments will be considered located in an orbital point Product or An identifier representing the amount of processing of the instrumental output processing A LO raw data from the instruments Not used within ECSIM version 1 2 level m Lla Level 0 contents with corresponding radiometric spectral and geometric i e Earth location correction and calibration computed and appended but not applied Not used within ECSIM version 1 2 L1b Fully geo localised products as well as error estimates and reliability data for each data set The data shall be calibrated to engineering units using the best possible characterisation data available Llc It is applicable only to the MSI instrument It consists of L1 MSI data re sampled to a specified spatial grid It shall be possible to use different methods for image re sampling Among them there shall be available at least e Bi cubic convolution interpolation e Nearest neighbour AU L2a Single instrument science products Q L2b Science products using more than one instrument in synergy In some circumstances Ll a b and L2 a b are also written as L1 and L2 through the main text Retrieval Models that transform the calibrated output of the instruments into geophysical models products represented also with the
43. the operation is confirmed the session is deleted from the repository and the file system It is to be noticed that for consistency reasons the session deletion causes the removal of all results generated from that session from the system 4 10 5 Session execution run Once a session definition is ready users can execute it Upon the activation of the run command the system performs a series of checks to ensure the validity of the session O If there is any file with the missing status that is the system is unable to find in the given location ECSIM will assume that this file will be in the right place when needed so it leaves the responsibility of placing it in the correct place to the user or to process outside the system A fatal error will be raised and the execution stopped if a model cannot locate the needed file Q In some cases like executing iterative sessions or sequences of simulations with the same models some of the models may be redundant that is they will generate the same output because they are run with the same input and configuration DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 17 of 121 o Editing x List of models to be executed showing their redundancy You can choose to either execute or ignore them Model Redundant Ln m 3 m m pe Im a o E I
44. the repository tab of the side bar a session named Synergistic Right click on it and select the Edit option DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 113 of 121 S OB de du EJ OU Browse every field of the input configuration parameters output and tools tabs to edit the values you desire You can use the files in the table above to perform a sample full end to end simulation L Once everything is as your wishes click on the Run button to start the execution OU The execution will start and you can see its progress status O Once the simulation ends all the post processing tools will start and you can see how the scene will be obtained in the case of operating with only the CPR and ATLID instruments OU Other operations you can do upon the execution s end are to check every other generated file or the final execution report where you can find detailed information about it 5 4 Experiment with Multiple runs 5 4 1 Operation objectives The objective is to perform an iterative simulation of a certain simulation in this case a RADAR simulation testing the changes on a certain parameter 5 4 2 Pre conditions A previously defined session called Radar exists in the repository This session includes L One simulation named Radar This simulation starts from the scene creator t
45. the user presses the refresh button DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 39 of 121 Repository Scenes Executions CFile system Browse through the file system File r B classpath project o ci settings ECSIM properties ECSIM db sql Future things txt o 7 META INF Models integration report xls Models performance study xls TODO list xls Tech used txt o aux o cj bin ci doc ecsim ecsim bat install install bat javadoc xml Igpl 3 0 txt log txt gt C models D mysql connector java 5 0 4 bin jar cf old models 20071005 c old tools 20071005 3 products G releaseMaker J releases o J scenes CJ screenshots ci sessions O src e 3 tmp o tools c unitTests cf workshop Figure 4 76 File system view 4 15 1 Tool execution As declared in section 4 5 2 the ECSIM system can associate external tools to a series of file extensions In case the user right clicks over a file name whose extension is associated to one or several product tools a menu showing some actions will pop up DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 100 of 121 S P A C EF Execute e I1 12 compare compare S3 11 02 rebin
46. to perform a full end to end simulation for the EarthCARE simulating a real situation the behaviour of several on flight instruments and the retrieval processing and then comparing the output obtained at ground segment with the original scene In this case the simulation will use both the ATLID and CPR instruments and will retrieve a combination of both outputs 5 3 2 Pre conditions A previously defined session called Synergy exists in the repository This session includes Q One simulation named Synergy This simulation starts from the scene creator to the retrieval stage and it contains all the models related with only the ATLID and CPR instruments O A list of product tools to visualize the results These tools must be well defined and accessible for the system The following set of input auxiliary and configuration files will be defined scene creator xml Input scene inp xml ECSIM_ HOME sessions Synergy 0 Synergy scene inp xml orbit dms Input scene uff Pending DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E N ECSIM Code ECSIM DMS TEC SUM 01 R Issue 2 4 Date a 07 05 2008 System User s Manual Page 112 of 121 fe Ae EY orbit_dms Configuration orbit_dms_config xml ECSIM HOME sessions Synergy 0 Synergy orbit_dms_config xml rad filter Input uff adjust xml SECSIM HOME sessions Synergy 0 Synergy uff adjust xml rad filter Input scene uff P
47. uff_adjust xml ECSIM_HOME products uff_adjust xml lid_filter Input scene uff Pending lid_filter Input orbit xml Pending lid_filter Configuration lid_filter_config xml ECSIM_HOME sessions Lidar 0 Lidar lid_filter_config xml lidar Input lid_filter_out nc Pending DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 111 of 121 pA EN lidar Input orbit xml Pending lidar Configuration lidar config xml ECSIM_HOME sessions Lidar 0 Lidar lidar_config xml lid_La Input lidar_out nc Pending lid 12a Configuration lid 12a config xml ECSIM_HOME sessions Lidar 0 Lidar lid_12a_config xml 5 2 3 Steps O Select from the repository tab of the side bar a session named Lidar Right click on it and select the Edit option OU Browse every field of the input configuration parameters output and tools tabs to edit the values you desire You can use the files in the table above to perform a sample execution Q Once everything is as your wishes click on the Run button to start the execution U The execution will start and you can see its progress status U Once the simulation ends all the post processing tools will start and you can see how the scene will be obtained 5 3 Synergistic Instrument Retrieval 5 3 1 Operation objectives The objective is
48. will have the input and configuration files used by the models and their outputs Framework sources Framework temporal directory ECSIM tools root folder tp Test procedures home folder Every test run in the system test campaign has its own sub folder structure O tp lt tp_number gt Individual test procedure folder Each test is identified with a four digits number OA input Input files needed for the test L output Generated output files during the test L reference Reference data needed for the test 3 4 5 Licensing scheme Due to the heterogeneous precedence of the contributions to this ECSIM project various licensing schemes are applied Here readers can find a list of the different license types used in the project Models developed by Exceptions KNMI 1 cloud fractal generator model type scene is GPL 2 fast lidar scattering model model type forward is GPL Orbital model This is based on the ESA CFI only available upon request to ESA Licensing is then conditioned to ESA Framework HMI DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM ram S Date 07 05 2008 de l I i i IS System User s Manual Page 33 of 121 S PAC Ep 3 5 How to Start the Application The ECSIM framework can be launched using a command line interface and executing the following command ECSIMS sh ecsim or into a Bourne shell ECSIMS e
49. 08 System User s Manual Page 24 of 121 S P A C ES 3 2 Conventions used in this Manual This chapter lists all the conventions used throughout this Software User Manual 3 2 1 ECSIM HOME All through the contents of this User Manual a variable called SECSIM_HOME is exhaustively used as a placeholder This variable value points to the root folder that contains the ECSIM installation Typically this folder could be similar to this usr home user name ECSIM This variable matches with one environment variable defined in the SW You can find more information in section 4 5 1 3 2 2 Data types Every requested or given piece of data in ECSIM is formatted in one of the following data types Short string A string of alphanumeric characters with a size not greater than 25 Medium string A string of alphanumeric characters with a size not greater than 75 Long string A string of alphanumeric characters with a size not greater than 255 Unsigned integer Integer number no decimal part between 0 and 2 Signed integer Integer number no decimal part between 2 and 2 Float Decimal number between 2 and 2 2 2 Boolean TRUE of FALSE File The absolute or SECSIM HOME relative path and name of a file into the file system Folder The absolute or SECSIM HOME relative path and name of a folder into the file system D COL COLDCLULDIo ZLU 3 3 Initial Requirements The ECSIM system is prepared to run in a h
50. 18 5 7 List of available tools eres eese eee A AAA 118 List of Figures Figure 3 1 Fall BGSIM Schema atada A PA BUR FUMER E eat 23 PIig re d 1 Main window apDearaloe ceci ive ee e IRR I HO HS ottenere ve eie tes 34 Figure 4 2 Main window appearance showing internal frames and scroll bars sss 35 Figure 43 Detail of rian ment Di 36 Figure 4 4 Detail of a menu showing menu items i i re ripa FE t PEE REL FERE PNE RR ERE Ro Pre steeceabassede Habsnsonspeabense 36 Figure 4 5 Detail ota contextual mena sce e i erre e UE Demetr c ep Orten Vei du re uet eme n uv iD Fette 36 Figure 4 6 File chooser diolog eee a Fipured 7 Dialog example A Rae ee arate teas 37 Figure 4 8 Frame mana OL 38 Figure 4 90 Internal kame Bellota ral 38 HigureA 103 System 39 MUS E A rm 39 Figure 4 12 System configurato laa 40 aris dlo Toole SE Poem 42 Figure 4 14 Tool Creation aai n i ninin arn Ele e lb EEE ENE EEEE E EE 42 Roura LCSIM di teehee E E ER a AEEA ee 44 Figure 4 16 Repository VIEW ara 44 RigureA 17 Descriptor Sid D eei E E 45 Figure 4 18 Descriptor list VIGW 2 esee ker pk iae Fea ads ERE sav EIN EUR URS ERR REN EATE NERAN AENT 46 Figure 4 19 Descriptors New descriptor uL cse rio Rb rrae t PEL bea EH e EE EREERAA PES ERE PRAE EAR MA HEAR PARE PEB E abia 47 Figure 4 20 Repository Men s os ea irte n benedi o a Ms tates Unete tede ae 48 Figuro 4 21 Model Pop Ma 48 Powe 4 22 Moa Hisl Se sca rixt Rai eee ORO ERE
51. 2 d image plot DEIMOS Space S L 2007 tools pgplot_tools bin plot_hor DMS DQS QRE0609 SUM 10 E oo e EL System User s Manual Page 120 of 121 Bde dx EJ plot profile ECSIM This program reads a 2 D height vs along track data file generated by extract quantity lidar radar etc and produces a profile plot corresponding to a specific along track point Multiple data files and quantities are possible and can be plotted using different line types thicknesses and colours A legend box is also plotted Code Issue Date ECSIM DMS TEC SUM 01 R 2 4 07 05 2008 tools pgplot_tools bin plot_profile plot_slice This program reads a 2 D height distance data file generated by extract_quantity lidar radar etc and produces a 2 D image plot tools pgplot_tools bin plot_slice uff_averager This program reads an UFF file and using simple averaging it outputs a UFF file of lesser resolution Size distributions are averaged on a bin by bin basis over the desired domain tools product_tools bin uff_averager uff_merger This program merges two UFF files in the vertical coordinate tools product_tools bin uff_merger View PS files PS files viewer evince View sh SH files viewer gedit View XML XML files viewer gedit XML differencer Finds the differences between two xml files DEIMOS Space S L 2007
52. 3 is presented to the user m Editing xj ure rawar Model 0 SCENE_CREATOR_XML null Input 000 Input scene inp xml scenes scene inp xml Available Configuration O O O Configuration Default configuration file Parameters Output 0 0 0 Output scene uff scene uff Pending Model 1 ORBIT_DMS null Input 0 10 Input scene uff scene uff Pending Configuration O 1 O Configuration models orbit dms conf ecsim orbit config xml models arhit dims conf ecsim orbit config xml Available Parameters 0 10 parameters along track corr shift radar SYNC Radar correction for non nadir pointing km FLOAT 0 01 01 1 parameters along track corr shift lidar SYNC Lidar correction for non nadir pointing km FLOAT 0 02 0 12 parameters assummed off nadir angle radar SYNC assummed off nadir angle for radar view deg FLOAT 0 03 1 3 parameters assummed off nadir angle lidar SYNC assummed off nadir angle for lidar view deg FLOAT 0 04 0 14 parameters execution mode USER or CFI orbit STRING USER 015 parameters azimuth sun USER solar azimuth deg FLOAT 90 0 90 0 v st oe amom ane Ll a AE Ut Ok Figure 4 73 Execution report DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 97
53. 41 Hardware Tequirements E 24 3 3 2 Operating system ES USES A ia 24 3 3 3 Framework pte ICI uan 23 3 331 Models and product tools znimum pre requisitos oo e uper re tne EE Opp aun E REIR 25 3 3 5 Models and product tools optional components sess 26 3 4 How t Install the Application puo see tore bh e aee neces eene ao ee ver saaneet eee nose ER eae Seve See eer sans Se neun 28 Sl Framework sta Maui a cad 28 34 2 Scattering libraries and DEM installation iia 29 301 2 1 Scattering BANG Sesona aes test ca cexy A Mme M UAE REM E tes 29 dopo DM aaa 30 24 3 Model comp iooi do 30 DA Folder SUC propia e RE EENES 31 A pi OE ERE EE Pe Ped shes ee ipte Bio DAS Ae cp ogE o nah us uo coobe ut dndd 32 3 5 How to Start the Application iro iani etorti dini Ihe CREER ERAT ERE ri 33 Seoul Bnvirontment Vartables otr 33 4 ECSIM Reference manual sio thes uh preasbo oo nh epa sepa ee R PE xn RE a ERR oo ERE oC ERE E Hen Rao ca ebaS OR a teses sees iss RERu RD 34 AD BD MT n 34 4 2 Generic Functions dialogues and displays eere eee eee ee sees eene teen ete tnn etae tn sense tassa snas tnas 36 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page ELS sPACEJ 4 3 Frame management e 37 4 4 Side AAA 38 ASS Macia iaa QU des 38 4 5 JT SOW
54. 609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ra ECSIM Date 07 05 2008 e IT System User s Manual Page 4 of 121 S PA C EF Document Status Log Issue Change description Date Approved 1 0 This version is produced for PM2 starting from the draft 19 04 07 discussed at PDR T Updated sections 4 and 0 to cover RID PM2 RFO1 15 06 07 Updated sections 3 and 3 3 to cover RID PM2 RF02 Updated batch mode definition in section 1 3 to cover RID PM2 DL22 Updated simulation definition in section 1 3 to cover RID PM2 DL23 Updated foot note in page Error Bookmark not defined to include the definition of vertical dimensions Major changes in section 4 Screenshots have been updated 1 2 Included changes all over the document to fulfil PM3 RIDs 03 07 07 and actions Fixed typographic error in Document information 24 09 07 External distribution 2 0 Major changes all over the document 17 10 07 2 1 Changes to meet ESA s comments on 9t November 2007 15 12 07 Section 3 2 1 Clarified the correspondence between ECSIM HOME the placeholder and ECSIM_ HOME the environment variable Section 0 Detailed the models that need the scattering libraries Section 3 4 1 Added instructions to copy the MySQL connector J jar file to the system Section 3 4 2 completed with instructions to install the scattering libraries and DEM Section 3 4 3 Detailed and explained the variables
55. Date 07 05 2008 le l I i i IS System User s Manual Page 7of 121 S PAC EP 2 4 Changes to meet ESA s comments at AR closeout Q Updated section 3 3 3 and section 3 3 4 to e Fix the Fortran Compiler version e Remind to set the root user name and password after the MySQL server installation e Stick to the SUN Java RE QO Updated figure 3 1 to show a more simplistic block diagram DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 8 of 121 Table of Contents T Introduction and PUEPOSE siaisicccscsssvssscavssscasesssapssevassesvossensenedabesedsvonsepSsecavbsodsboasesb ssavboieapoasepbossasesedens 15 Mg lm 15 1 2 Acronyms and ADDFeviatll OBS ad 15 DO T 9 16 2s Related documents isscis co casestebussside Goasonteciuedsesscccauss caunevteaseuseus tuasnesbeusesecsusndiutdedesscsneried 20 2 1 NN AAA AP an 20 2 2s RETEFENCE DOCUMEN ES eR 20 2 3 Sindari ii 20 2 EME SEUA iaa 21 EMIT 21 3 2 Conventions used in this MaNUal sissssscssscsssessessessacsessessssssessesssesssessssesseissonssessesseodsssesssssssnscsseessesssess 24 Exp A ena aa AAAA E 24 J od MANA Uy PE e EE A ERE A A D 24 3 3 Initial ReguireMeMiS cnni aiaa cans aaae 24 3 3
56. Default file bit dms conf ecsim orbit config xml lt xml version 1 0 gt lt ecsim_orbit_config version 1 0 Tencoding ISO 885 9 1 parameters gt Mo lt parameter name along_track_corr_shift_radar description SYNC Radar correction for non nadir pointing type FLOAT value 0 01 units z km gt parameter name along track corr shift lidar description z SYNC Lidar correction for non nadir pointing type FLOAT aluez on un km EN Accept Cancel Figure 4 24 Model Configuration 4 8 3 3 IO descriptors The Input and Output tabs Figure 4 25 from the Model properties window enable users to specify respectively the contents of the input files expected for the model and the output files the model produces as output Thus users can select Input and Output tabs in order to define to the IO descriptors for this model IO descriptors are intended to allow the model connection when defining simulations Each IO descriptor has an identifier that uniquely identifies the descriptor among the system It may happen that an IO descriptor for a new model may exist already in the system that is this model uses the same type of files and file contents as another model Therefore a combo box component is presented with the list of known IO descriptors in case the user desires to select an existing one DEIMOS Space S L 2007 DMS DQS
57. ECSIM System User s Manual 22 of 121 Page S PAC EP Aipejo soy ueppt ee swoue awos oj meg 100 npo Aseulq ejqeinoex3 Bpow uogewsoyut ju amp ajas Wi aly pejesoues sse owesed ajy uoneun6guo saxny eo Jo payeyep jou ase uosuedwoo seouejpes MI pue sexny MI VOL aJn sjoquiAs wesBeig i 5 saxny 3 MS VOL w uosuedwoo sexny uospeduoo sexny MS MI VOL pue sexntj VOL uoosy saoueipei MS juux Byuoo pes ms jux yuo pes Av ES 34n qux peiongsuooeMw OaD auans qux euaas pajanysuosay ssexold uonnaexe ay jo ed puoses ezi pes un Byuos ezi aqq qux Byuoo ez sw qux aqq quncisur jux Buyuoo sepes lux Bguoo gz pes pii s qux Byuoo sepi pun Byuos ez pes qux Byuoo egi pi qux Byuoo per s jux Byuoo pei quix Dyuoo sayy pei qux byuo2 sayy pi June qux a jux dur auass sseooJd uognoaxe aly jo ped 18414 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 _ ECSIM Date 07 05 2008 Mj d e l i L jS System User s Manual Page 23 of 121 5 BS EY ow l 2 vw o D ront O z m to mim E Instrument Level 1 Tools for plotting data extraction etc Figure 3 1 Full ECSIM schema DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e a ECSIM Date 07 05 20
58. End to END Mission System Performance Simulation ECSIM SYSTEM USER S MANUAL for SW version 1 2 Code ECSIM DMS TEC SUM 01 R Issue 2 4 Date 07 05 2008 Name Function Signature Jos Julio Ramos Juan R Acarreta Prepared by Project Engineer Dave Donovan Ricardo Moyano Reviewed by Juan R Acarreta Review Team Approved by Ricardo Moyano Project Manager Signatures and approvals on original DEIMOS Space S L Ronda de Poniente 19 Edificio Fiteni VI 2 2 28760 Tres Cantos Madrid SPAIN Tel 34 91 806 34 50 Fax 34 91 806 34 51 E mail deimos deimos space com DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 2 of 121 amp p S EY This page intentionally left blank DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 AS ECSIM Date 07 05 2008 Page 3 of 121 System User s Manual Document Information Contract Data Contract Number Contract Issuer Internal Distribution Ricardo Moyano Juan R Acarreta J ose J ulio Ramos Internal Confidentiality Level DMS COV POLO05 M Confidential Unclassified O Restricted External Distribution Raffaella Franco Dave Donovan MS Word 2003 ECSIM DMS TEC SUMOI 24 R doc Word Processor File Name DEIMOS Space S L 2007 DMS DQS QRE0
59. I E2E Simple end to end simulation DMS amp KNMI Forward Forward branch of the RADAR The simulation sta DMS amp KNMI Lidar Simulates the whole chain forward backward b DMS KNMI Radar Simulates the whole chain forward backward b DMS KNMI Synergy Combines the performances of the radar and lida DMS amp KNMI Pi Edit gt Run Ge Generate script iW Delete Figure 4 38 Session list view 4 10 2 Session creation Users can create a new session definition by clicking on the corresponding action from the Session menu 4 10 2 1 Import a session folder The first thing the system will ask the user is the possibility to import an existing session folder as shown in Figure 4 39 fm Session creation x You can create a new session importing settings from an existing folder Do you want to import Figure 4 39 Session import Once the user selects the import option the created session will have as identifier the same name of the folder and files within can be used as input for the session 4 10 2 2 General properties Figure 4 40 shows a blank session creation window First thing the user must fill shall be the following general properties Identifier Medium string No Uniquely identifies this E2E blank spaces allowed session definition into the system DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS
60. ML file that describes the scene is erased from the file system DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 A System User s Manual Page 92 of 121 S PAC EF 4 11 4 Compare scenes This functionality lets the user graphically compare two given scenes As shown in Figure 4 66 users can select two scenes to display their graphical representations in 3D Comparing two scenes First scene Second scene e aa ae gam Image Parameters Image Parameters Preview Preview Ok Cancel Figure 4 66 Scene Comparison 4 11 5 Import scene ECSIM can import scene information from third party applications Basically when creating a new scene you can define a scattering region as a read from file region then a size distribution file must be specified Here users can select a file formatted as the size distribution files generated by Iw msi lid rad 12b 3d as described in RD ICD 4 11 6 Merge scene This functionality consists of creating a third scene from two independent scenes The generated scene will sum the scene s dimensions and will contain every scattering region defined in both input scenes Accessing to this functionality will present the frame shown in Figure 4 67 DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC
61. Number of altitudes J scattering region C4 size dist info 3 re ait Relative altitude for C4 made paran ext or wextintion 1 m at 50 reff Effective radius r 3 shape p iShape parameter of r_min Lower limit of particl r max Upper limit of partic L Ok Cancel Figure 4 64 Scene Non fractal scattering region 4 11 2 5 1 Common region attributes O Scattering type File type Users can introduce the location of a file or browse the directories to locate it describing the type of scattering region This external file must follow the directives marked in RD ICD DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 88 of 121 S po S ER O Region type Users can choose one of these multiple options e Normal A normal region is a scattering region delimited with two terns x y and z of coordinates e Global A global region is a scattering region that occupies the entire horizontal extension of the scene thus only the Z limits need to be provided e Fractal Users can define fractal region if the CloudGen component is installed see section 3 3 3 File This scattering region is going to be defined via an external file that fulfils the RD ICD and the usual two terns of coordinates The location of this external file must be input in the text box or via the file chooser
62. OSI QD coc oH E ace LOIS DURANTE LER ive 82 S RIBUS elec I EAC CERE E E A E DL D DO 84 1125 010005 dnd aerosol aacra HEP EE EH In Een Ha Deep MI 86 2112 3 Common region att DUIS e eps E ERR HREBREHSE GER HAEEEHR ERE E AERE EIE ici 87 4 11 2 5 2 Non fractal region attributes a 88 2 11 2 5 3 Br etal region aU DUOS lacio 89 ZSIBRSMNBI Te IM EE 91 A Will Compare SCebBS rara 92 2 115 Mi POM SCEBE o odi re doi tree Reime mo du ERE Me C E 92 do NICE SG SCOMG is i aire Eee Feo rh a Dee FERT HR VIVERE Y CYTUR YER ET cei VK NUEVE EEE dev eror ta ei duet 92 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 11 of 121 Ss MAR EM 4 12 BX CUUODS rada 93 A cocus NIU quU EMI NIE UE 93 2 13 1 RESUME VIS Wood RI ul ep Hp IMPETUS EM VAM M PSI 94 2 13 4 ReBul b PERU uere E ERROR SEVERE Mea rA I tL ov bees ehem pe EU hod 96 213 3 Report PUSO POL ente ab eec eh Mok aotearoa us RR ease ees 96 EAE BIST Iri e P n 97 AMA copio unam dq du nM Ga a E VR AO d UVP UU UE ON UE 97 4 VA Log messages Hb s concors e Re REI dante e vete ia i dedu M Td NER SUM RATE 97 O LS 98 2 15 OOM GRE CIO s tech e R 99 4 16 Persistent storage Database and file system e eeeee eese esee eee seen eene tena ta setenta stas eno sen 100 2 16 1 Database maintenance as 101 4 17 Table of acceleration Keys inire reti a te neus uova sd cecaucastcct
63. P 2 orbit dms 1 0 lid filter 1 0 lidar 1 0 lidar 2a 1 0 orbit dms 1 0 id filter 1 0 idar 1 0 idar_l2a 1 0 cene creator xml 1 0 orbit dms 1 0 id filter 1 0 idar 1 0 Execute all Ignore redundant models Cancel execution Figure 4 50 Session execution Redundancy a scene_creator_xml 1 0 a gm E NJ m T o p R Figure 4 50 shows the dialog that shall pop up in case there is any redundancy Users can choose to either execute or ignore all the models marked as redundant Ignoring them saves a lot of processing time Once every validity check is fulfilled a background process Figure 4 51 will run the simulation and information concerning it will be given to the user in two different ways One is the log window and another is the simulation progress window The window presents a progress bar showing the percentage of simulation progress and a button to abort close the execution DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 System User s Manual Page 78 of 121 S he EJ Session RadarEnv 20070925111418930 Execution progress Session progress Model progress Session execution finished C Show non formatted messages Messages log Date and time Figure 4 51 Session Execution progress The execution of a session raises a set of e
64. QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM A Date 07 05 2008 System User s Manual Page 54 of 121 S PAC EF Creating a new model Configuration Output descriptor Default file Description ecsim orbit xml Figure 4 25 Model Input Output specification 4 8 4 Model upgrade New version A new version of a model represents an upgrade of the implementation of a given model This means that users can alter the binary code of the model but not the configuration input and output files originally involved in the model definition Users can create a new model version selecting the correspondent action from the context menu of the repository view or alternatively clicking over the new version button in the model list The system will automatically perform a minor version upgrade for example from 1 0 to 1 1 Users now can edit more attributes than with the model edition feature Changeable attributes are the following AU Model version DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 55 of 121 PACES Description Instruments compatibility s a O Author a a Source code O Binary code 4 8 5 Model edition Editing a model from the repository view or from the models list ECSIM will present the same window as in the previous chapter with all
65. S DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 System User s Manual Page 71 of 121 did EJ Session setup Input Configuration Parameters Output Log V Tools List of parameters Bp Iterate parameters Parameter identifier Description Type values Ci Parameters C RadarEnv Simulates the environment for the radar i 9 C ORBIT_DMS 1 0 parameters along SYNC Radar correction for non nadir poi FLOAT 0 01 parameters along SYNC Lidar correction for non nadir poin FLOAT 0 02 parameters assurrSYNC assummed off nadir angle for rad FLOAT 0 03 parameters assum SYNC assummed off nadir angle for lida FLOAT 0 04 parameters execuUSER or CFI orbit STRING USER Figure 4 44 Session Parameters definition Users can consult the following list of attributes Parameter Long string Complete name of the parameter A parameter parameters identifier identifier is formed by its path into the file execution mode structure dot separated and its parameter name as described in RD ICD Description Long string Brief description of the parameter purposes USER of CFI and values orbit Type Options Parameter values type Used to present STRING INTEGER different editor when editing the parameter FLOAT value STRING BOOLEAN FILE and FOLDER different Parameter value An uniq
66. TEC SUM 01 R Issue 2 4 a ECSIM Date 07 05 2008 System User s Manual Page 68 of 121 S BA SER Description Long string Brief remarks about the goals This is a full end to and characteristics of the end simulation for simulation the EarthCARE mission Author Medium string Name of person or group DMS responsible of the session definition Creating a new session General properties Identifier Description Author Simulations set These are the nes Simulations set buttons to add Simulation identi Description s remove and alter their execution order List of simulations w Session setup Input Configuration Parameters Output nput files list o iterate input Default file File instance Status D Input E Accept Cancel Figure 4 40 Session creation General properties 4 10 2 3 Altering the simulation set First simulations to be executed need to be included by selecting them from a list of available simulations Users just need to click on the desired row at the simulation list Figure 4 41 and press the Ok button DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 69 of 121 Simulation
67. a yes or no question or another question with different options The dialogs will provide information with a clear description of the event 4 3 Frame management Accessing to the Window menu of the main menu bar you can find all the functionality provided for the frame management Figure 4 8 shows that this menu has the common aspect of other MDI applications DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 38 of 121 SPA CEP Window Tile Cascade Auto Close AltZ 1 Editing model SCENE_CREATOR 1 0 2 Sessions list view Figure 4 8 Frame management menu This is a brief description of these well known capabilities A Tile arrange internal frames as tiles over the working area O Cascade arrange internal frames ordering them as in a cascade L Auto presets an arranging style for newly created frames OU Close hides and destroys the active frame Then the list of open frames is shown in the rest of the menu Active frame is pointed with a filled round button Other frame management functionalities can be found in the header of every internal frame and in the main frame not in dialogues Editing model scene creator xml 1 0 Figure 4 9 Internal frame header Note in Figure 4 9 three little icons at the right border of the header Those are the
68. above but referred to the model LIDAR src corresponding binary file lidar Codes in general will have several routines However there will be always a main This function is interesting to pinpoint as it is a sort of manager for the rest of routines The compiling process is an external procedure to ECSIM DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 coa ECSIM Date 07 05 2008 System User s Manual Page 52 of 121 S PAC ES A Creating a new mode Configuration Model description General Input output Identifier Model version 0 0 Description Author Type Scene O msi C BBR C ATLID LJ CPR Model algorithm Source file Binary file Figure 4 23 Model General properties 4 8 3 2 Configuration Selecting the Configuration tab Figure 4 24 users can select the XML configuration file and its correspondent XSD schema file using file browser dialogues Text areas are also provided to preview the XML code DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 rr ECSIM Date 07 05 2008 Mj d e L jS System User s Manual Page 53 of 121 S PAC EF A Creating a new model General Configuration Input output XSD schema file Default file E XML configuration file
69. al Page 96 of 121 SPACEY U Last model This is the number and identifier of the last model successfully executed In case of a successful execution this model must coincide with the very last model of the session This information is useful for the user to know which model was erroneous Second the Log tab is filled with the log messages generated by the session execution Users can access all these messages to check its performance 4 13 2 Result re run Accessing to this functionality users can repeat the execution of a previously executed session If the session execution was successful the system just creates another execution changing the starting date and time but if the previous execution was aborted or failed the system will inform the user with the dialog shown below fa Session execution x This session has been already executed and it had a failure Do you want to restart or resume it starting from last valid model Figure 4 72 Result Re run Users now can choose to restart the execution from the beginning or try to resume the execution that is to continue the execution from the last valid model So the execution will continue provided that the outer conditions that ruined the previous run have been corrected 4 13 3 Report generation This functionality is accessed by clicking ion the Generate report option from the Results pop up menu A window similar to the one shown in Figure 4 7
70. ardware and software platform with the following requirements These must be fulfilled before installing the distribution 3 3 1 Hardware requirements Hardware must at least fulfil the following requirements O 32 bit 2GHz dual core processor O 2 GB of RAM memory installed O 12 GB of free space to install the complete distribution including DEM scattering libraries and rest of auxiliary files 3 3 2 Operating system requirements A Linux Kernel version 2 6 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 25 of 121 S PA C EF 3 3 3 Framework pre requisites Sun Java TM 2 ECSIM runs within this GNU GPL http www java com en d Runtime Environment execution environment Jaya Community ownload Standard Edition 1 5 or Process superior MySQL client and ECSIM stores GPL or Proprietary http dev mysql com dow server 5 or superior information in this License nloads mysql 5 0 html relational database MySQL connector J ECSIM uses this library GPL or Proprietary http dev mysql com get 5 0 4 to connect to the MySQL License Downloads Connector database server J mysql connector java 5 0 4 tar gz from pick Don t use a Java Runtime Environment from another provider different than Sun Remember to set root user name and password after installing the MySQL server Note
71. arting from 1 to 10 with a step of 5 will generate a series of 1 6 Q Numeric sequence by division Once defined the starting xi and ending Xn values of the sequence users can input the number of divisions d in the step division text field Pressing the generate marked with the ellipsis symbol will create an arithmetical sequence following this rule x EN X d Numeric values will never be equal or greater than the upper limit For example a numeric sequence starting from 0 to 10 with five divisions will generate a series of 0 2 4 6 and 8 lend EZ K s Users can now accept or cancel the numerical sequence Once a valid set of values is input in both parameters users can press the preview button to consult the simulations that will be added to the session Figure 4 49 shows all possible combinations of parameter values tested in the example Once the user accepts the combination pressing the Ok button will add the generated simulations to the simulation list Note that parameters not involved in the iteration will remain fixed to a value but they can be manually changed as seen in chapter 4 10 2 5 Parameters to iterate Session preview Parameter name Yalues Parameter name Yalues Parameters CI Parameters C Complete Ed Complete EJ orbit dms 1 0 EI orbit dms 1 0 parameters propagation step 050 6 D parameters propagation step 0 5 CE rad filter 1 0 rad filter 1 0
72. as to reach an ending point defined by its type If with the available models this is not possible then the simulation cannot be defined and therefore it is not saved DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e ECSIM Date 07 05 2008 System User s Manual Page 64 of 121 N Creating a new simulation General properties Identifier Active Author Dms Description simulation with all active instruments CPR amp ATLID suns sasae rane e Instruments ATLID CPR C BBR CI MSI Models schema Simulation Stages Os Platform Forward Instrument Simulation completed 2 Current simulation definition Model identifier Type Description 2 Element identifier 5 Simulation definition 9G Scene 3 SCENE CREATOR 1 Platform 3 ORBIT_DMS 1 0 9 E Forward R CPR_F 1 0 ATLID_F 1 0 Ef Instrument CPR 1 0 ATLID 1 0 I Previous stage Next stage El Accept Figure 4 34 Defining a simulation final window 4 9 4 Simulation edition The edition of a simulation is accessed by either clicking on the Edit option from the main menu bar or selecting it from the context menu at the repository view or selecting the option from the actions tools bar of the simulation list frame The MMI will show the same frame as for simulation
73. atio 1 0 Mixing ratio file ch4_profile ias Ok Cancel Figure 4 60 Scene Extra gas DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 84 of 121 m ps E Clicking the trash bin button will erase the selected gas Double clicking over a gas row will also show the dialog Right clicking over it will show a context menu with the options of editing it adding a new one or removing the selected gas 4 11 2 4 Scene surfaces In this frame users can determine the surface parameters for a three dimensional scene Users can specify a default ground type present where no other surface region is defined and a list of surface regions Editing scene scene_inp Surface Default ground type open water ocean Surface regions Number of surface regions Element identifier Surface type C surface properties 3 surface region E accept Cancel Figure 4 61 Scene Surfaces Figure 4 61 shows the ability to manage the ground part of the scene Users can define the following attributes O Default ground type This is the general type for the ground Those parts of the scene s surface where a surface region is not defined will be of this type The list of possible ground types is e open water ocean e dark desert e moderate high vegation e bright desert e low mo
74. branch of the R DMS amp KNMI Instrument Lidar Simulates the whole chain Retrieval Radar Simulates the whole chain Retrieval RadiativeTransfer Generates BBR radiances Forward SceneCreation Generates an UFF file rep Scene Synergy Combines the performan DMS amp KNMI Retrieval iy Edit gt Execute iW Delete Figure 4 28 Simulations list view 4 9 2 Simulation creation By selecting the New simulation option from the Repository menu the system will present a new frame Figure 4 29 with components to introduce all necessary data to define a simulation DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 57 of 121 Creating a new simulation General properties Identifier Author san sane soose fara f Instruments ATLID CPR BBR MSI Models schema Simulation Stages amp Scene Platform Forward Instrument Retrieval Scene models available Current simulation definition Model identifier 2 Element identifier scene creator xml 1 0 Scene KNMI amp D Simulation definition Figure 4 29 Simulation Creation The information needed to create a new simulation is organised in two areas separated in the window OU General properties containing general information about the simulation and L Models schema that allows defining the model const
75. bution In microns DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e ECSIM Date 07 05 2008 System User s Manual Page 91 of 121 sPACEJ fo Editing x Scattering type Type file 1H2504_25 list xmi dos Region type Normal Global e Fractal Q File O File global Name E Region dimensions x1 km 0 0 yl km 0 01 21 km 0 0 x2 km 0 0 y2 km 0 0 22 km 3 0 Mon fractal Fractal Cloud generator pougen f Output file len ls Missing value oo Seed o Threshold oo Gen level oo Vertical exp oo Out scale oo Lower limit o o Upper limit oo Size correlation 0 0 Mixing l Size distribution E4 scattering region 2 4 size dist info rel alt Relative altitude for this entry 0 O botto FLOAT fall speed Particle fall speed at the relative altitude FLOAT horizontal exponent The height variation of the exponent of th FLOAT v wind V wind velocity at the relative height Use FLOAT u wind U wind velocity at the relative height Use FLOAT EC mode parameters Mean water content Ok Cancel Figure 4 65 Scene Fractal scattering region 4 11 3 Delete scene Once users have selected a certain scene and the delete scene action a confirmation dialog asking will come up Once the user is sure to proceed with the deletion the X
76. ccording to the selected instrumental model in the previous step If the user would like to include retrieval models for another instrument he she must go back to the previous stage or maybe selecting it from the tree structure and select the corresponding instrument model DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e a ECSIM Date 07 05 2008 System User s Manual Page 63 of 121 Creating a new simulation General properties Identifier Active Author Dms Description Simulation with all active instruments CPR amp ATLID Instruments ATLID CPR C BBR C msi Models schema Simulation Stages Os Platform Forward Instrument Instrument models available Current simulation definition Model identifier Description i Element identifier CPR 1 0 Instrument CPR model E3 Simulation definition ATLID 1 0 Instrument ATLID defaultL Deimos Space C9 Scene 2 3 SCENE CREATOR 1 0 9 c Platform 3 ORBIT_DMS 1 0 9 C4 Forward R CPR F 1 0 ATLID F 1 0 4 Previous stage b Next stage E accept Figure 4 33 Defining a simulation selecting models 4 9 3 4 Step 4 Finishing the simulation creation Once all models for the simulation have been defined the user may save it into the database by clicking on the Accept button Figure 4 34 7 Each type of simulation h
77. ch contains a gamma type single mode water distribution layer O scene fire fractal Scene included in the worst case scenario Includes a fractal ice cloud between 7 and 10 km present from x 0 20 and y 0 20 km 5 7 List of available tools ECSIM distribution includes some already defined product tools Here is their description extract_env This program reads a 3 D domain from tools product_tools a UFF file and extracts various averaged bin extract_env quantities and outputs them to the specified output file extract_quantity Extract quantity is used to extract tools product_tools information from a UFF file along a bin extract_quantity straight line between x1 yl and x2 y2 The program will read the UFF file as well as any relevant information from the scattering libraries in order to build up the requested data extract quantity 3d This program reads a 3 D domain from tools product_tools a UFF file and extracts various averaged bin extract quantity 3d quantities and outputs them to the specified output file extract quantity hor This program reads an entire UFF file tools product tools and extracts various column integrated bin extract quantity hor quantities and outputs them to the specified output file gthumbviewer Image viewer i gthumb DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 Syste
78. continuous interaction with the user Batch mode checks the agreement or not between the output of a given module and the input by the next one in the sequence of the simulation Several modes of executions can be performed Q Iteratively executing one or more simulations O Iteratively executing the same simulation several times depending on the parameters configuration U Same as above but by executing a batch script Closure Internal check of consistency following different branches available in the simulator In principle it is aimed only for complete simulations UFF 3D reconstruction In such a situation Q High level closure is made comparing TOA fluxes U Low level closure is made comparing UFF and 3D reconstructed scene Configuration A small XML file that contains all the parameters necessary to execute a model A File configuration file instance must comply with the corresponding XML schema defined at model creation time Framework Software infrastructure designed to support and control the simulation definition and execution It includes the GUI domain and database capabilities that enable to perform all the functionality of the ECSIM simulator Models are not considered part of the framework Forward Models that transform the scene or UFF file into output suitable for the instrument models models The forward models are based on radiative transfer techniques adapted for active and passive inst
79. csim If the ECSIM is launched with no parameters the GUI will show up normally This behaviour can be modified providing the following parameters O noGUI No graphical user interface is shown Running ECSIM with this option enables experienced users to go faster in the execution of their sessions This option only makes sense when used with the following one O execute session identifier The ECSIM framework will launch the execution of a previously defined session with the defined parameter values This option can be used with or without the previous one The session identifier shall correspond to the one stored into the ECSIM database Author and description parameters are optional and will be included in the session execution general data Fields can contain more than one word if they are enclosed in singles quotes An example to illustrate the execution in batch mode of a Radar simulation is as follows ECSIMS ecsim noGUI execute Radar DMS Test radar simulation This sentence will execute the ECSIM in text mode no graphical interface create a session named radar created by the author DMS and described as Test_radar_simulation Then it will execute it intercepts all the events generated and stores in the database its results Then the system will stop 3 5 1 Environment variables Once you have successfully run for the first time your ECSIM installation you would like to go to the Syste
80. ctions dialogues and displays This section is meant to describe the design of generic functions dialogs and displays used by the MMI There are some functionalities of the MMI that show a file chooser dialog as shown in Figure 4 6 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E A ECSIM Date 07 05 2008 a System User s Manual Page 37 of 121 S PAC ES om lalalala J aux 3 TEST_DMS c common 3 Makefile orbit dms 9 Makefile in J rad filter 4 rad l2 J radar J scene creator File Name Files of Type All Files v Open Cancel Figure 4 6 File chooser dialog This dialog helps the user to browse the system directory to select a certain file or list of files It provides some sorting filtering and file operations very common and already known for the majority of the users Throughout the ECSIM MMI some functionality could show information to the user and could ask for some input in response to an answer The MMI will present some modal dialogs that will get the system focus until the user provides an answer These modal dialogs will block the input to other areas of the application until a response is given m Message x Validation error Identifier cannot be void Please choose a different Identifier Figure 4 7 Dialog example These dialogs will typically provide a message with an OK button or give
81. d down buttons that move the selected file through the list A Creating a new I O descriptor Identifier Input Description Files Number of files Figure 4 19 Descriptors New descriptor 4 7 3 Descriptor edition Users can select a certain descriptor and choose the option to edit it Note that for consistency reasons only the description is allowed to be changed 4 7 4 Descriptor deletion Users can also select a descriptor to delete it Once users confirm the operation the descriptor is erased from the repository Note that for consistency purposes every model simulation session and its results that makes use of this descriptor will also be deleted from the system DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E ECSIM System User s Manual S PAC EJ 4 8 Models According to the definition given in section 1 3 a model is an executable entity that can take part in a simulation Users are able to manage all models that can take part in ECSIM simulations The operations upon models are O List present the list of existing models L Creation capability to create a new model into the system U New version create a new version of an existing model L Edition edit an existing model to enter changes Q Deletion delete a model from the system Descriptors Ctrl D R New descriptor Ctrl M Models 3 New model
82. dels aux standard_atmos_p standard atmospheric profiles rofiles SURF_FILES Folder location of auxiliary home lt user gt ECSIM models aux surface_files surface definition files Once you finished extracting the platform it is necessary to copy in ECSIM HOME folder a file from the MySQL Connector J package mysql connector java 5 0 4 bin jar This file is needed for the system to access the database server If you want to use another version of the MySQL Connector J you can also copy it into the ECSIM_HOME folder but then you must edit the ecsim running script to include the new jar file For example if version 5 1 6 wants to be used the next line must be changed java cp mysql connector java 5 0 4 bin jar bin ECSIM by this one java cp mysql connector java 5 1 6 bin jar bin ECSIM 3 4 2 Scattering libraries and DEM installation 3 4 2 1 Scattering libraries The scattering libraries are an essential component of ECSIM The scene UFF files do not contain any information about the optical properties of the clouds and aerosols To store this information at each grid point for all the necessary wavelengths for an end to end simulation would be infeasible Instead the UFF files only contain information on the number and sizes of the aerosol and cloud particles present at each grid point The necessary optical information i e extinction coefficient single scattering albedo phase function etc are stor
83. derate d vegation e snow O Surface regions It is possible to define individual surface regions of a different type than the default Clicking the plus button will show a dialog where the user can specify the information of a new surface region DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 85 of 121 S PAC EJ Surface type Options The user can select a type from the list in the bright desert combo box component Surface limits Float Users can specify the two dimensional limits x1 0 0 0 0 1 0 2 0 yl x2 y2 of the region They must be smaller than the general scene dimensions r r3 Editing x Surface type cultivated land le Surface limits x1 km 0 01 yl km 0 0 x2 km 0 0 y2 km 0 0 Ok Cancel Figure 4 62 Scene Surface region Clicking the trash bin button will erase the selected surface region Double clicking over a surface row will also show the dialog Right clicking over 1t will show a context menu with the options of editing it adding a new one or removing the selected surface region DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 d e L S System User s Manual Page 86 of 121 S PAC EF 4 11 2 5 Clouds and aerosols Now it is time to define th
84. e Model ID Medium string Unique model identification LIDAR Model version Float In a new model this field will be filled with a default value Users cannot edit this unless they use the new version functionality 1 0 Description Long string Free writing area where to briefly describe the model State of the art LIDAR instrument model Author Medium string Text field where to write the author s name DMS Options retrieval algorithms instruments platforms forward models and scene creators Type Model type or family DEIMOS Space S L 2007 Instruments DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 51 of 121 Se se ER Instruments Options Every model is compatible with at ATLID compatibility ATLID CPR least one of the EarthCARE BBR MSI instruments For example a model of a LIDAR should be compatible with the ATLID a scene creator or platform model must be compatible with all the instruments Only compatible models can be selectable during simulation definition see section 4 9 4 Simulation edition Source code file There is a text area to write the file models LIDAR src name and a button that will show a lidar f90 dialog to locate and choose the intended source code file Binary code file Same as
85. e ECSIM DMS TEC SUM 01 R Issue 2 4 E A ECSIM Date 07 05 2008 System User s Manual Page 95 of 121 SPACE P d Editing session E2E 20080328100633416 General properties Identifier E2E 20080328100633416 Date Time 20080328100633416 Description simple end to end simulation Duration 28m31s Status Successful Author DMS amp KNMI Last model 11 scene creator xml 1 0 Simulations set List of simulations Simulation identi Description Author Start Stop A complete zimulates the fo DMS amp KNMI pcene peeve DMS amp KNMI Scene fcene v Session setup Input Configuration Output Log List of log messages Date andtime Type Message Source Figure 4 71 Execution results First of all some data is presented in the general properties region showing this attributes U Date time this is the local computer date and time that the execution began This date and time can also be part of the simulation identifier to distinguish this session execution from others A Duration the time in minutes and seconds elapsed from the starting time until the execution was finished or interrupted L Status the overall status of the execution The possible values are Failed Successful and Aborted DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e ECSIM Date 07 05 2008 System User s Manu
86. e Run button at the bottom of the window launches the execution of the session gt Editing session SC 2000000 General properties Identifier c Description Runs the scene creator model Author Knmi Simulations set List of simulations Simulation identi Description Author SC Runs the scene KNMI Scene de SRE EAE IRL Session setup Input Configuration Parameters Output tog Tools Input files list amp Iterate input Default file File instance Status J Input Esc Y ELS SCENE CREATOR XML D scene inp xml scene inp xml Missing e Cancel Figure 4 35 Simulation Execution 4 10 Sessions According to section 1 3 a session is defined as an execution of either one simulation an ordered set of simulations or an iterative execution of simulation s with different parameter values Users can access to the list of sessions existing in the system in the repository view of the side bar or via the Sessions menu Figure 4 36 from the main menu DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 AN ECSIM Date 07 05 2008 System User s Manual Page 66 of 121 S P A C EJ PF Eon Descriptors Ctrl D gt Run F New descriptor 5 e Generate script Models Ctrl M 3
87. e main part of a scene clouds and aerosols composition Figure 4 63 shows that this is done by defining scattering regions with certain characteristics Editing scene scene inp Clouds amp aerosols Scattering regions Number of scattering regions Element identifier scattering EJ cloud and aerosol information scattering region H2S04 25 list xml scattering region water list xml scattering region PIt hess scatt tilt O1 list xml scattering region PIt hess scatt tilt O1 list xml Figure 4 63 Scene Clouds and aerosols This table of scattering region allows the usual editing adding and removing operations double clicks will edit it and a right click will open a context menu Clicking the Add button will show a dialog where users can specify the information of a new scattering region as shown in Figure 4 64 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E A ECSIM Date 07 05 2008 System User s Manual Page 87 of 121 SPACE E Oo Editing x Scattering type Type file H2504_25 list xml Region type Normal Global Fractal O File File global Name 1 Region dimensions x1 km yl km o 21 Km 0 0 x2 km y2 km z2 km 3 0 Non fractal Size distribution type Scale type O Water Content 8 Log normal Gamma amp Extinction Size distribution
88. ed in pre computed scattering libraries A scene can only be created or used as input by other ECSIM applications if all scattering libraries it references have been installed on the system One can check which libraries are referenced by a UFF file by inspecting the associated header file using any ASCII viewer The scattering list files are listed near the top line 4 onwards of the header files Your ECSIM distribution already has a minimal set of scattering libraries for running the included scenes In case you need other files not included in the provided set a more extensive set may be built in situ by the user by running the following steps 1 cd SECSIM HOME models aux scattering libraries 2 unzip scatt libs zip 3 cd data files 4 Open the file build mie tables csh with a text editor M umo ndo Eu us 5 Change the shell variables defining the compiler and compiler options to suit the target system default is ifort and O3 and save the files DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 30 of 121 amp pom EY 6 6 Execute source build mie tables csh gt amp LOG The script will then compile a number of Mie scattering codes and then execute various other scripts in order to build the full set of libraries Please note that this process can be extremely long around twelve hours in a machine matchi
89. ed section 5 to show latest changes in the repository Included more information about locating file instances when editing a session by absolute paths or ECSIM_HOME relative paths Added a new session to describe nominal included in the distribution scenes Added instructions to edit numerical sequences when iterating parameters in a session creation Updated figures and text to show the changes in the iterative session feature input and output files cannot be iterated anymore Simplified surface types Added detailed information about using environment variables when scheduling product tools in a simulation DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 a System User s Manual Page 6 of 121 S PAC ES 2 3 Changes to meet ESA s comments at AR on 6 March 31 03 08 2008 Following AR RF 07 updated titles of section 5 6 and 5 7 and contents of section 5 6 to clarify that the two scenes are just two examples given for testing purposes in the final delivery AR DL 11 Updated figures to match current SW AR DL 12 Updated section 3 4 4 to show the current and actual folder structure AR SP 13 Section 3 3 4 Add or superior in the Intel Fortran compiler version identifier AR SP 14 Updated table in section 3 3 3 to show the exact version of the Connector J and added instructions in section 3 4 1 i
90. ending rad filter Input orbit xml Pending rad filter Configuration rad filter config xml SECSIM HOME sessions Synergy 0 Synergy rad filter config xml lid filter Input uff adjust xml SECSIM HOME sessions Synergy 0 Synergy uff adjust xml lid filter Input scene uff Pending lid filter Input orbit xml Pending lid filter Configuration lid filter config xml SECSIM HOME sessions Synergy 0 Synergy lid filter config xml radar Input rad filter out nc Pending radar Input orbit xml Pending radar Configuration radar config xml SECSIM HOME sessions Synergy 0 Synergy radar config xml lidar Input lid filter out nc Pending lidar Input orbit xml Pending lidar Configuration lidar_config xml ECSIM HOME sessions Synergy 0 Synergy lidar_config xml rad_12a Input radar_out nc Pending rad_12a Configuration rad 2a config xml SECSIM HOME sessions Synergy 0 Synergy rad 2a config xml lid 12a Input lidar out nc Pending lid 12a Configuration lid 12a config xml SECSIM HOME sessions Synergy 0 Synergy lid 12a config xml lid rad I2b Input lid 12a out nc Pending lid rad I2b Input rad 2a out nc Pending lid rad I2b Configuration 5 3 3 Steps lid rad I2b config xml SECSIM HOME sessions Synergy 0 Synergy lid rad I2b config xml O Select from
91. ese tools can be executed instantly if the file is already available or be scheduled to end of the execution process Users can change the default parameters for the tool execution When scheduling actions to certain files ECSIM uses instead of the actual file name and location a reference to the file s foreseen location as an environment variable These variables are named starting with the dollar symbol then IO the simulation number and its identifier with no blanks underscores or dots For example IO0ecsimorbitxml denotes the orbital file to be generated in the proper folder by the execution process and IO1radaroutput nc the NetCDF file generated by the radar model in the second simulation of a given session It is also possible to use two other session related variables SSESSION FOLDER to point the foreseen location of the session execution and SSIM FOLDER with denoting the simulation number pointing the foreseen location of a certain simulation in current session In the same way users can include references to the rest of ECSIM environment variables like ECSIM_ HOME Q Clicking on the add tool to session button Upon a selection of this action users can choose one tool from the appearing list of defined tools Users can change the default parameters for the tool execution Users can also select a certain tool and remove it from the list and alternatively change the order of execution of the tool
92. extract quant extract quantity 3 tools product tool inputfilename out extract quant extract quantity h tools product tool inputfilename out gthumbviewergthumbviewer view gthumb 1 l1 I2 comparil1 I2 compare co Itools product tool INPUTFILENAME1 lll2 rebin 11_12_rebin rebin tools product tool INPUTFILENAMET ncBrowse ncBrowse view ncBrowse NetCDF differjNetCDF difference ncdiff file 1 36file 2 plot 3d plot tools pgplot tools iinputfile Quantity f eoi R New toot l Delete Figure 4 13 Tools list view A list of tools showing its identifier action executable and parameters is given Tools are definable by the user Thus new tools can be added by clicking the New tool button 4 5 2 1 New tool Accessing to this functionality a new window appears to let the user create a new tool gt Editing tool 11_12_compare Identifier I1 12 compare Description wo different 2 D ncdf files Action compare Extension nc Executable tools product tools bin I1 I2 compare Parameters title INPUTFILENAME title2 OUTPUTFILENAME out title out plot title Figure 4 14 Tool Creation DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 a ECSIM Date 07 05 2008 System User s Manual Page 43 of 121 S PAC EP Users can define the following attributes
93. f particle sizes to include in microns Users can define before adding a relative altitude how are going to be defined the size distributions of this scattering region by changing the number of its modes DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue N 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 89 of 121 S P A C E 4 11 2 5 3 Fractal region attributes Cloud generator File Path and call to the external cloudgen program usr local cloudgen 1 3 cloudgen Output file File Output file name of the cloudgen netcdf run Iwc nc Missing value Float The missing value used in the fractal code 999 0 Seed Signed integer Seed used by the random generator in the fractal code negative numbers use time Threshold The IWC threshold defining the cloud boundaries in g m Generating level Level at which the cloud is generated usually near cloud top in km Vertical exponent Exponent of the power spectrum in the vertical direction Outer scale The power spectrum becomes flat at scales larger than outer scale In km Lower limit Lower limit of particle sizes to include In microns Upper limit Upper limit of particle sizes to include In microns Size correlation The correlation coefficient between effective radius and the logarithm of ice water content
94. filter config xml SECSIM HOME sessions E2E 0 Complete lid filter config xml radar Input rad filter out nc Pending radar Input orbit xml Pending radar Configuration radar config xml SECSIM HOME sessions E2E 0 Complete radar config xml lidar Input lid filter out nc Pending lidar Input orbit xml Pending DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 117 of 121 S OB dd EJ lidar Configuration lidar_config xml ECSIM_HOME sessions E2E 0 Complete lidar_config xml rad_12a Input radar_out nc Pending rad_12a Configuration rad la config xml ECSIM_HOME sessions E2E 0 Complete rad_12a_config xml lid_12a Input lidar_out nc Pending lid_12a Configuration lid 12a config xml ECSIM_HOME sessions E2E 0 Complete lid_12a_config xml lid_rad_12b Input lid_l2a_out nc Pending lid_rad_12b Input rad 12a out nc Pending lid rad 12b lid rad 12b config xml ECSIM_HOME sessions E2E 0 Configuration Complete lid_rad_12b_config xml Iw msi lid rad 12b 3d msi_l2a_out nc Pending Input Iw msi lid rad 12b 3d lid rad I2b out nc Pending Input lw msi lid rad 12b 3d Iw msi lid rad 12b 3d config xml SECSIM HOME sessions E2E 0 Configuration Complete Iw msi lid rad 12b 3d config xml scene creator xml scene inp xml 0 Input Complete
95. he ecsim user into the database server and grant it with enough permission This also will create and fill the nominal database information The installation script will interactively ask the user for values of the following environment variables ECSIM HOME ECSIM system home folder home lt user gt ECSIM DEBUG MODE Presents debugging Off information to users TEST HOME ECSIM system test home home lt user gt ECSIM tp folder LD LIBRARY PATH Folder location of the Intel opt intel fc 9 1 036 lib LD LIBRARY PATH Fortran Compiler libraries PGPLOT FONT File describing supported usr local pgplot grfont dat PGPLOT fonts OMP NUM THREADS Default number of threads to use during execution of models using the OpenMP multi processing module KMP STACKSIZE Sets the stack size for each 512M thread created for models using the OpenMP multi processing module In almost every Linux system the diff program is installed by default DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 29 of 121 Se ae EY MSI LOOKUP Folder location of auxiliary home lt user gt ECSIM models aux msi_lookup MSI lookup tables SCATT_LIB Folder location of auxiliary home lt user gt ECSIM models aux scattering_librarie scattering libraries s STD_ATMOS Folder location of auxiliary home lt user gt ECSIM mo
96. iews the text content of many files including XML Diff text files differencer Highlights the differences between two files There are many examples of this with all kind of licensing schemes ECSIM pre integrated tool is GNOME Evince Again there are many different text files viewer in every operating system ECSIM pre integrated tool is the GNOME text editor gedit DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 AS ECSIM Date 07 05 2008 de l I i i IS System User s Manual Page 28 of 121 S P A C E 3 4 How to Install the Application Provided that every pre requisite is fulfilled users can now proceed to install the application 3 4 1 Framework installation First extract the framework zipped file into the desired location tar xvf ecsim lt version gt tar gz This command will decompress all the files in the distribution and create a folder named ECSIM and inside it the folder structure described in section 3 4 4 This folder will have to be the value of the ECSIM HOME variable defined in section 3 2 1 Go into the ECSIM folder and then execute the installation script as follows ECSIMS sh install user password Where user is the name of a user in the MySQL database server with administrative privileges typically root and password is its password See also section 4 16 1 This script will create t
97. ion on the functionality of the application itself but is also an operational guide to some of the procedures within an end to end simulation of the EarthCARE mission This document is applicable to version1 2 of the ECSIM application Chapter 1 this present chapter talks about the document giving a description and settling the basis to understand it Chapter 2 links this document with information from other sources Chapter 3 details the procedures for setting the ECSIM system up Chapter 4 describes one by one all the different functionalities of the ECSIM system Chapter 5 presents some examples of the simulations that can be achieved Reading the chapters in this order will help users to fully understand the use of the ECSIM system Chapter 5 can be skipped by experienced users 1 1 Scope The applicability of this document begins once ECSIM starts to be operable However it is aimed to support two different kinds of users L Users that want to take advantage of the application O Developers that want to implement new models intended to be used within ECSIM 1 2 Acronyms and Abbreviations Applicable Document Application Programming Interface Broad Band Broad Band Radiometer Customer Furnished Item Commercial Off The Shelf Database Management System DEIMOS Space End to end simulation Graphical User Interface DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E
98. ipt Igpl 3 0 Licensing scheme file Auxiliary files for the framework Binary files of the framework Framework documentation ECSIM models OU Makefile U Makefile in Auxiliary files for the models Channel definitions Lookup tables with scene reflectivity values They are intended to speed up the retrievals based on MSI L1 data Scattering libraries Solar data Standard atmospheric profiles Surface data for the scene description Fortran XML libraries Common sources modules and utilities used by the models Model root Every model has one directory structured as this one Model folders might include additional folders Auxiliary files Binary files Configuration files Sources ECSIM models test folder Scripts and file references for the model unit tests DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 D ECSIM Date 07 05 2008 System User s Manual Page 32 of 121 fe Ae EY QO products Some product file samples Q scenes Some scene files samples xml and uff files O sessions ECSIM sessions root folder Q session name gt Session folder Every session once executed has one directory structured as this one This folder will have the session script and if generated the session report O lt index simulation_name gt Simulation folder Every simulation into the session has a directory structured as this one This folder
99. ituents of the simulation The series of models are listed in the current simulation definition tree Both spaces for the simulation creation are further detailed below 4 9 2 1 General properties The general data is constituted by the following attributes DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 58 of 121 S RA ER Identifier Short Identifies a simulation within the system Lidar string Author Medium Denotes who created the simulation DMS string Description Long Users can briefly describe a simulation in End to end string this text area simulation of a single instrument Starting and Options Two combo box components allow users to Scene to Retrieval ending stages scene specify the first and last stage of this platform simulation Stages coincide with model forward families that are scene platform forward instrument instrument and retrieval Starting stage shall retrieval not be posterior to the ending stage and reciprocally ending stage cannot be anterior to the starting one Updates shall be performed to the current simulation definition sequence of models to be included according with the changes of the limits Instruments In order to ease the simulation definition ATLID users can filter models by the instruments that want to include i
100. jective of the EarthCARE simulator ECSIM is to provide an End to End simulation capability for EarthCARE to assess whether the scientific goals and mission requirements can be met ECSIM is based on an existing E2E simulator developed by KNMI which is a software system that runs a fixed set of models with no possibility of including new models without a difficult and challenging adaptation process ECSIM is therefore an upgrade in order to U Improve the current engineering and scientific models in scope and quality to provide the necessary functionality for the proper performance assessment for the mission in nominal conditions and in presence of failures L Test different L2 based algorithms that rely on active and passive instruments O Consolidate the software engineering approach and architecture in order to e Allow the inclusion of future instrument platform system and data retrieval models by providing clearly engineered model interfaces e Improve the operability and stability of the simulator e Ensure batch processing capability e Ensure computational efficiency e Address validation aspects in collaboration with the scientific user and model developer community e Establish proper configuration control mechanisms Such an ambitious scenario can be summarized in the Figure 3 1 The first thing to notice is that any simulation roughly any procedure that entails the connection of algorithms is decomposed into basic e
101. l pop up Users can now access to all the following functionalities O List present the list of existing scenes O Creation capability to create a new scene into the system O Edition edit an existing model to enter changes O Deletion delete a model from the system O Comparison functionality to show the differences between two scenes O Merge combine two scenes to form a third 4 11 1 List scenes Scenes Scenes Ctrl C RB New scene a Compare i Delete f3 Merge Figure 4 52 Scenes main menu Repository Scenes Executions File system Search scene Element identifier Scenes standard_test_scene scene_fire_fractal Figure 4 53 Scenes tab in the side bar 3 Edit iW Delete Figure 4 54 Scenes pop up menu The list of scenes shown in the scenes tab of the side bar and in the figure below represents the valid XML files stored in the default scenes directory see section 4 5 1 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 System User s Manual Page 80 of 121 tes ER Scenes list view LEE PAIAR es SEED n m bd Scene identifier Description Author Scenes standard test scene Standard scene for testing purposes Defines KINMI scene fire fractal Scene included in the worst case scenario KNMI
102. lations with added input output configuration files and product tools Into the repository tab of the side bar users can find a tree like structure containing the definitions for all known models descriptors simulations and sessions This tree like structure can be collapsed or expanded double clicking in the group name or clicking in the anchor icon Repository Scenes Executions File system Search object in repository Element identifier 1 Repository gt C Descriptors gt E Models 9 Scene D scene creator xml 1 0 9 2 Platform 3 orbit dms 1 0 9 Forward Y lid filter 1 0 Y lw_rad 1 0 rad_filter 1 0 sw_rad 1 0 Figure 4 16 Repository view Every row marked with a folder icon represents a group of elements Thus into the models group the model families can be found i e Scene Platform Forward Instrument and Retrieval O DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 45 of 121 SPACEY Every row marked with a document icon represents an element definition of the repository Right clicking over them a menu pops up containing some associated commands These menus are context sensitive meaning that different types of elements have their own associated commands These commands are going to be explained in detail in each
103. m Configuration module and adapt the default environment variables to match your distribution This is described in detail in section 4 5 1 It is assumed here that the environment variable PATH contains the path to the java virtual machine executable DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 34 of 121 S P A C EJ 4 ECSIM REFERENCE MANUAL This section provides a detailed description of all the elements that conforms the ECSIM graphical user interaction 4 1 Main window Here the look and feel operational behaviour and design features common to the ECSIM GUI in advance the MMI Man Machine Interaction are presented The MMI accepts input via devices such as the computer keyboard and mouse and provides articulated graphical output on the display Thus certain aspects of the MMI implement also the Object Oriented Interface OOUI paradigm because it is built from different pieces or objects with several properties and operations The ECSIM MMI also follows the Multiple Document Interface MDI pattern This approach has been chosen because of its flexibility as it lets users organize the layout of the information as desired showing only relevant windows and in the way users want The MDI pattern consists of a parent container that can host inside several internal frames These internal frames are
104. m User s Manual Page 119 of 121 S Bd EJ 11_12_compare L1_L2_compare is used to compare the quantities in two different 2 D ncdf files The program will read the data from the netcdf files and return the differences absolute and relative of filel file2 in the output netcdf file It reads in data from the L1 L2 rebin tool This means that there will be a predefined slab in the data stream of the input file and this argument is not needed here tools product_tools bin 11_12 compare l1 12 rebin L1 L2 rebin is used to change the resolution of the lidar and radar output files The program will read the data from the netcdf file and return the data in the new resolution in the output netcdf file It will retrieve the along track and height for vertical slabs made with extract quantity and the x scene and y scene for the horizontal slabs made with extract quantity hor tools product tools bin ll 12 rebin NetCDF differencer ncdiff subtracts variables in file 2 from the corresponding variables those with the same name in file 1 and stores the results in file 3 ncdiff ncBrowse NetCDF viewer ncBrowse must be in the system PATH This program reads a 3 D file from extract quantity 3d and produces 3 D iso surface plot along with a 2 D colour scale plot slice tools pgplot tools bin plot 3d plot hor This program reads a 2 d file from extract quantity hor and produces
105. menu bar to provide keyboard and mouse access to the simulator main functions as well as functions regarding frames management and application basis The MDI pattern provides some useful capabilities to arrange internal frames e g Figure 4 2 appropriately like cascading or tiling them Also internal frames can be iconized to give more available space When a user iconizes a frame it can be restored by clicking the button with its name in the available frames tool bar or in the corresponding menu item at the windows menu Occupying the central and main region there is a working area This area is where all internal frames are going to be created and main interaction is held Besides that this working area implements a scrollable panel in order to easily navigate through frames surpassing its bounds At the left side of the working area there is a system objects navigator a side bar aiming to provide a quick access method to every item known by the system repository of descriptors models simulations and sessions the list of simulation execution results a view to the scenes folder and also a file system browser to navigate through the contents of the application s directory The main window s footer area shows the corporate logos of the companies in charge of the development of ECSIM DEIMOS and KNMI as well as the ESA logo ECSIM EarthCARE simulator ILL Available frames System Repository Scenes Executi
106. meter values There are no restrictions on how to concatenate these simulations they do not have to be compatible between them but if necessary the final output files of a simulation can be used by the following simulation Simulation A simulation is understood as a list of models or even a model alone that is run sequentially and produces observable results A complete simulation would encompass a model per each of the model types defined within ECSIM Scene Platform Forward Instruments Retrieval Simulations can be more simple e g Instruments Retrieval Simulations can be started and ended at any stage even using only one model Interestingly simulations can be run in groups Equivalently simulations can be linked together This procedure is actually called session to better identify that we are dealing with groups of simulations The output of the simulations and the input also will be analysed if required with product tools Those will contain editors viewers and interfaces to the plotting libraries It is noted that those third party options are not fixed in general Exceptions are the plotting libraries based on PGPLOT which will provide ECSIM with basic plotting capabilities to browse and plot an UFF file for instance For this purpose ECSIM will contain configurable variables accessible through the MMI with editors or viewers However it is assumed that the third party editors and viewers will be i
107. n case users want to use a different version AR SP 15 Changed section 3 4 2 to separate the scattering libraries and the DEM Added clarifications about the minimal set and instructions to build the complete suite AR SP 16 Corrected section 3 4 2 2 The DEM is not provided as a tar ball AR SP 17 Substituted General data with General properties in section 4 10 2 2 AR SP 18 Changed pressing the accept button to pressing the Ok button at the end of section 4 10 2 9 AR SP 19 Deleted section 4 11 3 Open scene because that functionality is no longer in the system AR SP 20 Updated section 4 11 6 Deleted TBD AR ME 34 Included in section 3 3 3 and 3 3 4 a note to include the executables of some pre requisites into the PATH system variable AR ME 35 Removed from section 3 4 3 the mention to ECSIM HOME Clarified in section 4 5 1 that model executions get passed the environment variables AR ME 36 Included PGPLOT FFLAGS examples AR ME 38 Updated section 3 4 3 CFI installation is mandatory so should is replaced by must AR ME 39 Removed comment on figure in section 4 5 2 1 saying no parameter passing at this stage AR ME 41 Added detailed information in 4 10 2 8 and 4 15 1 explaining the variable passing technique DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Fam S ECSIM
108. n the simulation Thus only model compatible with selected instruments shall be selectable for current simulation Note that selecting at this stage the instruments that will take part of the simulation marks the instrument driven character of the simulation creation process 4 9 2 2 Models schema Users can now form the sequence of models that comprise the simulation the model schema Users have three different panels AU Simulation stages The list of simulation stages model families that the model schema must fill in according with the limits defined before The current stage is also indicated in this panel If no stage is indicated then the simulation is completely defined O Stage available models A list of available models from which the user selects one in order to start defining the simulation chain Notice that the list of models that appears in the panel must conform to the models corresponding to the previous processing step derived from the simulation type and the instruments compatibility this is done automatically by the system using the model definition and the IO descriptors It is important to note that the compatibility of a certain model is given by the fact that at least one file of its input is provided i e have the same default file name by the output of the previous models not necessarily the preceding one DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM
109. ng the hardware pre requisites 3 4 2 2 DEM ECSIM uses a DEM called GETASSE30 that stands for Global Earth Topography And Sea Surface Elevation at 30 arcsec resolution This DEM or Digital Elevation Model is a combination of four datasets the SRTM30 ACE Mean Sea Surface data and EGM96 ellipsoid being eventually referenced to the WGS84 ellipsoid The file is available at an ESA server as binary tiles with 1800 1800 points a squared area 15x15 degrees size These files must be placed in a specific folder that you must create with ECSIM mkdir models orbit dms aux dem data Alternatively you can create a link to the place where you have downloaded them ECSIMS cd models orbit dms aux ECSIM 1n sf original dem folder dem data 3 4 3 Model compilation Once the framework is successfully installed locate the SECSIM HOME models folder and once into it edit the Makefile in file ECSIM models vi Makefile in Inside you must locate and edit the following variables and match them with your actual folder structure LY NC INCLUDE Location of the NetCDF include files L NC LIB Location of the NetCDF library O PGPLOT LIB Location of the PGPLOT library O GCC_LIBS Your GNU C Compiler libraries location Another variable you can set is the one under section PGPLOT compile flags PGPLOT_FFLAGS This variable must be adapted to your PGPLOT library installation process It depends on what Fortran
110. ns O scale factor Includes the O in the calculations DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E oo Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 e AN System User s Manual Page 83 of 121 ae ht ER Editing scene scene inp 2222 General Dimensions Gasses Temperature pressure profile CO2 mixing ratio ppm Extra gasses atmosphere Surface Clouds amp aerosols Mid latitude_summer xml Number of extra gasses 350 0 H20 scale factor 1 0 O3 scale factor 1 0 1 aaa Element identifier Gas name Mixing ratio ppm cJ extra gasses extra gas 1o00 input N Add and remove buttons Double clicking over an Users can edit the scene s extra gas row users can list of extra gasses 5 edit them Figure 4 59 Scene Atmosphere composition L Extra gasses It is possible to include more gasses besides the three of the default set Clicking the plus button will show a dialog to input information of a new gas These are the attributes Gas name Short string Descriptive name of the gas CH4 Mixing ratio Float Mixing ratio of the gas 1 0 Mixing ratio file File An external file containing the mixing ratio profile ch4 profile This file must follow the RD ICD directives Gas name Editing x CH4 Mixing r
111. ns menu Operations involving simulations include the following O List present the list of existing simulations DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 AN ECSIM Date 07 05 2008 System User s Manual Page 56 of 121 PACEJ s U Creation capability to create a new simulation into the system Q Edition edit an existing simulation to enter changes a Deletion delete a simulation from the system U Execution Starts a new session definition including this simulation 4 9 1 Simulation list Users can access to the simulation list selecting the List simulations option from the Simulations menu Figure 4 28 shows an example of the simulation list window that is presented upon selection Below the table including the simulations existing in the system there is a tool bar with buttons to access to the different functions listed previously Users can thus select a certain simulation and perform the operations shown in the toolbar Data attributes shown in the simulation list table are simulation ID description the name of the author that created the simulation and both limits start and end of the simulation stages Repository list view Simulation identifier Description Simulations Backward Transforms the calibrate DMS amp KNMI i Retrieval Complete Simulates the forward an DMS amp KNMI Retrieval Forward Forward
112. nstalled downloaded by the user Synergy Synergy is essentially a synonym for the L2b products Basically it consists of combining the performances of each instrument to obtain state of the art 2D or 3D retrievals A tool is an external executable file that performs a given action to a certain group of files Used into the ECSIM platform and associated to a certain file extension these tools can be called to perform off line operations to products involved in simulations UFF File Binary file used by the current simulator containing the scene description Refer to RD SW for further details Version New instance of an existing model where either the source and binary code has been updated or the configuration file schema has been changed Instead of updating its version a model is considered as new if either its input and output schema is updated The justification for this approach considers that it is only with I O that a model is really embedded in the ECSIM architecture DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E e EN 07 05 2008 System User s Manual Page 20 of 121 S P A C EJ 2 RELATED DOCUMENTS 2 1 Applicable Documents AD RB TEC SW ECARE ETE RB Code Issue ECSIM Date End to End Mission System Performance Simulator for EarthCARE Requirements Baseline ECSIM DMS TEC SUM 01 R 2 4 1 2 AD SOW ECARE ETE SOW Statement of Work End To End Mission System
113. ntities boxes called models in the figure with clear I O This is completely new since the previous simulator did not have a clear definition of a model We can then connect the different models to perform simulations or to perform internal tests for example through the reconstruction of the input scenario at the end of the simulations It is also possible to focus on only one model calling it several times with slightly different conditions e g different configuration parameters to achieve an efficient sensitivity analysis or error assessment Figure 3 1 indicates all the models and basic closure options available at the time of delivering ECSIM Therefore this SUM will focus only on those models and tools Notwithstanding ECSIM has been designed to ease the addition of new models This is also indicated in the current document Returning again to the figure it should be added that as any user would appreciate it is possible to access directly to any of the processing stages that the simulator has That is someone interested only on checking L2 algorithms does not have necessarily to execute for example forward models prior to the instruments unless considered necessary for the generation of suitable and consistent L1 test data As a result any user can avoid those areas where he she has no interest DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E ECSIM DMS TEC SUM 01 R Code 2 4 Issue 07 05 2008 Date
114. o call the installation script ECSIMS sh install user password Where lt user gt and lt password gt are the name and password of the MySQL database root user Alternatively it is possible for the user to directly use the ECSIMdb sql script included in SECSIM HOME this way ECSIMS mysql database ecsim user ecsim password ecsim lt ECSIMdb sql 4 17 Table of acceleration keys This section describes the list of acceleration keys accessible for the user These combinations of keys when pressed access the desired platform functionality without using the mouse and menu systems Here is the complete list Exit the system Control x Exit the system Alt F4 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E a ECSIM Date 07 05 2008 System User s Manual Page 102 of 121 amp Bo E System Tools Tool list Control 4 System Configuration Show configuration Control 4 System About ECSIM Control 4 Repository Descriptors Descriptor list Control 4 Repository Models Model list Control 4 Repository Simulations Simulation list Control i Repository Sessions Session list Control 4 Scenes Scene list Control 4 Executions Results Result list Control 4 Executions Logs Log messages list Control 4 Window Close internal frame
115. o the instruments stage and it contains all the models related with the CPR instrument OA A list of product tools to perform the graphical comparison and to visualize the results These tools must be well defined and accessible for the system The following set of input auxiliary and configuration files will be defined scene creator xml Input scene inp xml ECSIM HOME sessions Radar 0 Radar scene inp xml orbit dms Input scene uff Pending orbit dms Configuration orbit dms config xml ECSIM_HOME sessions Radar 0 Radar orbit_dms_config xml rad filter Input uff adjust xml ECSIM_HOME products uff_adjust xml rad_filter Input scene uff Pending rad filter Input orbit xml Pending rad filter Configuration rad filter config xml ECSIM_HOME sessions Radar 0 Radar rad_filter_config xml radar Input rad filter out nc Pending radar Input orbit xml Pending radar Configuration radar config xml ECSIM_HOME sessions Radar 0 Radar radar_config xml DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 eco ECSIM Date 07 05 2008 d e l I i IS System User s Manual Page 114 of 121 S PACE NY 5 4 3 Steps O Select the HorSampling parameter from the radar model and access to the Iterate parameters function O Edit the parameter s values and input 200 0 300 0 400 0 Accept the changes and run the simulation O You can see
116. odel or a product tool is being executed they can access these variables if they need them because the system makes them available to the execution process Users can add or remove an environment variable using the given buttons Double clicking on an already existing variable the user can edit its name and value One mandatory variable is SECSIM HOME as explained previously This points to the ECSIM base folder location DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E SPACEY There is an environment variable called DEBUG MODE that controls the verbosity of some model executions Setting to On or Off can enable or disable this functionality Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q ECSIM Date 07 05 2008 System User s Manual Page 41 of 121 O System folders Users can change the default locations for these directories Models Here is where the model packages can be found These packages are just a folder structure containing the needed elements for the model to be successfully run following the directives given in RD ICD Products This is the best place to store product files of common use Scenes The set of XML files inside this directory are going to be scanned and those representing valid scene descriptions are going to be listed in the scenes tab of the side bar Sessions This is the place where all the files associated to session executions can be found Execution scri
117. of the simulation 61 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 10 of 121 sPACEJ 4 9 3 4 Step4 Finishing the simulation Creation cido 63 AIA simulatio COM ION ort 5505063555 toto tei rece EUR Oboe rta reap E REM cious a DE ELE i Rag R ERE esi aoa sa cus 64 4 9 5 lao Oda 64 4190 Simulation EC A Ia 65 ALO SESSIONS ii ata 65 A MOM o roe 66 A 10 2 SEBS IO GHC AMON sce nico PRI AAA A PRU N ERECTUS HET PIS RAP asennad 67 4 10 2 1 Import session foldet uoc EE Crete Eo a ine eere EIE edes dst on EPI Eee vu Od 67 10 22 General DIGDOPUGR siccitas p toin rai ita UR etae ETE ia 67 4102 3 Altering the simulation St Ecc UR EI ER e DI eee 68 2 10 24 PROVISION OF npt ara 69 4 10 2 5 Provision of configuration Tes eie ah HORN DRE ia 70 4 102 6 Parameters Conmp uta WOM eene ret t HER T Hu I eo apr 70 2 102 7 Speciicaiuimob output DIC iia 71 4 10 2 8 Specification of final productions 72 4 10 2 9 Iterative sessions iterating input output files and parameter values sss 73 21073 6851010 EIE BBC o oor neon MEETS a MEE 76 A A O 76 2 10 5 SESSION EXECU ON DD ads 76 4 10 On SesslOnscript A N E A S E E 79 AU SCONES T 79 A AULA VASE SCOTS a coa 79 MN e C E 80 A O e PEDI M UID DNI LM LINEAE 80 2 11 22 Scene ditnenstOns i es tt sa e i DLE OI tr LI Ie LIED 81 4 11 2 3 Atmosphere CoOD
118. ons toolbar Editing mo Repository V 4 Repository Scenes Executions File system Search object in repository e E Editing model scene creator xml 1 0 Bement identifier E General Configuration Input output mars 2 Model description gt Descriptors 3 Cf Models El Identifier scene_creator_xml 4 Scene y scene_creator_xml 1 0 E Model version 1 0 O Platform 3 N Repository list view E orbit dms 1 0 Description E Forward Model identifier Description 3 lid filter 1 0 Models Iw rad 1 0 Y Scene rad_filter 1 0 E E scene cresscene KNMI amp DMS sw rad 1 0 cf Platform E Instrument KNMI amp DMS D orbit dms Platform Deimos Space bbr 1 0 Ei E Forward lidar 1 0 lid filter Moran Forward model for KNMI msi 1 0 radar 1 0 a Retrieval E Instruments compatibilty sw rad LlForward KNMI id_i2a 1 3 X ES Instrument lid rad I2b 1 0 v ATUD YI CPR a hw_msi_lid_rad_12b_3d 1 0 E me a do barbara Uf can f New model version iif Delete 9 EA Simulations Source file Backward Complete Forward Binary file ene creator bin scene creator xml Iw rad 1 Forward KNMI rad filter Forward Forward model for KNMI pra
119. ooo RE RR ER EATON Na RUE 63 Detining a simulation final Wid Ow reos ciis bp He dea oe EHI I rete oer Sed 64 SX Daun o Beer were ate ope ee ment nese re ren eer arene Secor eee ees R t er ues rer ee eerie ree Ute fu 65 SESSION MCN as ia a asia 66 SESSION POP UP MEM c A A suka a occ Essa te n scere ron 66 SES MSM seceded P 67 SESSION a lo tale 67 Session creation General Properties o ER UT e ean eed 68 Session Simulations PSICO nad 69 Session Inputs da 69 Session Configuration files definition daria 70 Session Parameters definition cado 71 Session Output definit oM essan la 12 Session Product taals peca 72 Session creation Tterabinp Parameters ssc iscsi toss DUO Rat taal atone Fase PRIN OR ILE 74 Session Creation Editing numeric sequences nennen nennen 74 Session creation Pre viewing the parameters iteration esssssseseeeeeeeee nennen 15 Session execution Reddit 77 Session Execution Pro TESS Ui EEUU ira 78 Scenes qmd Teo eor csv et o EC C RTT GOD t a bre E n REC RE 19 SCENES ab in the Side Di cias 79 SCENES pop up MA Nie eran AiR ae 79 SER VIC aecacccssi bi dendi heap It A 80 Scone Concreto 81 Scenes Vencal resol a 81 Scene Dimensions and TES iia iii a epica 82 Scene Atmosphere COMPOSITION 2 pierre tor HERR a a REALE IA DAP ERRARE HAB M E E MEMO 83 SECO EM AS EE 83 Scene SMAC Pee RE 84 Ee E E TE DIQU E E A E A E IE 85 Scene Clouds and Aerosol asian 86 DEIMOS Space S L 2007
120. oose another identifier DMS DQS QREO609 SUM 10 E Code ECSIM DMS TEC SUM O1 R Issue i 2 4 4 E EM Date 07 05 2008 System User s Manual Page E 104 of 121 amp mu EN Deleting a descriptor Database error Possible database failure Is your database running Repository Models Accepting changes Validation error Follow the instructions to correct the value Model addition failed You have chosen a duplicated identifier Please provide a different identifier Deleting a model Database error Possible database failure Is your database running and configured Creating a new version Database error Possible database failure Is your database running and configured Repository Results Deleting a result Database error Possible database failure Is your database running and configured Repository Scenes Accepting changes Scene addition failed You have chosen a duplicated identifier Please provide a different identifier Validation error Follow the instructions to correct the value Adding a relative altitude to a scattering region Validation error Follow the instructions to correct the value Comparing scenes File IO error Follow the instructions Deleting a scene File IO error Follow the instructions Editing a vertical resolution layer Vertical resolution step of this layer must be less than its size Please inpu
121. operation is illustrated in Figure 4 31 DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 61 of 121 Creating a new simulation General properties Identifier Active Author DMS Description Simulation with all active instruments CPR amp ATLID Start Stage scene y End Stage Instrument y Instruments ATLID CPR C BBR C msi Models schema Simulation Stages Scene Platform Forward Instrument Platform models available i Current simulation definition Description Element identifier State of the art Deimos Space Simulation definition L5 Scene Y SCENE CREATOR 1 Previous stage gt Nextstage Accept 4 9 3 3 Step 3 Selecting the remaining models of the simulation The next step refers to the selection of the remaining models up to the completion of the simulation In the example once the scene generator model has been chosen the forward modelling must be defined By pressing the Next stage button Figure 4 32 the system will show the list of available forward models to join the simulation It is important to mention that only those models that are compatible with the IO descriptors of the previous model are presented here This means that during the simulation definition the consistency of its consti
122. own error messages and they are intercepted by the system and shown as log messages in the execution view Here is a list of possible kinds of errors raised by the models All forward retrieval and Incorrectly formatted or missing command Error and Usage help message is Adjust command line arguments to match the usage instrument models line arguments reported statement Ill formatted xml configuration file xml syntax error is reported along Edit configuration file based on the reported error with line and column where parsing failed DEIMOS Space S L 2007 DMS DQS QREO609 SUM 10 E oo ECSIM Code ECSIM DMS TEC SUM O1 R Issue 2 4 Date 4 07 05 2008 System User s Manual Page E 107 of 121 AS EY Mismatch between declared parameter type and dimensions and supplied parameter within the configuration file Mismatch error is reported along with offending parameter statement Edit configuration file based on the reported error Missing non optional parameters Name of missing parameter is reported Edit configuration file based on the reported error supply the missing parameter Missing input data files or necessary auxiliary data files including scattering libraries Name of missing data files are reported Verify that the relevant files have been installed and the ECSIM path environment variables have been correctly set Unable to write output file W
123. pts report files and by default configuration and output files generated are going to be stored here following the RD ICD directives Temporal Some intermediate files are going to be stored temporarily in this directory LI System tools There is a list of system tools that must be configured in order to activate some scene functionalities All around this configuration dialog and the rest of the ECSIM system except those places where something else is specified the user can choose to input the absolute path of a certain file or folder or the path relative to SECSIM HOME DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Z 778 ECSIM Date 07 05 2008 System User s Manual Page 42 of 121 E PA C EJ 4 5 2 Tools As explained in section 1 3 a tool is an external executable file that performs a given action to a certain group of files Used as part of the ECSIM framework and associated to a certain file extension these tools can be called to perform off line operations to products involved in simulations Tools are definable by the user Accessing to this functionality the user is able to manage the ECSIM product tools gt System list view Product tool identif Executable Parameters 7 Product tools extract env extract env extract tools product tool input uff env data extract quant extract quantity Itools product tool inputfilename out
124. ractal clouds DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E oo ECSIM Code ECSIM DMS TEC SUM 01 R Issue 2 4 Date 2 07 05 2008 System User s Manual Page 27 of 121 S pou ER CloudGen 1 3 Cloudgen is a program for generating three dimensional stochastic clouds specifically cirrus with realistic horizontal and vertical structure This is used by the scene_creator model to generate fractal clouds Refer to section 4 11 2 5 1 for more information http www met reading ac uk clouds cloudgen Scattering libraries Scattering phase function data extinction and absorption data covering wavelengths from 200 nm to 4000 microns as well as radar reflectivity at 95 GHz This is needed by all the models but the Orbit dms Distributed with ECSIM DEM Digital Elevation Model Used by the orbital model ESA http earth esa int services amorgos download getasse ncBrowse Generic netCDF file viewer that includes Java graphics animations and 3D visualizations for a wide range of netCDF file conventions See official site http www epic noaa gov java ncBrowse HDFView Visual tool for browsing and editing NCSA HDF4 and HDFS files See official site http hdf ncsa uiuc edu hdf java html hdfview Postscript files viewer Views the plots generated as result of many models Text files viewer V
125. red from the last valid model executed DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 e A ECSIM Date 07 05 2008 System User s Manual Page 79 of 121 sPACEJ 4 10 6 Session script generation This functionality is provided to create and save a file script to enable the external execution of the session This script file called lt session_name gt sh will be saved in the session folder as every needed input and configuration files This script shall contain all the environment variables definitions and calls for models executions It is important to recall that while the execution will be mimicked executing this script outside the ECSIM framework the error handling and results storage capabilities will be lost 4 11 Scenes The ECSIM system can be divided in three logical parts repository scenes and executions The second of these parts is a set of different scenes that is ensembles of atmospheric data that defines the initial conditions of a simulation serving as input files for the scene creator In this section users will learn how to manage definitions of these scenes represented as XML files that later will be used as UFF files taking part of simulations Users can access the scenes functionalities via the main menu bar Figure 4 52 or via the scenes tab of the side bar Figure 4 53 Right clicking over a scene the menu in Figure 4 54 shal
126. rieval c Simulations 3 Complete Figure 4 11 Side bar DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q a ECSIM Date 07 05 2008 System User s Manual Page 40 of 121 S P A C EJ 4 5 1 Show configuration Selecting this menu option the dialog shown in Figure 4 12 will show up In this System Configuracion x Environment variables Environment variables variable STD ATMOS Ze m ameJ projects ECSIM models aux standard atmos profi OMP NUM THREADS 2 KMP STACKSIZE 512M SCATT LIB Jhomej prajects ECSIM models aux scattering libraries DEBUG MODE Off ECSIM HOME home projects ECSIM SURF FILES jhome projects ECSIM modelsaux surface files es E Ee NE FONT jusr lib pgplot5 grfont dat remove LEE LD_LIBRARY_PATH j opt intel fc 9 1 036 lib LD LIBRARY PATH TEST HOME fhome projects ECSIM tp MSI LOOKUP home projects ECSIM models aux msi lookup System folders System toals Models models Products products Scenes scenes Sessions sessions Temporal tmp 11111 Ok Cancel Figure 4 12 System configuration dialog users can modify the following characteristics of the system Q Environment variables A list of environment variables and associated values are shown in this table Once a m
127. riting failure is reported along with name and path of the relevant file Verify that the specified output directory exist and that the user has write permission Plotting tools Requested quantity is not present with the expected number of dimensions within the ncdf data file Error message listing all available quantities for the supplied ncdf file is generated Rerun having made a choice amongst the available quantities Unable to create the plot using the requested graphics device Unformatted PGPLOT errors will be reported Rerun using an available graphics device To check the available devices specify as the device must be done in command line mode To add more devices PGPLOT must be recompiled and installed DEIMOS Space S L 2007 DMS DQS QREO609 SUM 10 E Code ECSIM DMS TEC SUM O1 R Issue i 2 4 a Date 07 05 2008 System User s Manual Page E 108 of 121 EAS E L1_12 compare Resolution mismatch between the 2 data An error message is generated Follow the instructions in the error message first use streams the user wishes to compare 11_12 rebin to harmonize the resolution of the 2 data files Uff merger Resolution mismatch between the 2 UFF files An error message is generated Follow the instructions in the error message first use the user wishes to compare uff averager to harmonize the resolution of the 2 uff files Extract_quantity Missing inpu
128. ruments Instrument Four types Radar CPR Lidar ATLID Imager MSI and Radiometer BBR models These models have as output LO and L1 products including L1b and L1c Model Executable entity that can take part in a simulation A model can be understood broadly speaking also as an algorithm Basically it contains the recipe to produce products function of inputs A model contains also several rules to define the input output and associated formats Furthermore its behaviour is controlled by one configuration file Overall the architecture of a model consists of U The source code and its binary compiled counterpart A A configuration file with its parameters Q An input file that characterizes its inputs A An output file that characterizes its outputs In addition it must belong to one of these classes scene forward retrieval platform instrument Parameter A constant whose value characterizes a given particularity of a model Parameters are user configurable they are fixed before launching a model and for practical reasons not all of them shall be accessible from the HMI DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 18 of 121 Se ae ER Platform Models that navigate the instruments along the orbit These models are responsible models for the proper location in space and pointing towards
129. s with the arrow buttons besides 4 10 2 9 Iterative sessions iterating input output files and parameter values Users can assemble iterative sessions This is a powerful feature that helps to run a large number of simulations by changing values of the parameters Users can alter any parameter s value to fine tune the behaviour of a model for a particular simulation run Selecting one or many files or attributes and pressing on the iterate button the dialog shown in Figure 4 47 will come up In this example we are going to iterate two float parameters from two different models Tools defined in the system have an action associated to a file extension See chapter 4 5 2 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 74 of 121 SPACES iterating parameters x Parameters to iterate Session preview Parameter name Values Parameter name Values Parameters C3 Parameters C Complete EA Complete ci orbit dms 1 0 ci orbit dms 1 0 parameters propagation step 0 5 D parameters propagation step 0 5 rad filter 1 0 9 rad filter 1 0 3 parameters rad freq 94 0 3 parameters rad freq 94 0 Preview Ok Cancel Figure 4 47 Session creation Iterating parameters This figure shows the initial state of the dialog The list of selected parameters is in the left table and a previe
130. scriptor s unique name LIDAR In string Description Long A brief description of its composition or Orbit information and string the purpose of the set of files radiative transfer information It is possible to alter the set of files that integrates the descriptor Users can edit add or remove files An individual file must be described by these two parameters Default file The default location and name of the file orbit xml This is the file that is going to be suggested during the session definition see section 4 10 Sessions Description Brief description of the files XML file with Orbital composition its purpose or its type information XML UFF NETCDF etc It is important to note that the default file name is the way to know if two models are compatible and to connect them in the simulation definition More information can be found in section 4 9 2 2 The order that those files occupy in the list is important This order must fulfil the directives of RD ICD or the command line specification of the third party model because how you sort the files will define the DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 A ECSIM Bete 07 05 2008 System User s Manual Page 47 of 121 pow EN order of the input and output files in the command line of the model execution This order can be altered with the up an
131. suesessssnsdesteuscsdecsiedes 101 4 1S uenau ciu e reU E 103 5 ECSIM Operations a isa 109 5 1 Forward branch simulation eee eee e eee e eee ee neenon eene enata seen seas etn eon sense ene sa sess etas ea seen esas en sena 109 ll Operation objective O IDEAE eS 109 S2 DS COROS aaa 109 SE SOS enero api ia 110 5 2 Single Instrument retrieval ssssssscsscssscssssscssassansansecsssasscnsassacseassassacssdssecsedsvsasaassatssnseassscssasstssacsedssisess 110 3 21 Operation OD GIO EE T EE EE sedbgebock pres E E T soeeauaaten 110 O LION EE I SE ELM IM I I EL 110 ELE eL 111 5 3 Synergistic Instrument Retrieval ssicccsicssscsscsscscssscscssesscssscsoescosseascessscecsseasssvessnesecscecsstsscctosssosseueseseee 111 3 9 1 Operation ODE NVES ai A ASG te NU PRU um Santee etes EAE Ld 3 37 A pact te em ird ee ue co tensnncesin E E Et I SE DSe a 112 5 4 Experiment with Multiple FUDS siscisisscssscscececcsccietssecassscccecciscesesecdssoceicassseesescesscoscssedsesssnssccsccdecdssesves 113 O 113 AD A A 113 A ERTER E EENE ERE R 114 5 5 E2E SIMU ALON A t bann E UI E A E A A 114 5 5 T D DerationpbIGGl VE nieto rH E E EE EEO R 114 22 Pre contitl BB S ii 116 s MITT M 117 DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 12 of 121 sPACEJ 5 6 List of available SCONES aria 1
132. t lt name gt xml DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 2 a ECSIM Date 07 05 2008 System User s Manual Page 101 of 121 es EE Scenes Scene binary file File system Q lt scenes_folder gt lt name gt uff O lt scenes_folder gt header_ lt name gt uff Q lt scenes_folder gt size_dist_ lt name gt uff Executions Results Database Executions Logs Database Execution Dumped log session File system Execution Input output configuration File system files lt sessions_folder gt lt name gt lt index simulation_name gt lt filename gt 4 16 1 Database maintenance Currently the database is allocated in a local MySQL server named ecsim and can be accessed with a user named ecsim with password ecsim This user and password cannot be changed or the ECSIM system will not be able to access it and consequently it will not start The user or the database server administrator is responsible to regularly back up de fragment clean and perform similar maintenance operations to guarantee the database integrity Users can execute the following script to perform a manual backup to the ECSIM database ECSIMS mysqldump user ecsim password ecsim ecsim gt ECSIMdb bk sql In case of a major corruption problem or if the user would like to roll back to the original ECSIM database configuration it is possible t
133. t a valid step Editing a scene File IO error Follow the instructions Merging scenes Incompatible scenes You must select two valid scenes to merge New scene File IO error DEIMOS Space S L 2007 Follow the instructions DMS DQS QREO609 SUM 10 E Code ECSIM DMS TEC SUM O1 R Issue i 2 4 4 E EM Date 07 05 2008 System User s Manual Page E 105 of 121 amp mu EN Previewing a scene File IO error Follow the instructions Repository Sessions Accepting changes Validation error Follow the instructions to correct the value Database error Possible database failure Is your database running and configured Session addition failed You have chosen a duplicated identifier Please provide a different identifier Adding a simulation Session identifier cannot be void Please provide a valid identifier before adding a simulation Deleting a session Database error Possible database failure Is your database running and configured Generating a script File IO error Follow the instructions Iterating parameters Invalid list of values Please input a comma separated list of valid values no blanks Validation error Follow the instructions to correct the value Removing a simulation There is no simulation selected Please select a simulation to remove Running a session Cannot run an unnamed session
134. t data files or necessary Name of missing data files are Verify that the relevant files have been installed and the Extract hor auxiliary data files including scattering reported ECSIM path environment variables have been correctly set Etc libraries Unable to write output file 2 Writing failure is reported along Verify that the specified output directory exist and that the with name and path of the relevant user has write permission file DEIMOS Space S L 2007 DMS DQS QREO609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 Q al ECSIM Date 07 05 2008 System User s Manual Page 109 of 121 S PA C E 5 ECSIM OPERATIONS MANUAL This chapter details some examples of procedures on the ECSIM system Experienced users can skip its reading 5 1 Forward branch simulation 5 1 1 Operation objectives The objective is to perform a simulation of the forward branch of all the instruments The simulation starts creating a scene and ends simulating the CPR instrument As a result of this simulation we can visually compare how the reflectivity of the original scene was and how the instrument sensed it 5 1 2 Pre conditions A previously defined session called Forward exists in the repository This session includes L One simulation also called Forward that concatenates the scene creator orbital rad filter and the radar models O A list of product tools to show to visualize the
135. that after the installation of the Sun Java 2 RE and the MySQL client and server your PATH system variable must contain the folder location of their main executables 3 3 4 Models and product tools minimum pre requisites Intel Fortran This is the recommended Several options http support intel com support compiler for Fortran compiler for the There is a free performancetools fortran linux Linux 9 er model sources Only version edition for the superior 9 community GNU C C This is the recommended GNU General http gcc gnu org compiler for C C compiler for the Public License Linux v 4 0 model sources GNU Lesser or superior General Public License PGPLOT 5 PGPLOT is a device Freely available http www astro caltech edu independent graphics for non tjp pgplot subroutine library This is commercial use used by some product tools to visualize graphics See note below DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 26 of 121 E Box EY NETCDF 3 6 NetCDF Network Common Freely available http www unidata ucar edu Data Form is a set of software netcdf software libraries and See note below machine independent data formats that support the creation access and sharing of array oriented scientific data Many product files used
136. this format ESA Earth Collection of multiplatform http eop cfi esa int Explorer CFI precompiled C libraries for CFl ee cfi software html software timing coordinate conversions orbit propagation satellite pointing calculations and target visibility calculations specifically parametrized and configured for EO satellites Note that the PGPLOT source code should be compiled on the target machine to obtain the libpgplot a library It needs as pre requisite the png devel and xorg x11 devel packages The following drivers should be installed GIF PS CPS VCPS PS and NULL Note that also the NETCDF source code should be recompiled with the Fortran compiler used to compile ECSIM After the installation of the Intel Fortran and the GNU C C compilers your PATH system variable must contain the folder location of ECSIM main executables 3 3 5 Models and product tools optional components If the user has already fulfilled all the previous pre requisites he she is already able to install and execute the ECSIM platform scientific models and tools However some of the capabilities are disabled until the following components are present into the system FFTW 2 1 FFTW for Fastest Fourier GPL and http www fftw org Transform in the West is a commercial software library for computing discrete Fourier transforms This is required by CloudGen and used by the scene creator model to generate f
137. thor At the model identifier column it is presented the indented outline structure with folder icons as nodes and document icons as leafs Double clicking over each folder will expand or collapse its content Repository list view Model identifier Description 9 1 Scene D scene creator xml 1 0 scene KNMI amp DMS 9 7 Platform IN orbit_dms 1 0 Platform Deimos Space 9 C Forward lid filter 1 0 Forward Forward model for the L KNMI Iw rad 1 0 Forward KNMI rad filter 1 0 Forward Forward model for the r KNMI sw rad 1 0 Forward KNMI 9 5 Instrument 2 Edit la New model version i Delete Figure 4 22 Model list view DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E oo Code Issue ECSIM Date ECSIM DMS TEC SUM 01 R 2 4 e 07 05 2008 System User s Manual Page 50 of 121 S P A C E 4 8 3 Adding models Users can add a new model accessing this functionality from the main menu or alternatively clicking over the New button in the model manager This frame contains the components needed to introduce all data to define a new model in the system These data model attributes are grouped with the following structure L General O Configuration L Input Output Each category is analysed in the following sub sections 4 8 3 1 General data In this group Figure 4 23 users must define general information about the model to creat
138. tion the model can be integrated and executed into the system Nevertheless model developers must have in mind the following points Q Memory handling is responsibility of the model ECSIM does not manage memory assignments and does not destroy any data structure created by the model L A model can create child processes but their management is still on the model developer s side O ECSIM system does not detect when a model execution is halted or in an infinite loop Please send some logging information see RD ICD to the ECSIM every two seconds at most to let the user know there is no problem O Execution performance of the model could be slightly slowed because of the messaging interception 4 8 2 Model list Accessing to this functionality from the main menu or from the repository the system will show a list of models known by the system Figure 4 22 shows an example of the window that appears upon its selection As models and their versions follow a hierarchical structure i e a single model belongs to a family of models the information is organized as a tree table which put hierarchical data in columns like a table but uses an indented outline structure in the first column to illustrate the tree structure Users can select a certain version of a model and perform the operations shown in the toolbar Data attributes shown in this tree table are model ID version number type description and the name of the au
139. to set before the compilation process Section 3 4 4 Changed folders named auxiliary to aux Section 3 5 Added a note about the ECSIM executable Section 4 16 1 Replaced append gt gt operator by create gt operator DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 E System User s Manual Page 5 of 121 S PAC d 2 4 Changes to meet ESA s comments at CDR on 28 08 01 08 November 2007 Updated figures and section 1 to match software version 1 1 Updates tables of applicable and reference documents to match latest versions Deleted former section 3 5 1 describing the setup of environment variables Included instructions for setting those variables through the installation script Added an introduction to section 4 17 Included a new section after number 4 17 describing the error messages generated by the framework and models Updated an extended description of the scattering libraries Removed section Scenes Generating XML Included instructions to import scenes from third party applications Fixed section 4 9 2 Simulation creation to show the correct way to access the functionality Table in section 4 9 2 1 Simulation ID in first row first column changed to Identifier Updated section 4 11 2 2 to correctly name the add and remove buttons Updat
140. ton to start the execution L The execution will start and you can see its progress status O Once the simulation ends all the post processing tools will start and you can see a graphical representation of how the instrument senses the scene and the generated orbital file L Other operations you can do upon the execution s end are to check every other generated file or the final execution report where you can find detailed information about it 5 2 Single Instrument retrieval 5 2 1 Operation objectives The objective is to perform a simulation of a single instrument and to retrieve its output In this case it will simulate the behaviour of the ATLID Finally a graphical comparison between the original and the reconstructed scene is shown 5 2 2 Pre conditions A previously defined session called Lidar exists in the repository This session includes L One simulation named Lidar This simulation starts from the scene creator to the retrieval stage and it contains only models related with the ATLID instrument QO A list of product tools to visualize the reconstructed scene The following set of input auxiliary and configuration files will be defined scene creator xml Input scene inp xml ECSIM_HOME sessions Lidar 0 Lidar scene_inp xml orbit_dms Input scene uff Pending orbit_dms Configuration orbit dms config xml ECSIM_HOME sessions Lidar 0 Lidar orbit_dms_config xml lid_filter Input
141. ts identifier and its description DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 ECSIM Date 07 05 2008 System User s Manual Page 46 of 121 S PAC EP Repository list view Descriptor identifier Description Number of files msi_l2a in msi I2a out orbit out Geolocation and coordinates of all the pixels within the scene In radar in Input for the radar model Orbital information generated by radar out Output of the radar instrument module Described in AD ICD 4 rad filter out Output of the radar forward module Described in AD ICD 4 12 rad 2a in Input files for rad I2a model Orbital information generated b rad 2a out Model radar 2a retrieval results Described in AD ICD 4 14 2 scene description XML description used as input for the scene creator xml to gen scene uff Set of UFF files describing a scene This set is composed by sc sw rad out Output of the SW radiative transfer forward module Described i E Edit MI Delete Every descriptor defines a j set of files Figure 4 18 Descriptor list view 4 7 2 Descriptor creation Users can define new descriptors in case they want to accommodate third party models that cannot make use of any of the nominal descriptors The frame shown in Figure 4 19 is responsible to define the descriptor s characteristics Identifier Medium De
142. tuents is granted Users can now select multiple models to add to the tree structure at the right side DEIMOS Space S L 2007 DMS DQS QREO0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 62 of 121 gt Creating a new simulation General properties Identifier Active Author Dms Description Simulation with all active instruments CPR amp ATLID Instruments ATLID CPR C BBR C msi Models schema Simulation Stages Os Platform Forward Instrument Forward models available Current simulation definition Description E Element identifier Radar forward E3 Simulation definition ATLID F 1 0 Fomward LIDARForward Deimos Space 9 C3 Scene 3 SCENE CREATOR 1 0 9 c Platform 3 ORBIT_DMS 1 0 Previous stage gt Next stage E accept Figure 4 32 Defining a simulation presentation of consistent models Once all the desired forward models have been added to the structure users can press the Next stage button and continue defining the models for in this example the platform instruments and retrieval algorithms It is important again to recall that each time a model is selected the list of models presented in the next processing stage is limited to those that are compatible in terms of the IO descriptors Thus the retrieval models shall be listed a
143. ue value for each CFI types parameter is needed Only the values column is editable to the user the others just present useful information describing each parameter Note that changing the value of these variables will not affect to the template configuration files specified in the Configuration tab The variables involved in a session definition are stored in database with the chosen values meaning that the session will use them during the execution 4 10 2 7 Specification of output files Users can change the name and location of the output files that will be generated by execution of models Selecting the output tab as shown in Figure 4 45 the system will show a list of output files grouped by models and simulations and following the execution order DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 IN ECSIM Date 07 05 2008 System User s Manual Page 72 of 121 Se d Es Session setup Input Configuration Parameters Output files generated Default file File instance J Output Radar J scene creator xml 1 0 D scene uff scene uff 9 J orbit dms 1 0 ecsim_orbit xml ecsim_orbit xml 9 rad filter 1 0 3 rad filter output nc rad filter output nc E radar 1 0 radar output nc radar output nc 4 rad_I2a 1 0 Figure 4 45 Session Output definition By default these files will have a Pending
144. vents These events can be of one of these groups O System information An event with some information to the user is generated by the platform This is a harmless event thus the execution continues with no interruption Coloured in dark green O Information An event is raised by some model Its message is intercepted and stored by the platform This is a harmless event thus the execution continues with no interruption Coloured in green U Warning A model has detected a non fatal error or situation that may cause a fatal error This is a harmless event thus the execution continues with no interruption Coloured in yellow OU Debug These events are raised when executing the session in debug mode This environment variable defined in section 4 5 1 is optionally used by some models to show debugging information Coloured in gray O Error A fatal error has happened in the model execution and the model itself informs the platform about it so the model has time to graciously close the execution Another event that causes an error is that a model execution unexpectedly crashes so this time the platform intercepts this error informs the user and stops the execution Coloured in red Pressing the abort button will make the system ask for confirmation Once granted the execution will be interrupted with an error event generated by the system Later on this session execution can be restarted or recove
145. w of the models upon the combination of all the different parameter values on the right table Accessing to the values column of the left table users can input a list of valid values separated only by blank spaces or commas but not both Users can alternatively double click on a parameter and the following numeric sequence generator dialog will show up Editing numeric parametel This is the step division Type FLOAT id text field Values 90 0 91 0 92 0 93 0 94 0 95 0 Numeric sequence Start 90 0 End e Step Division Ok Cancel Figure 4 48 Session Creation Editing numeric sequences This dialog lets the user define a numerical sequence of values of the selected type FLOAT or INTEGER in three different ways Q User input Users can introduce their own values using the Values text field Q Numeric sequence by step Once defined the starting xi and ending Xn values of the sequence users can input the value of the step s in the step division text field Pressing the generate marked with the ellipsis symbol will create an arithmetical sequence following this rule DEIMOS Space S L 2007 DMS DQS QRE0609 SUM 10 E Code ECSIM DMS TEC SUM 01 R Issue 2 4 E ECSIM Date 07 05 2008 System User s Manual Page 75 of 121 SPACEY fx x s X EZ E Numeric values will never be greater than the upper limit For example a numeric sequence st

SYSTEM USER`S MANUAL

Contents

Download Pdf Manuals

Related Search

Related Contents