Archive Users Manual - ESO
Contents
1. AMBER 2009 03 11T22 00 31 668 NGRH 1_Obeta8 ESO Data Flow Infrastructure Send us your comments Subscribe to Newsletter Privacy Statement Figure 10 ESO Archive Requests submission page ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 11 of 23 4 3 How to submit a request It s recommended to specify an informative Description before submitting a request The Request Description provides a label for the request in addition to the request number which should facilitate identification of the requests n a later return visit to the archive pages or to ease any enquiry to the archive heldpesk on a particular request The user can select the options Header on the fly correction and Add IRAF keywords Note that the addition of IRAF keywords is currently only possible to select if the Header on the fly correction is also selected Note WFCAM files can currently not be processed using the Header on the fly correction option In this case files must be requested without checking this feature The system will be soon able to identify files that cannot be processed in this service and skip this feature while processing When accessing the new ESO Archive Requests interface for the first time the user is presented with the following page ES European E x ESO Archive Requests O Observatory ge Fo ES2. Munchen Germany
3. PI Pack Select one of your own runs or one for which you have been delegated Data Access Rights and search to see if files were added to the PI Pack for the specified acquisition time interval Run ID 086 D 0165 A FORS2 acquired between and not included 2010 12 25 Figure 20 PI Pack Run and dates selection Clicking on the Search button will have the effect of displaying the list of raw files available for the run and dates chosen European ES Boyan ESO Archive Requests p O Observatory I s ESO Reaching New Heights in Astronomy mE S CECE ESO Home User Portal Contact Site Map Search OO Science User Information gt ESO User Portal gt ESO Archive Requests ESO User Portal Data Access Control ESO Query Science Archive Archive Requests Archive Department Logout Incremental Delivery of PI Packages What is this Define PI Pack Select one of your own runs or one for which you have been delegated Data Access Rights and search to see if files were added to the PI Pack for the specified acquisition time interval Run ID 086 D 0165 A FORS2 All Requests Recent Requests PI Pack Requests FAQ acquired between and not included 2010 12 25 Package contains 75 files until 2010 12 25 of which 4 are raw science data shown below The size of the selected package slice is 93 1 MB Package 086 D 0165 A FORS2 Raw Science File Acquisition Night 520926 sci_raw FOR
4. RE er u 3 ESO Reaching New Heights in Astronomy een ot oe rT tt eet ESO Home User Portal Contact Site Map Go Science Users Information Observing Facilities Science Users Information Future Facilities These pages are aimed at the ESO community astronomers they contain all the information required in order to prepare Observing with ESO Telescopes execute process and exploit observations with the ESO facilities They also contain information on the scientific activities aes Seema taking place at ESO Data Handling and Products The side menu will take you directly to the relevant pages Science Archive Facility ESO and HST Archives ERREGER ESO Virtual y La Silla Paranal Observatory and to the technical pages for the instruments and telescopes available at Ea Tind information on instrument development nn mean rn a E ts to information needed at every stage of preparing a proposal for observing time from the proposal IT Services preparation to submission and for planning the observations in Visitor or Service Mode In addition you will find here information Libraries on observing policies and procedures and on observing time allocation Publications e Via ESO Scientific Software and Tools you have access to a collection of ESO supported software products for data reduction and Job Opportunities analysis and to Scisoft a project within ESO to provide a collection of astronomical software utilities You will
5. clearly indicated in the display ES Sounen N ACE Access Control ESO O Observatory 4 5 ri 5 pi ESO Reaching New Heights In ze _ p I i m ESO Home User Portal Contact Site Map Science User Information gt ESO User Portal gt Access Control Carlos De Breuck Logout ESO User Portal Grant Revoke Data Access Rights for Proprietary Runs Admin Data Access 084 A 0324 AGN driven feedback in high z radio galaxies Quantifying the Impact of radio power pt 3A Instrument Delegated Revoked Users Delegate to Science Archive 084 A 0324 A SINFONI Service user added ane Nathalle F I Archive Requests tamena toana revoke delegate FAQ rn Figure 28 Entering the email of the delegated user The User Nathalie Fourniol can immediately log into the User Portal to access the ESO Archive Requests application and via the Data Access Control menu under View Data Access see which run id has been delegated to her and submit a request to download the corresponding data ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 21 of 23 Portal Contact Site Map Search GE Gol 50 User Portal gt Access Control Nathalie Fourniol Logout lata Access Rights Report for Public and Proprietary Runs My private delegated runs 0 Mga el 2 Eger eB oka a 084 A 0324 AGN driven feedback in high z radio gala
6. property of ESO This also applies to all data taken during ESO time on other facilities e g APEX GRANTECAN ESO grants PIs sole access to the data for a predefined proprietary period usually one year from the moment the data were made available to the user PIs may delegate access to data to one or more collaborators After the proprietary period has expired the data are released to all users worldwide current default but ESO reserves the right to restrict access to some or all data to users from selected countries for example users from ESO Member States the default before 2004 After the expiration of the proprietary period the PIs their delegates and Co Is are considered to be regular users more information to be found at the following link http archive eso org cms eso data access policy The factor determining the user s country is their affiliation and not for example the user s citizenship ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 7 of 23 4 User Guide 4 1 Search Definition There are several ways to submit a request of data depending on which query forms have been used From the entry point http www eso org sci the user can access the http archive eso org web page as can be seen from Figure 3 and 4 European 22 ne Ses Science Users Information E Southern O Observatory 4
7. 11 AUM Download and Delegation Page 12 of 23 Issue 1 0 Note that more queries can be posted from the Request Handler page following the ESO Query and the Science Archive links on the left hand menu gt with the ESO query link that gives access to the ESO main query form gt with the Science Archive link that gives access to archive eso org web page as can be seen from the figure below Science User Information gt ESO User ESO User Portal Data Access Control ESO Query Science Archive Archive Requests All Requests Recent Requests Pl Pack Requests FAQ R Figure 12 Accesses from the ESO Archive Requests application to ESO Archive 4 4 How to retrieve data Once the request is submitted the following result page is presented European ES Fa ESO Archive Requests O Observatory r u N ESO Reaching New Heights in Astronomy Eu u LLE ESO Home User Portal Contact Site Map Search OoOO Science User Information gt ESO User Portal gt ESO Archive Requests Nathalie Fourniol Logout ESO User Portal ze Request 391 by Nathalie Fourniol ESO Query SAF Test for the User Manual Science Archive Select All Unselect All Download Selected Archive Requests Requested Datasets All Requests Recent Requests UNIX Linux Shell script if you prefer command line download of complete request downloadRequest391script sh Req 391 Select Dataset File Size Access Options
8. B Dec 1 2010 at 13 03 UTC Y 26 SAF Test as HSTCD 2 1 16MB Dec 1 2010 at 13 01 UTC wv Figure 23 Displayed information on requests On the detailed page of a request see Figure 13 the user can click on the Options selected attached to a request which are currently as already mentioned Header on the fly correction together or not with Add IRAF Keyword or PI Pack Requests ESO Query gt Science Archive Archive Requests All Requests Recent Requests Req 391 Options selected Pi Pack Requests FAQ Figure 24 Link to the Options attached to a request And the next window will show the state of the process VVV 8 Zw 2 Ze vI I Awww TF SF U Pwwt UJ I IW I Nw wy 1 WRAL TEATTNZ F WMT TTIW Process ID Command State 9 HOTFLY Y Figure 25 State of a process 4 7 Possible state of a request and or a process The possible states of a request and or a process are the following ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 19 of 23 e Submitted this should only shortly be visible since the request submission time is very small Kr e completed error AN 5 The Use of Data Access Control From the ESO Archive Requests interface one can access the Data Access Control fac lity which allows Data Delegation from a PI to whoever s he wants assuming the latter s r
9. European Organisation for Astronomical Research in the Southern Hemisphere Organisation Europ enne pour des Recherches Astronomiques dans l Hemisphere Austral Europaische Organisation fur astronomische Forschung in der sudlichen Hemisphare Data Management and Operations Division Archive Department Archive Users Manual Retrieval of data with the Download Manager and Data Access Delegation Doc No GEN MAN ESO 32000 5 164 Issue 1 0 Date 14 March 2011 ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5 164 14 March 2011 AUM Download and Delegation Page 2 of 23 Issue 1 0 Change Record Issue Date Affected parts Remarks _ 1 o Al Newdocument oo S ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 3 of 23 Table of contents 1 Introduction 2m NEM 5 LE SCOP i 5 1 2 New download capability sssssss1iuannonnunnnnnnnnninnnnnnnunnnnannnnnnnnannannnnnnnnnnnan nnana nnana nanana nnana 5 1 3 Dataaccessdelepation Rn 6 2 List of OS java licences and browsers needed to use the new ESO Archive Redu ecsts tacitly sanii HERDEE en 6 3 ESO POlicies aniria a aaaea a aa 6 4 User GUE aa 7 4 1 Search Definitio issam Eae aaa Da Ra a Eaa ARa 7 4 2 Selecing Tretieval0pl 00 aan 9 4 3 How to submit aTequest nu ee 11 ACA HOW toretrieve da csn cele asc
10. O Reaching New Heights in Astronomy f i zu Eici Do ee ESO Home User Portal Contact Site Map Search Sco Science User Information gt ESO User Portal gt ESO Archive Requests Nathalie Fourniol Logout ESO User Portal Finis aaa RE All Requests of Nathalie Fourniol ESO Query ID Description No of Files Science Archive Archive Requests All Requests Recent Requests Pi Pack Requests FAQ NGRH 1_Obeta8 ESO Data Flow Infrastructure Send us your comments Subscribe to Newsletter Privacy Statement Figure 11 First Access to the ESO Archive Requests interface 1 A note on IRAF Keywords ESO FITS frames store information about instrument setup and observing conditions in hierarchical keywords As part of the request process it is possible for some instruments to add some of this information to the frame header in standard eight character keywords such as AIRMASS FILTERn SLIT GRISM GRAT UT ST These keywords are sometimes referred to as IRAF keywords since they present the information in a way understandable to popular IRAF tasks The original hierarchical keywords remain in the header This procedure works only for a subset of instruments Users can convert any hierarchical keyword to the eight character convention using the hierarch28 tool available from http archive eso org saft hierarch28 ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 20
11. S2 2010 12 10T08 56 43 068 fits Thursday December 9 2010 520926 sci_raw FORS2 2010 12 10T08 56 43 069 fits Thursday December 9 2010 504393 sci_raw FORS2 2010 10 23T23 38 41 912 fits Saturday October 23 2010 504393 sci_raw FORS2 2010 10 23T23 38 41 913 fits Saturday October 23 2010 Figure 21 List of raw files available for a given PI Pack request Clicking on the Request Files button will lead you to the page listing the files to get downloaded as depicted in Figure 15 4 6 Displaying Information on Requests To display information on Requests submitted or carried out the user has to access the ESO Archive Requests interface and choose the All Requests or Recent Requests buttons Recent Requests means the last 5 requests Request Handler ID Descrip 27 SAF TE Recent Requests 96 SAF Te Figure 22 Requests to be displayed ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 18 of 23 Issue 1 0 The general information for each requests are the following the ID the Description entered at submission time the total number of files the size the date of submission and the state of the request If no information is submitted at request time the Description displayed defaults to SAF All Requests of Nathalie Fourniol ID Description No of Files Size Date State 27 SAF TEST as HSTCD 2 non proprietary 2 67 64K
12. al eso org rh requests HSTCD 393 Summary a 4 Files 18 1MB available for download b 1 Files 3 3MB under proprietary period c 0 Files not available Please note the following detailed listing a files available for download AMBER 2011 01 01T02 41 04 851 AUTHORIZED AMBER 2011 01 01T02 43 39 093 AUTHORIZED AMBER 2011 01 01T02 45 05 637 AUTHORIZED AMBER 2011 01 01T02 46 33 530 AUTHORIZED b files under proprietary status AMBER 2011 01 01T02 32 57 945 DENIED c files not available NONE If it does not correspond to your expectations please send a mail to archive eso org All publications based on ESO archive data should carry the following acknowledgement Based on data obtained from the ESO Science Archive Facility under request number lt name gt lt number gt ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 16 of 23 Issue 1 0 where lt name gt is the archive user name of the requester Alternatively users can also cite the ESO programme ID given to all successful proposals in the form Based on observations made with ESO Telescopes at the La Silla Paranal Observatory under programme ID lt ppp gt lt c nnnn gt where the lt ppp gt lt c nnnn gt period category number is the ID of the ESO observing programme Please notify ESO Library at esolib eso org upon acceptance or public
13. also find various useful tools and services for Phase and Phase Il preparation like archives and catalogues ETCs weather information and more u Meie iaaii u in eee Heu eee edie oe he oh eee lee nn tees ee Da lan nn ne eo mde ood daia Figure 3 Access to the ESO HST Archive pages E80 er 7 Science Archive Facility European Organisation for Astronomical Research in the Southem Hemisphere Contact iome User Portal ESO Data Welcome to the ESO ST ECF Science Archive Facility Hubble Space Telescope Data Virtual Observatory Tools Catalogues Plates amp DSS The ESO ST ECF science archive is a joint collaboration of the European Organisation for Astronomical Research in the Southern Hemisphere ESO and the Sr Telescope European Coordinating Facility ST ECF ESO observational data can be requested after the proprietary period by the astronomical community Plea official ESO Data Access Policy statement for more information Both the ESO and HST archives are available world wide To request data you have to log In tot Tools amp Documentation Portal Please acknowledge the use of archive data in your publications Related External Services ESO amp HST Image Galleries ESO Archive News To browse the contents of the ESO archive use the main ESO archive query form or the VirGO application Introduction of Blu ray discs for SM PI packages distribution as of December 10th 2009 Read more Latest N
14. ation of a paper based on ESO data including the bibliographic reference article title authors journal title volume year pages All the best for a successful completion of your scientific program and best regards ESO Archive 4 5 Request and Retrieval of PI Packs An additional option or process available to the PIs and or their delegates see section 5 is accessible via the PI Packs Requests menu item as visible on the Figure 19 below which gives access to the former service known as PI Packages allowing PIs to access the raw and reduced data of their programmes ESO Home User Portal science User Information gt ESO Use ESO User Portal Data Access Control ESO Query Science Archive Archive Requests All Requests Recent Reouests Pl Pack Requests FAQ Figure 19 PI Pack Requests When requesting PI Packs one must choose among the Run_Id in the pull down menu and one have the choice to either enter no dates in that case the PI will be able to retrieve all the raw and reduced data accumulated in the archive for the whole program so far or enter a start and end dates in the fields acquired between and and not included The format of the dates must be yyyy mm dd ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 17 of 23 Incremental Delivery of Pl Packages What is this Define
15. ccs ccoesceccass eehae cnc csncecuecOrsbveusieaayevestunteuitaaeewneeens 12 4 5 Request and Retrieval Of PI Packs uuunssnsnnennennnnennnnenunnnnunnennnnennnnennnnennnnnnnnnnennnnennnnenannennnenn 16 4 6 Displaying Information on Requests uusnsnnennennnnennnnenunnenunnennnnennnnennnnennnnnnnnnnennnnennnnenannennnens 17 4 7 Possible state of a request and or a process uunnsenunsenunnennnnennnnennnnennnnnnnnnnennnnennnnenannennnenn 18 5 The Use of Data Access Conttdl u un ee 19 6 Incase of a failure in retrieving the data uunsnsenoneennnenunsunnnenunnenunnnnnnennnnennnennnnennnnnn 21 6 1 Failed doWNlO3U esse a aa ea eo 21 6 2 Failed process a ER sine 22 ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 4 of 23 Issue 1 0 List of figures Figure 1 Schematic illustrating use of the new download capability usssssseereenneesnnnnensnnrnnennnnnnnnnnenennnnnennnnnnnennennn 5 Figure 2 Schematic illustration of data access delegation uasssnsenennesnseneensennenennennnnnnunensennnnnnnsennnnnnnnnnnnnnunnennenennennennennannann 6 Figure 3 Access tothe ES0 H ST ACH WE pagesid a a a E a A A A 7 FORTEA ES OAC Wesen EDER Eee 7 PIG UIC o Available guey Or MS 4 2 ar ernennen ee 8 Figure b ESO generic query Joa BEE 8 Figure Instantdownload nev DUTON iaci aaa E ende E 9 Ergure 8 User Portallog INS Cl een aopn a a a RN 9 Figur
16. e 2 Old request submi son Page nen ee 10 Figure 10 ESO Archive Requests submission DGGE seinien a A a AAAA 10 Figure 11 First Access to the ESO Archive Requests interface nusnmsnesoennseneoonnseneenronnnennrennnennennnunenenrnnenennrenenenarennnennenneanene 11 Figure 12 Accesses from the ESO Archive Requests application to ESO Archive anssassnenssnennsensennnsennennunnnannannnnenn 12 Froure 13 Request supnm ted sanieren ee 12 Foure TA Downloud Request DUON sriain a a need 13 Figure 15 Request being Drocessea message ah 13 Figure 16 Destination directory Selection nee 14 Figure T7 Downoad Manager sarah 14 Figure 18 Download Manager completed reQuest ssssscsssessssssnssnesssnssnensenssnsssssssnsesssssnsenssssnssnssssnsensesentsnssssesnsensansntenesssnsenenssens 15 OUELI PIPAK Requesis en E avast awast asia E T 16 Pigure Z0 PL PaCK RUN Gi dates selection essen nase 17 Figure 21 List of raw files available for a given PI Pack reQuest vrssessssssssssssssssssssnssnssssssnssnssssnssnsensenssnssnsenssnsssessessnsssssnents 17 Figure 22 Requests to 0e CISPIOV CG au nein 17 Figure 23 Displayed information on requests un 18 Figure 24 Link to the Options Attached to a requesto irsana aiiis aaah diia akaa daiak 18 Figures lale Of d process nu Ne er us alta tar gata ictal ra SEE 18 Figure 26 Data Access Delega TON ars een ee e T Re 19 Figure 27 1st page of Data Access Delegation facility uasassneseeseesesenennsennunnunnnnnennnnennnnnnnnenennenn
17. e have a look at the ESO Data Products page and the Advan The checkboxes on the right of the parameters define whether or not they will be displayed on the query r Target Program and Scheduling Informati Target Name Night OK RA DEC J2000 OR give a query range Search Box 001000 Input Start 12 hrs U Output M Program ID W PI Col 7 List of Targets Choose File no file selected Title Q Observing Information Imaging Spectroscopy Interferometry Other OVLTIFORS1 OVLTICRIRES DVLTIWINCI CAPEX HET OVLTFORS2 OVLT FORS1 DVLTIMIDI APEX BOL l Figure 6 ESO generic query form ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 9 of 23 4 2 Selecting retrieval options Once the Search button is clicked an ESO Archive Query Results page is presented http archive eso org wdb wdb eso eso_archive_main query After marking the data files to be requested the user has now the choice between two buttons to retrieve the data the Instant Download button and the FTP or Media delivery button er FTP or Media delivery Reset Ri a nn nn nn nn 2 2 22 IM More HDR PRV OBJECT Target Header DXS ELAISN1 ENO1 0_0J 16 10 22 5 Header DXS ELAISN1 ENO1 0_0 J 16 10 21 9 Figure 7 Instant download new button If not yet authentica
18. egistered in the ESO User Portal WUNI 2 55 wow HELVA zu Zu Eu 7 25 2 Zu ew Wow war ESO User Portal All Re Data Access Control Science Archive Archive Requests Figure 26 Data Access Delegation Runs can be delegated as long as they contain proprietary data or have the potential to acquire proprietary data that s the run is st ll viable These are visible on the first page corresponding to the menu item Admin Data Access http www eso org ace ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 20 of 23 Issue 1 0 O scunem ea Ro ACE Access Control ESO O Observatory ESO Reaching New Heights In Green p ESO Home User Portal Contact Site Map Science User Information gt ESO User Portal gt Access Control Carlos De Breuck Logout ESO User Portal i Grant Revoke Data Access Rights for Proprietary Runs Admin Data Access 084 A 0324 AGN driven feedback in high z radio galaxies Quantifying the impact of radio power pt 3A Instrument Delegated Revoked Users Delegate to Science Archive 084 A 0324 A SINFONI Service enter email address Archive Requests delegate Figure 27 1st page of Data Access Delegation facility To delegate access enter the email address of the delegate and then press the button The user to whom the data has been delegated in this case Nathalie Fourniol is then
19. ews and Updates e FEROS spectroscopic time series data releases 2010 08 06 e Hubble Legacy Archive ACS WFC Grism Final Release 2010 06 30 a WISTAAAROC AAA inetnimant enarifin qian farm new auailahla MINMNEARN Figure 4 ESO Archive ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 8 of 23 Issue 1 0 Once on the Archive page http archive eso org cms eso data several query forms are accessible Site Map Contact Home ESO Data ESO Data Welcome to the ESO Science Archive Facility Raw Data Query Form Except for a few special cases ESO data are world wide available an n Please read the official ESO data access policy Contents of the ESO Archive All raw observations performed at the La Silla Paranal Observat aa e The raw data from the UKIRT Infrared Deep Sky Survey UKIDS rare these data are made available to the astronomers from the ESO mu en Data from the commissioning and science verification demo Data from the ESO Imaging Survey and other projects see 1 e Advanced Data Products see the data release overview pac Figure 5 Available query forms Specifically the ESO generic query form for example at http archive eso org eso eso_archive_main html If you would like to query the Archive for instrument specific parameters please use the dedicated query To search for reduced Data Products pleas
20. inutes to be performed depending on the size of the request and the process requested Test Request page refreshes automatically when request is completed Download Selected Requested Datasets Select Dataset File Size Access Please wait Requested Datasets list under construction Datasets 1 0 of 0 Figure 15 Request being processed message After clicking on Download Selected or Download Request a java applet windows pops up to enter the directory where the data are to be downloaded ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 14 of 23 Issue 1 0 ZI search DEVICES SHARED PLACES New Folder Figure 16 Destination directory selection Once the directory destination is selected the download manager window will display the status and progress of the files being downloaded Filename AMBER 2009 03 11T22 01 02 949 fits Z Completed AMBER 2009 03 11T22 00 31 668 fits Z Completed AMBER 2009 04 08T22 47 29 473 fits Z Completed AMBER 2009 03 11T22 00 41 533 fits Z Completed AMBER 2009 03 11T22 00 45 479 fits Z Completed AMBER 2009 04 08T22 46 53 881 fits Z Downloading El 251 AMBER 04 08T22 46 53 fits Z eu gt 252 Downloading 08 52 03 AMBER 2009 03 11T22 00 45 479 fits Zz Downloading gt 08 52 05 Completed 32 5KB 21 2KB s A 08 52 03 AMBER 2009 03 11T22 00 41 533 fi
21. nnnnnnennnnnnenennennennennannann 20 Figure 28 Entering the email of the delegated user nee ana un 20 Figure 29 Private runs delegated to User sun ne einen 21 Figure 30 ReVOKING access UO 1G COLO anne reason 21 Figure 31 Falledd0WN10Q0 2 022 00a Renee 21 Figure 32 Retry failed downloads button aan 22 Foures Taled PrOCES Saina A E A 22 EIGUFE34 RESUDN BUTON a nase 22 ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 5 of 23 1 Introduction 1 1 Scope Up until the beginning of 2011 electronic delivery of data from the ESO Science Archive was conducted through the use of ftp from a user dedicated staging area The user would have access to publicly available data as well as their own proprietary data This manual describes new services put into place the ESO Archive Requests facility to improve the electronic data access and also provide PIs with the option to delegate data access to their collaborators the Data Access Control also called Data Delegation The manual describes how to use the new features in the context of the existing User Portal and Data Query forms The new services are at first deployed in parallel to the old ones that are rapidly approaching retirement due to the aging of the underlying hardware components and obsolete technologies in use The following diagrams provide an overview of the new feat
22. s Downloading pmm o x 1 7727 A G Figure 31 Failed download ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5 164 Page 22 of 23 Issue 1 0 14 March 2011 AUM Download and Delegation It s possible to try again with the Retry failed downloads button Another option is to close the download manager window and re start the download again but this time a new destination directory should be selected w Lts Downloading IFCAM 2005 05 29T07 20 07 296 i FCAM 2005 05 29T07 17 29 184 fits Downloading Retry failed downloads Pause all downloads Speed 0 0byte rn u de afin AM NEUN Funken I un ba Figure 32 Retry failed downloads button It may also happen that the Download Manager does not work for other reason than platform browser java versions incompatibilities A solution to download the files in this case only one at a time is to click on them If this still does not work please contact the Archive team at archive eso org who will be happy to assist you 6 2 Failed process As mentioned before for each request processes or options like Header on the fly correction Add IRAF keywords or PI Pack Requests are currently available In the case of a failed process the whole request state should be the error one At the level of the detailed page of the request the interface will display an error message Select Dataset File Size Acce
23. s will be applied to the FITS header Please select your output media Warning Blu ray discs for data distribution will be introduced soon in the Science Archive Facility Local Area Network Only for users with account within ESO Garching Files will NOT be automatically copied to your unix account Transfer files yourself with ftp limited to 30GB O CD ROM 700MB Limited to requests between 300 and 1200 MB O DVD R 4 GB Limited to requests between 1 and 60 GB USB FireWire Magnetic disk has to be returned Limited to requests gt 60 GB You have marked the following datasets AMBER 2009 03 11T22 01 02 949 AMBER 2009 03 11T22 00 3 1 668 BETT BRETT f He f sach Figure 9 Old request submission page Instant download e The Instant Download button gives access to the new ESO Archive Requests fac lity ES ru u oo _ ESO Archive Requests Southern O Observatory z 4 l aun m a u i ESO Reaching New Heights in Astronomy A ae tt CEE ESO Home User Portal Contact Site Map Search co Science User Information gt ESO User Portal gt ESO Archive Requests Nathalie Fourniol Logout ESO User Portal Data Access Control Submit Request ESO Query Science Archive Request Description Archive Requests Options WM Header on the fly correction O Add Iraf keyword All Requests Roconi Roques PI Pack Requests FAQ Requested Datasets e AMBER 2009 03 11T22 01 02 949
24. selected D SAF AMBER 2009 03 11T22 01 02 949 AMBER 2009 03 11T22 01 02 949 fits Z 1 1MB vY PI Pack Requests o SAF AMBER 2009 03 11T22 00 31 668 AMBER 2009 03 11T22 00 31 668 fits Z 31 7KB x FAQ Datasets 1 2 of 2 1 2MB Figure 13 Request submitted ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 13 of 23 As llustrated the user can select one several or all the files as well as de select all items to be downloaded In the example access to these files s granted to Archive User Nathal e Fourniol A programmatic access is also available via the script downloadRequestxxxscript sh a shell script consisting of a series of WGET command lines 1 e the WGET utility s required on the User s machine to use the script directly This package is usually installed by default in Linux but not in MacOS X or Windows Note also that on the interface the user can see the total s ze of the request and the number of files before performing the download In case the number of files exceeds 1000 pagination is carr ed out and a Download Request button appears in addition as visible below Download Selected Download Request Figure 14 Download Request button Depending on the request especially if it requires processing a message will appear during the processing as depicted in Figure 15 In addition the processing part can take a few m
25. ss Your request could not be processed SAF WFCAM 2010 09 19T04 32 03 552 SAF WFCAM 2010 01 31T03 50 44 736 SAF WFCAM 2010 02 04T04 56 43 584 SAF WFCAM 2010 10 08T01 17 24 000 Par ciara nnan an narna nmnannnn And by clicking on the left hand s de menu at Processes the same error state w ll appear as indicated by the error con WFCAM 2010 09 19T04 32 03 552 fits WFCAM 2010 01 31 T03 50 44 736 fits WFCAM 2010 02 04T04 56 43 584 fits WFCAM 2010 10 08T01 17 24 000 fits za AMALA AN AATAL ANAN AMM Zi Figure 33 Failed process 10 0MB 12 7MB 11 8MB 8 4MB nna m I RR KIR en ae cee ee es Process ID Job ID Command Action 3 197 449 SuccessfulRemoteRequestProcess Figure 34 Resubmit Button ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5 164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 23 of 23 The Resubmit button allows the user to re start the failed process which could have been due to a temporary hiccup in the system At the same time and according to the type of error an automatic e mail will be sent to the archive operators who will fix the problem During this process the file request should remain in an error state see section 4 7 so that the user does not try to download the file up to the point where it is fixed and its flag is turned back to OK ESO Karl Schwarzschild Stra e 2 85748 Garching bei
26. ted via the User Portal you will be asked to do so when clicking either on Instant download or on FTP or Media delivery buttons European ES Southern O Observatory User Portal Welcome to the ESO User Portal For security reasons please Log Out and Exit your web browser when you have finished accessing se authentication intranet sd Enter your ESO Username and Password As of 25 August 2009 ESO User Portal usernames and passwords are both case sensitive Troubles logging in Try using the I forgot my links below Username Password e forgot my ESO User Portal password e forgot my ESO User Portal username e would like to create a new account Figure 8 User Portal log in screen ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Page 10 of 23 Issue 1 0 Then depending on which button was chosen see Figure 7 the user is redirected to one of two different pages FTP or Media delivery e The FTP or Media delivery button gives access to the old delivery facility via LAN FTP or on a medium currently CDs DVDs and USB disks The Request Submission Setup page is presented then with all the options to choose the medium and opt for correction of the Headers 4 7 REQUEST SUBMISSION SETUP rE ST ECF Eso HOME Please select your data product s M Raw data file M Update
27. ts Z Downloading gt 08 52 05 Completed 34 6KB 13 3KB s 5 v Speed 59 1KB s Completed 5 of 6 files failed 0 1 3MB of 1 6MB Conc Downloads 1 5 2 8 Figure 17 Download Manager It is possible to pause the download or retry a failed download by clicking on the corresponding buttons on the bottom left hand side of the window In addition the number of ESO Karl Schwarzschild Stra e 2 85748 Garching bei Munchen Germany GEN MAN ESO 32000 5164 14 March 2011 AUM Download and Delegation Issue 1 0 Page 15 of 23 concurrent downloads can be increased up to 5 simultaneous downloads as visible on the bottom right hand side of the window When the files have been downloaded to the User s directory the Completed status is visible on the download manager ES 2 signee dr O Filename Status Progress AMBER 2008 12 05T21 55 29 796 fits Z Completed AMBER 2008 12 05T21 55 18 021 fits Z Figure 18 Download Manager completed request It is to be noted that repeating a download of the same file in the same directory will not imply the overwriting of the file the Download Manager will recognize the file and will not copy it again The User receives an email at the completion time of the request of the following form Dear Dr Nathalie Fourniol Thank you for using our Archive services The archive files 21 4MB that you have requested are ready for you to download at the following link http dataport
28. ures available in the ESO User Portal and Archive services Details of how to fully use the applications are provided in Sections 4 through 6 1 2 New download capability ESO Request Handler Perform data query Authenticate at User Porta instant Download Repeat saved C Download Review order in download in direct from Download manager future ESO archive Figure 1 Schematic illustrating use of the new download capability ESO Karl Schwarzschild Stra e 2 85748 Garching bei M nchen Germany GEN MAN ESO 32000 5 164 14 March 2011 AUM Download and Delegation Page 6 of 23 Issue 1 0 1 3 Data access delegation Authenticate at Delegate Delegate Revoke access User Portal access retrieves data as required i i t ca a Figure 2 Schematic illustration of data access delegation 2 List of OS java licences and browsers needed to use the new ESO Archive Requests facility The OS Java and Browsers fully supported for the use of the application are the following o Java 1 6 0 patch level 18 and above o Scientific Linux 5 3 Firefox 3 6 o MacOSX 10 6 Snow Leopard Safari 4 Firefox 3 6 and Google Chrome o MacOSX 10 5 Leopard Safari 5 Firefox 3 6 o Windows XP Vista and 7 Internet Explorer 8 Firefox 3 6 and Google Chrome 9 o Solaris 10 Firefox 3 6 Older versions are not recommended since unexpected behaviour may occur 3 ESO Policies All data obtained with ESO telescopes are
29. xies Quantifying the impact of radio power Run Instrument Mode Month Delegator 084 A 0324 A SINFONI Service Carlos De Breuck mr_ so_user eso org Granted 26 11 2010 11 26 Figure 29 Private runs delegated to a user It is also possible at any time to revoke the access granted by clicking the button The corresponding user from whom the access has been revoked will be highlighted in gray Grant Revoke Data Access Rights for Proprietary Runs 084 A 0324 AGN driven feedback in high z radio galaxies Quantifying the impact of radio power Run Instrument Mode Month Delegated Revoked Users Delegate to 084 A 0324 A SINFONI Serv ice user removed enter email address Nathalie Fourniol 55034 nodomain org delegate Revoked 28 11 2010 17 48 UT Figure 30 Revoking access to the data Note the Data Access Control service is only available together with the Instant Download facility 6 In case of a failure in retrieving the data 6 1 Failed download In the case of a failed download that may occur if the user does not have write access to the specified download directory for instance a Failed status message is displayed on the Download Manager Filename Status Progress WFCAM 2010 01 31T03 50 44 736 fits Falled OD ytes OF SOT ytes i gt a WFCAM 2010 02 04704 56 43 584 fits Downloading ss ro T CLE Se G WFCAM 2010 10 08T01 17 24 000 fits Downloading m a S WFCAM 2010 09 20T04 20 19 392 fit
Download Pdf Manuals
Related Search