Home

AMGA MANAGER User MANUAL

1. r w o e EE OO 2 schema E Insert Columns amp pytest listentries population FILE E2 Mytest listattr population rank perio ears pepe percent_of_worl E AMGA 2_0 spec M4 Name Type population population amp PROJ Y FILE population date_of_estimate E TEMP_s m population source jo3 Bi rank be population new_remarks Ss a INC3 country t varchar 100 ed E belle V percent_o text E TEMP_ss 7 population text E3 pop_test1 y date of es text i E test soon y source text make Query lJ ES weather 7 new rema varchar 50 f E fed test make Query i B asdf selectattr population FILE a population rank amp pop rollback population country_territory amp report population percent_of_world E population population population F ts population date_of_estimate ES tshuh population source E drugscreenerg population new_remarks E 85 ACLINC4 E fed test k Insert Column k amcan lt Button Function on another Panels gt Send collection name PP import a collection name into the SQL Editor from the Collection Panel Send attribute name import a directory attribute name into the SQL Editor Only SQL Editor no schema browser from the Attribute Panel All Columns import all directory attribute names into the SQL Editor Only SQL Editor no schema browser lt Click
2. User Name amp belle replica user amp choinody A guest amp jykoo amp new user amp root amp tonv lt Users gt Search search a user Add User Se adds a new user to the selected group Delete User Se delete the selected user A How to create a user ID 1 Create a new user ID You should be a root user to create a new user To create a new user click create user icon at the user panel Then the following pop up window will show up Type a new user s name and press the OK button 43 Add a new User Name Enter 3 15 characters newuserl Lox cancel _ J 2 Create a temporary password After typing an ID the following window will pop up and ask a temporary password Add a new Password Enter 3 15 characters 3 Save a new user information ID Password The next pop up browser menu helps to save the composed authentication information into a file 44 M m id is OOIE ERA gt 823 gt thuh va lallen pl gz vy we SAAI B ouezes ME He AA I Site Manager The Site Manager is to store the information about other sites in the backend After registration of new site additional site information can be modified with following modify browser This is useful to set up replication and federation On the menu click Tools gt Site Manager or select Site Manager icon on the menu bar Hostname Por
3. lt View of the Included Columns gt Check boxes check selected attributes to show data in the schema browser Data SQL Query viewer show the AMGA query sentences made via filter GUI Clear remove filtering features OK complete filter Close close this browser without saving lt Click right mouse button gt select all select all attributes empty select no select in the activating position entry Order by ASC make ordering attribute only ascending Remove Order by remove ordering feature from the selected attribute b Where Clause Tab The WHERE statements of the SQL queries 34 PROJ BUDGET gt 30000 and notnull PROJ PTYPE and E PROJ FILE minx j ear E PROJ PNUM length string pow x y eene str2 con i iike str pattern PRO cTY substr str n m isnull arg notnull arg is condition t PROJ FILE PROJPNUM PROJ PNAME PROJ PTYPE PROJ BUDGET PROJ CITY PROJ BUDGET gt 30000 and notnull PROJ PTYPE notnull arg Checks that the argument is not NULL lt View of Condition Operators gt lt View of Condition Functions and Joins gt Tips show how to use selected function at the bottom side lt View of Attributes gt The view of attributes is a list of attributes which are able to give selecting attributes function and completing where clause c Order By ASC Tab
4. AMGA MANAGER User MANUAL ver 1 2 Authors Taesang Huh Korea Institute of Science and Technology Information Supercomputing Center Senior Researcher MS Belle II Computing group member EMI AMGA product team member WP3 SA1 WP5 JRA1 Email tshuh kisti re kr Geunchul Park Korea Institute of Science and Technology Information Supercomputing Center Senior Researcher MS EMI AMGA product team member WP3 SA1 WP5 JRA1 Email gcpark kisti re kr Jae Hyuck Kwak Korea Institute of Science and Technology Information Supercomputing Center Senior Researcher MS EMI AMGA product team member WP3 SA1 WP5 JRA1 Email jhkwak kisti re kr Soonwook Hwang Korea Institute of Science and Technology Information Supercomputing Center Infrastructure Technology Development Principal Researcher PhD Team Leader EMI AMGA product team supervisor WP3 SA1 WP5 JRA1 Email hwang kisti re kr lt Contents gt l OVerViEW se ei EE OR ee 1 Ps EME ee AE Ee OE AE AE EE EE 1 B PES el DES S ee N N ER GR Re ie ee 2 C Technical Support AMGA ENE EER EE EE ee onary 3 M Installati n RE EE ER soannen 3 els El EE ed ED EE ara aaa re ER 3 ode Ad EE OE EE EE E EE EEN 3 HI Main Menu N EE 4 A New Connect Onnee Ee Ge ee 4 1 ID PW authorization including authentication sesse RR ee Re 5 2 Certificate das dle ee patent dontveitionuciens 5 3 Globus Proxy authenticatiON seeks Re Reese RR Rea Re RR Re Re 5
5. directory a Examples 84 Query gt acl_remove TEST test_group acl_show directory On MySQL5 or PostgreSQL you can create directories with the acls option which will allow you to put ACLs also on individual files Examples Query gt acl_show TEST 85 P Access Control Lists O Replication e rep_umount lt remoteDirectory gt description Unmounts a replication point Local data is deleted rep mount perms master remoteDirectory description Mounts a directory from the server running at the given address rep_mount_users master description Replicate user and groups information from a remote node e rep_umount_users description Drops the user and group information that was being replicated from a master e rep_list_mounts description Lists all mount points e rep start receive master description Connects to the master and starts listening for the logs of all mount points from this master rep stop receive master description Stops listening for the logs of all mount points from this master e rep allow directory group description Grants to group the right to replicate lt directory gt and all its subdirectories e rep_disallow directory group 86 description Remove from group the right to replicate directory and all its subdirectories e rep users allow user descr
6. B B AA ES ACLINC E ACLINC3 ES ACLINC4 E amp AMGA_2_0_spec B asdf E belle E3 drugscreenerg ES fed test ES fed test1 E jo3 gt latitude longitude city E Mytest 3 pop BigData ES pop_rollback pop rollback1 E amp pop_test1 E population Some Entries Query Finish 35 Data export wizard provides two types of data exporting which consists of all data and some of data with your queries If you want to export a large scale of data which is some part of full dataset you may check some entries radio box and export some data Select a collection and type of exporting data which you want to export into a file format and click next button P S In the all entries case go to lt step 2 1 gt in the some entries query go to lt step 2 2 gt And other steps are the same as step 2 lt Step 2 1 gt Data Export Wizard Select Output Options AJ Entries In this step you can decide output format and string quote character and confirm information of output file s In the case that output file s is excel data exporting wizard may generate a few files with a few sheets Therefore you must check the information of output file s and some tips H De Data Export Wizard ee Select Output Options Select options for formatting the output of exported data Output Format Excel File String quote characher Tab Info of output file s entries 485286
7. 4 VOMS Proxy authentication sesse seek Re RR e ee RR ee Rea RARR ee ee R Rea eke RR ee 6 B DISCONNECTION oe GE Ge GE 11 C Change Pass Veld ee NE DE EE EE eee 11 D Collection Panel Vi W ee ee ee ee ee ee ee ee ee ee ee ee ee ee ee 11 T Coll cti n ETE el ee ccvsssas isa s aa 12 2 Right click Pop up Menu with the Schema BrowSet sssssssssssscesssscsceesneeeseesnnetecessnees 14 By GON eo EE NEOA AORE 16 4 Right click Pop up Menu in the case of focusing on the SQL Editor 17 5 How to create a new AMGA collection ee ere ee eek Reneke ek Rek Rek Rek ee Rek RR eke Re 18 E Attributes Panel VieW as sesse n GER oe AE ee ee ees ens kk ee og ae ie Ge RAKA 19 F Schema BOWEN ES EE Ee IE N EE ee 21 1 Data Manipulation Browserll RE HE N 21 2 Attribute Manipulation Panel VieW iese ese ee RR RR RR GER GeR Re RR Re RARR Re RR ee RR 26 3 ACL Manipulation Panel View EE Ed 26 A Constraints Manipulation Panel ViGW eccssssscsssssssssesesssesessnessesseesessneeessneeesessnesessneeessneeees 27 G Data Import Export and Rollback Wizard see sen se ee eke ER ER ee 30 1 Dat Import WIZard oun eessssescessecesssecessccesnsecesnsecesssecssssccssusecssnssessnueesnuecsnsneesssnueessnecssnseetsaes 30 27 Data Export WIZE ER N EE EE E irti E REENE 35 3 Data Rollback Wizard eaea 39 Eet se RS id pe EE EE EE 42 liGtodPAManadement asse RS EE RE Re Ge Ge n Ge ee ee 42 2 Edit Group Memberships EE EE N 42 se ahecnvestaecnsentae 43 Ste
8. File s 2 Excel sheet 10 XTips 1 One file consists of max 7 sheats including 50 000 entries Total 350 000 entries 2 In case of a large scale of metadata we recommend you to choose text format The above figure is the case that output format is excel and contains the information that includes the number of entries file s and excel sheet s If possible I recommend you to export a large scale of data in text form 36 G Data Export Wizard LE i Select Output Options Select options for formatting the output of exported data Output Format Delimited Text X String quote characher Taby Tab Space Info of output file s entries 485286 File s 1 Finish The above figure shows output format is text which has string quote characters like tab space and comma and includes the number of entries and file This two browsers help user to choose from two file formats for exporting metadata an Excel file format and a delimited file format If a user wants an Excel file format just click the next button Otherwise a user needs to select a delimited text and select a Tab Space and Comma Then click the next button lt Step 2 2 Complete query Some Entries This assists you to complete your query and add query s conditions in order to export output text file with some entries which you want 37 Complete query Add query s conditions into t
9. in order to order data set select attribute in the right side E PROIFILE l PROFBUDGET EE PROFPNUM SE PROFPNAME EE PROJPTYPE PROJ BUDGET E PROJ CITY Filter Query selectattr PROJ FILE PROJ PNUM PROJ PNAME PROJ PTYPE PROJ BUDGET PROJ CITY PROJ BUDGET gt 30000 and notnull PROJ PTYPE order PROJ BUDGET 2 Attribute Manipulation Panel View On the menu click Tools gt Schema Browser gt Attribute or press Attribute Tab below the schema browser Schema Browser fai SQL Editor EF current Path tshuh weather Attribute Attribute Type Length city varchar 30 temp lo float temp hi float precip int taken timestamp ACL Constraints Index lt Button Function on the Attributes Tab gt Add F creates new attributes Remove removes selected attribute If there are data in the selected attribute you need to remove data firstly Commit VI confirms changes original AMGA commands doesn t include this function Left arrow tid moves to the first entry Right arrow gt i moves to the last entry Refresh Qi refresh attributes It updates attribute name only 3 ACL Manipulation Panel View I 26 On the menu click Tools gt Schema Browser gt ACL or press ACL Tab below the schema browser 1 Schema Browser mm SOL Editor lm Current Path T
10. m Examples Query gt grp_delete test1 grp_show groupname Shows all the members belonging to group groupname You can only look into groups of which you are a member or your own groups Root can list all groups Examples Query gt grp_show test2 grp_adduser groupname user Adds a user to a group Only owners of a group or root can change group memebership Examples Query gt grp_adduser test tshuh Query gt grp_removeuser test tshuh grp_removeuser groupname user Removes a user from a group Only owners of a group or root can change group memebership Examples 83 Query gt grp_removeuser test tshuh e grp member user Shows to which groups a user belongs Only root can ask this question for other users Examples Query gt grp_member tshuh e grp_list a user Shows the groups owned by user by default the current user If the a option is given all groups are shown Examples Query gt grp_list tshuh O Access Control Lists ACLs Access Control Lists can be assigned to any directory The following commands exist to manipulate ACLs of a directory e acl add directory group rights Examples Query gt acl_add TEST test_group rwx acl remove directory group You can use the to remove all ACLs of a
11. tl t2 tlinum t2 num This selects the entry name of a job the id in the configuration the event generator name of a job and the id in a configuration for all jobs and configurations where the job has more than 1000 events and the keys attributes of the jobs and congurations match As of AMGA 0 9 selectattr also supports constraints to the query similar to a SELECT clause Queries can now take the form query distinct limit xx offset yy order exp group_by exp 68 where the distinct keyword translates into a SELECT DISTINCT the limit and offset clause limits the number of rows returned and with the order clause rows can be ordered according to the given expression The group_by construct corresponds to the GROUP BY SQL statement Queries can contain the following operators and or not gt lt lt gt or The following is a list of the supported joins and their translation into SQL join_left_on lt left gt lt right gt lt condition gt left LEFT OUTER JOIN right ON condition join_right_on lt left gt lt right gt lt condition gt left RIGHT OUTER JOIN right ON condition join_inner_on lt left gt lt right gt lt condition gt left INNER JOIN right ON condition join_cross lt left gt lt right gt left C JOIN right ON condition D Native SQL Query Supporting native SQL query greatly eases the work needed to port existing SQL based dat
12. 2 Hd Go ACL Ctrl 3 Go Constraint Ctrl 4 I Go Index Ctrl 5 B Go SQL Editor Ctrl 6 Collection gt amp Manage Federation Ctrl Home Scripting gt selectattr p Send collection name insert ix Data Import Ctrl I update ty Data Export Ctrl K delete amp Refresh FS drop Property Scripting compose automatically an AMGA query with the SQL Editor gt gt selectattr selectattr attributel attribute gt gt insert insert current directory FILE name FILE value attributel lt value gt attribute lt value gt gt gt update update current_directory FILE value attributel value attribute2 lt value gt gt gt delete rm Current directory gt gt drop rm r current directory 17 Send collection namel P 1 import the collection name into the SQL Editor from the Collection Panel Drop Collection drop the selected collection Data Import Import data from file having artificial data into AMGA server Data Export Export data limited by the selected attributes and where clause to file formats like xls txt xml and so on Refresh refresh session 5 How to create a new AMGA collection Detail Add 4 Create AMGA New Collection Ei Qe Create New Collection S AMGA collection die ad Create Directory and Collection with Aftribute Ta Create Path population Browse
13. 76 refer to the name of the constraint It must be unique for that directory Write permissions on the directory are necessary for this operation Examples Query gt constraint_add_check TEST_constraints Attr2 gt 100 const_check_nol constraint_add_primary_key directory key s Adds primary key constraint of the given directory which by default is on the entry name only Examples Query gt constraint_add_primary_key TEST_constraints Attr1 constraint_drop directory name Drops the constraint with the given name from the directory Write permissions on the directory are necessary for this operation The primary key of a table can be removed by specifying the name p_key Examples Query gt constraint_drop TEST_constraints const_name Query gt constraint_drop TEST_constraints p_key remove primary key constraint_list directory Prints all constraints of a directory You need read permissions on the concerned directory Examples Query gt constraint_list TEST_constraints gt gt constraint_add_check TEST_constraints user Name2 gt 100 const check namel gt gt constraint_add_not_null TEST_constraints Name 1 const_not_null_name 1 gt gt constraint_add_check TEST_constraints user Name2 gt 45 and user Name2 lt 75 const_check2 PP oes 77 J Views Views allow you to cre
14. Progress Panel shows the progress state in case of background process j E console progress SQL Result 62 Authentication Tokens Y a No operations to display at this time N SQL Result Panel View The SQL Result View shows the results on the AMGA queries typed at the SQL Editor browser According to queries categorization as the number of result column data grid type will be decided in order to recognize data intelligibly a Authentication Tokens population FILE Ed EE SEK ET Es EE ETER China China I 1339020000 ChineseOfficialPopulation India India i 1184259000 IndianofficialPopulationCI UnitedStates UnitedStates a 309897000 UnitedStatesOfficialPopul Indonesia Indonesia j 234181400 StatisticsIndonesia Brazil Brazil 1 193321000 BrazilianOfficialPopulation aoe O Authentication Tokens Panel View The Authentication Tokens view shows the type and status of Proxy generated with time left information Remember that time left doesn t decide AMGA service session If you extends session time you should have to modify AMGA server configuration El console Progress _ SQL Result 6 hentication Tokens 3 m eae ile fal Xx If you want to start another session and connect other AMGA service in case of being proxy information in authentication tokens you should have to clear it firstly before any action 52 P HELP 1 Program Help The Program He
15. database is past AMGA service version and you should have to change AMGA Service Version to new one in order to use new functions matched with new version 56 lt Button Function on the My AMGA Dialog gt Changelchangel change AMGA service version 57 IV Limitation In this chapter the limitation of AMGA Manager is aim to let you know the usage limitation information before you work with AMGA Manager and describe the supplementation plan for the issues A No collection copy with metadata schema e In the collection view there isn t the function to copy selected collection with metadata schema X Not yet fully operational for all AMGA commands e This GUI that is called AMGA Manager doesn t cover all AMGA commands although we have tried to provide many basic GUI functions for AMGA commands to you We d like to ask for your understanding regarding all GUI functions in this time 58 APPENDIX I Shortcut Key AMGA Manager Shortcut key File gt new Connection Ctrl Shift O Collection shortcut key File gt end Connection Ctrl Shift X Popup right button mouse ae MEES EE ME EE E Help gt Progam Help F Help gt About AMGA Manager Key Assist Ctrl Shift L Schema Browser Shortcut key SQL Result Shortcut key Popup Menu right button mouse right button mouse SQL Editor Shortcut key Popup Menu right button mouse gt Select All Ctrl A 6
16. gt execute above query in the target path which you want Query gt view remove ppl K Sequences 78 Sequences allow the creation of a sequence of integer numbers which are guaranteed to be unique They are also monotonically increasing at least during a single AMGA connection The exact implementation depends on the database backend which can optimize handing out parts of the sequence in batches so that two consecutive connections not necessarily get first a smaller number in the sequence and then the larger Sequences are not supported by MySQL lt 5 0 and SQLite On MySQL and Oracle sequences are implemented through stored procedures In PostgreSQL the native mechanism is used Sequences behave like another directory in a directory They cannot be deleted with rmdir however instead sequence_remove must be used The name of the sequence must be lower case due to limitations in some backends sequence_create name dir increment start value Creates a new sequences with the given name in the given directory The name of the sequence is then dir name It is possible to dene the increment as well as the start value Note that backends may not necessarily follow this behaviour strictly if multiple connections are being used Examples Query gt sequence_create id cities 1 10 Query gt sequence_next sequence Gets the next value from a sequence Examples Q
17. manager varchar 50 renameattr Examples Query gt renameattr TEST manager MGer removeattr dir entry key Removes the attributes or keys from the list of attributes of the directory dir or the directory of the given entry or if the implementation allows it from the list of attributes of a given entry Attributes can only be removed if they are not used by any entry So you either have to remove all entries for which this key is set or use clearattr to set the value of the attributes to NULL In order to remove an attribute write permissions on the directory are necessary Examples Query gt removeattr TEST remove_attr_name Examples in case of the attributes with value Query gt clearattr TEST remove_attr_name make it to NULL Query gt removeattr TEST remove_attr_name 64 schema_create dir attr type option Creates a new directory with a given schema This is an atomic replacement for a sequence of createdir and addattr The meaning of the optional option argument is backend dependent and you should not use it if you want to retain this independence With a MySQL backend you can give here the name of the table engine for PostgreSQL the keyword inherit will make the table inherit its schema from the parent directory Examples Query gt Query gt setattr file attribute value Sets a list of attr
18. of import export wizard e Add Data Rollback function in the case that network error disconnect session and socket fail happen due to an unknown cause 5 Federation management e New mount federation site 6 Site management 92 e New add site and modify site information 7 Group User management e Fixed bug that insert unnecessary symbols while generating id password 8 Common e New automatically program update e Add show connection information such as port number AMGA service version on the top of AMGA Manager e Add exporting AMGA Manager for windows 64 C Change in 1 0 1 schema browser Data e Add Save the selected target data to the file at schema browser Data 2 Console and Result view e Add Save the selected target rows or data to the file at console and result view e Add the menu function Menu Console SQL Result copy O O select all O O find O clear O O 3 User Group management e Add Make temporary ID Password only Administrator D Change in 0 9 1 User login and Access information management 93 2 Collection management e Fixed collection tree expand and collapse to be feasible to check lower directories e Fixed Make collections GUI procedure with making attributes types 3 Schema Browser Data e Add Filter at schema browser Data e Fixed handling data grid using keyboard e Add the function of CRUD at schema
19. 0 APPENDIX II AMGA Query This chapter AMGA Query supports you to be easy to manage your AMGA data and develop your systems with AMGA server Especially this helps using the SQL Editor of AMGA Manager A Commands for entry manipulation addentry entry attr value Creates a new entry and assigns the given values to the provided attributes Examples Query gt addentry testdir a id 10 Query gt addentry b id 10 finished Oct 10 2004 insert entry attr value Creates a new entry and assigns the given evaluated values to the provided attributes Same as addentry except that the values are evaluated first similar to an INSERT statement in SQL Examples Query gt insert cities Chungju altitude 25 latitude 23 addentries entry Creates the given entries in the catalogue This command is done in a transaction that is either all entries are inserted or none Entries can be spread over several directories Examples Query gt addentry cities Seoul altitude 86 latitude 37 Query gt addentry cities Hamburg altitude 6 latitude 53 rm options pattern condition Removes all files matching pattern where pattern may only contain wild cards in the file part If a condition is given than 61 that condition needs to be met by the entry s metadata In order to remove an entry you need write permissions on the parent direct
20. 800 1 5 7 100001 100001 25892e1780f64 bdata mcprod good 8800 1 5 8 100002 B0f64 8800 1 5 9 f100003 8800 1 5 10 f100004 8800 s 5 11 100005 8800 1 5 12 100006 NEE osse 8800 1 5 13 100007 dy _ Loo000 8800 1 5 14 f100008 more than 1 000 000 entries 8800 1 5 15 100009 dl can cause some errors related 8800 1 5 16 10001 dj to insufficient memory to 8800 3 o 17 100010 dj continue in your PC 8800 1 5 18 100011 8800 1 5 19 100012 8800 1 5 20 100013 q 8800 1 5 21 100014 d 8800 1 5 MM r a 4a otal rows 416666 Page rows 100000 Page 1 5 This viewer is working to show metadata by the page controlling page drag box or some arrows And the page size settings at the bottom of a page can decide the range of entries per a page Considering performance according to memory set less than 1 000 000 entries at each page L Console Panel View The Console view is a program designed to be used as a AMGA CLI interface which works very similar to the mdclient tool The Console view shows outputs from the AMGA server on the users given queries El Console 3 amp Progress SQL Result Authentication Tokens BERE ries a ls s Mytest selectattr population FILE population rank population country territory population listattr population acl_show population constraint list population ls s population M Progress Panel View The
21. 9 Format options and Location Select Format options and create Path Formats Location to be copied FJALL Create Path F Data Copy TUTORIAL Attribute Data interlock Directory Name ACL TUTORIAL Constraints Index Select formats and specify the path And then click Next button lt Step 3 gt Confirmation The aim of this step is to confirm the directory structure and the formats of your copied collection s Confirmation Confirm the directory structure and the formats of your copied collection s Format g X Data G Dring 7 Attribute L E TUTORIAL bookmark AGL amp TUTORIAL country_position E TUTORIAL country_position test L Index E TUTORIAL position CI Constraints ED ORDER After that click finish button to complete copy E Attributes Panel View The Attributes panel is located at the right side of the main window 20 B Attribute 2 le With Dir Only attr All attribute FILE rank int country_territory varchar 100 percent_of_world text population text date_of_estimate text source text new_remarks varchar 50 Deb Ebb bb Ebb Ebb hb bbs FERS Radio boxes During activating the SQL Editor In case of With Dir put attributes with selected collection path into the editor In case of Only attr put attributes wit
22. BPSAY 10 MN 3227 2 FY aP AFd watero 3 3 BASS ZA iia B Attribute MM ACL Constraints Index In the case of viewing a large metadata it takes so long time to get all metadata If users want to stop getting data a user could push pause button If users want to get data again a user could push play button This function limits the quantity of streaming data up to default 100 000 entries Thus if a user want to get more data double click the counting entries and set the range of preference as indicated below figure SQL Editor a H Q bal 2 B i ACL amp Constraints Index A How to use a filter at the data manipulation browser The filter allows a user to select some of interested columns at the data panel 23 a Included Columns Tab Y Filter Data population Attributes Order AS amp population FILE amp population rank amp population country territory 2 population percent_of_world amp population population 2 population date_of_estimate Fi population source population new_remarks lk KE K EIE All Select Empty Select K Order by ASC Remove Order by Filter Query selectattr population FILE population rank population country_territory population percent of world population population Vpopu lation date of estimate population source population new_remarks
23. EST das KA Q Group Read r WriteCw Eexecution x r w O root x 1 2 0 rootgui client r w x E O systemianyuser r x EN lt Data BE Attribute SAD Constraints Index lt Button Function on the ACL Tab gt Add creates new ACLs Remove removes selected ACLs Commit V confirms manipulating ACLs original AMGA commands doesn t include this function Left arrow id changes the activating target point into top Right arrow pl changes the activating target point into bottom Refresh refresh ACLs from AMGA server 4 Constraints Manipulation Panel View On the menu click Tools gt Schema Browser gt Constraints or press Constraints Tab below the schema browser 27 Schema Browser jag SQL Editor al Current Path _ tshuh constraints has KA Q Constraints Table Constraints constraint add check tshuh constraints user Name2 gt 100 const_hulhul constraint_add_not_null Atshuh constraints Name const_not_null_namel constraint_add_check tshuh constraints user Name2 lt 30 const check constraint_add_check tshuh constraints u 45 and useriName2 lt 75 const_ct constraint_add_check tshuh constraints user Attributed 55 const_check3 IT Data BE Attribute ld ACL ETE ETE lt Button Function on the Constraints Tab gt Add F creates new co
24. Mandage EE GE ee ee ee auras GE 45 Ji SOQL EditO ies n KS EN EE Sensis tes coun a a RD N det 46 J Console Panel VIEW act RS DE DES DI ES OGE DR ee 50 K Progress Panel Vie DEERE EE RE EG ee 51 IS OS RESUIE Panel MEW Re EE Ee cated 52 M Authentication Tokens Panel VieW ie ee ee ee ee ee ee ee ee ee 52 OSEIE P GN eN AR a N ES ES N ee GE 53 IV Limitation esseiste dioer ses Og ES Ee See ee ee Ge Ee 58 APPENDIX 1 Shortcut Key sesse sides ds edele ge dees ek ee dee se 59 APPENDIX II AMGA Query esse sesse ese se ee ee ee SG Ge ee Ge 61 APPENDIX IN Changelog uee sesse sesse sesse see EE BEE GE EE EE GE Be ee 91 I Overview A Introduction 1 AMGA AMGA is a gLite metadata catalogue service designed to offer access to metadata for files stored on the Grid In a more general way this is a database access service for Grid applications which allows user jobs running on the Grid to access databases by providing a Grid style authentication as well as an opaque layer which hides the differences of the different underlying database systems from the user To achieve this AMGA is a service sitting between the RDBMS and the user s client application 1 2 AMGA Manager The AMGA Manager is an easy to use general purpose GUI toolkit for AMGA The AMGA Manager aims at providing an interactive exploration and searching environment for metadata in an user friendly manner and hiding complexities for accessing Grid service It allows users to ma
25. OMS Proxy Authentication Fill in your directory of user certificate and user key in your PC in order to make VOMS proxy included voms proxy init command O VO Setting Add new VO You can use the g Eclipse gt VO Declarations preference page to declare a new Virtual Organization There you can click Add to start the VO Wizard If you have installed g Eclipse with a middleware extension the VO Wizard may show up a first page that let you choose the type of the VO you want to create Create a new VO Create a new Virtual Organization of the selected type voms vo E Generic VO Finish For the setup of a middleware specific VO please see the corresponding help pages of the middleware If no middleware extension is available the VO Wizard will directly switch to the wizard page for setting up a generic VO Generic VO Specify the attributes of your VO VO Name MYVO All you have to do here is to enter a name for your generic VO and to press Finish The newly create VO will then be shown in the VO preference page L VOMS VO setting F VOMS VO Specify the attributes of your VOMS VO VO settings Name fkppl Host fkppl kisti re kr v Port 15000 Host DN O GRID KR C FR O KISTI OU CC KISTI CN fkppI kisti re kr Services Information system end point Idap localhost 2170 Additional Services Type Name Remove You may ex
26. abase applications to the Grid using AMGA and complements the existing metadata query language in AMGA The followings are currently supported commands for native SQL queries e SELECT Examples Query gt SELECT x FROM weather WHERE weather temp_hi gt 20 gt gt weather FILE gt gt weather city gt gt weather temp_lo gt gt weather temp_hi 69 gt gt weather precip gt gt weather taken gt gt img1 jpg gt gt Hamburg gt gt 15 a gt 23 gt gt gt gt A0OE OT IT MORE IT gt gt img2 jpg gt gt Hamburg SP 1a a gt 23 gt gt 272008 0 138 LEO AT gt gt img 1S jpg gt gt Seoul Dy Zl gt gt 31 gt gt ERA So EG ME IG ENG e INSERT Examples Query gt INSERT INTO weather FILE city temp_lo temp_hi precip taken VALUES Cimg2 Pusan 24 22 21 2010 06 22 UPDATE Examples Query gt UPDATE weather SET city Daejeon temp_hi 38 WHERE precip 0 70 e DELETE Examples Query gt DELETE FROM weather WHERE temp_lo 21 AND temp_hi 190 E Manipulating Collections createdir parentdir dir option Creates the directory dir if it does not yet exist but parentdir already exists The directory is created with the current owner and the same ACLs as the parent directory The option led is a comma separated li
27. about AMGA middleware upgrade The AMGA Manager will be supported and maintained continuously by the main AMGA development team So it will have immediate update whenever there are changes in AMGA C Technical Support AMGA If you have a question about the AMGA service or the AMGA Manager please contact the following sites AMGA Homepage http cern ch AMGA AMGA Forum http amga ct infn it support GGUS bug tracking https gus fzk de pages home php II Installation A Pre Requiements 1 JAVA version A Java Runtime Environment JRE version 1 6 or higher download http www java com or http www oracle com 2 OS Linux 32bits or 64bits Windows 32bits or 64bits or Mac OS B How to Install 1 Download the AMGA Manager package corresponding to the platform http cern ch amga downloads AMGA_Manager 2 Unzip the downloaded file to a proper directory 3 To run the AMGA Manager Just execute the AMGA Manager exe file in case of the Windows platform 3 II Main Menu A New Connection New Connection consists of ID PW Certificate developed by KISTI and GLOBUS VOMS authentication module using a plug in of g Eclipse 2 Some of functions are not perfect imported and not customized due to the originality of g Eclipse and the dependency to be reflected by original source Therefore there could be unnecessary functions in this client Especially except for Security and VO Decl
28. accept before proceeding with the installation Feature 1 0 0 201206201141 Enter License Description here n j gt I accept the terms in the license agreement I do not accept the terms in the license agreement Click Next button M to move on lt Step 3 gt Installation The following features will be installed You can select a feature and change the location to be installed 55 Installation The following features will be installed You can select a feature and change the location where the feature will be installed Features to install Feature Name Feature Version Feature Size Installation Directory Gi Feature 1 0 0 201206201141 Unknown G 2012_AMGA_7 21 201206 Install Location G 2012_AMGA_7 2 20120614_EJA WAM Test A Change Location Required space Unknown Free space Unknown If all process was done click Finish button And then you can see new popup showing that this program needs to be restarted v Install Update You will need to restart the AMGA Manager for the changes to take effect Would you like to restart now 4 About Program This menu shows some Introduction about the AMGA Manager Contact us tshuh kisti re kr Reference URL http cern ch AMGA 5 My AMGA Version This page shows the two types of AMGA Service version If AMGA service is version up stored AMGA version in the
29. actly fill several blanks Name Host Port Host DN I let you remind services gt Information system and end point dependent g Eclipse only but you don t leave a blank O Security Preference setting The g Eclipse security settings are the central point for managing trusted certificates These are used for accessing remote servers and services that require some kind of authentication such as SSH handshake From the central security preference page you may add or import trusted certificates investigate your certificates or remove trusted or untrusted certificates Besides these settings g Eclipse hooks itself into HTTPS TLS connections Whenever such a connection needs trust management the Certificate Trust Dialog is used to ask the user about how to trust a particular certificate or certificate chain The following screenshot shows two types adding certificates that are adding trusted certificates and importing trusted certificates If you have trusted CA certificates you may click Add and select one or more CA files in your PC using Grid file dialog If you import CA from some site click Import and select one of the available repositories and choose your CA Fm EE eee type filter text Security Sv vw General Help Run Debug Team g Eclipse Certificate Trust valid until Manage your trusted and untrusted certificates Import CA certificates from remote repositories or add them from a local or remote dire
30. anage Collection ea collection Go ACL Ctrl 3 Go Constraint Ctrl 4 Permission W Go Index Ctrl 5 i collection Go SQL Editor Ctrl 6 Collection Manage Federation Ctrl Home collection Data Import Cti Scripting selectattr EN Data Export Ctrl K insert Property update delete Data Import Data Export Data Rollback 13 The above depicts a pop up menu when you right click a collection at the schema browser or at the SQL editor j2 Colecton TO BxieBle gt aB emmy i Testils ES tshuh 2E TEST lt Icon menu on the Collection Panel Adal Ek 1 creates new collection having attributes with data type under the selected directory Delete 1 drop the selected collection Expand all HI see all directories Collapse all EI hide sub directories Refresh refresh session Send collection name import collection name into SQL Editor 2 Right click Pop up Menu with the Schema Browser The pop up menu differs depending on a type of the right side panel 1 Tf you d like to know how to use Make Table refer to 4 How to create a new AMGA collection A E Go Data Ctrl 1 TE Go Attribute Ctrl 2 MM Go ACL Ctrl 3 Go Constraint Ctrl 4 P Go Index Ctrl 5 Go SQL Editor Ctrl 6 Collection 4 Manage Federation Ctrl Home Scripting Send collection name py Data Import Ctrl I ty Data Export C
31. ank int stattr tshuh weathe TEMP S stat Ashuh w J EP country_territory TMP selectattr population FILE population rank population country_territory S percent_of_world oes Population ere wand population population population date of estimate amp population text E date_of_estimate E STAFFI amp source text PROJI E VTABLE UPUNIG STAFF E WORKS EI AA gt schema E pytest HL belle E latitude_longitude_city gt Mytest gt population gt pop_test BE tshuh E TEST selectattr attr condition a e Returns the values of given attributes for all files matching condition lt ii gt indicates help commands lt Button Function on the SQL Editor Browser gt Save bd Save used AMGA queries Open file UE Open an existing AMGA file Run 21 Run AMGA queries Complete Query complete an AMGA query during typing some character in the queries press Fl key ad press the arrow button on your TED l keyboard or point the mouse cursor into Es the target query then select an AMGA capabilities_add i ae add hack query syntax Enter key or double click constraint_add_not_null yi in left button of the mouse 47 Via moving a mouse cursor or an arrow key it shows syntax and a description of the selected AMGA query as balloon help SQL makes some simple queries
32. apan Japan 127380000 Mexico Mexico 108396211 Philippines Philippines 94013200 Vietnam Vietnam 85789573 Germany Germany 81757600 Ethiopia Ethiopia 79221000 m O m m O m m m O m m O m O Filter 15 sets the data range in the target collection which you want to see Add F creates the new entries in the catalogue and needs to click commit button to confirm the final incoming data Remove removes selected entries automatically commit Commit XY confirms manipulating data original AMGA commands doesn t include this function Left arrow EK changes the activating target point into top Right arrow EP changes the activating target point into bottom Refresh Vd refresh data from AMGA server Pause Al pause deriving data a large scale data after that it s toggle to play gt button 3 If you d like to know how to use filter refer to A How to use a filter at the data manipulation browser 22 Click Pause E Schema Browser EN SQL Editor Current Path report Yit vi KW Q a F SA AE ZEA HA ES TE HANS SAAT 878 MISR SI MA HS SUPE B AMAAS 7S 1kg EGS QS ASA VIADIIEAA ER WA AR Hagge O A PS R2428 ZA BI 71S MES SRERE XBMC SHANA IV z378 53487 BS ESEI ABSA AT M DIe W788i PIW Z EO oi APIE AA E ZEY AA 32 5 9 BMC Ie 5387 BESS NAT C ASA VN aas7l s swaterol 3 5 5 APEC HSHTH N D
33. arations in the g Eclipse preferences we won t use others In detail refer to advanced preparations for VOMS proxy authentication On the menu click File gt New Connection or click the New Connection M button t host URL root EE RE 8844 belle_user hostURL 8822 z UserID RL 8822 1 tshuh EFESE 8822 0000 root MNHSSEURINEN 8822 rr root MASSERE 8822 root NESSEURIM 8825 Access ID PASSWORD v root 8823 root 8824 Cl UsessL 7 Save the Login information lt AMGA Login gt Host The IP address of an AMGA server User An user Account Password An user password Port Port Number of an AMGA server generally 8822 Access Choice of authentication mechanism 4 UseSSL Whether to use an SSL Connection Save Whether the connection information is saved for later use Access ID PW Certificate Grid Proxy VOMS Proxy GLOBUS Proxy 1 ID PW authorization including authentication Connection with ID PW 2 Certificate authentication Connection with Certificate authentication Grid Proxy add Specify the parameters of your Grid Proxy D User certificate C tshuhttshuh usercert pem User key Cgtshuhwtshuh userkey pem Key passphrase e Proxy lifetime 1 El Days o E Hours o Select user certificate and user key in your PC and key in passphrase with manipulating the proxy life cyc
34. ate virtual new tables directories that combine the information of other tables similar to what selectattr does AMGA uses the native support of the database to provide views so the actual behaviour depends on the database backend For example some backends like PostgreSQL allow you to update an existing view which actually updates the tables behind it An important use case of views are to support access restrictions to attributes the columns of the underlying table This is a typical use case for views also in normal database usage Views can be accessed and deleted like normal directories e view create name maindir attr 1 attr n condition Creates a view with the given name based on the entries in the given directory attaching the attributes given in the list to these entries based on the join condition In the following examples the first one shows a use case where a view viewl1 is created using all the entries in the current directory but using only the attrl or attr2 columns After assigning the right permissions to the resulting new directory viewl this can be made readable for users who need to read these attributes In the second example a view view2 is created combining attributes from the current directory and the dir subdirectory Examples Query gt view create ppl population rank country territory percent_of_world population date of estimate source new remarks rank lt 10 Query
35. ation xls ME ar Select file data then click next b utton os lt Step 2 gt Data Import Wizard Set up first data row Data Formats Specify the file format and conversion options for the data Input File Format File data format Delimited Text Tab First data row 1 Space Comma Finish This browser allows a data format inside a file to be selected If a user selects delimited text format the user has to choose the delimiter a tab a space or a comma We recommend users to select a tab in order to minimize import failure Then select the first data row and click the next button lt Step 3 gt Data Import Wizard Check Information start position 239 Select Star Position For Each Source Column FILE FILE China India UnitedStates Indonesia Brazil Pakistan Bangladesh Nigeria Russia Japan 8 2 Pod country _territory China India UnitedStates Indonesia Brazil Pakistan Bangladesh Nigeria Russia Japan Mexico Mexico Philippines Philippines Vietnam 13 Vietnam Germany 14 Germany Ethiopia 15 Ethiopia Egypt 16 Egypt Fm 17 es ll Total data row 223 1 2 3 4 5 6 7 8 9 RES This step gives users a preview of imported dataset With this step users can check whether importing is properly processed Then click the next button lt Step 4 gt Data Import Wizard Select target coll
36. browser Attribute e Add the function of CRUD at schema browser ACL e Add the function of CRUD at schema browser Constraints e Add the function of CRUD at schema browser Index 4 SQL editor e Add import all attributes names e Add import collections entry name e Add completed CLI completing commands simple query e Add support for making AMGA commands with balloon tip usage way e Fixed support multi Queries using notation e Add comments function about AMGA queris using notation e Add save open AMGA queries 5 Console and Result view e Add shows the results related collection panel and schema browser Attributes ACL Constraints Index e Add shows user query from all views e Add shows data grid for data results 6 User Group management e New user management GUI procedure group management GUI procedure e New relating with schema browser ACL 94 7 Import Export e New Import Export GUI procedure for various file formats such as excel delimited text including Tab Space and Comma E Change in 0 8 1 User login and Access information management e ID PW login e Save Access Information management e AMGA Mdclient call 2 Collection management e collection tree e Make collections e relating with schema browser and attributes panel 3 schema browser e the function of CRUD at schema browser Data e get data from AMGA server e show data grid 4 SQL edito
37. ctory Hey Globus SS GridFTP EP cs Job Status Updates Perspectives Scientific Visualisation Delete Security VO Declarations 10 O Preferences VO Declarations General Help Run Debug Add remove or edit VO descriptions The checked VO is taken as the default VO when creating new g Eclipse projects Known Virti g tam Ignore g Eclipse lams z Es biome only dependent on g Eclipse GridFTP Job Status Updates Perspectives Scientific Visualisation EE ee VO Declarations VOMS proxy authentication Don t be confused with inactivated functions B Disconnection To disconnect current connection On the menu click file gt Disconnect AMGA server or click End Connection M on the tool bar New Connection Ctrl Shift O A End Connection Ctrl Shift X Change Password Preferences Exit Alt F4 C Change Password On the menu click File gt Change Password D Collection Panel View 11 1 Collection Management The Collection panel is located at the left side of the main window The Collection panel helps users to manipulate AMGA collections such as creating listing and deleting collections directories sub directories EE Schema SQL Menu at collection MENU Sub MENU Browser Editor CE i a EE LE EEN Na EN ANN EE LN A NN WEEN IE N EE E Go Data Ctrl 1 Go Attribute ca I M
38. ection Nizar P Data Import V SS Select Collection Collection population 4B gt ES AA gt E ACL INC gt 83 ACLINC3 gt amp B ACL INCA gt ES AMGA 2 0 spec gt B asdf gt belle gt E drugscreenerg gt ES fed test gt ES fed test1 gt HE jo3 gt ES latitude longitude city gt E Mytest gt ES pop BigData gt ES pop rollback gt EB pop test gt ES population gt ES PROI gt E PROJ1 Total data row 223 lt Back Finish l Cancel Select the collection where you want to import and click the next button 33 lt Step 5 gt Data Import Wizard Attribute mapping Attributes Mapping Map the fields from the import file to a AMGA attribute in the target database The next step goes through a confirmation process that file fields match AMGA attributes If finished matching check then click the next button lt Step 6 gt Data Import Wizard Monitoring upload queries me EET aS AMGA SOL Script N AMGA Command i 5 upload pop_rollback Attr2 Attr3 Attr4 Attr5 Attr Attr7 Ar a put China i China 19 52 1339020000 2009 ChineseOfficialPopulationClock put India 2 India 17 26 1184259000 2010 ndianOfficialPopulationClock put Unitedstates 3 UnitedStates 4 52 309897000 2010 UnitedStatesOfficialPopulatio
39. eet0 sheet2 Click the next button The Exporting success message box should come up 3 Data Rollback Wizard On the menu click Tools gt Data Rollback or select DATA Rollback icon on the menu bar shortcut Ctrl U Tip Data Rollback Wizard This Data Rollback Wizard is temporary function when the transferring error closing session occurred for some unknown reasons or network disconnection happen during importing huge data into AMGA server 39 lt Step 1 gt Data Rollback Wizard Select target file Data Roll File Name Select the file that contains the data you would like to rollback Rollback from File Xls Txt J FT EGI technical Forum Sample data vel Sample data 24 P Fay wed fe Be f os ED et se Hie is E Latitude Longitude of World Cities 2010 08 20 2 Microsoft Off te E Population 2010 08 23 9S Microsoft Of dee Pee Population1_A L 2 2 2010 09 10 25 Microsoft mee a B queries_for_demonstration 2010 09 11 92 Text Docum snes T E weather data all 2010 09 01 2 Microsoft Of Ga ol 4 Ga First E x OldBOOT F ca Project G Backup H q m 7 79 OLEN Population v2 xisi m z aa lt Back Next gt Finish Cancel Click Import button hail then select file data at opening window browser lt Step 2 gt Select Objects for rollback 40 Se
40. emove lt user gt lt capability gt Removes the given capability from user s capabilities Only root can do this Examples Query gt Query gt e capabilities_list user Lists all capabilities of a user default is the current user Examples Query gt Query gt 74 H Index Management e index_create name collection attribute algorithm Creates an index name on a collection directory using several attributes and a given algorithm Algorithms depend on the backend The index is later referred to collection name in index_remove Examples Query gt index create indexname TEST index Aftr1 e Is collection show index list Examples Query gt Is TEST index gt gt TEST_index indexname gt gt FILE1 gt gt FILE2 DE Query gt Is TEST index gt gt TEST_index indexname index remove index remove path Removes an index Examples Query gt index remove TEST_index index1 I Table Constraints constraint_add_not_null directory attribute name Adds a not NULL constraint 2755 for the given attribute of the directory Name is the name used to refer to the name of the constraint It must be unique for that directory Write permissions on the directory are necessary for this operation Examples Query gt constraint add no
41. emoves the certificate given by the subject from the list of subject allowed for user e user list description Lists all users known to the authentication subsystem user_listcred user description Lists all possible credentials of a user Only for root O View e view create union view dirs condition description Creates a view as a union of the entries in the directories under given condition L Site e site list 88 description Lists all sites and their ID e site_dump site description Outputs the metadata commands to recreate the given sites e site add site name hostname port description Registers a site e site remove site description Removes a site site set properties site property value property value description Updates one or more configuration property of a site e site get properties site property property description Gets one or more configuration property of a site e site list properties site description List all configuration properties of a site O Replicas e replica list guid lfn 1 description Lists the sites with replicas of files given as guids or lfns e replica get guid 1 fn 1 description Lists the SURL replicas of files given as guids or lfns e replica add guid SURL description Adds a replica at SURL to the replicas of the file with the given GUID e replica_re
42. ep click Import Log View and check which row was failed In the second step select target sheet and During the third step manipulate both first data row and end data row f you don t set up that it could take long time to remove failed rollback data because of trying all entries in the file s After this click the finish button then rollback success message box comes up H Group User Manager On the menu click Tools gt Group User Manager or press Gourp User Manager on the tool bar 1 Group Management Search Group Group Name a belle_replica_user root choinody root aaaa jykoo root abc tshuh root belle_replica root group1 root gui_client R rootnew A root new aroun lt Group User Manager Add creates a new group Delete 1 deletes the selected group Search search a group name 2 Edit Group Membership In order to change add delete a group membership click Edit User Groups amp in the Group User Manager pop up browser 42 Group List All Users amp belle_replica_user amp choinody A guest amp jykoo root gui_client amp belle_replica_user amp choinody Biykoo Atshuh amp new user amp root lt Edit User Groups gt Import User Imports a user into the selected group 3 Users Manager EE FEIT f All Users Search User
43. he below sentence selectattr pop_BigData FILE pop_BigData Attr1 pop_BigData Attr2 pop_BigData Attr3 pop_BigData Attr4 pop BigData Aftr5 pop_BigData Attr pop_BigData Attr7 pop_BigData Attr8 pop_BigData Attr9 pop_BigData Attr10 pop_BigData Attr11 pop BigData Attr12 pop_BigData Attr13 pop_BigData Attri4 pop_BigData Attr15 pop_BigData Attr1 limit 10000 This step is applicable to only text case Complete your query and click next button lt Step 3 gt Data Export Wizard Check matching fields Check matching data fields Check origin attributes and exported data fields Amga Attributes Data Type FILE FILE rank int country_territory varchar 100 percent_of_world text population text date_of_estimate text source text new_remarks 38 Make sure that the origin attributes and exported data fields are correct Then click the next button lt Step 4 gt Data Export Wizard Make file Make file A make file and select file path to be saved for exporting the data j Excel File File Name population Save G W02_AMGAWEGI technical Forum 2010 Sample_data les Make a file name and select a file path which is used to save exported file If you export a large scale data in only excel form you could find a couple of files with a couple of sheets as I mentioned before e g outputfile O xls outputfile 1 xls including sh
44. hout any path into the editor Send attribute name let the directory attribute name imported into the SQL Editor All Columns import all directory attribute names into SQL Editor Only SQL Editor no schema browser Attribute List Attributes in the selected collection F Schema Browser The Schema browser provides a total solution for managing AMGA metadata catalogue such as adding modifying and deleting metadata schema entries access controls user and group information and so on To use the schema browser select Schema Browser menu at the main window or press SQL Editor EA icon on the menu bar 1 Data Manipulation Browser _ It is possible to search and manipulate entries from a selected collection through the data panel of the Schema Browser The data view is displayed in a grid form when a user selects a collection It helps users to easily understand entries and attributes of the selected collection 21 To use the data view click Tools gt Schema Browser gt Data menu or press Data Tab below the schema browser chema Browser il SQL Editor Ylt viK W Q a rank country_territory percent_of_world population China China 19 53 1339020000 India India 17 26 1184259000 UnitedStates UnitedStates 4 52 309897000 Brazil Brazil 2 82 193321000 Pakistan Pakistan 2 48 170183500 Bangladesh Bangladesh 24 164425000 Nigeria Nigeria 158259000 Russia Russia 141927297 J
45. ibutes of a file to given values The attributes must exist Examples Query gt setattr weather img132 jpg temp_lo 23 temp_hi 54 collection must have entry name and a set of attributes e getattr pattern attribute Returns the filename and all attributes in turn for every file matching pattern Examples Query gt getattr cities altitude latitude gt gt Hamburg gt gt 6 D gt OS gt gt Geneva gt gt 374 gt gt 46 Ed e listattr file Returns a list of all attributes E Examples 65 Query gt listattr weather gt gt city gt gt varchar 30 gt gt temp_lo gt gt float gt gt temp_hi gt gt float gt gt precip gt gt int gt gt taken gt gt timestamp e clearattr path attribute Sets the attributes of all files matching path to NULL Path may currently contain wildcards only in the file part Examples Query gt clearattr weather precip Query gt Sets the attribute of matching path entry_name to NULL Examples Query gt clearattr weather File6 precip C Finding and Updating Entries e find path query Returns a list of filenames matching path and fulling the query with their attributes The path may currently contain only wild cards in the file name part Query must be enclosed in single quotes Strings in the query mus
46. ing right mouse button at Collection Panel gt Scripting compose automatically a simple AMGA query at the SQL Editor Browser 48 DAE Federation Manager Ctrl Home Go Data Alt 1 Go Attribute Alt 2 Go ACL Alt 3 Go Constraint Alt 4 Go Index Alt 5 Schema Browser I Current Path _ tshuh weather i 2 S bl D O sal FL completed insert tshuh weather city temp_lo temp_hi taken a precip Alt 6 50 SOL Editor Collection Scripting gt Send collection name After clicking the insert at the scripting menu the SQL Editor browser shows full AMGA commands with all attributes and input value colums lt Execute blocked query and Add block Comment gt Although there are many queries in the SQL Editor you can choose and execute one of them by dragging some of command lines which changes the background color into blue If you want to write a description that is to be inctivated while making queries you can comment them out with the symbol Below figure there are several command lines which are comprised of two comments and one query with a description about listattr If you want to activate and run the first line query dealt with blocked comment you may drag activate and run F5 49 7 Schema Browser ii SQL Editor OB attribute 32 al Current Path tshuh cities With Dir O Only attr Q S bl O sa F1 completed selecta
47. iption Grants to user the right to replicate login information for users e rep_users_disallow user description Remove from user the right to replicate login information for users e rep_show_permissions description Show the replication rights for all directories e rep_list_subscribers description Show the current subscribers and their subscriptions e rep drop subscriber lt subscriberID gt description Drops a subscriber and all related subscriptions O Entry e import table directory description Imports an existing table in the database as the given directory e lfn_lookup guid description Looks up the lfn which belongs to given guids L Group e grp_voms_add groupname voms_group description Allows user to have group permission with a certificate with the given VOMS Group grp_voms_add groupname voms_group 87 description Allows user to have group permission with a certificate with the given VOMS Group grp_voms_list description List all possible VOMS Group e grp_voms_remove voms_group description Removes VOMS Group allowed O Schema e schema_cp source dir dest_dir description Copies a schema from one directory to another by adding attributes L User user_subject_add user subject description Allows user to log in with a certificate with the given subject user_subject_remove user subject description R
48. isticsBure i Mexico 11 Mexico 1 58 108396211 2010 INEGIestimate National 332 Philinnines 12 Philinnines 137 94013700 2010 NationalStatisticsOfficame ba Tip Help function Help function is that the grammar which let you know how to complete a query is shown on the bottom of SQL Editor In this time if you forget a word of command and remember some letters of a word you could type some characters and receive help to complete command by pressing F1 button on your keyboard K Fast View The Fast View is nice viewer to see very large scale of metadata with powerful rendering technique and to handle real time update dynamic styling and more Its uses are not legion and only to show mass metadata quickly and effectively However the function of page size button to set the mount of entries showed in a page has a high dependency on the available PC memory So users have to keep the sufficient available memory 50 schema Browser ill SQL Editor i Fast View E Belle 1 a FILE id uid Ifn status events datasetid stream 1 fl 1 25892e178064 odata mcprod good 8800 1 0 E 2 f10 10 25892e1780f64 bdata mcprod good 8800 j 0 3 f100 100 25892e1780f64 bdata mcprod good 8800 1 0 4 1000 1000 25892e1780f64 bdata mcprod good 8800 1 5 10000 10000 25892e1780f64 bdata mcprod good 8800 3 0 6 100000 100000 25892e1780f64 bdata mcprod good 8
49. itude latitude put Hamburg 66 413 gt put Geneva 77 62 put Pusan 99 73 gt commit Query gt put file values Inserts a new entry during upload Errors are returned by the call immediately OK is delayed until upload is committed abort Aborts upload or transaction Errors and OK are returned by the call immediately Examples Query gt abort commit Commits upload or transaction Errors and OK are returned by the call immediately Examples Query gt Commit B Commands for Manipulating Attributes e addattr dir key type Adds new keys to the list of keys of a directory In a relational database backend these keys become the columns of a table associated to a directory You should only use one key type pair currently for compatibility reasons because some older backends like PostgreSQL lt 7 4 do not allow to alter a table adding several columns 63 Possible types are explained in AMGA data types p 25 The type is only used as a hint for the back end to store the data efficiently and allow efficient queries The type may be ignored by the implementation e g if the back end is a filesystem In a filesystem the types and defined keys could be stored as attributes of directories Some storage backend may allow you to dene keys ona per entry basis Examples Query gt addattr TEST
50. le And then click finish button 3 Globus Proxy authentication Connection with GLOBUS Proxy authentication New authentication token Select the type of the new token D VOMS Proxy le Globus Proxy Select Globus and click Next button Grid Proxy Specify the parameters of your Grid Proxy User certificate C tshuh tshuh_usercert pem User key Ca tshuh tshuh_userkey pem gt e Key passphrase 00000000 Proxy lifetime 1 EE Days o E Hours 0 H Minutes New authentication token Select the type of the new token VOMS Globus Proxy speek imeta nsh Select VOMS proxy and click Next button u VOMS Proxy VO Selection Page Specify the VO that should be used Available VOs 7 biomed Name BDI Idap localhost 2170 Finish Edit VOs information Add VO and Modify VO information Please refer to Advanced preparations for VOMS proxy authentication Edit Security Add VO and Modify VO information Please refer to Advanced preparations for VOMS proxy authentication A Qe VOMS Proxy YOMS Proxy Specify the parameters of your Grid Proxy User certificate C tshuhi tshuh_usercert pem User key C tshuhi tshuh_userkey pem Key passphrase e Proxy lifetime 1 Days o 5 Advanced preparations for V
51. lect Objects Select the data objects that you wish to rollback B gt BB AA gt 8S ACLINC gt 8S ACLINC3 gt BS ACLINCA b E AMGA 2 0 spec gt B asdf gt ES belle gt ES drugscreenerg gt ES Aed_test gt ES fed_test1 gt B amp B jo3 gt ES Aatitude_longitude_city gt E Mytest gt B pop_BigData gt B pop rollback gt E pop rollback1 gt E pop_test1 gt ES population gt ES PROI gt E PROJ1 Perd Select the collection where you want to rollback and click the next button lt Step 3 gt Set the range of removal This step is temporary and can force to remove failed rollback data since AMGA API doesn t support to transfer a huge data more than 50 000 entries Set the range of removal Set the range of removal Format Excel File String quote characher Tab X Select Sheet First data row End data row File Name Last Modified Date Size Total data row 223 2 yodakisti re kr_7 22 Logpr 2011 07 25 9 05 31 1KB Host yoda kisti re kr User root Current Path pop_rollback1 Data 2011 7 22 16 25 27 Import Type Excel 1 100 row Commit 101 200 row Commit 201 223 row Commit User root Current Path pop_rollback Data 2011 7 22 16298 Import Type Text 1 100 row Fail In the first st
52. les Query gt stat cities gt gt cities gt gt collection perms gt gt rwx gt gt root gt gt system anyuser rx rmdir path Removes all directories matching path Directories are only deleted if they are empty and they have no attributes defined Examples Query gt rmdir test2 directory must have no entries Query gt e pwd Prints the current directory which you can change with cd Examples Query gt pwd gt gt weather cd path Changes the directory to the given path Examples Query gt cd weather Query gt 72 F Permission Handling whoami Prints out the name of the current user Note that this command does not need any connections of the AMGA server and can thus be also used to do a test on whether an AMGA server is alive and what response time it has Examples Query gt whoami Query gt e chown entry dir new owner Changes the owner of a directory or entry Only the owner of an entry is allowed to execute this or the root user chown does not check whether ser exists since user management is considered to be handled outside of AMGA ideally Examples Query gt chown TEST tshuh Query gt acl_show TEST gt gt tshuh rwx gt gt system anyuser rx e chmod entry dir new permissions Changes the access pe
53. lp gives you this on line Manual AMGA MANAGER USER MANUAL ver 1 2 Direct link URL htto amga web cern ch amga downloads AMGA_Manager 1 2 AMGA_Manager_U ser_Manual_v1 2 0 pdf 2 AMGA Homepage If you have a question about AMGA with using AMGA Manager please refer to this AMGA homepage http cern ch amga 53 htpvvamgaweb cem ch amga ee Tl ABBA METADATA CATALOGUE PROJECT overview downloads installation browse source more docs AMGA Overview 2 1 2 Introduction The ARDA project is studying the needs on metadata catalogues in a grid environment and what the solutions offered by the HEP experiments so far In order to investigate how an implementation of a highly performant and possibly distributed including distributed updates metadata server could look like ARDA has written a prototype implementation For the rationales of the design see here This prototype is also used to understand the design of the protocol interface of the server Currently the protocol of the metadata server is not yet final but already somewhat stable Definition of the Client Server Protocol It corresponds to the interface design for a web service which is deveped by ARDA together with the gLite team Development The AMGA implementation uses streaming to communicate between client and server which shows a very promising performance To meet the EGEE requirements we have al
54. move replica guid description Removes a replica for a GUID 89 e replica_register guid site description Registers a site to a central catalogue that has a certain file e replica_unregister guid site description Un Registers a replica on a site at a central catalogue O Ticket e ticket get description Asks for a new ticket to be issued e ticket check ticket description Validates a ticket O Admin e sudo user 90 APPENDIX III Changelog A Change in 1 2 1 Copy Collection Wizard e New Copy collection to target directory with metadata and some properties 2 Fast View e New view streaming datagrid faster using NatTable high performance SWT data grid 3 SQL editor e Fixed modifying to allow character set 4 Import Export e Fixed bugs in data import wizard matching attribute with null column 5 Common e New automatically program update Wizard e Fixed moving focus on the target column with tab key at every pages in AMGA Manager B Change in 1 1 1 User login and Access information management e Add access with several authentication importing g Eclipse plug in Certificate VOMS proxy and GLOBUS 2 Collection management e Add show the list of directory in each AMGA version only for more than AMGA version 2 1 1 new command ls s e Add graphically show collection status plan index sequence view federation re
55. nClock put Indonesia 4 Indonesia 3 41 234181400 2010 Statisticsindonesia put Brazil 5 Brazil 2 82 193321000 2010 BrazilianOfficialPopulationClock put Pakistan 6 Pakistan 2 48 170183500 2010 EER ne put Bangladesh 7 Bangladesh 2 4 164425000 2009 a S put Nigeria 8 Nigeria 2 31 158259000 2010 put Russia 9 Russia 2 07 141927297 2010 EE put Japan 10 Japan 1 86 127380000 2009 OfficialJapanStatisticsBureau commit Total data row 223 This browser gives users a chance to double check whether importing is processed properly Users can use these queries in development of their applications After this click the finish button then the importing success message box comes up 2 Data Export Wizard Users can export metadata in AMGA to external files with different forms MS excel text files etc through the Data Export menu On the menu click Tools gt Data Export or select DATA Export E3 icon on the menu bar shortcut Ctrl K Data Export 1 Export data limited by the selected attributes and where clause to file formats like xls txt and so on lt Step 1 gt Data Export Wizard Select target collection ME c Qe Data Export Wizard Select Objects Select the data objects that you wish to export
56. nipulate metadata schema entries access control user and group information through a user friendly GUI In addition it includes many features improving usability and convenience such as the automatic query composition importing and exporting metadata into a spread sheet and filtered metadata searching Portability was one of the most important considerations and the Eclipse IDE helped the toolkit work in various heterogeneous platforms Linux Windows and Mac We believe that these diverse features in the AMGA Manager helps users to build metadata searching environment more easily and faster and to boost productivity in managing large size metadata on Grid The AMGA Manager is compatible with AMGA Tu AMGA Manager Connection Bra E ACLING E ACLINGS E ACLINGS E AMGA_2_0 spec belle E drugscreenerg ES fed test y E PROJL pytest B report ES schema E STAFF ES STAFFL B TEMP S TEMP SS E Aest mest amp test soon B MP r E Ashuh Ea AIPUNIO China India UnitedStates Brazil Pakistan Bangladesh Nigeria Russia Japan Mexico Philippines Vietnam Germany Ethiopia country territory UnitedStates Data JI percent of world population 19 53 1339020000 17 26 1184259000 309897000 193321000 170183500 164425000 158259000 141927297 127380000 108396211 94013200 85789573 81757600 79221000 SQL Result Authentication Tokens 1308278208072 Que
57. nstraints a Add Constraints population ii rank const unigue namel constraint add check constraint add primary key After clicking Addl button choose constraint and attribute in the drag box Except collection change AMGA constraints command consisted of constraints attributes and constraint s name Remove removes selected constraints Commit v confirms changes 28 Left arrow IK moves to the first constraint Right arrow EP 1 moves to the last constraint Refresh Q refresh constraints 5 Index Manipulation Panel View On the menu click Tools gt Schema Browser gt Index or press Index tab below the schema browser ev KAQ Table Index index create index1 PROJ1 BUDGET IM Daa GE Attibute ACL E Constants GA 222O OC CS S lt Button Function on the Constraints Tab gt Add F creates a new index ae ae Index Name Index Attributes rank country territory percent of world population date_of_estimate source new_remarks After clicking Addi button change the index name and choose index attributes in the drag box Remove removes selected the target index Commit VY confirms changes Left arrow N moves to the first index Right arrow Pt moves to the last index Refresh Ql refresh indices G Data Impor
58. ory The pattern can also be the name of a directory if a condition is given if the table is a plain table the pattern _must_ be a directory name and there must be a condition given Examples Query gt rm cities latitude 65 Examples Query gt rm r testl remove recursively remove selected testl directory in addition to files and sub directories under test directory e listentries directory schema Returns the name of all entries in a given directory or schema This differs from the dir command in that it will not show any directories but also that it shows only entries attached to a schema in the case of an AMGA catalogue collaborating with a file catalogue Examples Query gt listentries TEST transaction Starts a transaction Any changes to the backend of AMGA are done only when committed To cancel a transaction use abort Examples Query gt transaction upload dir attribute Starts an upload of entries into the catalogue Currently a static restriction of the prototype is that there can be only up to 98 attributes assigned like this After the upload is initialized the put abort and commit commands are allowed Errors are returned by the call immediately the OK code is delayed till the entire upload is successfully committed 62 Examples Query gt upload cities alt
59. plica gt gt grp_adduser root belle_replica belle_replica_user gt gt grp_create root testgroup gt gt grp_adduser root testgroup tshuh LP ee M Management via VO Certificates You can allow users to log in with VO enabled certificates by using the VirtualOrganizations option and assigning it a list of VO default_user definitions By enabling MyProxyHack this works also with certificates issued by a MyProxy server The VOGroupMap and VOUserMap options allow to map VO groups to AMGA groups and special VO roles to AMGA users with the syntax used by VirtualOrganizations You can also manage mapping between a user group amp a VOMS Role group in the command line tools user_voms_add Allows user to log in with a certificate with the given VOMS Role Examples Query gt Query gt user_voms_list Lists all possible VOMS Role Examples Query gt user voms list Query gt 81 user_voms_remove Removes VOMS Role allowed for user Examples Query gt Query gt N Users Groups and ACLs The standalone AMGA server comes with a powerful system to manage users as well as to control access to entries and metadata If AMGA is run as an add on to a le catalogue however these features are not available and the access controls of the file catalogue is used instead The permission schema tries to copy the semantics of POSIX API
60. plication and so on e Add make ACL at the same time in the generation of collection 91 e Add change permission and owner in a directory 2 schema browser Data e Add view streaming datagrid that is a large scale of metadata deriving recursively and continuously default 500 entries with pause function and play function to stop getting metadata for a large scale of metadata e Add setup deriving rules which are the number of metadata and the starting point to get in a time e Fixed present shorter character set about long character set in a data column e Add sort metadata e Add edit ACL in the case of several entries at the same time after target dataset area is selected 3 SQL editor e Add show current path on the top of SQL editor browser Fixed register new AMGA commands to provide completed CLI e Fixed make the attribute s value column go away when focusing on it supported by scripting with mouse or keyboard Add show changed path in current working path information positioned at the top of SQL Editor according to change working path e Fixed deal double slash in the middle of symbols as data e Fixed arrange the directories in fast sql maker clicking sql icon in the menu bar 4 Import Export e Fixed change Import Export process with efficiency e Fixed import and export a large scale of metadata but it doesn t support to import export data at one go in the internal process
61. r Collection Name Attributes S Attribute Name Type Length E ACL Check lt Functions of Pop Up Browser gt Collection Name A Collection Name Attributes Attributes Back Previous Step Next Next Step Finish Complete creating a new collection 18 Cancel Cancel creating a new collection 6 Copy AMGA collection Wizard Copy collection function provides users to copy target collection with metadata including all entries and own properties On the collection pop up menu click Copy Collection shortcut Alt c lt Step 1 gt Choose collection s x Choose collection s Please choose the collection s a i TUTORIAL 7 TUTORIAL bookmark a ME TUTORIAL country_position MIES TUTORIAL country_position test ES TUTORIAL movies EE TUTORIAL participant info TUTORIAL population WE TUTORIAL position ES TUTORIAL guestionnaire EE TUTORIAL test IE TUTORIAL test 1 Select all collections under the target directory to copy and then click Next button Step 2 gt Format options and Location Users can set copied collections with its own formats data attributes ACL constraints which they select to the directory they want But ACLs can t be copied in the same as the data of ACL in original entries and in some cases ACLs can be filled with new access definition 1
62. r e import attributes names activating 1 line command dragged and selected e making basic query using SQL GUI 5 Console and Result view e shows the results related schema browser Data 95 REFERENCES 1 AMGA Available at http amga web cern ch amga 2 g Eclipse Available at http www geclipse org 96
63. rmissions of an entry or directory Entries have owner and group permissions while directories have owner permissions and group permissions are handled via ACLs Group permissions for entries allow you to remove privileges granted for all entries in a directory via the directories ACLs The format of new_permissions is rwxrwx for on entries and rwx for directories where signs can be substituted for the letters if you do not want to give a certain privilege The permissions for entries are the concatenation of first user and then the group rights The x Flag allows a user to enter a directory or respectively list an entry r and w flags allow users to read write metadata while the w flag for directories allows users to create or delete entries in the given directory Users cannot list directories for which they 73 don t have read permissions The command works also for patterns and uses a transaction Examples Query gt chmod TEST r x Query gt G Capabilities Capabilities are additional attributes assigned to individual users They are used for example to allow a user to replicate login information Currently no mapping of VOMS capabilities is done but this could be a future use case e capabilities_add lt user gt lt capability gt Adds the given capability to the user s capabilities Only root can do this Examples Query gt Query gt capabilities_r
64. ry gt selectattr population FILE populay Query gt listattr population Query gt acl_show population Query gt constraint_list population Query gt 1s 1 population f m FILE amp rank fint amp country_territory varchar 100 percent of world text amp population text tion country_territory population percen B Product Features 1 User Friendly Interface The AMGA Manager allows users to manipulate metadata schema entries access control user and group information through a user friendly flexible and powerful GUI In addition it includes many features improving usability and convenience such as the automatic query composition 2 Connections and Authentication The AMGA Manager directly connects to an AMGA server through the AMGA Java interface Currently it provides ID and password based authentication only It is planned to provide a certification based authentication sooner or later 3 Powerful Schema Browser The Schema Browser of the AMGA Manager allows users to collections data entries attributes ACLs user permissions in a very flexible way 4 Easy and Flexible Query Interface The AMGA Manager provides an easy and flexible query interface through filters which behave similar to the where clause and order clause of SQL 2 5 Easy and Fast Query Execution Users can easily create and execute both AMGA SQL and AMGA Query Builder 6 Prompt action
65. s Some of the semantics are different from the POSIX semantics for a file system as AMGA is a metadata catalogue As an example it is necessary to have the x permission for a directory to read the attribute list while r permissions for any file are necessary to read the values of the attributes for a file The exact behaviour is described together with the respective commands 1 Users The size of a username is limited to 64 lower case latin alphabet characters 2 Groups Any user can create groups Group names are scoped with the name of the user creating them A fully qualified group name has the form user groupname If the user scope of the group is the current user it does not need to be specified in a command The size of groupname is limited to 64 lower case latin alphabet characters A special group exists and is maintained by AMGA internally the system anyuser group which contains automatically any user which is authenticated to the system Using this group it is possible to emulate the 82 permissions for other users in a Unix filesystem which are missing in AMGA The following commands can be used to manage groups grp_create groupname Creates a new group with name groupname It is not possible to create groups belonging to others Examples Query gt grp_create testl grp_delete groupname Deletes a group with name groupname Only root can delete groups of other users
66. so implemented an alternative SOAP based frontend We have made a RPM including A streaming and a SOAP front end e An interactive client for the streaming front end e Client APIs for the streaming client C Java and Python 3 Update AMGA Manager The AMGA Manager provides automatic updater from program version 1 2 so that users can use new version program without re installation Therefore it is possible to minimize download and installation time and to make reuse private configuration information On the menu click Help gt Update Manager lt Step 1 gt Search Results This step is to select target features to install Below popup users can see only the latest version of a feature or all features to install X Default settings are recommended 54 Search Results Select features to install from the search result list P Select the features to install I E si AMGA Manager 1 2Update Deselect All More Info Properties Select Required Error Details 1 of 1 selected W Show the latest version of a feature only Filter patches included in other patches on the list Back Next gt Finish d Click Next button dill to move on lt Step 2 gt Feature License This step is to seek your signature of license Check your acceptance of license agreement Feature License Some of the features have license agreements that you need to
67. st of options no spaces allowed The following options are available as of AMGA 1 1 shared Subdirectories created under this directory share the same schema and database table of the parent directory acls Creates a directory with acls for every entry this is currently only supported by PostgreSQL and MySQL5 and only if the necessary supporting stored procedures have been installed first type lt type gt Species the data type of the entry column Explicitely supported are int oat date table lt tabletype gt Only MySQL Allows to specify the storage type of the table e g InnoDB Neccessary because not all tables are alike Specify e g Mylsam this allows for example GIS functionality Examples Query gt createdir TEST test1 Query gt e dir directory Returns the name of all subdirectories and files in the directory where the entry type is either entry or collection If AMGA collaborates with a file catalogue this command will effectively show the content of the file catalogue If you want to see which entries have already been attached to a schema in the AMGA part use the listentries command 71 Examples Query gt dir TEST Query gt e stat dir entry Returns information on a given entry or directory They can also be a pattern in the case of several entries You need read permission to get this information Examp
68. t Export and Rollback Wizard 1 Data Import Wizard The AMGA Manager allows users to import data from a wider variety of formats like excel text and xml files into AMGA metadata catalogue On the menu click Tools gt Data Import or select DATA Import 3 icon on the menu bar shortcut Ctrl I lt Step 1 gt Data Import Wizard Open File Data 30 Data Import Wizar File Name Select the file that contains the data you would like to import Import from File Xls Txt amp rI es I EGI technical Forum 2010 Sample data pl ode 4 Z5 z m d ae os 7 Ee Sm ss a7 MERR Latitude_Longitude_of_World Cities 2010 08 20 27i Microsoft Office E i z oaa cod Eeun 2010 08 23 2 Microsoft Office E EEE i Population_v2 2011 07 21 2 Microsoft Office E Es ol T First S Population1_A L 2 2 2010 09 10 9 Microsoft Office E irst 3 n EE E queries for demonstration 2010 09 11 9 SAE SH ol a ia Project 63 weather_data_all 2010 09 01 os Microsoft Office E a Proj W 00 Cloud Cor J 01 Grid Comp J 02_AMGA n 03_C aa m9 OIS N Population v Axis Z Cao B71 aa 2 x3 Data Import Wiz File Name Select the file that contains the data you would like to im port Import from File xls Txt G 02_AMGA EGI technical Forum 2010 Sample_data Popul
69. t Login Password Use ssl 150 183 8823 belle_replica 0 localhost 7733 0 kenobikis 8822 root 0 localhost 7744 root 0 lt Site Manager Add adds a new site 45 Modify change a preference values in specific options Delete delete the site Click Add button you can fill brief site information Fe si Add Site Name Grid4 HostName localhost Port 8822 In Add site dialog you may write down site name hostname and port number Name Grid2 Host Name localhost Port 7744 Login root Password Use Ssl Use Grid Proxy Authenticat Verify Sever Cert Cert File Key File Trusted Ceat Dir Requir l Cert Password If you want more information at the site Click Modify button in the Site Manager and fill other information above Modify dialog J SQL Editor 46 The SQL Editor is an effective tool to manipulate and manage AMGA metadata based on a Command Line Interface This provides several functions like a automatic composition of AMGA query Importing Collection Attribute names and Reusing previous AMGA queries via saved query files On the menu click Tools gt SQL Editor or press SQL Editor tab or select SQL Editor Ml icon on the menu bar H Collection E Schema Browser jag o8 0 B Attribute sg Ex fe Z YS wa DG O sa Fi completed All Columns 2 rm pop test E FILE E PROJ li r
70. t be quoted with double quotes WARNING Be careful with patterns which also match a subdirectory the result is undefined 66 Examples Query gt find cities like FILE H gt gt Hamburg Query gt find weather temp_hi 23 gt gt imgl jpg gt gt img2 jpg e updateattr pattern attribute value condition Updates attributes of entries matching a pattern in a single collection based on a condition The values to which the attributes are updated can contain attributes as variables Complex expressions are allowed as values The condition may reference attributes of other collections Updates are atomic Examples Query gt updateattr testdirl events eventst 1 events gt 100 Query gt updateattr testdirl events eventst 1 testdir2 key gt 0 The first example increases the number of events of every file in testdirl which has more than 100 events by one The second example increases the number of events of every file in testdirl provided there is an entry in the collection testdir2 which has the attribute key set to anything larger than 1 usefull to do locking by clients putting such an entry into testdir2 would lock testdir1 updateattr_single pattern attribute value condition Almost same as updateattr but this updates attributes of a random single entry matching a pattern in a single collection based on a condition This command is usef
71. t null test_constraints Attr1 const_not_null_nol constraint_add_unique directory attribute name Adds a UNIQUE constraint for the given attribute of the directory Name is the name used to refer to the name of the constraint It must be unique for that directory Write permissions on the directory are necessary for this operation NOTE On MySQL you can use attribute length to set the length of indexed columns Examples Query gt constraint_add_unique TEST_constraints Namel const_unique_nol constraint_add_ reference directoryattribute reffered_attr name Adds a foreisn kes econstraint for the siven attribute of the directory The foreian key is siven by the referenced attribute which must full qualify that attribute including the table parte c_ dir attry Name is the name used to refer to the name of the constraint ite must _be unique for that directory Write permissions on the directory are necessary for this operation Examples Query gt constraint_add_reference TEST constraints Attr2 REF_testl Attrl const_refer_nol constraint_add_check directory check name Adds a check constraint to the directory Check constraints are boolean expression which must be true for all entries inserted into the directory An example would be events gt O requiring the value assigned to the events attribute to be positive Name is the name used to
72. trl K amp Refresh F5 Property Go Data go to data browser Go Attribute go to Attribute browser Go ACL go to Attribute browser Go Constraint go to Constraint browser Go Index go to Index browser Collection Chapter 3 describes in detail Manage Federation make a federation in target directory 15 EE 4 Manage Federation Current Path fed test Browser 2 Site Name Host Name Port Login E amp Gria3 150 183 250 216 7722 amp Grid localhost 7733 root amp Grid2 localhost 7744 root It also behaves as an input interface when selecting a collection at the schema browser or at the SQL editor 3 Collection Make Collection make a collection with directory path Permission Collection change the permission and the owner of target collection with the current path fi N Current Path AMGA_2_0_spec Owner root permission Jr Mw x Change the current path by clicking Browser button And then change the owner and the permission in the above dialog 2 If you d like to know how to create a new collection with table refer to 4 How to create a new AMGA collection 16 Drop collection Delete the selected collection with metadata 4 Right click Pop up Menu in the case of focusing on the SQL Editor In case of the SQL Editor 7 Go Data Ctri 1 B Go Attribute Ctri
73. ttr tshuh cities FILE tshuh cities altitude tshuh cities latitude tshuh cities test tshuh cities new_remark Al attribute g E listattr tshuh weather EP altitude int amp latitude int amp test int new remark text selectattr selectattr attr condition Returns the values of given attributes for all files matching condition E Console G Progress _ SQL Result Authentication Tokens E E 78 Query gt selectattr population FILE population rank population country_territory population percent_of_world population population population date_of_estimate populz population FILE l po nk population ry_territory pop rid popul ation pop ate population source population new_remarks 2 1 China 2 China 19 52 1339020000 2009 ChineseOfficialPopulation E 21 India 2 India 17 26 1184259000 2010 IndianOfficialPopulationCl 3 Cid UnitedStates 3 UnitedStates 4 52 309897000 2010 UnitedStatesOficialPopul 4 Indonesia 4 Indonesia 3 41 234181400 2010 StatisticsIndonesia rs Brazil 5 Brazil 2 82 193321000 2010 BrazilianOfficialPopulation 6 Pakistan 6 Pakistan 2 48 170183500 2010 OfficialPakistaniPopulatio 7 Bangladesh 7 Bangladesh 24 164425000 2009 2008UNestimateforyear20 3 Nigeria 8 Nigeria 2 31 158259000 2010 2008UNestimateforyear20 raa Russia 9 Russia 2 07 141927297 2010 FederalStateStatisticsServi 40 Japan 10 Japan 186 127380000 2009 OfficiallapanStat
74. uery gt sequence_next cities id Query gt sequence_remove sequence Deletes a sequence Examples Query gt sequence_remove cities id Query gt 79 L Backing Up Data e dump sec_alllsec_none dir Recursively dumps the contents of a directory and all subdirectories so that they can be recreated by calling the sequence of AMGA commands printed out If no directory is specified it uses making a full catalogue dump The first option controls whether entry permissions and ACLs are included in the dump sec all includes them while sec none only dumps the metadata Only root is allowed to use this command Examples Query gt dump TEST user_dump Dumps the contents of a user database such that it can be recreated from the sequence of AMGA commands printed out Only root is allowed to use this command Examples Query gt user_dump gt gt user_create belle_replica_user gt gt user_create tshuh gt gt user_create choinody grp_dump Dumps out the information on all existing groups so that they can be recreated by calling the sequence of AMGA commands printed out Only root is allowed to use this command Examples 80 Query gt grp_dump gt gt grp_create root gui_client gt gt grp_adduser root gui client tshuh gt gt grp_create root root gt gt grp_create root belle_re
75. ul when AMGA is used as a placeholer for task retrieval Examples not Query gt updateattr_single task status running status Wwaiting gt gt task simulration 005 e update pattern attribute value condition Same as updateattr but the values are not evaluated prior to insertion into the table This command works with 67 bound variables which will also x problems with SQL command length limitations in Oracle Examples Query gt update cities altitude 33 latitude 44 like FILE Ottawa Query gt e selectattr attribute condition Selects attributes from several collections based on a condition doing an inner join on the collections based on a join condition The FILE attribute is used to select the entry name of an entry Example Examples Query gt selectattr jobdir FILE configdir id jobdir eventGen configdir id jobdir events gt 1000 and configdir key jobdir key Query gt selectattr weather FILE weather OWNER weather city weather temp_hi weather temp_lo weather taken like city a and isnull precip order city the results are selected FILE OWNER some attributes with like clause isnull and ranked in ascending order Query gt selectattr tlinum tl name t2 num t2 value tlinum 1 join_left_on t1 t2 tl num t2 num limit 1 Query gt selectattr tliname t2 value join_right_on

AMGA MANAGER User MANUAL

Contents

Download Pdf Manuals

Related Search

Related Contents