Home

Administrator Manual and Cookbook

1. Welcome Workflow Storage nane Required Settings Security Other Languages 0 Y information HTML Title Statistics E Other Languages 0 Y Publications Help Friendly URL End User http 192 168 152 34 8080 liferay web ques settings1 Security E Hidden Type Portlet E Permissions x Security Add Add Configure j Delete Update Role Discussion Page Applications Customize Delate Discussion Permissions Update Discussion View End User al P F E F m A Guest m i kittyrole E B al B A owner V 7 7 a F 2 V vj V Portal o E E B B o E Content Reviewer E A PowerUser 5 o v A Publisher B E m o d s E i al ial E a AL user D a F B o B B A writer A A A i a A Community i ni 2 E Content o B O Reviewer E Site Member a al al al al a al Save E 4 Figure 18 Unchecking the View permission of the Security menu in end user role in the Liferay based Security Permissions function 23 Administrator Manual and Cookbook Creating an end user account and signing by it to the portal _ gt Create Account _ Signin First Name Required Birthday Joruary sji 1970 om paren a a Thank
2. Implementation class in default case Addnew Edit Monitor settings Log entries i hu sztaki lpds submitter grids Grid_local Enable plugin Enabled Disabled Plugin implementation class Number of threads 1 Number of re submissions if the job failes 0 Check the SSH_KEY BASIC_AUTHENTICATION X_s09_GsI checkbox Supported proxy types X_s09_RFC SAML 7 BASIC_AUTHENTICATION This service running false WSDL of the other service Figure 34 Settings in DCI Bridge Middleware settings menu c Then you have two options for changing resource settings in the Cloud Edit menu see Fig 35 If you want to redirect your job submission to other DCI objects select Service and parameters tab If you want to execute your jobs in the cloud where EC2 based frontend is located select EC2 cloud frontend tab If you keep empty both options then the old settings will remain 41 Administrator Manual and Cookbook If you want to redirect the Add new resource e g job Preaunan to another http example com 8080 dci_bridge_service BESFactoryService DCI Bridge or another DCI wsdl object then add the exact URL of that DCI object web service Run the job to another service Service and parameters EC2 cloud frontend Available resources You can delete the current resource setting and you can add a new cloud service by setting three properties the URL of the Amazon EC2 service
3. INSTALLATION WIZARD MANUAL Administrator Manual and pepe Cookbook Guide to gUSE Components and Related Interfaces Administration ADMINISTRATOR MANUAL by Tibor Gottdank DCI BRIDGE ADMINISTRATOR Docs for Admin Series MANUAL REMOTE API a E ii A et Daie i HY CONFIGURATION pn ae SN oS T ig ing MANUAL Eee Oy T gt ae i ina j MTA SZTAKI Laboratory of Parallel and Distributed Systems Administrator Manual and Cookbook Copyright 2013 2014 MTA SZTAKI LPDS MTA SZTAKI LPDS accepts no responsibility for the actions of any user All users accept full responsibility for their usage of software products MTA SZTAKI LPDS makes no warranty as to its use or performance The gUSE WS PGRADE is an open source software MTA SZTAKI LPDS inspires and supports to take the whole gUSE WS PGRADE community into the developing work Administrator Manual and Cookbook Table of Contents AD OUE t is Mantal icsanceasnneenerncpeashanescunniuaenannnudicycabeinaianssuasevieaseaanausvamnsnesvacanpassiagesia aaar iia aeaiiai 4 How to Read this Manual sssssssssssessssssrsssssssseserrssserssrensrrnssnssttssstesstesstestttesettnsstessrensreesetsssretstts 4 Abbreviations sisieounsrissi esns ennaa aa an a iaai aaaeaii iaa k luisa centosienprnanounceen 4 l How to Start and Stop the System icces ccicicisacacesnsscasiadiveaslonatahictnavasbean iaenaiseustciaeeamannens 5 Using of Manual Step Seguente sieniin a
4. Note As the gUSE WS PGRADE system may be distributed on several server instead one more than one Tomcat servers may be involved Therefore in the description below the Tomcat controlling the DCI Bridge web application is distinguished from the Tomcat controlling the WFI web application The logs for every job are compressed in ZIP files The filename is a DCI Bridge based ID The ZIP see Fig A 6 may contain three standard job log files if the remote resource where the job runs delivers them gridnfo log stdout log stderr log The ZIP must contain the guse jsdl file which was submitted to DCI Bridge and the guse logg file which contains the events of the job Retrieving Information from Log Files If you want to know who has submitted a robot job to a VO do the following the general overview of information retrieval is shown on Fig A 4 the detailed explanations are shown on Fig A 5 A 7 1 Browse the guse logg files see Fig A 5 containing the matching job ID for example https grid150 kfki hu 9000 gBCGIImsmaE40XTtXfVFBw The user relevant information in the found guse logg are grouped in the info parts of the following items logg job clientip the IP of client which has submitted the job It is the IP of the WEI server in the case when the job has been sent by gUSE It is the expected normal case if the job is part of a workflow submitted from the portal or elaborated through the Remote AP
5. 0 00 Email Total USD 1 25 Password Password confirmation Salutation Mr First name Last name Phone enter in format country code phone number User role admin Index ill Figure 22 Create New User page 28 Administrator Manual and Cookbook Now you can register a cloud resource you have access to and add your own application software Resource Registration To use own cloud infrastructures for your applications e g workflow applications configured by gUSE you need to define the details of this infrastructure resources softwares on a cloud management system Then next section introduces the resource registration and software deployment process on CBP For Resource settings do the followings 1 Log in to CB Platform site https platform cloudbroker com use your valid authentication data that you got after registration process on CB Platform then click Resources New 2 In the next window fill the text fields set Resource type e g OpenNebula enter Specifier add Access key ID and Secret access key Fig 23 Note you get the latter three data not from CBP but from your cloud provider when you Resources Entries marked with are required Waipaoa vx Expert Options Resource type OpenNebula v Specifier S552013 Access key ID cloudbroker Secret access key LALALLLLILLILLLLLLILLLLLLLLLJ Save Figure 23 Resource setting in Resource
6. Boram om uss kraga ea raea Liferay v o Upload a WAR file to instali a layout template portlet or theme Pacage uwos C Users admin Deskto Browse A Users and Organizations Biogs a Site Settings smes Pacage Uren Aggregat Site Pages Csi reyes raat octal Specify an optional context for deployment Page Tempas amp Site Memberships WS PGRADE WAR ruse Grows Pacage unmosn as Recent Content Sree Bresocrumd Ti Pasewors Poncies Package Umos W Web Content eta Gi Porat seamos Calendar Pacage umos Documents and Media Figure A 1 Using of Plugin Installer function in Liferay Portal to upload the WS PGRADE WAR file Site Page Menu Point Selection to WS PGRADE in Liferay You can select WS PGRADE based site pages by a Liferay Portal function If you don t want to use one or more site pages in other words menu points or functions in your WS PGRADE portal you can simple take off that page from visible menu list in the Liferay WS PGRADE portal interface If you want to add that pages later to your other menus you can simple do it as well 58 Administrator Manual and Cookbook QOAdd Edit Controls 2 Page ar d l Page Layout i Page Customizations 2 Site Settings Site Pages we amp Site Memberships Site Content Storage Settings Lifer Manage Site Pages Liferay Public Pages Add Child Page j Permissions O Delete amp Export
7. Other Subdomain WS PGRADE 3 5 8 1 0 0 Application nce z Owner Dusan Vudragovic Engine WS Group AEGISCMPCSG Leader Dusan Vudragovic_ n re aR Status public iin Keywords h atus public Created 13 09 13 00 00 Modified 13 09 13 09 30 grap Description Workflow behind AEGIS CMPC SG Q SPEEDUP portlet It has three components Q SPEEDUP PREPARATION retrieves physical system configuration from the database This JSON output is then converted to the application specific configuration file and forwarded to the next process in the workflow This is not CPU intensive task and it Figure 41 Embedded SHIWA Repository 49 Administrator Manual and Cookbook IX Additional Settings in case of Not Trusted Certification with a SHIWA based Example If you add HTTPS type remote URLs e g within middleware settings in DCI Bridge or within input source definition in WS PGRADE instead of HTTP type URLs make sure of valid certification path e g by a browser If the certificate is not trusted e g your browser shows you an error message about that you need to add a trusted keystore by Java The next description explains the necessary steps as well as you find example how you can do it in case of SHIWA resource this specific parts will be in purple in the text The relevant parts of the console outputs are in dark blue Generic problem there are a configured Tomcat supported SSL and a deployed web service on a d
8. Perform this action for every software you want 8 Activate your Deployment and Software by the Actions Activate functions on the Deployments and Software pages Taaa eE St Expert Options Software Wrapper 1 0 v Resource OpenNebula MTA SZTAKI SS2013 Deployment type OpenNebula AMI amp Region OpenNebula MTA SZTAKI SS2013 SS2013 v Architecture x86_64 7 Operating system Other x x R1 z 9 Installation directory usr bin 9 Save Figure 29 A software deployment setting example in Software Deployment New Entry Options page Wrapper Deployment If you want to use own executables in this case you use the cloud in laas Infrastructure as a Service mode then you don t need to register softwares on CBP but you need to deploy a wrapper application The wrapper application is responsible for starting own executable e g execute bin that is related to the job 34 Administrator Manual and Cookbook You have to do the operations of section Software Deployment to your wrapper application e g Wrapper 9 1 0 guse_wrapper sh Note The job configuration specific part of wrapper settings the user need to click on the Enable own executable button in the Job Executable tab job during the job configuration in WS PGRADE portal to add wrapper to the corresponding job Resource registration http www pds sztaki hu summerschool2013 downloads 01 20 20CloudBroker 2
9. g wspgrade active Deletel Edit properties refre o 4 ttp 192 168 152 34 8080 wii http 192 168 152 34 8080 w1i whi ll users x active elete Edit properties refre Internal services EF 2 gt Components Services Component Types Copy Component Save settings Properties Edit base Component properies x ype of Component wh Joana IRL of Component http 192 168 152 34 8080 RL to intialize Component http 192 168 152 34 8080 Public URL of Component http 192 168 152 34 8080 State TP active P inactive save Figure 3 Component properties The most important obligatory parameters are Internal services Components Edit function lower window of Fig 3 Type of Component Service group Describes the kind of protocol by which components exchange messages At present there is just one installed protocol Its name is gUSE URL of Component Defines a hardware related access point through which internal clients of the Component s services clients belong to the gUSE infrastructure may access this service URL to initialize Component A distinguished URL to reset the Component Administrator Manual and Cookbook Public URL Defines a hardware related access point through which external remote clients of the Component s services may access this service State Boolean variable Inactive Active Warning there must be at least one Component to each base Co
10. no Workflow Editor required several creation and configuration interfaces are not needed in this case anymore The job will be executed on those resource what is prepared by the portal administrator so if mechanism of the robot certificates are utilized then the users do not have to take care about authentication neither The users are able to drop their applications and the inputs required then specify the names of the output files going to be generated by the application And that s all folks the job is going to be submitted to the resource In technical terms Single Job Wizard is based on ASM API provided by WS PGRADE gUSE system In its heart a prepared one job workflow is staying containing 4 inputs the application inputs compressed command line arguments output names descriptor file and 1 output all the required outputs compressed It executes a simple script that is responsible for the decompression of the inputs and executes the application Once the application is finished successfully it gets the certain output files specified by the user and compress them and it ends If the application fails the wrapper script inherits in exit code and returns Once the core system realizes that the wrapper is finished it downloads the output the compressed file and set the proper status for the application Single Job Wizard Setup For a successful setup and configuration you must follow the next steps 1 Deploy the web application Dep
11. 152 342080 manages htmt Ave t B Mos Visited Sees Apache Software Foundation http www apache org Tomcat Web Application Manager Application NYEY Fle CAE E a G Figure 12 The Apache Tomcat Web Application Manager page 17 Administrator Manual and Cookbook III Distinction the WS PGRADE Portal from Liferay Portal The WS PGRADE portal is implemented on top of the Liferay Portal framework Liferay Portal is a widely used free and open source enterprise portal framework Liferay is available bundled with a servlet container such as Apache Tomcat that is used as the servlet container to host gUSE services Liferay provides the authentication method it provides user id to access WS PGRADE Limited number of menus limited level of portal service The WS PORADE Portal Geveteped by Laborstory of Paralel aod Omtriutes Stems ot MTA STTAK Mangery im a web pertal of Be SSX Gre and ci ont Levene per evenen wt bed User CSNREN GAN T tere tt se ot Gatibvted applications executed on Me computational rescurces of various Sairbuted computing nirastruchres DOn cluding clusters service grids ARC glie Globus UNICORE BONC desitop grids and Googie Ape Engne cous Welcome to WS PGRADE Portal Aiemiahtnnd users and application developers cas access vie ordinary web browsers recommended Fretex Opera Chrome Appication Gevelopers can access to ai Be advanced werkfow features graph abat
12. Copy Portlets from Page rkfiow SEQ torag Name Required 90 and Fea Settings Settings S Other Languages 0 Layout format HTML Tite ni tatsi a Custom Figids i Advanced r Friendly URL Mobile Rule Groups hitp192 168 152 34 8080Niferayweb guest settings Z Hidden Save Cancel Type Link to Page x Link to Page Notification The result of modification in the user interface BEFORE Menubar with Settings menu Welcome Workflow Storage Settings information Statistics Publications Help End User Security Menubar without Settings menu Welcome Workflow Storage Information Statistics Publications Help End User Security Figure A 2 Hiding the Settings menu from menu bar To execute this Liferay based administration process you can use the Liferay menu bar on the top of your WS PGRADE portal window Select the Manage Site Pages menu The Manage Site Pages window will appear Select a wanted main menu or submenu from the left side Switch on the Hidden check box in the middle side of the window if you want to hide the menu and therefore the related functionality in the user interface Switch off the Hidden check box if you want to set back the visible state and therefore the related functionality of the menu Save the modified setting by Save button in the right side Fig A 2 demonstrates a sample menu hiding process for the Settings menu 59 Administrator Manual and Cookbook The Text Editor
13. Dynamic Data Lists Fa Portal amp Users and Organizations Figure 16 Adding a new user in the Liferay based User and Organizations function Registering the End User Role To enable the registration method do the followings Within the Liferay Control Panel go to the left tab select Portal Settings At the right tab select Authentication Under General tab you should see that anybody is allowed to create accounts Under the other tabs you can configure and enable other login methods e g Facebook you need to register a new application under Facebook for this see the Fig 17 21 Administrator Manual and Cookbook n 3 Portal Settings Portal Settings Settings is where most of the global portal settings are including names authentication default user associations and mail host names Authentication LIFERAY Ei asan LDAP CAS Facebook NTLM OpeniD Open SSO SiteMinder Liferay How do users authenticate Configuration By Email Address General 7 Allow users to automatically login Ee F 4 Portal Mail Host Names Email Notifications 7 Allow users to request forgotten passwords Allow users to request password reset links Users and Organizations 7 Allow strangers to create accounts Identification Sites ddresses Allow strangers to create accounts with a company email address p N 45 Ph mbers Site Templates e Humbers Require strangers to v
14. For embedding please follow the next steps 1 Create new page for SHIWA Repository in Liferay toolbar of your WS PGRADE portal click Add in the top menu then click Page submenu see Fig 38 Applications Web Content Display N Asset Publisher 4 Documents and Media Display Navigation More Figure 38 The Add Page menu in Liferay toolbar 2 Type a name for the menu e g SHIWA Repository Click the SHIWA Repository menu that is created 3 Click to the same Add button in the top menu then click to More List of the application groups will pop up in the left hand side 4 Open Sample group then click to add in the row of IFrame see Fig 39 A new portlet will be generated in the page 46 Administrator Manual and Cookbook QOAddY amp ManageY ZA Search applications searches as you type Collaboration Community E E E Content Management Finance News SZTAKI wspgrade Sample E Hello Velocity Add E Hello World Add 9 IFrame Add gg Web Proxy Add DEGO DDD Shopping Social Tools Undefined E Wiki D D O D G g Drag a portlet to place it on the page 4 Install More Applications Figure 39 Adding IFrame in Liferay toolbar 5 Click on the Please configure this portlet to make it visible to all users link and fill in the boxes as it is shown in the fig 40 Properties necessary to fill SourceURL the URL of SHIWA Repository Fiel
15. The system administrator may change displayed texts of WS PGRADE pages portlets on such places where the JSP responsible for the layout of a portlet containing certain keys The keys will be substituted by the associated text value The key value pairs are stored in the central database of the gUSE system and the key value record is maintained by the Text editor in Settings Text editor menu If there is no matching database item for a given key then the key string will be rendered by the JSP Notes New key value items can be defined by selecting the Add radio button filling the three input fields and confirming the operation by clicking the Submit Query button where the value entered for Key should match the key in the JSP the Descriptor value is a free text entered in order to help the user to find the given item and the unlabeled text area should contain the defined value text which will substitute the key during the rendering of the proper portlet An existing key value item can be found and its value eventually edited selecting the Find radio button and using associated check list button The items in this list are displayed such a way that the key in parentheses follows the descriptor However the items in the list are enumerated in the lexicographical order of the key part Text admin Find Dese Key 222 222 111 111 Key Add Desc The DCI Bridge is not available BirU sm 9 lJ Submit Query Figure A 3 The Text
16. WS PGRADE portlets configured for this portal is shown in the menu This is already the WS PGRADE environment 18 Administrator Manual and Cookbook where you can launch WS PGRADE activities lower view in Fig 13 The essential distinctions are see Fig 13 Liferay provides authentication service for WS PGRADE to make file access secure and only accessible to the entitled users Liferay provides the menu structure framework for WS PGRADE beside the utility Liferay menu bar that you can find on the top of WS PGRADE portal window see Fig 14 but the actual menu items come from WS PGRADE Liferay invokes the WS PGRADE portlets WS PGRADE provides the whole gUSE functionality at user interface side Thus Liferay gives the main technology framework of WS PGRADE Liferay encapsulates the WS PGRADE portlets the whole science gateway functionality and provides an emerging portal structure together with user authentication solution and menu structure Manager Toggle Edit Controls ZTAKI ARALLEL OF P TED S la Page it a Page Layout A a Test Test Sign Out ae Control Panel 7 Page Customizations gt Site Settings My Public Pages Pubic My Private Pages rvate l is Site Pages Orage amp Site Memberships Liferay Site Content SSe lt ooououuS eee ss Figure 14 The Liferay menu bar on the top of the WS PGRADE gUSE window and its availab
17. Y Set Figure 43 Single Job Wizard configuration 2 3 Finally set permissions in Permissions panel to hide the wrench from the users avoiding reconfiguration and to allow View option for them see figure 44 Single Job Wizard Configuration x Role Help View Add to Page Configuration Permissions End User Guest Portal Content Reviewer Power User E2 4 7 Publisher RobotPermissionOwner Lot est User L Writer Community Content Reviewer makker bh bb D2 be Site Member Figure 44 Single Job Wizard configuration 3 Note More details you find at ASM tab of gUSE SourceForge site https sourceforge net use asmsp wiki Single 20Job 20Wizard 56 Administrator Manual and Cookbook Additional Enhancements Some important and useful solutions are described briefly in this section Adding SHIWA Repository You can use the WS PGRADE for workflow export import to from the SHIWA Repository as of gUSE version 3 5 2 If you need to add a new target SHIWA Repository site into WS PGRADE do the followings 1 Singin to the portal 2 Navigate to Liferay Portal menu bar upper horizontal menu bar in the portal window then select Go to Control Panel Plugins Installation Install More Portlets Upload File and deploy the WAR file wspgrade war located in guse lt versionnumber gt tgz webapplication subdirectory see Fig A 1 The wspgrade war archive file contains among others
18. have to add two executables for SHIWA Submission Service URL and for SHIWA Workflow Repository instead of java InstallCert localhost 8443 An example java InstallCert submission cpc wmin ac uk java InstallCert shiwa repo cpc wmin ac uk You will get an output like this Loading KeyStore C Program Files Java jre6 lib security cacerts Opening connection to localhost 8443 Starting SSL handshake javax net ssl1 SSLHandshakeException sun security validator ValidatorException PKIX path building failed sun security provider certpath SunCertPathBuilderException unable to find valid certification path to requested target Server sent 1 certificate s 1 Subject CN yong mook kim OU mkyong O mkyong L puchong ST PJ C my Issuer CN yong mook kim OU mkyong O mkyong L puchong ST PJ C my shal 32 3e 15 42 96 ba e9 4d 9c 5d e7 5e 6b OF 30 23 b4 e3 4 98 md5 c8 dd al af 9f 55 a0 7f 6e 98 10 de 8c 63 1b a5 At this point you need to add 1 Enter certificate to add to trusted keystore or q to quit 1 1 Version V3 51 Administrator Manual and Cookbook Subject CN yong mook kim OU mkyong O mkyong L puchong ST PJ C my Signature Algorithm SHAlwithRSA OID 1 2 840 113549 1 1 5 Key Sun RSA public key 1024 bits Added certificate to keystore jssecacerts using alias localhost 1 3 Verify Trusted Keystore Try run the InstallCert command s again in case of SHIWA java InstallCert su
19. official access of Data Avenue WSDL applying the default value is recommended Inthe second field you need to add the portal administrator ticket You can get it by the next procedure Click on the Ticket request form link at the bottom right side see Fig 36 The Data Avenue Ticket Request Form will appear Fig 37 Fill the request form mandatory to fill First name Last name and E mail address as well as the CAPTCHA test field If you want to be on Data Avenue Users Map drag the marker if the estimated location is imprecise If you use Data Avenue in WS PGRADE portal then select the Portlet radio button instead of AP option However if you want to access Data Avenue from API instead of using gUSE WS PGRADE based portal then choose the option API Click on Submit 44 Administrator Manual and Cookbook https data avenue eu blacktop2 ws dataavenue wsdl m xample https data avenue eu blacktop2 ws dataavenue wsdl Data Avenue portal administrator ticket Set Data Avenue ticket can be requested by filling the form at page Ticket request form Figure 36 Setting the portal administrator ticket Data Avenue Ticket Request Form orange Central py Bathurst Coast Map Satellite Please fill out this form to get your ticket to be used in your A Gea Set portlet or API client om lt gt i _ _ we First name o gt r Last name E mail a
20. see Fig 10 Liferay ettings Internal services Internal services i a aE Components Services Component Copy Component Save settings Types Propertes List of defined Components RL of Component public URL of Component ype of Component cess rights State Liferay ttin kp pip n192 168 152 34 8080 wspgrade http 192 168 152 34 8080wspgrade portal pall users active inte sayi Pittp192_168 152 34 8080w4i http 192 168 152 34 8080 wi wi pil users 3 active 3 itip192 168 152 34 8080Ms htp 192 168 152 34 8080Mms wis fall users L active Components Ptip 192 168 152 34 8080 Antormation information pall users v active Pitip 192 168 152 34 8080 storage http 192 168 152 34 8080 storage storage pil users k active Pitip192 168 152 34 8080 repository rooson gt pill users b New active Create anew Component E quotamax Cancel SenicAgroperties alue Actio guse system database unl oe inost3306 guse eleteve cit guse system database user bm N eletele dit ootuser Delete JE cit louse system database driver om mysql jdbe Driver IN 7 quotamax 2000 DeleteVE dit Figure 10 Repository quota settings in WS PGRADE Val Setting of DCI Bridge Service Properties You can set the DCI Bridge service properties on the DCI Bridge administrator s interface in the Middleware settings function of the selected middleware see Fig 11 and Table 5 15 Administra
21. services To the proper configuration of a DCI Bridge plugin you can choose an installation location machine for DCI Bridge that corresponds to the target DCI infrastructure e g for gLite infrastructure you need an EMI UI machine If you can t deploy such a machine it remained two possibilities 1 2 You need to install the whole portal with the desired settings or You need to take into DCI Bridge configuration process an additional slave DCI Bridge machine where the given plugin is permitted Therefore in the legacy master machine you have to set DCI Bridge plugin for sending workflow jobs to slave DCI Bridge machine About installation of gUSE WS PGRADE see Installation Wizard Manual 61 Administrator Manual and Cookbook Robot Permission Related Logging of Job Submissions About Robot Permission and Related Logs The aim in robot permission is to perform automated tasks on grids clouds on behalf of users Basically this permission form can be used to identify a person responsible for an unattended service or process acting as client and or server Instead of identifying users the robot permission identifies trusted applications that can run by workflows from WS PGRADE WS PGRADE supports robot permission for every resource type that is accessible from portal certainly the ocal grid type is not require such a permission The user who has robot permission is the so called robot permission owner The robot p
22. the job configuration in WS PGRADE portal Let s see the steps 1 Go to Software New 2 Define the Product and Version details within Entry Options Fig 27 3 Click Save 32 Administrator Manual and Cookbook Software amp Entries marked with are required Entry Options Expert Options Product Version Figure 27 Software setting in Storages New Entry Options page 1 To executable definition go to Software Executables New 2 Set Software and Binary within Entry Options e g In case of a PS Parameter Sweep workflow called Autodock you can deploy the following softwares with binaries Software Binary AutoDock 9 1 0 ad_generator sh AutoDock 9 1 0 ad_worker sh AutoDock 9 1 0 ad_collector sh For every binaries you need to perform this operation 3 Click Save Executables Entries marked with are required Hansa Expert Options Software AutoDock 9 1 0 B Binary Q9 Argument string template 9 Default argument string Q Figure 28 Executable setting in Executables New Entry Options page 33 Administrator Manual and Cookbook 4 Activate the software under Software Actions Deploy 5 Go to Software Deployments New and set software deployment details set Architecture Operating system Installation directory within Entry Options see example on Fig 29 6 Go to Expert Options and set Image ID you got it from your cloud provider and username 7 Click Save
23. the shiwaRepos xml where you can set and add SHIWA repositories The next extract of shiwaRepos xml shows the syntax of Repos element in which you can directly specify SHIWA repositories lt Repos gt lt Repo name REPOSITORY1_NAME uri _REPOSITORY1_URL_ PORT_ _REPOSITORY1_SERVLET_ gt lt Repo name REPOSITORY2_NAME uri _REPOSITORY2_URL_ PORT_ _REPOSITORY2_SERVLET_ gt lt Repos gt If you have got valid credentials to this repository you can export or import workflows to or from the SHIWA Repository The details of SHIWA specific import and export in WS PGRADE are described in chapter 7 and 11 of Menu Oriented Online Help within Portal User Manual 57 Administrator Manual and Cookbook A Test Test Plugins Installation EZA Test Test Sian Out Lony acort i E Control Panel Tm Pages Eue y 2 My Public Pages Public ism Snowing 1 20 of 121 resus i Private Meras My Private Pages By St veroennos About Life ra Ql Recert Consert Ae wapgrace np grace y WP wed Comert PllDocuments anc mesis Pasage Unincen 3 Booemarss Aamin imjc encar are lE Message Boaros en imangs Ww Paaage Uren ESj Pons Announcements Osoa casing emim Assertion o iia on A Test Test Plugin Installe gt en Asset Puosener monte Device Rutes Prage uroen Sa My Account Browse Repository SEIGE CIJEI Download Fie Configuration soom ame Authentication for ClousBroner T My Pages
24. when the jobs are delivered to the resource The key string in the ApplicationName element refers to the client machine address Application The user ID identifies the user who sent the job Figure A 6 Robot job related information retrieval from guse jsdl This key string must be browsed in the daily LOG files of the WS PGRADE machine subdirectory tomcat temp submittedwflog see Fig A 7 which contains a single line entry for each workflows submitted by the gUSE The matching line contains the requested IP address of the end user have initiated the workflow and the associated job submission Ei quse apache tomcat 6 0 36 temp submittedwf 1 ocfEEREEEEEEEEEEEEer Log files in the tomcat temp submittedwflog directory about the submitted workflow instances organized by date The IP address of the online WS The key string about a workflow instance that refers to the Application element from the corresponding guse jsdi file see Fig 25 Figure A 7 Robot job related information retrieval from log file PGRADE portal from where the job was sent 65 Administrator Manual and Cookbook Other items of the matched guse logg file may be of interest see Fig A 5 logg job getproxy Hint of the authorization of the job the DN or username of the authentication file proxy logg job downloadinput Name and size of the input file s Adding and Removing User Roles The administration of user roles of gUSE
25. you for creating an account Middle Name Email Address Last Mame zotan farkas gmai com Forkas Password e Sign In Screen Mame Required 1241 verification Required zforkes 1485 Email Address Required Zoltan farkas gnal com ave The portal menu bar for End User the Security menu is set to invisible Welcome Storage Settings Information Statistics Publications Help End User d Configure Import The portal menu bar for Power User Welcome Workflow Storage Settings Security Statistics Registration Help Information Figure 19 Checking the result of the end user role setup 24 Administrator Manual and Cookbook V Settings on CloudBroker Platform In order to use gUSE WS PGRADE for job submission to a cloud resource managed by CloudBroker Platform CBP you need to do some preliminary registration and setting operations Roles Basically there are two types of users in CB environment administrators and standard users Administrators typically represent organizations and have the potential to create new users manage or delete belonging to the same organization whereas standard users as well as administrators can query repository and execute softwares made public Administrators can deploy new software that is in private status initially Private status means only administrators can see them at listing the repository and only administrators can run respectively Once the soft
26. 0Resource 20Configuration ppt Software deployment http www pds sztaki hu summerschool2013 downloads 02 20 20CloudBroker 20Software 20Configuration 20and 20Execution ppt Additional information Resource registration https platform cloudbroker com documents CloudBrokerPlatform ResourceRegistrationGuide 1 2 pdf Software deployment https platform cloudbroker com documents CloudBrokerPlatform SoftwareDeploymentGuide 1 2 pdf Resource registration https www pds sztaki hu services sw download php gt download 5384800b18ddc7ecafe9943e2bc13d55 Software deployment https www lpds sztaki hu services sw download php download 101c0799689ade585a8c4ca87253cfOd Wrapper execution https www lpds sztaki hu services sw download php download 1bf395604315dc4ae8a9a04b26cf89cc 35 Administrator Manual and Cookbook VI Settings to EC2 based Direct Cloud Access The direct cloud access solution in contrast to the CloudBroker based solution doesn t use any third party brokering for job submission to cloud Any clouds that implements the Amazon EC2 interface will be accessible by this development The direct cloud access is based on the capability of DCI Bridge distribution the capability of job forwarding from a Master to a Slave DCI Bridge About DCI Bridge distribution you can find details in chapter Introduction within the DCI Bridge Manual In the current process the Master DCI Bridge c
27. Administrative Tasks for Job Submission to SZTAKI Desktop Grid ccccssececesseeeeeseseeeeeeeeaes 73 Administrator Manual and Cookbook About this Manual The Administrator Manual covers a significant part of the gUSE WS PGRADE system administration information The Administrator Manual fits in the set of gUSE WS PGRADE administrator s documentations Therefore this guide contains the most relevant and useful information about gUSE WS PGRADE administration and those descriptions that are not included the other published administration documentations related to gUSE WS PGRADE Finally about a special text form the document uses light purple color for notifications and light orange for pitfalls and warnings How to Read this Manual The major goal of this Manual is to provide a detailed and useful administrator guide about all the main important components and interfaces of gUSE WS PGRADE system This Manual is permanently further developed and improved so if you miss any important information let us know at the SourceForge Discussion http sourceforge net p guse discussion source navbar and we will extend the next version of the Manual with the requested information We believe that this community oriented editing of the Manual is the most efficient way of producing a comprehensive and user friendly documentation The Liferay Portal which is the fundamental portal technology of WS PGRADE administration is out of the
28. E EEE 5 USINE Of SCIPS iieri ioirii iiia a EER A A EEREN ETE EA TE 6 ll The CSE Mal ServicES sieciami aaiae a aaa iaaeaie Satanai Taenia 7 Setting Of Service Sesuci i a aeaa EE EAT AT EEEE EREE AANEREN 11 Setting of Service Properties wg odcceseiccsasenecnewstvaccdeitueadventeicene ta texecevipacese linGadidateiadaaadecanmiianceats 12 Quota Setting fiiceciseetetie Geddectadeeccseatetecssassdedesdeedacetasavadanadelecseastbabasavedacecaledacaeasedacesasetadepiveusesens 13 Setting of DCI Bridge Service Properties cccccesssececsssseececssnsececsssneeceeseeaeceeseaeeeeseseneeeeeseaes 15 Ill Distinction the WS PGRADE Portal from Liferay Portal cccssscccessssteceesssteeecesseeeeeseeeaes 18 Pie Setup the End User RO euina a a a a a 20 Setting f End User Role stsiiseri seisan ai aaee AE EANES REENER A AKENE 20 Registering the End User ROG 0terssupeiescasaticecatiusdrendeldaecansddedecsadndacdantedaardabidesuatedeisaaetadeasahindiaass 21 Menu Visibility Modification wisccasnciiceiadventertounnceiasansesadaniend huiseuar ciumestbonndsauestdaiuuedaddevaddteenereuneteatean 22 V Settings on CloudBroker Platform sccssscanciatscieetavsanstiacclisstacesnaeedicdeseetiacariadialeseascdoanaastacaanceusd 25 RLO E E be Wes E A A E A E E 25 RCSISt ALON vaisivinc dali A O TAREE E EEE tiers i 25 New User ChEATION sursis it iesin ierta ai oaea nS Ea Aaa aa n SeS Eas aAa EE AE PARNA E a AATE 27 Resource REZIStEATION 4 see sicinies iieinid a EEE E
29. ER EEEE EIEE EER SEE 29 Software Deployment ses scctisccevesnveedacusvewcness geademnsvncuee dbvceden EAE aE PEAREN AAEE AA ENAKA KERNERNE 32 Wrapper Deployment c2etaeitacesduxessonseveenesetncsnedoesedungeyacdanedelonensadiediniguddnens ldangenguleacsavidacdoutiacens 34 VI Settings to EC2 based Direct Cloud ACCESS ccssccecessscecessseeececssaaececseseeeececsenaeeecseaaeeeenseaneess 36 Prerequisite Base Image Creation and Saving cssccccesssececessseececseaeeecssseneeeeesenaeeesseaaeeeenss 38 The detailed description of Administrator specific TaSkS ccccsccccecsssseeecssseeeeceesseeeeeeseaeeeeess 39 Task 1 Image Downloading and Saving in the Target ClOUC S cccscecesseecsseeessseessteeeeees 39 Task 2 Master DCI Bridge Configuration cccccccsssscececssnsececsssnececseseneececsenaeceessaeeeeeseneees 40 Administrator Manual and Cookbook VIL Ticket Request to Use Data AVemU eis sicccisscecncvecseesiciveensesvecnasexvedes uevacees sluene van iit riiseni 44 VIII Embedding SHIWA Repository into WS PGRADE ccccssssececssstececseseeeeceesenaeeesessaeeeenseaeeees 46 IX Additional Settings in case of Not Trusted Certification with a SHIWA based Example 50 X Administration of Single Job Wizard sis sccsccsiceesassacesscaccdaveracdanseaanedeseasanaavsacsacadsescdeazeaaesdearaanaceans 54 Single JOD Wizard SOM azinrnnsnoriier e E aae 54 OUT UN AUN I aegis Setter EEE E AEE E EEEE T A 55 A
30. I call interface However it may be the IP a foreign host which is able to communicate with the DCI Bridge directly 63 Administrator Manual and Cookbook The IP from where the job was sent The job ID in this case an URL cames from the middleware iten S EE ose The DN or username of the authentication file proxy Name and size of the input files nane tomcat temp dci_bridge robotcertlog Figure A 5 Some relevant information about a job in the guse logg 2 The real sender of the job can be concluded the following way The sibling job guse jsdl contains all information about the job the tag JobDefinition JobDescription Application ns2 username contains the Liferay based ID of the end user The IP of the client machine of end user can be identified by the help of the tag JobDefinition JobDescription Application ApplicationName the value of this tag contains a key string containing integer numbers postfixed by the string zentest An example see Fig A 6 value 345491687570196zentest 0 cell 3 gt key string 345491687570196zentest 64 Administrator Manual and Cookbook H apache tomcat 6 0 36 temp dci bridge robotcertlog 2013 04 18 0 ba376da7 ddc5 4289 96a4 16c5a487af26 zipfuzipgev Name Size MTime Files in the tomcat temp dci_bridge robotcertlog robotcertlog directory from the date 2013 04 18 the first two files are always in this directory the other three will be appeared
31. Sending the job descriptive JSDL file Resource pooling e r _ No Master DCI Bridge queries the number of jobs that transmitted to Slave DCI Bridge If this received numberis equal or more than 0 then then Slave DCI Bridge can be used Job is submitted through Master DCI Bridge to Slave DCI Bridge Figure 31 The communication between Master and Slave DCI Bridge within direct cloud access The direct cloud access process contains the next tasks and relates the next roles see fig 30 e Task 1 The DCI Bridge Administrator downloads a public base image containing a properly configured DCI Bridge this will be the slave DCI Bridge from a corresponding Repository This image will be saved in the target cloud environment The used cloud service provided by the Cloud Provider must contain Amazon EC2 Frontend Task 2 The DCI Bridge Administrator properly configures the Master DCI Bridge which is connected to the gUSE e Task 3 The User gets an account from Cloud Provider to a cloud where the image was imported from the Repository the Cloud Provider can provide information about the exact way to get cloud account From this point the User can use the WS PGRADE portal for job submission to cloud 37 Administrator Manual and Cookbook Prerequisite Base Image Creation and Saving Performed by gUSE Developers A ready for use public base image is created by the gUSE Developer Team It contains the following softw
32. WS PGRADE is at Liferay portal administration level About the end user role administration see chapter IV There are three general user roles in gUSE certainly it is possible to define other user roles by set various permissions but these three main roles can capture the essential user roles in WS PGRADE End user role fixed name for role setting End User The end user needs only a restricted manipulation possibility He she wants to get the application off the shelf to trim it and submit it with minimal effort Workflow developer user or full power user role fixed name Power User This user builds and tailors the application to be as comfortable as possible for the end user Robot permission owner role fixed name RobotPermissionOwner The robot permission owner is a special trusted user for creation the so called robot permission association for a trusted application 66 Administrator Manual and Cookbook o o 1621 Test Test Sian Out I Control Panel My Public Pages F Portal o My Private Pages 2 4 Pol Liferay amp Users and Organizations amp Sites Site Templates Page Templates ZR User Groups Users and Organizations Users are individuals who perform tasks using the portal Administrators can create new users or deactivate existing users Users can join sites be placed into organization hierarchies be delegated permissions in roles or be collecte
33. are components Java6 Apache Tomcat DCI Bridge configured to Cloud resource by the DCI Bridge Administrator this will be the slave DCI Bridge The base image is available from SourceForge http sourceforge net projects guse files DCIBridge local cloud img gz download and you also find it in OpenNebula Marketplace http marketplace c12g com appliance as DCI Bridge Direct Cloud Slave Appliance http marketplace cl2g com appliance 52e23e928fb81d46d4000001 root password for the image temp123 After downloading the following permissions must be granted Owner Group Others for Use and Owner for Manage see Fig 32 Another mandatory parameter setting is to add the value iscsi to parameter Datastore This setting is not visible on the Fig 43 38 Administrator Manual and Cookbook ghermann sztaki hu LPDS users DCI Bridge Direct Cloud iscsi Os Slave Appliance izabel The base image parameters and related permissions that must be Information granted image DCI Bridge Direct Cloud Slave Appliance Permissions Use Manage Admin ID 925 Owner Name DCI Bridge Direct Cloud Slave Appliance g Group 4 Datastore iscsi izabel Other v Type os z Register time 14 49 22 01 24 2014 Configuration amp Tags Persistent no g Add Filesystem type DEV_PREFIX hd g7 amp Size 2 1GB MD5 becfdd2790acde35e179fe54019 amp State USED acaco Runni
34. bmission cpc wmin ac uk and java InstallCert repo test cpc wmin ac uk The connection should be OK now java InstallCert localhost 8443 Thus in case of SHIWA use the already mentioned two commands instead of java InstallCert localhost 8443 An example java InstallCert submission cpc wmin ac uk java InstallCert repo test cpc wmin ac uk Output Loading KeyStore jssecacerts Opening connection to localhost 8443 Starting SSL handshake No errors certificate is already trusted Server sent 1 certificate s 1 Subject CN yong mook kim OU mkyong O mkyong L puchong ST PJ C my Issuer CN yong mook kim OU mkyong O mkyong L puchong ST PJ C my shal 32 3e 15 42 96 ba e9 4d 9c 5d e7 5e 6b OF 30 23 b4 e3 4 98 md5 c8 dd al af 9f 55 a0 7f 6e 98 10 de 8c 63 1b a5 52 Administrator Manual and Cookbook At this point you can quit by q Enter certificate to add to trusted keystore or q to quit 1 q KeyStore not changed 4 Copy jssecacerts Copy the generated jssecacerts file to your SJAVA_HOME jre lib security folder 5 Restart Tomcat 53 Administrator Manual and Cookbook X Administration of Single Job Wizard Single Job Wizard simplifies workflow creation and execution in the simplest case if the workflow contains one job only What looks a huge disadvantage in aspect of the possibilities of workflow development provides more advantages to create and execute these kinds of workflows
35. d Name sspUserld with the value user_id Hidden variable sspServiceld XXXXX where XXXXX is the password that you have got from the administrator of the SHIWA Repository 47 Administrator Manual and Cookbook IFrame Configuration x Setup Permissions Sharing H Atchive Restore Setu General Source URL http shiwa repo cpc wmin ac uk shiwa repo ssplogin J Relative to Context Path Authentication Authenticate You may use the tokens email_address screen_name and user_id for the user name field and password for the password field These will be replaced at runtime with the current user s information Authentication Type Form Form Method Posi User Name Field Name Value sspUserld use _id Password Field Name Value Hidden Variables sspServiceld XXXXXXXxX Advanced HTML Attributes a Figure 40 Configuring IFrame 6 Click Save button From this point you can access by the SHIWA Repository menu the SHIWA Workflow Repository site and the workflows are searchable in the Find Workflows field as shown in fig 41 48 Administrator Manual and Cookbook Information Statistics Publications Help End User DATAAVENUE Security SHIWA Repository About Workflows Implementations Documentation Log in Find Workflows Moomans v 1 of 27 Workflow AEGIS CMPC_SG SPEEDUP_Workflow P Details Workflow Summary Implementation Preview 1 Domain
36. d into user groups User groups can cross organizational boundaries and can be used to assign all members to other collections such as sites or roles User groups may also be used to customize personal site templates for members Vewal B Search v Users Search All Users Deactivate First Name LastName a Screen Name Job Title Organizations User Groups Sabor Hermann gabo lt 4 Actions Test Test test lt P Actions Test2 TestL2 test2 lt 4 j Actions Showing 3 results Figure A 8 Adding a user role to a user I If you want to add or remove a role as administrator for a user follow the next steps see fig A 8 A 10 1 Choose the Go to Contro Panel menu on the Liferay portal administration interface on the top of a portal window 2 Click on Users and Organizations menu on the left side In the appearing window choose a user by clicking on her his name then choose the Roles menu within the User Information menu group in the right side of the next window 3 Choose the Select link in the end of Regular Roles list Choose a corresponding predefined user role from the appearing list 5 For removing a role use the Remove function at the selected user role row of the Regular Roles list fig A 10 6 Save the changes by clicking on the Save button on the upper right side 67 Administrator Manual and Cookbook inj Control Pane Portal Users and Organizations Users and Organizations Users are individuals who
37. dditional Enhancements lt cvcciseaccsvccuresdsnsonesioententednusatuicencddnsataniaasdenassndatiusaaaecandsacteanseadtenederdutiunseetins 57 Adding SHIWA Repository siczsios Seaccsiiaaidteieageodancaensdasastabcaniucaaianeayeadancuyasdeonesaraniunacasmoasateneaaan mente 57 Site Page Menu Point Selection to WS PGRADE in Liferay ccsscccsssecssreecsseeecsteeeesteeeesaees 58 THE TEX EGLO sty cs veinseictetie docx dnn cater anaunsevanacsuezadinlowadtaradzadonnd e e a aane iaae tielet d ta 60 Setting System to Local Submitter we ccdenssscccccuneonctenndsenionndiadsenndeedlcanisdelenedeniteanbiadlerecendiduneiawsesuers 61 Robot Permission Related Logging of Job Submissions cccessseceesssteeecesseeeeceseeeeeeeseeaeeeeees 62 About Robot Permission and Related Logs cccsssscecesssececeessneeeecseseeeeceeseeeeceessaaeeeeesseneees 62 Retrieving Information from Log FileS ccccesssececesssecececssneeecesseeeeceesseeecesseueeessssueeeeeeseaes 63 Adding and Removing User Roles sccsesevecdiniccacstosnsetccnsadeandesasetnvesadunstdcvienacbestussedancladenmaontedeuias 66 Supported Protocols for Using of Remote Executable and INput ccesssceesssseeeessseeeeeeeenes 69 New Parameter Definition to a Middlheware ecccsesesesesecesssecesssneeseseeeessneessaeeeesaeeneseeeseaeeees 70 Logging With log cic a sacicoahsqdisieusatt avenaudedcangieseebagdeancesaildscead edeacaidandadigusddooteidesnadededbegateceacahindedeas 72
38. ddress Ticket type Portlet API T Goulburn i Yass jim is YE Organization ASS iy i An t i Planned usage poacher a f f eQueanbeyan Y ASO E Please add your location here if you want to be on Data i We as Avenue Users Map drag the marker if the estimated location i NEC ba is imprecise f i a Latitude 5 R Cooma Longitude yne Sar eta aise ee Ta tak Ree ree ee Click to change ka EN Ors ZA Map data 2014 GBRMPA Google Terms of Use Submit Figure 37 The ticket request form 4 A short time after you will get an automatically generated email about receiving your ticket request Your request will be processed in maximum two three days and you will get your ticket by email Once you received your ticket type it into the Data Avenue portal administrator ticket field see Fig 36 Note The validity period of a ticket is one year The validity can be extended after expiration of ticket you need to send a new ticket request 5 Click on Set The message Data has been saved will appear Click on Ok 6 From this point Data Avenue is available for every user who uses this portal 45 Administrator Manual and Cookbook VIII Embedding SHIWA Repository into WS PGRADE The goal of this Liferay based configuration is to browse and select submittable workflows in WS PGRADE terminology Submittable Execution Nodes SENs located in the SHIWA Workflow Repository from WS PGRADE
39. dresses Phone Numbers User Groups Additional Email Addresses Websites Miscellaneous Display Settings Google Apps D gt Save Cancel Figure 15 End user role setting in the Liferay based Portal Settings function The power user builds and configures the workflow applications either for own use or for the end users The end user has restricted manipulation rights in WS PGRADE for example no access to the workflow definition functions 20 Administrator Manual and Cookbook This way new users will receive only the end user role You can test your settings by adding a new user select Users and Organizations at the left panel after click Add User and fill in the form see Fig 16 Ai Test Test keene Users and Organizations My Pages Viewa O v Be ei IG Regular Org nization W Site Settings v Users Sod i Location IFlSite Pages Deactivate amp Site Memberships Recent conent Users and Organizations a Web Content amp Orv A FijDocuments and Media New User IE Bookmarks Detail FA Calendar Title Birthday 2 Message Boards iene a rons On ions m z z z z Pers te Screen Name Required Gender Somebody Mae e Save Cancel Email Address Required Job Title First Name Required i Blogs Gi wiki HB Polls Software Catalog l Tags Middle Name Categories Last Name Mobile Device Rules Social Activity r E
40. dynamically observe and tune the cooperation of internal components composing the gUSE infrastructure In order to configuring gUSE services you can use as administrator the Settings Internal services menu in WS PGRADE Existing service properties can be set or modified new services can be added connections between components can be defined properties can be imported between existing components and the whole system configuration can be downloaded Texts on the UI are jstl fmt based with multilingual support Internal services n o F 2 2 Components Services Component Types Copy Component Save settings Properties Figure 2 The five main tabs in Internal services page head The following terms have been introduced in Internal services function in WS PGRADE see the main functions as tabs on Fig 2 Administrator Manual and Cookbook Components Web applications of the gUSE system Components may have many parameters which fall in two categories 1 Obligatory or generic parameters 2 Individual Component Type dependent parameters in form of key value pairs Internal services fF 2 2 Components Services Component Types Copy Component Save settings Properties New List of defined Components IRL of Component public URL of Component ype of Component ss rights State tions i k 4 ttp 192 168 152 34 8080 wspgrade http 192 168 152 34 8080 a Buss rx
41. e ml small Save Figure 25 Instance type setting example in nstance types New Entry Options page 9 For storage configuration click Storages New 10 In the Entry Options and Expert Options tabs configure your storage then click Save 11 Activate the Storage and the Instance Type by the Actions Activate function 12 For region configuration click Regions New 13 In the Entry Options tab set the Human readable name select the Resource as defined earlier set URL select a Storage as defined earlier Fig 26 14 In the Expert Options set Maximum nodes 15 Click Save 16 Finally activate the Resource by Actions Activate At this point you have a new resource Next step set up new software application 31 Administrator Manual and Cookbook Taa eIE t Expert Options Human readable name S2013 Resource OpenNebula MTA SZTAKI SS2013 ar URL enter in format http s www example com http cfe2 lpds sztaki hu 4567 API name Storage Rados S3 MTA SZTAKI SS2013 z Save Figure 26 Storage setting in Storages New Entry Options page Software Deployment After resource configuration deploy your softwares You need to deploy softwares if you don t want to use own executable In this case you use the cloud in the SaaS Software as a Service mode Note The job configuration specific part of software settings the user need to select the corresponding software in the Job Executable tab job during
42. e chapter 2 9 in the DCI Bridge Manual This will make sure that 3G Bridge is aware of what applications you have deployed on BOINC gUSE WS PGRADE will be able to contact the 3G Bridge to query the list of usable applications users of WS PGRADE will be able to select from this set of applications during their workflows configuration Additional information 73
43. e g http cfe2 Ipds sztaki hu 4567 the inner ID of image e g ami 001061 and the enabled number of VM fora user e g 1 Figure 35 Settings in DCI Bridge Edit menu Additional notes and warnings about the current state of EC2 Direct Cloud Access Networking There are some advantages and disadvantages of the current solution of direct cloud from the network point of view 42 Administrator Manual and Cookbook Advantage There is not needed contextualization for this solution Disadvantage It can t use private IP addresses it is not optimal for networking The main reason of disadvantage is that the portal calls the virtual machine VM by an IP address that comes from the cloud service The VM doesn t call back to the portal The master DCI Bridges are on public network typically while the slave DCI Bridges are on private network clouds Currently the access of private cloud from public network is not possible Solved and not yet solved communications private portal gt private cloud solved private portal gt public cloud solved public portal gt private cloud not yet solved public portal gt public cloud solved Hypervisor The current direct cloud solution can be used in clouds that implement the EC2 protocol and contain KVM hypervisor The direct cloud access is operable for every OpenNebula based and OpenStack based clouds that fit to the requirements above However the current i
44. ed and you can directly continue with the registration confirmation If a page with CBP price conditions is displayed and you agree to the conditions click on the agree button to proceed to the final step of your registration 26 Administrator Manual and Cookbook The final step of the registration process is the registration confirmation Shortly after that you will receive an email notification that your registration request is being reviewed Once your registration request has been approved you will receive a confirmation email Follow the link in the email to activate your CBP account When you click on the activation link you are directly logged into the platform for the first time Now that your account is activated you can log into the platform using your user credentials i e email address and password specified earlier After the registration process you will get account to CBP from CloudBroker GmbH and then you can add users to the registered organization Let s see the user creation method New User Creation After you login to the CBP https platform cloudbroker com you can add users to your organization For new user adding you do not need to go through the registration process again You can easily add a new user through the CBP user interface Simply navigate to the Users tab or click on the Users link under the My Organization section of the dashboard Once the Users List page is opened click on the New but
45. editor function in WS PGRADE 60 Administrator Manual and Cookbook Setting System to Local Submitter For test purposes you can set DCI as the local resource in the following way 1 Go to Information Resources tab in WS PGRADE and click on the head icon on the right side The Tomcat user and password of the back end host will be requested default is admin admin and DCI Bridge becomes manageable Select the Local tab and in the Middleware settings submenu set the Enable plugin to enable and confirm it by the Floppy disk icon To realize the middleware changes in settings sign out from WS PGRADE portal then sign in again Therefore the portal cache will be updated After a successful testing you can change your configuration settings aka the setting of another DCI Bridge plugin to target infrastructure by using of Edit and Middleware settings functions of a corresponding middleware in DCI Bridge configuration interface Note there are two important prerequisites to access resources in case of some middlewares corresponding preinstalled program e g deployed UIF machine at gLite and the setting of resource access information in DCI Bridge Notes to the proper configuration changes you need to know the following general considerations You can increase or change the set of supported DCl s after portal installation by allowing various DCI Bridge plugins or by installing additional DCI Bridge
46. er quota User Name Screen Name User ID Quota zome Workflow End User Storage Settings Settings Quota management Quota setting for a portal user in MB ota nt pakkaa 10000 MB is the default value Bet quota for portal users 10000 lessage Quota for users successfully set User Name Screen NameUser DQuota 10205 10205 10000 MB Quota sharing per portal user Gabor Hermanngabor 13801 10000 MB Gabor Herman hermi 13821 10000 MB kk k 10801 10000 MB KK KK kkk 11316 10000 MB Test Test test 10239 10000 MB Test2 TestL2 test2 13701 10000 MB Summa 70000 MB Save Figure 9 User quota settings in WS PGRADE The second quota type is the repository quota that is related to export function in WS PGRADE The repository quota limits the overall size of exported workflows in a local portal repository Setting Default value Description Quota for portal users in MB 10000 Quota size belonging to a portal user for workflow submission limitation Quota for local repository in Quota size belonging to a portal local repository MB for workflow export limitation Table 5 Properties for user and repository quota 14 Administrator Manual and Cookbook The administrator can set the repository quota in the mentioned common place in WS PGRADE in the Settings Internal services window In this case you need to select the repository as Type of Component then you can set the quotamax value through the Edit function
47. erify their email address Additiona Email Addresses Page Templates Websites ZA User Groups Roles en Password Policies Google Apps Save Cancel J Portal Settings E Custom Fields 2 Monitoring lt a Plugins Configuration T Mobile Device Rules Figure 17 Authentication mode settings for end users in the Liferay based Portal Settings Authentication function Menu Visibility Modification If you don t need in end user view a menu in Liferay terminology a site page or in programming terminology a portlet in the default menu bar follow the next steps Let s say we don t need Security from menu bar Log in as portal administrator At the top select Manage Site Pages In the left part click Security In the top middle click on Permissions For the End User role uncheck the View permission Click Save see Fig 18 OP NP For checking the setting result log in as end user to portal and check the appearing menu structure for end user the Security menu will invisible as you set before and the whole provided functions will reduced for end user neeeds see Fig 19 aa The end user setup process is in video http www youtube com watch v rz3KLtO0eds 22 Administrator Manual and Cookbook 2 om E occ connoi 3 Page 7 lie Page Layout e Page Customizations Site Settings Liferay Public Pages 4 Public Pages
48. ermission owner has rights to add robot permission association to jobs about using robot permission in WS PGRADE see chapter 19 in Menu Oriented Online Help of Portal User Manual and the Tips amp Tricks within WS PGRADE Cookbook The entitlement adding to robot permission owner is the same process as the end user role adding see chapter IV Job description together with information about the sent application information about the user who sent the application user ID key string referred to an IP that is the client portal address A key string example peaa history user ID refers the user who sent the job information about a job 10196 submission which happened in an exact date and time job ID ip The IP address of the online WS PGRADE that comes from middleware IP of the location from where job was sent etc portal from where the job was sent e g 193 224 13 25 rtid Information about the exact portal IP matched to the key string referred in guse jsdl INFORMATION ABOUT ONE JOB Figure A 4 Retrieving information about a robot job from log files 62 Administrator Manual and Cookbook The robot permission related log information is stored for every finished or failed robot job in the DCI Bridge machine within the tomcat temp dci_bridge robotcertlog directory separated by days in Year Month Day lt x gt subdirectories where lt x gt is a little integer number The date refers to the job termination
49. evelopment Tomcat server During the connection to the deployed web service over SSL via this URL https localhost 8443 HelloWorld hello wsdl it hits javax net ssl SSLHandshakeException sun security validator ValidatorException PKIX path building failed sun security provider certpath SunCertPathBuilderException unable to find valid certification path to requested target Caused by sun security validator ValidatorException PKIX path building failed sun security provider certpath SunCertPathBuilderException unable to find valid certification path to requested target Caused by sun security provider certpath SunCertPathBuilderException unable to find valid certification path to requested target The steps of solution 1 Get InstallCert Get InstallCert class from http opentox ntua gr files InstallCert zip download and then unzip 3 The text based on the Unable To Find Valid Certification Path To Requested Target article http www mkyong com webservices jax ws suncertpathbuilderexception unable to find valid certification path to requested target 50 Administrator Manual and Cookbook 2 Add Trusted Keystore Run InstallCert with your hostname and HTTP port and press 1 when ask for input It will add your localhost as a trusted keystore and generate a file named jssecacerts java InstallCert localhost 8443 In case of SHIWA based middleware settings in DCI Bridge you
50. g Therefore you can avoid the logging of unnecessary events Note Technically the target file of logging is not changed with the introducing of log4j the catalina out file In gUSE you can use the INFO ERROR and DEBUG properties to set the desired logging level to the given component classes Example To set a gUSE component for detailed debugging do the followings 1 Go to the corresponding gUSE component to the lt Tomcat_Home gt webapps lt Component_Name gt WEB INF classes directory Open the log4j properties file Modify the next row log4j category hu sztaki INFO to this log4j category hu sztaki DEBUG 4 Restart Tomcat Note log4j provides many other configuration settings About this you find details here https logging apache org log4j 1 2 manual html 72 Administrator Manual and Cookbook Administrative Tasks for Job Submission to SZTAKI Desktop Grid In order to submit jobs to SZTAKI Desktop Grid eg SZTAKI DG szdg lpds sztaki hu szdg you have to first deploy the necessary applications on the desktop grid it is not necessary to deploy master components for them as 3G Bridge Generic Grid Grid Bridge will act as a master here add the applications to 3G _ Bridge s cg _algqueue_ table see here http doc desktopgrid hu doku php id manual gbac server side3g bridge configurati on configure the 3G Bridge s accessibility as a new BOINC resource in the DCI Bridge Se
51. he master DCI Bridge export EC2 URL lt url gt euca describe images access key lt ec2_access_key gt secret key lt ec2_secret_key gt where lt url gt is the first string in the Service and parameters text field of master DCI Bridge resource Edit window lt ec2_access_key gt and lt ec2_secret_key gt user name and password SHA1 hash coded added in the Security Cloud authentication window of WS PGRADE 2 You can trace the EC2 based job submission by the following method Set the value Debug of the selector Debug mode on the page Settings of the tab DCI Bridge within the configuration interface of the master DCI Bridge It can be done in administrative mode Go to the subdirectory apache tomcat 6 0 39 temp dci_bridge in the machine which contains the master DCI Bridge component and seek for a file has the name lt EC2_ACCESS_KEY gt ec2commands It logs the communication between the master DCI Bridge and the given cloud Configure Master DCI Bridge see fig 33 34 and 35 a Add new Resource name to Cloud middleware in the Cloud Add new window see Fig 33 b Set in the Cloud Middleware settings window within the DCI Bridge administration interface Set to BASIC_ATHENTICATION the Supported proxy types property see Fig 34 40 Administrator Manual and Cookbook Ee e oo Gia e oele EOB Resource name Status Enabled Disabled
52. izeMB 500 Maximum file size in MB to upload into WS PGRADE portal Table 3 Portal WS PGRADE property for file size to upload 12 Administrator Manual and Cookbook Quota Setting Another part within service properties is the quota setting The quota setting consists of two separate property settings the user quota setting and the repository quota setting You can set as administrator the user quota in File Storage for limitation of workflow submission per users see Fig 9 Note if the user just exceeds her his limit during a submission process the workflow will be submitted the submission process won t be interrupted The user can save her his quota by deleting of unuseful workflow instances in the Workflow Concrete Details window in WS PGRADE Table 4 shows a File Storage property for enable recalculating user quota to storage Property name Default value Description guse storageclient localmode sendquota Enables or disable recalculating quota information within the File Storage service If disabled file uploads to the Storage service will be much faster and there will be no quota limits Table 4 File Storage property for performance improvement 13 Administrator Manual and Cookbook Welcome Workflow Storage Settings X Information Statistics Liferay Workflow Concrete Notification Internal services Concrete Quota management Help editor Message amp Label Editor Information to us
53. kittyrote a Portal Content Reviewer A Power User AX Publisher L RobdotPermissionOwner Figure A 10 Adding a user role to a user Ill Supported Protocols for Using of Remote Executable and Input During the job configuration process you need to define your executable code of binary within the Concrete Job Executable tab You can do it not only by uploading binary from your local machine Local option but by adding the corresponding remote path of the executable Remote option 69 Administrator Manual and Cookbook You can use the Remote option to the following Grid Types together with the next protocols for the Executable code of binary definition Grid Type Supported Protocols gLite GT2 GT4 GT5 UNICORE ARC LSF PBS Local file http Ifn file http gsiftp file http gsiftp file http gsiftp http idbtool http http file http file http You can also use the Remote option by selecting the Remote icon to input port definition within the Concrete Job I O tab Figure 14 2 In this case you can use the following Grid Types and protocols Grid Type Supported Protocols gLite GT2 GT4 GT5 UNICORE ARC LSF PBS Local http Ifn http gsiftp http gsiftp http gsiftp http xtreemfs http http http http New Parameter Definition to a Middleware You can define new parameters e g JDL or RSL parameters for each supported middleware type in WS PGRADE Te
54. l Addresses Test esi Job Tie Websites ae j Social Network sus OpenID Figure A 9 Adding a user role to a user Il 68 Administrator Manual and Cookbook 9 Control Pane t Users and Organizations Users and Organizations Users are individuals who perform tasks using the portal Administrators can create new users or Geactivate existing users Users can join sites be placed into organization hierarchies be delegated permissions in roles or be collected into user groups User groups can cross Organizational boundaries and can de used to assign all members to other collections such as sites or roles User groups may also be used to customize personal site templates for members Biel om Bex Users and Organizations Pre Users are individuals wh v Users Search Al Users Deore neasi You can remove a user role sites or roles User group by Remove function FirstName LastName a ScreenName JobTite Organizations User Groups Hermann gabor lt P Actions Test test lt P Actions Tesi2 lest2 lt P Actions Test Test Showing 3 resuits Regular Roles Test Test z User Information A Enduser Remove Detail Poweruser Remove Password QO Select Organizations PAA eric aren You can select a User Groups y2168 154 240 8080 liferay portal 6 1 0 group control_panel n J defined user role Roles from the list Search Title a Administrator Enduser A
55. le content in case of administrator 19 Administrator Manual and Cookbook IV Setup the End User Role Setting of End User Role Once you installed the gUSE you are in power user role or in other words in workflow developer user role In order to set the end user role as the default role for new users please do the following Liferay specific steps At the top of the portal page select Go to Control Panel from the Liferay menu bar At the left panel click Portal Settings At the right panel click Users Select the Default User Associations menu Under Roles enter the text End User If you find other user role name remove that At the right panel click Save See Fig 11 tarona o Users and Organizations K Control Panel au FWwn bP Test Test Sian Out Sites My Public Pages Site Templates My Private Pages Page Templates Liferay Za User Groups Roles we Password Poli Portal Settings I Portal Settings Eg Custom Fields Settings is where most of the global portal settings are including names authentication default user associations and mail host names 2 Monitoring Users m RA Plugins Configuratio a LIFERAY Mobile Davice Riia Fields Reserved Credentials RSECWIAS Ig Cote iat Liferay Apply to Existing Users Configuration as General 9 Authentication Mail Host Names Roles amp Email Notifications End User Identification Ad
56. loy the web application singlejobwizard war through Liferay by clicking to Go to gt Control Panel gt Plugins Installation in the Server group in menu on the left hand side 2 Registrate it as a new component in Internal Services Navigate to Internal Services interface in Settings menu and add a new component with the following properties Type of Component portal Service group gUSE URL of Component PORTAL_URL singlejobwizard URL to initialize Component PORTAL_URL singlejobwizard init Public URL of Component PORTAL_URL singlejobwizard State active In the same interface go to Copy Component properties panel and copy the properties of the wspgrade component to singlejobwizard component 54 Administrator Manual and Cookbook 3 Restart the portal get the process ID of java by executing the following command JAVAPID ps aux grep java then kill the process kill 9 JAVAPID Finally start the portal by executing startup sh located in tomcat s bin folder startup sh 4 Initialize it and add new page Once the portal has been started successfully add new page Optional by clicking Add button on the top menu and clicking to Page button see next figure and then by typing its name The settings can be finalized by clicking the green tick Associate the portlet to the page by clicking to Add button on the top menu and then selecting option More Then af
57. mage is not usable for VMware based or Xen based hypervisors Robot Certification To use robot certification for job submission you need to do a preliminary task Once the corresponding job was configured with robot permission copy the content of directory apache tomcat 6 0 37 temp dci_bridge robotcert to the same directory of the image that includes the slave DCI Bridge Then the user can submit your workflow 43 Administrator Manual and Cookbook VII Ticket Request to Use Data Avenue The Data Avenue is a file commander tool for data transfer enabling easy data moving between various storages services such as grid cloud cluster supercomputers by various protocols HTTP HTTPS SFTP GSIFTP S3 and SRM The Data Avenue is integrated into WS PGRADE portal as a portlet To use Data Avenue services from WS PGRADE portal you as administrator need a so called ticket which is a kind of access code similar to API key used to access e g Google or Amazon services The next section describes the ticket requesting and receiving step by step process 1 Once you sign as admin into gUSE WS PGRADE portal select the Data Avenue menu 2 Select the Options icon on the top right in the Data Avenue window and select Preferences in the appearing submenu list 3 In the next window you find two text fields Fig 36 The first field is to define the Data Avenue service description access in form of URL The default value is the
58. mponent Type of the gUSE It means that the needed activities must be associated to resources by which they can be performed A Service which must belong to a given Service Group defines the possible request types among the Components It has four parameters 1 Component Type of Server It is the type of the component that serves the request of the client component 2 Component Type of Client It is the type of the client component that requests the service 3 Server side service interface It is a relative address to find the proper interface elaborating the request on the actual Component 4 Client side interface impl class points to the definition of the Java code which communicates with server on behalf of the client Further tabs in the Internal services window are Services The registry of gUSE components The component registration solution is similar to standard web service registration Here you can add or delete components in case of a gUSE system update Fig 4 Component Types The type of web applications identified as gUSE components To the proper work of gUSE a predefined set of Component Types must be present The table of component types contains three columns 1 The Name of service group is the name of group concerned the component 2 The second column gives short information about a component type 3 The last column provides actions Edit or Delete to the item Fig 5 Copy Component P
59. nfiguration menu the MySQL server must be redefined Please do not forget to replace the string IP by the URL of the MySQL server Define the SMTP server of the organization administrating the portal and the e mail address of the person administrating the portal in the subsequent step optional step By selecting the appearing blue sphere containing a magnifier a control step will be played The configuration of the WS PGRADE gUSE will be executed and animated by the wizard and the values of the most important URL s are displayed As last step the page named gUSE Service Wizard is called and the success will be reported By now your portal must be operational if you go to http lt URL_install_frontend gt 8080 liferay portal 6 1 0 To shut down the system 1 Stop the Apache Tomcat container with default settings guse apache tomcat 6 0 35 bin shutdown sh on or on each of the UNIX machine s 2 Check stopping of all java processes killall 9 java on or on each of the UNIX machine s Certainly you need first to stop then to start the system in case of system restart Administrator Manual and Cookbook Using of Scripts There is another way to start stop the gUSE system using of scripts You need three different scripts to this process 1 guse init script works with Debian and with minor modifications should work in Red Hat based distros as well start sh script to startup the system stop sh script
60. ng VMS 1 SHA1 6f830942d0efae9db503f9e7e76 Z gi 85fdSef555fcf DRIVER raw z7 Figure 32 Information about the base image including permission details on a OpenNebula based operation center However beyond this configuration the image content can be freely exceeded Note To VM and image creation and managing by an OpenNebula based Operation Center e g https cfe2 lpds sztaki hu please use this document http www pds sztaki hu summerschool2013 downloads Opennebula pdf slides 8 37 The detailed description of Administrator specific Tasks Task 1 Image Downloading and Saving in the Target Cloud s Performed by the DCI Bridge Administrator The DCI Bridge Administrator downloads a public base image containing a properly configured DCI Bridge this will be the slave DCI Bridge from a corresponding Repository This image will be saved in the target cloud environment The used cloud service provided by the Cloud Provider must contain Amazon EC2 Frontend 39 Administrator Manual and Cookbook Task 2 Master DCI Bridge Configuration Performed by the DCI Bridge Administrator The DCI Bridge Administrator configures the Master DCI Bridge as well It is connected directly to the gUSE and starts the VM that contains the slave DCI Bridge Notes 1 You can check the accessibility of EC2 cloud service from master DCI Bridge machine by the following way Please use the following shell command issued from the machine contains t
61. onnected directly to the gUSE forwards the jobs through the EC2 based frontend cloud service to the Slave DCI Bridge located in the cloud Technically the Master DCI Bridge starts a Virtual Machine VM via the EC2 based service The started VM contains the properly configured Slave DCI Bridge that was previously created and saved as an image in the cloud repository The Master DCI Bridge can start more VMs of different cloud services where EC2 based frontends are integrated see Fig 30 This solution is compatible to all cloud services that provide Amazon EC2 interface Downloading a public base image containing a DCI Bridge configured Authentication job to local Cloud resource Middleware from a Repository and configuration savingit ina cloud setting to be able service to transmit jobs to slave DCI Bridge to Cloud resource Repository configuration to Cloud resource and starting submission Virtual Machine Virtual Machine ae Starting VM s f g es 52 HE T Eu lt Slave jiane DCI Bridge PGRADE DCI Bridge Job Submission Providing a cloud service f 2 Cloud Provider with Amazon EC2 frontend Figure 30 Overview of the direct cloud access process 36 Administrator Manual and Cookbook V L AS Virtual Machine N Sending IMAGE ID and URL Master R for starting VM id DCI Receiving IP Address of VM Bridge Slave DCI Amazon EC2 Frontend Web
62. ou have any questions please contact us under platform cloudbroker com Entries marked with are required User Information Organization Information Please enter here the information about yourself for your personal user account Please enter here the information about you your group or institution for your shared organization account Salutation Mr v Organization name k Title Organization type commercial X First name Responsible Y Last name Address Function Postal code Department City Phone enter in format country code phone number r State Email Figure 20 Registration page on CloudBroker Platform Once you have your user and organization information filled in read the Terms of Service defining the conditions for using the CBP In case you agree to them confirm your agreement by clicking on the agree button The next step is to familiarize yourself with the platform price conditions Each organization has a certain monthly payment amount based on the following items Monthly organization cost Per month Monthly cost for each user in the organization Per user per month The prices on the above mentioned items may vary depending on the organization type selected in the Registration page In case the corresponding prices are set to zero this means that you can register a new user and organization in the platform for free No platform price conditions page is display
63. perform tasks using the portal Administrators can create new users or deactivate existing users Users can join iq 2885 be placed into organization hierarchies be delegated permissions in roles or be collected into user groups User groups can cross organizational boundaries and can be used to assign all members to other collections such as sites or roles User groups may also be used to customize personal site templates for members 2 View Alt O Ada By Export antusers Users and Organizations E Fest tome PESTRES ET rosa tame zob TIe Organizations usor Grops Users are individuals who perform tasks using the portal Administrators can create new Gabor deine ganar AF Actions delegated permissions in roles or be collected into user groups User groups can cross sites or roles User groups may also be used to customize personal site templates for Test Tost test lt P Actions Testa Tea2 test pi Actions amp View au Adc y H Export guy Showing 3 results Test Test Back Details Test Test Title cs User Information Details Screen Name Required Password test Organizations Email Address Required le enanos ser Groups test i i lest liferay com usar Roles First Name Required 10196 Personal site frest 5 Categorization f 7 Identification Middie Name J 1 1970 x a amway j roe Addresses j Gender Phone Numbers Last Name mae Additional Emai
64. ract werktiow template sppication and project to develop new worktiow appkcatons and pies them to the GuSE recostery Fer scientite end wnere WS PORADE gues Ml access to the parameterization and execxtos of applicators sommicased tom te GUSE recostory Liferay Portal More formation ro gust ty a Downoad USE au vansan x Dacussen forum yoecetirae oetsronctvman toners Pease nctty our wser support team about any new SCCI ty nalate natancen al ccsanucoc ai pea aziat y Would you have any questen act answered n the Users Mansal please cotact us through the Source crue Fangs in case of any bugs isuna please use the Source eve Den Resort Toss Would you have any feature requests please Wt as Low Brough the Liuc ovat Frater Braves Prot Authentication to The menus provided by Liferay Liferay invokes WS PGRADE portlets for workflow creation and submission w E o Lu a 4 oc 3 v Please noby ow user support team about any new success ty Mataled instances st poriaimasinir Figure 13 The Liferay WS PGRADE portal comparison It is important to distinct for many administrative reasons the Liferay Portal environment from the WS PGRADE portal Before you sign in for WS PGRADE portal you are actually in a Liferay portal Therefore the sign in authentication method belongs to Liferay and not to WS PGRADE upper view in Fig 13 Once you signed in as a user you will get a new view where all the
65. rage DCI Bridge properties together with their default values and descriptions are listed in the following tables Table 1 5 The presented WFI properties concern the used job workflow limitation Table 1 The WFS property Table 2 sets the saving of the visualizer data of portal statistics If the property value is true then the job data will be saved in database server and corresponding triggers will be run There is worth to set it to false if you don t need to use statistics because this data saving action loads the gUSE system significantly If you want to use the Statistics function of portal you need another step to enable the portal to show the statistics views please navigate to page http lt URL_install_backend gt 8080 stataggregator Thus the collection of statistics log information is automatically switched and the Statistics function is usable Property name Default value Description wfi zen activeingjobs max 500000 Maximum number of jobs managed by the WFI wfi zen activeingjobs usermax 500000 Maximum number of jobs managed by the WEI per user wfi zen quota user workflow 10000 Maximum number of workflows per user Table 1 WFI properties Property name Default value Description guse wfs system savevisualizerdata Enables or disables saving data for the statistics module in the database Table 2 WFS property for performance improvement Property name Default value Description wspgrade maxuploadfiles
66. roperties Enables copy the property set identified by URL between two selected components Fig 6 Save settings Administrator Manual and Cookbook Internal services a se gt Components Component Copy Componenti Save settings nee Propers List of Components together with client and server side types as well as their interface data Add new Service Configuration of Services ame of service group SF use Description ee _Standard USE TofClient cTof Server Server side service interface lient side interface impl class Actions portal services um portalwfsservice jnu sztaki Ipds portal net wsaxis13 WfsPortalClientimp Delete storage services urn portalstorageservice nu sztaki Ipds portal_net wsaxis13 StoragePortalClientimp Delete services urn portalwfsservice jhu sztaki Ipds portal net wsaxis13 WfsPortalClientimpi te po po services urn portalwfsservice Rel Figure 4 The component registry in the Services tab Internal services 2 Components Services Copy Component Save settings Properties New List of defined Component Types me of service group Description S information service Figure 5 The list of defined types in Component Types tab Internal services Components Services Component Types Copy the property set of a Component Component from http 192 168 152 34 8080 wspgrade Component to http 192 168 152 34 8080 wspgrade Copy l
67. s New Entry Options page 3 After clicking on Expert Options tab set Maximum nodes Set API URL e g http cfe2 lpds sztaki hu 4567 4 Click on the Proxy Server Enabled icon set proxy access details then click Save see Fig 24 29 Administrator Manual and Cookbook 5 Entry Options Expert Options External hostname External IP address Maximum nodes 1 Website enter in format http www example com API URL http cfe2 Ipds sztaki hu 4567 O Use global security group Visibility private v Proxy Server Enabled CloudBroker Virtual Machine Instance T ee Proxy hostname 193 224 70 205 Proxy username cloudbroker Proxy password Proxy private key home zfarkas Temp SZTAKI E _ Browse O Public Proxy Figure 24 Resource setting in Resources New Expert Options page i t Click the Instance types tab then click New In the Entry Options tab set Human readable name then select the Resource as defined earlier Set Architecture CPUs CPU cores Memory GB and API name Fig 25 Go to Expert options tab Set Maximum nodes Click Save 30 Administrator Manual and Cookbook Bade meee Sx Expert Options Human readable name S552013 Resource OpenNebula MTA SZTAKI SS2013 v Architecture x86_64 v CPUs 1 CPU cores 1 Hyperthreading Memory GB 1 API nam
68. scope of this Manual The detailed administration documentation for Liferay Portal version 6 0 is located here http www liferay com documentation liferay portal 6 0 administration However the explicitly WS PGRADE related Liferay settings are described in this Manual Abbreviations The following abbreviations are used in the Manual EGI European Grid Initiative gUSE grid and cloud User Support Environment WFI Workflow Interpreter WFS Workflow Storage WS PGRADE Web Service Parallel Grid Run time and Application Development Environment Administrator Manual and Cookbook I Howto Start and Stop the System One of the first relevant information in an administrator manual is to explain how to start and stop the system In case of gUSE you can do it by two ways by manual step sequence or by starting of scripts Using of Manual Step Sequence In case of manual system startup follow the next steps 1 Start the Apache Tomcat container with default settings guse apache tomcat 6 0 35 bin startup sh on or on each of the UNIX machine s 2 Start the Service Wizard by opening the following URL on the backend machine http lt URL_install_backend gt 8080 information Note that this operation needs authorization user password is admin admin You can change the password in tomcat users xml file if it s necessary The Service Wizard will be opened Inthe popup Database Co
69. t X y X a8 Figure 6 The in Copy Component Properties tab 10 Administrator Manual and Cookbook Setting of Services To set services you can log as an administrator into WS PGRADE Click on Settings Internal services see Fig 7 Welcome Workflow Storage Settings Information Statistics 3 Notification Liferay Settings Internal services Internal services Internal services Quota management ae Help editor eh ga Message amp Label Editor Components Services Component Copy Component Save settings Types Properties Figure 7 Selecting Internal services menu Find the service of interest e g wfi wfs and click on properties Here you can Delete Edit or add New properties see Fig 8 Internal services Sy Components Services Component Copy Component Save settings Types Properties List of defined Components ttp 192 168 152 34 8080 wspgrade http 192 168 152 34 8080 wspgrade active Delete Editl properties refresh Internal services Si gt Components Services Component Copy Component Save settings Types Properties Service properties otify quota time in hour Figure 8 The Service properties function within Internal services Components menu 11 Administrator Manual and Cookbook Setting of Service Properties The most important in respect of system performance internal service WFI WFS File Sto
70. ter the categories of portlets appear open SZTAKI wspgrade category and click add button in the row of Single Job Wizard 5 Upload reconfigure and export the workflow skeleton provided You can download the skeleton workflow from here Go to upload portlet and upload the prepared workflow to the portal server Then reconfigure its resource adjusted by default is local submitter for production purposes CloudBroker Robot Certificate is suggested Finally export the reconfigured workflow as application into the Local Repository by clicking Export button Configuration 1 Open the portlet s configuration panel by clicking to the wrench of the top right corner of the portlet see figure 42 Liferay Single Job Wizard Single Job Wizard x Your experiment list is still empty AEA Export impor Drop an application and proper inputs using the wizard at th Hel hand side _ Drop files to upload or click Figure 42 Single Job Wizard configuration 1 2 Then select the workflow that you have exported as a base workflow for Single Job Wizard 55 Administrator Manual and Cookbook Single Job Wizard Configuration x Setup Permissions Sharing A Archive Restore Setu l Currently Single Job Wizard is configured to use single JobByMTASZTAKI workflow exported by test To change select a workflow from the Local Repository to be used as base of Single Job Wizard singleJobByMTASZTAKI exported by test
71. to shut down the system Using of scripts 1 Put start sh and stop sh into the home directory of the user that runs the gUSE service e g in home guse 2 Put guse script in etc init d and set the GUSE_USER variable in it to the name of the user that runs the gUSE service Execute etc init d guse start as root to start gUSE and etc init d guse stop to stop gUSE Note the start sh checks if the current IP of the outside interface is the same as detected during a previous startup read from prev_init_IP If it s not the same some MySQL tables containing service URLs are dropped and gUSE is initialized using the new IP for the service URLs If it s the same the tables are not dropped and gUSE is initialized by using earlier service URLs You can eliminate this behavior by echoing your machine s current IP to prev_init_IP The scripts are available in scripts init directory in the gUSE package guse lt version number gt tgz located in SourceForge Administrator Manual and Cookbook II The Internal Services The Middle tier of the gUSE WS PGRADE framework Fig 1 contains those high level gUSE internal services that enable the management store and execution of workflows PRESENTATION TIER MIDDLE TIER ARCHITECTURAL MIDDLEWARE TIER Figure 1 The multitier architecture of gUSE WS PGRADE framework The gUSE internal services are accessible only by the administrator of gUSE The administrator can
72. ton Fig 21 amp Home O Software Resources HJobs Invoices Information Users Organizations Licenses amp Accesses amp Users 9 New Figure 21 Users List page You will see a form for creating a new user with the following mandatory fields on the Entry Options sub sub tab Email Password Password confirmation Salutation First name Last name Phone and User role by selecting one of three available user roles admin to create a user with the broadest level of access within the organization who can create new users runjobs deploy own software register own resources manage accesses licenses for organization users 27 Administrator Manual and Cookbook edit user and organization information handle billing information invoices and payments have access to everything that the other users in the organization do advanced who can run jobs create accesses licenses for him herself edit own user information standard who can run jobs edit own user information You can also fill in the optional fields on the Expert Options sub sub tab When you have filled in all the necessary user information click on the Save button okay any cost information if applicable and a new user will be created amp Users Entries marked with are required A Estimated Costs ATACE X Expert Options Gap alee iat a as p VAT USD
73. tor Manual and Cookbook DCI Resources DCI Bridge GT 2 GT 5 Add new Edit Monitor Middleware settings Log entries Enable plugin Enabled Disabled Plugin implementation hu sztaki pds submitter grids Gnid_glite class Number of threads Number of lt a 1 re submissions 0 if the job failes SSH_KEY Supported if age ea SAML 5 BASIC_AUTHENTICATION aes false service Figure 11 Properties setting in DCI Bridge administrator s interface Setting Default value Description Number of threads 1 The given number of threads will manage jobs The ideal value is between 2 5 in order to speed up the work of the given DCI plugin However too many threads will use up too many resources from the portal server and will slow down the whole portal Number of resubmissions The jobs will be resubmitted a given number of times to achieve a successful submission Since the grid systems are not always reliable resubmission could be useful However too many resubmission is useless so the recommended value is 3 Table 6 DCI Bridge properties Warning once you add a new property or changed an existing property of to a component you need to restart in the Apache Tomcat administration interface on the Apache Tomcat Web 16 Administrator Manual and Cookbook Application Manager page the component whose property was changed Note in this page the component referenced as application 192 168
74. ware has been tested i e they can really be run on the deployed resource and works as expected it may be published for use by the organization or by anyone accessing the CB platform by setting software status to public Note you find in this documentation the administrator specific description of the CBP handling The description of CB middleware settings you can see in chapter 2 15 within DCI Bridge Administrator Manual You find user specific details in chapter CloudBroker based Workflow Configuration and Submission in the WS PGRADE Cookbook and in chapter 17 in the Portal User Manual Registration To access the CBP you have to own username and password provided by CloudBroker GmbH after registration process which is used in every communication with the platform To registration you need to go to the CB platform registration page https platform cloudbroker com registration new_user_organization Here you can register a new organization together with your personal account Fig 20 25 Administrator Manual and Cookbook CloudBroker Platform Registration On this page please enter the information for your CloudBroker Platform user and organization accounts and agree to the usage terms If you or your organization have been registered on this platform before please do not register here again Instead please ask the admin of your organization to add or change your user account in the platform for you In case y
75. xt admin window Settings Message amp Label Editor in the following way For each parameter must be defined two key value pairs forthe help text and forthe parameter key 70 Administrator Manual and Cookbook Text admin Find Dese Key 222 222 111 111 Key Add Desc Modify breakpoint BIUm y Submit Query Figure A 11 Parameter adding to a middleware in the Text admin window See an example in case of gLite middleware Add the key CPUNumber for gLite middleware Select the radio button Add Set the following parameters Key glite textCPUNumber Desc Value the content of the text field The CPUNumber attribute is an integer greater than 1 Click on Submit Query The keys will be stored in the database If the previous values are disappeared restart your WS PGRADE 71 Administrator Manual and Cookbook Logging with log4j For better troubleshooting and debugging gUSE uses the log4j based solution The Apache log4j is a logging library for Java With log4j it is possible to enable logging at runtime without modifying the application binary The log4j package is designed so that these statements can remain in shipped code without incurring a heavy performance cost Logging behavior can be controlled by editing a configuration file without touching the application binary The practical advantage of log4j logging is to set the level of loggin

Administrator Manual and Cookbook

Contents

Download Pdf Manuals

Related Search

Related Contents