CLIFv2 Quick Start manual http://clif.ow2.org/
Contents
1. CLIF Report with BIRT th CLIF Report Template with BIRT rere Isac scenario mS HTTP Capture 9 Import py Export Refresh F Example F other Enter QuickStart as the name of the project and validate with button Finish New CLIF Project Create a new CLIF Project Choose project location Project name QuickStart Use default location Location E ABO cli trunk distibuildOirectors workspace QuickStart Browse March 19th 2013 You will have a CLIF skeleton project created with base files TS Navigator 25 m amp E t QuickStart c ET gt stats Ei project jj kh clif props File clif props contains specific configuration properties for the project See the User Manual for more details about CLIF s properties The report directory will contain test results This project will act as your container for your test plan and scenario files A test plan is a list of probes and injectors deployment definitions As a first touch with CLIF we create a basic test plan with a single probe 2 2 Test Plan Creation Create a Test Plan with wizard New CLIF Test Plan Tre TS Navigator 2 E d ES CLIF Project Go Into LE 154C Plug in Project x pri Open in New Window FP Project clif Copy CLIF Test Plan th Test Deployment NW Delete th CLIF Report with BIRT Enter probes ctp as file name and click on Finish CL2. JmsInjector Synchro Random Import Page Plug ins List of plug ins used in this scenario see http Httplnjector Remove Remove All Help Add behavior March 19th 2013 Properties Manage plug ins properties USE Httplnjector Httplniector i Load images and Frames enabled Then we also need a plug in to produce think times The ConstantTimer plug in provides support for constant think times Rename its import name to timer 5s and set the timer duration to 5000 ms Save the scenario Import Page Plug ins List of plug ins used in this scenario lt http Httplnjector dde SS ConstantTi Remove Properties Manage plug ins properties use ConstantTimer constant Timer Remove All Help duration msi 5000 15 CLIF Quick Start manual Now we have all necessary plug ins for our test 3 3 2 Write a virtual user behavior Switch to the Behavior tab to edit the virtual user behavior Insert an http get request aka action or sample and a sleep timer from timer 5s Behavior Page El Edition page for behavior description Properties Manage plug ins properties t Load profile er calles id http w Behavior tree CO timer Ss sleep Insert before Set automatic redirection optional Insert after enabled a Configure the Sample URI frequiredi tke i localhost 8080 This behavior per
3. i Arguments 1000 60 Comment Refer to the User Manual to get the list of available probes Unlike the JVM probe most of them are operating system dependent Now your test plan is ready You need to deploy it in order to execute it 2 4 Test Deployment Deploy it with wizard New Test Deployment and validate with the default parameters Go Into q cl Copy p DE E 3 Delete Move Rename pag Import Lig Export Refresh Close Project Open in Mew Window O thy probes ctp 2 2 Test Plan Editor d ES CLIF Project LE ISAC Plug in Project F Project thy CLIF Test Plan Test Deployment th CLIF Report with BIRT thy CLIF Report Template with BIRT rit sac scenario AS HTTP Capture Py Example Pay Other CLIF Quick Start manual _ New Test Deployment New Test Deployment Choose test plan to deploy Container MuickSkart Test plan to deploy elieeltpfeaa Click on button Finish to launch the test plan deployment 2 5 Test execution Once the test is deployed you must initialize the test Ss Navigator 2 Oj FT Test Commands O S E Quickstart Injectors and probes SS report All injectors and probes in the test plan HE stats jvm cpu a _ H project Id Server Fole Arguments El clif props 1 local host probe j 1000 60 Il probes ctp Information th Cliffree 7 O g l
4. 10 thetest PO riore S a E N A a 17 DS DEDIO ANG TUE E E TE die eine 18 A TC Capture And replay sn nn tien it en hi tie ite tes 20 PERION LE dda ech ciate ecules ongacdewtandende mu tackamaisentuuduaneuteanteene 20 A Capture a reall We D USerS SSIONMES SR Et ERE 20 AP TAUGHT ULC PUTS RSR Rd ey damned eis tn ce 20 4 2 2 Configure your navigator tO use the Capture DrOXY u rss 22 25 RKO NESCO O NS ati tote NN Sn T Ne die 22 A gt Edit scenario HUP ADIUTO NISSAN den een 23 4 4 Deployment and execution of httpCapture xi1s LL 24 March 19th 2013 1 Introduction In this Quick Start you will learn how to create your first CLIF project 1 1 Requirements We will use the Eclipse based CLIF console in this Quick Start Refer to the Installation Manual 1 2 Summary We will make three different tests In the first test you will learn how to create a CLIF project a Test Plan add probes to the Test Plan and deploy it In the second test we will create an Isac Scenario using several plug ins to test an HTTP server In the third test we will use the HTTP Capture wizard to create a scenario and replay it CLIF Quick Start manual 2 Basic test 2 1 Project creation Create a new CLIF project with wizard New gt CLIF Project _ CLIF RCP Console File Edit CLIF Search Window Help a a i hE eel E L HN TS Navigator 3 LE ISAC Plug in Project Py Project th CLIF Test Plan th Test Deployment th
5. o The JVM probe monitors free memory in currently allocated heap MB used memory with regard to currently allocated heap free of maximum allocatable memory heap Alarms probes m4 jvm cpu Alarms Blade Class Server Blade Date Time Severity Message local host 1 17 12 09 17 12 06 oo Info garbage collection iaca fet 1 17112109 17 13 32 on Info garbage collection 1 17112109 17 13 34 gg Info garbage collection 1 17112109 17 13 46 gg Info garbage collection 1 17112109 17 15 11 gg Info garbage collection 1 17112109 17 16 26 gg Info garbage collection Alarm messages appear depending on some events occurring in some probes or injectors For example the JVM probe raises information level alarms when garbage collection occurs 2 5 3 Start Starting the test will begin the test and store data mainly measurements From the start the test will last 60 seconds as defined in the JVM probe 2 5 4 Suspend Resume You can suspend the test during execution and resume it when desired No data is stored and no load injection is performed during suspension time Probes go on producing measurements but their execution time is frozen thy probes ctp 3 A Test Commands Injectors and probes All injectors and probes in the test plan yee Select All Arguments Deselect Al Global state suspende Edit Test Once the execution time has elapsed the test automatically stops 10 March 19th 2013 2 5 5 Collec
6. CLIFv2 Quick Start manual Air http clif ow2 org Copyright 2006 2009 2013 France Telecom SA March 19th 2013 CLIF Quick Start manual Table of contents L ENTFOQUCHONMS Ne tente dl te tete peste dents d nl erate 3 LI REQUIT MENES Se de net eme den a a 3 SU MAN en etes ananas te enr ten eee it Gone it ie nn 3 Zi BASIC lOS eoii a e Ea E N E E EEEa 4 DA PrO IEC tere aU Oene te eh E ne ee 4 22 Test PAR eai ON mention ei none 5 2O AAAI M PODO ne ee mie tr ee Reem ee OC Reo ee Le Eee eT 6 24 LS ED DIO VMS ue de tunis Contient dites Co ot ER 7 2 9 L ST X CULIONLS denis di Peas ie ta etant nette 8 CS BY AL LICL Ae eee eT eee EET OSE RT TEINS ORE REE do de S 22 VON OVI GO Erin ane dede on dd aE os 9 D OA er dodo me oo on na CH er en de nr dd 10 2 Pe UES CTIA RESUME ne aa nse ha chars et ee heed een den te nine 10 2 D ONO SR ee ee en Te EET eT ne nee Ce E ne Ce 11 ZORO MICS a ot ee eee di M ne Ra inc 11 JA Scenario TOF WED testna ssori an a ANSE aE aN EN 12 3 1 Create a scenario with the ISAC environment ss 12 3 2 DiSCOVe rte DBAC Scenario COLOR cess TR a a neue sun in eee 13 2 LL BACEN STOO S RES ne E one te en Sete AEE 13 55 WW TITLE A SCENA O serne a En 14 DL AMDOILNECES SAV PI I S aaea a a a Oa teat E Re Lan 14 ISL WU VIMUGEUSOT behav Or sisi aa O 16 DD odd PONE em a r A O 16 3 4 Make and run a test plan with a load injector ss 17 SA AE OA D LE AO PUO EEEE E ATE O E E O E E 17 SA2 Add a load mjector
7. GE copy dus CLIF Report with BIRT LE Paste ds CLIF Report Template with BIRT X Delete dus CLIF Test Plan oies th Test Deployment ove th Test Report on swing gui e g Import sac scenario gy Export Ta HTTP Capture Refresh Py Example Close Project Py Other Enter the scenario file name the xis file name extension stands for XML Isac Scenario Isac Scenario File This Wizard creates a new File with xis extension that can be opened Isac Scenario Editor Container QuickStart File name http Simple xis 12 March 19th 2013 3 2 Discover the ISAC scenario editor 3 2 1 Isac Editor s tabs At the bottom part of the scenario editor you can see 4 tabs namely Design Source Import and Behavior BO An Isac scenario is stored as an XML file The Design tab shows a tree view of the XML content while the Source tab is a generic XML editor Using the XML editor can be convenient in some cases but risky use with care if you want to keep your scenario meaningful to ISAC T httpSimple xis 2 3 Be httpSimple xis LE T xml lt xml versions 1 0 i Leg DOCTYPE lt DOCTYPE scenario E scenario lt scenaria gt lt hehayiors gt lt plugins gt lt lt hehayior lt hehaviors gt lt loadprotfile gt lt lt scenario gt s Design Source Import Behavior BO Design Source Import Behavior BO The Import tab lets you import all ISAC plug ins that are necessary to your scenario s
8. IF Quick Start manual New CLIF Test Plan AE Create a new CLIF Test Plan This wizard creates new CLIF Test Plan with chp extension that can be opened by a Test Plan editor 11 Container QuickStart File name probes ctp 2 3 Add a JVM probe Let s create a probe to monitor the JVM s memory usage Click on the Add button and enter the following information e leave the proposed Id you may also change it for whatever value as long as it is meaningful to you and unique among all injectors and probes in this test plan e keep local host as Server the probe will be deployed in the console itself e ensure the probe Role is selected e enter jvm in the Class field caution this field is case sensitive e enter arguments 1000 60 The first number indicates the polling period in milliseconds then a memory usage measure will be performed each second while the second argument sets the monitoring duration in seconds the probe will be working for one minute and then will stop ths probes ctp 23 Test Plan Editor Injectors and probes All injectors and probes in the test plan Add m Add a new probe or injector in this tab Remove All Test Plan Editor Injectors and probes Al injectors and probes in the test plan cpu jvm Server March 19th 2013 Properties Manage injector and probe properties id Server local host Refresh Role probe Class
9. e 4 2 3 Record the scenario Start the recording i HTTP Capture Run HTTP Capture Start and Stop the HTTP capture Time elapsed seconds 9 Number of requests 0 Stop Recording Cancel Then just use your browser as usual to get visited URIs recorded by the proxy The number of requests should increase accordingly Stop recording when you are done and click on Finish 72 March 19th 2013 1 HTTP Capture Run HTTP Capture Start and Stop the HTTP capture Time elapsed seconds 13 Number of requests 10 4 3 Edit scenario httpCapture xis The wizard has generated scenario file in your CLIF test project see the project navigator view Open this file httpCapture xis You need to define a load profile before using this scenario in an injector see 3 3 3 You might as well edit the behavior to match your needs change some parameters add or delete requests or think times etc 23 CLIF Quick Start manual D httpCapture xis 63 F Behavior Page meae Edition page for behavior description Properties Manage plug ins properties sample HttpInjector get Behavior id session Mew Duplicate t Load profile id replayHttp ww Behavior tree Configure the Sample URI required Atkp fflocalhost 8080 Set automatic redirection optional E Insert after _ enabled replayHttp get replay Timer sleep Insert before replayHekp get r
10. elete hy CLIF Report with BIRT E Move th CLIF Report Template with BIRT re Rename T ao Bac scenario r 5 il Import HTTP Capture thy e Export D Example Refresh Other Close Project ri Name the capture file httpCapture xis and click on button Next 20 March 19th 2013 1 HTTP Capture New HTTP Capture This Wizard allows the user to run an HTTP Capture and to save it into ISAC Format Container MuickSkart File name httpCapturel xis Port ogg F Lise Remote Proxy Timer ConstantTimer w 1 HTTP Capture Run HTTP Capture Start and Stop the HTTP capture Time elapsed seconds Number of requests Start Recording Stop Recording 21 CLIF Quick Start manual Now you just have to click on button Start Recording to make the proxy record URIs and think times 4 2 2 Configure your navigator to use the capture proxy Firefox To use the proxy in Firefox go to Tools Advanced Network tab Parameters Enter the proxy parameters localhost port 8090 and validate Then just use Firefox as usual to get visited URIs recorded by the proxy Internet explorer Right click on Internet Explorer and chose Properties Go to the connection tab and chose network parameters Enter the proxy parameter localhost port 8090 and validate Note Don t forget to remove this proxy configuration once you are done with your captur
11. eplay Timer sleep replayHekp get Remove Set specific headers header value replayHttp get replay Timer sleep replay Timer sleep Clear replayHttp get Help replay Timer sleep replayHekp get Enter Parameters scheme name value replayHttp get Add Field Remove Field replay Timer sleep replay Timer sleep replayHetp get The response body may be stored in variable i replay Timer sleep a variable name Design Source Import Behavior session 4 4 Deployment and execution of httpCapture xis Cy Create a new test plan httpCapture ctp see 2 2 and add an injector see 3 4 2 with the following parameters e Role Injector e Class IsacRunner Arguments httpCapture xis Deploy the test plan see 3 4 3 Initialize start and collect results 24 March 19th 2013 injector Alarms Display Collect Blade Time ne MERE asl i a co a 623 Oo 01 400 200 gg 01 34 J Store monitoring data You have completed the Quick Start guide Now you may discover other CLIF features by reading the User Manual or having a look at the sample scenarios and test plans other injection protocols external data sets ISAC language other user interfaces etc Java developers may also extend CLIF with new probes and injectors see the Developer Manual Enjoy 25
12. forms an HTTP Get request sleeps for 5 seconds and finally completes To set the URI to get click on the http get request in the Behavior tree and fill the URI field Do not enter a public web site Use your own web site instead in order to avoid flooding a public web site with requests For example you may launch a light Servlet container like Jetty http www eclipse org jetty downloads php You just need to get the distribution unzip it and launch it with command java jar start jar DEBUG true The server will be accessible at http localhost 8080 and you will have direct feedback of the requests with debug logs 3 3 3 Load profile Still in the Behavior tab click on button Create in the load profile section The load profile editor consists of a list of points execution time in seconds number of active virtual users The transition between one point to the next one may be linear or square with 2 possible squares vertical and then horizontal or horizontal and then vertical When not specified the initial point at time zero is implicitly set to 0 0 Enter points 10 20 and 50 20 with a linear ramp style Click on button Finish save and view the result on the Load profile view the test starts with O virtual users Then there is a ramp up to 20 virtual users at 10s execution time and then a plateau with 20 virtual users until 50s execution time 16 March 19th 2013 i Load profile Add points for this
13. ocal TER Start Suspend Collect la jvm 1 Edit Test 2 5 1 Initialize The initialization step bootstraps probes and injectors but does not start the test Initialize the test keeping the default given test id Select All Deselect All Global state deployed thy probes ctp 3 Test Commands Injectors and probes All injectors and probes in the test plan jvm cpu Id Server Fole Class Arguments Com Stake 1 local host probe jm 1000 60 initialized Edit Test th Monitor 22 probes g jm cpu Alarms Display Collect Blade Time Time Value a 1 oo Free memory ME Store monitoring data March 19th 2013 Select All Deselect All Global state initialized The JVM probe starts monitoring memory usage but its execution duration is counted only when it is running 1 e started and not suspended 2 5 2 Monitor tabs The monitor view allows you to see the details of each type of probe or injector An extra tab shows all alarm events sent by probes In each tab you will be able to control displayed probes and measurements probes 3 jvm cpu Alarms Display Collect Blade Time 1 oo Free memory ME Store monitoring data Drawing time Frame is Polling period s ho CLIF Quick Start manual jvm probe vin cpu Alarms Display Collect Blade Time 1 ooo Free memory ME lt free memory ME used memory o free usable memory
14. profile BO Time Population Ramp style O Of Oo F Force stop Points Time Population Ramp style io 20 Fal Add point P Load profiles 3 E Profiles Time 2 Value 18 w B0 Your scenario is now ready to use 3 4 Make and run a test plan with a load injector 3 4 1 Create a test plan To deploy and run this scenario we must define a CLIF test plan including a load injector running the scenario First create a test plan named httpSimple ctp see section 2 2 3 4 2 Add a load injector to the test plan Click on the Add button and set the following properties 17 CLIF Quick Start manual Id keep the default value or set any name meaningful to you e Server keep local host e Role select Injector Class enter IsacRunner which specifies that the load test will use the ISAC extension caution this name is case sensitive Arguments the name of the ISAC scenario file httpSimple xis thy HttpSimple ctp 3 Test Plan Editor Injectors and probes Properties All injectors and probes in the test plan Manage injector and probe properties Id Server a nn ae Server local host 7 Remove All Bale injector Class TsacRunner Arguments AkkpSinple xis Comment Edit 3 4 3 Deploy and run Deploy the test plan see section 2 4 Then initialize and start the test see section 2 5 During test execution you may monitor some monitoring statistics about respon
15. se times throughput and errors 18 March 19th 2013 us Monitor 3 httpSimple httpSimple 2 5 injector Alarms Display Collect Blade ae pote ee 0 7 5g 0110 Store monitoring data Drawing time frame s Polling period s When the test execution is complete you may collect measurements in order to analyze them later see section 2 5 5 Furthermore a quick statistical synthesis on response times is automatically generated in the stats directory of the CLIF test project look for file quickstats csv 19 CLIF Quick Start manual 4 Http capture and replay 4 1 Rationale When writing a virtual user behavior it is not always easy to know all the requests that will be issued A convenient way of defining a behavior for web testing is to enhance a web browser with some special tooling that can record all HTTP requests and possibly the real think times and generate a virtual user behavior The CLIF console provides such a tool able to generate an ISAC scenario from a real user session Basically it is an HTTP proxy that records URIs and measure think times 4 2 Capturing a real web user session 4 2 1 Launch Http capture First select wizard New HTTP Capture TS Navigator E3 S OFS httpSimple xis 2 2 T ia lt param natr o pee lt param natr E CLIF Project Ga Into LE ISAC Plug in Project Open in Mew Window FP Project 45 Copy hy CLIF Test Plan thy Test Deployment T a D
16. t Once the test is completed you may collect data in the report directory with the Collect button This should be immediate since the probe 1s local 2 6 Results Once collected test data are available in the report directory TS Navigator 23 7 7 7 E QuickStart E E report EBeesorobes 2009 12 16 11h07m28 Ge 0 EL CPU CPU classname lifecycle lifecycle classname D 0 D p server prop 9 ny ETT fu y WM Wh classname lifecycle lifecycle classname E server prop th probes 2009 12 16 11h07m28 ctp L stats Ey project clif praps Mu probes ctp my ES 11 CLIF Quick Start manual 3 scenario for web testing Let s create a scenario to generate HTTP Get requests This scenario defines a sequence of actions and think times to be executed during the test such a sequence is called a behavior This behavior will be replicated and executed in parallel by virtual users The number of simultaneously active virtual users running this behavior according to elapsed test time 1s specified by a load profile As for almost every utilization of CLIF we use CLIF s ISAC extension dedicated to scenario definition and execution 3 1 Create a scenario with the ISAC environment First let s create an Isac Scenario with the New Isac Scenario wizard TS Navigator 53 2 ES 7 7 z gt Mew E CLIF Project E Go Into L ISAC Plug in Project E Open in Mew Window F Project lt
17. upport for injection protocols HTTP FTP SIP etc data set generation or think times Be httpSimple xis E3 Import Page Plug ins List of plug ins used in this scenario Remove Remove All Help Add behavior Design Source Import Behavior BO Finally the Behavior tab provides a high level editor for defining a virtual user behavior It is the recommended way to edit behaviors since it is much more user friendly and safe than the Source 13 CLIF Quick Start manual edition tab This behavior s default name is BO You may define as many behaviors as you like all identified by whatever unique name Te httpSimple xis 23 Behavior Page Edition page for behavior description Behavior id t Load profile Behavior tree Insert at begin Insert at end Remove Clear Help Design Source Import Behavior BO 3 3 Writing a scenario 3 3 1 Import necessary plug ins Since we want to make some web testing we need to import the HttpInjector plug in which provides all the client primitives of the HTTP protocol Go back to the Import tab click on the Add button and select HttpInjector in the plug in list It is recommended to rename the imported plug in s id from the default name HttpInjector_Q to a simpler name say http Save the scenario 14 ISAC Plugins GK Add a new plug in lt UdpInjector HttpInjector ReEpInjector Chrono F tpInjector Context lt
Download Pdf Manuals
Related Search