Home

Tsung User`s Manual (English, PDF)

1. Tsung Users manual http tsung erlang projects org Page 19 51 30 31 32 33 34 35 36 37 IJaU kh WN Pune tributed load testing too ng 6 Understanding tsung xml configuration file Sessions lt www_authenticate userid Aladdin passwd open sesame gt lt http gt lt request gt lt session gt lt session name backoffice probability 30 gt lt session gt lt sessions gt If you use an absolute URL the server used in the URL will override the one specified in the lt server gt section The following relative requests in the session will also use this new server value until a new ab solute URL is set New in 1 2 2 You can add any HTTP header now as in lt request gt lt http url bla method POST contents bla blusamp name glop gt lt www_authenticate userid Aladdin passwd open sesame gt lt http_header name Cache Control value no cache gt lt http_header name Referer value http www w3 org gt lt http gt lt request gt New in 1 3 0 You can also read the content of a POST or PUT request from an external file lt http url mypage method POST contents_from_file tmp myfile gt Since 1 3 1 you can also manually set a cookie though the cookie is not persistent you must add it in every lt requests gt lt http url gt lt add_cookie key foo value bar gt lt add_cookie key id
2. lt request gt lt http url page id _counter gt lt http gt lt request gt lt for gt Tsung Users manual http tsung erlang projects org Page 35 51 unne UR unn o TAU au tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features lt repeat gt Repeat the enclosing action whileluntil some condition This is intended to be used together with dyn_variable declarations List of attributes name Name of the repeat max_repeat Max number of loops The last element of repeat must be either lt while gt or lt until gt example lt repeat name myloop max_repeat 40 gt lt request gt lt dyn_variable name result re Result gt lt http url random method GET version 1 1 gt lt http gt lt request gt lt until var result eq 5 gt lt repeat gt Since 1 3 1 it s also possible to add if statements based on dynamic variables lt if gt lt if var tsung_userid eq 3 gt lt request gt lt http url foo gt lt request gt lt request gt lt http url bar gt lt request gt lt if gt You can use eg or neq to check the variable lt foreach gt Repeat the enclosing actions for all the elements contained in the list specified The basic syntax is as follows lt foreach name element in list gt lt request subst true gt lt ht
3. lt setdynvars sourcetype random_string length 10 gt lt var name nick1 gt lt setdynvars gt lt request subst true gt lt jabber type muc join ack local room room _room nick _nick1 gt lt request gt lt use a for loop to send several messages to the room gt lt for from 1 to 6 var i gt lt thinktime value 30 gt lt request subst true gt lt jabber type muc chat ack no_ack size 16 room rooms _rooms gt lt request gt lt for gt lt change nickname gt lt thinktime value 2 gt lt setdynvars sourcetype random_string length 10 gt lt var name nick2 gt lt setdynvars gt lt request subst true gt lt jabber type muc nick room room _rooms nick _nick2 ack no_ack gt lt request gt MUC support is available since version 1 3 1 PubSub Experimental support for PubSub is available in version 1 3 1 You can read the following entry https support process one net browse TSUN 115 Tsung Users manual http tsung erlang projects org Page 23 51 tributed load testing too ng 6 Understanding tsung xml configuration file Sessions VHost VHost support is available since version 1 3 2 Tsung is able to bench multiple vhost instances by choosing a vhost XMPP name from a list at connec tion time in the scenario The vhost list is read from a file
4. dygraph use dygraphs http danvk org dygraphs to render graphs noplot don t make graphics gnuplot command path to the gnuplot binary nohtm1 don t create HTML reports logy logarithmic scale for Y axis tdir lt template_dir gt Path to the HTML tsung templates noextra don t generate graphics from extra data os monitor etc rotate xtics rotate legend of x axes stats lt file gt stats file to analyse default tsung log img format lt format gt output format for images default png available format ps svg png pdf Version 1 4 0 adds a new graphical output based on http danvk org dygraphs 7 4 Tsung summary Figure B shows an example of a summary report 7 5 Graphical overview Figure 4 shows an example of a graphical report Tsung Users manual http tsung erlang projects org Page 38 51 tributed load testing too n g 8 References Tsung Plotter Tung AAA version 1 3 0 Main Statistics Stats Report highest 10sec lowest 10sec Highest Name mean mean Rate Mean cum e Main statistics 0 330 e Transactions connect 0 894 msec 0 298 msec 5703 5 sec msec 7647824 ki HER mr page 98 32 msec 210msec 5703 3 sec 2 22 mec 7647817 Counters request 0 432 msec 0 283 msec 36952 6 sec 307 50280854 e Server monitoring mes HTTP status session 1200 4 sec 1200 0 sec 4165 sec 122900 443059 Graphs Report Transactions Stat
5. lt session gt lt session name foo probability 100 type ts_http gt lt request gt lt http url method GET gt lt http gt lt request gt lt session gt lt sessions gt In this example we have two sessions one has a 0 probability and therefore will not be used in the first phase and the other 100 We define 3 users starting respectively 3mn and 5 seconds after the beginning of the test using the http example session one starting after 10 minutes and a last one starting after 11 minutes using the foo session this time 6 4 3 Duration of the load test By default tsung will end when all started users have finished their session So it can be much longer than the duration of arrivalphases If you want to stop Tsung after a given duration even if phases are not finished or 1f some sessions are still actives you can do this with the duration attribute in load feature added in 1 3 2 lt load duration 1 unit hour gt lt arrivalphase phase 1 duration 10 unit minute gt lt users interarrival 2 unit second gt lt users gt lt arrivalphase gt lt load gt Currently the maximum value for duration is a little bit less than 50 days unit can be second minute or hour 6 5 Setting options Default values can be set up globally thinktime between requests in the scenario SSL cipher algo rithms TCP UDP buffer sizes the default value is 32KB These values overrides th
6. add the dynamic variable list to dynamic substitutions UserAgent is now customizable for HTTP testing Add an option to run all components controller and launcher within a single erlang beam use controller vm Should ease idx tsunami use for light load tests fix bash script for solaris jasonwtucker gmail com fix several idx tsunami status can be run simultaneously reported by Adam Spotton internal Host header is now set during configuration phase fix last phase duration fix recorder must log absolute url if only the scheme has changed 2 gt 1 0 3 Minor bugfixes 8 Jul 2005 add ts file server module fix broken https recording Thx to johann messner jku at for bug reporting fix forgot to add when an URL is absolute and had a query part fix regression in the recorder introduced in 1 0 2 must use CAPS for method wrong content length in recorder causing POST requests to silently fail allow multiple dyn variable in DID fix Host header when port is 80 1 5 1 0 2 Minor bugfixes 6 Jun 2005 fix the recorder is working now with R10B replace call to httpd parse request header in recorder by an internal func the func was removed in R10B update configure scripts should build on RHEL3 x86 64 remote beam startup is now tunable r ssh rsh internal changes in ts os mon suggested by R Lenglet gt 1 0 1 Major bugfixes 18 Nov 2004 fix broken free m
7. lt set_option name rate_limit value 64 gt lt option gt Only the incoming traffic is rate limited currently 7 Statistics and reports 7 1 Available stats e request Response time for each request e page Response time for each set of requests a page is a group of request not separated by a think time e connect Duration of the connection establishment e reconnect number of reconnection e size rcv Size of responses in bytes e size sent Size of requests in bytes e session Duration of a user s session e users Number of simultaneous users e connected Number of simultaneous connected users new in 1 2 2 e custom transactions The mean response time for requests page etc is computed every 10 sec and reset That s why you have the highest mean and lowest mean values in the Stats report Since version 1 3 0 the mean for the whole test is also computed HTTP specific stats e counter for each response status 200 404 etc Jabber specific stats e request noack Counter of no ack requests Since response time is meaningless with no ack requests we keep a separate stats for this new in 1 2 2 e async unknown data rcv Only if bidi is true for a session counter the number of messages received from the server without doing anything new in 1 2 2 async data sent Only if bidi is true for a session Count the number of messages sent to the server in response of a message received from the server
8. maxusers 30000 gt 6 3 Monitoring Tsung is able to monitor remote servers using several backends that communicates with remote agent This is configured in the lt monitoring gt section Available statistics are CPU activity load average memory usage Note that you can get the nodes to monitor from a job scheduler like lt monitor batch true host torque type erlang gt lt monitor gt Several types of remote agents are supported erlang is the default 6 3 1 Erlang The remote agent is started by Tsung It use erlang communications to retrieve statistics of activity on the server For example here is a cluster monitoring definition based on Erlang agents for a cluster of 6 computers lt monitoring gt lt monitor host geronimo type erlang gt lt monitor gt lt monitor host bigfoot 1 type erlang gt lt monitor gt lt monitor host bigfoot 2 type erlang gt lt monitor gt lt monitor host f14 1 type erlang gt lt monitor gt lt monitor host f14 2 type erlang gt lt monitor gt lt monitor host db type erlang gt lt monitor gt lt monitoring gt Note monitored computers needs to be accessible through the network and erlang communications must be allowed no firewall is better SSH or rsh needs to be configured to allow connection without password on You must use the same version of Erlang OTP on all nodes otherwise it may not work properly
9. tsung erlang projects org Page 12 WR uN tributed load testing too ng 6 Understanding tsung xml configuration file PostgreSQL 5 1 PostgreSQL For PostgreSQL the proxy will connect to the server at IP 127 0 0 1 and port 5432 Use serverlP to change the IP and P portnumber to change the port 5 2 HTTP and WEBDAV For HTTPS recording use http instead of https in your browser New in 1 2 2 For HTTP you can configure the recorder to use a parent proxy but this will not work for https Add the u option to enable parent proxy and use serverlP to set the IP and P portnumber to set the port of the parent 6 Understanding tsung xml configuration file The default encoding is utf 8 You can use a different encoding like in lt xml version 1 0 encoding ISO 8859 1 gt 6 1 File structure Scenarios are enclosed into Tsung tags lt xml version 1 0 gt lt DOCTYPE tsung SYSTEM usr share tsung tsung 1 0 dtd gt lt tsung loglevel info gt lt tsung gt If you add the attribute dumptraffic true all the traffic will be logged to a file Warn this will considerably slow down Tsung so use with care It is useful for debugging purpose You can use the attribute dumptraffic light to dump only the first 44 bytes Since version 1 4 0 you have also a specific logging per protocol using dumptraffic protocol It s currently only implemented for HTTP this
10. 1 lt options gt 2 ih 3 lt option name file_server value domains csv id vhostfileld gt lt option gt 4 Ng 5 lt option type ts_jabber name vhost file value vhostfileld gt lt option gt 6 nae 7 lt options gt When each client starts a session it chooses randomly a domain each domain has the same probability Reading usernames and password from a CSV file Since version 1 4 0 you can now use a CSV file to store the usernames and password Configure the CSV file 1 lt options gt 2 lt option name file_server id userdb value home foo tsung users csv gt 3 lt options gt And then you have to defined two variables of type file and the first jabber request connect must include a xmpp_authenticate tag 1 2 lt session probability 100 name jabber example type ts_jabber gt 3 4 lt setdynvars sourcetype file fileid userdb delimiter order iter gt 5 lt var name username gt 6 lt var name password gt 7 lt setdynvars gt 8 9 lt request subst true gt 10 lt jabber type connect ack no_ack gt 11 lt xmpp_authenticate username _username passwd _password gt 12 lt jabber gt 13 lt request gt 14 15 lt thinktime value 2 gt lt thinktime gt 16 17 lt transaction name authenticate gt 18 19 lt request gt 20 lt jabber type auth_get ack local gt lt jabber gt 21 lt request gt 22 lt request gt 23 lt jabber type auth_set_plain ack local g
11. export user dn 1 user_dn _Pid DynVars gt SearchResultEntry proplists get_value search_result DynVars _ DN _ SearchResultEntry DN We aren t covering errors here supposing that there is always one and only one user found that we extract from the search result variable as defined in the previous search operation Each entry in the result set is a SearchResultEntry record The record definition can be found in lt TSUNG_DIR gt include ELDAPv3 hrl As we only need to access the distinguished name of the object we index into the result tuple directly But if you need to access other attributes you probably will want to include the appropriate hrl and use the record syntax instead One of the eight user password pairs in our users file was wrong so we expect 1 8 of the authentication attempts to fail Indeed after running the scenario we can confirm this in the Tsung report see figure B The bind operation maintains two counters 1dap_bind_ok and ldap_bind_error that counts successful and unsuccessful bind attempts Name Highest Rate Total numbe finish_users_count 87 sec 797 Idap_bind_error 10 9 sec 991 Idap_bind_ok 76 1 sec 6982 Figure 2 LDAP Results Other examples lt session probability 100 name ldap example type ts_ldap gt lt request gt lt ldap type bind user uid foo password bar gt lt request gt lt request gt lt ldap type search
12. gnuplot and perl5 optional for graphical output with tsung_stats pl script The Template Toolkit is used for HTML reports see http template toolkit org python and mathplotlib optional for graphical output with tsung plotter for distributed tests you need an ssh access to remote machines without password use a RSA DSA key without pass phrase or ssh agent rsh is also supported bash 3 2 Compilation configure make make install If you want to download the development version use git git clone git git process one net tsung mainline git see also htEps git process one net Esung You can also build packages with make deb on debian and ubuntu and make rpm on fedora rhel and other rpm based distribution 3 3 Configuration The default configuration file is tsung tsung xml there are several sample files in usr share doc tsung examples Log files are saved in tsung log A new sub directory is created for each test using the current date as name t sung log 20040217 0940 for ex Tsung Users manual http tsung erlang projects org Page 8 51 tributed load testing too ng 4 Benchmark approach Running 3 4 Running Two commands are installed in the directory SPREFIX bin tsung and tsung recorder A man page is available for both commands gt tsung h Usage tsung lt options gt start stop debug status Options f lt file gt s
13. setdynvars gt 4 A dynamic variable can be a random string lt setdynvars sourcetype random_string length 13 gt lt var name rndstringl gt lt setdynvars gt Wo 5 A dynamic variable can be a urandom string this is much faster than the random string but the string is not really random the same set of characters is always used 6 A dynamic variable can be generated by dynamic evaluation of erlang code 1 lt setdynvars sourcetype eval 2 code fun Pid DynVars gt 3 ok Val ts dynvars lookup md5data DynVars 4 ts_digest md5hex Val end gt 5 lt var name md5sum gt 6 lt setdynvars gt In this case we use tsung function ts dynvars lookup to retrieve the dynamic variable named md5data This dyn variable md5data can be set in any of the ways described in the Dynamic variables section 7 A dynamic variable can be generated by applying a JSONPath specification see 6 7 3 to an existing dynamic variable 1 lt setdynvars sourcetype jsonpath from notification jsonpath result state OK node gt 2 lt var name deployed gt lt setdynvars gt A setdynvars can be defined anywhere in a session 6 7 4 Checking the server s response With the tag match ina request tag you can check the server s response against a given string and do some actions depending on the result In any case if it matches this will increment the mat ch coun
14. tsung erlang projects org Page 16 51 Wek un tributed load testing too ng 6 Understanding tsung xml configuration file Setting options In this case only 100 users will be created in the first phases and 200 more during the second phase The complete sequence can be executed several times using the loop attribute in the load tag loop 2 means the sequence will be looped twice so the complete load will be executed 3 times feature available since version 1 2 2 The load generated in terms of HTTP requests seconds will also depend on the mean number of requests within a session if you have a mean value of 100 requests per session and 10 new users per seconds the theoretical average throughput will be 1000 requests sec 6 4 2 Statically generated users If you want to start a given session see at a given time during the test it is possible since version 1 3 1 lt load gt lt arrivalphase phase 1 duration 10 unit minute gt lt users interarrival 2 unit second gt lt users gt lt arrivalphase gt lt user session http example start_time 185 unit second gt lt user gt lt user session http example start_time 10 unit minute gt lt user gt lt user session foo start_time 11 unit minute gt lt user gt lt load gt lt sessions gt lt session name http example probability 0 type ts_http gt lt request gt lt http url method GET gt lt http gt lt request gt
15. value 123 gt lt http gt 6 6 3 Jabber XMPP Here is an example of a session definition for the Jabber XMPP protocol lt sessions gt lt session probability 70 name jabber example type ts_jabber gt lt request gt lt jabber type connect ack local gt lt request gt lt thinktime value 2 gt lt thinktime gt lt transaction name authenticate gt lt request gt lt jabber type auth_get ack local gt lt jabber gt lt request gt lt request gt lt jabber type auth_set_plain ack local gt lt jabber gt lt request gt lt transaction gt lt request gt lt jabber type presence initial ack no_ack gt lt request gt lt thinktime value 30 gt lt thinktime gt lt transaction name online gt lt request gt lt jabber type chat ack no_ack size 16 destination online gt lt request gt lt transaction gt lt thinktime value 30 gt lt thinktime gt lt transaction name offline gt lt request gt lt jabber type chat ack no_ack size 56 destination offline gt lt request gt lt transaction gt lt thinktime value 30 gt lt thinktime gt Tsung Users manual http tsung erlang projects org Page 20 51 tributed load testing too ng 6 Understanding tsung xml configuration file Sessions lt transaction name close gt lt request gt lt jabber type close ack local gt lt jabber gt lt request gt lt tr
16. 0 4 lt user_agent gt lt option gt Tsung Users manual http tsung erlang projects org Page 18 51 UR un tributed load testing too ng 6 Understanding tsung xml configuration file Sessions 6 6 Sessions Sessions define the content of the scenario itself They describe the requests to execute Each session has a given probability This is used to decide which session a new user will execute The sum of all session s probabilities must be 100 A transaction is just a way to have customized statistics Say if you want to know the response time of the login page of your website you just have to put all the requests of this page HTML embedded pictures within a transaction In the example above the transaction called index_request will gives you in the statistics reports the mean response time to get index en html header gif Be warn that If you have a thinktime inside the transaction the thinktime will be part of the response time 6 6 1 Thinktimes You can set static or random thinktimes to separate requests By default a random thinktime will be a exponential distribution with mean equals to value lt thinktime value 20 random true gt lt thinktime gt In this case the thinktime will be an exponential distribution with a mean equals to 20 seconds Since version 1 3 0 you can also use a range min max instead of a mean for random thinktimes the distribution will be u
17. 17 Aug 2010 LACA Bugfix TSUN 154 parent proxy doesn t work anymore in 1 3 x tested with 1 3 2 and 1 3 0 TSUN 155 url substitution is broken in some cases TSUN 156 Tsung not using sessions with low probabilities TSUN 157 ssl doesn t work with erlang R14A TSUN 158 failure when a proxy is used and an URL substitution is set TSUN 159 HTTP cookies support is broken when a proxy is used TSUN 160 tsung can sometimes hang at the beginning using distributed setup TSUN 161 if statement not allowed in a transaction ROA OCA O OA Tsung Users manual http tsung erlang projects org Page 46 51 tributed load testing too ng C CHANGELOG 1 3 1 5 1 3 2 Major bugfixes and enhancements 14 Jun 2010 Bugfix x TSUN 128 Apostrophes cause string to convert to deep list in setdynvars with Erlang function TSUN 130 static users starting time is wrong TSUN 131 tsung can stop too early when static users are used TSUN 132 http cookies accept domains equals to hostname with a leading TSUN 133 proxy recorder with SSL fails on large client packets multiple TCP packets TSUN 138 when an error occured for ex a timeout during a request and a client exits started transactions are not TSUN 140 tsung does not honor the Proxy Connection keep Alive or Connection keep Alive header if the proxy is HT TSUN 142 http recorder can fail with https rewriting and chunked encodin
18. 579 742 5470 223 2 231 56 970 91567888 58 stats size_rcv 2715777 3568647 stats 200 1869 2450 stats size_sent 264167 347870 stats dump at 1218093530 stats users 356 356 stats users_count 109 356 stats connected 32 215 stats page 110 3 346 0 408 5465 940 2 177 77 234 724492 245 stats request 1100 0 305 0 284 5 207 0 115 0 385 26785716 2450 stats connect 110 0 320 0 065 4 472 0 174 0 540 39158164 245 stats tr login 110 3 419 0 414 5470 223 2 231 90 461 548628831 245 Tsung Users manual http tsung erlang projects org Page 43 20 21 22 23 N tributed load testing too n g A Frequently Asked Questions How can I compute percentile quartiles median for transactions or requests response time stats size rcv 1602039 5170686 stats 200 1100 3550 stats size sent 150660 498530 the format is for request page session and transactions tr XXX stats name l1l0sec count 10sec mean 10sec_stdvar max min mean count or for HTTP returns code size stats name count during the last 10sec totalcount since the beginning A 7 How can I compute percentile quartiles median for transactions or requests response time It s not directly possible But since version 1 3 0 you can use a new experimental statistic backend set backend fullstats in the lt tsung gt section of your configuration file This will print every statistics data in a raw format in a file named tsu
19. In some cases you may want to use a value given by the server in a response later in the session and this value is dynamically generated by the server for each user For this you can use lt dyn_variable gt in the scenario Let s take an example with HTTP You can easily grab a value in a HTML form like lt form action go cgi method POST gt lt hidden name random_num value 42 gt lt form gt lt form gt with lt request gt lt dyn_variable name random_num gt lt dyn_variable gt lt http url testtsung html method GET version 1 0 gt lt http gt lt request gt Now random num will be set to 42 during the user s session It s value will be replace in all mark up of the form _random_num if and only if the request tag has the attribute subst true like lt request subst true gt lt http url go cgi version 1 0 contents username nic amp random_num _random_num amp amp op login content type application x www form urlencoded method POST gt lt http gt lt request gt Tsung Users manual http tsung erlang projects org Page 3 151 UR Wer wn N DURAN tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features Regexp If the dynamic value is not a form variable you can set a regexp by hand for example to get the title of a HTML page the regexp engine uses the
20. as HTTP first you start to record one or more sessions with the recorder tsung recorder p pgsql start This will start a proxy listening to port 8090 and will proxy requests to 127 0 0 0 5432 To choose another port and or address tsung recorder L 5432 I 10 6 1 1 P 5433 p pgsql start This will start a proxy listening to port 5432 and will proxy requests to 10 6 1 1 5433 4 4 MySQL benchmark approach A MySQL plugin for the recorder is not yet implemented so you have to write the session by yourself see section for more information 4 5 Jabber XMPP benchmark approach 4 5 1 Overview This paragraph explains how to write a session for Jabber XMPP There are two differences between HTTP and Jabber testing 1 There is no recorder for Jabber so you have to write your sessions by hand an example is provided in 6 63 2 the jabber plugin does not parse XML instead it uses packet acknowledgments 4 5 2 Acknowledgments of messages Since the jabber plugin does not parse XML historically it was for performance reasons you must have a way to tell when a request is finished There are 3 possibilities ack local as soon as a packet is received from the server the request is considered as completed Hence if you use a local ack with a request that do not require a response from the server presence for ex it will wait forever or until a timeout is reached ack no_ack as soon as the request is send it is considered as
21. away status Be right back ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt Tsung Users manual http tsung erlang projects org Page 2251 6 Understanding tsung xml configuration file tributed load testing too ng 6 Understanding tsung xml configuration file Sessions lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence directed show xa status I may never come back ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence directed ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt jabber type presence directed show chat status Available to chat ack no_ack gt lt jabber type presence directed show dnd status Don t bother me ack no_ack gt MUC Tsung supports three MUC operations 1 Join a room attribute type muc join 2 Send a message to a room attribute type muc chat 3 Change nickname attribute type muc nick 4 Exit a room attribute type muc exit Here s an example lt First choose an random room and random nickname gt lt setdynvars sourcetype random_number start 1 end 100 gt lt var name room gt lt setdynvars gt
22. can cur rently be used to stress HTTP WebDAV SOAP PostgreSQL MySQL LDAP and Jabber XMPP servers It is distributed under the GNU General Public License version 2 12 What is Erlang and why is it important for Tsung Tsung s main strength is its ability to simulate a huge number of simultaneous user from a single machine When used on cluster you can generate a really impressive load on a server with a modest cluster easy to set up and to maintain You can also use Tsung on a cloud like EC2 Tsung is developed in Erlang and this is where the power of Tsung resides Erlang is a concurrency oriented programming language Tsung is based on the Erlang OTP Open Transaction Platform and inherits several characteristics from Erlang e Performance Erlang has been made to support hundred thousands of lightweight processes in a single virtual machine e Scalability Erlang runtime environment is naturally distributed promoting the idea of process s location transparency e Fault tolerance Erlang has been built to develop robust fault tolerant systems As such wrong answer sent from the server to Tsung does not make the whole running benchmark crash More information on Erlang onhttp www erlang organdhttp www erlang projects org 1 3 Tsung background History e Tsung development was started by Nicolas Niclausse in 2001 as a distributed jabber load stress tool for internal use at now OpenTrust It has evolved as an open s
23. completed do not wait for incoming data ack global synchronized users its main use is for waiting for all users to connect before sending mes sages To do that set a request with global ack it can be the first presence msg 1 lt request gt lt jabber type presence ack global gt lt request gt Tsung Users manual http tsung erlang projects org Page 10 tributed load testing too ng 4 Benchmark approach Jabber XMPP benchmark approach You also have to specify the number of users to be connected 1 lt option type ts_jabber name global_number value 100 gt lt option gt To be sure that exactly global number users are started add the Maxnumber attribute to users 1 lt users maxnumber 100 interarrival 1 0 unit second gt lt users gt If you do not specify maxnumber the global ack will be reset every global number users New in 1 2 2 This version adds an new option for a session if you set the attribute bidi for bidirec tional in the session tag lt session bidi true gt then incoming messages from the server will be analyzed Currently only roster subscription requests are handled if a user received a subscription request lt presence type subscribe gt it will respond with a lt presence type subscribed gt message 4 5 3 Status Offline Connected and Online You can send messages to offline or onli
24. info athttp jmob objectweb org Ihttp www editions eyrolles com php accueil Ouvrages ouvrage php3 o0uv_ean1l3 9782212110791 http ww sics se joe thesis armstrong_thesis_2003 pdf mickael remond erlang fr org Tsung Users manual http tsung erlang projects org Page 40551 Beye tributed load testing too ng A Frequently Asked Questions A A1 Connected Users i Connected users Qualif p ue aa Connected users Prod ES o o w a o w Q o N ua o Um a Aman PA AA AA Simultaneous connections N o o i o o 50 NN at ee 2 A Lome 80 TOO 160 Minutes elapsed 60 Figure 5 Graphical output of tsplot Frequently Asked Questions Can t start distributed clients timeout error Most of the time when a crash happened at startup without any traffic generated the problem arise because the main Erlang controller node cannot create a slave Erlang virtual machine The message looks like Can t start newbeam on host XXXXX reason timeout Aborting The problem is that the Erlang slave module cannot start a remote slave node You can test this using this simple command on the controller node remotehost is the name of the client node gt erl rsh ssh sname foo setcookie mycookie Eshell V5 4 3 abort with G foo myhostname 15 slave start remotehost bar setcookie mycookie You sho
25. new in 1 2 2 Tsung Users manual http tsung erlang projects org Page 37 tributed load testing too n g 7 Statistics and reports Design 7 2 Design A bit of explanation on the design and internals of the statistics engine Tsung was designed to handle thousands of requests sec for very long period of times several hours so it do not write all data to the disk for performance reasons Instead it computes on the fly an estimation of the mean and standard variation for each type of data and writes these estimations every 10 seconds to the disk and then starts a new estimation for the next 10 sec These computations are done for two kinds of data e sample for things like response time sample counter when the input is a cumulative one number of packet sent for ex There are also two other types of useful data no averaging is done for those e counter a simple counter for HTTP status code for ex e sum for ex the cumulative HTTP response s size it gives an estimated bandwidth usage 7 3 Generating the report cd to the log directory of your test say tsung log 20040325 16 33 and use the script tsung_stats pl usr lib tsung bin tsung_stats pl You can generate the statistics even when the test is running use help to view all available options Available options help this help text verbose print all messages debug print receive without send messages
26. not define more pa arguments x TSUN 84 dyn variables that don t match should be set to an empty string Improvements x TSUN 40 problem to rewrite url for https with gzip encoded html x TSUN 48 tcp udp buffer size should be customizable in the XML config file x TSUN 59 if a User Agent header is set in lt header gt it should override the global one x TSUN 62 add abilty to loop back to a previous request in a session x TSUN 63 check for ssl and crypto application at compile time x TSUN 65 enhance dynamic variables x TSUN 66 add global mean and counter computation and reporting for samples x TSUN 69 add option to read content of a POST request from an external file x TSUN 79 setting Host header with http header doesn t work as expected New Features x TSUN 56 ldap plugin x TSUN 58 add a new statistics backend to dump all stats in a file x TSUN 61 add a Webdav plugin x TSUN 64 add md5 authentication in the pgsql plugin x TSUN 72 Add support for defining dyn variables using XPath x TSUN 78 mysql plugin x TSUN 80 add random thinktime with in a given range min max Tasks x TSUN 76 add explanation for errors name in the documentation 1 2 1 5 1 2 2 Minor bugfixes and enhancements 23 Feb 2008 Bugfix x TSUN 30 SNMP monitoring gives an error x TSUN 31 dyn variable usage x TSUN 35 udp is not working x TSUN 36 default regexp for dyn variable does
27. now record and replay SOAP HTTP scenario The SOAPAction HTTP header is now recorded Preliminary Windows support A workaround has been introduced in the code to handle behaviour difference between Erlang Un x and Erlang Windows on how the command line is handled When an assumtion is made on the string type of a parameter it should be check that this is actually a string and not an atom beta3 gt 1 0 beta4 Minor bugfixes 16 Mar 2004 fix lost cookie when transfer encoding chunked is used fix config parsing the last request of the last page of a sesssion was not marked as endpage don t crash anymore on error during start or stop beta2 5 1 0 beta3 Minor feature enhancements 24 Feb 2004 fix stupid bug in start script for recorder HTTP fix amp writes in the XML recorder for content attribute HTTP enhanced Cookies parsing domain and path implemented ssl_ciphers can be customized change log directory structure all log files in one directory per test add HTML reports requires the perl Template toolkit change stats names page resptime gt page response time gt request Tsung Users manual http tsung erlang projects org tributed load testing too ng C CHANGELOG 1 0 betal 5 1 0 beta2 Minor feature enhancements 11 Feb 2004 reorganise the sources add tools to build a debian package fix documentations add minimalistic man page synta
28. re module a Perl like regular expressions module for Erlang lt request gt lt dyn_variable name mytitlevar re slt titlesgt 81t titlesgt gt lt http url testtsung html method GET version 1 0 gt lt http gt lt request gt Previously before 1 4 0 Tsung uses the old regexp module from erlang This is now deprecated The syntax was lt request gt lt dyn_variable name mytitlevar regexp 6lt titlesgt amp lt titlesgt gt lt http url testtsung html method GET version 1 0 gt lt http gt lt request gt XPath A new way to analyze the server response has been introduced in the release 1 3 0 It is available only for the HTTP and XMPP plugin since it is based on XML HTML parsing This feature uses the mochiweb library and only works with erlang R12B and newer version This give us some benefices e XPath is simple to write and to read and match very well with HTML XML pages e The parser works on binaries and doesn t create any string e The cost of parsing the HTML XML and build the tree is amortized between all the dyn variables defined for a given request To utilize xpath expression use a xpath attribute when defining the dyn_variable instead of re like lt dyn_variable name fieldl_value xpath input name fieldl value gt lt dyn_variable name title xpath html head title text gt There is a bug in the xpath engi
29. request gt lt pgsql type parse name_prepared P0_10 gt lt CDATA UPDATE pgbench tellers SET tbalance tbalance 1 WHERE tid 2 gt lt pgsql gt lt request gt Tsung Users manual http tsung erlang projects org Page 25 tributed load testing too ng 6 Understanding tsung xml configuration file Sessions 12 lt request gt lt pgsql type sync gt lt request gt 13 lt request gt lt pgsql type parse name prepared P0 11 75x CDATA UPDATE pgbench branches 14 SET bbalance bbalance 1 WHERE bid 2 gt lt pgsql gt lt request gt 15 lt request gt lt pgsql type sync gt lt request gt 16 lt request gt lt pgsql type parse name_prepared P0_12 gt lt CDATA INSERT 17 INTO pgbench_history tid bid aid delta mtime 18 VALUES 1 2 3 4 CURRENT_TIMESTAMP gt lt pgsql gt lt request gt 19 lt request gt lt pgsql type sync gt lt request gt 20 lt request gt lt pgsql type parse name prepared P0_13 gt lt CDATA END gt lt pgsql gt lt request gt 21 lt request gt lt pgsql type sync gt lt request gt 22 lt request gt lt pgsql type bind name prepared P0 7 formats none formats_results text gt lt request gt 23 lt request gt lt pgsql type describe name_portal gt lt request gt 24 lt request gt lt pgsql type execute gt lt request gt 25 lt request gt lt p
30. type of protocol add reconnection support persistent client add basic HTTP and HTTPS support split the application in two parts a single controller tsunami controller and the clients tsunami switch to RIC 0 1 0 5 0 1 1 Bugfix realease Aug 2002 fix config file fix few typos in docs fix init script few optimizations in user server erl switch to R8B 0 1 0 Initial release May 2001 Tsung Users manual http tsung erlang projects org
31. where Pid is the Erlang process id of the current Tsung Users manual http tsung erlang projects org Page 29151 UN Uh Y x WR we N YOUR wNr tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features virtual user and DynData the list of all Dynamic variables Warn before version 1 1 0 the argument was just the Pid Here is an example of use of substitution in a Tsung scenario lt session name rec20040316 08 47 probability 100 type ts_http gt lt request subst true gt lt http url echo symbol symbol new method GET gt lt http gt lt request gt lt session gt Here is the Erlang code of the module used for dynamic substitution module symbol export new 1 new Pid DynData gt case random uniform 3 of 1 5 IBM 2 gt MSFT 3 5 RHAT end use er1c to compiled the code and put the resulting beam file in SPREFIX lib erlang lib tsung X X X ebin on all client machines As you can see writing scenario with dynamic substitution is simple It can be even simpler using dynamic variables see later If you want to set unique id you can use the built in functionts user server get unique id lt session name rec20040316 08 47 probability 100 type ts_http gt lt request subst true gt lt http url echo id ts_user_server get_unique_id method GET gt lt ht
32. 16 add ability to run several tsung running in parallel on the same hosts TSUN 120 Https recorder Remove Secure from Set Cookie header New Features TSUN 25 add a way to start sessions in a specific order at specified times TSUN 89 include tsung plotter into the tsung distribution TSUN 90 add support for monitoring server cpu mem using munin node TSUN 94 add log action for match TSUN 95 add a default dyn variable with a unique tsung userid TSUN 107 add MUC support to the jabber doc plugin TSUN 114 add option to apply function to data before looking for a match TSUN 115 add pubsub support to the jabber plugin CCAA AX HH HF HF FH HF HF HF FH FH ki N N gt 1 3 0 Major bugfixes and enhancements 03 Sep 2008 Bugfix x TSUN 30 SNMP monitoring gives an error TSUN 57 using 1 with a relative path make distributed load fails with timeout error TSUN 60 https recorder broken if an HTML document includes absolute urls TSUN 67 Typo breaks recording of if modified since headers TSUN 68 some sites doesn t work with 443 added in the Host header with https TSUN 71 Tsung does not work with R12B httpd util funs removed XXX Tsung Users manual http tsung erlang projects org Page 4751 tributed load testing too ng C CHANGELOG x TSUN 73 Wrong parsing HTTP multipart form data in http request POST form doesn t work x TSUN 75 can
33. 195 12 gt lt ip gt lt ip value 10 9 195 13 gt lt ip gt lt client gt lt client host memphis weight 3 maxusers 600 cpu 2 gt lt clients gt lt servers gt lt server host 10 9 195 1 port 8080 type tcp gt lt server gt lt servers gt Several virtual IP can be used to simulate more machines This is very useful when a load balancer use the client s IP to distribute the traffic among a cluster of servers New in 1 1 1 IP is no longer mandatory Tf not specified the default IP will be used New in 1 4 0 You can use zip scan yes value eth0 gt to scan for all the IP aliases on a given interface ethO in this example In this example a second machine is used in the Tsung cluster with a higher weight and 2 cpus Two Erlang virtual machines will be used to take advantage of the number of CPU Note Even if an Erlang VM is now able to handle severals CPUs erlang SMP benchmarks shows that it s more efficient to use one VM per CPU with SMP disabled for tsung clients Only the controller node is using SMP erlang Therefore cpu should be equal to the number of cores of your nodes If you prefer to use erlang SMP add the S option when starting tsung and don t set cpu in the config file By default the load is distributed uniformly on all CPU one cpu per client by default The weight parameter integer can be used to take into account the speed of the client machine For instance if one
34. If you can t have erlang installed on remote servers you can use one of the other available agents 6 3 2 SNMP The type keyword snmp can replace the erlang keyword if SNMP monitoring is preferred They can be mixed Since version 1 2 2 you can customize the SNMP version community and port number It uses the MIB provided in net snmp see also A 9 Tsung Users manual http tsung erlang projects org Page 15 51 Upon Pune u nn UN tributed load testing too ng 6 Understanding tsung xml configuration file Defining the load progression lt monitoring gt lt monitor host geronimo type snmp gt lt monitor host f14 2 type erlang gt lt monitor gt lt monitor host db type snmp gt lt snmp version v2 community mycommunity port 11161 gt lt monitor gt lt monitoring gt The default version is v1 default community public and default port 161 6 3 3 Munin Since version 1 3 1 Tsung is able to retrieve data from a munin node agent see http munin projects linpro no wiki munin node The type keyword must be set to munin for ex ample lt monitoring gt lt monitor host geronimo type munin gt lt monitor host f14 2 type erlang gt lt monitor gt lt monitoring gt 6 4 Defining the load progression 6 4 1 Randomly generated users The load progression is set up by defining several arrival phases lt load gt lt arrivalphase pha
35. LECT x from users lt pgsql gt lt request gt lt request gt lt pgsql type sql gt lt CDATA SELECT n nspname as Schema c relname as Name CASE c relkind WHEN r THEN table WHEN v THEN view WHEN i THEN index WHEN S THEN sequence WHEN s THEN 3 toto 5 END as Type u usename as Owner FROM pg_catalog pg_class c LEFT JOIN pg_catalog pg_user u ON u usesysid c relowner LEFT JOIN pg_catalog pg_namespace n ON n oid c relnamespace WHERE c relkind IN r v S AND n nspname NOT IN pg_catalog pg toast AND pg catalog pg table is visible c oid ORDER BY 1 2 gt lt pgsql gt lt request gt lt request gt lt pgsql type close gt lt pgsql gt lt request gt lt session gt Example with the extended protocol lt request gt lt pgsql type parse name_prepared P0_7 gt lt CDATA BEGIN gt lt pgsql gt lt request gt lt request gt lt pgsql type sync gt lt request gt lt request gt lt pgsql type parse name prepared P0 8 5x CDATA UPDATE pgbench accounts SET abalance abalance 1 WHERE aid 2 gt lt pgsql gt lt request gt lt request gt lt pgsql type sync gt lt request gt lt request gt lt pgsql type parse name_prepared P0_9 gt lt CDATA SELECT abalance FROM pgbench accounts WHERE aid 1 gt lt pgsql gt lt request gt lt request gt lt pgsql type sync gt lt request gt lt
36. Tsung User s manual tributed load testing tool n Version 1 4 0 References tsung user manual Printing Date September 5 2011 tributed load testing too ng Tsung manual CONTENTS Contents 4 1 1 Whatis Tsung s ceses ae RR ER e a A ee ee NG 4 MAPA DES 4 1 3 Tsung background 2 4 2 Features 5 2 1 TSung main features os ee BID PANG BNG Eee Be ees de hbng 5 2 2 HTTP Telated features coloso CR ERR PAR e BG eR A ai 6 2 3 WEBDAV related features ee ee 6 2 4 Jabber XMPP related features AA AA 6 AA PA te Geen E ean Se T AA ee 7 2 7 LDAP related features e 7 2 8 Complete reports set o e 7 yA a a Bed a it e dl As 7 8 Bl Dependencies o rcr o eae ew a a A 8 A AA E tes AI Gs dees Ge 8 Pesce NA Grea e Ge Ht gt ae ah te oe a ah ye os Se aes AA ee Os 8 34 ROAMING EI 9 35 Feedback casar ewe Rw eR he ae eS HEAD ee a 9 4 Benchmark approach 9 4 1 HTTP WebDAV benchmark approach 20 2000 eee ee eee 9 4 1 1 Benchmarking a Web server 2 2 AA 9 ag wae Poa et Ee DRA dde N 9 AA eee 10 4 2 LDAP benchmark approach 0 0 0 0 00000002200 10 4 3 PostgreSQL benchmark approach 00 0200 000 10 4 4 MySQL benchmark approach 0 02000000000 0004 10 4 5 Jabber XMPP benchmark approach 2 0 000000 00 10 Sloe a
37. a kan dona Gee 29 6 7 Advanced features s 0 GA ee ee 29 6 7 1 Dynamic substitutions ee 29 DAG ene A a E a ey eee amp AG AAO 30 Sees ot PbS A PING DIPANG a 31 AA dan do gen 34 6 7 5 Loops If Foreach AA Aa 35 6 7 6 Rate limiting a 37 7 Statistics and reports 37 T1 Available Stats o gt cca pa aaa AA KAG ma PA KANA NG KA ee ee i 37 A AN 38 71 3 Generating the report gt c s ps sa done ae E NG WELL EE Re eS 38 NA SUD sunmas ua ha Km GNG Be ee DD nA PANG ADE oe 38 dea Sb hah mp ORS ae ook PAD EG KANE DAWA A 38 pana bib A RA MESES KG Slee MG NG 39 5 ee eo A RAD be eae be eee ee ee 39 8 References 39 9 Acknowledgments 40 41 Seer Serer eC e eee eee eee 41 PDE boa ao bee eed edb hae he hie bee x 42 oss gy SB a a AS e Bede ley Sk 42 PER g Pad Sie Cee ee ee Ee LA 43 A 5 Can I dynamically follow redirect with HTTP 2 ee ee 43 POPE Bee ee PAA eae eS 43 A 7 How can I compute percentile quartiles median for transactions or requests response time 44 A 8 How can I specify the number of concurrent users 44 rigs te BE ot dS Re RE SRG SS eas Be 44 a hs alan Act ah Sy sgl ds AUG Gh Gace the NG 45 B Errors list 45 46 Tsung Users manual http tsung erlang projects org tributed load testing too ng 1 Introduction 1 Introduction 1 1 What is Tsung Tsung formerly IDX Tsunami is a distributed load testing tool It is protocol independent and
38. ansaction gt lt session gt lt sessions gt Roster What you can do with rosters using Tsung You can 1 Add a new contact to their roster The new contact is added to the Tsung Group group and their name matches their JID 2 Send a subscribe presence notification to the new contact s JID This results in a pending subscrip tion 3 Rename a roster contact This changes the previously added contact s name from the default JID to Tsung Testuser 4 Delete the previously added contact Note that when you add a new contact the contact JID is stored and used for the operations that follow It is recommended that for each session which is configured to perform these operations only do so once In other words you would NOT want to ADD more than one new contact per session If you want to alter the rate that these roster functions are used during your test it is best to use the session probability factor to shape this The nice thing about this is that when you test run is complete your roster tables should look the same as before you started the test So 1f you set 1t up properly you can have pre loaded roster entries before the test and then use these methods to dynamically add modify and remove roster entries during the test as well Example roster modification setup lt session probability 100 name jabber rostermod type ts_jabber gt lt connect authenticate roster get etc gt lt transac
39. ase Tsung Users manual http tsung erlang projects org Page 751 tributed load testing too ng 3 Installation 3 Installation This package has been tested on Linux FreeBSD and Solaris A port is available on MacOS X It should work on Erlang supported platforms Linux Solaris BSD Win32 and MacOS X 3 1 Dependencies Erlang OTP R12B 5 and up http www erlang oxg download htmi Erlang is now part of fedora and debian ubuntu repositories pgsql module made by Christian Sunesson for the PostgreSQL plugin sources available at http jungerl sourceforge net The module is included in the source and binary distribution of Tsung It is released under the EPL License mysql module made by Magnus Ahltorp amp Fredrik Thulin for the mysql plugin sources available athttp www stacken kth se projJekt yxa The modified module is included in the source and binary distribution of Tsung It is released under the three clause BSD License eldap module for the LDAP plugin sources available at http Jungerl sourceforge net The module is included in the source and binary distribution of Tsung It is released under the GPL License mochiweb libs for xpath parsing optionally used for dynamic variables in the HTTP plugin sources available at http code google com p mochiweb The module is included in the source and binary distribution of Tsung It is released under the MIT License
40. ated features The WebDAV RFC 4918 plugin is a superset of the HTTP plugin It adds the following features some versionning extensions to WebDAV RFC 3253 are also supported 2 4 Methods implemented DELETE CONNECT PROPFIND PROPPATCH COPY MOVE LOCK UNLOCK MKCOL REPORT OPTIONS MKACTIVITY CHECKOUT MERGE Recording of DEPTH IF TIMEOUT OVERWRITE DESTINATION URL and LOCK TOKEN Headers Jabber XMPP related features Authentication plain text digest and sip digest presence and register messages Chat messages to online or offline users MUC join room send message in room change nickname Roster set and get requests Global users synchronization can be set on specific actions raw XML messages PubSub Multiple vhost instances supported Tsung Users manual http tsung erlang projects org Page 6151 tributed load testing too ng 2 Features PostgreSQL related features 2 5 PostgreSQL related features e Basic and MD3 Authentication e Simple Protocol e Extended Protocol new in version 1 4 0 e Proxy mode to record sessions 2 6 MySQL related features This plugin is experimental It works only with MySQL version 4 1 and higher e Secured Authentication method only MySQL gt 4 1 e Basic Queries 2 7 LDAP related features e bind e add modify and search queries e starttls 2 8 Complete reports set Measures and statistics produced by Tsung are extremely feature full They ar
41. ater in the session for request substitution add response pattern to match log if not match HTTP fix partial header parsing mickael remond erlang fr org HTTP fix chunk parsing when the chunk size is split across two packets HTTP fix parsing of no content length with connection close case check for bad input config file sclient5 name merge client and client rcv processes into a single process fix do not connect in init anymore this fix too long phases when connection time is high connect stat is now for both new connections and reconnections check phase duration in launcher various code cleanup beta4 gt 1 0 beta5 Major Feature enhancements 25 Mar 2004 add SNMP monitoring not yet customizable fix remote start log filename is now encoded to avoid bad parsing of log file by erl Patches from mickael remond erlang fr org Added idx tsunami creation in idx tsunami script if the directory does not already exist Extension of XML attribute entity normalisation HTIP fix Cookie support Cookie are not necessarily separated by HTTP fix long POST request in the recorder dorecord message was missing enclosing curly brackets and the body length counter were mistakenly taking the header size in its total HTTP Content type support in the recorder needed to handle non HTML form encoded posts add autoconf support to detect Erlang installation path SOAP Support IDX Tsunami can
42. base dc pablo desktop filter cn user2 scope wholeSubtree gt lt ldap gt lt request gt Tsung Users manual http tsung erlang projects org Page 28 51 tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features lt Add Adds a new entry to the directoryx gt lt request subst true lt ldap type add dn 35 new user dn33 gt lt attr type objectClass gt lt value gt organizationalPerson lt value gt lt value gt inetOrgPerson lt value gt lt value gt person lt value gt lt attr gt lt attr type cn gt lt value gt _new_user_cn lt value gt lt attr gt lt attr type sn gt lt value gt fffs lt value gt lt attr gt lt ldap gt lt request gt lt Modify Modifies an existing entry type add delete modify gt lt request subst false gt lt ldap type modify dn cn u119843 dc pablo desktop gt lt modification type replace gt lt attr type sn gt lt value gt SomeSN lt value gt lt attr gt lt attr type mail gt lt value gt some mail com lt value gt lt attr gt lt modification gt lt ldap gt lt request gt lt session gt 6 6 7 Mixing session type Since version 1 3 2 a new tag change_type can be used in a session to change it s type lt request gt lt jabber type chat ack no_ack size 16 destination offline gt lt request gt lt thinktime value 3 gt lt change_t
43. d is successful the user is authenticated this is the scheme used among others by the LDAP authentication module for Apache http httpd apache org docs 2 0 mod mod_auth_1ldap htm Tsung Users manual http tsung erlang projects org Page 26 51 DUDO BA yo UR uN x tributed load testing tool 6 Understanding tsung xml configuration file Sessions ldap simple xml process one k Program Settings Help Browser Choose plugin O a KK x Entries Distinguis pablo desktop dc pablo desktop cn admin ObjectClass v ou users organizatiol haan paa person N nipa inetOrgPers gt SC tributes ou users2 cn jane en gt cn mary sn cn paul userPasswor Figure 1 LDAP Hierarchy LDAP Setup For this example we are going to use a simple repository with the following hierarchy the repository has users in two organizational units 1 users with four members 2 users2 with tree members For simplicity we set the password of each user to be the same as its common name cn Tsung Setup We will use a CSV file as input containing the user password pairs for our test So we start by writing it in this case we name the file users csv userl userl user2 user2 user3 user3 user4 user4 jane jane mary mary paul pablo paul paul the pair paul pablo should fail to authenticate we will note that in the Tsung report Then in our Tsung scenario we let Tsung know about
44. e all represented as a graphic Tsung produces statistics regarding e Performance response time connection time decomposition of the user scenario based on request grouping instruction called transactions requests per second e Errors Statistics on page return code to trace errors e Target server behaviour An Erlang agent can gather information from the target server s Tsung produces graphs for CPU and memory consumption and network traffic SNMP and munin is also supported to monitor remote servers Note that Tsung takes care of the synchronization process by itself Gathered statistics are synchro nized It is possible to generate graphs during the benchmark as statistics are gathered in real time 2 9 Highlights Tsung has several advantages over other injection tools e High performance and distributed benchmark You can use Tsung to simulate tens of thousands of virtual users e Ease of use The hard work is already done for all supported protocol No need to write complex scripts Dynamic scenarios only requires small trivial piece of code e Multi protocol support Tsung is for example one of the only tool to benchmark SOAP applications e Monitoring of the target server s to analyze the behaviour and find bottlenecks For example it has been used to analyze cluster symmetry is the load properly balanced and to determine the best combination of machines on the three cluster tiers Web engine EJB engine and datab
45. e carta PE ech Verte eae toes Th Ries To aa AG dhan a Bas 10 a ie ee Gane Dele Me Ae Coe a Bie J 10 4 5 3 Status Offline Connected and Online 11 Cp Pa Rawat abe owed PE dba 11 12 S L PoststeSQU i trite es a Ba ee Ae ae bh ee EA Se A 13 he hh oo how Kab JUD he hh Ah ee eS 13 6 Understanding tsung xml configuration file 13 6 1 File structure s e eae eee eh ke BA RE eG Eee Ee ee Ea 13 6 2 Clients and Servet a es a RRP AR os eR RA 14 6 2 1 Basic Setup s a se eR RA ee ee ee ee 14 6 2 2 Advanced Setup 14 Yee ee oo ie ae eee ee GO NG 15 6 3 Monitoring ui oe ee ee A Dae ORS A 15 A AA 15 EPA NA BANG GRABA DRA eed GANA DD Sed ean MA 15 Tsung Users manual http tsung erlang projects org tributed load testing too ng Tsung manual CONTENTS ado Ka Db WG Sb BA a Doo bd HG 16 Met hh A RA e Ka 16 6 4 1 Randomly generated users o e e 16 paan dd a DP ERA habia beta 17 6 4 3 Duration of the load test a 17 e eek ngana JOG oe AnG e NN ann man Ek eo 17 6 5 1 XMPP Jabber options 0 18 AA oS eee ye RS a ok Fae A 18 6 6 SESSIONS 2 xa saa ba Se OES is 19 661 Think times ag a Sh ak ae HY Ae RON ee A 19 6 6 2 HTTP ne Be Oba oP Hee SG rs PAS OOS a EAE SS 19 66 3 Jabber MPB a enh Ok RR EE Oe A ek ASS BAS oa as 20 25 26 6 26 ts rada Ge Ba Be mak Ge apa Germ Be ge Gal
46. e_limit value 1024 gt lt option gt 6 5 1 XMPP Jabber options Default values for specific protocols can be defined Here is an example of option values for Jabber XMPP lt option type ts_jabber name global_number value 5 5 lt option type ts_jabber name userid_max value 100 gt lt option type ts_jabber name domain value jabber org gt lt option type ts_jabber name username value myuser gt lt option type ts_jabber name passwd value mypasswd gt lt option type ts_jabber name muc_service value conference localhost gt Using these values users will be myuserXXX where XXX is an integer in the interval 1 userid_max and passwd mypasswdXXX If not set in the configuration file the values will be set to e global number 10000 e userid max 100 e domain erlang projects org e username tsunguser e passwd sesame You can also set the muc_service here see previous example 6 5 2 HTTP options For HTTP you can set the UserAgent values available since Tsung 1 1 0 using a probability for each value the sum of all probabilities must be equal to 100 lt option type ts_http name user_agent gt lt user_agent probability 80 gt Mozilla 5 0 X11 U Linux 1686 en US rv 1 7 8 Gecko 20050513 Galeon 1 3 21 lt user_agent gt lt user_agent probability 20 gt Mozilla 5 0 Windows U Windows NT 5 2 fr FR rv 1 7 8 Gecko 20050511 Firefox 1
47. ed 3 000 requests per second 10 million simultaneous users running on a 75 computers cluster generating more million requests per second Tsung has been used at e SunTMfor their Mooddlerooms platform on Niagara processors http blogs sun com kevinr DGI Direction G n rale des imp ts French finance ministry Cap Gemini Ernst amp Young IFP Institut Francais du P trole French Research Organization for Petroleum LibertySurf resource Moodle Sun RA pdf 2 Features 2 1 Tsung main features than one High Performance Tsung can simulate a huge number of simultaneous users per physical computer It can simulates thousands of users on a single CPU Note a simulated user is not always active it can be idle during a thinktime period Traditional injection tools can hardly go further than a few hundreds Hint if all you want to do is requesting a single URL in a loop use ab but if you want to build complex scenarios with extended reports Tsung is for you Distributed the load can be distributed on a cluster of client machines Multi Protocols using a plug in system HTTP both standard web traffic and SOAP WebDAV Jab ber XMPP and PostgreSQL are currently supported LDAP and MySQL plugins were first in the 1 3 0 release SSL support Several IP addresses can be used on a single machine using the underlying OS IP Aliasing included OS monitoring CPU memory and network traffic using Erlang agen
48. ed subset of JSONPath as defined here To utilize jsonpath expression use a jsonpath attribute when defining the dyn_variable instead of re like lt dyn_variable name array3_value jsonpath field array 3 value 5 You can also use expressions Key Val e g lt dyn_variable name myvar jsonpath field array name bar value gt PostgreSQL New in 1 3 2 Since the postgreSQL protocol is binary regexp are not useful to parse the output of the server In stead a specific parsing can be done to extract content from the server s response to do this use the pgsql_expr attribute Use data_row L C to extract the column C of the line L of the data output You can also use the literal name of the column ie the field name of the table This example extract 3 dynamic variables from the server s response First one extract the 3rd column of the fourth row then the mt ime field from the second row and then 1t extract some data of the row_description lt request gt lt dyn_variable name myvar pgsql_expr data_row 4 3 gt lt dyn_variable name mtime pgsql expr data row 2 mtime 5 sdyn variable name row pgsql_expr row_description 1 3 1 gt lt pgsql type sql gt SELECT x from pgbench history LIMIT 20 lt pgsql gt lt request gt A row description looks like this INFO REPORT 14 Apr 2010 11 03 22 ts_pgsql 7 lt 0 102 0 gt PGSQL Pair row_description t
49. em on non linux arch Matthew Schulkind add script to convert apache log file combined to idx tsunami XML improved configure add with erlang option and xmerl PATH detection idx tsunami now compiles both with RIC and R10B Tsung Users manual http tsung erlang projects org tributed load testing too ng C CHANGELOG small fixes to the DID Thx to Jonathan Bresler for testing and bug reporting fix broken global local and no ack requests and size computation fix broken ids in jabber messages fix broken online offline in user server default thinktime can now be overriden many improvements fixes in analyse_msg pl beta7 5 1 0 Minor bugfixes 13 Aug 2004 fix broken path when building debian package add rpm target in makefile implement status add match in graph and doc fix add dynparams for jabber betab gt 1 0 beta7 Minor bugfixes 20 Jul 2004 HTTP really fix parsing of no content length with connection close better handling of configure prefix is working add different types of output backend currently only text works rrdtool is started but unfinished fix ssl_ciphers option is working again beta5 gt 1 0 beta6 Minor feature enhancements 5 May 2004 add a DTD for the configuration file add dynamic request substitution mickael remond erlang fr add dynamic variable parsing from response can be used l
50. emfile error means too many open files This happens usually when you set a high value for maxusers in the lt client gt section the default value is 800 The errors means that you are running out of file descriptors you must check that maxusers is less than the maximum number of file descriptors per process in your system see ulimit n You can either raise the limit of your operating system see etc security limits conf for Linux or decrease maxusers Tsung will have to start several virtual machine on the same host to bypass the maxusers limit Tsung Users manual http tsung erlang projects org Page 42 51 UD RAY tributed load testing too n g A Frequently Asked Questions Tsung still crashes fails when I start it A4 Tsung still crashes fails when I start it First look at the log file t sung log XXX tsung_controller yourhostname to see if there is a problem If the file is not created and a crashed dump file is present maybe you are using a binary installation of Tsung not compatible with the version of erlang you used If you see nothing wrong you can compile Tsung with full debugging recompile with make debug and don t forget to set the loglevel to debug in the XML file To start the debugger or see what happen start tsung with the debug argument instead of start You will have an erlang shell on the tsung controller node Use toolbar start to launch the graphical tools provided b
51. et configuration file default is tsung tsung xml l lt logfile gt set log file default is tsung log tsung 1log i lt id gt set controller id default is empty r lt command gt set remote connector default is ssh F use long names FQDN for erlang nodes y print version information and exit h display this help and exit A typical way of using tsung is to run tsung f myconfigfile xml start The command will print the current log directory created for the test and wait until the test is over 3 5 Feedback Use the Tsung mailing list eehttps lists process one net mailman listinfo tsung users if you have suggestions or questions about Tsung You can also use the bug tracker available at htt ps support process one net browse TSUN You can also try the tsung IRC channel on Freen ode 4 Benchmark approach 4 1 HTTP WebDAV benchmark approach 4 1 1 Benchmarking a Web server 1 Record one or more sessions start the recorder with tsung recorder start and then con figure your browser to use Tsung proxy recorder the listen port is 8090 A session file will be created For HTTPS recording use http instead of https in your browser 2 Edit organize scenario by adding recorded sessions in the configuration file 3 Write small code for dynamic parts if needed and place dynamic mark up in the scenario 4 Test and adjust scenario to have a nice progression of the load This is highly dependent
52. g TSUN 147 UDP amp bidi does not seem to work TSUN 148 dynvar not found when used in match TSUN 149 tsung doesn t work with Amazon Elastic load balancing x TSUN 151 tsung stats p1 produces invalid x gplot files Improvements x TSUN 82 XMPP vhost support x TSUN 127 add ability tu use floats for thinktimes x TSUN 139 option to set random seed for launchers x TSUN 141 add dynamic variable support for postgres x TSUN 146 New tsplot yfactor configuration support breaks most common configurations New Features TSUN 135 add support for SASL ANONYMOUS and PLAIN authentication for XMPP TSUN 136 add new plugin distributed testing of filesystem nfs for ex using a generic mode for executing erlang 1 TSUN 137 add a way to mix requests types inside a single session TSUN 143 global time limit for the load test TSUN 145 tsung should support json parsing for dynamic variable 1 3 0 5 1 3 1 Major bugfixes and enhancements 9 Sep 2009 Bugfix TSUN 92 the computation of the minimum for sample counter is wrong 4 4 4 FF OR E XX x TSUN 93 maxnumber not respected if several clients are used x TSUN 102 dyn variable configuration fails if variable name is not a valid erlang atom x TSUN 103 Network error handling in munin plugin x TSUN 104 tsung plotter can t handle the os mon statistics x TSUN 108 Cannot handle complicated dyn var name x TSUN 109 Tsung status displa
53. gsql type sync gt lt request gt 26 lt request gt lt pgsql type bind name_portal name _prepared P0_8 27 formats none formats results text 28 parameters 2924 37801 gt lt request gt 6 6 5 MySQL For MySQL 4 types of requests are available same as PostgreSQL 1 connect to a given database with a given username 2 authenticate with password or not 3 sql 4 close This example shows most of the features of a MySQL session 1 lt session probability 100 name mysql example type ts mysql 2 lt request gt 3 lt mysql type connect gt 4 lt request gt 5 lt request gt 6 lt mysql type authenticate database test username test password test gt 7 lt request gt 8 lt request gt 9 lt mysql type sql gt SHOW TABLES lt mysql gt 10 lt request gt 1 lt request gt 12 lt mysql type sql gt SELECT x FROM mytable lt mysql gt 13 lt request gt 14 lt request gt 15 lt mysql type close gt 16 lt request gt 17 lt session gt 6 6 6 LDAP Authentication The recommended mechanism used to authenticate users against a LDAP repository requires two steps to follow Given an username and password we 1 Search the user in the repository tree using the username so users can reside in different subtrees of the organization 2 Try to bind as the user with the distinguished name found in the first step and the user s password If the bin
54. gt 11 ba 12 lt session gt digest authentication as described in XMPP JEP 0078 Non SASL Authentication jabber org jeps jep 0078 html Tsung Users manual http tsung erlang projects org Page 1 151 sau kk WHE tributed load testing too ng 5 Using the proxy recorder lt session probability 100 name jabber digest type ts_jabber gt 1 2 3 lt regexp captures stream ID returned by server gt 4 lt request gt 5 lt dyn_variable name sid re amp lt stream stream id amp quot quot xmlns stream gt 6 lt jabber type connect ack local gt lt jabber gt 7 lt request gt 8 9 lt thinktime value 2 gt lt thinktime gt 11 lt transaction name auth_digest gt 12 lt request gt lt jabber type auth_get ack local gt lt jabber gt lt request gt 13 lt request subst true gt lt jabber type auth_set_digest ack local gt lt jabber gt lt request gt 14 lt transaction gt 15 ans 16 lt session gt e sip digest authentication lt session probability 100 name jabber sipdigest type ts_jabber gt 1 2 3 lt request gt lt jabber type connect ack local gt lt jabber gt lt request gt 4 5 lt thinktime value 2 gt lt thinktime gt 6 7 lt transaction name auth_sipdigest gt 8 lt regexp captures nonce value returned by server gt 9 lt request gt 10 lt dyn_variable name nonce 11
55. gt lt match do abort when match gt Error lt match gt lt http url index php method GET gt lt request gt You can also do the action on nomatch instead of match If you want to skip the HTTP headers and match only on the body you can use skip headers http Also you can apply a function to the content before matching for example the following example use both features to compute the md5sum on the body of a HTTP response and compares it to a given value lt match do log when nomatch skip headers http apply to content ts digest md5hex gt 01441debe3d7cc65ba843eeelacff89d lt match gt lt http url method GET version 1 1 gt You can also use dynamic variables using the subst attribute lt match do log when nomatch subst true gt _myvar lt match gt lt http url method GET gt 6 7 5 Loops If Foreach Since 1 3 0 it s now possible to add conditional unconditional loops in a session Since 1 4 0 it is possible to loop through a list of dynamic variables thanks to foreach lt for gt Repeat the enclosing actions a fixed number of times A dynamic variable is used as counter so the current iteration could be used in requests List of attributes from Initial Value to Last value incr Amount to increment in each iteration var Name of the variable to hold the counter lt for from 1 to 10 incr 1 var counter gt
56. he recorder x TSUN 179 tsung generated message stanzas are not XMPP compliant TSUN 180 file server crash if a dynamic substitution use it TSUN 182 When many clients are configured with few static users none of them are launched x TSUN 183 tsung can stop too soon in some cases TSUN 184 random number with start and end actually returns a number from startt1 to end x TSUN 187 Client IP scan is very slow on Linux also uses obsolete ifconfig Improvements x TSUN 54 tsung is very slow when a lot of dynamic variables are set x TSUN 96 generating more than 64k connections from a single machine x TSUN 106 Add content encoding support for dynvar extraction x TSUN 123 add option to read usernames from an external file for jabber x TSUN 125 use the new re module everywhere instead of regexp gregexp x TSUN 152 Add state rcv record as parameter to get message function x TSUN 153 dynvar used in match may contain regexp special characters x TSUN 185 handle postgresql extended protocol New Features TSUN 162 add foreach tag loop when a dyn variable is a list TSUN 164 add a switch to allow light queries replies logging TSUN 165 add a way to synchronize users for all plugins TSUN 167 add do dump option to matching TSUN 168 thinktimes value could be dynamically generated with dyn variable TSUN 181 add option to simulate slow connections 1 3 2 5 1 3 3 Minor bugfixes
57. id text 1 23 4 1 16395 bid text 2 23 4 1 16395 aid text 3 23 4 1 16395 delta text 4 23 4 1 16395 mtime text 5 1114 8 1 16395 filler text 6 1042 1 26 16395 So in the example the row variable equals aid set dynvars Since version 1 3 0 more powerful dynamic variables are implemented You can set dynamic variables not only while parsing server data but you can build them using external files or generate them with a function or generate random numbers strings Six types of dynamic variables are currently implemented sourcet ype tag 1 Dynamic variables defined by calling an erlang function lt setdynvars sourcetype erlang callback ts user server get unique id lt var name id1 gt lt setdynvars gt Wo 2 Dynamic variables defined by parsing an external file Tsung Users manual http tsung erlang projects org Page 33 51 UR un tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features lt setdynvars sourcetype file fileid userdb delimiter order iter gt lt var name user gt lt var name user_password gt lt setdynvars gt RUN delimiter can be any string and order can be iter or random 3 A dynamic variable can be a random number uniform distribution 1 lt setdynvars sourcetype random_number start 3 end 32 gt 2 lt var name rndint 5 lt
58. istics e Response times e Throughput graphs highest 10sec lowest 10sec Highest e Simultaneous Users Name Mean Count e Server monitorin mean mean Rate DEE tr login 0 101 sec 295 msec 690 4 sec 49 1098484 XML Config file Network Throughput Name Highest Rate Total size_rcv 521 40 Mbits sec 86 44 GB size sent 39 10 Mbits sec 6 54 GB Counters Statistics Name Highest Rate Total number finish_users_count 416 5 sec 446996 newphase 2 1 sec 612 users_count 681 sec 1105176 Name Max connected 89288 users 658180 Figure 3 Report 7 6 Tsung Plotter Tsung Plotter tsplot command is an optional tool recently added in the Tsung distribution it is written in Python useful to compare different tests runned by Tsung t splot is able to plot data from several tsung log files onto the same charts for further comparisons and analyzes You can easily customize the plots you want to generate by editing simple configuration files You can get more information in the manual page of the tool man tsplot Example of use tsplot First test firsttest tsung log Second test secondtest tsung log d outputdir Here s an example of the charts generated by tsplot figure 5 77 RRD A contributed perl script tsung rrd pl is able to create rrd files from the tsung log files It s available in usr lib tsung bin tsung rrd pl 8 References e Tsung home page http
59. ks to Gordon Guthrie for reporting this 8 old beam processes erlang virtual machines running on client nodes kill all beam processes before starting tsung Note that you do not need to use the 127 0 0 1 address in the configuration file It will not work if you use it as the injection interface The shortname of your client machine should not refer to this address Warn Tsung launches a new erlang virtual machine to do the actual injection even when you have only one machine in the injection cluster unless use controller vm is set to true This is because it needs to by pass some limit with the number of open socket from a single process 1024 most of the time The idea is to have several system processes Erl beam that can handle only a small part of the network connection from the given computer When the maxusers limit simultaneous is reach a new Erlang beam is launched and the newest connection can be handled by the new beam New in 1 1 0 If you don t use the distributed feature of Tsung and have trouble to start a remote beam on a local machine you can set the use controller vm attribute to true for ex lt client host mymachine use_controller_vm true gt A 2 Tsung crashes when I start it Does your Erlang system has ssl support enabled to test it gt erl Eshell V5 2 abort with G i gt sslistart you should see ok A 3 Why do i have error_connect_emfile errors
60. ments 07 Oct 2006 Bugfix TSUN 5 get traffic from all interfaces instead of only eth0 in erlang os monitoring Linux TSUN 18 the pgsql recorder fails if the client doesn t try first an SSL connection TSUN 19 a character in some requests eg type sql for pgsql make the config server crash TSUN 20 pgsql client fails while parsing data from server TSUN 21 substitution in URL is not working properly when a new server or port is set TSUN 23 set default http version 1 1 TSUN 24 destination previous doesn t work jabber Improvement TSUN 15 listen port is now customizable with the command line TSUN 17 add option to setup postgresql server IP and port at runtime for the recorder TSUN 22 add support for PUT DELETE and HEAD methods for http 1 1 0 5 1 2 0 Major feature enhancements 29 May 2006 change name idx tsunami is now called tsung add new plugin pgsql for postgresql load testing Tsung Users manual http tsung erlang projects org Page 48 tributed load testing too ng C CHANGELOG new it s now possible to set multiple servers selected at runtime by round robin add size rcv stats fix beams communication problem introduced in new erlang releases import snmp mgr src from R9C2 to enable SNMP with R10B rebuild boot scripts if erlang version is different from compile time many DID improvements improved match add loop abort restart on
61. mp sourceforge net You can try with sampwalk to see if your snmpd config is ok gt snmpwalk v 1 c public IP OF YOUR SERVER 1 3 6 1 4 1 2021 4 5 0 UCD SNMP MIB memTotalReal 0 INTEGER 1033436 Tsung Users manual http tsung erlang projects org Page 44 51 tributed load testing too ng B Errors list How can i simulate a fix number of users SNMP doesn t work with erlang R10B and Tsung older than 1 2 0 There is a small bug in the snmp mgr module in old Erlang release R9C 0 You have to apply this patch to make it work This is fixed in erlang R9C 1 and up lib snmp 3 4 src snmp mgr erl orig 2004 03 22 15 21 59 000000000 0100 lib snmp 3 4 src snmp mgr erl 2004 03 22 15 23 46 000000000 0100 296 6 296 10 end is options ok recbuf Sz Opts when 0 lt Sz Sz lt 65535 gt is options ok Opts tis options ok receive type msg Opts gt is options ok Opts tis options ok receive type pdu Opts gt is_options_ok Opts is_options_ok InvOpt _ gt error invalid_option InvOpt is_options_ok gt true A 10 How can i simulate a fix number of users Use maxnumber to set the max number of concurrent users in a phase and if you want Tsung to behave like ab you can use a loop in a session to send requests as fast as possible you can also define a max duration in lt load gt lt load duration 5 unit minute g
62. n t work in all case x TSUN 38 server monitoring crash if an ethernet interface s name is more than 6 chars long x TSUN 39 https recording doesn t work with most browsers x TSUN 43 session should not terminate if rosterjid is not defined x TSUN 49 lt match gt doesn t work with jabber plugin x TSUN 51 tsung does not work with R12B httpd util funs removed x TSUN 53 postgresql errors not reported in all cases x TSUN 55 no error counter when userid max is reached Improvements TSUN 14 no ack messages and asynchronous msg sent by the server are not available in the reports TSUN 27 handle bidirectional protocols TSUN 28 Refactoring needed to ease the change of the userid password generation code TSUN 29 Multiple file server support TSUN 32 make snmp server options tunable TSUN 34 add costum http headers TSUN 44 tsung should ignore whitespace keepalive from xmpp server TSUN 45 add kernel poll support for better performance TSUN 46 add number of open connections in statistics TSUN 47 ts mon can be a bottleneck during very high load testing TSUN 50 use the whole range of Id from 0 to userid max before reusing already used Ids New Features x TSUN 26 Ability to loop on a given sequence of phase x TSUN 52 Adding comment during script capture x TSUN 41 add support for parent proxy for http only not https O OORO OE O O 1 2 0 gt 1 2 1 Minor bugfixes and enhance
63. ne result nodes from descendant or self aren t returned in document order This isn t a problem for the most common cases However queries like img 1 src are not recommended as the order of the lt img gt elements returned from img is not the expected The order is re spected for paths without descendant or self axis so this html body div 2 img 3 src is interpreted as expected and can be safely used It is possible to use Xpath to get a list of elements from an html page allowing dynamic retrieval of objects You can either create embedded erlang code to parse the list produced or use foreach that was introduced in release 1 4 0 For XMPP you can get all the contacts in a dynamic variable lt request subst true gt lt dyn_variable name contactJids gt lt jabber type iq roster get ack local gt lt request gt Tsung Users manual http tsung erlang projects org Page 32 51 xpath iq type result query xmlns jabber igq roster item string length wr type 0 jid DURARON tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features JSONPath Another way to analyze the server response has been introduced in the release 1 3 2 when the server is sending JSON data It is only for the HTTP plugin This feature uses the mochiweb library and only works with erlang R13B and newer version Tsung implements a very limit
64. ne users A user is considered online when he has send a pres ence initial message before this message the state of the user is connected If you want to switch back to connected before going offline you can use a presence final message presence final does two things 1 It removes the client from the list of Online users and moves them into the list of Connected users 2 It sends a broadcast presence update of type unavailable presence final is optional warn this is new in 1 2 0 in earlier version only 2 status were available online and offline a user was considered online as soon as it was connected 4 5 4 Authentication Below are configuration examples for the possible authentication methods Note the regular expressions used here are only examples they may need to be altered depending on how a particular server implemen tation composes messages see also for password settings e plain authentication sends clear text passwords lt session probability 100 name jabber plain type ts_jabber gt 1 2 3 lt request gt lt jabber type connect ack local gt lt jabber gt lt request gt 4 5 lt thinktime value 2 gt lt thinktime gt 6 7 lt transaction name auth_plain gt 8 lt request gt lt jabber type auth_get ack local gt lt jabber gt lt request gt 9 lt request gt lt jabber type auth_set_plain ack local gt lt jabber gt lt request gt 10 lt transaction
65. ng fullstats log Warn ing this may impact the performance of the controller node a lot of data has to be written to disk The data looks like sum connected 1 sum connected 1 sample request 214 635 sum size_rcv 268 sample page 831 189 count 200 sum size sent 182 sample connect 184 787 sample request 220 974 sum size rcv 785 count 200 sum size sent 164 sample connect 185 482 sum connected 1 count 200 sum size sent 161 sample connect 180 812 sum size rcv 524288 sum size rev 524288 You will have to write your own script to analyze the output The format of the file may change in a future release A 8 How can I specify the number of concurrent users You can t But it s on purpose the load generated by Tsung is dependent on the arrival time between new clients Indeed once a client has finished his session in tsung it stops So the number of concurrent users is a function of the arrival rate and the mean session duration For example if your web site has 1000 visits hour the arrival rate is 1000 3600 0 2778 visits second If you want to simulate the same load set the inter arrival time is to 1 0 27778 3 6sec users interarrival 3 6 unit second gt in the arrivalphase node in the XML config file A 9 SNMP monitoring doesn t work It use SNMP v1 and the public community It has been tested with http net sn
66. niform in the interval lt thinktime min 2 max 10 random true gt lt thinktime gt Since version 1 4 0 you can use a dynamic variable to set the thinktime value lt thinktime value _rndthink random true gt lt thinktime gt 6 6 2 HTTP This example shows several features of the HTTP protocol support in Tsung GET and POST request basic authentication transaction for statistics definition conditional request IF MODIFIED SINCE lt sessions gt lt session name http example probability 70 type ts_http gt lt request gt lt http url method GET version 1 1 gt lt http gt lt request gt lt request gt lt http url images logo gif method GET version 1 1 if_modified_since Fri 14 Nov 2003 02 43 31 GMT gt lt http gt lt request gt lt thinktime value 20 random true gt lt thinktime gt lt transaction name index_request gt lt request gt lt http url index en html method GET version 1 1 gt lt http gt lt request gt lt request gt lt http url images header gif method GET version 1 1 gt lt http gt lt request gt lt transaction gt lt thinktime value 60 random true gt lt thinktime gt lt request gt lt http url method POST version 1 1 contents bla blu gt lt http gt lt request gt lt request gt lt http url bla method POST version 1 1 contents bla blu amp name glop gt
67. no match behavior multiple match tags is now possible suggested by msmith truelink com freemem and packet stats for Solaris jasonwtucker gmail com fix several small problems with use controller vm option ip is no more mandatory default is 0 0 0 0 clients and monitoring can use hosts list defined in environment variables for use with batch schedulers openpbs torque LSF and OAR performance improvements in stats engine for very high load use session cache Recorder add plugin architecture in recorder add pgsql plugin fix regression in recorder for WWW Authentication anders nygren gmail com close client socket when connection closed is ask by the server this should enable https recording with IE Jabber fix presence roster request add presence directed presence broadcast amp presence final requests for jabber jasonwtucker gmail com roster enhancements jasonwtucker gmail com sip digest authentication jasonwtucker gmail com fix online must use presence initial to switch to online status add pubsub support mickael remond process one net Http fix single user agent case minor fixes for HITP parsing 3 gt 1 1 0 Major feature enhancements 5 Sep 2005 new feature HTTP proxy load testing in now possible set http use server as proxy to true add dynamic substitution support for jabber add raw type of msg for Jabber use the new data attribute
68. of the application and of the size of the target server s Calculate the normal duration of the scenario and use the interarrival time between users and the duration of the phase to estimate the number of simultaneous users for each given phase 5 Launch benchmark with your first application parameters set up tsung start runman tsung for more options 6 Wait for the end of the test or stop by hand with tsung stop reports can also be generated during the test see sm the statistics are updated every 10 seconds For a brief summary of the current activity use tsung status 7 Analyze results change parameters and relaunch another benchmark 4 1 2 WEBDAV It s the same approach as HTTP first you start to record one or more sessions with the recorder tsung recorder p webdav start Tsung Users manual http tsung erlang projects org Page 9f51 n g 4 Benchmark approach LDAP benchmark approach 4 1 3 Benchmarking a proxy server By default the HTTP plugin is used to benchmark HTTP servers But you can also benchmark HTTP Proxy servers To do that you must add in the opt ions section lt option type ts http name http use server as proxy value true gt lt option gt 4 2 LDAP benchmark approach An LDAP plugin for the recorder is not yet implemented so you have to write the session by yourself see section 6 6 6 for more information 4 3 PostgreSQL benchmark approach It s the same approach
69. ogfiles for more information error connect XERRORNAME Error while establishing a connection to the server See http www erlang org doc man inet html for the list of all errors error no online jabber XMPP No online user available usually for a chat message destinated to a on line user error no offline jabber XMPP No offline user available usually for a chat message destinated to a offline user error no free userid For XMPP all users Id are already used userid max is too low error next session A clients fails to gets its session parameter from the config server the controller may be overloaded error mysql lt ERRNO gt Error reported by the mysql server see http dev mysql com doc refman 5 0 en error messages server html error_mysql_badpacket Bad packet received for mysql server while parsing data error_pgsql Error reported by the postgresql server C CHANGELOG 1 3 3 5 1 4 0 Major enhancements and bugfixes 5 Sep 2011 Bugfix TSUN 129 regexp defined in match or dynvars can fail when chunk encoding is used TSUN 150 Munin monitoring broken by cpu stats config request x TSUN 163 Tsung doesn t detect subdomains TSUN 166 snmp monitoring does not work with erlang R14A TSUN 171 maxnumber set in a phase is not always enforced x TSUN 172 auth sasl can t authenticate against ejabberd TSUN 178 some characters can make url and headers rewriting fail in t
70. ose set in session configuration tags if override is true Tsung Users manual http tsung erlang projects org Page 17 UN UB un WR we on tributed load testing tool ng 6 Understanding tsung xml configuration file Setting options lt option name thinktime value 3 random false override true gt lt option name ssl_ciphers value EXP1024 RC4 SHA EDH RSA DES CBC3 SHA gt lt option name tcp_snd_buffer value 16384 gt lt option gt lt option name tcp_rcv_buffer value 16384 gt lt option gt lt option name udp_snd_buffer value 16384 gt lt option gt lt option name udp_rcv_buffer value 16384 gt lt option gt A new option is available in version 1 3 1 hibernate This is used to reduced memory consumption of simulated users during thinktimes By default hibernation will be activated for thinktimes higher than 10sec This value can be changed like this lt option name hibernate value 5 gt lt option gt To disable hibernation you must set the value to infinity A new option is available in version 1 4 0 rate limit This will limit the bandwidth of each client using a token bucket algorithm The value is in KBytes per second You can also specify a maximum burst value eg max 2048 By default the burst size is the same as the rate 1024KB in the following example Currently only incoming traffic is rate limited lt option name rat
71. ource multi protocol load testing tool several months later The HTTP support was added in 2003 and this tool has been used for several industrial projects It is now hosted by Erlang projects and supported by The list of contributors is available in the source archive https git process one net tsung mainline blobs master CONTRIBUTORS e Itis an industrial strength implementation of a stochastic model for real users simulation User events distribution is based on a Poisson Process More information on this topic in Z Liu N Niclausse and C Jalpa Villanueva Traffic Model and Performance Evaluation of Web Servers Performance Evaluation Volume 46 Issue 2 3 October 2001 e This model has already been tested in the INRIA WAGON research prototype Web trAffic Gener atOr and beNchmark WAGON was used in the project Very High Broadband IP WDM test platform for new generation Internet applications 2000 2004 Tsung has been used for very high load tests e Jabber XMPP protocol Tsung Users manual http tsung erlang projects org Page 4 51 tributed load testing too ng Zi Features 90 000 simultaneous jabber users on a 4 node Tsung cluster 3xSun V240 1 Sun V440 10 000 simultaneous users Tsung was running on a 3 computers cluster CPU 800MHz HTTP and HTTPS protocol 12 000 simultaneous users Tsung were running on a 4 computers cluster in 2003 The tested platform reach
72. re amp lt Nonce encoding amp quot hex amp quot amp gt x amp lt Nonce amp gt gt lt jabber type auth_get ack local gt lt jabber gt 13 lt request gt 14 request subst true gt lt jabber type auth_set_sip ack local gt lt jabber gt lt request gt 15 lt transaction gt 16 Dia 17 lt session gt 5 Using the proxy recorder The recorder has three plugins for HTTP WebDAV and for PostgreSQL To start it run tsung recorder p lt PLUGIN gt start where PLUGIN can be http webdav or pgsgi for PostgreSQL The default plugin is http The proxy is listening to port 8090 You can change the port with L portnumber To stop it use tsung recorder stop The recorded session is created as t sung tsung_recorderYYYMMDD HH MM xm1 if it doesn t work take a look at tsung log tsung log tsung_recorderfhostname During the recording you can add custom tag in the XML file this can be useful to set transactions or comments tsung recorder record tag lt transaction name login gt Once a session has been created you can insert it in your main configuration file either by editing by hand the file or by using an ENTITY declaration like lt DOCTYPE tsung SYSTEM usr share tsung tsung 1 0 dtd lt ENTITY mysessionl SYSTEM home nniclausse tsung tsung_recorder20051217 13 11 xm1 gt 1 gt lt sessions gt mysessionl lt sessions gt Tsung Users manual http
73. real client has a weight of 1 and the other client has a weight of 2 the second one will start twice the number of users as the first the proportions will be 1 3 and 2 3 In the earlier example where for the second client has 2 CPU and weight 3 the weight is equal to 1 5 for each CPU The maxusers parameter is used to bypass the limit of maximum number of sockets opened by a single process 1024 by default on many OS and the lack of scalability of the select system call When Tsung Users manual http tsung erlang projects org Page 14 51 tributed load testing too ng 6 Understanding tsung xml configuration file Monitoring the number of users is higher than the limit a new erlang virtual machine will be started to handle new users The default value of maxusers is 800 Nowadays with kernel polling enable you can and should use a very large value for maxusers 30000 for example without performance penalty but don t forget to raise the limit of the OS with ulimit n see also FAQ A 3 6 2 3 Running Tsung with a job scheduler Tsung is able to get its client node list from a batch job scheduler It currently handle pbs torque LSF and OAR To do this set the type attribute to batch e g lt client type batch batch torque maxusers 30000 gt If you need to scan IP aliases on nodes given by the batch scheduler use scan_int f like this lt client type batch batch torque scan_intf eth0
74. se 1 duration 10 unit minute gt lt users interarrival 2 unit second gt lt users gt lt arrivalphase gt lt arrivalphase phase 2 duration 10 unit minute gt lt users interarrival 1 unit second gt lt users gt lt arrivalphase gt lt arrivalphase phase 3 duration 10 unit minute gt lt users interarrival 0 1 unit second gt lt users gt lt arrivalphase gt lt load gt With this setup during the first 10 minutes of the test a new user will be created every 2 seconds then during the next 10 minutes a new user will be created every second and for the last 10 minutes 10 users will be generated every second The test will finish when all users have ended their session You can also use arrivalrate instead of interarrival For example if you want 10 new users per second use lt arrivalphase phase 1 duration 10 unit minute gt lt users arrivalrate 10 unit second gt lt users gt lt arrivalphase gt You can limit the number of users started for each phase by using the maxnumber attribute just like this lt arrivalphase phase 1 duration 10 unit minute gt lt users maxnumber 100 arrivalrate 10 unit second gt lt users gt lt arrivalphase gt lt arrivalphase phase 2 duration 10 unit minute gt lt users maxnumber 200 arrivalrate 10 unit second gt lt users gt lt arrivalphase gt Tsung Users manual http
75. t lt arrivalphase phase 1 duration 10 unit minute gt lt users maxnumber 10 arrivalrate 100 unit second gt lt users gt lt arrivalphase gt lt load gt lt sessions gt lt session probability 100 name ab gt lt for from 1 to 1000 var i gt lt request gt lt http url http myserver index html method GET gt lt http gt lt request gt lt for gt lt session gt lt sessions gt B Errors list error_closed Only for non persistent session XMPP the server unexpectedly closed the connection the session is aborted error inet lt ERRORNAME gt Network error see http www erlang org doc man inet html for the list of all errors error_unknown_data Data received from the server during a thinktime not for unparsed protocol like XMPP The session is aborted error_unknown_msg Unknown message received see the log files for more information The session is aborted error_unknown Abnormal termination of a session see log file for more information error repeat lt REPEATNAME gt Error in a repeat loop undefined dynamic variable usually error_send_ lt ERRORNAME gt Error while sending data to the server see http www erlang org doc man inet html for the list of all errors Tsung Users manual http tsung erlang projects org Page 45p1 tributed load testing too ng C CHANGELOG error send Unexpected error while sending data to the server see the l
76. t lt jabber gt 24 lt request gt 25 26 lt transaction gt 2a sa 28 lt session gt raw XML You can send raw XML data to the server using the raw type 1 lt jabber type raw ack no_ack data amp lt stream amp gt foo amp lt stream gt gt lt jabber gt Beware you must encode XML characters like lt 5 amp etc Tsung Users manual http tsung erlang projects org Page 24 tributed load testing too ng 6 Understanding tsung xml configuration file a Sessions 6 6 4 PostgreSQL For PostgreSQL 4 types of requests are available 1 connect to a given database with a given username 2 authenticate with password or not 3 sql basic protocol 4 close In addition the following parts of the extended protocol is supported 1 copy copydone and copyfail 2 parse bind execute describe 3 sync flush This example shows most of the features of a PostgreSQL session lt session probability 100 name pgsql example type ts_pgsql gt lt transaction name connection gt lt request gt lt pgsql type connect database bench username bench gt lt request gt lt transaction gt lt request gt lt pgsql type authenticate password sesame gt lt request gt lt thinktime value 12 gt lt request gt lt pgsql type sql gt SELECT x from accounts lt pgsql gt lt request gt lt thinktime value 20 gt lt request gt lt pgsql type sql gt SE
77. ter if it does not match the nomat ch counter will be incremented For example let s say you want to test a login page If the login is ok the server will respond with Welcome in the HTML body otherwise not To check that lt request gt lt match do continue when match gt Welcome lt match gt lt http url login php version 1 0 method POST contents username nic amp amp user_password sesame content type application x www form urlencoded gt lt request gt Tsung Users manual http tsung erlang projects org Page 34 We we N UR un tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features You can use a regexp instead of a simple string The list of available actions to do is e continue do nothing continue only update match or nomatch counters e log log the request id userid sessionid in a file in match log e abort abort the session e restart restart the session The maximum number of restarts is 3 by default e loop repeat the request after 5 seconds The maximum number of loops is 20 by default e dump dump the content of the response in a file The filename is mat ch lt userid gt lt sessionid gt lt requestid gt lt dumpid gt dump You can mixed several match tag in a single request lt request gt lt match do loop sleep_loop 5 max_loop 10 when match gt Retry lt match
78. this file lt options gt lt option name file_server id users value users csv gt lt options gt We use two dynamic variables to hold the username and password lt setdynvars sourcetype file fileid users delimiter order iter gt lt var name username gt lt var name password gt lt setdynvars gt To start the authentication process we instruct Tsung to perform a search to find the distinguished name of the user we are trying to authenticate Tsung Users manual http tsung erlang projects org Page 27 51 Bun N UR un Vo IAM RAY tributed load testing too ng 6 Understanding tsung xml configuration file Sessions lt ldap type search base dc pablo desktop filter cn 353 username33 result var search result scope wholeSubtree gt lt ldap gt As we need to access the search result we specify it using the result var attribute This attribute tells Tsung in which dynamic variable we want to store the result if the result var attribute isn t set Tsung doesn t store the search result in any place Finally we try to bind as that user lt request subst true lt ldap type bind user ldap_auth user_dn password _password gt lt ldap gt lt request gt The only thing that remains to do is to implement the ldap auth user dn function that extract the distinguished name from the search result module ldap auth
79. tion name rosteradd gt lt request gt lt jabber type iq roster add ack no_ack destination online gt lt jabber gt lt request gt lt request gt lt jabber type presence subscribe ack no_ack gt lt request gt lt transaction gt Sie Jin gt lt transaction name rosterrename gt lt request gt lt jabber type iq roster rename ack no_ack gt lt jabber gt lt request gt lt transaction gt lt gt lt transaction name rosterdelete gt lt request gt lt jabber type iq roster remove ack no_ack gt lt jabber gt lt request gt lt transaction gt lt remainder of session gt lt session gt See also 4 5 2 for automatic handling of subscribing requests Tsung Users manual http tsung erlang projects org Page 21 BU Ran tributed load testing too ng Sessions SASL Anonymous SASL Anonymous authentication example lt session probability 100 name sasl type ts_jabber gt lt request gt lt jabber type connect ack local gt lt jabber gt lt request gt lt thinktime value 10 gt lt thinktime gt lt transaction name authenticate gt lt request gt lt jabber type auth sasl anonymous ack local gt lt jabber gt lt request gt lt request gt lt jabber type connect ack local gt lt jabber gt lt request gt lt request gt lt jabber type auth_sasl_bind ack local gt lt jabber gt lt req
80. tp gt lt request gt lt session gt 6 7 2 Reading external file New in 1 0 3 A new module ts_file server is available You can use it to read external files For example if you need to read user names and passwd from a CSV file you can do it with it currently you can read only a single file You have to add this in the XML configuration file lt option name file server value tmp userlist csv gt lt option gt New in 1 2 2 You can read several files using the id attribute to identify each file lt option name file server value tmp userlist csv gt lt option gt lt option name file_server id random value tmp randomnumbers csv gt lt option gt Now you can build you own function to use it for example create a file called readcsv erl module readcsv export user 1 user Pid DynVar gt ok Line ts file server get next line Username Passwd string tokens Line username Username amp password Passwd Tsung Users manual http tsung erlang projects org Page 30 WR we hune DURAN u nn Pune UN tributed load testing too ng 6 Understanding tsung xml configuration file Advanced features The output of the function will be a string username USER amp password PASSWORD Then compile it witherlc readcsv erl and put readcsv beamin Sprefix lib erlang lib tsung VERSION ebin director
81. tp url _element method GET version 1 1 gt lt request gt lt foreach gt It is possible to limit the list of elements you re looping through thanks to the use of the include or exclude attributes inside the foreach statement As an example if you want to include only elements with a local path you can write lt foreach name element in list include x gt If you want to exclude all the elements from a specific URI you would write lt foreach name element in list exclude http tld com gt You can combine this with a xpath query For instance the following scenario will retrieve all the images specified on a web page lt request subst true gt lt dyn_variable name img_list xpath img sre gt lt http url mypage html method GET version 1 1 gt lt request gt lt foreach name img in img_list gt lt request subst true gt lt http url _img method GET version 1 1 gt lt request gt lt foreach gt Tsung Users manual http tsung erlang projects org Page 36 51 u nn tributed load testing too ng 7 Statistics and reports 6 7 6 Rate limiting Since version 1 4 0 rate limiting can be enabled either globally see 6 5 or for each session separately For example to limit the rate to 64KB sec for a given session lt session name http example probability 70 type ts_http gt
82. ts on remote servers or SNMP XML configuration system complex user s scenarios are written in XML Scenarios can be written with a simple browser using the Tsung recorder HTTP and PostgreSQL only Dynamic scenarios You can get dynamic data from the server under load without writing any code and re inject it in subsequent requests You can also loop restart or stop a session when a string or regexp matches the server response Mixed behaviours several sessions can be used to simulate different type of users during the same benchmark You can define the proportion of the various behaviours in the benchmark scenario Stochastic processes in order to generate a realistic traffic user thinktimes and the arrival rate can be randomize using a probability distribution currently exponential Tsung Users manual http tsung erlang projects org Page 5 51 tributed load testing too n g 2 Features HTTP related features 2 2 2 3 HTTP related features HTTP 1 0 and HTTP 1 1 support GET POST PUT DELETE and HEAD requests Cookies Automatic cookies management but you can also manually add more cookies GET If modified since type of request WWW authentication Basic User Agent support Any HTTP Headers can be added Proxy mode to record sessions using a Web browser SOAP support using the HTTP mode the SOAPAction HTTP header is handled HTTP server or proxy server load testing WEBDAV rel
83. tsung erlang projects org e Tsung description French e Erlang web sitehttp www erlang org Tsung Users manual http tsung erlang projects org Page 39 tributed load testing too n g 9 Acknowledgments Response Time Transactions Requests and connection establishment T T T connect request msec a 100 200 300 400 500 600 700 806 9001000 O 100 200 300 400 500 609 700 800 9001000 unit seo unit sec Throughput Transactions Requests rate rate iT 1 4000 an T AAA connect request page tr login transactions sec rate 6 8 O 100 266 300 400 500 600 700 800 9001000 O 100 200300 400500 609 700 800 9001000 unit sec unit sec Network throughput New Users rate rate 66 TTT Se IE users count finish users count T_T size sent size rov t o v n N 2 x er of users sec 30 Figure 4 Graphical output e Erlang programmation Micka l R mond Editions Eyrolles 2003P e Making reliable system in presence of software errors Doctoral Thesis Joe Armstrong Stockholm 2003F e Tutorial on How to write a Tsung plugin written by t ty http www process one net en wiki Writing a Tsung plugin 9 Acknowledgments The first version of this document was based on a talk given by Mickael R mond during an Object Web benchmarking workshop in April 2004 more
84. uest gt lt request gt lt jabber type auth_sasl_session ack local gt lt Jabber gt lt request gt lt transaction gt Presence type can be either presence broadcast or presence directed show value must be either away chat dnd or xa e status value can be any text For more info see section 2 2 of RFC 3921 If you omit the show or status attributes they default to chat and Available respectively Example of broadcast presence broadcast to members of your roster lt request gt lt jabber type presence broadcast show away status Be right back ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence broadcast show chat status Available to chat ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence broadcast show dnd status Don t bother me ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence broadcast show xa status I may never come back ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt lt request gt lt jabber type presence broadcast ack no_ack gt lt request gt lt thinktime value 5 gt lt thinktime gt Example of directed presence sent to random online users lt request gt lt jabber type presence directed show
85. uld see this ok bar remotehost If you got error timeout it can be caused by several problems 1 2 3 4 A ssh in not working you must have a key without passphrase or use an agent Tsung and Erlang are not installed on all clients nodes Erlang version or location install path is not the same on all clients nodes A firewall is dropping erlang packets indeed erlang virtual machines use several TCP ports dynam ically generated to communicate SELinux You should disable SELinux on all clients Bad etc hosts This one is wrong real hostname should not refer to localhost loopback 127 0 0 1 localhost myhostname Tsung Users manual http tsung erlang projects org Page 411 Pune tributed load testing too n g A Frequently Asked Questions Tsung crashes when I start it This one is good 1 127 0 0 1 localhost 2 192 168 3 2 myhostname 7 sshd configuration For example for SuSE 9 2 sshd is compiled with restricted set of paths ie when you shell into the account you get the users shell when you execute a command via ssh you don t and this makes it impossible to start an erlang node if erlang is installed in usr local for example Run 1 ssh myhostname erl If the erlang shell doesn t start then check what paths sshd was compiled with in SuSE see etc ssh sshd config and symlink from one of the approved paths to the erlang executable than
86. will log all requests in a CSV file with the following data date pid id http method host URL HTTP status size match error The loglevel can also have a great impact on performance For high load warning is recommended Possible values are e emergency critical error warning notice default e info e debug For REALLY verbose logging recompile tsung with make debug and set loglevel to debug Tsung Users manual http tsung erlang projects org Page 13 51 YAU WN tributed load testing too ng 6 Understanding tsung xml configuration file Clients and server 6 2 Clients and server Scenarios start with clients Tsung cluster and server definitions 6 2 1 Basic setup For non distributed load you can use a basic setup like lt clients gt lt client host localhost use_controller_vm true gt lt clients gt lt servers gt lt server host 192 168 1 1 port 80 type tcp gt lt server gt lt servers gt This will start the load on the same host and on the same Erlang virtual machine as the controller The server is the entry point into the cluster New in 1 2 0 if several servers are defined a round robin algorithm is used to choose the server 6 2 2 Advanced setup The next example is more complex and use several features for advanced distributed testing lt clients gt lt client host louxor weight 1 maxusers 800 gt lt ip value 10 9
87. x change GETIMS date replace by GET if modified since 0 2 1 5 1 0 betal Major Feature Enhancements 3 Feb 2004 rewrite the configuration engine Now use an XML file add recording application use as a HTTP proxy to record session into XML format add support to OS monitoring cpu memory network Currently use an erlang agent on the remote nodes SNMP is on the TODO list mickael remond erlang fr org can now use several IPs per client host several arrival phases can be set with different arrival rates and duration can set test duration instead of number of users add user defined statistics using a transaction tag HTTP fix cookies and POST handling mickael remond erlang fr org HTTP rewrite the parser faster and cleaner fix bad timeout computation when close occur for persistent client bugfixes and other enhancements fix memory leak with ssl half closed connections 0 2 0 5 0 2 1 Minor bugfixes and small enhancements 9 Dec 2003 optimize session memory consumption use an ets table to store session setup HTTP fix crash when content length is not set in headers HTTP fix POST method HTTP preliminary chunked encoding support in HTIP 1 1 HTTP Absolute URL are handled server and port can be overridden no more hosts erlang required add stats on simultaneous users 0 1 1 5 0 2 0 Major Feature Enhancements Aug 2003 add realtime stats add new parse
88. y if the file has an id set to random change the call to ts file server get next line random Then use something like this in your session lt request subst true gt lt http url login cgi version 1 0 contents 35readcsv user33samp op login content type application x www form urlencoded method POST gt lt http gt lt request gt Two functions are available ts_file_server get_next_lineandts_file_server get_random_line For the get next line function when the end of file is reached the first line of the file will be the next line New in 1 3 0 you no longer have to create an external function to parse a simple csv file you can use setdynvars see next section for detailed documentation lt setdynvars sourcetype file fileid userlist csv delimiter order iter gt lt var name username gt lt var name user_password gt lt setdynvars gt This defines two dynamic variables username and user_password filled with the next entry from the csv file Using the previous example the request is now lt request subst true gt lt http url login cgi version 1 0 content s username _username s amp amp password _user_password s amp amp op login content type application x www form urlencoded method POST gt lt http gt lt request gt Much simpler than the old method 6 7 3 Dynamic variables
89. y Erlang A 5 Can I dynamically follow redirect with HTTP If your HTTP server sends 30X responses redirect with dynamic URLs you can handle this situation using a dynamic variable lt request gt lt dyn_variable name redirect re Location http r gt lt http url index html method GET gt lt http gt lt request gt lt request subst true gt lt http url _redirect method GET gt lt http gt lt request gt You can even handle the case where the server use several redirections successively using a repeat loop this works only with version 1 3 0 and up lt request gt lt dyn_variable name redirect re Location http r gt lt http url test redirect html method GET gt lt http gt lt request gt lt repeat name redirect_loop max_repeat 5 gt lt request subst true gt lt dyn_variable name redirect re Location http r gt lt http url _redirect method GET gt lt http gt lt request gt lt until var redirect eq gt lt repeat gt A 6 What is the format of the stats file tsung log stats dump at 1218093520 stats users 247 247 stats connected 184 247 stats users_count 184 247 stats page 187 98 324 579 441 5465 940 2 177 9 237 595 58 stats request 1869 0 371 0 422 5 20703125 0 115 0 431 7444062 581 stats connect 186 0 427 0 184 4 47216796875 0 174 0 894 88665254 59 stats tr login 187 100 848
90. ype new_type ts_http host foo bar port 80 server_type tcp store true gt lt request gt lt http url http foo bar gt lt request gt lt request gt lt http url favicon gt lt request gt lt change_type new_type ts_jabber host localhost port 5222 server_type tcp restore true gt lt request gt lt jabber type chat ack no_ack size 16 destination previous gt lt request gt store true can be used to save the current state of the session socket cookies for http and restore true to reuse the previous state when you switch back to the old protocol A dynamic variable set in the first part of the session will be available after a change type There is currently one caveat you have to use a full URL in the first http request after a lt change_type gt a relative URL will fail 6 7 Advanced features 6 7 1 Dynamic substitutions Dynamic substitution are mark up placed in element of the scenario For HTTP this mark up can be placed in basic authentication www_authenticate tag userid and passwd attributes URL to change GET parameter and POST content Those mark up are of the form Module Function Substitutions are executed on a request by request basis only if the request tag has the attribute subst true When a substitution is requested the substitution mark up is replaced by the result of the call to the Erlang function Module Function Pid DynData
91. ys always phase one even if you have more than one phase x TSUN 110 Cookie header not present if the URL is dynamically generated by a previous redirection 302 x TSUN 117 Bug in HTIP empty header can be generated in some case x TSUN 118 HTTPS proxy recorder ts utils to https incorrectly handles Content Length for POST requests x TSUN 119 tsung can crash when reading empty values from a csv file x TSUN 122 same http cookie key with different domains don t work Improvements TSUN 47 ts mon can be a bottleneck during very high load testing TSUN 77 Structural requests or goto like action for match in HTTP TSUN 81 Dynamic variables API TSUN 83 file server using fixed tuple instead of list TSUN 85 external entity should be copied into the log directory of a run TSUN 87 add dynamic code evaluation in set dynvars TSUN 88 add mkactivity method support in webdav TSUN 91 reduce memory consumption by hibernating client process while in think state TSUN 97 disable smp erlang for client beam for performance reason TSUN 98 try several times to connect to the server before aborting a session TSUN 99 make substitution work in lt match gt TSUN 100 improve scalability of ts launcher TSUN 105 Add load average statistic to server monitoring TSUN 111 add option to manually add a cookie in http requests TSUN 113 split tsung command into two separate tsung and tsung recorder commands TSUN 1

Tsung User`s Manual (English, PDF)

Contents

Download Pdf Manuals

Related Search

Related Contents