User Manual - glasnost.itcarlow.ie
Contents
1. installed for this software to work It is available as a Debian package called libxerces c3 1 Eclipse CDT An installation of Eclipse CDT or Eclipse Classic with CDT installed is required in order to make use of the Eclipse plug in Installation The software is distributed as a Tar archive with Gzip compression To install the software copy the archive to a new arbitrarily named folder Extract the files from the archive by typing at the console tar xzvf autounit tar gz There should now be an installation script named install sh in the folder you created To run this enter the following commands as root or using sudo if you prefer chmod x install sh install sh path to eclipse replacing path to eclipse with the path to your installation of Eclipse CDT You can also omit a path altogether if Eclipse CDT is not installed or you do not intend to use the Eclipse plug in Configuration of required options There are some options which must be configured before using the software for the first time Other configuration settings are described later All settings must be configured from the user account which will use the software generally not root GCC GCC is typically located in usr bin To configure autounit to use an installation of GCC located there type at the console autounit config gcc usr bin gcc CppUnit include path The include path for CppUnit header files will typically be usr include cppun2. is expressed as a floating point integer By default the value is set to 0 meaning that no NULL pointers are generated Enter a value between 0 and 1 by typing the following at the console autounit config null 68 replacing 68 with your chosen value Create tests Specifying the source code To create tests for a particular source code file the c or create command line argument can be used followed by the path of the file For example autounit create home user src test c Choosing the functions to test For each supported function in your source code the following prompt will appear Generate tests for float foo struct bar x y n To create tests for the named function type y followed by enter To skip test generation for this function type n followed by enter Specifying the number of tests For each function for which you choose to create tests the following prompt will appear How many Type the number of tests you wish to create for this function followed by enter Validating the result The software will generate a set of random input values for your function run your function with the generated input values and collect the result It will then print the input values which it generated on the console followed by the result indicated by the heading result After the values for the result have been printed the following prompt will appear Is this the expected result y n Having reviewed the generat
3. pointer to an array as a return type This is due to the fact that a typedef is needed to declare this return type prior to its use in a function declaration Due to the fact that the software uses dynamic linking to run the user s code to test it the compiled code becomes part of the software and an error such as a segmentation fault will affect not only the user s code which caused the error but will also prevent the software from continuing normally Users should consider this point carefully before enabling the NULL pointer generation feature Using the command line application Configuration Configuration settings for the software are modified using the cf or config command line argument Default include path You can configure the software with a list of default include paths which it will pass to GCC when compiling source code This setting is configured at the console by supplying a comma separated list of paths as follows autounit config include home user srcl home user src2 home user src3 Default library path You can configure the software with a list of default library paths which it will pass to GCC when linking object files This setting is configured at the console by supplying a comma separated list of paths as follows autounit config library home user libl home user lib2 home user 1ib3 Default libraries You can configure the software with a list of default libraries which it will pass to GCC
4. to be linked with any compiler output This setting is configured at the console by supplying a comma separated list of names as follows autounit config libraries libraryl library2 library3 Data type limits You can set minimum and maximum value limits for all data types supported by the software The software obeys any limits configured when generating test values This feature of the software makes a distinction between signed and unsigned versions of data types To set the minimum value to be generated for char to 10 type the following at the console autounit config min char 10 To set the maximum value to be generated for char to 80 type the following at the console autounit config max char 80 To set the default minimum and maximum for char type the following at the console autounit config min char default autounit config max char default Default array size You configure the software with a default array size It is set to 5 by default this value tells the software what size of array to generate when it encounters empty square brackets for the first dimension of an array parameter e g int func char a The software will always accept dimension sizes if they are provided regardless of this setting To configure the setting type the following at the console autounit config array 3 NULL pointer probability You can set the probability of a NULL pointer being generated for pointer parameters This setting
5. values for functions written in a subset of the C programming language Given a C source code file it will for each supported function in the file e Generate random values for the parameters of the function e Compile and execute the function and collect the result e Display the generated inputs and result e Verify with you that the result is the expected one e Accept corrections from you if the result is not the expected one e Save the generated inputs and expected result in a test database e Generate CppUnit tests in the same folder as your source code Once tests have been created the software can be run periodically to automatically apply the generated CppUnit tests and report failures and errors The software is provided in two parts e a command line application a plug in for the Eclipse CDT development environment This document provides an outline of the installation and usage of both parts of the software in addition to a description of the C language subset which is supported by the software Prerequisites GCC You must have version 4 4 of the GNU Compiler Collection installed to use this software It is available as a Debian package called gcc 4 4 Other versions of GCC may work but have not been tested CppUnit You must have the development version of CppUnit installed for this software to work It is available as a Debian package called libcppunit dev Apache Xerces 3 1 You must have version 3 1 of Apache Xerces
6. Unit gt Create Tests menu item is clicked the following dialog will appear Select the functions for which you want tests generated The following functions are supported by AutoUnit Set the number of tests to generate 1 Create Cancel Illustration 2 Eclipse plug in test selection dialog Functions for which tests are to be generated can be indicated by placing a check in the box beside each function s signature The number of tests to be generated for each function is indicated by the numeric value in the text box towards the bottom of the dialog When the Create button is clicked the following dialog is displayed for each test generated in this case 1 AutoUnit has generated the following values for function int higher int a int b a 11496353550 b 1636113110 and received the following result result 1496353550 Save ok Cancel Illustration 3 Eclipse plug in test results dialog This dialog shows the values generated for parameters a and b as well as the result whose value is editable If the result is not the expected one it is possible to correct it by entering the expected value and clicking the Save button When the Ok button is clicked the test is saved and we are shown the results of the next test or returned to our workspace if there are no further tests to be generated 10
7. User Manual for Automatic Random Regression Testing with Human Oracle Prepared by Ivan Maguidhir CO0002614 April 2011 Table of Contents O a 3 PEE MS A a cae 3 EO A A aa 3 A E E A O E E S 3 Apache Xerces liar i td 3 O thera en ction vestieoS etant ech aduee per dons ch usc oiicoS otees ues dat etea a E e 3 Stalin 4 Configuration of required options seseesessseessesseeseeseessreseesersseeseessessressessessessesseeseseeeseeseesseeseese 4 Gs Onna eer A een Rie ee PROP ar Pee In A RUE E er nan Ekman re eee 4 GppUnitincl de abl seek tint tee Side Bee eA i ie alae Moda OS 4 CppUnitlibrary pat he oa 4 CLAUDE SUIS GR wet sects ent O Mo tak 5 Using the command line applications c ciccc ssssscccetscucesnvesnesnnsentcosnutincdeblacuastesegecostessedavestavayentesebass 6 CO a aaa dans 6 Deta lt include pat tario 6 Default library pad needa hea eee eee 6 Detault DR ii or 6 DAA LTS a id 6 DA aa 7 NUEL pointer probable add rd lr 7 Greate TOSIS sia A AAA A 7 Specifying the source CO dd 7 Choosing the functions td d 7 Specifying the number of i n 7 Validating the tele E EE E EEEE Pub EE E E A ERE EENE 8 Entering the expected rest A A A 8 RUN Osa ia is ai 8 A uo ada a a a aa coe al ae 8 REMOVE TICO in A EA ii ai 9 O Saati tus cas vee taes uit cece a o RSS oaks hha ioe Sad 9 Using the Eclipse PA E A A A Aad merce tr AA LA 9 Create tests aiii a sat 9 Introduction AutoUnit is software for generating tests with random
8. ed input values and result you will know whether or not the result received is the expected one If the result is correct type y followed by enter The message Test saved will appear indicating that the test has been saved and the software will proceed to the next test to be generated If the result is not the expected one type n followed by enter Entering the expected result Having indicated that the expected result was not received the software will prompt you for the expected result If the function return type is a complex structure you will be prompted for values of all member element variables and their children If any variable is a pointer you will receive the following prompt Should x be NULL y n The actual variable name will appear in place of x If the variable was expected to be NULL in the result type y followed by enter If the variable was expected to have a non NULL value type n followed by enter For all result variables which are not NULL pointers you will receive the following prompt Enter the value for x Again the actual variable name will appear in place of x Enter a value valid for the variables data type followed by enter Once the expected result has been entered the message Test saved will appear indicating that the test has been saved Run tests To run tests either of the following commands can be typed at the console or run by a task job scheduler autounit r aut
9. it To configure autounit to use this path type at the console autounit config cppunitinc usr include cppunit CppUnit library path The CppUnit library is typically stored in usr lib To configure autounit to use this path type at the console autounit config cppunitlib usr lib C Language Subset The software supports the following set of data types char signed and unsigned short signed and unsigned int signed and unsigned long signed and unsigned float double long double The software supports the following data structures arrays with any number of dimensions struct union The software supports pointers e pointers to supported data types e pointers to supported data structures e pointers as members elements of supported data structures The software does not support functions which are declared in external files preprocessor statements other than include and the following language features e typedef enum const e extern e volatile Points worth noting e When generating random values for function parameters the software considers a pointer to a data type or data structure as being a pointer to exactly 1 of these This applies particularly to char parameters Given a function with a parameter of type char the software will not assume that this is intended to be a pointer to a string it will generate a pointer to exactly one char The software at present does not support
10. k scheduler autounit remove console c remove all tests associated with the console c file Main operation mode h help display this help screen c create file create tests for the specified source code file r run run tests l list list functions under test rm remove file remove tests associated with the specified file name cf config option value set the specified configuration option Using the Eclipse plug in The Eclipse plug in adds an AutoUnit menu to the IDE At present the menu contains only one menu item entitled Create Tests Clicking this menu item issues a Create Tests command G E home ivan Parser test c File Edit Source Refactor Navigate Search Project AutoUnit Run Window Help mi B Gy amp e oe Ov Q ja Alas Min Anes Illustration 1 Eclipse menu with AutoUnit plug in installed Create tests The Create Tests command is intended to provide the same functionality as the c and create commands for the command line application described earlier except that it uses a graphical user interface instead of a text one The Create Tests command works only when a source code file with the c extension is active in the workspace To illustrate the Create Tests command consider the following example The file currently active in the workspace is named test c and contains the following code int higher int a int b return a gt b a b When the Auto
11. ounit run Any failures or errors which occur will be recorded in the results txt file in the autounit application folder in your home directory List functions To list functions currently under test the list or command line argument can be used It is possible to list all functions or just those in a specified file autounit list autounit list home user src test c Remove tests To remove tests from the test database the remove or rm command line arguments can be used followed by the name of the source code file containing the functions under test This command removes from the test database all tests associated with all functions in the specified source code file For example the following command removes all tests associated with all functions in home user src test c autounit remove home user src test c Help To obtain a brief reminder of the commands supported by the command line application the h or help arguments can be used This will cause the application to display the following message on the console user machine autounit help Usage autounit OPTION FILE Examples autounit cf gcc usr bin gcc set the compiler path to usr bin gec autounit create functions c interactively create tests for functions c autounit list list all functions under test autounit l calc c list functions under test whose source code is calc c autounit r run tests generally called by a job tas
Download Pdf Manuals
Related Search