Exploratory Testing Objectives
Contents
1. Exploratory Testing resting is finding defects am e A common goals of exploration is to probe for weak areas of the program Let yourself be E cause you never know distracted what you Il find _ _ But periodically take stock of your status against your mission Exploratory Testing Testing is an extremely creative and intellectually challenging task e Simultaneous exploration design and execution An interactive test process pesto e Using the information gained while testing to design new and better tests e Different from ad hoc and error guessing as there Sot is a formal process defined Chapter 13 T taks objectives and deliverables e Testers have the skills to listen read think and report rigorously and effectively 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 4 ET vs Scripted Testing Exploratory testing Ad hoe Error te sting guessing Fully Scripted testing Scripted Testing 4 of many Launch Login Screen test User D XYX XYZ ae Password zyx ZYx ZyX Action lt Enter gt lt Login gt lt Enter gt Result login ok login ok login rejected etc 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 5 Simple test Pattern scripts Input fields Actions valid data keyboard invalid data buttons lenght gt max lenght max 1 e Operations le2. IMPROVE Exploratory destine Erik van Veenendaal eve improveqs nl Objectives Understand the background to Exploratory Testing e Understand the basis procedure to ET Identify key advantages and some disadvantages 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 1 Error Guessing e Random Ad hoc trying out e Domain product expertise e Hot spots high risk areas e Low risk areas e Sample to drive further testing Complementary to more formal techniques Friday afternoon No plan no documentation Error Guessing disadvantages No clear objectives Coverage unknown Defect reproduceability repeatability No re usable testdesigns testware e Finding defects is down to luck e Hard to manage 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 2 Exploratory Testing Approach e Based on traditional techniques tests are first So designed and then recorded md TEST fue They they may be executed at some later time or by a diferent tester In exploratory testing tests are a designed and executed at the PRODUCT amp same time and they may not even be recorded The game changes e The puzzle changes the puzzle e What s the most powerful test that I can perform right now 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 3
3. a Run attacks designed to corrupt internal data Study how software does computation Run attacks to force errant computation Being a tester means find bugs efficiently Understand where bugs might hide Know how to expose 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 9 18 Deadly Attacks Input constraint attacks ___Output constraint attacks Force all error messages to__ Force diff rent output for occur each input e Force invalid outputs e Force output size change e Force output to exceed output space Apply inputs that force default values Explore character sets and data types Overflow input buffers e Force the screen to refresh o Find input that may interact Repeat the same input many times 18 Deadly Attacks Storage constraint attacks Computation attacks Apply inputs under e Experiment with invalid differing initial conditions Data structure over and or underflow Find alternate ways to violate internal data constraints 2002 Improve Quality Services BV operand and operator combinations Force a function to call itself recursively Force computation results to be too large or too small Find features that share data or interact poorly Module C 14 Non Systematic Techniques 10 Team based approach s Two person testing together test executor and observer Regular e g daily defect meetings e What is the most interesti
4. cal features e Auditability is required e Testers are less skilled Keep track of the bug fix ratio Getting the Most Out of ET e Augment ET with formal test designs e Exploit inconsistency o Exploit the human factor Learn the logic of testing Practice critical reading and interviewing s Learn to model a product rapidly e Use a grid search strategy to control coverage e Learn to make reviewable notes e Practice responding to scrutinity s Devcloprand useheuristics 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 13 Key learning points 1 e Exploratory testing familiares tester with the product e Based on test charters e Formal test process defined e The skills of the testers are the core es Most usefull when applied in combination with formal test designs e Testing is Fun Key learning points 2 e There must be core controls in place e Test must remain objective driven e Risks are still the main driver e Re usability must be considered e Automation can only be considered if there is something to compare the results to e Test design is also an important static testing technique 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 14 Silver Bullet NO Useful YES 29 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 15
5. ng bug you have found today Team learning and motivation e Exploratory management Doing Exploratory Testing e Keep your mission and charter clearly in mind e Keep notes that help you report what you did why you did it and support your assessment of product quality e Keep track of the questions and issues raised in your exploration e To supercharge your testing pair up with another tester e You test what you know about and you are alert for clues about behaviors your don t yet know about 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 11 Where does ET fit ep RE US ES EN ete LEE product or feature particular defect You have already tested Investigate the status ofa using scripts and seek to particular risk in order to diversify the testing ___evaluatethe need for Find the single most scripted tests in that area important bug in the There isnot time to shortest time specify and script Check the work of another Testing based on reading tester by doing a brief the user manual and independent investigation checking each assertion Little or no specification Great with agile methods e RAD e RuP e DSDM Extreme programming e 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 12 Less useful when e The feedback loop breaks down e Batch systems aa e Detailed calculation expected results needed e Most criti
6. nght max _ add combinations of modify above delelete The core practice of a skilled tester e Test design on line equivalence part e Carefull observation e Critical thinking e Diverse ideas patterns heuristics generalise bugs that were found and document them in a checklist e Rich resources experiences 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 6 ET Status ET is any testing to the extent that the tester actively controls the design of the tests as those tests are performed Ms and uses information gained while testing to design new and better tests There is not one universal approach yet _ _ e Common elements but procedure needs to be defined to your needs e Goeroes Cem Kaner James Bach Stale Almland James Whittaker Allan Jorgensen Elements of Exploratory Testing e Test charters objectives List of risks coverage items to do list e Product exploration what is the it supposed to do Test design how are we going to tackle the problems Test ideas rather than formal scripts e Test execution do we think it works S Heuristics guidelines rules on the what and how Reviewable results Do the results meet the requirements and can we prove it Depends on the business objectives oa 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 7 Exploratory Testing process Test Objective Se
7. ssions exploration Debriefing Exploratory design Testing execution Procedure Test Charter What bullit list and numbering in Word Both through menu and right mouse click Why to verify that the bullit lists are consistent to check the correct numbering How use a word document use dot file new existing doc using right mouse button menu bar imported doc Expected Problems Reference 2002 Improve Quality Services BV Module C 14 Non Systematic Techniques 8 What Search Engine to look up other sources of information in the company list of sample information sources A B C etc Standard and Advanced search must be tested Why To test the search feature with single information sources and multiple sources to see that the retrieved information is presented consistently and according to standard and that the retrieved information is correct How Search from the WEB portal as well as continue searching in the result list advanced search refining the search Expected problems Some information not found Not possible to navigate to information found jumping between information sources Information found not presented consistently independent of sources References Requirement specification section x 11 Study the inputs Run attacks to break the input constraints Study the outputs Run attacks on output constraints Study the way software stores dat
Download Pdf Manuals
Related Search