Home

test

1. test System test Architecture N a Integration design test Detailed 42 2 Unit Design test Coding Compiling Implementation Testing Activities Creation setup and procedure Execution experiment run Evaluation verdict assignment Validation was test good a Usually one testing solutions covers just few activities e g 4 Creation may encode verdict based on possible executions 4 Execution may result in coverage profile for validation Execution and evaluation result in monitoring passive testing a Validation may require executing and evaluating tests on faulty objects SE d x Current development trends The key to success is automation Automation means implementable tools elementary steps precise unambiguous terminating Answer formal model based development Requirement specification is a model Test generation from a model Test execution concurrently with a model Test evaluation against a model Test validation by decorating a model IUT d Uppaal as Modeling Engine Timed automata are Well defined unambiguous formal semantics Expressive cover large class of systems Simple most analysis are decidable Abstract allows almost any level of detail Uppaal provides Practical language extensions Fast algorithms Compact data structures 4 _Conformance Testing Correctness is defined via conformance relat
2. Real Time Testing using UPPAAL Marius MikuCionis with Kim Larsen Brian Nielsen Shuhao Li Arne Skou Anders Hessel Paul Pettersson AE 0000 In Computer Science Center for Indlejrede Software Systemer gt 4115 d Overview Basic Concepts about Testing Conformance for Real Time Systems Off line Test Generation Controllable Timed Automata Observable Timed Automata On line Test Generation Uppaal TRON tutorial Testi ng Is an experiment empyrical activity with a real object implementation under test or IUT with a goal of determining it s qualities almost never complete Tests can only show presence of faults but never their absence E Dijkstra complementary to formal verification Formal proofs deal with abstractions and leave out details Types of testing White box black box functional non functional Levels of testing Function component module integration system Error Fault Failure ssue Customer y d Testing In practice Primary validation technique used in industry e In general avg 10 20 errors per 1000 LOC e 30 50 of development time and cost in embedded software Used to find errors determine risk of release Part of system development life cycle Expensive tedious error prone time consuming d V development model Requirements
3. x lt 0 kol3 0 T lt 0 EnvOutput Envinput I weakCoffee strongCoffee ImpOutput I weakCoffee strongCoffee Center for Indlejrede Software Systemer Implementation Adapter e weakCoffee Update the state set and other variables strongCoffee 69 Online Testing Testing UPPAAL l weakCoffee strongCoffee weakCoffee o Symbolic state set Lola 0 gs Db a 0 EnvOutput Envinput weakCoffee strongCoffee ImpOutput I weakCoffee strongCoffee Center for Indlejrede Software Systemer Implementation Wait or offer input Let s wait for 4 units strongCoffee 70 Online Testing Testing UPPAAL r weakCoffee strongCoffee weakCoffee strongCoffee Symbolic state set 1 4 Sup e 4 EnvOutput Envinput strongCoffee ImpOutput strongCoffee Center for Indlejrede Software Systemer Implementation no output so far update the state set strongCoffee 71 x Online Testing Testing UPPAAL Implementation ro weakCoffee strongCoffee weakCoffee strongCoffee weakCoffee strongCoffee Symbolic state set Lola 4 p s 4 EnvOutput Envinput strongCoffee or offer In put ImpOutput strongCoffee Let s wait for 2 units Center for Indlejrede Software Systemer 72 Testing UPPAAL weakCoffee weakCoffee strongCoffee S
4. 12 1 x 0 tilt O 4 up x 0 td11 1 idle c VUP ve QSmin odd 0dd 1 Addo 1 i Ee oun ta 2 1 9 Addi ta 0 1 i reset vez G9min odds we GSmin ve Q7min vez G9max odd weQ7max wQ max Addi ta 3 1 2 1 tapt Addo W T res ef QImax ta 4 1 VUP VUP we QSmin Addo WO max OUT odd odd 1 tal6 1 rn 51 1 Addo ve Q7min mx Q7max Center for Indlejrede Software Systemer 42 Benchmark Example Philips Audio Protocol Coverage Execution Generation Memory Criterion time us time s usage 2 2 Edgesender 212350 Edgeneceiver 18981 Edgesender Bus Receiver 114227 129 0 Center for Indlejrede Software Systemer 43 Off Line Test Generation Observable Timed Automata gt 575 0000 UM in Computer Science Center for Indlejrede Software Systemer PALEO 4115 44 d Observable Timed Automata Determinism two transitions with same input output leads to the same state Input Enabled all inputs can always be accepted Time Uncertainty of outputs timing of outputs uncontrollable by tester Uncontrollable output IUT controls which enabled output will occur in what order 45 Timed Games and Testing Tidle 20 touch B x gt Tidle Tsw 4 off touch x 0 Tp 0 _ bright x gt Tidle touch 0 touch Off line test case generati
5. code Dummylnterface java declares inputs DummyListener java declares outputs estIOHandler java handles the communication s configure Reporter registers observable channels run translates tester s input messages to Dummy calls reportMyOutput translates calls into output messages to tester 94 Thread programming Monitor synchronization Producer Consumer lock lock lock lock queue add item while queue isEmpty cond signalAll cond await lock unlock queue remove lock unlock Consumer and producer share queue queue is protected by lock Consumer blocks and releases lock in await if queue is empty cond is associated and surrounded with lock cond wakes consumer up which reacquires lock and continues 95 Testing using Uppaal TRON TRON can be run in Real world time requires adapter models see smartlamp Virtual time provides lab conditions and releases from scheduling and communication latency problems Virtual time option Q Uses single virtual clock All threads are registered at this clock use VirtualThread instead of Thread All time related calls are forwarded to this clock Virtual clock is incremented only when all threads agree to wait May deadlock if at least one thread misbehaves Possible Zeno behavior time does not progress 96 Tips for running online tests If test fails and diagnostics at th
6. of system reset A C xe initial x C reset reset Same encodings and min cost reachability Test sequence c 6 1 6 i reset i E i reset i 1 Test suite 7 o with minimum cost 1 40 d Philips Audio Protocol A bus based protocol for exchanging control messages between audio components Collisions Tolerance on timing events Bitstream 10 0 0 1 1 0 Manchester encodin 41 Philips Audio Protocol L10cal up status 1 190 1 HOSI dri x 0 tof et coll i i ba L11cdl H10 1 41 1 dri coll EN LEE a status len 0 trail0 0 lenis dens jean trail 0 r 2 1 iD Om 0 td3r 1 ino pon x lt clmex xe cimax C70 tera ti 3 1 int x qmin len z 4en 1 coli SO eo Hed int E x eqmax mur x 0 td3f 1 tiA K tofsj 1 empty trail0 01en 0 int 0 ti 8 1 i qmin trail0 lt 2 xezqmin status len Jen trail0 trail0 1 empty e x lt qmax isDn 6 1 LOCAL 01 empty 0 til7 x gt clmin x 0 E trail0 0 0 1 7 1 to 10 1 ti11 21 109 1 x clmax x lt clmatolB 1 tt 8 1 qmax len 0 0 isUp is x 0 ti
7. s offer input choose the only coin strongCoffee 64 Testing UPPAAL 21 weakCoffee strongCoffee Symbolic state set z lt D EnvOutput req Envinput ImpOutput Center for Indlejrede Software Systemer Online Testing strongCoffee Implementation weakCoffee Update the state set and other variables strongCoffee 65 Online Testing Testing UPPAAL Implementation qr strongCoffee weakCoffee strongCoffee weakCoffee strongCoffee Symbolic state set Ot EnvOutput req Envinput Q Wait or offer input ImpOutput Let s wait for 5 units Center for Indlejrede Software Systemer 66 Online Testing Testing UPPAAL Implementation Tl strongCoffee weakCoffee strongCoffee weakCoffee strongCoffee Symbolic state set kyly 5 ER poe 5 EnvOutput req Envinput no output so far ImpOutput update the state set Center for Indlejrede Software Systemer 67 Online Testing Testing UPPAAL Implementation r1 weakCoffe e strongCoffee strongCoffee weakCoffee strongCoffee Symbolic state set ib lt a lt 5 EnvOutput req Envinput Wait or offer input ImpOutput let s offer req Center for Indlejrede Software Systemer 68 Online Testing Testing UPPAAL rl strongCoffee weakCoffee strongCoffee Symbolic state set Lolo 0
8. technique Def use pair of variable x 2 0 24 OSO 2 100 definition no defs use Encoding ve false Ute initially false Boolean array of size E x E At definition on edge i At use on edge j if v then du v e true 37 Definition Use Pair Coverage Dataflow coverage technique Def use pair of variable x KE 24 Es c m COE definition no defs use Encoding ve false Ue e I initially false Boolean array du of size x E At definition on edge i v e At use on edge j if v then du v e true Check EF all du ij true 5 Oo i yt HERRER ER L L Yt ptt tt ty 38 U ppaal CoVer by Anders Hessel and Paul Pettersson Generates coverage optimal test suites Uses models with deterministic IUT and non deterministic environment Provides a language for specifying coverage locations edges variable definition use Internally generates corresponding observer automata Uses observer automata states to encode the state of coverage gt automatic model decoration better control over model dynamic more efficient memory usage Applied on Wireless Application Protocol gateway 39 Test Suite Generation In general a set of test cases is needed to cover a test criteria Add global reset of SUT and environment model and associate a cost
9. tests should pass Extreme but still realistic behavior Fast user use clock invariants to force more inputs Test may fail Find out why test fail Advanced find boundary conditions that test does not fail Unrestricted Allow any input at any time It is OK for tests to fail explain why tests fail 90 d Tips for Modeling he model consists of a closed system All sending and receiving synchronizations are paired for every sender there is a receiver Model is partitioned into Processes for environment Processes for implementation All communication between env and goes only with observable channel synchronization Adapter processes belong to implementation Use tron i dot option to get signal flow diagram d Model partition example tron v 3 i dot fridge xml lt fridge trn dot Tpng o fridge png Where fridge trn contains input temp T output turn on turn off precision 1000 micro sec timeout 10000 mtu d Input Enabledness UT model should be input enabled If not diagnostics might be misleading Environment model should be input enabled If not there might be Inconclusive verdicts Use loop edges with caution when consuming redundant observable actions d Tips for Programming in Java Use dummy example as a stub in java dir s See src com uppaal dummy Dummy java execute method is the implementation
10. 0 C bright BRIGHT react 2 T sw 4 Z lt Tsw Z gt Treact z gt Treact Z lt Tsw Z lt Tsw x gt Tidle touch touch touch touch T idle 20 2 0 z 0 z 0 x 0 2 Check that the light switches off after three successive touches Use restricted environment and E lt gt tpEnv goal eThe fastest test sequence is O touch 0 dim 2 touch 0 bright 2 touch 0 off PASS Center for Indlejrede Software Systemer 28 d Coverage Based Test Generation Multi purpose testing Cover measurement Examples Location coverage Edge coverage Definition use pair coverage 29 d Coverage Based Test Generation Multi purpose testing Cover measurement Examples Location coverage Edge coverage Definition use pair coverage 30 d Coverage Based Test Generation Multi purpose testing Cover measurement Examples Location coverage Edge coverage Definition use pair coverage 31 d Coverage Based Test Generation Multi purpose testing Cover measurement Examples Location coverage Edge coverage Definition use pair coverage 32 d Coverage Based Test Generation Multi purpose testing Cover measurement Examples On Locations coverage U Edge coverage L Definition use pair coverage All Definition Use pairs Generated by min cost reachability an
11. DON Center for Indlejrede Software Systemer 82 Model based Testing of Real Time Systems 222 Conclusions lt 0 2 a Basic Research In Computer Science Center for Indlejrede Software Systemer 83 Conclusions esting real time systems is theoretically and practically challenging Promising techniques and tools Explicit environment modeling Realism and guiding Separation of concerns Modularity Creative tool uses Theoretical properties Real time online testing from timed automata is feasible but Many open research issues 84 EResearch Problems Testing Theory Timed games with partial observability Hybrid extensions Other Quantitative Properties Probabilistic Extensions Performance testing Efficient data structures and algorithms for state set computation Diagnosis amp Debugging Guiding and Coverage Measurement Real Time execution of TRON Adapter Abstraction IUT clock synchronization Further Industrial Cases 85 lated Work Formal Testing Frameworks Brinksma Tretmans Real Time Implementation Relations Khoumsi 03 Briones 04 04 Symbolic Reachability analysis of Timed Automata Dill 89 Larsen 97 Online state set computation Tripakis 02 Online Testing Tretmans 99 Peleska 02 Krichen 04 Center for Indlejrede Software Systemer 86 Uppaal TRON Tutorial modeli
12. Test generated and executed event by event randomly u on the fly testing enter for Indlejrede Software Systemer Test execution tool Adaptor Implementation relation eE S I are input enabled Timed LTS eLet P be a set of states eTTr P the set of timed traces from states in P after o the set of states reachable after timed trace eOut P possible outputs and delays from states in P eI rt ioco S Vo TTr E Out E I after o c Out E S after el rt ioco S iff TTr I TTr E lt TTr S gt TTr E input enabled eIntuition for all assumed environment behaviors the IUT enever produces illegal output and ealways produces required output in time 53 Sample Cooling Controller Env model eWhen T is high low switch on off cooling within r secs hen T is medium cooling may be either on or off impl freedom 9098 d Environment Modeling E Any action possible at any time E Only realistic temperature variations E Temperature never increases when cooling E No inputs completely passive On Center for Indlejrede Software Systemer 55 1 Testing Effort Given I 5 m Assume I rt ioco 5 1 Given new weaker system specification 5 If SC 5 then I rt ioco S 2 Given new stronger environment specification E If E L Ethen I rt ioco S Online Testing Algorithm kapa a a B
13. alysis of annotated graph 33 Location Coverage Test sequence traversing all locations Encoding Enumerate locations 1 1 Add an auxiliary variable 1 for each location Label each ingoing edge to location i 1 true Mark initial visited 1 true Check EF l true l true true gt gt l true 34 Edge Coverage Test sequence traversing all edges Encoding Enumerate edges e e Add auxiliary variable e for each edge Label each edge e true Check EF e true A e true oem 0 0 1 LI a e2 1 DE 35 Edge Coverage off to 0 1 z gt Treact x gt Tsw x lt Tsw touch touch touch z 0 M x 0 nm tcB 1 ae 1 HU x gt Tidle Z gt Tpause t 2 te 1 touch BI 1 bright igi 10 5 1 bright EC react 0 0 touch 0 dim 0 touch 0 bright 0 ouch O off 20 touch 0 bright 4 touch 0 dim 4 touch 0 off PASS Time 28 react 2 0 touch 0 dim 4 touch 0 0ff 20 touch 0 bright 32 4 touch 0 dim 2 touch 0 bright 2 touch 0 off PASS IME pausing user T react 2 T pause 5 O touch O dim 2 touch O bright 5 touch 0 dim 4 touch 0 off 20 touch 0 bright 2 touch 0 off PASS Time 33 Center for Indlejrede Software Systemer Definition Use Pair Coverage Dataflow coverage
14. asic Research Cen mae in Computer Science Center for Indlejrede Software Systemer Algorithm Idea State set tracking Dynamically compute all potential states that the model M can reach after the timed trace 1 0 1 0 Tripakis Failure Diagnosis Z M after 1 0 1 0 If Z the IUT has made a computation not in model FAIL jisarelevant input in Env iff EnvOutput Z Center for Indlejrede Software Systemer 5 8 Online State Estimation Timed Automata State set explorer Specification maintain and analyse a set of symbolic states in real time 2 75 System Under 59 J Abstract Online Algorithm Algorithm TestGenExe S E returns pass fail Z 4 s0 e0 while Z and fiterations lt T do either randomly 1 p offer an input if EnvOutput Z randomly choose ie EnvOutput Z send i to IUT Z Z After i wait d for an output randomly choose de Delays Z wait for d time units or output o at d lt d if o occurred then Z Z After d Z Z After o may become gt fail else Z Z After d no output within d delay restart Z 4 50 e0 reset IUT reset and restart if Z then return fail else return pass enter for Indlejrede Software Systemer 60 Abstract Online Algorithm Algorithm TestGenExe S E returns pass fail Z 4 s0 e0 while Z iterations l
15. e end is not enough s Inspect the last good state set provided by TRON s Validate model Would you expect such state to be reachable No How such state can be reached Use UPPAAL verifier to find out s Would did implementation do as the model Why not s Add System out print in your implementation s Ask TRON for more verbose messages add D test log option to save test trace to test log use v 10 instead of v 9 to see engine events If test passes unexpectedly e g TRON is too passive s Use P option with larger smaller intervals or set to P random 97 d More Details Options are documented in the user manual http www cs aau dk marius tron manual pdf When all else fail See commands in Makefile rules See smartlamp example source code Write an email to mariusQcs aau dk
16. est case Center fo 5 nter for Indlejrede Software Systemer 17 Controllable Timed Automata Input Enabled Assumption about all inputs can always be accepted model of SUT Output Urgent enabled outputs will occur immediately Determinism two transitions with same input output leads to the same state Isolated Outputs If an output is enabled no other output is enabled Example Light Controller i Ic OL 1 xez delay 0 d 1 1 Ic L 1 Eroolleor Specific Test Purposes Model Coverage Optimal test suites Center for Indlejrede Software Systemer Off Line Testing Optimal Reachability transition covered L OL UpPassive x0 starhold d 0 1 Ic L 1 20 endhold out IGrasp silence 200 out IRelease 5 0 out IGrasp 200 silence 200 out IRelease touch in OSetLevel 0 9 out IGrasp 400 silence 500 hold 5 0 out IRelease Center for Indlejrede Software Systemer Switch L OL on 1 40 1 Ic OL 21 touch switch light on touch switch light off Bring dimmer from ActiveUp To Passive DN level 0 Page 1 Off Line Testing Optimal Reachability Fastest Transition Coverage 12600 ms transition covered UpPassive starthold x z delay OL L x 0 on 1 starthold d 7 1 13 out IGrasp 900 Bring d
17. immer PassiveDn gt ActiveDN gt silence 500 hold ActiveUP increase to level 10 silence 1000 in OSetLevel 1 silence 1000 in OSetLevel 2 silence 1000 in OSetLevel 3 silence 1000 in OSetLevel 4 silence 1000 in OSetLevel 5 silence 1000 in OSetLevel 6 silence 1000 in OSetLevel 7 silence 1000 in OSetLevel 8 silence 1000 in OSetLevel 9 silence 1000 in OSetLevel 10 silence 1000 in OSetLevel 9 bring dimm State to ActiveDN out IRelease check release gt grasp is ignored out IGrasp 12400 out IRelease silence dfTolerance Page 2 21 Off Line Testing optimal Reachability L OL x 0 on 1 01 1 s Ic L 1 s0r 1 cim Ic OL 21 11 L Max xe delay L L 1 dea 0 41 1 11 1 ER Ic L 1 Ic L 1 m Specific Test Purposes m Model Coverage m Optimal test suites Center for Indlejrede Software Systemer 2 2 Timed Automata E FSM clocks guards resets x lt Tsw touch x 0 off x gt Tsw x lt Tsw touch touch ofret of KO x 0 bright BRIGHT dim dim 2 Tsw x lt Tidie O touch touch wan 0 x gt Tidle touch x 0 bright WANT if touch is issued twice quickly turned off Solution Add real valued clock x T sw 4 T idle 20 then the light will get brighter otherwise the light is 23 Timed Tests x lt Tsw _ touch E T idle 20
18. ion Mostly system level isolation is important Black box state is not observable directly Functional value of response should be correct Behavioral input output sequences Real time timing is as important as computed value Environment assumptions are explicit Input Output Real time Model Based Testing Plant Controller Program Continuous Ge cuu Discrete sensors Test generation offline or online wrt Design Model inputs VE RD outputs UPPAAL Model Center for Indlejrede Software Systemer 11 onformance Relation Specification Implementation coin give coin gt give x gt 3 tea coin give Timed Automata with Timed LTS semantics Input actions are controlled by the environment Output actions are controlled by the implementation Implementations are input enabled Testing hypothesis can be modeled by some unknown TA 12 coin coin give give x 0 x 0 lt 5 gt 3 coffee I6 coin give x 0 lt 4 x 4 coffee Center for Indlejrede S Does I conform to S Q9 58 Q8 rv e diu gt coin coin coin coin give give give give x 0 x 0 x 0 x 0 lt 5 lt 5 lt 5 gt gt 3 id _ 1 x gt 4 coffee coffee coffee I7 I8 coin in coin i give give x 0 x 0 gt 3 5 9 gt 3 coffeel coffee 13 gt 1 x g
19. ng implementing and testing gars zm mm Basic Research k ae in Computer Science Center for Indlejrede Software Systemer 87 Test the setup Check Java version by java version s Should be Sun Java 6 or 5 Check ant version by ant version Should be 1 7 0 or 1 7 1 Unpack copy Uppaal TRON 1 5 distribution Go to java directory of Uppaal TRON distribution Recompile ant clean jar Run test of smartlamp s Linux start light v sh amp start test v sh Windows start test v bat Try commands from Makefile Linux only make test light s a make test dummy s 88 aL Task model implement test Simple shutter controller for photo camera When user presses configure sensors are read luminance L 10 0 10 5 lux aperture A 1 41 2 2 83 4 5 66 8 11 31 16 22 63 32 focal length F 0 05m s Controller then computes exposition E 1ms 2s E23 14 10 2 F 2 A 2 L in seconds When user presses shoot s Shutter should get signal open within 1ms s Shutter should remain open for at least E 0 1ms time s Shutter should get signal close within E time after open configure L A F shoot User Soo Shutter open close Controller f 89 d Test Specification Run tests at least against three environments Human behavior Slow user use clock guards to slow down user All
20. on Compute winning strategy for reaching Bright Assign verdicts st lost game means IUT not conforming indlejrede Software System b A trick light control Tidle 20 touch X gt ene touch x 0 Tp 0 x gt Tsw touch _ bright 0 Tp lt 2 Tp 0 How to test for Bright qas COn 14 Belen touch QE lt lt e u gt gt Q lt lt gt gt Fi Fole Center for Indlejrede Software Systemer d Cooperative Strategies Model Statespace possibly winning Phd oe 49 JTD t 2 loosing e Play the game execute test while time available or game is lost e Possibly using ranomized online testing 48 On Line Testing emulation execution and evaluation pAlb Aris o 0000 mm Basic Research 9 Computer Science Center for Indlejrede Software Systemer 49 RELATED SITES UPPAAL UPPAAL TRON UPPAAL FOR ING REALTIME S Main Page Introduction Adaptation Testing Publications Examples Download Authors Welcome Latest News UPPAAL is an integrated tool environment for modeling validation and verification of real time systems modeled as networks Version 1 5 released of timed automata extended with data types bounded integers arrays 17 June 2009 3 New preview release with fixes for usability issue
21. s UPPAAL TRON is a testing tool based on UPPAAL engine suited for black box conformance testing of timed systems mainly targeted for embedded software commonly found in various controllers By online we mean that tests are derived executed and checked simultaneously while maintaining the connection to the system in real time new user manual draft is available for building custom adapters See Linux README and Windows README for details Below are a screenshot of smart lamp controller Java applet demo and automatically generated signal flow diagram of the More News system model LightController Like UPPAAL UPPAAL TRON is free for non profit use e g for evaluation research and teaching purposes For more details please read the license For comments or questions about this website please email the author Updated gt Wednesday 17 Jun 2009 19 44 27 CEST Center for Indlejrede Software Systemer 5 0 Model DBLclick Test Generator tool vip election amp optimization Correctness Relation Does the behavior of the blackbox implementation comply to that of the specification Test sutte Automated Model Based Conformance Testing Test execution tool Adaptor Under Test 51 Online Testing Model DBLclick Test Generator tool Selection amp optimization Correctness Relation e
22. t 3 Timed Conformance Wow Derived from Tretman s Let I S be timed I O LTS set of states TTr P the set of timed traces from P eg O coin 5 req 2 thinCoffee 9 coin Out P after o possible outputs and delays after o eg out I2 x 1 thinCoffee 0 2 I rt ioco S def Vo e TTr S Out I after o c Out S after c TTr I c TTr S if s and I are input enabled Intuition no illegal output is produced and required output is produced at right time See also Krichen amp Tripakis Khoumsi and Briones 074 Off Line Test Generation Controllable Timed Automata gt ET 0000 UM in Computer Science Center for Indlejrede Software Systemer 2 l lt 4115 15 Model Test sutte DBLclick L Test Generator tool Jr r election amp optimization Implementation Relation Does the behavior of the blackbox implementation comply to that of the specification Model Based Conformance Testing Test execution tool Event mapping tail Driver Under Test Test generation using model checking SS System model j myProtocol xml Uppaal Model Trace Checker I witness Test purpose A eSome Property Y eRandom E lt gt connection Established eShortest eFastest testConnectionEst trc Use trace scenario as t
23. t T do either randomly 1 offer an input if EnvOutput Z randomly choose i EnvOutput Z send i to IU Z Z Afte 1 wait d for an randomly choos wait for d time if o occurred t eSound fail gt non conforming eComplete non conforming gt fail as T co under some technical assumptions else Z Z After d noc 3 restart Z 50 e0 reset IUT reset and restart if Z then return fail else return pass Center for Indlejrede Software Systemer 6 1 d State set Operations 2 after a possible states Z after possible states after and after and totaling a delay of 2 Y Can be computed efficiently using the symbolic data structures and algorithms in Uppaal v T 62 Online Testing Example Testing UPPAAL Implementation Adapter a no weakCoffee strongCoffee weakCoffee strongCoffee x av gt strongCoffee Symbolic state set Kolo 0 z lt 0 EnvOutput coin Envinput Wait for output delay ImpOutput or offer input Center for Indlejrede Software Systemer 63 g Online Testing Testing UPPAAL T 1 weakCoffee weakCoffee e S Q D o Symbolic state set kolo 0 p 0 EnvOutput coin Envinput ImpOutput Center for Indlejrede Software Systemer strongCoffee Implementation Adapter Let
24. troller JavaVM w2k Linux 77 Mutants Mutant Non conforming program version with a seeded error e 1 IRCOFrecty implereritssswrtieRen 0 if lightState lightOff setLevel oldLevel lightState lightOn else was missing if lightState lighton oldLevel level setLevel 0 lightState lightOff gt 2 violates a deadline 78 dips Cooling Plants Center for Indlejrede Software Systemer 79 Industrial Application oling Controller Sensor Input eair temperature sensor edefrost temperature sensor e door open sensor Keypad Input e2 buttons 740 user settable parameters Output Relays ecompressor relay edefrost relay ealarm relay e fan relay Display Output ealarm error indication emode indication ecurrent calculated temperature eOptional real time clock or LON network module 80 Industrial Application Controller Sensor Input eair Femneratiire ceoncar Fie Templates Queries Options Help Ranja a al ea o SystemEdtor Smuistor venter Drag out sonst MINT maxT step ntDrection Name pmperatureSinus Parameters 3 compressor Global declarations B N TemperaturepDn B N IUT_TemperstureMeasurement 18 UT_ActonHander GS ENV_Action BS ENV Hack BN TestActions E N T Relay ES ENV_TemperatureReporterPhis 19 4 UT TemperatureMeas
25. urementErr BS UT NT 18 5 TemperatureReporterMinus P S ENV NT BS UT Hack 1 5 IUT TemperstureReceiverPius P S UT TemperstureReceiverMinus Process assignments reportTemp CT env CT env step nitDirection f intone Ble Edt View Insert Format Tools Chart Window Help Acrobat Ds SRY x 2121 8 w lt minTi step 2200 setPoint 2100 calcTemp H measuredTemp 2000 D 5 5 1900 4 x COFF syntax error unexpected T ID expecting end 1800 BER 1700 lt 1600 1500 0 50000 100000 150000 200000 Ready Asa 3 51 sw en e Rr o Sem e e A ms eOptional real time clock or LON network module 81 Example Test log visualization es x x setTemp modelTemp ekcTemp CON COFF AON AOFF alarmRst HADOn HADOff DON DOFF manDefrostOn manDefrostOff 100090 200000 0000 N 408000 5000 600000 700000 800000 900000 resetAlarm AOFF DOFF CON defrostOff alarmOn HighAlarmDisplayOff compressorOn n alarmDisplayOn manualDefrostOn COFF 580606
26. x gt Tsw touch x lt Tsw touch EXAMPLE test cases O0 touch 0 dim 2 touch 0 bright 2 touch off PASS 0 touch 0 dim 2 touch 0 bright 3 touch off PASS 0 touch 0 dim 5touch 0 off PASS 0 touch 0 dim 5 touch 0 of 50 touch 0 bright 6 touch 0 dim PASS Center for Indlejrede Software Systemer 24 Optimal Tests x lt Tsw T sw 4 2 Er T idle 20 off x gt Tsw x lt Tsw touch touch x 0 0 C bright BRIGHT em en x lt Tidl touch touch a 0 x gt Tidle touch x 0 bright eShortest test for bright light eFastest test for bright light eFastest edge covering test suite el east power consuming test Center for Indlejrede Software Systemer 25 ht Controller Environment model System model T_react 2 sw 4 T idle 20 z gt Treact touch z 0 x gt Tidle touch 0 Center for Indlejrede Software Systemer 2 6 Test Purposes A specific test objective or observation the tester wants to make on SUT Environment model System model DIM 0 TP1 Check that the light can become bright E lt gt LightController bright eShortest Test 20 touch 0 bright PASS eFastest Test 0 touch 0 dim 2 touch 0 bright PASS Center for Indlejrede Software Systemer 27 Test Purposes 2 System model Environment model TP2 X gt Tsw x lt Tsw touch touch x 0 DIM
27. ymbolic state set Lola 4 c HS EnvOutput Envinput strongCoffee ImpOutput strongCoffee Center for Indlejrede Software Systemer Online Testing strongCoffee Implementation Adapter weakCoffee got output after 0 delay update the state set strongCoffee 73 x Online Testing Testing UPPAAL Implementation yg weakCoffee strongCoffee strongCoffee weakCoffee strongCoffee Symbolic state set kol3 4 Es 4 EnvOutput Envinput strongCoffee wna if there ion bug ImpOutput strongCoffee Let s wait for 2 units Center for Indlejrede Software Systemer 74 x Online Testing Testing UPPAAL Implementation gt 1 strongCoffee weakCoffee strongCoffee weakCoffee strongCoffee Symbolic state set 0 EnvOutput Envinput Q no output so far ImpOutput update the state set Center for Indlejrede Software Systemer 75 Jo A L Was s ry CARE w 2 I J ss B grasp x 0 touch starthold L OL x 0 on 0 on 1 on 1 touch touch L OL OL zL on 1 L 0 y lelz on 0 us endhold Starthold OL Lx 0 0n 1 Center for Indlejrede Software Systemer _ Test Setup LightController mousePress mouseRelease Test TRON Fixture Testing eReal time Host eSimulated time LightControllerGUI LightCon

test

Contents

Download Pdf Manuals

Related Search

Related Contents