Home

ソフトウェアの評価技術の標準化に関する調査研究(PDFﾌｧｲﾙ約1005KB)

Contents

1.
2. TIS0 IEC JTC1 SC7
3. 1980 CMM Capability Maturity Model 1986 CMM
4. Bees epe cias CAR LE
5. 2 RARAS 2 Ak R NI A JA m RBA f WA E
6. 10 3 metrics Gindicator
7. Do Fy DD Ces NW I SC7 WG2
8. SQuaRE Software product Quality Requirements and Evaluation 3 2 2 SQuaRE 2501n 2503n 2504n 2500n mj HEP HH E 2502n 25051 25099 SQuaRE 1 SQuaRE SQuaRE 1 19 1 2500n 2 SQuaRE ISO IEC 25000 SQuaRE Guide to SQuaRE IS
9. E YG NTT SE NTT XA S R SRA X X c EHH WG3 OLD gr Hj Fri vum
10. IS TR 7 ISO TEC 25000 ISO IEC 25001 ISO IEC 25020 150 TR 25021 ISO IEC 25030 ISO IEC 25051 ISO IEC 25062 FCD CD 3 ISO IEC CD 25010 ISO IEC FCD 25012 ISO IEC CD 25040 WD 6 ISO IEC WD 25021 ISO IEC WD 25022 ISO IEC WD 25023 ISO IEC WD 25024 ISO IEC WD 25045 ISO IEC WD 25060 25021 NWI 4 ISO TEC 25041 ISO IEC 25042 ISO IEC 25043 ISO IEC 25044 525 ISO IEC 25000 1SO Free Availability OJIS 3 JIS X 0111 2 ISO IEC TR 9126 2 2 JIS X 0129 1 2008 1 JISC X 0111 3 ISO IEC TR 9126 3 3 JIS X 0129 1 2008 4 2 JISC
11. CMMI Automotive Spice DOI JIS 5 DISO IEC 15504 1 2004 2150 15504 2 2003 Process Assessment Part 1 Concepts and vocabulary Process Assessment Part 2 Performing an assessment ISO IEC 15504 3 2004 Process Assessment Part 3 Guidance on performing an assessment
12. IT NO O 1991 7 1993 1 CMM MOD SQPA STD BT ED SAM HEALTH CHECK
13. WG1 SPE 8 NTT p crops BAT 4 gt gt E WG2 SPA f
14. 2 4 3 Evaluation Sthindgeney sa 2 5 Software Product Quality Evaluation Reference Model Laan 2 5 1 r PRE 2 5 2 Purpose of the software product quality evaluation process nana 3 5 3 DUE OIC i e t 3 5 4 Activities taskSs 2 2 4 6 SupbDort ingd DIOCESS OS A 13 Annex A normative The Process for developers 14 A 1 Acuvill s and TasKS tet de ten 14 Annex normative The Process for acquirers sseeecssssssssssseeeeseeeessseeeeeeseoonnssseeeeeeeooonassseeeesenoonesseeeesessooonass 19 B 1 PCUIVINICS and TasKs se a Ne NP eect o Act de ne 19 Annex C normative The Process for independent third party evaluation 29 C 1 Activities and asks n occus RR 29 Annex D inlormative Evaluauon TEV CIS mmm 37 D 1 Selection of evaluation levels oasis 37 D 2 Selecting evaluation techniques from evaluation levels ee 39 Annex E informative Evaluation methodS 41 E 1 Review of user and technical product documentation
15. 12 1 ISO IEC 25001 Software engineering Software product Quality Requirements and Evaluation SQuaRE Planning and management 2 ISO IEC 25010 Software engineering Software product Quality Requirements Evaluation SQuaRE Quality model 3 ISO IEC 25012 Software engineering Software product Quality Requirements and Evaluation SQuaRE Data quality model 4 ISO IEC 25020 Software engineering Software product Quality Requirements and Evaluation SQuaRE Measurement reference model and guide 5 ISO IEC TR 25021 Software engineering Software product Quality Requirements Evaluation SQuaRE Quality measure elements 6 ISO IEC 25030 Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality requirements 7 ISO IEC 25040 Software engineering Software product Quality Requirements Evaluation SQuaRE Evaluation reference model and guide 8 ISO IEC 25045 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation module for recove
16. a ee 33 2 SPA 3 3 1
17. MA MALES MA LESS FESR DU PB e PE EE SE BEE 3 1 BF 1 SPE WG2
18. 78 6 4 1 4 1 Process measurement attribute nn 79 6 4 2 4 2 Process control attribute ioc cea eei nd cec E sies Uo Bae deo cU CA Eco 81 6 5 Level 5 Opumizing DFOCBSS in i ct uS ne 83 6 5 1 5 1 Process INNOVATION alt TIDUIe se Aaaa E aA aaa Haaa aaa a 83 6 5 2 5 2 Process optimization attribute EE 85 6 6 Related Processes Tor Process Attributes nn 87 Annex A informative Conformity of the exemplar Process Assessment Model 88 A 1 ec Ase ewes cea nn ec ceed scie ce 88 A 2 Requirements for Process Assessment Models from ISO IEC 15504 2 88 A2 T ca ue cue eto iow 88 A 2 2 Process Assessment Model scoPE 88 A 2 3 Process Assessment Model elements and indicators 89 A 2 4 Mapping Process Assessment Models to Process Reference 89 A 2 5 Expression of assessment resultS eect eee 92 Annex informative Work product characteristics ee 93 B 1 Generic Work productss EE da 94 B 2 Generic and specific work produ
19. 1 2 GonformanGen a a due di 1 3 Normative referentes ou ee nn nt Ri 1 4 terms and eed 2 5 Fundamental concepts for quality requirements 2 5 1 Software SYSTEMS dua dris co ioa ne duet buo 2 5 2 Stakeholders and stakeholder requirements pp 3 5 3 Stakeholder requirements and system requirements esee 4 5 4 Software quality model se teneor nt ee ni Fono uc Enel ee 5 5 5 Software broberties ccu uda FE 7 5 6 Software quality measurement model sise 7 5 7 Software quality F QUIF eMENTS E11 8 5 8 System requirements 2 111111 9 5 9 Quality requirements life cycle model nn 10 6 Requirements for quality requirements sise 12 6 1 General requirements and assumptions nn 12 6 2 Stakeholder requirements ee 12 6 3 Soltware requirements MS a ae 14 Annex A normative Terms and 19 Annex B informative Processes from ISO IEC 15288 pe 32 01 SAR ne M 35 IV ISO IEC 2007 All rights reserved FINAL DRAFT PROJET FINAL ISO IEC 25030 2007 Foreword ISO the International Organiz
20. X 0111 4 ISO IEC TR 9126 4 JIS X 0129 1 2008 4 2 JISC JIS X 25000 SQuaRE SQuaRE 15 2008 4 2 JISC 3 2 5 WM 2 en La A
21. 1 9 2 0 3 1 E cxx 1 2 RBP e gt 2 2 2 We PO heey Pe ii eee Be tase eee eee 2 3 Ho 3 4 3 1 Ue uev tus C DUROS 14 UD CE 2 7 4 3 1 1 FBS Shek 4 ie RES SH ee wee E 3 2 1 5 3 2 2 27 7 SQuaRE ems 5 3 2 3 CAN 7 3 2 5 ADR e e eee eee e eee e ee e e e mom om momo m om om m m on n n 8 Le Pe te 9 3 3 1 esse se ee 9 iod 5 1 prie e ae et e end 9 ON Bh Be he ee ome Ue ee s CES Me ee a oe vind GS 5 SS 10
22. 52 536 Intedralion RIOEESS aa ARa a 54 5 0 1 Verification 6 a 56 55 08 7 TRANSINON PROCESS ael Essa d cens 58 55 9 TEC Validation RiOCOSS i nn NE 59 5310 TEC I Operation PrOCESS siira NSN R 61 59 11 TEC10 Maintenance PrOC SS eeu nn eer eee ee 64 ISO IEC 2006 All rights reserved iii 5 5 12 TEC T1L DISDOSAL PFOCRSS ep SN 66 6 Process capability indicators level 1 to 9 68 6 1 Level 1 Pertormed DIOGCGSS andi sauve uu acte nee een Ve 69 6 1 1 1 1 Process performance attribute eese rennen nnn enean nnn annua 69 6 2 Level 2 Managed DrOCESS eem eb 69 6 2 1 PA 2 1 Performance management attribute 69 6 2 2 PA 2 2 Work product management attribuyte enne nenne nennen nnn 72 6 3 Level 3 ene eoe sued Ero 74 6 31 PA Process definition attrita nina ei ebore Xe ner ona sue cree mS ias 74 6 3 2 PA 3 2 Process deployment 76 6 4
23. ESPRIT II BOOTSTRAP SDCAM TRILLIUM 1509000 The Malcolm Baldrige National Quality Award TR 15 JIS 3 3 2
24. SPA 9WG8 X BE 2 WGI FSM WG2 SMP WG3 SEES SUP 3 1 1 WG 34 WG 2 G1 12 WG2 11 Wig 9 3 2 Wl SPE 3 2 1 1985 ISO IEC 9126 Software quality characteristics and metrics JIS X 0129 1 TR X 0111 2 3 4 TISO IEC 14598 Evaluation of software products JIS X 0133
25. ew 3 4 WG3 OLD 3 4 1 FE
26. ee a 13 5 2 5 Process Attribute and Maturity Level Rating ee 13 2 0 Reno 14 5 3 Roles responsIibiltieS a on 14 5 4 Defining the initial assessment input 14 5 4 1 eneralreduirenmienits EE 14 5 4 2 Assessment OURO Se t E 14 54 3 Assessment SCOPE ss eia RE EAR 15 544 ClaSS Of ASSES SINGIN em a a a 15 5 45 Organmatonal Maturty Model 15 546 Roles and Responsible S roiie cuo a yr oo ea o Ue ea Uo ra ea oae eap RC ren d conr ere cd 15 5 5 Recording the assessment output nnne n nnn nnnm n nnn nnns 15 5 5 1 General requiremellfs nn 15 5 5 2 Specific Requirements Class 1 and Class 2 Assessments 16 5 6 Guidance on the assessment of Organizational 2 2 1 1 16 56r 55 55 did 16 5 56 2 Assessment Sample oues eoe On ede coe eat 16 O ISO IEC 2008 All rights reserved Guidance in the use of Organizational Maturity assessment results 17
27. ISO IEC JTC1 SC7 WG2 CIS SC7 WG2 8 p 3 4 2 1 2007 06 HOT 2 2007 07 H 05 3 2007 08 09 H 4 2007 09
28. ate 10 3 6 DATA QUNSIIT Y MODELO itas scias tablas ise a LOEO 10 3 7 DATATYPE eo eo 10 3 8 DERIVED MEASURE Zea M At PLI LC EUM ce 10 3 9 10 S TNT INSTANCE tete ut aee e m UEM E 10 SION xe LR Ok halo SN 10 D2 INFORMATION SY 5 5 11 AN TG RUDY cer a tee 11 S OMIS 5 ENG do 11 MEASUREMENT FUNCTION eR T I 11 NE 11 9 17 QUALITY MEASURE ELEMENT EK 11 DA 12 4 1 T 12 Ad Ieren CGC a a O 12 Dp XXtenueu data v eia ha EN 12 4 2 TWO 13 4 3 DATA QUALITY CHARACTERISTICS en ee 13 Jub tee ii de 13 Oo 14 2 0 5 M SU 14 OD 14 A NEN dd 15 OO 15 SCOMMILAN ee tana 1 7 15 16 2720 16 4 3 10 PPFOCISION LL Lui 16 4 3 11 IERE 111011 17 4 3 12 Ce 17
29. 42 8 12 PFOGUCE SIZC ye en a EE ENES AE E E EE EEE Na 44 8 13 HELa ABIE Ein e N ee RR 44 Annex A Informative Selected quality 4 4 47 Annex B Informative Cross reference table between quality measures and quality measure element 45214519 OMS m c 50 Annex Informative Cross Reference table between set of quality measure elements and quality cp 55 Annex D Informative Bibliography udo erii a 64 ISO IEC 2007 All rights reserved Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical
30. T 100 0014 2 13 5 03 3592 1408 T 107 8440 4 1 24 03 3585 4558
31. TTL 10 3 3 5 10 A 12 3 4 1 12 3 4 2 13 RN 13 3 4 4 SDR 13 AXI 14 1 ISO IEC 25001 Software engineering Software product Quality Requirements and Evaluation SQuaRE Planning and management 2 ISO IEC 25010 Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality model 3 ISO IEC 25012 Software engineering Software product Quality Requirements and Evaluation SQuaRE Data quality model 4 ISO IEC 25020 Software engineering Software product Quality Requirements and Evaluation SQuaRE Measurement reference model and guide 5 ISO IEC TR 25021 Software engineering Software product Quality Requirements and 1 6 7 8 9 10 11 12 Evaluation SQuaRE Quality measure elements ISO IEC 25030 Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality requirements ISO IEC 25040 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation reference model and guide ISO IEC 25045 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation modul
32. 2005 8 ISO IEC 25001 SQuaRE Planning and management IS 2007 2 2 2501n 2 ISO IEC 25010 SQuaRE Quality model 1stCD ISO IEC 25012 SQuaRE Data quality model FCD 3 2502n 5 ISO IEC 25020 SQuaRE Measurement reference model and guide IS 2007 5 ISO IEC TR 25021 SQuaRE Quality Measure Elements TR 2007 10 revision WD ISO IEC 25022 SQuaRE Measurement of internal quality W
33. 1 Scope This document defines a reference model and general requirements for software product evaluation addressing also aspects of the evaluation process for developers acquirers and independent third party evaluation This part of 2504n division establishes the scope of each document of the division and the relationship among the documents as well as shows how each SQuaRE document should be used during the activities of the evaluation process ISO IEC 25040 is intended for but not limited to developers acquirers and independent third party evaluators of software products particularly those responsible for software product evaluation It is recommended that users of the 2504n standards use this International standard as a reference model when executing their tasks ISO IEC 2002 All rights reserved 1 8 ISO IEC JTC1 SC7 SE Software and Systems Engineering INFORMATION TECHNOLOGY STANDARDS Secretariat CANADA SCC ISO IEC JTCI SC7 3933 2008 02 15 Document Type Combined WD circulation and CD registration Combined WD circulation and CD registration WD25045 Software Engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation Module for Recoverability source WG6 Project 25045 Status PDTR References Action ID ACT Due Date 2008 05 17 Start Date 2008 02 17 Distribution SC7 AG JTC 1 Medium PDF No of Pages 25 Note Please vote using the ISO Electronic
34. A 2 Regulatory Context Essential X Desirable Supportive _ B Related Work B 1 Yes Completion Maintenance of current standards No X B 2 Commitment to other Yes organisation No B 3 Other Source of Yes ___ standards No Technical Status C 1 Mature Technology Yes X _ No C 2 Prospective Technology Yes __ No Explanation Currently there is much confusion about what constitutes valid capability targets for suppliers In various industries e g automotive Hence suppliers are confronted with varying customer demands that reduce or impair the aim to perform one capability determination assessment valid for multiple customers With new safety standards that invoke or imply the need for process capability determination for software Target Profiles can provide a means to relate safety standards to process assessment capability targets The basis for Target Profiles was originally specified in ISO IEC TR 15504 Part 7 This has been retained in simplified form in ISO IEC 15504 Part 4 The NWIP proposer has proven that a valid methodology exists for creating Target Profiles in work for the European Space Agency C 3 Models Tools Yes X NO D Conformity Assessment and Interoperability D 1 Conformity Assessment Yes _X__ Would provide an informational guidance to ISO IEC 15504 Part 4 NO D 2 Interoperability Yes_ No X E Adaptability to culture Language Human funct
35. All rights reserved 1 10 C JTCT SS INFORMATION TECHNOLOGY STANDARDS Secretariat CANADA SCC ISO IEC JTCI SC7 N3921 2008 01 20 Document Type DTR Title DTR 15504 7 Information technology Process assessment Part 7 Assessment of Organizational Maturity Source SC7 WG10 Project 15504 7 Status Final SC7 3788 3919 N3920 Action ID FYI or ACT Distribution AG No of Pages 41 Sent to the JTC 1 Secretariat for DTR Ballot Address reply to ISO IEC JTC1 SC7 Secretariat cole de technologie sup rieure Department of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org Contents Page PO CW Od NN V vi 1 GOD TM UNE 1 2 NOrMatIV T l enNC S em E Et 1 3 and definitlo n tv S 1 4 A Measurement Framework for Organizational Maturity 2 4 1 INTRO CU CUO IN en a i 2 4 2 Architecture of an Organizational Maturity Model eee 3 4 2 1 Relationship between assessment of Process Capability and derivation of Organizational si i 3 4 2 2 Level 0
36. EE TTE OE 17 Validity and comparability of 15 4 1111 17 Glass or dssessmoeDnt SL dM E DD i 18 Scope olassessmoebL nito cus deos e uev pev copa cece VR nee 18 Independence of the Assessment Body and assessment 18 vitrine 19 Information available to qualify the assessment result 19 Mechanisms for verification of conformity ee 20 NETO CUI EO 1p TT EE RS 20 Verifying conformity of Organizational Maturity Models sss 21 Verifying conformity of assessments of organizational maturity 21 A informative An Exemplar Organizational Maturity Model 22 0 PR ROTE TIT TT X 22 Content of the Exemplar Organizational Maturity Model 22 Conformity of the Exemplar Organizational Maturity Model 23 Model Characteristics i euo icus co aie Ea vac s ease ea Dou ao RES qua nnmnnn vaut RE EE OS 23 Basic PIOCeSS Se
37. ISO IEC 15504 4 2004 Process Assessment Part 4 Guidance on using assessment results ISO IEC 15504 5 2006 Process Assessment Part 5 An exemplar process assessment model 4 ETR amp PDIR 6 150 15504 6 assessment model ISO IEC 15504 7 Process Assessment Process Assessment Part 6 An exemplar system life cycle process Part 7 Assessment of organizational maturity 8 ISO IEC 15504 8 Process Assessment Part 8 An exemplar process assessment model for Q ISO IEC 15504 9 IT service management Process Assessment Part 9 Capability target profiles 1 5 JIS 3 3 3 1 2007 04 H 12 2 2007 05 10 3 2007 06 H 14 4 2007 07 12 H 5 2007 09 13 6 2007 10 04 7 2007 11 08 8 2007 12 H 13 H 9
38. No of Pages Note ISO IEC JTC1 SC7 Software and Systems Engineering Secretariat CANADA SCC ISO IEC 1 5 7 3910 NWI Proposal New Work Item Proposal Information technology Process Assessment Capability Target Profiles Swiss NB 15504 NP ACT 2008 04 24 2008 01 24 SC7 AG JTC 1 PDF 4 Please vote using the ISO Electronic Balloting Facilities Resolution 937 Address reply to ISO IEC JTC1 SC7 Secretariat cole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org G3 New Work Item Proposal January 2008 PROPOSAL FOR A NEW WORK ITEM Date of presentation of proposal Proposer Switzerland SNV 2008 01 19 Secretariat ISO IEC JTC 1 N XXXX SCC ISO IEC JTC 1 SC 7 N3910 A proposal for a new work item shall be submitted to the secretariat of the ISO IEC Joint technical committee concerned with a copy to the ISO Central Secretariat Presentation of the proposal Title Information technology Process Assessment Capability Target Profiles Scope The goal of this NWIP is to specify the requirements and method for creating Target Profiles for Capability Determination purposes Purpose and justification ISO IEC 15504 Part 4 Guidance on use for process improvement and process capability determination describes the need for Target Profiles for capability determination p
39. This Technical Report is intended for but not limited to developers acquirers and independent evaluators of software product particularly those responsible for defining software product quality requirements and for software product evaluation 8 ISO IEC 2007 All rights reserved 6 FINAL INTERNATIONAL ISO IEC DRAFT STANDARD FDIS 25030 ISO IEC JTC 1 Secretariat ANSI Software engineering Software product m Quality Requirements and Evaluation 20070242 7 SQuaRE Quality requirements Voting terminates on Ing nierie du logiciel Exigences de qualit et valuation du produit 2007 04 14 logiciel SQuaRE Exigences de qualit Please see the administrative notes on page iii RECIPIENTS OF THIS DRAFT ARE INVITED TO SUBMIT WITH THEIR COMMENTS NOTIFICATION OF ANY RELEVANT PATENT RIGHTS OF WHICH THEY ARE AWARE AND TO PROVIDE SUPPORT ING DOCUMENTATION IN ADDITION TO THEIR EVALUATION AS Reference number BEING ACCEPTABLE FOR INDUSTRIAL TECHNO LOGICAL COMMERCIAL AND USER PURPOSES ISO IEC 25030 2007 E DRAFT INTERNATIONAL STANDARDS MAY ON OCCASION HAVE TO BE CONSIDERED IN THE LIGHT OF THEIR POTENTIAL TO BECOME STAN DARDS TO WHICH REFERENCE MAY BE MADE IN NATIONAL REGULATIONS ISO IEC 2007 ISO IEC 25030 2007 E Contents Page ForewWord A V a a vi 1 SCODE se
40. 6 Intetpretalion of tresulte EE EIEN SRNR 15 6 1 Mapping EE 15 6 2 side 15 Annex A normative New External Measure Autonomic Recovery Index Erreur Signet non d fini Annex B informative Application Procedure oo 16 Annex C informative Bibliography em arra retineo pra ec paa cue ve asa Ye e ERE 17 IV ISO IEC 2002 All rights reserved ISO IEC WD 25045 2007 E Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards D
41. Figure 1 Organisation of the SQuaRE series of standards Figure 1 illustrates the organisation of the SQuaRE series representing families of standards further called Divisions The Divisions within SQuaRE model are e ISO IEC 2500n Quality Management Division The standards that form this division define all common models terms and definitions referred further by all other standards from SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper standards to specific application cases offer help to all types of users The division provides also requirements and guidance for a supporting function which is responsible for the management of software product requirements specification and evaluation e ISO IEC 2501n Quality Model Division The standard that forms this division presents a detailed quality model including characteristics for internal external and quality in use Furthermore the internal and external software quality characteristics are decomposed into sub characteristics Practical guidance on the use of the quality model is also provided e ISO IEC 2502n Quality Measurement Division The standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and qual
42. Human Functioning and Context of Use E 1 Cultural and Linguistic Adaptability E 2 Adaptability to Human Functioning and Context of Use Validity Explanation Essential X _ Desirable _ Supportive ___ Yes No X Yes No X __ Yes No X __ Yes No X Yes No X __ Yes _ Translation 15 a target of this standard Thls framework Supports personalization of on line document depending on user s skill F Other Justification Notes to Proforma A Business Relevance That which identifies market place relevance in terms of what problem is being solved and or need being addressed A Market Requirement When submitting a NP the proposer shall identify the nature of the Market Requirement assessing the extent to which it is essential desirable or merely supportive of some other project A 2 Technical Regulation If a Regulatory requirement is deemed to exist e g for an area of public concern e g Information Security Data protection potentially leading to regulatory public interest action based on the use of this voluntary international standard the proposer shall identify this here B Related Work Aspects of the relationship of this NP to other areas of standardisation work shall be identified in this section B 1 Competition Maintenance If this NP is concerned with completing or maintaining existing standards those concerned shall be identified here B 2 External Co
43. Software product evaluation Quality characteristics and guidelines for their use which was developed to support these needs defined six quality characteristics and described a software product evaluation process model ISO IEC 9126 1991 was replaced in 2001 by two related multipart standards ISO IEC 9126 Software product quality and ISO IEC 14598 Software product evaluation This International Standard is a revision of ISO IEC 9126 1 2001 and incorporates the same software quality characteristics with some amendments e Security and interoperability are characteristics rather than subcharacteristics of functionality Editor s note national bodies are invited to comment on the suggested subcharacteristics e The usability subcharacteristic understandability has been renamed as appropriateness and attractiveness as likability The subcharacteristic helpfulness has been added e Quality in use has been subdivided into usability in use and safety in use which incorporate the previous subcharacteristics and has new subcharacteristics context in use security in use and adaptability in use This International Standard is intended to be used in conjunction with the other parts of the SQuaRE series ISO IEC 25000 ISO IEC 25050 of standards and with ISO IEC 14598 until superseded by the ISO IEC 25000 series of standards This International Standard complies with the technical processes defined in ISO IEC 15288 2002 related
44. System Life Cycle Processes e ISO IEC 2504n Quality Evaluation Division The standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by third party independent evaluators acquirers or developers The support for documenting a measure as an Evaluation Module is also presented ISO IEC 2002 All rights reserved vii ISO IEC CD 25040 2007 E ISO IEC 25050 to ISO IEC 25099 are reserved to be used for SQuaRE extension International Standards and or Technical Reports This International Standard is part of the 2504n Quality Evaluation Division that consists of the following International Standards ISO IEC 25040 Evaluation reference model and guide contains general requirements for specification and evaluation of software quality and clarifies the general concepts Provides a process description for evaluating quality of software product and states the requirements for the application of this process The evaluation process is the basis for software product quality evaluation for different purposes and approaches Therefore the process can be used for the evaluation of quality in use external software quality and internal software quality as well as can be applied to evaluate the quality of pre developed software or custom software during its development process The software product quality evaluation can be conducted by an acquirer a developer organi
45. of autonomic recovery index by assessing how well the system detects analyzes and resolves the disturbance This evaluation module is applicable to information systems executing transactions in a system supporting single or multiple concurrent users where speedy recovery and ease of managing recovery is important to the acquirer 1 1 Characteristics Reliability Recoverability Resiliency Autonomic recovery index 1 2 Level of evaluation Level D as defined in ISO IEC 14598 Part 5 This evaluation is intended for a system with executable products 1 3 Technique A disturbance injection methodology is a test methodology where disturbances are injected against the application and other components on the system while it is running a workload of interest to the acquirer A disturbance injection methodology and a list of disturbances based on common categories of operational faults and events are used to evaluate the external quality measure of Resiliency For each disturbance the Resiliency of the system is calculated based on the ratio of the number of transactions that complete successfully while the system is under disturbance over the number of transactions that complete successfully in a system that does not encounter the disturbance A set of disturbances are defined under the following categories e Unexpected shutdown e g abrupt OS shutdown process shutdown network shutdown e Resource contention e g CPU memory IO h
46. 06 5 2007 09 25 6 2007 11 H 20H 7 2007 12 H 11 A 8 2008 01 H 08 H CK 9 2008 02 06 3 4 3 ISO IEC FCD26514 Software and systems engineering User documentation requirements for documentation designers and developers 3 4 4
47. 2008 01 10 10 2008 02 H 14 11 2008 03 13 3 3 4 ISO IEC 15504 6 ISO IEC 15504 7 2007 IS JIS JIS X 0145 1 1 2008 3 JIS OJIS X 0145 2 2 2008 3 JIS JIS X 0145 3 3 OJIS X 0145 4 4 OTIS X 0145 5 5 3 3 5 TO 5 ISO IEC 15504
48. 4 3 13 c 17 4 3 14 18 4 3 15 0 18 ISO IEC CD 25012 Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote ISO IEC 25012 1s a part of the SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 Information Technology Subcommittee SC 7 Software and System Engineering SQuaRE
49. 5 CMM 2242 gt 7 ISO IEC 15504 Automotive Spice 5 6 7 SC7 WG10 CORB 8 9
50. Contents Page CRT LP 5 INIRE lO euS N EN i 1 ik 6 1 SCONE 8 2 GON FORMAN CO i 9 3 Normative references oo 9 4 Terms and 9 4 1 Le 9 4 2 Dase measUre D ENS eat EO 9 4 3 derived measure 9 4 4 externalisoltwWare qualty so ee T 10 4 5 ale Te Lo os se e RN 10 4 6 information need usa sesta 10 4 7 Internal software qualify oro eco aot va ee Eee nn tee sevo aav ee scu deseen decore coe con decus 10 4 8 Measure No UN e a a 10 4 9 measure VerD en En 10 4 10 Measurement dE M din 11 4 11 measurementunmeHtO ae 11 4 12 measurenient method sm 0050 sk 4 2 A A 1 11 AAS nise measure uu ee a Ri a 11 4 14 quality measure element ee 11 5 Sym
51. Organization Immalute en nn 4 4 2 9 aa a 4 4 2 4 Level 2 Organization mi ce ressens nie sonne 4 425 Level 3 Organization Established LuLu 5 4 2 5 Level 4 OrganiZation Predictable me aa aa Eea aaa 5 4 2 7 Level 5 Organization Innovating ce tente 6 4 3 Rules for deriving Maturity Levels from Capability Levels 6 4 4 Requirements for an Organizational Maturity Model ee 8 ModelCrnaracienisUgcsee em 8 442 JBaSIC Process SEL ndi ims nu EM HM LE EM DM PI MIDI MU D ELE 8 44 3 Extended PIOCOSS SEIS cod i A 8 4 5 Guidance interpreting the requirements for an Organizational Maturity Model 9 4 6 Guidance on selecting an Organizational Maturity Model 10 5 Assessing Organizational Maturity 0 11 5 1 a 11 21855 lAssessment P 11 91 27 IaSS 2 ASSESSMENT eee T 11 CSS SASSBSSINGI 11 5 2 TNE ASSESSMENT DIOCESS ene evi een ve RS a 12 521 eoe 12 522 lame 12 5 23 Data Colet UON sn aaa aa aa EE 12 524 Data
52. The standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and quality in use Measurement primitives forming foundations for the latter measures are defined and presented ISO IEC 2503n Quality Requirements Division The standard that forms this division helps specifying quality requirements These quality requirements can be used in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to technical processes defined in ISO IEC 15288 Information Technology Life Cycle Management System Life Cycle Processes ISO IEC 2504n Quality Evaluation Division The standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by evaluators acquirers or developers The support for documenting a measure as an Evaluation Module is also present ISO IEC 25050 to 25099 are reserved to be used for SQuaRE extension standards and or technical reports ISO ISO IEC CD 25010 Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality model 1 Scope This International Standard describes a two part model fo
53. and evaluation process measures and tools This includes the management of development acquisition standardization control transfer and feedback of requirements specification and evaluation technology experiences within the organisation The intended users of ISO IEC 25001 are those responsible for managing technologies used for requirements specification and evaluation execution specifying software product quality requirements Supporting software product quality evaluation managing software development organisations as well as those in a quality assurance function It is also applicable to managers involved in other software related activities ISO IEC 2007 All rights reserved 1 2 ISO IEC JTC1 SC7 Software and Systems Engineering INFORMATION TECHNOLOGY STANDARDS Secretariat CANADA SCC ISO IEC JTC1 SC7 3803 2007 07 09 Document Type CD Title CD 25010 Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality model Source JTC 1 SC7 WG6 Project 25010 Status CD References N3426 N3482 N3802 Action ID ACT Due Date 2007 10 11 Start Date 2007 07 11 Distribution SC7 AG Medium PDF No of Pages 32 Note Please vote using the ISO Electronic Balloting Facilities Resolution 937 Address reply to ISO IEC JTC1 SC7 Secretariat Ecole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada
54. committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote In exceptional circumstances the joint technical committee may propose the publication of a Technical Report of one of the following types type 1 when the required support cannot be obtained for the publication of an International Standard despite repeated efforts type 2 when the subject is still under technical development or where for any other reason there is the future but not immediate possibility of an agreement on an International Standard type 3 when the joint technical committee has collected data of a different kind from that which is normally published as an International Standard state of the art for example Technical Reports of types 1 and 2 are subject to review within three years of publication to decide whether they can be transformed into International Standards Technical Reports of type 3 do not necessarily have to be reviewed until the data they provide are considered to be no longer valid or useful Attention is drawn to the possibility that some of t
55. e hardware e g upgrading a computer system to improve response time Data Quality can affect every component of a system from the definition of system s requirements through in process and final data quality evaluation moreover data quality affects the quality in use of the system The data quality model defined in this International Standard is intended to be used in 5 ISO IEC CD 25012 conjunction with the other parts of the SQuaRE series of standards that are represented in figure 1 from ISO IEC 25000 Quality Model Division 2501n Quality Quality Requirements Quality Evaluation Division Management Division Division 2503n 2500n 2504n Quality Measurement Division 2502n Extension Division 25050 to 25099 Figure Organization of SQuaRE series of standards The Divisions within the SQuaRE series are ISO IEC 2500n Quality Management Division The standards that form this division define all common models terms and definitions referred further by all other standards from SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper standards to specific application cases offer help to all types of users The division also provides requirements and guidance for a supporting function which is responsible for the management of software product requirements specification and evaluation ISO IEC 2501n Quality Model Division The standards that
56. fact base 15 described in XML and may be automatically created from tabular form specification When a technical writer uses the target application via a scenario generator his her operation history 1s recorded as a sequence of used functions An on line help and or tutor will be generated from these scenario and fact base depends on requested user skill level Programme of work If the proposed new work item is approved which of the following document s is are expected to be developed _X_ a single International Standard ___ more than one International Standard expected number __ a multi part International Standard consisting of parts ____ an amendment or amendments to the following International Standard S ee a technical report type And which standard development track 1s recommended for the approved new work item _X _a Default Timeframe _____b Accelerated Timeframe ____ Extended Timeframe Relevant documents to be considered Co operation and liaison Preparatory work offered with target date s 2008 05 15 Signature Will the service of a maintenance agency or registration authority be required No If yes have you identified a potential candidate ali yes CANS ame b Are there any known requirements for coding No If yes please specify on a separate page Does the prop
57. in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to technical processes defined in ISO IEC 15288 ISO IEC 2504n Quality Evaluation Division The standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by evaluators acquirers or developers The support for documenting a measure as an Evaluation Module is also presented ISO IEC 2007 All rights reserved INTERNATIONAL STANDARD ISO IEC 25001 2007 E Software engineering Software product Quality Requirements and Evaluation SQuaRE Planning and management 1 Scope This International Standard provides requirements and recommendations for an organization responsible for implementing and managing the software product quality requirements specification and software quality evaluation activities through the provision of technology tools experiences and management skills The role of the evaluation group includes motivating people and training them for the requirements specification activities and the evaluation activities preparing appropriate documents identification or development of required methods and responding to queries on relevant technologies Technology management is related to the planning and management of a software quality requirements specification
58. including on line documentation 41 E 2 Evaluation based on supplier courses and training 2 4 41 E 3 Assessment of software engineering process 41 E 4 Review of operating history with the supplier ee 42 E 5 Review of operating history with customers eeeeeee ecce eeeeeeeeeee nennen nnne nennen nnn nnn nnn nana nnne 43 E 6 Review of supplier capability support and quality system 44 E 7 Prototyping and other evaluation 5 2 2 4 4 4 4 1 4 41 1 04 4 4 enne 44 Annex F informative Example of Cost Effectiveness Ranking of Evaluation Methods 46 Annex G informative Example of application of the evaluation process ss 47 ilej ofo gz e ny Va ENG 48 IV ISO IEC 2002 All rights reserved ISO IEC CD 25040 2007 E Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organizatio
59. planning and management requirements associated with software product quality requirements and evaluation While this standard 1s mainly concerned with product quality requirements and evaluation wherever it is relevant the corresponding process requirements and evaluation activities are also discussed This standard aims to clarify the requirements which should be identified by the organization in order to ensure the success of specifying quality requirements and executing the evaluation This International Standard is intended to be used in conjunction with the other parts of the SQuaRE series ISO IEC 250nn of standards and with ISO IEC 14598 and ISO IEC 9126 1 until superseded by the ISO IEC 25000 series of standards This International Standard complies with the technical processes identified In ISO IEC 15288 related to quality requirements definition and analysis Quality Model Division 2501n Quality Quality Quality Requirements Evaluation Management Division Division 500n Division 2503n 2504n Quality Measurement Division 2502n Figure 1 Organization of SQuaRE series of standards Figure 1 quoted after ISO IEC 25000 illustrates the organisation of the SQuaRE series representing families of standards further called Divisions The Divisions within SQuaRE model are e ISO IEC 2500n Quality Management Division The standards that form this division define all common models terms and definition
60. 0n Division 2503n 2504n Quality Measurement Division 2502n Figure 1 Organization of SQuaRE series of standards During the period of transition from a Technical Report to an International Standard the intention of this Technical Report is to be only a source of support for the collection of quality measure elements During this trial period the applicability of this Technical Report and its content will be evaluated in the user environment The support provided by this Technical Report for the measurement of software product quality is twofold a assist in the selection of the required quality measure elements for a given quality measure and b provide guidance for collecting the selected measurements The set of quality measures listed in this Technical Report arise from surveys involving several large commercial and academic institutions conducted during the following research projects Quality Measure Validation Survey Prague University of Economics research project GACR 201 06 0175 and Czech University of Life Sciences in Prague research projects MSM6046070904 and 2C06004 Conformity of Industrial Software to International Standards ES Excellent Software Mark Korean Agency for Technology and Standards Korea Project for Development fund of MIT China Ministry of Information Industry software engineering standardization NOTE This set does not contain quality measure elements for all ISO IEC 9126 1 Qualit
61. 25030 is part of the SQUARE series of standards The SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation SQuaRE ISO IEC 2500n Quality Management Division ISO IEC 2501n Quality Model Division ISO IEC 2502n Quality Measurement Division ISO IEC 2503n Quality Requirements Division and ISO IEC 2504n Quality Evaluation Division ISO IEC 25050 to ISO IEC 25099 are reserved to be used for SQuaRE extension standards and or Technical Reports ISO IEC 2007 All rights reserved FINAL DRAFT PROJET FINAL V ISO IEC 25030 2007 Introduction It is important to identify and specify software quality requirements as part of specifying the requirements for software product Software is usually part of a larger system System requirements and software requirements are closely related and software requirements can therefore not be considered in isolation This International Standard focuses on software quality requirements but takes a system perspective Software quality requirements can be categorized by use of a quality model for example the quality model defined in ISO IEC 9126 1 ISO IEC 25010 Measures of attributes of these characteristics and their subcharacteristics can be used to specify software quality requirements and evaluate the quality of a software product Software quality requirements address important issues o
62. 4 42 2 Process GIMENSIOMN assisia aa aaaea aa aa a aaa aa aaa 7 4 2 3 Capability AIM NSION nn se nanas ee ka ue 7 4 3 AssessmentInaiCaloES acea rare ee 8 4 3 1 Process Capability IndicatorS sm aaa DEPORTE evo bea 9 4 3 2 Process i 11 4 4 Measuring process capability se Ue eaaet cesa Ere ELO s 11 5 The process dimension and process performance indicators level 1 12 5 1 TaMoring Process TER na amen Sauce bad ca ora Vua can GE Oda 13 5 2 Agreement Processes AG REPE Ue De vg V nga RR 16 52 7 Introductions cscs use veo ek cow aav Gua uu a Colo 16 5 2 22 AAGH T Acquisition PFOCRSS ii 16 5 2 3 AGR 2 Supply PIOCOSS ciii ess nade 18 5 3 Enterprise Processes ne 20 S59 ntroductions md 20 5 3 2 ENT 1 Enterprise Environment Management Process ee 20 5 3 3 ENT 2 Investment M
63. Balloting Facilities Resolution 937 Address reply to ISO IEC JTC1 SC7 Secretariat Ecole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org ISO IEC WD 25045 2007 Contents Page Be OW PPS eee a MEM I MM LU care eines V 0 1 SCOBE e M 1 1 1 Chakacteristies 1 1 2 LEVEL Ol CV AAU OM E ewan LS ME E DL LM D 1 1 3 Techhnidle se 1 1 4 en t 2 2 CONOMANC S EOS DE TT ue sien 2 3 Normative TeIerenceS mo nt ect 2 4 2 5 Inputs and metrics EE 3 5 1 Input for the evaluatio 8 5 2 Data elements oi 11 5 3 Metrics and measures mm 12
64. C 1 Secretariat ANSI Software Engineering Software quality requirements and evaluation SQuaRE Voting begins on 2007 01 04 Quality measurement Measurement reference model and guide Voting terminates on 2007 03 04 Ing nierie du logiciel Exigences qualit et valuation du logiciel SQUARE Mesurage de qualit de r f rence de mesure et guide Please see the administrative notes on page iii RECIPIENTS OF THIS DRAFT ARE INVITED TO SUBMIT WITH THEIR COMMENTS NOTIFICATION OF ANY RELEVANT PATENT RIGHTS OF WHICH THEY ARE AWARE AND TO PROVIDE SUPPORT ING DOCUMENTATION ADDITION TO THEIR EVALUATION AS Reference number BEING ACCEPTABLE FOR INDUSTRIAL TECHNO ISO IEC FDIS 25020 2007 E LOGICAL COMMERCIAL AND USER PURPOSES DRAFT INTERNATIONAL STANDARDS MAY ON OCCASION HAVE TO BE CONSIDERED IN THE LIGHT OF THEIR POTENTIAL TO BECOME STAN DARDS TO WHICH REFERENCE MAY BE MADE IN NATIONAL REGULATIONS ISO IEC 2007 ISO IEC 25020 2007 E Contents FOreWOrM ee V an Vi 1 SCOPE A ULL ne 1 2 a 1 3 Normative r f rences sim cir orb stes Gri sa NR 1 4 Terms and de NS sm 2 5 Symbols and abbreviated terms sen a e ata
65. D ISO IEC 25023 SQuaRE Measurement of external quality WD ISO IEC 25024 SQuaRE Measurement of quality in use WD 4 2503n 1 JIS X 0170 ISO IEC 25030 SQuaRE Quality requirements IS 2007 6 5 2504n 6 ISO IEC 25040 SQuaRE Quality evaluation overview and guide 1 stCD e ISO IEC 25041 SQuaRE Evaluation Model REF ISO IEC 25042 SQuaRE Evaluation process for developers ISO IEC 25043 SQuaRE Evaluation process for acquirers ISO IEC 25044 SQuaRE Evaluation process for evaluators ISO IEC 25045 SQuaRE Evaluation Module for Recoverability
66. H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org Contents 2 SCOPE io 1 2 Conforman a in eee DL EI 2 3 Normative Tererences sn 2 A Terms d RNIUONS ao ea 2 4 1 se 2 5 Quality model framework nn 2 Sotware quality a ee one 2 5 2 ADpDoacnes TO QUAINY KEN 4 0 9 SONWAre DFODOTTIGS NR 4 5 4 Software quality measurement 5 5 5 Software product quality life cycle model ss 6 50 Quality MOSS SR 8 57 HMS TO pe evaluated E 8 5 8 Difference between internal external and quality in use measures 9 5 9 Using a quality Model 9 6 Quality model for External and Internal quality Vs 10 10 02 oeU ae i 11 seas EE 11 sm Mo 12 WS UY ETE 13 0 O aille T rr 14 67 es de ote elena Doo uit Sai Ga 14 15 7 Quality model for software quality in USe ee 16 16 7 2 Software quality in use i 16 USD 17 Cd C
67. IEC 25020 2007 E Quality Requirements Division 2503n Quality Model Division 2501n Quality Quality Management Division Evaluation 2500n Division 2504n Figure 1 Organization of the SQuaRE series of International Standards 25022 Measurement of internal quality 25020 Measurement reference model and guide 25023 25024 Measurement of Measurement of quality external quality in use 25021 Quality measure elements Figure 2 Structure of the Quality Measurement division viii FINAL DRAFT PROJET FINAL ISO IEC 2007 All rights reserved INTERNATIONAL STANDARD ISO IEC 25020 2007 E Software Engineering Software quality requirements and evaluation SQUARE Quality measurement Measurement reference model and guide 1 Scope The scope of this International Standard is the selection and construction of software product quality measures especially with respect to their use in conjunction with ISO IEC 2503n Software product quality requirements division and ISO IEC 2504n Software product quality evaluation division standards It also provides information that assists users of the SQuaRE quality measurement technical reports ISO IEC 25021 ISO IEC 25022 ISO IEC 25023 and ISO IEC 25024 to achieve the intended benefits of the above standards This International Standard also contains the following informative annexes A through C and Bibliography Criteria for selecting sof
68. NP 6 25051 25099 SQuaRE 3 e ISO IEC 25051 SQuaRE Requirements for quality of Commercial Off The Shelf COTS software product and instructions for testing IS 2006 4 ISO IEC 25062 SQuaRE Common Industry Format for Usability Test Reports IS Fr 2006 4 ISO IEC 25060 SQuaRE General framework for usability related information WD JIS SQuaRE 25001 25022 25023 25024 25030 25045 3 2 3 1 200742044138 4 2 200742055 118 3 20074E06 H 08 H 4 20074207 H 06 5 20074208 H OL 6 2007 09 07 H 4 7 2007 09 28 8 2007 10 26 9 2007 12 07 4 10 2008 01 11 11 2008 02 01 4 12 2008 03 07 4 3 2 4 3 2 2
69. OMEX USE m 17 7 0 Salely ID USC en a a om etre 18 RS 18 em 18 Annex A normative Terms and definitions ee 20 ISO ISO IEC CD 25010 Annex B informative Bibliography 23 ISO IEC CD 25010 ISO Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote Attention is drawn to the possibility that some of
70. OUR eo 3 4 3 EVALUATION TECHNOLOGY TECHNOLOGY USED FOR EVALUATION 3 4 TC LNT OU S Sood od 3 5 EVALUATION MANAGEMENT CONCEPTS ccccccsccccccccccccccccccccccccccccccece 3 6 REQUIREMENTS AND RECOMMENDATIONS FOR SOFTWARE QUALITY REQUIREMENTS SPECIFICATION QUALITY EVALUATION 4 AFN aad eens 4 6 2 ORGANISATION LEVEL ACOTIVITIE Se dy a a 5 6 3 PROJECT MANAGEMENT LEVEL ACTIVITIES 0000000000000000000 essere sa sera uae 8 6 4 ANALYSIS AND USE OF EVALUATION 8 0 0 00 001000000000 ses sase ra uae 9 Annex A Informative Quality Evaluation Project Plan Template 11 MS UPD D CAES NY asc a 15 ISO IEC 2007 All rights reserved ISO IEC 25001 2007 E Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison
71. Quality Model Division The International Standard that forms this division presents a detailed quality model including characteristics for internal external and quality in use Furthermore the internal and external software quality characteristics are decomposed into subcharacteristics Practical guidance on the use of the quality model is also provided ISO IEC 2502n Quality Measurement Division The International Standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and quality in use Measurement primitives forming foundations for the latter measures are defined and presented ISO IEC 2503n Quality Requirements Division The International Standard that forms this division helps specify quality requirements These quality requirements can be used in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to technical processes defined in ISO IEC 15288 ISO IEC 2504n Quality Evaluation Division The International Standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by evaluators acquirers or developers The support for documenting a meas
72. aRE series of International Standards is to move to a logically organized enriched and unified series covering three complementary processes requirements specification measurement and evaluation The purpose of the SQuaRE series of International Standards is to assist those developing acquiring software products with the specification and evaluation of quality requirements It establishes criteria for the specification of software product quality requirements and their evaluation It includes a two part quality model for aligning customer definitions of quality with characteristics of the software product In addition the series defines measures of software product quality characteristics that can be used by developers acquirers and evaluators It has to be stressed that the SQuaRE series of International Standards is dedicated to software product quality only The Quality Management Division of the SQuaRE series deals with software products and is separate and distinct from the Quality Management of processes which is defined in the ISO 9000 family of International Standards The major benefits of the SQuaRE series over its predecessor standards include coordination of guidance on software product quality measurement and evaluation guidance for the specification of software product quality requirements and harmonization with ISO IEC 15939 in the form of Quality Measurement Reference model presented in this Internati
73. anagement Process 22 5 3 4 System Life Cycle Processes Management 24 5 9 9 ENT 4 Resource Management Process ee 25 5 3 6 ENT 5 Quality Management ProceSS rr 26 5 4 Project Processes inr 28 5 4 1 SIBIFOdUClHOD EEE 28 5 4 2 PRJA Project Planning ProcessS uec coeno Een es de ze 28 5 4 3 PRJ 2 Project Assessment ProceSS sioe ient iio uns eus ORE ES st 31 34 4 Project Control PFOGCGSS EKKEN 33 5 4 5 DECISION MAKING Processado duro sita e Corsa ve osa 35 546 PRJ 5 RISK Management PIOGCGSS an 36 5 47 PRJ 6 Configuration Management ProCceSS 38 5 4 8 PRJ 7 Information Management ProCceSS eese ieeeen eiie enne nennen nnne anna nnn nnn nn nnns 40 5 5 Technical Processes as 42 JroguctiO naa en A A A a a E 42 5 5 2 TEC 1 Stakeholder Requirements Definition Process ne 43 5 5 3 TEC 2 Requirements Analysis Process 46 5 5 4 TEC 3 Architectural Design ProOCeSS 49 5 5 5 TEC 4 Implementation ProcessS xen que e den eaa pix e
74. aracteristics for typical work products to assist the assessor in evaluating the capability level of processes Annex C contains style guides for defining base practices work products and generic practices for adjusting the Process Assessment Model and guidance explaining how to expand or adapt the model and the Bibliography contains a list of informative references ISO IEC 2006 All rights reserved Vii Information technology Process assessment Part 6 exemplar system life cycle process assessment model 1 Scope This informative part of ISO IEC 15504 defines an exemplar Process Assessment Model that meets the requirements of ISO IEC 15504 2 and that supports the performance of an assessment by providing indicators for guidance on the interpretation of the process purposes and outcomes as defined in ISO IEC 15288 and the process attributes as defined in ISO IEC 15504 2 provides guidance by example on the definition selection and use of assessment indicators A process assessment model comprises a set of indicators of process performance and process capability The indicators are used as a basis for collecting the objective evidence that enables an assessor to assign ratings The set of indicators included in this part of ISO IEC 15504 is not intended to be an all inclusive set nor is it intended to be applicable in its entirety Subsets that are appropriate to the context and scope of the a
75. ation for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC 25030 was prepared by Joint Technical Committee ISO IEC JTC 1 Information technology Subcommittee SC 7 Software and systems engineering ISO IEC
76. ave established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 9o of the national bodies casting a vote Attention is drawn to the possibility that some of the elements of this part of ISO IEC 25020 may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC FDIS 25020 is part of the SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 nformation technology Subcommittee SC 7 Software and Systems Engineering SQuaRE series of standards consists of the following divisions under the general title Software Engineering Software Quality Requirements and Evaluation SQuaRE Quality Management Division ISO IEC 2500n Quality Model Division ISO IEC 2501n Quality Measurement Division ISO IEC 2502n Quality Requirements Division ISO IEC 2503n and Quality Evaluation Division ISO IEC 2504n ISO IEC 2007 All rights reserved FINAL DRAFT PROJET FINAL V ISO IEC 25020 2007 Introduction The general goal of creating the SQu
77. bols and abbreviated feriis assisas dN di 11 6 Quality measure elements concept ae 11 6 1 Quality measure elements in the Software Product Quality Measurement Reference Model ROOM RN 12 6 2 Quality measure elements and their categories ee 13 6 3 Aspects of quality measure elements nn 13 6 4 Table format of quality measure elements nn 15 7 Quality measure element categories pp 16 8 Set or quality measure elements co 0m oe 18 8 1 Data 18 8 2 Number ot tems a A 20 8 3 Number Or Fall res a RS EE E E i i 24 8 4 Number Of FaultS 26 8 5 N mberoft FUNCTIONS An cued 27 8 6 Number of EVvents het ec ee eel 35 8 7 Number of Reguremente nm i a 36 8 8 Number of sena sen 37 8 9 NumbDer or asKS bp 38 8 10 i 41 8 11 Number of TrialS
78. ctS 96 Annex C informative Adaptation of the assessment model sens 117 C 1 Assessment indicators identification 117 CTI Bas PNAC COS i mo ee PRA C dea ape vi A te 117 C12 Generic Dracli 68S a ua Cede Due eue e Ce duele Ua 118 C 2 Adaptation of the exemplar Process Assessment Modlel 119 C 2 1 Adding to or removing processes from the process dimension 119 C 2 2 Identifying process performance indicators for a new proceSS ue 120 Bibliography ea Re Re Re 121 IV ISO IEC 2006 All rights reserved Foreword ISO the International Organization for Standardization is a worldwide federation of national standards bodies ISO member bodies The work of preparing International Standards is normally carried out through ISO technical committees Each member body interested in a subject for which a technical committee has been established has the right to be represented on that committee International organizations governmental and non governmental in liaison with ISO also take part in the work ISO collaborates closely with the International Electrotechnical Commission IEC on all matters of electrotechnical standardization International Standards are drafted in accordanc
79. e all the quality measures for a given product these measurements need to be performed only once at the attribute level This approach will improve the productivity of the measurement processes Usability guidance cross reference This Technical Report allows users to identify the possible indicators of quality quality measures that can be derived by measuring one or more measures from a selected set of quality measure elements and thereby maximizing the benefits from the measurement process The quality measure elements are the common components of quality measures The intention here is that users of this Technical Report will select measures from quality measure elements for the purpose of defining internal external or quality in use measures These are then used for quality requirements definition ISO IEC 25030 software products evaluation ISO IEC 2504n quality assessment and other purposes It is therefore strongly recommended to use this Technical Report and the other standards in the Quality Measurement Division together with the other relevant documents in the ISO IEC 25000 series of standards 25020 Measurement reference model and quide 25022 25023 25024 Measurement of Measurement af Measurement of quality internal quality external quality in use 25021 Quality measure elements Figure 2 Structure of the Quality Measurement Division ISO IEC 2007 All rights reserved 7 Quality measure elements to
80. e for recoverability ISO IEC DTR 15504 6 Information technology Process assessment Part 6 An exemplar system life cycle process assessment model ISO IEC DTR 15504 7 Information technology Process assessment Part 7 Assessment of organizational maturity NWI ISO IEC 15504 8 Information technology Process assessment Part 8 Capability target profile NWI Software and systems engineering Reference structure for dynamic generation of online user documentation ii 1
81. e with the rules given in the ISO IEC Directives Part 2 The main task of technical committees is to prepare International Standards Draft International Standards adopted by the technical committees are circulated to the member bodies for voting Publication as an International Standard requires approval by at least 75 of the member bodies casting a vote In exceptional circumstances when a technical committee has collected data of a different kind from that which is normally published as an International Standard state of the art for example it may decide by a simple majority vote of its participating members to publish a Technical Report A Technical Report is entirely informative in nature and does not have to be reviewed until the data it provides are considered to be no longer valid or useful ISO IEC TR 15504 6 was prepared by Technical Committee ISO IEC TC JTC1 Information Technology Subcommittee SC 7 Software and Systems Engineering ISO IEC TR 15504 consists of the following parts under the general title nformation technology Process assessment Part 1 Concepts and Vocabulary Part 2 Performing an Assessment Part Guidance on performing an assessment Part 4 Guidance on use for process improvement and process capability determination Part 5 An exemplar Process Assessment Model Part 6 An exemplar system life cycle process assessment model This Part of ISO IEC 15504 is informat
82. ed 1 7 ISO IEC JTC1 SC7 ey STC 1 29 Software and Systems Engineering INFORMATION TECHNOLOGY STANDARDS Secretariat CANADA SCC ISO IEC 1 5 7 3924 2008 01 21 Document Type CD ballot Title CD 25040 2 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation reference model and guide Source WG6 Project 25040 Status 2 CD References SC7 N3695 N3739 N3293 Action ID ACT Due Date 2008 04 23 Start Date 2008 01 23 Distribution SC7 AG JTC 1 Medium PDF No of Pages 21 Note Please vote using the ISO Electronic Balloting Facilities Resolution 937 Address reply to ISO IEC JTC1 SC7 Secretariat Ecole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org ISO IEC CD 25040 2007 E Contents Page FOre WO eee eC V Sn i Ra Vi 1 SCODO 1 2 ER 1 3 Normative sm te en 1 4 Terms aNd deN O nS Sam MEE 2 4 1 Evaluation coVverade sii aa a Aaaa aE 2 4 2 Evaluatio leve es
83. ent and capability determination It defines the conditions under which the results of conformant assessments of process capability can be translated into expressions of organizational maturity ensuring that the results are objective impartial consistent repeatable comparable and representative of the assessed organizational units This part of the International Standard provides a structured approach for the assessment of organizational maturity for the following purposes by or on behalf of an organization with the objective of understanding the status of its organizational maturity for process improvement by or on behalf of an organization with the objective of determining the suitability of its organizational maturity for a particular requirement or class of requirements by or on behalf of one organization with the objective of determining the suitability of another organization s processes for a particular contract or class of contracts NOTE Copyright release Users of this part of ISO IEC 15504 may freely reproduce relevant material as part of any Organizational Maturity Model or as part of any demonstration of conformance with this international standard so that it can be used for its intended purpose om ISO IEC 2008 All rights reserved 11 INFORMATION TECHNOLOGY STANDARDS Document Type Title Source Project Status References Action ID Due Date Start Date Distribution Medium
84. eries provides recommended measures of software product quality attributes that can be used by developers acquirers and evaluators SQuaRE provides e Terms and definitions e Reference models e General guide e Individual division guides and e Standards for requirements specification planning and management measurement and evaluation purposes SQuaRE includes international standards on quality model and measures as well as on quality requirements and evaluation SQuaRE replaces the current ISO IEC 9126 series and the 14598 series ISO IEC 25040 Evaluation reference model and guide replace 14598 1 Software product evaluation General overview ISO IEC 25041 Evaluation modules replace 14598 6 Software product evaluation Documentation of Evaluation Modules ISO IEC 25042 Evaluation modules replace 14598 3 Software product evaluation Process for Developers ISO IEC 25043 Evaluation modules replace 14598 4 Software product evaluation Process for Acquirers ISO IEC 25044 Evaluation modules replace 14598 5 Software product evaluation Process for Evaluators ISO IEC 14598 2 Software Product Evaluation Planning and Management is a part of ISO IEC 250001 VI ISO IEC 2002 All rights reserved ISO IEC WD 25045 2007 E Quality Model Division 2501n Quality Quality Quality Requirements Management Division Evaluation Division Division 2500n 2503n 2504n Quality Measurement Division 2502n
85. f quality for software products Software product quality requirements are needed for specification including contractual agreement call for tender planning including feasibility analysis and translation of external software quality requirements into internal software quality requirements development including early identification of potential quality problems during development and evaluation including objective assessment and certification of software product quality If software quality requirements are not stated clearly they be viewed interpreted implemented and evaluated differently by different people This may result in software which is inconsistent with user expectations and of poor quality users clients and developers who are unsatisfied and time and cost overruns to rework software This International Standard aims to improve the quality of software quality requirements It does this by providing requirements and recommendations for quality requirements and guidance for the processes used to define and analyse quality requirements Application of this International Standard should help ensure that software quality requirements are In accordance with stakeholder needs stated clearly and precisely correct complete and consistent and verifiable and measurable This International Standard is intended to be used in conjunction with the other parts of the SQuaRE serie
86. form this division present detailed quality models for software and data Furthermore in the software quality model the internal and external quality characteristics are decomposed into subcharacteristics Practical guidance on the use of the quality models is also provided ISO IEC 2502n Quality Measurement Division The standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and quality in use Quality Measure Elements forming foundations for the latter measures are defined and presented ISO IEC 2503n Quality Requirements Division The standard that forms this division helps specifying quality requirements These quality requirements can be used in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to ISO IEC CD 25012 technical processes defined in ISO IEC 15288 Information Technology Life Cycle Management System Life Cycle Processes ISO IEC 2504n Quality Evaluation Division The standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by evaluators acquirers or developers The support for documenting a measure as an E
87. gether with the other support documentation offered in this Technical Report provide added value to the ISO IEC 9126 Technical Reports and International Standards by making them more understandable to users by clearly defining the relevant quality measure elements Figure 3 In this sense this Technical Report acts effectively as the common link between the 9126 series and its follower the SQuaRE series 9126 4 Quality in Use 25021 Quality measure elements 9126 3 Internal Metrics Quality measure element categories 9126 2 External Metrics Quality measure elements I Quality characteristics SQuaR Quality Measure 1 Measure 2 Measure 3 Figure 3 The relationship of 25021 TR as a link between the 9126 series and the SQuaRE series of standards 1 Scope This Technical Report specifies an initial set of quality measure elements in order to assist users of the ISO IEC 9126 series of technical reports ISO IEC TR 9126 2 ISO IEC TR 9126 3 ISO IEC TR 9126 4 and users of SQUARE series of quality measurement standards ISO IEC 25020 ISO IEC 25022 ISO IEC 25023 and ISO IEC 25024 in the selection and use of the quality measures for software product quality evaluation and to select the entities to be measured in the software product lifecycle This Technical Report contains a A description of the concept of quality measure elements b Considerations for using quality measure elements c Aset of quality measure elements
88. h are not immediately re usable because of semantic ambiguity or lack of consistency between such data and other existing co related data e the co existence of legacy architecture and systems with distributed systems designed and realized at different times and with different standards e the existence of information systems such as the world wide web where data changes frequently and integration is a special issue The data quality model defined in this International Standard aims to meet these needs it could for example be used to e ensure data quality of existing data even regardless of software e provide a basis useful to define organization s requirements in developing acquiring or maintaining computer systems or information systems e identify data quality requirements in data production acquisition and evaluation processes including security and interoperability aspects identify data quality assurance criteria also useful for re engineering assessment and improvement of data e help organizations to evaluate the compliance to laws and or requirements The detection of errors or inefficiencies due to data give rise to enhancement and corrective interventions concerning data e g redesigning parsing cleansing enriching transforming matching human business process e g user s training to avoid errors in the data entry process e software e g modifying source programs to implement consistency controls
89. he elements of this document may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC TR 25021 which is a Technical Report of type 2 was prepared by Joint Technical Committee ISO IEC JTC 1 Information technology Subcommittee SC 7 Software and System Engineering SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation Quality Management Division Quality Model Division Quality Measurement Division Quality Requirements Division and Quality Evaluation Division ISO IEC 2007 All rights reserved 5 Introduction The purpose of this Technical Report is to define an initial set of quality measure elements to be used throughout the software product life cycle for the purpose of Software Product Quality Requirement and Evaluation SQuaRE While the quality measure elements can be used for standalone measurement their main purpose is to be used as the building blocks for other SQuaRE measures as described in ISO IEC TR 9126 2 ISO IEC TR 9126 3 ISO IEC TR 9126 4 technical reports The content of this Technical Report constitutes the link between the ISO IEC 9126 series of standards and the subsequent SQuaRE series of standards Figure 1 Quality Model Division 2501n Quality Quality Quality Requirements Management Division Evaluation Division 250
90. iliency and autonomic recovery index when the information system composed of one or more software products execution transactions is subjected to a series of disturbances A disturbance could be an operational fault e g an abrupt shutdown of an OS process that brings down a system or an event e g a significant increase of users to the system ISO IEC 2002 All rights reserved ISO IEC WD 25045 2007 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation Module for Recoverability 1 Scope The ability of a software product and thereby a system to remain available or to recover within acceptable timeframe from disturbance has always been important since a down time often has economic and other consequences The emphasis in recent years has extended to the autonomic ability of the software product and thereby a system to self manage with minimal involvement by human operator There are interests in the user domain and industry on how well a software product and thereby a system handles such disturbances in the way it detects analyses adjusts or recovers This ISO IEC 25045 Evaluation Module for Recoverability makes use of the disturbance injection methodology and a list of disturbances based on common categories of operational faults and events to evaluate the external quality measure of resiliency A set of questions is defined for each disturbance to evaluate the external quality measure
91. ing customer definitions of quality with attributes of the development process In addition the series provides recommended measures of software product quality attributes that can be used by developers acquirers and evaluators SQuaRE provides e Terms and definitions e Reference models e General guide e Individual division guides and e Standards for requirements specification planning and management measurement and evaluation purposes SQuaRE includes international standards on quality model and measures as well as on quality requirements and evaluation SQuaRE replaces the current ISO IEC 9126 series and the 14598 series vi O ISO IEC 2002 All rights reserved ISO IEC CD 25040 2007 E Quality Model Division 2501 Quality Quality Quality Requirements Management Division Evaluation Division Division 2500n 2503n 2504n Quality Measurement Division 2502n Figure 1 Organisation of the SQuaRE series of standards Figure 1 illustrates the organisation of the SQuaRE series representing families of standards further called Divisions The Divisions within SQuaRE model are e ISO IEC 2500n Quality Management Division The standards that form this division define all common models terms and definitions referred further by all other standards from SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper standards to specific applicatio
92. ioning and context of use E 1 Cultural and Linguistic Yes_ Adaptability No X E 2 Adaptability to Human 5 _ Functioning and Context Use No X _ F Other Justification 12 G3 New Work Item Proposal March 2007 PROPOSAL FOR A NEW WORK ITEM Date of presentation of proposal Proposer Secretariat ISO IEC JTC 1 N XXXX National Body ISO IEC JTC 1 5 XX N XXX A proposal for a new work item shall be submitted to the secretariat of the ISO IEC joint technical committee concerned with a copy to the ISO Central Secretariat Presentation of the proposal Title Software and systems engineering Reference structure for dynamic generation of on line user documentation Scope and field of application This standard specifies a framework for dynamically generating help and or tutor document for users Actual help and or tutor document is dynamically generated when the user refers necessary information if a document developer registered elements that correspond to parts of final document and prepared scenarios Purpose and justification This standard specifies a framework for dynamic generation of user documentation and demonstrates an example implementation of this framework By using this framework a document developer may starts his her work at the very beginning of the software development process and easily adapt update or specification change of the software The collection of elements of document called
93. ity in use Measurement primitives forming foundations for the latter measures are defined and presented e ISO IEC 2503n Quality Requirements Division The standard that forms this division helps specifying quality requirements These quality requirements can be used in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to technical processes defined in ISO IEC 15288 Information Technology Life Cycle Management System Life Cycle Processes e ISO IEC 2504n Quality Evaluation Division The standards that form this division provide requirements recommendations and guidelines for software product evaluation whether performed by evaluators acquirers or developers The support for documenting a measure as an Evaluation Module is also presented This International Standard is part of the 2504n Quality Evaluation Division that consists of the following International Standards see Figure 2 O ISO IEC 2002 All rights reserved vii ISO IEC WD 25045 2007 viii ISO IEC 25040 Evaluation reference model and guide contains general requirements for specification and evaluation of software quality and clarifies the general concepts Provides a process description for evaluating quality of software product and states the requirements for the application of this process The evaluation process is the basis for soft
94. ive ISO IEC 2006 All rights reserved V Introduction This part of ISO IEC 15504 provides an example of a System Life Cycle Process Assessment Model for use in performing a conformant assessment in accordance with the requirements of ISO IEC 15504 2 An integral part of conducting an assessment is to use a process assessment model that is constructed for that purpose is related to a process reference model and is conformant with ISO IEC 15504 2 which sets out the minimum requirements for performing an assessment in order to ensure consistency and repeatability of the ratings A process reference model cannot be used alone as the basis for conducting consistent and reliable assessments of process capability because it requires greater detail to indicate process performance and capability Therefore descriptions of process purpose and process outcomes provided by a process reference model need to be supported with a comprehensive set of indicators of process performance and the capability levels and process attributes defined in ISO IEC 15504 2 and its associated rating scale need to be supported with a set of indicators of process capability This additional detail describes a process reference model in terms of a process assessment model that can enable the assessment of consistent and repeatable ratings of process capability This Process Assessment Model contains a set of indicators to be considered when i
95. lity of different solutions proposed by vendors using a common workload N ISO IEC 2002 All rights reserved 9 Document Title Source Project Status Reference Action ID Distribution No of Pages Note SyJTCT INFORMATION TECHN OLOGY STANDARDS Secretariat CANADA SCC ISO IEC JTC1 SC7 Software and Systems Engineering ISO IEC JTC1 SC7 N3669 2006 12 26 DIR DTR 15504 6 Information technology Process assessment Part 6 An exemplar system life cycle process assessment model WGIO 15504 6 Final N3551 N3668 FYI or ACT AG 129 Sent to JTC 1 for processing Address reply to ISO IEC JTC1 SC7 Secretariat cole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org Contents Page V E a UE Ea 1 SCODE RR 1 2 Normative relerenGe Ss oun ies a da 1 3 Terms GENNITNONS se a 2 4 Overview of the exemplar Process Assessment Model ee 2 4 1 INTFOGUCTION 10 OVER VICW om aasaran RCRA 2 4 2 Structure of the exemplar Process Assessment Model ee 3 VAN MEM el Si aaa nee a aaa eC a a aaae
96. m such as operating system data Data Quality Model Human Information system business Svstem process Computer system Computer Non target Mechanical hardware Data system Figure 2 Data quality model in SQuaRE Architecture The purpose of the data quality model defined in this International Standard is to define and describe characteristics that may be used as a term of reference to define data quality requirements and data quality measures and to establish criteria for the assessment and evaluation of the quality of the data managed by a computer system according to organization s objectives 8 ISO IEC CD 25012 Three main situations can be highlighted a when anew system needs to define the requirements to be allocated to data b when an existing system needs to assess data quality for data acquisition integration reengineering migration compliance purposes c to support data management and systems interoperability all through the data life cycle In the first situation the data quality model defined in this International Standard aims to support the implementation of system s life cycle processes such those defined for example in ISO IEC 15288 Systems and software engineering System life cycle processes In the second situation data are analysed independently from other system s components which may also be unknown or not available for example the software that created data may not be available
97. ment indicators are introduced in this clause clause 5 addresses the process dimension It uses process definitions from ISO IEC 15288 to designate the Process Reference Model The processes of the Process Reference Model are described in the Process Assessment Model in terms of purpose and outcomes and are grouped in four process categories The Process Assessment Model expands the Process Reference Model process definitions by including a set of process performance indicators called base practices for each process The Process Assessment Model also defines a second set of indicators of process VI ISO IEC 2006 All rights reserved performance by associating work products with each process Clause 5 is also linked directly to Annex which defines the work product characteristics clause 6 addresses the capability dimension It duplicates the definitions of the capability levels and process attributes from ISO IEC 15504 2 and expands each of the nine attributes through the inclusion of a set of generic practices These generic practices belong to a set of indicators of process capability in association with generic resource indicators and generic work product indicators Annex B is also linked directly to Clause 6 as it defines the work product characteristics Annex A provides a statement of conformance of the Process Assessment Model to the requirements defined in ISO IEC 15504 2 Annex B provides selected ch
98. ment output is self consistent and provides evidence to substantiate the ratings and to verify compliance with the requirements This part of ISO IEC 15504 identifies a Measurement Framework for Organizational Maturity and establishes requirements for a constructing Organizational Maturity Models b performing an assessment of Organizational Maturity verifying conformity of organizational maturity assessments As defined in this part of ISO IEC 15504 Organizational Maturity is an expression of the extent to which an organization consistently implements processes within a defined scope that contributes to the achievement of its business goals current or projected The scope of reference for an assessment of Organizational Maturity is determined by the Organizational Maturity Model employed for the assessment An Organizational Maturity Model is based upon one or more specified Process Assessment Models and addresses the domains and contexts for use of the Process Reference Models from which the Process Assessment Models are derived The assessment of Organizational Maturity is undertaken through the performance of process assessment as specified in ISO IEC 15504 2 Specific conditions are defined in this part of ISO IEC 15504 relating to the process scope of the organizational maturity assessment the organizational scope of the assessment which has to be specified as representing the elements characterised by the Organizational Maturity
99. mmitment Groups bodies or for a external to JTC 1 to which a commitment has been made by JTC for Co operation and or collaboration on this NP shall be identified here B 3 External Std Specification If other activities creating standards or specifications in this topic area are known to exist or be planned and which might be available to JTC as PAS they shall be identified here C Technical Status The proposer shall indicate here an assessment of the extent to which the proposed standard is supported by current technology C 1 Mature Technology Indicate here the extent to which the technology is reasonably stable and ripe for standardisation C 2 Prospective Technology If the NP is anticipatory in nature based on expected or forecasted need this shall be indicated here C 3 Models Tools If the NP relates to the creation of supportive reference models or tools this shall be indicated here D Conformity Assessment and Interoperability Any other aspects of background information justifying this NP shall be indicated here D 1 Indicate here if Conformity Assessment is relevant to your project If so indicate how itis addressed in your project plan D 2 Indicate here if Interoperability is relevant to your project If so indicate how it is addressed in your project plan E Adaptability to Culture Language Human Functioning and Context of Use NOTE The following criteria do not mandate any feature for adaptability to cultu
100. mples of uses of the quality model defined in this International Standard are to e identify software requirements e validate the completeness of a requirements definition e identify software design objectives e identify software testing objectives e identify quality assurance criteria e identify acceptance criteria for a completed software product NOTE 1 This International Standard can be used in conjunction with ISO IEC 15504 which is concerned with the software process assessment to provide framework for software product quality definition in the customer supplier process e support for review verification and validation and a framework for quantitative quality evaluation in the support process e support for setting organisational quality goals in the management process ISO IEC CD 25010 ISO NOTE 2 This International Standard can be used in conjunction with ISO IEC 12207 which is concerned with the software lifecycle to provide framework for software product quality requirements definition in the primary lifecycle process e support for review verification and validation in supporting lifecycle processes NOTE 3 This International Standard can be used in conjunction with ISO 9001 which is concerned with quality assurance processes to provide e support for setting quality goals e support for design review verification and validation 3 ISO IEC JTC1 SC7 SE Software a
101. n cases offer help to all types of users The division provides also requirements and guidance for a supporting function which is responsible for the management of software product requirements specification and evaluation e ISO IEC 2501n Quality Model Division The standard that forms this division presents a detailed quality model including characteristics for internal external quality in use and data quality Furthermore the internal and external software quality characteristics are decomposed into subcharacteristics Practical guidance on the use of the quality model is also provided e ISO IEC 2502n Quality Measurement Division The standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and quality in use Measurement primitives forming foundations for the latter measures are defined and presented e ISO IEC 2503n Quality Requirements Division The standard that forms this division helps specifying quality requirements These quality requirements can be used in the process of quality requirements elicitation for a software product to be developed or as input for an evaluation process The requirements definition process is mapped to technical processes defined in ISO IEC 15288 Information Technology Life Cycle Management
102. n to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC CD 25040 makes a part of SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 information technology Subcommittee SC 7 Software and System Engineering SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation e ISO IEC 2500n Quality Management Division e ISO IEC 2501n Quality Model Division e ISO IEC 2502n Quality Measurement Divisi
103. nd Systems Engineering INFORMATION TECHNOLOGY STANDARDS Secretaria CANADA SCC ISO IEC JTC1 SC7 3894 2008 01 15 Document Type FCD Title FCD 25012 2 Software Engineering Software product Quality Requirements and Evaluation SQuaRE Data Quality Model Source WG4 Project 25012 Status FCD References N3792 N3889 N3893 Action ID ACT Due Date 2008 05 16 Start Date 2008 01 16 Distribution SC7 AG JTC 1 Medium PDF No of Pages 18 Note Please vote using the ISO Electronic Balloting Facilities Resolution 937 Address reply to ISO IEC JTC1 SC7 Secretariat Ecole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat jtcl sc7 org www jtcl sc7 org ISO IEC CD 25012 Table of content FOREWORD a CA eb 4 INTZRODEUC ON 5 SOFTWARE ENGINEERING SOFTWARE PRODUCT QUALITY REQUIREMENTS AND EVALUATION SQUARE DATA QUALITY MODEL 45 8 SLC 8 2 CONFORMANCE Se ten 9 3 TERMS AND DEFINITIONS EA 9 3 1 BA ENPA st te 9 222 COMPUTER SYSTEM i 10 3 3 a A M n LE 10 3 4 DR OO ese rng sar ears ede te geste 10 3 5 DATA OUALIT ME ASURERS brute Re
104. nterpreting the intent of its Process Reference Model These indicators may also be used when implementing a process improvement program or to help evaluate and select an assessment model method methodology or tools The Process Reference Model defined in ISO IEC 15288 2002 has been used as the basis for the Process Assessment Model in this part of ISO IEC 15504 As an exemplar this Process Assessment Model embodies the core characteristics that could be expected of any Process Assessment Model consistent with ISO IEC 15504 2 Nevertheless use of this Process Assessment Model is not required to meet the requirements of ISO IEC 15504 any other process assessment models meeting the requirements of ISO IEC 15504 2 may be used in a conformant assessment This Part of ISO IEC 15504 has a similar structure to Part 5 It may be used in conjunction with Part 5 for joint assessment of system life cycle processes and software life cycle processes This Part of ISO IEC 15504 uses the classification structure of the information work products used in ISO 15289 Systems and software engineering Content of systems and software life cycle process information products Documentation as the basis for the Generic Work Products Within this part of ISO IEC 15504 clause 4 provides a detailed description of the structure and key components of a process assessment model which includes two dimensions a process dimension and a capability dimension Assess
105. ogs memory leak DBMS run away query DBMS deadlock DBMS and queuing server storage exhaustion Loss of data e g DBMS loss of data DBMS loss of file DBMS and queuing server loss of disk e Load resolution e g a moderate or significant increase of users or workload Restart failures e g restart failure on OS and middleware server process ISO IEC 2002 All rights reserved ISO IEC WD 25045 2007 E A set of questions to assess how well the system detects analyzes and resolves the disturbance is defined for each disturbance to evaluate the external quality measure of autonomic recovery index A score is calculated for each disturbance based on the answers to those questions The overall Resiliency and autonomic recovery index are calculated respectively as an average of those individual scores 1 4 Applicability This evaluation module is applicable to information system solution that involves a software product and other software components The information system must have a workload that has a consistently reproducible performance result to properly assess the impact of disturbance and recovery The evaluation module can be used in the following situations 1 Evaluate as part of the system verification testing and is applicable for all types of application systems 2 Evaluate against the test environment of a production system to gauge recoverability and identify weakness 3 Evaluate the recoverabi
106. on e ISO IEC 2503n Quality Requirements Division and e ISO IEC 2504n Quality Evaluation Division Annex A provides specific issues to be followed when the evaluation process is applied by developers Annex B provides specific issues to be followed when the evaluation process is applied by acquirers Annex C provides specific issues to be followed when the evaluation process is applied within a third party independent evaluation Annex D provides an explanation on levels of evaluation aspects to be considered when defining evaluation levels and suggestions on evaluation techniques to be applied according to the rank of evaluation level Annex E provides examples of evaluation methods Annex F provides a table showing relationships between some evaluation methods possible costs rank and their effectiveness per software quality characteristics Annex G provides an example of application of the evaluation process to be included Annex H contains bibliographic references O ISO IEC 2002 All rights reserved V ISO IEC CD 25040 2007 E Introduction The evaluation of software product quality is vital to both the acquisition and development of software that meets quality requirements The relative importance of the various characteristics of software quality depends on the mission or objectives of the system of which it is a part software products need to be evaluated to decide whether relevant quality characteristics meet the re
107. onal Standard The major differences between the SQuaRE series of International Standards and its predecessors ISO IEC 9126 and ISO IEC 14598 are the introduction of the new general reference model introduction of dedicated and detailed guides for each division introduction of Quality Measure Elements within the Quality Measurement Division introduction of the Quality Requirements Division incorporation and revision of the evaluation processes introduction of guidance for practical use in the form of examples and co ordination and harmonization of content with ISO IEC 15939 SQuaRE consists of the following five divisions Quality Management Division ISO IEC 2500n Quality Model Division ISO IEC 2501n Quality Measurement Division ISO IEC 2502n Quality Requirements Division ISO IEC 2503n and Quality Evaluation Division ISO IEC 2504n SQuaRE provides terms and definitions FINAL DRAFT PROJET FINAL ISO IEC 2007 All rights reserved ISO IEC 25020 2007 reference models a general guide individual division guides and standards for requirements specification measurement and evaluation purposes SQUARE includes International Standards and technical reports for a quality model and measures as well as on quality requirements and evaluation SQuaRE replaces current ISO IEC 9126 series and ISO IEC 14598 series This Interna
108. osed standard concern known patented items No If yes please provide full information in an annex Are there any known accessibility requirements and or dependencies see http www jtclaccess org No If yes please specify on a separate page Are there any known requirements for cultural and linguistic adaptability No If yes please specify on a separate page Comments and recommendations of the JTC 1 or SC XX Secretariat attach a separate page as an annex if necessary Comments with respect to the proposal in general and recommendations thereon It is proposed to assign this new item to JTC 1 5 7 Voting on the proposal Each P member of the ISO IEC joint technical committee has an obligation to vote within the time limits laid down normally three months after the date of circulation Date of circulation Closing date for voting Signature of Secretary YYYY MM DD YYYY MM DD NEW WORK ITEM PROPOSAL PROJECT ACCEPTANCE CRITERIA Criterion A Business Requirement A Market Requirement B Related Work B 1 Completion Maintenance of current standards B 2 Commitment to other organisation B 3 Other Source of standards C Technical Status C 1 Mature Technology C 2 Prospective Technology C 3 Models Tools D Conformity Assessment and Interoperability D 1 Conformity Assessment D 2 Interoperability E Adaptability to Culture Language
109. quirements of the system The essential parts of software quality evaluation are a quality model the method of evaluation software measurement and supporting tools To develop good software quality requirements should be specified the software quality assurance process should be planned implemented and controlled and both intermediate products and end products should be evaluated This document is part of SQuaRE series of standards and contains general requirements for specification and evaluation of software quality as well as clarifies the associated general concepts It provides a framework for evaluating the quality of software products and states the requirements for methods of software product measurement and evaluation Specific issues related to the developers acquirers and third party independent evaluation are provided in annexes The general goal of creating the SQuaRE set of standards is to move to a logically organised enriched and unified series covering two main processes software quality requirements specification and software quality evaluation supported by a software quality measurement process The purpose of the SQuaRE set of standards is to assist those developing and acquiring software products with the specification and evaluation of quality requirements It establishes criteria for the specification of software product quality requirements their measurement and evaluation It includes a two part quality model for align
110. r software product quality a internal quality and external quality and b quality in use The first part of the model specifies eight characteristics for internal and external quality which are further subdivided into subcharacteristics These subcharacteristics are manifested externally when the software is used as a part of a computer system and are a result of internal software attributes This International Standard does not elaborate the model for internal and external quality below the level of subcharacteristics The second part of the model specifies five quality in use characteristics Quality in use is the combined effect for the user of the eight software product quality characteristics The characteristics defined are applicable to every kind of software The characteristics and subcharacteristics provide consistent terminology for software product quality They also provide a framework for specifying quality requirements for software and making trade offs between software product capabilities The quality model can be used to support specification and evaluation of software from different perspectives by those associated with acquisition requirements development use evaluation support maintenance quality assurance and audit of software It can for example be used by developers acquirers quality assurance staff and independent evaluators particularly those responsible for specifying and evaluating software product quality Exa
111. rability 9 ISO IEC DTR 15504 6 Information technology Process assessment Part 6 An exemplar system life cycle process assessment model 10 ISO IEC DTR 15504 7 Information technology Process assessment Part 7 Assessment of organizational maturity 11 NWI ISO IEC 15504 8 Information technology Process assessment Part 8 Capability target profile 12 NWI Software and systems engineering Reference structure for dynamic generation of online user documentation 14 INTERNATIONAL ISO IEC STANDARD 25001 First edition 2007 02 01 Software engineering Software product Quality Requirements and Evaluation SQuaRE Planning and management Ing nierie du logiciel Exigences de qualit et valuation du produit logiciel SQUARE Planification et gestion Reference number ISO IEC 25001 2007 E ISO IEC 2007 ISO IEC 25001 2007 E Contents FOREMWORD nn I a 1 iv INTRODUCTION Sn i i ie cia UE Ad 8 V SCOTT 1 2 CONFORMANCE cain 1 NORMATIVE REFERENCES 0 ea 2 4 TERMS AND DEFINITIONS 3 URN A LU ATION WO TIVITY eel kc 3 EALUATIONGR
112. raft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC CD 25040 makes a part of SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 information technology Subcommittee SC 7 Software and System Engineering SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation e ISO IEC 2500n Quality Management Division e ISO IEC 2501n Quality Model Division e ISO IEC 2502n Quality Measurement Division e ISO IEC 2503n Quality Requirements Division and e ISO IEC 2504n Quality Evaluation Division ISO IEC 2002 All rights reserved V ISO IEC WD 25045 2007 Introduction The evaluation of software product quality is vital to both the acquisition and development of software that meets quality requirements The relative importance of the various characteristics of software quality depends on the mission or objectives of the system of which it is a part software products need to be evaluated to decide whether relevant quality charac
113. rating and the data collection strategy which must ensure that the results of the assessment are representative of the organizational scope On completion of the assessment the set of process profiles established for the organization are converted into a rating of the level of Organizational Maturity based on the framework defined in this part of ISO IEC 15504 as specified in the relevant Organizational Maturity Model This part of ISO IEC 15504 also contains guidance on implementing the requirements for constructing an Organizational Maturity Model on conducting assessments of Organizational Maturity and on the application of Organizational Maturity ratings for process improvement and capability determination This part of ISO IEC 15504 is being developed as a Technical Report Type 2 to enable experience in the use of the approach to assessment of Organizational Maturity to be gained In future revisions of the Standard it is likely that the content of this part will be distributed across the complete document set ISO IEC 2008 All rights reserved Information technology Process assessment Part 7 Assessment of Organizational Maturity 1 Scope This part of the International Standard addresses the expression of the results of assessment of processes in terms of the overall maturity of an organizational unit and the application of the results of assessment of organizational maturity for process improvem
114. rds Technical Reports of type 3 do not necessarily have to be reviewed until the data they provide are considered to be no longer valid or useful ISO IEC TR 15504 7 was prepared by Technical Committee ISO IEC TC JTC1 Information technology Subcommittee SC 7 Software and Systems Engineering ISO IEC TR 15504 consists of the following parts under the general title Information technology Process assessment Part 1 Concepts and Vocabulary Part 2 Performing an Assessment Part 3 Guidance on performing an assessment Part 4 Guidance on use for process improvement and process capability determination Part 5 An exemplar Process Assessment Model Part 6 exemplar System Life Cycle Process Assessment Model Part 7 Assessment of Organizational Maturity ISO IEC 2008 All rights reserved V Introduction This part of ISO IEC 15504 defines the conditions for an assessment of Organizational Maturity it establishes a framework for determining overall Organizational Maturity based upon assessed profiles of process capability and defines the conditions under which such assessments are valid Other parts of this International Standard define and provide guidance on the assessment of process capability ISO IEC 15504 2 sets out the minimum requirements for performing a process assessment that ensure consistency and repeatability of the ratings The requirements help to ensure that the assess
115. re language human functioning or context of use The following criteria require that if any features are provided for adapting to culture language human functioning or context of use by the new Work Item proposal then the proposer is required to identify these features E 1 Cultural and Linguistic Adaptability Indicate here if cultural and natural language adaptability 1s applicable to your project If so indicate how it is addressed in your project plan ISO IEC TR 19764 Guidelines methodology and reference criteria for cultural and linguistic adaptability in information technology products now defines it in a simplified way ability for a product while keeping its portability and interoperability properties to be internationalized that is be adapted to the special characteristics of natural languages and the commonly accepted rules for their se or of cultures in a given geographical region take into account the usual needs of any category of users with the exception of specific needs related to physical constraints Examples of characteristics of natural languages are national characters and associated elements such as hyphens dashes and punctuation marks writing systems correct transformation of characters dates and measures sorting and searching rules coding of national entities such as country and currency codes presentation of telephone numbers and keyboard layouts Related terms are localization juri
116. s of Standards ISO IEC 25000 ISO IEC 25050 and with ISO IEC 14598 and ISO IEC 9126 1 until superseded by the ISO IEC 25000 series This International Standard complies with the technical processes defined in ISO IEC 15288 2002 related to quality requirements definition and analysis vi FINAL DRAFT PROJET FINAL O ISO IEC 2007 All rights reserved ISO IEC 25030 2007 Quality Division 2501n Quality Management Division Quality Us Quality Requirements Quality Evaluation Division Measurement Division Division 2503n 2502 2504 Figure 1 Organization of SQuaRE series of International Standards Figure 1 copied from ISO IEC 25000 illustrates the organization of the SQuaRE series representing families of International Standards further called Divisions The Divisions within SQuaRE model are ISO IEC 2500n Quality Management Division The International Standards that form this division define all common models terms and definitions referred to further by all other International Standards from the SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper International Standards to specific application cases offer help to all types of users The division also provides requirements and guidance for a supporting function which is responsible for the management of software product requirements specification and evaluation ISO IEC 2501n
117. s referred further by all other standards from SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper standards to specific application cases offer help to all types of users The division ISO IEC 2007 All rights reserved V ISO IEC 25001 2007 E also provides requirements and guidance for an evaluation group which is responsible for the management of software product quality requirements specification and quality evaluation ISO IEC 2501n Quality Model Division The standard that forms this division presents a detailed quality model including characteristics for internal external and quality in use Furthermore the internal and external software quality characteristics are decomposed into subcharacteristics Practical guidance on the use of the quality model is also provided ISO IEC 2502n Quality Measurement Division The standards that form this division include a software product quality measurement reference model mathematical definitions of quality measures and practical guidance for their application Presented measures apply to internal software quality external software quality and quality in use Quality measure elements forming foundations for the latter measures are defined and presented ISO IEC 2503n Quality Requirements Division The standard that forms this division helps specifying quality requirements These quality requirements can be used
118. sation a supplier or an independent third party evaluator These three different approaches are presented as annexes that complement the main evaluation process providing issues to be followed according to each evaluation perspective ISO IEC 25041 Evaluation modules defines the structure and content of the documentation to be used to describe an Evaluation Module These Evaluation Modules contain the specification of the quality model i e characteristics subcharacteristics and corresponding internal external or quality in use measures the associated data and information about the planned application of the model and the information about its actual application Appropriate evaluation modules are selected for each evaluation In some cases it may be necessary to develop new evaluation modules Guidance for developing new evaluation modules is found in ISO IEC 25041 This International Standard can also be used by organisations producing new evaluation modules ISO IEC 25040 Evaluation reference model and guide is a revised version and replaces the current ISO IEC 14598 1 Software product evaluation General overview and ISO IEC 14598 3 4 and 5 Also ISO IEC 25041 Evaluation modules replaces current ISO IEC 14598 2 viii ISO IEC 2002 All rights reserved ISO IEC CD 25040 Software engineering Software product Quality Requirements and Evaluation SQuaRE Evaluation reference model and guide
119. sdiction and multilingualism E 2 Adaptability to Human Functioning and Context of Use Indicate here whether the proposed standard takes into account diverse human functioning and diverse contexts of use If so indicate how it is addressed in your project plan NOTE 1 Human functioning is defined by the World Health Organization at http www3 who int ict beginners bg pdf as lt lt In ICF International Classification of Functioning Disability and Health the term functioning refers to all body functions activities and participation gt gt 2 Content of use is defined in ISO 9241 11 1998 Ergonomic requirements for office work with visual display terminals VDTs Part 11 Guidance on usability as lt lt Users tasks equipment hardware software and materials and the physical and societal environments in which a product is used gt gt 3 Guidance for Standard Developers to address the needs of older persons and persons with disabilities F Other Justification Any other aspects of background information justifying this NP shall be indicated here 19 20 3 B
120. sed to create measures of software product quality characteristics Quality measure elements may measure a static representation of the software the behaviour of the software or the effects of the software when it is used ISO IEC 25022 ISO IEC 25023 and ISO IEC 25024 will describe measures for the characteristics in the quality model Internal measures characterize software product quality based upon static representations of the software external measures characterize software product quality based upon the behaviour of the computer based system including the software and quality in use measures characterize software product quality based upon the effects of using the software in a specific context of use The measures in these technical reports should not be construed as an exhaustive or required set Figure 2 depicts the relationship between this International Standard and the technical reports in the Quality Measurement Division Developers evaluators quality managers acquirers suppliers maintainers and other users of software may select measures from these technical reports for the measurement of quality characteristics of interest In practice this may be with respect to defining requirements evaluating software products quality management and other purposes Users may also modify the measures or use measures which are not included in those technical reports ISO IEC 2007 All rights reserved FINAL DRAFT PROJET FINAL VII ISO
121. series of standards consists of the following divisions under the general title Software Engineering Software Quality Requirements and Evaluation SQuaRE Quality Management Division ISO IEC 2500n Quality Model Division ISO IEC 2501n Quality Measurement Division ISO IEC 2502n Quality Requirements Division ISO IEC 2503n Quality Evaluation Division ISO IEC 2504n ISO IEC CD 25012 Introduction The quantity of data and information handled by computer systems is increasing worldwide data quality is a key component of the quality and usefulness of information derived from that data and most business processes depend on the quality of data A common prerequisite to all information technology projects is the quality of the data which are exchanged processed and used between the computer systems and users and among computer systems Managing and enhancing the quality of data is important for a number of reasons e the acquisition of data from organizations of which the quality of data production process is unknown or weak e the existence of defective data contributing to unsatisfactory information unusable results and dissatisfied customers the dispersion of such data among various owners and users Data captured in accordance with the workflow needs of a single organization often lacks a coherent and integrated vision which is necessary to ensure interoperability and co operation the need of manage data whic
122. ssessment should be selected and possibly augmented with additional indicators see Annex The Process Assessment Model in this part of ISO IEC 15504 is directed at assessment sponsors and competent assessors who wish to select a model and associated documented process method for assessment for either capability determination or process improvement Additionally it may be of use to developers of assessment models in the construction of their own model by providing examples of good systems engineering and management practices Any process assessment model meeting the requirements defined in ISO IEC 15504 2 concerning models for process assessment may be used for assessment Different models and methods may be needed to address differing business needs The assessment model in this part of ISO IEC 15504 is provided as an exemplar of a model meeting all the requirements expressed in ISO IEC 15504 2 The scope of this Part of ISO IEC 15504 is consistent with the scope of Part 5 of ISO IEC 15504 in order to assist situations where assessment is being made of both system and software life cycle processes NOTE Copyright release for the Exemplar Process Assessment Model Users of this part of ISO IEC 15504 may freely reproduce the detailed descriptions contained in the exemplar assessment model as part of any tool or other material to support the performance of process assessments so that it can be used for its intended purpose ISO IEC 2006
123. t committee International organizations governmental and non governmental in liaison with ISO also take part in the work ISO collaborates closely with the International Electrotechnical Commission IEC on all matters of electrotechnical standardization International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of technical committees is to prepare International Standards Draft International Standards adopted by the technical committees are circulated to the member bodies for voting Publication as an International Standard requires approval by at least 75 of the member bodies casting a vote In exceptional circumstances a technical committee may propose the publication of a Technical Report of one of the following types type 1 when the required support cannot be obtained for the publication of an International Standard despite repeated efforts type 2 when the subject is still under technical development or where for any other reason there is the future but not immediate possibility of an agreement on an International Standard type 3 where a technical committee has collected data of a different kind from that which is normally published as an International Standard state of the art for example Technical Reports of types 1 and 2 are subject to review within three years of publication to decide whether they can be transformed into International Standa
124. t iussus ouo to Ub ee Si ll d iMd LM DU 24 Extended Process Sets ascetic ee crete de UD T DID eee nt ur 24 BALLET ASIE Le ma ee ES RD D 25 informative Extensions to Process Reference Model ee 26 ie 26 Quantitative Performance Management Process ee 26 PULDOSG EIE D LU 26 QUICOHIGS on ne in ee 26 Quantitative Process Improvement Process 1 26 PUIDOSG ee 26 COUNBOUNGS se TATE tenace een nl 27 C informative Extensions to Process Assessment Model eeu 28 IntrodwouO Ns TET DNE 28 Quantitative Management Process Group QNT nnn annnm 28 QNT 1 Quantitative Performance Management ee 28 QNT 2 Quantitative Process Improvement 30 Description of additional specific work products 32 ISO IEC 2008 All rights reserved Foreword ISO the International Organization for Standardization is a worldwide federation of national standards bodies ISO member bodies The work of preparing International Standards is normally carried out through ISO technical committees Each member body interested in a subject for which a technical committee has been established has the right to be represented on tha
125. tended Timeframe Relevant documents to be considered ISO IEC 15504 Part 4 Guidance on use for process improvement and process capability determination Co operation and liaison Preparatory work offered with target date s Draft will available for next SC7 WG10 meeting if approved by start April 2008 Signature E Hugentobler SNV Switzerland Will the service of a maintenance agency or registration authority be required No If yes have you identified a potential candidate If yes indicate name Are there any known requirements for coding No If yes please specify on a separate page Does the proposed standard concern known patented items No If yes please provide full information in an annex Comments and recommendations of the JTC 1 or SC 7 Secretariat attach a separate page as an annex if necessary Comments with respect to the proposal in general and recommendations thereon It is proposed to assign this new item to ISO IEC JTC 1 5 7 WG10 Voting on the proposal Each P member of the ISO IEC joint technical committee has an obligation to vote within the time limits laid down normally three months after the date of circulation Date of circulation Closing date for voting Signature of Secretary 2008 01 24 2008 04 24 W Suryn NEW WORK ITEM PROPOSAL PROJECT ACCEPTANCE CRITERIA Criterion Validity A Business Requirement A 1 Market Requirement Essential X Desirable Supportive _
126. teristics meet the requirements of the system The essential parts of software quality evaluation are a quality model the method of evaluation software measurement and supporting tools To develop good software quality requirements should be specified the software quality assurance process should be planned implemented and controlled and both intermediate products and end products should be evaluated This document is part of SQuaRE series of standards and contains general requirements for specification and evaluation of software quality as well as clarifies the associated general concepts It provides a framework for evaluating the quality of software products and states the requirements for methods of software product measurement and evaluation The general goal of creating the SQuaRE set of standards is to move to a logically organised enriched and unified series covering two main processes software quality requirements specification and software quality evaluation supported by a software quality measurement process The purpose of the SQuaRE set of standards is to assist those developing and acquiring software products with the specification and evaluation of quality requirements It establishes criteria for the specification of software product quality requirements their measurement and evaluation It includes a two part quality model for aligning customer definitions of quality with attributes of the development process In addition the s
127. the elements of this document may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC 25010 is a part of the SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 information technology Subcommittee SC 7 Software and System Engineering The SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation e ISO IEC 2500n Quality Management Division e ISO IEC 2501n Quality Model Division e ISO IEC 2502n Quality Measurement Division e ISO IEC 2503n Quality Requirements Division and e ISO IEC 2504n Quality Evaluation Division ISO ISO IEC CD 25010 Introduction Computers are being used in an increasingly wide variety of application areas and their correct operation is often critical for business success and or human safety Developing or selecting high quality software products is therefore of prime importance Comprehensive specification and evaluation of software product quality is a key factor in ensuring adequate quality This can be achieved by defining appropriate quality characteristics taking account of the purpose of usage of the software product It is important that every relevant software product quality characteristic is specified and evaluated whenever possible using validated or widely accepted measures ISO IEC 9126 1991
128. tional Standard is intended to be used together with ISO IEC 25010 It is strongly recommended that users refer to ISO IEC 2500n ISO IEC 2501n ISO IEC 2503n and ISO IEC 2504n division of International Standards prior to using this International Standard and the associated measurement technical reports particularly if the user is not familiar with the use of software measures for requirements specification and product evaluation These International Standards discuss the planning and use of the software quality measures defined in the ISO IEC 2502n series on software product quality measurement ISO IEC 25010 will provide a model and defines terms for software product quality characteristics and how these characteristics are decomposed into subcharacteristics It does not describe how any of these subcharacteristics could be measured The Quality Measurement Division provides information and guidance about how to measure the characteristics and subcharacteristics of a quality model This International Standard provides a reference model and guide for measuring the quality characteristics defined in ISO IEC 2501n Quality Model Division Figure 1 The associated standards and technical reports within the Quality Measurement Division describe measures of quality throughout the product life cycle ISO IEC 25021 offers quality measure elements that can be used to construct software quality measures Quality measure elements are the base and derived measures u
129. to quality requirements definition and analysis Figure 1 from ISO IEC 25000 illustrates the organisation of the SQuaRE series representing families of standards further called Divisions The Divisions within SQuaRE model are e ISO IEC 2500n Quality Management Division The standards that form this division define all common models terms and definitions referred further by all other standards from SQuaRE series Referring paths guidance through SQuaRE documents and high level practical suggestions in applying proper standards to specific application cases offer help to all types of users The division provides also requirements and guidance for a supporting function which is responsible for the management of software product requirements specification and evaluation ISO IEC CD 25010 ISO Quality Model Division 2501 Quality Evaluation Division Quality Requirements aay Management Division Division 2503n 2500n 2504n Quality Measurement Division 2502n Figure 1 Organization of SQuaRE series of standards ISO IEC 2501n Quality Model Division The standard that forms this division presents a detailed quality model including characteristics for internal external and quality in use Furthermore the internal and external software quality characteristics are decomposed into subcharacteristics Practical guidance on the use of the quality model is also provided ISO IEC 2502n Quality Measurement Division
130. tware quality measures and quality measure elements Demonstrating predictive validity and assessing measurement reliability Example format for documenting software quality measures Bibliography The SQuaRE series of International Standards is intended for but not limited to developers acquirers and independent evaluators of software particularly those responsible for defining software product quality requirements and for software product evaluation It is recommended that users of SQuaRE use this International Standard as a guide to execute their software product quality measurement tasks ISO IEC 2007 All rights reserved 5 Document Title Source Project Status Reference Action ID Distribution No of Pages Note SyJTCT INFORMATION TECHN OLOGY STANDARDS Secretariat CANADA SCC ISO IEC JTC1 SC7 Software and Systems Engineering ISO IEC JTC1 SC7 N3697 2007 02 05 TR for publication ISO IEC TR 25021 Software Engineering Software product Quality Requirements and Evaluation SQuaRE Quality measure elements WG06 25021 Final JTC 1 N 8072 JTC 1 N8143 N3696 FYI or ACT AG 64 Sent to ITTF for TR processing Address reply to ISO IEC JTC1 SC7 Secretariat Ecole de technologie sup rieure Departement of Software and IT Engineering 1100 Notre Dame Ouest Montr al Qu bec Canada H3C 1K3 secretariat tcl sc7 org www jtcl sc7 org
131. ue uou 4 6 Software Product Quality Measurement nn 5 6 1 Software product quality measurement reference model 5 6 2 Selecting software quality measures nn 5 6 3 Constructing software quality measures nn 6 Annex A informative Examples of criteria for selecting software quality measures and quality measure ee a STIS tmi NS 8 Annex B informative Assessing measurement validity and reliability esses 10 Annex informative Example format for documenting software quality measures 12 Se cc 15 FINAL DRAFT PROJET FINAL ISO IEC 2007 All rights reserved ISO IEC 25020 2007 E Foreword ISO the International Organization for Standardization and IEC the International Electrotechnical Commission form the specialized system for worldwide standardization National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity ISO and IEC technical committees collaborate in fields of mutual interest Other international organizations governmental and non governmental in liaison with ISO and IEC also take part in the work In the field of information technology ISO and IEC h
132. ure as an Evaluation Module is also presented ISO IEC 25050 to ISO IEC 25099 are reserved to be used for SQuaRE extension International Standards and or Technical Reports ISO IEC 2007 All rights reserved Vil FINAL DRAFT PROJET FINAL INTERNATIONAL STANDARD ISO IEC 25030 2007 E Software engineering Software product Quality Requirements and Evaluation SQuaRE Quality requirements 1 Scope This International Standard provides requirements and recommendations for the specification of software product quality requirements This International Standard applies to organizations in their role as both acquirers and suppliers The quality model in ISO IEC 9126 1 ISO IEC 25010 is used to categorize software quality requirements and to provide a basis for quantifying the quality requirements in terms of software quality measures This International Standard complies with the technical processes defined in ISO IEC 15288 2002 which are relevant for identification of stakeholder product quality needs and for analysis of software product quality requirements This International Standard does not cover specification of other requirements such as functional requirements process requirements business requirements etc This International Standard does not prescribe specific software quality measures nor does it prescribe any specific development process FINAL DRAFT PROJET FINAL ISO IEC 2007 All rights reserv
133. urposes It does not describe or specify how to create these Target Profiles or what they should contain Within the ISO IEC 15504 standard and referenced lifecycle standards there are many possible Process Reference and Assessment Models specified for various domains and applications 1 e the process dimension 15 well specified We have specified the capability dimension into six capability levels valid for process assessment however there is no specification for what capability level 15 needed for various domains and applications This proposed new part would specify the requirements for creating valid Target Profiles and specify what constitutes a valid method for creating Target Profiles This will cover domain of application use of predictive means to specify and apply targets and community of use validation requirements It will also provide representative formats for Target Profiles Programme of work If the proposed new work item is approved which of the following document s is are expected to be developed _____ a single International Standard ___ more than one International Standard expected number _ _ amult part International Standard consisting of parts _ an amendment to the following International Standard s _X__ a technical report type And which standard development track 1s recommended for the approved new work item __ Default Timeframe __X_b Accelerated Timeframe c Ex
134. valuation Module is also presented ISO IEC 25050 to ISO IEC 25099 are reserved for SQuaRE extension International Standards Technical Specifications Public Available Specifications PAS and or Technical Reports ISO IEC 25051 25062 are already published ISO IEC CD 25012 Software engineering Software product Quality Requirements and Evaluation SQuaRE Data Quality Model 1 Scope This International Standard defines a general data quality model to support organizations to manage data with the necessary quality characteristics to achieve their objectives The scope of the data quality model is data retained in a structured format within a computer system In Figure 2 the structure of a general system is displayed in a diagram this can include information systems which in turn can include one or more computer systems The data quality model defined in this International Standard focuses on the quality of the data as part of a computer system and defines quality characteristics for target data used by the users and operators of the system target data are those that the organisation decides to be analysed and validated through the model Non target data are the data that the organisation considers out of the scope of the application of the data quality model EXAMPLE In a context of use represented by a business application that includes software and data non target data are system elements required to run the computer syste
135. ware product quality evaluation for different purposes and approaches Therefore the process can be used for the evaluation of quality in use external software quality and internal software quality as well as can be applied to evaluate the quality of pre developed software or custom software during its development process The software product quality evaluation can be conducted by an acquirer a developer organisation a supplier or an independent third party evaluator ISO IEC 25041 Evaluation modules defines the structure and content of the documentation to be used to describe an Evaluation Module These Evaluation Modules contain the specification of the quality model i e characteristics sub characteristics and corresponding internal external or quality in use measures the associated data and information about the planned application of the model and the information about its actual application Appropriate evaluation modules are selected for each evaluation n some cases it may be necessary to develop new evaluation modules Guidance for developing new evaluation modules is found in ISO IEC 25041 This International Standard can also be used by organisations producing new evaluation modules ISO IEC 25045 Evaluation Module for Recoverability provides the specification to evaluate the sub characteristic of recoverability defined under the characteristic of reliability of the quality model It determines the external quality measures of res
136. when the system migrates to another architecture In the third situation data quality is required to monitor the data taking into account that the data life cycle is often longer than software life cycle The data quality model defined in this International Standard takes into account all data types e g character strings date numbers images sounds etc assigned data values and relationships between data e g consistency between data in the same or in different entities the scope does not include data produced by embedded devices or real time sensors that are not retained for further processing or historical purposes The definition of metadata is addressed by ISO IEC 11179 series and is outside the scope of this International Standard even if it refers to metadata to evaluate data quality Conceptual and logical data design are outside the scope of this data quality model but benefit from consideration of the data quality characteristics Conformance of the data to the data design are within the scope of the data quality model The relationship and precedence of this data quality model relative to industry and domain specific data quality standards shall be identified by the application using this data quality model Absent identification of precedence this model is interpreted to be non conflicting with any other data quality standard applied 4 FINAL INTERNATIONAL ISO IEC DRAFT STANDARD FDIS 25020 ISO IEC JT
137. with ISO and IEC also take part in the work In the field of information technology ISO and IEC have established a joint technical committee ISO IEC JTC 1 International Standards are drafted in accordance with the rules given in the ISO IEC Directives Part 2 The main task of the joint technical committee is to prepare International Standards Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting Publication as an International Standard requires approval by at least 75 of the national bodies casting a vote Attention is drawn to the possibility that some of the elements of ISO IEC 25001 may be the subject of patent rights ISO and IEC shall not be held responsible for identifying any or all such patent rights ISO IEC 25001 makes a part of SQuaRE series of standards and was prepared by Joint Technical Committee ISO IEC JTC 1 Information Technology Subcommittee SC 7 Software and system engineering SQuaRE series of standards consists of the following divisions under the general title Software product Quality Requirements and Evaluation Quality Management Division 2500n Quality Model Division 2501n Quality Measurement Division 2502n Quality Requirements Division 2503n and Quality Evaluation Division 2504n IV ISO IEC 2007 All rights reserved ISO IEC 25001 2007 E Introduction ISO IEC 25001 provides details about the
138. y Model subcharacteristics Some subcharacteristics were omitted because survey results did not find evidence of their use It does not imply the ISO IEC 9126 1 Quality Model should be changed but rather new quality measures may need to be defined in the future Subsequently the quality measure elements necessary for measurement of above quality measures set have been identified and documented These quality measure elements represent an initial set of measures which can be used during the construction of quality measures referenced in ISO IEC TR 9126 2 ISO IEC TR 9126 3 and 6 ISO IEC 2007 All rights reserved ISO IEC TR 9126 4 as well as other measures for other purposes Quality measures described in the SQuaRE series Figure 2 are derived from one or more quality measure elements described in this Technical Report When evaluating a selected quality measure the user should first review and evaluate the relevant quality measure element s listed in this Technical Report Some important benefits from using the measures in this Technical Report are To improve measurement productivity and consistency which will minimize measurement effort When using quality measures such as internal external and quality in use there is a possibility of duplicating the attribute measurement tasks because they are usually performed as separate activities However by identifying the set of quality measure elements that are uniquely required to deriv

Download Pdf Manuals

Related Search

Related Contents

CTI 2550 EIGHT CHANNEL ISOLATED ANALOG INPUT  GIGABYTE GA-VM800PMC User's Manual  Manual do Usuário Nokia E6–00  Cat CP Pump Service Manual 279KB Jul 20 2012  Fait, tout fait… Quelques nouvelles frontières artistiques Marc  EELECTOHOD - Electrohome  Sony 4-166-513-13(1) Digital Camera User Manual  

Copyright © All rights reserved. Failed to retrieve file