Main >> Business Park >> Software

 
National Software Quality Experiment: Results 1992-2002

National Software Quality Experiment




Years: 1992-2002

The National Software Quality Experiment has collected software inspections defect discovery data from 1992 to 2001. The National Software Quality Experiment data below shows the distribution of Software Inspections process and product metrics for the years 1992 through 2002.

Years 1992-2002
Process Metrics Pre-19921992199319941995199619971998199920002001200292-02
Minutes of Preparation Effort Per Defect 15.92 15.49 11.56 13.88 12.24 12.37 10.46 8.24 15.92 12.10 8.82 17.33 12.18
Minutes of Preparation Effort Per Major Defect 103.67 107.01 76.43 84.29 76.94 97.55 49.96 52.63 100.67 45.52 52.09 218.75 72.24
Major Defects Per Thousand Lines 2.91 3.26 4.00 4.64 1.41 1.74 4.62 2.32 2.19 4.13 3.94 0.39 2.46
Minor Defects Per Thousand Lines 16.03 19.26 22.43 23.53 7.46 11.96 17.44 12.52 11.65 11.40 19.33 4.51 12.15
Lines Per Conduct Hour 740.78 713.44 651.65 471.30 1451.50 826.90 540.99 843.53 633.04 663.46 610.23 1533.95 858.74
Defects Per Session 5.14 5.58 6.10 5.55 4.40 4.85 4.82 5.73 3.77 4.46 6.95 2.35 4.90
Preparation/Conduct Effort 0.93 1.04 0.83 0.77 0.66 0.58 0.52 0.43 0.58 0.52 0.52 0.54 0.64
Lines Per Session 271.40 247.57 230.75 197.10 495.77 354.37 218.59 386.02 272.52 287.55 298.71 479.21 335.60
Return On Investment 4.05 4.26 5.20 4.35 4.42 3.60 5.25 4.93 3.14 5.30 5.49 1.99 4.50
Years 1992-2002
Defect Type Percents 1992 199319941995199619971998199920002001200292-02Defect Type Descriptions
Interface 0.98 1.77 0.63 1.15 1.10 1.34 0.77 1.37 1.84 0.98 0.00 1.18 Error in parameter list
Data 4.54 4.09 5.83 5.26 3.35 5.72 3.75 2.44 6.28 1.97 0.00 4.62 Error in data definition, initial value setting, or use of disciplined data structures and their operations
Logic 10.13 7.63 8.37 6.07 4.64 9.84 5.29 4.12 4.90 1.65 1.05 7.22 Error revealed through informal correctness questions spanning prime constructs of structured programming
I/O 1.44 1.23 1.27 0.22 0.45 1.56 0.77 0.61 0.58 1.11 0.00 0.83 Error in formatting, commanding, or controlling I/O operations
Performance 5.74 2.18 1.52 1.76 0.90 2.99 1.25 1.83 2.42 2.21 3.03 2.30 Error in managing or meeting constraints in computer resource allocations and capacities for CPU, memory, or I/O
Functionality 4.76 4.50 3.42 9.57 7.02 6.20 4.33 4.58 3.55 2.15 0.45 6.57 Error in stating intended function or in satisfying intended function through refinement and elaboration
Human Factors 3.25 0.41 2.41 1.88 1.29 2.78 1.25 2.44 1.64 1.72 0.00 1.98 Error in externally visible user or enterprise interface or interaction
Standards 21.16 13.76 27.00 21.66 20.17 16.31 24.06 26.11 35.17 40.91 57.58 23.20 Error in compliance with product standards for construction or integration including style guidelines, open system interfaces, or guidelines for the application domain architecture
Documentation 42.86 51.77 45.88 40.41 48.13 39.59 41.09 47.02 24.54 28.62 8.08 40.51 Error in guidance documentation
Syntax 2.27 8.99 2.53 4.76 3.09 5.25 5.87 7.02 3.67 8.11 1.01 4.79 Error in language defined syntax
Maintainability 0.00 0.00 0.00 3.86 5.41 4.68 10.68 2.29 6.38 4.55 0.00 4.09 Error in good practice impacting the supportability and evolution of the software product
Other 2.12 1.36 0.89 2.32 3.03 3.64 0.87 0.15 1.16 0.49 0.00 2.05 Any other error
@Copright Don O'Neill, 2002

Email to Don O'Neill
Don O'Neill Home Page