ISO Metrics

DSI
Definition:

Weighted average of the total number of product defects till date against all
categories (Show Stopper (S), High (H), Medium (M) and Low (L))..

Formula: Defect Severity Index = Weighted Count Defects in the project /

Total number of product defects in the project.

Data Source: Defect Management tool

Responsible: PM/QA Team

Method: PM should update the defect details in Metrics template.

Frequency: Weekly

Action:
PM group will review the metrics of project in weekly status meeting and
take the appropriate actions if required
 Defect Density
Definition:

Number of weighted defects per weighted requirements.

Formula: Defect Density (Test Execution) = Total number of weighted defects

/ number of weighted requirements

Data Source: Defect Management tool and Requirement Management tool

Responsible: PM

Method: PM should update the defect and requirement details in Metrics

template.

Frequency: Weekly

Action:
PM group will review the metrics of project in weekly status meeting and
take the appropriate actions if required
DRE (Defects Removal Efficiency)
Definition:

Percentage of all product Defects detected internally, over all

product defects detected including the client reported defects.

Formula: DRE = Total Number of defects found by QA team* 100 / (Total

Number of defects found by QA + Total Number of defects Reported by client)

Data Source: Defect Management tool

Responsible: PM

Method: PM should update the defect details in Metrics template.

Frequency: Weekly

Action:
PM group will review the metrics of project in weekly status meeting and
take the appropriate actions if required
 DRR (Defect Remark Ratio)
Definition:

Number of defects per weighted requirements.

Formula: Ratio of number of Defects (Remarks accepted as Defects by the

development team) to the total number of Remarks raised by the Test Team

Data Source: Defect Management tool

Responsible: PM

Method: PM should update the defect details in Metrics template.

Frequency: Weekly

Action:
PM group will review the metrics of project in weekly status meeting and
take the appropriate actions if required
 Effort Variance
Definition:
Percentage deviation of actual effort spent on the project over estimated effort

Formula: Effort Variance = (Actual Effort – Estimated Effort) * 100 / Estimated

Effort

Data Source: Weekly Status report (Est vs Act), Time Track

Responsible: PM

Method: PM will enter the Actual and Estimated efforts details in the Metrics
Template

Frequency: Weekly

Action:

PM group will review the metrics of project in weekly status meeting and
take the appropriate actions if required
 Trac Changes
New field should be added to categorize the defects

Defect type should be Internal and Client. Categories should be removed.

Total hours should be added, it is mandatory when status is changed to Fixed.

Estimated hours is mandatory when status is accepted

Severity should be replaced with complexity if the ticket type is requirement

 Metrics Templates
There are three different types of templates available as mentioned below

PM’s should use appropriate Metrics template as per the project type

Project Template

Using Trac for Requirement and Metrics_Template1

Defect Management

Using Trac only for Defect Metrics_Template2

Management

Not using Trac for Defect Metrics_Template3

Management
 Metrics Targets
Metric Target

DSI < Or equal to 2.5

DRE and DRR >75%

Defect Density <10%

Effort variation -/+10%

 Guidelines

For the projects which are using Trac for Requirement and Defect
Management

• PM’s should log all the requirements with complexity in Trac

• Test team should log all the defects in Trac as Internal defects

• PM should ensure that Client defects are logged in Trac as Client defects

• PM should download the “Metrics – Defects” and “Metrics – Requirements

• ” reports which will be under available reports.

• PM’s should copy the details in Defects and Requirements details sheets in
• Metrics template.

• PM’s also should update the Est vs Act efforts details in the template.

• PM’s should send the updated Metrics report to SQA.

 Guidelines

For the projects which are using Trac only for Defect Management

• Test team should log all the defects in Trac as Internal defects

• PM should ensure that Client defects are logged in Trac as Client defects

• PM should download the “Metrics – Defects” report which will be

under available reports.

• PM’s should copy the details in Defects details sheet in Metrics template.

• PM’s also should update the Est vs Act efforts and requirement details in
Summary sheet in Metrics template

• PM’s should send the updated Metrics report to SQA.

 Guidelines
For the projects which are not using Trac

• PM should update the Requirement, Defect and Est vs Act details manually
in Summary sheet in Metrics template.

• PM’s should send the updated Metrics report to SQA .