UMP Metrics Data Tracker

Telecom4 NA CSP
CTL QAN PRVAP TST CHN
Name of the Author: Pinky T
Date Created: 20/03/2013

UMP Metrics

It helps define metric limits for different projects types for each
Delivery Center, and facilitates metrics data collection and
analysis from various projects across the organization.
This feature has gained importance in validating the Certainty
concept quantitatively.

OBJECTIVE
The objective of UMP is to achieve Uniform Metrics definition,
Collection and Analysis across TCS.

How will UMP help :

Metrics Set-up and Data Extraction from IPMS.

Outlier Analysis Data Repository in IPMS.

Uniform Data Analysis Process across Centers.

Online mechanism for Metrics Data Correction and for Causal

Analysis.

Steps to collect and update of UMP

metrics

UMP metrics are tracked every month for the project and is
being updated in an Excel sheet.

Metrics like number of test cases designed and executed has

taken into account. Both system and regression test cases are
included.

Data related to UMP Metrics is taken from Quality center. The

cases are split with respect to priority wise.

Log-in to Quality Center,click the Test plan tab to collect the

number of test cases created in that particular month.

Both the regression as well as system test cases are calculated

and filled in the UMP Metric sheet.
5

UMP Metrics Data Sheet

Like wise for Test execution we need to click the Test Lab tab
and collect the number of test cases executed in that month
and fill in the sheet.

The normalized test cases count is calculated automatically.

In the Final sheet we will fill the values for the following :

Test Design - Completion : Number of test cases created and

Number of test cases that are were planned to create.
Test Execution - Completion : Number of test cases executed
and Number of test cases that are were planned to execute.
Productivity - Test Design : Number of normalized test cases
created during test design phase & Effort (in Person Days) to
create the test cases
7

Productivity - Test Execution : Number of normalized test

cases executed during test execution phase & Effort (in Person
Days) to execute the test cases.

Test Design Coverage : Number of testable requirements

covered by test cases created & Number of testable system
requirements.

Test Execution Coverage : Number of testable requirements

covered by test cases executed & Number of testable system
requirements.

Effort (in Person Days) is calculated as follows:

((No of test cases/No of working hours per day)/No of persons

testing)
8

Final Sheet

10

Test Effectiveness : Number of defects (sev1 and sev2) found

in testing done by TCS & Number of defects in subsequent test
phases and mutually agreed period in production.

Invalid Defects : Number of defects rejected & Total number of

defects raised.

Like wise each and every data is collected every months for
different projects and is updated in the sheet.
This asset would help the associates regarding how are we
collecting UMP metrics data monthly and what are the steps to
update UMP metrics.

11

Thank You