GSM Key Performance Indicator

KPIGuidebook

Version: V1.1

Security Category: Secret

Serviceable range: Radio Planning Section

GSM Network Planning & Optimization Dept. of Engineering Service Division

ZTE Corporation
 Secret
Secret

Work Guidebook for GSM P&O Dept.

Version Introduction
Version Date Writer Assessor Amendment Records
V1.0 2008-01-21 Chen Chun Zheng Hao None
1V3 KPI and EDGE KPI were added.
2Amendment: mainly directed at V2.97
Zheng Hao, and V6.0.
V1.1 2008-12-07 Yang Jiazhi Chen Chun, 3Some classic KPI cases and comments
Fei Aiping were added.
4Principles for KPI risk analysis were
added.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements.
 Secret
Secret

CONTENTS

1 Overview...........................................................................................................................1

2 CS Radio Service Statistical KPI....................................................................................4

2.1 Availability ........................................................................................................................4
2.1.1 SDCCH availability/SDCCH ....................................................................................4
2.1.2 TCH availability/TCH ...............................................................................................4
2.1.3 Cell utilization ...........................................................................................................4
2.2 Accessibility ......................................................................................................................5
2.2.1 Random Access Success rate.....................................................................................5
2.2.2 SDCCH blocking rate................................................................................................5
2.2.3 TCH blocking rate .....................................................................................................6
2.2.4 Radio connection ratio...............................................................................................6
2.2.5 SDCCH drop rate ......................................................................................................7
2.2.6 SDCCH assignment success rate...............................................................................7
2.2.7 TCH assignment success rate ....................................................................................7
2.2.8 Call setup success rate ...............................................................................................8
2.3 Mobility .............................................................................................................................9
2.3.1 Handover success rate ...............................................................................................9
2.4 Reliability ..........................................................................................................................9
2.4.1 TCH Call Drop Rate..................................................................................................9
2.4.2 Traffic Call Drop .....................................................................................................10
2.4.3 Call Completion rate................................................................................................10
2.4.4 UL RxQual 0-4 ........................................................................................................11
2.4.5 DL RxQual 0-4 ........................................................................................................11
2.5 Call Setup time ................................................................................................................12
2.5.1 Call setup time (GSM to PSTN)..............................................................................12
2.5.2 Call setup time (GSM to GSM)...............................................................................12

3 CS Radio Service Test KPI ...........................................................................................13

3.1 Call Setup Success Rate ..................................................................................................13
3.2 Handover Success Rate ...................................................................................................13
3.3 Call Drop Rate.................................................................................................................13

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements.
 Secret
Secret

3.4 Coverage (Drive Test)......................................................................................................13

3.4.1 SQI...........................................................................................................................14
3.4.2 MOS ........................................................................................................................14
3.4.3 MOS & PSEQ .........................................................................................................15

4 PS Radio Service Statistical KPI ..................................................................................18

4.1 Accessibility ....................................................................................................................18
4.1.1 DL TBF establishment success rate .........................................................................18
4.1.2 UL TBF establishment success rate .........................................................................18
4.1.3 GPRS RLC ..............................................................................................................19
4.1.4 GPRS RLC ..............................................................................................................20
4.1.5 EGPRS RLC............................................................................................................20
4.1.6 EGPRS RLC............................................................................................................20

5 PS Radio Service Test KPI............................................................................................22

5.1 Accessibility ....................................................................................................................22
5.1.1 Attach success rate...................................................................................................22
5.1.2 Average GPRS attach time ......................................................................................22
5.1.3 PDP context activation success rate ........................................................................22
5.1.4 PDP context activation time ....................................................................................23
5.1.5 PING test success rate .............................................................................................23
5.1.6 Average PING test time ...........................................................................................23
5.2 Mobility ...........................................................................................................................24
5.2.1 Routing Area Update Successful rate ......................................................................24
5.3 Data Throughput..............................................................................................................24
5.3.1 Average FTP download rate ....................................................................................24
5.3.2 Average FTP upload rate .........................................................................................25
5.3.3 Throughput ..............................................................................................................25
5.4 Reliability ........................................................................................................................25
5.4.1 PDTCH Drop Rate ..................................................................................................25

6 Introduction to CN Statistical KPI...............................................................................27

6.1 Paging success rate ..........................................................................................................27
6.2 Location update success rate ...........................................................................................27
6.3 Attach success rate ..........................................................................................................27
6.4 GPRS average attach time ...............................................................................................28
6.5 PDP context activation success rate ................................................................................28

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements.
 Secret
Secret

6.6 Routing Area Update Success rate ..................................................................................28

7 Comments on KPI Cases...............................................................................................30

7.1 Pengshui (Chongqing) PS Test Result.............................................................................30
7.2 Jishou (Hunan) China Mobile EDGE Test Result ...........................................................31
7.3 Acceptance requirements for EDGE KPI of Data Service of a network .........................33
7.4 Operation & Maintenance KPI of a Network ..................................................................34
7.5 Operation & Maintenance KPI of a network in Southeast Asia ......................................36
7.6 KPI requirements for Indonesia Telkomsel network .......................................................40

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements.
 Secret
Secret

1 Overview

This guidebook collected the Key Performance Indicators (KPI) for CS and PS
services, which are now commonly adopted in presales bidding projects; and the
definitions of different KPIs and counter formulas for V2/V3 are explained here as
5 well. Meanwhile, with the aim to unify response on KPIs and avoid the possible
market risks, after analyzing the performance indicators of current networks of
both domestic and overseas key projects, the writer provides the reference values
and risk values of different KPIs in this guide. If the KPIs listed in the bidding
documents go beyond the reference values and risk values (suppose risk value of
10 the KPI is provided; otherwise, suggested values shall be applied.), we need to
conduct risk analysis and evaluation, meanwhile, try to avoid the risk and send out
pre-warning. The KPIs can be quite different due to the differences in network
structure and dimension. To make sure that our KPI can meet requirements in
bidding documents, we need not only support from theories, but accumulation of
15 work experience as well. The suggested values and risk values of KPI mentioned in
this guide are reference suggestions concluded from the current conditions of GSM
network. As GSM techniques and skills are developing and equipment performance
is improving constantly, the reference standards for KPI will change accordingly.

The key requirement for engineers engaged in presales network planning is to

20 thoroughly understand and master the related KPIs, which is also the basic but
highest demand for radio network planning engineers.

Why network operators set up KPIs and what are they aimed at?

How to define KPI and what can be resulted from deviation of KPI?

How much influence can the value of KPI impose on presales bidding?

25 How to clarify KPI and how to achieve favorable negotiation results during KPI
clarification?

How to avoid and pre-warn KPI risks?

What is the development direction of KPI assessment?

Each presales radio network planning engineer shall possess related techniques of
30 and up-to-date answers to the six questions above. For lack of space, the six

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 1Total 45 pages
 Secret
Secret

questions will not be further discussed in this guidebook. The engineers will be
able to experience and get to know them in presales planning work in future.

Generally, KPI can be classified into four types: statistical KPI, testing KPI,
equipment performance KPI, customer perception KPI. Only statistical KPI and
5 testing KPI are elaborated here. As for equipment performance KPI and customer
perception KPI, they are focused on in another guidebook. Nowadays, network
operators are attaching more and more importance to KPI during negotiations.
Besides the four types mentioned above, a lot more aspects are involved in KPI.
KPI is also closely related to the basic network environment. Therefore, KPI is
10 affected by various factors. That is why operators are now regarding KPI as a very
important leverage to shift risk and decrease network investment and maintenance
cost. Equipment manufacturers must commit themselves to suitable, reasonable
and timely KPI, so as to bring down contract risk and ensure profits. Rationalize
commitment, share risks is an important principle in presales planning work.

15 The following are the factors that shall be taken into consideration when we work
on KPI:

1. network dimension;

2. network type;

3. degree of subscriber(number) growth;

20 4. geographical distribution of network(urban, countryside, village)

5. equipment types; there is difference in KPI for V2 and V3.

Functional principles for this guidebook (mainly directed at KPI):

1. This guide is only available to the radio network planning engineers engaged
in presales bidding. No one is entitled to spread it outside or extensively spread
25 it inside the company. The right to interpret the serviceable range of this guide
remains with GSM Technical Research Section & Resources Section.

2. It is suggested to release the guidebook in encrypted document. It can not be

procured unless logging into document security software.

3. The guide is a reference to radio network planning staff engaged in presales

30 bidding. It can not replace the presales KPI project evaluation.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 2Total 45 pages
 Secret
Secret

4. The KPI values enclosed in this guide are valid within only half a year since
the release of it. After half a year, it needs to be updated and reassessed.

5. The guide is mostly applicable to V2.97 of V2 and V6.0 (ISMG) and V6.1
(Minos) of V3.

5 Notes: V6.0 (ISMG), V6.1 (Minos), sic passim

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 3Total 45 pages
 Secret
Secret

2 CS Radio Service Statistical KPI

2.1 Availability

2.1.1 SDCCH availability/SDCCH

KPI SDCCH availability (SDCCH in service rate)
KPI reference 99%
value
Indicator SDCCH usable total*100%/(SDCCH usable total +SDCCH unusable total
definition
V2 C11601*100%/(C11601+C11602)
Counter
V6.0 C100030122*100%/( C100030122+ C100030123)
formula V3
V6.1 C900060122*100%/(C900060122+C900060123)
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly
used to examine equipment performance, especially to inspect the utilization of SDCCH in
Notes the cells. It is directly related to the stability of equipmenttransmission and power supply,
etc.. It reflects the utilization ratio of network equipment and the stability of initial network
operation.

2.1.2 TCH availability/TCH

KPI TCH availability (TCH in service rate)
KPI 98%
reference
value
Indicator TCH usable total*100%/(TCH usable total+ TCCH unusable total
definition
V2 C11607*100%/(C11607+C11608)

(C100030125+C100030134+C100030155)*100% / (C100030125 +
V6.0
Counter C100030134 + C100030155 + 100030126+ C100030217+ C100030218)
formula V3 (C900060125+C900060134+C900060155)
V6.1 *100%/(C900060125+C900060134+
C900060155+C900060126+C900060217+C900060218)
The ratio of the SDCCH usable total to the total SDCCH allocated in network is mainly used to
Notes examine equipment performance, especially to inspect the utilization of SDCCH in the cells. It is
directly related to the stability of equipmenttransmission and power supply, etc..

5 2.1.3 Cell utilization

KPI Cell utilization
KPI reference 80%

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 4Total 45 pages
 Secret
Secret

value
Indicator Cells, in which ratio of actual traffic / desired traffic<1
definition
Counter None
formula
This is mainly to compare performance of preplanning network with that of actual
network. The prerequisite is that precise traffic model traffic dispersion network
Notes
capacity and redundancy rate shall be provided in preplanning period. This KPI is also
related with network configuration and traffic distribution.

2.2 Accessibility

2.2.1 Random Access Success rate

KPI Random Access Success rate
KPI reference Suggested value 99%
value Risk value 99.5%
Indicator Random access success times *100% / Random access call attempt times
definition

V2 (C11626+C11696-C11697)*100%/(C11625+C11696)

Counter (C100030004+C100030010+C100030038-(C100030011 +C100030039))

V6.0
formula *100%/(C100030003+C100030010+C100030038)
V3
(C900060004+C900060010+C900060038-(C900060011 +C900060039))
V6.1
*100%/(C900060003+C900060010+C900060038)
Notes SDCCH congestion rate shall be taken into consideration, because of its direct influence on
this KPI.

2.2.2 SDCCH blocking rate

KPI SDCCH blocking rate
KPI reference 1%
value
Indicator Signaling channel congestion times*100% / signaling channel call attempt times
definition
V2 (C11625-C11626+C11697)*100%/(C11625+C11696)

(C100030005+C100030011+C100030039) *100%/ (C100030003+

Counter V6.0
C100030010+C100030038)
formula V3
(C900060005+C900060011+C900060039)*100%/(C900060003+
V6.1
C900060010+C900060038)
This is mainly to evaluate the fitness between preplanned network and actual network. It will
be affected by the following factors:
Notes 1. the fitness between network desired capacity and actual capacity; fitness between preset
traffic model and the actual one; 2. burst traffic; 3. lack of SDCCH capacity; 4. internal &
external interference; 5. preplanned redundancy rate; 6. operators special requests; 7. FR and HR

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 5Total 45 pages
 Secret
Secret

used as signaling channel.

2.2.3 TCH blocking rate

KPI TCH blocking rate
KPI
reference 2%
value
Indicator
TCH congestion times*100%/ TCH call attempts
definition

V2 C11612-C11699*100%/C11611-C11698

(C100030020+C100030031+C100030043+C100030047+C100030022 +
Counter V6.0 C100030033+C100030045+C100030049)*100%/(C100030019+C100030030+
formula V C100030042+C100030046+C100030021+C100030032 +C100030044+C100030048)
3 (C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+
V6.1 C900060045+C900060049)*100%/(C900060019+C900060030+C900060042+C900060046+
C900060021+C900060032+C900060044+C900060048)
This is mainly to evaluate the fitness between preplanned network and actual network, and the precondition is
that precise traffic model traffic dispersion network capacity and redundancy rate shall be provided in
preplanning period. It is related to the following factors:
Notes
1. the fitness between network desired capacity and actual capacity; fitness between preset traffic model and the
actual one; 2. burst traffic; 3. lack of TCH capacity; 4. internal & external interference; 5. preplanned redundancy
rate; 6. handovers.

2.2.4 Radio connection ratio

KPI Radio connection ratio
KPI
reference 97%
value
Indicator
1-signalling channel congestion rate*(1-voice channel congestion rate)*100%
definition

V2 (1-(C11625-C11626+C11697)*100%/(C11625+C11696))*(1-(C11612-C11699)/(C11611-C11698))

(1-(C100030005+C100030007)*100% / (C100030003+C100030006)) * (1-(C100030011

Counter
+C100030020+ C100030031+C100030039 +C100030043 + C100030047 +C100030013+
formula V
V6.0 C100030022 +C100030033+C100030041 +C100030045+C100030049) / (C100030010+
3
C100030019+ C100030030 + C100030038+ C100030042+C100030046+ C100030012+
C100030021 +C100030032+C100030040 +C100030044+C100030048))
(1-
(C900060005+C900060011+C900060039)*100%/(C900060003+C900060010+C900060038))*(1-
V6.1
(C900060020+C900060031+C900060043+C900060047+C900060022+C900060033+
C900060045+C900060049)/(C900060019+C900060030+C900060042+C900060046+

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 6Total 45 pages
 Secret
Secret

C900060021+C900060032+C900060044+C900060048))

This is mainly to compare performance of preplanned network with that of actual network. The prerequisite is that
Notes precise traffic modeltraffic dispersionnetwork capacity and redundancy rate shall be provided in preplanning
period. This KPI is in direct tie-in constraint with SDCCH blocking rate and TCH blocking rate.

2.2.5 SDCCH drop rate

KPI SDCCH drop rate
KPI reference Suggested value 0.1%
value Risk value 0.05%
Indicator SDCCH call drop total*100%/(random access call attempts + voice channel call attempts total
definition (handover excluded)signalling)
Counter V2 C11605*100%/(C11625+C11696)
formula V3 V6.0 C100030053*100%/(C100030003+C100030010+C100030038)
V6.1 C900060053*100%/(C900060003+C900060010+C900060038)
C11605 accumulates SDCCH call drops resulted from all reasons, including radio link failure
LAPD link breakshandover failure, etc., but except the following four reasons: lost connection
with SMM, forced OMC-R disconnection, forced disconnection by other calls, and other causes. If
we compute according to the formula above, SDCCH call drop rate will be rather low. If counter
Notes
116135 is included (BSS call drop times on SDCCH), the suggested KPI value is 0.6%, and
suggested risk value 0.4%.
C100030053/C900060053 is used to find out the frequency of call drops resulted from radio link
failureLAPD link breakshandover failure. This KPI value is relatively lower.

2.2.6 SDCCH assignment success rate

KPI SDCCH assignment success rate
KPI reference Suggested value 96%
value Risk value 98%
Indicator SDCCH assignment success rate*100/(SDCCH assignment success times +SDCCH assignment
definition failure times)
V2 C11644*100%/( C11644+ C11645)
V6. C100420014*100%/C100420014+C100420015)
Counter
0
formula V3
V6. C901250014*100%/(C901250014+C901250015)
1
SDCCH assignment success rate is involved with many factors, such as LAPD linkfrequency
Notes
interferenceaccess parameters, etc..

2.2.7 TCH assignment success rate

KPI TCH assignment success rate
KPI reference Suggested 98%
value value

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 7Total 45 pages
 Secret
Secret

Risk value 99%

Indicator TCH assignment success times*100/( TCH assignment success times +TCH assignment
definition failure times)
V2 C11657*100%/(C11657+C11658)

(C100030017+C100030028+C100030036+C100030235 +
C100030199+C100030210)*100%/(C100030017+C100030028
V6.0 +C100030036+C100030018+C100030029+C100030037+
C100030235+C100030199+C100030210+C100030200+
Counter C100030211+C100030135)
formula V3 (C900060017+C900060028+C900060036+C900060199+
C900060210+C900060235) *100%/(C900060018+C900060029+
C900060037+C900060200+C900060211+C900060135+
V6.1
C900060017+C900060028+C900060036+C900060199+
C900060210+C900060235)

Notes This KPI is directly related to radio environment frequency carrier problems
assignment methodsapplication of data service, etc..

2.2.8 Call setup success rate

KPI Call setup success rate CSSR
KPI reference Suggested value 92%
value I Risk value` 94%
Indicator (1-SDCCH blocking rate)* (1-SDCCH assignment failure rate)*(1-SDCCH drop rate)*(1-
definition I TCH blocking rate)*(1-TCH assignment failure rate)
Note I The definition of this CSSR is relatively strict because too many factors are included
(LACSMS, etc.). The definition is not rational from the view of voice call, so that the
CSSR used in MOTO excluded SMS factor. Handover is excluded.
KPI reference Suggested value 93%
value II Risk value 95%
Indicator ((MOC success + MTC success/ (MOC attempt + MTC attempt)) *(1-SDCCH drop
definition II rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note II According to common understanding, CSSR is mostly applied to inspect the establishment
of voice call. It is rather reasonable to exclude LAC and SMS. Handover is excluded.
KPI reference Suggested value 97%
value III Risk value 95%
Indicator ((MOC success + MTC success/ (MOC attempt + MTC attempt)) *(1-SDCCH drop
definition III rate)*(1-TCH blocking rate)*(1-TCH assignment failure rate)
Note III The CSSR is mainly measured in the view of congestion. It is similar to Hutchisons
definition of CSSR. Handover excluded.
Counter CSSR is usually obtained from the combination of original KPI.
formula
Different manufacturers have different definitions for CSSR. The formula above is
Explanation regarded too strict. Some may define it to be TCH assignment success rate or radio access
completion rate. We need to make clear the formula with customers. It is regarded a

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 8Total 45 pages
 Secret
Secret

favorable way to exclude location update indicators when we define this KPI.

2.3 Mobility

2.3.1 Handover success rate

KPI Handover success rate
Suggested value 94%
V2
KPI reference Risk value 96%
value Suggested value 95%
V3
Risk value 97%
Indicator Handover success times in busy hours*100% / handover request times in busy hours
definition
(C11618+C11669-C11675)*100%/(C11617+C11668-
V2
C11675)
(C100030098+C100030102+C100030120+C100030094+
C100030096)*100 %/ (C100030097+C100030213+
V6.0 C100030214+ C100030215+C100030099+C100030100
+C100030101+C100030216 +C100030119 +C100030093
Counter
+C100030095)
formula
V3 (C900060098+C900060102+C900060120+C900060094+
C900060096)
*100%/(C900060097+C900060213+C900060214+
V6.1
C900060215+C900060099+C900060100+C900060101+
C900060216+C900060119+C900060093+C900060095)

This formula includes both incoming and outgoing handovers, while some operators may take into
consideration only one of them. As for V3 equipment, 1-2% can be appropriately increased
Notes according to real situations. This KPI can differ a lot from each other due to different types of
network. In many presales bidding, the operators require a handover success rate of around 98%,
which involves high risks to be reached, though several networks have reached 98%.

2.4 Reliability

2.4.1 TCH Call Drop Rate

KPI TCH drop rate / Call drop rate
Suggested value 1.0%
V2
KPI reference Risk value 0.7%
value Suggested value 0.7
V3
Risk value 0.5
Indicator TCH call drop times*100%/TCH assignment success times
definition

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 9Total 45 pages
 Secret
Secret

C11615*100%/(C11611-C11698-(C11612+C11656+C11658+
V2
C11617-C11618-C11699-C116103-C116133))
V6. (C100030054+C100030055)*100%/(C100030028+ C100030036+
Counter
0 C100030199+C100030210+ C100030098+C100030102+C100030120)
formula
V3 (C900060054+C900060055) *100%/(C900060028+C900060036+
V6.
C900060199+C900060210+C900060098+C900060102+
1
C900060120)
Voice channel call drop rate falls into two types: one is with handover included; the other is with
handover excluded. The formula above takes handover in it. If handover is not included, the indicator
will be about 0.2% higher than the one with handover included. This discrepancy is not universally
Notes
definite yet, for it can be bigger in dual-band network. Generally, call drop rate of V3 equipment is a bit
lower than the one of V2. This KPI differs a lot in varied types of network. The discrepancy can reach
0.3%.

2.4.2 Traffic Call Drop

KPI Minute per drop(MPD)
Suggested value 90
V2
KPI reference Risk value 120
value Suggested value 120
V3
Risk value 180
Indicator Traffic /TCH call drop times*60
definition
V2 (C11616/3600)*60/C11615
Counter ((C100030129+C100030127)/3600)*60/
V6.0
formula V3 (C100030054+C100030055)
V6.1 ((C900060129+C900060127)/3600)*60/(C900060054+C900060055)
Notes This KPI of different networks varies to a large extent. Generally, its difficult for to reach
this KPIs standards, if the call drop (with handover included) rate is higher than 0.5%.

2.4.3 Call Completion rate

KPI Call Success Rate CSR
KPI Suggested 92%
reference value value
Risk value 94%
Indicator CSSR*(1- Call drop rate)
definition
Counter None. Refer to Indicator Definition II under Item 2.2.8
formula
Notes This formula is a customer KPI. We need to make it clear with customers
when referring to this KPI. But it is close to customers perception.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 10Total 45
pages
 Secret
Secret

2.4.4 UL RxQual 0-4

KPI UL RxQual 0-4
Suggested 95%
KPI reference
value
value
Risk value 97%
Indicator UL RxQual 0-4 *100 / UL RxQual 0-7
definition
(C116114+C116115+C116116+C116117+C116118) * 100 / (C116114
V2 +C116115+C116116+C116117+C116118+ C116119
+C116120+C116121)
(C100030066+ C100030067+ C100030068+ C100030069+
Counter
V6.0 C100030070)*100/ (C100030066+ C100030067+ C100030068+
formula
C100030069+ C100030070+ C100030071+ C100030072+ C100030073)
V3
(C900060066+ C900060067+ C900060068+ C900060069+
V6.1 C900060070)*100/ (C900060066+ C900060067+ C900060068+
C900060069+ C900060070+ C900060071+ C900060072+ C900060073)
Notes
None

2.4.5 DL RxQual 0-4

KPI DL RxQual 0-4
Suggested 95%
KPI reference
value
value
Risk value 97%
Indicator DL RxQual 0-4 *100 / DL RxQual 0-7
definition
(C116122+C116123+C116124+C116125+C116126+C116127)* 100 /
V2 (C116122 +C116123+C116124+C116125+C116126 +C116127
+C116128+C116129)
( C100030074+ C100030075 + C100030076+ C100030077 +
Counter V6.
C100030078)*100/ ( C100030074+ C100030075 + C100030076+ C100030077 +
formula 0
C100030078+ C100030079+ C100030080+ C100030081)
V3
( C900060074+ C900060075 + C900060076+ C900060077 +
V6.
C900060078)*900/ ( C900060074+ C900060075 + C900060076+ C900060077 +
1
C900060078+ C900060079+ C900060080+ C900060081)

Notes None

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 11Total 45
pages
 Secret
Secret

2.5 Call Setup time

2.5.1 Call setup time (GSM to PSTN)

KPI Call setup time (GSM to PSTN)
Suggested 8 seconds
KPI reference
value
value
Risk value 5 seconds
Indicator time duration from starting call to ringing out
definition
Notes We can use test software to estimate the time duration, which is related with network
structurerouting and radio environment. MSC provides this KPI. It differs in different
network configurations.

2.5.2 Call setup time (GSM to GSM)

KPI Call setup time (GSM to GSM)
Suggested 7 seconds
KPI reference
value
value
Risk value 5 seconds
Indicator Obtain from test the time duration from starting call to ringing out
definition
Notes We can use test software to estimate the time duration, which is related with network
structurerouting and radio environment. MSC provides this KPI. It differs in different
network configurations.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 12Total 45
pages
 Secret
Secret

3 CS Radio Service Test KPI

3.1 Call Setup Success Rate

KPI Call Setup Success Rate
Suggested 95%
KPI reference
value
value
Risk value 98%
Indicator Call connection times*100% / call attempt times
definition
Indicator value DT&CQT, test pre-defined locations and Drive Test route
Notes None

3.2 Handover Success Rate

KPI Handover Success Rate
Suggested 95%
KPI reference
value
value
Risk value 98%
Indicator Handover success times*100% / handover attempt times
definition
Indicator value DT&CQT, Pre Defined Drive Test Route or NMS
Notes None

3.3 Call Drop Rate

KPI Call Drop rate
Suggested 3%
KPI reference
value
value
Risk value 2%
Indicator Call drop times*100% / call connection times
definition
Indicator value DT&CQT, test Pre Defined Drive Test Route or NMS
Notes None

5 3.4 Coverage (Drive Test)

Urban Suburban Rural Road

Illustration of 85% of the 85% of the 85% of the 85% of the

coverage sample values sample values sample values sample values

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 13Total 45
pages
 Secret
Secret

requirement should have a value should have a value should have a value should have a value
equal to or higher equal to or higher equal to or higher equal to or higher
than 75 dBm. than 80 dBm. than 85 dBm. than 90 dBm.
Influencing factors 1. landform; 2. inconsistency between project implementation and project plans;
3. test equipment; 4. test routes
Detailed coverage requirements (as shown above) are delivered in the bid documents.
Estimation of network dimension is also based on the requirements. Nowadays,
requirements for network coverage are higher, so the accordingly estimated number of sites
will meet the needs. If the network dimension has to be reduced due to market strategies
needs, this KPI will cause problems in the acceptance inspection. Further more, we need to
Notes
make sure that our customers are aware of regional assignmentDT routes and test
methods. Coverage KPI is one of the most important KPIs, because it directly reflects not
only our radio network planning ability and the performance of our equipment, but also our
core competitive strength in network planning. Due to lack of space, there is no more
illustration of coverage KPI hereafter in this guide.

3.4.1 SQI
KPI SQI
Suggested 95% sample >=18
KPI reference
value
value
Risk value 95% sample >=25
Indicator TEMS test value
definition
This KPI is for inspecting the sound distortion degree resulted from incapable link
transmission. The formula is Ericssons patent. It takes into consideration many factors,
including BERFERhandover timeshandover conditionsDTX activated (or not)
Notes and the encoder in use, etc., to finally get the SQI. There are different SQI top limits for
different types of encoders. For half-rate encoder, the SQI top limit is 19; for full-rate
encoder, 21; for enhanced full-rate encoder, 30. SQI ranges from 18 to 30. SQI value will
increase when EFR is applied.

3.4.2 MOS
KPI Mean Opinion Score ( MOS)
KPI reference Refer to the form attached bellow.
value
Indicator Test value
definition
Notes The commonly used MOS assessment method consists of subjective and objective scoring
parts. In the subjective part, engineers subjectively compare the original voice material and
the deteriorated voice material according to ITU-T Suggestion book P.800 and P.830, and
give their MOS scores respectively, then average the scores from different engineers. While
in the objective part, PESQ method from ITU-T Suggestion book P.862 is employed, that is
special equipment or software (e.g. the VQT test equipment of Agilent) is used to proceed

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 14Total 45
pages
 Secret
Secret

the assessment. In MOS, 0 means the worst quality, 5 stands for the highest. Standard PCM
quality shall reach around 4.4.
The MOS values for commonly used coding formats are as follows:
G.711MOS 4.8
G.721G.723G.726MOS 4.2
G.728 MOS4.2
G.729 MOS4.2
G.723.15.3MOS3.5
G.723.16.3MOS3.98
MOS can be affected greatly by the performance of test equipment. The test results from
different manufacturers are different. Currently, the test equipment from Actena performs
the best.

Average MOS(Including FR &HR

TFO
MOS)
Voice version combination
Frequency No frequency Frequency No frequency
hopping hopping hopping hopping
100% FR 3.04 3.29
100% EFR 3.63 3.57
100% AMR FR 3.56 3.54
60% HR (+EFR)
30% HR (+EFR)
10% HR (+EFR)
60% AMR HR (+AMR FR)
30% AMR HR (+AMR FR)
10% AMR HR (+AMR FR)

3.4.3 MOS & PSEQ

Subjective scoring method had been used in assessment on voice quality until 2001.
Users were requested to assess the voice quality of incoming calls by scoring 1-5
5 (5- best, 1 - worst). This assessment method was regulated to be a standard by ITU
in August, 1996. MOS assessment method was defined in its P.800 standard in
details. But later it was found that this method not only took too much time, but
also cost a lot. So there was an urgent need for a kind of economic test equipment,
which can be used to simulate the voice quality received by users, and thus can
10 play its part in designingtesting and debugging new type of voice encoders.

With the aim to meet the need, in February 2001 ITU issued the new test standard
on voice transmission quality-P.862 (PESQ-Perceptual Evaluation of Speech
Quality). It adopts the new algorithm developed by Psytechnics company. PESQ

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 15Total 45
pages
 Secret
Secret

can be used to compute voice samples MOS-LQO value (Mean Opinion Score-
Listening Quality Objective). The computed result and the subjective scoring result
are basically the same. PESQ compares the output signal (collected after the signal
is transmitted through equipment) and the reference signal, then works out the
5 difference. In the ordinary course of event, the bigger the difference between the
output signal and the reference signal, the smaller the reference value of MOS will
be. PESQ is testified to be a reliableeconomic and fast measuring tool for voice
encoder. Compare PESQs predicted value and the result from subjective scoring
method, we can see the correlation between the two values is 0.935(refer to
10 P862E.docfor correlation factors). For 22 kinds of ITU benchmark tests, the
absolute error is within 0.5 MOS, 69.2% among which is within 0.25 MOS. It is
worth our attention that PESQ value ranges from 0.5 to 4.5, while MOS value
ranges from 1 to 5.

15
Fig 1 MOS/PESQ Correlation Diagram

At the present time, there are two types of QOS test method-subjective and
objective methods. MOS subjective test method is defined in ITU-T P.800. The
objective test methods includes PSQMPSQM+ and PESQ etc.. ITU-T P.862
20 PESQ is the method currently recommended by ITU to test end-to-end

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 16Total 45
pages
 Secret
Secret

network voice quality. It would be ideal if MOS and PESQ are simultaneously
supported in the QOS test.

Form 1 Definition of MOS Values

Level MOS
Excellent 5
Good 4
Fair 3
Poor 2
Bad 1

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 17Total 45
pages
 Secret
Secret

4 PS Radio Service Statistical KPI

4.1 Accessibility

4.1.1 DL TBF establishment success rate

KPI DL TBF establishment success rate
KPI reference Suggested value 95%
value Risk value 96%
Indicator type Statistical value
GPRS DL signalling TBF link setup times+ GPRS DL data TBF link setup
Indicator
times +EGPRS DL signalling TBF link setup times +EGPRS DL data TBF link setup
definition
times*100%/ DL packet channel request timesV3

V2 (C70043+C70057+C70071)*100/C70041

(C100010007+C100010015+C100010008+C100010016)
*100%/(C100010141+C100010142+C100010143+
V6.0
Counter C100010144+C100010145+C100010146+C100010147
formula +C100010148)
V3
(C900040007+C900040015+C900040008+C900040016)
*100%/(C900040141+C900040142+C900040143+
V6.1
C900040144+C900040145+C900040146+C900040147
+C900040148)
This KPI reflects the request fulfilled status of PS downlink resources. Its TBF
includes DL signaling TBFGPRS DL data TBF and EGPRS DL data TBF. DL
TBF link setup success rate can reflect the DL PS quality of a cell. Its major
influencing factors are as follows:
Notes 1. Interference: internal & external interference;
2. Parameters setting: eg. errors in Timer and functional parameters
3. Stability of equipment and transmission: eg. instant breakdown(flash)
resulted from high error rate or unstable link;
4. Usability of data service functions.

4.1.2 UL TBF establishment success rate

KPI UL TBF establishment success rate
KPI Suggested 92%
reference value
value Risk value 95%
Indicator type Statistical value
Indicator GPRS UL signalling TBF link setup times + GPRS UL data TBF link setup times
definition +EGPRS UL signalling TBF link setup times +EGPRS UL data TBF link setup times

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 18Total 45
pages
 Secret
Secret

*100/ UL packet channel request timesV3

V2 (C70042+C70055+C70069)*100%/C70040

(C100010025+C100010033+C100010026+C100010034)
V6.0 *100% /(C100010159 +C100010160+C100010161+C100010168
Counter
+C100010163+C100010164+ C100010165+C100010166)
formula
V3 (C900040025+C900040033 +C900040026 +C900040034)
*100%/ (C900040159+ C900040160
V6.1
+C900040161+C900040168+C900040163 +C900040164
+C900040165+C900040166)
This KPI reflects the request fulfilled status of PS uplink resources. Its TBF includes
UL signaling TBFGPRS UL data TBF and EGPRS UL data TBF. UL TBF link setup
success rate can reflect the UL PS quality of a cell. Its major influencing factors are as
follows:
1. Interference: internal & external interference;
Notes
2. Parameters setting: eg. errors in Timer and functional parameters
3. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;
4. Usability of data service functions.

4.1.3 GPRS RLC

KPI UL GPRS RLC retransmission rate
KPI Suggested 10%
reference value
value Risk value 5%
Indicator type Statistical value
Indicator GPRS UL TBF NACK blocks *100% / valid data statistics received by GPRS UL TBF
definition

V2 C70066*100%/ C70065

Counter C100010063*100%/C100010062
V6.0
formula
V3
C900040063*100%/C900040062
V6.1

This KPI reveals UL GPRS RLC retransmission rate, which is the most important
indicator to reflect the sensibility of GPRS UL service and to show whether instability
congestion and interference exist in the system. Its major influencing factors are as
Notes follows:
1. Interference: internal & external interference;
2. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 19Total 45
pages
 Secret
Secret

4.1.4 GPRS RLC

KPI DL GPRS RLC retransmission rate
KPI reference Suggested 10%
value value
Risk value 5%
Indicatory Statistical value
type
Indicator GPRS DL TBF NACK blocks *100% / valid data statistics received by GPRS DL TBF
definition

V2 C70068*100%/ C70067

Counter C100010065*100%/C100010064
V6.0
formula
V3
C900040065*100%/C900040064
V6.1

This KPI reveals DL GPRS RLC retransmission rate, which is the most important
indicator to reflect the sensibility of GPRS DL service and to show whether instability
congestion and interference exist in the system. Its major influencing factors are as
Notes follows:
1. Interference: internal & external interference;
2. Stability of equipment and transmission: eg. instant breakdown resulted
from high error rate or unstable link;

4.1.5 EGPRS RLC

KPI UL EGPRS RLC retransmission rate
KPI Suggested 10%
reference value
value Risk value 5%
Indicatory Statistical value
type
Indicator EGPRS UL TBF NACK blocks *100% / valid data statistics received by EGPRS UL TBF
definition

V2 C70080*100%/ C70079

Counter C100010071*100%/C100010070
V6.0
formula
V3
C900040071*100%/C900040070
V6.1

Notes Refer to UL GPRS RLC retransmission rate

4.1.6 EGPRS RLC

KPI DL EGPRS RLC retransmission rate

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 20Total 45
pages
 Secret
Secret

KPI Suggested 10%

reference value
value Risk value 5%
Indicatory Statistical value
type
Indicator EGPRS DL TBF NACK blocks *100% / valid data statistics received by EGPRS DL TBF
definition

V2 C70082*100%/ C70081

Counter C100010073*100%/C100010072
V6.0
formula
V3
C900040073*100%/C900040072
V6.1

Notes Refer to DL GPRS RLC retransmission rate

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 21Total 45
pages
 Secret
Secret

5 PS Radio Service Test KPI

5.1 Accessibility

5.1.1 Attach success rate

KPI Attach success rate
Suggested 95%
KPI reference
value
value
Risk value 98%
Indicator Attach success times/Attach attempt times100
definition
Indicatory test
type
Counter None
formula
Notes Normally, this KPI is the CQT value. Attach success means that the
mobile phone receives the Attach Accept signaling within 15 seconds
after it sends the Attach Request. It is required to perform the Attach test
ten times at each test site.

5.1.2 Average GPRS attach time

KPI Average GPRS attach time
KPI reference Suggested value 2 sec
value Risk value 1.5 sec
Sum of attach success duration/ Attach success times. It is the
Indicator duration from the mobile sends out the first Attach Request to it
definition receives the Attach Accept signaling.
It is required to perform the test ten times at each test site.
Indicatory type Test value
Counter None
formula
Notes Normally, this KPI is the same as the CQT value. Authentication
included.

5 5.1.3 PDP context activation success rate

KPI PDP context activation success rate
KPI reference Suggested 95%
value value

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 22Total 45
pages
 Secret
Secret

Risk value 98%

Indicator PDP activation success times/attempt times 100.
definition PDP activation success means that the mobile phone receives the Activate
PDP Context Accept signaling 15 seconds after it sends the Activate PDP
Context Request.
Indicatory type Test
Counter None
formula
Notes Normally, this KPI is the same as the CQT value. It is required to perform
the PDP activation test ten times at each test site. Test methods for GPRS
and EDGE are the same.

5.1.4 PDP context activation time

KPI PDP context activation time
KPI reference Suggested value 1.5 sec
value Risk value 1.2 sec
Indicator Sum of PDP activation duration/ PDP activation success
definition times.
PDP activation time means the duration from the mobile
phone sends out the first Activate PDP Context Request to
it receives the Activate PDP Context Accept.
Indicatory type Test value
Counter None
formula
Notes Normally, this KPI is the same as the CQT value.
Authentication included. GPRS and EDGE are not
separated in this test.

5.1.5 PING test success rate

KPI PING test success rate
KPI reference Suggested value 95%
value Risk value 98%
Indicator Ping success times/Ping attempt times*100%
definition
Counter None
formula
Notes It is regarded as failure if the time exceeds 30 seconds.

5.1.6 Average PING test time

KPI PING test time
KPI reference Suggested value 1.5 sec
GPRS
value Risk value 1.4 sec

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 23Total 45
pages
 Secret
Secret

Suggested value 1 sec

EDGE
Risk value 0.6 sec
Indicator Sum of Ping success duration/ Ping success times
definition
Indicatory type Test value
Counter None
formula
Notes Authentication is included in this KPI. The Ping package size
will have influence on the test result. Generally, the smaller
the Ping package is, the better the test result will be. It is
sometimes referred as Round Trip Time.

5.2 Mobility

5.2.1 Routing Area Update Successful rate

KPI Routing Area Update Success rate
Suggested value 90%
KPI reference
Risk value 95%
Indicator Routing update attempt times*100% / Routing update success times
definition
Indicatory type test
Counter
None
formula
Notes Usually it can be statistical value. It also can be obtained from DT too.

5.3 Data Throughput

5.3.1 Average FTP download rate

KPI FTP download rate
Suggested value 20kbps
KPI GPRS
Risk value 30kbps
reference
Suggested value 80kbps
value EDGE
Risk value 120kbps
Indicator definition Actual download data quantity (byte)/actual download duration
Indicatory type Test value
Counter formula None
Notes Normally, this KPI is the CQT value. Class 4 mobile. Size of the
downloaded document will affect the test result. Usually, the
smaller the document size is, the better the test result will be. It is
related to the number of PS channelsterminal typeencoding
method and test software, etc.. The test result can also be affected

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 24Total 45
pages
 Secret
Secret

by the adoption of encoding method for CS3 and CS4. 3static time
slots are configured.

5.3.2 Average FTP upload rate

KPI FTP upload rate
Suggested value 8kbps
GPRS
KPI reference Risk value 10kbps
value Suggested value 25kbps
EDGE
Risk value 35kbps
Indicator definition Actual upload data quantity (byte)/actual upload duration
Indicatory type Test value
Counter formula None
Notes Normally, this KPI is the same as the CQT value. Class 4 mobile.
Size of the uploaded document will affect the test result. Usually,
the smaller the document size is, the better the test result will be. It
is related to the number of PS channelsterminal typeencoding
method and test software, etc.. The test result can also be affected
by the adoption of encoding method for CS3 and CS4. This KPI is
the result of single time slot.

5.3.3 Throughput
Mobile phone with multi-timeslot Level 8; single
Preconditions subscriber; 4 DL static signaling channels, 1 UL static
signaling channel
Indicators (EN) Indicators (CN) Suggested value
GPRS: Max data throughput-DL GPRS DL maximum transmission rate 9.8kbyte/s
GPRS: Max data throughput-UL GPRS UL maximum transmission rate 2.4kbyte/s
GPRS: Average data throughput-DL GPRS DL average transmission rate 5kbyte/s
GPRS: Average data throughput-UL GPRS UL average transmission rate 1.3kbyte/s
EDGE: Max data throughput-DL EDGE DL maximum transmission rate 26.5kbyte/s
EDGE: Max data throughput-UL EDGE UL maximum transmission rate 7kbyte/s
EDGE: Average data throughput-DL EDGE DL average transmission rate 14kbyte/s
EDGE: Average data throughput-UL EDGE UL average transmission rate 3.5kbyte/s

5.4 Reliability

5.4.1 PDTCH Drop Rate

KPI PDTCH Drop Rate
KPI reference Suggested value 5%
value Risk value 2%
Indicatory type DT test value

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 25Total 45
pages
 Secret
Secret

Indicator PDTCH drop times/ FTP download attempt times *100%

definition
Counter None
formula
Notes

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 26Total 45
pages
 Secret
Secret

6 Introduction to CN Statistical KPI

6.1 Paging success rate

KPI Paging success rate
KPI reference Suggested value 90%
value Risk value 93%
Indicator Paging response times*100% / Paging request times
definition
Counter Paging request times refer to the sum of PAGING information sent out by all
formula MSCs in the area, excluding the secondary paging information. Paging response
times refer to the sum of the PAGING RES received by all MSCs in the area,
including the second paging response. Statistical point is at MSC side.
Notes BSC can indirectly provide this KPI, but its statistical point differs from that of
MSC. The difference lies in call loss at Interface A.

6.2 Location update success rate

KPI Location update success rate
KPI reference Provided by the SMC side
value
Indicator Location update success times *100%/ location update request times
definition
Counter Provided by the SMC side
formula
Notes This KPI can be indirectly provided by BSC, but the value is different and its statistical
point differs from that of MSC too.

6.3 Attach success rate

KPI Attach success rate
KPI reference Suggested value 90%
value Risk value 95%
Indicator GPRS attach success times *100% / GPRS attach times
definition
Indicatory GPRS attach success times SGSN delivers ATTACH ACCEPT
type 3GPP TS 24.008excluding redeliver
Counter Statistics at SGSN side
formula
Notes excluding Unregistered subs

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 27Total 45
pages
 Secret
Secret

6.4 GPRS average attach time

KPI GPRS average attach time
KPI reference Suggested value To be confirmed
value Risk value To be confirmed
Indicator Customer attach establishment duration *100% / customer
definition number of attach establishment success
Indicatory type Statistics
Counter Attach establishment time refers to the time duration from the
formula receipt of GPRS ATTACH REQUEST by MS to the delivery of
ATTACH ACCEPT by SGSN. If the attach time exceeds the
timer, the attach duration is only computed within the attach
accepted period.
Notes

6.5 PDP context activation success rate

KPI PDP context activation success rate
KPI reference Suggested value 80%
value Risk value 85%
success times of PDP context activation started by MS*100%/ attempt
times of PDP context activation started by MS

Indicator The attempt times of PDP context activation started by MS is the times
definition GGSN received Create PDP Context Request from SGSN.
The success times of PDP context activation started by MS is the statistic
of Create PDP Context Response sent from GGSN to SGSN when Cause
value is Request Accepted.
Indicatory type Test or statistics
Counter Statistics at GGSN side
formula
Notes The performance evaluation in China Mobile in 2003 (success times of
PDP context activation started by GPRS terminal/ attempt times of PDP
context activation started by GPRS) results are as follows:
Excellency index: 94%
Reach-the-mark index: 90%
Lowest Threshold index: 85%

6.6 Routing Area Update Success rate

KPI Routing Area Update Success rate
KPI reference Suggested value 92%
value Risk value 95%
Indicator Routing update attempt times*100%/ routing update success times
definition

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 28Total 45
pages
 Secret
Secret

Indicatory type From statistical value or DT.

Counter
Statistics at SGSN side, provided by GPRS core network
formula
Update success rate at routing area crossing SGSN is lower than that at the SGSN routing
Notes
area.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 29Total 45
pages
 Secret
Secret

7 Comments on KPI Cases

7.1 Pengshui (Chongqing) PS Test Result

1 CQT scenenear cell

2 EDGE Commissioned

5 3 Multi-timeslot capability3+1

4 Number of PDCH static channels: 3

Test FTP size Download Download Average timeslot speed

Test state FTP type
serial Kbyte speed (Kbyte/s) speed (kbps) kbps

Pre-optimization 1 Download 102.381 8.99 71.93 23.98

Pre-optimization 2 Download 48.18 8.10 64.80 21.60
Pre-optimization 3 Download 204.8 2.97 23.78 7.93
Pre-optimization 4 Download 2188.817 7.21 57.72 19.24
Pre-optimization 5 Download 102.381 9.05 72.42 24.14
Pre-optimization 6 Download 102.381 8.66 69.29 23.10
Pre-optimization 7 Download 512.304 15.97 127.73 42.58
Pre-optimization 8 Download 512.304 13.34 106.69 35.56
Pre-optimization 9 Download 512.304 15.81 126.51 42.17
Pre-optimization 10 Download 512.304 15.74 125.88 41.96
Pre-optimization 11 Download 512.304 14.33 114.67 38.22

Ping Ping timelagms

Average Ping
Ping package
timelag success
interval size 1 2 3 4 5 6 7 8 9 10
ms rate
byte
61
0 32 839 634 612 608 589 566 765 561 761 655 100%
2
77
5 32 816 590 581 757 733 716 692 812 609 709 100%
9
75
2 100 571 650 697 753 651 711 729 707 688 691 100%
6
107 82
2 500 839 955 779 737 918 894 875 840 873 100%
5 1
5 500 862 760 857 75 672 811 690 811 709 825 775 100%

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 30Total 45
pages
 Secret
Secret

5
86
2 800 959 910 869 845 823 781 883 860 846 865 100%
9
115 115 90 102 105 108 103
2 1000 880 918 881 1010 100%
7 8 7 8 4 2 7
107 95 101 119 102 101 104
2 1200 840 897 959 1002 100%
8 7 7 1 0 8 2

Comments on case:

1. When C/I is in good condition, the EDGE download speed of current

equipment can reach above 40kbps.

5 2. The Ping success rate and Ping timelag can vary very much due to different
Ping intervals different Ping package sizes and different Ping servers.

7.2 Jishou (Hunan) China Mobile EDGE Test Result

Test Specification

Test equipmentANT Pilot for E-GPRS

10 Test phone SEGAM OT490(one set)

Test laptop: memory 1024Mharddisk 80GCPU 1.60GhzWindows XP-

SP2 standard 28800bps modem rate at 115200bps modem error
control and compression forbidden no software irrelevant to the
test.

15 Test method outdoor static FTP download test Test location 11

th th
sites at Baoqing market in Fenghuang county Test time 19 30 ,
June 2008

Test aim to test E-FPRS network performance under static state

Test aimto download 1000KB document

20 Timeslot 4 static timeslots

Test Result
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 31Total 45
pages
 Secret
Secret

Test Test RLC RLC

Branch document electrical Download average average
Test sites Test location
office size level times rate rate
KB dBm Kbps Kbps
Fenghuang County
prefectural government
Jishou 1000 -44 2 Gate of Prefectural government office 201.19 181.3
office building
Cell 1
Fenghuang County
prefectural government
Jishou 1000 -40 2 Lobby of MingDu Hotel 192.6 198.98
office building
Cell 2
Fenghuang County
prefectural government
Jishou 1000 -51 2 Opposite MingDu Hotel 197.09 206.26
office building
Cell 3
Basketball field
Jishou Old district Cell 1 1000 -49 2 197.74 201.79
of Jiandaoping Primary School
Basketball field
Jishou Old district Cell 2 1000 -32 2 207.29 193.91
of Jiandaoping Primary School
Kindergarten
Jishou Old district Cell 3 1000 -56 2 198.83 196.38
next to Jiandaoping Primary School
Jishou Rainbow Bridge Cell 1 1000 -43 2 Opposite Wanmingta River 185.72 191.1
Jishou Rainbow Bridge Cell 2 1000 -43 2 Opposite Wanmingta River 191.37 181.36
Square in front of
Jishou TianXia Feng Huang Cell 1 1000 -34 2 197.46 186.55
TianXiaFengHuang Hotel
Square in front of
Jishou TianXia Feng Huang Cell 2 1000 -59 2 197.09 206.26
TianXiaFengHuang Hotel
Jishou BaoQing market Cell 1 1000 -38 2 Gate of Linlinlou Drug Store 207.85 198.02
Jishou BaoQing market Cell 2 1000 -36 2 Gate of Linlinlou Drug Store 162.16 185.34
Jishou BaoQing market Cell 3 1000 -46 2 Gate of Linlinlou Drug Store 180.51 180.09
Jishou Xinhua Bookstore Cell 1 1000 -50 2 Lobby of Xinhua Hotel 195.81 191.5
Jishou Xinhua Bookstore Cell 2 1000 -53 2 Lobby of Xinhua Hotel 198.02 188.38
Jishou Xinhua Bookstore Cell 3 1000 -45 2 Parking lot of Xinhua Hotel 183.08 190.16
Comprehensive Building Cell
Jishou 1000 -37 2 Lane, west to ChinaMobile business hall 178.96 157.44
1
Comprehensive Building Cell
Jishou 1000 -45 2 Gate of XingGuang Hotel 185.46 187.98
2
Comprehensive Building Cell
Jishou 1000 -60 2 Gate of XingGuang Hotel 184.07 184.45
2
Comprehensive Building
Jishou 1000 -50 2 Gate of XingGuang Hotel 193.98 184.51
Cell 1800M1
Jishou Comprehensive Building 1000 -62 2 Gate of XingGuang Hotel 176.22 185.21

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 32Total 45
pages
 Secret
Secret

Cell 1800M2
Jishou Telecom Bureau Cell 1 1000 -51 2 Business Hall of Telecom Bureau 180.75 197.88
Jishou Telecom Bureau Cell 2 1000 -64 2 Business Hall of Telecom Bureau 171.85 199.19
Jishou Telecom Bureau Cell 3 1000 -57 2 Backdoor of Supermarket (next to Telecom Bureau) 182.7 179.49
Jishou Telecom Bureau Cell 1800M1 1000 -59 2 Gate of furniture store (next to Telecom Bureau) 105.44 106.48
Jishou Telecom Bureau Cell 1800M2 1000 -73 2 Business Hall of Telecom Bureau 181.85 185.85
Jishou Telecom Bureau Cell 1800M3 1000 -84 2 Business Hall of Telecom Bureau 159.20 166.92

Comments on case:

1. When C/I is in good condition, the average EDGE download speed can reach
above 180kbps with a peak value of above 200kbps;

2. This test is the CQT. Cell reselection and RAC renewal can be neglected, that
5 is they are not necessary to the test conditions.

7.3 Acceptance requirements for EDGE KPI of Data Service of a

network
Serial Indicators Explanation Formula Target
1 GPRS/EGPRS GPRS/EGPRS Attach success GPRS/EGPRS attach success >95%
attach means that the mobile phone rate GPRS Attach success
success rate receives the Attach Accept signaling times/attach attempt times
15 seconds after it sends the Attach 100
Request.
2 Average Attach time means the Average attach time sum of <3s
attach time duration from the mobile attach success duration
sends out Attach Request /attach success times
until it receives GPRS
attach accept signaling.
3 PDP PDP activation success means that PDP activation success >95%
activation the mobile phone receives the ratePDP activation success
success rate Activate PDP context Accept times/attempt times100
signaling 15 seconds after it sends
the Activate PDP Context Request.
4 PDP average PDP average activation time PDP average activation time <3s
activation means the duration from the sum of PDP activation
time delivery of Activate PDP success duration/PDP
Context Request to the activation success times
receipt of Activate PDP
Context Accept by the mobile
phone.
5 WAP website WAP website log-in success WAP website log-in success >95%

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 33Total 45
pages
 Secret
Secret

log-in means that the homepage rate WAP website log-in

success rate fully and correctly displays success times/ website log-
within 60seconds after the in attempt times100
mobile phone started the WAP
website log-in request.
6 average WAP WAP homepage displaying time average WAP homepage <10s
homepage refers to the duration from displaying time sum of
displaying the WAP website log-in successful homepage
time request is sent out until displaying duration / WAP
the homepage fully and homepage displaying success
correctly displays. times
7 WAP webpage WAP webpage refresh success WAP webpage refresh >95%
refresh means that the selected success rate WAP webpage
success rate webpage can be refreshed refresh success times /
within 60seconds. webpage refresh attempt
times100
8 Ping success Ping success rate ping >95%
rate success times/ping attempt
times100
9 Ping average Ping average timelagsum of <2s
timelag each Ping success
duration/ping success times
10 FTP download FTP download speed actual >80kbps
speed download data quantity
Byte /actual download
time(sec)9
11 FTP upload FTP upload speed actual >20kbps
speed upload data quantityByte
/actual upload time(sec) 9

Comments on case:

1. Requirements of operation and maintenance KPI are not as strict as those of

acceptance check KPI.

2. Usually these KPI requirements can be satisfied.

5 7.4 Operation & Maintenance KPI of a Network

SN Indicator Unit Target Level Permissible Remark
Level
1 SDCCH Drop % 1 1.2 Base on system performance report of
Ratio OMCR, Indication Definition: SDCCH
Drop Ratio=SDCCH call drops/ Access

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 34Total 45
pages
 Secret
Secret

attempt Number
2 TCH Drop Ratio % 2 2.2 Base on system performance report of
OMCR, Indication Definition: TCH Drop
Ratio = TCH call drops/ Seized TCHs
(include handover )
3 Call Success % 98 97 Base on system performance report of
Ratio OMCR, Indication Definition: Call
Success Rate = 1 TCH assignment
failure rate
4 SDCCH % 0.5 0.75 Base on system performance report of
Blocking Ratio OMCR, Indication Definition: SDCCH
Blocking Ratio=SDCCH overflows/
SDCCH call attempts
5 TCH % 2 2.5 Base on system performance report of
Blocking Ratio OMCR, Indication Definition: TCH
Blocking Ratio=TCH overflows (include
handover)/ TCH call attempts (include
handover)
6 TCH % 98 97 Base on system performance report of
Assignment OMCR, Indication Definition: TCH
Success Ratio assignment Success Ratio=Number of TCH
assignment successful / Number of TCH
call attempts (include handover)
7 GPRS average Kbps 28 25 24-Hour measurement
DL throughout
per TBF
8 EDGE average Kbps 45 40 24-Hour measurement
DL throughout
per TBF
9 Attach % 99 97 24-Hour measurement
Success Rate
(GPRS/ EDGE)
10 Handover % 94 93
Success Ratio
11 Call Blocking % < 2 for 98% < 2 for 90% Based on OMC-R statistics
Ratio of all GSM of all GSM
cells cells
12 Call Setup % 97 90 Depend on the DT route and method
Success Rate
(Drive Test)
13 Call Drop % 2 3 Depend on the DT route and method
Rate (Drive
Test)
14 Speech MOS >= 3 for >= 3 for Depend on the DT route and method

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 35Total 45
pages
 Secret
Secret

Quality (Drive 95% of 90% of

Test) measurement measurement
samples samples
15 Coverage dBm >= -85 for >= -85 for Depend on the DT route and method
(Drive Test) 95% of 90% of
measurement measurement
samples samples
16 UL Kbps >10 >10 Based on DT
Throughput
17 DL Kbps >30 >30 Based on DT
Throughput
18 BSC/RNC % >99.999 >99.999 per BSC/RNC / week
down time (< 6 sec) (< 6 sec)
(unscheduled)
19 TRX/channel % < 1 of all < 2 of all per BSC/RNC / week
element failure active TRX active TRX
(unscheduled)
20 SDCCH s <2 <3 per BSC/RNC / BH of a week
Mean Holding
Time
21 Radio Access % >99.5 >99 per BSC/RNC / BH of a week
Success Ratio
22 Worst Cells Less than Less than per BSC/RNC / BH of a week
GOS 1.5% cells of 1.5% cells of
Network with Network with
GOS 5% or GOS 5% or
above above
23 RXQUAL 0 to 3 % >97 >95 per BSC/RNC / BH of a week
24 AMR voice % <1 <1 per BSC/RNC / BH of a week
FER

Comments on case:

1. This KPI comprises statistical KPItesting KPI and equipment performance KPI, which
features detailed classification and all-round evaluation;

2. Requirements for KPIs like GPRS average DL throughout per TBF and EDGE average
5 DL throughout per TBF are higher.

3. Requirements for evaluation of CS voice quality are higher.

7.5 Operation & Maintenance KPI of a network in Southeast Asia

No. KPI Measurement
Level 0 Level 1 Level 2 Scope and
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 36Total 45
pages
 Secret
Secret

interval

% of
outdoor
pre-defined
area with per city /
1 Drive test >90% >97% >99%
2G signal monthly
route
level > -
104 dBm
Call Setup
pre-defined
Success per city / BH of
locations and
2 Rate 95% >98% >99% a week (drive
Drive test
(exclude test monthly)
route/NMS
blocking)
per city / BH of
week.
With condition
Paging
that Core
3 Success NMS >90% >95% >97%
Network is
Rate
achived the same
value of Level 1
and Level 2
pre-defined
Call per city / BH of
locations and
4 blocking <0.5% <0.5% <1% a week (drive
Drive test
rate test monthly)
route/NMS
Drop Call
Pre Defined per city / BH of
Rate GSM:
5 Drive Test GSM: <3% GSM: <1% a week (drive
(excluding <2%
Route/NMS test monthly)
inter RAT)
per city / BH of a
week (drive test
monthly),per city
/ BH of week.
Handover Pre Defined
With condition
6 Success Drive Test >90% >97% >97%
that Core
Rate Route or NMS
Network is
achived the same
value of Level 1
and Level 2
Pre Defined Average value
SQI
9 Drive Test >20(95%) > 25(95%) > 25(95%) per city / BH of a
(TEMS)
Route week
Call setup
delay
(PSTN to
Pre Defined per Media
MS, time
10 Drive Test <6s < 6s <6s Gateway/
from
Route monthly
number
dialed to
ring)
Call setup
delay (MS
to PSTN, Pre Defined per Media
11 time from Drive Test <5s < 5s <5s Gateway/
send Route monthly
pressed to
ring)
This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 37Total 45
pages
 Secret
Secret

Call Setup
per BSC/RNC /
12 Successful NMS >95% >98% >99%
BH of a week
Rate
SDCCH
per BSC/RNC /
13 Access NMS >99% >99% >99.5%
BH of a week
Success
per BSC/RNC /
SDCCH Pre Defined
BH of a week
15 Blocking Drive Test <0.5% <0.5% <1%
(drive test
Rate Route/NMS
monthly)
per BSC/RNC /
TCH Pre Defined
BH of a week
16 Blocking Drive Test <0.5% <0.5% <1%
(drive test
Rate Route/NMS
monthly)
per BSC/RNC /
Pre Defined
Drop Call BH of a week
18 Drive Test <5% <2% <1.5%
Rate (drive test
Route/NMS
monthly)
per BSC/RNC /
BH of a week
(drive test
Inter BSS: monthly)
Handover Pre Defined
Inter BSS: >92% : >97% : Inter BSS: >97% : With condition
19 Success Drive Test
Inter Cell: >92% Inter Cell: Inter Cell: >97% that Core
Rate Route/NMS
>97% Network is
achived the same
value of Level 1
and Level 2
per BSC/RNC /
Pre Defined
RXQUAL 0 BH of a week
20 Drive Test >80% >85% >90%
to 3 (drive test
Route/NMS
monthly)
per BSC/RNC /
Pre Defined
AMR voice BH of a week
21 Drive Test <1% <1% < 1%;
FER (drive test
Route/NMS
monthly)
Successful
per city / BH of
23 PS NMS >98% >98% >98%
a week
Attachment
Successful
PDP per city / BH of
24 NMS >98% >98% >98%
context a week
activation
Data
session
Setup
Pre Defined
Success per city / BH of
25 Drive Test >95% >98% >98%
Rate (PDP a week
Route/NMS
context
already
exist)

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 38Total 45
pages
 Secret
Secret

Moving MS GPRS
Pre Defined GPRS (Class 4
FTP (Class 4 per city / BH of
26 Drive test GPRS>30kbps MS):> 30Kbps
download MS): a month
route
1MB file >30Kb

GPRS
Moving MS
Pre Defined (Class 4 GPRS (Class 4
FTP per city / BH of
27 Drive test GPRS>8kbps MS): > MS): > 9Kbps;
upload a month
route 9Kbps;
1MB file

Stationary GPRS
MS near (Class 4
Pre-defined GPRS (Class 4 GPRS (Class 4 MS): per city / BH of a
28 site, FTP MS): > 40
locations MS): > 40 Kbps > 40 Kbps month
download Kbps
1MB file
Stationary
GPRS MS
GPRS
in cell
Pre-defined GPRS (Class 4 (Class 4 GPRS (Class 4 per city / BH of
29 border,
locations MS): > 20 Kbps MS): > 20 MS): > 20 Kbps; a month
FTP
Kbps;
download
1MB file
Stationary
UMTS MS
in cell
border Pre-defined > 150 per city / BH of
30 N/A > 150 Kbps
(SHO), locations Kbps a month
FTP
download
1MB file
PDTCH
per BSC / BH of
31 blocking NMS <0.5% <0.5% <1%;
a week
rate
60 second
data
Pre Defined
transfer per city / BH of
32 Drive Test <3% <2% <1.5%
drop Rate a week
Route
(MS
moving)
Routing
Area
per city / BH of
33 Update NMS > 95% > 95% >97%
week
Successful
rate
MS
Pre Defined
initiated per city / BH of
34 Drive Test <5s <5s <5s
service a week
Route
setup time
MS
roundtrip Pre Defined
per city / BH of
35 Ping time Drive Test <1 <1 <0.8s
a week
(20 ping Route
averaged)
PDP per city / BH of
36 NMS >98% >98% >99%
update a week

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 39Total 45
pages
 Secret
Secret

success
rate

Comments on case:

1. This OM KPI just got some of the indicators, excluding the weighing of all
KPIs and 2/3G interoperate KPI, etc.. Due to market factors, the OM KPI of
this network is set unreasonable, and there is risk in some of the KPIs.

5 2. The evaluation of this KPI falls into three grades. The requirements for
handover success rate and paging success rate are very high, which are difficult
to reach. But the attached prerequisites can lower the risk to some extent.
Besides, the definition of handover success rate varies with different
manufacturers, which we need to make clear with customers in technical
10 clarification.

3. The requirements for data service and voice KPI are higher.

7.6 KPI requirements for Indonesia Telkomsel network

KPI requirements
for Indinesia Telkomsel.xls

Comments on case

15 1. The evaluation scale of KPI is relatively large, mainly dealing with statistical
KPI and testing KPI;

2. It ranges from 2G to 3G network. Its service includes voiceGPRS and 3G

data service, etc..

3. The division of KPI evaluation scenes and most KPI values are relatively
20 reasonable.

This document contains proprietary information of ZTE Corporation and is not to be disclosed or used
except in accordance with applicable agreements. Page 40Total 45
pages