Академический Документы
Профессиональный Документы
Культура Документы
E HUAWEI 1 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
PROVISIONAL ACCEPTANCE
CERTIFICATE (PAC)
LTE FDD MEDAN PROJECT
Area MEDAN
Cluster MDN-04
Abstract
This document is to provide report for XL Axiata on Provisional Acceptance Cluster based for commercial LTE launch.
Alief Risbaya
Approved Checked Date Rev Reference
CONTENTS
1 INTRODUCTION 4
1.1 Introduction 4
1.2 General Cluster Information 4
1.3 Drive Test Methodology Mobility Assessment 6
1.4 Drive Test Methodology Stationary Assessment 6
1.5 FTP Server Information 6
1.6 Drive Test tool and Detail 7
2 MAP INFORMATION 7
2.1 Map Information 7
2.2 Drive test route, cluster border and coverage prediction 7
3 Performance Result 9
3.1 NMS KPI LTE 9
3.1.1 Availability 9
3.1.2 Accessibility 9
3.1.3 Retainability 9
3.1.4 Integrity 9
3.1.5 Mobility 10
3.1.6 Utilization 10
3.1.7 CSFB 10
3.1.8 Traffic 10
3.2 Drive Test KPI 10
3.2.1 Coverage Map Accuracy 10
3.2.2 Capacity 19
3.2.3 Retainability 20
3.2.4 Accessibility 20
3.2.5 CSFB 20
3.2.6 Integrity 22
3.2.7 Mobility 22
3.2.8 Functional 22
3.2.9 PCI Plot 23
3.2.10 RSRQ 24
3.2.11 PS DL Throughput 25
3.2.12 PS UL Throughput 26
3.2.13 Event Failed 26
3.2.14 Low RSRP near site (+ 200m) 27
3.2.15 Sleeping Cell Identification 27
PAC REV.E HUAWEI 3 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
1 INTRODUCTION
1.1 Introduction
Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are
some issues that halt the RFS e.g. due to delayed community case, tower strengthening,
etc, PAC can be conducted when at least 85% of sites are on air within a cluster.
This document presents the result of Cluster Drive test and Network Performance KPI based
on active measurement and OSS data collection for Cluster MDN-04.
The drive-test KPIs are evaluated by drive-test coverage and statistic according to the pre-
defined drive-test route that is mutually agreed by both parties.
The results of the measurements are then compared with the passing criteria agreed upon
by XL and HUAWEI.
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
HUAWEI Dedicated,
1800 /
E392 continues Lock LTE LTE PDCP UL THP
900
(Modem) Upload 1 laptop, separated round
Round
between UL & DL Test to
2
Dedicated, guarantee single user
Automatic WCDMA / 2100 / IRAT HO on edge
Handset 1 continues
(Unlocked) LTE 1800 4G coverage
download
Stationary KPIs will be tested based on the agreed-on methodology with XL team. Cell Edge
Performance for Link Budget Verification will be tested on the spot where the RSRP reaches
between -115dBm to -120dBm at the edge of a cluster.
Huawei
IP: 202.152.254.235
FTP Server information
Username: ftp
Password: ftpuser
PAC REV.E HUAWEI 7 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Huawei E392
Samsung Galaxy S4
DT Mobility Tools GENEX Probe v3.15
MSISDN UE : +6285974901395
MSISDN MODEM : +6287889481280
2 MAP INFORMATION
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
3 Performance Result
3.1 NMS KPI LTE
Cell KPI Aggregate for 7 days, taken at cell busy hour except for Availability.
Availability is measured within 24 hrs in a day. Cell busy hour is defined as the hour
when downlink and uplink payload reach the peak value.
Date (Start - End) 21 Feb 2016 to 27 Feb 2016
3.1.1 Availability
No Name Reference Measured On Cluster Level Status
1 Cell Availability* > 99.995% Cell (Aggregated Cluster Level) 99.936 % Pass
*calculates system availability only for acceptance (exclude manual lock due to software upgrade, etc)
3.1.2 Accessibility
No Name Reference Measured On Cluster Level Status
1 Session Setup Success Rate > 99% Cell (Aggregated Cluster Level) 99.721 % Pass
2 RRC Setup Success Rate > 98% Cell (Aggregated Cluster Level) 99.94 % Pass
3.1.3 Retainability
No Name Reference Measured On Cluster Level Status
1 Session Abnormal Release Rate < 1.4% Cell (Aggregated Cluster Level) 0.23 % Pass
3.1.4 Integrity
No Name Reference Measured On Cluster Level Status
1 UL Packet Loss (PDCP ) < 1e-6% Cell (Aggregated Cluster Level) 5.4E-05 Not Pass
2 DL Packet Loss (PDCP ) < 1e-6% Cell (Aggregated Cluster Level) 7.6E-06 Not Pass
> 15 Mbps (3 MHz)
Downlink User Throughput
3 > 50 Mbps (10 MHz) Cell (Aggregated Cluster Level) 56.06 Mbps Info only*
(Peak)*
> 75 Mbps (15 MHz)
> 4 Mbps (3 MHz)
Uplink User Throughput
4 > 15 Mbps (10 MHz) Cell (Aggregated Cluster Level) 24.44 Mbps Info only*
(Peak)*
> 25 Mbps (15 MHz)
> 5.1 Mbps (3 MHz)
Downlink User Throughput
5 > 17 Mbps (10 MHz) Cell (Aggregated Cluster Level) 10.79 Mbps Info only*
(Average)*
> 25.5 Mbps (15 MHz)
> 3 Mbps (3 MHz)
Uplink User Throughput
6 > 10 Mbps (10 MHz) Cell (Aggregated Cluster Level) 5.03 Mbps Info only*
(Average)*
> 15 Mbps (15 MHz)
Counter DL
Uu Latency
will be
No NMS counter available in
7 DL Uu Latency < 8 ms Cell (Aggregated Cluster Level)
available eRAN 8.0 in
Q1 2016,
Free of
Charge.
* Depend on user behavior
PAC REV.E HUAWEI 10 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
3.1.5 Mobility
No Name Reference Measured On Cluster Level Status
Cell (Aggregated
1 Handover Success Rate Intra-Frequency > 98% 99.77 % Pass
Cluster Level)
Only one frequency
Cell (Aggregated
2 Handover Success Rate Inter-Frequency > 98% N/A configuration on this
Cluster Level)
cluster
Handover Success Rate Inter-RAT (IRAT- Cell (Aggregated
3 > 95% 96.00 % Pass
HO, not RwR) Cluster Level)
3.1.6 Utilization
No Name Reference Measured On Cluster Level Status
1 Maximum eNodeB CPU Utilization < 70% eNodeB (Aggregated Cluster Level) 20 % Pass
3.1.7 CSFB
No Name Reference Measured On Cluster Level Status
Cell (Aggregated No NMS counter
1 Voice - Outgoing Call Setup Time 5s N/A
Cluster Level) available
Voice - Outgoing Call Setup Success Cell (Aggregated
2 > 97% 99.96 % Pass
Rate Cluster Level)
Cell (Aggregated No NMS counter
3 Voice - Incoming Call Setup Time 3.5 s N/A
Cluster Level) available
Voice - Incoming Call Setup Success Cell (Aggregated
4 > 97% 99.96 % Pass
Rate Cluster Level)
Cell (Aggregated No NMS counter
5 Voice - Time to Return to LTE 5s
Cluster Level) available N/A
Cell (Aggregated No NMS counter
6 Voice - Return to LTE Success Rate > 97%
Cluster Level) available N/A
3.1.8 Traffic
Name Ref Cluster Level in a week
UL Volume (Gigabyte) Information only 97.775 Gb
DL Volume (Gigabyte) Information only 1012.126 Gb
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
N/A
Alief Risbaya
Approved Checked Date Rev Reference
3.2.1.3 RSRP
Min Value (dBm) RSRP Criteria (dBm) Max Value (dBm) Percentage (%) Legend
-85 DL RSRP (dBm)>=-85 Infinity 56.77%
-90 -90<=DL RSRP (dBm)<-85 -85 21.54%
-100 -100<=DL RSRP (dBm)<-90 -90 20.15%
-110 -110<=DL RSRP (dBm)<-100 -100 1.54%
-115 -115<=DL RSRP (dBm)<-110 -110 0.00%
-Infinity DL RSRP (dBm)<-115 -115 0.00%
CDF Plot :
PAC REV.E HUAWEI 14 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
3.2.1.4 SINR
Min Value (dB) SINR Criteria (dB) Max Value (dB) Percentage (%) Legend
20 SINR (dB)>=20 Infinity 20.42%
10 10<=SINR (dB)<20 20 53.32%
5 5<=SINR (dB)<10 10 19.32%
0 0<=SINR (dB)<5 5 6.09%
-5 -5<=SINR (dB)<0 0 0.85%
-Infinity SINR (dB)<-5 -5 0.00%
SINR > 0 99.15% Pass
CDF Plot :
PAC REV.E HUAWEI 15 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Cell LTE
No RSRP longitude latitude PCI throughout Target Status
1 -116dBm 98.710258 3.568390 339 4160 kbit/s > 1000 Kbit/s Pass
2 -120dBm 98.718207 3.580703 303 9480 kbit/s > 1000 Kbit/s Pass
3 -117dBm 98.693911 3.568667 262 3210 kbit/s > 1000 Kbit/s Pass
4 -118dBm 98.686799 3.568909 241 5050 kbit/s > 1000 Kbit/s Pass
5 -115dBm 98.690000 3.571000 214 3100 kbit/s > 1000 Kbit/s Pass
6 -117dBm 98.694000 3.572000 223 3480 kbit/s > 1000 Kbit/s Pass
Note : RSRP Level Cell Edge is between -115dBm ~ -120dBm, taken using FTP application.
OOKLA and OpenSignal Cell Edge verification:
PAC REV.E HUAWEI 16 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
3.2.2 Capacity
Average
No Name Reference Measured On value of 90% Status
sample
1 DL > 75 Mbps (15 MHz) Cell
Single User Downlink / Uplink
UL > 9 Mbps (15 MHz)
TCP Throughput*
DL > 50 Mbps (10 MHz) 40.672 Mbps /
Excellent Criteria: Not Pass
UL > 6 Mbps (10 MHz) 20.17 Mbps
RSRP -80 dBm,
DL > 15 Mbps (3 MHz)
SINR 28 dB
UL > 1.8 Mbps (3 MHz)
2 DL > 30 Mbps (15 MHz) Cell
Single User Downlink / Uplink
UL > 4.5 Mbps (15 MHz)
TCP Throughput*
DL > 20 Mbps (10 MHz) 26.31Mbps /
Good Criteria: Pass
UL > 3 Mbps (10 MHz) 19.22 Mbps
-80 dBm > RSRP -90 dBm,
DL > 6 Mbps (3 MHz)
28 dB > SINR 18 dB
UL > 0.9 Mbps (3 MHz)
3 DL > 15 Mbps (15 MHz) Cell
Single User Downlink / Uplink
UL > 1.5 Mbps (15 MHz)
TCP Throughput*
DL > 10 Mbps (10 MHz) 13.99 Mbps /
Medium Criteria: Pass
UL > 1 Mbps (10 MHz) 15.93 Mbps
-90 dBm > RSRP -100 dBm,
DL > 3 Mbps (3 MHz)
18 dB > SINR 8 dB
UL > 0.3 Mbps (3 MHz)
4 DL > 3 Mbps (15 MHz) Cell
Single User Downlink / Uplink
UL > 0.75 Mbps (15 MHz)
TCP Throughput*
DL > 2 Mbps (10 MHz) 6.97 Mbps /
Minimum Criteria:
UL > 0.5 Mbps (10 MHz) 7.60 Mbps Pass
-100 dBm > RSRP -110 dBm,
DL > 0.6 Mbps (3 MHz)
8 dB > SINR 0dB
UL > 0.15 Mbps (3 MHz)
5 Downlink TCP / UDP Cell Peak Total > 105.4 Mbps (15 MHz) Cell
Capacity with 2 Ues Total > 70.3 Mbps (10 MHz) 75.41 Mbps Pass
(SUM) Total > 21.2 Mbps (3 MHz)
Alief Risbaya
Approved Checked Date Rev Reference
3.2.3 Retainability
No Name Reference Measured On Value Status Remark
Session Abnormal Release Averaging from SSA
1 < 1.4% Cell / Cluster 0.0% Pass
Rate DT Result
3.2.4 Accessibility
Referenc Statu
No Name Measured On Value Remark
e s
Averaging from SSA DT
1 Session Setup Success Rate > 99% Cell / Cluster 100% Pass
Result
Averaging from SSA DT
2 RRC Setup Success Rate > 98% Cell / Cluster 100% Pass
Result
3.2.5 CSFB
No Name Reference Measured On Value Status Remark
Voice - Outgoing Call Setup
2.65 s Pass
1 Time 5s Cell / Cluster
Voice - Outgoing Call Setup
100% Pass
2 Success Rate > 97% Cell / Cluster
Voice - Incoming Call Setup
2.40 s Pass The value is derived
3 Time 3.5 s Cell / Cluster
by averaging SSA
Voice - Incoming Call Setup
100% Pass stationary test result
4 Success Rate > 97% Cell / Cluster
Voice - Time to Return to
2.1 s Pass
5 LTE 5s Cell / Cluster
Voice - Return to LTE
100% Pass
6 Success Rate > 97% Cell / Cluster
PAC REV.E HUAWEI 21 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
(b) voice-Incoming Call Setup Time is measured as follow (KPI target remains same 3.5s)
PAC REV.E HUAWEI 22 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
3.2.6 Integrity
No Name Reference Measured Value Status
On
1 RTT Packet Delay (ping) 73.19ms/
<= 20 ms / 30 ms Cell Not Pass
32/1000* 83.17ms
2 UL Packet Loss (PDCP )* < 1e-6 Cell 0 Pass
3 DL Packet Loss (PDCP )* < 1e-6 Cell 0 Pass
4 > 15 Mbps (3 MHz)
Downlink Peak User
> 50 Mbps (10 MHz) Cell 40.66 Mbps Not Pass
Throughput**
> 75 Mbps (15 MHz)
5 > 4 Mbps (3 MHz)
Uplink Peak User
> 15 Mbps (10 MHz) Cell 28.50 Mbps Pass
Throughput**
> 25 Mbps (15 MHz)
6 > 5.1 Mbps (3 MHz)
Downlink Average User > 17 Mbps (10 MHz) Cell /
9.02 Mbps Not Pass
Throughput** > 25.5 Mbps (15 Cluster
MHz)
7 > 3 Mbps (3 MHz)
Uplink Average User Cell /
> 10 Mbps (10 MHz) 21.20 Mbps Pass
Throughput** Cluster
> 15 Mbps (15 MHz)
8 Jitter (Uplink and
< 50 ms Cell 3.76 ms Pass
Downlink)*
*Stationary test. For PAC is derived from SSA average result (after rectification)
**Using drive test method
3.2.7 Mobility
Measured
No Name Ref Value Status Remark
On
Handover Success Rate
1 > 98% Cell / Cluster 100% Pass
Intra-Frequency
Handover Success Rate Only one frequency
2 > 98% Cell / Cluster N/A N/A
Inter-Frequency configuration in this cluster
Handover Success Rate
3 > 95% Cell / Cluster N/A N/A Not Happened in DT
Inter-RAT
3.2.8 Functional
No Name Method Measured Status
On
1 Downlink QoS Test One UE in excellent, one UE in medium, Cluster OK
and one UE in bad positions, all with same
priority. One additional UE with higher
priority is inserted, under different
conditions
2 Downlink GBR / NGBR One UE in excellent, one UE in medium and Cluster N/A. No
Test one UE in bad positions, all with same GBR/NGBR
priority and GBR. One additional UE with product is
higher priority but NGBR is inserted, under available
different conditions.
PAC REV.E HUAWEI 23 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
PCI plot is provided for information only. Cross-feeder has been checked during SSA
PAC REV.E HUAWEI 24 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
3.2.10 RSRQ
Min Value (dB) RSRQ Criteria (dB) Max Value (dB) Percentage (%) Legend
-6 RSRQ (dB)>=-6 Infinity 1.57%
-9 -9<=RSRQ (dB)<-6 -6 68.62%
-11 -11<=RSRQ (dB)<-9 -9 29.38%
-14 -14<=RSRQ (dB)<-11 -11 0.44%
-Infinity RSRQ (dB)<-14 -14 0.00%
PAC REV.E HUAWEI 25 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
3.2.11 PS DL Throughput
Percentage
Min Value (Mbps) DL Throughput (Mbps) Max Value (Mbps) (%) Legend
30 DL Throughput (Mbps)>=30 Infinity 13.81%
20 20<=DL Throughput (Mbps)<30 30 30.91%
10 10<=DL Throughput (Mbps)<20 20 41.39%
5 5<=DL Throughput (Mbps)<10 10 12.34%
0 0<DL Throughput (Mbps)<5 5 1.55%
Alief Risbaya
Approved Checked Date Rev Reference
3.2.12 PS UL Throughput
Min Value (Mbps) UL Throughput (Mbps) Max Value (Mbps) Percentage (%) Legend
15 UL Throughput (Mbps)>=15 Infinity 67.36%
10 10<=UL Throughput (Mbps)<15 15 20.10%
5 5<=UL Throughput (Mbps)<10 10 11.36%
2 2<=UL Throughput (Mbps)<5 5 0.83%
0 0<UL Throughput (Mbps)<2 2 0.34%
EVENT FAIL
MDN_04.csv
Alief Risbaya
Approved Checked Date Rev Reference
TRAFIC CLUSTER
MDN_04.xlsx
Alief Risbaya
Approved Checked Date Rev Reference
SUMMARY :
RSRP Plot >= -110 dBm Result
Target Result
BEFORE AFTER
100.00% 100.00% In 95% of cluster, the RSRP must be >= -110 dBm Pass
PAC REV.E HUAWEI 29 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
SUMMARY :
RSRP Plot >= -115 dBm Result
Target Result
BEFORE AFTER
97.81% 99.15% In 90% of cluster, the SINR must be >= 0 Pass
SUMMARY :
PDCP DL must be >= 5 Mbps Result
Target Result
BEFORE AFTER
65.01% 98.45% The PDCP DL must be >= 5 Mbps Pass
PAC REV.E HUAWEI 30 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
-Poor RSRP
Low SINR and low coverage from site
2 -Poor SINR -MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 1 Downtilt ET form 3 to 5 Done
MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 1
-Poor DL
Throughput
- Low RSRP, SINR due to Overshooting from site
422C199E_LTE_SUN_YAT_SEN sector 1 with distance
1.235 km ,
- Low RSRP, SINR due to Overshooting from site
-422C199E_LTE_SUN_YAT_SEN sector 1 Downtilt ET 0 to 4
MC422C297E_LTE_MC_ASIA_MEGAMAS sector 2 with
-Poor RSRP -MC422C297E_LTE_MC_ASIA_MEGAMAS sector 2 Downtilt ET 0 to 2
3 distance 0.915 km Done
-Poor SINR -4223714E_LTE_SUTRISNO_BARAT sector 1 Downtilt ET 0 to 6
- Low RSRP, SINR due to Overshooting from site
-Poor PDCP DL -4223053E_LTE_PURI_MEDAN sector 1 Downtilt ET form 0 to 4
4223714E_LTE_SUTRISNO_BARAT sector 1 with distance
0.697 km ,
- Low SINR and low coverage from site
4223053E_LTE_PURI_MEDAN sector 1.
-Poor RSRP
Low SINR and low coverage from site
4 -Poor SINR -MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 2 Downtilt ET form 3 to 5 Done
MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 2
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
5 -Poor SINR -4223714E_LTE_SUTRISNO_BARAT sector 3 Downtilt ET form 0 to 6 Done
4223714E_LTE_SUTRISNO_BARAT sector 3
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
6 -Poor SINR -M4222541E_LTE_KOTA_MATSUM_MEDAN sector 3 Downtilt ET form 5 to 7 Done
4222541E_LTE_KOTA_MATSUM_MEDAN sector 3
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
7 -Poor SINR -422C199E_LTE_SUN_YAT_SEN sector 3 Downtilt ET form 0 to 8 Done
422C199E_LTE_SUN_YAT_SEN sector 3
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
10 -Poor SINR -4222580E_LTE_SIMPANG_WASPADA sector 3 Downtilt ET form 3 to 4 Done
4222580E_LTE_SIMPANG_WASPADA sector 3
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
11 -Poor SINR -4223071E_LTE_KEMALA_MEDAN sector 3 Downtilt ET form 2 to 6 Done
4223071E_LTE_KEMALA_MEDAN sector 3
-Poor DL
Throughput
-Poor RSRP
Low SINR and low coverage from site
12 -Poor SINR -M4222541E_LTE_KOTA_MATSUM_MEDAN sector 3 Downtilt ET form 5 to 7 Done
4222541E_LTE_KOTA_MATSUM_MEDAN sector 3
-Poor DL
Throughput
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Cell Availability degraded 25February due to alarm Session Setup SR is maintained above reference
Cell Unavailable fault at site value 99%; Degrade due to Availability degraded
MC2222582_SimpangAsiaPandu (inline)
RRC Setup Success Rate is maintained Session Abnormal Release Rate is maintained
above reference value 98% below reference value 1.4%
PAC REV.E HUAWEI 33 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Handover Success Rate Inter-RAT is eNodeB processor load maximum is lower than
maintained above reference value 95%; 70%.
Degraded since 26 February due to Double
Configuration of EARFCN
PAC REV.E HUAWEI 34 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
5 KPI 2G & 3G
Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be
reviewed during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review
the NMS KPI, plus MRR data of 3G in PAC report.
The target for NMS KPI is maintained of improved, comparing the best week (within 3
weeks) after Frequency Carving/TRX Shutdown versus the week when PAC is collected.
2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless
they have collocated LTE installed or not. All KPI, except availability are calculated during
busy hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr
daily.
Alief Risbaya
Approved Checked Date Rev Reference
5.2 NMS 2G
Baseline Current
Week Week
KPI (W-38) (W-49) Comments* Result**
Assignment Success Rate Maintained Pass
Perceive Drop Rate Maintained Pass
Perceive Congestion Rate Maintained Pass
SDCCH Drop Rate Maintained Pass
SDCCH Congestion Rate Maintained Pass
SDCCH Success Rate Maintained Pass
TBF Failure Rate Improved Pass
Cell Availability Maintained Pass
HO Success Rate Maintained Pass
* Fill comments with : Degraded or Maintained or Improved according to current week compared with
baseline
** Fill result with Pass if the KPI is maintained or improved, and Not Pass if it gets degraded
PAC REV.E HUAWEI 36 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
5.3 NMS 3G
5.4 MRR 3G
During LTE Optimization process, some physical tuning might be executed to enhance LTE
quality. While in some sites, the antenna is shared between 3G and LTE. Therefore, LTE
vendor must provide the MRR before and after physical tuning is executed. The CPICH
RSCP must be maintained, or if due to less sample, the deviation of 2% is accepted.
Alief Risbaya
Approved Checked Date Rev Reference
Vendor must retest again the Non Pass items using below method:
a) Use USIM class 11 with HotRod Prioritas profile (MBRD 150 Mbps, MBRU 75 Mbps)
b) Make sure all cells within eNB are unlocked in cell barred, therefore only 1 UE attach
c) Use SSA Rev.G for validation (Speed is stable 50 Mbps + 10% within 30 sec)
d) Get the acknowledgement from PTHS Optim Region that issues have already been
solved and result is above threshold
If the result is still below target, vendor has to perform necessary cluster tuning,
troubleshooting and optimization. If still could not meet the target due to external issues (e.g.
Transmission backhaul capacity limitation, etc) the justification must be provided.
LTE_SUTRISNO_BARAT
Before rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
Alief Risbaya
Approved Checked Date Rev Reference
LTE_ISTANA_MAIMUN_MEDAN
Before rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
LTE_PURI_MEDAN
Before Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 12.10 Mbps 9.90 Mbps 4.70 Mbps 10%, within 20 sec
After Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 59.8 Mbps 59.8 Mbps 34 Mbps 10%, within 20 sec
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3053
PAC REV.E HUAWEI 39 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_KOTA_MATSUM_MEDAN
Before rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 15.70 Mbps 12.00 Mbps 10.80 Mbps 10%, within 20 sec
After rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Pass
Throughput (Max) 57.1 Mbps 60.2 Mbps 57.2 Mbps 10%, within 20 sec
LTE_KEMALA_MEDAN
Before rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 3.7 Mbps 3.90 Mbps 5.40 Mbps 10%, within 20 sec
After rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Pass
Throughput (Max) 57.2 Mbps 52.9 Mbps 55.8 Mbps 10%, within 20 sec
Alief Risbaya
Approved Checked Date Rev Reference
LTE_GAJAH_GEDE_MEDAN
Before Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 5.50 Mbps 19.50 Mbps 5.10 Mbps 10%, within 20 sec
After Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus
Not Pass
Throughput (Max) 54.8 Mbps 43.2 Mbps 45.8 Mbps minus 10%, within 20 sec
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3001<>MC3223794G
LTE_AUR_MEDAN
Before rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
50 Mbps stable, plus
DL Single User
6.2 Mbps 1.7 Mbps 2 Mbps minus 10%, within 20 Not Pass
Throughput (Max)
sec
15 Mbps stable, plus
UL Single User
24.8 Mbps 24.1 Mbps 24.2 Mbps minus 10%, within 20 Pass
Throughput (Max)
sec
UDP Can 50 Mbps (with
UDP (Mbps) 62.242 Mbps 60.761 Mbps 55.833 Mbps Pass
10% tolerance)
After rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus
Not Pass
Throughput (Max) 42.4 Mbps 37.5 Mbps 67.4 Mbps minus 10%, within 20 sec
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3070
PAC REV.E HUAWEI 41 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_SIMPANG_ASIA_PANDU_(RELOC)
Before rectification
Functionality
Stationary Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
DL Single User 50 Mbps stable, plus minus
29.2 Mbps 40.66 Mbps 26.83 Mbps Not Pass
Throughput (Max) 10%, within 20 sec
UL Single User 15 Mbps stable, plus minus
20.33 Mbps 23 Mbps 20.33 Mbps Pass
Throughput (Max) 10%, within 20 sec
UDP Can 50 Mbps (with
UDP (Mbps) 69.92 Mbps 68.264 Mbps 53.909 Mbps Pass
10% tolerance)
After rectification
Functionality
Stationary Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
DL Single User 50 Mbps stable, plus minus
Not Pass
Throughput (Max) 43.5 Mbps 28.6 Mbps 41 Mbps 10%, within 20 sec
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3001<>MC2222582
LTE_PASAR_MERAH_TIMUR
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3070<>222C227
PAC REV.E HUAWEI 42 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_BROMO_MEDAN
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3002<>2223121
LTE_HOTEL_GRAND_SIRAO
Before Rectification
Functionality
Stationary Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
Alief Risbaya
Approved Checked Date Rev Reference
LTE_SUN_YAT_SEN
Before Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus
9.1 Mbps 7.4 Mbps 12.7 Mbps Not Pass
Throughput (Max) minus 10%, within 20 sec
UL Single User 15 Mbps stable, plus
22.9 Mbps 22.7 Mbps 24.3 Mbps Pass
Throughput (Max) minus 10%, within 20 sec
UDP Can 50 Mbps (with
UDP (Mbps) 59.503 Mbps 58.376 Mbps 63.54 Mbps Pass
10% tolerance)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3001<>MC2222582<>C199
LTE_MULTATULI_MEDAN
Before Rectification
Functionality
Stationary Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
DL Single User 50 Mbps stable, plus
0.4 Mbps 3.3 Mbps 2.8 Mbps Not Pass
Throughput (Max) minus 10%, within 20 sec
UL Single User 15 Mbps stable, plus
0.7 Mbps 3.1 Mbps 1.7 Mbps Not Pass
Throughput (Max) minus 10%, within 20 sec
UDP Can 50 Mbps (with
UDP (Mbps) 71.235 Mbps 70.566 Mbps 68.908 Mbps Pass
10% tolerance)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3070<>MC3223772G
PAC REV.E HUAWEI 44 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_MC_SIMPANG_GARUDA
Before Rectification
Functionality
Stationary Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
LTE_MC_SUTRISNO_MEDAN
Before Rectification
Functionality
Stationary Test (10 Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
times)
DL Single User 50 Mbps stable, plus
6.9 Mbps 2.2 Mbps 3.1 Mbps Not Pass
Throughput (Max) minus 10%, within 20 sec
UL Single User 15 Mbps stable, plus
22.7 Mbps 24.1 Mbps 23.8 Mbps Pass
Throughput (Max) minus 10%, within 20 sec
UDP Can 50 Mbps (with
UDP (Mbps) 70.149 Mbps 70.75 Mbps 69.982 Mbps Pass
10% tolerance)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
Alief Risbaya
Approved Checked Date Rev Reference
LTE_PERAK_MEDAN
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
LTE_RS_METHODIST_MEDAN
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3002<>3072<>3223717G
PAC REV.E HUAWEI 46 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_SIMPANG_WASPADA
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3070<>2252580
LTE_SEI_RENGAS
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
PAC REV.E HUAWEI 47 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
LTE_MEGA_MAS
Before Rectification
Functionality Stationary
Sec 1 Sec 2 Sec 3 Ref Pass / Not Pass
Test (10 times)
After Rectification
Functionality Stationary Pass / Not
Sec 1 Sec 2 Sec 3 Ref
Test (10 times) Pass
After retest FTP Throughput still cant meet target but UDP test can achive the target (>50Mbps stable 30s),
need to check each link Transport performance between 3049<>C198
PAC REV.E HUAWEI 48 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
Pass, accepted
Not pass (rejected), need
further optimization
*Tick one appropriate result
PAC REV.E HUAWEI 54 (55)
Prepared No.
Alief Risbaya
Approved Checked Date Rev Reference
Alief Risbaya
Approved Checked Date Rev Reference
10 Revision History
Rev Date Item Updated Author
4.2 Cluster DT : Adding PCI Plot (required for MOCN)
1.3 Drive Test Methodology: Remove round 3 data collection
(CSFB result is taken from SSA for PAC). For FAC CSFB will be
taken from round 3. SINR would be on DL Dedicated Mode
3.2 Drive Test KPI on Capacity : explain clear range of different
radio condition
3.2 Drive Test KPI - Retainability, Accessibility, RRC Setup
Success Rate values are derived by averaging SSA result
3.2 Drive Test KPI CSFB Voice Incoming Call Set Up Time :
explaining start and end time measurement message flow
13 Dec Alief Risbaya
E 3.2 Downlink QoS Test : updating the test sample by comparing
2015 Sirait
2 product with higher QoS and lower QoS
Adding 2G & 3G aspect to be reviewed in Chapter 5 (NMS 2G,
NMS 3G and MRR 3G)
Coverage Map Accuracy : histogram plot, RSRP >= dBm in 95%
cluster area, SINR > 0 in 90% cluster area
Low RSRP, SINR, DL Throughput, UL Throughput near site
External interference and overshooting analysis
Summary of Tuning activities
Scoring update