Академический Документы
Профессиональный Документы
Культура Документы
City Surabaya
${Level2}
TABLE OF CONTENTS
1 INTRODUCTION 5
1.1 Introduction 5
1.2 General Site Information 5
1.2.1 New Site Database 5
1.2.2 Neighbors First Tier 6
1.2.3 Punch List Database 6
1.3 Drive Test Methodology “Stationary Assessment” 7
1.4 FTP Server Information 8
1.5 Drive Test tool and Detail 8
2 MAP INFORMATION 8
2.1 Map Information 8
2.1.1 Drive test route, cluster border and coverage prediction 9
3 Performance Result 11
3.1 NMS KPI LTE 11
3.1.1 Availability 11
3.1.2 Accessibility 11
3.1.3 Retainability 11
3.1.4 Integrity 11
3.1.5 TX_RANK (Info Only) 12
3.1.6 Mobility 12
3.1.7 Utilization 12
3.1.8 CSFB 12
3.1.9 Traffic and Capacity 13
3.2 Drive Test KPI 15
3.2.1 Retainability 15
3.2.2 Accessibility 15
3.2.3 CSFB 15
3.2.4 Integrity 15
3.2.5 Mobility 16
3.2.6 RSRP IDLE Drive Test 16
3.2.7 SINR-DL Dedicated Drive Test 18
3.2.8 PCI Plot 19
3.2.9 CQI 20
LTE NEW SITE PAC DOCUMENT 3 (47)
3.2.10 RSRQ 20
3.2.11 PS DL Throughput 22
3.2.12 PS UL Throughput 23
3.2.13 Transmission Modes Plot 24
3.2.14 Channel Bandwidth Plot 25
3.2.15 Event Failed 25
3.2.16 Sleeping Cell Identification 26
3.2.17 External Interference Identification 26
3.2.18 Cell Overshooting 27
3.2.19 Bad Spot analysis and Improvement 28
Physical Tuning Summary 32
3.2.1 Parameter Tuning Summary 32
4 NMS KPI RAN LTE TREND 32
5 KPI 2G & 3G 35
5.1 List of 2G, 3G & LTE sites inside LTE Polygon 35
5.2 NMS 2G 36
5.3 NMS 3G 36
5.4 MRR 3G 36
5.4.1 MRR RSCP 36
6 FEATURE 38
7 Issues, Recommendation and Exclusion 42
7.1.1 Ping Latency 32bit 42
7.1.2 Ping latency 1000bit 43
7.2 KPI 2G & 3G 44
7.3 Justification 44
8 Conclusions 47
LTE NEW SITE PAC DOCUMENT 4 (47)
Table of Figure
Figure 1: Cluster Map Information ......................................................................................................................... 8
1 INTRODUCTION
1.1 Introduction
Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are
some issues that halt the RFS e.g. due to delayed community case, tower strengthening,
etc, PAC can be conducted when at least 85% of sites are on air within a cluster. In the case
of mushroom site where there is only 1 new site only with existing neighbor sites SSO is
conducted for PAC.
This document presents the result of Cluster Drive test and Network Performance KPI based
on active measurement and OSS data collection for EJ_TBN_4G_SHB2_NAE_310
The drive-test KPIs are evaluated by drive-test coverage and statistic according to the pre-
defined drive-test route that is mutually agreed by both parties.
The results of the measurements are then compared with the passing criteria agreed upon
by XL and HUAWEI.
Cluster is barred / reserved to ensure only single user camp in the cluster using USIM class 11
HotRod Prioritas profile to be used
LTE NEW SITE PAC DOCUMENT 7 (47)
LTE Mobile
KPI Measured Remark
No. UE Method RAT BAND
Stationary KPI’s will be tested based on the agreed-on methodology with XL team. Cell Edge
Performance for Link Budget Verification will be tested on the spot where the RSRP reaches between
-115dBm to -120dBm at the edge of a cluster.
LTE Mobile
KPI Measured Remark
No. UE Method RAT BAND
LTE NEW SITE PAC DOCUMENT 8 (47)
IP Address
FTP Server information
IP:103.52.146.236
Samsung Galaxy S5
DT Tools
GENEX Probe v3.16
Date of DT 07 Desember 2018
DT Team Rusli
2 MAP INFORMATION
2.1 Map Information
Site List, Polygon Border, DT Route and Coverage Must be matched with
Match Pass
Prediction match with agred design agreed design
LTE NEW SITE PAC DOCUMENT 10 (47)
Residensial
EJ_TBN_4G_SHB2_IMP_066.xlsx
SubUrban_Open_Area(%)
Road_Open_Area(%)
Coverage Area(km2)
RSRP Criteria (dBm)
% of Coverage Area
Max Vaule (dBm)
Inland_Water(%)
Min Value (dBm)
Green_Land(%)
Percentage (%)
Village(%)
Forest(%)
Scrub(%)
Legend
-85 DL RSRP (dBm)>=-85 Infinity 1.0 2.6 2.6 0.0 9.7 13.3 3.3 4.4 18.5
-90 =-90<=DL RSRP (dBm)<-85 -85 0.8 2.2 0.6 0.0 6.0 11.1 5.4 4.8 10.8
-100 -100<=DL RSRP (dBm)<-90 -90 3.4 9.2 0.4 0.0 3.0 14.2 3.2 1.5 4.4
-105 -105<=DL RSRP (dBm)<-100 -100 3.5 9.4 0.6 0.0 1.9 23.9 1.3 0.0 4.2
-115 -115<=DL RSRP (dBm)<-105 -105 13.9 37.5 0.2 0.0 5.1 35.9 1.4 0.8 8.5
Infinity DL RSRP (dBm)<-115 -115 14.5 39.1 0.0 0.0 4.2 44.1 0.9 0.2 8.2
TOTAL 37.2 100.0 4.3 0.0 30.0 142.6 15.5 11.7 54.6
3 Performance Result
Cell KPI Aggregate for 7 days, taken at cell busy hour except for Availability.
Availability is measured within 24 hrs in a day. Cell busy hour is defined as the hour
when downlink and uplink payload reach the peak value.
Measurement period:
3.1.1 Availability
3.1.2 Accessibility
3.1.3 Retainability
3.1.4 Integrity
TXRank2.xlsx
3.1.6 Mobility
3.1.7 Utilization
3.1.8 CSFB
3.1.9.1 Payload
Name PAC Result*
UL Volume (Gigabyte) 2.32 GB
DL Volume (Gigabyte) 40.85 GB
Trend daily Payload (GB)
*Calculation:
Busy hour is defined as the hour in which sum DL & UL payload reach the highest value
Daily : on busy hour, UL/DL PRB utilization is averaged for each cell on each site
LTE NEW SITE PAC DOCUMENT 14 (47)
*Calculation:
Busy hour is defined as the hour in which sum DL & UL payload reach the highest value
Provided for information only
*Calculation:
Busy hour is defined as the hour in which sum DL & UL payload reach the highest value
Daily : on busy hour, IRAT HO Attempt is summed for each cell toward its relation
Weekly : summing daily value
Provided for information only
3.2.1 Retainability
PAC
No Name Target Status Remark
Result
Session Abnormal In PAC, value is measured on mobility or
1 < 1.4% 0.00% Pass
Release Rate stationary on each PCI
3.2.2 Accessibility
No Name Target PAC Result Status Remark
1 Session Setup Success Rate > 99% 100% Pass In PAC, value is measured on
mobility or stationary on
2 RRC Setup Success Rate > 98% 100% Pass each PCI
3.2.3 CSFB
No Name Target PAC Result Status Remark
3.2.4 Integrity
No Name Target PAC Result Status
RTT Packet Delay (ping) 32/1000 45.00ms/ Pass with
1 <= 20 ms / 30 ms
bytes 60.40ms Justification
2 UL Packet Loss (PDCP ) < 1e-3 0 Pass
3 DL Packet Loss (PDCP ) < 1e-3 0 Pass
> 15 Mbps (3 MHz)
4 Downlink Peak User Throughput* > 50 Mbps (10 MHz) 94.65 Mbps Info only*
> 75 Mbps (15 MHz)
> 4.5 Mbps (3 MHz)
5 Uplink Peak User Throughput* > 15 Mbps (10 MHz) 64.97 Mbps Info only*
> 25 Mbps (15 MHz)
> 4 Mbps (3 MHz)
6 Downlink Average User Throughput 14.15 Mbps Pass
> 15 Mbps (10 MHz)
LTE NEW SITE PAC DOCUMENT 16 (47)
3.2.5 Mobility
No Name Ref PAC Result Status Remark
Handover Success Rate Intra-
1 > 98% 100% Pass 100%
Frequency
Handover Success Rate Inter- Applicable if L900/L2300 are
2 > 98% N/A N/A
Frequency deployed
Handover Success Rate Inter-
3 > 95% 100% Pass 100%
RAT (PSHO, not RwR)
Min Value (dBm) RSRP Criteria (dBm) Max Value (dBm) Percentage (%) Legend
-85 DL RSRP (dBm)>=-85 Infinity 13.86%
-90 -90<=DL RSRP (dBm)<-85 -85 11.28%
-100 -100<=DL RSRP (dBm)<-90 -90 38.40%
-105 -105<=DL RSRP (dBm)<-100 -100 14.94%
-115 -115<=DL RSRP (dBm)<-105 -110 16.27%
-Infinity DL RSRP (dBm)<-115 -115 5.25%
Not
RSRP ≥ -105 78.48%
Pass
PAC Result
Target Status
(RSRP Plot >-105 dBm Result)
In 95% of cluster, the RSRP must be ≥ -105 dBm -115 dBm @ 95% Pass
No low RSRP ( < -105 dBm ) is found near site ± 300m) Not found Pass
CDF Plot:
Min Value (dB) SINR Criteria (dB) Max Value (dB) Percentage (%) Legend
20 SINR (dB)>=20 Infinity 9.83%
10 10<=SINR (dB)<20 20 33.01%
3 3<=SINR (dB)<10 10 31.59%
0 0<=SINR (dB)<3 3 12.09%
-5 -5<=SINR (dB)<0 0 10.60%
-Infinity SINR (dB)<-5 -5 2.88%
SINR ≥ 3 74.43% Not Pass
CDF Plot:
LTE NEW SITE PAC DOCUMENT 19 (47)
3.2.9 CQI
Item Status
CQI Distribution* Info Only
3.2.10 RSRQ
Min Value (dB) RSRQ Criteria (dB) Max Value (dB) Percentage (%) Legend
-6 RSRQ (dB)>=-6 Infinity 8.50%
-9 -9<=RSRQ (dB)<-6 -6 40.40%
-11 -11<=RSRQ (dB)<-9 -9 23.83%
-14 -14<=RSRQ (dB)<-11 -11 20.93%
-Infinity RSRQ (dB)<-14 -14 6.35%
LTE NEW SITE PAC DOCUMENT 22 (47)
3.2.11 PS DL Throughput
Min Value (Mbps) DL Throughput (Mbps) Max Value (Mbps) Percentage (%) Legend
30 DL Throughput (Mbps)>=30 Infinity 11.97%
10 10<=DL Throughput (Mbps)<30 30 37.65%
5 5<=DL Throughput (Mbps)<10 10 20.24%
3 3<=DL Throughput (Mbps)<5 5 10.57%
0 0<DL Throughput (Mbps)<3 3 19.57%
3.2.12 PS UL Throughput
Min Value (Mbps) UL Throughput (Mbps) Max Value (Mbps) Percentage (%) Legend
15 UL Throughput (Mbps)>=15 Infinity 48.18%
10 10<=UL Throughput (Mbps)<15 15 18.44%
5 5<=UL Throughput (Mbps)<10 10 15.72%
3 3<=UL Throughput (Mbps)<5 5 3.93%
0 0<UL Throughput (Mbps)<3 3 13.73%
Event.csv
LTE NEW SITE PAC DOCUMENT 26 (47)
LuInterference.xlsx
LTE NEW SITE PAC DOCUMENT 27 (47)
4542870E_LTE_PlembonBanjarej
o
DL BEFORE DL AFTER
LTE NEW SITE PAC DOCUMENT 31 (47)
UL BEFORE UL AFTER
No Parameter tuning or optimization done since the coverage already follow RF design &
parameter standard (CDD) already implemented sucscessfully.
Cell AvailabilityRate is maintained above Session Setup Success Rate is maintained above
reference value99% reference value99%
RRC Setup Success Rate Session Abnormal Release Rate
RRC Setup Success Rate is maintained above Session Abnormal Release Rate is maintained
reference value 98% below reference value 1.4 %
Handover Success Rate Intra Frequency is Handover Success Rate Inter RAT Frequency is
maintained above reference value 98.00% maintained above reference value 95.00%
Processor Load 3G HSDPA users vs LTE RRC users
eNodeB processor load maximum is lower 3G and LTE User Number actually no issue.
below reference value 70.00 %. (Only for Information)
3G vs LTE Payload Trend (Daily sum in GB) 3G throughput vs LTE throughput (BH)
Payload actually no issue (only for information) Throughput actually no issue(only for information)
LTE NEW SITE PAC DOCUMENT 35 (47)
5 KPI 2G & 3G
Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be reviewed
during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review the NMS
KPI, plus MRR data of 3G in PAC report.
The target for NMS KPI is maintained of improved, comparing the best week (within 3 weeks)
after Frequency Carving/TRX Shutdown versus the week when PAC is collected.
2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless
they have collocated LTE installed or not. All KPI, except availability are calculated during
busy hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr
daily.
5.2 NMS 2G
KPI Baseline Week 1 PAC Week 2 Comments
Assignment Success Rate 11.77% 11.77% Maintain
Perceive Drop Rate 99.77% 99.77% Maintain
Perceive Congestion Rate 148.33% 148.33% Maintain
SDCCH Drop Rate 0.00% 0.00% Maintain
SDCCH Congestion Rate 11.77% 11.77% Maintain
SDCCH Success Rate 2.46% 2.46% Maintain
TBF Failure Rate 9997.53% 9997.53% Maintain
Cell Availability 9889.54% 9889.54% Maintain
HO Success Rate 0.77% 0.77% Maintain
* Fill comment with: Degraded or Maintained or Improved according to current week compared with baseline
5.3 NMS 3G
KPI Baseline Week 1 PAC Week 2 Comments
RRC Success Rate 11.77% 11.77% Maintain
Speech Access Rate 99.77% 99.77% Maintain
PS Access Rate 148.33% 148.33% Maintain
Speech Drop Rate 0.00% 0.00% Maintain
PS Drop Rate 11.77% 11.77% Maintain
RAB Congestion 2.46% 2.46% Maintain
Cell Availability 9997.53% 9997.53% Maintain
CS IRAT-HO SR 9889.54% 9889.54% Maintain
5.4 MRR 3G
During LTE Optimization process, some physical tuning might be executed to enhance LTE quality.
While in some sites, the antenna is shared between 3G and LTE. Therefore, LTE vendor must provide
the MRR before and after physical tuning is executed. The CPICH RSCP must be maintained, or if due
to less sample, the deviation of 2% is accepted.
RSCP Plot
LTE NEW SITE PAC DOCUMENT 37 (47)
EcIo Plot
LTE NEW SITE PAC DOCUMENT 38 (47)
6 FEATURE
PAC acceptance validates the feature state on each RAN LTE nodes. The validation refers to Bill of Quantity
stated in Purchased Order with the actual feature status on the node. The feature may be applicable on the cell
level, site level (eNB) or RRC Connected user level. Each LTE vendor may have their own feature ID.
RECOMME
FEATURE FEATURE BoQ Current
FEATURES FEATURE ID NDED
DOMAIN TYPE Checking Status
BASELINE
CS Fallback to UTRAN LOFD-001033 RF Optional YES ON ON
CS Fallback to GERAN LOFD-001034 RF Optional YES OFF OFF
CS Fallback with LAI to
LOFD-001069 RF Optional YES OFF OFF
GERAN
LoCation Services(LCS) LOFD-001047 Product Optional YES OFF OFF
Support of UE
LOFD-001030 RF Optional YES ON ON
Category2/3/4
Enhanced Scheduling LOFD-001015 RF Optional YES ON ON
Active Queue
LOFD-001027 RF Optional YES Trial Trial
Management(AQM)
Enhanced Admission
LOFD-001029 RF Optional YES Trial Trial
Control
PS Inter-RAT Mobility
between E-UTRAN and LOFD-001020 RF Optional YES OFF OFF
GERAN
Security Mechanism LOFD-001010 Product Optional YES ON ON
Temporary Temporar
Intra-LTE Load Balancing LOFD-001032 RF Optional YES
OFF y OFF
Intra-LTE User Number Temporary Temporar
LOFD-070215 RF Optional YES
Load Balancing OFF y OFF
PS Inter-RAT Mobility
between E-UTRAN and LOFD-001019 RF Optional YES ON ON
UTRAN
RObust Header Temporary Temporar
LOFD-001017 RF Optional YES
Compression (ROHC) OFF y OFF
Flash CS Fallback to
LOFD-001052 RF Optional YES ON ON
UTRAN
Flash CS Fallback to
LOFD-001053 RF Optional YES OFF OFF
GERAN
Temporary Temporar
Flexible User Steering LOFD-001054 RF Optional YES
OFF y OFF
Inter-RAT Load Sharing
LOFD-001044 RF Optional YES Trial Trial
to UTRAN
UL Interference
LOFD-001012 RF Optional YES ON ON
Rejection Combining
Automatic Neighbour
LOFD-002001 RF Optional YES ON ON
Relation(ANR)
Self-configuration LOFD-002004 Product Optional YES ON ON
PCI Collision Detection &
LOFD-002007 RF Optional YES ON ON
Self-Optimization
Mobility Robust
LOFD-002005 RF Optional YES OFF OFF
Optimization (MRO)
Remote Electrical Tilt
LOFD-001024 Product Optional YES Scene On Scene On
Control
LTE NEW SITE PAC DOCUMENT 40 (47)
RECOMME
FEATURE FEATURE BoQ Current
FEATURES FEATURE ID NDED
DOMAIN TYPE Checking Status
BASELINE
RIM Based LTE Target Temporary Temporar
LOFD-070203 RF Optional YES
Cell Selection OFF y OFF
DL 2x2 MIMO LOFD-001001 RF Optional YES ON ON
Enhanced Transmission
LOFD-003011 Product Optional YES ON ON
QoS Management
IP Performance Temporary Temporar
LOFD-003012 Product Optional YES
Monitoring OFF y OFF
S1 and X2 over IPv6 LOFD-003017 Product Optional YES OFF OFF
IPsec LOFD-003009 Product Optional YES OFF OFF
Public Key
LOFD-003010 Product Optional YES OFF OFF
Infrastructure(PKI)
Integrated Firewall LOFD-003014 Product Optional YES OFF OFF
S1-flex LOFD-001018 Product Optional YES ON ON
2G/3G and LTE Co-
LOFD-003002 Product Optional YES Scene On Scene On
transmission
UL 64QAM LOFD-001006 RF Optional YES ON ON
Inter-RAT ANR LOFD-002002 RF Optional YES Trial Trial
RACH Optimization LOFD-002015 RF Optional YES Scene On Scene On
RF Channel Intelligent
LOFD-001039 Product Optional YES OFF OFF
Shutdown
PSU Intelligent Sleep
LOFD-001056 Product Optional YES OFF OFF
Mode
Temporary Temporar
UL 2x2 MU-MIMO LOFD-001002 RF Optional YES
OFF y OFF
Intra-eNodeB UL CoMP LOFD-001066 RF Optional YES ON ON
LOFD-
CQI Adjustment RF Optional YES ON ON
00101501
LOFD-
Dynamic Scheduling RF Optional YES ON ON
00101502
Control Channel IRC LOFD-001094 RF Optional YES Trial Trial
CS Fallback with LAI to
LOFD-001068 RF Optional YES ON ON
UTRAN
Temporary Temporar
SRVCC to UTRAN LOFD-001022 RF Optional YES
OFF y OFF
Intelligent Access Class
LOFD-070207 RF Optional YES Scene On Scene On
Control
IP Active Performance
LOFD-070219 Product Optional YES Scene On Scene On
Measurement
Dynamic Inter-Cell
Interference LOFD-001014 RF Optional YES OFF OFF
Coordination
LAOFD-
Static TDM eICIC RF Optional YES OFF OFF
002001
LTE NEW SITE PAC DOCUMENT 41 (47)
RECOMME
FEATURE FEATURE BoQ Current
FEATURES FEATURE ID NDED
DOMAIN TYPE Checking Status
BASELINE
Temporary Temporar
TTI Bundling LOFD-001048 RF Optional YES
OFF y OFF
LAOFD-
FeICIC RF Optional YES OFF OFF
081234
SFN LOFD-003029 RF Optional YES Scene On Scene On
CPRI Compression LOFD-001076 Product Optional YES OFF OFF
Cell Outage Detection
LOFD-002012 Product Optional YES ON ON
and Compensation
Enhanced
LOFD-003013 Product Optional YES OFF OFF
Synchronization
IPsec for IPv6 LOFD-003024 Product Optional YES OFF OFF
Ethernet OAM LOFD-003004 Product Optional YES OFF OFF
Antenna Fault Detection LOFD-002011 Product Optional YES OFF OFF
Multi-mode BS Common
MRFD-231601 Product Optional YES OFF OFF
Reference Clock
Below is the detail log file on feature validation:
t1 t2 t3 t4
t1 t2 t3 t4
7.3 Justification
8 Conclusions
We conclude that PAC of Cluster EJ_TBN_4G_SHB2_NAE_310 is: