Training

By Alessandro Esposito

NQDI

20 January SwissQual 2000-2010

CONFIDENTIAL MATERIALS

Table of Contents
Platform Overview Database Management Data Management Data Analysis Reports, Queries, KPI and Maps System Operation Practice Session

Confidential

CONFIDENTIAL MATERIALS

Platform Overview
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Post Processing Complete Solution

Confidential

CONFIDENTIAL MATERIALS

NQDI Highlights
NQDI means NetQual Database Interface Post-processing application based on SQL Server database Client / Server Architecture for Standalone as well as Enterprise configuration options Import and handling of data from all SwissQual platforms Filtering and data mining Intelligent drill down analysis Map analysis and export KPI Statistics Historical trending Reporting Database querying / mining New external OPT Optimization module

Confidential

CONFIDENTIAL MATERIALS

Architecture
Layered structure Different possible deployments
Standalone (Multi) Client Server
NQDI Application NQDI Database SQL Server Windows Server

Standalone

Client Server CONFIDENTIAL MATERIALS

Confidential

External tools
SQL Enterprise Manager (MS SQL 2008)
Managing databases Databases backup

SQL Query Analyzer (MS SQL 2008)

View tables, functions, views, procedures Workspace for creating queries

SQL Server Management Studio (MS SQL 2008)

MapInfo

Google Earth
Confidential CONFIDENTIAL MATERIALS

Enhanced Post Processing

Horizontal or Vertical approach Horizontal
Call analysis (statistics) and trending analysis available Rich and powerful report generation tools Map plots and grid plots generation Integration with Google Earth

Vertical
Call quality Detailed (layers 1, 2 and 3) analysis of calls or data sessions
Analysis of speech quality Analysis of video quality (for video calls, video streaming and DVB-H) Analysis of data tests Analysis of messaging tests
Confidential CONFIDENTIAL MATERIALS

Database Management
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Open Database Structure

The structure of the entire NQDI database is described in the Manual NQDI - Database structure.pdf document
Description of all the tables Description of the relations Descriptions of views Description of stored procedures

Confidential

CONFIDENTIAL MATERIALS

NQDI Database Structure

0..n FileList

NQDI

Tables
Position

PosId

0..n 1 FileId PosId 1..n Sessions 1 SessionId DataSession 0..1

Configuration Tables System Tables Measurement Result Tables Position Tables Network Information Table Audio Recordings Table Other Tables

NetworkId

CallSession

1 NetworkInfo

0..n NetworkId 0..n PosId NetworkId

SessionId

0..1

MNC, MCC, CId, LAC

0..n

1
SessionId 0..n SessionId 1 SampleId 0..1 SampleSettingsInfo TestInfo

1 BTSList

SessionId

0..n

0..1 Msg Msg Msg Msg TestId 1..n

1 TestId 1..n Result..

Confidential

CONFIDENTIAL MATERIALS

Basic Database Management

sa user must be used Startup Auto Log In Within NQDI
Database creation Database deletion Database update

With the external tools

Database copy Database backup Database migration

CONFIDENTIAL MATERIALS

Confidential

Exporting Databases
Database export is also possible from within NQDI
Creation of historical databases
Possibility to save up to 95% disk space

CONFIDENTIAL MATERIALS

Confidential

Data Management
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Data Management
Import Data
Manually or automatically defining collection names Automatically evaluate KPI and other parameters (through SQL scripts) Possibility to define Event queries and have them run at import time

Remove Data
Can delete data according to given collection, campaign, file or data scope Can remove data at different levels

Maintain data (collection names)

Confidential

CONFIDENTIAL MATERIALS

Sessions I
One session: from CONNECT command until the DISCONNECT/RELEASE
Each measurement file from QualiPoc or Diversity can contain multiple sessions In QualiPoc there is one measurement file for each Job In Diversity there is one measurement file for each Task Sessions can be of different type CALL - Voice and Video calls DATA - GPRS, SMS, broadcast (e.g. DVB-H) IDLE Time between CALL or DATA sessions Idle or Scanner Only tests
Confidential CONFIDENTIAL MATERIALS

Sessions II
Tests in multi transfer mode (e.g. Multi-RAB or DTM) involve multiple IDLE and DATA sessions
Sessions are separate but are grouped together Can be filtered according to the transfer mode

Sessions can contain one or more Tests

Test can be of different type
Speech, ping, FTP, video streaming, SMS send, DVB-H, etc.

Confidential

CONFIDENTIAL MATERIALS

Choosing the Data to Analyse

Data filtering / selection
Save current selection Load saved selection Manage selections

Store Data Selection Query in DB

Used for NQWeb

Polygon filtering
Session not considered if not entirely within the polygon

CONFIDENTIAL MATERIALS

Available Selection Criteria

General
Campaign name Test description = Job name Task Name Session type Transfer mode Date and time

Call
Call status Call type

Layer
GSM, GPRS or UMTS L3 messages

Map
Polygon regions

Test
Type of test Test results

User
User comments Alarms Any SQL script

Device
Measurement device type IMEI Firmware

KPI
Predefined KPI Custom KPI Custom events

Operator
Home or serving operator Cell Location Area Technology

AND MUCH MORE!

Confidential

CONFIDENTIAL MATERIALS

Cockpit View
Summary of current selection (Customize Thresholds)

CONFIDENTIAL MATERIALS

Confidential

Data Analysis
Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Rich Session Specific Data Display

Vertical approach For each different type of test all and only the appropriate or relevant tabs are displayed Different types of calls/sessions Test information
Data sessions Messaging sessions Voice or Video calls Video streaming and Broadcasting sessions

Radio information is always displayed

From the measuring device For traced devices

Scanner information if available If calls fulfils the standard requirements, Call quality is also shown for voice calls
Confidential CONFIDENTIAL MATERIALS

Analysis Tab Overview

Session overview Current Selection
Red Current session and test White Other sessions or tests in the current selection Gray Other sessions or tests in the scope but not in the current selection

Confidential

CONFIDENTIAL MATERIALS

Information Organization
Information is divided into logical sub tabs
Tabs shown dynamically based on the content in the selected session and test Session info Test results (Service layer)
Listening quality, FTP, HTTP, etc.

Protocol info (IP layer) Scanning (RF layer)

Separated for WCDMA and GSM Separated for GSM, GPRS/EDGE and UMTS Separate Tab for B side, GSM (B), UMTS (B)

Network technology (Layer1 to Layer3) KPI

Voice Call (GSM) Video Streaming FTP Test

Confidential CONFIDENTIAL MATERIALS

Analysis Details
Graph manipulation Layer 3 filtering

Confidential

CONFIDENTIAL MATERIALS

Call Status Definition

Completed
Audio connection Correct counterpart Intentionally terminated

Dropped
Audio connection Correct counterpart

Failed
No audio connection Wrong counterpart

System Release
Call ended by user Call ended because of equipment constraints
Confidential CONFIDENTIAL MATERIALS

Data Session Status Definition

Failed
No data connection could be established
Attach failed PDP context activation failed or rejected PPP authentication failed No network coverage Device hardware issue

Dropped
Data connection established Connection ended before the end of the defined test session
Network forces a PDP deactivation Network coverage lost Device hardware issue (i.e. reboot)

Completed
Data connection established PDP context deactivation (e.g. disconnect) driven by test session

System Release
Call ended by user Call ended because of equipment constraint
Confidential CONFIDENTIAL MATERIALS

Listening Quality Analysis

SQuad LQ MOS (Narrow and/or Wideband) P.852 MOS (optional) Quality Cause code Signal and Noise levels, SNR Delay Clipping Speech Activity Gain DC offset Frequency shift Clip replay

CONFIDENTIAL MATERIALS

Data Analysis TCP/IP

Timestamps Protocols IP addresses Port numbers Header info IP throughput Packet count Packet sequence

CONFIDENTIAL MATERIALS

Confidential

Data Analysis FTP

FTP operation File name Throughput Transfered bytes MCC-MNC

CONFIDENTIAL MATERIALS

Video Streaming Analysis

Video MOS Quality Cause code Frame rate Freezing Matched frames Blurring Blockiness Jerkiness PSNR Lip Sync Player and Protocol Clip replay

CONFIDENTIAL MATERIALS

Confidential

Analysis Streaming Media layer

Media Codec Protocol analysis Frame-by-Frame analysis Codec parameters Content parameters Frame type display IP throughput

Confidential

CONFIDENTIAL MATERIALS

GSM Scanner Analysis

Channel Overview Serving and Neighbour channels Best server Hot channels RxLev, BSIC, C/I Operator filtering Markers Optional CGI decode and multiple BSIC

CONFIDENTIAL MATERIALS

Confidential

WCDMA Scanner Analysis

Channel Spectrum (LX only) Top CPICH SC RSCP and Ec/No PSCH and SSCH Ec/No Delay Spread

CONFIDENTIAL MATERIALS

Confidential

CDMA Scanner Analysis

SC Ec/No, RSCP Best CPICH

CONFIDENTIAL MATERIALS

Confidential

GSM Network Analysis

GSM radio RF BCCH and TCH ARFCN RxLev, RxQual, FER, C/I Codec type and rate HSN, MAIO DTX, TxPwr, TA, RLT Measurement report Serving Cell Layer 3 message decode Markers Home and Serving operator Cell-Id and LAC

CONFIDENTIAL MATERIALS

GPRS/EDGE Network Analysis

SNCDP, LLC, RLC info TBF state Coding Scheme TS allocation EDGE BEP Info RLC and LLC throughput RLC BLER TxPwr, BLER, target SIR MAC info GMM and SM Signalling plane CS and TS allocation statistics

CONFIDENTIAL MATERIALS

UMTS Network Analysis

WCDMA radio RF IRAT neighbor list UARFCN RRC State RSSI, RSCP, Ec/Io TxPwr, BLER, target SIR Active, Monitor, Detected set Spreading Factor Power Control info RRC and NAS signalling decode Markers Home and Serving operator CellId and LAC

CONFIDENTIAL MATERIALS

Analysis - HSDPA

SSCH Scheduling SSCH Allocation Throughputs: Requested, Scheduled, HS-DSCH, MAC-HS UE Category CQI ACK, NACK status HARQ Statistics HS-DSCH Modulation RLC and MAC layer allocation

Confidential

CONFIDENTIAL MATERIALS

Analysis - HSUPA

HSUPA(EUL) Status indication Radio Link Set presentation E-DCH and MAC-e configuration E-DCH Scheduling and Reporting information HARQ Statistics Throughputs: Requested, Scheduled, E-DCH, MAC-E Serving Grant Absolute Grant Relative Grant

Confidential

CONFIDENTIAL MATERIALS

CDMA Network Analysis

RLP Throughput Monitor Rx/Tx Vocoder Rate Active, Candidate and Neighbor Set Finger Monitor Layer3 signalling Power Control Info IS-95/IS-2000 MUX Statistics

CONFIDENTIAL MATERIALS

Reports, Queries, KPI and Maps

Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Reports
Horizontal approach Wide set of predefined reports and KPI reports Custom KPI reports
Possibility to generate Trending Analysis

Custom reports
Multi step process Advanced functionality Requires SQL query language, Excel Macro and Pivot Table knowledge

Custom SQL scripts

For any kind of database data manipulation Can be set to run during import process
CONFIDENTIAL MATERIALS

Map Plot Selection

Map Tab to see Map Plots Values to plot ordered in a tree structure
GSM Mobile Mobile Layer 1 Measurements RxQualFull

Grids or Points can be used Favorites Plots can be stored as well

Needed to include Maps in Reports

CONFIDENTIAL MATERIALS

Map window Plot types

Point plot
Plot values as stored in the database point by point
Best for smaller areas Needed for detailed analysis Warning! Huge data sets can take long time to plot

Radial map plot

Grid plot
Plot values averaged over grid squares
Best for overview plots over large areas
Confidential CONFIDENTIAL MATERIALS

Map Plot Configurator

Predefined shade Customizable shade per value User defined map plots KPI map plot wizard

Confidential

CONFIDENTIAL MATERIALS

Reports including pictures

Option to add pictures from Favorite Map plots in a report (new sheet for every map window) Where: Configuration Report Configurator

Confidential

CONFIDENTIAL MATERIALS

Export to Google Earth

Display collected data on satellite maps from Google Earth
Provides 3D views (compared to the standard 2D views of MapInfo Photo realistic maps offer more details and more information to troubleshoot network issues
I.e. those related to specific geographical circumstances

Any value can be plotted onto the integrated MapInfo map or exported to Google Earth
Possibility to store the representation in a Google Earth file format (.kmz) Requires Google Earth installed on the client Requires the client to have Internet access

Confidential

CONFIDENTIAL MATERIALS

System Operation Practice Session

Agenda ->

Confidential

CONFIDENTIAL MATERIALS

Lets do it!
Create a new database Import some measurement files into the database Explore the Selection tabs and make different selections Test the Cockpit View Select all sessions where HandOverFromUTRANCommand-GSM message was received Analysis
Open different type of session and tests Study the different sub tabs Drag and drop values to show them on the charts Expand Layer 3 messages

Reports generation
Select all the available sessions Create some QualiPoc specific report

Define and generate a custom KPI report

Confidential

CONFIDENTIAL MATERIALS

So far any

Question?

Confidential

CONFIDENTIAL MATERIALS