Академический Документы
Профессиональный Документы
Культура Документы
Monitoring
www.dsp-ip.com
Overview
QoS and QoE
Measurement and Monitoring Goals
Lab, pre-deployment, Monitoring, failure analysis
Measurement Methods
Objective, Subjective, payload/codec based
Monitoring Levels
Transport, Transaction, content
Monitoring Domains
Head-end, network, Home
www.dsp-ip.com
Challenge
Answer
network
Improved protocols
QoS mapping schemes
Bandwidth
Monitoring
Automatic maintenance,
Automatic firmware update
Home network monitoring
www.dsp-ip.com
Content quality
Content pricing
Content availability
Viewing experience
Video Quality
Channel Zapping delay
Integration of services
Usability
One bill
New services
Customer services
www.dsp-ip.com
Voice/Video Quality?
We can look at quality in different ways:
1. Perceptual subjective Quality (MOS)
2. Numerical Quality parameters (PSNR)
3. How to connect (relation matrix between 1
and 2)
www.dsp-ip.com
MEASUREMENT &
MONITORING
In the Lab & In The Fields
For Pre-Deployment/monitoring/Failure Analysis
www.dsp-ip.com
Lab
Testing
Deployment
Phase
Pre
Deployment
Testing
Pre-Deployment
Phase
Analysis
Problem Solving
Tuning
24/7
Monitoring
www.dsp-ip.com
www.dsp-ip.com
MEASUREMENT TAXONOMY
Subjective
Objective
Payload based, codec aware, codec anaware
www.dsp-ip.com
Objective
Repeatable
For both testing and monitoring
www.dsp-ip.com
Broadcast
World
Subjective
MOS
(Voice)
BT500
(Video)
Objective
Codec aware
Packet based
VQS
Telchemy
V-Factor
VQI
Testing
Network
Monitoring
Delay, Jitter
Packet loss
Codec independent
Packet based
MDI
Monitoring
www.dsp-ip.com
Objective methods
www.dsp-ip.com
www.dsp-ip.com
www.dsp-ip.com
www.dsp-ip.com
www.dsp-ip.com
VQS
Telchemy
V-Factor
VQI
www.dsp-ip.com
Robust
codec
Problem area
Raw
codec
www.dsp-ip.com
Average can
be
misleading
Poor quality
during burst of
loss/discards
Impact of Burst
of
Packet Loss
5-8
seconds
15-30
seconds
Subjective
compensation for
variance between
human and testing
equipment view of
loss
www.dsp-ip.com
Example V-Factor
Based on MPQM (Moving Picture Quality
Metrics) high quality video measurement
standard
V = f(QER, PLR, R)
QER relative video codec quality
PLR Packet loss ratio (based on actual packet
loss, jitter data and jitter buffer model)
R Image complexity factor (2-3)
Adopted by Spirnet
www.dsp-ip.com
Monitoring only
Codec independent
Based on network parameters data only
Scales - could monitor thousands of channels
Examples:
MDI
IneoQuest
standardized by IETF
www.dsp-ip.com
MONITORING LEVELS
www.dsp-ip.com
Measurement Levels
Transport Level
Service (transaction) Level
Media Quality Level
Add Your Text
Content Quality
Transport Quality
Transaction Quality
www.dsp-ip.com
Transport Level
Example:
Packet Loss
Loss Patterns
Jitter
Delay
Well understood
Defined by ITU and IETF
www.dsp-ip.com
Transaction Level
Examples
Post-dial delay in PSTN/mobile networks
Video start time
www.dsp-ip.com
Multicast Leave +
Multicast Join +
First I Frame +
Up to 2 seconds buffering time
First frame
viewed
First I
Frame
Buffering
latency
Join latency
Signaling Latency
Media
Latency
www.dsp-ip.com
First frame
viewed
I Frame Multicast
unicast stream
Join latency
Multicast stream
www.dsp-ip.com
VoD Signaling
Unicast server is used to serve the stream till the
second multicast stream has an I Frame
Immediate I Frame
Shorter buffering time
First frame
viewed
Total VoD Signaling Latency
Play to server
Buffering
latency
www.dsp-ip.com
Content Level
Content quality is a payload based measurement.
Requires decoding of the video stream
Understanding of the buffering and error concealment algorithms
of the decoder
www.dsp-ip.com
Standardization landscape
ATIS
ITU
IIF IPTV
Interoperability
Forum
Study Group 12
QoS Metrics
Standardization
Algorithms for
end-to-end
transmission
performance
Used for
Monitoring
ITU
VQEG Video
Quality Expert
Group
Video performance
measurement based
on Subjective tests
Database
DSL
DSL Forum
TR-64, TR-69
LAN and WAN
monitoring
standards
Used in
Diagnostics /
Lab
www.dsp-ip.com
www.dsp-ip.com
Monitoring levels
J.144 and PSNR examines the video content only (payload
measurements)
TR101290 examines only transport stream data and coherence without
examining the video content
V-Factor and VQS looks at packet loss, jitter and loss patterns data and
incorporate it with codec information and video header information
MDI Examines only packet loss and packet loss patterns without
considering the codec or video information
MDI
V-Factor, VQS
TR101290
MPEG2TS
Headers
J.144, PSNR
Video
payload
www.dsp-ip.com
MEASUREMENT DOMAINS
Headend
Network
VoD
Home
www.dsp-ip.com
DVB TR 101290
DVB Transport stream monitoring standard
Alerts and KPI:
TS sync loss
CRC error
Sync byte error
PCR error
PAT error
PCR
Continuity counter errors
discontinuity
PMT error
PCR accuracy
PID error
error
PTS error
Transport error
www.dsp-ip.com
VoD Servers
Encoders
TS muxers
Network core
Routers
Network edge
ATM switches
GBE Switches
Access
DSLAM / BRAS
CPE
STBs
Home network
www.dsp-ip.com
Headend
Video source quality
Video encoding quality
MPEG2 Transport stream parameters
TR100290
1st-3rd level priority alerts
Inputs
www.dsp-ip.com
VoD
Pre-deployment
RTSP signaling latency (delay)
Performance under stress (user load)
Trick Mode (FF, REW)
Signaling delay
Video quality
Buffer state (overflow and underflow)
Monitoring
Loss of data (under stress)
Interfaces:
GBE
10GBE
www.dsp-ip.com
www.dsp-ip.com
Installation
Preventive maintenance
STB and CPE remote management (TR69 and more)
Service verification for field technician
CRM support
Interaction logging
Home Network monitoring and repair
www.dsp-ip.com
www.dsp-ip.com
www.dsp-ip.com
Vendors specialization
Lab Testing
Monitoring
Incumbent
Telecom
Agilent
Ixia
Spirnet
Telecom
Agilent
JDSU/
Acterna
Spirnet
New
entrants
Telecom
Shenick
Cable
Rhode &
Schwartz
Cable
Thomson
Snell&Wilcox
Telecom
Telchemy
Bridge Technologies
iBrix
QoSMetrix
www.dsp-ip.com
adi@dsp-ip.com
+972-9-8651933
www.dsp-ip.com