XCAL VoIP Features

Edition: 00 Version: 1.00 2009. 03

 2005 Couei Corporation., All rights reserved. This documentation shall not be changed, distributed to the public, and opened to the third person without written permission. Couei is not responsible for any direct or indirect damages arisen or related to use of this manual. All information included herein may be changed without prior notice.

Couei Corporation Address: 13 F, Queen's Tower A, 2-3-1 Minato Mirai, Nishi-Ku, Yokohama 220-6013, JAPAN Phone #: +81-(0)45-682-7000 Fax #: +81-(0)45-682-7007 Web site: http://www.couei.com

Copyright by Couei Corporation

Page II

Contents

Contents ............................................................................................................................ I Introduction ..................................................................................................................... 3 Overview ................................................................................................... 3 Key Features .............................................................................................. 5 Measurement Environment ........................................................................... 6 System Requirements .................................................................................. 6 MOS .................................................................................................................................. 7 PESQ ................................................................................................................................. 9 AutoCall Setting ............................................................................................................. 12 VoIP AutoCall Setting ................................................................................ 14 Advance Setting .................................................................................. 17 Result ............................................................................................................................. 19 Call Statistics ........................................................................................... 19 MOS Statistics .......................................................................................... 21 MOS Statistics [All Info tab] .................................................................. 23 RTP Info .................................................................................................. 25 Packet Capture Viewer ............................................................................... 27 PESQ Wave Format ................................................................................... 28 Mobile tab .......................................................................................... 28 All Info............................................................................................... 29 PESQ Information ..................................................................................... 30 MOS Graph .............................................................................................. 33 Measurement result by Count ................................................................ 33
I

Measurement result by Call ................................................................... 33 MOS Signal Graph ..................................................................................... 34

Copyright by Couei Corporation

Page II

Introduction

Overview
VoIP is an optimization tool which performs VoIP measurement over wireless network especially for WiMAX network. It monitors changing network environment in real time as well as measures voice quality, MOS.

Various protocols such as SIP and RTP are utilized to measure voice and its transferring quality. VoIP performs measurement by unit between WiBro mobile, LCG (PSTN), and ICG; Mobile to Mobile, Mobile to LCG (PSTN), and Mobile to ICG, which measures quality between mobile and network node.

VoIP system overview

Copyright by Couei Corporation

Page 3

VoIP Features

Chapter 1. Introduction

VoIP main window

Copyright by Couei Corporation

Page 4

VoIP Features

Chapter 1. Introduction

Key Features
VoIP optimization tool is provided with the following special features. To measure VoIP in Softphone type by using SIP Client. To capture packets in real time and analyze SIP signaling and RTP/RTCP messages. To provide various call results through SIP protocol. To cooperate with various SIP servers. (both free and commercial SIP servers) To support various codec such as G.711, aLaw/uLaw, GSM, iLBC, G723.1, G729. To support various audio options such as AEC, VAD, AGC, CNG. To measure E-model MOS R-Factor (ITU-T G.107) by using packet based media information. To measure voice quality (MOS) based on ITU-T PESQ algorithm. To provide parameters network delay, jitter, packet loss, and etc. To measure telecommunication quality over WiMAX network by using WiBro mobile, and provide various parameters. To monitor various protocols including TCP/IP and SIP in real time. To measure telecommunication quality between PSTN by cooperating LCG. To measure telecommunication quality at IP network node by cooperating ICG. To provide OPTis functionalities.

Copyright by Couei Corporation

Page 5

VoIP Features

Chapter 1. Introduction

Measurement Environment
VoIP optimization tool provides various test environments as it performs

measurement by unit between WiBro mobile, LCG (PSTN), and ICG; Mobile to Mobile, Mobile to LCG (PSTN), and Mobile to ICG, which measures quality between mobile and network node.

Measurement Environment

System Requirements
Before you begin, ensure that your system meets the following requirements.
Item Requirements

PC Monitor RAM Hard Drive Operation System

Pentium 4 or above VGA (Over 1024 * 768, 256 color) 512MB or above 10GB or above Window 2000/XP/Vista

Copyright by Couei Corporation

Page 6

MOS

This chapter summarizes what MOS (Mean Opinion Score) is and its rating scheme.

MOS provides a numerical measure of the quality of human speech at the destination end of the circuit. The scheme uses subjective tests (opinionated scores) that are mathematically averaged to obtain a quantitative indicator of the system performance.

MOS is based on figures that result from what is perceived by people during tests.

The MOS is generated by averaging the results of a set of standard, subjective test where a number of listeners rate the heard audio quality of test sentences read aloud by both male and female speakers over the communications medium being tested. MOS value is rated based on the following rating scheme: Quality level 5 4 Impairment Excellent Good

Copyright by Couei Corporation

Page 7

VoIP Features 3 2 1 Fair Poor Bad

Chapter 2. MOS

Copyright by Couei Corporation

Page 8

PESQ

This chapter summarizes PESQ (Perceptual Evaluation of Speech Quality.)

PESQ is an algorithm for automated assessment of the speech quality enjoyed by the user of a telephony system. It is standardized as ITU-T in 2001, and most commonly used.

PESQ provides a measure that predicts the result of listening tests on telephony system. To measure speech quality, it uses a sensory model to compare the original, unprocessed signal with the degraded version at the output of the communications system.

The result of comparing the reference and degraded signals is a quality score. This score is analogous to the subjective MOS measured using panel tests according to ITU0T P.800.

PESQ takes into account coding distortions, errors, packet loss, delay and variable delay, and filtering in analogue network components.

Copyright by Couei Corporation

Page 9

VoIP Features

Chapter 3. PESQ

Level alignment. In order to compare the signals, the reference speech signal and the degraded signal are aligned to the same constant power level. This corresponds to the normal listening level used in subjective tests.

Input filtering. PESQ compensates for any filtering that has taken place in the network.

Time alignment. The system may include a delay, which may change several times during a test - for example Voice over IP often has variable delay. PESQ can identify and account for delay changes.

Auditory transform. In order to compare the reference and degraded signals, taking account of how a listener would have heard them, each is passed through an auditory transform that mimics certain key properties of human hearing. This gives a representation in time and frequency of the perceived loudness of the signal, known as the sensation surface.

Disturbance processing.

Copyright by Couei Corporation

Page 10

VoIP Features

Chapter 3. PESQ

Disturbance parameters are calculated using non-linear averages over specific areas of the error surface.

Copyright by Couei Corporation

Page 11

AutoCall Setting

This chapter enables you to create new scenarios and set AutoCall test for VoIP.

1. Select Manu Bar - File AutoCall Start, or click on AutoCall Icon Bar. 2. AutoCall Scenario Setting window appears.

icon from

AutoCall Scenario Setting window

3. Click Create New Scenario

icon.

4. AutoCall Setup window appears.

Copyright by Couei Corporation

Page 12

VoIP Features

Chapter 4. AutoCall Setting

AutoCall Setup window

5. Select VoIP tab.

Copyright by Couei Corporation

Page 13

VoIP Features

Chapter 4. AutoCall Setting

VoIP AutoCall Setting

Set AutoCall options for VoIP measurement.

VoIP tab in AutoCall Setup window

The detailed options in VoIP tab are as follows.

Item Description

IP Phone Call Type

Select IP phone type. * Select SIP call. Select call type between origination (sender) or termination (receiver). Enter receiver ID or dial number. Click Advance button for detailed settings. For detail, see Advance Setting.
Page 14

SIP Dial Number

Copyright by Couei Corporation

VoIP Features
Item

Chapter 4. AutoCall Setting

Description

Mos Calculation Sound Setting

Measure MOS while VoIP measurement. Click Sound Setting button to select Tx/Rx sound device type and their channel. Select MOS measurement mode. Half duplex (Down/Up): Sender and receiver transfer voice calls alternately. Full duplex (Down/Up): Sender and receiver transfer voice calls simultaneously. Simplex (Down): Sender or receiver receives voice calls. Simple (Up): Sender or receiver transmits voice calls. ARS Downlink: One-way voice call transferring; sender or receiver transfers voice call with no synchronization. TimeSync (Down/Up): Sender or receiver transfers voice call based on TimeSync setting. Select PESQ algorithm between PESQ 862.0 or PESQ 862.1. * Select PESQ 862.1. Enter time sync measurement. term for TimeSync type

Measurement method Type

Measurement method Algorithm Measurement method TimeSync Term(ms)

Event

Mos Count for Traffic: Enter MOS count, and voice call is to be terminated at the MOS count. Bad Quality Threshold: Enter standard threshold to determine bad quality threshold. Threshold less than the value are to be determined as bad quality threshold. Continuous B.Q. Threshold: Enter standard continuous bad quality threshold to determine CBQ Fail. Threshold which is under CBQ threshold and appeared more than CBQ count are to be determined as CBQ Fail. Continuous B.Q. Count: Enter standard continuous bad quality count to determine CBQ Fail. Threshold which is under CBQ threshold and appeared more than CBQ count are to be determined as CBQ Fail. Continuous Call in CBQ: Continue traffic for the corresponding voice call even if CBQ Fail is occurred.

Copyright by Couei Corporation

Page 15

VoIP Features
Item

Chapter 4. AutoCall Setting

Description

File

Original File: Select sound source to be received. Play File: Select sound source to be transmitted. Plan and wait time (ms): Set waiting time after ending play sound source. Default value is set to zero ms. Wave Save Threshold: Set standard threshold of wave file to be saved after MOS measurement. Wave file under the Wave Save Threshold setting are to be saved. Save Path: Set save path of wave file. Default save folder is Logdata folder.

Copyright by Couei Corporation

Page 16

VoIP Features

Chapter 4. AutoCall Setting

Advance Setting
Advance button in AutoCall Setup window helps to set receivers detailed configuration. User ID, SIP server address, and etc. registered at free or commercial SIP server are to be entered.

1. Click Advance button in VoIP tab. 2. VoIP Setting window appears.

VoIP Setting window

The detailed items in VoIP Setting window are as follows.

Item Description

SIP

User Name: Enter user name (ID) or dial number of SIP server. Password: Enter password. SIP Server: Enter SIP server IP address or domain

Copyright by Couei Corporation

Page 17

VoIP Features
Item

Chapter 4. AutoCall Setting

Description

address. Server Port: Enter port number of SIP server. Generally port number of SIP server is set to 5060. STUN Server: Enter STUN server IP address or domain address. Use when intra IP attempts call communication with IP outside of company. Port: Enter port number of STUN server. Use when intra IP attempts call communication with IP outside of company. Outbound: Enter outbound proxy server IP address. Port: Enter port number of outbound proxy server. User Domain: Enter user domain if necessary. Authorization: Show user name. Dial Number: Enter receiver ID or dial number. Set voice transferring options while traffic is opened. These options may affect on MOS measurement. Acoustic Echo Cancellation (AEC): Remove voice echo. Voice Activity Detection (VAD): Close traffic if there is no call communications. Automatic Gain Control (AGC): Control sound volume automatically while call communications. Comfort Noise Generator (CNG): Generate steady noise while silence to help stable call communication conditions. Set voice codec. Recommended to set one codec. Display SIP signaling event in Call Statistics window.

Audio Option

Audio Show callback event

Copyright by Couei Corporation

Page 18

Result

This chapter explains network QoS information and MOS result measured by VoIP calls.

Call Statistics
Call Statistics window shows fail reason and signaling event of SIP as well as general call statistics.

Call Statistics

VoIP Call Event SIP Signaling Information

Call Statistics (Current Scenario) window

The detailed items for Traffic Fail Reason result are as follows.
Item Description

Copyright by Couei Corporation.

Page 19

VoIP Features
Item Description

Chapter 5. Result

Register Fail Call Fail Timeout

Registration to SIP server is failed. Wrong receiver ID is entered, receiver is not registered at server, or receiver is busy status. Connecting to traffic is failed within Traffic Setup Time.

Copyright by Couei Corporation

Page 20

VoIP Features

Chapter 5. Result

MOS Statistics
MOS Statistics window shows MOS statistics and status measured over VoIP calls.

MOS Statistics window

The detailed items in MOS Statistics window are as follows.

Item Description

MOS Type

MOS type * Simplex (Downlink), (Alternation) PESQ algorithm * MOS P.862, MOS P.862-1

Simplex

(Uplink),

Half

Duplex

Algorithm Original file Play file B.Q. THR

File name of sound source to be received. File name of sound source to be transmitted. Standard threshold to determine bad quality threshold. Threshold less than the value are to be determined as bad
Page 21

Copyright by Couei Corporation

VoIP Features
Item Description

Chapter 5. Result

quality threshold. C.B.Q. THR Standard continuous bad quality threshold to determine CBQ Fail. Threshold which is under C.B.Q. THR and appeared more than C.B.Q. Count are to be determined as CBQ Fail. Standard continuous bad quality count to determine CBQ Fail. Threshold which is under C.B.Q. THR and appeared more than C.B.Q. count are to be determined as CBQ Fail. Standard threshold of wave file to be saved after MOS measurement. Wave file under the Wave Save Threshold setting are to be saved. Average MOS value of the current calls. Number of total AutoCalls. Number of AutoCall success calls. Number of AutoCall fail calls. Good calls determined based on Bad Quality Threshold. Bad calls determined based on Bad Quality Threshold. Number of total AutoCall count. Good counts determined based on Bad Quality Threshold. Bad counts determined based on Bad Quality Threshold. Number of Continuous Bad Quality determined based on C.B.Q. THR and C.B.Q. Count. Number of counts excluded from MOS measurement.

C.B.Q. Count

SAVE THR MOS AVR Total Call Success (Call) Mosfail (call) GOOD (Call) BAD (Call) Total Count Good (Count) BAD (Count) C.B.Q. (Count) No MOS

Copyright by Couei Corporation

Page 22

VoIP Features

Chapter 5. Result

MOS Statistics [All Info tab]

All Info tab in MOS Statistics window shows overall information of MOS measurement.

MOS Statistics [All Info] tab

The detailed items in All Info tab in MOS Statistics window are as follows.
Item Description

Total Call MOS Call Type Success (Voice) Setup Fail Traffic Fail DROP Time Success (MOS) MOS Fail

Total calls for MOS measurement MOS measurement type VoIP success calls VoIP setup fail calls VoIP traffic fail calls VoIP drop calls Time for each section MOS success calls Calls excluded for MOS measurement

Copyright by Couei Corporation

Page 23

VoIP Features
Item Description

Chapter 5. Result

Good (MOS) BAD (MOS) NO MOS Aver_Total MOS Aver_MOS by Call Cur MOS Status MOS 4.0 ~ MOS 3.0 ~ 4.0 MOS 2.0 ~ 3.0 MOS 1.0 ~ 2.0 MOS 0.0 ~ 1.0 Progress MOS Result

MOS calls over Bad Quality Threshold MOS calls under Bad Quality Threshold Number of MOS count under MOS Count for Traffic set from VoIP tab in AutoCall Setup window. Average MOS for all calls Average MOS for current call Current MOS value MOS measurement status Number of MOS calls over 4.0 Number of MOS calls between 3.0 and 4.0 Number of MOS calls between 2.0 and 3.0 Number of MOS calls between 1.0 and 2.0 Number of MOS calls between 0.0 and 1.0 MOS measurement status for one call Current MOS result

Copyright by Couei Corporation

Page 24

VoIP Features

Chapter 5. Result

RTP Info
RTP Info window shows network QoS information including Delay, Jitter, and Packet Loss.

RTP Info window

The detailed items in RTP Info window are as follows.

Item Description

Packet Loss (EA) RTP Throughput (kbps)

Loss packet count among received packets (Calculated by Sequence) RTP (Real Time Protocol) throughput

Copyright by Couei Corporation

Page 25

VoIP Features
Item Description

Chapter 5. Result

Delay (ms) Delta Delay (ms) Jitter Delay (ms) One Way Delay (ms) RTP Packet Count (EA) Round Trip Time (ms) R-Factor R-Factor Mapping MOS

Interval between received RTP packets by one second Average changes of RTP packet interval Packet delay jitter by one second Delay between sender and receiver Received RTP packet count Returning time of transmitted packet R-Factors based on QoS information including network delay MOS in R-Factor relationship

Copyright by Couei Corporation

Page 26

VoIP Features

Chapter 5. Result

Packet Capture Viewer

Packet Capture Viewer window helps to capture and analyze SIP signaling and TCP/IP packets in real time.

Packet Capture Viewer window

The detailed items in Packet Capture Viewer window are as follows.

Item Description

Time Source Destination Type Info Detail

Time of packet which is currently received Senders IP address Receivers IP address Protocol type of received packet Overall information of received packet Detailed information of received packet

Copyright by Couei Corporation

Page 27

VoIP Features

Chapter 5. Result

PESQ Wave Format

PESQ Wave Format window compares and analyzes wave formats of original sound and the sound received in real time.

Mobile tab
Mobile tab in PESQ Wave Format window compares wave format of original and MOS measured in real time.

Mobile tab in PESQ Wave Format window

Copyright by Couei Corporation

Page 28

VoIP Features

Chapter 5. Result

All Info
All Info tab in PESQ Wave Format window shows MOS wave format in order measured from the current call.

All Info tab in PESQ Wave Format window

The detailed items in PESQ Wave Format window are as follows.

Item Description

REF DATA E/B FEC HOT D/O Overlap

Wave format of reference sound Wave format of measured sound Bad frame section Front End Clip Sound loss at front section of sound file Hold Over Time Sound loss at end section of sound file Drop Out Sound loss section Overlap measurement and reference sound file to compare.

Copyright by Couei Corporation

Page 29

VoIP Features

Chapter 5. Result

PESQ Information
PESQ Information window shows various parameters provided by PESQ excluding MOS.

PESQ Information window

The detailed items in PESQ Information window are as follows. Parameter MOS (P.862) Description The PESQ Score according to P.862 / PESQ

Copyright by Couei Corporation

Page 30

VoIP Features Parameter

(P.862)Speech

Chapter 5. Result Description

PESQ Score during active speech periods (mfMOSSpeech in older versions). PESQ Score during silent periods (mfMOSNoise in older versions). The PESQ score mapped as a G.107 (E-Model) Ie factor. PESQ score mapped to MOS-LQO according to P.862.1

P(P.862)

(P.862) Noise

G.107 Rating etc MOS_LQO(862.1) MOS P.800

Obsolete, will be removed in future releases. Use mfMOSLQO_P862_1 instead.

PESQ Score mapped to the entire P.800 scale (1..5)

Loudness

Reference

The loudness of the reference signal during speech in sone

Test

The loudness of the degraded signal during speech in sone

Background Noise

The loudness of the degraded signal during silent intervals in sone

Level Ref

Total Speech Background Noise

The Level of the reference file in dB Active speech level of the reference signal in dBov Level of silent intervals (background noise level) in the reference signal in dBov

Level Test

Total Speech Background Noise

The Level of the degraded file in dB Active speech level of the degraded signal in dBov Level of silent intervals (background noise level) in the degraded signal in dBov

Attenuation & SNR

Attenuation Speech Silence

The Level of the reference file in dB Active speech level of the reference signal in dBov Level of silent intervals (background noise level) in the reference signal in dBov

Delay

Avg Min Max

The Level of the degraded file in dB Active speech level of the degraded signal in dBov Level of silent intervals (background noise level) in the degraded signal in dBov

Copyright by Couei Corporation

Page 31

VoIP Features Parameter

FEC & HOT HOT [1~10] FEC [1~10]

Chapter 5. Result Description

Vector with front end clipping time for each utterance in ms Vector with hold over time for each utterance in ms Vector with start time of each utterance of the reference signal in ms Ref_End [1~10] Vector with end time of each utterance of the reference signal in ms

Utterance
Ref.

Ref_Start [1~10]

Utterance
Test.

Setence Clip_Start [1~10]

First or Second setence Vector with start time of each utterance of the degraded aligned signal

Clip_End [1~10]

Vector with end time of each utterance of the degraded aligned signal

Copyright by Couei Corporation

Page 32

VoIP Features

Chapter 5. Result

MOS Graph
MOS Graph window shows MOS measurement result in bar graph.

Measurement result by Count

MOS Graph (Count) window

Measurement result by Call

MOS Graph (Call) window

Copyright by Couei Corporation

Page 33

VoIP Features

Chapter 5. Result

MOS Signal Graph

MOS Signal Graph window compares changing RF parameters and MOS value in the same time frame.

MOS Signal Graph widnow

Copyright by Couei Corporation

Page 34