MASTER DEGREE REPORT

Monitoring the quality of the radio access

Author: Karim BEN SAID

Academic tutor: Prof. Piero CASTOLDI

Company tutors: Mr. Flavio MURATORE Mr. Sergio BARBERIS September, 2008

Acknowledgments
This work has been accomplished within TELECOM ITALIA LAB and exactly with the Wireless team. Initially, I would like to express my gratitude to my supervisors Flavio Muratore and Sergio Barberis for giving me support, encouragement and information enabling me to carry out this Master training. I would like to thank Prof. Piero CASTOLDI. I would like also to thank all Scuola SantAnnas and University of Tuniss staffs for all the excellent effort they provided to let us finish this master in the best possible conditions.

Karim BEN SAID

Figure List
Fig.1 TEMS POCKET ................................................................................................................................ 6 Fig.2 Nemo Outdoor ................................................................................................................................... 9 Fig.3 OT4x0 and OT4x8 tools .................................................................................................................. 12 Fig.4 Invex3G-PC solution ....................................................................................................................... 14 Fig.5 Block diagram of the novel performance evaluation equipment..................................................... 16 Fig.6 Block diagram of the call test terminal............................................................................................ 17 Fig.8 Block diagram of the control processor of the call test terminal ..................................................... 18 Fig.9 Block diagram of the environment network .................................................................................... 20 Fig.10 System architecture for Invertix solution ...................................................................................... 21 Fig.11 General architecture of NSN solution............................................................................................ 22 Fig.12 Block diagram of the testing device .............................................................................................. 22 Fig.13 Test system in previous solutions .................................................................................................. 23 Fig.14 Test system of SAGEM solution ................................................................................................... 24 Fig.15 Block diagram of a cellular radio communication system adapted to support the Motorola solution.............................................................................................................................................. 26 Fig.16 High-level block diagram of MQoS system level architecture. .................................................... 27 Fig.17 Block diagram of a mobile device ................................................................................................. 28 Fig.18 System Diagram of France Telecom solution ............................................................................... 29 Fig.19 System for monitoring the quality of service in a communication network.................................. 31 Fig.20 General architecture of the wireless communication system ........................................................ 32

Table of contents
1 2 INTRODUCTION............................................................................................................................. 5 COMMERCIAL PRODUCTS ........................................................................................................ 5 2.1 ERICSSON TEMS [2] .................................................................................................................... 5 2.2 ASCOM CARRIER PRODUCTS [3] ............................................................................................. 7 2.3 NEMO TECHNOLOGIES [4] ........................................................................................................ 8 2.4 QUALCOMM CDMA TECHNOLOGIES [5] ............................................................................. 10 2.5 CONDAT NETWORK TEST AND SUPERVISION SYSTEM .................................................. 11 2.6 SAGEM COMMUNICATION TEST TOOLS [6]........................................................................ 11 2.7 NOKIA NETWORK MANAGEMENT SYSTEMS [7] ............................................................... 12 2.8 SWISSQUAL NETWORK MANAGEMENT SYSTEMS [8] ..................................................... 13 2.9 PIXIP XMASS [9]......................................................................................................................... 13 2.10 2.11 3 DEVICEANYWHERE [11]...................................................................................................... 14 INVEX3G [10].......................................................................................................................... 14

PATENTS ........................................................................................................................................ 15 3.1 WILLTECH INTERNATIONAL, INC. [21] ........................................................................................... 16 3.2 MFORMATION TECHNOLOGIES, INC [16]....................................................................................... 18 3.3 INVERTIX CORPORATION [13] ........................................................................................................ 20 3.4 NOKIA SIEMENS NETWORKS [18]................................................................................................... 21 3.5 SAGEM SA [19].............................................................................................................................. 23 3.6 MOTOROLA INC. [17] ..................................................................................................................... 24 3.7 CHRISTOPHER AND GREGORY M.MCGREGOR [15] ........................................................................ 26 3.8 FRANCE TELECOM [12] .................................................................................................................. 28 3.9 TELECOM ITALIA [20] .................................................................................................................... 30 3.10 LG ELECTRONICS INC. [14]........................................................................................................ 31

4 5

MAIN CHARACTERISTICS OF THE EXAMINED PATENTS ............................................. 32 CONCLUSION ............................................................................................................................... 35

1 Introduction
The mobile market is experiencing a continuous growth of competition and consumers have benefited from significantly lowered prices and expanded choices. In this contest quality of services, according to the request / expectative of the users represents a great element that can make the difference, since service providers failing to meet consumers requirements and expectations in terms of quality of services will lose out to their competitors. In order to ensure that quality of service can be monitored correctly, during the last years different systems for monitoring and reporting Quality of Service (QoS) of mobile telecommunications services have been put on the market. In this contest, this document analyzes the state of the art of the monitoring QoS systems for mobile telecommunication systems by exploring the commercial products, the patents made in this domain and presenting the main features of the most important ones. In particular, this report is structured in three main parts. The first one presents the relevant solutions found in the market, the second one gives information about the patents that present some solutions to assure the QoS monitoring and finally, and, in the last one main characteristics of some of the patents studied are highlighted

2 COMMERCIAL PRODUCTS
Monitoring of user experience with respect to the QoS provided by the telecommunications networks and devices the user is attached to, has been recently increased during the last decade, while some monitoring tools are commercially available. All systems presented hereafter have a common characteristic: their target is to help mobile communications operators in running their networks by potentially increasing the system performance and the customer satisfaction. It is worth noting that the information hereafter reported have been extracted by advertisement material and therefore the correctness of the contents is not responsibility of the author but at the sometime can represent an useful view of the commercial tool now available on the market.

2.1 ERICSSON TEMS [2]

Ericsson has presented TEMS, a portfolio of products aiming to provide operators at every stage of network development with solutions that help them maximize the Quality of Service offered to their customers. TEMS products are divided into four main categories: Real-time Diagnostics, Autonomous monitoring, Network performance and Network planning. And, this solution uses essentially the Sony Ericsson mobiles phones. 5

 TEMS POCKET (Real-time Diagnostics) is a mobile terminal with extra features. The terminal is able to display network information, view cell configuration and radio environment measurements and log important network events even while operating as a simple phone.

Fig.1 TEMS POCKET The TEMS Pocket Remote package is a fully integrated test probe for TEMS Automatic. Work-orders sent remotely from the TEMS Automatic central server direct the TEMS Pocket device to silently collect network data wherever the user goes, without ever disrupting the users normal activities. The data is collected at scheduled times, and visualized in TEMS Automatic. Because the network monitoring and data collection functionality is completely unattended, anyone can carry the TEMS Pocket Remote package. Features of the Remote package include: Remote control configuration. Remote control of measurement (voice, idle, and FTP). Use of integrated or external GPS.

TEMS AUTOMATIC (Autonomous Monitoring). TEMS Automatic is a truly autonomous system that gives an overview of network quality as perceived by subscribers, while also providing details necessary for reporting, thorough troubleshooting, and analysis. In the competitive wireless environment, network quality is a key success factor. At the same time, efficient use of resources and personnel is crucial. TEMS Automatic provides round-the-clock measurements without the cost of round-the-clock personnel. It is a complete, comprehensive autonomous solution.

TEMS Automatic is used to:

Automatically collect network data. Test voice and data quality. Reduce churn and increase revenue. Detect faults, capacity bottlenecks, and configuration problems. Gain insight into the end-user perception of the network. Allow field engineers to focus on troubleshooting and fixing errors rather than merely collecting data. Provide continuous feedback on quality of service of the network, as experienced by the customers. Generate analyses for the whole organization. Collect data from competitor networks for benchmarking purposes. Reduce cost.

2.2 ASCOM CARRIER PRODUCTS [3]

QVoice system is a complete test system for mobile networks encompassing data collection, post processing and reporting. It can be used by operators to maintain performance quality, optimization and competitive benchmarking. Since 1993, QVoice is being used for mobile network benchmarking and optimization. It can monitor quality and evaluate network performance in all systems, from 2G voice and 2.5G IP-data to the latest multimedia 3G networks. QVoice implements ITU and ETSI QoS test parameters and recommendations and all user application measurement requirements that range from IP data, SMS and streaming video to e-mail, MMS and video telephony. It is a comprehensive family of tools covering both drive testing and indoor measurements. The System comprises 3 building blocks:

Fleet Manager fleet control and administration QVoice Smart Units (Symbian applications execution
based mobiles phones:

Nokia N95, 6630) measurement

QVoice Presentation measurement analysis and reporting

Fleet Manager is a central administration component of the Symphony product family for controlling a fleet of QVoice Smart measurement units deployed to monitor the Quality of Service in cellular networks. The measurement units can be installed in vehicles, carried around by people using the phones in real-life situations, or permanently fixed at important locations. QVoice Smart provides measurement data of speech quality and performance values on other mobile services such as video telephony, SMS, MMS, HTTP, FTP, ping and WAP. The user interface is a webbased application allowing users to access and control QVoice Fleet Manager from an office desktop PC or notebook. The system can be operated in automatic or manual mode and switched back and forth. Communication between Fleet Manager and the QVoice Smart units is reliable, fast and has low operating costs.

2.3 NEMO TECHNOLOGIES [4]

Nemo Technologies offers tools for network planning, roll-out, tuning, verification, optimization, maintenance, and benchmarking of services, mobile terminals, technologies, or operators. Measurement possibilities vary from detailed info on specific cells to extensive overview of the state of the network. These measurement tools are versatile and evolve with wireless technologies. They are also compatible with mobile terminals and frequency scanners from several manufacturers. Supported wireless technologies include: GSM, HSCSD, GPRS, EDGE, WCDMA, AMPS, IS-136, cdmaOne, CDMA2000, HSDPA, and TETRA. In short, Nemo Technologies can offer a measurement package that guarantees flexible solutions for improving the quality of wireless voice and data networks in both indoor and outdoor environments and that includes two measurement tools, Nemo Outdoor and Nemo Handy, and a front-line analysis tool, Nemo Analyze.

Fig.2 Nemo Outdoor Nemo Outdoor is a portable engineering tool designed for measuring and monitoring the air interface of wireless networks. Fast and accurate measurement data provide detailed information in real time for 2G, 2.5G, 2.75G, and 3G networks. This tool supports more than 30 different test phone terminals on one common software platform. It collects measurement data and geographical coordinates that provide useful information for network planning, roll-out, tuning, verification, optimization, maintenance, and benchmarking purposes. The results can be easily and efficiently viewed with Nemo Analyze SW and as they are saved in an open ASCII file format, they can be imported to third party software applications as well. In general Nemo Outdoor is a powerful drive test tool for wireless network testing and its key features include voice & data testing, scanner measurements, PoC measurements, missing neighbour detection and script files for automated measurements. Nemo Handy is a Symbian-based extremely lightweight and portable engineering tool for measuring and monitoring the air interface of wireless networks. It supports measurements on GSM, GPRS, EDGE, and WCDMA networks. Nemo Handy is a state-of-the-art handheld tool for testing mobile application QoS/QoE and measuring the air interface of GSM/GPRS/EDGE/WCDMA/HSDPA/Wi-Fi 802b/g wireless networks. Nemo Handys extensive application testing features are complete with voice quality MOS testing, and full application level metrics on voice and video calls, FTP/HTTP data transfers, HTML/WAP browsing, SMS/MMS messaging, email POP3/SMTP, and ping. Nemo Handy not only provides the best real-time measurement visualization on the handheld market, it also allows building real-time views for all the 9

relevant network parameters supported by the terminals mobile trace interface. Supported terminals include Nokia N95, N95 US, N80, N75, 6120 and 6121. The test mobile can be used as a regular phone, while Nemo Handy does the measuring in the background. Nemo Handy is ideal for measurements in locations and buildings where big bulky measurement equipment is not a practical solution. Furthermore, Nemo Handy can be equipped with a Bluetooth GPS receiver to collect geographical coordinates. The tool offers also a graphical real-time user interface and during measurements the results and the progress of the measurement process can be easily monitored. Measurement files are produced in a binary file format (.nbl) and they can be converted and imported to Nemo Outdoor and Nemo Analyze as well as to various third party postprocessing/analysis tools. Finally, Nemo Analyze is a post-processing tool for quick and easy data review. It can be used on the field or in the office for immediate problem solving and report generation. Nemo Analyze supports the analysis of all major wireless technologies: GSM, HSCSD, GPRS, EDGE, WCDMA, AMPS, IS-136, cdmaOne, and CDMA2000. Multiple layers in the same graph window offer a convenient way to compare two or more RF parameters simultaneously. Measurement data can be plotted on MapInfo maps. Quality survey reports display important overall statistics, such as, Call Success Rate, Handover Success Rate, and Frame Error Rate, while powerful built-in search facilities make it easy to locate specific events, trends, or problems.

2.4 QUALCOMM CDMA TECHNOLOGIES [5]

QUALCOMM CDMA Technologies (QCT) provides a full suite of tools to support the development and deployment of 3G technologies and products (test phones based on Mobile Station Modem chipsets and performance testing tools that provide diagnostic information and verification of system software). The diagnostic software includes real-time data collection tools, analyzing handset and over-the-air 3G performance system. CDMA Air Interface Tester (CAIT) is a diagnostic application that characterizes performance by measuring real-time, mobile-based CDMA RF characteristics, as well as messaging and protocols. This tool displays statistics and diagnostic information that users can read and write to nonvolatile memory. CAIT is designed to operate in all commercial handsets that contain QUALCOMM ASIC chips (HTC, Motorola, Toshiba, Blackberry, i-mate, Sony Ericsson), as well as in all QUALCOMM test/trial phones, and provides powerful functionality for evaluating handset and network performance in the lab or in the field.

10

2.5 CONDAT NETWORK TEST AND SUPERVISION SYSTEM

Condat developed the Network Test and Supervision System (NTSS) for offering an End-to-End Quality of Service testing solution for mobile networks. NTSS has numerous applications including drive and walk tests, roaming, benchmarking tests, field and laboratory tests truly implementing its end-to-end philosophy, namely to reflect subscribers' network experience. It embraces a wide range of technologies, including GSM/GPRS, 3G and GSM-R, and assesses the applicable features like Voice, SMS, FTP, WAP and MMS as well as new 3G services like Media Streaming and Video Telephony. Test results are produced according to GSM, ETSI, IREG and 3GPP specifications. NTSS system includes the following components: NTSS-walk: a lightweight test system optimized for walk tests (both indoor and outdoor). It includes a GPS receiver for precise location and time stamps. Main features: Benchmarking capability. Wireless system control via PDA. Easy to operate even by inexperienced users. Powerful post-processing capacity available. Assembled using off-the-shelf components. Open SQL database platform. Export of measurement data for evaluation by the back-office Supports ETSI, 3GPP and GSM specifications and recommendations.

NTSS-drive: a compact and powerful drive test solution offering the complete package of GSM, 3G and GSM-R service tests. It offers also the choice of operation in unattended mode. In this case, the system automatically runs long-term test campaigns for specified periods of time (e.g. installed in taxis or metro buses). It includes a GPS receiver for location and precise timestamps.

2.6 SAGEM COMMUNICATION TEST TOOLS [6]

A series of test tools for real time network monitoring and measuring are also produced by Sagem Communication (OT230, OT260, OT290, OT4x0 and OT4x8). These tools are compatible only with GSM and GPRS networks and they give all trace information for investigation or quality monitoring. The GSM/GPRS software provided with the mobile terminal enables visualization, recording and replay 11

of all information. Moreover, measurements made in real time can be stored in the mobile device, while their transfer in a computer is facilitated by an open interface for external trace processing and logging.

Fig.3 OT4x0 and OT4x8 tools

2.7 NOKIA NETWORK MANAGEMENT SYSTEMS [7]

NetAct and Traffica are two extra network management systems developed by Nokia. NetAct provides a future-proof, scalable framework for operating the entire managed network, including GSM/EDGE, GPRS, UMTS, TETRA, Fixed and Broadband Networks. It comprises of six modules: WCDMA Planner, Radio Planner, Link Planner, Transmission Planner, Quality Planner and Rollout Planner. The user-interface is a suite of integrated graphical applications, which can be accessed remotely, bringing all elements of the network together for management purposes. Some of the major features of NetAct are: Monitoring of network performance and operational status. It can manage the complex parameters of radio access networks (2G/3G and TETRA). It offers configurable, automatic upload of measurements from the network, providing operators with an up-to-date picture of the network state and load.

Nokia Traffica, on the other hand, can be used for real time monitoring and troubleshooting of both Mobile and Fixed Networks. It allows operators to oversee the entire network right down to the individual subscriber. Furthermore, it provides end-user-specific, detailed information about successful 12

and unsuccessful call attempts, PDP context activation and location information and it can be used in multi-technology environments by combining into one screen the graphs received from GSM, GPRS or fixed networks.

2.8 SWISSQUAL NETWORK MANAGEMENT SYSTEMS [8]

SwissQual offers an extended suite of network management products including drive-test systems for optimization and benchmarking of GSM, GPRS, EDGE, UMTS, CDMA and TDMA networks, end-toend monitoring systems for speech, data, messaging and video service quality testing on both fixed and mobile networks. Smart-phone based quality assessment probes are used for the measurement of true customer experience. The available products are: QualiPoc: a Smartphone based system for service quality testing and monitoring. With the QualiPoc application loaded on commercial phones supporting the Symbian operating system, testing and monitoring can be executed on a grand scale without any additional hardware or the need for dedicated test mobiles. Automatic mode uses a central Test Manager to remotely control and manage test campaigns as well as the QualiPoc probes. NetQual: a flexible voice, video and data quality test system that enables true end-to-end testing on any type of network. It is used for mobile networks wide monitoring as well as for standalone testing in Labs and R&D centers. Seven.Five: a drive testing system for network optimization and benchmarking. Its flexibility and modularity supports a multitude of test applications for multi-technology environments. All these solutions are provided with a post-processing system NQDI.

2.9 PIXIP XMASS [9]

Xmass, can be used for device testing, cross service testing, multi-tier testing, E2E testing, walk testing, drive testing, mass testing and cross platform testing of several networks (GSM, GPRS, UMTS), services (SMS, WAP, MMS, HTTP, FTP, email), mobile applications (LBS, SMS info services) and mobile content (images, audios, videos). The main features of Xmass include: No dependency on the underlying hardware. It supports mass testing on standard terminals (JAVA J2EE/J2ME devices). A flexible, open system that is based on open technology standards (XML, SOAP and JAVA) and that can be dynamically expanded at any time. 13

 Broad range of testing options (stationary tests, walk tests, drive tests or even on-demand tests in stand-alone mode). GPS support for time and positioning stamping. Mobile device management including functions that report continuously on terminal status, configure and control mobile devices and install the client software OTA (over the air).

2.10 DEVICEANYWHERE [11]

DeviceAnywhere provides developers real-time interaction with handsets that are connected to live global networks. Built on Mobile Completes innovative device interaction technology, Direct-ToDevice, DeviceAnywhere allows connecting to and controlling mobile devices around the world using just the Internet. Through DeviceAnywheres original, non-simulated, real-time platform, it is possible to remotely press buttons, view LCD displays, listen to ringers and tones, and play videos

2.11 INVEX3G [10]

The Invex3G-PC solution supports phones, air cards, digital scanners, and GPS receivers using the manufacturers USB cables and drivers in combination with a Windows XP PC running the Invex3G software. Users of the Invex3GPC solution have access to the full range of Invex3G displays such as data summary, bar charts, state, map, and message windows, as well as technology specific summary and scanner displays. Invex3G-PC produces standard ILF log files supported by leading postprocessing applications including Actix Analyzer, Xceed Technologies WindCatcher, and Qualitest Gladiator.

Fig.4 Invex3G-PC solution 14

Main features: Powerful Invex3G Graphical User Interface. Simultaneous testing of multiple technologies recorded in a single log file. Data task scriptingincluding FTP, HTTP, Mail, and Connect tasks. Supports HSDPA, WCDMA, GSM, GPRS, EDGE, iDEN, EV-DO Rev A, CDMA, and CDMA20001X. Supports phones, air cards, and digital receivers. Produces standard Invex3G ILF log files supported by leading post-processing applications.

Conclusion
In the previous chapter, we have presented the most important systems used to monitor and measure the quality of service in the communications networks. We conclude that these systems allow supporting moreover the most used networks us GSM, GPRS, EDGE, UMTS and CDMA. Also we can divide them into two categories: Drive test systems: they need computer or other equipment connected to the mobile phone to extract the QoS results by using an application installed in the computer and then make a log file containing these results. The log file can then be used on a computer and the results are interpreted by another application containing many features. Real-time QoS monitoring systems: in this case, an embedded application said software agent is installed in the mobile phone. It extracts the QoS parameters and makes internally the treatment to create an adequate file. This file is sent to a server in real time by different means of transport. Then, in the server, the file is treated to have an interpretable result.

3 PATENTS
In this part, the patents related to the QoS monitoring present different architectures and components and use many techniques and methods to transmit the QoS parameters and results. Also, they can support numerous mobiles networks. Besides the knowledge of the characteristics of the main products available on the market it is interesting to provide an overview of the most innovative solutions related to the QoS monitoring in mobile networks. On the base of an accurate survey on the IPR produced during the last few years, it has been selected and shortly described a set of 10 patents that gives an idea of the most advanced concepts in this field. The different architectures and components as well as the techniques to transmit toward a 15

collector the QoS measurement results are briefly presented for each patent and then, the key aspects of each one are summarized in a following table.

3.1 Willtech International, Inc. [21]

METHOD AND APPARATUS FOR AUTOMATIC CALL TESTS IN WIRELESS NETWORK. US 2003/0054811 A1 20/03/2003 Willtech International, Inc.

Problems detected in previous solutions: In a conventional call-testing environment, the procedure to measure, collect, parse, and then manually transfer the network parameters, is entirely manually controlled by the testers operator. Consequently, the conventional call testing methodology is manual intensive, inconvenient and inefficient. Accordingly, there is a need for an improved testing method that substantially obviates one or more problems due to the limitations and disadvantages of the related art. Solution invented: A methodology to automatically measure network parameters relating to wireless network environments is disclosed. First, if a servers telephone number is detected from power-on registration data stored in a storage device, then a connection with the server is attempted through a mobile station with a data service function using the servers telephone number. Thereafter, if there is test plan from the server after the connection is made, the network parameters is measured using another mobile station with a diagnostic monitor function based on the test plan data. The measured network parameters are the collected and parsed to obtain sets of measured network parameters, each set having a different kind of measured data; and the sets of measured network parameters are transmitted to the server using the mobile station with the data service function when there is a data transmission request from the server or it is time for data transmission.

Fig.5 Block diagram of the novel performance evaluation equipment 16

This figure presents a block diagram of the performance evaluation system incorporating therein one or more call test terminals in accordance with the preferred embodiments of the present invention. The call test terminals can be installed in moving objects like vehicle. From these call test terminals, various network parameters relating to the wireless network environment within the service coverage area of multiple base stations can be measured. Thus, the performance evaluation system to automatically measure the network parameters and evaluate the performance of the base stations using the measured network parameters can be performed. According to the preferred embodiments of the invention, where there is a test request from a server module or it is time to start to measure according to test plan that specified from the server, network parameters relating to wireless network environments within the service coverage area of multiple base stations are automatically measured from the call test terminals. After measuring the network parameters, they are automatically sent to server module through a communications network. Therefore, the system does not require operators for the call test terminals; and, thus, it is more efficient, cost-effective and convenient.

Fig.6 Block diagram of the call test terminal

17

The call test terminal includes a control processor, a GPS module, a read only memory (ROM), a random access memory (RAM), a real-time clock (RTC), an uninterruptible power supply (UPS), a watchdog and a reset switch.

Fig.8 Block diagram of the control processor of the call test terminal

The processor includes a main controller, a data communications interface, a GPS interface, a flash memory interface, an accumulator and a DM controller. The main controller is used to control the operation of the entire system as well as the other control processor components. A data bus is used to communicate data and messages among the control processor components.

3.2 Mformation Technologies, INC [16]

SYSTEM AND METHOD FOR DERVICE QUALITY MANAGEMENT FOR WIRELESS DEVICE. WO 2007/016337 A2 08/02/2007 MFORMATION Technologies, INC 18

Problems detected in previous solutions: Conventional methods of monitoring the performance of wireless networks are generally based on client-server approach in which both the client and the server are installed in the same domain. The term domain as used herein is intended to refer to a wireless network operated by one wireless operator. In such a conventional performance monitoring method, service monitoring is initiated by a server that sends instructions to the wireless device to conduct predefined tests. The server receives the results data from these tests and can use the data to monitor performance in the network domain. Any loss of connection during the test is considered a failure and such tests are ignored. This approach requires interaction between the wireless device and a fixed server. However, in wireless network, the assumption that the two ends of the connection (device end and server side) are reachable at all times is not valid. Furthermore, data relating to failed attempts to establish a connection from the wireless device to the server are not measured with these tests. Another drawback to the conventional client-server performance monitoring approach involves mobility. Wireless devices connect to different networks as the user moves. However, the servers, which initiate the tests in conventional performance monitoring systems, are fixed and are associated with specific domains and cannot operate across multiple domains. Therefore, the server can only collect preference data when the wireless device and the server are connected to the same network. When a user moves to a different network, the performance-monitoring server may not accessible to the wireless. Solution invented: A system and method for detecting and recording events related to the quality of service experienced by a wireless device in a wireless network. In one example, these events may be detected and recorded by the wireless device, without support from the network. A device agent is constructed and arranged to interface with software on the wireless device to detect and record these events. Performance monitoring tests may be initiated by the wireless device at the direction of a management server, independent of the network in which the device may be operating. The wireless device may store the results of these tests and report the results to the management server.

19

Fig.9 Block diagram of the environment network

3.3 Invertix Corporation [13]

METHOD AND SYSTEM OF MEASURING DATA QUALITY OF SERVICE ON A WIRELESS NETWORK USING MULTIPLE REMOTE UNITS AND A BACK END PROCESSOR. WO 01/72058 A2 27/09/2001 Invertix corporation

Problems detected in previous solutions: The general deficiency with the tools already invented is that they were primarily developed to measure voice quality and RF parameters over the wireless system and not to measure data quality. Some of them have been modified to include some rudimentary data measurements; however, they arent optimized for performing wireless data measurements. In particular, they dont allow unattended measurement of wireless data from multiple remote units in a statistically significant manner with remote control from a back end processor. Solution invented: The present invention provides for a method and a system for measuring data quality of service in a wireless network using multiple peripatetics and stationary, unattended, position, and performance instruments (PUPPI) that are remotely controlled by a back end processor. In some embodiments of the invention, the data service whose quality is measured relates to wireless internet access, e-commerce transactions, wireless messaging, or push technologies. In other embodiments of the invention, the

20

system includes an element that is located within the wireless network infrastructure, for example at the WAP gateway to monitor the wireless data protocol and to perform benchmarking measurements. The system includes multiple remote units that are unattended and are remotely controlled by a back end processor. This allows for a large quantity of measurements to be taken in a fully automated manner. An objective of the invention is to collect a variety of different types of measurements such as latency measurements, reliability (BER/FER), layer 3 network information, RF information, and call connection information.

Fig.10 System architecture for Invertix solution

3.4 Nokia Siemens Networks [18]

TESTING DEVICE AND SOFTWARE US 7257378 B2 14/07/2007 Nokia Siemens Networks (FI)

Problems detected in previous solutions: Data transmission rate variations caused by data network load in particular can considerably decrease the quality of a signal or cut off the connection completely. A partial or complete failure of base station transmitters can also easily remain undetected in prior art solutions and cause great problems to users in that the signal disappears or its quality decreases.

21

Solution invented: The invention relates to a testing device and a software. The cellular radio system comprises a testing device that is a fixed part of the cellular radio system and operationally connected to a data network. The testing device has a connection over radio path to one or more base stations, and the operational condition of the cellular radio system is examined by means of the testing device by utilizing the radio connection of the testing device to at least one base station. In addition, the data network is utilized.

Fig.11 General architecture of NSN solution

Fig.12 Block diagram of the testing device 22

3.5 Sagem SA [19]

TEST SYSTEM FOR CELLULAR RADIOTELEPHONE NETWORK USING POSITIONING IN REAL-TIME OF THE INFORMATION NOTED. FR 2 820 595 B1 31/12/2004 SAGEM SA

Problems detected in previous solutions: To measure the quality of service and the coverage of a wireless network, the operators use test units containing a radiotelephone mobile (M) and a terminal (TI). Also, they need the position of the mobile using GPS positions (P) like it is in the figure. So, the terminal TI collects the GPS positions and the data from the mobile. But the problem is detected when the operator makes the correspondence between the two data. There is usually a delay in the time of them due to the exact time of taking the position and the QOS data.

Fig.13 Test system in previous solutions Solution invented: Test system for network of radio cellular telephony comprising on the one hand at least a mobile terminal of test and means of storage and/or treatment to which this mobile terminal is connected and transmits information of trace, and on the other hand a device of measure of location, characterized in that the aforementioned device of measure of location is connected to the mobile terminal of test and in what the aforementioned mobile terminal of test comprises of the means to generate a sequence of information of trace in which information of position is inserted as they are transmitted to the mobile terminal of test by the device of means and measure of location to transmit this sequence of information

23

to the means of storage and/or treatment by preserving the order of information of the aforesaid the sequence.

Fig.14 Test system of SAGEM solution

3.6 Motorola Inc. [17]

COMMUNICATION SYSTEM AND METHOD FOR END-USER QoS PERFORMANCE MONITORING GB 2 401 283 A 03/11/2004 Motorola Inc.

Problems detected in previous solutions: The traditional procedures used for monitoring and measurement tasks on mobile communications networks tend to be focused on the overall network quality, i.e. they are based on per network element statistics. Current network monitoring procedures include: -Test transactions from a Mobile station (MS): A test MS is configured to transmit a specific communication, say at a particular location, and the performance of the communication is measured. This method is typically used to identify areas of poor coverage and quality of service, so that the network operator can improve the quality of service in that particular geographical area. Such a test transaction technique is used to verify how the call is handed over between cells.

24

- Test Transaction from a test program: Some IP products execute test transactions in order to measure, store and generate reports about the network and service performance like measuring the quality of a file transfer across a communication link. These two monitoring procedures are invariably used over a limited coverage area. Furthermore, they are typically performed from static locations. In addition, these measurements are rarely employed in real user environment, such as in-building coverage. Therefore, such procedures dont reflect the actual QoS that the user is obtaining from the network. Further monitoring procedures are used after that like: - Statistics measurement and reporting by network elements on a per-packet data protocol (PDP) context basis. - Monitoring agents exist on fixed network devices and end-user terminals. A very known disadvantage of these procedures is that the user data that passes through a SGSN and a GGSN is embedded in the message, i.e. It is embedded in accordance with the GPRS Tunnelling Protocol (GTP) standard. Hence, the real user-traffic is never observed by these Network elements (NEs). Solution invented: A wireless communication system (100) comprises at least one mobile wireless communication unit (105) having a transmitter and an application monitoring agent (108) operably coupled to the transmitter and configured to collect and transmit application-based statistics relating to one or more applications employed by the at least one mobile wireless communication unit (105). A network element (145) comprises a receiver, for receiving the transmission of application based statistics from the at least one mobile wireless communication unit and a signal processor configured to determine a quality of service being provided to the mobile wireless communication unit based on the statistics. A method for end-user QoS performance monitoring in a wireless communication system (100) and a management station therefore are also provided.

25

Fig.15 Block diagram of a cellular radio communication system adapted to support the Motorola solution

3.7 Christopher and Gregory M.McGregor [15]

METHOD ANS SYSTEM FOR QUALITY OF SERVICE MONITORING FOR WIRELESS DEVICES US 2004/0058652 A1 25/03/2004 Christopher M.McGregor. Problems detected in previous solutions: Mobile network operators monitor QoS to manage network performance from a mobile infrastructure perspective. Others have attempted to measure QoS performance using available technologies that measure from the base station, terrestrial networks linking the base, UTRAN controllers, gateways to the core, the core itself, remote peripheral networks (fixed and mobile) and IT infrastructure. Others have provided solutions for QoS monitoring of packet-based transmission infrastructure. 3GPP, 3GPP2, TMF, e TOM, ETSI, QOS Forum, Eurescom, ETR and ITU, among others have outlined specifications for taking QoS measurements from the mobile infrastructure. While, fixed line and server based QoS technology solution space is a mature market, a general knowledge of these technologies is important to expand common methodologies into the packet-based wireless QoS technology space, especially in view of monitoring QoS across the mobile environment, and particularly at the mobile device level. Further, integrating handled level QoS monitoring into existing systems requires that the QoS monitoring method operate with existing network systems and integrate with existing wireless standards such as 3GPP to ensure a high level of QoS. 26 and Gregory

Therefore, what is needed is a method and system to monitor QoS in networks including mobile devices without reducing communication efficiency and increasing cost and complexity for mobile network operators and companies. Solution invented: In one embodiment, the present invention provides a method to monitor the health of 3G mobile devices and provide a status check of such health to network technicians, supervisors, and management. In one aspect, mobile devices on the network perform measurement of MQoS (mobile QoS) factors that are reported to a quality of service backend. The MQoS data is combined to show current and historical network status. In another aspect, alarms may be set to notify specific managers when manager programmable conditions occur, such as low system performance, or specific error conditions occur. Reports may be generated summarizing and illustrating performance in tabular and graphical form. Parameters used for testing and monitoring mobile devices may be input to specific mobile devices or groups of mobile devices in a system. In one aspect, customer care or call centers may be enabled to request specific test from specific mobile devices and utilize the overall network status to diagnose and resolve customer issues.

Fig.16 High-level block diagram of MQoS system level architecture.

27

Fig.17 Block diagram of a mobile device

3.8 France Telecom [12]

CONTROLLING QUALITY OF SERVICE IN COMMUNICATIONS NETWORKS WO 2008/077886 A1 03/07/2008 FRANCE TELECOM

Problems detected in previous solutions: Different architectures have mostly common QoS reservation and control requirements. So, the protocols and mechanisms chosen to implement QoS control are quite different. Since all such architectures also require some form of mapping and attachment with call and non-call session based signalling, providing QoS services can be complicated and costly due to the requirement for all nodes and endpoints to support various different protocols and mechanisms. It would thus be desirable to provide QoS services in communication networks with reduced complexity and cost. Solution invented: A method for controlling Quality of service (QoS) in a communications session between two endpoints, said communications session comprising transfer of Session initiation Protocol (SIP) session control signalling information, said SIP session control signalling information relating to media data to be communicated between said two endpoints, said method comprising the steps of receiving QoS information at a QoS provider node using transfer of SIP signalling information, said QoS provider node 28

being responsible for controlling QoS services in a communications network through which said media data is to be communicated; and in response to receiving said QoS information at said QoS provider node, allocating a level of QoS for said media data to be communicated between said two endpoints.

Fig.18 System Diagram of France Telecom solution

An endpoint 14 located in one communication network 42, wishes to communicate with another endpoint 14 located in another communication network 44. In this example, networks 42 and 44 are access networks in which endpoints 14 and 16 connect to their respective service providers. Access networks 41 and 44 are connected by a core network 46 via gateways 34 and 38. Elements 50, 52 and 54 are QoS provider nodes, each responsible for controlling QoS services on behalf of endpoints 14 and 16 respectively and provide network transport and policy control functionality. Each of the access networks 42, 44 and the core network 46 contain QoS provider nodes 50, 52 and 54 respectively, which are responsible for controlling QoS services in each network.

29

3.9 Telecom Italia [20]

SYSTEM FOR MONITORING THE QUALITY OF SERVICE IN A COMMUNICATION NETWORK WO 2006/070218 A1 06/07/2006 TELECOM ITALIA

Problems detected in previous solutions: With the outcome and development of telecommunications networks of the mobile type (GSM, GPRS, UMTS, and WLAN), the variety and number of voice, data, multimedia services that a service provider/operator is able to offer to its customers is constantly growing. For a service operator, being able to obtain an accurate and reliable monitoring of the quality of service level offered to users is thereby more and more a major need. The methodologies and techniques in use have fundamentally been based: - On measurement campaigns under artificial traffic conditions, conducted using terminals and/or specialized equipment (whose characteristics are not always equivalent to the commercial mobile radio terminals utilized by users), with obvious deficiencies from the viewpoint of flexibility and accuracy, and with high costs, due to the continuous employment of specialized personal and to the additional generated traffic. -On QoS measurement and management techniques based on terminal and network measurements which are typical of the quality and operating conditions of radio access, used also for the optimized management of handovers and of radio resources, such as measurements of transmitted or received power, BER, spectrum, interference on uplink and downlink channels, often, though erroneously, called QoS measurements. These measurements indirectly increase the offered quality level, but are not capable of directly evaluating it in the quantitative and qualitative sense in relation to the quality perceived by the user. - On monitoring, under actual traffic conditions, the performance of shared network and link resources at the transport level (normally carried out by the mobile radio operator with internal or external measures, taken by sampling or total with counter, but almost never inclusive of the terminal and hence not end to end and not at application level), with evident limits to the ability to correlate said measures to the communication quality actually perceived by the user, also deriving from the difficulty of activating coordinated measuring campaigns in the network on a call and/or service session basis. 30

Solution invented:

Fig.19 System for monitoring the quality of service in a communication network Monitoring system comprising a set of peripheral monitoring agents including processing functionalities housed in SIMs. Such processing functionalities, depending at least on operating conditions of each terminal and its respective SIMs, are able to adaptively establish a distribution of measuring functionalities included in the peripheral monitoring agents between the terminal itself (for example storing them in the related memory or multimedia card) and its respective SIM.

3.10 LG Electronics Inc. [14]

METHOD OF REPORTING CHANNEL QUALITY IN EGPRS SYSTEM US 2008/01/65696 A1 Solution invented: It is a method of enabling a mobile station to report channel quality in a wireless communication system. The method includes receiving a radio block allocated for a control block, the control block comprising a header and a control message, the header comprising an identifier, measuring channel quality for the radio block allocated for the control block when the identifier identifies the mobile station, and reporting the channel quality. A mobile station can report channel quality for its own control block. 10/07/2008 LG Electronics Inc.

31

Fig.20 General architecture of the wireless communication system

4 Main characteristics of the examined patents

The patents discussed in this chapter presents many differences such as how the architecture of the system is added to the communications networks and in the diagrams of theirs components essentially in the mobile phone used to achieve the measurement. Besides, in the mobile unit, they can include the GPS (Global Positioning System) module that allows the system to link each measure to a specific position. So, the operator can have a plan of the city/town presenting the QoS parameters of each region defined by the GPS positions. Patent: Applicants/Inventors Willtech International, Inc. -Automatic call test reporting. -When there is a test request from a server module or it is time to start a measure campaign, the system does not require operators for the call test terminals - Very detailed architecture of the test terminal. - Test terminals are dedicated to the system only. - Test terminal are not useful for others activities. 32 Main characteristics

MFORMATION Technologies, INC

- Multi-domain service quality management. -Data related to failed attempts to establish a connection from the wireless device to the server are measured in the tests. - Use of a device agent constructed and arranged to interface with software on the wireless device to detect and record performance data relating to the network.

Motorola Inc.

- The system allows to route end-user QoS application data to a management APN (access point name). This data can then be used to improve other system functions such as monitoring and reporting SLAs (service level agreement). - Monitoring and logging of geographical areas where there is a loss of network coverage. - The QoS performance statistics are obtainable irrespective of where the Mobile is located, for example even when it has roamed into visited networks. Monitoring some applications running on the wireless communication unit like FTP, HTTP, and WAP. - Applied only on UMTS/GPRS networks.

Nokia Siemens Networks

- The monitoring system is used to the indoor environments. - The connection between the testing device and a base station is arranged by using packet or circuit switched mode. -The testing device can perform a forced handover to another base station to test the handover functions of the radio system. - Failed tests are transmitted to the network element responsible of collecting reports. - The testing device can reduce the transmission power and monitor the sensitivity and operational conditions of the receiver of the base station. - The testing device is a fixed part of the monitoring system because it should be in a location where electrical power can easily be arranged for the device.

33

Christopher and Gregory - Multi-tier architecture. M.McGregor. -After validating the data received from the testing device, the server provides alerts to technicians and reports to supervisors and management services. - The monitoring system can also be configured for other embodiments to enhance the mobile users experience and help improve customer care (including a virus protection program). -Use of SOAP protocol to manage the access to the collected statistics and to control the monitoring system. - The Client software can be stored in a memory module or in a SIM module. - As the number of simultaneous client requests to the server increases, the server can become severely overloaded. FRANCE TELECOM - Use of Session Initiation Protocol (SIP) to perform the transfer of data between the two endpoints of the system. - The communications network used by the monitoring system must comprise an Internet Protocol Multimedia Subsystem (IMS) architecture. Telecom Italia -The software agent can be stored in the mobile terminal or in the SIM card or divided between the two components. - The JADE technology is used to develop the software agent that is used to develop distributed applications of the peer-to-peer type. -Communication between agents can use different transport techniques that can be selected according to the detected operating conditions (TCP/IP, SMS) to minimise the impact on the network load. -Possibility to remote update of software applications installed in the terminals. -The monitoring system allows performing measures both by the service provider and by the user of the terminal. -The MS can be used, through an ad hoc interface API development, with operating and development environments of fixed networks (LAN, MAN and WAN) and wireless networks (W-LAN). -The MS can operate in multi-standard environments on board 34

multimode terminals. Table: Main characteristics of QoS monitoring patents

5 Conclusion
The mobile market works towards technologies and standards that will allow the optimal use of services and heterogeneous networks with a measurable Quality of Service. Many valid approaches in this direction are taking into account all involved elements, that are applications, terminals, on the networks and the server side. These approaches will enable players in the mobile arena to collect and analyze mass data in order to enable the creation of new kind of services and to identify the perceived Quality of Experience of the mobile end-user. By exploring the market of Quality of Service monitoring solutions, it comes out that the most used systems in this field are those destinated to the drive test components (this mainly for their intrinsic simplicity with respect to the software agents based monitoring products). The solutions based on remote software agents are not so widely used in the market although many patents are present in which are defined different architectures and solutions resolving the end-to-end QoS monitoring problems. In this perspective, more researches and investigations must be done to further investigate the issues related to the use of remote software agents and to facilitate the implementation of the different architectures identified in this paper.

35

Bibliography
[1] [2] [3] [4] [5] [6] [7] [8] [9] < www.wipo.int >. < www.ericsson.com >. < http://www.ascom.fr/fr/index-fr/products-solutions >. < http://www.anite.com >. < www.qualcomm.com >. < http://www.sagem-communications.com >. < www.nokiasiemensnetworks.com >. < http://www.swissqual.com/Autonomous_Service_Monitoring.aspx >. < http://www.pixip.net >. 1206420_13488.html > [11] < www.deviceanywhere.com >. [12] France Telecom (France). Controlling quality of service in communications networks. 03/07/2008. Patent N WO 2008/077886 A1. [13] Invertix Corporation (USA). Method and system of measuring data quality of service on a wireless network using multiple remote units and a back end processor. 27/09/2001. Patent N WO 01/72058 A2. [14] LG Electronics Inc. Method of reporting channel quality in EGPRS system. 10/07/2008. Patent N US 2008/01/65696 A1 [15] Christopher and Gregory M.McGregor (USA). Method and system for quality of service monitoring for wireless devices. 25/03/2004. Patent N US 2004/0058652 A1 [16] MFORMATION Technologies, INC (USA). System and method for device quality management for wireless device. 08/02/2007. Patent N WO 2007/016337 A2 [17] Motorola Inc (UK). Communication system and method for end-user QoS performance monitoring. 03/11/2004. Patent N GB 2 401 283 A
36

[10] <http://www.commscope.com/andrew/eng/product/network/3g/

[18] Nokia Siemens Networks (USA). Testing device and software. 14/07/2007. Patent N US 7257378 B2. [19] SAGEM SA (France). Test system for cellular radiotelephone network using positioning in real-time of the information noted.31/12/2004. Patent N FR 2 820 595 B1. [20] TELECOM ITALIA S.p.A (Italy). System for monitoring the quality of service in a communication network. 06/07/2006. Patent N WO 2006/070218 A1. [21] Willtech International, Inc (USA). Method and apparatus for automatic call tests in wireless network. 20/03/2003. Patent N US 2003/0054811 A1.

37