Latency minimization in data communication

Presented By: Ishita Akhter Date: 11/07/2013

Presentation topics
Introduction: Latency Overview

Latency Sources
Latency background Latency research motivations The research project

Intended timeline
Tasks performed Current simulation setup Observations

Discussions
Future targets Conclusions References

Introduction: Latency Overview

Definition

Delay between a command and corresponding reaction

Prominently used in Psychology, Biology, Computer Science, Communication Networking etc. Focus of current discussion is Communication Latency The time duration of exchanging a packet (APDU) within a communication network One-way delay or RTT (Round Trip Time) Example evident inSlow audio/video transmission, late response in gaming commands, delayed arrival of data files etc.
Source: o D. Delaney, T. Ward and S. McLoone, "On consistency and network latency in distributed interactive applications: A survey-Part I," Presence: Teleoperators & Virtual Environments, vol. 15, no. 2, pp. 218-234, 2006.

Latency Sources

Figure: Communication network scenario

Processing Delay: Preparation time on each arriving packet, before being queued (Typically within s range) Queuing Delay: Waiting time for processed packet to be transmitted into the physical link (Expressed as, QD = Used memory , Typically within s - ms range) Packet processing speed

Transmission delay: Transfer time for all bits of a packet into the start of physical link (Expressed as, TD
= 1 , Typically within s - ms range) Interface speed

Propagation delay: Travelling time for packet all through the physical link towards destination node (Expressed as, SPD = Packet travelling distance , Typically within ms range) Propagation speed

Source: o J. F. Kurose and W. R. Keith, Computer Networking: A Top-Down Approach, Essex: Pearson, 2013. o ONPATH Technologies, "White Papers - Physical layer switching," 2013. [Online]. Available: http://www.onpathtech.com/assets/WhitePapers/ONPATHLatencyWP.pdf. [Accessed 20 6 2013].

Latency background
Earliest latency observationdelay in repetitive sound generation of volcano eruptions (1912 1916) Latency observation within circuit-switched telephone networks (1930s 1960s) Latency investigation in packet-switched communications (1970s present) Network performance issues over the last thirty years

Table: Comparison of network performance issues

Recent latency-oriented researches focus on measurement, estimation, possible solutions etc.

Latency research motivations

Latency effects Reduced efficiency in real-time interactivity Data congestion and loss of information Complicates relevant system/application design Overall network performance degraded Less favourable user experience General latency improvement policies Better hardware with lesser processing times Congestion control mechanisms to downsize queuing Better compression techniques for faster transmission

Relocating network equipment to reduce propagation time

Latency research motivations (cont.)

Latency investigation schemes End-to-end latency measurements Wireless network latency estimations Online gaming latency dimensions Miscellaneous latency observations (IPV6, channel, positioning, satellite, telemedicine etc.)

Significant latency improvement initiatives Remote access latency minimization Mobile environment latency improvements Packet-switching latency enhancements

Developing low-latency communication mechanisms/systems

Latency research motivations (cont.)

Latency-based research mostly around layer- 3 (Network layer) Insignificant latency observation for layers 1 & 2 (physical & data link layer) Effects on latency with physical layer modulation schemesunexplored initiative in physical layer Latency by MAC header processing-not observed for data link layer Latency due to data coding techniques-still offering scopes of in-depth observations

Not enough attempts to relate energy consumption and latency Not enough observation of individual layer latencies

The research project

Project title Latency minimization in data communications Primary directive Investigating latency in first 3 OSI reference model layers Initial attempt Spectral efficiency & latency relation in physical layer Simulator tool Simulink by Mathworks

Intended timeline

Research directives Literature review on communication latency in OSI layers Selecting research project focus areas and finalizing on tasks & tools to be used Building-up skills on software for system simulations, e.g. Simulink Designing & simulating systems on different modulation schemes Experimenting with the developed systems, possible paper publication Preparation for the PhD conversion

Timeline Month(s) 1- 2: (November 2012 December 2012) Month(s) 3 - 4: (January 2013 February 2013) Month(s) 5 - 6: (March 2013 April 2013) Month(s) 6 - 10: (May 2013 August 2013) Month(s) 11- 12: (September 2013 October 2013) Month(s) 13: (November 2013)

Tasks performed
Literature review on latency publications Research project defining Finalizing on tasks & tools Building-up software skills Designing & simulating on different modulation schemes

Experimental setup

System components: Source, transmitter, ideal/noisy channel, receiver, destination, result scopes, BER calculator and delay calculator Simulated systems: OOK, ASK, BPSK & BFSK

Experimental setup (contd.)

Transmitted modulated signal (), 1 = 1 0 (), 0 Signal passes through communication channel, reaches receiver side as received signal , = , = noise signal + , is multiplied with a reference unit-energy wave = 1 () 0 (), to become = Integrating for the period (0, Tb), where Tb = bit transmission time, to get signal, = 0 Integrated signal passes through the decision device, compared to threshold if > , bit detected as 1 and if < , bit detected as 0
Source: o R. C. T. Lee, M. C. Chiu and J. S. Lin, "Digital Modulation Techniques," in Communications Engineering: Essentials for Computer Scientists and Electrical Engineers, 2008, pp. 135-188. o D. Silage, "Bandpass Modulation and Demodulation," in Digital Communication Systems Using MATLAB and Simulink, Bookstand Pub., 2009.

Observations

Figure: Example of delay comparison

Observations (contd.)
Initial observation Component-by-component approach showing delay for ideal/noisy channels Non-coded information transmission/reception performed for single-level modulation schemes

Delay seen at demodulation, specifically just before integration Simulating with ideal software blocks provide no delay Further results expected with ongoing system-build up using higher order modulations

Discussions
Modulation scheme OOK ASK BPSK BFSK Constellation points (M= 2k) 2 2 2 2 Bit transmission rate (k) 1 1 1 1 Spectral efficiency (bps/Hz) 1 1 1 1 Delay (Samples) 1 1 1 1

Systems simulated have the same spectral efficiency, exhibiting same amount of delay Same results obtained for both noisy/ideal channels (component-by-component approach) Delay possibly in order to detect transient behaviour of incoming signal Default simulator blocksets solve systems ideally with numerical method Further designs are being developed with modulation schemes having higher spectral efficiencies and additional coding components
Source: o S. Tomazic, "Spectral Efficiency," in Encyclopedia of Wireless and Mobile Communications, 2008, pp. 10951099. o Mathworks, Simulink documentation, 2012.

Future targets
Latency observation by Building higher-order modulation systems & observing spectral efficiency and latency relation Inclusion & observation of latency in MAC layer processing

Observation of system energy consumptions in relation with latency

Relate above observations with established findings on network layer

Conclusion
Addressed issues so far
Defined latency, its sources Provided latency research background/history Explained latency-based research motivations Summarized the research project, along with intended workplan/timeline Elaborated on tasks performed Explained experimental setup, observations and related discussions Described future targets within the scope of the project

Thank you

Questions/comments??

References
[1] D. Delaney, T. Ward and S. McLoone, "On consistency and network latency in distributed interactive applications: A survey-Part I," Presence: Teleoperators & Virtual Environments, vol. 15, no. 2, pp. 218-234, 2006. [2] S. K. Singhal and M. Zyda, Networked virtual environments, New York: ACM Press, 1999. [3] J. Smed, T. Kaukoranta and H. Hakonen, "Aspects of networking in multiplayer computer games," Proceedings of International Conference on Application and Development of Computer Games in the 21st Century, pp. 74-81, 2001. [4] A. Dutta-Roy, "The cost of quality in internet-style networks," IEEE Spectrum, vol. 37, no. 9, pp. 57-62, 2000. [5] M. Meehan, S. Razzzaque, M. C. Whitton and F. P. J. Brooks, "Effect of latency on presence in stressful virtual environments," Virtual Reality (VR 03), pp. 141-148, 2003. [6] E. S. H. Tse-Au and P. A. Morreale, "End-to-end QoS measurement: Analytic methodology of application response time vs. tunable latency in IP neworks," IEEE/IFIP Network Operations and Management Symposium (NOMS 00), p. 129142, 2000. [7] J. M. Pullen and D. C. Wood, "Network technology and DIS," Proceedings of the IEEE, vol. 83, no. 8, pp. 1156-1167, 1995. [8] M. Shafahi and C. de Laat, "Time Sensitive Application Transport," 2012. [9] J. F. Kurose and W. R. Keith, Computer Networking: A Top-Down Approach, Essex: Pearson, 2013. [10] O3b Networks, "What is Network Latency and Why Does It Matter?," O3b Networks, 2008.

References
[11] ONPATH Technologies, "White Papers - Physical layer switching," 2013. [Online]. Available: http://www.onpathtech.com/assets/WhitePapers/ONPATHLatencyWP.pdf. [Accessed 20 6 2013]. [12] Cisco Systems, Inc., "Design Best Practices for Latency Optimization," Financial Services Technical Decision Maker White Paper, 2007. [13] J. Emling and D. Mitchell, "The Effects of Time Delay and Echoes on Telephone Conversations," Bell System Technical Journal, vol. 42, no. 6, pp. 2869-2891, 1963. [14] R. Goonatilake and R. A. Bachnak, "Modeling Latency in a Network Distribution," Network and Communication Technologies, vol. 1, no. 2, pp. 1-11, 2012.

[15] S. Rumble, "It's time for low latency," Proceedings of the Thirteenth Workshop on Hot Topics in Operating Systems (HotOS 2011), 2011.
[16] P. M. Sharkey, M. D. Ryan and D. J. Roberts, "A local perception filter for distributed virtual environments," Virtual Reality Annual International Symposium (VRAIS 98), pp. 242-249, 1998. [17] C. N. Chuah, "Providing End-to-End QoS for IP based Latency sensitive Applications," Dept. of Electrical Engineering and Computer Science, University of California at Berkeley, 2000. [18] C. Diot and L. Gautier, "A distributed architecture for multiplayer interactive applications on the internet," IEEE Network, vol. 13, no. 4, pp. 6-15, 1999. [19] M. Lum, J. Rosen, H. King, D. Friedman, T. Lendvay, A. Wright, M. Sinanan and B. Hannaford, "Teleoperation in surgical robotics network latency effects on surgical performance," in Proceedings of Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2009. [20] S. Cheshire, "Latency and the quest for interactivity," A white paper commissioned by Volpe Welty Asset Management, L.L.C., for the synchronous person-to-person interactive computing environments meeting, 1996.

References
[21] M. Wloka, "Lag in multiprocessor VR," Presence: Teleoperators and Virtual Environments, vol. 4, no. 1, pp. 50-63, 1995. [22] P. Smulders, "Exploiting the 60 GHz band for local wireless multimedia access: prospects and future directions," IEEE Communications Magazine, vol. 40, no. 1, pp. 140-147, 2002. [23] S. Tomazic, "Spectral Efficiency," in Encyclopedia of Wireless and Mobile Communications, 2008, pp. 1095-1099. [24] C. Fraleigh, F. Tobagi and C. Diot, "Provisioning IP backbone networks to support latency sensitive traffic," in Proceedings of Twenty-Second Annual Joint Conference of the IEEE Computer and Communications. IEEE Societies, 2003.

[25] S. Larsen, P. Sarangam and R. Huggahalli, "Architectural Breakdown of End-to-End Latency in a TCP/IP Network," in 19th International Symposium on Computer Architecture and High Performance Computing, 2007.
[26] J. Kim and J. Yi, "A pattern-based prediction: An empirical approach to predict end-to-end network latency," The Journal of Systems & Software, vol. 83, no. 11, pp. 2317-2321, 2010. [27] S. Sundaresan, W. De Donato, N. Feamster, R. Teixeira, S. Crawford and A. & Pescap, "Broadband Internet Performance: A View From the Gateway," in Proceedings of the ACM SIGCOMM 2011 conference, 2011. [28] J. Kim, J. Yi and H. H. Park, "A Case Study on Oscillating Behavior of End-to-End Network Latency," in Proceedings of The International Conference on Information Networking (ICOIN), 2012. [29] I. Maric, "Low latency communications," in Proceedings of Information Theory and Applications Workshop, San Diego, CA, 2013. [30] R. C. L. Gmez, P. Marti, M. Velasco and J. Fuertes, "Wireless Network Delay Estimation for Time-Sensitive Applications," Automatic Control Department, Technical University of Catalonia, Catalonia, 2006.

References
[31] K. Xu, D. Bin, F. Zhang, B. Huang and B. Zhang, "Latency Estimation for Time-Sensitive Applications under Wireless Network Coding Scheme," in Proceedings of International Conference on Communications and Mobile Computing, 2009. [32] D. Marshall, B. Mooney, S. McLoone and T. Ward, "An Unobtrusive Method for Tracking Network Latency in Online Games," in Proceedings of China-Ireland International Conference on Information and Communications Technologies, 2007. [33] S. Agarwal and J. R. Lorch, "Matchmaking for Online Games and Other Latency-Sensitive P2P Systems," in Proceedings of the ACM SIGCOMM 2009 conference on Data communication, 2009. [34] L. M. M. &. R. E. S. Kayili, "Abnormal group delay and detection latency in communication systems," in Antennas and Propagation Society International Symposium, 2010. [35] F. Ping, C. McConnell and J. H. Hwang, "A Retrospective Approach for Accurate Network Latency Prediction," in Proceedings of 19th International Conference on Computer Communications, 2010. [36] A. Berger, "Comparison of Performance over IPv6 versus IPv4," Akamai Technologies, 2011. [37] L. B. Ping, C. P. Kit and E. K. Karuppiah, "Network Latency Prediction Using High Accuracy Prediction Tree," in Proceedings of the 7th International Conference on Ubiquitous Information Management and Communication, New York, 2013. [38] W. Sun, N. Shibata, K. Yasumoto and M. Mori, "A Method for Overlay Network Latency Estimation from Previous Observation," in Proceedings of The Twelfth International Conference on Networks, Seville, 2013. [39] J. Nieplocha, V. Tipparaju, M. Krisnan, G. Santhanaraman and D. Panda, "Optimizing mechanisms for latency tolerance in remote memory access communication on clusters," in Proceedings of IEEE International Conference on Cluster Computing, 2003. [40] M. Nussle, M. Scherer and U. Bruning, "A Resource Optimized Remote-Memory-Access Architecture for Low-latency Communication," in Proceedings of International Conference on Parallel Processing, Vienna, 2009.

References
[41] P. Berndt, "Crowd buzz: scalable audio communication for MMVEs using latency optimized hypercube gossiping," in Proceedings of IEEE International Workshop on Haptic Audio Visual Environments and Games, Hebei, 2011. [42] V. Govindaswamy, G. Zaruba and G. Balasekaran, "A QoS scheme to address communication latency issues for critical network flows in besteffort networks using mobile agents," in Proceedings of Canadian Conference on Electrical and Computer Engineering, 2004. [43] J. Raiyn, "A Novel Handover Scheme Based on Adaptive Agent for Reducing Real-Time Communication Latency in Automation Environment," in Proceedings of Tenth International Conference on Computer Modeling and Simulation, Cambridge, 2008. [44] X. Chen, W. Wang and G. Wei, "Reducing Web Latency in Mobile Network," in Proceedings of 8th IEEE/ACIS International Conference on Computer and Information Science, Shanghai, 2009. [45] Y.-L. Chen and S.-L. Tsao, "A Low-Latency Scanning with Association Mechanism for Real-Time Communication in Mobile WiMAX," IEEE Transactions on Wireless Communications, vol. 11, no. 10, pp. 3550-3560, 2012. [46] N. Calabretta, S. Di Lucente, Y. Nazarathy, O. Raz and H. Dorren, "Scalable optical packet switch architecture for low latency and high load computer communication networks," in Proceedings of 13th International Conference on Transparent Optical Networks, Stockholm, 2011. [47] C. Xin, H. Qiao-lin, L. Hao, X. Ge-Ming and L. Jun, "ILACF: An Incentive-Based Low-Latency Anonymous Communication Framework," in Proceedings of The 11th IEEE International Conference On Trust, Security And Privacy In Computing And Communications, Liverpool, 2012. [48] F. Nagase, T. Hiraguri, K. Nishimori and H. Makino, "Web Acceleration by Prefetching in Extremely Large Latency Network," American Journal of Operations Research, vol. 2, pp. 339-347, 2012. [49] "Wikipedia article on OSI model," [Online]. Available: http://en.wikipedia.org/wiki/OSI_model. [Accessed 21 06 2013].

[50] R. C. T. Lee, M. C. Chiu and J. S. Lin, "Digital Modulation Techniques," in Communications Engineering: Essentials for Computer Scientists and Electrical Engineers, 2008, pp. 135-188.
[51] D. Silage, "Bandpass Modulation and Demodulation," in Digital Communication Systems Using MATLAB and Simulink, Bookstand Pub., 2009. [52] Mathworks, Simulink documentation, 2012.