SubOptic 2013 Masterclass Tutorial

"OTN & Mesh Networking"

Tuesday April 23, 2013

13:30-15:00
 Chairperson / Moderator:
Dr Steve Grubb, Fellow & VP Advanced Optical
Development, Infinera
Participants:
Antti Kankkunen, Vice President Product Planning, Infinera
Andy Lumsden, Chief Technology Officer, Pacnet
Dr Michael Enrico, Chief Technology Officer, DANTE
 Paris
San Francisco

Submarine Networks historically considered

only as point to point links
Service Providers are having to compete in
turning up new international services rapidly
Rapid restoration and provisioning becoming
more critical to service providers
 OTN Feature Comparison

OTN Switching

Virtualized optical networking

Meshed based architecture
Rapid Provisioning
OTN Transport
Multipath protection Pt to Pt architecture
Circuit based management Client protocol
transparency
Universal transport
Maximum Network protocol
Efficiency OAM&P
Functionality
1+1 Protecion
OTN as Percentage of the Market

All Images
and assets
should be
contained within
these boundaries Reduce to here when
there is a title

Source: Infonetics Research, OTN and Packet Optical Hardware, 2013

 Chairperson / Moderator:
Dr Steve Grubb, Fellow & VP Advanced Optical
Development, Infinera
Participants:
Antti Kankkunen, Vice President Product Planning, Infinera
Andy Lumsden, Chief Technology Officer, Pacnet
Dr Michael Enrico, Chief Technology Officer, DANTE
 OTN and Mesh Networking

April 23, 2013

Presenter: Antti Kankkunen

Company: Infinera
 Presenter Profile

Antti Kankkunen is VP, Product Planning at

Infinera Corporation (Nasdaq: INFN) and
since 2008 has been responsible for leading
the long term product roadmap development
at Infinera. Antti has more than 20 years of
experience in the communications industry
and has worked in both small startup
companies and large established equipment
providers. He has held senior executive
positions with responsibilities covering
product planning, product strategy,
technology strategy, business development,
product marketing and product development.
He spent 12 years at Tellabs and among Name: Antti Kankkunen
other things held the roles of director of
Tellabs 8100 product line and CTO of Tellabs Title: VP, Product Planning
International. Antti graduated from Helsinki
University of Technology in 1991 with M.Sc.
Email: akankkunen@infinera.com
in Electrical Engineering.
 What Well Discuss Today

OTN technology overview

Purpose
Functional description
Overhead and payloads
Multiplexing
Compare/contrast with SDH
Adoption and evolution (future)
Mesh Networking
Purpose/Mesh topologies
Functional description of various protection mechanisms
Efficiency vs. dedicated protection

Summary
PURPOSE
 Purpose of OTN
Replace SDH Designed for DWDM
Transport technology with Digital wrapper with FEC
support for rates of 1Gbps for high performance
- 100Gbps and beyond optical transmission

Multi-Service Enhanced OAM and

Timing and bit transparent Protection
transport of any client TCM
signal Linear, Ring and Mesh
Multiplexing and switching Protection
for network efficiency
 Properties of OTN
Multi-vendor/carrier
Most cost efficient
interoperability for all Transparent services with
switching technology for
services: Ethernet, low and constant latency
services 1Gbps
SONET, SDH, OTN, SAN

OTN OTN OTN OTN DWDM OTN Control

Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

GMPLS Control Plane

Efficient grooming
minimizes the cost of
optical layer
G.709 standard OA&M
enables rapid ODUk circuit
tools for trouble shooting
provisioning, protection,
and ODUk E2E monitoring
and 50ms restoration
FUNCTIONAL DESCRIPTION
 Network View
IP Layer Routers
Links between routers
IP realized via Transport
network

Electrical: Client Mapping,

Connection Multiplexing,
OTN Switching, Monitoring,
Protection/Restoration

Optical Layer:
Add/Drop, Express,
DWD Protection/Restoration
M
 OTN Adaptation
Properties
Serviceagnostic digital wrappers
End-to-end bit and timing transparency
Adaptation
1Gb/s to 100Gb/s clients mapped into OTN
containers Non-OTN Non-OTN
client
ODUk
Higher rates (400Gb/s, 1Tb/s, ...) will be client
accommodated as new client interfaces emerge

OTN OTN OTN OTN DWDM OTN Control

Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

Common Transport Layer for All Services

 OTN Switching
Properties ODUk Switching with 1.25Gb/s granularity
Typically ~1Tb/s 5Tb/s today with scalability to
Nx10Tb/s in the future
1 2 34
Fully non-blocking 1 2 34
Often with Integrated DWDM
1.25Gb/s (ODU0) granularity optimized for 1Gbps
1 2 34
1
and higher rate services 2
3
4
OTN OTN OTN OTN DWDM OTN Control
Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

Switching = Network EFFICIENCY

 OTN Multiplexing
OTN Multiplexing ODU3

ODU2

ODU3

ODU2e

ODU1
ODU2
G.709 defines multiplexing of LO ODUj into HO

OH

OH
OH

OH

OH
10G 10G 10G 2.5G

ODUk (j<k; j=0,1,2,2e,3,flex; k=1[jflex],2,3,4) ODU2 muxed into

Typically 1 or 2 stages of OTN multiplexing ODU3

ODU2
ODU0 -> ODU4

OH
10G

ODU0 -> ODU2-> ODU4 2nd ODU2e muxed into

Enables use of high-speed interfaces for lower ODU3

ODU1
OH
speed services 2.5G

ODU1 muxed into same

ODU3

OTN OTN OTN OTN DWDM OTN Control

Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

EFFICIENT Aggregation of Services to Fully Fill Wavelengths

* In addition to multiplexing into OTN DWDM Line-side
 OTN DWDM Transport
Properties
Typically 8Tb/s 9.6Tb/s per extended C-band.
All Long Haul DWDM systems are based on proprietary OTUkV
format (proprietary FEC mechanisms and coherent detection
algorithms). There is no line side interoperability.
PM-QPSK with 2bit/s/Hz spectral efficiency dominates terrestrial
applications
In subsea applications special formats with spectral efficiencies in
the range 1bit/s/Hz 3+bit/s/Hz (PM-BPSK PM-8QAM, <50GHz
spacing)

OTN OTN OTN OTN DWDM OTN Control

Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

Multi-Terabit SCALE
 OTN Control Plane & OAMP
Digital OAM
OTN Control Plane & OAMP

OTUk PM
ODUk PM
Digital processing Service interface PM
G.709 defines enhanced OAM tools based on at every OTN node TCM
SDH OAM
GMPLS/ASON/WSON-based control planes
provide auto-discovery of resources and auto-
provisioning of services for ease of operation
Digital OTN PMs at OTN switching nodes ensure
Topology Auto-Provisioning
service visibility Auto-Discovery

OTN OTN OTN OTN DWDM OTN Control

Adaption Switching Multiplexing Transport Plane & OAMP

OTN
OTN
OTN
OTN
OTN
client ODUj ODUj ODUj ODUj <-> ODUk NxODUk <-> NxOTUk GMPLS, ASON,
(10GbE -> ODU2e) (ODU2) (ODU2) (ODU2 <-> ODU3) (NxODU4<-> NxOTU4) WSON

OAMP Tools for End-to-End Monitoring and Provisioning

OVERHEAD AND PAYLOADS
 OTN Architecture
SONET/SDH Ethernet SAN Multi-Service Clients
Associated OH

OH Client Optical Payload Unit (OPUk)

Domain

(transparent client signal transport)

Digital

OH OPUk Optical Data Unit (ODUk)

Optical Transport Unit (OTUk)

OH ODUk FEC (k = 1/2/3/4 for 2.5/10/40/100G)
FEC Enhanced optical reach

OCh
Associated
OH (OSC)

Optical Channel (OCh)

Non

OCh
Domain
Optical

...........
OMSn Optical Multiplex Section (OMS)

OTSn Optical Transport Section (OTS)

 OTUk, ODUk and OPUk OH
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

1 FAS MFAS SM GCC0 RES

PM& TCM
2 RES TCM6 TCM5 TCM4 FTFL OPU Specific
TCM ACT

3 TCM3 TCM2 TCM1 PM EXP

OPU
4 GCC1 GCC2 APS/PCC RES PSI Spec
.

Activation/deactivation control
ACT PCC Protection Communication Control channel
channel
Automatic Protection Switching
APS PM Path Monitoring
Coordination channel
EXP Experimental Bits PSI Payload Structure Identifier

FAS Frame Alignment Signal RES Reserved

FTFL Fault Type & Fault Location SM Section Monitoring

GCC General Communication Channel TCM Tandem Connection Monitoring

MFAS Multi-Frame Alignment Signal

G.709 2012-02, Cor. 1 2012-10, Amd. 1 2012-10

 Client Signal Mappings
Client Interfaces Mapping Transported Nominal
STM-1/4, OC-3/12 ODUk Rate
G.709
1GE GMP
2012-02
TTT+GMP
G.7041 1G FC
2011-04 GMP ODU0 1.25G
2G FC
G.Sup43 GMP
12/2008 ODU1 2.5G
STM-16, OC-48 AMP, BMP

4G FC BMP
ODUflex Nx1.25G
BMP
8G FC
AMP, BMP
OC-192/STM-64 ODU2 10G
AMP, BMP
10GE WAN PHY GFP-F
ODU1e 10G
10GE LAN PHY BMP
16FS+BMP
10G FC ODU2e 10G
TTT+16FS+BMP
STM-256, OC-768
AMP, BMP ODU3 40G
40GE TTT+GMP

100GE GMP ODU4 100G

 Client Signal Mappings
Client Interfaces Mapping Transported Nominal
ODUk Rate
G.709
2012-02 CPRI option 1/2

SBCON/ESCON
GMP
DVB_ASI, SDI ODU0 1.25G
GMP
CPRI Option 3
ODU1 2.5G
1.5G SDI AMP

CM_GPON ODUflex Nx1.25G

BMP
3G SDI
AMP ODU2 10G
CPRI Option 4/5/6

IB SDR/DDR/QDR

CM_XGPON
 Mapping of cell/packet clients

G.709
Mapping of
ATM cell
stream into Mapping of GFP frames into OPUk (k=0,1,2,3,4,flex)
OPUk
(k=0,1,2,3)

Any packet
streams
ATM IP Ethernet MPLS
encapsulated
in GFP-F
MULTIPLEXING
 G.709/G.Sup43 Multiplexing Hierarchy
ODU1 ODU2 ODU3 ODU4
Low-Order ODUj High-Order ODUk
Muxing Muxing Muxing Muxing
ODU0 2 8 32 80

ODU1
ODU1 4 16 40 ODU1
8 32 80
ODUflex
ODU2
ODU2 4 10 ODU2

ODU3e1/2 Muxing
ODU2e 3 10 4

ODU3e1 ODU3e1
ODU3e2 ODU3e2
ODU3
ODU3 2 ODU3

ODU4
ODU4
 OTN Multiplexing Example

ODU2e ODU2e ODU2e ODU2e ODU2e

10GbE mapped muxed into muxed into is switched muxed into
is switched
into ODU2e ODU4 ODU4 ODU3

ODU2
ODU2e
ODU2e
ODU2e

ODU2e

ODU2e
ODU3
ODU2e

ODU4
ODU4

OH
OH
OH
OH

OH

OH
OH
OH
OH

OH
10 10G 10G 10G 10G 10G 10G 10G
G
10GbE
OTU3
ODU2
OTU4 OTU4 muxed into same
ODU3

ODU2
OH
10G
Legend
OTU4
10G Client service
ODU2

ODU2
ODU2

ODU4
OH

OH
OH

OH

10 10G 10G 10G

G ODU2
OH ODU2 encapsulation
STM-64/ STM-64/OC-192
OC-192 mapped into ODU2
ODU2e
OH ODU2e encapsulation

ODU3
OH ODU3 encapsulation

ODU4
OH ODU4 encapsulation
COMPARE/CONTRAST WITH
SDH
 OTN vs. SDH
OTN SDH

DWDM Part of the basic framework Not part of SDH

2Mbps (1.5Mbps for SONET) to

1Gbps - 100Gbps
40Gbps
Efficiently mapped client rates (higher rates will be standardized
(no standardization plans for
in the future)
higher rates)

Supported by the basic frame

FEC Not supported
format

TCM 6 Layers Cleanly defined 1 Layer Complex definition

Linear, Ring
Standardized Protection Linear and Ring
Mesh is work in progress

Client Signal Transparency Bit and timing Bit and timing

Synchronization of transport Typically part of synchronization

Free running
nodes hierarchy
ADOPTION AND EVOLUTION
(FUTURE)
 OTN Adoption
Spending in Mesh
OTN equipment had 58%
Networking equipment
share of optical
(OTN switching) was 14%
equipment spending in
of total OTN spending in
2012 and this is forecast
2012 and it is growing to
to grow to 78% by 2017*
21% by 2017*

OTN has established itself

as the state of the art
transport technology

*Infonetics Report: OTN and Packet Optical Hardware, March 2013

 OTN Future

Higher Client 400Gbps

Ethernet,1Tbps
Rates Ethernet, ...

Higher Line n x OTU4

Rates (n x 100G)
OTUCn

ODUk 50ms
Protection with
Shared Mesh Shared Backup
Protection Resources
 What Well Discuss Today

OTN technology overview

Purpose
Functional description
Overhead and payloads
Multiplexing
Compare/contrast with SDH
Adoption and evolution (future)
Mesh Networking
Purpose/Mesh topologies
Functional description of various protection mechanisms
Efficiency vs. dedicated protection

Summary
PURPOSE/MESH TOPOLOGIES
 North American Long-Haul Network Model
50
45 100G
40 40G

Total Traffic Volume (Tb/s)

35
10G
30
2.5G
25
1G
20
15
10

36,382km fiber network with 5

0
82 total add/drop nodes Avg. Link 0.831 1.308 1.874 3.079 4.342
7 data centers (dual nodes), 21 Tier 1 Total
Traffic
5.6 9.3 14.7 25.7 50.3
cities, 10 Tier 2 cities, 34 Tier 3 cities, 2012 2013 2014 2015 2016
352 x optical line amplifier sites

Srinivasan Ramasubramanian

Suresh Subramaniam

Satyajeet Ahuja, Steven Hand

Realistic Fiver Year Network and Traffic Model

 Economic Comparison
No OTN Switching OTN Switching

Architectures Vs.
Compared
Muxponder Muxponder + Integrated OXC
OXC + DWDM

Cumulative CAPEX OPEX - Space Bays OPEX - Power kW

120% 600 4000.0
3500.0
100% 500
3000.0
80% 400
2500.0
60% 300 2000.0
1500.0
40% 200
1000.0
20% 100
500.0
0% 0 0.0
2012 2013 2014 2015 2016 2012 2013 2014 2015 2016 2012 2013 2014 2015 2016

Muxponder Muxponder Muxponder

Muxponder + OXC Muxponder + OXC Muxponder + OXC
Integrated OXC & DWDM Integrated OXC & DWDM Integrated OXC & DWDM

Integrated OXC & DWDM is the Most Cost Efficient Architecture

FUNCTIONAL DESCRIPTION
OF VARIOUS PROTECTION
MECHANISMS
 Recovery mechanisms for networks
Multi-failure Fast Minimal
backups Recovery Costs

Optical SONET/SDH: Single failure Sub 50ms recovery Dedicated backup

1+1, 1+N, 1:N scenario on failure resource

Packet IP/MPLS: MPLS Multi-failure Sub 50ms for Shared bandwidth,

Fast Re-Route (FRR) scenarios limited scenarios Packet layer $$$

Digital OTN: SW Based

Shared Mesh Multi-failure Up to few seconds Shared bandwidth,
scenarios recovery on failure Transport layer
Restoration

Digital OTN: HW
Multi-failure Sub 50ms recovery Shared bandwidth,
Accelerated Shared
scenarios on failure Transport layer
Mesh Protection

SMP (Shared Mesh Protection) is currently being standardized in ITU-T

 SMP solution components
Network Planning System OTN Switch with Hardware GMPLS Control Plane
based SMP Processor

Pre-provisioned in hardware Real-time backup

Plan for multi-failures for <50ms activation path re-computation

A B C

SPs like Pacnet moving to mesh architectures to take

advantage of new transport protection schemes

F G
E
D
 SMP in Action
SMP Processor Table
Service 1 = Working Path AE Protection
Failure 1 Backup ADE = 1:1 Plan for multi-failures
Failure 2 Backup ABFE Online optimization w/GMPLS at Transport
= N:1 Hardware activation <50ms across network
Failure 3 Backup ABCGFE

Service 2 = Working Path AD

Failure 1 Backup AD

A B C
Service 2
High Service 1
Priority

Low
F G
E
D Shared backup = 50% fewer line cards than 1+1 on AD
Industry impetus on Shared Mesh Protection
ITU Q9 / SG15 Documents
under
G.SMP G.808.3 Last Call
G.ODUSMP

Two current drafts Documents

on Standards
Requirements for SMP Track
Supporting SMP in MPLS-TP
EFFICIENCY VS. DEDICATED
PROTECTION
 SMP saves 30% over 1+1 Protection
8750
9000 1+1 SMP
100G WDM 8000
Protection 7000 6270 6400
Interface 6000
Count 4630 4540
5000
4000 3480 3240
2660 2320
3000 1870
2000
1000
0
Year 1 Year 2 Year 3 Year 4 Year 5
SMP
30% 33% 30% 28% 27%
Savings
While being more reliable than 1+1 protection
Source: ACG Research, 2013
Large network, 80+ nodes
SUMMARY
 Summary

OTN provides the
optimal digital layer for
DWDM networks
OTN provides
OTN is replacing standardized bit and
SDH/SONET in timing transparent
transport networks transport of all important
client services

HW Accelerated ODUk
OTN is the most cost
Shared Mesh Protection
efficient multiplexing and can provide guaranteed
switching technology for
50ms protection and the
1Gbps and above
bandwidth efficiency of
services
shared restoration
 DANTE, GANT &
Application of OTN & Mesh
Restoration/Protection

Presenter: Michael Enrico

Company: DANTE
 Presenter Profile

Michael Enrico received his BSc and PhD

degrees in Physics from Lancaster University in
1991 and 1995. In 1997 he moved into
telecommunications joining what was then BT
Labs, where he worked on: the study and
development of innovative broadband access
network architectures based on hybrid fibre-
copper infrastructures and highly scalable IP
network transport solutions for broadband
services. In 2001, he joined DANTEs Network
Engineering and Planning team in which he
worked on various high and low level design
assignments. In 2003, he was promoted to
Network Engineering and Planning Manager and
in 2012 to CTO and is now responsible for
developing technology strategies in DANTE and Name: Michael Enrico
the GANT project as well as representing these
same entities on the international R&E networking Title: Chief Technical Officer
stage.
Email: michael.enrico@dante.net
 DANTE who we are, what we do
DANTE (Delivery of Advanced Network Technology to Europe)
established in 1993 - plans, builds and operates advanced networks for
research and education
Owned by Europes National Research and Education Networks
(NRENs) and works in partnership with them and the European
Commission
DANTE's work is primarily organised in the form of projects, which
receive co-funding from the EC e.g.
o GANT via GN3plus pan-European R&E comms infrastructure
o EUMEDCONNECT3 southern & eastern Mediterranean
o CAREN central Asia
o ORIENTPlus China
o AfricaCONNECT Africa
 The GANT core offers
Flexibility, Reliability & Speed
40 European Countries
Dark Fibre + DWDM
Hybrid network:
Routed IP
IPv6, multicast, VPN
Point-to-point
Circuits typically 1Gbps
Dedicated Lambdas
Full 10Gbps
Bandwidth on Demand
Network monitoring
Security
Mobility/AAI (edu*)
An architectural view of GANT (before)
IE BE SK UK DE ES DK AT HU GR EE LV LT RO BG TR IL MK RS

HR SI NL FR CH IT CZ PL MT CY ME

Routerless Fully featured Off fibre net IP/MPLS only NREN POPs

Circuits
over GANT Leased
IP & MPLS circuits

RU Switching
TDM (SDH) PT LU platform Converged
(Routerless)
(P-OTS)
Transmission platform?
pt-to-pt DWDM platform

Fibre Leased circuits

 and after (upgrade)
IE BE SK UK DE ES DK AT HU GR EE LV LT RO BG TR IL MK RS

HR SI NL FR CH IT CZ PL ALL now Better featured MT CY ME

Routerless
Fully featured Fully featured Off fibre net Better
IP/MPLSfeatured
only NREN POPs

Circuits
over GANT Leased
IP IP Converged
circuits

(packet transport)
Packet RU platform
Switching
transport PT LU platform

Converged
Transmission (P-OTS)
DWDM & OTN platform platform

Fibre Leased circuits

 Benefit of superchannels with OTN
(rapid provisioning & resilience options)
100GbE service demand 500Gb/s total
95Gb/s in use
115Gb/s in use 2x10GbE service
215Gb/s in use
demand

B/W Virtualization
DWDM
OTN Switching
GMPLS Control Plane

B/W Virtualization transforms waves into resources

A large pool of intelligent capacity
GMPLS allocates resources to service demands
Same concept as data center virtualization
Enables shared mesh restoration 53
New GANT day-1 DF footprint
Current status of transmission rollout
A potential use of 1:1 or SM protection
 100G Trunk Protection
GANT Western Ring consists of 5 links each running 100GE
Upgrade Path?
NL
Upgrade all five100G
trunks to 2x100GE OR
100G
UK DE
100G
100G
100G
FR CH

100G 100G
UK DE
100G NL
100G
100G

FR CH
 100G Trunk Protection
GANT Western Ring consists of 5 links each running 100GE
Upgrade Path?
Upgrade all five trunks to 2x100GE OR

NL
2x100G 2x100G
UK DE
2x100G
2x100G
2x100G
FR CH
 100G Trunk Protection
GANT Western Ring consists of 5 links each running 100GE
Upgrade Path?
Upgrade all five trunks to 2x100GE OR
Add a direct fully protected link between two sites

NL
100G 100G
UK DE

UK 100G 100G DE
100G
100G
NL working
Prot/rest FR CH path
path

FR CH
 100G Trunk Protection
GANT Western Ring consists of 5 links each running 100GE
Upgrade Path?
Add a direct fully protected link between two sites
If there is a fibre cut between CH & DE the direct link between CH & NL will get restored
dynamically in ~50ms
The IP traffic will use the same physical path it would have used if the ring was 2x100GE
There will be no increase in traffic on IP link FR-UK or UK-NL or FR-CH
Traffic between CH & DE will go via NL making CH only 2 IP hops away rather than 4

UK DE

NL working
Prot/rest path
path

FR CH
 Two interesting applications

(in BIG Science)

 The LHC Experiments
pp, B-Physics,
CP Violation

LHC : 27 km long
100m underground

ATLAS

General Purpose,
pp, heavy ions

Heavy ions, pp

CMS
ALICE
+TOTEM
 Exploring our Universe with eVLBI
Through dedicated high-speed
links, GANT connects remote
radio telescopes around the
world, providing researchers with
real-time distributed images of
the solar system.

The EXPReS project has been transformed by our connection

to the GANT network. Whilst the advancement of telescope
technology means we can now carry out years worth of
observations in days, the ability to then transfer that vast
quantity of data between astronomers at such high speed
means the pace of our research has accelerated beyond
recognition, with real-time collaboration now a reality.
Professor Ralph Spencer, Jodrell Bank Observatory)
 The path to eVLBI in near real-time
Custom-made hardware (correlator)
~500000 lines of C++ code
Tape Disks Network BOD!!!
Coming SKA Square Kilometre Array
Southern Africa

Western Australia
 THE NEW PACNET NETWORK

Andy Lumsden
CTO, SVP Operations
Pacnet
 Introduction

Pacnet Overview
Transformation Strategy
The New Network
OTN & MESH Adoption Our View & Challenges..

6
 Pacnet Overview..
Our Submarine Cable Network
Pacnet owns and operates the leading pan-Asian
submarine cable network that lands in 21 cable landing
stations and extends from India to the USA
EAC-C2C, fiber optic submarine cable network
EAC-C2C spanning 36,800 kilometers between Hong Kong,
China, Korea, Japan, Taiwan, the Philippines and
way. Singapore. EAC-C2C has a design capacity of 17.92
terabits per second (Tbps) to 30.72 Tbps to and from
each of the landing countries, with continuous upgrades
under progress planning and review

EAC-PACIFIC is part of UNITY with 2 dedicated FPs

from Chikura to LA, USA

Pacnet services incl..

IRU, IPL, E-IPL

IP-MPLS, IP-T
CDN
Managed Datacenter Services, Hosting/Storage, Colocation
Self owned & operated Data Center space in the Asia Pacific Region
 Transforming the PACNET Network
Transform the Core Network
Move away from SDH Rings
Converge to reduced number of highly efficient connectivity (integrate subsea
and backhaul)
Deploy powerful multi-service and multi-protocol platform in the core
Extend and Expand Carrier Ethernet & VPLS Capability
A Comprehensive IP/Optical convergence strategy
Integrated Data Plane
Integrated Control Plane
Connect the Data Centers
10/40/100GE Ethernet connectivity over new Core Network

7
 Converge to improve efficient links
New Topology
Build a new parallel Optical
Mesh Network
No more SDH Rings
2-Fiber Pair model
Choose, Upgrade and
Use only 1 Fiber Pair
Interconnect Fast & Furious Mesh
Philippines and Korea
No distinction between Make use of Asias longest
Subsea and Backhaul and most resilient Fiber
Optic Cable Network
Integrated Subsea and
Backhaul
Pick the right
segments for most
direct routes
More than 2 degrees
for more auto-restore

Simplify the Core!

 New Optical Network

Ethernet VPN (EVPN), IP, SDH,

Flexible Services EIPL
At the Edge OTN transport services on top of
the Optical Transport

Wholesale,
GMPLS signaling and OTN
Restoration and Switching for virtualization and Full
Routing Availability Meshed Topology

Large Effective
Built upon 100G Optical Core
Bandwidth
Availability
 Transforming the Core Network
End-to-end
Increase Efficiency
Next-gen core equipment
allowing multi-layer & multi-

Cross- Layer
service creation across all Multi-Service
key dimensions: Layer
Integrated Subsea and
Backhaul
Wave restoration Next-Gen
Integrated
40G/100G/OTN DWDM/OTN/
Packet Optical Network ODU Switching
ODU Grooming

Core Layer

Core simplification Converged backbone: Maximize efficiency of core

Convergence on reduced
number of shortest & highly
efficient core network
connectivity that
accommodate profitable
growth across all services
transport for scalable & profitable service expansion
Convergence Carrier Ethernet
Integration of IP & optical Expansion of our Ethernet
domains with Cross-Layer Services coverage and
visibility and automation, capability (VPLS & T-MPLS
optimizing operational costs
The relentless growth of video, mobile and cloud-based applications The In nera DTN-X is simple to install, operate, troubleshoot and
demands a network that can deliver highbandwidth, market-leading scale. Services can be quickly and easily provisioned and transported

IP/Optical Integration IP Traffic Grooming

network economics. The In nera DTN-X integrates Photonic Inte-
grated Circuit (PIC) based multi-Terabit WDM transport and inte-
grated OTN switching to offer a combination of scale and ef ciency
over a common WDM layer. The key enablers of network simplicity are:

PIC-enabled economical optical-electronic-

optical (O-E-O) conversion allows sub-lambda grooming while
while simplifying network operations. By combining plug-and-play
automated turn-up, GMPLS network intelligence and service automa-
tion, DTN-X provides a truly simple network and system architecture
leveraging high density, low power enabling PICs, delivering a no
compromise Digital Optical Network.
GMPLS
intelligence
500 Gb/s super-channel
SCALABLE
to 100 Tb/s
What Is the DTN-X
The In nera DTN-X is a next generation multi-Terabit converged
Sub-port (VLAN) level to peering gateway
P-OTN solution. The DTN-X enables 5 Tb/s) of non-blocking switch- Intelligent GMPLS
automation
ing in a single bay, upgradeable in the future to 10 Tb/s, scalable SIMPLE
to 100 Tb/ s in a multi-bay con guration, and offering 8 Tb/ s of MPLS future
Port level
WDM capacity scalable to 24 Tb/ s. DTN-X combines the bene ts Service-specific
ODU
of PIC technology, integrated switching and the exibility of OTN
ODUflex transport
and packet. The DTN-X extends In neras leadership with the unique
EFFICIENT
ODU50% less power containers
Lambda level
Digital ROADM architecture and Generalized Multi-Protocol Label
Switching (GMPLS) service intelligence and is positioned to meet
the needs of service providers seeking to offer new and innovative
services in a SIMPLE, SCALABLE, and EFFICIENT manner.
to datacenter
OTN
networking
Service Edges (IP/IPVPN/VPLS..)

Flexible IP traffic grooming options at the OTN layer,

including port-level and sub-port-level grooming
IP traffic from router ports or sub-ports is mapped to the optimal transport
container
Traffic is individually forwarded to its specific destination across the low-cost
optical layer with the highest reliability and quality.
Maximum filling of optical transport resources avoids capacity waste
Next Generation SLTEs
Unifies Subsea & Typical Terrestrial/Subsea Network
Terrestrial
End to End
Provisioning/Management
End to End
Protection/Restoration

Improves Operations Back to Back

transponders
Eliminates potential points of
failure
Provisioning Provisioning
Reduces time to Across subsea
Across terrestrial
activate/troubleshoot

Integrated Terrestrial/Subsea Network Eliminates Back to Back

Transponders
No grey optics required for
pass through traffic
Less equipment yields capex
savings
Reduced ODF requirements

End to End Provisioning/Protection/Management

OTN & MESH Adoption
 OTN & MESH
Anticipate that OTU client Interface requirement coming from
Telecom Carriers and large capacity consumers, for instance
Internet Service Providers and Cloud Service Providers
Unprotected 10G services still in demand, OTN provides
grooming capabilities and flexibility for multi service traffic type
40G on sub sea services now commonly requested
Pacnet's multiple cable architecture, opens up offer of fast re
route, multi path back up/restore. Product offer key to
successful take up
Holistic overlay approach, to deploy capabilities POP-POP or
Importantly DC-DC

7
 OTN for UNI
OTN for Intra-Domain IaDI is obviously mature BUT Inter-
Domain IrDI / UNI is not mature yet.
Pacnet will look at inter vendor testing, PoC to realize potential
of OTN
Multiple Specification for OTU client interfaces will make more confusion

(source : OTNtutorial.pdf)
 In Summary
Next Gen Transport Evolution will allow Pacnet
Transition to a cost efficient Terrestrial and Sub Sea architecture
Traffic grooming, multi services integration (TDM & Packet)
MPLS+ETHERNET+OTN
Network Scalability, Flexibility
Leverage existing network footprint with multiple cable spans in region
OTN Adoption is coming to the Sub Sea Environment
Extend Pacnet's Optical domain to Enterprise, Carrier customer base
Separate Data and Control Plane opens up future development
Thank You