Virtela UniversIty

a global network solutions company

www.virtela.net | +1.720.475.4445
MPLS NNI’s and QOS
Backbone Engineering
© 2005 Virtela Communications, Inc. • Proprietary & Confidential
Initial Points about MPLS and Virtela

Virtela is a Layer-3 VPN Provider

MPLS Circuits are like Private Circuits using a Virtual Private
network to provide guaranteed bandwidth or Performance
Layer 3 MPLS NNI’s are essentially co-managed networks where
Virtela Manages one portion of a Customers VPN, and our Partner
manages a different Portion of a Customers VPN, at our Direction
Layer 2 MPLS NNI’s are like Virtual Access-Trunks, which allow us
to bring in PtP connections into the Virtela Cloud
There are 2 primary purposes of MPLS VPN’s, and NNI’s, and they
are:
 Gaurenteed Bandwidth up to the Port Speed
 QOS/COS (See Attached QOS/COS Presentation)

a global network solutions company www.virtela.net | +1.720.475.4445 2

General MPLS Layer 3 Partner Network Points

Layer 3 MPLS NNI’s are

They are essentially co-managed networks where Virtela Manages one portion of a
Customers VPN, and our Partner manages a different Portion of a Customers VPN,
at our Direction
For Ethernet Handoff, it is 1 VLAN per CUSTOMER
Packet routing is controlled by Routing Protocols that have to be managed between
the respective Providers Networks (Like Virtela and Easynet)
QOS is done on a Per-Hop-Behaviour, and each router has to make a QOS decision
for each and every packet. The Provider has to honor packet markings that we set,
and queue them appropriatly on their Egress Interface
Virtela CE Engineer would need to work with a Partner NNI Provider for all QOS
configurations
PRO’s
 Most Commonly deployed service today
 Is Interface type INDEPENDENT (Virtela Connection can be Ethernet, and Customer Connections can be any mix of private lines, including DS-1, E-1,
Ethernet, Frame-Relay, SONET)

CON’s
 Initial Configuration is far more tricky, and requires close integration between Virtela and the Network Provider to agree to a standard configuration
and minimum requirements
 We have no ability to directly configure the QOS/COS settings on the Providers Network connection from PE-CE (NOTE...our NNI is PE-PE)
 We have no ability to ensure the QOS/COS is configured correctly.
 Changes to COS/QOS would have to be sent as a change request to our Partners NNI Provider (Mainly it’s an issue in Delaying implementation)
• In the past, Virtela solved this problem with GRE Tunnels terminated on Cisco Routers, which can do QOS/COS against a
bandwidth Shaped path

a global network solutions company www.virtela.net | +1.720.475.4445 3

General Layer -3 NNI Document

PROVIDER / Virtela Interconnects

Ethernet Trunk in POP
Separate VLAN ids and
eBGP VRF for PROVIDER
Virtela inject 0.0.0.0/0 or Customer
all Customer routes

P
0.0.0.0/30
M7i M7i Separate VRF for Every
Virtela and PROVIDER POP-SWTH-1 M7i M7i
Customer PROVIDER PE
ASXXXXX

Virtela POP PE
M10i
Virtela ASXXXXX G0/10
PROVIDER
MPLS MPLS
Network PROVIDER PE
Ethernet Trunk Network
Ethernet Trunk ASXXXX
Circuit Circuit

M7i M7i
Separate VRF for M7i
PROVIDER Customer M7i
P
NOTE: E1 in VRF
PROVIDER PE
-PROVIDER can only handle 500 routes per VRF
ASXXXXX
-Request more routes from Access Management PROVIDER Unique /30
-PROVIDER vlan block is 350-400 eBGP
-PROVIDER Provides Unique /30 for CE to PE Link
Virtela CPE
-x.x.x.x/30 standard PE to PE link
Router AS65000
-If CE needs Internet
NAT on Loopback. Reserve POP Public routable Space
in VCOM

a global network solutions company www.virtela.net | +1.720.475.4445 4

Layer 2 MPLS Services

Layer 2 MPLS Services are getting very complicated and tricky

There is one MAJOR benefit to Layer MPLS Services, and that is our
Partner does NOT have to do QOS/COS for us. Virtela is responsible
for Queuing the Packets into the network.
For Ethernet Services, it is 1 VLAN PER Circuit
L2VPNs (aka Psuedowire or even Point-to-Point)
 Are point-to-point links that need the same interface handoff on each end (Ethernet-Ethernet, or DS1-DS-1)
 Can have dedicated Handoff interface, or have a Shared Interface through VLANS
VPLS MPLS Service is a Layer2 VPN but is Point-to-Multipoint
 Stands for VIRTUAL PRIVATE LAN SERVICE
 Creates an Ethernet Switch type WAN Connection Architecture
 Limited today only to Ethernet Handoffs on all sides
 There are quite a few CONS to this, but I won’t list them, but it is gaining Popularity
 Not VIABLE for our Backbone links, and in rare cases would be a benefit for customers
Layer 2.5 MPLS Services are translational bridges (One side can be
Ethernet, the other an E-1, and the link will act like a point-to-point
circuit)
 VERY new, and has a lot of maturing to do

a global network solutions company www.virtela.net | +1.720.475.4445 5

Layer 2 NNI Issues/Concerns for Virtela

VLAN Limitations for Ethernet NNI’s

 Cheap Ethernet Switches we have purchased in the past for the RPC’s only support 64
VLANS, and at the large RPC’s are almost exhausted
 We are mitigating this by installing AGSW’s, which support 1024 VLANS
• We have deployed them to only 11 RPC’s (Think mostly the Major Ones)

QOS Issues on Layer 2 Ethernet Services at an RPC

 AGSW’s (Cisco ME-3400’s) are really only good for doing QOS for DEDICATED PtP
Ethernet Service
• They are relatively cheap CAPEX ($3K)

 New Gig/E PIC’s on the Juniper NERD will allow us to do Per-VLAN QOS (Only done in LA
and SJC, with NYC planned
• This will allow us to do full QOS for all Ethernet Layer-2 Services at our RPC.
• Cost is about $80K per RPC, and we are only doing it at our Major RPC’s over the next year
• Smaller RPC’s, will not get these PIC’s anytime soon.

a global network solutions company www.virtela.net | +1.720.475.4445 6

Visio

Layer2 / Virtela Interconnects

Ethernet Trunk in POP

A N1
VL
Customer A
router #1
to
p ed
p
P
Separate VLAN ids for Ma
each Ethernet Circuit

M7i

PROVIDER PE
Virtela
MPLS PROVIDER
M10i
Network Vlan 1,2,3
MPLS 2
Mapped to VLAN
Network Customer A
router #2

Ethernet Trunk
Circuit
M7i Ethernet Trunk
Circuit
P Ma
p pe
d to
V LA
N3

Customer A
router #1

a global network solutions company www.virtela.net | +1.720.475.4445 7