Unified Compute System Architectural Overview

Unified Compute System (UCS)
Architectural Overview
Steve McQuerry. CCIE #6108
Session ID 20PT
UCS System and Connectivity View
 Single Management Interface for up to 160 blade servers
 Role Based Access for LAN, SAN, and Server Administrators
 Clustered for fault tolerance and no single point of failure for any chassis
 Open APIs for third party integration
SAN
Network
SAN A
LAN
Server
Mgmt
SAN B
BRKSPM-2604_c1 © 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
Single Point of Management
Unified ComputingReduced
System (UCS)points
# of management
Reduced firmware management
Reduced time to resolve issues
Reduced complexity
Unified Fabric
Stateless Servers
with
Virtualized Adapters
Unified Computing System (UCS)
Unified Fabric
Reduced # of adapters
Reduced # of switches
Single Point of
Reduced Management
LAN and SAN edge ports
Reduced cabling costs
Unified Fabric Reduced power due to less H/W
Stateless Servers
with
Unified Fabric
Large Memory
Reduced server costs
Reduced power and cooling costs
Reduced software costs
Stateless Servers
with
Unified Fabric
Virtualization & Stateless Servers

Reduced type of servers via H/W virtualization
Reduced # of standby servers for HA
Reduced downtime due to service profiles
Reduced time to resolve issues with VM’s
Stateless Servers
with
Cisco Unified Computing System
System Components
SAN LAN MGMT SAN
 Fabric Interconnect
G G S S G G
Fabric Fabric
(40 or 20 10GE ports) + (2 or 1 GEM slots)
A A
Interconnect Interconnect
G G G G G G  Chassis
Upto 8 half width blades or 4 full width blades
Compute Chassis
Fabric Fabric
R I C C I R
Extender Extender
x8 x8 x8 x8  Fabric Extender
Host to uplink traffic engineering
Up to 80Gb Flexible bandwidth allocation
M P P
B B
Adapter Adapter Adapter
 Adapter
X X X X X X
Virtualized adapter for single OS and hypervisor
systems
x86 Computer x86 Computer
 Compute Blade
Compute Blade Compute Blade
(Half slot) (Full slot)
System Components – Details
 Altos ASIC
SAN LAN MGMT SAN
0.56 Tbps Xbar
G G S S G G
A
Fabric Fabric
A
 Gatos ASIC
Switch Switch
G G G G G G 10GE/FC/1GE Media Access Controllers
Forwarding - Ethernet, Fibre Channel, Multipath
Compute Chassis
Policy Engine
Fabric Fabric
R I C C I R
Extender Extender Packet Buffering
x8 x8 x8 x8
 Redwood ASIC
Host to uplink traffic engineering
Connectivity detection & management portal
E/Q
Adapter
B
P
Adapter
B
P
Adapter
 Palo ASIC Data Plane
Virtualized adapter for both single OS and
X X X X X X
hypervisor systems
Ethernet, FC
x86 Computer x86 Computer
Direct Data Placement for Fibre Channel
Compute Blade Compute Blade

(Half slot) (Full slot)
Wire for Bandwidth, Not Connectivity
Uplinks
20Gb/s 40Gb/s 80Gb/s
 Wire Once Architecture

 All links can be active all the time
 Policy-driven bandwidth allocation
 Virtual interface granularity
Building Blocks
UCS Manager
Embedded in Fabric Interconnect
UCS Fabric Interconnects

6100
6200
UCS Fabric Extenders

Logically part of Fabric Interconnect
Inserts into Blade Enclosure
UCS Blade Server Chassis

Flexible bay configurations
UCS Blade Servers

Different blade types
Mix blade types within enclosure
UCS Rack Servers

Different server types
Standalone or UCSM integrated
UCS Adapters
Three adapter options
Mix adapters within blade
Unified Computing System Manager
• Embedded device manager for family of UCS components

• Enables stateless computing via Service Profiles
• Efficient scale: Same effort for 1 to N blades
• APIs for integration with new and existing data center infrastructure
UCS Manager
 Single point of management for UCS system of
components
GUI Custom Portal or Tools Adapters, blades, chassis, fabric extenders, fabric
interconnects
CLI Systems Management

Software
 Embedded device manager
Discovery, Inventory, Configuration, Monitoring,
Diagnostics, Statistics Collection
UCS Manager Coordinated deployment to managed endpoints
 APIs for integration with new and existing data

center infrastructure
SMASH-CLP, IPMI, SNMP
XML-based SDK for commercial & custom
implementations
Management Protocols
CIM XML
SNMP SMASH CLP
syslog
IPMI
Call-home
Remote KVM
UCS CLI and GUI
Serial Over LAN

UCS XML API
Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
UCS 6100 Series Fabric Interconnects
6100 Series Fabric Interconnects

• 10 Gigabit Ethernet, FCoE capable, SFP+ ports
• 20 and 40 fixed port versions with Expansion slots for additional
Fiber Channel and 10 GE connectivity
• Upto to 1.04 Tbps of throughput
• Hot pluggable fan and power supplies
• Hardware based support for Cisco VN-Link technology
• Fully managed by UCS Manager through Fabric Interconnect
UCS 6100 Series Expansion Modules
FC-only (8 ports
@ 1/2/4 Gbsec)
FC-only (6 ports
@ 1/2/4/8 Gbsec)
Combo FC + Ethernet
Ethernet-only
UCS 6248UP Fabric Interconnect
Benefit
 Scalable platform for high density, high
performance, unified infrastructure
 Platform for future app and virtualization needs
Feature details
• UCS 6248UP chassis
• 32 fixed Unified Ports
• 1 expansion module slot (16 ports)
• Double the port density in 1RU
• Foundation for future network scalability
• 1.92 Tbps throughput
• 4096 VLANs
• Dual power supplies for both AC and DC
Unified Ports
Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel
 Convert protocol support on the
same port dynamically Unified Port
 All ports on UCS 6200 Series
 16-port Expansion Module for
6248UP and 6296UP
Native Fibre Channel Lossless Ethernet:

1/10GbE, FCoE, iSCSI, NAS
Benefits Use-cases
 Simplify switch purchase -  Flexible LAN & storage convergence
remove ports ratio guess work based on business needs
 Increase design flexibility  Service can be adjusted based on the
demand for specific traffic
 Remove bandwidth
bottlenecks
UCS 6200 Expansion Module
UCS-FI-E16UP
• 16 “Unified Ports”
• Ports can be configured as either
Ethernet or Native FC Ports
• Ethernet operations at 1/10 Gigabit
Ethernet
• Fibre Channel operations at 8/4/2/1G
• Uses existing Ethernet SFP+ and
Cisco 8/4/2G and 4/2/1G FC Optics
Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
UCS 2104 Fabric Extender
2104 Fabric Extender

• Connects UCS blade chassis to the Fabric Interconnect
• Four 10 Gigabit Ethernet, FCoE capable, SFP+ ports
• Up to 2 Fabric Extenders per chassis for redundancy and up to 80
Gbps of bandwidth per chassis
• Built-in chassis management functionality
• Hardware based support for Cisco VN-Link technology
• Fully managed by UCS Manager through Fabric Interconnect
UCS 2208XP I/O Module
Customer benefits
I/O scalability and flexibility
Feature details
• Double the uplink bandwidth
• 8 x 10 Gig network-facing ports
• Quadruple the server-facing bandwidth
• 32 x 10 Gig = 4 per half width slot
• Two I/O Modules per chassis
• 80Gbps to a single half-width blade
(40Gbps left and right)
• 160Gbps to a full-width blade
Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
UCS 5108 Blade Chassis
Chassis
• Up to 8 half slot blades
• Up to 4 full slot blades
• 4x power supplies, N+N grid redundant
• 8x fans included
• 2x UCS 2104 Fabric Extender
• All items hot-pluggable
UCS 5108 Blade Chassis Parts
2 Fabric
Extenders
8 Fan Modules
4 Power
Connectors
4 to 8 Blades
4 Power
Supplies
6U, 19” Rack
UCS 5108 Blade Chassis Backplane
I/O Modules
PSU Connectors Blade Connectors
Redundant data and management paths

Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
Compute overview
B200 M2
2 Socket Intel 5600, 2 SFF Disk, 12 DIMM
Blade
B230 M2
2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM
B250 M2
B440 M2
4 Socket Intel E7,4 SFF Disk, 32 DIMM
C200 M2
2 Socket Intel 5600, 4 Disks, 12 DIMM, 2 PCIe, 1U
Rack Mount
C210 M2
C250 M2
C260 M2
2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U
C460 M2
4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U
Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
Compute overview
B200 M2
Blade
B230 M2
2 Socket Intel E7, 2 SSD 7mm Disk, 32 DIMM
B250 M2
B440 M2
4 Socket Intel E7, 4 SFF Disk, 32 DIMM
C200 M2
Rack Mount
C210 M2
C250 M2
C260 M2
2 Socket Intel E7, 16 Disks, 32/64 DIMM, 6 PCIe, 2U
C460 M2
4 Socket Intel E7, 12 Disks, 64 DIMM, 10 PCIe, 4U
Building Blocks
UCS Manager

6100
6200


UCS Blade Servers

UCS Rack Servers

UCS Adapters
I/O Adapters for B-Series M72KR-Q
High Performance 10Gbps per port

maximum throughput for high bandwidth
SAN and LAN traffic
Full hardware offload for FCoE protocol
processing
250,000 IOPS per port deliver high I/O
Up to 8Gb FC throughput
Full support for TCP/IP and Ethernet with
enhancements
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads
Common driver for CNAs and HBAs
Low power ~ 5W
I/O Adapters for B-Series M72KR-E
 Full 10Gbps network performance

with support both LAN and SAN traffic
 Full hardware offload for FCoE
protocol processing
 PCIe Express 2.0 (x8, 5GT/s), MSI-X
support
 Integrated data buffer and code space
memory
 Theoretical 10Gb FC throughput
 Common driver for UCNAs and HBAs
 Support for Jumbo frames
 Cannot do per priority pause on
Ethernet traffic.
I/O Adapters for B-Series M61KR-I
 Interface Type PCIe v2.0 (5.0GT/s)

 Intel® VT-dVMDq, SR-IOV
 Full support for TCP/IP and Ethernet
with enhancements:
 Priority-based Flow Control (802.1Qbb)
 Jumbo frames
 Checksum offloads
 Segmentation offloads
 Low power ~7W
I/O Adapters for B-Series M51KR-B
 Broadcom NetXtreme II 57711 Dual-

Port 10 Gigabit Ethernet PCIe Adapter
 x8 PCI Express base specifications
v2.0 and v1.1
 iSCSI offload
 Virtual LANs (VLANs), IEEE 802.1q
 IEEE 802.3x flow control
 TCP, IP, UDP checksum offload - TCP
segmentation
 iSCSI Boot capable
Palo Based Mezzanine Card M81KR-VIC
Adapter designed for both single-OS and
VM-based deployments
• Network Interface Virtualisation support
• VN-link capable hypervisor integration
PCIe standard compliant
Power of 18 watts
Cut-through architecture Eth Eth
High Performance FC
FC
• 2x 10Gb
• Low latency
• 600K IOPS
HW capable of up to 128 vNICs
• Ethernet vNIC, and FC vHBA 0 1 2 119
• Two ports to the backplane
• Switch and network see all vNIC and vHBA
UCS 1280 2nd Gen VIC
Customer benefits
Dual 4x10 Gb to a single slot

VM-FEX scale, up to 116 VM interfaces /w ESX 5.0
Feature details
• Dual 4x10 Gbps to a single slot
• Host connectivity PCIe Gen2x16
• HW Capable of 256 PCIe devices
• OS restriction apply
• PCIe virtualization OS independent (similar to
Palo)
• OS drivers for 1st Gen VIC and 2nd Gen VIC
same
3rd Party Adapters for UCS C-series
I/0 Adapters:
N2XX-ABPCI02 - Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)
N2XX-ABPCI03 - Broadcom BCM5709, GbE Quad Port GE NIC
N2XX-ABPCI01 - Broadcom BCM5709, GbE Dual Port GE NIC
UCSC-PCIE-BSFP - Broadcom BCM57712, 10GbE Dual Port NIC
N2XX-AEPCI01 - Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)

N2XX-AEPCI03 - Emulex LPE 11002 4Gb Dual Channel FC HBA
N2XX-AEPCI05 - Emulex Lpe 12002 8Gb Dual Port FC HBA
N2XX-AIPCI01 - Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)
N2XX-AIPCI02 - Intel Quad Port GE NIC
N2XX-AQPCI01 - Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)
N2XX-AQPCI03 - Qlogic 2462 4Gb Dual-Channel FC HBA
Connectivity
UCS 6100 Operating Modes
End Host Switch
• External LAN sees UCS 6100 as an end-host • External LAN sees UCS 6100 as a traditional
with multiple adapters (no STP) Ethernet switch (STP = PVST+)
• Active/Active use of uplinks by pinning • Some uplinks blocked by STP (no pinning)
• Single or disjoint upstream L2 domain • Single or disjoint L2 domains
• More scalable than switch mode • MAC learning on uplink/server interfaces
UCS Ethernet Connectivity
IP Storage FCoE Storage
LAN
appliance uplinks storage target

UCS 6100 UCS 6100
monitor
Nexus 2248 Nexus 2248
Port Types vs. FI Operating Mode
From Chassis to Fabric Interconnect
Fabric SFP+ Module SFP+ Module

Interconnects
(UCS 61XX)
IO Module to 61XX
Blades pinned to uplink based
IO Modules
On Slot number
UCS 2104 UCS 2104
Midplane
Mezz
10Gb Mezz
x16 Gen 2
x16 Gen 2
Server Blade IOH
CPU CPU
Blade Chassis
From Chassis to Fabric Interconnect -
New
Fabric 16x 16x 16x 16x

Module Module
Interconnects SFP+ SFP+ SFP+ SFP+
(UCS 6248)
IO Module to 6248 links user

configuration Ether channel
IO Modules
(UCS 2208) UCS 2208 UCS 2208
Midplane
Mezz
(UCS 1280) UCS 1280
 4x10 Gbps Ether channel from VIC-2 to 2208 IO Modules
x16 Gen 2  No user configuration required
x16 Gen 2
 vNIC flows are 5-tuple LB across links
 Each individual flow limited to 10Gb
Server Blade IOH
 Fabric Failover available
CPU CPU
Blade Chassis
FC Switch mode
SAN Fabric Storage Arrays
Fibre Channel
Fabric A Fabric B
Ethernet
Core
Direct Attach Unified I/O
FCoE
FC Storage
FCoE Storage
SAN Edge A SAN Edge B
 Must have connection to

UCS 6100
MDS FC Switch or N5K
UCS 6100
 Data traffic doesn’t have to go
through FC switch or N5K
 Only works with Cisco

FC Switches or N5K
UCS B-Series
UCS C-Series Integration to UCSM
Management path via FEX, Data path directly connected
6100 running UCSM 6100 running UCSM
Mix of B & C Series
is supported
2 LOM ports Adapter support:

exclusive CIMC GE LOM PCIe Adapter Emulex CNA
connectivity Qlogic CNA
CIMC CPU Mem Intel 10g NIC
Broadcom 10g NIC
OS or Hypervisor Cisco VIC
Mgmt Traffic
C200, C210, or C250 Data Traffic
UCS Manager C-Series Integration
Phase 2, UCS 2.0+ (Capitola +1) Server Bundle/ MR (Target Q1
CY2012)
Customer benefits
 Simplified topology with converged FEX
 Scalable up to 160 servers (target scale, not QA verified)
UCS
Feature details Manager
 Stateless computing and management services benefits of
Phase 1
UCS 6100 or 6200 UCS 6100 or 6200
 Improved C-Series server connectivity
•Management and data connectivity through 2232PP FEX
•Phase 1 topology will no longer be supported (from this
server pack forward, a 2248 topology will not work).
•Note that you will not be able to direct connect the data
plane to the FI in this topology. Also, the mgmt and data
connections from the rack mounts to the 2232 are separate 10 Gb CNA
1 or 10 Gb LOM
(single wire mgmt is an uncommitted ask for a later software GLC-T connector
release)
 Server Support
• Phase 1 supported servers (C200 M2, C210 M2, C250 M2)
• Additional C-series models shipping at time of Phase 2 (e.g.,
C200 M2 Small Form Factor, C260 M2, C460 M2)
Mgmt Connection
Data Connection
Highlights of the New Topology
 New topology
Both mgmt and data connect into a single Nexus 2232 which plugs in to UCS fabric
interconnects. A pair of Nexus 2232 is required for HA. Mgmt ports will require a
1000Base-T SFP Transceiver Module (RJ-45 connector).
 Required software version
UCS 2.x (maintenance release) – This is NOT part of 2.0 FCS, but rather a follow-on
server pack
 New topology benefits
Topology simplification (converged connectivity i.e both mgmt and data plane connect
into a Nexus 2232)
Increased scale up to 160 servers (targeted value, subject to modification)
VM-FEX
Modes of VM-FEX
Emulated Mode VMDirectPath
Standard Mode High Performance Mode

 12%-15% CPU performance  Co-exists with Standard mode
improvement
 Bypasses Hypervisor layer
 vMotion supported
 30% improvement in I/O performance
 vMotion supported with ESX 5.0
VM-FEX with KVM Architecture
Guest 1 Guest 2
KVM
Application Application
Port Profile1:
Management
Qos1, vlan1
Tools Guest Guest
User
OS OS Port Profile2:
Libvirt
virtio-net virtio-net Qos2, vlan2
Netlink
Socket vhost-net vhost-net
Kernel
Macvtap
Macvtap 1 Macvtap 2 Interface
eth2…… ethn
Netdev
eth0 eth1 Interface
PF VF1 VF2 …… VFn

Cisco VIC
Adapter Port
Switch Port
Veth 1 Veth 2
Port Profile1: UCS Switch Port Profile2:
Qos1, vlan1 Qos2, vlan2
Complete Your Session Evaluation
 Please give us your feedback!!

Complete the evaluation form you were
given when you entered the room
 This is session BRKxxx-xxxx
Don’t forget to complete the overall

event evaluation form included in
your registration kit
YOUR FEEDBACK IS VERY

IMPORTANT FOR US!!! THANKS

Unified Compute System Architectural Overview

Загружено:

Сведения о документе

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

Unified Compute System Architectural Overview

Загружено:

Авторское право:

Доступные форматы

Unified Compute System (UCS)

Virtualization & Stateless Servers

SAN LAN MGMT SAN

Compute Blade Compute Blade

20Gb/s 40Gb/s 80Gb/s

 Wire Once Architecture

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

• Embedded device manager for family of UCS components

CLI Systems Management

 APIs for integration with new and existing data

Serial Over LAN

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

6100 Series Fabric Interconnects

Native Fibre Channel Lossless Ethernet:

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

2104 Fabric Extender

I/O scalability and flexibility

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

PSU Connectors Blade Connectors

Redundant data and management paths

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

UCS Fabric Interconnects

UCS Fabric Extenders

UCS Blade Server Chassis

UCS Blade Servers

UCS Rack Servers

High Performance 10Gbps per port

 Full 10Gbps network performance

 Interface Type PCIe v2.0 (5.0GT/s)

 Broadcom NetXtreme II 57711 Dual-

Dual 4x10 Gb to a single slot

N2XX-AEPCI01 - Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)

• Single or disjoint upstream L2 domain • Single or disjoint L2 domains

• More scalable than switch mode • MAC learning on uplink/server interfaces

appliance uplinks storage target

Fabric SFP+ Module SFP+ Module

Server Blade IOH

Fabric 16x 16x 16x 16x

IO Module to 6248 links user