Objectives

This training prepares students to:

Use and understand basic SAN terminology Distinguish SAN from NAS and other storage network technologies Understand where SANs can help users the most Describe the configuration of SANs in the point-topoint, arbitrated loop, and switched fabric topologies Cite the performance gains available through use of SAN technology Recognize the distinguishing features of the main SAN products in todays market
3/19/2014 2

Agenda

Introduction to SANs SAN connectivity

SAN components SAN applications

Basic terms and concepts Advantages of SANs SAN and NAS A Fibre Channel Primer Products and features

High-performance backup Storage consolidation/expansion Disaster protection

3

3/19/2014

What is a Storage Area Network?

A dedicated network for servers and storage systems

LAN

SAN

3/19/2014

SAN Storage

RAID: Redundant Array of Inexpensive Disks

Fault-tolerant grouping of disks that server sees as a single disk volume Combination of parity-checking, mirroring, striping Self-contained, manageable unit of storage

JBOD: Just a Bunch of Disks

Drives independently attached to the I/O channel Scaleable, but requires server to manage multiple volumes Do not provide protection in case of drive failure

3/19/2014

SAN Components

Servers with host bus adapters Storage systems

RAID JBOD Tape Optical

Hubs and switches Bridges and extenders SAN management software 3/19/2014

High Availability

Multiple levels of redundancy are configurable throughout data path Multiple access paths allow failover cluster configurations De-coupling of storage from application service allows it to be managed independently Data vaulting and disaster recovery configurations can address loss of service due to site failure

F A I L O V E R

3/19/2014

Network Attached Storage (NAS)

Dedicated, multi-protocol filer
File I/O File I/O

Attached directly to network

NAS

3/19/2014

10

SAN and NAS

SAN

NAS

Remote storage access Private net for storage Storage protocols Centralized management
Good for hosting large databases

Remote file access Shares user net Network protocols Distributed management

Good for simple, scalable file sharing

11

3/19/2014

SAN Connectivity
A Fibre Channel Primer

3/19/2014

13

Fibre Channel
Channel transport ideal for SANs
Multiple protocol support Networking capability and functionality Heterogeneous interconnect

bandwidth -- availability -- reliability -- integrity -- scalability

3/19/2014

14

Fibre Channel Connectivity

Channel

Network

Closed, structured High performance Error-free Large data transfer Hardware intensive

Open, unstructured Error-free secondary Peer to peer Data, voice, video Software intensive

Fibre Channel

3/19/2014

16

SAN Topologies
Point-to-Point
100MB > < 100MB

Arbitrated Loop

100MB

100MB

Switched Fabric
100MB 100MB
3/19/2014 17

Point-to-Point Topology

100 MB/sec

100 MB/sec

3/19/2014

18

Arbitrated Loop

TX of each node is connected to the RX of the next node until a loop is formed Operational sequence:

Arbitrate for control of the loop Open channel to target Transfer data Close Tx
Rx

Maximum bandwidth - currently Node 1 Node 2 100 MB/sec Rx

Tx Tx Rx

3/19/2014

Node 3

19

Arbitrated Loop Topology

3/19/2014

20

Switched Fabric

Maximum number of nodes = 16 million Maximum bandwidth = 200MB/sec x nodes Nodes (N-ports) log into the Fabric (F-ports) Internal routing and addressing managed by fabric End to end connection managed by the N-Ports

Fabric
Node
TX TX

Node

RX

F-Port

RX

N-Port

F-Port N-Port

3/19/2014

21

Switched Fabric Topology

10 Km

3/19/2014

22

Zoning
Zoning arranges FC connected devices into logical groups
Switch
Zone X

Zone Y

Node

Node

Node

Node

Node

3/19/2014

24

Zoning

Operation

Zone members see only other members of the zone Zones are configured dynamically Devices can be members of more than one zone FC-AL zoning allows the creation of private loops on a single hub Switched fabric zoning can take place at the port or device level

Benefits

3/19/2014

Secured device access Allows operating system co-existence

25

FC Protocol Architecture
ULP (Upper Level Protocol)

SCSI-3

IP

ATM

FC - 4

IPI - 3 Command Set Mapping (IPI-3 STD)

SCSI - 3 Command Set Mapping

FC Link Encapsulation FC - LE

FC - ATM

FC - 3 FC - 2 FC - 1 FC - 0
Framing Protocol Encode / Decode Physical Variant

Common Services

Fibre Channel Physical & Signaling Interface ( FC- PH, FC-PH2, FC-PH3 )

FC - AL

FC - AL -2

8B/10B Encoding Copper, Optical

3/19/2014

HP Quick Frame Reference at http://www.hp.com/HP-COMP/io/tech/index.html

26

How Does FC Compare to SCSI?

Fibre Channel Connections 16 Million Distance Bandwidth Hot Plug Multiple Protocols
3/19/2014

Fibre Channel AL 126 10km

Shared Bandwidth

Parallel SCSI 15 25m 160 MB/sec

Shared Bandwidth

10km
Per connection

200 MB/sec 200 MB/sec Yes Yes Yes Yes

No No

30

SAN Components
Pieces of the Puzzle
Cables Interfaces/Adapter s Hubs Switches
..

Bridges and Extenders Storage Systems

31

3/19/2014

Cables
Fiber Optic Copper

3/19/2014

32

Host Bus Adapters & Interfaces

PCI to FC Adapter

32/64-bit, 33/66-MHz, PCI 2.1 compliant Other buses - HSC, SBus 100 MB/sec FC performance GBIC support SNMP and MIB compliance AL and Fabric login support (vendor-specific) Copper/optical media support (vendor-specific) Operating system support (vendor-specific)

GBICs

Features

GLM

3/19/2014

33

Hubs

Multi-Port Fibre Channel Hub

6 -16 ports, copper or optical GBICs Network management software Supports FC-AL
34

3/19/2014

Fibre Channel Hub

Hub

Node

Node

Node

Node

Node

Features

Zoning Integrated SNMP and MIB-compliant management Configuration management tools and utilization monitoring Automated port isolation and device failover N+1 hot-swappable components for fault-tolerance Fabric upgradeability/integration

3/19/2014

35

Fibre Channel Switch

Multi-Port Fibre Channel Switch

8 -16 ports (or more) Copper or optical GBICs Fast, non-blocking, dedicated bandwidth Special services (time, name, etc.)

3/19/2014

36

Fibre Channel Switch

Switch

Node

Node

Node

Node

Node

Features

Zoning Integrated SNMP and MIB-compliant management Configuration management tools with utilization monitoring Automated port and device fail-over N+1 hot-swappable components for fault-tolerance
37

3/19/2014

Bridges and Extenders

FC-SCSI Router/Bridge

Maps SCSI devices to units of a single AL-PA Configurable mapping table SNMP management Allows FC connections > 10 KM
38

Extenders

3/19/2014

Bridges and Extenders

Host Server Arbitrated Loop
126 IDs 15 IDs

Router

SCSI Bus

Tape Library

Features

Allow use of SCSI devices on a FC network Allow use of Fibre Channel peripherals by SCSI-only hosts (running the router in initiator mode) SNMP and MIB compliance Available in multiport units

1 FC to 2 SCSI 2 FC to 4 SCSI
39

3/19/2014

Storage Systems

Features

FC-attached to the SAN High RPM, fibre drives Support for multiple RAID levels SNMP and MIB-compliant Multiple storage processors for load-balancing N+1 hot-swappable components GUI configuration management tools with utilization monitoring
40

3/19/2014

Summary and Questions

SAN Components
Cables Interfaces/Adapters Hubs Switches Bridges and Extenders Storage Systems
..

3/19/2014

41

SAN Applications

3/19/2014

42

SAN Applications

High Performance Backup

Multiple servers using SAN to backup to a shared backup resource Consolidating storage for easy management Scaling storage to meet business needs Clustering for fault tolerance Remote real-time mirroring of data

Storage Consolidation and Expansion

Disaster Protection

3/19/2014

43

The Backup Dilemma

Problem

Increasing amounts of data to backup Decreasing daily backup window Increasing backup costs
Centralized backup hardware
Reduced

Solution

equipment and management costs

High bandwidth I/O channel to offload LAN

Improved

backup performance

Scaleable connectivity
Cost

effective deployment
44

3/19/2014

Network Backup Today

Client Client Client

LAN
Network Server Network Server Network Server Backup Server

Disk Storage

Disk Storage

Disk Storage

Tape

3/19/2014

45

LAN-Free Backup
Client Client Client LAN

Network Server

Network Server
(backup node)

Network Server

Disk Storage
3/19/2014

SAN

Tape

46

Serverless Backup
Client Client Client

LAN

Network Server

Backup Server

Network Server

Disk Storage
3/19/2014

SAN

Tape

47

Storage Consolidation and Expansion

SAN provides economies of scale in storage allocation

Purchase driven by cost, not capacity Allocation on demand, no waste

SAN provides increased configuration flexibility

Multiple Initiators Multiple RAID levels

SAN provides improved expansion capabilities

Add storage as required Add I/O bandwidth

48

3/19/2014

Storage Consolidation
Client Network Server Disk Storage LAN Network Server Disk SAN Storage Client Network Server Disk Storage

Disk Storage
3/19/2014

Tape
49

Expansion - Scaling Fabric Capacity

Server
FC Host Adapter

Scaling storage does not require additional controllers, so a SAN allows flexible scaling as needs grow

3/19/2014

51

Expansion - Multiple Loops

Multiple switches are used between loops to create a larger SAN Cascaded Switches Separate Loops
Loop #1 Loop #2 Loop #3 Loop #4 Loop #5

3/19/2014

52

Fibre Channel Workgroup

FC-AL is used to create a high-bandwidth client/server workgroup
NT File Server
FC-AL w/IP FC-AL w/SCSI

Workstations
3/19/2014

Shared Storage
53

Disaster Protection

Server clustering

Application-level failover between nodes in the cluster Server-level failover between nodes in the cluster
Writing or replicating data to remote storage nodes
54

Data mirroring

3/19/2014

Server Clustering
FC is used to create a high availability server and storage cluster
Servers

FC Switch/Hub

JBOD or RAID
3/19/2014 55

Small High-Availability Cluster

Server 1 Server 2

FC Hubs/Switches

Loop A

Loop B

Mirrored RAID
3/19/2014 56

Data Mirroring
10Km Long-wave Fiber Optics Low-latency area switching enables full server and storage mirroring across up to 120Km distance

FC Switch/Hub
3/19/2014

FC Switch/Hub
57

Consider your enterprise storage requirements before beginning implementation

Implementation Lessons Learned

Capacity -- Availability -- Speed of Access

Create enterprise storage standards Consider a phased implementation approach

Assessment -- Design -- Pilot -- Test -- Rollout

Work with a single vendor or make sure all vendors approve your SAN design Make sure host OSes are at right patch/sp levels Consider the effect of SAN and Disaster Protection implementations on hosted applications 3/19/2014 58

Conclusion

Review of SAN Terms and Concepts A Look Ahead: SAN Trends Questions Course Evaluation SAN 101 Student Guide Farewell
60

3/19/2014

Review: SAN Terms and Concepts

SAN NAS RAID JBOD Fibre Channel Point-to-Point network for servers and storage systems multi-protocol network filer redundant array of inexpensive disks just a bunch of disks protocol and architecture for SANs the simplest SAN, a dedicated connection between server and storage a shared-bandwidth SAN that uses hubs to chain servers and storage nodes in a serial ring topology

Arbitrated Loop

3/19/2014

61

Review: SAN Terms and Concepts

Continued
Switched Fabric a dedicated-bandwidth SAN that uses switches to provide parallel paths that connect servers and storage nodes into a fabric Segregation of ports on a switch or hub to produce separate SANs

Zoning

GBIC
GLM
3/19/2014

Giga-Bit Interface Converter Giga-baud Link Module

62

SAN Trends

User movement from Loop to Fabric or a mix of Loop and Fabric Deployments with multiple layers of switches Adoption of LAN-free backup, moving to serverless backup Support for multiple operating systems on the same storage array Development of Common File Systems Movement to managed devices Emergence of management tools and standards
63

3/19/2014

Thank you for attending SAN

3/19/2014

65