Software Defined Storage @ Microsoft

PRESENTATION TITLE GOES HERE

Siddhartha Roy
Cloud + Enterprise Division
Microsoft Corporation

Lessons Learned operating large cloud properties

Industry trends
Cloud scale services influencing design
Standard, volume hardware to build
high-scale systems at low cost
Cloud design points in software

Data explosion

Device proliferation
Modern apps
Unstructured data analytics

What is Software Defined Storage (SDS) ?

Cloud scale storage and cost economics
on standard, volume hardware

Virtualization

Mobility and flexibility within and

across sites/clouds
More density

Scale Out with minimal operational

complexity

Customer choice

Private Cloud
with partner
storage

Private Cloud
with
Microsoft SDS

Hybrid
Cloud
Storage

SAN and NAS

storage

Windows SMB3
Scale Out File Server
(SoFS) + Storage
Spaces

StorSimple +
Microsoft Azure
Storage

Public
Cloud
Storage
Microsoft Azure
storage

Microsoft Software Defined Storage (SDS)

Breadth offering and unique opportunity

Private Enterprise and Hosted Clouds with

SAN and NAS storage

Private Cloud
with partner
storage

Private Cloud
with
Microsoft SDS

Hybrid
Cloud
Storage

SAN and NAS

storage

Windows SMB3
SoFS + Storage
Spaces

StorSimple +
Microsoft Azure

Public
Cloud
Storage
Microsoft Azure
storage

Optimizing Windows for SAN/NAS storage

INCITS: T10,T11,T13 (SCSI,FC,AT)

IETF: Co chairs for NFS 4.1, STORM
(iSCSI)

Technical work: SMI-S, NVM

Programming, XAM
SMB 2/3 Plugfest

Private Enterprise and Hosted Clouds with

Microsoft Storage Defined Storage

Private Cloud
with partner
storage

Private Cloud
with
Microsoft SDS

Hybrid
Cloud
Storage

SAN and NAS

storage

Windows SMB3
SoFS + Storage
Spaces

StorSimple +
Microsoft Azure

Public
Cloud
Storage
Microsoft Azure
storage

Public Cloud lessons applied

Software Defined Storage in Windows Server 2012 R2

Primary application data storage on cost affective,
continuously available, high performance
SMB3 file Shares backed by Storage Spaces

Hyper-V Clusters
SMB3 Storage Network Fabric

Scale-Out File Server

Clusters

Storage Spaces
Shared JBOD
Storage

1.

Performance, Scale: SMB3 File Storage network

2.

Continuous Availability and Seamless Scale Out with File

Server Nodes

3.

Elastic, Reliable, Optimized Storage Spaces

4.

Standard volume hardware for low cost

SoFS + Storage Spaces under the hood

SMB3 File Storage network

High speed, low latency with SMB Direct

SMB Multichannel for storage path failure resiliency

Hyper-V cluster
nodes
SMB3 Storage Network

Scale Out File Server Nodes

Easy share management

Active/Active Scale Out pay as you grow
Continuously Available

Scale Out File Server

cluster nodes

Virtualized
storage
Optimized Placement

Physical SSD
storage

HDD

Tiered Storage
spaces

SoFS - Low latency, high scale with SMBDirect

SMBDirect Microsoft

Hyper-V
Cluster

Scale Out File server (SoFS)

Cluster

App
Buffer

implementation of RDMA on
Ethernet, InfiniBand over SMB3
protocol

High throughput with low latency

Optimized to expose full potential

SMB
Buffer

SMB
Buffer

of 10/40Gbps Ethernet and 56Gbps

InfiniBand

Usage beyond storage for Server

Server Fast Live migration

32KB random
reads
Adapter
Buffer

Adapter
Buffer

from a mirrored
space (disk)
~500,000 IOPS
~16.5 GBytes/sec

Windows
Server

Software Defined Storage stack overview

Scale with
64-node
clusters

8,000 VMs
per HyperV Cluster

Guest
Clusters on
SMB

VM
Prioritization

VM Storage
Migration

Cluster-Aware
Updating
with no
downtime

Hyper-V
Replica

DPM

Dynamic
Access
control

SMB3 in
flight data
encryption

Windows
Azure
Backup

File storage
provisioning

Block storage
provisioning

Storage
Utilization
Trending

SAS Array
Support

Thin
Provision
Alert Monitor

PowerShell
Support

Hyper-V
Storage
Management

SAN based
Rapid
Provisioning

Thin LUN
provisioning

Storage Pool
Classification

SM API
Integration

SMI-S
Storage
Service

SMB3 SoFS for Hyper-V, SQL Server

iSCSI Target
block
storage

NFS 3, 4.1
for *nix
clients,
VMware

SMB3 for
Windows
clients

SMB3
Transparent
Failover

ReFS local
file system
for resiliency

System Center

SMB3 Direct
for low
latency

Fast NTFS
chkdsk

Tiered Storage Spaces

Dedup

CSV Scale
Out

SMB3
Multichannel
for FT, Perf

Private Cloud Choice - SAN or Microsoft SDS

Traditional FC/iSCSI
SAN storage arrays

Block protocol fabric

Low latency network
Management of LUNs
Storage tiering
Data deduplication
RAID resiliency groups
Pooling of disks
High availability
Persistent write-back cache.
Copy offload
Snapshots

Hyper-V
compute
nodes

Microsoft SDS Storage

(in Windows Server)

Hyper-V
compute
nodes

SAN/NAS

Scale Out File Server +

Storage Spaces

FC/SAS disk shelf

Shared SAS JBOD

FC/SAS disk shelf

Shared SAS JBOD

File protocol fabric

Low latency with SMB3Direct
Management of Shares
Storage tiering (new with R2)
Data deduplication
Flexible resiliency options
Pooling of disks.
Continuous availability
Persistent write-back cache.
(new with R2)
SMB copy offload
Snapshots

Customer Quote: NTTX

Hosting provider uses industry-standard storage (Microsoft
SoFS + Storage Spaces) to slash storage costs by 30 %

By using Storage Spaces, Hyper-V

over SMB, and other new features, I
eliminate big, lumpy capital
expenditures. I can buy
inexpensive storageand scale.
- Philip Moss, Chief Technology Officer, NTTX Select

NTTX designed a
new datacenter
around Windows
Server 2012 in order
to get new services
to market faster and
at a lower cost.

Benefits:
Achieved greater
flexibility for meeting
customer needs.
Got new offerings to
market faster.
Increased annual revenue
opportunities to
U.S.$18.6 million.
Saved $5.8 million a year.

http://www.quantaqct.com/

http://www.raidinc.com/

http://www.dell.com/

http://www.fujitsu.com/fts/

http://www.supermicro.com/

http://www.dataonstorage.com/

Ecosystem of SMB server/client

implementations
SMB PlugFest
Occurs every year side-by-side with the

Storage Developer Conference (SNIA SDC)

in September

Interaction across operating systems and

SMB implementations

Participants in the 2013 edition of the

SNIA SMB2 / SMB3 Plugfest
Santa Clara, CA September 2013

Hybrid Cloud Storage

StorSimple + Azure

Private Cloud
with partner
storage

Private Cloud
with
Microsoft SDS

Hybrid
Cloud
Storage

SAN and NAS

storage

Windows SMB3
SoFS + Storage
Spaces

StorSimple +
Microsoft Azure

Public
Cloud
Storage
Microsoft Azure
storage

StorSimple Applications & Workloads

Target Use Cases
File Share

CapEx, OpEx
of traditional
storage

SMB
NFS

File servers
NAS

Capacity

SharePoint
Cloud
Storage

Data grows exponentially

(5060% Annually)

Collaboration
Content & records
management

Business intelligence

Archives
Media
Engineering
Logs, records

Most I/O happens to

working set data
Local
Storage

Time
MICROSOFT NDA ONLY

EMR/PACS
Legal
Construction
VMs

VM sprawl
VM archives

Regional office
storage

Application Servers

StorSimple connects Windows, Hyper-V and

VMware servers to Azure Storage in minutes
with no application modification

StorSimple Appliance
Most Active Data on
SSD
Warm data on SAS
Local Tier

Speed of SSD/SAS
+ Elasticity of Cloud

Consolidates primary, archive, backup,

DR thru seamless integration with Azure

Azure Storage

Cloud Snapshots = revolutionary speed,

Inactive Primary Data +

Backup +
Archive +
DR

Reduces enterprise storage TCO by 6080%

simplicity and reliability for backup and recovery

Public Cloud Storage Azure

Private Cloud
with partner
storage

Private Cloud
with
Microsoft SDS

Hybrid
Cloud
Storage

SAN and NAS

storage

Windows SMB3
SoFS + Storage
Spaces

StorSimple +
Microsoft Azure

Public
Cloud
Storage
Microsoft Azure
storage

Store, backup, recover your data

Highly scalable: 20 trillion objects stored

Highly durable: Multiple copies of your data
Multiple object support: blobs, tables, drives
Easy access: Supports REST APIs
Available anywhere: multiple regions

Get your data wherever and whenever you need it

Microsoft Azure Storage
Defend against regional
disasters.

Geo replication

Continue the journey

Microsoft Cloud Server Contribution to Open Compute

Contributions to Open Compute Project CAD models, Specs, Gerber files, Source code
Benefits to traditional servers - 40% cost savings, 15% power efficiency gains

Where can I find more information ?

Microsoft Storage

http://Microsoft.com/storage

Solution guide Cost effective storage for Hyper-V

http://technet.microsoft.com/en-us/library/dn554251.aspx

Drop by our expo booth