Storage Overview And Architecture

Presented by :
Mahesh Totad USN:2VX10SCN08 Raghunathsingh Rajput USN:2VX10SCN10

Under the Guidance of Asst. Prof. S. F. Rodd

Enterprise Network Storage Architecture

Unbounded performance and capacity

Network Attached Storage Software Direct Attached

+ +

Unprecedented flexibility
Storage Area Network

Core Technology

Services

Simplified management

The lowest total cost of ownership

Direct Attached Storage(DAS)

Low Cost Solution Simple to Configure De-Centralized Storage No Storage Consolidation No High Availability Low Performance

Network Attached Storage(NAS)

Heterogeneous Environment Centralized Storage Low Performance Limited scalability Network Congestion during backups & Restore Ethernet Limitations

Storage Area Network

Heterogeneous environment Centralized Storage Management High Degree of Fault Tolerance Best and superior performance Storage Consolidation Fast and efficient backups and restores Dynamic Scalability Expensive solution for small setups

SAN
Fibre Channel

V/s

NAS
IP

Reliable
Extremely low CPU Overhead Large Blocks of Data LAN-free back-up

Unreliable
Extremely High Large Nos. of small Blocks Lan Back-up

Applications managing own Applications driven by universal Data specs access to files

Mid-Range Storage Features

Excellent ease of use Virtualization Dynamic virtual disk expansion Business Copy functions Continuous Access functions High availability features High, middle*, and low models and configurations Multiple operating system support Single pathing support for all operating systems Coexistence with heterogeneous configurations

Buisness copy Overview

Continuous Access-Overview

Flex Copy Concept

Features Allows use of low end storage for low-cost point-in-time copies of production data Point-in-time copy to and restore from Low end storage CLI or GUI Configuration Benefits Reduced TCO in mixed product/non-production Offloads production data from secondary operations Allows for distributed remote data and hi performance twostage backup/archive configurations

Cost-effective, external point-in-time copies

C1

Low end storage

Enterprise storage

Product Positioning

Additional Features EVA4000/6000/8000

Additional features unique to the second generation EVA New controllers with improved performance, higher capacity support, larger cache, more FC ports Up to 200TB of presented capacity (versus 35TB for the first generation EVA) Support for 1024 LUNs (first generation EVA was 512)

Support for active-active failover using multipath software

for all operating systems Increased support for boot from SAN (AIX, Solaris) Direct Connect support for Windows Additional CA functionality Support for native HBAs and HBA drivers Additional snapshot and snapclone functionality

Useful Links
Information sources : HP Enterprise Virtual Array http://h18006.www1.hp.com/storage/arraysystems.ht ml HP Command View EVA http://h18006.www1.hp.com/products/storage/softwar e/cmdvieweva/index.htm Whitepapers http://h18006.www1.hp.com/storage/arraywhitepapers .html

Storage backup Overview And Architecture

BACKUP SOFTWARE
What is it? Software that provides automated data protection for businesses with 24x7 availability needs. What does it do? Data Protection: copies data onto a storage device, so that in case of a need (loss, corruption, disaster), data can be easily recovered and made accessible. Media management: easily manages the library catalogues to keep track of all media and copies of data for fast recovery. Most important features: Automated backups that scale from small workgroups to multisite, heterogeneous SAN & NAS environments with thousands of servers. Fully-integrated Zero-Downtime backup with Instant-Recovery.

Architecture Components

manager of managers

distributed GUI

operations console

cell manager

cell clients

Client-Server Modules
cell console (CC)

cell manager (CM)

media agent (MA)

disk agent (DA)

Inter-process Communication (IPC)

cell console

network backup/restore
disk agent

local backup/restore tcp/ip

cell manager

tcp/ip

disk agent

tcp/ip

scheduler

shared memory

session manager media agent

session manager

tcp/ip

tcp/ip

media agent

How to choose between tape drives and tape libraries servers

Tape drives
Servers are configured individually and backup device is connected directly to the server

Autoloaders

Tape Libraries
Multiple servers are configured together Unattended backup LAN or SAN based backup Disk capacity to be backed up is more than 1 TB Consolidation and centralized management is required Storage external to servers in JBOD or disk arrays

Single/Multiple servers Unattended backup LAN based Backup Disk capacity to be backed up is 200 GB Disk capacity to be to 1 TB backed up is less than Consolidation is 200 GB required Cost conscious customer

Relative Performance
Ultrium 460 SDLT 320 Ultrium 215 Ultrium 230

Corporate/ networked backup

400GB

DLT VS80

100GB

Office Servers

DAT 72

50GB

DAT 24 Workstations

DAT 40

25GB 6 12 25 50 100 200

Speed GB/hour (compressed)

Capacity (compressed)

Departmental/ local network

200GB

Tape drives Speeds and feeds - Comparison

Ba ck up ca pa city GB / hourTa pe Device DAT 12/ 24 DAT 20/ 40 DAT 72 DLTvs80 DLTvs160 DLT 80 (obs) SDLT 110/ 220(obs) Ultrium 215 Ultrium 230 SDLT 160/ 320 SDLT 600 Ultrium 448 Ultrium 460 Ultrium 960 Da te Tra nsfer Speed M B/ Sec N a tive 1.2 2.4 3 3 8 6 11 7.5 15 16 36 24 30 80 Com pressed 2.4 4.8 6 6 16 12 22 15 30 32 72 48 60 160 Da ta Ca pa city in GB N a tive 12 20 32 40 80 40 110 100 100 160 300 400 200 400 Com pressed 24 40 72 80 160 80 220 200 200 320 600 800 400 800 N a tive 4.32 8.64 10.8 10.8 28.8 21.6 39.6 27 54 57.6 129.6 86.4 108 288 m ax Com pressed 8.64 17.28 21.6 21.6 57.6 43.2 79.2 54 108 115.2 259.2 172.8 216 576

Complied by Ranganath Sadasiva

Features
Features Required in any Backup software
Advanced backup to disk

Oracle/SAP Integrations Zero Downtime Backup Split mirror Snapshot Snapclone Filesystem / application backup on inactive MC/SG node

Overview Advanced backup to disk

Why backup to disk? Benefits
Fast random access allowing:

Fast single file restore Space efficient backup e.g. switching for recovery instead of restoring data from tape

Instant recovery

Faster restore of backup chains No tape streaming problems Ideal for RAID 5 Easy to detect disk failures More protected, e.g. its not easy to steal a disk

Advantages of ZDB
The advantages of using Data Protector Oracle ZDB integration are the following: ZDB reduces the performance degradation of the application system. The tablespaces are in backup mode (online backup) or the database is shut down (offline backup) only during the short period required to create a replica (split the mirror disks or create snapshots). The time to create a replica is significantly reduced. Following its creation, tape backup can be created on the copied data, at leisure , using a separate backup system. The Data Protector Oracle ZDB integration offers online and offline backup of your Oracle Server System (application system).

BACKUP CONCEPT-SPLIT MIRROR BACKUP

ZDB Setup
True online backup for integrated applications Split mirrors may used for instant recovery or resynced No performance impact on applications during backup Mirror synchronization before or after backup Automatic mirror rotation API based integration

Application host

XP

M
0
P primary LDEV

M M
1 2
Backup host

M mirror copy (MU0-2)

Backup Software and Storage Integration Concept

Client 1

Client 2

New HP Storage Products

RISS
Introducing

HP StorageWorks Reference Information Storage System

What is RISS is and who wants it?

The HP StorageWorks
Reference Information Storage System (RISS)

A cornerstone of HP ILM (Information Lifecycle

Management )

A fully integrated and uniquely scalable system for access to reference information that
reduces Total cost of Ownership, mitigates risk and turns data into information

HP StorageWorks
Reference Information Storage System
Manage Costs

Remove static data from application servers/storage Shorten backup windows Eradicate duplicate data objects

Mitigate Risks

Automated retention of messages & attachments Data is digitally signed, time stamped & protected Assist customers to meet their compliance requirements

Exploit Data Assets

Power indexing! Grid computing for fast search/retrieval

Scale is the Problem

As the number of information objects grows
cost of management increases accessibility to the information decreases

Access Time TCO $ Performance

A B

A A B C B

A B C

TCO
# of content objects managed

HP StorageWorks RISS architectural benefits

Client applications get added archive functionality (architecture transparent to them) front end' Application integration with e-mail and MS Office back end' Content is digitally signed and time stamped for regulatory compliance Objects in the RISS cannot be modified or deleted until end of retention period
smart cell

Clients User Application

Application Integration

Open protocol API

RISS

Application-independent indexing, search and retrieval of information Modular, redundant, self healing grid computing and storage (smart cells)
smart cell

hp Storage Works File System Extender (FSE)

A General Overview

What is FSE?
HP StorageWorks File System Extender (FSE) is new-generation data management software that is part of the HP Information Lifecycle Management portfolio. Enables automatic and transparent data movement between production (primary) storage media and secondary storage media, using simple userdefined rules.

Changing digital storage demands

Stored data

Majority is reference information

Reference

FSE attacks the costs of reference data

Operational Time

FSE Basics
Based on Client/Server architecture. Infinite File System FSE software supports LTO drive technologies for

LTO Ultrium 1 and LTO Ultrium 2 media.

WORM Support. Automatic error detection FSE automatically detects drive and media hardware errors. NFS & CIFS support

Managing storage spaces

FSE storage spaces

MSA/EVA & FSE

production storage SCSI disk

1. Inactive files moved from SCSI to SATA disk

MSA1500/ EVA secondary storage SATA/FATA disk

3. Automatic & transparent recall of migrated files

2. Optional second copy to tape

4. File recall from second copy if first unavailable

secondary storage MSL tape library

Contents

What is the EFS WAN Accelerator?

HP EFS WAN Accelerator

How Does it Work?

Removes All Redundant TCP Traffic on WANs

Files, Emails, Backup, Web Traffic, FTP, Applications Stores All TCP Traffic On Disk Never Send The Same Data Twice Reduces WAN Traffic By Up To 98%

Optimizes Application Protocol Behavior

Removes Most Round Trips for Chatty Apps Like Windows Highly Effective for the Most Common Applications

Optimizes the Behavior of TCP

Reduces Chattiness in TCP Implements Latest TCP Optimizations

Up to 100 Times Faster Throughput

HP EFS WAN Accelerator

Three-part Solution The Problem 1. Not Enough Bandwidth HPs Solution Scalable Data Referencing (SDR) Virtual Window Expansion (VWE) High speed TCP optimizations Transaction Prediction (CIFS, MAPI) What it Does Remove repeated bytes from the WAN for all TCP traffic Optimizes performance of TCP Enables much higher throughput on LFNs Optimizes the performance of specific applications

2. TCP Chattiness and Inefficiency

3. Application Chattiness and Inefficiency

HP EFS WAN Accelerator

Management Features Overview

EFS WAN Accelerator Manager

Provides central management of up to 500 appliances

Provides fleet management

Monitors health, throughput & acceleration done Performs SW updates to groups of nodes

Separate product packaged as an appliance

HP Proliant Management
HP Systems Insight Manager Full Integrated Lights-out (iLO) support

HP Storage Essentials Suite

Storage Software Division Hewlett-Packard

Unified Management of Server and Storage Infrastructure

Storage Island
Efficiency
Consolidate infrastructure mgmt tools Centralize and automate routine tasks Improve deployment costs Lower training costs Deploy resources faster and more reliably

Server Island
Enable IT agility Increase availability
Quicker time to problem resolution
Manage systems remotely from any location Single point of integration between business process and IT infrastructure Specify SLAs across entire infrastructure Consistent security model for entire infrastructure Quick access to business operation metrics (e.g., audit and usage reports)

Introducing HP Storage Essentials

Topology Maps Centralized Reporting Chargeback Capacity GUI & CLUI Provisioning Performance Policy Mgr File System Views Sybase Views 3rd Party/ HP Developed

Enterprise Edition Provisioning Mgr Chargeback Mgr Oracle Viewer Exchange Viewer Sybase Viewer File System Viewer Global Reporter Report Designer

Main console for open, heterogeneous SAN management Heterogeneous host to array path provisioning wizard

Customize Reports Exchange Views

Asset based chargeback management. Assign tiers

Oracle database availability and performance views Exchange database availability and performance views Sybase database availability and performance views File system scanning reclaim wasted space Rollup reporting of multiple Storage Main console for open, Essentials Server instances heterogeneous SAN management Develop custom reports for storage infrastructure

Oracle Views

HP Storage Essentials Enterprise Edition

Main console for open, heterogeneous SAN management
Capabilities:
Application-to-LUN autodiscovery Topology visualization Dependency, path, & connection management Capacity management Real-time performance monitoring Advisors & Automators Enabling Features: Role-based security Event management Historical & predictive trends Reporting engine Policy engine OpenRAD and CLIs

Topology

Capacity

Deployment on Windows 2003

HP Storage Essentials Oracle Viewer

Extends Storage Essentials capabilities "inside" Oracle databases to ensure availability and performance of database applications

Capabilities: Discovers database instances, hosts, databases & tablespaces SAN dependency & path management Closed loop capacity management Real-time performance monitoring Role-based security Policies, events, reports

Where is the Pain ?

Under-utilized assets

Storage infrastructure

IT staff
Cost of heterogeneous management is expensive and inefficient Application down time issues angers the customer

Troubleshooting is time consuming Help desks are flooded

Server consolidation/data center moves drives the budget On-going justification of the budget

What happened to all the storage? Why do we need more now? When again?

Key Qualification Questions

Identifying the Pain Points

How do you manage increasing storage capacity with flat or shrinking IT headcount? Do you have a SAN? Can you tell what the impact of a lost SAN element will be on your applications and users? How do you keep your staff trained on a wide range of device-specific element managers and tactical SRM tools that, right now, only add complexity? Do you want to replace the whiteboards and spreadsheets youre currently using for SAN management with something that is more scalable and reliable? How do you avoid vendor lock-in and heavy, proprietary agents that come with other solutions? Can you provision storage in real time to support new applications and projects? How do you comply with SAN change control and internal audits?

Thank you