Академический Документы
Профессиональный Документы
Культура Документы
The EMC Symmetrix Remote Data Facility (SRDF) family of replication software offers various levels of Symmetrix based business continuance and disaster recovery solutions. The SRDF products offer the capability to maintain multiple, host-independent, mirrored copies of data. The Symmetrix systems can be in the same room, in different buildings within the same campus, or hundreds to thousands of kilometers apart. By maintaining copies of data in different physical locations, SRDF enables you to perform the following operations with minimal impact on normal business processing: y Disaster restart y Disaster restart testing y Recovery from planned outages y Remote backup y Data center migration y Data replication and mobility
Course Objectives
Upon completion of this course, you will be able to: y Compare and contrast how each of the SRDF remote replication solutions y Describe the overall SRDF architecture and how each of the options replicate data to a remote Symmetrix y Perform SRDF/Synchronous, SRDF/Asynchronous, and SRDF/Automated Replication setup and monitoring tasks using the Solutions Enabler Command Line Interface y Describe the concepts of consistency, and configure consistent operations using SRDF/CG technologies and the Solutions Enabler CLI
2007 EMC Corporation. All rights reserved. SRDF - 2
This class is intended for an internal audience who needs to understand the architecture of the Symmetrix Remote Data Facility and how to set it up and manage it. It is assumed that the feature benefit is well understood and not discussed in detailed.
References
SRDF - 3
The above documents will be referenced throughout the session. All are available on Powerlink and the product guides are also bundled as part of the Solutions Enabler Documentation CD.
y Host, operating system, and application independent y Maintains copies of data in different physical locations
Protect against local and regional disruptions Minimize impact of planned outages Data Center Migration Content Distribution
SRDF Family
SRDF/S
Synchronous for zero data exposure
SRDF/Star
Multi-point replication option
SRDF/CG
Consistency Group option
SRDF/A
Asynchronous for extended distances
SRDF/AR
Automated Replication option
Cascaded SRDF
SRDF/DM
Efficient Symmetrix-toSymmetrix data mobility
SRDF/CE
Cluster Enabler option
SRDF - 4
The SRDF family of software is a powerful suite of remote storage-replication solutions for disaster recovery and business continuity. Leveraging the Symmetrix hardware architecture, it offers deployment flexibility and scalability to deliver a wide range of distance-replication capabilities. SRDF family is the most widely deployed set of high-end replication solutions, with tens of thousands of installations in the most demanding environments.
y Target (R2)
Secondary Copy BC/BR operations
RE RE
RE RE
y Remote Adapters
RF Fibre Channel RE Gb Ethernet RA - ESCON
Source Source R1 Target R1 R2 RF RF
y SRDF Links
Point-to-point Switched
Source Source R1 Source R1 DRX RF RF
RF RF
Production
Recovery
SRDF - 5
A basic SRDF configuration consists of a production site and a recovery site. Application servers are connected to the production Symmetrix, and optionally to the Symmetrix at the recovery site. The device containing the production data that is remotely mirrored is called the Source or R1 volume. At the recovery site, the Symmetrix contains a copy of the data called the Target or R2 volume. Dynamic SRDF configurations enable the user to dynamically create, delete, and swap SRDF source and target pairing relationships using Solution Enabler CLI or other EMC SRDF control software. Dynamic RDF devices are configured in the binfile as DR1 which can be dynamically paired as R1 devices, DR2 that can be dynamically paired as R2 devices, or DRX which can be paired as either or personality swapped dynamically. The Symmetrix systems communicate through SRDF links, that are connected at the Symmetrix using Remote Adapters. EMC today currently supports ESCON, Fibre Channel and gigabit Ethernet connections. When the Symmetrix is configured for SRDF, Remote Adapters are logically grouped together into SRDF groups. SRDF groups define relationships between Symmetrix systems. An SRDF group is a set of SRDF director port connections configured to communicate with another set of SRDF director ports in another Symmetrix system. Logical volumes (devices) are assigned to SRDF groups. An SRDF group configured through Symmetrix configuration is called a static SRDF group. With Enginuity level 5669 or above, a user can dynamically create empty SRDF groups and dynamically associate the groups with Fibre Channel or GigE SRDF directors.
One to Many
Many to One
Many to Many
SRDF - 6
Only EMC provides the breadth and depth of choices for configuration and consistency that you see on this slide. Whether you want to run SRDF/S or SRDF/A, you have the option to configure bidirectional, one-to-many, many-to-one, or concurrently protected environments. And you can mix and match any or all members of the SRDF and TimeFinder families into solutions and configurations that meet the needs of your applications, instead of being forced to fit your needs to a specific solution.
SRDF/Asynchronous
y RPO in Seconds y Data transfer in Delta Sets y No performance impact y Unlimited distance
2 1
Source
Target
Unlimited distance 3
SRDF/Data Mobility
y Data Transfer between Symmetrix y No performance impact y Write ordering NOT maintained y Unlimited distance
2007 EMC Corporation. All rights reserved.
Target
4
SRDF - 7
Where service-level requirements dictate zero data exposure, SRDF/Synchronous is the appropriate solution. With synchronous replication it must be understood that distance is limited by speed-of-light issues, and network bandwidth must be sized for peak workload to ensure appropriate application performance. SRDF/A provides asynchronous replication while maintaining a dependent write consistent copy of the data on the secondary (R2) device at all times. The point-in time copy of the data at the remote side is typically less than a minute behind the primary (R1) copy. SRDF/A session data is transferred to the remote Symmetrix system in predefined timed cycles or delta sets. When multiple writes are made to the same blocks, only the most recent changes are maintained and need to be sent to the remote side, thus eliminating the redundancy of multiple same track changes being transferred over the link and potentially reducing the required bandwidth. In addition, writes to consecutive blocks are combined and more efficiently transferred as a single write. SRDF/Data Mobility (SRDF/DM) is designed for data distribution and/or migration between two or more Symmetrix systems. SRDF/DM transfers data from primary volumes to secondary volumes permitting information to be shared, content to be distributed, and access locally. There is no application performance impact as write operations are acknowledged immediately, however write ordering is not maintained and in the event of a disaster, it is likely that the copy on the remote site will be incomplete or inconsistent. SRDF/DM should only be considered for content distribution and not disaster recovery.
Synchronous Mode
2 4 R1 1 3 R2
1. Source Symmetrix receives write from host 2. The write is propagated to the target Symmetrix 3. The target Symmetrix system sends an acknowledgment to the source Symmetrix 4. Status sent to Host
SRDF - 8
1.The local Symmetrix system containing the primary (source) volume receives a write operation from the user application. 2. Write is propagated to the remote Symmetrix system.. 3. When the write is received and stored in cache, the remote Symmetrix system sends an acknowledgment to the Source Symmetrix. 4. The local Symmetrix system sends an I/O complete message to the local host; and the local Symmetrix system can now accept additional write operations to that device.
Asynchronous Mode
2 R1 1
R2
1. Source Symmetrix receives write from host 2. Status sent to Host 3. Changes are tracked as Delta Set 4. Delta Sets sent to R2 site 5. Complete Delta Sets are applied to R2 or not
2007 EMC Corporation. All rights reserved. SRDF - 9
1. Host sends write operation to Source Device. 2. With SRDF/A, when the Symmetrix containing the source volume receives a write operation from the user application, the local Symmetrix system immediately sends an I/O complete message to the host. 3. SRDF/A tracks changes as Delta Sets in cache. Delta Sets are simply a set of changes that occurred over a specified time. 4. Delta sets are sent to the Remote Symmetrix. 5. Delta set is applied to Target devices. During normal operation, SRDF/A continuously cycles between capturing changes in Delta Sets, transmitting Delta Sets to the R2 Symmetrix, Receiving Delta Sets, and applying the Delta Sets to the R2 devices. Key is the concept that only complete Delta Sets are applied. This ensures ordered write consistency.
1. Write I/O sent to Source device from host 2. Once received in cache, write complete is returned to host 3. Write is queue for transmit to target and asynchronously destaged to disk locally 4. Write is sent to remote Symmetrix 5. Target Symmetrix sends acknowledgment to Source source
2007 EMC Corporation. All rights reserved. SRDF - 10
SRDF/S Adaptive Copy mode is used primarily for data migrations, data center moves, and content distribution applications. By itself, this operational mode is not appropriate for disaster recovery/restart purposes. When a device is in SRDF/Ss Adaptive Copy mode ,the source (R1) volumes and target (R2) volumes may be a few or many I/Os out of synchronization and the order that they are re received on the Target side may be different than the order in which they were sent by the host so unless the devices are fully synchronized, the Target will be an inconsistent copy. The number of tracks that a target can be out of synchronization is called the skew and is user selectable. There are two types of adaptive copy: y Write Pending mode y Disk mode.
Far city
SRDF - 11
The synchronous and asynchronous modes are not static and can be combined in deploying a solution that is appropriate for a given environment. For example, SRDF/S and SRDF/A can be run concurrently off the same source volume to two different target devices in different locations. SRDF/A can be added to an existing SRDF/S implementation nondisruptively to extend the disaster recovery capabilities to included a recovery site that is out of region. . Modes can also be dynamically changed in an environment that is prone to frequent bursts of heavy processing. By switching from SRDF/S to SRDF/A, the performance penalty associated with Synchronous mode can be minimized with only a slight compromise to the DR position. Mode change can make it possible to size network bandwidth requirements for something less than peak.
SRD F/ A
Far city
Near city
SRDF/A Source 1 4 2 SRDF/S 3
SRDF/DM
SRDF/AR
y RPO: Zero or hours y Unlimited distance y Single or multi hop y Leverages TimeFinder
Target
Cascaded SRDF
y RPO: Zero or hours y Unlimited distance y No TimeFinder dependencies
2007 EMC Corporation. All rights reserved.
Source 1 4 2 SRDF/S 3
R21
Target
SRDF/A 5 4
SRDF - 12
. There are a couple options for providing multi-site protection. y Through the use of Multi-Hop SRDF/AR, you can configure a solution that offers the protection of no data loss over any distance in the event of a single-site disruption. This configuration combines TimeFinder to create single and multi-hop configurations. y SRDF/Star combines concurrent SRDF/A and SRDF/S with the ability to immediately enable protection between two remote sites in the event of a source-site failure. This allows critically applications to quickly retain their DR position.
32
32
y Ordered writes
Device level Spanning multiple devices Across hosts and applications Across multiple Symmetrix systems
5 4
5 4
SRDF - 13
A very important concept to understand is the Dependent Write Concept where the start of one write is dependent on the completion of a previous write. This is logical dependency, not a time dependency. Nearly all Database Management Systems (DBMS) depend on this in order to successfully recover after a power failure or other error conditions. Key to this is the assumption that log writes must complete successfully before data updates are made to the table space. While it is easy to see and understand the importance of ensuring that writes to a device occur in the order that they are sent, if the application dataset spans multiple devices, it is equally as important that write ordering be maintained across devices and that when devices are replicated, all members reflect the same point in time. Taken further, in large environments, a set of business applications may also need to maintain order consistency. For example sales order systems and inventory systems have a logical dependency. If a sales order is shipped and the inventory is not updated, there will be business inconsistency. EMC replication and consistency technologies provide a variety of solutions that will be discussed in this class. An example of this technology is Consistency Group. SRDF/CG provide a capability to maintain consistency across a number of devices, applications, and even to a number of storage arrays maintaining ordered write fidelity, even when there is no external linkage between disparate operations.
y Devices act in unison to preserve dependent write consistency and maintain data integrity
If a R1 device cannot propagate data to its corresponding R2 device, consistency software suspends data propagation from all the R1 devices in the group
y Session consistency for SRDF/A devices is provided by host-based Multi Session Consistency (MSC) technology
2007 EMC Corporation. All rights reserved. SRDF - 14 14
Again, Consistency is key! One of the simplest options for maintaining write consistency across devices is to enable Domino mode where if something prevents the propagation of a write from a source to a target, all devices immediately are placed in a not ready state to prevent data diversion. SRDF Consistency Group (SRDF/CG) are Composite Group enabled for remote database consistency. They contain R1 or R2 devices that may belong to different RA groups in the same or different Symmetrix Systems. Devices in a consistency group are specially configured to act in unison to maintain the integrity of a database when distributed across multiple Symmetrix arrays or across multiple devices within an array. If a source R1 device in the consistency group cannot propagate data to its corresponding R2 device, RDF consistency software suspends data propagation from all the R1 devices in the group. EMC PowerPath or Enginuity Consistency Assist (ECA) is responsible for tripping the consistency. RDF consistency group protection is available for both synchronous mode (SRDF/S) and asynchronous mode (SRDF/A).
898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898 898
There are several different commands that can be used to display a list of device types and can be used to identify SRDF configured devices.
As an alternative to symdev or sympd list, symrdf can be used and will display more detail about the state and configuration of the SRDF source and target devices. Note the Legend for MODES.
000190102255 000190102255 1 1 (00) (00) 1 1 000190102255 000190102255 1 1 (00) (00) 1 1 000190102255 000190102255 12 12 (0B) (0B) 12 12 000190102255 12 (0B) 12 000190102255 12 (0B) 12 D D I I R R E E C C T T O O R R S S Remote Remote SymmID SymmID Local Local RA RA Grp Grp
(00) (00) Online Online (00) (00) (0B) (0B) Online Online (0B) (0B)
Symmetrix Symmetrix ID: ID: 000190102255 000190102255 (Remote) (Remote) S S Y Y M M M M E E T T R R I I X X Ident Ident RF-8D RF-8D RF-9D RF-9D Symb Symb 08D 08D 09D 09D Num Num 56 56 57 57 Slot Slot 8 8 9 9 Type Type RDF-BI-DIR RDF-BI-DIR RDF-BI-DIR RDF-BI-DIR
Status Status
000190101856 000190101856 1 1 (00) (00) 1 1 000190101856 000190101856 1 1 (00) (00) 1 1 000190101856 000190101856 12 12 (0B) (0B) 12 12 000190101856 12 (0B) 12 000190101856 12 (0B) 12
(00) (00) Online Online (00) (00) (0B) (0B) Online Online (0B) (0B)
SRDF - 17
The Symmetrix systems communicate through SRDF links, that are connected at the Symmetrix using Remote Adapters. EMC today currently supports ESCON, Fibre Channel and gigabit Ethernet connections. When the Symmetrix is configured for SRDF, Remote Adapters are logically grouped together into SRDF groups. SRDF groups define relationships between Symmetrix systems. An SRDF group is a set of SRDF director port connections configured to communicate with another set of SRDF director ports in another Symmetrix system. Symmetrix Source and Target devices are assigned to SRDF groups. An SRDF group configured through normal Symmetrix binfile configuration are called a static SRDF group. With Enginuity level 5669 or above, a user can dynamically create SRDF groups and associate Fibre Channel or GigE SRDF directors as needed. And dynamically assign Source and Target devices to these RA groups. In the example above, both the local and the remote Symmetrix have two directors configured as SRDF Remote Link Directors. Director 8D is part of RA Group 1 and 9D is designated as a Remote Link Director but is not part of a RA Group. However, director 9D could dynamically be configured to be a member of a RA Group.
The symcfg rdfg list all command will display all rdfg groups n both the local and remote Symmetrix. For this example, information about the remote RDF groups was deleted from the screen shot.