E-Net DB2 Solutions for Availability,

Workload Balancing and Business

Continuity
Tom Flesher
EVP
E-Net Corporation
IDUG Denver
Session: VSP
Wednesday, May 25, 2005
2:00 pm
Information all day, every day.
2
E-Net Corporation Overview
Providing DB2 Offsite Recovery and Replication Solutions since 1989
Customers
Primarily financial services, banking, government
Main office: San Francisco, California
International distribution & support network
Development and support locations across the US
Development/Marketing Partners
IBM, BMC, Software AG, CA, Treehouse
Business Continuity Service Providers
IBM Business Continuity and Recovery Services
Sungard
3
E-Net Locations
4
Information - all day, every day.
Business continuity
Protect real-time business transactions
Minimize outage time
Continuous availability
24 x 7 operation
Database replication
Balancing demands on centralized data
5
Data
Loss
(RPO)
0
1 Day
1 Hour
1 Second
Recovery Time (RTO)
0 15 Minutes
6-24 Hours
1-2 Hours
E-Net Solutions Address Customers RPO/RTO Requirements
Daily Backups
CTAM / Vaulting
Traditional
Journaling (and/or
Vaulting) Solutions
Asynchronous Disk Mirroring
Synchronous Disk Mirroring
(short distance only)
Asynchronous Database Replication
RPO Recovery
Point Objective
How much
transactional
data is lost when
an offsite
recovery is
required?
RTO Recovery Time Objective
How much time is required to perform
offsite recovery?
6
Relative Cost Levels
0
50
100
150
200
250
300
350
CTAM Remote Tape RRDF with
REMOTe-VAULT
RRDF host-to-
host
RRDF and DB
Shadowing
Synchronous
Mirroring
Semi-
Synchronous
Mirroring
XRC or HXRC
Semi-
Synchronous
Fees&Misc
People
Comm
Tape
Disk
Memory
CPU
7
RRDF Remote Recovery Data Facility
E-Nets flagship product
Remote site disaster recovery
Remote site data replication
Enables remote recovery of critical databases to point-of-
failure
Enables uni-directional homogeneous replication for critical
databases
Captures, transmits, archives and reformats log and journal
data emanating from mainframe DBMS systems
DBMS feature modules for each supported DBMS
DB2 for z/OS, IMS, CICS/VSAM, CA-IDMS, ADABAS, MQ-Series, CPCS
Highly efficient, optimization features
Compression and filtering
8
DBMS
Database
Logs
RRDF Log
Management
Software
Remote
Recovered
Database
RRDF Log
Management
Software
Database
Recovery
Process
Local Server
Remote Server
Network Connection
Log has after-images of changed records
Sometimes only changed fields or columns
Used for forward/backward recovery processes
Concise basis for change propagation
Typically used for recovery on demand i.e. disaster
recovery or testing
Real-time log capture
Gap recovery
Logs
E-Nets Journaling Solution
RRDF and Database Recovery
9
Replication & Supporting Products
Log Apply for DB2
Enables replication of DB2 databases
Licensed as RRDF feature
Log Apply for CICS/VSAM
Enables replication for VSAM, online and batch
E-NET2 CA-IDMS Database Shadowing Facility
Enables replication of CA-IDMS databases
Remote use requires RRDF
REMOTe-VAULT
Real-time journaling to inexpensive Windows platform
Recovery performed on mainframe (hotsite) system
E-NET7
Sophisticated compression for RRDF
10
DB2
Database
Logs
RRDF Log
Management
Software
Remote
Replica
Database
RRDF Log
Management
Software
Log Apply for
DB2
Replication &
change
propagation
software
Local Server
Remote Server
Network Connection
Log data is periodically applied to remote replica database
Facilitates quick switch-over to backup site
Replica can be used read-only at any time
Supports DB2 for z/OS through Version 7
Real-time log capture
Gap recovery
DB2 Replication Solution:
RRDF and Log Apply for DB2
11
EDR Enterprise Data Replicator
E-Nets Enterprise Data Replicator sets the new standard in database
application availability. EDR provides replication and propagation
solutions designed specifically for real-world applications.
Your applications: High-value. High-volume. Critical systems which
have the ultimate availability requirements. Not 99%. Not
99.99999%......Systems that require 100% uptime.
EDR provides industrial-strength real-time peer-to-peer replication you
can deploy with confidence.
EDR replaces RRDF/LogApply for DB2 for z/OS Version 8 and
beyond
Migration from V7 to V8 compatibility mode to V8 new function mode
Fully tested using V8 new features
RRDF journaling solution supports DB2 V8
both modes: compatibility & new function
12
EDR: Solutions
EXPERIENCE
EDR builds on E-Nets twenty years of experience with mainframe database
replication and offsite recovery solutions, for both continuous availability and
disaster recovery applications.
LEAN AND CLEAN ARCHITECTURE
EDR uses a completely new and redesigned software architecture exploiting todays
best practices in development and quality assurance. It provides the leanest and
cleanesthigh-end data replication capability.
EXTENDED DISTANCE
EDR addresses todays and tomorrows demands for completely available and
responsive mainframe database applications across potentially many nodes,
distributed across the globe, separated by thousands of miles.
13
EDR: Solutions
GOES BEYOND MIRRORING
EDR goes well beyond the capabilities of any hardware mirroring approach,
which are by design uni-directional. EDR does not require any proprietary
hardware.
NETWORK COMPATABILITY
EDR fully exploits todays and tomorrows network configurations and
topologies, with full TCP/IP and Websphere MQ support.
BULLET-PROOF
EDR automatically recovers from unforeseen system outages, abends and
operational errors with no impact on users.
EASE OF OPERATION
EDR is easily maintained and operated, enabling true 100% continuous operation
24 by 7 by 365. Your applications are always up. Your information is available
all day every day.
14
Business Requirements
Scenario A Replication
One site normally handles update workload, but switch-over
to backup site is instantaneous
All sites have Referential Integrity, Triggers, Stored Procedures, etc.
Backup site is ready to go at all times.
Switch-back to original primary site is fast and simple
Load balancing
Inquiry transactions and other read-only work can use backup copy
Handles both scheduled and unscheduled outages with
identical operational procedures
15
Replication Scenario A
Switch-over & Switch-back
Normal Operations
Site 1 Site 2 Changes from Site 1 are
continually applied to replica
database at Site 2
Database at Site 2 available for
read-only queries/reports
Switch-over
Fail-over
Database at Site 1 unavailable
replica database at Site 2
becomes the production database
instantaneously!
PROD
PROD
Catch-up Phase
Updates which occurred at Site
2 are applied to original
production database at Site 1
PROD
Switch-back
Fail-back
Return to normal operations
complete
PROD
PROD?
16
Business Requirements
Scenario B Peer-to-Peer Replication
Multiple sites simultaneously handling update workload
Virtual Data Center concept
Enables unrestricted load balancing across multiple sites
A given user may be normally assigned to his/her preferred
site but can be immediately redirected to an alternate site
when preferred site is not available
Need to resolve logical collisions which are possible due to
involvement by multiple commit managers
All sites have Referential Integrity, Triggers, Stored
Procedures
17
Peer-to-Peer Scenario B
Multiple Update Locations
East Coast
West Coast Central
18
Enterprise Data Replicator - Goals
Reliability
The cornerstone to E-Net's ongoing success is reliability - guaranteed
data movement from DB2 to DB2 without compromising data integrity
or the operating system environment. In the world of continuous
availability, the ability to recover from abends or unforeseen system
outages must have no impact on the users of the system.
Performance
As the performance leanness of the E-Net Log Apply engine has
always been acknowledged by our customers, it is a key goal for EDR.
E-Net designed and implemented EDR based on years of experience
handling real-world applications having both high transaction rates and
large databases.
19
Flexibility
EDRs engine is structured and flexible enough to take advantages of
any new or improved features for any DB2 version. An example would
be the ability to adapt to a new DB2 data type.
Maintainability
EDR is easily maintained and by design anticipates true continuous
operations (24 by 7). EDRs engine is able to switch between software
levels without impacting current users of the system. In addition EDR
is software back level tolerant. This means that it permits different
versions of the engine to execute concurrently with no impact to users.
The engine itself contains easily distributable and maintainable
modules implemented and architected by design.
Compatibility
Compatibility with the existing versions, and future versions of DB2
and other DBMS products are a must. Downward compatibility
between and among versions of EDR is also supported.
Enterprise Data Replicator - Goals
20
EDR: OCEAN and OAR Architecture
EDR: OCEAN
Open Communications Environment
Across Networks
EDR: OAR
Open Architecture Replication
User interface
3270
Web client
21
EDR: OCEAN - Features
TCP/IP or MQ communication layer
Native TCP/IP support
Websphere MQ Series support
Uses non-persistent queues for performance
Client/server user interface architecture
XML-like packages
Standard web app (browser) interface
Also providing 3270 (green screen) support via TSO
Extensible and customizable user interface
Dynamic session management
Network pipes constantly monitored and balanced as traffic and
availability change over time
When required (e.g. network outage), packets routed over alternate
connections
22
EDR: OCEAN Topology
23
EDR: OCEAN Configurations
24
EDR: OAR/DB2 - Features
Real-time DB2 replication
Exploits DB2 Change Data Capture
Uses efficient push log capture technology
Peer-to-peer support
Effective for both Scenario A and Scenario B deployments
Highly automated operation
Fully dynamic and automatic activation for new objects
Ability to tolerate DDL changes at source site with no outage at
target
Data sharing support at both source and target
Enables true parallelism exploitation
Supports LOBs
25
EDR: OAR/DB2 - Features
Full DB2 Version 8 exploitation
Supports variety of migration strategies
Different levels of DB2 supported within a sphere
Highly efficient parallel apply mechanism
Lean and Clean
Partition-level apply for partitioned table spaces
Even if unique NPIs are in use
Specially-designed exploitation of static and dynamic SQL to
apply changes at a target location
Full support for referential integrity (RI), triggers and
stored procedures
No requirement for a unique index on target object
Ability to handle long running URs
Customizable conflict resolution
26
OAR/DB2: Capture, Apply & User Interface
OAR/DB2
Apply
OAR/DB2
Capture
DB2
for z/OS
OAR/DB2
Apply
OAR/DB2
Capture
DB2
for z/OS
OAR/DB2
Apply
OAR/DB2
Capture
DB2
for z/OS
Ocean A
Ocean C
Ocean B
User interface
27
EDR: OAR/DB2 RO Sets
> Synchronization
and apply are done
at the RO Set level
> Insures integrity
among related
objects
28
EDR: OAR for DB2
OAR/DB2
Capture
OAR/DB2
Apply
29
EDR: DB2 Consistent Unload
Source Database
IBM Image
Copy Utility
Share-level Change Image Copy
Log Files
E-Net Consistent
Unload Utility
Consistent Unload File
Introduced with RRDF V3, US Patent pending
Consistent unload output file reflects a state of
consistency even though no quiesce has occurred
30
EDR: OAR/DB2 Sync Process
Source
Database
Unload File
Target
Database
ASCL
OAR/DB2
OCEAN A
ASCL
OAR/DB2
OCEAN B
Automated FTP process
Consistent
Unload
Standard
Load Utility
31
EDR: Conflict Detection & Resolution
Detection Level One - SQL Error
Row not found (+100) & Duplicate (-803)
Advantages
Minimal overhead
Can assure data consistency in peer to peer environment
Disadvantages
Cannot detect all types of conflicts
Updates can be lost due to undetected conflicts
Detection Level Two - Content Based
Read/select done before update of a given row
Advantages
Detects all conflicts
Disadvantages
Increased CPU and bandwidth overhead
Unable to resolve conflicts at the column level
Detection Level Three Version Based
EDR keeps track of all versions of a given row
Most comprehensive approach to conflict detection and resolution
Significant overhead if conflicts occur frequently
32
Application Design
Data Center A
Application
DB2 for z/OS
EDR
Data Center C
Application
DB2 for z/OS
EDR
Data Center B
Application
DB2 for z/OS
EDR
ber-application layer
33
In summary
E-Net provides comprehensive solutions for
DB2 recovery, replication and change
propagation
We are happy to discuss your requirements in
detail with no sales pressure!
We provide a log analysis tool (RRDF
analyze) to size up your logging volumes and
identify appropriate solutions and costs.
Available at no cost.
Thank you for attending!
34
E-Net DB2 Solutions for Availability, Workload Balancing and Business
Continuity
Session: VSP
Tom Flesher
E-Net Corporation
tomf@enet.com
Tel +1-415-835-8419