Data Replication and

CDC using Data Services

4.x
Vara Reddy , CareFusion
SESSION CODE: 0203
LEARNING POINTS

Data Services(DS) CDC and Replication capabilities

Capabilities of DS and Attunity adapters
Long running SAP Processes vs replicating data
Reducing load on SAP instances significantly
(near) Real time availability of data for reporting
Agenda

Introduction
Driver for CDC based architecture
Challenges in current reporting and data extraction
Data Services @ CareFusion
Platform for data conversions, ETL and Replication(CDC)
Complex SAP landscape
CDC & Replication
Requirements
Full loads and Deltas
Test results
Post Golive
Q&A
Introduction
Introduction

Driver for CDC Architecture

Challenges in current reporting environment
Business requirements
IT Challenges
Complex SAP extracts
Time taking
Resource constraints
Data Services 4.x

Data Services 4.x

Data migration tool
ETL platform
Data replication platform
CDC & Replication

Requirements (Technology)
Ability to replicate data in (near) real-time
Ability to provide support for operational reporting
Load on source systems should be less than 2% of CPU
Manage Data loads effectively (ODBC connections)

Development constraints
Verifying row counts (Source vs. Target audits)
Validation
Full Loads & ODBC

Full loads
Initial , one time loads (mostly)
Should be able to handle large
data volumes
Indexes
Truncate Tables
Drop & Recreate options in DS
Full Loads (Contd..)

Full loads
Challenges with load times
Parallel threads to decrease
the load times
Thread counts to match up with
available CPUs
Full Loads (Contd..)

Pre & Post load steps

Set proper LSNs
Getting access to LSN
Managing LSN
Archiving data every 6 hours due
to storage constraints
Delta Loads (CDCs)

Delta Loads
Interface design
Ability to handle changes (I, U, D)
effectively
Setting up input stream
Defining suitable transforms
Continuous jobs (4.2+ feature)
Delta Loads (CDCs)

Delta Loads
Defining subscription names
Ability to use various add on fields
Delta Loads (CDCs)

Delta Loads
Use of DI Sequence number and Op type
Managing input keys
Managing duplicate values
Delta Loads (CDCs)

Delta Loads
Use of add-on fields
Context
Agent Context
Transaction ID
Timestamp
Views vs. Direct access to tables
SQL restrictions
Test Results
Test Results

Test Results
Post Go-live : Success Factors

Success Factors
Replicating data in near real time
System handled long running processes efficiently
Able to manage expectations around large data sets

Load on source SAP Systems

Load on source SAP Systems less than 2% of CPU
Substantial tests were performed in QA to determine actual CPU Usage
Crucial metric for success or failure of the project
Post Go-live : Success Factors
Success Factors
Operational reporting
Ability to report directly against data objects
Created views with nolocks ( deprecated feature in MS2012)
Even though near real time , SLAs were set lower for operational support

Significant reduction in development time

Overall time to develop reduced significantly
Ability to manage releases based on project demand

Significant reduction in time to deploy

Post Go-live : Challenges / Improvements
Challenges / Improvements
Windows based environment
Issues with / based custom tables in SAP
24 x 7 Connectivity and availability
Audit reports and limitation of source environments
Time outs and network issues
DS Patches and upgrades
Integrating international cross Atlantic sources
Post Go-live : Operations / Support
Operations
Code promotion
Start / Stop Deltas
Environment errors and support challenges
DB locks and ETL loads
Error notification and SLAs
Q&A

Thank you !!
FOLLOW US

Follow the ASUGNews team:

Tom Wailgum: @twailgum
&
Courtney Bjorlin: @cbjorlin
For all things SAP
THANK YOU FOR PARTICIPATING

Please provide feedback on this session by completing a

short survey via the event mobile application.

SESSION CODE: 0203

For ongoing education on this area of focus,

visit www.ASUG.com