20150909-Regio Berlinbrandenburg 010 Jaensch - Oracle Dis 12c Short Overview

Oracle
Data Integration Solutions

Short Overview
Joachim Jaensch - Principal Sales Consultant
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3

Agenda
1 Oracle Data Integration Solutions (DIS)

2 Oracle Data Integrator (ODI)
3 Oracle GoldenGate (OGG)
4 Oracle Enterprise Data Quality (OEDQ)
5 Oracle Enterprise Metadata Management (OEMM)
6 Oracle Data Service Integrator (ODSI)

7 Oracle Active Data Guard (OADG)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle OpenWorld 2014 4
Oracle Data Integration Solutions (DIS)
Introduction
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 5
Oracle Data Integration Solutions 12c
Deliver real-time data integration for Cloud and Big Data
• Real-time data replication; optimized for

Oracle Data Integrator Database 12c and Oracle Exadata
Cloud
• End-to-end integrated with simplified
Oracle GoldenGate deployment
Apps Oracle Enterprise Data • Unified tooling for both structured data
Quality sources and Hadoop / NoSQL
Oracle Metadata • Flexible deployment on-premise or in the
Database Management Cloud for heterogeneous systems
Oracle Data Services • Expanded support for 3rd party systems
Integrator
Big Data
and Oracle Applications in real-time data
Oracle Active integration and continuous availability
Data Guard
solutions

Oracle Data Integrator
E-LT: Bulk Data Processing and Fast Data Transformation
Cloud Oracle Data Integrator

• Certified for leading
technologies to deliver fast
High Performance E-LT
time to value
Apps
Declarative Design • High-performance, low cost
of ownership E-LT
Extensible Knowledge Modules architecture
Database
• Lightweight deployment
Data Services
• Flexible, easy to enrich
Big Data Structured & Unstructured Data functionality

Industry Leading Performance
Extremely Fast Execution and Reduced Cost
Conventional ETL Architecture E-LT provides a flexible architecture for
Extract Load
optimized performance on any platform
Transform Benefits
• Leverages set-based transformations
Next Generation Architecture • Improves performance for loading,
no network hop
“E-LT” • Takes advantage of existing infrastructure:
hardware and software
Extract Load
Transform Transform

Declarative Design
Improved Developer Productivity For Faster Time to Solution
• Easy and universal for designing simple to complex mappings
• Robust and Reusable: Create Mappings once for any physical design
• Quick to define and refactor maps, high degree of automation
• Extensible model for any data integration mechanism
• Benefits ODI Declarative Design

• Significantly reduces the learning curve
• Shortens implementation times 1 2
• Simpler maintenance Define Automatically
What Generate
You Want Dataflow
Define How: Knowledge Modules

Knowledge Modules
Simpler Physical Design and Shorter Implementation Time
Pluggable Knowledge Modules Architecture

Reverse Load from
Engineer Journalize Check Integrate, Data
Source to
Metadata (CDC) Constraints Transform Service
Staging
Sample out-of-the-box Knowledge Modules: Key Architecture Benefits:

• Faster development and simpler
Oracle
Oracle Sqoop Hive HBase SAP ERP maintenance using templates
Merge
Oracle Oracle External

• Easy to extend and add new best
SAP BW JMS Teradata
Datapump DBLink Tables practices
Oracle eBusines
• Enforces predictability and reduces cost
Siebel IBM DB2 Netezza SCD
Spatial Suite of ownership

Extended Connectivity
Leverages Existing IT, Faster Implementation
Cloud
 Big Data: Hive, HBase, Sqoop
 Best for Oracle: Merge, Spatial, Multi-Table Big Data
Insert, Optimizer Hints and more
 Real-Time: CDC with GoldenGate
Applications
 Applications: E-Business Suite, Siebel,
PeopleSoft, JD Edwards Enterprise One, JD
Edwards World, SAP ERP and SAP BW Databases
 Heterogeneous: Optimizations for all major
RDBMS: IBM DB2, Microsoft SQL Server,
Teradata, Netezza, etc. Legacy

How ODI Works: E-LT Architecture
High Performance, Flexible, Lightweight Architecture
Application & SOA Business Intelligence

& Data Warehouse
ODI Agent
ODI Agent may be deployed in

any part of the architecture
JKM LKM
A IKM
D
B C$_0
I$ E$ (Errors)
LKM C$_1
File
C RKM IKM CKM
Extract-Load Transform Check-Load

• Key Architecture Benefits: 100% Java, Open APIs, fast E-LT

Integration Between GoldenGate and ODI 12c
• Enable GoldenGate journalizing on

interfaces without restructuring.
• Manage GoldenGate Capture/Delivery

instances in ODI Topology
• Set common GoldenGate parameters

graphically
Bulk Load Scenario Real Time Scenario
• Deploy GoldenGate processes via ODI
• Support real-time and bulk from the same
Capture Delivery
interface

Oracle GoldenGate
Heterogeneous Data Replication
Oracle GoldenGate • High-performance, low-

Cloud
impact real-time data
Log-based Change Data Capture and integration and
Delivery
replication
Apps
Active-Active Replication
• Timely data for
Heterogeneous Source and Targets improved business
Database insight
Reliability and Transaction Integrity
• Continuous availability
Big Data/Java/FlatFile Integration for 24/7 operation
Big Data

More Information later!
Oracle Enterprise Data Quality
Data Quality for Customer and Product Data
Cloud Oracle Enterprise Data Quality • Improves data accuracy,

usability and ‘fitness for
Profile, Explore, Audit purpose
Apps
Parse, Standardize, Cleanse • Unified interface for
ease-of-use, lower TCO
Match, Merge, Enrich
Database • Depth of capability in
Governance multiple data domains
reduces project risk
Big Data Case Management
Data Quality Issues – A simple Customer Table
Matching Records
Non Standard formats
Name Address City State Zip Phone Email
Bob Williams 36 Jones Avenue Newton MA 02106 617 555 000 bob.williams@yahoo.com
Robert Williams 36 Jones Av. MA 02106 617555000

Burkes, Mike and Ilda 38 Jones av. Nweton MA 02106 617-532-9550 mburkes@gmail.com
Jason Bourne, Bourne & Cie. 76 East 51st Newton MA 617-536-5480 6175541329
… … … … … … …
Mis-fielded data
Multiple Names
Typos
Mixed business and

contact names Missing Data
Copyright © 2014 Oracle and/or its affiliates. All rights reserved.Oracle

| Confidential – Internal/Restricted/Highly Restricted 17
Profile, Cleanse and Govern Business Data
• Solution
– Profile business data to find the bad data and assess quality over
time
– Cleanse, match and merge data before it gets loaded into the Data
Mart or Data Warehouse
– Repair data during batch processing flows
• Benefits
– Stop the garbage-in-garbage-out cycle!
– Improve the trust of data within business marts and data
warehouses
– Enable IT to deliver value to the lines of business during every data
integration flow
– Improve business efficiency with match and de-duplicate redundant
records

Profiling – Understand the data first
Interactive exploration of data,

identifying distribution and
outlying values with drill-
downs
Identify and quantify issues in

data
Oracle Enterprise Data Quality – Standardization
Name: Dr Ellen Van Der Heijde Name: Mr RJ & Mrs FB MacDonald Name: Jalila Abdul-Alim (Do Not Call)
Title: Dr First: Jalila

First: Ellen Title: Mr Title: Mrs Last: Abdul-Alim
Last: Van Der Heijde First: R First: F Gender: Female
Gender: Female Middle: J Middle: B Note: Do Not Call
Last: MacDonald Last: MacDonald
Gender: Male Gender: Female
• Standardize, Transform and Parse

• Split names and name elements
• Identify individuals and businesses
• Derive additional attributes
Oracle Enterprise Data Quality - Matching
First: Bob
Last: Fulmar
Gender: Male
Title: Mr Email: chem291_rjf@barker.edu Title: Dr
First: Robert First: Robert
Last: Fulmar Last: Fulmar
Gender: Male Gender: Male
DoB: 12/05/1978 DoB: 12/05/1978
Phone: 555-120-1329 Title: Dr Email: chem291_rjf@barker.edu
Address: First: R Phone: 555-120-1329
9405 Main St Last: Fulmer Address:
Fairfax DoB: 01/01/1978 9407 Main St
Virginia Email: chem291_rjf@barker.edu Fairfax
22030 Address: VA
9407 Main Street 22031-4001
Fairfax
VA
22031-4001
• Match & Merge data from disparate sources

• Create ‘best’ record based on survivorship rules

Oracle Enterprise Metadata Management
Trust your data
Oracle Enterprise Metadata

Cloud Management • Exploring Metadata
Report to Source Lineage • Sarbanes-Oxley Act (SOX)
Apps
Compliance
Impact Analysis, Model Versioning
• Stewardship Collaboration
Annotations and Tagging • Lifecycle Change
Database Management
Supports Metadata Standards
• Data Standardization & Data
Big Data Enabled
Governance
Big Data
Metadata Management
“Metadata Management involves

managing data about other data,
whereby this ‘other data’ is
generally referred to as content.
”
- wikipedia
Value of Enterprise Metadata Management
Solves a significant pain point for a wide variety of business consumers and technical staff
What will happen

Which reports if I change this
use this table?
customer data?
ETL Executive
Developer
Application User
ETL ETL
How was sales
GG BI
App CDC figure calculated?
Dashboards
Hadoop
ETL
What reports use Data Lake
BI Developer
the mainframe Data Steward
data? Sys Admin Where did
this data
Data Scientist come from?
Can I trust the
sources of this I want to design an
customer data? experiment to measure the
success of a signup page.
What data do I have?
Oracle Metadata Management Logical Architecture
Actionable Information
Data Discovery Analytics
Business
Glossary Data Integration
Impact Analysis
Data Lineage
ETL Data Quality Data Streams Integration Data Enrichment
Semantic
Linking
Data Sources
File Based Cloud Big Data Relational Applications
Metadata
Repository
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential
25
Detailed Feature List
Exploring Metadata Lifecycle Change Management
 Text Search and Metadata Browser,  Metadata Harvesting from any DM, DW,
 Model/Diagram Visualizers, Birds-eye ETL/DI, BI Tooling and Big Data/Hadoop
View, Metadata Reporting  Enterprise Architecture Management
 Data Flow and Lineage Analyzer (Metadata Configuration Management)
 Impact of Change
Sarbanes-Oxley Act (SOX) Compliance
 Versioning and Model Compare Data Standardization & Data Governance
 URI Based Call back from BI reports or  Supports Variety of Metadata Standards
Business applications  Annotations and Tagging
 Business Glossary with Semantic Lineage
Stewardship Collaboration
 Feedback Comments and Review Board Oracle Integrated
 Metadata Tagging with Labels  Oracle Database
 Multimedia attachments (documents,  Oracle Data Integrator, Oracle GoldenGate
videos, presentation, code)  Oracle Business Intelligence Enterprise
 URL link references for e-mail, blogging, Edition
social networking  Oracle Business Intelligence Applications
(ODI and older Informatica based OBIA)
Oracle Data Services Integrator
Data Federation and Virtualization
Cloud Oracle Data Services Integrator • Easily develop data

services and ad-hoc
Federated Data Services queries without
Apps infrastructure changes
Data Virtualization
• Open and standards
Integrates with Oracle SOA based—SOA, Web
Database Services, Java, Service
Bi-directional Reads & Writes Data Object
Big Data Integrates with Oracle Business Analytics
Oracle Service Oriented Architecture (SOA) – Product Mapping
Oracle® Reference Architecture, SOA Infrastructure, Release 3.2, 4479-03, February 2012
Different Data Access Techniques
• Consolidation: Move data from distributed sources to central hub; consuming applications query hub database
• Data Virtualization / Federation: Query and update distributed sources in-place and provide combined result
• Hybrid Approach: Federation and Consolidation are combined based on best approach for individual use cases
Consumer Consumer Consumer
ODSI ODSI
Consolidated Hub
ODI/OGG Consolidated Hub

Source A Source B
Source A Source B Data Virtualization only ODI/OGG
Consolidation only
Source A Source B Source C
Hybrid Consolidation & Data Virtualization

When to Use Which Integration Technology
Data Virtualization Consolidation

• Data cannot be replicated (security, ownership) • Performance is priority
• Consolidation is not efficient for access pattern • Data needs to be offloaded from original source
• Real-time access is required and replication is not efficient • Replication is used for redundancy
• Transactional updates
• Need to change model frequently
Data Virtualization Service Bus / Business Process

• Combine & normalize data access services • Orchestrate services to business processes
(Create, Read, Update, Delete) • Service Routing / Mediation
Data Virtualization Use Cases
• Data Services Layer

– Provide a clean data abstraction for SOA and application developers
– Shield consumers from changes in data topology
• Augmenting Business Intelligence

– Extend access to sources outside the data warehouse
• Rapid Prototyping of Data Integration

– Quick creation of an interface to integrated data without building a consolidated store
• Cloud Data Integration

– Combine onsite and offsite data resources in a unified interface
ODSI Core Strengths
• Native SOA Data Integration
Native XML type system allows processing and passing of hierarchical & SOA data.
Based on open standards (XML, WS, JDBC/SQL, XQuery)
Tight integration in Oracle SOA: Fast-path with OSB, Governance with OER
• Normalization and Reuse through Data Services
Multi-layer approach to normalizing and transforming source data
• Highly Scalable, Industrial-Strength Performance
Linear scalability through WLS Clusters
Performance through caching, streaming and query optimization
• Fine-Grained Security and Auditing
Row and column-based data security
• Comprehensive Update Capabilities
Automated CRUD operations on data services
Distributed XA transactions through WLS Transaction Manager
Oracle Active Data Guard
High Availability of the Database
Cloud Oracle Active Data Guard
Snapshot Database
• Main Component of
Maximum Availability
Apps Architecture (MAA)
Open for Read-Only Operations
• Role Transition between

Using for GoldenGate Extract
Source and Standby
Database
Database in Case of
Continuous Recovery
Failure
Big Data Automatic Block Repair
Use Cases: Data Guard and Active Data Guard
Real-Time Data Protection and Availability for Oracle Database
Exact copy Disaster Recovery
of primary Manual or Automatic Failover
Data Guard & Exact copy Query & Report Offload

of primary Open Read-Only
Active Data Guard
Snapshot Convert to Test Database
(open read-write)
Standby Single Command Refresh
New DB Standby First Patching,

SYNC Version Database Rolling Maintenance
or
ASYNC Exact copy
Offload RMAN Backups
of primary
Exact copy
Source for thin snaps/clones
of primary
Note: A single DR copy may be multi-
Exact copy Extract offload, source for
purposed for different combinations of
of primary GoldenGate ALO mode
the use cases described
Far Sync,
Redo
GoldenGate Downstream

Data Guard
Standby Database: Failover Target
Read-write
Workload Fast Incremental
Real-time Reporting Backups
Continuous redo
shipping, validation & apply
Production Physical Standby

Database Database

Active Data Guard
Standby Database: Offload Production + Failover Target
Read-write Fast Incremental

Workload Real-time Reporting Backups
Continuous redo
shipping, validation & apply
Production
Active Standby Database
Database
(physical standby open read-only)

Active Data Guard
Best Data Protection, Auto-Repair, and High ROI
Primary Data Center DR Data Center Offload read-only

workload to open
standby database
Zero data loss at any distance
Automatic Block Repair
Offload Fast
Incremental
Enterprise Manager Cloud Control Backups

Data Guard and Active Data Guard Feature Sets
Data Guard (included with EE) Active Data Guard (Option)

Data Protection with HA Advanced Protection with High ROI
• Zero or near-zero data loss protection • Zero data loss at any distance
• Transparent – all datatypes, workloads • Automatic corruption repair
• Continuous data validation • Auto-replay of inflight transactions
• Detect silent corruption • Offload transport compression*
• Automatic database failover • Offload read-only workload
• Dual-purpose DR as test system • Offload read-mostly workload
• Simple migrations and upgrades • Offload fast incremental backups
• Oracle Enterprise Manager integration • Automation for rolling upgrades
* Also requires Advanced Compression Option

Oracle Replication Solutions for Business Continuity
Active Data Guard: Disaster Recovery and Data Protection

High-performance, simple, drop-in physical replication for HA and DR
Zero data loss, unique data corruption protection, automatic failover, offload read-only workloads
Disaster recovery for all data types, applications and workloads
GoldenGate: Flexible HA, Maintenance and Migrations, Real-Time Data Integration

Logical replication for advanced replication requirements, target open read-write
Enable minimal/zero downtime upgrades and application migration using 2nd database copy
Heterogeneous platforms, bi-directional replication, transformations, subsetting, multiple topologies

Oracle Products for Data Movement
Comparing Tradeoffs and Benefits Driven by Different Architectures
• Not invasive on source

• Fastest read and write
Active Data Guard • Oracle Database only
• No transformation; no partial sets
• Unidirectional
• Not Invasive on source

• Very fast read and write
GoldenGate • Heterogeneous or homogeneous
• Basic transformation and partial sets
• Uni- and Bi-Directional
• Optimized Set-based transformation

Data • Highest latency for real-time feeds
Integrator • Heterogeneous
• Supports highly complex transformation
Resources
Oracle Data Oracle Oracle Oracle Enterprise Oracle Data

Integrator GoldenGate Enterprise Metadata Services
Data Quality Management Integrator
Oracle Data Integration Oracle Data Integration ORCL DataIntegration blogs.oracle.com/dataint OracleGoldenGate
egration
Data Integration
http://www.oracle.com/us/products/middleware/data-integration/overview/index.html
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle OpenWorld 2014
41
Questions and Answers

20150909-Regio Berlinbrandenburg 010 Jaensch - Oracle Dis 12c Short Overview

Загружено:

Сведения о документе

Оригинальное название

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

20150909-Regio Berlinbrandenburg 010 Jaensch - Oracle Dis 12c Short Overview

Загружено:

Авторское право:

Доступные форматы

Oracle

Data Integration Solutions

Joachim Jaensch - Principal Sales Consultant

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3

1 Oracle Data Integration Solutions (DIS)

6 Oracle Data Service Integrator (ODSI)

• Real-time data replication; optimized for

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

E-LT: Bulk Data Processing and Fast Data Transformation

Cloud Oracle Data Integrator

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 8

• Benefits ODI Declarative Design

Define How: Knowledge Modules

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 9

Pluggable Knowledge Modules Architecture

Sample out-of-the-box Knowledge Modules: Key Architecture Benefits:

Oracle Oracle External

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 10

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Application & SOA Business Intelligence

ODI Agent may be deployed in

Extract-Load Transform Check-Load

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 12

• Enable GoldenGate journalizing on

• Manage GoldenGate Capture/Delivery

• Set common GoldenGate parameters

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Heterogeneous Data Replication

Oracle GoldenGate • High-performance, low-

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Data Quality for Customer and Product Data

Cloud Oracle Enterprise Data Quality • Improves data accuracy,

Name Address City State Zip Phone Email

Robert Williams 36 Jones Av. MA 02106 617555000

Mixed business and

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.Oracle

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.Oracle

Interactive exploration of data,

Identify and quantify issues in

Title: Dr First: Jalila

• Standardize, Transform and Parse

• Match & Merge data from disparate sources

Copyright © 2014 Oracle and/or its affiliates. All rights reserved.Oracle

Trust your data

Oracle Enterprise Metadata

“Metadata Management involves

What will happen

ETL Data Quality Data Streams Integration Data Enrichment

Data Federation and Virtualization

Cloud Oracle Data Services Integrator • Easily develop data

Big Data Integrates with Oracle Business Analytics

Consumer Consumer Consumer

ODI/OGG Consolidated Hub

Source A Source B Data Virtualization only ODI/OGG

Hybrid Consolidation & Data Virtualization

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 29

Data Virtualization Consolidation

Data Virtualization Service Bus / Business Process

• Data Services Layer

• Augmenting Business Intelligence

• Rapid Prototyping of Data Integration