Breaking Down the BI Apps

Oracle Open World November 15, 2007 Jeff McQuigg Partner, Fallbrook Consulting Group LLC www.Fallbrookllc.com
Fallbrook Consulting Group LLC Proprietary and Confidential

Agenda

How Do We Deliver BI? Whats In The Box? How To Build Are The BI Apps For Me? Summary Q&A
2
Fallbrook Consulting Group LLC Proprietary and Confidential

How Do We Deliver BI?

3
Fallbrook Consulting Group LLC Proprietary and Confidential

Do It On Your Own?
These are some of the things you will need to design and build to make a functioning and scaleable BI and Data Mart system.
Source DBs Source DBs Data Mart

Sources Know the data model Know the naming conventions Know UI to data model translations Know the business process Know technical features Know update approach Each source has a different technical implementation Packaged apps are very large and complex

ETL Extracts data out of applications & files and into a Data Mart, transforming it into a format more suitable for reporting and analysis ETL Development is very time consuming (Est. 70% of effort) Mappings need orchestration to feed and manage the health of the Data Mart

Data Mart Data Marts need extensive data modeling effort driven by the requirements gathered Data Mart design is often the most challenging aspect, requiring the most experienced designers Design is key to flexibility, scalability and good performance

BI Tool Configuration of the BI Tool metadata to link to the Data Mart The BI Tool abstracts from the Data Mart to provide a user friendly view of information New metrics and dimensions can be configured here Security configuration

Report Content Configuration of the format for reporting and analysis presentation Dashboards Delivers Briefing Books Functional organization needed Optimize to user workflows Security configuration needed

Project Management Data Governance Skilled Resources

Project Planning Business Requirements Documentation

PMO / COE /CC Training Support

Data Architecture Security User Training 4

Fallbrook Consulting Group LLC Proprietary and Confidential

Why Its So Hard

Implementing a BI/DW system is not easy and is loaded with risk
Quantity Requirements Gathering Dimensional Modeling Source System Understanding Data Quality Analysis ETL Design and Development BI Tool Metadata Layer UI Design, Build, Alter, ReBuild Integration Testing Designing for Phase 2 Monitoring Support Difficulty Dimensional Modeling requires years of experience to become proficient Requirements gathering for BI/DW is very different from traditional systems Many different users provide differing inputs Building ETL based on inadequate data understanding Technology decisions to make

Quantity x Degree of Difficulty results in significant risk Poor Data Intelligence results in costly adjustments during Development and Test Delays compound poor data quality issues as shortcuts are taken Delays eat into performance tuning activities Systems are deployed later, over budget with poor data quality and poor performance
5
Fallbrook Consulting Group LLC Proprietary and Confidential

What If The Hard Parts Were Mostly Done For You?

Oracle has packaged most of what you would need to do
Pre Built Reports Pre Built Dashboards Pre Built Delivers Common User workflows Security Implemented SSO & UI Integration

Oracle BI Server

Pre Built OBI MetaData Model Logical /Business Model Subject Areas Created Ad-hoc capable

Pre Built Mappings to Siebel CRM Multiple Security Configurations SSO Multi-Language Support

Business Analysis Warehouse

Dimensional Model Multi-Source Aware SCD I, II, III Support Mini Dimension Support

Aggregates Hierarchy Support Multiple Security Options Common Indexes Defined DW Administration Index Mgmt Load Parallelization Dependency Mgmt ETL Performance Monitoring

Informatica Pre Built ETL Source to Target Mappings Change Data Capture Restarts Multi Source Aware Custom Development Support Upgrade Support SCD Aware Aggregate Support & Management Universal Source Support

Universal Sources

6
Fallbrook Consulting Group LLC Proprietary and Confidential

The Oracle Head Start

Developed Modules Physical Data Model Main Input Efforts done by Oracle General requirements definitions Metric and hierarchy definitions Source System data element catalog Complimentary BI Tool & physical model design Physical Data model create scripts Index identification and scripts Performance enhancements Security Model design Source system analysis Data quality analysis Business rule / transformation design Develop & unit test mappings Design of overall ETL architecture Index management integration ETL load dependency & parallelization identification

ETL Mappings ETL Orchestration DW Monitoring

Fallbrook Consulting Group LLC Proprietary and Confidential

The Oracle Head Start

Developed Modules OBI EE Metadata Main Input Efforts done by Oracle General requirements definitions Metric and hierarchy definitions Source System data element catalog Naming standards (internal & external) Complimentary BI Tool & physical model design OBI EE MetaData configuration Security system design & configuration Ad-hoc Answers design & testing General requirements definitions Analytics Workflow (use case) identification Reports, Dashboards, iBots development Navigations/drill down configuration Integration with base Oracle Apps Security model design & implementation
8
Fallbrook Consulting Group LLC Proprietary and Confidential

User Interface Reporting Content

Whats In The Box?

9
Fallbrook Consulting Group LLC Proprietary and Confidential

Components In The BI Apps The BI Apps contain several technical components

Interactive Dashboards Reports
OBI EE Server

Security Business Analytics Warehouse (BAW)

BAW Dimensional Data Model Informatica Logical Mapping & Session

Informatica Post Load Process (PLP) Informatica Source Independent Load (SIL) Informatica Source Dependent Extract (SDE)

BAW Table

Source Tables

Stage Table

Data Warehouse Administration Console (DAC) Scheduling Index Management Dependencies Application Assignment 10

Fallbrook Consulting Group LLC Proprietary and Confidential

The BAW Data Model - Overview

Star Schema Dimensional Model Employs techniques promoted by Ralph Kimball
Conformed dimensions SCD Types I, II, III Mini Dimensions Dimensional Helper Tables Hierarchy Tables Snapshot tables

Each Fact table is richly described by many dimensions (many >30!) The Stars are conformed together via common dimensions Tables follow stringent naming standards All tables contain trace-back fields and common accounting fields

11
Fallbrook Consulting Group LLC Proprietary and Confidential

The BAW Data Model Dimension Tables

All have Accounting Fields:
ROW_WID: system generated primary key ETL_PROC_WID: the ETL process that created the record INTEGRATION_ID: the original transaction PK field DATASOURCE_NUM_ID: the source system that supplied the record

Some also have:

EFFECTIVE_FROM_DT: for SCD Type IIs _I - language independent codes Hierarchies Security linkage fields

Most but not all descriptive fields are brought over from a source application
Some dimensions have > 100 fields W_ORG_D has 267 fields!

Dimensional Aggregates (_DA )

Correspond to fact aggregates E.g., W_MONTH_DA (Month : Month)
12

Fallbrook Consulting Group LLC Proprietary and Confidential

The BAW Data Model Fact Tables Composite key defines uniqueness
All _WID FK Fields Security FKs

Additive or snapshot fact fields Load control fields Unique ROW_WID Many aggregate tables (_A)
W_REP_ACTIVITY_F W_REP_ACTIVITY_HOUR_A W_REP_ACTIVITY_MONTH_A

13
Fallbrook Consulting Group LLC Proprietary and Confidential

ETL - Overview
Uses Informatica PowerCenter 7.1 for all ETL mappings Ships with a very large repository of pre-built mappings, sessions, and workflows Maps to many different Oracle Txn Applications (more coming!)
Siebel Oracle EBS PeopleSoft

Contains many generic mappings (Universal Adapters) for other sources Reusable transformations for common logic reuse Also contains special Verticals loads for Siebel CRM Vertical applications
14

Fallbrook Consulting Group LLC Proprietary and Confidential

ETL Architecture
Performs one time pre-load steps Building of Time tables Lookup tables Post Load Process Aggregates Updates Aging Snapshots

Initialization Source Source Source SDE SDE Stage SDE SIL PLP Stage SIL

BAW

PLP

Source Dependent Extracts Gets Data Out of sources Staging Tables Holds data in a generic structure for SIL processes
Fallbrook Consulting Group LLC Proprietary and Confidential

Source Independent Loads Applies most transformations and loads BAW tables 15

ETL Design Details

The SDE Mappings identify and extract data into a generic table structure
SDE Mapping

Source Dependent Extract (SDE) Source Database Tables

SQL Select Change Data Capture Included Standard Mapping Template

Stage Table

The SIL Mappings contain most of the complex logic - reusable across sources
SIL Mapping

Stage Table

Key Lookups

Common Transfor mations

Specific Transfor mations

Code & Language Translations

Insert/ Update Logic

BAW Table

Reload/Restart Logic Delete Logic 16

Fallbrook Consulting Group LLC Proprietary and Confidential

The DAC - Overview

Data Warehouse Administration Console (The DAC) Separate Java based application to control ETL
Runs on the same box as Informatica server Includes its own repository of configuration

Manages Informatica mappings in Application terms

E.g., defines which mappings (100s) are needed for Service Analytics Set up dependencies between load streams

Advanced load parallelization

Mappings across multiple PowerCenter servers Execution of multiple Subject Areas in parallel when possible

Manages BAW Tables and Indexes

Index Management is tightly integrated into each load stream

Monitors the ETL loading processes execution and performance

17
Fallbrook Consulting Group LLC Proprietary and Confidential

The DAC Subject Areas

List of Fact tables by Subject Area

List of Subject Areas with some editing options

Loading Phase for the Task determines when it executes

List of Tasks to build the Subject Area

Fallbrook Consulting Group LLC Proprietary and Confidential

Task Groups roll up tasks to a higher functional level 18

The DAC Execution Plans

Execution Plans define how an application is loaded

Edit options on a Execution Plan Execution Plans A plan is pre-built for a source system and a target BI Application Family Plans can be easily combined or pruned

List of Subject Areas in the Plan 19

Fallbrook Consulting Group LLC Proprietary and Confidential

OBI EE Repository

A large repository (RPD) comes in the BI Apps box

~150 Subject Areas ~200 Logical Fact Tables, 1,700+ Metrics ~400 Logical Dimension Tables, nearly 10,000 attributes

There are 20 Business Models in the RPD

Core is the one that most of the BI Apps use 106 Fact tables, 251 Dimension Tables Other Business Models exist for different purposes

20
Fallbrook Consulting Group LLC Proprietary and Confidential

The Core Business Model

Core supports 98 Subject Areas and the following BI Applications & Verticals:
Financials CRM Supply Chain Order Management HR - Financial Services - Healthcare - Insurance - Public Sector

Abstracts the BAW physical data model for usability Very high degree of integration and consolidation of data objects Built to a high degree of quality by expert Metadata engineers Several security model options are pre-built
21
Fallbrook Consulting Group LLC Proprietary and Confidential

The Core Business Model Dimensions Only!

22
Fallbrook Consulting Group LLC Proprietary and Confidential

OOB RPD Table Mappings

Each Logical Table maps to one or more physical tables

Aggregate aware Mini Dimension aware SCD Type II ready but not enabled (requires minimal configuration) Hierarchy helper tables

Many role-playing dimensions

E.g., Sales Rep, Service Rep
23
Fallbrook Consulting Group LLC Proprietary and Confidential

OOB RPD Logical Fact Tables - Compound

Many compound metrics exist

Combine metrics from 2 stars into one Work with conformed (common) dimensions

Quote Items & Order Items combine to make a conversion rate

24
Fallbrook Consulting Group LLC Proprietary and Confidential

OOB RPD Logical Fact Tables Time Series

Time comparisons are common

Month vs. Month Qtr vs. Qtr

25
Fallbrook Consulting Group LLC Proprietary and Confidential

BI Apps OOB User Interface OOB BI Apps contain a wealth of pre-built content
~90 pre-built dashboards with ~400 dashboard pages ~1,350 dashboard reports, ~2,200 total reports
Insight Business Objectives

Reporting content is organized along Analytic Workflows

Pre-defined use cases implemented as analysis paths through pages and reports Drill downs, navigations, deeper details, drill to source app

Take Action

26
Fallbrook Consulting Group LLC Proprietary and Confidential

BI Apps Functional Overview

Most of the BI Apps come pre-mapped to more than one source Support level varies, so be sure to investigate coverage Given the BI Apps came from Siebel, Siebel has a head start in Vertical applications
27
Fallbrook Consulting Group LLC Proprietary and Confidential

How To Build

28
Fallbrook Consulting Group LLC Proprietary and Confidential

Deployment Overview
The following Tools and Apps code are needed
OBI EE 10.1.3.x platform Informatica Power Center The DAC Build the DAC repository in a database Restore the Informatica ETL Load the BI Apps OBI EE Repository Load the BI Apps OBI EE UI Catalog Build the BAW Database - 2 Servers Typical - ETL Server - ETL Server - DAC DB Schema - INFA DB Schema - RPD Server - PS Server - BAW DB Schema

Plan on the better part of a day for a Windows install, longer for Unix or mixed environment After installation, prune elements of the Apps that are not needed
BI Server RPD Server UI Server OBI EE Catalog Server HTTP Server

ETL Server Informatica Server The DAC Server

Source Database Tables

DAC Repos INFA Repos BAW Schema

29

Fallbrook Consulting Group LLC Proprietary and Confidential

Requirements Requirements for deploying a pre-built system still exist

Your Business will still have specific needs

Traditional requirements gathering sessions are still necessary Conduct Gap requirements sessions
Have business users review pre-built content for suitability

In many cases, BI Apps are deployed shortly after the ERP goes live
Requirements may be hard to come by Common to go with a lets see what its all about first approach
30
Fallbrook Consulting Group LLC Proprietary and Confidential

Mapping to a Supported Source Strategy: Identify Gaps and Alter OOB Gather a detailed list of source system changes Identify list of new fields/tables desired for reports
Back track through OBI Metadata and ETL to source

Determine gap severity vis--vis the OOB mappings and data model
Changed business rules Extensions Model alterations

Adjust impacted ETL mappings/build new mappings

Add new mappings to the DAC
31
Fallbrook Consulting Group LLC Proprietary and Confidential

New Sources for OOB BAW Tables Strategy: Use Universal Adapters if possible, otherwise custom development Check if there is a pre-built Universal Adapter
Universal Adapters are like generic file templates with supporting ETL mappings Use the Universal Adapter mapping along with an extract from the source system

If not, custom build the SDE portion of the loading process

The OOB SIL mapping can be used The SIL does most of the hard work applying transformations

The BAW and ETL designs support multiple sources for a single target
Code is not 100% turned on
32
Fallbrook Consulting Group LLC Proprietary and Confidential

Universal Adapters Universal Adapters allow for easy inclusion of a variety other data sources
Currently, SAP and Telephony support is via Universal Adapters

Source

A UA contains 3 pieces
External File template to use as a data source SDE mapping to convert into a Staging table Common SIL mappings to load into final tables

Text File

Universal Adapter

BAW

Extract from the source system to the file format needed

Use whatever tools/techniques are best
Fallbrook Consulting Group LLC Proprietary and Confidential

33

No OOB Tables
Strategy: Custom development integrated into OOB environment Perform typical analysis and design steps Design the data models Design ETL as normal
Can use supplied INFA shell templates to assist Map directly to the source if desired or use files

ETL can leverage and integrate with existing OOB modules

Reuse common transformations and conventions Reuse much of the existing BAW model

Add processes into the DAC

Identify dependencies, indexes and parallelization

Map into OBI repository metadata

34
Fallbrook Consulting Group LLC Proprietary and Confidential

Extending the BI Apps

The BI Applications are 100% customizable and extensible
If Informatica can have access to it and it can fit into a RDBMS, then it is possible to include it
Effort by Customization Level

The further away from OOB functionality you go, the more closely effort will resemble 100% custom development However, any new custom development fits within a high quality foundation and infrastructure
DAC ETL orchestration, management & monitoring Leverages existing naming standards Leverages common ETL routines Leverages sample starter mappings Leverages facilities for upgrades Less effort required as with 100% Custom development

Effort

Customization Degree

10 0%

Fallbrook Consulting Group LLC Proprietary and Confidential

Cu st om

O O B

35

Are The BI Apps For Me?

36
Fallbrook Consulting Group LLC Proprietary and Confidential

Deployment Timelines
With the flexibility and quantity of pre-built components, Oracle BI Applications deployments can be measured in weeks not months or quarters.
Months / Years
Test, Package for Deployment and Deploy

Design & Build Dashboards and Reports

Project Duration

BI Tool Configuration

Due to the predictability of BI Apps projects that weve seen over the last 5 years, Fallbrook is able to offer fixed priced, 12-week deployments

ETL Design & Development

Test, Package for Deployment and Deploy Design & Build Dashboards and Reports

Weeks / Months

DW Infrastructure Design & Build

BI Tool Configuration ETL Design & Development

Test, Package for Deployment and Deploy Design & Build Dashboards and Reports BI Tool Configuration ETL Design & Development DW Infrastructure Design & Build Data Requirements and Data Model Design

Data Requirements and Data Model Design

DW Infrastructure Design & Build Data Requirements and Data Model Design

Pure Custom Build

High Customization

Low Customization

37

Fallbrook Consulting Group LLC Proprietary and Confidential

Flexibility and Risk The Oracle BI Apps align with changing needs:
Designed for extensions/additions Designed for upgrades Designed for alternative and additional data sources Designed for fast and reliable report building Not limited to only purchased functionality Integrates with other Oracle Fusion products

Risk is reduced:
The hard parts are pre-built by skilled engineers They work hand-in-hand with supported ERPs Follow industry design best practices Provide a pluggable infrastructure Upgrade paths across Oracles versions
38
Fallbrook Consulting Group LLC Proprietary and Confidential

Turnkey?
The BI Apps are large and complex
Contain many moving parts Numerous custom developed code modules
E.g., change data capture for Siebel is very complex

Installation alone is a daunting task

Applications are not push-button installs

Extending the BI Apps for supported sources requires knowledge of the Prebuilt Application Code, not just the Tools
Conventions Design Process Common modules Installation, pruning and 1st ETL batch execution The DAC organization and extension usage

Extending the BI Apps to new sources requires traditional BI & DW skills

Dimensional Modeling ETL OBI EE Server - Requirements gathering - Dashboards & Reports - Testing

The BI Apps must be tailored to your database environment for optimal performance
39

Fallbrook Consulting Group LLC Proprietary and Confidential

Go With The BI Apps Experts

Fallbrook has extensive BI Apps experience
We have been deploying the BI Apps since 2002 (Siebel) One of the few companies who understand the whole application, not just the OBI EE portion

We have worked with all of the BI Applications

Order Management Analytics - HR Analytics Financials Analytics - Supply Chain Analytics CRM Analytics (Sales, Service, Marketing, Partner, Supplier)

Worked with all of the supported source systems

Siebel CRM Peoplesoft - Oracle EBS - Universal Adapters

Have the expertise to customize and extend the BI Apps

Modifications to OOB source mappings Extending to entirely new data sources and data models with custom design and development Developed BI Apps specific design deliverable templates

40
Fallbrook Consulting Group LLC Proprietary and Confidential

Summary We find more and more customers considering the Oracle BI Applications The BI Apps are Oracles BI future
The creation of BI Apps mirrors the proliferation of ERP apps a decade ago Oracles BI Apps are not lightweight canned reports
Large scale data warehouse capable Fully extensible and scaleable to whatever need you may have

BI Apps projects offer greater ROI than a custom solution due to

Shorter deployment times High quality designs Robust and flexible infrastructure Industry resources, knowledge and support available
The BI Apps are becoming a known quantity in the industry
41
Fallbrook Consulting Group LLC Proprietary and Confidential

Q&A
Fallbrook Consulting Group LLC
8895 Towne Centre Drive Suite 105 #386 San Diego, California 92122

www.Fallbrookllc.com

Fallbrook Consulting Group LLC Proprietary and Confidential

42