Вы находитесь на странице: 1из 13

JPMC Integrated Consumer Data

Warehouse(ICDW)
TCS Digital Enterprise Analytics, Big Data and Information
Management

PLEASE, CONTACT THE ACCOUNT OWNER FOR USING CUSTOMER INFORMATION AND REFERENCES.

Copyright 2013 Tata Consultancy Services Limited

TCS Confidential

JPMC
ICDW

Customer Overview
One of the largest
Global Bank
headquartered in
USA. It is one of the
leading global
financial services
firm in Asset &
Wealth
Management Chase
Card, Services
Commercial
Banking,
Investment
Banking, Retail
Financial, Services
Treasury &
Securities Services.

Business Case
The ICDW Customer Migration initiative seeks to move
Customer data and processes available in the Enterprise
Data Warehouse (EDW) framework into the new ICDW
framework
Migration of Customer subject areas (data & processes)
into the ICDW framework Customer Data Mart (CST), Cross
Customer Data (XCS), Relationship Data Mart (RDM),
Weekly Relationship Mart (WRM), Prospect Data Mart (PDM),
Ad Hoc Matching Model (AMM), Compliance Data Mart
(CMP), Know Your Customer (KYC)
Migration of 76 CDW applications from IDW to ICDW
environment. CDW Applications includes all load streams ,
TCS Solution
datamarts, engines and other applications like Retail and
Stored Value
ICDW solution brings in tactical & strategic solution, factory
approach, strong governance focus
Process Driven Reverse Engineering KIT
Process Driven Informatica Development KIT
Process Driven - Data Modelling Development KIT
Process Driven QA Tool KIT
Technology Driven Ab-Initio RE Automation

Challenges
Business resources spend a disproportionate amount of time
on data integration, movement and transformation rather
than being focused on business analysis to drive insights
Cross-LOB analytical data is challenging to locate and
access
Lack of confidence in data quality & lineage impedes
effective business analysis causing business units to create
their own transformations
The analytical environment stability issues are causing
extended timelines and rework
Data fragmentation has become expensive and complex to
Benefits
do repeatable historical analysis
ICDW program brings in benefits like Development Speed to
Market: faster analytic application development, improved
analytic development
Deeper Analytic Capability: sandbox enables greater
experimentation, greater ability to run scores
Data Integrity: Single version of analytical truth,
Stability & Performance: Platform designed for business
analytics, improved reporting timeliness( e.g. dashboards,
management reporting)
Scalability: Longer data retention where appropriate,
continues improvement
Technology Stack

ETL: Ab-Initio, Informatica, Reporting: Hyperion, Cognos, Tableau, SSRS Database: Teradata, DB2, Oracle, Data Modeling:
Erwin
TCS Confidential 2

JPMC - ICDW
Business Case

Scope comprises capturing data to the ICDW


Integration area and Semantic layer.

Attributes from landing pad & Data Mart will be


identified based
on the attribute usage
develop the Integration model

and

Semantic views to be developed for all marts based


on the transformation rules
from EDW application

reverse engineered

Scope comprises Migration of 76 CDW applications


from IDW to ICDW environment. CDW Applications
includes all load streams , datamarts, engines and
other applications like Retail and Stored Value.
TCS Confidential

JPMC ICDW Solution Approach Business Requirements


Deliverables

Interaction with
Business / SME
EDWSME
Business User

Document Business
Requirements / Use Cases
EDWSME Review
Business User Review

Source to Logical Mapping


BDWSME Review
EDW SME Review
Business User Review

(Need Basis) Reverse Engineering for


Validation of Attributes
Technical & some Business Validations Rules
Process Orchestration Rules

BRD, Source to Target Mapping

Business Requirement Analysis


Source to Target Mapping
EDW SME Review
ETL Architecture Review
Business User Review
Base Attribute
Derivation

Reverse Engineering Factory


TCS SME
Review

RE Inputs

AI Graphs
TWS / Shell
Scripts
DB2
Components
Data Models
RE Templates

Inputs

Reverse
Engineering
Automation

Data
Lineag
e/Usag
e
Analysi
s

BDW SME
Review
EDW SME
Review

Base Attribute
Derivation

*Business Rules
Reverse engineering
Deliverables

*Business Rules will be derived for all other marts except CDM
TCS Confidential

JPMC ICDW Solution Approach Development Approach


SOR
Populate Structure & Data
from SOR to Clean Staging
Data Structure to be made
ready before start of ETL
Development

Reverse Engineering
(RE) & New Business
Requirement Analysis

Responsible for Data


profiling, classification and
Quality
Data Architects work with
IQM team during Data
Modeling Phase

Infa Admin
Supports code move from
Dev to QA, IST, UAT and Prod
Environments
Request sent from Dev team
with code package details
and approvals from ADM

Central QA
Part of Agile team and
responsible for QA and
conducts sprint level testing
Responsible for Integrated
testing across datamarts, UAT
and Go-live testing

Business Team
Semantic view requirement
analysis
User Acceptance Testing

SME Reviews

New Req.
Analysis
Doc.
Deliverables

Team Leads
T
e
a
m

T
e
a
m

T
e
a
m

T
Business
e
Analysis
a
m RE templates, guidelines

Documents + New
Requirements

Development
(Modified Agile)

T
e
a
m

T
e
a
m

T
e
a
m

T
e
a
m

4 DM templates,

Modeling
Deliverables

guidelines documents

4
4

2
3
Sprint Teams

Sprint Execution
Dev
2 weeks

2 weeks

QA Test

Integration
Build

Semantic
Views
Build

Sprint
Deliverables

C
o
d
e
R
e
vi
e
w
s

Business
Reviews

Semantic

Factory Model

DRB Reviews

Physical

DM Leads

IQM Reviews

Logical

Data
Architect

SME Reviews

Conceptual

Data Modeling
(DM)

Factory Model

Teradata
Guidance for Physical
Modeling
DB space determination

EDW to
Source
Mapping

RE Solution
Lead

IQM

Usage
Analysis

Integrated
Testing
CST

XCS

XPD/RDM

PDM

WRM

AMM

Central Testing team


to create and execute
IST test cases
TCS Owned
Activities

T
e
st
R
e
vi
e
w
s

User Acceptance
Testing
CST

XCS

XPD/RDM

PDM

WRM

AMM

U
A
T
S
i
g
n
O
f
f

Business / SME /
Architect execute UAT
test cases
JPMC Owned
Activities

TCS supported
Activities

Production
Deployment
CST

XCS

XPD/RDM

PDM

WRM

AMM

Warranty
Support

TCS Confidential

JPMC ICDW Solution Approach Modified Agile


Methodology
Modified Agile

2 4 weeks Sprint Cycles depending on the scope

4 Agile Teams
20 day Sprints
Each agile team
has a scrum master

CDM

Agile
Team 1

ETL & QA of ICDW Integration

ETL Team
QA Team

CVM, EWS, FDM

Analysis, Sequencing
Agile Awareness
Building the Foundation
Product planning, Decomposing
the Migration into atomic stories

Sprint 0

ETL & QA of ICDW Integration

Agile
Team 2
HFDM, HPI

Agile
Team 3

ETL Team
QA Team
Shippable
Software

ETL & QA of ICDW Integration


ETL Team

QA Team

COGDM

Production
Deployment

ETL & QA of ICDW Integration

Agile
Team 4

Roles Required
Product Owner :- Ensures business value
Scrum Master :- Facilitates team success by efficient running of
process
Scrum Team :- Builds shippable functionality per iteration
Performs various tests to ensures high quality

ETL Team
QA Team

Sprint 1.n

Process
Sprint Planning
Meeting
Sprint Goal

Daily
Standup
Sprint
Backlog

Blocks
List

Sprint Burn
down
Shippable Product

Sprint Review &


Retrospection
Product
Backlog

TCS Confidential

Challenges
Component Volumetric
Database Size
Interfaces

Challenges Listed in Slide#2

TCS Confidential

Functional Coverage
Retail Financial Services
Credit Cards
Mortgage Loan

TCS Confidential

Logical Architecture
Layer

Public Area

Supporting Services

Discovery Area

Application

1:1 Views of Integrated Tables

Integration
[INTG]
[INTG]

Involved Party

Location

Event

Product

Audit & Control

Arrangement

Classification

Resource Item

3rd Party Data

Reference

Integrated Consumer Banking Data Model


Load Ready Tables
Subject Area Interfaces

Staging
[ACQN]
[ACQN]

SOR

Source System Representation of Data

Interim Data
Repository

IDR
IDR_CDI
TABLES
VIEWS
WORK

Governance
Governance

Base and Context Security Views

Infrastructure
Infrastructure Services
Services

[PRSN]
[PRSN]

Metadata
Metadata (Ab
(Ab Initio
Initio Meta
Meta Hub)
Hub)

Shared Dimensions and Metrics

Reference
Reference Data
Data Management
Management

Temporary
Temporary User
User
Workspace
Workspace

Architecture
Architecture &
& Data
Data Modeling
Modeling

Access
Semantic

Extract
Extract Views
Views

Application
Application &
& Process
Process Specific
Specific Views
Views

Data
Data Quality,
Quality, Control,
Control, Audit
Audit &
& Balancing
Balancing

Analytical
Analytical // SAS
SAS Datasets
Datasets

Purpose
Purpose Built
Built Data
Data Marts
Marts

ETL
ETL &
& ELT
ELT Services
Services (Informatica
(Informatica 99 // Teradata
Teradata TPT)
TPT)

BI,
BI, Data
Data Access
Access &
& Query
Query Tools
Tools

File System Landing Pad

System Of Record Data


TCS Confidential

Physical Architecture

TCS Confidential 10

Sample Screen Shots (esp. Reports)


TCS Solution
Contact Performance Reporting
Used SSIS to extract and transform data from
heterogeneous sources like raw files and load
it into the data warehouse
Build Tools to do Data Validations for the
staging data that comes from the Voice
channel and then Push it into the warehouse
Developed Summary tables for the Data that
comes in
Tools to capture the details of Lookup
(Dimensional Values) Values and their
Changes
Developed SSRS Reports for the Summarized
Data (Tabular, Matrix, Drill Down, Drill
Through, Graphical)
Integrated SSRS reports with Web Portal build
using ASP. Net
Developed SSAS Cubes and Report Models for
Adhoc Users and for deeper dive into the data.
TCS Confidential 11

Benefits

TCS Confidential 12

Thank You

Copyright 2013 Tata Consultancy Services Limited

TCS Confidential 13

Вам также может понравиться