E: Getting the Data Into the DW

Note: Numbers in the parentheses refer to Kimball’s 34 ETL subsystems.

First: Get the Data Into the DW

Comprehensive
Requirements
Prepare to start
Logical Data
Map

Data Profiling (1) Judge data

Change Data
Capture (2) Isolate changes

Extract (3) Get into DW

Result:
Extracted Tables
incl Format
Conversions

© 2013 Kimball Group. All rights reserved.

 T: Clean and Conform
Note: Numbers in the parentheses refer to Kimball’s 34 ETL subsystems.

Second : Clean and Conform

Cleansing Sys &

Cleaning machinery Data Quality
Screens (4)

d d

Cleaning control f Error Event Schema (5)

w. Audit Dimension (6)

d d

Deduplicating (7)
Integration and Conforming
System (8)

Result:
Cleaned Tables
and Conformed
Dimensions

© 2013 Kimball Group. All rights reserved.

 L: Prepare for Presentation
Note: Numbers in the parentheses refer to Kimball’s 34 ETL subsystems.

Third: Prepare for Delivery

Time Fact Table

variance SCD Manager (9) Types (13): Fact types
Late Arriving
Data (16) and late data

Dimension
Surrogate Key
Keys Generator (10),
Manager (17),
Fact Provider Admin
Pipeline (14)
(18)

Hierarchy Table Agg Tables (19),

Aggregates,
Hierarchies
Manager (11):
Fixed, Variable,
OLAP Cubes (20), cubes, and
Ragged
DI Manager (21)
data integration

Special Result:
Bridges Dimensions (12), Fact & Dim
Multi-Valued Tables Ready for
Dimensions (15) Delivery

© 2013 Kimball Group. All rights reserved.

 M: Manage All the Processes
Note: Numbers in the parentheses refer to Kimball’s 34 ETL subsystems.

Fourth: Manage

Control Job Scheduler (22) Lineage &

Dependency (29) Source

Backup (23) Problem Escalation (30) Respond

Protect
Recovery/Restart (24) Pipeline/Parallelize (31) Speed
Version Control (25) &
Control Migration (26)
Security (32) Guard

Measure Workflow Monitor (27) Compliance (33) Comply

Speed Sorting (28) Metadata Repository (34) Manage

© 2013 Kimball Group. All rights reserved.