Вы находитесь на странице: 1из 48

DATA WAREHOUSE

Cognos PPES

Informatica PowerCenter

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Connectivity Overview

Informaticas Architecture
Designer
Workflow Manager
Workflow Monitor

Repository Manager

Data Models

Targets 1-n

Sources 1-n
PowerPlugs
Repository

Server

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Connectivity Overview

Informatica Design Process

1.
2.

Source Def
5.
3.

Target Def
Sessions
Mapping

4.

1. Create Repository
2. Import Source Definitions
3. Import/Create Target
Schema
4. Create Mappings
5. Load Data

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Repository

Metadata Repository
Information about the target system
Catalogs the repository
Directs the server
Contains record of user access
Can be shared
Can be searched and reported
Bridged through Metadata Exchange

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Repository Manager

Repository Manager Navigator

10

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Create Repository
Launch the Repository Manager
Repository Connect to Repository Server

11

1. Create the configuration


In Manage Repository window
Configuration - Create

12

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

2. Create Repository
In Manage Repository window
Repository Create

13

Informatica Server can not start up without repository

NO REPOSITORY

14

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Create a group
Connect to the repository using repository manager
SecurityManage Groups

15

Assign Privileges to a Group

16

New Concept Training Center

DATA WAREHOUSE

Cognos PPES

Creating a new user

17

User Management

Privileges
(issued per login ID and/or group)
Use Designer *
Browse Repository *
Create Sessions and Batches *
Session Operator
Administer Repository
Administer Server
Super User

Permissions

Object Locking

(issued at folder level)

(applied at object level)

Read
Write
Execute

Lock - automatic
Unlock - automatic, manual

* Default privileges to each new user and group

New Concept Training Center

18

DATA WAREHOUSE

Cognos PPES

Groups and Privileges

Create users
Create groups
Assign privileges to
groups

Move users into groups


Assign additional privileges to
users

19

Folder Permissions

Assign one user as the folder


permissions
owner for first tier

Select one of the owners groups


for second tier
permissions

All users and groups in the


repository will be assigned the
third tier permissions

20

New Concept Training Center

10

DATA WAREHOUSE

Cognos PPES

Designer Tools

21

Designer Windows

22

New Concept Training Center

11

DATA WAREHOUSE

Cognos PPES

Working with Sources


Relational Source
Oracle
Sybase
Informix
SQL Server
DB2
MS Excel Source
Cobol Source
Flat files
XML sources

23

Working with Relational source

24

New Concept Training Center

12

DATA WAREHOUSE

Cognos PPES

Analyze Sources

Import from Database


Import from Files
Flat File
Excel file
XML file

Import from Cobol File

Repository

Create manually
Transfer from data modeling
tools via PowerPlugs

Relational

Diff Type
Of files

COBOL file

Data Model

25

Relational Source Analysis

Source Analyzer

Relational Source
OD

BC
Table
View

O
D
B
C

Synonym
DEF

DEF

Repository
26

New Concept Training Center

13

DATA WAREHOUSE

Cognos PPES

Import from relational database

27

Import from relational database


After import, chose Repository Save

28

New Concept Training Center

14

DATA WAREHOUSE

Cognos PPES

Updating a relational source definition

Edit existing source definition


Re-import source definition

29

Flat File Analysis

Source Analyzer

Map
NFS ped D
r
Loc Moun ive
al D
t
irec
tory

Flat File
DEF

Fixed Width
Delimited

O
D
B
C

DEF

Repository
30

New Concept Training Center

15

DATA WAREHOUSE

Cognos PPES

Flat File Wizard

Three-step wizard

Can rename columns


within wizard

Only datatypes allowed


are text or numeric

Wizard guesses datatype

31

Flat File Analysis

Edit Source Definition

32

New Concept Training Center

16

DATA WAREHOUSE

Cognos PPES

Import source from MS Excel


To import source from MS Excel
Install the MS Excel ODBC driver

Create a MS Excel ODBC Data Source for each


source file

Prepare MS spreadsheet by definition ranges


and formatting columns of numeric data

import source definitions to the designer

33

Import source from XML

34

New Concept Training Center

17

DATA WAREHOUSE

Cognos PPES

COBOL File Analysis

Source Analyzer

Map
NFS ped D
Loc Mou rive
al D ntin
irec g
tory

.CBL File
DEF

O
D
B
C
DATA

DEF

Repository

Supported Numeric Storage Options

35

Cobol File Analysis

Edit Source Definition

36

New Concept Training Center

18

DATA WAREHOUSE

Cognos PPES

Working with Target Warehouse Designer

37

Importing a relational target definitions

38

New Concept Training Center

19

DATA WAREHOUSE

Cognos PPES

Import from Database


Reverse engineer existing object definitions from a
database into Informatica repository
Warehouse Designer
Database
OD
O
D
B
C

BC

Table
View
Synonym
DEF

Repository

39

Import target from a relational database

40

New Concept Training Center

20

DATA WAREHOUSE

Cognos PPES

Import target from a flat file

41

Import target from XML

42

New Concept Training Center

21

DATA WAREHOUSE

Cognos PPES

Manual Target Definition


1. Create empty definition

2. Add desired columns

3. Finished target definition

43

Target Table Definitions

44

New Concept Training Center

22

DATA WAREHOUSE

Cognos PPES

Create Physical Tables

DEF
DEF

DEF

Execute SQL
via
Designer

Informatica
Repository
logical
target table definitions

Target
Databases
physical
tables

45

Create Physical Tables

Create tables that do not already exist in target database

Connect - connect to the target database


Generate SQL file - create DDL in a script file
Edit SQL file - modify DDL script as needed
Execute SQL file - create the physical tables in target database

Connect

46

New Concept Training Center

23

DATA WAREHOUSE

Cognos PPES

Mappings and Mapplets

47

Sample Mapping

48

New Concept Training Center

24

DATA WAREHOUSE

Cognos PPES

Steps to develop a mapping


Verify that all source, target, and reusable objects are
created

Create the mapping (Open the Mapping Designer, chose


MappingCreate or drag a repository object into the
workspace, enter a name for the new mapping e.g.
m_PromotionItems)

Add sources and targets


Add transformations and transformation logic
Connect the mapping
Validate the mapping
Save the mapping

49

Mapping Object Edit View

50

New Concept Training Center

25

DATA WAREHOUSE

Cognos PPES

Connecting mapping objects

51

Working with source in a mapping

52

New Concept Training Center

26

DATA WAREHOUSE

Cognos PPES

Working with transformation in a mapping

53

Working with Mapplets in a mapping

54

New Concept Training Center

27

DATA WAREHOUSE

Cognos PPES

Working with Targets in a mapping

55

Working with Targets in a mapping

56

New Concept Training Center

28

DATA WAREHOUSE

Cognos PPES

Relational Target

57

Mapping Validation

58

New Concept Training Center

29

DATA WAREHOUSE

Cognos PPES

Mapplets Overview

59

Sample Mapplet

60

New Concept Training Center

30

DATA WAREHOUSE

Cognos PPES

Sample Mapplet in a mapping

61

Expanded Mapplet in a mapping

62

New Concept Training Center

31

DATA WAREHOUSE

Cognos PPES

Transformation

63

Transformation Type -1

64

New Concept Training Center

32

DATA WAREHOUSE

Cognos PPES

Transformation Type -2

65

Creating a transformation

66

New Concept Training Center

33

DATA WAREHOUSE

Cognos PPES

Configuring a transformation

67

Working with Expression

68

New Concept Training Center

34

DATA WAREHOUSE

Cognos PPES

Using Local Variables

69

Using Local Variables sample

70

New Concept Training Center

35

DATA WAREHOUSE

Cognos PPES

Using Default Value

71

Configuring Tracing levels Session log

72

New Concept Training Center

36

DATA WAREHOUSE

Cognos PPES

Linking Port

73

Auto-Link by position

74

New Concept Training Center

37

DATA WAREHOUSE

Cognos PPES

Auto-Link by Name

75

Auto-Link by Prefix/Suffix

Layout Autolink

76

New Concept Training Center

38

DATA WAREHOUSE

Cognos PPES

Link one to many / many to one

77

Create a reusable transformation

78

New Concept Training Center

39

DATA WAREHOUSE

Cognos PPES

Source Qualifier Transformation


Represents the source record set queried by the server.
Mandatory in mappings using relational or flat file sources.

Active Transformation
Connected
Ports
All input/output
Usage
Modify SQL statement*
Sorted ports*
Select DISTINCT*
Convert datatypes

79

*relational sources only

Source Qualifier Transformation


For relational sources
SQL Query replaces the default query
User Defined Join replaces the WHERE clause of the default query
Source Filter is added to the WHERE clause of the default query
Number of Sorted Ports adds an ORDER BY to the default query
Select Distinct adds a DISTINCT to the default query

80

New Concept Training Center

40

DATA WAREHOUSE

Cognos PPES

Expression Transformation
Perform calculations using non-aggregate Informatica
functions.
Passive Transformation
Connected
Ports
Mixed
Variables allowed
Create expression in an
output port
Usage
Perform majority of
data manipulation

81

Aggregator Transformation
Performs aggregate functions.

Active Transformation
Connected
Ports
Mixed
Variables allowed
Group By allowed
Create expression in an
output port
Usage
Standard
aggregations
Group By

82

New Concept Training Center

41

DATA WAREHOUSE

Cognos PPES

Sorted Ports

Source Qualifier

Number of Sorted Ports property - will create an ORDER BY


statement in the SQL

Increases performance

for rank, joiner, and aggregator

Aggregator

The Sorted Ports property ONLY works if data has been sorted
Group By ports
MUST be pre-sorted in SQL
MUST be in same order as in SQL
Server will store data for a group into memory, and when it
reaches the first record of the next group, it can release data from
the cache

83

Working with Transformations

Aggregation Mapping

84

New Concept Training Center

42

DATA WAREHOUSE

Cognos PPES

Rank Transformation
Filters the top or bottom range of records.

Active Transformation
Connected
Ports
Mixed
One predefined output
port RANKINDEX
Variables allowed
Group By allowed
Specify the column to be
ranked
Usage
Select top/bottom
number of records

85

Update Strategy Transformation


Used to specify how each individual row will be used to
update target tables (insert, update, delete, reject).
Active Transformation
Connected
Ports
All input/output
Specify the Update
Strategy Expression
Usage
Slowly changing
dimension tables
IIF or DECODE logic
determine how to
handle the record

86

New Concept Training Center

43

DATA WAREHOUSE

Cognos PPES

Lookup Transformation
Looks up values from database objects and provides to
other components in a mapping.
Passive Transformation
Connected/Unconnected
Ports
Mixed
L denotes Lookup port
R denotes port used as
a return value in
unconnected lookup
Specify the Lookup
condition
Usage
Get related values
Update tables

87

Working with Transformations


Update Strategy Mapping

SOURCE

SOURCE
QUALIFIER

LOOKUP
Look up
source
Job_IDs
in target
T_JOBS

UPDATE
STRATEGY
Based upon
match of
Job_IDs,
update the
target
T_JOBS table

TARGET

88

New Concept Training Center

44

DATA WAREHOUSE

Cognos PPES

Filter Transformation
Limits rows sent to targets or other transformations.

Active Transformation
Connected
Ports
All input/output
Specify a Filter condition
Usage
Filter rows from flat
file sources
Single pass source(s)
into multiple targets

89

Stored Procedure Transformation


Calls a database stored procedure.

Passive Transformation
Connected/Unconnected
Ports
Mixed
R denotes port used as
a return value (from a
stored function)
Usage
Perform transformation
logic outside Informatica

90

New Concept Training Center

45

DATA WAREHOUSE

Cognos PPES

Stored Function vs.


Stored Procedure Transformations
ORACLE
STORED FUNCTION

ORACLE
STORED PROCEDURE

Can only return one value


(connected or unconnected
mode)

Can return multiple values (in


connected mode)

Must use the Return (R) port


option for the output port that
provides the return value,
regardless of whether the
transformation is unconnected
or connected.

In a connected mode, use links to


designate return values. In
unconnected mode, use
PROC_RESULT in the parameter list
of the stored procedure call to
designate the return value.

91

Sequence Generator Transformation


Generates unique keys for records.

Passive Transformation
Connected
Ports
Two predefined output
ports, NEXTVAL and
CURRVAL
No input ports allowed
Usage
Generate sequence
numbers
Shareable across
mappings

92

New Concept Training Center

46

DATA WAREHOUSE

Cognos PPES

Working with Transformations


Star Schema Mapping
Filter
filters out
discontinued items
Stored Procedure
calls stored procedure
to calculate the
number of times an
item has been ordered

Sequence Generator
generates unique
ID numbers

93

Workflow Manager

94

New Concept Training Center

47

DATA WAREHOUSE

Cognos PPES

Workflow Monitor

95

New Concept Training Center

48