Data Warehousing

Data Warehouse (DW) is a concept where in data is stored in database in summarised format and based on reporting requirements of business. The data can then be analysed using data mining techniques to gain advantages over business rivals. DW provides a set of functionalities. DW can extract data from various data sources (e.g. flat file, tables, etc.) and stored data in its own databases. DW also provides functionalities for query and analysis. usiness Warehousing is one of the concept which is used to setup a data warehouse. DW is designed considering reporting and analytical requirements of business. !"# W provides solution related to business warehousing where in data can be transformed, cleansed, loaded, scheduled, monitor and reported based on business reporting requirements $n %nline Transaction #rocessing (%&T#, e.g. !"# '(), *++), normali,ation is used as database design technique where in same information is available only at one place. %b-ective of normali,ation is to avoid data redundancy and data integrity issues. .ence if an information is updated at one place, there is no need to update it at another place and updated information is available where ever it is retrieved. Star Schema To facilitate data retrieval from data warehouse, a special database design technique is used which is called /!tar !chema/. !tar !chema uses a 0act table and several Dimensional tables. 0act table is a central table which is surrounded by many dimensional tables. .ence the name !tar !chema. 0ollowing is an example of !tar !chema1

0act Table1 "t the centre Dimensional Table1 !urrounding (+ustomer, #roduct and &ocation)

" star schema consists of many dimensions, hence term 2ultidimensional "nalysis is also used. %ne dimension can have many attributes. These attributes allows to drill up and down to analysis data. $n the example, dimension /&ocation/ has one of the attribute as /'egion/. .ence, reporting can be done at region level as well.

Customize SAP R/3 for SAP BW

!"# '() (%&T#) system needs to be customi,ed so that data can be extracted in !"# W. To extract data, one needs to activate the standard business content. 0or each application (e.g. !D, 22, etc.), there are data sources for extracting 2aster and Transactional data. 3) &og on to !"# '() system 4) *xecute transaction ! $W )) 5o to / usiness +ontent Data!ources/ 6) +lic7 /Transfer "pplication +omponent .ierarchy/

8) $n the confirm prompt1 /Do you want content application Transfer +omponent .ierarchy/, press /9es/ :) +onfirmation message will appear realted to transfer component hierarchy ;) 'epeat step 4 < ), clic7 / usiness +ontent Data!ources/

Data !ources are extraction structure. They have list of fields. They are classified as 2aster Data !ources and Transactional Data !ources. 2aster data sources are divided in "ttributes, Texts and .ierarchies.

=) !elect the !"# "pplication +omponent, mar7 the data source and select "ctivate Data !ource

Customize SAP BW for SAP R/3

!"# W system needs to be customi,ed for !"# '() so that data can be smoothly extracted in !"# W. Transfer of global setting, exchange rates, replication of data sources are common setting need to be done while setting up !"# W system. 3) +reate >ser $D for !ource !ystem +ommunication a) *xecute transaction !>?3 b) +reate user $D '0+>!*', type !9!T*2 with profile !@ $AW.2@'0+ and !@ $A WB@'0+ 4) !et >ser $D for !ource !ystem +ommunication a) Transaction '!+>!T" b) !et C W >ser "&*D as '0+>!*'

)) '() !ource !ystem a) Transaction '!"3 b) 5o to !ource !ystems and +reate source system for '() and 'eplicate Data!ources 6) +opying 5lobal !ettings from '() a) 'ightAclic7 '() !ource !ystem and choose Transfer 5lobal settings

8) +opying *xchange 'ates from '() a) 'ightAclic7 '() !ource !ystem and choose Transfer *xchange rates :) 0lat file !ource !ystem a) Transaction '!"3 b) 5o to !ource !ystems and +reate source system for 0lat file ;) W !ource !ystem a) Transaction '!"3 b) 5o to !ource !ystems and +reate source system for W and 'eplicate Data!ources =) 2aintain !ource !ystem $D a) Transaction '!"3 b) 2enu Tools AE "sgnmt of !rce !yst to !rce !yst $D B #+&FT3?? AE # B*#+&FT3?? AE *# #+0&"T0$&* AE 0T

G) Define source system mappings a) Transaction '!"3 b) 2enu Tools AE 2apping of the !ource !ystem Fames B*D+&FT3?? AE B*#+&FT3?? B D+&FT3?? AE B #+&FT3??

3?) #ermitted +haracters a) Transaction '!H+ b) 2aintain permitted characters 33) "ctivate *x .istory a) Transaction !#'% b) 5o to !"# FetWeaver AE !"# usiness $nformation Warehouse AE 'eportingArelevant !ettings AE 5eneral 'eporting !ettings in usiness *xplorer AE "ctivate #ersonali,ation in *x) c) +hoose option C"ctivate *x .istoryD and *xecute 34) Fumber ranges for Transfer !tructure a) Transaction !F>2 b) *nter ob-ect name C $@T!D and +lic7 on CFumber 'angesD c) +hoose C+hange $ntervalsD d) "dd new interval C?3D (Fot 3), from number C?????????3D to number CGGGGGGGGGGD !ave and exit 3)) %b-ect +hangeability Transaction '!"3 a) 5o to Transport +onnection) +lic7 on button C%b-ect +hangeabilityD b) !et the following ob-ects as C+hangeable %riginalD I $!$# J $nfo#ac7age I '!#+ J #rocess +hain I '!#T J #rocess +hain !tarter I '!#K J #rocess Kariants

Define Source System

!ource !ystem is the system from where data is extracted and stored in data warehouse. 0ollowing are the steps to Define a !ource !ystem in !"# W 3) *xecute transaction '!"3 4) !elect !ource !ystem as shown below and right clic7 to create

)) !elect !ource !ystem Type as shown below. $n this example, we are creating a source system for a flat file. >sing this, we can load a .csv file to an infocube

!imilarly, a !"# '() or !"# W system can be defined as source system. !erver id, system id, bac7ground user, clients are some of the information required to define !"# source system.

6) *nter a name and description for source system

8) !ource system is created as shown

Create Data Source in SAP

Data !ources are extraction structure. Data !ources are used to extract data from various source system. $n the below steps, we will see how to create a data source using a !"# table K "H. 3) *xecute transaction '!%4 4) *nter data source name to be created

)) #ress +reate 6) *nter description of the data source 8) *nter the name of table or view on which data source has to be created. Data !ource can also be created using a Kiew, $nfo set or a 0unction 2odule.

:) !ave the data source ;) *xecute '!%4 again and clic7 +hange =) !elect K *&F field as selection

G) !ave the Data !ource

33) To chec7 whether data is getting extracted, execute transaction '!") 34) *nter the name of data source as shown below and press /*xtraction/

3)) "n information message will appear stating no. of records fetched 36) "dditional button /Display list/ will appear, press button

38) !elect one of the data pac7et and double clic7 to get records fetched

3:) Data !ource is ready to be usedL

Replicate Data Sources

%nce the data source is created in source system, this has to be replicated into data warehouse. This way data source will be available for W to extract data. 3) *xecute transaction '!"3 4) !elect !ource !ystem )) 'ight clic7 the source system where data source was created earlier

6) !elect 'eplicate Data !ources 8) !tatus will appear at bottomAleft with replication status as shown

:) %nce replication is done, a status message will appear

Naming Convention in SAP BW

!"# W has a naming convention related to its ob-ects. !"# W prefixes ( $%( to the names of usiness +ontent database ob-ects. $t prefixes ( $+( to the database ob-ects created by users. $f a user creates characteristics type info ob-ect M#'%D>+T and activates it, information will be stored in following1 Data element1 ( $+($%M#'%D>+T !$D table1 ( $+(!M#'%D>+T 2aster data table1 ( $+(#M#'%D>+T Text table1 ( $+(TM#'%D>+T Kiew1 ( $+(2M#'%D>+T

When an info cube M!"&*! is created and activated, information will be stored in following1 Kiew 0act table1 ( $+(KM!"&*!0 Transparent 0act table1 ( $+(0M!"&*! Dimension tables1 ( $+(DM!"&*!3 to ( $+(DM!"&*!F where F being no. of dimensions ( $+(DM!"&*!#, ( $+(DM!"&*!T, ( $+DM"&*!> for Data #ac7et, >nit < Time (maximum 3: dimensions possible, ) reserved for #, T < >) $f a hierarchy is used in an info ob-ect MD"T*, following tables will be created1 .ierarchy table1 ( $?(.MD"T* .ierarchy !$D table1 ( $?(HMD"T* !$D hierarchy structure1 ( $?($MD"T* .ier$nterval table1 ( $?(NMD"T*

Common SAP BW ransactions

0ollowing are most commonly used !"# W Transactions 3) ! $W1 Data Transfer to !"# W 4) '!"31 "dmin Wor7bench 2odelling )) '!MK1 2aintain Kariable for *x "nalyser 6) '!!21 W "uthori,ation 8) '!%41 2aintain 5eneric Data !ources :) '!";1 W Delta Oueue 2aintenance ;) '!")1 Data *xtractor +hec7 =) '!"81 $nstallation of Data !ources from usiness +ontent G) &$!T+> *1 To display content of $nfo #roviders 3?) '!+>!T"1 !et >ser $D for !ource !ystem +ommunication 33) '!H+1 #ermitted +haracters 34) !F>21 Fumber ranges for Transfer !tructure 3)) !2:41 Define *vent 36) '!2%1 *valuation of 'equests 5eneral !"# Transactions1 3) !*331 " "# Dictionary (+reate, +hange, Display Table, Kiew, Data *lements, etc.) 4) !*3:1 Data rowser for Table and Kiew )) !>?31 >ser 2aintenance 6) #0+51 'ole 2aintenance 8) !#'%1 +ustomi,ing :) !*=?1 %b-ect Favigator ;) !*G)1 To chec7 transaction codes available =) !T2!1 Transport 2anagement G) !*?G1 Transport %rganiser

!a"or Difference #et$een SAP B% &'( an) SAP BW 3'*

3) "dministrator Wor7bench is renamed as Data Warehousing Wor7bench. 4) There are additional modeling options available at left hand side panel in transaction '!"3 as shown below. The additions are /Data!ources/ and /%pen .ub Destination/.

)) The functions of the $nfo#ac7age tree are fully covered by process chains. 6) #rocess +hains are used instead of *vent +ollector. 8) The /'emodelling/ transaction help you add Hey 0igures and +haracteristics in a $nfocube while handling historical data effectively. :) $nfocubes can be included in $nfosets. ;) Transformation is used instead of update and transfer rules. =) %D! ob-ects have been renamed as Data!tore %b-ects. G) 9ou can access ob-ects till $nfo#ac7age directly from $nfo+ube as shown below.

%nfocu#e Creation using SAP BW 3'* + B% &'(

$nfocube ob-ects are widely used in any !"# usiness Warehousing implementation. Data is stored in $nfocube from one or many $nfo!ources. *x Oueries are used to analysis data available in $nfocube. !tandard $nfocubes are optimised for there readAaccess performance. $nfocube uses concept of star schema. $nfocube is created using +haracteristics and Hey

0igures. +haracteristics are levels on which reporting has to be performed. 0or example, #roduct, +ustomer and &ocation. Hey 0igures are measures used for characteristics. 0or example, sales quantity for a product, customer and location combination. "s there is a significance difference between !"# W ).8 and !"# $ ;.?, we are providing here steps of $nfocube creation process for both the versions. %nfocu#e Creation using SAP BW 3'* 3) $nfocube +reation !tep 3 using !"# W ).8 4) $nfocube +reation !tep 4 using !"# W ).8 )) $nfocube +reation !tep ) using !"# W ).8 %nfocu#e Creation using SAP B% &'( 3) $nfocube +reation !tep 3 using !"# 4) $nfocube +reation !tep 4 using !"# )) $nfocube +reation !tep ) using !"# 6) $nfocube +reation !tep 6 using !"# $ ;.? $ ;.? $ ;.? $ ;.?

,pen -u# Service using SAP BW 3'* + B% &'(

%pen .ub !ervice functionality in !"# W ).8 is mainly used with $nfo!po7e. $nfo!po7e is an ob-ect for exporting data. $nfo!po7e is defined using a data source (from which data is extracted), extraction mode and destination (where data will be stored). %pen .ub !ervice functionality is used to distribute data from !"# $ to other nonA!"# data systems. $n earlier version, it was part of $nfo!po7e but in !"# $ ;.? this can be used independently. "s there is a significance difference between !"# W ).8 and !"# $ ;.?, we are providing here steps of %pen .ub !ervice creation process for both the versions.

,pen -u# Service using SAP BW 3'*

%pen .ub !ervice functionality in !"# W is mainly used with $nfo!po7e. $nfo!po7e is an ob-ect for exporting data. $nfo!po7e is defined using a data source (from which data is extracted), extraction mode and destination (where data will be stored). $n this section, we will see, how data is extracted from !"# W $nfo+ube to a .csv file on a des7top. 3) *xecute transaction '!"3, /Tools/ AE %pen .ub !ervice AE *dit $nfo!po7e

4) *nter name of $nfo!po7e and press /+reate/

)) *nter short description and select the Data !ource as /$nfo+ube/

6) !elect *xtraction 2ode as /0ull/

8) 5o to /Destination/ tab, enter short description. $n this example, we will be exporting data in a .csv file, select the /0ile/ and chose /Directory/

:) 5o to /$nfo%b-ects/ tab, select the $nfo%b-ects you would li7e to have in your exported file

;) 5o to /!election/ tab, enter if you want a particular selection criteria, in this example there is no selection used.

=) "ctivate the $nfo!po7e by pressing /"ctivate/ button

G) "fter activation, source structure will appear as follows

3?) 5o bac7 and display the $nfo!po7e, press /Dialog/ button

33) Data will be exported to .csv file which will be stored at des7top

34) 5o to $nfo!po7e 2onitor to chec7 status of export

3)) Data is exported as the monitor status is green

36) +hec7 the exported file at des7top

,pen -u# Service using SAP B% &'(

%pen .ub Destination functionality is used to distribute data from !"# $ to other nonA!"# data systems. $n earlier version, it was part of $nfo!po7e but in !"# $ ;.? this can be used independently. $n this section, we will see, how data is extracted from !"# $ $nfo+ube to a .csv file on a des7top. 3) *xecute transaction '!"3, #ress /%pen .ub Destination/

4) !elect $nfo"rea and right clic7 to /+reate %pen .ub Destination

)) *nter Fame and Description

6) 5o to /Destination/ tab, enter Destination Type as /0ile type/. $n this example, we will be exporting data in a .csv file, select Directory to /Des7top/

8) 5o to /0ields Def./ tab, select the $nfo%b-ects you would li7e to have in your exported file

:) "ctivate the %pen .ub Destination by pressing /"ctivate/ button ;) !elect the %pen .ub Destination and right clic7 to /+reate Transformation/

=) *nter source of transformation as $nfo+ube

G) "ccept the proposed mapping and activate

3?) +reate Data Transfer #rocess for transfering data from $nfo+ube to Des7top as .csv file

33) *nter source of DT# as $nfo+ube

34) "ctivate DT# and *xecute, Data will be exported to .csv file which will be stored at des7top

3)) #ress /9es/ to chec7 the status of request monitor

36) Data is exported as the monitor status is green

38) +hec7 the exported file at des7top

,perational Data Store .,DS/ using SAP BW 3'*

%D! consists of /Hey fields/ and /Data fields/. Data fields can also contain characteristics e.g. customer, product etc.. %D! is not used for multiAdimensional analysis li7e $nfocube. The data from %D! can be

updated with delta update into a $nfocube. The data in %D! is stored in a transparent table. There is no fact or dimensional table created for %D!. 0ollowing are the steps to create an %D!1 3) *xecute transaction '!"3, select the $nfo"rea under which you would li7e to create %D!. 'ight clic7 the $nfo"rea, select /+reate %D! %b-ect/

4) *nter %D! %b-ect /Fame/ and /Description/, press /+reate/

)) +hec7 the box against / *x 'eporting/ to enable %D! for *x reporting, press /$nfo%b-ect +atalog/ button to get the $nfo%b-ects which you would li7e to add to %D!

6) !elect the characteristics ($nfo%b-ects) which you would li7e to add as /Hey fields/ or /Data fields/, drag and drop the $nfo%b-ects in respective folders as shown below.

8) 9ou can also insert an $nfo%b-ect into to fields folders by right clic7ing the folder

:) "dd /?+"&2%FT./ as /Hey field/

;) "dd Hey 0igures as /Data fields/ as shown below, chec7 and activate the %D!, system will display message related to %D! activation

=) #ress / ac7/, you can see %D! as shown

Fow define $nfo!ources, Transfer 'ules, >pdate 'ules, $nfo #ac7age as discussed in $nfocube +reation !teps. G) elow is the *xtraction !tructure created based on %D!

We will see more details about %D! in coming sections... than7s for your patienceL

Process Chain Creation using SAP BW 3'*

Process chains are used extensively in SAP Business Warehousing for executing loads, running reports etc. sequentially or parallel. There can be number of steps ith in a process chain. !ou can also decide hat has to be done incase a particular step fails. "n case of failure you can decide to sent notification email to concern person ho can correct the issue. "n this section e ill see ho #.$. %sing this process chain &' (xecute transaction )SP* +' Press ,*reate,, enter ,-ame, and ,.escription, of the process chain, press ,*ontinue, to create a process chain using SAP BW e ill load data in "nfocube.

#' /irst step in the process chain ill be a ,Start, step, press ,*reate, to create a process variants

0' (nter ,-ame, and ,.escription, of the process variant

$' ,Save, process variant and go bac1, ,*hange selections, is used to schedule the process chain, e ill revisit this again later

2' Press ,*ontinue,

3' Select the "nfoPac1age used to load data in "nfocube, drag "nfoPac1age to right panel

hich is

4' Select the process variants as "nfoPac1age using fucntion 1ey /0

G) !elect the $nfo#ac7age M""" and press /+ontinue/

&5' /ollo ing steps in the process chain

ill be added

&&' 6oin ,Start, step ith step ,"ndexes, by selecting ,Start, step and dragging the line to ,"ndexes,

&+' 7o bac1 to ,Start, step and right clic1 to ,8aintain 9ariant,

&#' Select ,"mmediate, to schedule the process chain immediately

&0' ,*hec1, the process chain and ,Activate, the process chain

&$' (xecute the process chain, enter the server name in the follo ing screen

&2' Process chain executing, to chec1 the status, Press

ill start

&3' Select ,!esterday and Today, to chec1 the status of the process chain

&4' /ollo ing screen sho s that load is still not completed

&:' ;nce completed, the status ill appear as follo s, incase there is any failure, the status ill appear as

cancelled