Name of Solution:

Workflow: Session Recovery - Relational Source

Business Requirement:
Demonstrates the inbuilt recovery features available in PowerCenter to recover a failed Session with relational source.

Solution URL:
https://community.informatica.com/solutions/1865

Supported Versions:
PowerCenter 9.1 and 9.5

Description:
When a PowerCenter workflow fails, it is the part of the operations teams responsibility to troubleshoot the issue and successfully complete the workflow. A PowerCenter workflow fails when a task (e.g. Session) inside the workflow fails for various reasons. When the root cause of the issue is understood and fixed the workflow will be recovered. When you recover a workflow, the Integration Service recovers the tasks based on the recovery strategy for each task. Depending on the task, the recovery strategy can be fail task and continue workflow, resume from the last checkpoint, or restart task. When you configure session recovery to resume from the last checkpoint, the Integration Service creates checkpoints in $PMStorageDir to determine where to start processing session recovery. When the Integration Service resumes a session, it restores the session state of operation, including the state of each source, target, and transformation. If the mapping uses a non-repeatable and non-deterministic relational source, (i.e. The order of data and the number of rows is not guaranteed to be the same during recovery) , the source data is cached to be used during recovery. This block illustrates the session recovery features when the session is configured to resume and has non-repeatable and non-deterministic relational source.

Download file contents:

1. Workflow 2. Source File 3. Script

Steps to implement the solution:

1. Place source file in $PMSourceFileDir folder. Execute the script to create the target tables. 2. Import workflow using the Repository Manager. Select the appropriate folder from the repository and resolve the conflicts by choosing suitable option.

Please rate this solution and share your feedback on Marketplace Website.

3. Open the workflow in Workflow Manager. Assign the integration service in Workflow > Edit -> Integration Service 4. Edit session and assign valid connection object for the source and target. 5. For more details of importing object please visit our YouTube link. 6. To set up the demo, start the workflow wf_load_relational_source to load the table T_LINEITEM. Now the source data for the session recovery demo is ready. 7. Note that the workflow wf_Session_Recovery is enabled for recovery by checking the option Enable HA Recovery in the properties tab.

8. Start the workflow wf_Session_Recovery. After an elapse of 15 seconds, abort the workflow wf_Session_Recovery. Observe the workflow monitor as below.

9. Before recovering the session or workflow, to verify that cached source data is used during recovery, truncate the table T_LINEITEM.

Please rate this solution and share your feedback on Marketplace Website.

10. Recover the workflow or the session task. Observe the workflow monitor after completion as below.

11. After the session is successful use the below query to verify the results Select to_char(insert_dt,'YYYYMMDD HH24:MI:SS'), count(*) from T_ORDER_QTY Group by to_char(insert_dt,'YYYYMMDD HH24:MI:SS') For example, the please review the below result

We can notice that the 350 rows were created before the session was aborted and the rest of the rows were created during the recovery run started after approximately 11 minutes 12. We can also observe that: 1. The target table was not truncated again during session recovery run. 2. The target rows already committed to the target were ignored 3. The source data was read from the recovery cache. 4. During the complete process you can observe the changes in $PMStorageDir folder. After aborting folder looks as below.

Please rate this solution and share your feedback on Marketplace Website.

After completing most the checkpoint files will be removed.

YouTube Video on Importing and Configuring Workflows:

http://www.youtube.com/playlist?list=PLLRreK2jjjgWBQ4NPfp0QWTxYDvlnEqSJ

Other Useful links:

Mapping Bundles Workflow Bundles Informatica Tools Bundles Informatica for Social Media Bundles Debugging Tools Bundles Visio Templates Bundles B2B Templates and Projects Bundles Data Quality Packs and Plans Bundles Script Bundles

Please rate this solution and share your feedback on Marketplace Website.