Root Cause Analysis

File Identifier Effective Date Version Incident IDs : Open Date & Time Attended Dated & Time Closure Date & Time Open Date & Time Attended Dated & Time Closure Date & Time 10-Oct-10 10-Oct-10 10-Oct-10 10-Oct-10 10-Oct-10 10-Oct-10 Incident Support Staff TP_MIT_PBM_RcaFrm 13 Sep 2009 1.00
th

Windows Team

Problem ID: PM0025

Problem Support Staff

Windows Team

Problem Description

HCIF menu option is hanging in Finacle , the same sytem is not allowed to work in HCIF menu option, due to that the same

HCIF menu option is automatically stopped.

Symptoms

Bounce the services & Run the SQL Query

Impact Analysis

HCIF menu option is hanging in Finacle , the same sytem is not allowed to work in HCIF menu option, due to that the same is not working in Finacle and got delayed

Root Cause

Due to heavy load on particular port HCIF menu option taking tlong time to complete the process & which will impacted the customer services.

Root Cause

What

Who

When

Corrective Action

Bounce the services & Run the SQL Query We have moved to other server 172.25.2.29 port 9090 was working fine.

While using the HCIF menu option day to day basis activity will be factored. Delay in Customer operation

Application L2/DBA

10-Oct-10

What

Who

When

Preventive Action

Due to heavy load on particular port HCIF menu option taking tlong time to complete the process & which will impacted the customer services. Configuration of new setup of RESIN & FINlistval services

While using the HCIF menu option day to day basis activity will be factored. Delay in Customer operation

Application L2/DBA

10-Oct-10

Recommended for Change

Yes

Change Request ID

2212

Observations

It is observed that most of the days, ONS menus are not available in the mornings. In our analysis , we found that this issue is occurring because of error in services when it bounced. But Helpdesk team will not be able to identify this unavailability of ONS service since this service is mapped to Sol id & Ip addresses. They will get the error only when the services on Ip/server where DC is mapped is unavailable. We found that on most of the days, core dump is generating while starting the finlistval services. The reason for this ,can be time delay in releasing the ports or /finlistval/work directory is having more contents. To avoid this , person/team who bounces the services can check for any core dumps generated in finlistval/bin directory. And if found he /she can stop finlistval service and remove core and again start the services. Currently we have 4 sets of Finlistval services which are installed in 172.25.5.53 172.25.5.59 172.25.5.65 172.25.5.93 Along with this, we found that during business Hours , there are delay in ONS/CRV menus which will be solved by introducing new finlistval/resin components to production and the load will be distributed equally. The reason for the delay/unavailability of the services described above is due to the drastic use of ONS menu's in production(HCIF/CARDMNT/HRTGS)

Wipro-MIT

Confidential

Cause and Effect Diagram

File Identifier Effective Date Version TP_MIT_PBM_RcaFrm 8-Feb-10 1.00

Branches are not able to opend the HCIF menu option in finacle ,the same system was not allowd to start the services, due to that customer services & daya to day operation effected

We have to monitored the log directory

Moved to Other server

Prioritization of Causes: Impact/Implement Matrix

File Identifier TP_MIT_PBM_RcaFrm Effective Date 13th Sep 2009 Version 1.00 Delay in day to day operation in HCIF menu option services was down frequently.

Back to Corrective Action

Impact

Low

High

Delay in HCIF menuoption was not working in finacle

Easy

Difficult Implementation

Based on Impact/Implement Matrix Following Causes are taken forward for Corrective and/or Preventive Action

RCA - Action Tracker

File Identifier Effective Date Version Preventive Actions Who When Status Remarks Actionable Closure Date What TP_MIT_PBM_RcaFrm 13th Sep 2009 1.00

Problem Problem ID Description

Support Staff

Date Problem Reported

Root Cause

Corrective Actions What

Who

When

Status

Remarks

Actionable Closure Date

PM0025

HCIF menu option is hanging in Finacle , the same sytem is not allowed to work in HCIF menu option, due to that the same Application is not working in L2 team Finacle and got delayed

10-Oct-10

Due to heavy load on particular port HCIF menu option taking tlong time to complete the process & which will impacted the customer services.

While using the HCIF menu option day to day basis activity will be factored. Delay in Customer operation

Bounce the services & Run the SQL Query Application L2/DBA 10-Oct-10 Work in Progress We have moved to other server 172.25.2.29 port 9090 was working fine. 8-Nov-10

While using the HCIF menu option day to day basis activity will be factored. Delay in Customer operation

Application L2/DBA

10-Oct-10

Closed

Due to heavy load on particular port HCIF menu option taking tlong time to complete the process & which will impacted the customer services. Configuration of new setup of RESIN & FINlistval services

10-Oct-10