Вы находитесь на странице: 1из 45

THE ROTARY CLUB OF KITGUM

END TERM EVALUATION REPORT


MOTHER AND CHILD HEALTH project-MCH-p
BY FRANCIS ODWONG AND ROBERT BABU
7/22/2014

An end-term/terminal evaluation report for a mother and child health project implemented by the Rotary
Club of Kitgum in hard to reach rural locations within the district. The project lasted for sixteen months (April
2013-June 2014. The evaluation was meant to demonstrate the successes, challenges, best practices and
lessons learnt in the project implementation for future programming by the club and its stakeholders as well
as to offer accountability on the performance of the club in this project.

END TERM EVALUATION REPORT


July 22, 2014

1) Acknowledgement
Nen Anyim Skyline Uganda acknowledges all those who participated in the end term evaluation exercise in Lamit,
Pajong, Akuromo and Okuti parishes in Kitgum district for offering their time for the activity. We also acknowledge the
leadership of the Rotary Club of Kitgum and the technical staff who worked in the Mother and Child Health project for
the cooperation and support rendered to the evaluation team during the exercise. We highly appreciate the projects
donor representative for her invaluable contribution to the evaluation exercise.
Our heartfelt appreciation also goes to the field data collection team including Atimango Vicky, Komakech Moses, Ochan
Francis, and Ogwal Tom Peter for their dedication in the exercise.
This Evaluation would not have happened without the technical and financial assistance from Mount Airy Rotary
Foundation through the Rotary Club of Kitgum. Your continued support to relief world suffering including in Northern
Uganda is highly acknowledged.

END TERM EVALUATION REPORT


July 22, 2014

2) Executive summary
a) Background:
The Rotary Club of Kitgum with part funding from Mount Airy Rotary Club implemented a Mother and Child Health
project in Akwang, Mucwini and Orom Sub Counties in Kitgum districts from April 2013 to June 2014. In order to
maximize the work of the project with the target communities, the Club in June 2014 contracted Nen Anyim Skyline Co.
Limited (a development consultancy company) to undertake an end term evaluation to document successes, challenges,
lessons learnt and best practices registered by the project.
b) Purpose:
To establish objective information on the successes and lessons learnt among others by Rotary Club Kitgum in the
implementation of this project. The information shall be used to determine the efficiency and effectiveness of the
strategies used by Rotary Club Kitgum in planning and implementation of the project for replication, improved
programming, accountability and reference.
c) Objectives:
To report on the level of achievement of the project objectives according to the expected results listed in the logical
framework. To highlight lessons learnt, best practices, and challenges faced during the implementation of the Mother
and Child Health project.
d) Methodology:
The evaluation applied the survey (cross-sectional) study design using both quantitative and qualitative data collection
and analysis techniques. Data were collected through beneficiary interviews, Focus Group Discussions (FGDs), Key
Informant Interviews (KIIs), review of the projects statistics and official health records plus other relevant documents. A
sum of 3 FGDs, 15 KIIs and 76 beneficiary interviews were conducted.
e) Key findings, conclusion and recommendations:
Most of the end of project output targets on Mother and Child Health were attained. However there were serious
shortfalls in the performance for some important targets. The Maternal and Child Health project greatly contributed to
the improvement of maternal and child health through increased ANC attendance, vaccination, family planning and
deliveries at the health facilities. The mothers have been empowered in better hygiene practices and seek timely health
care for themselves and their children.
The project performed satisfactorily on the targets it set prior to the intervention. Some of the achievements registered
in the project far exceeded the targets such as awareness on family planning, change in the health seeking behaviors of
women, and use of the referral system for women at risk and in emergency. A couple of other targets were
unfortunately not attained especially the one on vaccination for DPT3 and measles.

The project also applied a lot of innovation and creativity in its approach by engaging key stakeholders and
partners which ensured synergy, efficiency and effectiveness.
3

END TERM EVALUATION REPORT


July 22, 2014
TABLE OF CONTENT
1)

Acknowledgement..............................................................................................................................................2

2)

Executive summary.............................................................................................................................................3

3)

Acronyms ...........................................................................................................................................................6

1.

CHAPTER I ..........................................................................................................................................................7

1.1

Background ....................................................................................................................................................7

1.2

The project background .......................................................................................................................................... 7

1.3

Project Objectives ................................................................................................................................................... 7

1.4

Project Activities ..................................................................................................................................................... 8

1.5

Objectives of the Evaluation ............................................................................................................................9

1.6

Scope of work .................................................................................................................................................9

1.6.1

Project Design ..................................................................................................................................................... 9

1.6.2

Project Implementation ...................................................................................................................................... 9

1.6.3

Project Performance and Impacts .................................................................................................................... 10

1.6.4

Conclusions and Recommendations for Future Activities ................................................................................ 10

2.

Chapter II: Methodology ................................................................................................................................... 11


2.1

Study Design.......................................................................................................................................................... 11

2.2

Study area and Population: ................................................................................................................................... 11

2.3

Sample Size ........................................................................................................................................................... 11

2.4

Data Collection Methods ...................................................................................................................................... 11

2.5

WCA Interviews ..................................................................................................................................................... 12

2.6

Focus Group Discussions (FGDs) ....................................................................................................................... 12

2.7

Key Informant Interviews (KII) .......................................................................................................................... 12

2.8

Data Management, Analysis and report writing ................................................................................................... 12

2.9

Quality control ...................................................................................................................................................... 12

2.10

Ethical considerations ........................................................................................................................................... 13

3.

CHAPTER III ...................................................................................................................................................... 14

3.1

FINDINGS AND ANALYSIS .............................................................................................................................. 14

3.2

Demographic information ..................................................................................................................................... 14

3.3

THE PROJECT DESIGN ............................................................................................................................................ 14

3.4

IMPLEMENTATION ................................................................................................................................................ 15
4

END TERM EVALUATION REPORT


July 22, 2014
3.5

RELATIONSHIP WITH STAKEHOLDERS ............................................................................................................... 18

3.6

Challenges faced during the project implementation ...................................................................................... 21

3.7

PROJECT PERFORMANCE AND IMPACTS .............................................................................................................. 22

3.7.2
3.8
4.

State of the local referral system .................................................................................................................. 24

The level of sustainability/self-reliance achieved by the project ......................................................................... 28

CHAPTER IV ...................................................................................................................................................... 30
4.1

CONCLUSION AND RECOMMENDATIONS ............................................................................................................. 30

4.2

Performance on targets .................................................................................................................................... 30

4.2.4

The project design ......................................................................................................................................... 31

4.2.5

The project implementation ......................................................................................................................... 31

4.2.8

Project performance and impact .................................................................................................................. 32

4.3

RECOMMENDATIONS, INSIGHTS AND LESSONS LEARNT...................................................................................... 34

APPENDICES ............................................................................................................................................................ 36
ANNEX I ............................................................................................................................................................................. 36
ANNEX II ............................................................................................................................................................................ 37
ANNEX III ........................................................................................................................................................................... 39
ANNEX IV ........................................................................................................................................................................... 43

END TERM EVALUATION REPORT


July 22, 2014

3) Acronyms
S/NO
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
29.
30.

ACRONYMS
AIDS
ANC
ARTI
CAO
DHO
DSC
FGD
HC
HIV
KDLG
KII
LC
LQAS
MC
MCH
MDG
M&E
NGOs
NMS
PC
PHC
PMTCT
RC
RCK
RDT
TBA
VHT
WASH
WCA
WHO

IN-FULL
Acquired Immune Deficiency Syndrome
Ante Natal Care
Acute Respiratory Tract Infection
Chief Administrative Officer
District Health Officer
District Services Commission
Focus Group Discussion
Health Centre
Human Immune Virus
Kitgum District Local Government
Key Informant Interview
Local Council
Lot Quality Assurance Sampling
Management Committee
Mother and Child Health
Millennium Development Goal
Monitoring and Evaluation
Non-Governmental Organizations
National Medical Stores
Project Coordinator
Primary Health Care
Prevention of Mother to Child Transmission
Rotary Club
Rotary Club of Kitgum
Rapid Diagnostic Test
Traditional Birth Attendants
Village Health Team
Water, Sanitation and Hygiene
Women of Child Bearing Age
World Health Organization

END TERM EVALUATION REPORT


July 22, 2014

1. CHAPTER I
1.1 Background
1.2 The project background
Simon Lawoko, Foundation Chair of Kitgum Rotary, emailed M. Goldwasser from Rotary Club Mount Airy
about having a project focused on saving lives of mothers and children in March 2011. Nurse Practitioner
Rudolf Schachner, long experienced in working in Africa, was consulted on the best way to do this. In May
2011, the Kitgum President Sunday Abwola and project coordinator Simon Lawoko contacted and set up
meetings with the District Health Officer and District Education Officer. Several talks with the District
health Officer (DHO), representatives of health centers, an experienced local midwife, as well as members
of the Village Health Teams (VHTs) and Traditional Birth Assistants (TBAs) took place. The group approved
the project idea and assured cooperation. Kitgum Rotary Officers and the DHO determined where to begin
the project, then took the idea to the Kitgum Rotary Club for discussion and approval. The club selected
this project from 5 project ideas. During meetings with Kitgum officers, the DHO and Health Unit
Management Committee agreed to attend seminars and oversee the Health Centers and VHT's. The DHO
offered to find an office in Kitgum for the team. Members of the assessment team submitted a plan of
action and budget for approval. In 2013 and 2014, Rotary Club Kitgum undertook the 15 months project in
Kitgum district with funds from Rotary Foundation.
1.3 Project Objectives
1.3.1 The main objective of the project was to improve the health situation for mothers and children in
the rural areas of Kitgum district (Northern Uganda). The project would contribute to the
Millennium Development Goals 4 (Reducing Child Mortality Rates) and 5 (Improving maternal
health). The Specific Objective of the project was to provide an increased access to Mother and
Child Health Care services to the local population in difficult to reach areas of Kitgum district by
mobile outreach.
The following three results were to be achieved:
1.3.1.1 Establishment of a mobile outreach system for MCH-services in eight villages in the rural areas of
Kitgum.
1.3.1.2 Pregnant woman and mothers of young children practice hygiene and health prevention according
to WHO guidelines in eight villages in the rural districts of Kitgum.
1.3.1.3 Local decision makers are aware and support the regular MCH services by the mobile Outreach
team. They will contribute to the sustainability and long term running of the ambulance.
1.3.1.4 The following indicators would be used to assess the achievement of the above mentioned
objective and results:
1.3.2 Indicators for project objective
7

END TERM EVALUATION REPORT


July 22, 2014

1.3.2.1 50 percent of all deliveries are attended by a skilled midwife in Kitgum district by the end of April
2014.
1.3.2.2 65 percent of women will have at least three ANC visits by the mobile outreach team in the rural
areas of Kitgum district by the end of April 2014.
1.3.2.3 The local population is aware of the possibility of a referral system for woman at risk and
emergencies in the rural areas of Kitgum district till the end of April 2014.
1.3.3 Indicators for result No. 1
1.3.3.1 Eight pre-selected villages in the rural districts of Kitgum are visited twice per month by the mobile
outreach team till the end of April 2014.
1.3.3.2 Monthly numbers of daily medical consultations of pregnant women in the rural areas of Kitgum
district till the end of April 2014.
1.3.3.3 85 percent of children have a DPT3 and measles vaccination in the rural areas of Kitgum district by
the end of April 2014.
1.3.3.4 30 percent of all women at a child bearing age are aware about methods of family planning.
1.3.4 Indicators for result No. 2
1.3.4.1 Number of education units for mothers in the rural areas of Kitgum district until the end of April
2014 performed by VHT's.
1.3.4.2 Five VHTs per parish receive a training of at least six days until the end of April 2014.
1.3.4.3 Women in the rural districts of Kitgum are aware of the basics of hygienically disease prevention.
1.3.5 Indicators for result No. 3
1.3.5.1 Running costs of the ambulance are budgeted by the DHO for the financial year 2014/2015.
1.3.5.2 At least four radio broadcasts will be held in local radio station to inform about the health services
the MCH-Team is providing in the rural areas of Kitgum district.
1.3.5.3 Number of participatory meetings with at least 20 participants.
1.4 Project Activities
1.4.1 A mobile clinic consisting of 1 midwife, 2 nursing assistants, 1 double comprehensive nurse and 1
driver offers basic health and ANC services at rural areas by mobile outreach. In total 4 parishes
were selected and in total 8 spots were visited regularly per month.
1.4.2 Activities include:
1.4.3 Training of VHTs and TBAs to provide health education in family planning, nutrition, sanitation and
vaccination to reduce infections, malnutrition, high birth rates and disease.
8

END TERM EVALUATION REPORT


July 22, 2014

1.4.4 Neonatal consultations to ensure detection of complications in pregnancy and necessary referrals
to functional health centers or hospitals.
1.4.5 Scheduled immunization, mosquito nets, counseling, retro-viral & anti-malarial drugs to reduce
illness and death, transmission of HIV-AIDS and low birth-weight infants
1.4.6 Capacity building and linkages with community based networks, upgrading and strengthening the
Health Center staff will mean better health care for women and children and sustainability of the
project.
1.5 Objectives of the Evaluation
1.5.1 Objective: To report on the level of achievement of the project objectives according to the results
listed in the logical framework.
1.5.2 The evaluation of the Project was done in order to generate objective information on the successes
and failures of Rotary Club Kitgum. The information will be used to determine the efficiency and
effectiveness of the strategies used by Rotary Club Kitgum for planning and implementation of the
current project, for the formulation of future project proposals and for the incorporation of Rotary
Club Kitgum's methodologies in other projects.
1.5.3 The recommendations of the evaluation report should further enable Rotary Foundation
International to assist Rotary Club Kitgum in improving its decision-making processes and technical
and financial management.

1.6 Scope of work


The evaluation addresses the following issues in the report:
1.6.1 Project Design
1.6.1.1 Considers the effect of the project design on reducing maternal and child mortality.
1.6.1.2 Considers how realistic the project objectives, as defined by the Logical Framework, were.
1.6.1.3 Considers if the organizational framework was suitable for the implementation of the project and if
Rotary Club Kitgum had the right staff, budget, equipment and management capacity to achieve
the project objectives.
1.6.2 Project Implementation
1.6.2.1 Comments on the implementation strategy, procedures and planning methods used by Rotary Club
Kitgum.
1.6.2.2 Determines the efficiency of implementation by a comparison of the costs incurred and the results
achieved.
1.6.2.3 Comments on the role and performance of RC Kitgum and local partners, the beneficiaries and
other stakeholders in the implementation of Rotary Club Kitgum.
9

END TERM EVALUATION REPORT


July 22, 2014

1.6.2.4 Assesses the technical and managerial potential and efficiency of Rotary Club Kitgum and other
stakeholders.
1.6.2.5 Reports on how much external factors have influenced project implementation.
1.6.2.6 Assesses the monitoring and reporting competence of Rotary Club Kitgum.
1.6.2.7 Assesses the technical and managerial competence of Rotary Club Kitgum technical staff and
Rotary Club Kitgum Steering committee and make recommendations on how these may be
improved.
1.6.3 Project Performance and Impacts
1.6.3.1 Determines how far Rotary Club Kitgum has realised the objectives defined by the Logical
Framework and compare the project activities with the project documents.
1.6.3.2 Determines the contribution of Rotary Club Kitgum towards the accessibility to health services for
women.
1.6.3.3 Reports on the attitude of local population to participate in the project.
1.6.3.4 Measures the knowledge level of women at child bearing age in hygiene and disease prevention.
1.6.3.5 Examines the attitude towards family planning.
1.6.3.6 Examines womens attitude towards ANC1 to ANC3 visits.
1.6.3.7 Examines the attitude to give birth at Health Centre.
1.6.3.8 Determines the capacity of VHTs and TBAs to perform health education.
1.6.3.9 Assesses the willingness of the government to take over the project.
1.6.3.10 Assesses the level of sustainability/ self-reliance achieved by the project beneficiaries.
1.6.3.11 Reports on womens participation/ involvement in the design and the realization of the project.
1.6.3.12 Assesses the effectiveness of the training courses provided by RC Kitgum to VHTs.
1.6.4 Conclusions and Recommendations for Future Activities
1.6.4.1 Summarise the consultants findings on the following issues:
1.6.4.2 Policies, structure, management, staffing RC Kitgum.
1.6.4.3 Objectives of RC Kitgum.
1.6.4.4 Reporting, monitoring and oversight,
1.6.4.5 Roles of the different stakeholders and relationships with the key actors, local administration,
other NGOs and donors.
1.6.4.6 The effects of external factors on the implementation of RC Kitgum.

10

END TERM EVALUATION REPORT


July 22, 2014

2. Chapter II: Methodology


2.1 Study Design
The study employed the cross sectional design (survey) by applying a mix of selected qualitative and
quantitative techniques to obtain data on the process and impact of the project in selected
parishes/villages in Kitgum District. It also involved review of relevant project documents like the overall
project statistics and official statistics.
2.2 Study area and Population:
The study was conducted in the four parishes1 where the project was implemented. The study population
included Women of Child Bearing Age (WCA) numbering some 2,436 women and girls, VHTs and TBAs
engaged in the project implementation. The study also interviewed various other stakeholders such as the
project staff, the project donor, the project consultant and members of the RCK management committee.
The women and girls mentioned above constituted the projects direct beneficiaries whereas the other
stakeholders provided the project with all kinds of support ranging from financial aid, oversight and
implementation.
2.3 Sample Size
The LQAS sampling technique was applied to ensure that the minimum quality standards of the data
collected were met. A sample size of 83 Women/Girls of Child Bearing Age whereby each of four parishes
were set to provide at least 20 of these respondents. Given the study population size (2,436) a standard
sample size of 332 was arrived at on the basis of 95% confidence level and +/- 10% confidence interval.
Since there was four study areas/parishes (referred to as lots according LQAS) the standard sample size
was divided by four to obtain the actual LQAS sample size of 83 respondents which was finally used. Once
at the study areas, the enumerators applied non-probability/purposive technique to identify suitable
respondents to realize the calculated sample size for WCA. Purposive sampling is not the best alternative
out there (due to non-existent/inadequate sampling frame) but it served the purpose well enough since
the respondents were fairly homogenous.
2.4 Data Collection Methods
Primary data were collected from the respondents by Field Research Assistants and the consultants using
specific sets of tools. FGD and Key Informant Interview guides were used for collecting qualitative data.
Photo documentation and field observation of the implemented activities and changes in the behavior of
the target groups like use of WASH facilities2 stemming from the projects intervention was applied.
The FGD guide was applied for qualitative data collection with VHTs and TBAs who were trained by the
project and participated actively in its implementation. A varied KII guide was used to collect qualitative

1
2

Pajong-Mucwini, Lamit-Akwang, Okuti and Akurumo in Orom sub-county


Latrines, rubbish pits and utensil drying stands etc.

11

END TERM EVALUATION REPORT


July 22, 2014

data from various key informants of the project including the project staff, members of the Clubs
management committee, the project donor, government focal person and the project consultant.
2.5 WCA Interviews
A questionnaire was used to collect quantitative/qualitative primary data from WCA by the field research
assistants/enumerators. This tool covered issues regarding the project design, implementation and
outcomes to which the respondents competently provided responses.
The research assistants were inducted on the questionnaire through brainstorming and role plays. The RAs
were also prompted to administer the tool among themselves to clarify any lingering inconsistencies.
2.6 Focus Group Discussions (FGDs)
Focus Group Discussions (FGDs) were held with the Village Health Teams (VHTs) and Traditional Birth
Attendants (TBAs) in the projects target areas. The discussions focused mostly on the implementation of
the project including the roles of these health workers within the project. Three FGDs were conducted in
Lamit, Pajong and Akurumo with an average of eight (8) participants for each session. The FGDs were
conducted by the consultants themselves.
2.7 Key Informant Interviews (KII)
KIIs were addressed to Clubs Management Committee, the project staff, the Local Government Focal
Person, and the respective sub-county leaders and health center personnel. This particular interview was
intended to collect data on the project design, implementation and impact from a vantage point of view of
the respective offices.
2.8 Data Management, Analysis and report writing
Data was entered directly into the computer using Epi data software. Data entry was done daily from
commencement of data collection. The entered data were then synchronized by the consultants for
analysis. After entry and cleaning, validated data were then exported to SPSS 21.0 and analysis done. Univariate analysis of the data was applied to the data producing relevant descriptive statistics. The data were
disaggregated according to project activity, demographic characteristics and target areas to get specific
details on performance of the project. The Atlas software was used for the analysis of data from FGDs and
other qualitative data.
2.9 Quality control
This was ensured right from the design of the data collection tools through to data collection, data coding,
analysis and interpretation. The consultants recruited and inducted qualified field data
collectors/enumerators. The Lot Quality Assurance Sampling LQAS that was used for the selection of
participants for the beneficiary interviews minimized bias and ensured a representative sample size of the
target population.
12

END TERM EVALUATION REPORT


July 22, 2014

The study in the design of the relevant tools borrowed from the health industry scoring standards
including the WHO guidelines on hygienic practices.
The tools were reviewed by peers including MCH-Care practitioners from agencies working on the same to
ensure that they address the key issues in MCH-care. The tools were pre-tested for feasibility and redesigned where necessary to suit the circumstances identified.
The draft evaluation report was validated by all the relevant stakeholders and reviewed by peers before a
final copy was written.
2.10
Ethical considerations
Confidentiality was guaranteed by concealing the identity of the respondents such as not recording their
names on the tools. A cover letter was written and shared with respondents to seek their informed
consent to participate in the exercise before it commenced.
The evaluation team ensured sensitivity to local cultural and social issues which might have jeopardized
the exercise. For example young women and girls who participated in the exercise were talked to in open
places (outside the ear-shot of onlookers) to avoid antagonizing their male guardians.
The report was shared with stakeholders who participated in the exercise to reassure them that it was a
true reflection of the information they provided.

13

END TERM EVALUATION REPORT


July 22, 2014

3. CHAPTER III
3.1 FINDINGS AND ANALYSIS
3.2 Demographic information
Most of the WCA-respondents were within the age 20-29 years (43/57% respondents) and 30-39 years
(28/37% respondents). Only five respondents were teenage girls of child bearing age. Each of the four
project sites/parishes across the three sub-counties3 in Kitgum district provided a fairly equal number of
respondents. The respondents came from a sum total of fifteen villages from within the four target
parishes.
A significant number 50% of the WCA-respondents never had any formal education and a fairly large
number 42% studied only up to the primary level of education. Less than 10% attained more than primary
level of education.
Over 10% of the women interviewed had produced more than eight children. The rest had between 1-7
biological children.
3.3 THE PROJECT DESIGN
3.3.1 Womens participation/ involvement in the design and the realization of the project
More than a third of the beneficiaries acknowledged that they were consulted at the design of the project.
This according to them was done through community meetings organized by their local leaders in
collaboration with the local health officials and members of the Rotary Club of Kitgum.
Most of the target group interviewed intimated that they were not engaged by the implementation team
to improve the project implementation process.

3.3.2 Effectiveness of the project according to various stakeholders


More than three quarters of Women and Girls of Child Bearing Age interviewed thought that the project
addressed the specific concerns pertaining to mother and child health in the target areas.
The project satisfied the pressing health needs of the target population according to the WCA interviewed.
They pointed out that there was need for vaccination of children, counselling on family planning, access to
VCT services, and attendance of ANC visits by pregnant mothers which the project specifically addressed.
The projects Local Government focal person observed that the project was holistic in its approach to
mother and child health covering key components like ANC, immunization, family planning and referral
according to government policy. She also noted that despite its mandate, the project provided emergency
services to all and normal services to PWDs and the elderly. A VHT member in Okuti parish, Orom subcounty qualified these claims in the following statements;
3

Orom (Okuti and Akurumo), Mucwini (Pajong) and Akwang (Lamit/Tumangu)

14

END TERM EVALUATION REPORT


July 22, 2014

Lokom and Lachom are hard to reach areas and the implementing team penetrates up to there. You
find children of up to five years of age not immunized yet and it is through the project that we have
started reaching out to such children. There are very many patients in those areas and the project really
helped them. Other activities like ANC, PMTCT for all mothers who cannot come here, those mothers
are really glad to have the RCK operating here.
A VHT member in Pajong, Lagot Mucwini sub-county also noted;
The biggest benefit that RCK brought was accessibility to health services i.e. before they came, women
used to go for ANC up to Mucwini, and even for vaccination they had to come up to HC here but now all
this has stopped because RCK now goes to them, even those who used to complain of distance and
those who were lazy, that excuse is no longer there.
Another VHT member from Akurumo parish who participated in an FGD conducted there opined that the
maternal and child mortality rates have drastically reduced with the intervention of the project. She noted;
Prior to the project implementation the neighboring villages here experienced frequent mother and
child death resulting from risky deliveries and lack of vaccination respectively. But as I speak now this
has tremendously reduced because pregnant mothers are promptly counseled through repeated ANC
visits on what to do to ensure their safety and that of their babies before and after deliveries
The VHTs talked to in the study also noted how positively the project has changed the health seeking
behaviour of WCA. A VHT member in Tumangu/Lamit parish echoed this view in the following words;
Today with the help of the project, women are more aware about what to do in order to protect their
health and that of their babies. Mothers strictly follow the vaccination schedules to ensure that their
children get all the recommended vaccines. They also pay early and regular ante natal visits compared
to before the intervention
However the project did not attain its target of ensuring that 50% of all deliveries were carried out by a
qualified health worker at a health facility. By April 2014 the projects target area recorded only an average
of 20% level of professionally attended deliveries4.
3.4 IMPLEMENTATION
3.4.1 Implementation strategies and procedures
The project management team developed a work plan in consultation with the clients, government
agencies and other stakeholders to ensure effectiveness5. The beneficiaries therefore knew before hand
the time and place (designated locations) of arrival of the project treatment team.

Official District Health Statistic ANNEX I

15

END TERM EVALUATION REPORT


July 22, 2014

The Project Coordinator pinned on her office wall a chart indicating all the activities to be implemented
under the project for specific periods of time.
The relationship among the implementing team was great. The staff members were motivated, disciplined
and professional in doing their job. The donor representative noted;
Florence (the PC) trained a cohesive and dedicated team which showed up on time for work, had open
communication with her staff, and promoted trust and loyalty. She is an excellent leader. The midwife
Alice was an excellent role model as well, with a good work ethic. Job, the bookkeeper was bright and I
believe honest.
3.4.2 Attitude of the local people towards the project
Most 68/91% of the WCA interviewed were aware of the MCH project by the RCK, the rest had no idea.
Almost all 85% of those who knew about the project were interested in it. 81% of those WCA who showed
interest in the project participated in it in one way or the other. Their participation in order of importance
involved receiving treatment, health education, immunization, and ANC among others.

Almost all the Key Informants interviewed indicated that they were involved in the MCH project in
different ways. For example the village leaders (LC Is) indicated that they were involved in mobilizing the
community to sweep and organize the venue for the treatment sites and to look for seats for the health
workers when they go for outreach and encouraging the community to send the women and children for
treatment. The health facility staff also indicated several ways in which they were involved in the MCH
project. A Health Assistant in one of the local HC II noted;
I go with them to the field and perform the duty of records. I conduct tallying like number of
immunization, record and register out patients. I also record child immunization card, date of return
visits and many other things in immunization card. At times I do RDT6 as well as mobilization. Other
staff members handle immunization, ANC, checking children under five and sometimes Adults, relevant
of complicated cases. They pick us and we go and check patients and we also immunize children.
3.4.3 Participation gaps noted in the project by some stakeholders
The beneficiaries thought they could have participated in the project more by getting a platform within the
project to share their opinions with the implementing team. They also highlighted the idea of having
adequate access to information as another way by which they could have been better involved in the
project.

Visits/treatment days were scheduled for the various project sites on a weekly basis; Pajong on Tuesday, Akurumo on Wednesday,
Lamit on Thursday and Okuti on Friday
6
Rapid Diagnostic Tests

16

END TERM EVALUATION REPORT


July 22, 2014

Most key informants interviewed expressed the opinion that they were adequately involved in the MCH
project because they were engaged in the services that they could offer. A VHT from Akurumo parish,
Orom sub-county noted;
I think the involvement is already adequate because we have always worked as a team. They have
helped us a lot because this is a hard to reach area. They were also the ones who give us gas cylinder
for the fridge, sometimes when we run out of vaccines and since they come here weekly they bring
some to us from town. We also use their data from the field as part of our outreach activities data.
However some of the Sub County and parish leaders expressed mixed feelings about their involvement in
the MCH project and its core activities and suggested not being adequately engaged. A parish leader who
took part in the interviews noted;
I think RCK feared to adequately involve the parish chiefs in their activities because of financial issues,
they imagined we would be expensive and so excluded us from their activities completely.
3.4.4 The project monitoring
To their credit, the designers of the project put together the relevant project documents one would need
to monitor a project. There was the projects logical frame highlighting key indicators, the projects budget
outlining the different costs and the projects work plan among others. Apparently the Project Coordinator
indicated to the evaluation team that a monitoring tool (checklist) was used by the steering committee
and other stakeholders to monitor the project implementation.
The donor was adequately represented in monitoring the projects implementation which involved their
representative travelling with the field team to most of the projects locations.
However reporting on the progress of the project covered strictly the core aspects of the project i.e.
expected outputs and outcomes. The reports could have covered intervening factors during
implementation, status of the budget and other broader issues on mother and child health in the district
among others.
3.4.5 Support that WCA received from the project
56/78% of those interviewed received at least some form of support from the MCH project, 16% did not.
The support included treatment for minor ailments (38%), receipt of Primary Health Care materials like
mama-kits and immunization against TT for mothers and the five killer diseases for children under five
(22%), receipt of contraceptives and access to ANC and basic medical tests. Mentioned was also made of
access to ambulance and counseling services provided by the project.

17

END TERM EVALUATION REPORT


July 22, 2014

NUMBER OF CHILDREN VACCINATED

600

RATE OF IMMUNIZATION DURING THE PROJECT IN THE TARGET AREAS

500

BCG
DPT-HepB+Hib1

400

DPT-HepB+Hib2
DPT-HepB+Hib3

300

Measles
Polio "0"

200

Polio 1
Polio 2

100

Polio 3
Vitamin A < 5yrs.

Deworming < 5 yrs.


PROJECT DURATION 2013/14

Figure 1Source: Overall project statistics Annex II

The rate of immunization remained low for most of the project period except for de-worming and vitamin
A which started high, dipped for some 5 months and then rose again to record levels. Vaccination for the
six killer diseases did not exceed 20 children for each of the 15 project months. Crucially the project did
not reach the 85% vaccination target for children eligible for DPT-HepB+Hib1 but vaccinated only 9% by
June 2014.
3.5 RELATIONSHIP WITH STAKEHOLDERS
3.5.1 Government
The project had a good relationship with relevant government agencies like the DHO, the political
leadership and the local health centres. The government assigned to the project one of its senior nursing
officer to ensure that the projects intervention addresses the districts health priorities regarding MCH
and collaborated with RCK Kitgum during the entire process of project design and recruitment of staff. A
member of RCK management committee noted;
They (government) were very supportive, during the initial planning we planned together as a team
even the project design we did together. We also did the interview for staff recruitment t together, the
CAO, the DSC, the DHO and even the traffic police sent representatives when we were recruiting the
driver and the other staff as well.

18

END TERM EVALUATION REPORT


July 22, 2014

The project was offered a well furnished office space at the district health department as well as two
nursing assistants/midwives. The district paid the bill for office utilities such as electricity and water for the
entire project period and helped to build a solid relationship with Rotary club international. The clubs
treasurer noted;
The DHO and the LC5 also wrote to the donor an acknowledgement letter that they received the
money in the Bank Account of Rotary Club of Kitgum and also that they have received the vehicle
bought which was a very good gesture of cooperation.
The project worked in collaboration with the relevant district health staff in the target areas whereby it
provided these personnel the necessary facilitation. The projects Local Government Focal person noted;
The project management gave allowances to the district health staff it engaged in some of its
activities hence motivating them to dedicate themselves to the project
The district also provided the project with drugs and antigens needed during some of its field visits. One of
the projects Nursing Assistant noted;
When we were procuring drugs from the NMS, the CAO gave us the Tin number for the district because
NMS does not sell drugs to anyone.
The local government further facilitated the project to secure an ambulance for its operations. The clubs
treasurer pointed out;
When we were buying the vehicle, we used the local government and we were exempted from paying
tax and we saved over 52 million Uganda shillings. The local government also helped us to register the
car as an ambulance further helping us to save a lot of money.
3.5.2 The donor
The donor was closely involved with the project right from the design through to implementation. The
donor representative from Mount Airy Rotary Club expressed the functional relationship she had with the
Kitgum team in the following terms;
Rudolf Schachner, myself and Simon Lawoko, past President and Club Foundation Chair for Kitgum
Rotary discussed various possibilities for projects and presented them to the Rotary Club Kitgum which
selected the Mother/Child Mobile Clinic project
The donor representative also revealed how they fully played their role as an important stakeholder of the
project to ensure its success. She noted;

19

END TERM EVALUATION REPORT


July 22, 2014

I filled the Rotary Application form and raised the needed 30,000, which our District matched, as did
the Foundation. Mr. Sunday Abwola, the project point person and Past President of Rotary Kitgum and
I corresponded by email on various hiring and payment issues
However on one occasion the implementing team crucially omitted the donors opinion on the need to
divert funds within the project.
3.5.3 The local health structures
The project worked with the existing health structure including the local health centre staff, VHTs and
TBAs. These health personnel helped the project implementing team in vaccination, dispensing medicine,
counselling and health education among others. One of the projects Nursing Assistants noted;
The local health facilities and personnel have been very supportive of our work, we normally notify the
VHTs of our coming so they can mobilize the community in time. They also willingly came with us for
the outreach program in the community. I do not think we could have realized the project outcomes if it
were not for them
3.5.4 The Management Committee-MC of RCK
The Project Coordinator noted how supportive the management committee had been during the course of
the projects implementation. She underlined the MCs willingness to provide them the necessary
autonomy at the same time offering support supervision both at office and in the field, as well as giving
feedback on their periodic monthly reports. She intimated;
The Management Committee has been so reliable, they responded fast to our calls ensuring that
activity implementation goes on smoothly
A Nursing Assistant also noted;
Most of the committee members were committed because when we make a work plan we follow it
through. What I like most is that sometimes members surrendered their own vehicles and we would use
them to go to the field to conduct our monitoring activities.
However it was also indicated that the committee did not adequately execute all of its oversight roles for
example in monitoring field activities. A committee member pointed out;
May be we did not support them enough in one way or the other, we were supposed to have a
monthly support visit but we turned it to quarterly instead. You know we are a loose group like
Teachers, bankers, business men and because of that we do not have much time to go about all this
activities but at least we managed to do it quarterly.
Staff appraisal was also not well followed through by the Management Committee. An MC member noted;
20

END TERM EVALUATION REPORT


July 22, 2014

The other thing was on the staff appraisal. In the first year we failed to do this, we were supposed to
receive appraisal from the Project Coordinator of the lower staff which she did in the second year and
she gave us a report. Then the PC who was supposed to be appraised by the Rotarians was never
appraised. She was later appraised by the consultant but we never got the report.

3.6 Challenges faced during the project implementation


The target group for the most part did not experience any serious challenge during the implementation of
the project safe for lapses in time keeping by the treatment team, limited access to the services by adults
(especially adult males), limited drugs, and long distances to the treatment centers.
The Project Coordinator (a Registered Nurse, with over twenty years of experience) indicated that the
staffing for the project was rather low as they had to do several assignments including consultation, clinical
work, immunization and dispensing of drugs every other treatment day.
The PCs view resonated with those of the projects clients on drug shortages. She noted;
Sometimes during implementation we could not offer patients the drugs they needed after diagnosis
and prescription which was rather frustrating for all those involved
At the same time, she lauded the indefatigable district offices and relevant personnel who came to the aid
of the project in this regard from time to time.
The Technical staff and the steering committee also cited some challenges faced during the implementation of
the program. One of the project staff noted;

We nearly gave up going back to certain areas because mobilization was very poor. You go there and
meet no body which is quite a waste of resources. When the team brings us the statistics from the field,
areas like Pajong had zero attendance twice. We then moved fast and held stakeholders meetings
which made us realize it was as a result of misinformation because the community thought we were
only doing immunization but when we clarified then they started coming in big numbers.
The project also encountered some political challenges as well as conflicting with the local health priorities
in Lamit (one of its target areas) where there was an ongoing epidemic of the nodding syndrome disease.
A key informant from the area noted;
In other areas like Tumangu there was political interference because their priority was in managing
nodding syndrome so they refused to make a shelter for us at first. Then when we went and talked to
them they realized our work was also important.
The VHT for their part noted inadequate facilitation as a major challenge they experienced during the
project implementation. This included limited operational gears (transport means/bicycles, gumboots,
21

END TERM EVALUATION REPORT


July 22, 2014

torches, raincoats, and umbrella), low stipends and little or no refreshments on treatment days, though
they conceded that the Club provided them with eight pieces of soap as token of appreciation on a regular
basis. A VHT participant in an FGD in Akurumo noted;
During rainy seasons the mud in this area is at knee level which makes our operation especially during
emergency at night quite nightmarish. It would have been quite helpful if the Club considered providing
us with gumboots, torches, umbrellas and rain coats for operations of this nature
Some of the planned activities were not fully implemented due to one reason or another. An important
stakeholder of the project pointed out the low level of implementation of planned seminars for local
stakeholders in MCH in service training. She noted;
The budget for the Project Manager in Germany was high. He did not complete the 4 Seminars for
local stakeholders in MCH in service training for which 2920 was allocated, but completed one only. He
said that he was going to do the other three in May, a month before the project ended. I expected the
seminars to be spread out over the length of the project so they could impact the success of the
project.
Some stakeholders also feared that poor timing of some of the project activities could have diminished
their impact for the project. One of the project partners noted;
The capacity building training of TBAs in 3-5 day workshops, budget 4672 USD, took place way too late
-over half-way through the project, so the effect was diluted.
The project also faced competition with other NGOs implementing similar projects in the area. In Pajong
parish, Mucwini sub-county, the evaluation team witnessed Marie stopes (an NGO) providing reproductive
health services to the same target beneficiaries. The funding partner representative qualified this claim in
the following words;
The numbers served in the areas with poor roads, and the competing NGO were low. When the team
had holidays, the villagers were not served. This results in the villagers not being certain when to
attend the clinics.

3.7 PROJECT PERFORMANCE AND IMPACTS


3.7.1 Access to health services for women
More than three quarters of women asked asserted that the coming of the project resulted into significant
increase in access to health services by mothers and children. A lesser number 21% thought the project did
not bring much change in access to health services by mothers and children in the area. A woman
respondent from Pajong parish, Lagot A village in Mucwini sub-county noted;
22

END TERM EVALUATION REPORT


July 22, 2014

To a large extent most women now go to the Health Center except those who are really unable but
also those ones endeavor to go to HC after delivery.
A VHT member highlighted the gradual increase in the turnout of women on treatment days in the
following words;
I think the attendance increases by the week. When we first started you would only see 10 patients in
a day but right now you can see for yourself. In the past children would not even be vaccinated, they did
not value vaccination or ANC or even delivering at H/C but the number has increased a lot.

The intervention of the project has led to a remarkable increase in access to health services for mothers
and children according to more than half of the women interviewed. A fifth of the women interviewed also
thought the health status of mothers and their children improved as a consequence of the project. A
significant number also opined that womens attitude towards regular ANC visits has improved overtime.
600

TOP TEN CAUSES OF MORBIDITY IN THE PROJECT'S TARGET AREA


500

REPORTED CASES

MALARIA
400

ARTI
INTESTINAL WORMS
ACUTE DIARRHOEA

300

EYE INFECTION
SKIN DISEASES

200

SEVERE MALNUTRITION
DYSENTRY

100

TRAUMA
PNEUMONIA
0

DURATION OF THE PROJECT 2013/14


Figure 2 Source: Overall project statistics ANNEX II

The chart above provides a general outlook on the trend of morbidity for mothers and children in the
project area. It indicates that the overall level of morbidity by common diseases steadily declined during
the project period especially for intestinal worms, malaria and ARTI (Acute Respiratory Tract Infection).
23

END TERM EVALUATION REPORT


July 22, 2014
70

KEY INDICATORS FOR MOTHER AND CHILD HEALTH IN THE PROJECT AREAS

ATTENDANCE RATES

60
50
ANC 1

40

ANC 4
30

ANC re-attendance

20

Family planning
IPT 1

10

IPT 2
01-Apr

01-Mar

01-Feb

01-Jan

01-Dec

01-Nov

01-Oct

01-Sep

01-Aug

01-Jul

01-Jun

01-May

01-Apr

PROJECT DURATION 2013/14

Figure 3 Overall project statistics ANNEX II

The graph above shows a general rise in the health seeking behavior of women in the project target areas.
ANC re-attendance particularly skyrocketed during the project period which demonstrates the effect the
project had on the attitude of the target group.
The Local Government project focal person reechoed the above situation asserting;
Before the project was implemented, pregnant womens attitude toward attendance of ANC was very
low due to long distance from the nearest health facility but this has markedly improved with the
coming of the project
3.7.2 State of the local referral system
About three quarters of the respondents expressed awareness of an existing referral system in their
communities. This according to them involved the use of ambulance, hiring of Boda-boda by caregivers
and writing referral letters by the VHTs among others.
The state of roads was commented on by the projects government focal person as a serious draw back on
the existing referral system. She noted;
KDLG is trying its best to achieve MDG targets 4&5 for maternal and child health but is handicapped
by poor infrastructure such as telecommunication and roads which makes referral of pregnant mothers
in hard to reach areas to deliver at the health center nearly impossible

24

END TERM EVALUATION REPORT


July 22, 2014

Setting up a health centre nearer to where its clients are settled, building motorable access roads, and
establishing and ambulance service came out strong as some of the ways of enhancing the health seeking
behaviour among women at risk and emergency. Health education was also considered by the
respondents to be effective in getting women at risk and emergency to seek health care. Others
recommended making the existing health facilities more reliable and building a strong referral network to
encourage the above category of women to seek medical help.
70
60
50

TT VACCINATION FOR
NON PREGNANT WOMEN

40
30

TT VACCINATION FOR
PREGNANT MOTHERS
DURING THE PROJECT

30

TT 1

25

TT 2

20

TT 3

20

35

TT 1
TT 2

15

TT 3

10

01-Apr

01-Feb

01-Dec

01-Oct

01-Aug

01-Jun

01-Apr

TT 5

01-Apr

01-Feb

TT 5
01-Dec

0
01-Oct

TT 4

01-Aug

01-Jun

TT 4
01-Apr

10

The two charts above show that at the start of the project both pregnant and non-pregnant women had a
more positive attitude towards TT vaccination. A steady decline was recorded for both categories
plummeting to rock bottom mid-way the project. Thereafter a steady positive change was noted in
womens attitudes towards the end of the project.

NUMBER TESTED

PREGNANT WOMEN TESTED ON HIV IN THE PROJECT AREAS


40
35
30
25
20
15
10
5
0

THE PROJECT DURATION 2013/14


Figure 4 Source: Overall project statistics ANNEX II

The chart above also represents a positive improvement in the attitude of women towards healthy life
choices like PMCT in the above case.

25

END TERM EVALUATION REPORT


July 22, 2014

3.7.3 Hygiene and disease prevention


Most of the mothers in the target areas seemed to have received health education on hygiene and disease
prevention under the project as indicated by 81% of those interviewed.
The key to good personal health according to 40% of the WCA interviewed was having and properly using
the main WASH facilities i.e. pit latrine, rubbish pit, and utensil stand among others. A significant number
22% of those asked also thought personal hygiene and grooming were key ingredients to good personal
health.
In order to live in a clean and healthy environment the respondents thought it would be realized by having
the relevant WASH facilities, cleaning ones compound, proper use of the WASH facilities and cleaning
water holding containers among others.
To ensure good personal health the WCA asked intimated that one ought to in order of importance wear
clean clothes, bathe frequently, cut their finger nails, wash hands often, exercise, eat balanced diet, live
within a clean compound and drink clean water among others.
3.7.4 Attitude towards family planning
Three quarters of the WCA interviewed were sensitized about family planning. The key message that they
got from the sensitization included child spacing, use of contraceptives and the advantages of Family
Planning among others.
Most of the WCA interviewed indicated that to control pregnancy they would in order of importance use
pills, implants, and condoms among others. 7% of the women interviewed did not know what they would
do to control pregnancy. Another 7% interesting thought they would abstain during their menstruation
period to avoid getting pregnant.
Varied opinions were put across regarding family planning by the WCA interviewed; generally they thought
the practice is good for the health of mother and child, and for the economic well being of the family.
Some thought their husbands should be excluded from the arrangement because they would most likely
refuse to comply. Others expressed fears for the side effect of Family Planning especially the prospect of
becoming barren. The women interviewed noted that most men and the community elders are opposed to
practice citing that its against procreation which they consider a duty of man and women in a marriage.
3.7.5 Current use of family planning methods among WCA
More than half of the women questioned were using some kind of family planning method/contraceptive.
Significantly 41% did not use any family planning method. The reasons why some women would not use
any family planning method range from fear of side effects, lack of awareness, their husbands refusal, and
dislike for the practice among others.
3.7.6 Womens attitude towards ANC1 to ANC3 visits.
26

END TERM EVALUATION REPORT


July 22, 2014

All the women interviewed were pro antenatal visit citing numerous benefits among them protecting the
health of the mother and child, handling complicated pregnancies, and PMCT services to mentioned but a
few.
One VHT member from Orom subcounty, Okuti parish noted;
Yes in a way that the mothers down in the village started seeing the importance of ANC and family
planning. They started getting cards, they started coming in large numbers for revisits. If you compare
with the previous years, the numbers just keep increasing. In fact Locom and Lokom have biggest the
numbers for return dates than any other villages.
3.7.7 WCA attitude towards giving birth at the Health Centre
The study revealed that most women in the target area would pay antennal visits to the local health unit
when pregnant. The women interviewed cited sudden labor pain, long distance to the nearest health
facility and poor transport means among others as the reasons for home deliveries. The women asked did
not consider home delivery as the next best alternative but asserted that it only happened due to
unavoidable circumstances.
The women interviewed expressed a good level of appreciation of the merits of delivering at a health
facility. The advantages of Health Centre delivery according to them included limited chances of infection,
attendance by qualified and competent personnel, access to relevant materials like the mama-kits, free
counselling, and fast and quality services which reduces excessive pain.
3.7.8 The capacity of VHTs and TBAs to perform health education
VHTs trained and mentored by the project engaged in health education for the target community as
expected. The WCA 69% interviewed acknowledged that they attended health sensitization meetings
conducted by VHTs.
84% of the women who attended the health education sessions organized by VHTs seemed satisfied by
their capacity to deliver the sensitization contents. The VHT members interviewed also demonstrated their
competence to the evaluation team on how they conducted health education sessions in their
communities. A VHT member in at the FGD conducted in Akurumo parish noted;
A lot has improved regarding our work for mothers and children; we now handle them in a more
professional way compared to before, we also know how to read the symptoms and signs of common
diseases that afflict mothers and children in the area
The Key Informants interviewed at the health facilities expressed mixed feelings about the work and
commitment of VHTs. The in-charge of Akilok HC II positively noted;
They do it (their work) well because they have taken long and they are always within the community
and they are continuously trained by various agencies. Given any new disease outbreak they always get
trained so I think they are competent enough

27

END TERM EVALUATION REPORT


July 22, 2014

Others expressed reservation on the commitment and work of the VHTs. For example the Akilok in-charge
noted;
Considering that this is a rainy season many of the VHTs find it difficult to juggle between their private
work and the work of Rotary Club so normally they come late.
Some VHT members were not competent enough to deliver the services expected of them. A HC staff in
Akilok HC II, Okuti parish pointed out;
Sometimes the VHTs do not know how to administer certain drugs like vaccines whereby some of the
children get swollen arms and end up being taken to the hospital so this has to improve. There are
some VHTs who are more active than others so to me I think more effort should be put on the active
ones so they can reach more people
3.8 The level of sustainability/self-reliance achieved by the project
A third of the women interviewed thought the project initiatives would not be sustained after the closure
of the project. The remaining two thirds thought the project initiatives would be sustained or were not
sure altogether. The donor representative expressed the fears he observed in the beneficiaries should the
project leave in the following words;
The villagers themselves are quite attached to the clinic and do not want it to end.
A significant percentage 29% of the women/girls of child bearing age were of the opinion that continuity of
the projects initiatives could only be ensured by extending the timeframe of the project a little forward.
Others suggested that the government should set up a health facility in the respective areas which would
offer similar services.
When the WCA were asked about what they would do to sustain access to important supplies and
materials like the mama-kits and mosquito nets after the project, they responded that the project has to
continue for them to access these things or they would have to turn to their local health centers or
purchase them. Others mooted the idea for proper maintenance of some of the re-usable materials in this
package as a way out for them among others.
However some key informants at the health facilities noted that they would use the government PHC
funds to maintain some of the equipments that were donated to them by rotary club like the gas cylinders.
A health center staff asked on this matter noted;
We have resources like the PHC funds that we can use for that and the district also helps to refill the
gas cylinder. We shall still use the PHC resources or we improvise with what the district can offer. Like
for gas cylinder we shall resort to using charcoal stove

28

END TERM EVALUATION REPORT


July 22, 2014

The projects Local Government focal person noted that KDLG will sustain the projects initiatives by reabsorbing the projects personnel especially the midwives into its mainstream structure, ensuring the
districts yearly (FY) health planning caters for these hard to reach areas/project locations. She also
pledged that the relevant government agencies would provide post project monitoring of the projects
locations.
Evidently the government was setting up health facilities in the areas where RCK implemented the MCH
project particularly in Tumangu/Lamit and Akurumo where HC IIs were under construction. The Treasurer
of RCK steering committee noted;
In areas where we have worked i.e. Akuromo and Tumangu the government has now built health
centers, and also recruited staff to work in those health centers including one of our midwives to work
there full time
The District Local Government also indicated readiness to meet some of the operation costs of RCK
especially on their ambulance services. The Clubs Treasurer intimated;
They have included fuel for our ambulance in their budget for this financial year, they already have
four ambulances that they budget for so plus this one there are now five ambulances budgeted for by
the district this financial year.

29

END TERM EVALUATION REPORT


July 22, 2014

4. CHAPTER IV
4.1 CONCLUSION AND RECOMMENDATIONS
4.2 Performance on targets
4.2.1 Project objectives
4.2.1.1 The projects target areas registered 32% safe deliveries (at HC) against the set project target of
50%. This was a commendable accomplishment on the part of the project as it achieved more than
half of its target. Regrettably the baseline data for this target at the start of the project was not
available to the evaluation team though the needs assessment conducted prior to the intervention
presented a rather needy situation.
4.2.1.2 Up to 40% ANC re-attendance was recorded during the project period against the project target of
65%. This by all means is a good level of performance well over fifty percent of the project target.
Though this statistic was not specifically for all the stages of ANC visits but only for re-attendance it
still remain a good measure of this target.
4.2.1.3 At least three quarters of the local population in the projects target area were aware of the
possibility of a referral system for woman at risk and emergencies. This implies a commendable
level of achievement in creating awareness on the same in the local community.
4.2.2 Result I
4.2.2.1 The target parishes/treatment centers were visited once a week or four times a month unless
otherwise which demonstrates an excellent performance against the set target of two visits per
month to the project locations. The project also covered far more than the planned sixteen (16)
villages but 39-40 villages. This can be put at more than 200% coverage which was a stunning
achievement by the project.
4.2.2.2 A remarkably low percentage 9% (317 children <5 YR) for DPT3 vaccination was registered by the
project for its target population against the set target of 85% (3,491) by June 2014. However its
important to note that the government has a rolling vaccination schedule which mostly likely
served the same clients that the project intended to serve. A more accurate picture would
therefore include the number of children vaccinated by government health workers within the
same period as well.
4.2.2.3 The number of WCA aware of the various family planning method was found (65%) by the study to
be well over the projects target of 30%. Despite this finding, the study noted some challenges in
the practice of these family planning methods by most couples in the target communities.
4.2.3 Result II
4.2.3.1 The VHTs recruited and trained by the project made little effort to organize education units for
mothers in the rural areas of Kitgum. They engaged in this activity more seriously only in the
presence of the project staff during field visits.

30

END TERM EVALUATION REPORT


July 22, 2014

4.2.4 The project design


4.2.4.1 RCK consulted with the target community to establish the exact challenges of mother and child
health that they faced. The club did this through community meetings and a needs assessment.
This kind of initiative at the formulation of a project is recommended to ensure the effectiveness of
a given intervention.
4.2.4.2 The project addressed the specific needs of the target group/communities in as far as mother and
child health is concerned. This is quite reassuring of the possible positive long term outcomes for
mother and child health that the intervention promises.
4.2.4.3 The project in addition to its mandate reached out to other groups including emergency cases, the
elderly and PWDs in desperate need of medical services. This demonstrates the flexibility exercised
within the project to ensure that it addresses emerging issues related to its mandate.
4.2.4.4 There has been a noticeable positive change in the health seeking behavior of WCA in the target
areas of the project implying an improvement in the health situation of the mother and child.
4.2.5 The project implementation
4.2.5.1 To a large extent the implementation team was transparent in its dealings during the project
implementation especially by involving most of the key stakeholders in the process. The project
implementing team was disciplined, motivated and professional under the competent leadership of
a seasoned nursing officer (PC).
4.2.5.2 The target beneficiaries i.e. WCA were fully aware of the project and actively participated in it
especially by attending and receiving treatment/vaccination for themselves and their babies.
4.2.5.3 The project was well received and owned by the beneficiaries and their communities who
thoroughly utilized the services it offered.
4.2.5.4 Notably the project fully engaged the respective health workers like in-charges, health assistants
and VHTs in its areas of operation and at the district level. This ensured quality health service
delivery coming from the project as well as enhancing its chances for sustainability.
4.2.5.5 The activities that the project implemented met the expectations of the beneficiaries and other
stakeholders and largely fulfilled the promises of the project as outlined at its launch. This
underlines the trust that the Club has built in the community with the implementation of this
project.
4.2.5.6 Some planned activities were not fully implemented whereas another took so long to implement.
These discrepancies would certainly diminish the desired effect expected of the respective
activities.
4.2.5.7 The monitoring system was found to be wanting despite the availability of supporting documents
like the logical framework. This would deprive the various project stakeholders from continually
providing the right kinds of responses to challenges and opportunities that emerged during the
implementation.

31

END TERM EVALUATION REPORT


July 22, 2014

4.2.5.8 The internal control system for the project needed to be tightened so as to ensure timely and
effective communication between stakeholders regarding resource utilization among others.
4.2.5.9 Beneficiary opinion on the project implementation was not seriously sought on an ongoing basis
which deprived the project of valuable ideas to continuously tune itself to the needs of the target
communities.
4.2.5.10 Local leaders at the village level were more involved in the project implementation than their
sub-county level counterparts. This situation does not augur well for accountability within the
project and the necessary political support.
4.2.6 Relationship with stakeholders
The project enjoyed an excellent relationship with the government which involved sharing of personnel,
office space, medical supplies and procuring an ambulance for the project among others. This relationship
facilitated the achievement of the project goals a great deal.
The project could have done more to engage other partners involved in implementing similar interventions
in its target areas. This would have ensured even more efficiency in the delivery of its stated objectives.
4.2.7 Challenges
4.2.7.1 The project had to co-opt some personnel from the district health structure to supplement its
limited staff capacity (number). This posed a potential risk for the project as these government
functionaries are expected to be at their stations full time.
4.2.7.2 There was inadequate drug supply on some occasions during the project implementing teams field
trips/treatment days. Again the project had to rely on government to supplement its stock which
might have turned out not quite reliable.
4.2.7.3 The sub-county leaders in Akwang/lamit parish were less than impressed with the projects choice
of intervention as the apparently most feared cause of child morbidity (the nodding syndrome) did
not get the attention it deserved. This disparity in opinion between the sub-county leadership and
the project management sapped away at the opportunity for synergy.
4.2.7.4 The VHTs were not adequately motivated to secure their total commitment in the project. This
probably explains their reluctance to take initiative to further the projects cause like organizing
frequent education units for mothers.
4.2.7.5 Poor infrastructure in terms of communication and transport was a barrier in the project
implementation and will continue to jeopardize access to health services for mothers and children
even after the project.
4.2.8 Project performance and impact
4.2.8.1 Overall the project performed well in terms of addressing the problem of inaccessibility to vital
health services for the mother and child in hard to reach areas.
32

END TERM EVALUATION REPORT


July 22, 2014

4.2.8.2 The intervention resulted into visible positive outcomes in the health situation of mothers and
children. The rates of morbidity and mortality from common illnesses dropped markedly during the
project highlighting the success registered by the project.
4.2.8.3 The counseling and sensitization that the project offered through its health workers on hygiene,
family planning and antenatal care visits significantly on a positive note changed the health seeking
behavior of WCA in the project area.
4.2.8.4 The project revived the referral system in the target areas by building the capacity of the local
health service structure and offering ambulance service which will continue to operate in the
project areas long after the closure of the project.
4.2.8.5 Though most women are now aware and willing to practice various family planning methods, men
and the elderly are still reluctant and sometimes against the idea of FP. This calls for continued
effort to break conservatism with regards to procreation for the benefit of individual households
and the entire community.
4.2.8.6 Despite the sensitization of community members on the maintenance of both personal and
environment hygiene there appears to be a reluctance to seriously practice the awareness that has
been imparted in these communities implying a recurrence of already diminished common
illnesses.
4.2.8.7 WCA in the target areas now have adequate awareness of the benefits of HC deliveries and a
positive attitude to go with it. This is bound to cut back the rampant maternal and child mortality
that arise from poorly conducted deliveries.
4.2.9 The capacity of VHTs
The VHTs trained and mentored by the project are today better skilled and prepared to provide health
services for the mother and child. They have acquired both soft and hard skills in their domain of work
making them more resourceful and reliable to protect the health of the mother and child.
However there is still need for further training of VHTs to provide some basic health services that they are
mandated to carry out in their areas of operation.
4.2.10 The project sustainability
The project beneficiaries do not trust the government to carry forward the projects initiatives in the
manner that the RCK conducted it.
The beneficiaries will not be able on their own to sustain the supply of some of the materials they received
from the project like the mama-kit in the short run.
The relevant government agencies have the necessary resource and political will to carry out some of the
projects initiatives like the ambulance service for hard to reach areas.

33

END TERM EVALUATION REPORT


July 22, 2014

4.3 RECOMMENDATIONS, INSIGHTS AND LESSONS LEARNT.


4.3.1 The technical staff and the steering committee established that carrying out an integrated
approach to implementation of activities can produce excellent results as it was the case with this
project. The project offered a whole package for mother and child health making the intervention
quite effective and meaningful.
4.3.2 Having a good working relationship with key stakeholders is crucial for the success of a project.
Given the cordial relationship the project enjoyed with the relevant government offices, it was in
position to address so many of the challenges that it faced for better results.
4.3.3 Good collaboration with the local leadership and engaging the existing relevant structures like VHTs
and TBAs is crucial for the success of a project.
4.3.4 Concrete baseline data against which the project targets are set must be established (through a
thorough needs assessment exercise) and made accessible to all relevant stakeholders. This would
ensure effective monitoring and accountability among the projects stakeholders.
4.3.5 A project being implemented should also monitor and document the performance of other
actors/partners undertaking similar interventions in its target area/with its target beneficiaries.
This would enhance efficiency and maximize the expected project outcomes.
4.3.6 Support visits/follow-up and mentoring should be provided to trainees under every project so that
they are properly engaged in rolling out the skills and knowledge they gained for the benefit of the
community members.
4.3.7 Flexibility within a project is highly recommended as it would allow for unforeseen circumstances
and ensure that emerging needs are continually addressed within a project.
4.3.8 Adequate dialogue has to happen between stakeholders to ensure that they are on the same page
during project implementation. This would enhance collaboration, ownership of project outcomes
by stakeholders and project sustainability in the long run.
4.3.9 During the implementation of this project it was noted that building of trust and confidence among
beneficiaries was important for sustenance of a project outcomes and project ownership among
beneficiaries.
4.3.10 The suitability and capacity of the personnel hired to implement the project must be carefully
considered. This is to ensure that activities are implemented adequately and on time. Untimely and
inadequate implementation of planned activities would diminish their effects for the project.
4.3.11 It is important to make community participation a reality than just for its own sake. This would
ensure undivided support and commitment by the beneficiary community to the projects cause.
4.3.12 A proper monitoring plan or framework with clear baseline data, indicators, targets, responsible
persons, and timeframe among others is highly recommended for every project to measure
progress towards set objectives and goals.
4.3.13 A consumer/client feedback mechanism ought to be established within a project for timely and
appropriate response. This would enhance the effectiveness of a given intervention and ensure
that emerging challenges within the project are addressed on a continual basis.
34

END TERM EVALUATION REPORT


July 22, 2014

4.3.14 A stakeholder analysis and effective ways of engaging them should have been looked into at the
initiation of the project. This would promote collaboration and efficiency as one initiative builds on
the other.

35

APPENDICES
ANNEX I
Deliveries per month in each target Health Facility 2013/2014
2013

2014

Total

%
reached

Par/Scty

HF

Popn

50
% Target

Okuti
Parish
Orom
Sub
county

Akilok
HC II

212

106

10

14

12

96

91

Orom
HC III

1500

750

62

19

17

22

26

34

47

28

36

37

36

37

34

382

51

113

56.5

33

Non
Akuromo
functio
parish
nal HC
Lubalangit HC II
Lamit
Pajimo
Parish
HC III

target/ month April May June July Aug Sept Oct Nov Dec Jan Feb Mar April

0
146

73

29

40

Akwang
Pajimo
subcou
HC III
nty

850

425

35

29

33

30

25

19

35

32

23

35

36

36

348

82

Lagot
HC II +
Mucwini
n HC

113

57

46

81

121

57

60

56

59

57

78

94

95

88

61

57

934

64

Pajong
parish

2934

1467

100 72

END TERM EVALUATION REPORT


July 22, 2014

ANNEX II
Overall project statistics 2013/2014

13-Apr
ATTENDANCE 177

13-May
180

13-Jun
253

1-Apr
1-May
MALARIA
53
40
ARTI
65
101
INTESTINAL WORMS
29
31
ACUTE DIARRHOEA9
12
EYE INFECTION
9
19
SKIN DISEASES
7
8
SEVERE MALNUTRITION
0
0
DYSENTRY
2
0
TRAUMA
0
3
PNEUMONIA
0
0

1-Jun
81
148
34
23
19
8
0
1
4
1

1-Apr
ANC 1
26
ANC 4
7
ANC re-attendance
22
Family planning 0
IPT 1
24
IPT 2
8

OPD Attendance below <5 years


13-Jul
13-Aug
13-Sep
13-Oct 13-Nov
13-Dec
182
60
168
357
71
155
MORBIDITY RATE (TREATMENT) AND CAUSES
1-Jul
1-Aug
1-Sep
1-Oct
1-Nov
1-Dec
168
37
152
232
68
54
285
81
254
511
86
174
85
15
114
160
9
44
40
14
43
45
5
29
31
4
9
19
4
18
16
5
8
10
4
8
0
0
1
0
0
0
2
1
2
4
0
1
9
5
5
4
0
3
1
0
0
6
1
1

14-Jan
161

14-Feb
157

14-Mar
85

14-Apr
167

1-Jan
52
192
53
17
25
7
0
1
6
3

1-Feb
29
102
17
45
25
2
0
2
2
1

1-Mar
17
53
15
30
19
0
0
2
2
0

1-Apr
58
146
25
30
25
8
0
7
1
2

TABULAR PRESENTATION OF THE PERFORMANCE IN THE HEALTH SEEKING BEHAVIOR OF THE TARGET
1-May
1-Jun
1-Jul
1-Aug
1-Sep
1-Oct
1-Nov
1-Dec
1-Jan
1-Feb
10
13
32
6
20
7
5
14
34
45
5
8
11
4
8
3
7
5
9
22
29
24
33
16
24
22
18
55
61
65
9
11
4
2
9
8
7
10
20
9
13
13
33
5
20
8
5
9
35
34
11
11
14
8
15
12
12
27
35
35

1-Mar
9
3
23
11
9
11

1-Apr
48
12
46
53
40
22

37

END TERM EVALUATION REPORT


July 22, 2014

1-Apr
BCG
11
DPT-HepB+Hib1 27
DPT-HepB+Hib2 17
DPT-HepB+Hib3 27
Measles
23
Polio "0"
10
Polio 1
27
Polio 2
17
Polio 3
28
Vitamin A < 5yrs.177
Deworming < 5 yrs.
167

1-May
11
17
20
14
19
11
17
20
14
275
331

1-Jun
9
17
16
17
19
6
17
16
17
65
106

VACCINATION PERFORMANCE OF THE TARGET AREAS


1-Jul
1-Aug
1-Sep
1-Oct
1-Nov
1-Dec
16
7
25
14
5
12
15
11
20
11
11
18
25
12
20
19
5
14
24
10
15
24
12
13
38
5
30
20
11
18
17
3
20
13
3
10
15
11
15
11
11
18
22
12
19
19
5
14
19
10
13
24
12
7
106
1
133
57
59
47
310
38
13
151
58
66

TT 1
TT 2
TT 3
TT 4
TT 5

1-Apr
63
22
28
22
7

1-May
35
13
12
13
17

1-Jun
6
12
7
4
6

1-Jul
19
23
12
10
8

TT 1
TT 2
TT 3
TT 4
TT 5

1-Apr
21
16
6
3
0

1-May
9
9
8
6
4

1-Jun
15
5
9
3
1

1-Jul
14
6
3
2
2

TT for non pregnant


1-Aug
1-Sep
1-Oct
0
3
0
3
2
2
2
4
0
1
1
0
0
0
0
TT for pregnant mothers
1-Aug
1-Sep
1-Oct
3
11
1
1
3
1
0
0
0
0
0
0
0
5
0

1-Jan
21
26
20
22
16
12
26
20
22
145
165

1-Feb
14
16
29
39
36
14
23
20
24
249
294

1-Mar
9
18
20
40
16
2
27
20
40
86
150

1-Apr
9
21
36
39
43
10
21
36
39
382
539

1-Nov
0
0
0
0
0

1-Dec
6
2
0
0
0

1-Jan
14
13
8
10
13

1-Feb
4
11
7
4
0

1-Mar
3
9
5
3
0

1-Apr
27
35
32
17
12

1-Nov
1
0
0
0
0

1-Dec
10
9
4
1
1

1-Jan
11
4
5
3
0

1-Feb
27
3
1
0
0

1-Mar
15
10
4
3
0

1-Apr
29
11
7
3
2

38

END TERM EVALUATION REPORT


July 9, 2014

OPD

Overall statistics summary for the project period April 2013- June 2014
PAJONG OKUTI
AKUROMO LAMIT TOTAL
Children < 5 yrs.
296
255
558
718 1,827
Patients 5 yrs. And above
638
405
905 1,313 3,261
5,088

Most common
conditions

Malaria
Respiratory Tract infections
Intestinal worms
Acute Diarrhoea
Eye Infections
Skin Diseases
Dysentry
Truama
Pneumonia

173
423
107
57
42
17
3
4
6

128
235
104
49
20
13
8
3
2

260
611
157
135
89
48
13
10
8

455
957
262
128
100
40
3
30
1

1,016
2,226
630
369
251
118
27
47
17
4,701
296
108
473
877
175
175
175
146
255
266
317
332
1,491

Ante natal Care

ANC 1st visit


ANC 4th visit
Re-attendance

28
18
54

69
31
130

111
45
204

88
14
85

Family Planning

Family Planning

19

68

22

66

Immunisation

BCG
Poli 'O'
Polio1,DPT-HepB-Hib1
Polio2,DPT-HepB-Heb2
Polio3-DPT-HepB-Hib3
Meseasles

3
5
19
18
29
72

45
38
51
63
76
88

98
77
135
139
161
122

29
26
50
46
51
50

TT1
TT2
TT3
TT4
TT5

9
21
16
8
3

35
30
33
28
28

117
52
45
27
6

21
35
17
15
13

182
138
111
78
50
559

TT1
TT2
TT3
TT4
TT5

9
4
4
3
1

35
11
15
9
7

117
61
38
14
4

21
16
9
2
7

182
92
66
28
19
387
8,577

Tetanus Toxoid for


non-pregnant

Tetanus Toxiod for


pregnant

TOTAL DIRECT BENEFICIARIES

39

END TERM EVALUATION REPORT


July 9, 2014

ANNEX III
QUESTIONNAIRE FOR (DIRECT BENEFICIARIES) WOMEN OF CHILD BEARING AGE (WCA)
Introduction
The Rotary Club of Kitgum-RCK recently implemented a fifteen-month project on maternal and child health
(MCH) care in Orom, Mucwini and Akwang sub-counties. The project started in April 2013 and ended this
month, June 2014. RCK implemented this project to address serious gaps that had been identified regarding
maternal and child health care in the target areas above. Among others the project provided equipment such
as birthing beds, Mamakits for pregnant and lactating mothers, and capacity building for the local health
structure including VHTs and TBAs.
The management of the club has therefore undertaken to conduct an end term evaluation as a final step in
the project life span to determine what successes and failures have been registered. The evaluation exercise
shall also look at best practices and lessons learnt during the project implementation for replication and future
programming. Having been a target beneficiary of this project therefore, your participation in the survey is
very valuable for the evaluation team to gather relevant information and write a meaningful report. Your
participation in the exercise is not mandatory but quite important. The information you provide will be kept
confidential and the team will ensure that no harm is caused to you following this exercise.
Demographic information
I.
II.
III.

IV.

Age
A. Sub-countyB. Parish..C. Village.
Education level
a. Primary
b. Secondary
c. Others, specify..
Number of biological children

IMPLEMENTATION
Attitude of the local people towards the project
1. Did you know about the RCK MCH project?
a. Yes
b. No
2. If yes were you interested it?
a. Yes
b. No
3. Did you participate in it?
a. Yes
b. No
4. If yes how?
5. How else would you have liked to participate in the project?
6. Did you ever receive any support from the MCH project of the RCK?
a. Yes
40

END TERM EVALUATION REPORT


July 9, 2014

b. No (Skip the next question if no)


7. If yes, what support have you received from the project?
8. What were the challenges that you faced during implementation of the project in your community?
9. What suggestions do you have to overcome challenges of this nature?
The mobile outreach services for MCH
10. Are you aware of a mobile outreach system for MCH-services in your parish?
a. Yes
b. No (Skip questions 13-15 if no)
11. How have you participated in the outreach program by RCK?
12. Do you think the initiative will continue even after the withdrawal of RCK from the area?
a. Yes (if yes go to question 13)
b. No
c. Not sure
13. If yes how will you ensure its continuity?
THE PROJECT DESIGN
Womens participation/ involvement in the design and the realization of the project
14. Were you consulted during the design of the project?
a. Yes
b. No (if no skip the next question)
15. If yes how?
16. Was your opinion on how to improve the project implementation sought during the
implementation?
a. Yes
b. No (if no skip the next question)
17. If yes how?
18. Did the project address the key problems/needs pertaining to MCH in your area?
a. Yes
b. No (Skip the next question if no)
19. If yes how so?
PROJECT PERFORMANCE AND IMPACTS (STRENGTHS AND WEAKNESSES)
Access to health services for women
20. Have you had better access to health services since the implementation of the MCH project by the
RCK?
a. Yes
b. Somehow
c. No
21. What has changed in terms of health service provision for women with the incoming of the MCH
project of the RCK?
The referral system
22. Are you aware of a referral system for women at risk and emergency in your area?
41

END TERM EVALUATION REPORT


July 9, 2014

a. Yes
b. No (Skip the next question if no)
23. If yes can you please describe this system?
24. What do you think can be done differently to promote better health seeking behavior among
women at risk and emergency?
Hygiene and disease prevention
25. Were you sensitized on hygiene and disease prevention by the MCH project of the RCK?
a. Yes
b. No
26. What are the key factors for good personal health?
27. What do you do to ensure that you live in a clean and safe environment?
28. What can one do to maintain a good personal hygiene?
Attitude towards family planning
29. Have you been sensitized about family planning by the MCH project of the RCK?
a. Yes
b. No (if no skip the next question)
30. If yes, what message did you get on Family Planning from the project?
31. Mention some of the ways you can use to regulate pregnancy?
32. What is your opinion on family planning?
33. Do you use some family planning methods?
a. Yes (If yes skip qtn. 34)
b. No
34. If no why not?
Womens attitude towards ANC1 to ANC3 visits.
35. What is your view on antenatal care visits to the Health Center by pregnant women?
36. Would you pay antenatal care visits to your local Health Center when pregnant?
The attitude to give birth at Health Centre
37. What do you think about giving birth at the Health Centre?
38. Under what circumstances would you give birth at home?
The capacity of VHTs and TBAs to perform health education
39. Have you ever attended a health sensitization meeting convened and conducted by VHTs/TBAs?
40. If yes were you satisfied by their ability to deliver the sensitization?
41. In which areas of health education competence do you recommend improvement for VHTs and
TBAs?
The level of sustainability/self-reliance achieved by the project beneficiaries
42. How will you ensure the availability of materials like the Mamakit that was provided by RCK under
the MCH project?
43. What new lessons (insight) regarding MCH have you attained following the project implementation
in your area?
THANKYOU FOR YOUR TIME!!!!!

42

END TERM EVALUATION REPORT


July 9, 2014

ANNEX IV
STAFF INTERVIEW GUIDE
DEMOGRAPHIC INFORMATION
I.
II.
III.
IV.
V.
VI.

Position.....................................................................................................................................
Date of joining the project/organization..........................................................................................
Experience................................................................................................................................
Qualification (profession).....................................................................................................
Skills...............................................................................................................................
Knowledge...................................................................................................................................

THE PROJECT DESIGN


Organizational framework, staff, budget, equipment and management capacity to achieve the project
objectives
1)
2)
3)
4)
5)

Were there adequate staff members to deliver the projects expected outcomes?
Was the financial resource secured for the project enough to conduct the planned activities?
Did the project have at its disposal the relevant equipment needed for its implementation?
How supportive was the project steering committee in the project implementation?
How was your engagement with key stakeholders like the district health department in the
project implementation?
Implementation strategy, procedures and planning methods used by Rotary Club Kitgum.
6) What steps did you take in implementing each of the projects activities?
7) How does the existing implementation strategy affect the project implementation?
8) How do you control the use of the organizations assets/resources including funds, equipment
and human resource?
9) Did the existing internal control system affect the project implementation?
10) What better internal control system would you recommend to deliver such a project in future?
THE IMPLEMENTATION
The efficiency of implementation by a comparison of the costs incurred and the results achieved.
11) How commensurate with the outcomes were the budget lines for respective
activities/procurement?
(Look at activity reports and budgets, budgetary performance, procurement records, and market
prices)
The technical and managerial potential and efficiency of Rotary Club Kitgum and other stakeholders
12) Does the steering committee of RCK have the right mix of knowledge, skills and experience
needed to deliver the proposed outcomes of the clubs projects?
13) Do the club and its stakeholders have the necessary managerial to deliver projects like the
MCH?
Effects of external factors on the project implementation
14) What external factors affected the project during its fifteen-month implementation?
15) To what extent did these factors affect the project implementation and outcomes?
43

END TERM EVALUATION REPORT


July 9, 2014

The monitoring and reporting competence of the Rotary Club of Kitgum


16) Does a monitoring system exist for the RCK projects (or this project)?
17) Are the monitoring indicators effective and relevant to the proposed outcomes? (look at the log
frame)
18) Is the existing monitoring system independent and effective?
19) Was there regular and effective reporting (covering the key points as outlined in the project
logical framework)?
The technical and managerial competence of Rotary Club Kitgum technical staff and Rotary Club Kitgum
Steering committee and recommendations on how these may be improved.
20) What do you think about the capacity of technical team/staff and steering committee of RCK in
delivering the clubs projects/program?
21) What challenges do you face in your work as the technical person/steering committee member
of RCK?
22) Which areas of your work do you feel you need to be supported in?
OUTCOMES/IMPACT
The capacity of VHTs and TBAs to perform health education
23) What is your view on the capacity of VHT members to conduct health education?
Assess the willingness of the government to take over the project.
24) What exit and sustainability strategy do you have for the project at its conclusion?
25) Would government or any other party take up the initiatives of the project after its closure?
26) If yes, how?
Report on womens participation/involvement in the design and the realization of the project.
27) How did you ensure the participation of women (WCA) in the projects design and
implementation?
Assess the effectiveness of the training courses provided by RC Kitgum to VHTs.
28) What capacity gaps were visible among the VHTs you recruited under this project?
29) How relevant was the content of the training you provided them to their capacity needs?
30) How have their performance improved with regards to the training you provided?

44

END TERM EVALUATION REPORT


July 9, 2014

INTERVIEW GUIDE FOR THE PROJECTS DONOR REPRESENTATIVE


IMPLEMENTATION
1. Implementation strategy, procedures and planning methods used by Rotary Club Kitgum.
a. What role did you play in the projects planning and implementation?
b. Did you feel adequately included in the projects implementation? Please explain...
c. What more could you have done to improve the project implementation and outcomes?
d. What comments do you give on the internal control system of RCK in view of this project?
e. Did the existing internal control system facilitate or hinder the project implementation?
f. Would you recommend a better internal control system to deliver such a project in future?
Please explain...
2. Efficiency of implementation
a. In your opinion were the budget votes for the respective activities/procurement commensurate
with their specific outcomes? Please explain...
3. Technical and managerial potential and efficiency of Rotary Club Kitgum and its stakeholders
a. Which other support besides funding did you provide to the RCK under this project?
b. Did the steering committee of RCK exhibit the right mix of knowledge, skills and experience
needed to deliver the proposed outcomes of the clubs projects? Please explain...
4. Effects of external factors on the project.
a. Did you encounter any external factors which significantly affected the course of the project
implementation? Please explain...
b. To what extent did these factors affect the projected outcomes of the project?
5. The monitoring and reporting competence of Rotary Club Kitgum.
a. Did you participate in monitoring of the projects activities? Please explain...
b. What monitoring system was applied to project?
c. Were the monitoring indicators effective and relevant to the proposed project outcomes?
d. Was the existing monitoring system independent and effective?
e. Was there regular and effective reporting (covering the key issues as outlined in the project
logical framework)?
6. The technical and managerial competence of Rotary Club Kitgum technical staff and Rotary Club
Kitgum Steering committee and make recommendations on how these may be improved.
a. What is your opinion on the competence of the technical team/staff recruited to implement the
project?
b. Which challenges did you face besides the ones addressed above in your interaction with the
staff/steering committee members of the RCK under this project?
c. What general recommendations do you give to RCK in implementing a similar project in future?

45

Вам также может понравиться