Академический Документы
Профессиональный Документы
Культура Документы
Research
ABANDULA | YENEZA
Program Evaluation
Evaluation
judged
according
to
appropriate criteria, with those criteria
explicated and justified. (House, 1993: 1,
paraphrasing Scriven , 1991a)
Evaluation Research
Is the systematic application of social
research procedures for assessing the
conceptualization, design,
implementation and utility of social
intervention programs. (Rossi and
Freeman, 1993:5)
Program Evaluation
Research
A type of action research that uses a
set of techniques used to determine
effectiveness of a social service or
intervention program in meeting
needs or solving problems
used for decision making
purposes and making
recommendations
versus social research, which is
generally used to build
understanding and knowledge,
as well as to inform practice
What is assessed in
Program Evaluation
Research?
effectiveness of human service
organizations in order to provide
feedback to administrators about
their services
needs, processes, outcome and
efficiency of social services in
order to provide feedback
Program Evaluation
Models
Objective-based Approach
Objectives written by client and
evaluator depict overarching
purpose of the evaluation
and clearly state the type of
information to be collected
Uses benchmarks (more
specific objectives)
Goal-free evaluation
Guided by the perspective that
many findings and outcomes do
not fall within goals and
objectives that should have
been established
Expertise-oriented Evaluation
consultation
Participant-oriented Evaluation
Interested in who the program
serves
Dimensions of
Evaluation Research
Formative-Summative (Types of
Evaluation Research)
Formative- Process or progress
evaluation
-
Types:
needs assessment determines
who needs the program, how great
the need is, and what might work
to meet the need
evaluability
assessment determines whether
an evaluation is feasible and how
stakeholders can help shape its
usefulness
structured
conceptualization helps
stakeholders define the program or
technology, the target population,
and the possible outcomes
implementation
evaluation monitors the fidelity of
the program or technology delivery
process evaluation investigates
the process of delivering the
program or technology, including
alternative delivery procedures
Steps in Planning an
Evaluation
1. Identify stakeholders
2. Arrange preliminary meetings
3. Decide whether an evaluation should
be done
4. Examine the literature
5. Determine the methodology
6. Present a written proposal
Methodologies
An evaluation strategy is composed of:
Descriptive-Judgmental
an evaluation design
Preordinate-Responsive
Preordinate
Focus on the objectives of
the programme and the
evaluation will be designed
to assess the extent to
which these objectives have
been realized
Responsive
Permits some of the agenda
to be set by those involved
in the programme, and
allows for issues to be
explored as they emerge
during evaluation
Permits unanticipated
outcomes to be identified
Holistic-Analytic
Internal-External
Internal
Advantage of allowing the
developers to focus on what
an analytical method
Evaluation Designs:
Experimental design which involves a
treatment and control group
Quasi-experimental design wherein the
treatment or control group is not chosen
randomly
Implicit design only a treatment group
exists, measurement is made after exposure
to the program and assumptions are made
about conditions before the treatment
Data Collection Method
Literature Search evaluation of official
documents, general research reports,
published papers, books or past evaluations
File Review review of general program
files (specific to what is being evaluated),
files on individual projects, clients and
participants, administrative and financial
records
Observation
Survey
Expert Opinion as a source of data re
functional aspects and addressing evaluation
issues, not as part of the evaluation team
Case Study
Analytical Method
Statistical Analysis descriptive or
inferential statistics
Planning Evaluation
Cycle
Pitfalls
Input-output models
In econ: factors of production (resource)
goods and services (product)
Use of Models
Microeconomic Analysis
Behavior of consumers at the micro level
(people, households, firms) because this is
usually the target of the program
Uses demand and supply curves as well as
prices
Macroeconomic Analysis
Inflation, unemployment, GNP, interest rates,
etc
For example,
reluctance of public
officials to seek
evaluation of their
own reforms
Uses a longitudinal design
which entails difficulty in
controlling what occurs over
time
References
Banister, P. (1994). Qualitative
methods in psychology. Buckingham
[England]: Open University Press.