Program Evaluation Forms and Approaches 3rd edition John M. Owen ), ALLENSUNWIN“This edition frst published in 2006 Fest published in 1993, Copyright © John M, Owen 2006 Al sighs reserved. No pact ofthis book may be reproduced oF transmitted in any form or by any means, electronic or mechanical including photocopying, recording or by say information storage and eercral system, withoue pice permission in writing from the publisher The Australian Copyright Act 1968 (che Act) allows 8 ‘maximum of one chapter or 10 per cent of this book, whichever is the greater, tbe photocopied by any educational insiition for its ‘elvcational purposes provided thatthe educational institution (or ‘body that administers) has given a remuneration notice to Copyright Agency Limited (CAL) under the Act, Allen 8 Unwin £83 Alexander Steet, Cows Nest NSW 2065 Aseria Phone: (61 2} 8425 0100 Fax: (61 2) 99062218 Email: jnfo@llenandonwin com Web: worwallenandunwin.com ‘National Library of Autalia ‘Cataloguing in-Publiation enry: Owen, Joba M. John Maxwell, 1943- Program evaluation: forms and approaches Sed ed Inches index ISBN 1 74114 676 3 4, Management - Evaluation. 2. Evaluation - Methodology Tile. 6584 Setin 10.52 pe Sabon by Midland Typeseters, Australia Printed by CMO Image Printing, Singapore 10987654321 | Contents 10 u 2 13 Figures and tables Acknowledgments, Evaluation fundamentals The natute of interventions: What we evaluate Focusing evaluative enquiry: Evaluation forms and approaches Negotiation and evaluation planning From evaluation questions to evaluation findings From evaluation findings to utilisation Managing evaluation Codes of behaviour for evaluators Proactive evaluation Clarificative evaluation Interactive evaluation Monitoring evaluation Impact evaluation Index 22 39 63 87 105 132 149 169 191 217 237 252 293Figures and Tables FIGURES 1.1 Conference evaluation: excerpt from questionnaire ul 1.2. Evaluation definitions 18 2.1 Program components 27 3.1. Combined use of Proactive and Impact Forms in an evaluation 56 3.2 Eight critical steps in leading and managing change $8 3.3 The change process and the use of evaluative enquiry 58 4.1 Negotiating evaluations: dimensions of an evaluation plan 23 5.1 Data management in evaluation 99 6.1 Conceptualising evaluation utilisation 106 6.2. Simple utilisation paradigm 114 10.1 Program logic for a water conservation program 205 10.2 Program logic for an innovatory rehabilitation program 206 10.3 Program logic statement informed by the evaluation: adding a systems perspective 210-211 12.1 Generic program logic framework 247 13.1. Richmond community program content test 271 13.2 Variations in baby weights over time 278 13:3 Diploma in Education course evaluation 280 13.4a_ Evaluation of college teacher education program 283 13.4. Evaluation of college teacher education progeam— emphasis 284 TABLES 1.4 Characteristics of breakfast cereals 67 1.2 Conference evaluation: comparative impact on participants 2 3.1 Evaluation forms: orientation, typical issues and key approaches 32 3.2. Evaluation forms: all dimensions 33 Epistemological bases of Forms Proactive evaluation: typical questions Clarificative evaluation: typical questions Interactive evaluation: typical questions Monitoring evaluation: typical questions Impact evaluation: typical questions Summary of Proactive evaluation Different meanings of ‘need’ Summary of Clarificatve evaluation Summary of Interactive evaluation Summary of Monitoring evaluation Summary of Impact evaluation 61 91 92 94 95 170 472 193 218 239 254 Figures and tables