| ADPC
1998 Monitoring
and Evaluation Plan for the Asian Urban Disaster
Mitigation Program, base document
prepared by Jean W. Parker, Asian Disaster
Preparedness Center, Bangkok, Thailand
This document is a plan for conducting and setting
up a Monitoring and Evaluation Plan for the
Asian Urban Disaster Mitigation Program, of
ADPC. The base document was prepared by Jean
W. Parker and was later developed and used for
monitoring the program.
ALNAP 2001 Humanitarian Action: Learning
from Evaluation: The ALNAP Annual Review 2001,
Overseas Development Institute, London, U.K.
ISBN 0850035864, 135 pp
This annual review covers an Introduction, Summary
of Findings and Assessment of non-Kosovo Evaluation
Reports, Evaluations of Humanitarian Aid in
Response to the 1999 Kosovo Crisis: Synthesis
and meta-evaluation, Overview of the analysis
and next steps. Plus six appendices. This report
"draws together the principal findings of over
49 evaluations of humanitarian action published
during 1999 and 2000". The review "combines
synthesis of the evaluations main findings with
a meta-evaluation of the quality of reports,
showing us where evaluation practice deserves
emulation and where it is in need of strengthening.
However, in providing a systematic basis for
assessment, it promises to be an important tool
for monitoring the progress of efforts to improve
the quality and effectiveness of the evaluation
of humanitarian action mechanism".
ALNAP 2002 Humanitarian Action: Improving
Performance Through Improved Learning; ALNAP
Annual Review 2002, Overseas Development Institute,
London, U.K. ISBN 0850035864, 232 pp
This book reviews and synthesizes 55 evaluation
points to a number of well known problematic
areas: a lack of connectedness; a lack of attention
to preparedness, rights-based approaches, targeting
and gender equality; low levels of affected
population participation; limited attention
to indigenous coping strategies; and limited
coordination. Why is it that the humanitarian
sector continues to face these problems? This
book thoroughly analyses the obstacles to learning
in the sector and provides advice on how to
deal with them.
Apthorpe, Raymond 2000 Kosovo
Humanitarian Programme Evaluations: Towards
Synthesis, Meta-analysis and Sixteen Propositions
for Discussion, Background paper
for the ALNAP Symposium Learning-from-Evaluation:
Humanitarian Assistance and Protection in Kosovo
held in Geneva 17-18 October 2000 ALNAP,
Overseas Development Institute, London
Baker, Judy L 2000 Evaluating the Impact
of Development Projects on Poverty: A Handbook
for Practitioners, World Bank ISBN 0-8213-4697-0
SKU 14697, 240 pages, $ 25.00. Order form:
http://publications.worldbank.org/ecommerce/catalog/product?item_id=213111
This handbook seeks to provide project managers
and policy analysts with the tools needed for
evaluating project impact. It is aimed at readers
with a general knowledge of statistics. For
some of the more in-depth statistical methods
discussed, the reader is referred to the technical
literature on the topic. Chapter 1 presents
an overview of concepts and methods. Chapter
2 discusses key steps and related issues to
consider in implementation. Chapter 3 illustrates
various analytical techniques through a case
study. Chapter 4 includes a discussion of lessons
learned from a rich set of "good practice" evaluations
of poverty projects, which have been reviewed
for this handbook.
Bert van de Putte 2001
Follow-up to Evaluations of Humanitarian
Programmes: Findings of the ALNAP Commissioned
Study paper submitted to the ALNAP
Biannual Meeting 26-27 April 2001
Blumberg, Rae L. 1999
Rapid Appraisal Methodologies for Assessing
Impact, Food and Agriculture Organization
of the United Nations (FAO) Evaluation Service,
FAO, Rome 1998
Booth, D. 2001
Desk Study of Good Practice In The Development
of Prsp Indicators and Monitoring Systems: Initial
Review of Prsp Documentation, Overseas
Development Institute ODI, 2001
This report reflects the first stage of a desk
study of good practice in the development of
PRSP indicators and monitoring systems. The
article focuses on five main areas that are
of potential importance in PRSP monitoring:
- input monitoring
(budget reforms and expenditure tracking)
- timely monitoring
of implementation processes (by established
and innovative means)
- measurement
of poverty-related outcomes and impacts (by
surveys and participatory assessments)
- measures to
enable PRSP stakeholders to have and use information
- steps to enhance
the use of available data for analytical purposes
The article
finds that: the measurement of final poverty
outcomes/impacts is about to take a substantial
leap forward in most countries. The final poverty
outcome measurements are heavily emphasized,
the monitoring of implementation processes and
intermediate outputs has a long way to go, and
is generally neglected by comparison, the choice
of indicators for PRSP monitoring needs to be
linked to the content of the strategy, particularly
at the level of intermediate outputs and processes,
a closer look at the indicators actually selected
suggests that they are the result of bringing
together those already agreed for different
projects, programmes and concessional loans.
They are not integrated by an overall rationale
The document is available at http://www.odi.org.uk/pppg/monitoring_report.pdf
Booth, William, Ebrahim Radya and Morin,
Robert 1998
Participatory Monitoring, Evaluation and
Reporting: an Organizational Development Perspective
for South African NGOs, PACT, South Africa,
produced with support from USAID in South Africa.
Center for Human Resources Development (LADACEN-CHRD),
and the Vietnam Union for Science and Technology
Associations 2001 Participatory Monitoring
and Evaluation
A manual designed to accompany training courses
provided by the above, and one of three manuals
supporting training in project management. Aimed
at NGO workers within Vietnam, section headings
include: Introduction, Participation, Monitoring
and Evaluation, Indicators, Setting and implementing
a PM&E system, Steps to set up a PM&E
system, Implementing a PM&E system, Comments
about a PM&E system, Case study: Binh Minh
Nutrition project. 12. Tools, and references.
84 pages. For copies try contacting LADACEN-CHRD
through the NGO Resource Centre in Hanoi at
director@ngocentre.netnam.vn
Clark, Noreen and McCaffery, James 1979
Demystifying evaluation: training program staff
in assessment of community-based programs through
a field-operational seminar, World Education,
69 pg. 210 Lincoln Street, Boston MA 0211
Cole, Galen E., et al.
Addressing Problems in Evaluating Health-Relevant
Programs Through Systematic Planning and Evaluation
This publication seeks to clarify the definition
of evaluation for a common understanding to
the term. The paper proposes a systematic planning
and evaluation model (SPEM) to address the problems
in inconsistency or usage of terminology in
the literature, absence of details concerning
needed steps to carry out evaluations from start
to finish, lack of common perspective about
how evaluation related to program planning and
absence of a systematic approach to carry out
evaluations.
Dabelstein, Niels 2001
AID Responses to Afghanistan: Lessons From
Previous Evaluations, presented
at the DAC Senior Level Meeting 12-13 December
2001 Development Co-operation Directorate
www.alnap.org/pubs/pdfs/followup.pdf
Davies, Rick 2001 A review of NGO approaches
to the evaluation of advocacy work. A report
for DFID, August 2001. 53 pages.
This publication in seven sections covers an
Executive summary, Background, Definitions and
their consequences, who participates and what
difference does it make, what to monitor, collection
and analysis, next steps, plus appendices. Copies
available by email, on request to rick@shimbir.demon.co.uk
Davis-Case, D 1989 Community Forestry
Field Manual 2 Food and Agricultural Organization,
Rome, 150 pg.
This publication outlines the concepts, approaches
and techniques that need to be an integral part
of a participatory development strategy. It
presents a flexible and adaptable framework
within which projects can work to increase the
level of participation that is fostered. About
half of the book is used to describe "tools"
that can be used to facilitate the involvement
of local people in project planning, implementation
and evaluation of community forestry activities.
The publication helps the reader design an approach,
using the appropriate tools and techniques that
are tailored to the specific community. Some
of PAME's underlying concepts came from a set
of case studies that were collaboratively produced
by CARE, the Ford Foundation and six NGO projects
in Africa. The approach was further developed
through field research and literature analysis.
An annotated bibliography is also included.
http://www.fao.org/forestry/FON/FONP/cfu/pub/en/fm/abfm02-e.stm
Destler, Harriett, Brown, Keith, Vondal,
Patricia and Beyna, Larry 1996
Planning and Managing for Results Under
Reengineering: Early Lessons From the Field,
a Joint Initiative of Program/Policy Coordination
and Management Bureaus, USAID, Center for Development
Information and Evaluation
Estrella, Marisol et al
Learning from Change: Issues and Experience
in Participatory Monitoring and Evaluation,
Intermediate Technology Publications. The book
can be purchased from
www.ids.ac.uk/ids/bookshop/
Feinstein, Osvaldo N. & Picciotto, Robert
ed. Evaluation And Poverty Reduction Available
from Transaction Publishers
The network of world-class scholars and development
practitioners covers the gamut from methodological
issues to policy concerns with respect to participatory
evaluation, poverty reducing growth, macro and
micro levels of intervention, health, nutrition
and population programs, social inclusion and
the changing role of the civil society. The
participants include major figures, including
a Nobel Laureate as well as cutting edge policy
makers. Poverty reduction is examined in innovative
ways—utilizing state of the art techniques of
the social and economic sciences.
Feuerstein, Marie-Therese, 1986 Partners
in Evaluation: Evaluating Development and Community
Programmes with participants, Macmillan, TALC,
ISBN 0-333-42261-9, 194 pg.
A practical field handbook designed for fields
workers with little or no formal training in
evaluation methodology. It advocates the participation
of people at community level in various parts
of the evaluation process. It is geared towards
technologies, which are centered on people working
as a team, in partnership with project teachers
and managers. It contains practical advice on
how to plan an evaluation, organize resources,
use existing knowledge and records, collect
and analyze information, report the results
of evaluation, and use evaluation results.
Food and Agriculture Organization of the
United Nations (FAO) 1998
FAO Evaluation Mission Brief, Evaluation
Service, FAO, Rome 1998
Food and Agriculture Organization of the
United Nations (FAO) 1998
Model Terms of Reference for a Joint Evaluation
Mission, Evaluation Service, FAO, Rome
1998
Food and Agriculture Organization of the
United Nations (FAO) 1998
Outline of an On-going Evaluation Report,
Evaluation Service, FAO, Rome 1998
Food and Agriculture Organization of the
United Nations (FAO) 1994
Project Evaluation Questionnaire for Completion
by all Evaluation Missions, Evaluation
Service, FAO, Rome 1998
Funnell, Sue C. 2000 Developing and
Using a Program Theory Matrix for Program Evaluation
and Performance Monitoring, New Directions for
Evaluation, no. 87, Fall 2000.
This article discusses the essential features
of the program theory approach and how its usefulness
for monitoring and evaluation can be enhanced:
by incorporating information about the context
in which the program operates, by defining success
criteria and comparisons for judging and interpreting
performance information, and by identifying
sources of performance information
Guba, E.G. & Lincoln, Y.S. 1989
Fourth Generation Evaluation, Sage, Newbury
Park, CA
The book describes the differences between the
earlier (and still widely used) evaluation model,
based on positivist/scientific assumptions and
statistical techniques, and the “naturalistic”
approach to evaluation, and outlines methodological
guidelines for the conduct of naturalistic evaluations.
Hauge, Arild 2001
Strengthening Capacity for Monitoring and
Evaluation In Uganda: A Result Based Management
Perspective, ECD Working Paper Series
No.8, World Bank Operations Evaluation Department,
the World Bank, Washington, D.C.
www.worldbank.org/html/oed
Herman, Joan L., Lyons Morris, Lynn and
Taylor Fitz-Gibbon, Carol 1987 Evaluator’s
handbook: the Program Evaluation Kit, Sage Publications,
ISBN 0-8039-3126-3, 155 pg.
This is the first book in the Program Evaluation
Kit, which is a set of nine books intended to
assist people who are conducting evaluations.
It is intended as an aid to people with or without
evaluation experience, and is based on examples
from educational, social service and business
settings in America. Each book contains a step-by-step
procedural guide to help people gather, analyze
and interpret information for almost any purpose.
The kit is a comprehensive guide to the process
of evaluation, but it is not designed for use
in development work, and is probably more detailed
than required by most people. It would be a
useful basic text for anyone who wants to study
evaluation in depth.
House, Ernest R. 1993 Professional Evaluation
– Social Impact and Political Consequences,
Sage, Newbury Park, CA
In the author’s own word, “this book is about
analyzing the social, political, economic, historical
and cultural influences on evaluation.” It provides
a thoughtful overview of the field’s evolution,
from its earlier reliance on “value-free” experimental
and primarily quantitative methods to the current
emphasis on methods more appropriate to the
diverse, multicultural and politically charged
environment in which social and educational
programs operate.
Johnston, Timothy and Battaile, William
2001 2000
Annual Review of Development Effectiveness:
from strategy to results, World Bank
Operations Evaluation Department, the World
Bank
www.worldbank.org/html/oed
Joint Committee on Standards for Educational
Evaluation 1981 Standards for Evaluation
of Educational Programs, Projects, and Materials.
McGraw-Hill, New York
Kaufmann, Kraay and Zoido-Lobaton, 2000
Governance Matters: From Measurement to Action,"
Finance & Development (IMF) June 2000, Volume
37, Number 2.
Khan. Adil. M. Dr. 2001 Planning for
and Monitoring of Project Sustainability: A
Guideline on Concepts, Issue and Tools, UNDP/Ministry
of Plan Implementation, Colombo. June 2001,
20 pages.
This publication covers issues on sustainability,
monitoring sustainability, project management,
sustainability indicators and measuring tools
etc.
Mackay, Keith
Evaluation Capacity Development: A Diagnostic
Guide and Action Framework
This guide is intended to assist those governments
and development agencies which have decided
to develop a national or sectoral evaluation
system. The guide provides detailed checklists
of issues to be considered in developing a country’s
evaluation capacity.
Marsden, David and Oakley, Peter (ed.)
1990 Evaluating Social Development Projects:
Development Guidelines No.5 OXFAM, ISBN 0-85598-147-4,
162 pg.
A book that brings together the main papers
and workshop discussions from an international
conference held in Swansea in 1989. The four
major themes covered are: qualitative indicators
to be used in evaluation; methodologies for
social development evaluation; partnership in
evaluation and the changing nature of relationships
between funders/donors and recipients; and the
role and position of the evaluator. It gives
useful background to the ideas, principles and
discussions concerning the evaluation of social
development projects.
McPherson, Sam 1994 Participatory Monitory
and evaluation in PRA: annotated bibliography
of selected sources, Institute of Development
Studies at Sussex University
The documents listed and review in this section
of the bibliography constitute the result of
an extensive search on the fast growing subject
areas of PRA methods applied to monitoring and
evaluation.
Mougeot, Luc 1995
Urban Community-based Disaster Prevention
and Mitigation: Project Impact Evaluation,
part of the LA RED Consortium, Central America
http://www.idrc.ca/library/document/104811/
Narayan, Deepa 1993 Participatory Evaluation:
Tools for Managing Change in Water and Sanitation,
World Bank Technical Paper No.207, ISSN 0253-7494,
122 pg.
This document provides ideas about participatory
processes and indicators that can be used to
involve community members and others in evaluation.
Drawing on extensive field experience, the volume
is structured around a framework of key indicators
that can be measured to determine progress towards
that objectives, sustainability, effective use,
and replicability in water and sanitation programmes.
The methodology is relevant to other sectors
too.
National Science Foundation
12 Basic Tips for Designing and Describing
Project Evaluation from the Foundation
Relations, University of Massachusetts
http://www.umass.edu/sta/
Newman, D. Scheirer, M.A., Shadish, W. and
Wye, C.
Guiding Principles for Evaluators: a report
from the AEA Task Force on Guiding Principles
for Evaluators, American Evaluators
Association
www.eval.org/EvaluationDocuments/aeaprin6.html
OECD 1991
Principles for Evaluation of Development
Assistance, Development Assistance Committee,
Organization for Economic Co-Operation and Development,
Paris
OECD/DAC, 1999 Guidance for Evaluating
Humanitarian Assistance in Complex Emergencies,
Development Assistance Committee, Organization
for Economic Co-Operation and Development, Paris
1999
This guide is aimed at those involved in the
commissioning, design and management of evaluations
of humanitarian assistance programmes. It defines
and describes the characteristics complex emergencies
and explains the difference between evaluation
of humanitarian assistance programmes and conventional
aid programmes. It provides guidance for evaluation
managers on how to plan, conduct and manage
the evaluation.
OECD/Development Assistance Committee
1998 Effective Practices in Conducting a Joint
Multi-Donor Evaluation, 1998.
This report outlines the key steps on how to
plan and conduct a joint evaluation of development
programmes when more than one donor agency is
involved. With the enhanced role of partnership
in the funding and implementation of development
assistance, there will be a growing demand for
joint evaluation and for lessons learned from
various modalities of jointly implemented development
cooperation. The guide serves as a useful tool
for those who seek to promote joint evaluation
and collaboration among donor agencies. It was
prepared for donor agency managers involved
in planning and implementing joint evaluations
of development assistance programs with other
donor partners.
Overseas Development Institute 1998
Evaluating Humanitarian Assistance Programmes
in Complex Emergencies
The study seeks to improve the consistency and
quality of evaluation methodologies, and enhance
the accountability function of evaluation, contribute
to institutionalizing the lessons learned, and
identify better methods for monitoring performance
of humanitarian aid operations. It discusses
key considerations of evaluations in a humanitarian
context, measures to enhance the effectiveness
of the evaluation process, and how to establish
basic parameters for the evaluation. It contains
guidelines for planning, conducting and managing
evaluations in conflict situations, including
preparing a terms of reference, team composition,
sources of information and information gathering
techniques, and methods of working.
Owen, J. M. 1998 Fundamentals of Program
Evaluation Workshop given at the annual
meeting of the American Evaluation Association,
Chicago, November 1998
Owen, J. M. 1998 Interactive Evaluation:
Using Professional Evaluators to Encourage Effective
Participatory Evaluation. Paper given at
the third annual conference of the European
Evaluation Society, Rome, October.1998
Owen, J. M. 1998 Linking Benchmarking
Techniques to Principles of Evaluation Practice.
Paper given at the annual meeting of the American
Evaluation Association, Chicago, November 1998
Owen, J. M. 1998 Towards a Theory of
Negotiation. Paper given at the annual meeting
of the American Evaluation Association, Chicago,
November 1998
Owen, J. M. 1998 Using Evaluation Forms
to Structure a Post Graduate Program in Evaluation.
Paper given at the third annual conference
of the European Evaluation Society, Rome, October
1998
Owen, J.M. with Rogers P.J. 1999 Program
Evaluation: Forms and Approaches 2nd Ed. Allen
and Unwin. Sydney. ISBN: 1-86448-784-4 International
Edition: Sage Publications, Thousand Oaks. ISBN:
0-7619-6177-1
Pasteur, Katherine and Blauert, Jutta
2000
Participatory Monitoring and Evaluation
in Latin America: Overview of the Literature
with Annotated Bibliography, Institute
of Development Studies, University of Sussex,
England, U.K.
Patton, M.Q. 1990 Qualitative Evaluation
and Research Methods Sage, Newbury Park, CA
Pfohl, Jacob (designed by) 1986 Participatory
evaluation: user’s guide, Private Agencies Collaborating
Together, (PACT), 81pgs. 777 United Nations
Plaza, New York 10017
This document is useful for anyone planning
to carry out a participatory evaluation. Section
one goes through the design of an evaluation,
step by step: a look at basic concepts; how
to establish a purpose and focus; thinking through
a plan to gather information; learning to analyze,
interpret and use information. Section 2 includes:
a training in participatory evaluation based
on the manual; a sample evaluation exercise;
and where to go for more information.
Pratt, Brian and Loizos, Peter 1992
Choosing Research Methods: data collection for
development workers, Development Guidelines
No.& Oxfam, ISBN 0-85598-177-6, 115 pg.
This book discusses the various ways in which
research can be carried out, and how to select
the most appropriate methods for particular
circumstances. The advantages and disadvantages
of a wide range of research methods are assessed,
and guidance is given on how to decide exactly
what information is necessary and how to obtain
it, given the resources available.
Raynard, Peter 2000
Mapping Accountability in Humanitarian Assistance
Report presented to the ALNAP at
the Biannual Meeting in April 2000 and revised
to reflect comments received ALNAP, Humanitarian
Policy Group, Overseas Development Institute.
Riddell, Roger 1990 Judging success:
evaluating NGO approaches to alleviating poverty
in developing countries: ODI Working paper 37,
Overseas Development Institute, ISBN 0-85003-133-8,
57 pg
A useful guide to an approach for evaluating
programmes which aim to alleviate poverty in
developing countries. The approach is based
on the assumption that it is essential to incorporate
a range of non-economic elements relevant to
the projects and communities participating in
the projects I the overall evaluation. It would
be useful for someone who already has some evaluation
skills and experience, or for anyone planning
a detailed evaluation of a piece of work, which
aims to alleviate poverty.
Rogge, J.R. and Lavell, A. 1996 The
Disaster Management Programme: An Evaluation
of UNDP's and DHA's Disaster Management Training
Programme, Disaster Research Institute
Rossi, Peter H. & Freeman, Howard E.
1993 Evaluation-A Systematic Approach 5th ed.
Sage, Newbury Park, CA
This is perhaps the most comprehensive and widely
used texts about evaluation. It provides extensive
and sophisticated discussions of all aspects
of designing and assessing the implementation
and utility of social programs. Many of the
projects cited and discussed in this volume
deal with educational programs and innovations,
although the bulk of the programs with which
these authors had first hand experience were
in the fields of housing, health services, and
criminal justice. Most tasks that evaluators
are likely to be asked to perform, and most
problems they will have to deal with, technical
as well as political, are covered here. The
authors adhere to the social science model in
their approach to evaluation, with clear preference
for randomized and quasi-experimental designs,
but they also cover other evaluation methods,
including the use of qualitative and judgmental
approaches.
Rugh, Jim 1986 Self-evaluation: Ideas
For Participatory Evaluation of Rural Community
Development Projects.
A useful addition to anyone who wants to carry
out participatory evaluation, although not as
detailed or practical as The Community’s Toolkit
or Partners in Evaluation
Sage Publication 2000 Evaluation Frameworks
for Development Programs and Projects, Sage
Publications India Pvt Ltd, 2000 (Reprint).
ISBN 81 – 7036 – 693 India (Hb); 81 – 7036 –
694 – 1 India (Pb); 0 – 7619 – 9239 – 1 US (Hb);
0 – 7619 – 9240 – 5 US (Pb), 152 pages, 25 (Cloth),
12.99 (Paper). Order form:
http://www.sagepub.co.uk/frame.html?http://www.sagepub.co.uk/journals/details/c001.html
This analysis of the evaluation of organized
development work explores all the major issues
and aspects of evaluation, chief among which
are context, perspectives, methods and management.
Among the important features of the book are:
an interconnected analysis of the main facets
of evaluation; connections made between the
evaluation of development schemes with the planning,
implementation and monitoring of schemes; a
cognizance of the complex nature of societal
development; and a number of diagrams illustrating
the perspectives and processes of evaluation.
Sage Publication 2001 Practical Evaluation
for Collaborative Services: Goals, Processes,
Tools, and Reporting Systems for School-Based
Programs. Sage Publications, 2001, 226 pages,
Cloth £ 62.00, Paper £ 31.00. Order form:
http://www.sagepub.co.uk/frame.html?http://www.sagepub.co.uk/journals/details/c001.html.
Practical Evaluation for Collaborative Services
answers the call for help wherever assessment
and evaluation are being considered as schools
and community service agencies work to establish
and evaluate broad-based community collaborative
initiatives. This book is unique in that specific
evaluation instruments are provided in a format
that can be immediately copied and used. The
instruments and processes were developed and
used within large and small communities to assess
collaborative service arrangements between public
schools and service agencies such as public
health, mental health, human services, etc.
Sage Publications 1999 Evaluation:
A Systematic Approach, Sixth Edition. Sage Publications,
1999. ISBN 0761908935 (Cloth), 510 pages, £
50.00. Order form:
http://www.sagepub.co.uk/frame.html?http://www.sagepub.co.uk/journals/details/c001.html
The book that has been a benchmark in evaluation
has been further improved and updated. Relied
on by over 90,000 readers as the text on how
to design, implement and appraise the utility
of social programmes, the Sixth Edition of Evaluation
has been completely revised to include the latest
techniques and approaches, as well as guidelines
for how evaluations should be tailored to fit
programmes and social contexts.
Scriven, Michael 1991 Evaluation Thesaurus
4th ed. Sage, Newbury Park, CA
A highly original, wide ranging collection of
ideas, concepts, positions and techniques which
reflect the critical, incisive and often unconventional
views held by the leader in the field of evaluation.
It contains a 40 page introductory essay on
the nature of evaluation and nearly 1,000 entries
which range from one paragraph definitions of
technical terms and acronyms to philosophical
and methodological discussions extending over
many pages. The thesaurus is not focused on
the field of education, but it provides excellent
coverage of issues and concepts of interest
to educational evaluators.
Shaw, Ian 1999 Qualitative Evaluation,
Series: Introducing Qualitative Methods series
Sage Publications, 1999. ISBN 0761956891 (Cloth,
£ 50.00), ISBN 0761956905 (Paper, £ 16.99),
240 pages. Order form:
http://www.sagepub.co.uk/frame.html?http://www.sagepub.co.uk/journals/details/c001.html
If one is looking for a practical introduction
to the strategies and methods of qualitative
evaluation, Ian Shaw shows how evaluation practice
can utilize qualitative approaches to gain an
understanding that more traditional quantitative
approaches may fail to do. Three broad sections
include discussions of: the foundations of evaluation
and recent trends; evaluation and action programmes;
and the practice of evaluation (including design,
data collection and analysis). Exercises for
each chapter show students how to apply the
issues, approaches and methods illustrated.
Stevens, F., Lawrenz, F. and Sharp, L.
User-Friendly Handbook for Project Evaluation:
Science, Mathematics. Engineering and Technology
Education National Science Foundation, Education
and Human Resource Development, University
of Massachusetts
This handbook available at http://www.ehr.nsf.gov/RED/EVAL/handbook/handbook.htm
of the national science foundation was developed
to provide project evaluators working within
the foundation a basic understanding of selected
approaches to evaluation. It discusses both
quantitative and qualitative evaluation methods,
but emphasizes more on quantitative techniques
for conducting outcome evaluations. It addresses
several topics in 8 chapters. The first four
chapters focus on designing and implementing
evaluation studies and the remaining chapters
provide support materials.
Swiss Agency
for Development and Cooperation 2000 External
Evaluation: Are we doing the right things? Are
we doing things right? June 2000.
The guidelines are divided into two sections.
Part I explains the terminology and principles
of evaluation. Part II discusses each of the
five stages of an external evaluation. These
guidelines are primarily addressed to organizations
that sponsor or participate in evaluations and
are responsible for implementing their results.
UNDP 2001
Managing for Results: Monitoring and Evaluation
in UNDP: a Results-Oriented Framework,
Evaluation Office, United Nations Development
Program, 16 November 2001
UNDP
Handbook on Monitoring and Evaluating for
Results, United Nations Development
Program
UNFPA 2000
UNFPA and Government Decentralization: a
Study of Country Experience, Office
of Oversight and Evaluation, United Nations
Population Fund
UNHCR, 1998 Enhancement of the Evaluation
Function in UNHCR, 1998,
The review assesses the role of the evaluation
function in UNHCR. It is divided into two sections.
Section I presents a situational analysis; and
Section II discusses key steps in enhancing
evaluation by establishing an enabling structure
and suggesting improvements to the evaluation
cycle.
UNHCR, 1998 Planning and Organizing
Useful Evaluations, 1998.
These guidelines are intended to assist UNHCR
field and headquarters staff in evaluating and
analyzing the broad range of operational activities
undertaken by UNHCR. The guidelines provide
an elementary understanding of the function,
a description of the different approaches, and
how to plan, implement and follow up on evaluations.
UNPF 1999
Implementing the Reproductive Health Vision:
Progress and New Directions for UNFPA, Evaluation
Report No.17, United Nations Population
Fund
UNPA 2000
Assessment of National
Execution Capacity: a Methodology in Evaluation
Findings, Issue 29 March 2000, Office of
Oversight and Evaluations
USAID 1996
Performance Monitoring and Evaluation Tips:
Conducting Customer Service Assessments,
USAID Center for Development Information and
Evaluations, No.9
This tips give practical advice about customer
service assessments for example, when they should
be conducted, what methods may be used, and
what information can be usefully included.
USAID 1996
Performance Monitoring and Evaluation Tips:
Conducting Key Informant Interviews,
USAID Center for Development Information and
Evaluations, No.2
Rapid appraisal techniques offer systematic
ways of getting such information quickly and
at low cost. These tips advise how to conduct
one such method- key informant interviews.
USAID 1996 Performance
Monitoring and Evaluation Tips: Conducting a
Participatory Evaluation, USAID Center
for Development Information and Evaluations,
No.1
The tips outline how to conduct participatory
evaluation.
USAID 1996
Performance Monitoring and Evaluation Tips:
Establishing Performance Targets, USAID
Center for Development Information and Evaluations,
No.8
This paper discusses what targets are, why they
are important, and what information sources
and approaches may be used for setting targets.
USAID 1996
Performance Monitoring and Evaluation Tips:
Guidelines for Indicator and Data Quality,
USAID Center for Development Information and
Evaluations, No.12
Because performance data have become more important
to Agency decisions, clear criteria for judging
the quality of these data have become increasingly
crucial. These tips describe Agency criteria
and procedures for ensuring the quality of indicators
and data in operating units performance-monitoring
systems.
USAID 1996
Performance Monitoring and Evaluation Tips:
Preparing an Evaluation Scope of Work,
USAID Center for Development Information and
Evaluations, No.3
These tips offer suggestions for preparing a
good evaluation scope of work.
USAID 1996
Performance Monitoring and Evaluation Tips:
Preparing a Performance Monitoring Plan,
USAID Center for Development Information and
Evaluations, No.7
USAID’s reengineering guidance requires operating
units to prepare a performance-monitoring plan
for the systematic and timely collection of
performance data. These tips offer advice on
how to prepare such a plan.
USAID 1996
Performance Monitoring and Evaluation Tips:
Selecting Performance Indicators, USAID
Center for Development Information and Evaluations,
No.6
To manage for results, USAID operating units
need reliable and timely data on their program
results. Performance indicators define the data
to be collected to measure progress, and are
thus and indispensable tool for decision-making.
These tips offer advice on how to select appropriate
and useful performance indicators.
USAID 1996
Performance Monitoring and Evaluation Tips:
Using Direct Observation Techniques,
USAID Center for Development Information and
Evaluations, No.4
USAID’s reengineering guidance encourages the
use of rapid, low cost methods for collecting
information on the performance of our development
activities. Direct observation, is one such
method.
USAID 2000
Performance Monitoring and Evaluation Tips:
Building a Results Framework, USAID
Center for Development Information and Evaluations,
No.13
Tips contain no new Agency Policy or essential
procedures. Rather they provide guidelines,
advice, and suggestions to USAID managers on
how to effectively plan and conduct performance
monitoring and evaluation activities.
USAID 2000
Performance Monitoring and Evaluation Tips:
Measuring Institutional Capacity, USAID
Center for Development Information and Evaluations,
No.15
The paper defines and discusses capacity assessment
in general and presents several approaches for
measuring institutional capacity.
Wood, Adrian, Apthorpe, Raymond and Borton,
John Evaluating International Humanitarian
Action - Reflections from Practitioners, Zed
Books, ISBN/PRICE: 1 85649 975 8 hbk GBP45.00/US$65.00
1 85649 976 6 pbk GBP14.95/US$22.50 Order directly
from Zed Books or via Amazon Books UK or by
emailing Mohammed Umar at Zed Books via
sales@zedbooks.demon.co.uk
The is one of the first systematic compilation
of the lessons learned from humanitarian aid
interventions and wide-ranging case studies
from Africa, South East and Central Asia, Oceania,
and the Balkans. It provides practical information
and advice for agencies and individuals dealing
with complex emergencies. The case studies cover
the different kinds of humanitarian emergency
characteristic of the past decade. The contributors
address the context in which evaluations of
humanitarian assistance take place; the actual
process of doing evaluations; and the lessons
for improving how such evaluations might be
better undertaken in future. This pioneering
volume will be of great practical value to agencies
and individuals engaged in both the delivery
of humanitarian assistance in complex emergencies
and its evaluation.
World Bank 1996
Designing Project Monitoring and Evaluation,
Operations Evaluation Department, Lessons and
Practices No. 8, World Bank
www.worldbank.org/oed
World Bank 2000 Evaluation and Poverty
Reduction: Prodding from a World Bank Conference,
World Bank: 2000. ISBN 0-8213-4684-9 SKU 14684,
384 pages, $30.00
Order from:
http://publications.worldbank.org/ecommerce/catalog/product?item_id=213097
Many different organizations and institutions
around the world came together for a conference
to discuss the meaning of evaluation in poverty
reduction. Their goals during the two day conference
were: first, to identify lessons from past efforts
to evaluate poverty reduction programs; second,
to search for the new evaluation frontier in
methodology for future poverty reduction programs;
and third, to discuss how partnerships in evaluation
can be promoted and how to use evaluation results
more effectively. This volume contains the proceedings
of that conference.
World Bank 2000
Monitoring and Evaluation Capacities in
Ghana - A Diagnosis and Proposed Action Plan
World Bank 2001
Private Sector Development: Findings and
Lessons from Selected Studies: Lessons and Practices
No.17, Operations Evaluation Department,
the World Bank, Washington D.C.
World Bank
Monitoring and Evaluation: Some Tools, Methods
& Approaches, Operations Evaluation
Department, the World Bank, Washington D.C.
Worthen, Blaine R. & Sanders, James
R. 1987 Educational Evaluation: Alternative
Approaches and Practical Guidelines, Longman,
White Plains, NY.
This book was designed primarily as a basic
text for graduate courses in evaluation, or
related administrative, curriculum, or teacher
education courses, where efforts are made to
teach practitioners how to assess the effectiveness
of their educational endeavors. It seeks to
familiarize readers with alternative approaches
for planning evaluations, and provides step-by-step
practical guidelines for conducting them. The
book is very systematically organized, describes
at length all evaluation approaches which have
been developed over the years, and includes
a great deal of useful information, especially
for the inexperienced evaluator. A detailed,
naturalistic description of the conduct of an
evaluation program, including problems encountered
with school staff, other stakeholders, and administrators,
provides a useful example of “real world” issues
in evaluation.
Worthen, Blaine R., James R. Sanders, and
Jody Fitzpatrick 1997 Program Evaluation:
Alternative Approaches and Practical Guidelines,
2nd Edition, Longman Inc., White Plains, NY
This book serves as a reference guide for practicing
evaluators and those professionals who want
a comprehensive overview of program evaluation
and references to additional information. It
covers the following topics: Evaluation approaches
and models Collection, analysis and use of qualitative
and quantitative data Practical guidelines for
planning, conducting and using evaluations,
including checklists and procedural guides,
Glossary of evaluation terminology
Worthern, B & Sanders, J. 1987 Educational
Evaluation: Alternative Approaches and Practical
Guidelines, Longman, Inc. New York
Yin, R. 1989 Case Study Research, Sage,
Newbury Park, CA
The author’s background in experimental psychology
may explain the emphasis in this book on the
use of rigorous methods in the conduct and analysis
of case studies, thus minimizing what many believe
is a spurious distinction between quantitative
and qualitative studies. While arguing eloquently
that case studies are an important tool when
an investigator has little control over events
and when that focus is on a contemporary phenomenon
within some real-life context, the author insists
that case studies be designed and analyzed so
as to provide generalizable findings. Although
the focus is on designing and analysis, data
collection and report writing are also covered.
ADPC
2002
Guidelines for Safer Cities: Case Studies
on Mitigating Disasters in Asia and the Pacific,
January 2002, Asian Urban Disaster Mitigation
Program, Asian Disaster Preparedness Center,
Bangkok
ADPC 2002
Safer Cities 1: Community Based Initiatives
in Kathmandu Valley, January 2002, Asian
Urban Disaster Mitigation Program, Asian Disaster
Preparedness Center, Bangkok
Alimuddin, S., Hasan, A. and Sadiq, A.
The work of the Anjuman Samaji Behbood and the
larger Faisalabad context , Pakistan: IIED
Working Paper 7 on Poverty Reduction in
Urban Areas
Bhatt, M.R.
Disaster Mitigation, Social Security &
Microfinance: What Works at Community Level
http://www.proventionconsortium.org/files/microfin_020200/bhatt.pdf
Buckle Philip, 2000
New approaches to assessing vulnerability
and resilience in Australian Journal of Emergency
Management winter 2000
Damian, Catherine.
Developing a Culture of Safety at the community
level: Case Studies from The Philippines and
Colombia.
Harun-AL-Rashid, A.K.M. 1997
The Cyclone Preparedness Programme in Bangladesh,
Regional Course on Community Based Approaches
in Disaster Management (CBDM-1) ADPC,
AIT, Bangkok, Thailand.
Khan, Abdul Latif. 1998
Community Based Disaster Management : A
Case Study on Bangladesh Flood’98
Mitlin, Diana and Patel, Sheela. 2001.
The work of SPARC, the National Slum Dwellers
Federation and Mahila Milan :
Working Paper Series on Poverty Reduction
in Urban Areas. Human Settlements Programme,
London www.iied.org
Rogala, J. L. 2001 In the Face of Danger
Community-Based Disaster Preparedness in
Security Products, pp 20-24
Sanderson, David 2000
Cities, Disasters and Livelihoods in Environment
& Urbanization Vol.12 No.2 October 2000
Trauth, J. M.
A Case Study of Health Risk Communication:
What the Public Wants and What it Gets.
World Bank 1994
Building Evaluation Capacity: Lessons and
Practices Number 4, Operations Evaluation
Department, the World Bank.
World Bank 2000
Lessons on Community Driven Development:
Lessons and Practices Number 12, Operations
Evaluation Department, the World Bank
|
