Monitoring and evaluation

Essays on humanitarian effectiveness

Fernando Espada (Ed.)

The five essays that form this collection are the result of extensive desk and field research carried out in nine countries: Bangladesh, India, Nepal; Jordan, Lebanon, Turkey; Liberia; Niger; and the Philippines. The essays are part of a project by Save The Children’s Humanitarian Affairs Team, in partnership with the Humanitarian and Conflict Response Institute at the ...» more

When and how to develop an impact-oriented monitoring and evaluation system

Greet Peersman et al.

This guidance note was developed in response to a common challenge experienced by organisations whereby they commission an impact evaluation at the end of intervention only to find that there is insufficient data about implementation, context, baselines or interim results. Dealing with impact – if deemed relevant to the type of intervention – early on in the intervention cycle ...» more

Evaluating digital citizen engagement: A practical guide

Digital Engagement Evaluation Team

This guide provides practical steps to assess the extent to which digital tools have contributed to citizen engagement, and to understand the impact that the introduction of technology has had on the engagement processes. The guide draws on examples and lessons from case studies from Brazil, Uganda, Cameroon and Kenya. It can be used at many stages— to inform project design, as ...» more

Balancing inclusiveness, rigour and feasibility: Insights from participatory impact evaluations in Ghana and Vietnam

Adinda Van Hemelrijck and Irene Guijt

How can we ensure that impact evaluation of complex programmes is rigorous and inclusive, and triggers reflection and learning about contributions, while also remaining feasible? This paper reflects on piloting a Participatory Impact Assessment and Learning Approach (PIALA) to assess the impacts of two pilot government livelihood programmes. It explores trade-offs in rigour, ...» more

Public sector management reform in developing countries: Perspectives beyond NPM orthodoxy

Derick W. Brinkerhoff and Jennifer M. Brinkerhoff

What alternative frameworks for theory and practice offer insights and guidance beyond the new public management (NPM) orthodoxy? This article offers some answers to this question. It is the introduction to a special issue of the journal Public Administration and Development titled ‘Beyond conventional public sector management reforms in developing countries’, and includes ...» more

NIMD Country Programme evaluation

Laure-Hélène Piron

The Netherlands Institute for Multiparty Democracy commissioned an institutional evaluation of the period 2011–2014, with a focus on three country programmes (Georgia, Guatemala and Mali). The first objective of the evaluation was to assess the extent to which NIMD achieved results in the period 2011–2014. The second objective was to assess the extent to which the NIMD ...» more

Improving education outcomes by linking payments to results: an assessment of disbursement-linked indicators in five results-based approaches.

Sarah Holzapfel & Heiner Janus

What are good indicators and how can they be selected? While results-based approaches are gaining popularity with donors and partner countries, there remains a question of whether they deliver higher returns than traditional aid modalities. This paper argues that the quality of indicators may determine the success of results-based approaches; the link between disbursement of ...» more

Addressing gender in impact evaluation: what should be considered?

Gillian Fletcher

This paper guides development practitioners and evaluators in how to assess the way in which development interventions engage with gender, whether recognised or not, and their impact. It suggests that understanding gender as a process of judgement and value related to stereotypes and norms, rather than a category, underpins the collection of meaningful data on gender-related ...» more

Strategy testing: an innovative approach to monitoring highly flexible aid programs

Debra Ladner

How can we develop a rigorous and meaningful monitoring system that will support, rather than hinder, a flexible, adaptive programme approach? This paper outlines the Strategy Testing (ST) approach The Asia Foundation has developed in response to this question. It finds that ST is a promising monitoring approach, contributing to broader efforts to reorient development ...» more

Designing and monitoring PFM reform programmes

The PEFA framework is the most comprehensive assessment instrument. It provides indicators to measure all dimensions of a PFM system. While PEFA assessments are now in wide usage, other diagnostic instruments and tools – like the IMF Fiscal Transparency Code and various World Bank and OECD tools – are used alongside them for more specific purposes. Alternatively, ...» more

Public financial management

PFM: Why does it matter and how best to improve it? What is Public Financial Management (PFM)? PFM refers to the set of laws, rules, systems and processes used by sovereign nations (and sub-national governments), to mobilise revenue, allocate public funds, undertake public spending, account for funds and audit results. It encompasses a broader set…» more

Lessons from Female Engagement Teams

Evaluations of Female Engagement Teams (FETs) used by the military to engage with women in Afghanistan that are available indicate that: Female soldiers have had a deescalating effect as Afghan males generally accepted females being searched as long as it was done by other females. FETs have had positive engagement with both women and men and were viewed as a kind of ‘third ...» more

Social media and conflict management in post-conflict and fragile contexts

Some of the roles social media has played in conflict management include: In some cases social media and other new media tools have been used to help hold governments accountable, bring citizens together to protest violence, coordinate relief efforts, empower citizens, provide information to reduce tensions, and build bridges of understanding across boundaries. In other cases ...» more

Better Value for Money: An organising framework for management and measurement of VFM indicators

Julian Barr, Angela Christie

This paper provides an organising framework that attempts to provide a means to better understand, express and enable judgements to be reached on Value for Money (VFM) in development programmes.The framework is based on, but evolves around the 4Es approach (Economy, Efficiency and Effectiveness and Equity). It aims to do two things: bring the dimensions of value ...» more

Lessons on Lessons: Why we haven’t learnt anything new for 68 years

Stabilisation Unit

This lessons brief is a summary of a workshop given by Dr. Robert Lamb in conjunction with the Stabilisation Unit. The workshop discussed how to identify recurrent systemic failures in lesson learning within fragile states and consider how they can best be addressed. The presentation systematically reviewed ‘lessons’ research since 1949 and established that researchers have ...» more

Evaluating protection in humanitarian action: Issues and challenges

Francesca Bonino

This paper attempts to identify the issues and challenges relating to the evaluation of protection work carried out by humanitarian actors, including those both with and without a specific protection mandate. It excludes literature and practice on the Responsibility to Protect doctrine and work carried out specifically in the context of human rights, legal or prosecutory ...» more

Using Action Research and Learning for Politically Informed Programming

Michael O'Keefe et al.

This Research Paper outlines preliminary findings about how action research can help build more politically informed development programs. It discusses action research being undertaken by the Pacific Leadership Program, the Coalitions for Change program in the Philippines, and DLP. This approach combines theory and practice to support development practitioners to think and ...» more

What evidence is available and what is required, in humanitarian assistance?

Mike Clarke et al.

This paper investigates the current landscape of evidence in the humanitarian sector, with particular emphasis on evidence from impact evaluation. This is in an attempt to identify areas in which actionable evidence is available and those where more evidence is needed, so as to direct research to where it will be most valuable. It finds a paucity of evidence in most areas, ...» more