OXFAM GB S GLOBAL PERFORMANCE FRAMEWORK:

Size: px
Start display at page:

Download "OXFAM GB S GLOBAL PERFORMANCE FRAMEWORK:"

Transcription

1 OXFAM GB S GLOBAL PERFORMANCE FRAMEWORK: CAPTURING AND COMMUNICATING OUR EFFECTIVENESS Claire Hutchings

2 Oxfam Great Britain Who we are Part of the Oxfam family an international confederation of 17 organizations (affiliates) networked together in over 100 countries. Page 2

3 THE DRIVERS shifts in external environment - need to be able to capture and communicate organisational impact for strategic financing / accountability Diverse portfolio of rights based programming learning account -ability Mixed quality of evaluations - limited institutional knowledge of what works, how, for whom, under which conditions, and for what cost time and resource constraints require a practical, proportional approach to access credible intervention effectiveness feedback Page 3

4 GLOBAL PERFORMANCE FRAMEWORK Global Output Reporting (GOR) Project Effectiveness Reviews Demonstrating the scale and much of the diversity of what we do (all relevant projects) The Global Performance Framework (GPF) Demonstrating our effectiveness reliable, credible evidence (random sample of mature projects) Page 4

5 THEMATIC AREAS Policy Influencing Humanitarian Assistance Citizen s Voice Livelihoods Support Women s Empowerment Resilience Accountability Page 5

6 OUTPUT INDICATORS Humanitarian Support Total number of people provided with appropriate humanitarian assistance, disaggregated by sex Adaptation & Risk Reduction # of people supported to understand current and likely future hazards, reduce risk, and/or adapt to climatic changes and uncertainty, disaggregated Livelihoods # of women and men directly supported to increase income via enhancing production and/or market access Women's Empowerment # of people reached to enable women to gain increased control over factors affecting their own priorities and interests Citizen s Voice Degree to which interventions have contributed to enabling citizens to hold duty bearers to account Policy Influencing Degree to which interventions have contributed to influencing pro-poor policy change OUTCOME INDICATORS Degree to which humanitarian responses meet agreed quality standards for humanitarian % of supported households demonstrating greater ability to minimise risk from shocks and adapt to emerging trends & uncertainty % of supported households demonstrating greater income, measured by daily consumption &expenditure per capita % of women demonstrating greater empowerment at household, community, and institutional levels # supported to engage with state / other relevant actors; and b) duty bearers benefiting from capacity support Number of campaign actions directly undertaken or supported Accountability (cross-cutting) Degree to which programmes meet Oxfam s Programme Standards Page 6

7 Only one part of Oxfam S MEAL system OXFAM REFLECTS Regional Reviews Audits Country Reviews Programme Monitoring Reviews BASELINES Learning feeds into planning 7 Page 7

8 A closer look at the working parts... Global Output reporting Effectiveness Reviews Page 8

9 GLOBAL OUTPUT REPORTING

10 What is Global Output Reporting? Annual beneficiary/output information from all active projects Demonstrates the scale and much of the diversity of what we do 36 indicators across six thematic areas, in addition to total direct / indirect beneficiaries Started in 2010/11 now going into its fourth year Page 10

11 EXAMPLE OUTPUTS: PRACTICALITIES Page 11

12 Page 12

13 EFFECTIVENESS REVIEWS

14 EFFECTIVENESS REVIEW PROJECT SELECTION c LIVE PROJECTS c. 300 OVER > 2.5 YEARS OLD c. 100 > 250k c. 20 SELECTED FOR EFFECTIVENESS REVIEWS Page 14

15 MEASURING IMPACT? The Conventional NGO approach: Endline indicator reading Baseline indicator reading Change achieved Feedback OK but not reliable for most interventions Page 15

16 CONTRIBUTION/ ATTRIBUTION CHALLENGE Oxfam Intervention Positive Change in desired outcomes Association does not necessarily imply causation Contribution of Other Factors? Page 16

17 Large N Interventions OUTPUT INDICATORS Humanitarian Support Total number of people provided with appropriate humanitarian assistance, disaggregated by sex Adaptation & Risk Reduction Resilience # of people supported to understand current and likely future hazards, reduce risk, and/or adapt to climatic changes and uncertainty, disaggregated by sex Livelihoods # of women and men directly supported to increase income via enhancing production and/or market Livelihoods access Women's Empowerment # of people reached to enable women to gain increased control over factors affecting their own priorities and interests Empowerment Citizen s Voice # of a) citizens, CBO members and CSO staff supported to engage with state institutions/ other relevant actors; and b) duty bearers benefiting from capacity support OUTCOME INDICATORS Degree to which humanitarian responses meet agreed quality standards for humanitarian programming (e.g. Sphere guidelines) % of supported households demonstrating greater Mimic ability randomisation to minimise risk from through shocks and adapt to emerging trends & uncertainty use of comparison groups combined with techniques such % of supported households demonstrating greater as propensity income, as measured score matching by daily consumption and expenditure per capita to control for hopefully most of the relevant differences % of supported women demonstrating greater empowerment between at household, them community, and institutional levels Degree to which interventions have contributed to enabling citizens to hold duty bearers to account Policy Influencing Number of campaign actions directly undertaken or supported, e.g. contacts made with policy targets, online and offline actions taken, media coverage, publications, and specific events held Accountability (cross-cutting) Degree to which programmes meet Oxfam s Programme Standards Degree to which interventions have contributed to influencing pro-poor policy change Page 17

18 Small N Interventions OUTPUT INDICATORS Humanitarian Support Total number of people provided with appropriate humanitarian assistance, disaggregated by sex Adaptation & Risk Reduction # of people supported to understand current and likely future hazards, reduce risk, and/or adapt to climatic changes and uncertainty, disaggregated by sex Livelihoods # of women and men directly supported to increase income via enhancing production and/or market access Women's Empowerment # of people reached to enable women to gain increased control over factors affecting their own priorities and interests Citizen s Voice # of a) citizens, CBO members and CSO staff supported to engage with state institutions/ other relevant actors; and b) Citizen Voice duty bearers benefiting from capacity support Policy Influencing Number of campaign actions directly undertaken or supported, e.g. contacts made with Policy policy Influencing targets, online and offline actions taken, media coverage, publications, and specific events held Accountability (cross-cutting) Degree to which programmes meet Oxfam s Programme Standards OUTCOME INDICATORS Degree to which humanitarian responses meet agreed quality standards for humanitarian programming (e.g. Sphere guidelines) % of supported households demonstrating greater ability to minimise risk from shocks and adapt to emerging trends & uncertainty % of supported households demonstrating greater income, as measured by daily consumption and expenditure per capita % of supported women demonstrating greater empowerment at household, community, and institutional levels Degree to which interventions have contributed to enabling Non-counterfactual citizens to hold duty approach bearers to to account causal inference (process tracing) to explore significance of interventions contribution to observed outcomes. Degree to which interventions have contributed to influencing pro-poor policy change Page 18

19 MEASURING & EVALUATING RESILIENCE

20 RESILIENCE MEASUREMENT: THE CHALLENGE Complex, multi-dimensional concept Contextually dependent Need to evaluate resilience-building work even in the absence of a shock. Page 20

21 Examples of Indicators Dimensions RESILIENCE FRAMEWORK Livelihood viability Innovation potential Access to contingency resources & support Integrity of the natural & built environment Social & institutional capability Ownership of productive assets Diversification: Crop types Livestock types Other livelihoods Access to markets Use of improved crop & livestock management techniques Access to vaccination Access to veterinary care Access to credit Attitudes towards new livelihood practices Adoption of innovative practices Awareness of climate change Access to a grain bank Savings Access to remittances or formal earnings Ownership of small livestock Social support networks Access to medical care Access to irrigation Damage to soil Access to desalination pump Access to safe drinking water source Access to agricultural & livestock extension services Risk-reduction activities in community Possession of CNIC card Confidence in local leaders accessing support from government/ngos Confidence in government structures to deal with crises Social cohesion in community Page 21

22 PROCESS Identify appropriate characteristics of resilience. Define what it means to score positively in terms of each characteristic. Collect data from intervention and comparison group. Aggregation: count the number of characteristics in which each household scores positively. Compare outcomes for intervention and comparison group (regression and/or propensity-score matching) Page 22

23 REMAINING CHALLENGES Assumptions about resilience characteristics and thresholds not tested Reliance on perception-based indicators Intra-household level Evaluating against resilience overall v. evaluating against project objectives Using PSM or regression modeling without a baseline is not ideal. Page 23

24 MEASURING POLICY INFLUENCE PROCESS TRACING PROTOCOL

25 PROCESS TRACING Investigating causal inference: 1. Understand whether and to what extent the outcome has materialised 2. Consider the evidence supporting different causal stories or explanatory hypotheses to build an understanding of "how change happened", with the intervention just one possible contributing factor 3. Where the evidence supports a causal relationship between the intervention and the outcome - determine the significance of the intervention s contribution in light of other contributing factors Page 25

26 ADAPTATION OF PROCESS TRACING (MAIN STEPS FOR RESEARCHERS) 1. Specify outcomes the intervention is seeking to achieve (explicit theory of change). 2. Assess and document what was done to achieve the targeted outcomes. 3. Examine the extent the targeted outcomes have actually materialised, as well as any unintended outcomes. 4. Undertake process induction to identify all salient, plausible causal explanations ( causal stories ) for each materialised outcome. 5. Use process verification to assess the extent each causal story is supported or not by the available evidence signatures, footprints. Page 26

27 Gender Mainstreamed into the Departmental Statute of Autonomy The Women s Platform (Oxfam and its IFFI) advocacy efforts Approval of the National Political Constitution (incorporation of gender equity) Departmental Federation of Indigenous and Rural Women of Bolivia Page 27

28 PROBATIVE TESTS Conducting probative tests on available evidence/ causal-process observations (aka clues ) can help to support or overturn explanatory hypotheses Sufficient to Establish Causation Necessary to Establish Causation No No Straw in the Wind May increase the plausibility of a given hypothesis, or raise doubts about it, but are not decisive by themselves Yes Smoking Gun Passing confirm the hypothesis, but does not eliminate others Yes Hoop tests cannot provide direct support for a hypothesis, but can eliminate a hypothesis Doubly decisive confirm one hypothesis and eliminate others Bennett (2010); Van Evera (1997) Page 28

29 WHERE ARE WE NOW? WHAT ARE SOME OF THE OUTSTANDING CHALLENGES?

30 WHERE HAVE WE GOT TO Clear set of Global Indicators (outputs and outcomes, 6 thematic areas, 1 cross-cutting) Piloted and refined measurement approaches, and developed 4 distinct methodologies humanitarian, accountability, development, campaigns/voice - robust, but practical and adaptable Completed 72 evaluations (effectiveness reviews) of randomly selected mature projects & 4 Accountability Reviews Transparent in communicating findings and reflections, the good, the bad and the ugly Developed a management responses system Learning, learning, learning! Page 30

31 PUBLISHING THE GOOD, THE BAD & THE UGLY Page 31

32 LEARNING, LEARNING, LEARNING PERCEIVED USEFULNESS OF EFFECTIVENESS REVIEWS - % of Country/Regional staff seeing as effective for the following purposes Page 32

33 LEARNING, LEARNING, LEARNING CHANGES MADE FOLLOWING EFFECTIVENESS REVIEWS % identifying changes in each category Page 33

34 BALANCING ACCOUNTABILITY & LEARNING learning account -ability Page 34

35 SUMMING IT UP (EXAMPLE FROM LIVELIHOODS GLOBAL INDICATOR: % of supported households demonstrating greater income) Year Global indicator (percentage points) 2011/12 aggregate /13 aggregate /14 aggregate 14.3 Year Country Weight (sample frame) Global indicator (percentage points) 2011/12 Zimbabwe /12 Uganda /12 DRC /12 Haiti /12 Nicaragua /13 Georgia /13 Liberia /13 Vietnam /13 Sri Lanka /14 Armenia /14 Colombia /14 Honduras /14 Zimbabwe Page 35

36 SUMMING IT UP... CHALLENGE % of supported households demonstrating greater income, measured by daily consumption &expenditure per capita Agricultural Inputs Enterprise Development Micro-Credit Page 36

37 Key Emerging Issues Priority Uses of Performance Reporting - balance between evaluation, accountability, and learning Rigour vs breadth, intervention vs institutional learning, random selection vs learning priorities, standardisation/ aggregation vs contextualisation More coherent approach to evaluation - link between rigorous, centrally managed &funded Effectiveness Reviews, and wider portfolio of country led evaluations Funding of Effectiveness Reviews - could project planning and budgeting processes be adapted to enable Effectiveness Reviews be funded from project funding Enhancing Institutional Learning strengths/ weaknesses, prioritisation Transition to Oxfam How should GPF processes evolve to align with emerging OI-wide processes Page 39

Oxfam Management response to the review of Resilience in Nepal: Impact evaluation of the Joint Programme on Risk Management and Humanitarian Preparedness (Effectiveness Review Series 2015/16) Prepared

More information

Oxfam Management response to the review of Resilience in Thailand: Impact evaluation of the climate change community-based adaptation model for food security project (Effectiveness Review Series 2014/15)

More information

Oxfam Management response to the review of Resilience in Ethiopia and Somaliland - Impact evaluation of the Reconstruction Project: Development of enabling conditions for pastoralist and agro-pastoralist

More information

Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review

Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review Summary Report Photo: Women from Dolakot village construct a pond to irrigate their land, Oxfam GB Oxfam GB Adaptation

More information

CDS Briefing Paper. The Qualitative Impact Assessment Protocol (QUIP)

CDS Briefing Paper. The Qualitative Impact Assessment Protocol (QUIP) April 2015 CDS Briefing Paper The Qualitative Impact Assessment Protocol (QUIP) This brief presents an overview of the QUIP in three steps: the background to the QUIP and its main aims; the data collection

More information

CDS Briefing Paper. The Qualitative Impact Assessment Protocol (QUIP)

CDS Briefing Paper. The Qualitative Impact Assessment Protocol (QUIP) August 2015 CDS Briefing Paper The Qualitative Impact Assessment Protocol (QUIP) This brief presents an overview of the QUIP in three steps: the background to the QUIP and its main aims; the data collection

More information

Summary report of the P4P Instrument Review workshop,

Summary report of the P4P Instrument Review workshop, Summary report of the P4P Instrument Review workshop, Nairobi, 4-5 February 2013 hosted by the African Economic Research Consortium Introduction In September 2008, WFP launched an innovative agricultural

More information

Job Profile. JOB FAMILY: Program

Job Profile. JOB FAMILY: Program JOB TITLE: PROGRAM MANAGER LIVELIHOODS RESILIENCE (LR) DIVISION / DEPARTMENT / LOCATION: International/ Southern African Region/ Malawi Country Program/ Lilongwe JOB FAMILY: Program SALARY : TBA LEVEL:

More information

Core principles for assessing effectiveness: A NGO approach to evidencing change

Core principles for assessing effectiveness: A NGO approach to evidencing change Core principles for assessing effectiveness: A NGO approach to evidencing change DRAFT II (revised based on feedback in October 2011) Bond Effectiveness Programme / PPA Learning Group on measuring empowerment

More information

Terms of Reference. Innovative Models of Livelihood Interventions in Diyala and KRI

Terms of Reference. Innovative Models of Livelihood Interventions in Diyala and KRI Terms of Reference Household Economy Analysis (HEA) and Baseline Assessment for Building Resilience through Innovative Models of Livelihoods and Market Interventions in Iraq Organization Oxfam GB Country

More information

Towards Gender-Transformative Outcomes from CIF Investments in Renewable Energy

Towards Gender-Transformative Outcomes from CIF Investments in Renewable Energy Towards Gender-Transformative Outcomes from CIF Investments in Renewable Energy Anne T. Kuriakose, Ph.D. Sr. Gender Specialist Phnom Penh -SREP Pilot Countries Meeting Feb 2, 2016 Outline of Presentation

More information

Economics Training Series Introductory Course. Project Impact Evaluation Design

Economics Training Series Introductory Course. Project Impact Evaluation Design Economics Training Series Introductory Course Project Impact Evaluation Design Outline 1. What is project impact evaluation? 2. Methods of project impact evaluation? 3. Operational implications. Project

More information

Technical Note Integrating Gender in WFP Evaluations

Technical Note Integrating Gender in WFP Evaluations Technical Note Integrating Gender in WFP Evaluations Version September 2017 1. Purpose of this Technical Note 1. This technical note shows how gender equality and empowerment of women (GEEW), hereafter

More information

Impact Evaluation Objectives and Design

Impact Evaluation Objectives and Design Impact Evaluation Objectives and Design Laura B. Rawlings World Bank Second International Workshop on Conditional Cash Transfer Programs Sao Paulo, Brazil - April 2004 Outline Monitoring vs. Evaluation

More information

HEA for Resilience Measurement: Opportunities, Challenges and Trends Observed

HEA for Resilience Measurement: Opportunities, Challenges and Trends Observed www.hea-sahel.org HEA for Resilience Measurement: Opportunities, Challenges and Trends Observed 29th Meeting of RPCA Abidjan, 26 November, 2013 Amadou DIOP & David MATYAS Identifying Common Problems with

More information

Module 6 Introduction to Measurement

Module 6 Introduction to Measurement Module 6 Introduction to Measurement 1 Module Objectives By the end of this module participants will be able to: 1 2 Make initial decisions regarding when you need to collect data and on whom or what you

More information

Guidance Note 3 Introduction to Mixed Methods in Impact Evaluation. Michael Bamberger Independent Consultant

Guidance Note 3 Introduction to Mixed Methods in Impact Evaluation. Michael Bamberger Independent Consultant Guidance Note 3 Introduction to Mixed Methods in Impact Evaluation Michael Bamberger Independent Consultant Outline 2 A. Why mixed methods (MM)? B. Four decisions for designing a MM evaluation C. Using

More information

RESILIENCE IN THAILAND

RESILIENCE IN THAILAND EVALUATION: DECEMBER 2014 PUBLICATION: DECEMBER 2015 RESILIENCE IN THAILAND Impact evaluation of the climate change community- Effectiveness Review Series 2014/ based adaptation model for food security

More information

Costa Rica Panama El Salvador Guatemala Nicaragua Honduras

Costa Rica Panama El Salvador Guatemala Nicaragua Honduras 8000 7000 6000 5000 4000 3600 3000 2000 1600 1000 0 Costa Rica Panama El Salvador Guatemala Nicaragua Honduras 22 Synopsis of Swiss Cooperation Strategy for Central America 2013-2017

More information

LIVELIHOODS IN THE PHILIPPINES

LIVELIHOODS IN THE PHILIPPINES EVALUATION: FEBRUARY 2015 PUBLICATION: NOVEMBER 2015 LIVELIHOODS IN THE PHILIPPINES Impact evaluation of the project Scaling up sustainable livelihoods in Mindanao Effectiveness Review Series 2014/15 Photo

More information

Oxfam GB s Attempt to Measure Resilience. Karl Hughes Oxfam GB AEA October 2012

Oxfam GB s Attempt to Measure Resilience. Karl Hughes Oxfam GB AEA October 2012 Oxfam GB s Attempt to Measure Resilience Karl Hughes Oxfam GB AEA October 2012 Presentation Outline: Part A: Conceptual Framework Part B: Application to Assess Impact Part C: Improving Measurement with

More information

Toolkit for Impact Evaluation of Public Credit Guarantee Schemes for SMEs (Preliminary)

Toolkit for Impact Evaluation of Public Credit Guarantee Schemes for SMEs (Preliminary) Toolkit for Impact Evaluation of Public Credit Guarantee Schemes for SMEs (Preliminary) Madrid June 2, 2017 Pietro Calice Finance & Markets Global Practice World Bank Group Outline of the Presentation

More information

EVALUATION OFFICE. Global Evaluation Reports Oversight System (GEROS)

EVALUATION OFFICE. Global Evaluation Reports Oversight System (GEROS) EVALUATION OFFICE Global Evaluation Reports Oversight System (GEROS) JANUARY 2013 2 Introduction and justification The evaluation function seeks to strategically contribute to UNICEF s performance by providing

More information

A GLOBAL WATER AND SANITATION SYSTEM THAT WORKS FOR ALL

A GLOBAL WATER AND SANITATION SYSTEM THAT WORKS FOR ALL A GLOBAL WATER AND SANITATION SYSTEM THAT WORKS FOR ALL Oxfam GB s Sustainable Water and Sanitation Strategy A global water and sanitation system that works for all 1 OUR STRATEGIC AIMS Oxfam aims to work

More information

Reducing Rural Poverty: Social Protection, Access and Decent Employment

Reducing Rural Poverty: Social Protection, Access and Decent Employment Reducing Rural Poverty: Social Protection, Access and Decent Employment Natalia Winder Rossi Deputy Director (a.i) Social Policies and Rural Institutions Division Social Protection Team Leader, FAO New

More information

Resilience Marker. Guidance note 1. INTRODUCTION

Resilience Marker. Guidance note 1. INTRODUCTION Resilience Marker Guidance note 1. INTRODUCTION This guidance document provides additional information and explanation on using the Resilience Marker Vetting Form. Increasing Resilience is one of three

More information

RECOMMENDED 140/155=90%

RECOMMENDED 140/155=90% 1. Overview Program Market Development Facility Sri Lanka Audit visit dates 22 May 26 May 2017 Overall final ratings 1 MUST 501/540=93% RECOMMENDED 140/155=90% Coverage Diversifying Tourism Destinations,

More information

Oxfam GB Humanitarian Quality Assessment Management Response

Oxfam GB Humanitarian Quality Assessment Management Response Oxfam GB Humanitarian Quality Assessment Management Response Regional Director: Olga Ghazaryan Country Director: Geoffrey Poynter Name of Response reviewed: Syria crisis in Jordan Date: 02 October 2014

More information

Integrating Gender Equality and Women s Empowerment into an Activity, Programme or Policy

Integrating Gender Equality and Women s Empowerment into an Activity, Programme or Policy Integrating Gender Equality and Women s Empowerment into an Activity, Programme or Policy GENDER ANALYSIS GUIDELINE Last updated: 18 September 2012 Overview When to use This tool provides guidance to integrate

More information

What is impact evaluation, when and how should we use it, and how to go about it?

What is impact evaluation, when and how should we use it, and how to go about it? What is impact evaluation, when and how should we use it, and how to go about it? ADB December 17, 2009 International Initiative for Impact Evaluation What is impact? Impact = the outcome with the intervention

More information

UNICEF Global Evaluation Report Oversight System (GEROS) Review Template

UNICEF Global Evaluation Report Oversight System (GEROS) Review Template UNICEF Global Evaluation Report Oversight System (GEROS) Review Template Colour Coding CC Dark green Green Amber Red White Questions Outstanding t Applicable Section & Overall Rating Very Confident to

More information

Career Opportunity at CARE International in Uganda

Career Opportunity at CARE International in Uganda Career Opportunity at CARE International in Uganda About CARE International CARE International has been active in Uganda since 1969 and working in the country continuously since 1979, implementing a diverse

More information

Delivering Opportunities to Youth in Northern Uganda

Delivering Opportunities to Youth in Northern Uganda Delivering Opportunities to Youth in Northern Uganda Short Term Impacts of NUSAF YOP on Non-Migrant Youth* Christopher Blattman, Yale University Nathan Fiala, World Bank Sebastian Martinez, World Bank

More information

GEROS Evaluation Quality Assurance Tool Version

GEROS Evaluation Quality Assurance Tool Version GEROS Evaluation Quality Assurance Tool Version 2016.4 Title of the Evaluation Report Report sequence number Reviewers: complete all cells highlighted in Yellow Support to community sanitation in eastern

More information

Working Conditions KPIs, sub-indicators and definitions

Working Conditions KPIs, sub-indicators and definitions Working Conditions KPIs, sub-indicators and definitions Standard KPI Sub-indicator, to be included along with the KPI, where relevant Working Conditions KPI / sub-indicator(s) KPI #1. Number of workers

More information

Strengthening the resilience of livelihood in protracted crises in the Democratic Republic of the Congo, The Niger and Somalia

Strengthening the resilience of livelihood in protracted crises in the Democratic Republic of the Congo, The Niger and Somalia Strengthening the resilience of livelihood in protracted crises in the Democratic Republic of the Congo, The Niger and Somalia Why is the RBA Resilience Initiative Innovative? The government of Canada

More information

Terms of reference for the baseline survey on Sexual and Reproductive Health Rights in Rwanda

Terms of reference for the baseline survey on Sexual and Reproductive Health Rights in Rwanda Terms of reference for the baseline survey on Sexual and Reproductive Health Rights in Rwanda 1. Introduction and background OXFAM is a development, humanitarian and campaigning international confederation

More information

Evaluation Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review Full Technical Report

Evaluation Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review Full Technical Report Evaluation Climate Change Adaptation and Advocacy Project in Nepal Project Effectiveness Review Full Technical Report Oxfam GB Adaptation and Risk Reduction Outcome indicator April, 2013 Acknowledgements

More information

SOCIAL ACCOUNTABILITY IN TAJIKISTAN

SOCIAL ACCOUNTABILITY IN TAJIKISTAN OXFAM CASE STUDY MARCH 2017 CAB members, head of service provider, members of government agencies, NGOs and women s committee with a banner which reads Transparency, accountability and citizen participation

More information

INTRODUCTION AND OVERVIEW. FAQs

INTRODUCTION AND OVERVIEW. FAQs J a n u a r y 2 0 1 3 INTRODUCTION AND OVERVIEW The Programme Partnership Arrangements (PPAs) are one of DFID s main support mechanisms to Civil Society Organisations. From 2011 to 2014, DFID will provide

More information

Estimating household and individual level impacts: the experience of Kenya

Estimating household and individual level impacts: the experience of Kenya Estimating household and individual level impacts: the experience of Kenya Solomon Asfaw Food and Agricultural Organization (FAO) Agricultural Development Economics Division (ESA) Rome, Italy Outline of

More information

Positions required: A team of consultancy with one Lead Consultant and one Qualitative Research Assistant

Positions required: A team of consultancy with one Lead Consultant and one Qualitative Research Assistant Terms of Reference for Gender Transformative and Responsible Agribusiness Investments in South East Asia II (GRAISEA 2) Baseline Study in Vietnam: Farmer Survey and Focus Group Discussion Positions required:

More information

Monitoring and Evaluation Policy

Monitoring and Evaluation Policy Monitoring and Evaluation Policy 1 M&E Policy Last Updated October 2017 1. Introduction The Monitoring and Evaluation (M&E) policy will apply to the global C&A Foundation including Fundación C&A in Mexico

More information

Module 13 Gender in Evaluation

Module 13 Gender in Evaluation Module 13 Gender in Evaluation ADS References for this Module ADS Reference ADS 205.3.1 ADS 205.3.2 ADS 205.3.6.2 Topic or Issue Differences in the status of women and men and their differential access

More information

Integrating a gender perspective to help scale Africa RISING technologies and practices: Requirements for proposal development and implementation

Integrating a gender perspective to help scale Africa RISING technologies and practices: Requirements for proposal development and implementation Integrating a gender perspective to help scale Africa RISING technologies and practices: Requirements for proposal development and implementation Annet A. Mulema Produced by Published by International

More information

Making the choice: Decentralized Evaluation or Review? (Orientation note) Draft for comments

Making the choice: Decentralized Evaluation or Review? (Orientation note) Draft for comments Introduction Making the choice: Decentralized Evaluation or Review? (Orientation note) Draft for comments 1. WFP stands in the frontline of the global fight against hunger. Its operational decisions which

More information

OXFAM CASE STUDY JULY Women members of the Azatek cooperative sort their tomato harvest beside their new greenhouse. Beniamin Gazaryan/Oxfam

OXFAM CASE STUDY JULY Women members of the Azatek cooperative sort their tomato harvest beside their new greenhouse. Beniamin Gazaryan/Oxfam OXFAM CASE STUDY JULY 2015 Women members of the Azatek cooperative sort their tomato harvest beside their new greenhouse. Beniamin Gazaryan/Oxfam WOMEN S ECONOMIC EMPOWERMENT AND LEADERSHIP IN ARMENIA

More information

Working Party on Aid Evaluation

Working Party on Aid Evaluation For Official Use DCD/DAC/EV(2001)3 DCD/DAC/EV(2001)3 For Official Use Organisation de Coopération et de Développement Economiques Organisation for Economic Co-operation and Development 24-Apr-2001 English

More information

Assessing the downstream socioeconomic and land health impacts of agroforestry in Kenya

Assessing the downstream socioeconomic and land health impacts of agroforestry in Kenya Assessing the downstream socioeconomic and land health impacts of agroforestry in Kenya Inception Workshop on Under-evaluated Areas of CGIAR Research Organized by the CGIAR Independent Science and Partnership

More information

Strengthening Resilience in Tsunami-affected Communities in Sri Lanka and India Getting Started on Monitoring and Evaluation Plans Notes for Partners

Strengthening Resilience in Tsunami-affected Communities in Sri Lanka and India Getting Started on Monitoring and Evaluation Plans Notes for Partners p. 1 Strengthening Resilience in Tsunami-affected Communities in Sri Lanka and India Getting Started on Monitoring and Evaluation Plans Notes for Partners Stephen Tyler, February 2007 1. Introduction Project

More information

GENDER MAINSTREAMING IN THE BUILDING CLIMATE RESILIENCE IN THE PYANJ RIVER BASIN PROJECT

GENDER MAINSTREAMING IN THE BUILDING CLIMATE RESILIENCE IN THE PYANJ RIVER BASIN PROJECT GENDER MAINSTREAMING IN THE BUILDING CLIMATE RESILIENCE IN THE PYANJ RIVER BASIN PROJECT PPCR Pilot Countries Meeting, July 20-23, 2015, Frascati, Italy Jamshed Hasanov PPCR Secretariat Chief Technical

More information

GENDERED ENTERPRISE AND MARKETS PROGRAMME STRATEGIC REVIEW 31 OCTOBER 2016

GENDERED ENTERPRISE AND MARKETS PROGRAMME STRATEGIC REVIEW 31 OCTOBER 2016 GENDERED ENTERPRISE AND MARKETS PROGRAMME STRATEGIC REVIEW 31 OCTOBER 2016 Contents 1. Introduction... 2 2. GEM Vision and Mission... 2 3. Review of DFID-GEM operations to date... 2 4. Shifting Focus A

More information

Gender and Energy: experiences and lessons learned

Gender and Energy: experiences and lessons learned Gender and Energy: experiences and lessons learned Annemarije Kooijman PhD SREP Pilot Countries Meeting Phnom Penh, Cambodia 2 February 2017 Hosted by: Outline Why gender? Introducing ENERGIA : International

More information

Baseline Study on Newly Fairtrade Certified Cocoa Producer Organizations in Côte d Ivoire and Ghana. Terms of Reference - May 2013

Baseline Study on Newly Fairtrade Certified Cocoa Producer Organizations in Côte d Ivoire and Ghana. Terms of Reference - May 2013 Baseline Study on Newly Fairtrade Certified Cocoa Producer Organizations in Côte d Ivoire and Ghana Terms of Reference - May 2013 Fairtrade Africa and Fairtrade International are currently seeking a research

More information

Indicative content of evaluation final reports Draft, Jérémie Toubkiss, Evaluation Office, NYHQ (updated 4 February 2016)

Indicative content of evaluation final reports Draft, Jérémie Toubkiss, Evaluation Office, NYHQ (updated 4 February 2016) Indicative content of evaluation final reports Draft, Jérémie Toubkiss, Evaluation Office, NYHQ (updated 4 February 2016) 0. Opening pages - The first pages provides the key information on the programme

More information

An Agenda for Cash. Part of CaLP s 100 days of cash initiative May Background and introduction

An Agenda for Cash. Part of CaLP s 100 days of cash initiative May Background and introduction An Agenda for Cash Part of CaLP s 100 days of cash initiative May 2016 The Agenda for Cash provides a snapshot of what more than 40 organisations believe needs to change in relation to cash transfer programming

More information

COMMUNITY WATER SUPPLY & SANITATION PROJECT SRI LANKA

COMMUNITY WATER SUPPLY & SANITATION PROJECT SRI LANKA COMMUNITY WATER SUPPLY & SANITATION PROJECT SRI LANKA Sri Lanka PROFILE OF SRI LANKA Sri Lanka : An island nation Land Area : 64,740 sq km Total population : 20.9 million Rural population : 16.4 million

More information

Fairtrade certification in the banana hired labour sector

Fairtrade certification in the banana hired labour sector Fairtrade certification in the banana hired labour sector Study summary and response from the commissioning agencies Fairtrade International and the Fairtrade Foundation to an independent impact study

More information

Measuring Impact Impact Evaluation Methods. Nathan Fiala DIW Berlin March 2014

Measuring Impact Impact Evaluation Methods. Nathan Fiala DIW Berlin March 2014 Measuring Impact Impact Evaluation Methods Nathan Fiala DIW Berlin March 2014 1 Why Evaluate? Refine program design Design new programs Improve program targeting (effectiveness) Identify inefficient programs

More information

Plan UK: Request for Quotation - Year 3 Evaluation and Programme Review (DFID funded PPA Programme)

Plan UK: Request for Quotation - Year 3 Evaluation and Programme Review (DFID funded PPA Programme) Plan UK: Request for Quotation - Year 3 Evaluation and Programme Review (DFID funded PPA Programme) Building Skills for Life: Empowering Adolescent Girls through Education I. SUMMARY This tender invites

More information

ADRA DENMARK CHS Certification Report

ADRA DENMARK CHS Certification Report ADRA DENMARK CHS Certification Report ADK-CER-2017-009 2017-06-17 Table of Contents TABLE OF CONTENTS... 2 1. GENERAL INFORMATION... 3 2. SCOPE... 3 3. SCHEDULE SUMMARY... 4 3.2 VERIFICATION SCHEDULE...

More information

Delivering Sustainable Change: TREE AID s Approach

Delivering Sustainable Change: TREE AID s Approach Delivering Sustainable Change: TREE AID s Approach June 2012 1.1 Sustainability and our Values Our values underpin this policy and our approach to delivering sustainable change. It is worth restating them

More information

RESILIENCE CAPACITIES AND THE GENDER AGENDA: MOVING TOWARDS TRANSFORMATIVE CHANGE

RESILIENCE CAPACITIES AND THE GENDER AGENDA: MOVING TOWARDS TRANSFORMATIVE CHANGE RESILIENCE CAPACITIES AND THE GENDER AGENDA: MOVING TOWARDS TRANSFORMATIVE CHANGE TOPS Knowledge and Learning Event Dhaka, Bangladesh March 4, 2015 Laurie Starr Kristi Tabaj Resilience is the path, not

More information

Concept Note for the financial inclusion of Women entrepreneurs in Nigeria.

Concept Note for the financial inclusion of Women entrepreneurs in Nigeria. Concept Note for the financial inclusion of Women entrepreneurs in Nigeria. Introduction and Background. The relevance of access to financial services for women entrepreneurs to development, poverty reduction,

More information

Call for Expression of Interest

Call for Expression of Interest Call for Expression of Interest Mid term Evaluation Project: Empowerment of Vulnerable Women in Sri Lanka Deadline for submission of Expression of Interest: October 17 th 2014 1. Introduction Empowerment

More information

Department for International Development

Department for International Development INFORMATION ASSURANCE SUMMARY REPORTS Department for International Development The purpose and scope of this review 1 During the period 1 October 2011 to 27 January 2012, the National Audit Office (NAO)

More information

Terms of Reference. Desk review of Gender Equality and Women s Economic Empowerment Issues in Sustainable Rice Production

Terms of Reference. Desk review of Gender Equality and Women s Economic Empowerment Issues in Sustainable Rice Production Terms of Reference Desk review of Gender Equality and Women s Economic Empowerment Issues in Sustainable Rice Production Research Project Manager: Pham Quang Trung, GRAISEA (Rice Value Chain) Regional

More information

Participatory rural planning processes

Participatory rural planning processes Rural Transport Training Materials Module 2: Planning, Design, Appraisal and Implementation Participatory rural planning processes Session 2.1 Part 1 Presentation 2.1a The Training Modules Module1. Policies

More information

RESILIENCE IN ETHIOPIA AND SOMALILAND

RESILIENCE IN ETHIOPIA AND SOMALILAND EVALUATION: NOVEMBER 2015 PUBLICATION: JUNE 2017 RESILIENCE IN ETHIOPIA AND SOMALILAND Impact evaluation of the reconstruction project Development of Enabling Conditions for Pastoralist and Agro-Pastoralist

More information

Empowering Women and Youth in the Malian Dryland Systems - Impact of research technologies diffusion

Empowering Women and Youth in the Malian Dryland Systems - Impact of research technologies diffusion Food security and better livelihoods for rural dryland communities Empowering Women and Youth in the Malian Dryland Systems - Impact of research technologies diffusion Bamako Feb 15, 2017 Djalal Ademonla

More information

Module 4 Deciding to Evaluate: Front-End Analysis

Module 4 Deciding to Evaluate: Front-End Analysis Module 4 Deciding to Evaluate: Front-End Analysis Module Objectives By the end of this module you will be able to: 1 2 3 4 5 6 Identify whether an evaluation may be appropriate for a particular program

More information

MAPPING THE DEVELOPMENT JOURNEY USING LARGE-SCALE SURVEYS TO UNDERSTAND CONTEXT AND ADDRESS LEARNING NEEDS

MAPPING THE DEVELOPMENT JOURNEY USING LARGE-SCALE SURVEYS TO UNDERSTAND CONTEXT AND ADDRESS LEARNING NEEDS MAPPING THE DEVELOPMENT JOURNEY USING LARGE-SCALE SURVEYS TO UNDERSTAND CONTEXT AND ADDRESS LEARNING NEEDS Authors: Ali Hayat (Chief of Party, MESP) and Dan Killian (Technical Manager, MSI) Decision-makers

More information

UNDP-Spain MDG Achievement Fund. Terms of Reference for Thematic Window on Environment and Climate Change

UNDP-Spain MDG Achievement Fund. Terms of Reference for Thematic Window on Environment and Climate Change UNDP-Spain MDG Achievement Fund Terms of Reference for Thematic Window on Environment and Climate Change This document provides policy guidance to UN Country Teams applying for funding under the UNDP-Spain

More information

Terms of Reference (ToR) Right Based Approach Training to NCA Partners Organizations

Terms of Reference (ToR) Right Based Approach Training to NCA Partners Organizations Terms of Reference (ToR) Right Based Approach Training to NCA Partners Organizations 1. Introduction Norwegian Church Aid (NCA) with its long presence (since 1979) in Afghanistan. NCA is a partner based

More information

Increase agricultural production to address soaring food prices through distribution of agricultural inputs. Total cost Total Cost :

Increase agricultural production to address soaring food prices through distribution of agricultural inputs. Total cost Total Cost : ACTION FICHE FOR ERITREA 1. IDENTIFICATION Title/Number Increase agricultural production to address soaring food prices through distribution of agricultural inputs. Total cost Total Cost : 3 400 000 Aid

More information

Livelihoods and Food Security Trust Fund (LIFT)

Livelihoods and Food Security Trust Fund (LIFT) Livelihoods and Food Security Trust Fund (LIFT) Monitoring and Evaluation for Accountability and Learning (MEAL) Framework Revised: 10 February 2016 Table of Contents Executive Summary... 2 1. LIFT MEAL

More information

sustainable solutions to water supply in kenya Resiliencebuilding women s leadership in Bangladesh

sustainable solutions to water supply in kenya Resiliencebuilding women s leadership in Bangladesh sustainable solutions to water supply in kenya Resiliencebuilding and women s leadership in Bangladesh 1 Overview Programme information Name Resilience through Economic Empowerment, Climate Adaptation,

More information

UNICEF-Adapted UNEG Quality Checklist for Evaluation Terms of Reference

UNICEF-Adapted UNEG Quality Checklist for Evaluation Terms of Reference EVALUATION OFFICE UNICEF-Adapted UNEG Quality Checklist for Evaluation Terms of Reference UNICEF/UNI164247/Johansen Updated June 2017 CONTENTS Introduction... 2 1. Evaluation Object... 3 2. Evaluation

More information

Giang Pham/CARE PROMOTING WOMEN S ECONOMIC EMPOWERMENT WITH ETHNIC GROUPS IN THE MEKONG. A Vietnam Case Study

Giang Pham/CARE PROMOTING WOMEN S ECONOMIC EMPOWERMENT WITH ETHNIC GROUPS IN THE MEKONG. A Vietnam Case Study PROMOTING WOMEN S ECONOMIC EMPOWERMENT WITH ETHNIC GROUPS IN THE MEKONG A Vietnam Case Study This factsheet shares learnings from CARE Australia s strategic evaluation of our Women s Economic Empowerment

More information

Logframe Kenya Country Programme ( )

Logframe Kenya Country Programme ( ) Logframe Kenya Country Programme (2013-2016) Goal: To contribute to the improvement of the living conditions and health status of vulnerable and marginalised people in arid and semi-arid areas of Kenya

More information

JOB DESCRIPTION Position Monitoring and Evaluation (M&E) Coordinator - Hub Grade C2 Department & Location

JOB DESCRIPTION Position Monitoring and Evaluation (M&E) Coordinator - Hub Grade C2 Department & Location JOB DESCRIPTION Position Monitoring and Evaluation (M&E) Coordinator - Hub Grade C2 Department & Location M&E - KISUMU Date November, 2016 Reports to Programme Unit Manager with dotted line to the Country

More information

DANISH REFUGEE COUNCIL CHS CERTIFICATION REPORT

DANISH REFUGEE COUNCIL CHS CERTIFICATION REPORT DANISH REFUGEE COUNCIL CHS CERTIFICATION REPORT DRC- CER - 2017-008 Date: 2017-06-20 Humanitarian Quality Assurance Initiative 7, ch. De Balexert 1219 Chatelaine - Switzerland Page 1 of 21 Table of Contents

More information

Enhancing opportunities for rural women s employment and poverty reduction. 09 May 2017, Expert Group Meeting on Strategies for Eradicating Poverty

Enhancing opportunities for rural women s employment and poverty reduction. 09 May 2017, Expert Group Meeting on Strategies for Eradicating Poverty Enhancing opportunities for rural women s employment and poverty reduction 09 May 2017, Expert Group Meeting on Strategies for Eradicating Poverty WHY? In many developing economies, women are concentrated

More information

MEASUREMENT THE RESULTS FRAMEWORK ( ) INCREASING THE BANK S DEVELOPMENT IMPACT, DELIVERING THE HIGH 5S

MEASUREMENT THE RESULTS FRAMEWORK ( ) INCREASING THE BANK S DEVELOPMENT IMPACT, DELIVERING THE HIGH 5S THE RESULTS MEASUREMENT FRAMEWORK (2016-2025) INCREASING THE BANK S DEVELOPMENT IMPACT, DELIVERING THE HIGH 5S ADF-14 Second Replenishment Meeting June July, 2016 Abidjan, Côte d Ivoire Outline 1 Why this

More information

UNICEF Global Evaluation Report Oversight System (GEROS) Review Template

UNICEF Global Evaluation Report Oversight System (GEROS) Review Template EVALUATION ID 2070-2014/004 UNICEF Global Evaluation Report Oversight System (GEROS) Review Template Colour Coding CC Dark green Green Amber Red White Questions Outstanding Satisfactory No Not Applicable

More information

Practical Sampling for Impact Evaluations

Practical Sampling for Impact Evaluations L.Chioda (adopted by DIME, LCRCE) Practical Sampling for Impact Evaluations innovations & solutions in infrastructure, agriculture & environment April 23-27, 2012, Naivasha, Kenya Introduction Now that

More information

Program Theory of change and Impact Pathway

Program Theory of change and Impact Pathway Last Update December 2015 Program Theory of change and Impact Pathway Quang Bao Le, Tana Lala-Pritchard, Enrico Bonaiuti, Richard Thomas, Karin Reinprecht Food security and better livelihoods for rural

More information

World Bank Africa Gender Innovation Lab (GIL) Call for Expressions of Interest: About the World Bank Africa Region Gender Innovation Lab (GIL)

World Bank Africa Gender Innovation Lab (GIL) Call for Expressions of Interest: About the World Bank Africa Region Gender Innovation Lab (GIL) World Bank Africa Gender Innovation Lab (GIL) Call for Expressions of Interest: Seeking NGOs, governments, donors, and private sector firms with interventions designed to improve women s land tenure security

More information

Manual for writing a Strategic Programme Plan (SPP)

Manual for writing a Strategic Programme Plan (SPP) Manual for writing a Strategic Programme Plan (SPP) Introduction Partner organisations that seek financial support for their multi-annual programmes from Red een Kind (ReK) or Woord en Daad (WD) are requested

More information

Best Practices in Mainstreaming Gender in Energy Value Chains

Best Practices in Mainstreaming Gender in Energy Value Chains Best Practices in Mainstreaming Gender in Energy Value Chains Emmanuel Ngeywo Practical Action Eastern Africa Date: 11/11/2015 About Practical Action An international development agency working with poor

More information

Section E3 Social sector dynamics

Section E3 Social sector dynamics 279 Section E3 Social sector dynamics 280 Objectives Define the following concepts in the context of mitigation and reconstruction. Social Policy Resilience Social Capital Social impact assessment Benefits

More information

Value for Money: a modern challenge for Progressio

Value for Money: a modern challenge for Progressio Value for Money: a modern challenge for Progressio 1. Background The world of international development continues to change fast. Long gone are the days of well-meaning colonial philanthropy. Recent decades

More information

Guidelines for identifying and designing planned comparisons

Guidelines for identifying and designing planned comparisons Guidelines for identifying and designing planned comparisons Developing value chain innovation platforms to improve food security in East and Southern Africa (VIP4FS) Project (FST/2014/093) November 2016

More information

ACFID Code of Conduct PMEL Guidance Note. Prepared for ACFID by Learning4Development

ACFID Code of Conduct PMEL Guidance Note. Prepared for ACFID by Learning4Development ACFID Code of Conduct PMEL Guidance Note Prepared for ACFID by Learning4Development September 2017 1 CONTENTS: 1. Introduction 2. What is PMEL? 3. Approaches to PMEL 3.1 At a strategic or policy level

More information

Impact evaluation proposal form

Impact evaluation proposal form Impact evaluation proposal form BASIC DETAILS Number of the grant submission (to be filled by 3ie) Title of proposed impact evaluation study (Please include intervention type, country and possible method

More information

Productive Uses of Energy: Unlocking Socioeconomic Benefits and Economic Viability of Energy Access Infrastructure

Productive Uses of Energy: Unlocking Socioeconomic Benefits and Economic Viability of Energy Access Infrastructure Productive Uses of Energy: Unlocking Socioeconomic Benefits and Economic Viability of Energy Access Infrastructure Ana Pueyo (IDS) Webinar Clean Energy Solutions Center- 30th August 2016 Renewed interest

More information

Handbook Basics of Indicators, Targets and Data Sources. 11/30/2011 Produced by Poverty and Environment Initiative (PEI) Project Tajikistan-Phase 1

Handbook Basics of Indicators, Targets and Data Sources. 11/30/2011 Produced by Poverty and Environment Initiative (PEI) Project Tajikistan-Phase 1 Handbook Basics of Indicators, Targets and Data Sources 11/30/2011 Produced by Poverty and Environment Initiative (PEI) Project Tajikistan-Phase 1 1. HOW WILL WE KNOW IF WE VE GOT THERE? 1.1 Laying the

More information

WFP CORPORATE RESULTS FRAMEWORK ( )

WFP CORPORATE RESULTS FRAMEWORK ( ) WFP CORPORATE RESULTS FRAMEWORK (2017 2021) SECOND DRAFT Informal Consultation 9 May 2016 World Food Programme Rome, Italy INTRODUCTION 1. WFP is committed to attaining the highest standards of accountability.

More information

architecture for gender transformative programming and measurement: a primer

architecture for gender transformative programming and measurement: a primer Plan International Canada s architecture for gender transformative programming and measurement: a primer introduction As part of its new strategic framework, Plan International Canada is committed to achieving

More information

Gender impact assessment and hydropower. Assessment understanding - empowerment

Gender impact assessment and hydropower. Assessment understanding - empowerment Gender impact assessment and hydropower Assessment understanding - empowerment Michael Simon 13 September 2013 Overview 1. Why gender impact assessment? Basic principles and approach 1. Dam project: Simple

More information