Session 9 Project M&E Plans Document Version Date: 2013-12-31
Session Objectives By the end of this session, participants should be able to: Understand what makes up a Project M&E Plan Understand which parts should be included in PMP
Project M&E Plan: Overview Essential to assessing progress toward achieving project outcomes Describes plan for collecting data over life of project Identifies planned project evaluations Specifies how M&E data and findings will be used The M&E Plan feeds into a broader mission Learning approach! 3
Relationship of Project and Activity M&E Plans to the PMP Key Planning & Performance Monitoring Tools Mission-wide Portfolio Project CDCS Results Framework Project Log Frame Project M&E Plan P M P Activity RFAs/RFPs/ Other Award Activity M&E Plan
Project M&E Plan: Requirements at a Glance Monitoring Requirements 1-3 indicators for each level of project results (Project Goal, Purpose, Sub-purposes (if relevant), and Outputs) Baselines and targets for Project Purpose Indicators (and plan to collect other baselines). Must be sexdisaggregated if people-level. Data methodology, sources, and data collection frequency Indicators or means of tracking assumptions (context and other donors) 5
An Example NARRATIVE SUMMARY INDICATORS DATA SOURCES ASSUMPTIONS Goal: Inclusive economic growth from agriculture increased % change in the contribution of key commodities to agric. GDP Commodity platform reports Purpose: Increased income of male and female smallholder farmers in NE region EOPS: % increase in per capita household expenditures of USG targeted beneficiaries FTF baseline CPRs Macroecon. (I.Rate (inflation) stability Sub-Purpose 1: Increased agricultural productivity of male and female smallholder farmers in NE region Gross margins per hectare of key commodities in targeted region Implementer Survey Real producer prices do not decline Outputs: M/F smallholder famers trained on commercial farming and on-farm climate change risk reducing practices New market-tested technologies developed Climate change vulnerability assessment completed Inputs: Training farmers, TA for research, vulnerability assessment, seeds & fertilizer for testing new tech. Average score from training participants on quality of the training course. -# of farmers trained in new farming tech. -# of key commodity technologies under development as a result of USG assistance -# of recs for climate change adaptation from vulnerability assessment tested. Project Activity reports The Climate Change vulnerability assessment identifies viable opportunities for climate change adaptation Sub-Purpose 2: Increased access to markets x% increase in the $ value of export of key commodities by end of project National statistics New market linkages result in sales Outputs: Buyer facilitation and training provided Market information system facilitation delivered Inputs: TA & equipment for info systems, TA & resources to train buyers, and convene and promote buyers network -# info. system recommendations produced -# stakeholders convened to assess information system weaknesses -# buyer contacts made -# buyers trained Project Activity reports Buyers willing to participate in training & perceive benefits of organizing in networks
Project M&E Plan: Requirements at a Glance Evaluation Requirements Limited # of key questions Proposed evaluation type (performance or impact) Tentative evaluation schedule (update PMP Evaluation Plan) Estimated evaluation budget 7
Types of Evaluation at USAID Performance Evaluations Use Explore a range of issues linked to program design and implementation; e.g., how a project is being implemented or what is has achieved. Lack a rigorously defined counterfactual Impact Evaluations More narrowly defined; provide a quantifiable measurement of change attributable to a given intervention with a high level of confidence Requires rigorous counterfactual or comparison group Questions Design Methods Generally, descriptive and normative Wide variety depending on purpose & questions Mix of qualitative and quantitative methods Cause-and-effect Experimental (randomization) or quasi-experimental Quantitative, though often include qualitative methods
Evaluation in the Project M&E Plan Plan for evaluation during Project Design! Ask: 1. Does this project require an evaluation? (i.e. large project or innovative) 2. Even if not required, is there a management or learning purpose for which we may wish to evaluate this project? If yes, identify: Plan for utilization of evaluation findings! What type of evaluation? Performance or impact? Few key questions linked to specific future decisions Preliminary evaluation methods based on questions Estimated budget (PD time is the time to budget!) Mission-wide M&E budget target = 5-10% (not per project) Mission-wide evaluation target = 3% 9
Developing Evaluation Questions Going back to the agriculture project example. Illustrative Performance Evaluation Questions To what extent was beneficiary targeting appropriate? What other factors in project area account for increased income? Illustrative Impact Evaluation Questions What is the project s net effect on the uptake of new technology among farmer populations? Which combination of project outputs (incentives, training and marketing) has the greatest effect on increasing farmer income? 10
So what translates from the Project M&E Plan into the PMP? Performance indicators. From Output through Project Purpose. Each should have a PIRS and be tracked in the PMP indicator tracking tables. Mission Performance Management Plan Planned project evaluations. Update in the PMP Evaluation Plan with evaluation questions, type, budget, timing, etc. Indicators for assumptions. Any context indicators identified during project design to track critical assumptions. 11
Session 10: Analyzing and Using Data So What s Next?