DIME Impact Evaluation Workshop

Transcription

1 DIME Impact Evaluation Workshop DIME Impact Evaluation Workshop Innovations for Agriculture Innovations for Agriculture June 2014, Kigali, Rwanda June 2014, Kigali, Rwanda

2 Impact Evaluation Workshop Innovations for Agriculture Accountability Measures in India s National Employment Guarantee Scheme (MGNREGS) June 2014 Kigali, Rwanda

3 Intervention World s largest national welfare programme 100 days paid employment guaranteed per year & creation of assets Problems w targeting, inefficiencies & corruption Exclusion and poor uptake in marginalised communities

4 Intervention 6 monthly social audits mandated in the Act Officials and communities monitor and address irregularities Social audits not really happening and where they are they don t have bite Poorest Areas Civil Society Programme (PACS) of DFID Works with a network of CSOs in 20,000+ villages in 90 poorest districts Facilitates excluded claim their entitlements in MGNREGS Facilitates social audits and planning

5 8. Follow up on recommendation s and agree actions 1. Official request to government officials for data e.g. application register, budget forecast etc 2. Community meeting to cross-check the data e.g. ask people whether they actually received the work recorded officially 7. Report presented to officials Social Audit 3. Physical verification of the sites e.g. official record says a road was built- was it? 6. Public Hearing to present and discuss findings and recommendations - includes government officials and community members 5. Preparation of audit report 4. Village assembly meeting to discuss the findings and finalise recommendations

6 Evaluation Questions Has corruption reduced as a result of these interventions and how? Has uptake and performance improved as a result of these interventions and how? Linkages between increased community scrutiny, corruption, uptake and improved performance? Is it value for money?

7 Evaluation Design Focus on two States of India Madhya Pradesh and Bihar RCT comb. w qualitative villages Treatment arms as social audits, planning and a combination of them 2 yrs baseline, mid and end

8 Apr-15 May-15 Jun-15 Jul-15 Aug-15 Sep-15 Oct-15 Nov-15 Dec-15 Jan-16 Feb-16 Mar-16 Social Audit 1 Planning for started Planning and approvals for concluded Baseline Apr-16 May-16 Jun-16 Jul-16 Aug-16 Sep-16 Oct-16 Nov-16 Dec-16 Jan-17 Feb-17 Mar-17 Social Audit 2 Social Audit 3 Implementation of Plan for Planning Planning for started and approvals for concluded Midline Apr-17 May-17 Jun-17 Jul-17 Aug-17 Sep-17 Oct-17 Nov-17 Dec-17 Jan-18 Feb-18 Mar-18 Social Audit 4 Implementation of Plan for Endline

9 Questions and Challenges Issues of measuring corruption Testing bureaucratic incentives and sanctions Purity of treatment and control where social audits are a legal mandate Outcomes at various levels and dimensions Enlighten us!

10 DIME Impact Evaluation Workshop DIME Impact Evaluation Workshop Innovations for Agriculture Innovations for Agriculture June 2014, Kigali, Rwanda June 2014, Kigali, Rwanda

11 Impact Evaluation Workshop Innovations for Agriculture Making Public Works Work for Graduation Rwanda June 2014 Kigali, Rwanda

12 Intervention Summary Objective: How can make our public works work to ensure beneficiaries graduation from extreme poverty Components: Savings: so they can use these savings to accumulate assets which will help them generate income Team building for mobilizers: to help us work on people s mindsets towards savings and investment Also useful for other existing poverty alleviation measures Build on local knowledge and trust

13 Evaluation Questions How can we increase savings among public works beneficiaries? How can we make Community Mobilization Team (CMT) more efficient towards encouraging savings among beneficiaries?

14 Evaluation Design Randomized control trial Three treatment groups and one control group Treatment 1: Default savings option Treatment 2: Default savings + Team incentives for Community Mobilization Team Treatment 3: Default savings + Individual incentives for Community Mobilization Team

15 Sample and data VUP already operates in 180 sectors for public works component 45 sectors in each treatment (45 in control) All beneficiaries already have bank accounts Data on savings will be obtained directly from their respective banks Can link to EICV-4 survey to study food consumption, asset accumulation, agriculture technology take up etc

16 Timeline Prepare concept note quickly Spend 6 months preparing full concept Research team travel to Rwanda Meet with officials who are managing VUP in some sectors, at national and local government level Design default form, finalize incentive for Community Mobilization Teams etc Pilot testing in some sectors Get FUNDING Establish evaluation tools and roll out

17 End result: Changing the community!!

18 DIME Impact Evaluation Workshop DIME Impact Evaluation Workshop Innovations for Agriculture Innovations for Agriculture June 2014, Kigali, Rwanda June 2014, Kigali, Rwanda

19 Impact Evaluation Workshop Innovations for Agriculture Rural Feeder Roads Development Project Rwanda June 2014 Kigali, Rwanda

20 Intervention Summary FEEDER ROADS: Unpaved rural roads that link agricultural productivity areas with either district roads or national roads CURRENT STATUS: Feeder roads have low quality surface Irregular width from 4m to 6m No drainage structures

21 Intervention Summary TREATMENT: Widening the road to 6m Resurfacing the road with lateritic soils Constructing drainage structures

22 Evaluation Questions What is the impact of feeder roads on: Welfare of population in the villages Access of agriculture products to the market Changes in land property values Travel time reduction Access to social facilities Development of other Infrastructure facilities like electricity & portable water

23 Evaluation Design Selection of roads to be upgraded: Ministry of Agriculture and the Districts, NPV, social and environmental impact are used to rank road projects by order of priority in each District Budget available will determine how many road Kilometers can be actually upgraded Control group will be road projects that will not be upgraded but were high priority too

24 Evaluation Design Selection Method of upgraded roads: Ranking Cost of Road Cumulative Cost Total budget Status Treated Treated Treated Control Control Control

25 Sample and data Output indicators (all administrative data): Agriculture market prices Kilometers upgraded IRI (change in international roughness index) Average speed Employment level Presence of other basic infrastructure assets Traffic flow statics Changes in transport costs

26 Sample and data Impact indicators (all administrative data): Changes in market prices and quantities of agriculture inputs and outputs Traffic volume on roads Property values (price per hectare of farmland) Changes in population count Availability of imported variety food steps

27 Timeline Activity Frequency Data collector Collect price data Expand data collection: Distinguish out-of-district and local goods Quantities traded of agriculture inputs and outputs Data collection points Daily e-soko Collect land transactions data Annually District Offices Collect population data Annually Village leaders/sector Office Collect IRI data for Feeder Roads Annually RTDA

28 CONCLUSION IE is very important since it will give us the picture of how RFR can improve the rural socio-economic development.

29 Where are we heading for IE!

30 DIME Impact Evaluation Workshop DIME Impact Evaluation Workshop Innovations for Agriculture Innovations for Agriculture June 2014, Kigali, Rwanda June 2014, Kigali, Rwanda