The overall objective of PATH is to provide the poorest Jamaican households with a targeted social safety net programme to enable them to increase

Transcription

1 Jamaica 1

2 The overall objective of PATH is to provide the poorest Jamaican households with a targeted social safety net programme to enable them to increase their educational attainment and improve health outcomes and in turn break the cycle of intergenerational poverty. 2

3 Reform of the SSN Consolidation of three social assistance programmes - Food Stamps, Poor Relief and Old Age & Incapacity Programmes 2002 PATH: administered by the Ministry of Labour & Social Security through its 13 Parish Offices Conditional Cash Transfer Programme attendance at school and health centres 3

4 Selection to the programme is done through the use of a proxy means test Payments are made bi-monthly. Beneficiaries receive payment by cheque or cash card Benefits consist of cash grant, school lunch and free health care and education (free tuition up to secondary level) Funded by the GOJ, World Bank & IADB 4

5 PATH Registered Beneficiaries Benefit Category Actual Number of Beneficiaries March 2011 Target # of Registered Beneficiaries Children 0-18 years 284, ,000 Preg & Lactating Women 2,609 3,000 Elderly Poor 53,668 60,000 Disabled 9,018 18,000 Other Destitute Poor 1,589 2,000 PAD/Poor Relief 12,701 17,000 Payment Suspension 7,374 0 Totals 371, ,000 5

6 Institutional arrangements (compliance) MOH; MOE Long application process Capacity Issues Limited social workers High non-compliance rates especially among boys in secondary school Inclusion & Exclusion errors MIS did not adequately capture data needs 6

7 Inputs Staff (Central Office, 13 Parish Offices Staff MOH, MOE, PCJ Budget: GOJ, WB, IADB Activities Operations: Application, Payment, Compliance, Case Management Public Education Monitoring & Evaluation Procurement Outputs Registered beneficiaries PATH benefit payments Training & Public Education sessions Reports (Monitoring, Financial Outcomes Increased consumption Increased school attendance Increased health care usage Final Outcomes Improved School Performance -Grades/test scores Improved Health Status: - Fewer serious diseases -Fewer school absences Healthy and educated - Break intergenerational cycle of poverty Planned Work Intended Outcomes 7

8 Beneficiaries BMIS Evaluation: -JSLC -Impact evaluation -Targeting Assessment -Process Evaluation -Research Monitoring: -Results framework -Progress Reports -Service Standards -Operations Manual, -Action Plan - Audits Policy Making Programme Design 8

9 M & E Activity Results Framework Progress Report JSLC Frequency of Activity Ongoing Once every four months Annual Report Impact Evaluation Once ( ) Again ( ) Targeting Assessment Once ( ) Again ( ) Process Evaluation Research Service Standards Reports Audits Once M & E Unit: Two per year External Consultants: When necessary Once every four months Internal: Ongoing 9

10 Impact Evaluation Goal (primary research questions) Outcome Measures Strategy to Identify the Counterfactual Sample & Data Used Examined the impact that PATH had on school attendance and health centre visits. School Attendance Health Centre Attendance Treatment: PATH participants just barely eligible (just below cut-off score) Control: Applicant households that were just barely ineligible (just above cut-off score) 2,500 PATH Households & 2,500 Poor Non- PATH Households Data from PATH MIS & Survey Instruments Time Frame Baseline Survey: January June 2004 Follow up Survey :May October 2005 Costs/Source Financing of Cost: Approx US$600,000; World Bank Loan (INCLUDING COST FOR TARGETING ASSESSMENT AND IMPLEMENTATION ASESSESSMENT) 10

11 M & E instrument Results Delivered Change in Programme Design 2003 Targeting Assessment: Using data from the JSLC and the PATH MIS Examined how effectively the programme covered the most needy inthe population: 80% of PATH beneficiaries were identified to be among the poorest in the Jamaican society Better targeted programme in identifying the poor than a previous social security programme (Food Stamp Programme) 2007 Impact evaluation 3% increase in school attendance of PATH students vs non-poor Gave legitimacy to the continuation ofthe PATH Introduction of a dual cut-off score: Urban & rural Legitimacy for the use of an Appeals Committee 100% verification of households by social workers Review ofthe BIS Gave legitimacy to the Programme and buy in from stakeholders and politicians 38% increase in health centre visits Continuation of PATH 11

12 M& E Instrument Results Delivered Change in Programme Design 2008 Progress Reports 2006 JSLC Research (External Consultant) Non-attendance of PATH students and drop outs was more prevalent among boys in the lower secondary school Introduction of the differentiated payment - varying amounts to students by gender and grade. Boys receive 10% higher benefit BMIS database High non-compliance rates How conditional should CCT s be? Research BMIS database Investigation into the reasons for the low uptake of the pregnant/lactating benefit Impact Evaluation ( ) June 2010: Introduction of a minimum benefit irrespective of compliance Introduction of service standards Development of a comprehensive public education programme targeting this group 12

13 M& E Instrument Results Delivered Change in Programme Design Process Evaluation (Interim) and Progress Report Review of the process cycles: Recommendation for Improvement to the application/verification process, payment of benefits, compliance process etc Internal Audits Recommendation on procedural aspects of the programme: - Operational - Financial or procurement Introduction of 16 Service Standards which are being implemented island wide: - 70% of applications are processed and benefits paid within 2 payment cycles -Payments delivered to the Post office by 15 th of payment month - Improvement in timeframe for the data entry of compliance information Identification of duplicate payments : PATH & NIS Crossmatching of PATH & NIS databases Introduction of System of Spot Checks verify PATH households exists and procedures are being followed 13

14 Programme Activity that worked well Collaborative meetings with partners (WB, PIOJ, MLSS) in developing outcome indicators Development of an Operations Manual Implementation Alternatives yield better results Designing of M&E Systems simultaneously with implementation activities Identifying data sources and availability Development of enhanced BMIS Identifying monitoring & evaluation instruments Preparation of WB Reports Collaborate with partners get buyin and ownership Research (Internal & External) Design clear objectives and specific indicators of measurement 14

15 NATIONAL DEVELOPMENT PLAN VISION Year Medium Term Socio- Economic Plan MLSS Corporate Plan & Operational Plan JSLC PATH M&E National SFP MIS (MOE) 15

16 Collaborative partnerships Government, private sector and International Development Partners Integrating political leadership in the system to ensure legitimacy Incorporation of technical and financial expertise through the PIOJ & MOFPS to ensure that planning priorities and targets are linked to implementation of resources Monitoring mechanism to ensure feedback on performance National Management Information System STATIN Link PATH MIS to School Feeding MIS at the Ministry of Education and STW MIS at the Ministry of Labour 16

17 Develop Programme Work Plans (Design, Implementation and M & E Plans) simultaneously and ensure that these are linked to National or Sector Plans Identify relevant stakeholders and engage them in a collaborative planning process Establish a records information system and mechanism for data collection Identify M&E tools to be utilized early bearing in mind, procurement guidelines and cost Identify programmes within your organizations that can possible share aspects of the same M&E system. 17

18 18

19 19

20 Outcome Indicator Baseline YR YR Target Value YR YR YR Data Collection and Reporting Frequency and Reports Data Collection Instrument Responsibili ty for data collection PDO: Further improve the effectiveness of PATH to foster investment by poor families in human capital accumulation Outcome Indicator: Net change inschool attendance by PATH Students at the secondary level for boys and girls PATH already increased by 0.5 days Interim Outcome Indicators: Enrolment at secondary level for poor children aged years Share of PATH children with 85% school attendance: Secondary level 77% (2006) B : 80% G: 80% 80% 81% To be determi ned at baselin e +0.5 days Baseline and Follow up Survey 78% 81% Biennial JSLC PIOJ 81% 82% 82% 83% 83% 84% 84% 85% Every 4 months PATH BMIS Impact Evaluation Surveys MLSS 20