Stop Malaria Project. M and E Training workshop. 26 th June 2009

Transcription

1 Stop Malaria Project M and E Training workshop 26 th June 2009

2 Presentation Outline Background Goal and objectives M and E concepts. Project Indicators and source of data/information. Data collection methods Review of the M and E tools Flow of information (Data flow) and deadlines for reporting. Discussion on the way forward.

3

4 Goal Goal and objectives To provide a framework for obtaining reliable information to determine progress in malaria control and inform decisions for programme improvement.

5 Objectives To guide the collection, processing, analysis and use of project data in the SMP districts. To guide the periodic documentation of planned activities and measure expected outcomes and impact. To provide a comprehensive list of project indicators that will guide all stakeholders involved in the implementation that will be reported upon routinely. To outline key actions for implementing M&E in the project districts.

6 The M vs. the E Monitoring is a continuous function that uses the systematic collection of data on specified indicators to provide management and the main stakeholders of an ongoing development intervention with indications of the extent of progress and achievement of objectives and progress in the use of allocated funds OECD

7 The M vs. the E Evaluation is the systematic and objective assessment of an ongoing or completed project, program, or policy, including its design, implementation, and results. The aim is to determine the relevance and fulfillment of objectives, development efficiency, effectiveness, impact, and sustainability. An evaluation should provide information that is credible and useful, enabling the incorporation of lessons learned into the decisionmaking process of both recipients and donors

8 Monitoring and evaluation, and the chain of project results to undertake activities... the direct results of which... must have effects... Resources are mobilized This chain is based on a series of logical relationships (if then) called "causal relationships" and an impact on Malaria Mortality Monitoring Evaluation

9 Outline of M&E framework Implementation Results Input Process Output Outcome Impact RESOURCES Money Staff Supplies SERVICES LLINs through ANC Community mobilization and sensitization Trainings IPTp uptake Provision of ACTs Lab trainings PRODUCTS More use of ANC services More children and mothers with ITNs CMDs trained Lab staff trained. SS conducted BENEFITS Improved service delivery Healthy children Health mothers &babies Increased knowledge CHANGES Reduced malaria mortality Reduced poverty

10 M&E Timeline Project Implementation Support Supervision (Quarterly) Collect Routine Data from HMIS and HBMF Activity reports Baseline assessments Health facility survey UDHS SPA HMIS Mid-Term UDHS SPA MIS Facility Assessments Net tracking surveys End of project Health facility survey

11 The complementary roles of Monitoring the M & the E Periodic measurement of the progress of a project Can help focus on comparison of performance with existing project objectives Links activities & resources to objectives Routinely collects data to compare results with targets Reports progress to managers to alert problems

12 The complementary roles of the M & the E Evaluation Analyses why intended results were not achieved Provides lessons and highlight accomplishments There can be many types of evaluations Process gives you information on operations and problems in service delivery Cost-effectiveness evaluations gives you information on costs vs results Impact evaluation- did the program make a difference (this can be immediate or long term) Purposes of an evaluation Formative (performance monitoring) Summative assessment occurs at the end of the program

13 Indicator -Definition Signal that reveals progress (or lack thereof) towards objectives; means of measuring what actually happens against what has been planned in terms of quantity, quality and timeliness. An indicator is a quantitative or qualitative variable that provides a simple and reliable basis for assessing achievement, change or performance.

14 Developing Indicators SMART or CREAM of indicators Specific, Measurable, Achievable, Relevant, Time-Bound Clear, Relevant, Economic, Adequate, Measurable

15 SMP Indicators Intermediate result indicators Sub-intermediate result Project output-indicators. Frequency of reporting Quarterly Annually Biennially (every 2 years) Note: Details in the PMP indicator table

16 Data collection Methods Routine HMIS reporting. Routine HBMF reporting. Activity reports Workshop, Trip, Training etc National surveys e.g. DHS, SPA, MIS. Net tracking surveys. Facility Assessments

17 List of M and E forms FORM A: NMCP ANNUAL REPORTING FORM FORM B: NMCP QUARTERLY REPORTING FORM FORM C: COMMODITY PROCUREMENT AND DISTRIBUTION QUARTERLY REPORTING FORM FORM D: MASS MEDIA QUARTERLY REPORTING FORM FORM E: DIAGNOSTIC TRAINING QUARTERLY REPORTING FORM FORM F: ZONAL QUARTERLY REPORTING FORM FORM G: DISTRICT HMIS QUARTERLY REPORTING FORM FORM H: DISTRICT HBMF QUARTERLY REPORTING FORM FORM J: TRAINING ACTIVITY FORM FORM K: COMMUNITY ACTIVITY FORM WORKSHOP AND ACTIVITY REPORT FORM

18 THE STOP MALARIA PROJECT M & E REPORTS (DATA/INFORMATION) FLOW NMCP/MOH PMI/USAID Guidelines for reporting. Provide policy documents. Provide data on national surveys and operational research studies. Provide feedback to the project for improvement. UMEMS SMP(MC,IDI,U HMG, DISTRICTS Review the reports and provide feedback. Provides standards and reporting formats. Provides TA to the districts Conduct M and E trainings to the districts and partners. Reviews districts (FORM G &H) and partners (FORM C&J) data and provides feedback. Generates USAID quarterly (by end of the following month) and annual reports. Compiles training and community activity reports (form J and K). Reviews the Zonal and NMCP reports and gives feedback. Compiles monthly HBMF forms and enters them into the database. Compiles monthly HMIS reports and enter them into the database/reports to the MOH databank. Compiles SMP quarterly forms G and H and submit to the Zonal Team Leader by 7 th day following end of the quarter. CSOs Reports (data/information) Feedback HEALTH FACILITIES CMDS Compiles the MONTHLY HBMF REPORT from the CMDs reports and submits to the district together with the HMIS forms. Compiles HMIS 105, 108 and submits to the district by 7 th of the following month. Provide feedback for project improvement. Compiles data from the community medicine distributor s register and reports to the nearest health facility by the 3 rd of the following month. Feedback to CMDs

19 Deadlines for reporting No. Indicator FORM A FORM B FORM C FORM D FORM F FORM G FORM H FORM J FORM K NMCP ANNUAL REPORTING FORM NMCP QUARTERLY REPORTING FORM COMMODITY PROCUREMENT AND DISTRIBUTION QUARTERLY REPORTING FORM MASS MEDIA QUARTERLY REPORTING FORM ZONAL QUARTERLY REPORTING FORM DISTRICT HMIS QUARTERLY REPORTING FORM DISTRICT HBMF QUARTERLY REPORTING FORM TRAINING ACTIVITY FORM COMMUNITY ACTIVITY FORM Deadline

20 Data use /Information dissemination Training of districts and health facilities in data analysis/ information use. Sharing of reports/ providing feedback information at all levels. National level partners meetings.