Monitoring and Evaluation

Transcription

1 Monitoring and Evaluation

2 Presentation Outline 1. What is Uwezo Fund 2. M&E and Livelihoods projects Life Cycle 3. What is the purpose of M&E 4. M&E Tools 5. Logical framework as a monitoring tool 6. Undertaking M&E 7. Uwezo progress reports 8. Sample logical framework 9. Sample evaluation form 10. Impromptu visits 11. Envisaged Uwezo Fund overall outcome in development

3 INTRODUCTION Monitoring is the systematic collection of information that involves the tracking of inputs, processes, activities, outputs and outcomes against indicators Monitoring is an integral part of day-to-day operational management to assess progress against objectives. It captures planned versus actual activities, timely implementation of activities, targeted beneficiaries versus true beneficiaries, unintended effects on the community and unexpected problems etc The leading question is Are we doing things right?

4 MONITORING AND EVALUATION Cont. Evaluation is a systematic and objective assessment of ongoing or completed project. It makes comparison of the outcomes of the project with planned ones. Inputs, activities, outputs, outcomes and impacts are components of the evaluation process Again we answer the quiz Are we doing the right things? Who does M & E Project staff, Implementation Organization and Donors

5 WHY DO MONITORING AND EVALUATION? We do M&E to analyze the current situation, identify problems, find solutions, discover trends and patterns, keep project activities on schedule, measure progress towards objectives, formulate/revise future goals and objectives, make decisions about human, financial, and material resources for programme improvement, organisational learning, accounting and communication purposes

6 Monitoring tools Refers to the monitoring and evaluation instruments used during the implementation of a given intervention They mostly document, empirical data used during project implementation. The tools include: lists of participants, registers, application forms, monitoring and evaluation project implementation forms, cameras, videos, GPs, data analysis soft wares, logical frame works, questionnaires, interview guides, observation guides, focus group discussion, project schedules etc

7 Monitoring tools cont d There are different tools and approaches used in M & E Some of them are complimentary, some are substitutes and the choice of which is appropriate for any given context depend on a range of considerations. Examples include: The uses in which M & E is intended, The main stake holders who have an interest in the M & E findings, The speed in which the information is needed The cost.

8 M&E and Livelihoods projects Life Cycle ASSESSMENT What is the nature of the problem? EVALUATION How do I know that the strategy is working? How do I judge if the intervention is making a difference? STRATEGIC PLANNING What primary objectives should my program pursue to address this problem? 4 MONITORING How do I know the activities are being implemented as designed? How much does implementation vary from site to site? How can the program become more efficient or effective? 3 DESIGN What strategy, interventions and approaches should my program use to achieve these priorities?

9 What are you concerned with when monitoring Input Process Output Outcome Impact Programme Monitoring Household Surveys Community Surveys changes at the Population level

10 Explanation of terms Inputs: defined as financial, human and material resources available to implement a project. These entails necessary resources required during project implementation processes. Examples include funds, training materials, expertise, data collection tools, questionnaires, etc Outputs: Immediate results after utilization of inputs. Includes records of the amount disbursed to the groups; copies of documentation of reported activities; list of participants; number of trainings and trainers; no. of workshops; registers; case studies; training venues; training materials

11 Explanation of terms con t Processes: these demonstrate Activities; reporting writing; dissemination of feedback and feed word. Outcomes: includes services or products that a project delivers to a target population to produce the expected impacts. Indicators: are succinct measures that aim to describe as much possible about a system in few points as possible. They are the benchmarks or results that will measure whether an objective has been reached. Indicators help us understand a system compare it and improve it Impact: refers to lasting results with indicators

12 Logical framework as a monitoring tool Log frame helps to clarify objectives of any project, program or policy. It helps in identification of the expected Casual links of inputs, activities, outputs, outcomes and impacts and includes coverage or reach ; across beneficiaries. It is also an effective tool too guide implementation, monitoring and evaluation and should be updated during implementation to reflect changing conditions

13 Uwezo progress reports Agree & adopt a standard reporting format Submit a quarterly report every 10 th day of the preceding month Adopt a quarterly reporting schedule Adopt an M & E reporting format Adopt an M & E approach Conduct validation impromptu visits to groups and institutions ( guiding question to be generated on what informs the impromptu visits) Provide feed back and feed forward

14 WHAT IS A PROJECT A project is a temporary endeavor designed to produce a unique product, service or result with a defined beginning and end. It is usually time-constrained, and often constrained by funding or deliverables, undertaken to meet unique goals and objectives. Typically a project is suppose to bring about beneficial change or added value.

15 Main Characteristics of Projects unique set of sequenced events; Has a defined scope; Has a start and a finish date; Limited resources and budget; Involves many people across functional areas; Limited by Specification, cost and time; Goal oriented

16 The Project Cycle The project cycle is processes/stages that a project goes through from its inception/identification, planning/design, implementation to completion

17 Critical Areas in Project Planning a) setting of the projects objectives; b) identifying activities to be carried out; c) determining the resources required; d) time frames and responsibilities; e) expected outputs; f) success indicators; g) how monitoring and evaluation should be conducted. h) Constraints i) Assumptions j) Roles and responsibilities

18 Sample Logical frame work Key Activities Inputs Key Outputs indicators Key Expected Outcome indicators Key Expected Impacts Risks and Assumptions 18

19 A sample of an evaluation form S/N o. Group Name s Registr ation Cert No. Membershi p Profile F M P W Ds Ban k Acc No. Perio d of exist ence Loans borrowed from other Funds e.g, WEF, YEDEF, and others Table banking Documen tation. Duly signed list of members with ID & Tel. Nos Recom mendati on note by the area chief Uwe zo Fund Train ing cert. Gro up Busi nes s Types of group busine sses. 19

20 Tools and techniques applied for participatory, qualitative monitoring Documents review a. Surveys b. Discuss with groups, federations and their members. c. Interviews d. Observations e. Listening to people f. Brain storming g. Conversation h. Case studies

21 ANNEX 1 Uwezo Fund Groups Table Banking Performance Monitoring Indicators Key Indicators Key output indicators Remarks Component Measure Score ; meetings Regularity of meetings Weekly > 5 Monthly <5 Attendance at meetings Above half > 5 2. Book keeping Correct recording of minutes and cash book Correct recording of savings book 3. savings Regularity in weekly savings by members Regular Realization of the amount that should have been saved by the entire group Below half <5 Update and correct records > 5 Not update with incorrect record <5 Systematic weekly savings Groups regular target achievement 4. Repayment records Correct recording of minutes and cash book Correct recording of savings book Correct Loan repayment records Updated records 5. Types of Successful Businesses by the members Milestones recorded No. of additional businesses recorded. Total 100 %

22 Impromptu visits Adhoc field monitoring visits that are not necessarily detailed. Resonate from positive or negative information Gathered key informants pertaining community projects in a targeted phenomena, e.g., funded projects

23 Approaches of M&E Self-monitoring systems at the community (ward) level a. Self-monitoring of fund recipients (youth, women and PWD groups) and their enterprises/businesses; b. Training of CUFMC members on M&E to enable groups at the ward level to monitor their own work. c. Participatory monitoring and evaluation: inculcating M&E skills; accountability and responsibility

24 Indicators related to Table Banking Concept Regularity of savings from group members Rotation of at least 90% of savings among group members by way of loans, with o o o o o o o amounts given to a greater number of members at one time Utilization of at least 70% of the loans for income generation, e.g., for agricultural purposes, asset building, and loan repayment, etc. More group loans for group activity Prompt repayment with interest Regular meetings of the group members for Feedback on utilization of amount Sharing on experience with amount utilized Exploring various income generation and enterprise options Presence of strong sub-committee within the group to prioritize needs of individual members Strong peer pressure for proper utilization of amounts. Presence and regular update of related books namely: Savings Register Loan register Minutes book Pass book

25 Monitoring vs Evaluation Item Monitoring Evaluation Frequency Periodic, Regular Episodic Main Action Basic Purpose Keeping track/ oversight Improving efficiency Adjusting work plan Assessment Improve effectiveness, impact, future programming Focus Information sources Inputs/outputs, process Routine systems, field observations, progress reports, rapid assessments Effectiveness, relevance, impact, cost effectiveness Same plus surveys/ studies Undertaken by Project managers Community workers Community (beneficiaries) Supervisors Funders Program managers Supervisors Funders External evaluators Community (beneficiaries) 25

26 Envisaged Uwezo Fund overall outcome in development Access to basic needs and social services at individual, family and national level (Improved Living standard measures) Access to gainful employment and enterprises; Face validity measure- actual/concrete; Access to skills/knowledge for Kenyans literate population ( youths and women); Training should be value based; Relevant; Practical and usable linked to access to finances. 26

27 CONCLUTION Monitoring and Evaluation involve the collection and analysis of data on the project Monitoring is more concerned with on-going projects and their adherence to plans. Evaluation is more concerned with the achievement of goals and other changes brought about by the project M&E is a continuous process from inception to end.

28 Demonstrated impact on natural regeneration diversity

29 END OF PRESENTATION Asante Sana! I believe we are all ready to take this challenge