Evaluation in the GEF and Training Module on Terminal Evaluations

Transcription

1 Evaluation in the GEF and Training Module on Terminal Evaluations GEF Expanded Constituency Workshop Baljit Wadhwa Senior Evaluation Officer GEF Independent Evaluation Office Jordan September 2015

2 Overview Evaluation in the GEF: Monitoring and Evaluation in the GEF GEF Independent Evaluation Office (IEO) GEF M&E Policy 2010 Training Module on Terminal Evaluations Page 2

3 M&E in the GEF Two overarching objectives: Promote accountability for the achievement of GEF objectives through the assessment of results, effectiveness, processes, and performance of the partners involved in GEF activities. Promote learning, feedback, and knowledge sharing on results and lessons learned among the GEF and its partners as a basis for decision making on policies, strategies, program management, programs, and projects; and to improve knowledge and performance. Page 3

4 Separate reporting lines for Monitoring (through Secretariat) and Evaluation (through IEO) GEF Council Agency evaluation units Annual evaluation reports Overall Performance Study (to Assembly) Annual Work Program and Budget GEF Independent Evaluation Office Annual Monitoring Report Evaluation Management Response Programming documents and indicators Results Based Management GEF Secretariat Corporate evaluations Project and Program Independent evaluations Project and Program evaluations Agency GEF coordination units Project and Program Implementation Reports Agency Portfolio Reports Project documents with M&E plans Project and Program Implementation Reports Project and Program monitoring documentation Terminal evaluations GEF projects and programs Page 4

5 GEF Independent Evaluation Office Mission: Enhance global environmental benefits through excellence, independence, and partnership in monitoring and evaluation. Functions: Independent GEF Evaluation Normative function Oversight function Knowledge sharing and dissemination Brief history: 1996 Initially established as an M&E unit within the GEF Secretariat 2003 The M&E unit was made independent of the GEF Secretariat 2005 The unit was renamed as GEF Evaluation Office 2013 The office was renamed as GEF Independent Evaluation Office Page 5

6 GEF IEO Stakeholders Page 6

7 Types of Evaluations Project Evaluations Impact Evaluations Ad-hoc Reviews Program Evaluations Cross-cutting and thematic evaluations Overall Performance Studies (OPS) Country Level Evaluations Process and performance evaluations Special Studies Different TORs, scopes, frequency, audiences, methodologies Page 7

8 GEF IEO Dissemination and Knowledge Management Page 8

9 IEO Work Program for GEF-6 Page 9

10 The GEF M&E Policy Defines the concepts, role, and use of monitoring and evaluation within the GEF Defines the institutional framework and responsibilities Indicates the GEF minimum M&E requirements covering: Project design Application of M&E at the project level Project evaluation Engagement of Operational Focal Points in M&E Current M&E Policy: Approved by GEF Council in November 2010 Page 10

11 Training Module on Terminal Evaluations

12 Introduction Purpose of this module is to: Discuss importance and utility of terminal evaluations Characteristics of a good terminal evaluation Exercise on pre-requisites for preparing a good terminal evaluation What needs to be done during project preparation and implementation When a project is prepared When a project is implemented What needs to be done during preparation and delivery of a terminal evaluation When a terminal evaluation is planned When a terminal evaluation is conducted When a draft report is prepared Page 12

13 Importance and Utility of Terminal Evaluations Source of information on project Results: Outputs, outcomes and progress to impact Implementation, execution, and project cycle related information Project finances including co-financing Recommendations and Lessons for the future GEF M&E Policy (2010): Minimum Requirement 3 Terminal evaluations mandatory since 1995 For full-size projects required, encouraged for MSPs Page 13

14 Importance and Utility of Terminal Evaluations contd. Reporting at the project portfolio level (APR, AMR) Input to other evaluations STAR s performance index About 1000 terminal evaluations completed so far. Terminal evaluation may be accessed at: GEF website: Through PMIS Page 14

15 Characteristics of a Good Terminal Evaluation GEF IEO criteria for terminal evaluations quality: Outcomes Consistency and comprehensiveness Sustainability Lessons and recommendations Project finances M&E Other characteristics of good terminal evaluations: Transparency and timeliness Candor Balance Utility Question is good terminal evaluation and good project performance the same? Terminal Evaluation Guidelines are available at: Page 15

16 Examples of Good Terminal Evaluations Links to examples of good terminal evaluations GEF ID #394: GEF ID #1599: GEF ID #1188: GEF ID #1348: Page 16

17 Exercise: Pre-requisites for preparing a good terminal evaluation You will be asked to think about what needs to be done to facilitate preparation of a good terminal evaluation: At different stages of terminal evaluation preparation At project preparation and implementation Each group will discuss the requirements at each of these steps and will record their joint responses as bullets in the response sheet provided to them. After all stages have been discussed by the groups, one of the groups will present its response for a stage, others may add if their group had an additional bullets not yet covered. Each stage will be presented by a different group. We will end with a summary that pulls the discussion together Page 17

18 First Discussion: What needs to be done during project preparation and implementation? 1 A. What needs to be done during the project preparation stage? Development of M&E plan Tracking tools 1 B. What needs to be done during the project implementation? Implementation of M&E plan Gathering of data on tracking tools Page 18

19 Second Discussion: What needs to be done during preparation and delivery of a terminal evaluation? Consider a situation where a project is about to be complete within one year. What needs to be done at different stages of terminal evaluation preparation to ensure that it leads to a good quality evaluation: 2 A. Commissioning of the terminal evaluation 2 B. Conduct of the terminal evaluation 2 C. Finalization of the terminal evaluation Page 19

20 Short Presentations by Stages Presentation on group discussion Summary Page 20

21 Thank you