BACKGROUND TERMS OF REFERENCE MONITORING/EVALUATION CONSULTANT Reference No.: SPIRIT/IC-M&E/16 Scholarships Program for Strengthening Reforming Institutions (SPIRIT) BAPPENAS Government of Indonesia with the International Bank for Reconstruction and Development, World Bank Group, signed a Loan Agreement to commence the Scholarships Program for Strengthening Reforming Institutions (SPIRIT) with a project period of 2011 2017. SPIRIT has three components with a total cost estimated at US$ 112.65 million, all of which financed through IBRD Loan No. 8010-ID. PROJECT DEVELOPMENT OBJECTIVE The Development Objective of the proposed project is to build participating agencies capacity by (a) strengthening their human resources in core functional areas; and (b) enhancing their ability to initiate and manage reforms. Further, more detailed objectives of the program are in Annex 1: Results Framework and Monitoring. PROJECT DESCRIPTION The Project consists of the following parts: 1. Degree Scholarships for Ministry of Finance (a) (b) Competitive selection of candidates, and provision of pre-departure language training to selected candidates. Award of scholarships for overseas and joint domestic and overseas (Link) degrees to successful candidates in fields relevant to the work of the Ministry of Finance. 2. Degree and Non-Degree Scholarships for Bappenas Cluster of Participating Agencies (a) (b) Competitive selection of candidates, and provision of pre-departure language training to selected candidates. Award of scholarships for domestic, overseas, and joint domestic and overseas (Link) degrees and overseas and domestic non-degree training to successful candidates in fields relevant to the work of the respective Participating Agency. The participating agencies coordinated by the Bappenas Project Implementing Unit (PIU) are: 1. Ministry of National Planning Development/National Planning Development Agency (BAPPENAS) 2. National Civil Service Agency (BKN) 3. Investment Coordination Board (BKPM) 4. Supreme Audit Board (BPK) 5. Financial and Development Supervisory Board (BPKP) 6. National Land Agency (BPN) 7. Ministry of Foreign Affairs (MoFA) Page 1 of 7
8. Ministry of Home Affairs (MoHA) 9. National Institute of Public Administration (LAN) 10. State Ministry for Administrative and Bureaucracy Reforms (MenPAN) 3. Program and Project Support Sub-component 3.1: Program management (i) (ii) Scholarship program management, including matching of scholars to institutions and courses, payment of tuition fees to institutions and living and supplies stipends to scholars, and monitoring of scholars. Provision of support to the Project Coordination Unit and the Project Implementation Units in relation to Project management, implementation, including financial and procurement management support, and routine monitoring. Sub-component 3.2: Quality assurance, and monitoring and evaluation (i) (ii) (iii) Carrying out of annual technical audits of scholarship program compliance with agreed eligibility, selection, and implementation modalities as specified in the Project Operations Manual. Carrying out of an alumni and Participating Agency staff survey in relation to alumni satisfaction with the program and of a broader Participating Agency staff assessment in relation to program impact on Participating Agency capacity development. Provision of support for development and implementation of a scholar re-entry and career development program. OBJECTIVE OF ASSIGNMENT The objectives of the Monitoring and Evaluation Consultant ( Consultant ) are to: 1. Monitor progress of scholars and evaluate results of training, both for domestic and overseas degree and non-degree programs in the PIUs, and 2. Monitor progress and evaluate results of overall SPIRIT program, compared to its results indicators stated in Annex 1. SOURCE OF FUNDS The source of funding for the recruitment of the Consultant is the IBRD Loan 8010-ID. The expenditure will be funded from Category 1 (Goods and non-consulting services, Consultancies, Training and Operating Cost). DUTIES AND RESPONSIBILITIES: 1. Develop monitoring and evaluation policies, including M&E plan, procedures, tools and methods for the program; 2. Monitor the progress of scholars in overseas and domestic degree and non-degree programs, as well as returning alumni with the support of TRANSPAR system; 3. Evaluate the results of degree and non-degree programs through TRANSPAR system, training evaluation and satisfaction surveys and selected interviews as necessary to Participants; 4. Provide inputs and updates to the TRANSPAR database as necessary to ensure that the a sound and reliable source of basic data is available; Page 2 of 7
5. Identify and propose solutions to problems and challenges faced by scholars, in coordination with the Project Implementing Units (PIUs), Project Management Unit (PMU), Commitment Holder (PPK) and team; 6. Monitor progress and evaluate results of Participating Agencies performance and link them with resources allocations; 7. Monitor, provide analysis and inputs to ensure the program is performing as the results indicators in Annex 1, using data from TRANSPAR, Human Capital Development Plans and Human Resources Data, results from annual Technical Review, Alumni and Participating Agencies Staff Survey and other related sources; 8. Provide inputs and analysis on progress of SPIRIT to program reports (implementation support missions, annual report, mid-report, final report, etc.); 9. Together with the Information System Officer, make sure that data are accessible. 10. Prepare and writing reports of Benefit Monitoring and Evaluation in Indonesia and English ORGANIZATION AND REPORTING The Consultant will report directly to the Project Manager as the Team Leader of Project Management Unit (PMU or in below chart Konsultan ), which will be reported to the Head of Project Implementing Unit (Head of Pusbindiklatren Bappenas) and the Project Coordinating Unit (PCU), and would cover the following : 1. The and improved Monitoring and Evaluation framework; 2. Timely project progress reports with up to date progress of the project s key performance indicators (quarterly, semi-annually, annual) to be used as management tools for further decision. The following is the SPIRIT project governance: Page 3 of 7
The Consultant will be a part and will be working closely with PMU as well as with other divisions in the PIU. The Consultant will also be supported by an Assistant for Monitoring and Evaluation. SELECTION CRITERIA Post graduate degree in the field of monitoring and evaluation, management, statistics, mathematics, research, human resources, development studies, and other related field. Minimum 5 (five) years of experience in Monitoring and Evaluation practices particularly in human resources, training, scholarships and other related field. Strong communication, analytical, research, as well as numerical abilities. Practical experience in the design, planning, and applying monitoring and evaluation frameworks. Fluency both in Bahasa Indonesia and English is essential, both oral and written. LENGTH OF ASSIGNMENT The consultant will be offered 1 (one) year as an initial contract with the possibility of extension approximately until 2017 based on annual performance evaluation. The project may terminate the contract at any time if the Consultant deemed to be unperforming. Page 4 of 7
ANNEX 1: RESULTS FRAMEWORK AND MONITORING Project Development Objective (PDO): The Development Objective of the proposed project is to build participating agencies capacity by: (a) strengthening their human resources in core functional areas; and (b) enhancing their ability to initiate and manage reforms. PDO Level Results Indicators* Core Unit of Measure Baseline Cumulative Target Values** YR 1 YR 2 YR3 YR 4 YR5 Frequency Data Source/ Methodology Responsibility for Data Collection Description (indicator definition etc.) Increase in percentage of staff with the relevant competencies in the core priority areas of the participating agency, as based on needs and gap analysis %; gap analysis score N/A 5% increase 10% increase 15% increase Annual ; HR database; tracer studies PA Percentage of respondents in the agency expressing satisfaction with the impact of the program on building agency capacity % N/A 75% expressing satisfaction Periodic Staff Survey PCU INTERMEDIATE RESULTS Intermediate Result Technical competencies and gap analysis conducted Human Capital Development Plans () prepared that identify key competencies required, and staff skill gaps in core priority areas Report 22 prepared Annual PA Page 5 of 7
Project Development Objective (PDO): The Development Objective of the proposed project is to build participating agencies capacity by: (a) strengthening their human resources in core functional areas; and (b) enhancing their ability to initiate and manage reforms. Scholarships in priority areas Percentage of scholars participating in degree and non-degree programs that were identified through the gap analysis in % N/A >90% >90% >90% >90% >90% Annual ; project monitoring reports; HR database PA, PCU Scholar selection transparent and meritbased Percentage of scholars selected (in each year) as per procedures specified in Project Operational Manual, as verified by independent technical audit % N/A >95% >95% >95% >95% >95% Annual Independent Technical Audit PCU Successful completion of studies Percentage of scholars completing their programs of study with GPA s >3.0 (annual targets) % N/A 80% 80% 80% 80% 80% Annual Project monitoring reports, HR databases PCU, PA Effective scholar reintegration, ment, and career development policies in Decree None and ment ment, ment, ment, ment, Annual Project monitoring reports PA Page 6 of 7
Project Development Objective (PDO): The Development Objective of the proposed project is to build participating agencies capacity by: (a) strengthening their human resources in core functional areas; and (b) enhancing their ability to initiate and manage reforms. Database and tracer studies used for tracking ment progression of returned scholars Program evaluation Limited Database used for tracking alumni Database used for tracking alumni Database used for tracking alumni Percentage of staff expressing satisfaction with the program based on staff survey % N/A 75% expressing satisfaction Periodic Staff Survey PCU Jakarta, Februari, 2016 Head of Center for Planner s Development, Education and Training Ministry of National Development Planning/National Development Planning Agency Ir. Yahya Rachmana Hidayat, MSc., PhD NIP 1962032331989031003 Page 7 of 7