Terms of Reference: Project Final Evaluation

Size: px
Start display at page:

Download "Terms of Reference: Project Final Evaluation"

Transcription

1 Terms of Reference: Project Final Evaluation 1. Background Project: Implementing agency and partner(s): Project funding sources: Creating a space for the participation of Myanmar s civil society in policy dialogue People in Need, Loka Ahlinn, EPD European Commission, MFA Czech Republic and private funding Assignment: Conducting a final evaluation of the project achievements Expected locations of Mandalay Region, Shan, Kayin and Mon States travel outside of Yangon Period of assignment: February 2019 Type of contract: Consultancy contract Open to: Research/policy experts or team of experts Deadline for submitting 21 st December 2019 applications: Submit to: hr.myanmar@peopleinneed.cz 1. PROJECT BACKGROUND The Project Creating a space for the participation of Myanmar s civil society in policy dialogue is implemented in four states and regions namely Kayin, Mon, Shan States and Mandalay Region. Within the recent policy framework, the project provides support for the development of a coherent bottom-up approach for policy dialogue that includes the strengthening of the capacities and role of civil society in interaction with local and regional authorities for an effective and efficient implementation of the local development actions and policy making efforts. Specific objectives SO 1: To develop the organisational and technical capacities of local CSOs in governance, accountability, financial management and advocacy for enhancing their role in policy dialogue. SO 2: To support networks to consolidate and to foster their active participation in policy dialogue and in national and local governance processes SO 3: To enhance the relationship between civil society and media, regional parliaments and local authorities in order to increase mutual understanding and strengthen communication channels between them

2 The achievement of the above mentioned objective is supported by the following results: Expected Result 1: Strengthened governance and accountability of 30 CSOs and their involvement in policy dialogue through sub-projects implemented in their areas of intervention Expected Result 2: Increased organizational, advocacy and technical capacity of 30 CSOs to perform their roles as actors in the policy and advocacy process more effectively Expected Result 3: Enhanced cooperation and best practice sharing among CSOs in networks in order to improve their influence and participation in monitoring, formulation and implementation of public policies, legal reforms, and joint programmes Expected Result 4: Strengthened participation of civil society actors in policy dialogue and enhanced trust between those actors and Region and State Parliaments, Local Authorities and other stakeholders Expected Results 5: Increased promotion of inclusive and sustainable development and policy dialogue actions through cooperation with donors and media The major activities to support the attainment of results are as follows: Grant competition and provision of sub-grants for CSOs based on sector priorities; orientation workshops for CSOs on grant competition; Participatory Impact Assessment CSOs capacity assessment and capacity development plans; Tailor-made training programme leading to development of organisational, advocacy and technical skills; Exchange visits and experience sharing Networking meetings to plan advocacy and policy dialogue actions; collective policy assessment workshops with CSOs; grant competition and provision of sub-grants for joint advocacy actions Series of consultative meetings with representatives of Region and State Parliaments, Local Authorities and other stakeholders; series of multi-stakeholder dialogue events. Final conferences to disseminate the Roadmaps; meetings between CSOs and donors on recommendations from the Roadmaps Expert studies: CSO Sustainability, Drugs in Myanmar, Land Tenure Security in Shan and Mandalay 2. OBJECTIVE AND SCOPE OF THE EVALUATION The main purpose of the evaluation is to assess the quality of implementation, the immediate impact of the project and its perspectives for sustainability, as well as provide recommendations for the next stages of related programming. Objectives: 1. To evaluate the outcomes and impact of the INSPIRED Myanmar project against its key objectives;

3 2. To analyse the outcomes of the 4 dialogue process implemented according to the INSPIRED approach 1, with a special focus on the improvements in the capacities of the target groups and stakeholders that have taken part in them; 3. To analyse the impact (both positive and negative changes) that have occurred within beneficiary groups in particular members of CSOs and representatives of Joint Advocacy Groups and along different levels: knowledge, attitudes and behaviours; 4. To identify any problems and constraints that the project may have encountered and to explain their repercussions within the wider political context; 5. To assess the project s financial management and the overall efficiency of the action (value for money) 6. To identify important lessons to be learned and to make recommendations for the sustainability of its main outcomes once the funding is over Scope: Aspects of the project requiring more in-depth analysis: 1. Relevance of effort for capacity building of CSO members; 2. Relevance of capacity building of applicants and grantees for sub-grants; 3. Potential of INSPIRED to contribute to national dialogue process on local issues Geographical scope: The fieldwork will take place in the four target areas, with some interviews in Yangon. 1 The INSPIRED approach is the methodology for inclusive and participatory policy dialogue that has served as a learn-by-doing exercise to familiarise the target CSOs with the policy making process. More information can be found in the following link:

4 3. KEY EVALUATION QUESTIONS The following is an indicative list of evaluation questions. The evaluation team/consultant is expected to develop them further when submitting the inception report with the full methodology of the evaluation. Relevance How would you evaluate relevance of the project in respect to the local context (capacity of CSOs, legal framework and financial sources accessible or local CSOs, current cooperation between CSOs and local authorities etc.) Is the INSPIRED approach relevant to promote the engagement and participation of CSOs in the policy making process? Is the regional/state context an appropriate level to influence the policy-making process? Effectiveness Were all the intended outputs and outcomes delivered according to the set indicators? Were other unforeseen outcomes delivered? (especially within the INSPIRED dialogue processes) What changes (intended and unintended) have been implemented in the project? Do the changes have positive or negative effect in terms of meeting the project results and objectives? Efficiency Was the management, coordination and monitoring of the project efficient and appropriate? Assessment of local project ownership and stakeholder participation, including impacts on policy discussion. Impact What changes can be observed with regards to participation of the population in policymaking process Did the sub-grants scheme contribute to the improvement of the specific themes the subgranted projects were addressing? Sustainability Do CSOs members demonstrate commitment to the participatory and constructive approach promoted by the INSPIRED methodology? Has CSOs engagement and access to public authorities at local, State and Union levels increased as a result of their participation in the process? Do members of regional advocacy platforms possess sufficient skills, competencies and capacity to manage resources to ensure the sustainability of their organizations? PIN will require specific and data-supported answers to each of the agreed evaluation questions or strong justification for why the data could not be obtained. Justification of data unavailability must be communicated by the evaluator without any delay as soon as it becomes apparent and it has to be approved by PIN. Failure to do so can result in decreasing the consultant s remuneration.

5 4. METHODOLOGY AND APPROACH The evaluation is expected to apply qualitative methods of research - semi structured interviews, focus group discussions, desk research of related data including project documentation. 1. Document review Project documents Project proposal, logframe and budget EU call for proposals INSPIRED Handbook Internal Mid-term review Roadmaps for reform and their implementation plan (4) Participatory Policy Assessments (4) Integrated Support Framework on policy issues M&E plan, Results Framework Policy Studies (2) Capacity building need assessment, individual tailored capacity strengthening plans (baseline and endline) Documents produced by CSOs CSO proposals, action plans and reports Data collection/field research: Interviews and/or focus group discussions with: project team and partners, project consultants; authorities (local and national); CSOs members, grantees, direct or indirect beneficiaries of sub-grants projects, rejected applicants. Internal Evaluation: The Evaluation Team/Consultant will take into consideration the outcomes already identified through the internal evaluation of the four INSPIRED dialogue process (carried out following the method of Outcomes Harvesting ) and will take the necessary steps to substantiate these outcomes during his/her interviews with the relevant stakeholders. 2. Specific tasks to be performed by the Evaluation Consultant: Review of project documents Meetings with project staff and relevant stakeholders To adequately prepare for the field work by reading background information and conducting desk research To conduct the field work, with support from PIN+LA, in line with the agreed methodology To upload and store electronically all data collected during the survey Provision of recommendations for future programming (emphasis on the immediate phases after the project, but looking also at other possible rural development interventions) and for capacity building Preparation of evaluation documents (inception report, draft report, final report)

6 3. Roles and responsibilities of project partners: To review the Evaluation Methodology designed by the expert in the Inception Report and provide feedback prior to its finalization To provide the Consultant with all the necessary information to carry out his/her tasks To provide feedback on the Consultant s Inception Report and First Draft of the Final Evaluation Report and to approve the Final Report in line with the partner organizations quality standards Local level support: to support the Evaluation Team/Consultant during the field work in each of the four regions, providing him/her with logistical support and enabling him/her to access the project s beneficiaries (together with partner CSOs) To provide technical guidance and logistical support regarding the access to and involvement of CS groups in the review, as necessary 4. Expected deliverables Inception report (methodology, tools, work schedule) Presentation of findings to the project team and partners in Yangon Draft report submitted to the PIN Programme Manager for review and comments prior to finalizing and submitting the final document Final report (with incorporated feedback) submitted to the PIN Country Director and CSO Support Programme Manager 5. Evaluation report The final evaluation report should include: Executive summary; Brief description of the context and the project; Description of evaluation methodology and data collection methods; Presentation of the main findings and conclusions; Substantiation of the preliminary outcomes identified by the internal evaluation of the dialogue processes; Discussion of lessons learned; Recommendations Annexes The evaluation report s executive summary should not exceed two pages, and the remaining parts of the report should not exceed 40 pages (excluding annexes).

7 6. Duration The Consultant should perform all of the tasks under these Terms of Reference during the assignment period. Expected workload is approximately working days according to the following schedule: Preparatory phase, desk study Last week of January 2019 Field work, data collection No later than February 1 st 2019 Debriefing with the project team in Yangon Submission of 1 st draft of report February 28 th 2019 Comments from all implementing partners March 8 th 2019 Submission of the final evaluation report March 15 th 2019 Date to be specified upon signing the contract 7. Logistics PIN will arrange transportation within the regions/states (rented car, motorbike) to selected project sites. All other costs must be borne by the Consultant and included in the financial offer. PIN and Loka Ahlinn team will make themselves available during the consultancy, and particularly during the field missions, to provide the Consultant with the necessary information to smoothly conduct the evaluation. More specifically, PIN and Loka Ahlinn will provide the following additional support: Facilitation for organizing interviews and meetings, Stationary, workspace and internet within PIN and Loka Ahlinn premises during the whole duration of the assignment 8. Qualification requirements Education Degree in international development, social or political sciences, economics, law, rural development, or other related field; Post-graduate studies on Public Policy will be considered an asset. Work Experience Proven professional experience in the fields of public policy, community development, rural development, economic development, CS capacity building and/or good governance; Significant practical experience in monitoring and evaluation, social research, report writing and formulation of recommendations; Sound understanding of the influence of political factors and power relations in developmental processes in line with the principles advanced by the practitioner communities Thinking and Working Politically and Doing Development Differently ; Knowledge of the political organization of the Myanmar Public Administration at Union and State Levels

8 Skills Strong analytical and communication skills Proficiency in written English Ability to meet deadlines and prioritize tasks Fluency in English, Myanmar language skills an advantage 9. Application process Interested applicants must submit the following: Full CV (in English) to include relevant professional experience and list of previous similar assignments; Proposed evaluation methodology and work plan (max. 4 pages); Price offer (to include consultant s fees and ALL costs not specifically mentioned in the Logistics section above); please note that, due to budget constraints, offers above 14,000 EUR will not be considered. Sample of previous similar work (in English). The above shall be sent to the following address: hr.myanmar@peopleinneed.cz using the subject heading Ref: Final Evaluation CSO-LA. Incomplete applications or applications sent through other channels will not be considered. Deadline for applications: January 8 th, The Consultant should be available to start no later than February 1 st 2019.