Somalia programme. Terms of Reference (TOR) End of project evaluation

Transcription

1 Somalia programme Terms of Reference (TOR) End of project evaluation Integrated WASH and Livelihoods Response in Bay and Gedo Regions, South Central Somalia 2015

2 BACKGROUND: Oxfam has worked in Somalia in development and humanitarian sectors over years. In the South Central south, the programs have focused on Public Health (Water and Sanitation and Hygiene Promotion), and Food Security and Livelihoods programming with overall aim at poverty eradication. Somalia continues to face complex and protracted humanitarian situations in the world. Malnutrition rates remain amongst highest in the world and access to basic survival food remains a serious challenge for a significant percentage of the population. In response to the complex and protracted humanitarian crisis facing Somalis in the South Central region, Oxfam proposed an intervention to provide emergency and sustained water provision, environmental sanitation, hygiene education and livelihood support so that affected women and men will have improved access to safe water and sanitation services whilst meeting short-term food needs, and retaining community assets. The proposed interventions include rehabilitation of water sources, support to environmental sanitation (latrine construction and garbage collection), hygiene awareness campaigns and lean season conditional cash transfers that support new community assets and unconditional cash transfers for the most vulnerable. The project will benefit a total of 67,329 IDPs, pastoralists, agro-pastoralists and people in urban areas through improved WASH services. The project has been implemented in partnership with SADO and funding from DFADT Purpose: This project is an integrated WASH and Livelihood response targeting vulnerable communities in Bay and Gedo regions of Somalia, and has two main outcomes. Outcome 1: Increase access to, and use of, safe water, sanitation facilities and improved hygiene practices The indicators are as follows % of targeted beneficiaries report increased availability of water % of women and girls report walking shorter distances to collect water % of targeted beneficiaries are using latrines appropriately (sex disaggregated) % of targeted beneficiaries are practicing safe hygiene (hand washing, safe water handling and safe faecal disposal practices) % of targeted communities utilizing sanitation tools for solid waste management Activities: Rehabilitation of 2 boreholes and producing potable water Rehabilitation of 12 water pans and being used by the community and 12 shallow wells 13 Water Management Committees (composed of at least 30% women) demonstrate ability to operate, manage and maintain water points 2,899 household water filters distributed and are used effectively 105 latrines of acceptable quality constructed 525 portable solar lamps distributed and being used Distribution of sanitation tool set distributed and being used for Cash for work activities and environmental sanitation Selection and training of 114 hygiene promoters selected and carrying out hygiene promotion activities 270 hygiene kits (water container, soap and water purification chemicals) distributed after consulting beneficiaries as well as sanitary towels Outcome 2: Increased access to income to meet minimum food requirements Indicators % of targeted households with improved coping strategy index as compared to baseline % of targeted households with improved food consumption score of 35.5 or above Activities: 409 households receive three cash disbursements of 50% of the minimum food basket expenditure

3 440 households participate in non water pans desilting CFW activities and receive 3 rounds of 60 USD payments in Garbahaley and USD 45 in Baidoa 1333 household participate in De-silting of 12 community water catchments in grazing/farm areas Environmental cleanup activities Tree planting activities at water points 3. Evaluation Purpose and Objectives This evaluation will seek to measure the change realized by both this action. It will seek to establish how this project is contributing towards achieving the intended objectives and the impact made to the targeted beneficiaries and well as enrich the learning process for new ideas employed during this project. The evaluation will also look at how the project was delivered, integration with contribution from other stakeholders and generate learning s that will help in coming up with recommendations especially on coordination, monitoring, accountability, Do No Harm principles. The evaluation must address the following specifics To determine the relevance and appropriateness of the action given the following context The assistance in Somalia was mainly humanitarian and early recovery and thus may not have addressed the root-causes. Contextual changes in the project delivery area are inevitable due to recurrent conflicts, drought, floods and other dynamics. The evaluation thus seeks to determine how the delivery approach has been adopting and responding to these contextual changes and evidence of incorporating for lessons learnt. The level of integration and roles played by other stakeholders In analyzing this information, the evaluation is trying to seek the level at which the project outcomes / results, their respective activities and implementation approaches used were able to contribute to the project s main objective.. This will thus determine whether this was the right intervention given the prevailing situation. The evaluation is also expected to determine the levels of participation of all the stakeholders in the project cycle, i.e. design, implementation, monitoring and taking consideration the special groups especially women, boys and girls and other disadvantaged groups To determine the effectiveness of the action in relation to the context The evaluation seeks to measure the extent to which the action achieved its purpose with special regards to timelines. The evaluation seeks to examine the process used to identify villages, targeting process, and analysis of inclusion / exclusion errors. The consultancy will then be required to come up with specific recommendation/s with respect to project design and targeting processes. In addition, at the evaluation will also assess how the project outcomes / results were integrated in achievements and how they were able to contribute to each other, e.g. how outcome 1 contributed to outcome t 2 and so forth. The consultancy will also seek how these results also made a contribution to the overall change desired To determine the efficiency of the action in comparison with other ways of delivering integrated WASH and livelihoods. The evaluation seeks to measure the extent to which the action realized the desired outputs in relation to the inputs provided. The consultancy will be expected to analyze the implementation approaches used in delivering the action and make comparison with alternative approaches of achieving the same outputs to see whether the most efficient process has been used in delivering the action. Special emphasis should be made on analyzing the monitoring approach employed by these groups To determine the sustainability / impact of the action The consultancy is expected to assess the result changes realized by this project / action as well as assessing communities perception of the project, their level of participation and plans / identify gaps that need to be addressed to sustain gains made by this project. The evaluation is also expected to clearly recommend based on the findings the best way forward with respect to the sustainability of the project.

4 3.5. To determine transparency and accountability during delivery of the action The evaluation also seeks to assess the degree of upward and downward accountability during project implementation. This will be analyzed by examining how the level of transparency in the whole life cycle of the project including examples of how targeting errors (inclusion or exclusion) were resolved. The consultancy is expected pay much attention in analyzing the monitoring and feedback systems from the perspectives of all stakeholders and provide useful insights and lessons To assess mainstreaming of gender and cross cutting issues in delivery of the action: The consultancy will analyze how gender and other cross cutting issues such as environmental protection, safety / dignity of beneficiaries, protection of vulnerable groups such as the elderly and the disabled were factored in during the design and implementation of the action. The evaluation will look at the roles played by marginalized groups, extent to which project activities contributed to environmental conservation, daily timings of project activities and roles played by women and men in designing and implementation of the project. 4. Evaluation Methodology The consultancy team is expected to propose scientifically, culturally and socially (in relation to the Somali context) approaches that will be used to answer the questions raised in this ToR. A mixture of qualitative and quantitative approaches should be used as well as primary and secondary data in analysing the impact and multiplier effect of the action. The consultant is expected demonstrate ability to undertake the evaluation by providing details of the process including the assessment tools, formats and method that might not be limited to the following key process Desktop review / documents review: The consultant is expected to review project documents which will be supplied by Oxfam for a deeper understanding of the project before finalizing the tools. These will include project proposal, assessment report, progress reports and other monitoring reports. The consultant is also expected to review other external secondary data prior to and after collection of data to have enough ground for further triangulation of information and probing during data collection. A secondary data checklist should thus forms part of the tools to be used during this exercise. Key Informant Interviews: the consultant is expected to hold plenary discussions with staffs (both from Oxfam and from the partner) who were largely involved in delivering this action. This will be complemented by having similar discussions with staff members from other actors in similar regions as well as selected community members who have a wide understanding of the community dynamics in the project implementation sites / villages. Several key informant guides targeting different key informant groups should also be used during this exercise. Focus group discussion: the consultant is expected to hold several discussions with different groups of community members (men, women, children and committee members) to get qualitative insights in regard to the project and underlying causes. Several FGD tools targeting different groups should be used in carrying out these discussions. Observations / photos: the consultant is expected to move to several project sites to physically assess status and quality of some of the works carried out and is also expected to have informal discussions to gather some insights and stories in regards to the same. Photos and case stories should thus be annexed with the evaluation report. Household survey: a statistically significant and representative sample size will be used in conducting household interviews using a structured questionnaire to gather primary quantitative data that will be used to make numerical comparison between the baseline and the evaluation.

5 After successfully going through Oxfam s recruitment process, the consultancy is also expected to finalize and submit a detailed inception report prior to travelling to the field. This should include: methodology; sampling; finalized tools; detailed budget; team members (and their qualifications / credentials) who will participate in the evaluation. The consultant will hold a brief presentation of initial findings and impressions the Oxfam office in Nairobi in order to give room to incorporate feedback or preparation of the final report. The partner and Oxfam will be present in this meeting to give their feedback and clarify some of the issues that might have been left out during the exercise. The consultant will then prepare a draft report and submit to Oxfam (via ) for more feedback / comments before making the final evaluation report and submit to Oxfam in PDF format. On approval of the final report, the consultant is also expected to submit three hard copies of the report and two CDs containing the report, photos, raw data and all the annexes to the evaluation report. Oxfam will work with the implementing partner to facilitate logistics for the consultancy team during the evaluation. The proposal to undertake the exercise should have an inception report that will contain brief analysis of the Somalia context, proposed methodology to undertake the exercise, sampling approaches to be used for collecting the data, targeted respondents and audients of the evaluation, quality assurance, draft evaluation tools and budget based work plan. 5. What we are looking for An independent consultant/consultancy firm with experience in Monitoring and Evaluation. Proven experience of undertaking integrated WASH and Livelihoods projects. The lead consultant/s should have at least a master s degree in wash and livelihoods related subject.. Good understanding of M&E practices.. Understanding of political, social and cultural contexts of the project area is a must. The consultant should have a clear plan on how s/he will have access to quality information from the project implementation sites without compromising on data quality. Very good knowledge of aid delivery in Somalia Have an eye for details & fully understands risks of undertaking task in insurgent controlled territories to self, corporate and or contracting party. The consultancy should demonstrate independence and ability to undertake the assignment in Somalia without compromising on quality. DURATION OF THE ASSIGNMENT: The duration of the assignment is 21 working days after signing of contract. Days are inclusive of travelling, fieldwork and reporting. The evaluation is expected to take place in July/August APPLICATION PROCESS Interested candidates should send their applications to HecaConsultancy@oxfam.org.uk before 24 th June am using the subject line END OF PROJECT EVALUATION. Kindly note only shortlisted candidates will be contacted.