UNITED NATIONS CHILDREN'S FUND (UNICEF) CALL FOR INSTITUTIONAL EXPRESSIONS OF INTEREST (EOI) UNICEF programming in health systems strengthening a forward looking evaluation Date of the EOI: 22 August 2016 Closing Date of the EOI: 26 September 2016 Email EOI to: evalofficeapplications@unicef.org 1 PURPOSE OF EXPRESSION OF INTEREST (EOI) The UNICEF Evaluation Office (New York) plans to commission a global evaluation of UNICEF s strategies and programmes with regard to health systems strengthening and seeks Expressions of Interest (EoI) from qualified institutions (consultancy firms, universities, etc.). Institutions that meet the requirements of this EoI will be shortlisted and invited to submit full technical and financial proposals. This EoI document provides a short description of the planned evaluation. Detailed terms of reference (ToRS) will be provided to those organizations selected to advance to the next stage. 2 BACKGROUND Health systems strengthening is one of three overarching approaches of the newly-developed UNICEF Health Strategy which link UNICEF s actions to its dual goals of ending preventable maternal, newborn and child deaths and promoting the health and development of all children (the other two are addressing inequities in health outcomes and promoting integrated, multi-sectoral policies and programs) 1. These approaches are viewed as necessary to increase focus and coherence across health programs and should underpin all of UNICEF s programming and engagement in the health sector. In this strategic context, stronger health systems are necessary to reach the most marginalized children and women, to sustain the progress achieved and to increase the resilience of both delivery systems and communities to absorb and recover from external shocks, including public health emergencies and outbreaks. Through its heath programming efforts, UNICEF has made substantial investments in activities to both support and strengthen health systems. These efforts have been implemented in a wide range of contexts with limited commonality of definition, concepts and approaches. In the past, many in UNICEF used the World Health Organization s six health systems building blocks to frame and guide their work. However, the thinking around the building blocks has shifted and agencies, including UNICEF, are re-strategizing their approaches. The current situation is characterized as transitional with a move away from the building blocks and investments supportive of specific programs and towards actions aimed at durable improvements in health services which result in equitable health, nutrition and development outcomes for children. Recently, UNICEF adopted a common definition of health system strengthening as actions that bring about sustained improvements in the provision, utilization, quality and efficiency of health services, broadly defined to include family care, preventive services and curative care, and that produce equitable health, 1 UNICEF. UNICEF s Strategy for Health 2016-2030. 2015. Programme Division. 1
nutrition and development outcomes for children, adolescents and women 2,3. HSS actions may also address the wider health system through drivers such as policies, governance, financing, management, implementation capacity, behavior and social norms and nations participation in initiatives designed to maintain national and global health security. UNICEF s new approach to HSS is framed around a core set of actions that are categorized by level and issues specific to that level and local context (Figure 1). The levels at which HSS actions are taken are community, decentralized or sub-national, and national level. Issue-specific actions pertain to data and information system, procurement and supply chain management, social protection and welfare, private sector engagement and regulation, and quality of care. Figure 1 Schematic representation of UNICEF's HSS approach Given the centrality of HSS in UNICEF s strategic direction, an evaluation of these efforts is a priority corporate undertaking and thus, included in UNICEF s Plan for Global Thematic Evaluations. However, the shifting conceptual basis and gaps in available information pose a challenge for the design of the evaluation. To prepare for the evaluation, UNICEF is conducting a HSS scoping and mapping exercise (June- September 2016) which will create an evidence base on the range, resources and distribution of interventions pursued by UNICEF; distil and analyse issues, clarify concepts and definitions of HSS as they are understood within UNICEF; and contribute to the evaluation focus and approach. 3 OBJECTIVES OF THE EVALUATION With the development of a new Health Strategy 2016 2030 and the accompanying resource paper on Health Systems Strengthening, the evaluation is being framed in a forward-looking manner to help inform implementation based on these new guidance documents. The purpose of the evaluation is twofold: firstly, to generate evidence and learning to guide effective action for strengthened and sustainable health systems in the coming years and; and secondly, organizational accountability for its performance and results. The findings and recommendations put forth by the evaluation will be used to influence strategic direction and partnerships/advocacy as well as programme strategies (sectoral and cross-cutting) to achieve the results and targets outlined in the Health 2 Ibid. 2
Strategy. In addition, the evidence generated by the evaluation will inform UNICEF s next strategic plan covering the years 2018 to 2021. In general terms, the evaluation will: Assess the relevance, appropriateness and coherence of UNICEF s global, regional and country programme strategies and plans to address health systems strengthening. Assess the effectiveness, efficiency and sustainability of UNICEF s country programmes in addressing health systems strengthening with particular attention to less reached, disadvantaged and vulnerable groups. Assess UNICEF s leadership, guidance and technical support at all levels as well as the adequacy of UNICEF staffing/institutional capacity. Provide forward-looking lessons, conclusions and recommendations for strengthening UNICEF s work. 4 SCOPE OF WORK The evaluation has a broad focus covering the assessment of UNICEF s investments across organizational levels namely: global, regional and country-level. An important emphasis will be on country level strategies and programmes including sustainability and partnership arrangements. In terms of geographic/regional focus, the evaluation will target all of UNICEF s seven regions in order to examine experiences in countries with varying levels of capacity. A relative emphasis will be placed on those countries and regions where UNICEF s HSS investments are most significant. In terms of the time-frame covered, the evaluation will build on the retrospective HSS mapping and scoping exercise (covering the period 2010-2015) thereby allowing a direct focus on on-going implementation (approximately 2016 to 2017). 5 PERIOD OF ASSIGNMENT AND EVALUATION APPROACH The evaluation team is expected to be contracted in late November 2016 for a January 2017 start of the evaluation. Although the precise design of the evaluation is under discussion, it can be broadly considered to have three phases: the Inception Phase, the Data Collection Phase, and the Analysis and Reporting Phase. During a comprehensive Inception Phase, the evaluation team will assess and build out, as needed, UNICEF s results chain/theory of change on health system strengthening accounting for the organization s manner of operating across levels. This phase will incorporate the results of the mapping and scoping exercise and include a relevant literature, development of the conceptual framework, a detailed evaluation matrix and action plan for conducting the exercise. During a Data Collection Phase, the evaluation team will used multiple methods to collect data through means such as desk reviews, key informant and stakeholder interviews, on-line surveys, case studies. To accommodate a forward-looking evaluation design, it is anticipated that the Data Collection Phase may be somewhat extended to allow progress in implementation. Therefore, the evaluation will be expected to generate interim analytical products and updates to satisfy the learning objective on an on-going basis. During the Analysis and Reporting Phase, the evaluation team will employ a mixed-methods approach entailing triangulation of findings to arrive at evaluative conclusions and recommendations. The evaluation team will, under the overall responsibility of 3 UNICEF. 2016. UNICEF approach to Health Systems Strengthening. A resource paper for the UNICEF Strategy for Health 2016-2013. Health Section, Programme Division. New York. June. 3
the team leader, draft successive versions of the Evaluation Report for review by UNICEF EO and an Evaluation Advisory Group which will be established in support of the evaluation. The evaluation team will report to a Senior Evaluation Officer in UNICEF s Evaluation Office. The evaluation is expected to be completed by mid-march 2018. 6 DESIRED TEAM COMPOSITION AND PROFILE Qualified institutions (consultancy firms, universities, etc.) that have the capabilities to meet the following requirements, and are available for the evaluation period indicated, are invited to submit an EOI. In their EoI, institutions are required to specify their capacity to provide a team of evaluation specialists with expertise in health systems strengthening and work experience that covers the following areas or comparable professional area/content: data and information systems, procurements and supply chain management, social protection and welfare, engagement and regulation of the private sector, and quality of care at community and facility levels. Team members should have experience in these professional/content across levels (i.e. with community platforms, decentralized health systems management, national-level functions including policy and strategy development, planning and budgeting). As a whole, the team should bring skills and experience including: strong conceptualization, analytical and writing skills; hands-on experience in collecting and analysing quantitative and qualitative data; knowledge management for evaluation, information technology and data management; expertise in handling collaborate teamwork software, online surveys, document repositories, bibliography software and databases; use of consistent interview protocols, templates for recording and reporting on interviews; good communication and people skills and ability to communicate with various stakeholders. Given the scope of this evaluation, it requires professionals with significant expertise at senior levels, as well as solid organizational back-office support functions. The Evaluation Office encourages interested institutions to proffer an indicative team of evaluators, with the understanding that final identification of team members and confirmation of their availability will be carried out at the proposal-writing stage. However, companies will be assessed favourably at the EoI stage for proposing a highly qualified team leader, and giving assurance of his/her availability. A highly qualified team leader is considered to have a strong team leadership and management track record, extensive evaluation expertise (at least 10 years) of comprehensive scope with strong mixed-methods evaluation skills; and familiarity with UNICEF s programming, policy and advocacy work. We require institutions to demonstrate familiarity with UNICEF work for children and women s rights with an equity focus, and ability to communicate in more 3 or more UN languages. Companies should also demonstrate experience/familiarity with countries of different typologies, including countries undertaking humanitarian programming and those with upper middle income status. A demonstrated capacity to assemble a team with adequate gender and geographic balance will be an added advantage. The institutions should demonstrate its commitment to handling back-office support and logistics as needed. The evaluation team should demonstrate a firm grasp of the ethical issues associated with working with children and of the recognition that the safety and welfare of rights-holders is paramount. 4
7 SUBMISSION OF EXPRESSION OF INTEREST (EOI) Interested institutions are encouraged to complete and submit the attached EOI form. Please submit one form only per proposed evaluation team. EOIs should be sent to evalofficeapplications@unicef.org no later than close of business on 26 September 2016. Please quote UNICEF programming in health systems strengthening a forward looking evaluation as the subject in your correspondence. This EOI does not constitute a solicitation. We do not require bids or proposals at this stage; we merely seek your expression of interest in participating in the tender. A response to this Call for Expression of Interest does not automatically ensure that you will be selected to participate in the tender. UNICEF reserves the right to change or cancel requirements at any time during the EOI and/or solicitation process. UNICEF also reserves the right to require compliance with additional conditions as and when issuing the final tender document. Responses received without a duly completed form or an incomplete form will not be considered. Following this EOI, institutions will be short-listed and invited to tender. More detailed Terms of Reference (TORs) will be sent to short-listed institutions in the form of a Request for Proposal of Services (RfPS) during the October 2016. The RfPS will remain open for 4-5 weeks from the day of issue. If you have any questions about this EOI, please email Beth Plowman (baplowman@unicef.org). 5
UNICEF Evaluation Office Expression of Interest Form (Institutions) UNICEF programming in health systems strengthening a forward looking evaluation Please fill-in the form (up to 10 pages total) and submit to evalofficeapplications@unicef.org Full Name of Institution: Type of Entity: User Salutation: Dr. Ms. Mr. First Name: Last Name: Job Title/Role in Entity: Phone Number: Alternate Phone Number: (please include country & city code) (please include country & city code) Contact E-mail Address: Mailing Address: City: State: Postal Code: Country: Address of Internet Website: Alternate Contact Person: 6
Please answer the following mandatory questions: 1. Provide information which will enable us to determine whether your company/organization has the capacity to carry out a multi-country evaluation. In no more than three pages, information should include: organizational structure including any associates, partner firms, etc and infrastructure in place to support the evaluation, including an overview of company financial profile; the year in which the company or consultancy firm started operating, and the number of years in the consultancy business. staff capacity, both technical and support staff (to the extent possible, attach CVs of prospective team members, pending confirmation of their availability) 2. Provide information which will enable us to determine whether your company/organization has relevant evaluation experience and specialized knowledge in HSS to be covered by the evaluation. In no more than four pages, the information should include: a description of the technical competencies of proposed team members, evaluation experience of individual team members and the number of years of evaluation experience; and indicate if they have previously worked for your company in the capacity being proposed a description of proposed team members experience in health systems strengthening through policy or strategy development, program implementation, and/or research; or other involvement a description of the type of evaluations the institution has carried out notably most relevant past experience with formative, prospective or developmental evaluations any evaluations commissioned by UN agencies and other comparable international organizations that the institution has conducted or proposed individual team members participated in. 3. Confirmation that your entity: Has no on-going litigation with the UN; Is not currently removed/invalidated or suspended by the United Nations or UN system organisations; 7