REQUEST FOR PROPOSALS

Transcription

1 1.0 RIGHT TO PLAY *** DEADLINE EXTENDED *** Right To Play is an international humanitarian organization that uses the transformative power of sport and play to promote the holistic development of children and youth in the most disadvantaged areas of the world. Right To Play is committed to improving the lives of children and young people and to strengthening their communities by translating the best practices of sport and play into opportunities to promote development, health and peace. Right To Play programs foster healthy physical, social and emotional development of children and build safer and stronger communities. Right To Play s guiding principles are inclusion which recognizes the importance of children who may be marginalized for reasons of gender, ability/disability, religion, ethnicity, or social background; child protection and safeguarding; and sustainability which ensures lasting impact. As such, Right To Play is seeking a consultancy firm/group to lead the global coordination of the overall multi-phased evaluation process, including planning and revising, data collection and data analysis, and the creation and implementation of a comprehensive learning strategy. This will include the writing of any and all accompanying reports. 2.0 PROGRAM OVERVIEW The Play for the Advancement of Quality Education (PAQE) program is a large and complex initiative that aims to directly address the educational needs of children and youth through a two-year quality education program in eight countries: Benin, Ghana, Liberia, Mali, Mozambique, Rwanda, Tanzania and Pakistan. Beginning on April 1, 2015 to June 30 th, 2017, the PAQE program endeavours to improve educational attainment for children and youth aged two to fifteen in eight countries, through a sustainable and replicable child-centred, play-based learning model. Right To Play will contribute to this ultimate outcome through focused interventions at the school, community and policy level that result in: 1. Improved positive participatory and gender-sensitive learning environments that promote play-based learning 2. Improved commitment of community stakeholders to address barriers to education 3. Enhanced policy and regulatory environment for the delivery of gender sensitive, childcentered, play-based learning policies and practices across communities 4. Increased engagement of targeted Canadians and Canadian institutions in activities that promote the value of sport and play to advance quality education in developing countries

2 3.0 OBJECTIVES The primary objectives of the multi-phased evaluation are as follows: 1. To improve the quality of monitoring and evaluation frameworks of the PAQE program; 2. To determine the extent to which program results can and will be achieved; 3. To facilitate discussion and learning regarding program best practices among beneficiaries, community members, Right To Play staff, partners, and institutional stakeholders 4. To inform organizational strategic learning and continuous improvement in order to strengthen capacity to carry out quality program design, implementation, and monitoring and evaluation in the future 4.0 EVALUATION OVERVIEW A multi-phased evaluation will be conducted for the PAQE program with the anticipated timeline of August 2016 to Mid-year Phase 1 will involve a comprehensive review of all PAQE program, monitoring, and evaluation plans including the logic model, performance measurement framework, and measurement tools. It will also involve an analysis of baseline data and a final baseline report in order to determine its appropriateness and usability. The deliverables for this first phase include: 1. Refinement and recommendations for appropriate outcomes for the project given the project timeline 2. Refinement and reduction of indicators such that key program results can be effectively and efficiently obtained 3. The creation of a refined toolkit that is well-aligned with the measurement needs of the PAQE program 4. The post-evaluation analysis of baseline data and the final baseline report available for PAQE in order to determine any gaps and make recommendations as to how to complement these through an additional evaluation 5. An assessment and recommendations on capacity for collection of monitoring data 6. A refined measurement strategy that will ensure the effective collection of data and the streamlined communication of results Phase 2 will involve the development and implementation of a mid-project, mixed-methods evaluation of the PAQE program in up to four countries, including the collection and analysis of data and the production of a comprehensive report. Travel is required and the consultancy team must ensure the ability develop a robust data collection strategy for at least four countries as well as ensure the ability to source, hire and train (as needed) enumerators, research assistants, and/or associates with the ability to collect large amounts of qualitative and quantitative data. Right To Play staff are expected to be integrally involved in the collection of data and the consultancy firm/group should be mindful of this during planning. The purpose of this second phase is to collect data based on any changes made to the program measurement framework and overall strategy during Phase 1.

3 Phase 3 will involve the co-creation and implementation of an effective learning strategy that will enable the sharing of key results with beneficiaries and their communities, and key Right To Play staff members that are currently involved in the PAQE program. More specifically this will include the facilitation of learning sessions for the program to-date for beneficiaries and community members, Right To Play staff members, Right To Play partners and institutional stakeholders. The key deliverable here will include a document detailing important program learnings as well as strategies for addressing any issues or barriers that have arisen that are preventing program success. 5.0 LOCATION In phase one, the evaluation work will primarily be carried out in Toronto with the expectation of travel as needed. For the second and third phases of the consultancy, extensive in-country travel is expected in three of the eight program countries (Benin, Ghana, Liberia, Mali, Mozambique, Rwanda, Tanzania and Pakistan) in order to properly carry out evaluation work and document program learnings. 6.0 METHODOLOGY Phase 1 will involve a document review of the PAQE measurement framework and its accompanying tools, desk research coupled with key-informant methodology in order to create a revised toolkit to be used for the remainder of the program year and an additional document review/ post-evaluation analysis of the data that was collected from the baseline exercise. Phase 2 will involve the implementation of a mixed-methods evaluation that will measure program outcomes at the immediate level of results. Where possible, sample sizes will be calculated using a 95% confidence level and confidence interval of 5. The sample sites will remain the same as those that participated in the baseline study. Sample groups should ideally also be the same cohorts of children, teachers, school administrators, etc. Sample sites were selected through a randomized stratified selection process and strata were selected at the country level. Where possible, such sample selection criteria should be retained while considering key characteristics and factors expected to impact progress towards outcomes (e.g. differing geographic locations, socio-economic features, and key issues faced such as conflicts and environmental emergencies). As this assessment will need to comment on progress towards outcomes, it will therefore need to compare against baseline results. Phase 3 methodology is expected to be co-created with the consultancy firm/group and key stakeholders of the PAQE program including beneficiaries and community members, Right To Play staff members, partners and institutional participants. Data Collection Tools The data collection tools for Phase 2 and Phase 3 of the consultancy will reflect a mixed-methods approach and will reflect the use of both primary and secondary data sources. Data collection tools are expected to be revised and/or refined by the consultants as detailed above in Evaluation

4 Overview. The following tools have been used to gather data for the PAQE program and could be used for Phase 2 and 3 as well: Child Survey (Right To Play) Girls Survey (Right To Play) Classroom Observations (Right To Play) Focus-group discussions for children and parents Community Initiative Mapping Community Event Tracking Measure The Change Activity (MCA) with children Safe Space Audit (Right To Play) Semi-Structured Key Informant Interview (SSKII) with: teachers, school administrators, education officials, civil society partners School Records: attendance, grade promotion and academic achievement Document review (national level statistics, school, local and national level education policies and strategies) Data Analysis Data will be analyzed both quantitatively and qualitatively and will cover all areas described in Section 7 below Areas of Focus. Quantitative Data Analysis The consultancy firm/group may use appropriate software (e.g. Excel, SPSS, STATA) as agreed to with Right To Play to carry out the data analysis which may include but is not limited to: Frequency tables to summarize results for each qualitative term; Cross tabs to summarize results between communities as well between gender and age categories; Significance tests to see if there are any notable differences between baseline, mid-term, and final data. Qualitative Data Analysis The consultancy firm/group will ensure word-for-word transcriptions for all qualitative data, and will carry out the coding and thematic analysis, sentence-by-sentence to identify the following: The main themes that emerge for each indicator; Descriptions of the context or situation that are relevant to understanding the indicator, or program planning and implementation related to the indicator; Examples of knowledge and behavior that are relevant to understanding each indicator. 7.0 AREAS OF FOCUS ****To be determined once key indicators have been decided during Phase 1**** ****A Performance Measurement Framework can be shared with shortlisted applicants****

5 8.0 GENERAL CONDITIONS OF THE CONSULTANCY Steering Committee A steering committee of key implementation stakeholders (i.e. Right To Play country, regional and global staff) will be formed to guide and inform the evaluation process. During Phase 1, they will help to inform the recommendations of the revised measurement plan and data collection tools. During Phases 2 and 3, they will help to ensure that the data collection processes are sound, culturally appropriate and contextually relevant to Right To Play s programmatic needs and to the needs of all relevant stakeholders (i.e. beneficiaries, community members and partners). Measurement Plan The measurement plan adheres to the Global Affairs Canada PAQE program performance measurement framework (PMF) and uses a results-based management approach for tracking the progress of outputs and outcomes against targets. Consultancy Expectations The consultancy firm/group will have an orientation to Right To Play s program delivery model; The consultancy firm/group will submit a detailed work plan and time frame for the completion of the evaluation; The data analysis and draft reports will be shared with Right To Play with sufficient time to allow for Right To Play to review and provide feedback, which will be incorporated into subsequent work; After the completion of any evaluation reports, a presentation will be given to Right To Play staff and appropriate stakeholders to share both results and recommendations; Throughout each phase, the consultancy firm/group will be expected to maintain regular communications with Right To Play regarding progress; Travel and accommodations for visits to Right To Play intervention countries will be coordinated, booked and paid for by Right To Play as outlined in an agreed upon work plan; The consultancy firm/group must follow OECD-DAC principles for evaluation All materials, processes, methodologies, reports, plans and other works provided to the consultancy firm/group or developed by the consultancy firm/group on behalf of Right To Play remain the property of Right To Play. All data must be stored in a safe and secure location, allowing full access to Right To Play staff during the evaluation process; Upon completion of the evaluation all raw data must be submitted to Right To Play.

6 9.0 ROLES & RESPONSIBILITIES (SUMMARY) The consultancy firm/group will report directly to Emily Kere, Manager, Monitoring, Evaluation and Learning at Right To Play International, and all deliverables should be submitted to her according to the schedule outlined in the Key Deliverables and Timeline section below. The consultancy firm/group s roles and responsibilities include, but are not limited to, the following: Background research to familiarize themselves with the PAQE program and Right To Play s approach (i.e. program documents provided by Right To Play); Development of evaluation plan in collaboration with the Right To Play International Steering Committee; Document review of program, monitoring and evaluation plans, including logical models, performance management frameworks, and tools (Phase 1); o Refinement and recommendations for appropriate outcomes for the project given the project timeline o Refinement and reduction of indicators such that key program results can be effectively and efficiently obtained o The creation of a refined toolkit that is well-aligned with the measurement needs of the PAQE program o The post-evaluation analysis of baseline data and the final baseline report available for PAQE in order to determine any gaps and make recommendations as to how to complement these through an additional evaluation o An assessment and recommendations on capacity for collection of monitoring data o A refined measurement strategy that will ensure the effective collection of data and the streamlined communication of results Preparation and presentation of findings and recommendations (Phase 1); Data collection, entry & cleaning, and analysis (Phase 2 and 3); Data validation and interpretation through internal review of findings (Phase 2 and 3); Preparation and presentation results (Phase 2 and 3); Completion of a final report (Phase 2 and 3) KEY DELIVERABLES AND TIMELINE (NEGOTIABLE AND TO BE FINALIZED WITH RTP STAFF) DELIVERABLES DEADLINE 1. Question Period July 29, 2016 August 26, Submission of Proposal August 26, Interviews September 6, 2016 September 16, Award of Contract September 19, Right To Play Consultations September 20, 2016 October 14, Detailed Inception Plan/Work Plan All Phases October 21, Measurement plan revisions and refinement November 30, 2016 completed Phase 1 8. Submit quantitative and qualitative December 15, 2016 methodological evaluation plan Phase 2 9. Tool Piloting and Data Collection Phase 2 January 2, 2017 February 28, 2017

7 10. Submit draft of evaluation report Phase 2 To be determined 11. Receive feedback from Right To Play on draft To be determined report Phase Submit co-created methodological evaluation To be determined plan Phase Submit draft evaluation report Phase 3 To be determined 14. Receive feedback from Right To Play on draft To be determined report Phase Submit final full evaluation report All Phases To be determined 16. Final Presentation to Right To Play Staff To be determined The above timeline is negotiable and subject to change based on consultation with Right To Play International, Regional and Country staff PROPOSED BUDGET AND PAYMENT SCHEDULE Consultants are asked to provide a draft budget proposal along with their proposal for consideration. Right To Play International offers competitive consultancy rates in keeping with market value and international NGO standards. First payment: After signing of contract agreement with Right To Play (25%) Second payment: Submission of analyzed data and preliminary report (Phase 2) (50%) Final payment: Submission of analyzed data and the final report approved by Right To Play (Phase 3) (25%) 12.0 QUALIFICATIONS A consultancy firm/group at least 7-15 years of experience in the research and/or evaluation field, including experience in quantitative and qualitative data collection, analyzing quantitative and qualitative data, and report writing; Extensive experience creating measurement frameworks, refining indicators, and creating measurement tools for education focused programs Extensive experience managing and designing evaluation studies in a diverse contexts (e.g. within multi-country contexts, with children and young people, in remote settings, etc.); Extensive experience in international education including pre-primary and primary levels; Experience in life skills measurement and behavioural change measurement; Experience using participatory methodologies and following OECD-DAC principles for evaluation and measurement; Applicant should have a relevant degree in social sciences, international development, statistical sciences, or another related field ; Excellent skills and experience with data analysis using rigorous analytical tools (Excel, SPSS, STATA, NVIVO); Excellent working proficiency in English

8 13.0 PROPOSAL APPLICATION SUBMISSION Interested organizations are requested to submit proposals including the following documents: Cover letter/expression of interest A complete profile of the firm/organization/group, highlighting previous experience and expertise in areas listed in the Qualifications section detailed in the above section; CVs of any other key team members who will be the part of the Multi-phased evaluation team Two writing samples, ideally reports the firm/organization/group has lead authorship on The Proposal must be submitted no later than August 26, 2016 to Emily Kere, Manager, Monitoring, Evaluation and Learning at: ekere@righttoplay.com, with Sarah Johnson, Monitoring, Evaluation and Learning Officer in copy at: sjohnson@righttoplay.com. Early submissions are encouraged and appreciated. While we thank all applicants for their interest, only those selected for interviews will be contacted. Right To Play is a child-centered organization. Our recruitment and selection procedures reflect our commitment to the safety and protection of children in our programs. To learn more about how we are and what we do, please visit our website at