1.0 RIGHT TO PLAY Right To Play is an international humanitarian organization that uses sport and play to promote holistic development of children and youth in the most disadvantaged areas of the world. Right To Play is committed to improving the lives of these children and to strengthening their communities by translating the best practices of sport and play into opportunities to promote development, health and peace. Right To Play programs foster healthy physical, social and emotional development of children and build safer and stronger communities. Right To Play s guiding principles are inclusion, which recognizes the importance of children who may be marginalized for reasons of gender, religion, ability, ethnicity, disability, or social background; child protection and safeguarding; and sustainability, which ensures lasting impact. 2.0 PROGRAM OVERVIEW The Jam Suka pillar of tomorrow project will address the protection needs of crisis affected and vulnerable children, especially girls, through a 5 year project in Mali. The Jam Suka project will aim to strengthen child protection systems in the regions of Kayes, Sikasso and Mopti. Using a systems approach, this program will strengthen the protective environment around children by engaging local communities, civil society and international organizations, as well as local, regional and national governments to strengthen capacity and increase accountability of these bodies to maintain a commitment to child rights and protection over the life of the program, and beyond. The initiative will seek to achieve the following three intermediate outcomes: 1) Increase the efficiency of child protection systems and mechanisms to promote an environment where children s rights are protected and respected, especially girls; 2) Increase the capacity of communities to ensure better protection of children, especially girls affected by harmful traditional practices and 3) Increase access to social services and promote rehabilitation and reintegration of children affected by the crisis, engaged in child labour and victims of harmful traditional practices. 3.0 EVALUATION OVERVIEW A baseline evaluation will be conducted in the Kayes, Sikasso and Mopti regions of Mali. The evaluation will be managed by an external consultant(s), who will be hired to support the overall baseline planning process and assist with the finalization of the overall baseline design, including planning for data collection. Additionally, the consultant(s) will lead the data collection process in Mali and analysis of the respective data. A report based on this data will also be required for internal purposes. The baseline evaluation process will take place from July to October 2016 with data collection beginning in September 2016. In line with Right To Play s standards for measurement, the baseline evaluation will involve rigorous sample sizes (offering a 95% confidence level and confidence interval of 5) such that the sample results represent those from the broader population wherever possible. It will allow for the identification of changes in outcomes over time (i.e. the final evaluation will build off the baseline).
4.0 OBJECTIVES The primary objectives of the baseline are as follows: Analyze the current situation in communities where Right To Play will be implementing the Jam Suka project Identify the starting points for the Jam Suka project s intended outcomes Provide information for setting realistic and achievable targets for the 5 year program To leverage results to identify key questions and areas for additional learning (to help inform the planned learning study) Enhance program learning among beneficiaries and staff 5.0 SCOPE OF WORK FOR CONSULTANT The baseline will be designed to assess the current status of intended outcomes related to child protection systems in Mali, detailed in the program s log frame. For further detail on outcomes and indicators to be measured, please see Appendix. Right To Play is seeking a consultant(s) to support the overall baseline planning process and assist with the finalization of the overall baseline design, including planning for data collection. Additionally, the consultant(s) will lead the data collection process and the analysis of the respective data, both quantitative and qualitative. While the donor only requires submission of the data, a baseline report will be written for internal learning purposes. More specifically the consultant(s) is expected to: 1. Co-lead on baseline data collection methodology after the review of our planning documents and consultation with Mali Country Manager, MEL Officer and HQ MEL Team 2. Co-collaborate on tool refinement (and development if necessary) 3. Lead on tool piloting and co-lead alongside country office staff on contextualization of tools 4. Lead on analysis of data collected, both quantitative and qualitative 5. Collaborate on preparation of a baseline report and appropriate data translation for the donor 6.0 BASELINE METHODOLOGY Throughout the life of the project, outcomes will be measured using a child-centred and learning-driven approach that applies elements of an ecological systems lens to data gathering and analysis. Given the emphasis on children and youth in this project, the baseline methodology will also reflect an emphasis on child participation in the co-engagement of children through the use of play-based reflective tools. In partnership with the International Institute for Child Rights and Development (IICRD), Right To Play will co-create a customized toolkit with children and the community to effectively measure knowledge, attitudes and behavior change as it relates to child protection outcomes in the Malian context which the contracted consultant will be expected to use for data collection and analysis.
Sampling Within communities of program intervention, cluster sampling and household sampling methodologies will be used in order to include a representative segment of the geographical area where the communities of intervention lie. Where possible, sample sizes will be calculated using a 95% confidence level and confidence interval of 5 where the population size has been estimated at 70,000. Village leaders and commune administrators may be leveraged to provide community and household lists for data collection. Also depending on the evolution of the PMF, sampling methodology may reflect a more nuanced qualitative measurement strategy where sample sizes are contextually and justifiably smaller. Data Collection Enumerators will be trained on both the data collection toolkit and key facilitation skills, such as interviewing, prior to the data collection period Confidentiality and consent must be upheld in the data collection process Data will need to be cleaned and reviewed for errors or missing data Data Collection Tools The data collection tools will reflect a mixed-methods approach and have a participatory, childcentered focus. Data sources will be selected to ensure adequate triangulation. For example, the following tools could be used in the baseline: Most Significant Change Activities Focus Group Discussions (children, key informants from villages) Child Protection Systems Mapping Gender analysis tools Household survey tools (family care givers) Key Informant Interviews (village Leaders, teachers, FBOs, health service providers, extension officers, community development officers) Document Review (activity reports, meeting reports, training reports, policies and strategies) In each research site the evaluation will include Jam Suka partner staff and key local stakeholders, including children, adult care providers and members of local child protection mechanisms. All data will be collected in a sensitive and ethical manner in reference to Right To Play s guidelines for data collection and in addition ensure that children s participation is safe and age appropriate. Data will be summarized and validated with feedback from local stakeholders including children. To ensure that data collection instruments such as surveys are clearly understood piloting will be conducted. This will allow for any contextual adjustments prior to the beginning of data collection. Data Analysis Data will be analyzed both quantitatively and qualitatively and will consider the following:
Quantitative Data Analysis The consultant(s) may use appropriate software (e.g. Excel, SPSS) as agreed upon with Right To Play to carry out the data analysis which may include but is not limited to: Frequency tables to summarize results for each qualitative term; Cross tabs to summarize results between communities as well between gender and age categories; Significance tests to see if there are any notable differences between baseline, mid-term, and final data. Qualitative Data Analysis The consultant(s) will ensure word-for-word transcriptions for all qualitative data as appropriate, and will carry out the coding and thematic analysis, sentence-by-sentence to identify the following: The main themes that emerge for each indicator; Descriptions of the context or situation that are relevant to understanding the indicator, or program planning and implementation related to the indicator; Examples of knowledge and behavior that are relevant to understanding each indicator. 8.0 GENERAL CONDITIONS OF CONSULTANCY Steering Committee A steering committee of key implementation stakeholders (i.e. Right To Play country, regional and global staff) will be formed to guide and inform the evaluation process. These individuals will help to inform the development of the baseline measurement plan and data collection tools as well as ensure that the data collection processes are sound, culturally appropriate and contextually relevant to Right To Play s programmatic needs and to the needs of all relevant stakeholders (i.e. beneficiaries, community members and partners). Measurement Plan The measurement plan will adhere to the Global Affairs Canada Jam Suka program performance measurement framework (PMF) and uses a results-based management approach for tracking the progress of outputs and outcomes against targets. Consultancy Expectations The consultant(s) will have an orientation to Right To Play s program delivery model; The consultant(s) will submit a detailed work plan and time frame for the completion of the evaluation; The data analysis and draft reports will be shared with Right To Play with sufficient time to allow for Right To Play to review and provide feedback, which will be incorporated into subsequent work; After the completion of any evaluation reports, a presentation will be given to Right To Play staff and appropriate stakeholders to share both results and recommendations; Throughout each phase, the consultant(s) will be expected to maintain regular communications with Right To Play regarding progress;
Travel and accommodations for visits to Right To Play intervention countries will be coordinated, booked and paid for by Right To Play as outlined in an agreed upon work plan; The consultant(s) must be familiar with OECD-DAC principles for evaluation All materials, processes, methodologies, reports, plans and other works provided to the consultant(s) or developed by the consultant(s) on behalf of Right To Play remain the property of Right To Play. All data must be stored in a safe and secure location, allowing full access to Right To Play staff during the evaluation process; Upon completion of the evaluation all raw data must be submitted to Right To Play. 9.0 ROLES AND RESPONSIBILITIES The consultant(s) will report directly to Emily Kere, Manager, Monitoring, Evaluation and Learning at Right To Play International, and all deliverables should be submitted to her according to the schedule outlined in the work plan below. The consultant(s) roles and responsibilities include, but are not limited to, the following: Background research to familiarize themselves with the Jam Suka program and Right To Play s approach (i.e. program documents provided by Right To Play); Development of evaluation plan in collaboration with the Right To Play International Steering Committee; Document review of planning frameworks and existing tools; Data collection, entry and cleaning, and analysis; Data validation and interpretation through internal review of findings; Preparation and presentation results; Completion and submission of a final report. 10.0 QUALIFICATIONS A consultancy firm/group at least 7-15 years of experience in the research and/or evaluation field, including experience in quantitative and qualitative data collection, analyzing quantitative and qualitative data, and report writing; Extensive experience managing and designing evaluation studies in a diverse contexts (e.g. within multi-country contexts, with children and young people, in remote settings, etc.); Extensive experience in the evaluation of international child protection and child safeguarding programs; Experience in the development and or usage of tools to measure improvements in child rights and development; Experience using participatory methodologies and following OECD-DAC principles for evaluation and measurement; Applicant(s) should have a degree in social sciences, international development, statistical sciences, economics or another related field ; Excellent skills and experience with data analysis using rigorous analytical tools (Excel, SPSS, STATA, NVIVO); Excellent working proficiency in English and French is required
11.0 KEY DELIVERABLES AND TIMELINE DELIVERABLES DEADLINE 1. Detailed work plan and time line for analysis and August 12 2016 deliverables 2. Finalize data analysis plan August 26 2016 3. Enumerators recruitment and training September 26 to October 1, 2016 4. Data collection and entry October 3 to13th,2016 5. Submit quantitative and qualitative results October 14 2016 6. Submit draft of baseline report October 21 2016 7. Receive feedback from Right To Play on draft October 26 2016 report 8. Submit final baseline report October 31 2016 12.0 PROJECT SCHEDULE The proposed schedule for the baseline evaluation project is as follows: Submission of proposal: Anytime on or before August 3, 2016 Decision to award contract: Applications will be considered on a rolling basis and Right To Play reserves the right to award a contract before the closing date of the RFP Preliminary calls/meetings with Right To Play: August 8-12, 2016 Quantitative data analysis submitted: October 14, 2016 1 st Draft Report: October 21, 2016 Final Report: October 31, 2016 13.0 PROPOSED BUDGET AND PAYMENT SCHEDULE The consultant(s) are asked to provide a detailed budget proposal along with their proposal for consideration. Right To Play offers competitive consultancy rates in keeping with market value and international NGO standards. First payment: After signing of contract agreement between Right To Play and Consultant (25%) Second payment: Submission of analyzed data (50%) Final payment: Submission of the final report approved by Right To Play (25%)
14.0 PROPOSAL APPLICATION SUBMISSION REQUEST FOR PROPOSALS Interested organizations/individuals are requested to submit proposals including the following documents: Cover letter/expression of interest A complete profile of the organization/individual, highlighting previous experience in analyzing quantitative and qualitative data, and report writing; CVs of any other key team members who will be the part of the Baseline Evaluation team Two writing samples, ideally reports the organization/individual has lead authorship on The Proposal must be submitted no later than August 3, 2016 to Emily Kere, Manager, Monitoring, Evaluation and Learning, Right To Play International at: ekere@righttoplay.com. Early submissions are encouraged and appreciated. While we thank all applicants for their interest, only those selected for interviews will be contacted. Right To Play is a child-centered organization. Our recruitment and selection procedures reflect our commitment to the safety and protection of children in our programs. To learn more about how we are and what we do, please visit our website at www.righttoplay.com
APPENDIX A: JAM SUKA PERFORMANCE MEASUREMENT FRAMEWORK