Recruitment DIME Impact Evaluation Field Coordinator. Terms of Reference

Transcription

1 Recruitment DIME Impact Evaluation Field Coordinator Terms of Reference November 2018 Summary The short-term consultant (STC) will be hired to work as a DIME field coordinator to work on impact evaluations (IEs) of interventions aimed to enhance firm s capabilities in Brazil. The consultant will be based in Brasília and work with the DIME team to build client governments capacity for evidence-based policy-making through the cycle of several IEs. The consultant s main responsibility will be to coordinate the implementation of the IE work in the field working closely with the project implementation team, prepare and supervise surveys and delivering training to the clients as needed. The consultant will also be involved in analytical aspects of the IE. Send your CV to caiopiza@worldbank.org. The position will be opened until November 23 rd. 1. Background and objectives Impact Evaluation Unit of World Bank Research Group. The Development Impact Evaluation Unit (DIME) works to mainstream impact evaluations (IEs) into World Bank-supported operations, and build government capacity for impact evaluation, statistical analysis and evidencebased policy making. IEs use rigorous experimental and quasi-experimental methods to identify the actual impact of a program against a scientifically valid counterfactual. Unlike traditional performance monitoring, IEs ask what would have happened to the beneficiaries if the program had not taken place, or if a different program design had been chosen. DIME emphasizes client ownership of impact evaluations in order to maximize their use and relevance for the client s policy learning needs; and client capacity development. Each impact evaluation study is designed by the entire project team to ensure its relevance for the client s policy learning needs. Working with the project teams at all stages of the impact evaluation, including the use of impact evaluation results in program improvement, serves to build capacity through intensive cooperation during the whole lifecycle of the IE. 2. Project description

2 The consultant will work in the growing private sector development portfolio in Brazil. The consultant will work closely together with the Rafael Dantas, the Brazil Program Coordinator, and will report to Caio Piza (Economist, DECIE) and Astrid Zwager (Research Analyst, DECIE). The program currently includes to following projects, but can be potentially expanded to include IEs in Education and Governance sectors: SEBRAE-Parana DIME is currently working with SEBRAE-PR on a randomized controlled trial that will assess the impact of shocking small firms in Parana state with different sets of information related to management practices to see whether (a) information is a binding constraint behind firms lack of adoption of good management practices, and (b) firms that adopt better practices have better performance. Baseline data have been collected and short-term effects of the intervention have been preliminary analyzed. The will support data analysis (e.g. cleaning, coding, and regression analysis), the follow up surveys planned to be collected in 2019, and help develop a work plan for the next few years based on SEBRAE-PR s priorities. SEBRAE-Minas Gerais DIME is exploring a new partnership with SEBRAE-MG seeking to develop an IE program for the next 2-3 years. We are in the process to sign up a Memorandum of Understanding outlining roles and responsibilities of each institution in the partnership. Our plan is to carry out a pilot RCT throughout the calendar year of 2019 and in the meantime develop a work plan that reflects SEBRAE-MG s priorities. Other Partners DIME has formalized partnerships with SERASA-Experian and Fundação Nacional de Qualidade (FNQ) that will grant DIME access to non-public data on firms performance indicators and management practices. These data are expected to be used in the ongoing IEs and to enrich descriptive exercises aimed at better describing the market and identifying testable hypotheses to be explored in future research. 3. Tasks The consultant will oversee the day-to-day implementation of the impact evaluations and liaise with the survey firm, the implementing partner organization and the evaluation team. The consultant will prepare regular progress reports, communicate on an ongoing basis with the joint research research/operations/government team, and provide day-to-day support on technical and operational tasks, including but not restricted to those listed below:

3 Effective Cooperation Provide daily coordination between the impact evaluation team and local counterparts (including the data collection firm and project implementing partners), ensuring that concerns are effectively communicated between parties, flagging emerging issues that may be of potential concern to one or both parties, and ensuring that effective and productive collaboration is maintained; Interact with the line Ministry staff, local authorities and other partners on evaluationrelated issues; Help ensure that targets are met on time, and that all activities are carried out in accordance with the study design. Impact Evaluation Field Coordination and Supervision Work with the research/operations/government on the elaboration of a rigorous impact evaluation identification strategy. This includes working with researchers and implementers to identify the key questions to be addressed, the outcome indicators to be used, data sources and sample sizes (including sampling framework and field procedures), timeline and budget. Provide technical inputs into IE designs, including preparation of funding proposals, concept notes, and draft reports as necessary; Work with the research/operations/government team to elaborate detailed protocols/manuals for the different interventions. Reports on field-testing of the interventions including lessons learned and recommended changes; Work closely with the implementing organization to ensure compliance with randomization protocols and treatment assignments are administered per the agreed up-on protocols and plans. Visit study communities as possible to ensure that they have the assigned program status and gather general information about the implementation process; Preparation of mission trip of research team: schedule meetings, plan activities such as qualitative (group) interviews, support overall logistics; Monitor implementation activities so that the evaluation team understands and has documented the details of implementation across study areas. This includes supporting the implementation partners in setting up monitoring protocols for tracking progress. Data collection and analysis Support the procurement process for the survey firm, including drafting Terms of Reference; Prepare written reports with feedback and analysis on the piloting and fielding of survey and other measurement instruments; Finalize data collection instruments, including questionnaires and field procedures; Monitor the entire data collection process, from training of enumerators, quality control during the field work to data entry, to ensure data quality;

4 Assist in the analysis of the survey data, and the writing of project reports and policy memos; Build capacity for data collection, data management and data analysis within the implementing agency. 4. Skills Required Academic specialization: At least a Master s degree in economics, public policy, statistics, or related field with strong quantitative research skills is essential, preferably with a concentration in development economics, impact evaluation and applied microeconometrics Technical skills: The candidate must have technical expertise in impact evaluation and econometric analysis (including proficiency in STATA). Experience with programming in an ODK based platform is desirable Experience: Previous experience in working in development and government counterparts. Capacity Building Skills: Demonstrated ability and experience in designing and delivering training and capacity building activities or other teaching experience Language: Superior written and oral communications skills in English and Portuguese Interpersonal skills: Motivated self-starter, with demonstrated ability to work effectively and sensitively in teams and with government counterparts at all levels and with partner organizations. High levels of energy, initiative and flexibility in quickly adjusting to changing work program requirements. Ability to juggle numerous competing demands and priorities, respond quickly to internal and external client requests, and set priorities for self and others Knowledge about the relevant sectors is desirable 5. Intellectual Property The World Bank shall, solely and exclusively, own all rights in and to any work created in connection with this agreement, including all data, documents, information, copyrights, patents, trademarks, trade secrets or other proprietary rights in and to the work. The consultant is not allowed to post or publish (electronically or in print) any project-related information without the explicit permission of the Impact Evaluation Team.

5 6. Terms The Field Coordinator will be hired as a short-term consultant based in the stated duty station for 100 days for this fiscal year (June 2019). Contract extension is possible and will depend on performance and needs. While in the duty station, s/he will not be paid per diem nor be reimbursed for accommodation expenses. The Field Coordinator is expected to use his/her own laptop and mobile phone. S/he will be reimbursed for travel expenses to/from the duty station and for travel expenses (including accommodation) for in-country travel outside the duty station. All payments and reimbursements will be conditional on the submission of outputs or receipts, as applicable.