Human Rights and Digitalization Project in Tanzania Baseline Survey Terms of Reference August, 2017 Introduction Oxfam Country Strategy, 2015 2019, has a vision of an inclusive, equitable and just Tanzanian society, where citizens especially women and young people enjoy their rights and have access to resources necessary to live good lives and as active citizens. Governance and transparency is one of three change goals that are integrated into the Country Strategy. Tanzania is among the most politically stable and peaceful countries in Africa. Nevertheless, institutionalized democracy and good governance are challenged by shortcomings in upholding rule of law, policy incoherence, institutional weaknesses as well as laxity in enforcement of key regional and national frameworks and agreements. Oxfam in Tanzania in collaboration with Oxfam-Solidarite (Belgium) have secured funding for a two year project titled Enabling Improved Governance and Accountability in Tanzania through Digital Technology. This project seeks to address the current deficit, as provided by project proposal, in community driven governance reform, and to link these efforts to policy change and strengthened accountability at national level. To achieve this, Oxfam will take its flagship governance program Chukua Hatua ( Take Action ) to a new level through innovative use of digital technology. Oxfam believes that digital (information and communications) technology is an enabler of solutions to development and human rights challenges, if implemented in the right manner. To be effective, digital technology needs to compliment and strengthen existing and proven approaches to enable more impactful, scalable and efficient interventions. Accordingly, Oxfam will integrate digital technology into a proven, existing governance program. This will involve empowering a network of Community Animators village level organisers or facilitators who mobilise or animate communities around a common advocacy agenda through the provision, training and support of a range of digital tools. The animation approach is a proven model for community governance reform as evidenced in a range of project evaluations. By leveraging digital 1
tools, Oxfam intends to create a step change in the impact and scalability of its governance and accountability programming. The primary mechanism for achievement of the project will be placing the power and information of the internet in the hands of Community Animators. Through a range of bespoke digital products, for example the provision of basic smart phones, a specifically designed app that will enable simple, quick and real time reporting on the work of community animators whilst also acting as a resource centre for human rights related materials, real time data analytics and digital campaigning platforms, community animators will have a range of powerful research, monitoring, e-government, communications and advocacy tools at their disposal. Through its ICT in Programme work, Oxfam has learnt that providing technology such as basic smart phones to communities can be fraught with challenges. Critically, such approaches work best when ICT enables the work of an existing role or function rather than being widely distributed across a population group. In terms of reach and output, the project aims to target 200 animators and will be implemented in 4 districts of Kibondo (Kigoma), Mbogwe (Geita) and, Ngorongoro (Arusha) and Mtwara (Mtwara rural). Additionally, the project targets different groups of individuals (i.e. women, men, and youths), civil society organisations, local government leaders, digital influencers and government institutions. Ultimately, it is expected that 3,000,000 users of social media will benefit indirectly from the programme. The assignment will start in September and end in October 2017, and an impact evaluation is currently being designed. A baseline survey will be conducted in September/October 2017 as an integrated component of the impact evaluation. The baseline is a key step to project implementation as well, and it will allow: Assessing the level of project s indicators prior to the intervention; Recommending improvement on the project s logframe and MEAL system; Adopting a gender-sensitive approach throughout the whole process The baseline will allow looking at the following areas of change in the Impact Evaluation: - The use of technology; - The thematic areas and actions undertaken by the groups; - The interaction of local governments with citizens in the project area. 1. Consultancy overview The impact evaluation, to which this Terms of Reference refers, will assess the added-value of the use of digital technology to promote human rights in a community-driven approach, compared to traditional approaches for the people we work with. Digital technology in development programming is a new approach for Oxfam in Tanzania. As a key component of the impact evaluation and to project implementation, a baseline will be conducted, and data will be captured primarily through the administration of individual questionnaires and also through complementary qualitative tools. Oxfam is recruiting a consultant 2
to train, supervise and mentor a team of enumerators to carry out the survey fieldwork and any data entry that is required. The consultant will work especially to ensure that the data collected meets Oxfam s high quality standards. The survey will be conducted with 1400 individuals using two different questionnaires: a 30 minute long questionnaire for 400 individuals (group animators), and a 45 minute long for 1000 individuals (citizens). It is Oxfam s strong preference that the questionnaires be administered electronically using mobile devices or tablets. The qualitative fieldwork will be used to provide extra information to supplement the results of the quantitative evaluation. The statistical analysis will be carried out by Oxfam s impact evaluation team. The Oxfam team will be responsible for the overall methodology, but will work in close collaboration with the consultant (as well as Oxfam s programme staff and the partner organisations) to identify the comparison group, define the sampling protocol and create appropriate questionnaires. Proposals are invited from organisations and individual consultants who meet the profile described below. The proposal should outline the consultant s profile (including CV/resume), proposed management arrangements, and examples of previous work. The assignment is expected to take approximately 25 to 30 days working days between 11 th September and 25 th of October. A detailed timeline is presented in this document. 2. Scope of work Oxfam is looking for a consultant who will be leading the survey data collection, in close collaboration with the Oxfam Impact Evaluation Adviser. The consultant will report directly to the Oxfam s Impact Evaluation Adviser. The scope of the work involves the following: Review project documents and discuss the project with Oxfam and partner staff, to understand the details of the project objectives and its implementation. Undertake formative qualitative research potentially including a review of existing research and/or focus groups in communities to investigate how to measure active citizenship and human rights promotion in the local context. Work with Oxfam staff to identify measurement approaches and indicators, and make sure questionnaires are suitable for benchmarking in the short-run, and evaluating the project s impact, in a longer-run. Work with Oxfam staff to adapt and tailor the questionnaires accordingly. Work with Oxfam staff to identify the adequate information to feed back to the surveyed communities (if this approach is deemed suitable to the context of this impact evaluation). Engage a team of experienced enumerators for the data collection (balanced numbers of male and female enumerators) and any data entry required. (Note: the final selection of enumerators for the work will be carried out jointly between the consultant and Oxfam, and that both parties will agree on the selected candidates. It is expected that more enumerators will attend training than the needed number of enumerators.) 3
Lead a four-day training workshop for enumerators. This will include three days working through questionnaires and the use of the mobile devices/tablets and one day of field testing and debriefing post-test. Organise the logistical arrangements necessary to carry out the field work, including transport and accommodation for enumerators, as necessary. Proposals should outline where Oxfam should support on this, and the budget provided must include these costs. Arrange the translation of the questionnaires, and any other qualitative data tools, into the local language (where appropriate). However, the enumerators selected should be fluent in both English, swahili and the local languages. Help Oxfam s staff to identify a valid comparison group of communities which will not receive the ICT component of the project but are similar to the project communities that will receive it. Work with Oxfam s staff and partners to prepare a list of sampled individuals (1400 in total, 400 group animators and 1000 citizens) and a list of replacement citizens to ensure sufficient sample size. Prepare a logistical plan for feeding back the quantitative results to the surveyed communities, during the data collection process (Oxfam staff will prepare the program enabling such feedback process). Manage the survey work in the field, ensuring that the enumerators interview the correct respondents; that surveys are carried out to a high standard; that targets for numbers of respondents to be interviewed are met; and that data are uploaded to the server regularly (ideally at the end of each day). Consult Oxfam s Impact Evaluation Adviser on any problems that affect the selection of respondents for the survey or the number of respondents to be interviewed. Oxfam s Impact Evaluation Adviser will run data quality checks and liaise with the consultant during data collection. Write a brief report on the conduct of the field work, including details of any problems which were encountered and how they were resolved, and any feedback which may be useful for future surveys. Oxfam has a strong preference for using mobile devices/tablets. Oxfam will provide these devices, but the consultant will: Manage mobile/tablet devices ensuring each device is signed in and out at the beginning and end of each data collection day and that they are safely stored each night. Supervisors take responsibility to charge devices and to upload the data collected every evening. Ensure that the data files are uploaded and transmitted to the server every night. All mobile/tablet devices are returned to the Oxfam office undamaged and in the same condition as when they were signed out within one week of data collection finishing (if this approach is deemed suitable to the context of this impact evaluation). 3. Expected Deliverables Survey tools translated in Swahili and local languages (22 nd September). 4
Training schedule and training material (including practices, and sessions specifically dedicated to translation) (20 th September). Work with Oxfam s Impact Evaluation Adviser on the sampling criteria, producing a sample frame and sample list of intervention and comparison areas and individuals to be surveyed, including lists of replacement communities/individuals (25 th September). Detailed schedule of data collection activities and locations including description of selection criteria of communities and respondents (26 th September). All 1400 data files (20 th October). Brief report on the conduct of the field work, including details of any problems which were encountered and how they were resolved, and any feedback (25 th October). Report on any qualitative work, including raw data (transcripts of interviews or focus groups) (25 th October). 4. Time Commitment The assignment is expected to take approximately 25-30 working days to complete. Between 11 th and 15 th September the consultant will have remote contact with Oxfam s Impact Evaluation Adviser and start the process of identifying the survey enumerators (and qualitative research assistant if needed). The Oxfam s Impact Evaluation Adviser will arrive in Tanzania on the week of 18 th September and will conduct a workshop with the program stakeholders and the consultant. Data collection tools will then be tailored, field work prepared and enumerator training by the 27 th of September. The consultant will then begin data collection with her or his team on the 28 th of September, and Oxfam s Impact Evaluation Adviser will take part in the survey launch. Data collection should take place between 28 th September 2017 and the 20 th October 2017. 5. Skills and Qualifications for the Consultant Essential: Masters degree in project management, monitoring and evaluation, social sciences, or any relevant field. Knowledge and experience of working in rural areas of Tanzania. Experience in undertaking quantitative evaluations, especially administering household or individual surveys. Exceptionally high level of attention to detail in carrying out surveys. Strong management skills: able to organize the work of teams of enumerators so as to complete the work on schedule and to the required standard. Strong information technology/computer skills. Excellent English technical writing and communication skills. Desirable: 5
Experience of electronic data collection (using mobile devices/tablets) proposals should include examples and references for this, where possible. Strong understanding of human rights promotion approaches and challenges for community-driven governance programming. Experience of or willingness to use focus groups and/or other qualitative techniques. Fluency in relevant local languages. 6. Skills and Qualifications for Enumerators Essential: University/college graduate (exceptional candidates who have completed the highest grade in High School, may also be considered). Fluency in relevant local languages. Ability to read and understand English effectively. Strong information technology/computer skills. High level of attention to detail in carrying out surveys. Energy and a positive attitude to work, even when working in arduous conditions. Experience of working in rural areas of Tanzania, with a strong understanding of rural livelihoods. Desirable Previous experience of administering household or individual surveys. Previous experience of using mobile devices/tablets for data collection. 7. Budget Proposals are invited from organisations and individual consultants who meet the profile described above. The proposal should outline the consultant s profile (including their CV/resume), proposed management arrangements, and examples of previous work. Proposals must also include a clear itemised budget. Any proposals that do not include an itemised budget will not be considered. The budget submitted by the consultant should include: Consultant s fees and subsistence for approximately 25-30 days of work. Travel arrangements for conducting formative qualitative research with Oxfam s Impact Evaluation Adviser. Fees for a team of enumerators to carry out a questionnaire of 1000 individuals, of approximately 45 minutes duration each, and a questionnaire of 400 individuals, of approximately 30 minutes duration. (Oxfam estimates that a team of approximately 13 6
enumerators would be required for 18 work days in total. The consultant may wish to employ more enumerators and do the work quicker if desired.) Use of a training venue and of any equipment required. Transport and (if applicable) subsistence costs for the teams of enumerators. Translation of questionnaire into Swahili and local languages, where appropriate. Printing of training materials, as well as questionnaires of 10-15 pages as back-up in the field in case the mobile devices are not working. Any data entry costs, if interviews need to be transcripted. Consultants travel. Any other costs anticipated in completing this assignment. Contact details for the consultant. The budget for the Survey Team Coordinator should not exceed 12,000 (approx 35,185,800 Tanzanian Shillings) including taxes. This budget includes the consultant s fee, enumerator salaries, and enumerator training workshops, costs for data collection and field logistics, and taxes. 8. How to apply Proposals are invited from organisations and individual consultants who meet the profile described above. The proposal should outline the consultant s profile (including their CV/resume), proposed management arrangements, and examples of previous work. Proposals must also include a clear itemised budget (any proposals that do not include an itemised budget will not be considered). Proposals should be submitted to www.oxfam.org.uk/jobs 9am EAT on Wednesday 6 th September. 9. Payment Oxfam will pay 60% upon signing of the contract to cover field data teams and data collection, and the final payment will be subject to verification of the data quality by Oxfam s Impact Evaluation Adviser. 7