Request for Quote: Formative Evaluation Consultant

Transcription

1 Request for Quote: Formative Evaluation Consultant Scope Global is looking to engage a Monitoring and Evaluation Consultant to undertake a formative evaluation of capacity building approaches in our People-to-People programs. This evaluation will consider our flagship program in volunteering and technical advice, the Australian Volunteer for International Development (AVID) and the Pacific Technical Assistance Mechanism Phase II (PACTAM2), both initiatives of the Australian Government. This evaluation will inform and guide current and future programming decisions for the company. It is also expected that this evaluation may contribute to the broader discourse of capacity building and the role of soft skill investments in supporting lasting development outcomes. Please review the attached Terms of reference for further details. To be considered for this contract, please submit the following: 1. Cover letter outlining the suitability and experience for the contract (up to 1 page) 2. Approach to achieve the objectives of the contract (up to 3 pages) 3. Quotation for proposed work (not including travel, per diem costs) 4. CV including contact details for two referees (up to 2 pages) Only complete submissions will be considered as part of the selection process. Only shortlisted applicants will be contacted. Please provide submissions to alison.fleming@scopeglobal.com by 11:59pm on 19 March Interviews for shortlisted candidates are expected to be scheduled the week commencing 27 th March For further information, please contact: Alison Fleming alison.fleming@scopeglobal.com V page 1 of 5

2 Finding the right solutions: Formative evaluation of capacity building approaches in people-to-people programs Terms of Reference: Formative Evaluation Consultant Background Scope Global is a specialist program management company delivering international development, volunteering and education programs throughout Asia and the Pacific. Two of Scope s key people-topeople programs are: The Australian Volunteers for International Development (AVID) program, an Australian Government initiative, supports the deployment of Australians to undertake volunteer assignments aimed at improving the capacity of host organisations in sectors of high priority to Australian and partner governments. Volunteers also promote positive people-to-people links between individuals, organisations and communities in developing countries and in Australia. Pacific Technical Assistance Mechanism Phase 2 (PACTAM2), an Australian Government initiative, places highly skilled technical advisers in partner organisations across 12 Pacific Island countries, with the aim to provide technical advice on the design and delivery of an effective development assistance program. Scope leads the recruitment, mobilisation and in-country support, while also providing assistance to DFAT and partner governments in the selection and management of advisers. We (Scope Global) are currently reviewing our approach to capacity development and have identified the need for a deeper understanding of capacity building issues and the approaches adopted to address these issues across different programs. We have also identified the need to establish a more systematic process for monitoring, evaluating and learning in this area, including lessons to guide future programming. Part of our review is an internally driven evaluation of the core capacity building approaches delivered in AVID and PACTAM2. Capacity building within the AVID program focuses on partner organisations (POs) in partner countries as the vehicle or target of the initiative the PO owns the assignment and the volunteer is a skilled resource. A specific need has been identified through a PO capacity assessment and a volunteer is then recruited to meet that need. Capacity of the PO is built at an organisational and individual level through skills and knowledge sharing. Capacity development plans, on assignment outcomes and effective monitoring, evaluation and learning are important program components. PACTAM2 adviser positions range from in-line (capacity supplementation) to advisory (capacity building) as well as some short term inputs. Capacity building happens on an individual level through direct mentoring, and on-the-job training. Advisers generally are involved in substantial systems improvements and reform contributing to institutional capacity. Occupying highly influential positions within governments means that some advisers are also in the position to challenge norms and cultural attitudes. While there is no explicit approach to capacity building, it is an inherent in all assignments and Adviser performance in this area is measured through annual Performance Assessment Meetings. V page 2 of 5

3 The results of this evaluation are primarily intended for internal use to transfer knowledge across programs and inform future improvements. Findings will further inform our future approach to monitoring, evaluation and learning about capacity development approaches. Objectives of the evaluation This evaluation is not expected to make an assessment of the success of either AVID or PACTAM2 management, advisers, or volunteers in delivering capacity building as part of their services. The overall purpose is to enable internal learning and reflection. The key objectives and evaluation questions can be stated as follows: 1. Enhance understanding of the breadth of capacity building approaches in use in the selected programs, and the appropriateness of different approaches within different situations a. What is a useful framework for defining and assessing the impact of capacity building in the selected programs? b. What are the different views of stakeholders in participating partner organisations regarding the value of the capacity development services for their organisations? c. What changes have participating partner organisations experienced as a result of their work with AVID volunteers or PACTAM2 advisers? d. To what extent have capacity building practices taken into account and addressed crosscutting objectives of the Australian aid program, such as gender equality and social inclusion? 2. Contribute to internal learning to help us improve our capacity development practices a. What issues and innovative ideas should be considered and approaches adopted, to ensure the most appropriate and effective capacity building approaches are incorporated into PACTAM2 and the AVID program? Are these recommendations relevant to other Scope Global people-to-people programs? b. Based on the perspectives of partner organisations in receipt of AVID and PACTAM2 capacity development services, how can these services be enhanced and improved? Primary intended users and uses of the evaluation Program management: (i) enhancing understanding of the breadth of capacity building approaches in use and the appropriateness of different approaches within different situations; (ii) lessons to guide current and future programming decisions Development practitioners (technical advisers, volunteers) and staff in partner organisations: enhancing understanding of capacity building approaches in particular contexts, and sharing insights and lessons from their own experience with other key stakeholders DFAT Canberra and Posts: staying in touch with innovations and developments in people-topeople programs Scope Global: fostering and leveraging evaluative thinking across our programs to enable continuous improvement and learning. Indicative scope of services 1. Develop a brief conceptual paper to underpin the evaluation. The paper should draw on international trends in capacity building in the development sector, and relevant insights and findings from Australian Research Council s Linkage Project - Cosmopolitan Development: The Impacts of International Volunteering Project and Scope Global s V page 3 of 5

4 formative assessment of team volunteering initiatives in AVID 1. The paper should include the Evaluator s proposed analytical framework for the project. 2. Desk review: to the extent that capacity building approaches, tools, and issues are detailed in program documents, provide an analysis of capacity building characteristics, definitions, approaches and initiatives implemented under PACTAM2 and AVID. 3. In-country field work: Identify how capacities are being built across a sample of AVID and PACTAM2 assignments/placements, and assess the preliminary indications of potential impact and sustainability 2 of results including the contribution to capacity development and achievement of Aid Investment Plan objectives in the selected sample 4. Identify issues impacting upon the potential impact and sustainability of results of the capacity building approaches in contributing to the desired development outcomes 5. Review how, and the extent to which, capacity building activities are monitored and evaluated in each program 6. Develop recommendations on how Scope Global could better assess, monitor, measure and communicate the role of capacity building in these programs 7. Summarise lessons learned from both programs with respect to capacity building issues and approaches. o Cross-cutting themes including gender equality and social inclusion should be explicitly considered as part of the analysis. o Consider the role that Australia Awards Scholarships and Fellowships has played, or could play as part of the capacity building approach in particular contexts. o Learning lessons speaks to the issue of understanding what has and what has not worked as a guide for future program-level planning. Evaluation approach The evaluation will be conducted by an independent Evaluator who is familiar with formative evaluation techniques, and the area of capacity building in development, especially within Australia s aid program. The Evaluator will undertake a desk review of relevant documents and conduct field work to assess the practical application of capacity building approaches. The evaluation is intended to be a participatory process, involving and consulting with a range of staff from Scope Global in Australia and off-shore, development practitioners (volunteers and advisers), and relevant representatives of partner organisations and DFAT posts. By providing the opportunity and space for open reflection, the formative evaluation is intended to be beneficial for all involved. The Evaluator will work under the methodological guidance of the Scope Global Senior Advisor M&E. The preferred location for the field work is one or more partner countries where both programs are currently active these include Kiribati, Tuvalu, Tonga and Samoa. The final decision on field work location(s) will be made in discussion between the Evaluator, the PACTAM2 Team Leader, the AVID Senior Manager, and the Scope Global Senior Advisor M&E. Scope Global Staff may accompany the evaluator for some or part of the field work. 1 Internal documents and evaluation reports will be provided to the Evaluator upon commencement. 2 The evaluation criteria are to be proposed in the Concept Paper and agreed with program management. V page 4 of 5

5 Timeline and milestones Evaluation is expected to commence early April The Evaluator will spend a maximum of days on this project. It is anticipated that approximately 10 days will be allocated to field work, and 2 days for revision of the draft final report as necessary. Deliverable Indicative date Conceptual paper and proposed approach 5 days after contract commences Final report Due 12 May 2017 Qualifications The contractor must have: Tertiary qualification in monitoring and evaluation or a related discipline; At least 5 years demonstrated experience in monitoring and evaluation, including familiarity with DFAT approaches and systems including cross-cutting themes; Specific knowledge of and experience of formative evaluation techniques, and the area of capacity building in development, especially within Australia s aid program; Persuasive communication skills including excellent writing and analytical skills; Ability to work with internal and external stakeholders, under pressure and tight deadlines. Experience of evaluation in the Pacific is desirable but not essential. Experience in small island states is preferred. V page 5 of 5