STRATEGIC PROJECT POLICY ANALYSIS AND SYSTEM WIDE POLICY MONITORING IMPLEMENTATION PLAN - WP2017 1. Justification The Strategic Project policy analysis and system wide progress monitoring contributes to strategic area one: effective policy making in VET for economic development and social cohesion and, more specifically, to evidence based policy making. Partner countries still face challenges in the effective management of their policy cycles. The availability and use of evidence is still limited in most cases, as well as the availability of sound monitoring processes, which inform the policy making cycle and supports implementation. The project responds to the need of countries to improve the availability of evidence, and strengthen the institutional capacity to create evidence which feeds the policy cycle, and use evidence available to generate policy choices, monitoring implementation and assess impact. The project is inspired, and builds on the EU policy analysis and system wide progress monitoring processes, and the EU tools and approaches for policy making1 and to capacity development. Since its start in 2010, the policy analysis and system wide monitoring actions of the ETF have allowed countries to improve their capacity for policy analysis (as shows the number of self-assessments moving from 2 in 2010, to 20 in 2016), and increased participation of stakeholders (from solely national government involved in the policy debate, to include social partners, civil society at both national and sub national levels). While lot needs still to be addressed, progress in capability for policy analysis and system monitoring is notable across all regions covered by the ETF 2. The project as well allows ETF to monitor progress in partner countries and to offer cross country analysis for its thematic interventions and the EU project and programme cycle. The project is implemented around three axes of work: (i) the Torino Process: a periodic participatory and evidence based analysis of VET policies in ETF partner countries, implemented in 2010-11, 2012-13, 2014-15 and 2016-17.The next round of the Torino process will be implemented in 2019-20. 1 The EU2020 Strategy, the New Skills for New Jobs Agenda, the New skills Agenda for Europe. The Copenhagen Process, Bruges and Riga Deliverables. The EU Better regulation www.ec.europa.eu/smart-regulation. The EU capacity development approach www.capacity4dev.ec.europa.eu. 2 In SEET countries have used the ETF methodology for ex ante impact assessment of policy options, linking it with the preparation and implementation of the RIGA Medium Term Deliverables, in EE countries have moved to involve social partners and civil society in the process including sub national levels, in Ukraine for example all regions have implemented a policy analysis exercise in 2016 in view of developing a national monitoring system based on a bottom up reporting mechansim. In Central Asia all countries are involved in a self assessment of VET policies, and Kazakstan has allocated national funding to the implementation of the policy analysis and monitoring cycle based on the ETF Torino process approach. In SEMED Tunisia has advanced in the involvement of sub national levels in the policy debate as well as in the development of its monitoring system. These are just a few examples of the added value of the ETF intervention in this domain of work. 1
(ii) (iii) the ETF contribution to the monitoring of the implementation of the RIGA medium term deliverables in candidate countries, within the RIGA monitoring and reporting cycle established by the EU the institutional capacity development input to countries engaged in developing their policy analysis and monitoring system in view of using the generated policy analysis for a better and more efficient policy making cycle. This includes the development-adaptation of methodologies and tools for policy analysis and monitoring and training of policy makers and other VET stakeholders on specific methodologies to increase effectiveness of policy cycle. The project aims at promoting a virtuous policy cycle where evidence is used to inform policy making and monitor results of implementation, for better services to citizens and relevance of VET for the labour market. 2. Key priorities for 2017 Torino Process. The fourth Torino process cycle (2016-17) will come to its closure in 2017, with finalisation of publications, including country, regional and cross country analyses which will be published online (through a dedicated TRP website) and narrative evidence will be stored in an on-line database accessible through the website. ETF will give high priority to disseminating the findings of the Torino process cycle, which will include an international conference in Turin on 7-8 June 2017, with all ETF partner countries, EU institutions, and the international community. The conference will give the opportunity to reflect on results and lessons learned from the four implemented Torino process cycles, and to formulate a shared vision for the next Torino process cycle, expected to take place in 2019-2020) with a stronger focus on evaluation of country progress (in line also with the post-riga monitoring framework). A specific communication plan is presented in the section below. RIGA monitoring. Under the RIGA support to Candidate Countries the ETF will follow up the second round of policy reporting in 2017, and provide specific support to candidate countries in the area of evidence collection and policy analysis in the MTDs areas. In particular, building on the learning generated by the first round of RIGA monitoring, the ETF will support institutional capability for evidence collection and reporting, mirroring the REFERNET function in use for Member States, through the launch of the TORI-NET Networks for Monitoring in all candidate countries. All candidate countries will undergo the second round of RIGA reporting in 2017. The objective of the ETF is to facilitate quality reporting (through specific support to evidence collection in MTDs which lacked evidence in the first round) and monitor implementation of policy choices for MTDs which have been selected in 2016 for the ex-ante impact assessment. The ETF will analyse the findings form the 2016 and 2017 rounds of MTD monitoring in the candidate countries and will provide inputs to the 2017 Interim Report on progress towards RIGA MTDs. The candidate countries will be encouraged to carry forward ex-ante impact assessment for other MTDs with the scope of enhancing their capacity in terms of policy analysis in support to policy identification and implementation, and advancing the policy discussion under all MTDs. A specific policy lab will be organized for candidate countries in 2017 with the scope of advancing as well the regional coordination and cooperation in this domain. The lab will be implemented in close cooperation with regional actors (RCC-ERISEE in particular). Policy analysis and monitoring development. In 2017 the project will continue the dialogue with partner countries engaged in strengthening their technical and institutional capabilities in the area of evidence based policy making, monitoring process and systems. In particular, in 2017 the project will provide input to the development/consolidation of monitoring and evaluation processes at country level (both at national and subnational levels) in Ukraine, Tunisia, Morocco (with the SPGOV), Kazakhstan and the Russian Federation. Furthermore, the project will contribute to improve technical capabilities for evidence collection and use, policy analysis and policy decision making, including ex-ante impact assessment in Moldova, Kosovo, Bosnia&Herzegovina (with SPEMPL), Armenia, Palestine, and at regional level in Central Asia where the project will work in partnership with the CAEP (Central Asia Education Platform) initiative. The overall scope of these actions is to ensure progress in the outcome of the project i.e. to contribute to progress of partner countries in 2
evidence based policy making and in the implementation of the torino process principles (participation, evidence, holistic view of VET and ownership). 3. Cooperation Within the project, and following the 2015 Riga Conclusions, the ETF will continue, under the coordination of DG Employment and in cooperation with the CEDEFOP, to contribute to the monitoring of the new set of medium term deliverables (MTDs) in the candidate countries. For all partner countries, the Torino process constitutes a rich source of information on country progress and priorities for action in VET and employment. It is a key input to be fed - via the EU Delegations, DG NEAR and DG DEVCO - into national and regional policy debates (such as the Eastern Platforms, the CA Education Platform or Union for the Mediterranean regional debates). The Torino Process in the countries gives a platform for discussion with both national stakeholders and the international community active in the field of skills development. Torino process represents the ETF s corporate contribution to the international debate on policy analysis and monitoring progress of VET reforms in the partner countries, which is an objective also for most of the donors and international organisations active in the field of VET and skills (EU Member States and other bilateral donors, OECD, World Bank, UNESCO, and others). The project actively cooperated with EUROFUND specifically on indicators and policy analysis methodologies, and with EUROSTAT for data collection methods and implementation in partner countries. In addition, the project is cooperating with RCC in the SEE region and contributes to the monitoring of the SEE2020 strategy. For all countries, the Torino process will build on synergies with other international actors, including the work of the Inter-Agency Group led by UNESCO, and the G20 framework following the 2010 Seoul Summit. This is intended to facilitate synergy and policy learning between the ETF partner countries, the EU and the Global development agenda. In particular in 2017 the ETF, through the dissemination of the TRP findings, and the TRP international conference, will engage the global community in a reflection on the status of VET policies and progress in partner countries to seek a joint agenda for future action. Together with the external actors, the project is a service hub for all other strategic projects implemented by the ETF. The cooperation thus is also a key pillar of the project for the in-house work, allowing for rationalization and management of indicators, support to methodological development for policy analysis exercises, evidence collection and capacity building input to thematic deliverables for methodological support and expert input on the use of evidence for policy analysis and policy decision making. (more details on in-house cooperation are provided under the knowledge management section). 4. Expected Outcomes 2017 The objective for the project is to improve policy making in VET by strengthening institutional capacity for the generation and use of evidence throughout the policy making cycle (design, implementation, monitoring and evaluation) and to develop a culture of policy monitoring, feedback and improvement. This will be achieved through: Outcome 1. Partner country policy making processes are increasingly evidence based, holistic and participatory, and take into account the results of the Torino Process. The project follows a cycle based implementation, which allows to monitor progress of countries and assess their needs in a systematic and consistent manner. The cycle is based on the implementation of the Torino Process, and as such the assessment is provided in coincidence with the year of closure of the round (2017, 2020). 3
In 2017 the publication of national, regional and synthesis reports will be completed. The reports will be published online and disseminated throughout partner countries. The dissemination phase will also include a policy dialogue dimension which will be the basis for the work towards the new Torino process cycle in 2019. In 2016, 20 countries out of 25 have implemented a self-assessment and have led as well the drafting of the report (the increase vis-à-vis the 2014 round is remarkable, with all EE and CA countries conducting a self assessment, and all SEET except Kosovo, in SEMED self assessment have grown by 1 with Palestine joining Tunisia and Israel in the self-assessment modality), in addition in 2016, 3 countries have implemented the Torino Process at subnational level too (Ukraine, Tunisia and Russian Federation) and many countries have involved sub-national level actors in the consultation process through contribution in the workshops and evidence collection phase. This new development has opened up interest of other countries for the sub-national level role and capacity to be engaged in the monitoring and policy analysis process. Yet, despite the progress, lot remains to be done. Some countries are still in need to reinforce their evidence processes and methods, increase consultation and participation, and develop a holistic view of VET linking VET to the wider economic and development agenda. These challenges remain to be addressed in the next years of the project implementation. In 2017 the project will continue its policy dialogue with partner countries to reinforce their policy analysis and evidence based policy making capability. In particular, through the Torino process coordinators network created in 2016 (see 2016 IP), the project will continue engaging partner countries through the online community and specific dissemination actions. In addition some countries will be targeted through specific expertise input for reinforcing the role of sub-national actors in policy analysis and monitoring (with the SPGOV) and the technical capability for the establishment of monitoring processes and monitoring systems (with the SP EMPL). Outcome 2. Sound policy analysis and reporting by candidate countries for the Riga Process complies with the new methodology. The ETF will provide support to candidate countries for the reporting cycle of RIGA and the implementation of the the medium term deliverables following the EU monitoring requirements, this will be done under the form of expertise support to strengthen the evidence based of the RIGA reporting exercise, as well as the input to the monitoring of implementation of the priority MTDs selected in 2016. Furthermore ETF will contribute to the synthesis report which will be led by CEDEFOP in 2017. ETF will continue the support towards the institutionalisation of national networks for the collection, processing and analysis of information for the monitoring of MTDs (TORINETF) and provide capacity building for evidence collection and analysis, set up of indicators, benchmarking, policy analysis and evidence based policy making upon request of candidate countries and as regional actions. 5. Indicators Outcome 1 Increasing number of partner countries progress within, or to next, policy development stage with regard to the use of policy analysis in the policy cycle Targets: 1.1 At least 10 countries make progress in one of the principles vis a vis the 2015 assessment 1.2 At least 3 countries move to a higher development stage 4
See Annex for Details on baseline 2014. Outcome 2 Increased quality of partner countries reports to the Copenhagen-Bruges-Riga process measured through the feedback of CEDEFOP on the usability of evidence for the report Targets: 2.1. At least 2 countries improve the evidence basis in relation to 1 or more MTDs 2.2 There is a higher degree of comparability of data between CC and EU for at least 1 MTD area 6. Methodology The project follows the same methodological approach throughout its activities, focusing on the added value of policy analysis to inform policy making and developing its actions around the four areas of institutional development: 1. Evidence based policy cycle management. Under this area the project focuses on the technical support to countries for the creation of evidence (both quantitative and qualitative), its proper communication across the system and use for decision making. In the majority of ETF partner countries there is still a lack of evidence, which brings to the need to ensure that there is a development of availability for policy analysis. However, where evidence is available, there is still a need to ensure that this is used for the policy cycle. In the majority of countries where evidence is available there is seldom use of it. The project offers methodological support and capacity development tools for both the creation of evidence as well as its use for the policy cycle. 2. Ownership. Under this area ETF refers to the capacity of the system to develop transparent and accountable policies which are owned by all stakeholders. It is key in most of the ETF partner countries to increase the accountability and transparency of policies through virtuous policy cycle management and monitoring systems. The project supports the development of monitoring systems at country level uplifting the capacity of all stakeholders in the sector, thus contributing to create the condition for a transparent and accountable policy cycle. Under this area ETF contributes as well to the coordination of donors interventions in the sector, making of the policy analysis debate an opportunity for dialogue and shared action. 3. Holistic view of VET. This area is key in the contribution to ensure that policies can become more result oriented and impactful. VET needs to be looked at in its complexity and interlink with the wider economic and social cohesion and development agenda. In the majority of countries the VET debate is still limited and articulated around Initial VET only, lacking the longer term vision of the VET contribution within the national context. The project, adopting a method of policy analysis aiming at capturing the complexity of VET, contributes to articulate the interconnection of VET with the wider context. 4. Participation. It is a key pillar of development as well as a principle for the project implementation. The all project is based on a consultative and participatory approach to policy analysis and policy making, which aims at bringing all stakeholders around the policy debate. Since 2010 there has been an evolution in terms of participation from the inclusion of solely national government level, to include social partners and civil society at national and sub national levels, experts and the donors community. The project is focusing on uplifting the technical capabilities of all stakeholders involved in the policy analysis process, ensuring that their participation is active. 5
The four principles are articulated across the three axes of implementation: TORINO PROCESS. In 2017 the cycle will come to its closure, with the continuation of the methodology developed for the all round. Q1 Q2 Q3 Q4 2016 Kick-off country consultations Country consultations Country Reports peer review Regional Forum CA Country reports validation Regional forum EE 2017 TRP regional forum SEET and SEMED TRP national reports finalized Cross country analyses finalized (regional report, crosscountry, process report) Closure of the process TRP synthesis report Dissemination International conference dissemination In 2017 the key focus of the work will be on the analysis of findings. These will be analysed in clusters and then brought together, after the TRP conference, in the final publication. The list of publications and timeline is available in Annex. Together with the effort on analysis which will occupy the first 2 quarters of the year and partially the third quarter with the finalization of the publication (which will include the TRP conference findings), the project will also continue its policy dialogue with partner countries on policy analysis and evidence based policy making. Together with the policy analysis, the project will target the dissemination of findings as a priority in 2017 (see communication strategy), including preparing a dissemination package for all partner countries for their own national dissemination and use, with the scope to contribute to improve communication on VET in partner countries. RIGA MONITORING. Under this pillar the methods used mirror the REFERNET mechanism used for Member states. In the specific case of partner countries, and within the specific financial regulations in place for the ETF, a full mirroring of the REFERNET is not possible, as ETF cannot provide GRANTS, and because partner countries availability of entities which could bid for such a service is limited. At the same time, together with these constraints, the scope of the ETF is not only to ensure the provision of evidence as an input to a centralized monitoring function of the ETF (as it is the case for the REFERNET and CEDEFOP), but it is to ensure that partner countries make progress in their own monitoring and policy analysis capability and processes. As such the ETF will implement actions in candidate countries aimed at enhancing the progress of the monitoring function and the capability of VET stakeholders to contribute to the policy dialogue in the MTDs domain as regard to policy planning, implementation and monitoring (in particular through ex-ante impact assessments and monitoring tools). Only for 2 countries (Turkey and Serbia) where there is an advanced availability of possible tenders, the ETF will launch a procurement process aimed at identifying a REFERNET like actor. The actor will have the mandate to collect evidence, support policy analysis and reporting on the basis of the demands of the ETF (agreed with the responsible institutions in the country). For the other three candidate countries, the ETF will develop an annual 6
work programme with the responsible institution, and provide support to specific actions through its framework contracts (expertise, evidence collection, capacity building). The mechanism will be reviewed on an annual basis, with the objective of establishing in all CC a policy network by 2020. On the basis of the reporting cycle, ETF will produce an analysis which will contribute to the RIGA monitoring report, in cooperation with CEDEFOP. The ETF will continue to contribute to the DGVT/ACVT meetings and preparation of Candidate Countries participation to the meetings, coordinating their input when requested. A centralized team will work in close cooperation with the country desks of candidate countries, to ensure full ownership of the process in all countries, avoid duplication of actions, and ensure that the ETF input is proportionate and sustainable within the existing institutional framework. In case of capacity, development needs the RIGA action will be complemented by capacity building programmes for selected stakeholders. In addition the team will work in close cooperation with SPPROV, in particular to follow up on the monitoring of implementation of selected MTDs, and with SPQUAL and SPEL, and SPEMPL, for their related MTDs monitoring and evidence collection needs. POLICY ANALYSIS AND MONITORING DEVELOPMENT. Actions in the countries will be carried out through project expertise inputs and missions of project team members in complementarity to other SPs actions, or as direct support to country owned processes. In addition to country specific activities, all countries will be covered through a specific meeting for coordinators within the TRP conference, as well as through online meetings and a specific training in Q4. The project will build on the knowledge and tools produced in the years of implementation, as well as benefit from methodological work carried out under implemented projects, specifically under the FRAME (in particular on vision building and monitoring, as well as the review of institutional arrangements in relation to the four policy analysis capabilities i.e. torino process principles), and the GEMM (in particular on the use of evidence for policy identification and monitoring and participatory policy making), and the ex-ante impact assessment guidelines developed under the PRIME implementation and the RIGA support in 2016. Country/REGION SP coordination Target input Modalities Central Asia Nn Input to CAEP capacity building and networking for central Asian countries on evidence based policy making and monitoring for VET Kazakhstan Nn Involvement of sub-national actors in policy analysis and monitoring Armenia Nn Technical capability of stakeholders to advance ownership of policy monitoring Moldova SPEMPL Development/reinforcement of monitoring system Ukraine SPGOV Involvement of sub-national actors in policy analysis and monitoring Russia Federation Nn Involvement of sub-national actors in policy analysis and monitoring Tunisia SPGOV (for the sub Involvement of sub-national national dimension) actors in policy analysis and monitoring ETF expert input in 3 workshops and 1 conference Training for subnational actors (events funded by Kazakhstan authorties) Follow up to CAEP workprogramme in particular in use of evidence based tools for monitoring Expert input/coaching through missions and creation of network towards 2019 round Expert input to SPEMPL activities Follow up to TRP 2016 as an input to the decentralization agenda Follow up to TRP 2016 and consolidation of process towards 2019 Follow up to TRP 2016 as an input to the decentralization agenda and preparing for wider subnational participation 7
in 2019-2020 Expertise input in the development of system monitoring process Morocco SPGOV Involvement of sub-national actors in policy analysis and monitoring Palestine Nn Communication and dissemination of monitoring results and consolidation of monitoring process Kosovo SPEMPL/SPGOV Technical capability of stakeholders to advance ownership of policy monitoring Bosnia SPEMPL Technical capability of stakeholders to advance ownership of policy monitoring Expertise input under national reform actions Preparation of sub national level preparation to TRP in 2019-2020 Expertise input and national expertise support Communication expertise Expert input/coaching through missions and creation of network towards 2019 round Follow up to 2016 TRP round and consolidation of network towards 2019 7. Knowledge Management Policy analysis. In 2017 ETF will deliver the monitoring report of progress in partner countries, based on the outcomes of the Torino Process. The project will deliver regular policy analysis reports on key indicators (KIESE: key indicators Education, Skills, Employment), and Country Progress Indicators (CPIs). Under this function the project acts within OPS, through the EST (Evidence and Statistics) team, as a hub for quality assure data collection methods, and providing input to policy analysis exercises at country, regional and cross-country level, within the work programme objectives covered by other SPs. In 2017 the project will provide methodological support, evidence collection and analysis input to the SPEUSUP, SPEMPL, SPEL, SPPROV, SPGOV, in addition to serving transversal needs and management requests in relation to policy analysis and progress monitoring. The project will release the KIESE in April and September of each year. IN September the KIESE will be accompanied by an analysis of data for each partner country. The possibility for access and for extraction of tables and graphs from the KIESE database will be explored in early 2017 and possibly implemented within the year to ease knowledge management and data use across the ETF. To increase the use of the Torino Process narrative evidence, with the COMM department, the project is developing an online dedicated platform which will allow the selection of questions/countries covered by the Torino Process 2016 and a comparison through the extraction of specific sections of country reports. This shall increase the knowledge management and serve the objective of contributing to the rationalization of the evidence management within the ETF. In 2017 options to enlarge the coverage of the database to other policy analysis tools will be explored with the objective of achieving a full accessibility and usability of the ETF gathered analysis and intelligence and a single repository. The database will be accessible also by external users. In particular partner countries policy makers and practicioners will be able to compare country data and policy progress, as well as to look for practices and examples through the database. The scope is to ensure that the dissemination of the torino process is increased and reaches out to more stakeholders types by offering customized users products studied on the basis of identified needs (policy makers, EU services, practicioners, international partners, VET stakeholders, academia and researchers). A specific action is implemented in 2017 to ensure as well knowledge management as regard to implemented processes. In particular practices to showcase the operationalization of the four torino process principles will be collected and shared, as well as examples of the added value of the torino process in terms of advancement of the policy analysis and monitoring capability, donors coordination, informing country policy making, and informing the EU programming and project cycle. These practices will be key in the packaging of the methodology torino 8
process as a tool for strengthening policy cycle management which could be used beyond partner countries (in particular through the DEVCO VET FACILITY). 8. Communication Plan and Networks and Dissemination Based on the 2016 IP, a communication plan with COMM is under implementation for the coverage of the all TRP cycle. In particular, thanks to the joint effort across the two departments, the communication and dissemination has been a key element of the project since its new round of implementation in 2016. Of particular importance have been the questions: who needs/wants to know what? And how best the content needed can be made accessible? Two pillars of communication and dissemination have been identified: the first focusing on the content of the project (reports on progress in policy areas and VET system overview) and the second focusing on methods and tools (including good practices in policy cycle management and monitoring). There was also the need identified to humanize the torino process, and show the story behind each report, to showcase the added value and learning outcome of the process implementation. The complexity of the project is such that it is a challenge to identify all its possible users and audiences. An attempt is provided below. The table includes the key messages as well as the methods for communication and responsible service. The TRP conference 2017 will have its own communication strategy, this is included already in the conference preparatory design. Some of these actions have started already in 2016 using the TRP events as means to capture all countries stories and also faces of TRP community members of all partner countries. Furthermore the design of the online platform has started and the TRP has also developed the connection page which is the key tool for communication with the practicioners group, extended TRP team. Finally a workshop on data visualization took place in 2016 involving both COMM and TRP team members with the scope of preparing the communication strategy and better identify users demands and tools. The table below largely builds upon the workshop. The communication strategy builds on the TRP publications, which are the basis of all content and the key products that all audiences shall access to and use. The scope for this round is to extend the life of TRP products, make them more accessible, and track the use and benefit of stakeholders groups. The communication plan covers for its large extend the Torino process in both its policy analysis and capacity development areas of work. The dissemination of the RIGA axes of work will be done together with the Torino Process, and will however be further disseminated through CEDEFOP products and initiatives, to which the ETF will contribute. Visibility of these products will be assured through communication with candidate countries as well as through ETF media and website. AUDIENCE NEED MESSAGE TOOL RESPONSIB LE SERVICE ALL To know the TRP FIND OUT IN Pre-publication TRP team analysis is coming out THE TRP communication with COMM and it is an interesting and added value PPT story infographic Teaser #TRP2017 WHEN? November20 16-February 2017 GB WEBISTE STAKEHOLD ERS network (CPD) TRP NETWORK (database) EU SERVICES Know status of VET The TRP/ETF Infographics TRP team TRP2017 9
and progress made by countries, outline areas of needs and possible EU interventions monitoring is useful for identification of needs and tracking of EU assistance ETF as a key tool for intelligence and policy briefs (short, region based) Testimony from EU service Dissemination of database with COMM Printed/online profile Videos GB Structural dialogue Country missions EU missions management POLICY MAKERS IN PARTNER COUNTRIES What actions shall be put in place to advance in the reform agenda How country performs vis a vis other countries and vis a vis Europe How other policy makers have made change happen TRP/RIGA as a tool for policy making and decision. Evidence based systems allow for better impact #TRP2017 Country profiles based on the executive summary of TRP, plus regional/eu benchmarking Peer inspiring stories give a face to the TRP Video TRP team with COMM Printed/online profile TRP team with COMM TRP2017 Country meetings under all SPs Online platform INTERNATIONAL ORGANIZATIONS/ DONORS/EUdeleg ations What needs are there at country level which donors shall invest on? TRP as a tool for donor coordination and intelligence access TRP as a method for VET policy analysis and VET policy making capability development Stakeholders communication package Link to database/make it accessible Methodological guides and stories of added value CPD database message and CDs in partner countries COMM TRP and CPD And country desks TRP2017 Interagency meeting and CPD work with stakeholders Country missions ETF staff (actions could also be targeted to specific groups, such as CDs, SPLs; etc.) PRACTICIONERS IN PARTNER COUNTRIES What is there at country level and how best to move forwards TRP in: How do countries work on my area of expertise? Are TRP as a tool for intelligence coordination and use TRP as a tool for intelligence use and access to #TRP2017 Link to database/make it accessible Complement with other ETF intelligence Link to database TRP team TRP and country desks Cappuccino meetings Intranet TRp2017 Coordinators 10
there good practices? What shall I do do move forwards in my work? network Access to connection group TRP out: increase/create buy in What is in it for me/us Stories of Added value Stakeholders communication through TRP database and connections community PUBLIC/OTHER STAKEHOLDERS What is the TRP and what is it for? TRP as a support to EU assistance and progress in partner countries #TRP2017 Stories #TRP2017 COMM WEBSITE FACEBOOK #TRP2017 The communication plan will be implemented through the support of the COMM FWC Article 10, specifically for the development of the design of the TRP platform, and through COMM FWC for journalism and photography for the stories and faces of TRP project. In addition the communication package will include the development of short videos in 2017 on good practices (during the TRP conference in June), and a presentation of the TRP findings as a complement to the publication in September 2017. Finally a dissemination package for use in partner countries will be prepared, with the scope of making partner countries representatives ambassadors of the TRP conclusions and actions forwards to improve policy making for impact and real change through VET. The communication package will be distributed during and after the TRP conference with the scope of kicking off the dissemination phase of the TRP 2016-17 round. 9. Monitoring and Evaluation The recent external evaluation points to the Torino Process as a tool for better governance, contributing to the involvement of stakeholders in partner countries and contributing to greater transparency and accountability through improved monitoring of VET policies. Furthermore, the Torino process is described as the key unifying process for ETF activities, helping countries to put in place the foundation stones for effective policy making. In line with the external evaluation, the process will reinforce the offer of tools and access to expertise for partner countries, monitoring the development of partner countries capabilities through the development stages of policy analysis and policy making. In 2017 at the closure of the 4 th round a reflection on lessons and future of the Torino process implementation will be conducted internally, involving all OPS colleagues and in particular the project members and country desks, as well as SPs. Country feedback and lessons learned from implementation as well as the results of the external evaluation will be the basis to run this discussion and feed decision making for the future implementation modalities of the project. Discussion should touch for example on the balance between the capacity building and the policy analysis function of the Torino process, the relevance an devolution of the different implementation modalities and the synergies and coordination with other monitoring processes. Furthermore, in 2017 the project will undergo a performance Audit (Q1) and an external evaluation (Q3-4). The monitoring of the project is performed according to the standard ETF monitoring milestones (Q reports and self-evaluation at the end of the year). Together with the project implementation monitoring the project as established a methodology for monitoring and evaluating the Torino Process implementation. In 2017 a specific 11
analysis will be conducted building on three sources: (1) countries self assessment and feedback on the implementation of the process through the TRP coordinator, (2) a feedback from country desks which will provide a comparison with previous round of implementation, and (3) a survey conducted throughout the TRP workshops participants through an online questionnaire. This will give an opportunity to outline process implementation and monitor its added value and gaps for gaining lessons for the next round. Furthermore, through the community of coordinators the findings of this analysis will be discussed and refined and will inform the publication of a methodological note on the Torino process in 2017. As the next round 2019-2020 will be focused on policy evaluation, already in 2017 through the coordinators network a first brainstorming on evaluation will be conducted, for informing the IP2018 of the project. For the RIGA pillar monitoring will be as well conducted through standard ETF milestones, as well as through a continuous communication and feedback loop with CEDEFOP and Candidate countries representatives including through the DGVT and ACVT meetings, where ETF will be present and will monitor as well the feedback on quality of reporting of candidate countries as well as the added value of its own support. The RIGA pillar, through the monitoring of implementation of the results of the ex-ante impact assessment work carried out in 2016, will provide the opportunity to build a solid basis for evaluation in 2019-2020. Country desks as well as thematic projects will be active contributors to the monitoring and evaluation of the project, including thorough feedback on outcomes of actions of 2016, and use of the 2016 findings for both TRP and RIGA to inform policy making. During the 2017 the project, through periodic meetings with SPs and CDs will monitor these outcomes and report them in the Q reports. 12
13