Study of VET graduate tracking measures in EU Member States Final findings European Commission. DG EMPL 21 November 2017 EQAVET Forum Shane Beadle In association with
What will be covered Context for the study Brief overview of study objectives and scope, methodology How tracking measures can assess and monitor performance of VET Key findings of the mapping and analysis EU involvement in VET graduate tracking 2
Context How can tracking measures assess VET performance Quality of courses, teaching, providers in relation to needs of government, employers, students and enabling progression in education Labour market relevance of courses in relation to the needs of the labour market and enabling their contribution to the economy and progression in employment What do tracking measures need for this to be done effectively Collect data from the entire reference population of VET graduates or a large achieved sample Draw systematic samples and obtain representative achieved samples Use administrative data for some quantitative information such as pay and unemployment Draw on both admin and survey data to provide quantitative and qualitative information Collect data at least twice in the five years after graduation Compare VET graduates with non-graduates Make data usable by and available to government users, providers and potential students Presentation Title 3
Study objectives Specific objective 1: Mapping of VET graduate tracking instruments used at system level (with illustrative examples at provider level) Specific objective 2: Analysis of graduate VET tracking measures and development of their typology Specific objective 3: Identification of strengths and weaknesses of these measures and recommendations for ways to improve them at Member State and EU levels Specific objective 4: Review of options for EU activities in this field to improve VET tracking instruments both at national and EU level 4
Study scope VET IVET Lower secondary VET Upper secondary VET Post-secondary non-tertiary VET (up to ISCED 2011 level 4) CVET EU 28 Belgium: Flanders and Wallonia (+Brussels) Germany: two Lander (Bavaria, Baden-Württemberg) Spain: two Autonomous Communities (Catalonia, Basque Country) Italy: focus on national level UK: England and Scotland. Wales, Northern Ireland 5
Study methodology First inventory by core team. Desk research. Mapping by country researchers. Desk research & consultations. In-depth review of 30 selected measures. Interviews. Inception Mapping Detailed assessment selected measures Scenarios for EU intervention Final analysis Scoping interviews with institutions involved in EU-level measures. Interviews with institutions involved in national measures. Stakeholders consultation on options for EU action. 6
Key findings 85 measures from 24 countries; 4 countries have no measures; 5 countries no regular measures; in 19 countries with regular national/regional measures, 8 cover IVET and CVET, 10 only cover IVET Level of implementation Countries which have measures in place Countries with no measures, currently developing them Countries with no measures National AT, CZ, DE, DK, EE, FI, FR, HU, IE, IT, LT, LU, MT, NL, PL, PT, RO, SE, SI, SK BG CY, EL, LV Regional AT, BE, DE, ES, IT, PL, UK Sectoral AT, DE Provider CZ, HR, HU, FI, LT, PT*, SI 7
INTERIM FINDINGS Coverage of VET graduate tracking measures (1) 39 46 VET-specific measures Wider measures Focus on the tracking of VET graduates exclusively Track graduates from different types of education (e.g. all upper secondary graduates) or wider groups of people (e.g. age cohort). 8
INTERIM FINDINGS Coverage of VET graduate tracking measures (2) IVET CVET Lower secondary Upper secondary Post-secondary non-tertiary 30 73 28 23 Note: study did not aim at a comprehensive mapping of all CVET tracking measures. 9
INTERIM FINDINGS Main indicators: employment-related Employment status (employed/not employed) 62 Unemployment rates from graduates after VET Type of employment Job placement rates from graduates after VET 42 42 43 Other 37 Matching between job and qualification 28 Satisfaction of graduates with current job Salary level Length of job search after graduation Matching between position and level of education 20 19 19 19 Duration of employment/unemployment 17 Perception of usefulness of VET for finding employment 8 Satisfaction with income / salary level 6 Satisfaction rate of employers with skills/competences 3 10
Main indicators: employment related (replacement slide) Figure A1.1 Employment-related data. Number of measures covering them employment status (employed/not employed) 68 type of employment unemployment rates from graduates after VET 49 48 job placement rates from graduates after VET Other 42 44 matching between job and qualification 38 length of job search after graduation duration of employment/unemployment salary level 24 26 28 satisfaction of graduates with current job matching between job and qualification 20 20 graduate perception of usefulness of VET studies for 15 satisfaction with income / salary level 9 satisfaction rate of employers with acquired 3 Source: ICF/3s research. Presentation Title 11
INTERIM FINDINGS Main indicators: education-related Participation in further education, training pathways 52 Other 29 Satisfaction rate of individuals with VET training received 25 Further qualifications achieved 15 Reasons for pursuing further education 7 12
Education related indicators (replacement slide) Figure A1.1 Education-related indicators. Number of measures covering them Participation in further education, training pathways 58 Other 33 Satisfaction rate of individuals with VET training received 29 Further qualifications achieved 22 Reasons for pursuing further education 9 Source: ICF/3s research. Presentation Title 13
INTERIM FINDINGS Data collection approach In 19 countries with regular measures, 6 combine admin and survey data, 7 only use survey data and 7 only use admin data. National Regional Data collection approach Qualitative survey EE, FR, IT(2) BE-fr(3), IT(2) Quantitative survey AT(2), CZ(2), DE(4), EE, FR(4), HU, IE(2), LU(3), MT(2), NL(2), PT, RO, SE, SI AT, BE-fr(2), ES(3), PL(2), UK(5) Administrative data collection AT, CZ, DE3 DK(3), EE(2), FI(2), IE, IT, LT, LU(2), MT, NL(4), PL, SE(3), SK BE-fl, BE-fr, DE, ES, UK(2) - Sectoral AT AT(2), DE - - Provider CZ, HR FI, HR, HU(3), LT, SI(3) CZ - Census Note: the number in brackets after each country indicates the number of measures using that approach. Please note that one measure may combine more than one approach. NL 14
INTERIM FINDINGS Measurement strategy 48 Single measurement point (crosssectional) 35 4 Multiple Multiple crosssectional analysis measurement points Data collected once, x time after graduation. Data collected once, x time after graduation. Data is produced periodically. Longitudinal studies; individuals followed over time. 15
INTERIM FINDINGS Sampling 44 total reference population 41 based on a sample* 21 Convenience sampling Presentation Title * In two of these measures there was no information on the type of sampling. 13 systematic sampling 7 random sampling 16
What are the gaps in policy and practice on VET measures Existence of regular and systematic measures in all Member States The quality of measures is variable in terms of their measurement techniques, timing of measurement and outputs Admin data is not used alongside survey data in over half of Member States Key educational and employment indicators are not universally collected Graduates are not universally tracked at multiple points Availability of tracking data is variable (both discrete and summary data) Tracking data is not used for some of its intended purposes Presentation Title 17
What can the EU best do to promote VET graduate tracking? Scenarios for EU intervention Presentation Title 18
WHAT CAN THE EU DO TO PROMOTE VET GRADUATE TRACKING? Options evaluated Develop a new EU VET graduate tracking measure? Streamline an existing survey to enable VET graduate tracking? Provide support or incentives to the creation or development of measures at national, regional or provider level? 19
WHAT CAN THE EU DO TO PROMOTE VET GRADUATE TRACKING? Key reasons for EU support to create and develop measures at national, regional and provider levels Widely perceived usefulness of the support activities which the EU could provide Widely perceived to be high levels of take up as the support would be useful for countries with needs to develop and improve tracking measures which can be tailored to meet different needs and contexts Potential to support development of similar systems Potential to meet higher quality standards for tracking measures so they can be used by government, providers and potential students Icon by Freepik at www.flaticon.com 20
Thank you 21