So you really want to be assessed by us? Assess yourself first! Gilles Guillard EPSO Nicoletta Vullo - PROMETRIC

Transcription

1 So you really want to be assessed by us? Assess yourself first! (Using upfront Self-selection and SelfAssessment tools in large scale selection processes) Gilles Guillard EPSO Nicoletta Vullo - PROMETRIC

2 European Personnel Selection Office EPSO selects highly qualified staff for : 2

3 The EU Institutions 3

4 EU selection process Annual cycles 4

5 A few figures Since creation of EPSO in 2003: Over candidates have participated in EPSO selection processes Over EPSO candidates have taken a computer-based test delivered with Prometric Over CBT exams have been delivered in 2014 Between 1 and 2 % of all candidates in EU open competitions are successful and can be recruited Some competitions have attracted up to applicants for approx. 300 positions offered 5

6 What is the issue? EPSO is bound by law to test all applicants but only very few will be successful High financial costs for the organisation Risks of delay for timely completion of the selection processes Potential large gaps in cultural/organisational fit in the initial pool of candidates Potential large gaps in ability and skills compared to requirements to pass the first phase of the competition 6

7 Solution? Use technological solution provided by Prometric to support the introduction of compulsory Selfselection and Self-assessment For selection process with a high level of attractiveness, all potential candidates must take several online tests before being allowed to apply SST and SAT are tools to support the decisionprocess of individuals to apply or not to EU selection procedures 7

8 Application process 8

9 First assess your potential fit with the organisation 9

10 then assess your abilities and skills prior to actual tests 10

11 Self-selection EU Career, My Career (I) First online compulsory test Objective: raising awareness about applicants' potential fit within EU Institutions Focus on 3 key areas: Organisational citizenship behaviour EU working environment Professional skills attitudes 11

12 Self-selection EU Career, My Career (II) Compulsory but not eliminatory Now available in 24 EU languages Accessible online 24/7 only during application window (usually one month) MCQ (+/- 20 questions) Timed + pass mark Possibility to see correct answer/feedback immediately (educational/branding) Content developed in-house (psychologists + SMEs) and now adapted to specific job profiles 12

13 EU Career, My Career 13

14 EU Career, My Career 14

15 Self-assessment (I) Second suite of online test Objective: provide potential applicants with a free testing experience to allow them to assess their chances of success Different tests: Cognitive abilities (VR, NR, AR) SJT Specific skills tests (e.g. language proficiency for Translators) 15

16 Self-assessment (II) Compulsory but not eliminatory Available in 24 EU languages (SJT in 3 languages) Accessible online 24/7 during application window (usually one month) AND beyond to allow practice and familiarisation with types of tests MCQ (generally 50 % of questions compared to actual exam) Timed + pass mark Correct answers are NOT given away Content extracted from actual EPSO item bank and used in past competitions ("second life" of items) 16

17 Self-Assessment (VR) 17

18 Self-Assessment (NR) 18

19 Feedback? 19

20 Feedback EU Career, My Career 20

21 Feedback Self-assessment tests 21

22 Prometric A trusted and market leader of technologyenabled testing and assessment Committed to a set of values that get the right test to the right location at the right time and to the right test taker Supporting candidates worldwide who take more than 9 million tests each year 22

23 Supporting the EPSO We support the EPSO since 2005 in their effort to select the right candidate for the right job and in making the selection process better, faster and at a less expense; We have implemented innovative, tailored solutions to meet the EPSO needs, including: Multiple choice exams; Case Studies; Audio-Video exams; E-Trays; In the EU24 languages and across all the EU28 member states and WW 23

24 IBT Implementation Tailored solution: A full integration between the EPSO registration process and the IBT testing environment, including seamless navigation and consistent look and feel; No login or data entry by candidates to access the exams; A dynamic presentation of content in multiple languages; Candidate support in the three EU languages 24

25 IBT Landing Page 25

26 IBT exams delivered 2014 overview Cycle Exam Title Test volume Pass rate AST 3 Self-assessment Part I: Reasoning test 57,815 30% AST 3 Self-Assessment Part II: Professional skills test 12,297 33% AD Compulsory self-assessment Part I 200,252 10% AD Compulsory self-assessment Part II SJT 100,449 25% ADL Self-Assessment Translators Part I Reasoning Tests 15,892 11% ADL Compulsory Self-Assessment Part II Language Test 17,907 51% General EU CAREER, MY CAREER? 50,194 51% General EU-LAUFBAHN, MEINE LAUFBAHN? 8,998 64% General UNE CARRIERE EUROPEENNE, UNE CARRIERE POUR MOI? 12,545 53% General EPSO Enquête de satisfaction - French 4,450 n/a General EPSO Survey - English 17,958 n/a General EPSO Umfrage - German 4,513 n/a 503, ,000 IBT tests & surveys delivered To a total of 270,000 candidates In up to 24 languages Minimal candidate complaints 26

27 Some of the lessons learned Reduced number of actual applicants (between 25 to 50 % compared to SST/SAT): costs and testing constraints driven down Increased commitment and motivation of actual applicants (decreasing number of dropouts) Extremely positive feedback from test takers on SST/SAT Increased transparency in EU selection processes 27

28 Future prospects? Comparative assessment of quality of successful candidates and scores achieved in SST/SAT (requires data capture at an early stage)? SST/SAT compulsory AND eliminatory? Migration of EPSO exams from IBT to the new TC Net platform Next Generation - Provides the benefits of Web 2.0 and RIA standards Maintainability Built on the ASP.NET platform Usability - Implements HTML5 leveraging its rapid response capabilities and enhanced UI Design & Security 3-tier architecture WCAG2.0/508 PCI compliance and Architectural Security Risks audited by independent 3rd party 28

29 Thank you! White paper available, just ask for it! Contact details: EPSO Gilles GUILLARD Head of Unit "E-selection and test development" + 32 (0) / mailto:gilles.guillard@ec.europa.eu Prometric Nicoletta VULLO Director of Account Management / mailto:nicoletta.vullo@prometric.com QUESTIONS? 29