Building Services Engineering Apprenticeships. Building Services Engineering Installer Assessment Plan. Contents. 1. Introduction and purpose

Transcription

1 Building Services Engineering Apprenticeships Building Services Engineering Installer Assessment Plan Contents 1. Introduction and purpose 2. Assessment overview 3. Installer assessment content 4. Installer end point assessment methods 5. Roles in the assessment process 6. Quality assurance, consistency, accuracy and independence 7. Grading 8. Implementation Annex 1: Best practice in on programme learning and assessment 1

2 1. Introduction and purpose This Assessment Plan sets out the assessment requirements for the following Apprenticeship standard: Building Services Engineering Installer (level 2) The Assessment Plan supports delivery of the Installer Apprenticeship standard. Its purpose is to inform those involved in delivery of the apprenticeship: how employers from the industry intend assessment to operate what they intend to be assessed who should be involved how assessment should be quality assured 2. End point assessment overview The assessment plan design is driven by the following principles: The apprentice demonstrating competence as far as practical through workplace performance The apprentice s ability to meet specified industry standards of competent performance The apprentice s ability to demonstrate the requisite knowledge and behaviours that support workplace performance Identification of the apprentice s potential for progression Installer Assessment Health and Safety Basic health and safety knowledge is to be assessed within the first two weeks of the on programme training. The more specific aspects of health and safety will form an integral part of the end point assessment Installer apprentice assessment will be delivered through a combination of three components: Portfolio assessment Knowledge assessment Skills test End point assessment overview diagram 2

3 Installer Apprenticeship End Point Assessment (Undertaken within the final 3 months) Portfolio assessment Knowledge test Undertaken after the portfolio assessment Skills test Undertaken after passing the knowledge test Note: Health and Safety Basic health and safety knowledge is to be assessed within the first two weeks of the on programme training. The more specific aspects of health and safety will form an integral part of the end point assessment 3. Installer assessment content (what will be assessed) 3

4 The Building Services Engineering Installer Apprenticeship standard defines the occupation profile, knowledge, skills and behaviours employers expect of a competent Installer at completion of the apprenticeship. Assessment organisations will work collaboratively to develop the content detail, assessment strategy and assessment specifications to meet the apprenticeship standard. These documents will be approved by the Employer Development Group before being implemented and will be made available on the Building Engineering Services Association website [link to be inserted] to any organisation wishing to deliver the apprenticeship. 4. Installer assessment methods (how it will be assessed) Point of Method Coverage Assessed by Grading Weighting* Assessment Health and Safety Basic health and safety knowledge to be assessed within the first two weeks of the on programme training. The more specific aspects of health and safety will form an integral part of the end point assessment Multiple Start of Basic safety Assessment choice Pass/fail programme knowledge organisations examination Portfolio of evidence End point synoptic Skills, knowledge & behaviours applied in the workplace Employer & Training provider/assessment centre assessor Pass/fail 30% Multiple choice examination End point synoptic Underpinning and applied knowledge Assessment Organisations Pass/ merit distinction/ fail 30% Skills test 1 End point Performance application of skills & knowledge Independent assessor Pass/merit/ distinction fail 40% *Weighting indicates the importance of each assessment component within the overall assessment process. There are no calculations or formulae within these weightings. The apprentice must pass all assessment components to complete the apprenticeship End point synoptic portfolio assessment The portfolio assessment must be undertaken and passed by the apprentice, prior to sitting the end point synoptic knowledge test and skills test 1. This is to ensure the apprentice has gained sufficient learning and workplace experience. The Installer apprentice will produce the portfolio from records of a range of activities undertaken in the workplace, reflecting the breadth of the knowledge, skills and behaviours within the Apprenticeship standard. The records will be signed off by the apprentices employer (or representative) to confirm the activities were undertaken by the apprentice and meet industry standards for quality, timescale, how the activities were approached, planned and undertaken. The portfolio will be assessed by the training provider/assessment centre assessor who is occupationally competent and qualified to assess. The assessor will validate and assess activities 4

5 recorded in the portfolio through a desk-based review and guided discussion with the apprentice. The assessor will also inspect some of the site work completed by the apprentice and may also ask the apprentice to undertake practical simulated activities where there is a gap in the evidence provided. The awarding organisation will provide independent verification by sampling each apprentices portfolio. End Point Synoptic Knowledge Test Installers are required to have a basic knowledge of the systems and components they install, knowledge of how to work safely and sustainably, and how to plan and prepare the work area. The knowledge test will use multiple-choice questions to assess underpinning and applied knowledge. The underpinning questions will cover the how and why elements of the content. Applied knowledge will use scenario type questions to assess the apprentice s judgement and decision making. This knowledge will be tested by the assessment organisation, through centrally set and centrally marked multiple choice on-line examination. The examination will be administered and invigilated by the training provider/assessment centre. The knowledge test must be passed before candidates can sit skills test 1. This is to allow the independent assessor to calculate and apply the overall grading of the apprenticeship after marking and scoring skills test 1 End Point Synoptic Skills Test 1 The skills test will be used to confirm that the apprentice can organise and undertake pipework installation to specified standards, within a specified timescale. The test will be, administered and invigilated by the training provider/centre assessor. Each test will be marked and scored by an independent assessor who is occupationally competent and qualified to assess. The independent assessor will be appointed by the assessment organisation or a third party. The independent assessor will also calculate and apply the overall grading of the apprenticeship. This will be decided on by combining the graded results of the end point synoptic knowledge test and skills test 1 Timing of End Point Assessment The process of setting up the end point assessment will begin three months before completion of the apprenticeship. The timing of the end point assessment will start with the apprentice passing the portfolio assessment, then follow on with the knowledge test and skills test. The portfolio should be kept under regular review by the training provider and employer to monitor progress, address any gaps in learning or experience and to ensure the portfolio is completed to a high standard. The employer should decide on timing of the portfolio assessment with guidance of the training provider if required. Once the apprentice has passed the portfolio assessment the apprentices employer should make arrangements for the apprentice to undertake the knowledge test and skills test. Completion of the apprenticeship The apprentice must pass all three components of the assessment (portfolio assessment, knowledge test, skills test 1) to be deemed competent and complete the apprenticeship. If unsuccessful, feedback would be given and remedial action would be required by the apprentice before resitting unsuccessful component/s. 5

6 5. Roles in the assessment process Apprentices Employer: Supports the end point assessment process by observing and making judgements on the workplace evidence to substantiate that it is authentic and meets industry standards Decides on the timing of and makes arrangements for the end point and intermediate assessment, with the support of the training provider as required Ensures the apprentice has the necessary documentation for end point assessment Works with the training provider/assessment centre to agree remedial action required by the apprentice before re-sitting any unsuccessful component/s Training Providers/Assessment Centres: Where the training provider is also an approved assessment organisation assessment centre: o Provide and manage assessors who are occupationally competent and qualified to assess to: - administer the end point synoptic knowledge test on behalf of the awarding organisation - validate and assess activities recorded in the portfolio through a desk based review discussion with the apprentice, onsite inspection and where necessary practical simulated activities - Manage the administration, preparation, operation and invigilation of skills test 1 o Provide and manage internal quality assurance through internal verifiers who are sector competent and qualified to undertake verification Manage the generation of workplace evidence working with the employer to plan and continuously monitor the apprentice s progress, address any gaps in learning or experience and to ensure the portfolio is completed to a high standard end point synoptic assessment Support the employer in deciding the timing of and arranging the end point assessment Provide the apprentice with training in the end point assessment process Support the employer in agreeing remedial action required by the apprentice before resitting any unsuccessful component/s Notes: 1. Assessments may be undertaken by a third party contracted by but independent of the training provider. 2. The exact balance between Employer and Training Provider support is down to negotiation between the Employer and Training Provider on service and price. Independent Assessors Bring an independent view as they as they have not been previously involved with the apprentice Undertake marking and scoring of the end point synoptic skills test 1 Assesses against pass and distinction criteria Participates in annual standardisation events which will be arranged by the assessment organisation Assessment Organisations Approve and maintain a network of training provider/assessment centres Provide independent assessment of knowledge by centrally setting and marking online multiple choice examinations Provide and manage independent verifiers to undertake verification of the assessment process and in particular, the portfolios Provide and manage independent assessors to mark and score skills test 1 6

7 Provide documentation, training and support for independent verifiers and independent assessors to ensure rigour and consistency Contribute to maintenance and implementation of the Building Services Engineering Assessment Plans 6. Quality assurance, consistency, accuracy and independence Assessment organisations provide important functions to ensure quality, consistency, accuracy and independence of assessment. It is a requirement that assessment organisations involved in the delivery of this apprenticeship are registered with and operating to the Ofqual regulatory requirements Quality assurance Quality assurance of assessments is provided by assessment organisations who will: - Determine criteria for training providers and non-training providers to become approved assessment centres by defining the staff, resources, processes and procedures required to undertake the assessments - Approve training provider and non-training provider assessment centres, ensuring they have the necessary staff, resources, processes and procedures in place to undertake the assessments - Provide and manage a network of independent verifiers to undertake verification of the training providers/assessment centres, the assessment process and in particular, the portfolios - Develop, manage and maintain on-line multiple choice examinations to test knowledge of Installer and Craftsperson apprentices Assessment organisations independent external verifiers will visit centres on at least one occasion per year to review the assessments made by training provider/non training provider assessors. During these visits they will: - review operation of the multiple choice knowledge examinations - review by sampling the portfolio assessments for each apprentice - review operation of the skills tests Multiple choice examinations will be formulated, reviewed and moderated by the assessment organisations to meet a common assessment specification Consistency and accuracy Assessment organisations will work collaboratively to develop the content detail, assessment strategy and assessment specifications to meet the apprenticeship standard. These documents will be approved by the Employer Development Group before being implemented and will ensure a consistent learning and assessment experience. The documents will be made available on the Building Engineering Services Association website [link to be inserted] to any organisation wishing to deliver the apprenticeship The assessment organisation will provide documentation, training and support for independent external verifiers and independent assessors to ensure rigour and consistency The independent external verifiers and independent assessors will attend at least two meetings per year, arranged and managed by the assessment organisation. The purpose of these meetings will be: - to improve consistency and rigour in the approach and execution of their quality assurance responsibilities - to ensure that where any technical or assessment variation (or scope for variation) is identified, a standard interpretation is established and applied Independent assessors will be provided with marking schemes and marking schedules for the skills tests 7

8 The independent assessors will also calculate and apply the overall grading of the apprenticeship. This will be decided on by combining the graded results of the end point synoptic knowledge test and skills test 1 Apprentices will be provided with portfolio templates. They will also be given instruction on the techniques and best practice in formulating their portfolio Independence Independence is provided to the Installer apprenticeship by: - the multiple knowledge test being set and marked centrally by the awarding organisation - awarding organisation independent external verifiers reviewing the assessment process and sample individual assessments within each training provider or non-training provider assessment centre 7. Grading In order to complete the apprenticeship, apprentices must pass all components of the assessment as indicated in the list below: - Portfolio assessment - Knowledge assessment - Skills test 1 Overall grading of the apprenticeship will be decided on by combining the graded results of the end point synoptic knowledge test and skills test 1 The end point synoptic knowledge test and skills test provide an objective measurement of the apprentice s ability and are graded pass, merit, distinction or fail 8. Implementation Based on previous apprenticeship training patterns it is expected that there will be an intake of 400 Installer apprentices each year Assessment of the Installer apprenticeships will be delivered through a network of 22 centres operating in each geographical region throughout England These assessment centres currently deliver apprenticeship training and assessment for the SASE frameworks in these occupations. They have adapted well to the changing requirements of apprenticeships and assessment over the years They are also able to operate in a flexible way to meet the needs of larger businesses who normally have well developed training, mentoring and monitoring processes in place, but can also meet the needs of smaller businesses where more direct support is required to help structure work experience, provide mentoring and monitor the apprentice s progress The Employer Development Group will work with awarding organisations to produce and deliver an Implementation Plan. The Implementation Plan will ensure the provider network is fully briefed on the requirements and operation of the Installer apprenticeship Use of training providers within the assessment process, with external quality assurance through independent verification provided by the awarding organisations provides an effective balance of reasonable costs and effective oversight The overall grading of the apprenticeship being made by an independent assessor brings an appropriate cost effective enhancement to the process for this level of apprenticeship The percentage proportion of end point assessment against the overall cost of the apprenticeship is 24% 8

9 Annex 1 Best practice in on programme learning and assessment This annex shows best practice for on programme learning and assessment and how it relates to the end point assessment Installer Apprenticeship On programme learning (Delivered over months) Basic health and safety knowledge assessment Skills knowledge and behaviours Portfolio building Progress testing 9

10 End Point Assessment (Undertaken within the final 3 months) Portfolio assessment Knowledge test Undertaken after the portfolio assessment Skills test Undertaken after passing the knowledge test Employer discussion Notes: Health and safety Basic health and health and safety knowledge to be assessed within the first two weeks of the on programme training. The more specific aspects of health and safety will form an integral part of the end point assessment Progress testing Progress testing (on programme) is undertaken by training providers on skills, knowledge, behaviours and portfolio to monitor the apprentice s progress throughout the apprenticeship Employer Discussion The employer discussion is used to review the future training and employment options with the apprentice, based on end point assessment performance Health and safety assessment As noted within the main body of the end point assessment document, apprentices must undergo basic health and safety knowledge assessment as part of their induction training. This demonstrates they have met basic health and safety requirements and provides evidence allowing access to construction sites with CSCS (Construction Skills Certification Scheme) or affiliated Trainee card (such as the Engineering Services Trainee category SKILLcard). This knowledge will be tested by the assessment organisation, through centrally set and centrally marked multiple choice on-line examination. The examination will be administered and invigilated by the training provider/assessment centre. The more specific aspects of health and safety will be assessed throughout the apprenticeship including the end point assessment, ensuring they operate to the safety requirements specified in the Apprenticeship standard. Employer discussion 10

11 Following the end point assessment, the employer will discuss future training and employment options with the apprentice. Where the apprentice has performed particularly well the employer may choose to offer progression onto the Craftsperson apprenticeship. This will provide the apprentice with an opportunity to continue with more advanced training, assessment and completion of the Craftsperson apprenticeship. 11