WIOA Performance Technical. Assistance Guide

Transcription

1 WIOA Performance Technical Bryan Huebsch WIOA Performance Planner Assistance Guide PY 2017

2 References Definitions ASSET Menu Reporting Periods Exclusions Common Exit and Co-Enrollment Primary Indicators of Performance Business Service Reporting Incumbent Worker Training Reporting Statistical Adjustment Model Scenarios ASSET Services Additional Resources 2

3 References References: WIOA Law WIOA Final Regulations Joint and ETA ICR 6/29/2016 TEGL Joint Performance Guidance TEGL Joint Supplemental Guidance 3

4 Definitions Participant: a reportable individual who has received services other than self-services after satisfying all applicable programmatic requirements for the provision of services, such as the eligibility determination. Participants are included in performance calculations. Reportable Individuals: Reportable Individual: An individual who has taken action that demonstrates intent to use program services and who meets specific reporting criteria of the program. Participants are included in the definition of Reportable Individual. Reportable individuals who are not participants are not included in performance indicator calculations. The specific reporting criteria are: (1) Individuals who provide identifying information (2) Individuals who only use the self-service system (3) Individuals who only receive information only services or activities. Exit: The last date of service. The last date of service cannot be determined until 90 days have passed. The individual may not have received any services for 90 days and there are no future services planned. For the purpose of this definition, service does not include self-service, information-only activities, or follow-up services." 4

5 Definitions Common Exit. Wisconsin has a common exit policy for the Division of Employment Training administered programs. The common exit will exit ETA funded program participants at a common date where the participant has not received any services for 90 days and there are no future services planned from any of the affected programs. This definition does not include self-service, information-only activities or follow-up services from partner programs. The DET (ETA) partner programs in Wisconsin's WIOA common exit are Title 1B (Adult, Dislocated Worker and Youth), WIOA Title 3 Wagner Peyser Employment Services, Jobs for Veterans State Grant (JVSG) and Trade Adjustment Assistance Act of 1974 (and amendments) fund sources. Co-Enrolled. An individual who is a participant in more than one of Wisconsin s WIOA program during a concurrent period of time. 5

6 ASSET Menu The Automated System Support for Employment and Training (ASSET) is Wisconsin s WIOA system of record. To the left are the different menu options that will be referenced throughout this guide. Each page with an ASSET screenshot has an excerpt of the menu tree in ASSET. See the figure to the left. 6

7 What makes a participant in ASSET? Adult/Dislocated Worker Programs A reportable individual becomes a participant when all required fields are filled out in ASSET Manage Customer, a program and related elements are filled out in Manage Programs and a Basic Career Staff Assisted Service, Career Individualized Service or Training Service is entered. Youth Program A reportable individual becomes a participant when all required fields are filled out in ASSET Manage Customer, a program and related elements are filled out in Manage Programs and a Youth Program Element is entered into ASSET. Only provide staff assisted services/program elements to individuals who meet eligibility criteria. Failure to follow and applicable program guidance may result in findings and disallowed costs. 7

8 WIOA Reporting Periods When are participants counted in performance indicators? 8

9 Reporting Periods Exits during the colored bars will appear in the annual report of the year with the corresponding color. The next slide has the text version. 9

10 Annual Reporting Periods 2016 Annual Report No data will be available for most indicators Measurable Skill Gain: July 16 to June Annual Report Q2 Employment: July 16 - June 17 Q4 Employment: July 16 December 16 Median Earnings: July 16 - June 17 Credential Attainment Rate: July 16 December 16 Measurable Skills Gain: July 17 to June 18 Indicator of Employer Effectiveness: July 16 - June 17 10

11 Example of Report Period Interpretation Exit 2/1/17 The participant who exits a program on February 1, 2017 will be included in the PY 2017 (Light Blue) Q2 Unsubsidized Employment Rate and Median Earnings Rates. The same participant will be included in the PY 2018 (Green) Q4 Unsubsidized Employment Rate and the Credential Attainment Rate. If the same participant was in education or training, they would be reported in the PY 16 (Yellow) Measurable Skill Gain Rate. 11

12 Other Reasons for Exit AKA: Exclusions 12

13 Exclusions Other Reasons for Exit are commonly referred to as exclusions. These are circumstances where the participant s exits status warrant exclusion from performance indicators. The exclusions that apply to the Adult, Dislocated Worker and Youth programs are: Institutionalized: the participant exits because he/she has become incarcerated in a correctional institution or has become a resident of an institution of a facility providing 24-hour support such as a hospital or treatment center during the course of receiving services as a participant. Health/Medical: the participant exits the program because of medical treatment and that treatment is expected to last longer than 90 days and precludes entry into unsubsidized employment or continued participation in the program. Deceased: the participant is deceased. Reserve Forces called to Active Duty: the participant exits because the participant is a member of the National Guard or other reserve military unit of the armed forces and is called to active duty for at least 90 days. Foster Care: the participant is in the foster care system defined in 45 CFR (a), and exits the program because the participant has moved from the area as part of such a program or system. None: if the participant meets none of the above conditions. 13

14 Enter Exclusions There are 2 methods to enter exclusions. Entering an exclusion in either location will be reported as an exclusion for the entire episode. Method A: Manage Exits 1. Select Exclusion Reason Method B: Manage Follow-ups 1. In the Follow-Up Status Overview 2. Select Exclusion Reason 14

15 Co-Enrollment Common Exit 15

16 Common Exit Wisconsin has a common exit policy for the Division of Employment Training (DET) administered programs. The common exit will exit program participants at a common date when the participant has not received any services for 90 days and there are no future services planned from any of the affected programs. This definition does not include self-service, information-only activities or follow-up services from partner programs. The DET (ETA) partner programs in Wisconsin's WIOA common exit are: Title 1B (Adult, Dislocated Worker and Youth) Program and Responsible Agency DWD-DET-BWT, Local WDBs National Dislocated Worker Grants (NDG) WIOA Title 3 Wagner Peyser Employment Services (WP ES) Jobs for Veterans State Grant (JVSG) Trade Adjustment Assistance (TAA) Act of 1974 DWD-DET-BWT, Local WDBs DWD-DET-BJS DWD-DET-OVS DWD-DET 16

17 Co-Enrollment An individual who becomes a participant in any of Wisconsin s common exit programs will be included in applicable performance indicators for each program they are a participant. This includes indicators that only measure those in training. Training conducted in a WIOA program will trigger the participants inclusion into the Credential Attainment Rate and Measurable Skills Gain Rate for each program the individual is a participant because the programs need to work together to ensure the participant s success. 17

18 Co-Enrollment Example. An individual who is co-enrolled in Title 1 Adult and Title I Youth will trigger entry into the Adult Q2 Employment Rate and the Youth Q2 Employment or Education Rate. Example. An individual who is dual enrolled in TAA and Title I Dislocated worker will trigger entry into the Dislocated Worker Q2 Employment Rate and the TAA Q2 Employment Rate. Example. An individual who is dual enrolled in Title 1 Youth and Adult Basic Education is included in the Title 1 Youth Credential Attainment Rate, Title 1 Youth Measurable Skills Gain regardless if the individual receives any training funded by the Title I Youth Program. 18

19 Primary Indicators of Performance Q2 Unsubsidized Employment Rate Q2 Employment/Education Rate (Youth) Q4 Unsubsidized Employment Rate Q4 Employment/Education Rate (Youth) Median Earnings Credential Attainment Rate Measurable Skills Gain Indicator of Effectiveness in Serving Employers 19

20 Adult/Dislocated Worker Q2 Unsubsidized Employment The percentage of program participants who are employed during the 2 nd full quarter after exit. Employment includes military duty and registered apprenticeship. Specifications: Denominator Fund Stream = Adult or Dislocated Worker Participation Date = Not Blank Exit Date = In the Report Period Exclusions = None Numerator Employed Second Quarter After Exit = Employed, Military, Registered Apprenticeship 20

21 Adult/Dislocated Worker Fund Source/Participation Date Back to Indicator Manage Services Adult Funding Stream Participation Date Manage Services Dislocated Worker 21

22 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Mange Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 22

23 Exclusions Manage Exits Select an Exit - Select an Exclusion Reason Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) 23 None - Blank

24 Determining Employed 2nd Quarter after Exit Back to Indicator Method #1: Wage match through Unemployment Insurance Wage Records Method #2: Wage match through State Wage Interchange System (SWIS) Method #3: Supplemental Data Wages detected in wage record (Method 1 or 2) Wages not detected requires supplemental data (Method 3) 24

25 Youth Q2 Employment/Education Rate The percentage of program participants who are employed or are in education during the 2 nd full quarter after exit. Employment includes military duty and registered apprenticeship. Education includes secondary, post-secondary education and advanced training. Specifications: Denominator Fund Stream = WIOA Title 1 Youth Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Numerator Employed 2 nd Quarter After Exit = Employed, Military, Registered Apprenticeship or Enrolled in Education 2 nd Quarter After Exit = Yes, 25

26 Youth Fund Source/Participation Date Manage Services Back to Indicator Funding Stream Participation Date 26

27 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Manage Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 27

28 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) None - Blank 28

29 Determining Employed 2nd Quarter after Exit Back to Indicator Method #1: Wage match through Unemployment Insurance Wage Records Method #2: Wage match through State Wage Interchange System Method #3: Supplemental Data Wages detected in wage record (Method 1 or 2) Wages not detected requires supplemental data (Method 3) 29

30 Determining Enrolled in Education 2nd Quarter After Exit Manage follow-ups Follow Up Status Second Quarter Tab Back to Indicator What counts? Secondary Education, Post Secondary Education Occupational Skills Training 30

31 Adult/Dislocated Worker Q4 Unsubsidized Employment The percentage of program participants who are employed during the 4th full quarter after exit. Employment includes military duty and registered apprenticeship. Specifications Denominator Fund Stream = Adult or Dislocated Worker Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Numerator Employed 4th Quarter After Exit = Employed, Military, Registered Apprenticeship 31

32 Adult/Dislocated Worker Fund Source/Participation Date Back to Indicator Manage Services Adult Funding Stream Participation Date Manage Services Dislocated Worker 32

33 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Manage Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 33

34 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) None - Blank 34

35 Determining Employed 4th Quarter After Exit Back to Indicator Method #1: Wage match through Unemployment Insurance Wage Records Method #2: Wage match through State Wage Interchange System Method #3: Supplemental Data Wages detected in wage record (Method 1 or 2) Wages not detected requires supplemental data (Method 3) 35

36 Youth Q4 Employment/Education Rate The percentage of program participants who are employed or are in education during the 4th full quarter after exit. Employment includes military duty and registered apprenticeship. Specifications: Denominator Fund Stream = WIOA Title I Youth Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Numerator Employed 4th Quarter After Exit = Employed, Military, Registered Apprenticeship Enrolled in Education 4th Quarter After Exit = Yes 36

37 Youth Fund Source/Participation Date Back to Indicator Manage Services Funding Stream Participation Date 37

38 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Manage Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 38

39 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) None - Blank 39

40 Determining Employed 4th Quarter After Exit Back to Indicator Method #1: Wage match through Unemployment Insurance Wage Records Method #2: Wage match through State Wage Interchange System Method #3: Supplemental Data Wages detected in wage record (Method 1 or 2) Wages not detected requires supplemental data (Method 3) 40

41 Determining Enrolled in Education 4th Quarter After Exit Back to Indicator Manage follow-ups Follow Up Status What counts? Secondary Education, Post Secondary Education Occupational Skills Training 41

42 Adult, Dislocated Worker, Youth Median Earnings Median earnings of program participants who were in unsubsidized employment during the 2nd full quarter after exit. Specifications Fund Stream = Adult, Dislocated Worker Fund Stream = Adult, Dislocated Worker or Youth Participation Date = Not Blank Exit Date = In the Reporting Period Wages Exclusions = None Earnings 2 nd Quarter After Exit = 0 > or < Acceptable Wage Sources Select the middle number of the series of average of the middle two numbers. 42 $7,000 $6,500 $4,000 $3,500 $2,000 $1,000 $3,750

43 Adult/Dislocated Worker Fund Source/Participation Date Back to Indicator Manage Services Adult Funding Stream Participation Date Manage Services Dislocated Worker 43

44 Youth Fund Source/Participation Date Back to Indicator Manage Services Funding Stream Participation Date 44

45 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Manage Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 45

46 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) None - Blank 46

47 Reporting Earnings Method #1: Wage match through Unemployment Insurance Wage Records Method #2: Wage match through State Wage Interchange System Method #3: Supplemental Data Back to Indicator Supplemental Data Status: Not Necessary. This reveals there are wages in the wage record from either Wisconsin UI or the SWIS for the participant. The system will use those wages as the input to the PIRL. Wages from the wage record are not displayed in ASSET. In this example the Supplemental Data Status is Necessary. The Total Wages Paid in Quarter from Supplemental Employment entered here will be reported on the PIRL. 47

48 Wage Supplemental Data Back to Indicator Allowable Sources Multiple wages from different jobs may be added. Acceptable documentation sources: IRS Form 941 Participant s W-2 form Pay Check Stub (minimum 2 pay periods) IRS Form 1099 IRS Form 1040 IRS Form 1099-B Signed letter from employer verifying participant was employed Wisconsin Form PRA-012 IRS 2099 IRS Form 1040 Wisconsin Form EX-012 Wisconsin Form S-220a Participant Self-Reported income Participant Self-Reported commission/sales Detailed case notes verified by the employer, signed by the career planner Automated system matching with other partners who collect wage data Self-Employment worksheets signed and attested to by program participants *For self-employed IRS 1040 must be accompanies by schedule C. 48

49 Supplemental Data Practices Remind participants, before program exit, they or their employers may be contacted to obtain confirmation of employment status and earnings, and to explain the expected timeframe for those follow-up contacts. The table below explains when collection of supplemental information may begin. Performance Indicator UI Wage Data Becomes Available Collection of Supplemental Data Information May Begin Q2 Unsubsidized Employment/ Median Earnings During 3 rd or 4 th Qtr after exit Beginning 3 rd Qtr after exit. Q4 Unsubsidized Employment During 5 th or 6 th Qtr after exit Beginning 5 th Qtr after exit Credential Attainment During 2 nd or 3 rd Qtr after exit Beginning 2 nd Qtr after exit 49

50 Deadlines for Timely Collection of Supplemental Data Exit Qtr. Report Q2 Unsubsidized Employment/Median Earnings Report Q4 Unsubsidized Employment Report Credential Attainment Rate First Quarter (Q1) July 1- September 30 Q1, Next program Year (Four Quarters Later) Q3, Next Program Year, (Six Quarters Later) Q3, Next Program Year (Six Quarters Later) Second Quarter (Q2) October 1 December 31 Q2, Next program Year (Four Quarters Later) Q4, Next Program Year, (Six Quarters Later) Q4, Next Program Year (Six Quarters Later) Third Quarter (Q3) January 1 March 31 Q3, Next Program Year (Four Quarters Later) Q1, Second Program Year After Exit (Six Quarters Later) Q1, Second program Year After Exit (Six Quarters Later) Fourth Quarter (Q4) April 1-June 30 Q4, Next Program Year (Four Quarters Later) Q2, Second Program Year After Exit (Six Quarters Later) Q2, Second program Year After Exit (Six Quarters Later) The timeframes when employment related information must be reported. 50

51 Adult, Dislocated Worker, Youth Credential Attainment Rate Percentage of program participants who obtain a recognized postsecondary credential, or a secondary school diploma or its recognized equivalent during participation in or within 1 year after exit from the program. Secondary School Diploma/Equivalent Diploma: Counts only if the participant is employed or enrolled in a training program leading to a recognized postsecondary credential within 1 year after exit from the program. Adult/Dislocated Worker Specifications Youth Specifications Numerator Fund Stream = Adult, Dislocated Worker Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Who s in CAR? Numerator Fund Stream = Youth Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Who s in CAR? Denominator What counts in CAR? Denominator What counts in CAR? 51

52 Adult/Dislocated Worker Fund Source/Participation Date Back to Indicator Manage Services Adult Funding Stream Participation Date Manage Services Dislocated Worker 52

53 Youth Fund Source/Participation Date Back to Indicator Manage Services Funding Stream Participation Date 53

54 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Mange Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 54

55 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) 55 None - Blank

56 Who s in CAR? Back to Indicator Adult/Dislocated Worker Training Types 02 - Skill Upgrading 03 Entrepreneurial Training 04 ABE or ESL 06 Other Occupational Skills Training 07 Remedial Training (TAA) 08 Prerequisite Training 09 Registered Apprenticeship Training 10 Youth Occupational Skills Training All training except OJT and Customized Training fits into these categories. See the Services Section for specific training services. 56 Training Types Youth Program Occupational Skills Training Education Types Secondary Education Post-Secondary Education Adult Basic Education Job Corps YouthBuild Education triggers entry into the Credential Attainment Rate regardless of fund source. See Services Section for the services that trigger entry into the CAR.

57 Report Credentials Back to Indicator Manage Follow-ups Follow-up Credentials Dates are critical as the credential must be earned within 365 days after exit. 57

58 What counts in CAR? Scenario #1: Attending Post Secondary Education Back to Indicator Credential is Associates Degree, Bachelor s Degree, Master s Degree/Equivalent, Doctorate Degree/Equivalent, Occupational Skills Licensure, Occupational Skills Certificate, Occupational Certification, Other Recognized Diploma, Degree, or Certificate Date Attained Recognized Credential is less than 365 days after exit. Scenario #2: Attending Secondary Education Credential is High School Diploma or GED or Equivalent. Date Enrolled in Post Exit Education or Training is Less than 365 days after exit Or Employed during Q1 after exit = Yes, Military, Registered Apprenticeship or Employed during Q2 after exit = Yes, Military, Registered Apprenticeship or Employed during Q3 after exit = Yes, Military, Registered Apprenticeship or Employed during Q4 after exit = Yes, Military, Registered Apprenticeship 58

59 Credential Resources License Lookup 59

60 Wisconsin License Look-up 60

61 Certification Finder 61

62 National Student Clearinghouse An automated method of collecting credential and enrollment data. Wisconsin DWD acquired an annual subscription on 5/3/17 to verify credential and enrollment data to satisfy performance outcomes. The process of matching against these automated records is conducted by DWD for participations with out documented credentials. 62

63 Adult, Dislocated Worker, Youth Measurable Skill Gain Percentage of program participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains toward such a credential or employment. Adult/Dislocated Worker Specifications Denominator Fund Stream = Adult, Dislocated Worker Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Who s in MSG? Youth Specifications Denominator Fund Stream = Youth Participation Date = Not Blank Exit Date = In the Reporting Period Exclusions = None Who s in MSG? Numerator What counts as MSG? Numerator What counts as MSG? 63

64 Adult/Dislocated Worker Fund Source/Participation Date Back to Indicator Manage Services Adult Funding Stream Participation Date Manage Services Dislocated Worker 64

65 Youth Fund Source/Participation Date Back to Indicator Manage Services Funding Stream Participation Date 65

66 Exit Date Manage Exits Select an Exit The Exit Date Must be within the Reporting Period Back to Indicator Manage Services Exits can be generated by closing all active services. Enter a valid close date in the Actual Service Date. 66

67 Exclusions Manage Exits Select an Exit Back to Indicator Title 1 Authorized Exclusions Institutionalized Health/Medical Deceased Reserve Forces called to Active Duty Foster Care (Youth Only) None - Blank 67

68 Who s in MSG? Back to Indicator Adult/Dislocated Worker Youth Program Training Types Receive any training service Occupational Skills Training Education Types Secondary Education Post-Secondary Education Adult Basic Education Job Corps YouthBuild Education triggers entry into the Credential Attainment Rate regardless of fund source. 68

69 Who s out of the MSG? Adult and Dislocated Worker Participants who do not receive training/education services in a PY. Out of School Youth who do not receive training/education in a PY. Specifically: Occupational Skills Training Job Corps Youth Build Title II Adult Education Enrolled in Post Secondary Education Enrolled in Secondary Education Back to Indicator In School Youth: The Date completed or Withdrew from Educational program field must be entered to take a participant out of the MSG in future PY. For Out of School Youth, Adults and Dislocated Workers: All Training/Youth Services that enter participants into the MSG must be closed. In the example, the service is closed in PY 16. If there are no further training services in PY 17, the participant will not be in PY 17 MSG. 69

70 What counts as MSG? Back to Indicator 1. Documented achievement of at least 1 educational functioning level of a participant who is receiving instruction below the post secondary level. 2. Documented attainment of a secondary school diploma or recognized equivalent. 3. Secondary or postsecondary transcript or report card for a sufficient number of credit hours that shows a participant is meeting the State unit s academic standards 4. Satisfactory or better progress report, towards established milestones, such as completion of OJT or completion of 1 year of an apprenticeship program or similar milestones from an employer or training provider who is providing training. 5. Successful passage of an exam that is required for a particular occupation or progress in attaining technical or occupational skills as evidenced by trade-related benchmarks such as knowledge-based exams. 70

71 A few rules about MSGs Back to Indicator A MSG may be made during any program year where training or education is 1 day or greater in length. Regardless if training/education was completed or not Regardless of when the participant begins training or is enrolled in education Exclusions only applies to the year the participant exited 71

72 Back to Indicator Measurable Skills Gain Method #1 EFL Gain 72

73 MSG Method #1 Back to Method There are 3 ways to make a Method #1 (EFL Gain) measurable skill gain. Documented achievement of at least 1 educational functioning level of a participant who is receiving instruction below the post secondary level. Who may make MSG Method #1 Gain? Participants in education/training below the post-secondary level. How can MSG Method #1 be made? 1a. EFL Gain: Compare a pre-test EFL with a post test EFL 1b. Exit from the program and enroll in post-secondary education during the PY 73

74 1a. EFL Gain Allowable Assessments Back to Method Adult Basic Education (ABE)/Adult Secondary Education (ASE) Comprehensive Adult Student Assessment System (CASAS) Life Skills Math Assessments Comprehensive Adult Student Assessment System (CASAS) Life Skills Reading Assessments Massachusetts Adult Proficiency Test (MAPT) for Math Massachusetts Adult Proficiency Test (MAPT) for Reading Test of Adult Basic Education (TABE 9/10) Math Test of Adult Basic Education (TABE 9/10) Language Test of Adult Basic Education (TABE 9/10) Reading General Assessment of Instructional Needs Test of English Skills (GAIN) General Assessment of Instructional Needs Test of Math Skills (GAIN) English as a Second Language (ESL) Basic English Skills Test (BEST) Literacy Reading Basic English Skills Test (BEST) Literacy Writing Tests of Adult Basic Education Complete Language Assessment System (TABE/CLAS-E) Reading and Writing Tests of Adult Basic Education Complete Language Assessment System (TABE/CLAS-E) Listening and Speaking Basic English Skills Test (BEST) Plus 2.0 Listening and Speaking Comprehensive Adult Student Assessment Systems (CASAS) Life and Work Listening Assessments (LW Listening) Comprehensive Adult Student Assessment Systems (CASAS) Life and Work Listening Assessments (Reading) 74

75 1a. EFL Gain Pre-Test Back to Method Select Assessment and Functional Area A participant can do one or two functional areas Just need to make a gain in one. 75

76 1a. Post-Test Year 1 Back to Method Notice: Test Due date is the last day of the Program Year EFL gains continue each PY until the participant exits or does not attend training/ education in a PY. 76

77 EFL Gain 1b. Exit to Post Secondary Education Back to Method Manage Follow-Up - Follow Up Status After selecting Yes, a date field will appear. A date must be entered to determine if the gain was made in the reporting period. 77

78 Back to Indicator Measurable Skills Gain Method #2 Attainment of Secondary Diploma or Equivalent 78

79 MSG Method #2 Back to Method Who may make MSG Method #2 Gain? Participants in Secondary Education with Highest Education Level Completed = No Education Level Completed (Less than Secondary Diploma or Equivalency) How can MSG Method #2 be made? Attain Secondary School Diploma or equivalent within the PY. 79

80 Attain Secondary School Diploma Back to Method Highest School Grade Completed is less than Secondary School diploma or equivalent. Manage Follow-Up - Follow Up Credentials One of the credentials entered must be a High School Diploma or GED or Equivalent. 80

81 Back to Indicator Measurable Skill Gain Method #3 Secondary/ Postsecondary Transcript 81

82 MSG Method #3 Back to Method Who may make MSG Method #3 Gain? Any WIOA Participant who received training or education can make a gain Hint: The participant must be in a credit bearing institution. How can MSG Method #3 be made? Secondary Education: Pass all classes in one semester within the program year. Post-Secondary Education: Full-time students earn 12 credits in one semester Part-time students earn 12 credits over the course of two consecutive semesters Note: All participants in education may make this gain. Transcripts/report cards must not indicate that the participant dropped out of school, was removed from the institution, or otherwise indicate removal on academic or conduct grounds. 82

83 3a. Report Card/Transcript Post Secondary Back to Method Manage Assessment Measurable Skill Gains Enter the end date the last term the Post-secondary Education Transcript/Report Card covered. 83

84 3b. Report Card/Transcript Secondary Back to Method Manage Assessment Measurable Skill Gains Enter the end date the last term the Secondary Education Transcript/Report Card covered. 84

85 Back to Indicator Measurable Skill Gain Method #4 Training Milestone via Progress Report 85

86 MSG Method #4 Back to Method Who may make MSG Method #4 Gain? Any WIOA Participant who received training or education can make a gain from skills progression via progress report. How can MSG Method #4 be made? Provide documentation of a satisfactory or better progress report towards established milestones from an employer/training provider who is providing training. There are many progress reports that can demonstrate a measurable skill gain. The graphic on the next slide is designed to assist in determining if the progress report meets the criteria. 86

87 Measurable Skill Gain Method #4 Checklist Is it a progress report? Is there documented substantive skill development achieved by the participant? Individual mastery or improvement of job skills. Steps to complete an OJT or apprenticeship program. Increases in pay from acquired skills. (Did the participant get a raise?) Individual's performance is documented to be improved. Other documented substantive skill achievements On a progress report with specific skill ratings did at least one skill improve/satisfactory? If multiple skills are on the report card, identify any single skill that was improved. Yes/No Yes/No Back to Method If all boxes are answered "Yes" enter the date the progress report was issued into ASSET. Retain a copy of the progress report in the participant file. 87

88 4. Training Milestone Back to Method Manage Assessment Measurable Skill Gains Enter the date the progress report was issued. 88

89 Back to Indicator Measurable Skill Gain Method #5 Skills Progression through Exams 89

90 MSG Method #5 Skills Progression Back to Method Who may make MSG Method #5 gain? Any WIOA Participant who received training or education can make a gain from knowledge based exam. How can MSG Method #5 be made? Provide documentation of an exam that is required for a particular occupation, or progress in attaining technical or occupational skills as evidenced by traderelated benchmarks such as a knowledge based exam. 90

91 Measurable Skill Gain Method #5 Checklist 1. It is an objective test or assessment done by an evaluator on an evaluation, with pass/fail benchmarks. Yes/No 2. Is the exam/test/assessment required for entry or advancement in a particular occupation? (If the person does not complete the exam, are they qualified/ allowed to have the job) OR Yes/No 2. Is the exam/test/assessment required for completion of a WIOA credential? If all answers are "Yes", enter the date the exam was passed in ASSET. Retain a copy of the exam, score sheet or letter indicating the exam was completed in the participant file. 91

92 5. Exam (Skills Progression) Back to Method Manage Assessment Measurable Skill Gains Add Measurable Skill Gain Enter the date the examination was taken and passed. 92

93 Effectiveness in Serving Employers WIOA introduces a new indicator of performance designed to measure the workforce system s effectiveness at serving employers. The Departments of Labor and Education are piloting three methods. States have the option to select two of three methods to measure the effectiveness in serving employers. During PY 2016 and PY 2017 states are only required to submit the report in the annual report. Wisconsin selected two methods: Employer Penetration Rate Repeat Business Customers 93

94 Employer Penetration Rate Back to Indicator The total number of establishments, as defined by the Bureau of Labor Statistics Quarterly Census of Earnings and Wages program, that received a service or, if it is an ongoing activity, are continuing to receive a service or other assistance during the reporting period. Divided by The total number of establishments, as defined by the Bureau of Labor Statistics Quarterly Census of Earnings and Wages program, located within the State during the final month or quarter of the reporting period. 94

95 Repeat Use of Services Back to Indicator The total number of establishments, as defined by the Bureau of Labor Statistics Quarterly Census of Earnings and Wages program, that received a service or, if it is an ongoing activity, are continuing to receive a service or other assistance during the reporting period (E1), AND who utilized a service anytime within the previous three years (E4). Divided by The number of unique business customers (establishments - as defined by the Bureau of Labor Statistics Quarterly Census of Earnings and Wages program) who have received a service previously in the last three years. 95

96 What s an Establishment? Back to Indicator An establishment is an economic unit, such as a farm, mine, factory, store, etc. that produces goods or provides services. It is usually at a single physical location and engaged in one or predominantly one type of economic activity for which a single industry code is applicable. Where a single physical location encompasses two or more distinct and separate economic activities for which different industry codes seem applicable, such activities should be treated as separate establishments and classified in separate industries, provided it is determined that: 1. No one industry description in the NAICS system includes such combined activities; 2. The employment in each such economic activity is significant; 3. Such activities are not ordinarily associated with one another at common physical locations; and 4. Separate reports can be prepared on the number of employees, their wages and salaries, and other establishment-type data for each of the activities. In the government sector, the term "installation" generally is used instead of establishment. An employer who has more than one establishment reporting under the same UI Account Number within the State and has a total employment of 10 or more in all of the secondary establishments combined is considered a multi-establishment employer to be disaggregated. For additional information see: 96

97 What s a Business Service? Back to Indicator Business Services Employer Information and Support Services Workforce Recruitment Assistance Engaged in Strategic Planning/Economic Dev. Accessing Untapped Labor Pools Training Services Incumbent Worker Training Services Rapid Response/Business Downsizing Assistance Planning Layoff Response System of Record JCW Business JCW Business JCW Business JCW Business JCW Business JCW Business RRETS RRETS 97

98 Entering Business Services Back to Indicator Access JCW Business: 98

99 Add a Business Service Select Staff Action Management 2. Select Manage Services 3. Search for a business. 4. Select a business

100 Add a Business Service Select Add Service 100

101 Add a Business Service Select a Service Category. 101

102 Add a Service Select a Service. 102

103 Service Screen 1. Open: Enter Planned Service Date Enter Actual Service Date 2. Closed: Enter Planned Service Date Enter Actual Service Date 4 3. Comments: Enter Comments describing the service. 4. Click on Save

104 Adding Multiple Services to Multiple Employers Select the businesses 2. Click on Move Site to Selected List 3. Click on Add Service to Selected Sites 104 3

105 Incumbent Worker Reporting Incumbent Workers may not be WIOA program participants. Individuals in incumbent worker programs must be reported in ASSET. The procedure for reporting incumbent worker services is in this TAG. The minimum information is outlined in TEGL Attachment 8. Wisconsin requests the minimum information to create an ASSET record on the Manage Customers screen. 105

106 Incumbent Worker Individual Recording Back to IWT Reporting 1. Select Incumbent Worker 2. Complete The General Program Summary Page and click save. 106

107 Incumbent Worker Training Back to IWT Reporting 3. Select Manage Services 4. Select the Participant 5. Select Add Service 6. Select Incumbent Worker Training 107

108 Incumbent Worker Training Back to IWT Reporting 7. Enter the Incumbent Worker Training Service 8. Enter the Planned and Actual Service Dates for Open services 9. Enter the Planned Close Service Date. 10. Enter the funding source 11. Enter the Incumbent Worker s Job Title, ONET Code, businesses NAICS code and training schedule type. 12. Click Save. 13. When the service is complete, enter the Close: Actual Service Date 108

109 Statistical Adjustment Model Adult/Dislocated Worker Adult/Dislocated Worker Youth WIOA requires an objective statistical adjustment model (SAM) that considers the characteristics of the participants served and economic conditions used to assist in the setting of negotiated levels of performance and to adjust the level of performance at the end of the program year. The SAM is comprised of a number of explanatory variables that dictate the performance expectation of the state or local area. Each variable is assigned a coefficient developed from statistical norming of a national population. The coefficient is multiplied by the value of the explanatory variable and summed. The sum of the explanatory variables is added to the State s Fixed Effect to provide the Predicted Outcome. The sum of the explanatory variables is added to the Average State Effect to provide the Target Outcome. The Negotiated Level generally is between the Target Outcome and the Predicted Outcome. This TAG will only provide detail on reporting the explanatory variables that relate to participants. 109

110 Adult/Dislocated Worker Youth Gender Age (Date of Birth) Race/Ethnicity Highest Grade Completed Employed at Participation Individual with Disability Veteran Employment/Earnings Previous Quarters (Reported from UI) Wagner Peyser Services Limited English Proficiency Single Parent Low Income TANF Recipient Other Public Assistance Recipient Homeless Offender UI Claimant, non-exhaustee UI exhaustee Established ITA Pell Grant Recipient Pre-vocational activity services 110

111 Youth Program A/DW Gender Age Race/Ethnicity Highest Grade Completed Employed at Participation Individual with Disability Wagner Peyser Services Limited English Proficiency Low Income TANF Recipient Other Public Assistance Recipient Homeless Offender UI Claimant, non-exhaustee UI exhaustee Pregnant/Parenting Needs Additional Assistance Pell Grant Recipient 111

112 Gender, Date of Birth Back to SAM Manage Customers- Contact Details 112

113 Race, Ethnicity, LEP, Disability Back to SAM Manage Customers Demographics Tab 113

114 Veteran Status Back to SAM Manage Customers Military Service 114

115 Highest Grade Completed, Employed at Participation Back to SAM Manage Customers Case Management Info. 115

116 UI Exhaustee Back to SAM Manage Programs General Program Summary 116

117 Establish ITA Manage Employability Plan Add ITA Back to SAM 117

118 Single Parent, Pell Grant Back to SAM Manage Programs Title I 118

119 Low Income (AD,DW Programs) Back to SAM Adult Income Prev. 6 Month = LLSIL, FPL Case Public Assistance = Yes Food Share =Last 6 Months SSI, SSDI = SSI or SSDI or both General Assistance = Yes Refugee Cash Assistance=Yes Homeless= Yes 119 Dislocated Worker Income Prev. 6 Month = LLSIL, FPL Case Public Assistance = Yes Food Share =Last 6 Months SSI, SSDI = SSI or SSDI or both Homeless= Yes

120 Other Public Assistance, Homeless, Offender, TANF Manage Programs Dislocated Worker Adult Back to SAM 120

121 Other Public Assistance, Homeless, Offender, TANF, Needs Additional Assistance, Low Income Manage Programs Youth Back to SAM 121

122 Wagner-Peyser Services Back to SAM Manage Services - Service The WP service and entry in the Actual Service Date are required to trigger WP. 122

123 Pre-Vocational Services Back to SAM Manage Services - Service The Prevocational Service must have an entry in the Actual Service Date are required to trigger Prevocational Services. 123

124 Performance Scenarios Common Questions 124

125 Scenario #1 The Scenario? Adult Program Eligibility Determination is made 4/21/17. First Adult Program service is provided 5/4/17. Participant received career counseling and job placement assistance Last service (job referral) is provided 11/18/17. No further services are provided for the next 90 days No further services were planned beyond 11/18/17. Participants gets a job on 9/15/17. What is? Date of Participation? The date of exit? Exit Quarter? 125

126 Scenario #1 Answer PY 16 PY 17 APR MAY JUN JUL AUG SEP OCT NOV DEC JAN FEB MAR APR MAY JUN Exit Quarter 1 st Quarter After Exit 2 nd Quarter After Exit 4/21/17 Eligibility Determination 5/4/17 First Service 11/18/17 Last Service ends What is? Date of Participation? 5/4/17 The date of exit? 11/18/17 Exit Quarter? OCT 17-Dec

127 Scenario #2 The Scenario? Participant exits 3/1/2017 Participant is employed 8/15/2017 Participant is dislocated 9/29/2017 Participant enrolls in Dislocated Worker Program 10/1/2017. Is? The participant included in Q2 Employed after Exit measure? Is the participant a positive outcome (numerator)? 127

128 Scenario #2 Answer PY 16 PY 17 JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC JAN FEB APR Exit Quarter 1 st Quarter After Exit 2 nd Quarter After Exit 3 rd Quarter After Exit 4 th Quarter After Exit 3/1/17; Exit 8/15/17; Employed Is? The participant included in Q2 Employed after Exit measure? Is the participant a positive outcome (numerator)? Yes Yes The participant is employed during the 2nd Quarter After Exit. The participant only needs to be employed for 1 day or register more than $.01 in wages. 128

129 Scenario #3 The Scenario? Participant exits 3/1/2017 Participant is employed 8/15/2017 Participant is dislocated on 12/15/2017 and was never found in wage records afterward. When? When is the participant s 4 th quarter after exit? Is? The participant a successful outcome? 129

130 Scenario #3 Answer PY 17 PY 18 JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC JAN FEB MAR Exit Quarter 1 st Quarter After Exit 2 nd Quarter After Exit 3 rd Quarter After Exit 4 th Quarter After Exit 3/1/18; Exit 8/15/18; Employed 12/15/18; No longer employed When? is the participant s 4 th quarter after exit? Quarter beginning January 2019 ending March 2019 Is? The participant a successful outcome? No 130

131 Scenario #4 The Scenario? Participant enrolls in education on 6/20/17 Participant makes EFL Gain on 10/5/17 Participant graduates with secondary school diploma from education on 5/25/19. One continuous period of education. When? Is the participant included in MSG indicator? Which years? Does the participant qualify for the numerator? 131

132 Scenario #4 Answer 6/20/17 Enrolled in Sec. Ed. 10/5/17 EFL Gain 5/25/2019 Graduate with Sec. School Diploma 7/1/17 7/1/18 When? Is the participant included in MSG indicator? PY 16, PY 17, PY 18 Which years? Does the participant qualify for the numerator? PY 17 (EFL Gain), PY 18 (Diploma) 132

133 Scenario #5 The Scenario? Participant enters On-the-Job Training on 7/20/17. Participant is not hired by the employer and on 9/1/17 enters occupational classroom training. The participant exits on 12/31/17 and does not receive a credential by 12/31/18. When? Is the participant included in Credential Attainment Rate Indicator? Does? The participant qualify for the numerator? 133

134 Scenario #5 Answer 7/20/17 OJT Begins 8/15/17 Ends OJT 9/1/17 Begins Occupational Skills Training 12/31/17 Exits Training and the program 12/31/18 Did not receive a credential When? Is the participant included in Credential Attainment Rate Indicator? Yes, Occupational Skills Training on 9/1/17. Does? The participant qualify for the numerator? No 134

135 Service Behavior ASSET Services JCW Business Services The intent of this section is to show how the services effect performance. For complete definitions of the services; log into the system. 135

136 Service Behavior Adult and Dislocated Worker Program Basic Career Self-Services: Does not trigger nor extends participation Basic Career Staff Assisted Services: Triggers participation* Individualized Career Services: Triggers Participation Support Services: Does not trigger nor extend participation Training Services: Triggers participation, triggers entry into Credential Attainment Rate** and Measurable Skill Gain Rate * Some exceptions (Eligibility Determination) ** Exceptions: On-the-Job Training and Customized Training do not trigger entry into the Credential Attainment Rate. 136

137 Service Behavior Youth Program Objective Assessment, Individual Service Strategy and Eligibility Screening: Do not trigger nor extend participation. Program Elements: Trigger participation Program elements that are specified as training/education. Trigger participation and entry into the Credential Attainment Rate and Measurable Skill Gain Rate. Partner Program Services (YouthBuild, Job Corps, Title II Adult Education, Non-WIOA Secondary Education and Non-WIOA Postsecondary Education) Trigger entry into the Credential Attainment Rate and Measurable Skill Gain. These services do not trigger nor extend WIOA program participation. 137

138 Service Behavior Adult and Dislocated Worker Basic Career Self/Info Only Basic Career Staff Assisted Individualized Career Services Supportive Services Training Services Partner Programs/Other Services Youth Program Youth Services and Program Elements 138

139 Service Behavior Basic Career Self/Info Only Service Type Participation Info on Career Counseling Services Basic Career-Self/Info Only N Info on Demand Occupations Basic Career-Self/Info Only N Info on Assessment Services Basic Career-Self/Info Only N Job Center Info. Basic Career-Self/Info Only N Job Search Info. Basic Career-Self/Info Only N Job Skill Needs Info. Basic Career-Self/Info Only N Online Self-Services and Informational Activities Basic Career-Self/Info Only N Labor Market Information Basic Career-Self/Info Only N Local Area Performance Basic Career-Self/Info Only N Program Performance and Cost Basic Career-Self/Info Only N Support Services Information Basic Career-Self/Info Only N Unemployment Insurance Info. Basic Career-Self/Info Only N 139

140 Service Behavior Basic Career Self/Info Only Service Participation Service Participation Info on Vocational Guidance Services N Referred to Federal Training N Info on UI Profiled Job Seekers N Referred for Non-WIOA support services at a Partner Agency N Veteran Priority of Service Information on Training N N Referred to VR & E Programs Referred to Other WIOA Program or Program Area N N Financial Aid Information Online RES Orientation Self-Service N N Referred to Other Non-WIOA Program Customer Specific LMI Referral to Online Job Boards N N N Online RES Assessment Self-Service N One-Stop Orientation N Online Workshop-Networking N Referred to Other Federal/State Assistance N Online Workshop-Resume & Job Application N Referred to DVOP Specialist N Online Workshop Interviewing N Referred to VA Services N Online Workshop Your Workplace Skill N Referral to Training N Online Workshop Job Searching with Technology N Online Workshop Resume Job Application N 140