Measuring Effectiveness

Transcription

1 Measuring Effectiveness 14 th Annual Federal Programs Conference June 22-23, 2016 Workshop Sharon Brown Program Specialist Greg Petersen Program Specialist

2 Avis King Deputy Superintendent Office of School Improvement Cindy Saxon Associate Superintendent Teacher and Leader Effectiveness Division Julie Noland Program Manager Teacher and Leader Effectiveness Division

3 Map and Specialists Map Specialists Carly Ambler Julie Noland Program Manager Division of Teacher and Leader Effectiveness Saralyn Barkley Sharon Brown Pam Daniels Greg Petersen Terri Still Elizabeth Zipperer

4 Effectiveness

5 Session Description Measuring the Effectiveness of Funded Activities: GaDOE Specialists will lead participants through a process for documenting effectiveness. Specific examples will be given for commonly funded activities, like funding staff, professional learning opportunities and recruitment/ retention initiatives. Participants will be encouraged to share their successes and challenges in measuring effectiveness of funded activities.

6 Effectiveness In compliance with Federal expectations and those of the program, the DOE requires local education agencies to submit an annual LEA Effectiveness Plan. The LEA needs assessment and resulting CLIP and equity action plan will guide the LEA s development of the Budget and the corresponding Effectiveness Plan.

7 Essential Question Did the strategies funded by Title II, Part A effectively meet the needs of the LEA? NEEDS ASSESSMENT LEA EQUITY ACTION PLAN CONSOLIDATED LEA IMPROVEMENT PLAN (CLIP) TITLE II, PART A BUDGET & COORDINATION OF FUNDS DETERMINING EFFECTIVENESS OF FUNDED STRATEGIES

8 TITLE II, PART A COMPONENTS STUDENT ACHIEVEMENT PROFESSIONAL LEARNING PERSONNEL FACTORS THAT IMPACT THE LEARNING AND WORK ENVIRONMENTS TITLE II, PART A ADMINISTRATION STUDENT SUPPORT & INTERVENTIONS TEACHER DEVELOPMENT LEADER DEVELOPMENT PROFESSIONAL GROWTH RECRUITMENT RETENTION EFFECTIVENESS CLIMATE SUPPORT PROGRAMS & INTERVENTIONS PRIORITIZING FUNDS NEEDS ASSESSMENT/ CONSULTATION INTERNAL CONTROLS

9 Reauthorizing NCLB as ESSA Components No Child Left Behind Every Student Succeeds Act Recruitment Retention Equity of: Teacher Quality & Experience Class Size Meeting Diverse Student Needs Professional Learning Highly Qualified Staff Administration Personnel Factors that Impact the Learning and Work Environment Professional Learning Title I: Professional Qualifications

10 Effectiveness The plan must include the following: Component & Equity Intervention Need(s) being addressed Specific funded activity Data to be collected Position of the person responsible for collecting the data and coordinating the review and analysis of the data Timeline for collecting data and completing the review and analysis of the data

11 Effectiveness Funded Component(s) & Equity Interventions Personnel: Retention Personnel: Effectiveness Factors that Impact the Learning & Working Env.: Support Programs and Interventions Program Administration: Needs Assessment Prioritized Needs Being Addressed Retain New Teachers & Leaders Support Teachers with Low Ratings Improve 1 st Grade Scores Involve More Required Stakeholders Funded Strategies Selected to Address Prioritized Needs Mentor Stipends Teacher Development Specialists Grade 1 CSR Pay for Advertising, Online Surveys, Calling Tree Data to be Collected to Measure and Monitor Effectiveness of Funded Strategies Attrition Rate, Mentee Feedback, Mentor Feedback Teacher Feedback, Supervisor Obs., Student Growth Data, TKES Data 1 st Grade Student Achievement Data # of Participants using Sign In Sheets, # of Surveys Completed, Advertising Statistics (Site hits, Call Completion, Circulation) Person(s) Responsible for Collecting Coordinating and Analyzing Data HR Director PL Coordinator Title IIA Coord. HR Director PL Coordinator School Principals Title IIA Coord. Principal Title IIA Coord. Title IIA Coord. Timeline for Collecting Coordinating and Analyzing Data Bi Annually Bi Annually June Spring

12 Monitoring and Measuring Effectiveness Program Components(s) Being Funded Needs Being Addressed Funded Activity Data to be Collected Person Responsible for Collecting, Coordinating and Analyzing Data Timeline for Collecting Coordinating and Analyzing Data Recruitment Retention Funded Component(s) & Equity Interventions Prioritized Needs Being Addressed Funded Strategies Selected to Address Prioritized Needs Data to be Collected to Measure and Monitor Effectiveness of Funded Strategies Person(s) Responsible for Collecting Coordinating and Analyzing Data Timeline for Collecting Coordinating and Analyzing Data HiQ Professional Learning Professional Learning Equity Personnel Factors that Impact the Learning and Working Environment Program Administration

13 Program Component Professional Learning: Student Supports and Interventions Teacher Development Leader Development Professional Growth Personnel: Recruitment Retention Effectiveness Factors that Impact the Learning and Work Environment: Climate Support Programs and Interventions Administration Prioritizing Funds Needs Assessment/ Consultation Internal Controls Measuring Effectiveness

14 Effectiveness Guiding Questions Have you distinguished between documentation that shows implementation versus documentation that shows effectiveness? Sample Question: Which documentation measures effectiveness of PL, sign in sheets and PPTs or post PL observation data and lesson plan review? Answer: post PL observation data and lesson plan review When deciding who will be responsible for collecting data and reviewing data, have you discussed what will need to be done by the identified internal stakeholders? Sample Questions: How might the Coordinator work with the PL Coordinator to document the effectiveness of the PL being funded or with HR to gather data to determine the effectiveness of retention activities? When considering the timeline for data collection and review will the collection be ongoing or can it be gathered at a fixed point in time? While many activities take several years to view the full impact, have you identified something that can be examined in the current grant year?

15 Monitoring Implementation Documenting Effectiveness Using the LEA Effectiveness Plan, Budget, and Actual Expenditures determine the effectiveness of funded activities. Sample: Description of Expenditure with Intended and Actual Outcome and Next Steps with Supporting Data Sample form provided courtesy of Carrollton City.

16 Effectiveness Funded Component(s) & Equity Interventions Prof. Learn.: Student Intervention & Supp. Prog. Prof. Learn.: Teacher/ Leader Development Prof. Learn.: Professional Growth Personnel: Recruitment Prioritized Needs Being Addressed Increase Literacy across Content Areas Increase use of Differentiation Build a Pool Internal Leaders Develop Recruitment Pipeline for High Needs Areas Funded Strategies Selected to Address Prioritized Needs Reading Endorsement Edivation, Consultant Leadership Academy Partners with IHE for Supporting Student Teachers Sample Plan Data to be Collected to Measure and Monitor Effectiveness of Funded Strategies Student Scores, Access Report, Observations, Teacher Qualifications TKES Reports, Focus Walks, Subgroup Data # of Participants Promoted & # of Leadership Vacancies, Leadership Attrition Placement # s, Teacher/ IHE Feedback, Person(s) Responsible for Collecting Coordinating and Analyzing Data HR Director Principals Curriculum Coord. Title IIA Coord. Title IIA Coord. Curriculum Coord. HR Director Superintendent HR Director IHE Coordinator School Principals Timeline for Collecting Coordinating and Analyzing Data Monthly, December, May October, December, March, May Bi Annually Ongoing Quarterly

17 Effectiveness Possible Documentation for Reading Endorsement Activity: List of teacher participants, syllabus, registration payments Effectiveness: Summary and analysis of student reading scores Possible Documentation for Edivation or PD360 Activity: Reports listing participants/modules taken Effectiveness: Summary and analysis of student achievement data Possible Documentation for Leadership Academy Activity: List of teacher participants, expenditures for Leadership Academy Effectiveness: Number of new principals who were academy participants Possible Documentation for Partnership with IHE Supporting Student Teachers Activity: GACE registration Effectiveness: Summary and analysis showing teachers gaining professional qualifications and new teachers hired

18 Effectiveness Funded Component(s) & Equity Interventions Personnel: Retention Personnel: Effectiveness Factors that Impact the Learning & Working Env.: Support Programs and Interventions Program Administration: Needs Assessment Prioritized Needs Being Addressed Retain New Teachers & Leaders Support Teachers with Low Ratings Improve 1 st Grade Scores Involve More Required Stakeholders Sample Plan Funded Strategies Selected to Address Prioritized Needs Mentor Stipends Teacher Development Specialists Grade 1 CSR Pay for Advertising, Online Surveys, Calling Tree Data to be Collected to Measure and Monitor Effectiveness of Funded Strategies Attrition Rate, Mentee Feedback, Mentor Feedback Teacher Feedback, Supervisor Obs., Student Growth Data, TKES Data 1 st Grade Student Achievement Data # of Participants using Sign In Sheets, # of Surveys Completed, Advertising Statistics (Site hits, Call Completion, Circulation) Person(s) Responsible for Collecting Coordinating and Analyzing Data HR Director PL Coordinator Title IIA Coord. HR Director PL Coordinator School Principals Title IIA Coord. Principal Title IIA Coord. Title IIA Coord. Timeline for Collecting Coordinating and Analyzing Data Bi Annually Bi Annually June Spring

19 Effectiveness Possible Documentation for Stipends Activity: List of mentors, payroll reports, mentor logs Effectiveness: Summary and analysis of retention data, mentor/mentee feedback Possible Documentation for Teacher Development Specialists Activity: Specialists schedules, Time and Effort docs Effectiveness: Summary and analysis of student achievement data Possible Documentation for CSR Teacher Activity: CSR worksheet, Periodic certification Effectiveness: Summary and analysis of student achievement data across grade level or in content Possible Documentation for Advertisement for Teachers Activity: Copy of the ad, expenditure report Effectiveness: Summary and analysis of hiring report

20 Questions

21 Measuring Effectiveness 14 th Annual Federal Programs Conference June 22-23, 2016 Workshop Sharon Brown Program Specialist Greg Petersen Program Specialist