THE BENEFITS OF DATA AND REPORTING

Transcription

1 THE BENEFITS OF DATA AND REPORTING A D I S C U S S I O N F O R H O W T E S T M A N A G E R S C A N U S E D A T A T O A C H I E V E T H E I R C E N T E R S G O A L S Rachel Hample Test Manager at Temple University Traci Taylor Test Coordinator at Temple University

2 BACKGROUND INFORMATION Temple University Philadelphia, PA 38,297 Enrolled as of Fall ,754 Undergraduate/9,543 Graduate or Professional Test Center Computer Based Testing: Castle, CLEP, HiSET, Kryterion, MAT, MCAT, NTN, Pearson VUE, Placement Testing, TOEFL Paper Based Testing: Accommodated Classroom Exams, ACT, GRE-Subject, HiSET, LSAT, MPRE, SAT 24,054 exams administered during the fiscal year full time staff, 2 part time staff, and up to 10 graduate/undergraduate student workers

3 WHY DO I NEED DATA AND REPORTING? If you re not using data to make decisions, you re flying blind Evidence 2. Communicates value to others 3. Encourages updating 4. Identifies strengths and weaknesses 5. Drives goals

4 GOALS FOR THIS PRESENTATION You will be able to: Describe types of reports test centers can develop Examine ways data and reporting can support your test center s vision, goals, and actions to achieve success. Develop your vision Set your goals Define ways to measure your goals Identify actions to achieve your goals

5 TEMPLE UNIVERSITY EXPERIENCE Test Center Business Plan Can we grow from a testing site to a Test Center?

6 TEMPLE UNIVERSITY EXPERIENCE Test Center Business Plan Can we grow from a testing site to a Test Center? Test Counts Reports Generated Reports Needed Test Counts Test Counts Historical Seat Usage Profit and Loss Statements Revenue Historical CBT Vs. PBT Tests Administered Profit and Loss Financial Forecast Evening Testing Profit and Loss Accommodated Classroom Exams Administered

7 TEST COUNTS

8 TEST COUNTS HISTORICAL Number of Distance Learning Tests Administered Historically Distance Learning

9 SEAT USAGE Percent of Seat Usage in CN 715 CBT Room - Fiscal Year 2016 Percent of Seat Time Used Average Seat Time Used Over The Year Jul-2015 Aug-2015 Sept-2015 Oct-2015 Nov-2015 Dec-2015 Jan-2016 Feb-2016 Mar-2016 Apr-2016 May-2016 Jun-2016

10 PROFIT AND LOSS STATEMENTS

11 REVENUE HISTORICAL Trend of Gross Revenue Historically July August September October November December January February March April May June

12 CBT VS. PBT TESTS ADMINISTERED Total Number of Computer Based vs. Paper and Pencil Based Tests Administered Computer Paper FY 10/11 FY 11/12 FY 12/13 FY 13/14 FY 14/15

13 PROFIT AND LOSS FINANCIAL FORECAST Financial Forecast for Test Center based upon Current Testing Facilities Historical Revenue Previously Generated Forecasted Revenue Generated Expon. (Historical Revenue Previously Generated)

14 EVENING PROFIT AND LOSS

15 Mon, 02/02/15 Tue, 02/03/15 Wed, 02/04/15 Thu, 02/05/15 Fri, 02/06/15 Mon, 02/09/15 Tue, 02/10/15 Wed, 02/11/15 Thu, 02/12/15 Fri, 02/13/15 Mon, 02/16/15 Tue, 02/17/15 Wed, 02/18/15 Thu, 02/19/15 Fri, 02/20/15 Mon, 02/23/15 Tue, 02/24/15 Wed, 02/25/15 Thu, 02/26/15 Fri, 02/27/15 Tue, 03/03/15 Fri, 03/06/15 Mon, 03/09/15 Tue, 03/10/15 Wed, 03/11/15 Thu, 03/12/15 Fri, 03/13/15 Mon, 03/16/15 Tue, 03/17/15 Wed, 03/18/15 Thu, 03/19/15 Fri, 03/20/15 Mon, 03/23/15 Tue, 03/24/15 Wed, 03/25/15 Thu, 03/26/15 Fri, 03/27/15 Mon, 03/30/15 Tue, 03/31/15 Wed, 04/01/15 Thu, 04/02/15 Fri, 04/03/15 Mon, 04/06/15 Tue, 04/07/15 Wed, 04/08/15 Thu, 04/09/15 Fri, 04/10/15 Mon, 04/13/15 Tue, 04/14/15 Wed, 04/15/15 Thu, 04/16/15 Fri, 04/17/15 Mon, 04/20/15 Tue, 04/21/15 Wed, 04/22/15 Number of Students ACCOMMODATED CLASSROOM EXAMS ADMINISTERED Scheduled DRS Exams Spring 2015 Exams Administered Exams Not Administered Average Number of Exams Scheduled

16

17 Total Number of Computer Based vs. Paper and Pencil Based Tests Administered Computer Paper FY 10/11 FY 11/12 FY 12/13 FY 13/14 FY 14/15

18 Cumulative Tests Administered by Month in Carnell Room Year Trend July August September October November December January February March April May June

19 Cumulative Accommodated Classroom Tests Administered by Month - 5 Year Trend July August September October November December January February March April May June

20 PROCESS OVERVIEW Vision Goal Measurements Actions

21 PART 1: DEVELOPING A VISION What is your vision for your test center? Where is your test center headed? What is your dream? What do you want your test center to be? Vision The vision I have for my test center is that I would like our center to be the biggest test center in the nation.

22 PART 2: SET GOALS What goals will help you reach your vision? Goal Increase number of tests administered in our facilities from 5,312 during FY 15/16 to 5,500 during FY 16/17.

23 PART 3: MEASURING GOALS How do you know you achieved your goals? 1. Pick the Right Metrics 2. Create a system of data collection and entry 3. Analyze and develop reports Measurements Test Counts Report

24 PICK THE RIGHT METRICS The question you are trying to answer Drives The metrics you need! How many tests do we administer? Drives Test Counts Metrics are what you measure!

25 PICK THE RIGHT METRICS The question you are trying to answer Drives The metrics you need! Is it profitable for us to administer this test? Drives Revenue Cost (staffing, materials, etc.) Volume Metrics are what you measure!

26 Rachel Hample Traci Taylor David Griffith 8:30 AM 1:00 PM 1:00 PM 5:00 PM Castle Kryterion Distance DATA COLLECTION

27 2. DATA ENTRY

28 Cumulative Tests Administered by Month in Carnell Room Year Trend July August September October November December January February March April May June 3. ANALYSIS & REPORTING

29 RESOURCES Excel Access Google Analytics Tableau Public

30 EXCEL HOW-TO VIDEO

31 PART 4: TAKE ACTION What actions can you take to achieve your goals? Scheduling Actions Advertise Add test offerings

32 THE TEST PROGRAM ASSESSMENT CYCLE 1. Outcomes 4. Use Results 2. Opportunities 3. Assessment

33 TIPS Be Consistent Computer Software is Your Friend! Longitudinal Reports Show Trends Simplify

34 SUMMARY Describe ways data and reporting can support your test center s vision, goals, and actions to achieve success. Vision I would like our center to be the biggest test center in the nation. Goal Increase number of tests administered Measurements Test Counts Actions Scheduling Advertise Add test offerings

35 Data Reporting System 1. Collect Data 2. Enter Data 3. Analyze & Develop reports

36 I DON T KNOW WHERE TO BEGIN! Take a snapshot! Test Counts Revenue Customer Base Other Services

37 KEEP THE DISCUSSION GOING The Benefits of Data and Reporting for Test Center Management