Training Metrics and Benchmarking

Transcription

1 Training Metrics and Benchmarking February Meeting 1

2 2014 Metrics SIG Topics Month January 30 February 18 March 18 April 23 May date TBD June date TBD Topic What are members tracking? What s the next great metric? What CEdMA metrics already exist? How can you use the Quarterly Market Barometer? Demo of ClickTools. What does the newly released Bi-Annual State of the Business Survey reveal? Measuring Training Effectiveness Getting Beyond Level 1 Member presenter(s) wanted. Member presenter(s) wanted. Measuring ROI? If you would like to present, please contact SIG Chair Lauren.Thibodeau@ca.ibm.com 2

3 Quick Recap of January Meeting Metrics Members are Tracking Success of Business Fully Loaded Course Development Cost Course Support Net Promoter Score Resource Utilization Customer Satisfaction Customer Behaviour The Next Great Metric ROI Doing a Better Job Training Effectiveness Getting Beyond Level 1 Correlation Between Support Calls and Training 3

4 What CEdMA Metrics Exist Already Dirk Braune and Mike Dowsey

5 Overview of Metrics Already Available Quarterly Barometer Biennially Business Metrics (2003, 2008, 2011, 2013) Pricing and Discounting (2013) On demand Virtual Classroom (2009) Authorized Training Partners (2009) Curriculum Development (2007) LMS (2006) 5

6 Common Approach Demographics the same for all surveys and automatically filled with previous data Regular surveys like barometer include previous responses to speed up process to fill out surveys Surveys have now regular schedule Adaptive surveys: only questions relevant to responders Surveys are reviewed with the Executive Council and this SIG 6

7 Different Approaches to Leverage and Analyze Data Download PDF Download conference presentations for survey highlights Download Excel and use Excel functionalities Graphs Correlations Cross tab in ClickTools (compare just 2 variables) Filter to identify specific cases eg benchmarking 7

8 Quarterly Barometer Comparison last quarter to same quarter previous year, also actual quarter expectation vs last years same quarter Global and EMEA only Metrics collected: Revenue Profit Activity: classroom, virtual classroom, elearning, certification Instructor Utilization Headcounts and contractors Verbatim for growth/decline areas 8

9 Barometer is covered on March 18 9

10 Biennial Business Survey (2011, 2013) Demographics Strategy and Objectives Organization Financials Measurement of Education Services Quality and Impact Sales and Marketing Learning Portfolio and Development Course Delivery and Distribution Training Partner Programs Certification 10

11 Demo Business Survey PDF, Excel Results and ClickTools Access 11

12 Biennial Pricing Survey (2013) Click Tools Survey: ~140 questions addressing general strategies as well as specifics for different learning services Adaptive survey: if certain cases are irrelevant for responder, all corresponding questions are skipped 45 responses Excel Pricing Sheet Prices are collected by spreadsheet for easy averaging and communication List & street prices for customer and partner Send only to Mike 30 responses 12

13 Use Biennial Pricing Survey Results Pricing Strategies Review key statistics in this presentation Identify general pricing strategies via general Excel and PDF file and use Excel file to create own charts and statistics Research pricing strategies for specific cases eg benchmark vs similar companies in terms of revenue, business model etc.: Leverage pdf and xls files in Goldmine for key groups (by company size, by training revenue etc.) Analyze yourself in ClickTools with filter and cross tabs (updated How to Use ClickTools in Goldmine) and export data if needed Pricing Review average pricing by region in Sheet Summary Research pricing for specific cases eg benchmark vs similar companies in terms of revenue, business model etc.: Leverage existing groups in rows 36 to 65 for key groups (by company size, by training revenue etc.) Go to country sheets and filter via columns B to E Crev=company revenue and Erev=Education revenue (Small, Medium, Large) Busn=Business model EdBM=Education Business Model (PL=P&L, CC=cost center, hybrid) 13

14 Demo Pricing Survey Pricing Sheet, PDF/Excel Survey Results and ClickTools Access 14

15 15

16 Questions? 16