MTM Advanced Report Training CEB. All rights reserved. ]

Transcription

1 MTM Advanced Report Training 2014 CEB. All rights reserved. ]

2 Purpose Your organization is using Metrics that Matter (MTM) to: Collect evaluations / tests for training Improve learning effectiveness and impact Communicate results Learn to use MTM optimally Advanced Reporting class Basic Reporting is a pre-requisite 2012, KnowledgeAdvisors

3 Agenda Accessing reports Increase training impact Measure overall performance Analyze impact of strategic programs Wrap-up 2012, KnowledgeAdvisors 3

4 Logging into MTM View announcements Register for workshops, events, and MTM training sessions

5 Hands-On: Log into MTM 1. Open your web browser 2. Go to 3. Bookmark this page 4. Login 5. Click Reporting tab 2012, KnowledgeAdvisors

6 Additional reports Recent reports Manage reports Recommended reports

7 Show All Reports Based on reports you have access to Sort Alphabetically By Popularity By Release Date Narrow Results By Report Type By Objective 2012, KnowledgeAdvisors 7

8 Hands-On: Report Scavenger Hunt Search for the report links. No need to run them. 1. Find a report named Response Rate 2. Find the most popular report 3. Display all the reports to Increase Job Impact 4. Display all the reports to Import / Export Data 5. Display My Recent Reports again 2012, KnowledgeAdvisors 8

9 Increase Training Impact Objectives Identify sources of scrap learning Discover changes to improve impact

10 Scrap Learning 50% of every $ spent on training is wasted Already know the content Don t learn the content Content is not relevant to jobs Lack of support Ensure the right people are attending the right training at the right time 2012, KnowledgeAdvisors 10

11 Instant Insights: Scrap Learning Get the actionable insights you need to save time and money for your organization by reducing scrap learning. 2012, KnowledgeAdvisors

12 Multiple filtered analyses Best opportunity to reduce scrap Best practice actions Courses contributing most to scrap Financial impact

13 Get Additional Insights into Scrap Learning Add and Filter Additional Widgets Configure the overall Scrap Learning widget as needed by clicking the Edit icon: Add additional Scrap Learning widgets by selecting Tab Actions > Add Widget Apply filters by Courses, Demographics, or Modality to get the insights you need

14 Hands-On: Add Addt l Scrap Learning Widgets From your Instant Insights dashboard tab: 1. Add additional Scrap Learning widgets 1. Select Tab Actions > Add Widget 2. While generating, click the Edit icon in the corner of the widget to apply a filter (recommend by learning methodology and/or specific courses/curriculum) 2012, KnowledgeAdvisors 14

15 Analyze Qualitative Feedback Text Analytics Learner Comments Report Provide aggregated view of qualitative data Easier access to actionable and informative feedback Determine learner sentiment: Sentiment Score (overall Satisfaction Score) Relative to Benchmark Word count 2012, KnowledgeAdvisors 15

16 Hands-On: Learner Sentiment Variance 1. Go to Reporting > Learner Comments 2. Select Learner Sentiment Variance Query 3. Select Courses as the Report Type 4. Select your date range 5. Click Generate Report 2012, KnowledgeAdvisors 16

17 Measure Overall Performance Objectives Trend performance over time Compare performance vs. benchmark Publish quarterly L&D summary

18 Measuring Overall Performance Provide context for the metrics Trends, Benchmarks, Goals Focus on communication Within L&D and to customers Establish accountability for improvement 2012, KnowledgeAdvisors 18

19 Trend by Learning Methodology View performance trend by learning methodology View trend of evals collected Analyze downward trends Trend Scale Average 2012, KnowledgeAdvisors 19

20 Hands-On: Trend Scale Average 1. Click Reporting > Show All Reports 2. Select Trend Results under Narrow Results By 3. Select Scale Average 4. Select Learning Methodologies in Report Type 5. Select Performance and Activity 6. Select Monthly in Frequency box 7. Set date parameters 8. Click Generate Report 2012, KnowledgeAdvisors

21 Use Benchmarks Compare performance against internal or external reference Context for quantitative metrics Insight into above and below average areas Report Card 2012, KnowledgeAdvisors 21

22 Select a Benchmark Identify the primary default benchmark Use more targeted benchmarks selectively Region Industry Audience Course Type 2012, KnowledgeAdvisors

23 Hands-On: Set Benchmark & Report Card 1. Go to My Settings > Set Benchmark 2. Select Everything Except My Company (or another benchmark of your choice) 3. Click Update Settings 4. Go to Reporting > Report Card 5. Set date parameters 6. Click Generate Report 2012, KnowledgeAdvisors 23

24 Publish Quarterly L&D Summary 15+ page executive level summary Includes: Benchmark comparison Demographics Top/Bottom Trends Impact & Value Review, notate, and set action steps Talent Development Summary 2012, KnowledgeAdvisors 24

25 Talent Development Summary 15 October 2010, 2014 KnowledgeAdvisors 25

26 Talent Development Summary Top/Bottom Analyses

27 Talent Development Summary Trends

28 Talent Development Summary Job Impact

29 Hands-On: Talent Development Summary 1. Click Reporting 2. Select Talent Development Summary 3. Select start and end month 4. Click Next 5. Select all demographics 6. Change Number to Display to 5 7. Select format of report 8. Click Generate Report 2012, KnowledgeAdvisors 29

30 Analyze Impact of Strategic Programs Objectives Determine impact of key programs Communicate value to customers

31 Measure Impact of Key Programs Select strategic, costly, and visible programs Collect Post Event, Follow Up, Manager evals Estimate fully loaded costs and average salary Improvement = % of work time requiring knowledge and skills * % overall improvement in this area * % improvement due to training * 65% ROI = (Salary * Improvement) Cost) Cost 2012, KnowledgeAdvisors

32 Determine Impact of Key Program Filter to program courses Focus on key metrics Time to job impact Barriers to use % improvement due to training Increases in business results and ROI Compare vs. benchmark Human Capital ROI Card 2012, KnowledgeAdvisors 32

33 Hands-On: Human Capital ROI Card 1. Go to Reporting > Show All Reports 2. Select Increase Job Impact under Narrow Results By 3. Click Human Capital ROI Card 4. Set date parameters 5. Click Create New Filter 6. Name filter and click Add Filter 7. Click Courses, select course(s) 8. Click Add to Filter and click Done 9. Click Close Window and click Next 10. Click Generate Report 2012, KnowledgeAdvisors 33

34 Communicate Value to Clients Focus on needs of clients Increase productivity of workforce Achievement of goals NOT highly rated instructors and courseware Set goals with clients during design phase Review metrics as program progresses Use metrics as tool for discussion 2012, KnowledgeAdvisors 34

35 Summary Objectives Reduce scrap learning Measure overall performance Analyze impact of strategic programs Tools Instant Insights Trend Scale Average Report Card Talent Development Summary Human Capital ROI Card 2012, KnowledgeAdvisors 35

36 Thank you For further information: MTM Help Guide Answers to your MTM questions and additional training videos MTM Training Sessions Free, public training sessions MTM support