The Future of Analytics. Dave Rogers, Director of EBC Operations and Technology Integration - Microsoft

Transcription

1 The Future of Analytics Dave Rogers, Director of EBC Operations and Technology Integration - Microsoft

2 Today s Agenda Essential Program Metrics Advanced Analytics - Using Business Intelligence and Visualization Machine Learning Training an algorithm to predict outcomes Using Artificial Intelligence and Bots to enhance the Planning and Briefing Experience

3

4 Leveraging the ABPM World Class Characteristics in Measurement 1. A performance measurement strategy, designed to meet the needs of key stakeholders, quantifies and communicates the program s value. 2. Immediate or on-site feedback measures briefing impact. 3. Integrated planning, management, and reporting tools support briefing operations and provide meaningful insight on program performance. 4. Sales closure tracking and delayed surveys quantify the briefing program s contribution to business results.

5 Essential Program Metrics Efficiency Metrics that measure activity Effectiveness Metrics that measure impact Core Objectives Program goals and commitments

6 Essential Program Metrics Efficiency # of briefings # of events # of event days # of sessions # of customers # of partners # of employees % cancellations # of opportunities Effectiveness Revenue Revenue expansion Revenue acceleration Account feedback Customer Satisfaction / NPS Cost per briefing/event Close rate % of Top Accounts touched Core Objectives Program reputation Budget attainment

7 Advanced Analytics - Using Business Intelligence and Visualization

8 Tools of the Trade Excel PowerPivot, Power Query Briefing Management Tool Standard reports Custom Reports Data Visualization Tools Power BI Tableau

9 Overall Program Dashboard

10 Department Dashboard (Tech Support)

11

12 Understanding core drivers behind trends - CSAT

13 Understanding core drivers behind trends - CSAT

14 Understanding core drivers behind trends - CSAT

15 Understanding core drivers behind trends - CSAT

16 Additional uses for Visualization Setting targets based on multi-year visualization of past performance. Understanding an increase in costs Same number of briefings but higher attendees/briefing Take action based on CSAT responses Executive participation& Topic health

17 What Dashboards do you use to manage your program?

18 Machine Learning Training an algorithm to predict outcomes

19 Getting Started with Machine Learning What is Machine Learning? Teaching software to find patterns in current data so that it can seek out the patterns in future data (typically to predict future outcomes). Key providers include Amazon, Databricks, HPE, IBM, Microsoft Azure Machine Learning Website - Overview of AML

20

21

22 Predicting Briefing Cancellations Problem: Over 50% of all requests are cancelled or rescheduled FY16-54% (1529/2807) FY17-54% (1398/2606) Common Cancellation Assumptions Weather issues preventing travel Change in Executive Team Poor relationship between account team and customer Political unrest Economic or customer specific incidents

23 EBC Cancellation Prediction Model

24 Key Cancellation Indicators Number of speakers/topics requested Lead time from request to start date Industry Public Sector (48%) Partner (33%) Country/Region MEA (58%), LATAM, India, Australia (20%) Job title of Briefing Owner Month May (47%), June, Feb (38%) Day of the Week Thursday (44%) Wed (40%)

25 What s Next? Briefing CSAT? Sales Closure? Opportunity Increase? Deal Acceleration? Likelihood to recommend or NSAT? Correlating tweets, stock price variations or other external signals to briefing or attendee volume?

26 How could you use Machine Learning?

27 Artificial Intelligence and Bots

28 AI and Bots Enhancing the Briefing Experience Executive Engagement Virtual Assistant (EEVA) Transcription Bot

29 AI and Bots Internal Help Tools MyEBC Helper Bot Agenda Builder

30 Agenda Builder Design Briefing Objectives (customer + Microsoft) Industry Recommendations Azure Text Analytics Key Words & Phrases Content Catalog Azure Search Phase 1: Text Analytics + Azure Search = Recommended Topics Recommended Topics & Agenda Actual Agendas

31 Agenda Builder Design Briefing Objectives (customer + Microsoft) Industry Recommendations Chat Bot Azure Text Analytics Key Words & Phrases Content Catalog Azure Search Phase 1: Text Analytics + Azure Search = Recommended Topics Phase 2: Chat Bot introduces conversation and increases richness and accuracy of data to be analyzed Recommended Topics & Agenda Actual Agendas

32 Agenda Builder Design Briefing Objectives (customer + Microsoft) Industry Recommendations Chat Bot Machine Learning Content Catalog Actual Agendas Phase 1: Text Analytics + Azure Search = Recommended Topics Phase 2: Chat Bot introduces conversation and increases richness and accuracy of data to be analyzed Phase 3: Machine Learning applies data and outcomes from past briefings to provide recommended topics Recommended Topics & Agenda

33 Getting Started with AI and Bots Intro to AI Course Building a simple Q&A Bot QnA Maker Building a Bot that understands natural language queries LUIS: Language Understanding Intelligent Service

34 How are you using AI in your program?

35 Q&A

36