Qian Wang & Thierry Paquet. Statistical Programming Outsourcing KPI Dashboard. - A tool for better collaboration - - Merck Sharp & Dohme -

Transcription

1 Statistical Programming Outsourcing KPI Dashboard - A tool for better collaboration - Qian Wang & Thierry Paquet - Merck Sharp & Dohme - Brussels - October, 16 th 2013.

2 Agenda Introduction Dashboard High Level Process Flow Modular Structure Dashboard Input KPI Library Reporting The Toolkit SAS code Conclusion Q&A 2

3 Introduction Why do we outsource? 1. Reduce cost. 2. Business strategy (distribute risk). 3. Focus on its core competence. 4. Share the risk with third party vendors. 5. Access a flexible pool of skilled resources. Risk and Pre-requisites. Tracking 1. Risk of reduced quality (handovers). 2. Service-level agreement (SLA) to define and respect. 3. Key performance indicator (KPI) to measure outsourcing efficiency. A Metrics Dashboard to measure and control the activity to the objectives. 3

4 Dashboard Example of dashboard 4

5 High Level Process Flow Service/Project Deliverable Service Provider Metrics Input/feedback metrics repository Metrics Client Feed-Back Outsourcing Metrics Dashboard Governance 5

6 Modular Structure Dashboard A Module Selection Dashboard B LOADING CLEAN-UP MACROS CALLS ODS REPORTING KPI #1: Timeliness KPI #2: Timeliness Over Time KPI #3: Quality KPI #4: Quality Over Time KPI #5: Staff Retention KPI #6: Rework KPI #7: Cost LOADING CLEAN-UP MACROS CALLS ODS REPORTING KPI Library KPI1 KPI2 KPI3 KPI4 KPI5 KPI6 KPI7 KPI8 KPI9 KPI10 KPI11 KPI12 KPI13 KPI14 KPI15 KPI16 KPI17 KPIxx 6

7 Dashboard Input The Project Metrics Sheet Partner Compound Number Protocol Number Deliverable Type Number of Item Deliverabl es Target Start Date Actual Start Date Delivery Target Date Delivery Actual Date Partner resources spent on Developme nt (Re-work incl.) (FTE days) QC (Re-work incl.) (FTE days) Total Partner resources spent on those deliverable s (Re-work incl.) (FTE days) Quality as assessed by Merck staff MyPartner DUMMY DUM4 Type Jan-12 2-Jan-12 4-Jan-12 4-Jan good MyPartner DUMMY DUM4 Type Jan-12 7-Jan Feb Feb issues with numbers MyPartner DUMMY DUM4 Type Feb Feb-12 4-Mar-12 4-Mar good MyPartner DUMMY DUM5 Type Jan-12 5-Jan Jan Jan good MyPartner DUMMY DUM5 Type Jan Jan Feb Feb issues with code efficiency MyPartner DUMMY DUM5 Type Feb Feb-12 4-Mar-12 4-Mar issues with numbers MyPartner DUMMY DUM6 Type Feb-12 2-Feb-12 4-Feb Feb good MyPartner DUMMY DUM6 Type Feb-12 7-Feb Feb Feb good MyPartner DUMMY DUM6 Type Feb Feb Mar Mar good MyPartner DUMMY DUM7 Type1 1 2-Mar-12 2-Mar-12 4-Mar-12 4-Mar good MyPartner DUMMY DUM7 Type Mar Mar Mar Mar issues with SOP compliance MyPartner DUMMY DUM7 Type Mar Mar Mar Mar good 7

8 KPI Library KPI Library KPI1 KPI2 KPI3 KPI4 KPI5 KPI6 KPI7 KPI8 KPI9 KPI10 KPI11 KPI12 KPI13 KPI14 KPI15 KPI16 KPI17 KPIxx SAS Macros with similar interface to allow data selections or output fine-tunings. KPIxx Data selection Data selection parameters observation_where = criteria used to select the input metrics to be summarized. timeunit = time interval used to summarize the performance (e.g. monthly/weekly/quarterly). Output fine-tunings Formatting parameters odsregion ymin ymax xaxis subtitle = ods region statement to position the plot as part of the page. = minimum value of yaxis. = maximum value of yaxis. = xaxis statement as in SAS graph format. = subtitle. 8

9 Reporting: The Table Of Contents The report is created in a PDF format which avoids any update of the charts or information displayed. The PDF Dashboard is presented with its table of contents that offers the user an easy way to overview 9

10 Reporting: The Charts The Timeliness Timeliness across all deliverables MyPartner April 2012 to March 2013 This report displays the percentage of deliverables on time versus delayed. This percentage is calculated as the number of deliverables on time divided by the total number of deliverables completed in the last year. capacity to meet the timeline. 10

11 Reporting: The Charts The Timeliness Over Time Timeliness Over Time MyPartner Quarterly Summary timeliness of the service provided through the selected period calculated as the percentage of deliverables on time at each quarter. performance evolution over a defined timeframe, against an acceptance criterion (e.g. 90% on time) and provides a graphical view to identify the trend. % Deliverables on Time Time # on time # completed

12 Reporting: The Charts The Quality Assessment Quality Assessment Frequency MyPartner Yearly Summary This KPI is based on the feedback from the client. The horizontal bar graph displays the percentage of deliverables for each category of quality assessment. The percentage is calculated as the number of deliverables by the total number of deliverables completed in the last year. 12

13 Reporting: The Charts The Quality Over Time Quality Over Time MyPartner Quarterly Summary for Outstanding or Good Quality quality of the service (as perceived by the clients as either good or outstanding) and is calculated as the percentage of deliverables at each quarter. % Deliverables with the expected quality performance evolution over a defined timeframe, against an acceptance criterion (e.g. 90% good or outstanding) and its trend. Time # good or outstanding # completed

14 The Toolkit SAS code Data Loading Data Cleaning Time Window definition ODS Output Statement Coverpage creation 14

15 The Toolkit SAS code KPI#1 macro call KPI#2 macro call KPI#3 macro call 15

16 Conclusion Outsourced resources are more and more used in the pharmaceutical industry. An efficient collaboration needs a performance monitoring to evaluate and improve if necessary. LOADING CLEAN-UP MACROS CALLS ODS REPORTING This toolkit presents a way to create KPIs dashboards with a modular structure and different levels of granularity answering business needs. The KPI SAS library allows the user to build his own dashboard as needed. 16

17 17 Questions & Answers