Effective Ways to Use Metrics to Achieve "Best Practice" Performance in Your Lab. Using Metrics for "Best Practice" Performance: Outline

Similar documents
Combining Lean, Middleware, and Targeted Automated Systems to Unlock Lab Automation's Full Potential

Aligning Lab Automation and Lean Methods to Achieve World-Class Productivity in Your Lab. Aligning Lab Automation and Lean Methods

Intersection of LEAN and the LIS. Megan Schmidt. Product Manager, Sunquest Information Systems, Inc. Patrick O Sullivan

The Thinking Approach LEAN CONCEPTS , IL Holdings, LLC All rights reserved 1

Continuous Improvement Toolkit

Using Laboratory Automation as a Catalyst for Performance Improvement

Blending Work Cell Automation, Middleware, and Lean to Reduce TAT, Decrease Required Specimen Volume, and Boost Productivity

Measuring Percent Outliers for Lab TAT in the ED. Judy Heng, BS MT, C(ASCP) AMT, MBA

Introduction. Steps to Lean IT. Sample Lean IT Processes

Achieving Best in Class Performance with Your Laboratory Automation System. Presented by: Denny Lamb, FACHE

National Reference Laboratory Quality Assurance Dashboard. Quality Improvement Metrics Q2 2017

WORKFLOW WITHOUT THE WORK

Lean, team-based medical device manufacturing. David Hurley Associate Director of Operations Alcon Research, Ltd.

Innovations with "Best of Breed" Solutions:

The PCL Alverno Difference Quality Driven Patient Focused Elevating the clinical laboratory and diagnostic capabilities of hospitals and healthcare

WORKFLOW WITHOUT THE WORK. Power Express Clinical Automation Solution

Applying Lean Principles to Any Process

The Thinking Approach LEAN CONCEPTS , IL Holdings, LLC All rights reserved 1

Optimizing Transfusion and Blood Banking Services by Using Lean and Smart Automation

Continuous Improvement Toolkit. Value Analysis

Data Hidden in Plain Sight - Using Unexpected Analytics for Quality and Process Improvement in the Clinical Laboratory

Instructor Info: Dave Tucker, LSSMBB ProModel Senior Consultant Office:

This presentation contains client specific data. Individual results may vary. Numbers and values provide the foundation for laboratory services

Lean in the Lab: A Process Improvement Journey

Electric Forward Market Report

Real Time Management of All Operational Domains and Workflows in Your Laboratory. Chris Christopher Csquared Global Healthcare Consulting

IT 470a Six Sigma Chapter X

Metrics-Based Process Mapping (MBPM)

Process Mapping. You cannot improve a process until everyone agrees on what the process is.

Creating a Lean Culture Transformational Leadership for Lean Health Care

Six Sigma Methodologies. Process Improvement

Making it Lean: Shands at AGH Lab Process Improvement and Layout Redesign

Tuning your Practice s Business Process and Performance Illinois/Chicago Ophthalmology, March 2014

Financial Intelligence NCIA 2016 National Training Conference Pittsburg April 18 th & 19 th

What Does Lean Surgical Pathology Look Like?

R o l l i n g F o r e c a s t i n g :

Continuous Flow and Anatomic Pathology Theory vs Reality

Certification Workshop: Mastering the Essential Tools of Value Stream Mapping, A3 Writing and Kata

TYPICAL FACTORY LAYOUT vs THE TOYOTA APPROACH

Transforming Microbiology at DynaLIFE MEDICAL LABS

The Principles of Effective Contact Center Management Part 1

Presentation Handouts

Internal Medicine Faculty Affairs Staffing Analysis Program & Operations Analysis University of Michigan Health System

LONDON HEALTH SCIENCES CENTRE (LHSC) WORKFLOW COMPARISON STUDY WITH THE AQUIOS CL FLOW CYTOMETER

Data Usage, Lean Thinking and Process Improvement

Injury and Illness Analysis. Fiscal Year (FY) 2008 (October 1, 2007 September 30, 2008) Report No. 1

Quality Confab Atlanta, GA, September 29, Easy Steps to Internally Benchmark Your Lab and Unlock Major Improvements

Quick Manufacturing Stencil

Continuous Improvement Toolkit. Graphical Analysis. Continuous Improvement Toolkit.

Using the LIS and Workflow Redesign to Improve Specimen Management in the Lab. Outline. 1. Basics of Lean Six Sigma

Transforming Microbiology at DynaLIFE Dx Labs:

Aligning Process Redesign and Change Management with Project Management (System Implementation Projects)

Case Study College of American Pathologists. All rights reserved. cap.org

Lean Flow Enterprise Elements

An Introduction to Lean. Heidi Maier Sagstad

The Sweet Spot of Diversity on Productivity in Apparel Manufacturing

LEAN PRODUCTION FACILITY LAYOUT.

LeadingAge Maine & New Hampshire 2014 Annual Conference

HAI event March 2009

Masterclass in Resource Planning. Beyond the basic: Exploding some common misconceptions

EXL 2016 Performance Report. Stacie Loucks, Executive Director May 2, 2016

Quality and Efficiency Support Team (QuEST) Directorate for Health Workforce and Performance. The DCAQ Journey in NHS Lothian.

Utilising Lean to improve Defect & Inspection Management. 17-Apr-2018

A Restaurant Turnaround: From Crash to Cash

Chapter 6 Planning and Controlling Production: Work-in-Process and Finished-Good Inventories. Omar Maguiña Rivero

Lean Project Delivery Operating System

Making the Artwork Process Work Brendan Marken VP NPI & Technical Packaging GSK CH

Lean Leader Manual. How to Manage Operations in a Lean Environment

LEAN CS PRINCIPLES. Using Lean Methodology Real Applications for CS. Presented by John Kimsey

Operations Report. Stephanie Monzon Manager, Markets Coordination MC Webinar January 22, PJM 2018

Value Stream Mapping

Elements of Excellence

PROPOSED METHOD TO INCREASE PRODUCTIVITY AT PT AMI

Justifying Simulation. Why use simulation? Accurate Depiction of Reality. Insightful system evaluations

Administration Division Public Works Department Anchorage: Performance. Value. Results.

POS Collections. Changing the Culture at Oconee Medical Center

C8: Stream Mapping: Making Improvements That Add Value

LEAN Best Practices for Laboratories

KeySolution New Case Implementation Manual

PRODUCTION SCHEDULING PART-A

Time study is not rocket science, but it is possible to get in big-time trouble with incorrect application. Briefly,

Online library of Quality, Service Improvement and Redesign tools. Value stream mapping. collaboration trust respect innovation courage compassion

EDMM Cycle Time Definitions and Line Balancing (Yamazumi) Charting

Pharmacy Materials Management Lean and Accountable

LEAN ADMINISTRATION.

Traffic Department Anchorage: Performance. Value. Results.

UNITE Managing Service Delivery, Workloads, and Capacity Burn on Metered and Non-Metered Systems

Staffing to Workload in Central Receiving

Complex P2P processes are a thing of the past. NHS Shared Business Services

Lean for Service Overview

Measure What You Manage. Michael Cowley, CPMM President CE Maintenance Solutions, LLC

Sustaining Our Buildings & Grounds

Engaging Staff in Daily Improvement

CI User Engagement Activities and Schedule Nov Apr 2013

INTRODUCTION 1. When manufacturing processes of products being examine through customer s perspective, we will be able to identify 2 types of processe

INTRODUCTION 1. When manufacturing processes of products being examine through customer s perspective, we will be able to identify 2 types of processe

Leadership and the Toyota Production System

A PM on Lean Production Randel Ltd.

Recommended Modifications to Train Performance Indicators

California Independent System Operator Corporation. California ISO. Import resource adequacy. Department of Market Monitoring

Transcription:

Effective Ways to Use Metrics to Achieve "Best Practice" Performance in Your Lab Lab Quality Confab September 29, 2009 Thomas P. Joseph, MBA, MT(ASCP) Using Metrics for "Best Practice" Performance: Outline 1. Some problems with metrics 2. Lean metrics 3. Using Metrics Benchmarking For Lean process improvement Long range space planning Ongoing metrics to sustain Lean improvements 1

Using Metrics for "Best Practice" Performance: Some Problems with Metrics 2 Using Metrics for "Best Practice" Performance: Some Problems with Metrics Some of the problems with metrics Not linked to strategic goals People cannot affect the metrics Long delays, not produced in a timely manner Not granular enough e.g. monthly trends Focused only on downstream outcomes or measure only outputs, not inputs 1 Portions of this section are adapted from Arnsdorf Associates lecture notes 2003. 3

Using Metrics for "Best Practice" Performance: Some Problems with Metrics Why have metrics? Analyze and redesign the process Verify and quantify improvement and from process changes Sustain Lean improvements, provide feedback to operators Can help motivate the proper behavior Indicates when the process is out of control limits Helps creates the proper focus on the process you measure what you value Metrics test How often are they updated and distributed? Does everyone use the same metrics or are they different for different groups? Can you affect them? Do they affect your actions/performance? 4 Using Metrics for "Best Practice" Performance: Lean Metrics 5

Using Metrics for "Best Practice" Performance: Lean Metrics Typical savings from Lean projects: Carrying cost of inventory Reduced material handling cost Less space required Reduced rework the cost of poor quality is not often measured Lower capital cost better use of capacity Reduced staffing often, not always Typical benefits Improved cycle times and delivery times Fewer delayed deliveries TAT outliers Lower cost Improved quality 6 Using Metrics for "Best Practice" Performance: Lean Metrics Typical metrics in Lean projects Takt and cycle times Lead time (turnaround time) Defects, inspection, rework Value added: Non-value added ratio FTEs/productivity, overtime Walking Space Inventory, Work in Process 7

Using Metrics for "Best Practice" Performance: Using Metrics: Benchmarking 8 Benchmarking: Productivity/Expense Benchmarking A number of hospital wide services do not even count tests uniformly. Accept raw statistics which may include phlebotomy, indices, etc. Labs are only one department in their database. Solucient Yankee Alliance Mecon Far better, are lab specific services. Some have complexity measurements to adjust for test mix. HealthCare Development Services: Lab Trends Chi Solutions CAP LMIP Benchmarking will not provide a roadmap to improvement Must go and see the process genchi genbutsu 9

Benchmarking: Turnaround Time From a comparative database 45 M performance measurements of laboratories: from community hospitals to academic medical centers and lean early adopters 300 test procedures All segments of the value stream 10 Using Metrics for "Best Practice" Performance: Using Metrics: For Lean Process Improvement 11

Using Metrics for "Best Practice" Performance: Using Metrics for Lean Process Improvement Process analysis Takt and cycle times, process capacity Lead times (TAT times) Value added, non-value added Staffing analysis, requirements, process capacity Layout, redesign Work cell/operator analysis Queuing theory and staffing Measuring results 12 Using Metrics for Lean Process Improvement: Definitions Some definitions Takt time. The pace of production required to meet customer demand. This is calculated as the available hours divided by the number of specimens. Usually expressed in seconds. Cycle time. How often (in seconds) a specimen is completed by a process. Cycle times for each process must be less than the Takt time or there will be bottleneck in the process and customer demand will not be met. Types of Work/Activity Value Added. An activity that changes the form, fit or function of a product. Value added activities can also be defined as something a customer would be willing to pay for. Non-value Added. The various forms of waste. Non-value Added, but Necessary. Required activities that do not provide value added improvements to the product. 13

Using Metrics for Lean Process Improvement: Case F: Takt and Cycle Times Process Capacity The various process with very different cycle times. Additional capacity for certain processes will keep the work flowing in an even manner. Cycle times for each process must be below the takt time GI (Upper, Lower) Process Balance Chart (GI - Upper and Lower) Wkstns CT (1 Wkstn) CT (All Wkstns) Lead Time Takt 250.0 250.0 sec sec min sec Receiving 1 13.0 13.0 1.3 107.4 Registration 3 211.2 70.4 4.1 107.4 200.0 200.0 Grossing 3 231.0 77.0 7.0 107.4 Tissue Processor 1 67.6 67.6 124.0 107.4 Embedding 2 120.0 60.0 0.6 107.4 Cutting 2 120.0 60.0 2.0 107.4 Staining 1 33.4 33.4 107.4 Seconds 150.0 100.0 150.0 100.0 Coverslipper 1 11.1 11.1 107.4 Total Lead Time 139.0 min 50.0 50.0 2.32 hrs 583.1 5.43 - Receiving Registration Grossing Tissue Processor Embedding Cutting Staining Coverslipper - CT (1 Wkstn) CT (All Wkstns) Takt 14 Using Metrics for Lean Process Improvement: Case M: TAT Improvement with Lean Potential turnaround time improvement with Lean (midday specimens) Current operations (report at 9AM the following day) w Lean: reduce waiting, earlier instrument QC and run of samples (report at 10PM same day) Elapsed Time for Specimens Arriving at Midday: Olympus PK7200) Delivery Delivery Current State Wait for Intake w Lean Analysis Wait for Testing Wait for NAT Results QC Report Analysis Wait for QC Review, Reporting Value Non Added Value Added QC Report - 5.00 10.00 15.00 20.00 Hours

Using Metrics for Lean Process Improvement: Case E: TAT Improvement with Lean TAT projections: w/ Front End Automation: 7.5 minute improvement w/ Lean (Phase 1): 39 minute improvement Traditional vs Lean Process Improvement (AM Draws: Chemistry Specimen) Current State w Front End Automation Lean Phase 1 (Phlebot Kaizen) Lean Phase 2 Draw Draw Draw Draw Storage on phlebot tray Storage on phlebot tray Storage on phlebot tray Storage on phlebot tray Centrif Centrif Analysis Verif Centrif Centrif Analysis Verif Value Added Analysis Analysis Non Value Added Verif Verif - 20 40 60 80 100 120 Minutes Using Metrics for Lean Process Improvement: Batching, TAT and VA and NVA Time The effect of batch size on TAT and staffing 92% of TAT reduction benefit from moving from batch of 15 to 3. Number of Staff Required 8 7 6 5 4 3 2 1 Turn-Around-Time and Staffing Requirements as a Function of Batch Size Takt Time: One Minute (Chemistry Specimen) 120 100 80 60 40 20 Turn-Around-Time (Minutes) - Batch Size: 15 10 5 3 1 Decreasing Batch Size - Phlebot Spec Proc Tech Average Turn Around Time 17

Using Metrics for Lean Process Improvement: Batching, TAT and VA and NVA Time The effect of batch size on staffing, VA, NVA work Batch size reduction from 3 to 1: a 47% increase in work for an additional 6 minute TAT improvement Value-Added and Non Value-Added Work as a Function of Batch Size 12.0 Number of Staff Required 10.0 8.0 6.0 4.0 2.0 Phlebotomists Spec Proc Staff Technologists All Staff - 15 10 5 3 1 15 10 5 3 1 15 10 5 3 1 15 10 5 3 1 Batch Size Staff Work: VA Staff Work: NVA 18 Using Metrics for Lean Process Improvement: Case C: Staffing Requirements Begin with analysis of workflow First look at opportunities for leveling and eliminating waste

Using Metrics for Lean Process Improvement: Case C: Staffing Requirements Matching workflow with actual staffing provides an incomplete understanding. Using Metrics for Lean Process Improvement: Case C: Staffing Requirements Analysis of cycle times for each class of specimen Usually will need patient location level detail Minutes/Accn Non Bar-coded Bar-coded 1.73 0.26

Using Metrics for Lean Process Improvement: Case C: Staffing Requirements Resulting determination of required and actual staffing provides insight. FTE Requirements for Specimen Accessioning 2.00 1.50 1.00 0.50-0 3 FTEs 6 9 12 15 18 21 0 3 6 9 12 15 18 21 0 3 6 9 12 15 18 21 FTEs (Required) FTEs (Current) Using Metrics for Lean Process Improvement: Case K: Process Capacity and Staffing At peak times there is a lack of preanalytical processing capacity Even the best process will fail to keep pace with demand if there is insufficient capacity Routine Specimens STAT Specimens

Using Metrics for Lean Process Improvement: Case K: Process Capacity and Staffing Process capacity for accessioning is not sufficient in the early AM hours and during much of the day shift. Call-ins will almost always result in reduced staffing in this area. Seven scheduled accessioners are needed to effectively have 6 workstations filled, considering breaks and lunch Using Metrics for Lean Process Improvement: Case D: Operator Walking/Layout Workflow for Hgb A1c. Note sequence of processing steps.

Using Metrics for Lean Process Improvement: Case D: Operator Walking/Layout Flow Cytometry layout. Re-layout in a workcell with an 83% reduction in operator walking. Using Metrics for Lean Process Improvement: Workcell design The U shaped workcell is efficient in both low and high volume settings

Using Metrics for Lean Process Improvement: Case J: Workflow and Performance Analysis An analysis of the time spent in processing on various activities. Of primary importance is that phone calls represent a major disruption of workflow. The phone calls during the observation period required 18% of the processor s time. Processor T ime Analysis 18% 6% 16% 14% 9% 1% 3% 33% PT: Unload Unbag/Sort Receive/Relabel Centrif: Load Centrif: Unload Aliquot Distribute Phone Using Metrics for Lean Process Improvement: Case J: Workflow and Performance Analysis The left illustrates the sequence of process steps. It is characterized by a somewhat random organization of the workflow (which is not unusual in the laboratory setting.) Phone calls and inadequate staffing also result in processing delays. An improved processing design would move specimens from process to process every few minutes. Preanalytical Process Sequence Processing Delays - 0:00:00 0:14:05 0:15:16 0:17:40 0:20:35 0:22:56 0: 25: 36 0:26:04 0:27:45 0: 29: 23 0:30:40 0:32:26 0:33:46 0:35:15 0:38:35 0: 43: 25 0:45:48 0:47:29 0:49:42 0:51:31 4.5 4 3.5 1 2 3 4 PT Unload Unba g Re c/rela be l Load Centrif 3 2.5 2 1.5 1 Cause of outliers 5 Unloa d Ce ntrif 0.5 0 6 Di stribute 0-5 6-10 11-15 16-20 21-25 26-30 31-35 36-40 Minutes 7 Pneumatic Tube Centrifuge Deliver

Using Metrics for Lean Process Improvement: Case J: Operator Balance and Cell Design A work assignment for two preanalytical operators with a relatively balanced workload based on a 3 minute cycle. This was sufficient to maintain workflow. Required operators = total operator cycle time / takt time = 310/180 = 1.72 Operator Balance: 2 person workcell 250 200 Planned cycle time Takt time Seconds 150 100 1- unload pneumatic tube 2 - unbag 3 - receive/reprint labels 4 - load centrifuge 5 - unload centrifuge 6 - deliver specimens 50 0 operator 1 operator 2 Using Metrics for Lean Process Improvement: Queuing Theory and Phlebotomy Staffing Phlebotomy staffing models for: OP clinics, Patient Service Centers To model the staffing requirements it is preferable to have data on patient arrivals, not data based on collect time - patient may be waiting in queue Random arrivals follow the Poisson distribution Phone calls to call center, customers arriving at grocery store checkout, patient arriving for blood collection Simple models will help determine required staffing More advanced queuing models (e.g. ProModel/MedModel) can provide comprehensive data on staffing models and patient wait times 31

Using Metrics for Lean Process Improvement: Queuing Theory and Phlebotomy Staffing Key Principles: A simple illustration of the Poisson distribution: 40% 35% Assume 12 patients arrive per hour and it takes 5 minutes to draw each patient. Is one phlebotomist enough? if 48 patient per hour or 4 per 5 minute period Probability of N arrivals in a 5 minute Period (Mean = 1) 0.368 0.368 30% Probability of N arrivals in a 5 minute Period (Mean = 4) Probability 25% 20% 15% 10% 5% 0% 0.184 0.061 0.015 0.003 0.001 0.000 0.000 0.000 Probability 25% 20% 15% 10% 5% 0.018 0.073 0.147 0.195 0.195 0.156 0.104 0.060 0.030 0.013 0 1 2 3 4 5 6 7 8 9 0% N 0 1 2 3 4 5 6 7 8 9 N 32 Using Metrics for Lean Process Improvement: Case K: Staffing Models: ED/OR Accessioning Between 10 am and 7 pm ED/OR/CathLab specimens frequently arrive within zero to two minutes of the previous specimen. A single ED accessioning individual will often not be able to process these samples within the expected 6 minute Receive to Bench TAT. Time between Arrival of ED/OR/Cath Specimens Average Count 2.0-2.5 1.5-2.0 1.0-1.5 0.5-1.0 - - 0.5 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of Day Minutes between specimens

Using Metrics for Lean Process Improvement: Case H: Measuring Results The preanalytical processing kaizen reduced chemistry TAT by 38 minutes (a 37% improvement). Results of the pilot were available the next day TAT (Receive to Verify) - Potassium 160 140 TAT change: -37% (38 Minutes) 120 Minutes 100 80 60 40 20-0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of Day Avg of 4 Wednesdays 8-Aug Using Metrics for Lean Process Improvement: Case K: Measuring Results The ED preanalytical kaizen improved TAT and eliminated all excessive outliers. The average Receive to Bench time was 2.9 minutes, the longest 7 minutes. ED ABC: Receive to Bench Turnaround Time (Minutes) Sep 15 - Lean Mar 2008 Pct Chg Oct 9, 2008 Process Target 6.0 6.0 6.0 Outliers (Above Target) 59.4% 27.1% 15.4% -43.3% Average 8.2 5.2 2.9-43.6% Median 7.0 4.0 3.0-25.0% 90th Pctile 13.0 10.0 6.2-38.0% 95th Pctile 16.6 13.0 7.0-46.2% 98th Pctile 22.0 18.1 7.0-61.3% Emergency Dept ABC: Turnaround Times (Receive to Bench) 25.0 20.0 Minutes 15.0 10.0 5.0 - Average Median 90th Pctile 95th Pctile 98th Pctile Mar 2008 Sep 15 - Oct 9, 2008 Lean Process

Using Metrics for Lean Process Improvement: Case K: Measuring Results The STAT preanalytical kaizen reduced outliers by 84% and eliminated all excessive outliers. STAT ABC: Receive to Bench Turnaround Time (Minutes) Lean Mar 2008 Pct Chg Process 15.0 15.0 Target Outliers (Above Target) 31.5% 5.0% -84.1% Average 12.2 8.0-34.5% Median 10.0 8.0-20.0% 90th Pctile 27.0 13.0-51.9% 95th Pctile 33.0 13.3-59.7% 98th Pctile 46.3 16.7-63.9% STAT IP/OP ABC: Turnaround Times (Receive to Bench) Minutes 50 45 40 35 30 25 20 15 10 5 - Average Median 90th Pctile 95th Pctile 98th Pctile Mar 2008 Lean Process Using Metrics for "Best Practice" Performance: Using Metrics: Long Range Space Planning 37

Using Metrics for Long Range Space Planning: Case M: Instrument Requirements for Growth Detailed projections for each category and instrument (with Lean and extended operating hours) Use machine cycle times and include setup time for a run Using Metrics for Long Range Space Planning: Case M: Instrument Requirements for Growth Instrument requirements as a category are shown below. EIA projections assume HIV will be moved from the Commander to the Prism in the near term, reducing required number of instruments. Lean strategies will reduce instrument requirements. Number of Instruments Required as Test Volume Increases 50.0 45.0 Number of Instruments Required 40.0 35.0 30.0 25.0 20.0 15.0 10.0 5.0 - NAT NAT (w Lean) EIA EIA (w Lean) Olympus Olympus (w Lean) Current Vol 140% of Current Vol 180% of Current Vol 220% of Current Vol 260% of Current Vol 300% of Current Vol

Using Metrics for Long Range Space Planning: Case M: Instrument Requirements for Growth Significant growth in test volume can be accommodated with the new space. The additional 60% increase in space should roughly accommodate a 60% increase in instrumentation. The 120% increase in volume (and 200+% with Lean) may not be fully realized due to changes in test mix, and importantly, the time of arrival of additional client specimens. If these new arrivals occur late in the evening, there will be less effective capacity for growth. Increase in Instruments Increase in Required Instruments as Test Volume Increases 240% 220% 200% 180% 160% 140% 120% 100% 80% 60% 40% 20% 0% 100% 120% 140% 160% 180% 200% 220% 240% 260% 280% 300% Increase in Volume Pct Increase Pct Increase (w Lean) Using Metrics for "Best Practice" Performance: Using Metrics: Ongoing Metrics to Sustain Lean Improvements 41

Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Focus should be on the process and maintaining standard work. Metrics are after the fact, you cannot inspect quality into a product Harold F. Dodge, Bell Labs 42 Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Ongoing metrics can help sustain process improvement Who considers this of value? Toyota follows the Plan, Do, Check, Act cycle. Provides daily metrics as feedback to workgroups. Six Sigma DMAIC: Define, Measure, Analyze, Improve, Control Survey of early adopter Lean labs: Level of detail/granularity Frequency Monthly Weekly Daily Hourly By Spec Daily 0% 0% 67% 17% 0% Week ly 0% 33% 0% 0% 0% Monthly 67% 0% 0% 0% 0% How Important are ongoing metrics? (scale: 1-5) Average Sustaining Lean improvements 4.7 Feedback on current process improvements 4.3 Maintaining standard work 3.8 How are metrics used? Pct Discussed in daily huddle meetings 50% Posted 100% Distributed/eMailed 67% 43

Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Toyota practices the Floor Management Development System that includes group visual control board, daily workgroup meetings and daily performance feedback 1. Find the key processes and control items that will drive the results. 1 Toyota Culture, Jeffery Liker and Michael Hoseus, Ch 15. 2008. McGraw-Hill. 44 Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Monthly, weekly not granular to provide any insight into what went wrong or well. Real time displays can be valuable, but do not provide a daily summary of overall performance Daily metrics and feedback much more valuable 45

Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements A common approach: daily reports with many pages of accession/test level detail Pt Num Pt Ord LPt Loc CID Acc Num Prty CodOrd TecOrd CodRec TecOutlier Ord-Col Coll-RecOrd-RecColl-Ver Ord-Ver Rec-Ver Res Tech Phleb Code LDLP LDLP E192005808 S 2999 ABC 569 Y 14 13 27 75 89 62 911 2592 RADONRADON E192005864 S 105 ABC 569 8 7 15 15 23 8 00200-A 1208 ED ED E192005869 S 2999 ABC 1098 96 2 98 8 104 6 00200-A WBNLPWBNLPE192005878 S 2999 ABC 569 Y 9 8 17 69 78 61 969-378 2591 WBNLPWBNLPE192005903 S 2999 ABC 569 Y 81 11 92 64 145 53 448-911 8888 ED ED E192005907 S 2999 ABC 1042 1 13 14 20 21 7 00200-A 8888 ONC ONC E192006013 S 105 ABC 1727 11 7 18 19 30 12 00200-A 2598 HEM HEM E192006019 S 105 ABC 1727 3 9 12 59 62 50 378 1208 SAU SAU E192006060 S 1098 ABC 1098 14 27 9 13 00200-A 8888 ONCINFONCINFE192006111 S 1727 ABC 1727 5 15 7 10 00200-A 8888 RADONRADON E192006398 S 652 ABC 1727 11 6 17 26 37 20 00200-A 1208 ED ED E192006418 S 2999 ABC 1098 15 12 27 19 34 7 00200-A 2774 ONCINFONCINFE192006485 S 1587 ABC 1587 16 37 17 21 00200-A 8888 C3 C3 E192006616 S 1098 ABC 1098 11 25 12 14 00200-A 8888 LDLP LDLP E192006617 S 2999 ABC 1727 29 15 44 29 58 14 00200-A 2592 ED ED E192006660 S 2999 ABC 1098 14 6 20 13 27 7 00200-A 2774 LDRLP LDRLP E192006689 S 2999 ABC 1587 Y 71 66 137 87 158 21 00200-A 8888 ED ED E192006819 S 2999 ABC 1042 20 4 24 10 30 6 00200-A 2774 LDLP LDLP E192006831 S 2999 ABC 1727 14 7 21 14 28 7 00200-A 2591 FGR FGR E192006839 S 2999 ABC 1727 10 12 22 25 35 13 00200-A C2 C2 E192006908 S 2999 ABC 1727 46 4 50 24 70 20 00200-A 2593 ED ED E192006943 S 2999 ABC 1098 2 8 10 14 16 6 378 ED ED E192006998 S 2999 ABC 1098 21 13 34 22 43 9 00200-A ED ED E192007086 S 2999 ABC 1098 47 3 50 13 60 10 00200-A 879 ED ED E192007108 S 2999 ABC 1098 17 3 20 15 32 12 00200-A 879 ED ED E192007125 S 2999 ABC 1098 24 8 32 21 45 13 911 ORC ORC E192007133 S 1098 ABC 1098 6 14 5 8 00200-A 8888 ED ED E192007142 S 2999 ABC 559 57 14 71 24 81 10 00200-A 8888 ED ED E192007147 S 2999 ABC 1098 27 21 48 30 57 9 00200-A 897 ED ED E192007201 S 2999 ABC 771 21 3 24 11 32 8 00200-A 879 LDRLP LDRLP E192007227 S 2999 ABC 569 25 10 35 21 46 11 00200-A 8888 ED ED E192007233 S 2999 ABC 1098 15 14 23 22 8 00200-A LDLP LDLP E192007251 S 2999 ABC 1587 11 5 18 12 7 00200-A ED ED E192007278 S 2999 ABC 559 5 23 28 29 34 6 00200-A 8888 ED ED E192007377 S 2999 ABC 2773 15 1 16 9 24 8 00200-A 8888 ED ED E192007396 S 2999 ABC 559 16 5 21 9 25 4 00200-A 8888 LDRLP LDRLP E192007401 S 2999 ABC 507 40 28 57 45 17 00200-A 8888 ED ED E192007437 S 2999 ABC 559 12 7 19 18 30 11 00200-A 8888 ED ED E192007483 S 2999 ABC 559 22 4 26 16 38 12 00200-A 879 S ABC 313 313 54 46 Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements 100 Summary STAT TAT % Compliance Rec-Ver April 2007 - March 2008 Target: 90% Compliance 90 % Compliance (Reported within 1 Hour) 80 70 60 50 40 What happened here? 30 Apr-07 May June July Aug Sept Oct Nov Dec Jan Feb Mar Apr-08 May- Jun-08 Jul-08 08 Date WBC/ONC K/CVICU HCT/LDR PT/2E, 2W, CVICU 47

Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Daily metrics may still not provide adequate granularity Avg = 95.6% Percent Percent 100 90 80 70 60 50 40 30 20 10 0 Avg = 92.6% Percent 100 90 80 70 60 50 40 30 20 10 0 Avg = 94.2% 100 90 80 70 60 50 40 30 20 10 0 HGB TAT (July 2009) Receipt to Result <25 Minutes 1 3 5 7 9 1113151719212325272931 Potassium TAT (July 2009) Receipt to Result <25 Minutes 1 3 5 7 9 1113151719212325272931 INR TAT (July 2009) Receipt to Result <25 Minutes 1 3 5 7 9 1113151719212325272931 Avg = 95.0% Percent Percent 100 90 80 70 60 50 40 30 20 10 0 Avg = 95.1% Percent 100 90 80 70 60 50 40 30 20 10 0 Avg = 92.9% 100 90 80 70 60 50 40 30 20 10 0 ph TAT (July 2009) Receipt to Result <25 Minutes 1 3 5 7 9 11131517 19 21232527 2931 UAI TAT (July 2009) Receipt to Result <25 Minutes 1 3 5 7 9 1113151719212325272931 Troponin TAT (July 2009) Receipt to Result <40 Minutes 1 3 5 7 9 1113 15171921 23252729 31 48 Using Metrics for "Best Practice" Performance: Ongoing Metrics to Sustain Lean Improvements Concluding thoughts: Metrics can be a powerful tool to achieve best practice performance You measure what you value Comments, questions? Contact info: email: Thomas.Joseph@management-insight.com Phone: (734) 741-0356 Web: www.management-insight.com 49