One if by Land, Two if by Sea You are a CMMI-DEV appraisal expert. What do you do if your org wants to do a CMMI-SVC appraisal? Debra Smith Kerry Trujillo November 14-17, 2011 Copyright 2011 Raytheon Company. All rights reserved. October 7-8, 2009 Page 1 Customer Success Is Our Mission is a trademark of Raytheon Company.
Agenda Overview Beginning of the Story Raytheon IDS Organization and Service Process/Tools/Roles Summary End of the Story Questions Presenters Biographies CMMI is registered in the U.S. Patent and Trademark Office by Carnegie Mellon University. Page 2
Overview How do you collect evidence the first time an organization has a CMMI for Services appraisal after only being appraised against CMMI for Development? How do you know what evidence to gather when you ve done CMMI for Development appraisals for years? Raytheon Integrated Defense Systems (IDS) worked with Cooliemon LLC, an external CMMI appraisal lead, to focus on the process, tools, and personnel roles that would create a successful appraisal. Page 3
Beginning of the Story The time: April 1775 The Place: Boston, Massachusetts The Story: Paul Revere had many occupations; silversmith, dentist, Lieutenant in the Massachusetts militia, and Son of Liberty. As a successful businessman he planned his activities, worked with suppliers, and dealt with product defects and customer plaints. He also became a courier for the Boston Committee of Correspondence and the Massachusetts Committee of Safety. He provided news on British movements to people in towns from Boston to New York. Page 4
Raytheon - Integrated Defense Systems (IDS) Page 5
IDS Life-cycle Sustainment Service Note: Acronyms spelled out in the slide notes Page 6
IDS CMMI SVC Timeline First CMMI SVC Workshop 2/2009 Deploy 8/2009 CMMI Class C Appraisal 2/2010 CMMI Class B Appraisal 7/2010 CMMI- SVC SCAMPI Level 3 11/2010 CMMI Class C Appraisal Looked at evidence and conducted interviews. Lots of discovery. CMMI Class B Appraisal Looked at evidence and conducted interviews. Very little discovery. SCAMPI Appraisal Official appraisal that results in a Maturity Level rating. Page 7
Process / Tools / Roles Page 8
CMMI-SVC and CMMI-DEV - 1 Today Reuse Tomorrow 5 Process Areas 17 Core Process Areas 7 Process Areas CMMI DEV CMMI for Development CMMI SVC CMMI for Services CMMI is registered in the U.S. Patent and Trademark Office by Carnegie Mellon University. Page 9
CMMI-SVC and CMMI-DEV - 2 Product Integration (PI) Requirements Development (RD) Technical Solutions (TS) Validation (VAL) Verification (VER) CMMI DEV CMMI for Development Causal Analysis and Resolution (CAR) Configuration Management (CM) Decision Analysis and Resolution (DAR) Integrated Project/Work Management (IPM/IWM) Measurement and Analysis (MA) Organizational Process Definition (OPD) Organizational Process Focus (OPF) Organizational Performance Management (OPM) Organizational Process Performance (OPP) Organizational Training (OT) Process and Product Quality Assurance (PPQA) Project/Work Monitor and Control (PMC/WMC) Project/Work Planning (PP/WP) Quantitative Project/Work Management (QPM/QWM) Requirements Management (REQM) Risk Management (RISKM) Supplier Agreement Management (SAM) CMMI SVC CMMI for Services Capacity and Availability Management (CAM) Incident Resolution and Prevention (IRP) Service Continuity (SCON) Service Delivery (SD) Service System Development (SSD) Service System Transition (SST) Strategic Service Management (STSM) Page 10
Leverage from the Common Process Area Evidence - Configuration Management (CM) CM Plan is program level - Risk Management Risk Management Plan is program level - Work Monitor Control Overall Program Schedule - Measurement and Analysis Measurement Analysis Plan Program Monitor Package Page 11
CMMI for Services for IDS Customer Negotiations and Contract Award Design influence and preparation to ensure Operational Availability, Sustainability, Maintainability, and Mission Assurance Product Delivery and Service Initiation Fielded System Performance Bidding Business Development CMMI for Development Engineering Development and Support Production Product Execution Failure Review Board Corrective Action Requests Engineering Change Proposals Concept Start-up Production Readiness Page 12
IDS Organization Example CBT / IBT IBT 1 IBT 2 IBT 3 Engineering Finance Contracts Business Development Supply Chain Operations Quality IBT = Integrated Business Team is the portion of the IDS organization representing a grouping of programs that provides products and services. CBT = Cross Business Team is the portion of the IDS organization that provides people, processes, tools and technologies across IDS Integrated Business Teams (IBT). Page 13
Program Organization Example IBT CPT = Cross Product Team is a functional team responsible for establishing the process and providing resources to support the IPT. IPT = Integrated Product Team is a multi-functional team responsible for delivering a product or service. CPT / IPT IPT 1 IPT 2 IPT 3 Sys, SW, HW Engineering WL Engineering X X X X Finance X X X Contracts X X X Business Development X X X Supply Chain X X X Operations Quality X X X X X = Represented in Appraisal Page 14
Appraisal Preparation Roles Appraisal Team Representative/Member Provided CMMI-SVC model interpretation SME for each function Created long evidence list Provided experiential knowledge Did not need to know the model Point of contact for each program Deployed updated process Collected evidence as the program executed Statused readiness Page 15
Keys (Reins) to the successful appraisal - 1 Alignment between Appraisal Team and the Programs Appraisal Team overview and discussion meetings War Room Appraisal Team representative provided live feedback to the evidence collectors Questions were answered quickly Review and validation of evidence was immediate Page 16
Keys (Reins) to the successful appraisal - 2 Evidence collection tool Common repository Leverage from the evidence for the core processes Plans, Measurement Reviews, Schedules, Initial list provided from Execution SMEs They own or use the processes everyday use their knowledge This became a long list.. Page 17
Evidence file example -1 Generic Name CPT Meeting minutes CPT Meeting minutes CPT Meeting minutesx1 CPT Meeting minutesx2 CPT Meeting minutes CPT Meeting minutes IPT Meeting minutes IPT Meeting minutes IPT Meeting minutesx1 Process Area IWM SP 1.5 Practice Description of Evidence Link D: IPT/CPT Meeting Logistics https://teamexample.repository. D: CPT Meeting Logistics WMC SP 1.1 https://teamexample.repository. WMC SP 1.5 PMT meeting minutes https://teamexample.repository. WMC SP 1.5 Team Handbook https://teamexample.repository. WMC SP 1.2 D: - CPT Meeting Logistics https://teamexample.repository. SD SP 2.2 D: CPT Meeting Logistics https://teamexample.repository. D: IPT Meeting Minutes DAR GP 2.8 where trade study https://teamexample.repository. discussed. DAR GP 2.7 SD SP 2.2 D: IPT Meeting Minutes where trade study discussed. D: IPT Meetings https://teamexample.repository. https://teamexample.repository. Comment Supportability merged into Logistics CPT after reorg in 2009- hence no meeting PMT Meeting minutes folder - see 3/23/10 file See page 14 (Fig 7) for names of each roles Folder includes examples of CPT meeting minutes Updated Updated 6/22 with Comm Pwr mm IPT Meeting minutes; Operations is an IPT within program structure; Fire Unit meetings is part of the test Radars IPT that is responsible for maintaining radar Done - 5/17/10 Meeting minutes were used in 31 instantiations Page 18
Evidence file example - 2 Generic Name Management Plan Management Plan Management Plan Management Plan Management Plan Management Plan Management Plan Management Plan Management Plan Process Area WP SP 1.4 Practice Description of Evidence Link D:Management Plan Section 4.1.1 WP SP 2.7 D: Management Plan WP SP 3.1 D: Management Plan WP GP 2.4 CAM GP 2.2 CM GP 2.2 DAR GP 2.4 DAR GP 2.2 IWM SP 1.4 D: Management Plan Section 6.2.3 (Roles and Responsibilities) D: Mgmt Plan, CAM planning sect 4, Execution, Sect 5 https://teamexample.repository. https://teamexample.repository. https://teamexample.repository. https://teamexample.repository. https://teamexample.repository. D: Management Plan https://teamexample.repository. D: Management Plan - Roles & Resp. Table 4-1 - Program Management Team does program management iaw with section 4 D: Management Plan section 4.12 https://teamexample.repository. Comment See WLPMP in PDM The program plan was used in 42 instantiations Updated https://teamexample.repository. Updated 6/7 D: Management Plan https://teamexample.repository. Page 19
Keys (Reins) to the successful appraisal - 3 After a C appraisal the evidence list was abridged to the important few 5% reduction in total evidence count after the C appraisal 8% reduction in total evidence count after the B appraisal Evidence collection and validating activities prior to event significantly improved, with less discovery between the C and the B appraisals 85% reduction in number of Document Requests written during the B appraisal Page 20
Summary Organizational support Knowledgeable Appraisal Lead Service SMEs Appraisal SMEs Program points of contact Tie your Service to your business goals and objectives. Collect evidence that is already part of how you do business. Have CMMI model SMEs and service SMEs collaborate. Reduction in evidence collection churn Tool that identifies the top pieces of evidence to collect with mapping to the model Leverage from the CMMI-DEV evidence list COLLABORATION Page 21
End of the Story Paul Revere was successful in delivering his message that the Regulars were ing. We have evidence that he planned for his service, handled resources and incidents, and executed to the plan. Page 22
Questions Page 23
Presenters Biographies Kerry Trujillo Raytheon, Affordability Engineering Section Manager Kerry has 20 years of experience in military, mercial, and government contractor environments. He has also held roles as individual contributor, process engineer, line supervisor, automation engineer, project lead, process group lead, and Naval Officer. He has utilized the CMMI for Services model in a business that maintains multiple sustainment types of contracts (e.g. Repair and Return, Performance Based Logistics, Depot Support, and Field Operations). Debra Smith Raytheon, Process Group Lead Debra has worked more than 15 years in mercial and government contractor environments. Her roles have included research biologist, software engineer, process engineer, IPT Lead, six sigma black belt, line supervisor, and project manager. Debra is currently working for a large aerospace pany on business improvement initiatives that involve both CMMI for Development and CMMI for Services. Page 24
Acronyms CAIV = Cost As an Independent Variable CBT = Cross Business Team CMMI = Capability Maturity Model Integration CPT = Cross Product Team FRACA = Failure Reporting Analysis and Corrective Action HW = Hardware Engineering HSI = Human Systems Integration IBT = Integrated Business Team IPT = Integrated Product Team LCC = Life Cycle Cost RAM = Reliability Availability and Maintainability SCAMPI = Standard CMMI Appraisal Method for Process Improvement Sys = Systems Engineering SW = Software Engineering TOC = Total Ownership Cost WL = Whole Life Engineering (Specialty Engineering) Page 25
Acronyms CMMI DEV and SVC Process Areas CAM = Capacity and Availability Management CAR = Causal Analysis and Resolution CM = Configuration Management DAR = Decision Analysis and Resolution IPM = Integrated Project Management IRP = Incident Resolution and Prevention IWM = Integrated Work Management MA = Measurement and Analysis OPD = Organizational Process Definition OPF = Organizational Process Focus OPM = Organizational Performance Management OPP = Organizational Process Performance OT = Organizational Training PI = Product Integration PMC = Project Monitor and Control PP = Project Planning PPQA = Process and Product Quality Assurance QPM = Quantitative Project/Work Management QWM = Quantitative Work Management RD = Requirements Development REQM = Requirements Management RISKM = Risk Management SAM = Supplier Agreement Management SCON = Service Continuity SD = Service Delivery SSD = Service System Development SST = Service System Transition STSM = Strategic Service Management TS = Technical Solutions VAL = Validation VER = Verification WMC = Work Monitor and Control WP = Work Planning Page 26