Mary Beth Chrissis, as represented by: Pat O Toole Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 15213 May 15, 2008
CMMI Today The CMMI Product Suite was released 1/2002 and today CMMI website averages 20,000 visits/day Over 80,000 people have been trained Over 3,000 class A appraisals have been reported to the SEI Global adoption is steadily growing. 2
CMMI Transition Status As reported to the SEI as of 3-31-08 Training Introduction to CMMI 84,074 Intermediate CMMI 2,726 Understanding CMMI High Maturity Practices 396 Authorized Introduction to CMMI V1.2 Instructors 430 SCAMPI V1.2 Lead Appraisers 488 SCAMPI V1.2 B&C Team Leaders 499 Certified V1.2 High Maturity Lead Appraisers 138 CMMI-ACQ V1.2 Instructors 18 CMMI-ACQ V1.2 Lead Appraisers. 7 3
Transition from V1.1 to V1.2 Status As reported to the SEI as of 3-31-08 Introduction to CMMI Students Registered for Upgrade Training 6,540 Upgrades Complete 5,491 Lead Appraisers and Instructors Registered for Upgrade Training 678 Upgrade Completed. 608 4
Number of Appraisals Conducted by Year Reported as of 4-30-08 1200 1000 800 600 400 200 0 SPA CBAIPI(Discontinued after 12/31/2005) SCAMPI v.x ClassA 5
Number of SCAMPI Class A Appraisals Conducted by Year by Representation* as of 4-30-08 *Where Representation is reported 1000 900 800 700 600 Staged Continuous 500 400 300 200 100 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 4/30/2008 6
SCAMPI v1.1/v1.2 Class A Appraisals Conducted by Quarter Reported as of 4-30-08 350 325 300 275 250 225 200 175 150 125 100 75 50 25 0 7
Intro to the CMM and CMMI Attendees (Cumulative) as of 3-31-08 90000 80000 70000 60000 50000 CMM Intro (discon'td. 12/31/05) 40000 30000 CMMI Intro 20000 10000 CMMI Intermediate 0 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 8
Organization Size Based on the total t number of employees within the area of the organization that t was appraised 1001 to 2000 3.7% 501 to 1000 2000+ 6.8% 25% 2.5% 301 to 500 7.4% 25 or fewer 13.6% 201 to 2000+ 29.4% 9.0% 1 to 100 50.8% 201 to 300 26 to 50 15.6% 101 to 200 19.8% Based on organizations reporting size data 76 to 100 8.9% 51 to 75 12.8% 2635 9
Countries where Appraisals have been Performed and Reported to the SEI Red country name: New additions with this reporting Argentina Australia Austria Bahrain Bangladesh Belarus Belgium Brazil Bulgaria Canada Chile China Colombia Costa Rica Czech Republic Denmark Dominican Republic Egypt Finland France Germany Hong Kong Hungary India Indonesia Ireland Israel Italy Japan Korea, Republic Of Latvia Malaysia Mauritius Mexico Morocco Netherlands New Zealand Norway Pakistan Peru Philippines Poland Portugal Romania Russia Saudi Arabia Singapore Slovakia South Africa Spain Sweden Switzerland Taiwan Thailand Turkey Ukraine United Arab Emirates United Kingdom United States Uruguay Viet Nam 10
Number of Appraisals Reported to the SEI by Continent 1600 1400 1354 Numb ber of Appra aisals 1200 1000 800 600 1080 400 403 200 208 38 30 0 Africa Asia Europe North America Oceania South America 3113 Based on appraisals 11
Number of Appraisals and Maturity Levels Reported to the SEI by Country Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Maturity Level 5 Reported Country Maturity Level 1 Reported Maturity Level 2 Reported Maturity Level 3 Reported Maturity Level 4 Reported Country Number of Appraisals Number of Appraisals Argentina 47 31 10 2 3 Malaysia 42 15 24 3 Australia 29 1 8 4 2 4 Mauritius 10 or fewer Austria 10 or fewer Mexico 39 1 18 13 3 4 Bahrain 10 or fewer Morocco 10 or fewer Bangladesh 10 or fewer Netherlands 10 or fewer Belarus 10 or fewer New Zealand 10 or fewer Belgium 10 or fewer Norway 10 or fewer Brazil 79 37 31 1 8 Pakistan 14 1 8 3 1 Bulgaria 10 or fewer Peru 10 or fewer Canada 43 10 18 5 3 Philippines 20 2 10 7 Chile 20 13 5 1 Poland 10 or fewer China 465 1 103 293 18 34 Portugal 10 or fewer Colombia 18 6 9 1 2 Romania 10 or fewer Costa Rica 10 or fewer Russia 10 or fewer Czech Republic 10 or fewer Saudi Arabia 10 or fewer Denmark 10 or fewer Singapore 16 3 8 1 4 Dominican Republic 10 or fewer Slovakia 10 or fewer Egypt 27 12 11 2 2 South Africa 10 or fewer Finland 10 or fewer Spain 75 1 49 21 1 3 France 112 4 67 34 1 2 Sweden 10 or fewer Germany 51 7 27 7 1 1 Switzerland 10 or fewer Hong Kong 14 1 9 4 Taiwan 88 60 25 2 Hungary 10 or fewer Thailand 10 or fewer Idi India 323 1 11 127 22 151 Turkey 10 or fewer Indonesia 10 or fewer Ukraine 10 or fewer Ireland 10 or fewer United Arab Emirates10 or fewer Israel 16 3 9 2 United Kingdom 71 3 36 24 1 2 Italy 17 9 8 United States 1034 25 365 347 21 114 Japan 220 16 64 88 13 15 Uruguay 10 or fewer Korea, Republic Of 107 1 31 48 11 7 Viet Nam 10 or fewer Latvia 10 or fewer Maturity Level 5 Reported 12
Number of Appraisals Posted to PARs by Year 1200 1000 POSTED 904 1006 TOTAL 834 800 Number of Appraisals 600 437 598 635 400 384 200 186 214 0 52 76 6 2002 2003 2004 2005 2006 2007 13
Performance Results Summary # of data Improvements Median points Low High Cost 20% 21 3% 87% Schedule 37% 19 2% 90% Productivity 67% 16 11% 255% Quality 50% 18 29% 132% Customer Satisfaction 14% 6-4% 55% Return on Investment 4.8 : 1 14 2 : 1 27.7 : 1 N = 25, as of 15 December 2005 Organizations with results expressed as change over time 14
A Program s Capability Contractor A ML 3 My Program Contractor B ML 4 Contractor C Acquirer ML 5 ML? CMMI Math: 3 + 4 + 5 +? =? CMMI for Acquisition (CMMI-ACQ) Phillips, April 2, 2008 15
How Capable is the Team? Early: How capable is a program team to deliver an operational capability? Ongoing: How well is the program performing? CMMI Maturity Levels at the organizational level are necessary, but not sufficient, to provide answers to these questions at the program level. 16
Maturity Levels Important Realities Know the capabilities of your entire program team Multiple contractors, each appraised at CMMI Maturity Level 3, does not ensure that your project will execute at Maturity Level 3 Processes may be incompatible Communication may be inadequate A contractor appraised at Maturity Level 3 does not ensure that your project will execute at Maturity Level 3 Was your team part of the process evaluation? Is your team following the processes? An acquisition organization without mature processes can hurt a mature contractor 17
Acquirer/Supplier Mismatch High Acquirer Mismatch mature acquirer mentors low maturity supplier Matched acquirer and supplier are both high maturity predictable success not routcome highest probability of Lo ow Disaster no discipline no process no product Mismatch less mature acquirer derails mature supplier; encourages short cuts supplier compromises processes Technical & Management Skill Low Supplier High 18
Interpreting CMMI Ratings 1. A CMMI rating or CMMI level is not a guarantee of program success 2. Organizations that have attained CMMI maturity level ratings do not necessarily apply those appraised processes to a new program at program start-up 3. Organizations that claim CMMI ratings are not always dedicated to process improvement 4. Organizations may sample only a few exemplar programs and declare that all programs are being executed at that CMMI level rating 5. Organizations that claim a high maturity level rating (level 4 and 5) are not necessarily better suppliers than a level 3 supplier. Understanding and Leveraging a Supplier s CMMI Efforts: A Guidebook for Acquirers, April 2007, CMU/SEI-2007-TR-004 19
Beyond CMMI V1.2 Improved architecture will allow post-v1.2 expansion Extensions of the life cycle (Services, Outsourcing/Acquisition) could expand use of a common organizational framework: allows coverage of more of the enterprise or potential partnering organizations adapts model features to fit non-developmental efforts (e.g., CMMI Services, CMMI Acquisition). 20
Three Complementary Constellations CMMI-DEV provides guidance for measuring, monitoring and managing development e e processes CMMI-SVC CMMI-SVC provides guidance for those providing services within organizations and to external customers 16 Core Process Areas, common to all CMMI-DEV CMMI-ACQ CMMI-ACQ provides guidance to enable informed and decisive acquisition leadership 21
CMMI-ACQ Staged Representation: PAs by Maturity Level Maturity Level Optimizing Quantitatively Managed Defined Managed Process Areas Causal Analysis and Resolution Organizational Innovation and Deployment Quantitative Project Management Organizational Process Performance Organizational Process Focus Organizational Process Definition Organizational Training Integrated Project Management Risk Management Acquisition Technical Management Acquisition Verification Acquisition Validation Decision Analysis and Resolution Acquisition Requirements Development Agreement Management Project Planning Project Monitoring and Control Requirements Management Configuration Management Process and Product Quality Assurance Measurement and Analysis Solicitation and Supplier Agreement Development 22
CMMI-ACQ v1.2 Acquisition Category Process Areas Solicitation & Supplier Agreement Development Agreement Management Acquisition Requirements Development Acquisition Technical Management CMMI Model Framework (CMF) 16 Project, Organizational, and Support Process Areas Acquisition Verification Acquisition Validation 23
CMMI-SVC v0.5 Reuse CMMI for Services Constellation = 22 PAs + 3 Optional PAs Service PAs Shared PAs (SAM) CMMI-SVC 5 3 22 Service Addition PAs Service Modifications: 77% % of CMMI-DEV PAs are reused; % of Corporate Investments are potentially reusable! 1 16 CMMI Model Foundation 21 amplifications in 7 PAs 5 added references 1 modified PA (REQM) 1 specific goal 2 specific practices CMMI-DEV CMMI-ACQ 24
Who is the audience? Broad spectrum of service providers Primarily intended for industry use, just like CMMI-DEV Service Sector Weights Focus on current CMMI users 30% PAMS Professional, 25% Administrative, Management Support 20% 15% 10% 5% 0% PAMS R & D FRS ERS CRS ICT Other Medical R & D Research and Development FRS Facilities-Related Services ERS Equipment-Related Services CRS Construction-Related Services ICT Information and Communications Technology Source: FY06 Federal Procurement Data System 25
Planned Sequence of Models CMMI-SVC March 2009 CMMI V1.1 CMMI-DEV V1.2 CMMI V1.3? TBD CMMI-AM GM IT Sourcing CMMI-ACQ Released November 2007 SA-CMM 41 26
For More Information Mary Beth Chrissis CMMI Training Manager CMMI Project Telephone: +1 412-268-5757 Email: mb@sei.cmu.edu edu PACT.otoole@att.net U.S. mail: Software Engineering g Institute Customer Relations 4500 Fifth Avenue Pittsburgh, PA 15213-26122612 USA World Wide Web: www.sei.cmu.edu Customer Relations Email: customer-relations@sei.cmu.edu www.sei.cmu.edu/contact.html edu/contact Telephone: +1 412-268-5800 SEI Phone: +1 412-268-5800 SEI Fax: +1 412-268-6257 27
28