CC532 Collaborative System Design

Transcription

1 CC532 Collaborative System Design Part I: Fundamentals of Systems Engineering 6. Systems Engineering Process Standard

2 Why SE Standardization? 2 of 30 SE process Elements Different processes in SE Process 1 Understandable? Process k Architecture Framework Elements activity 1 activity n Different activities in a process Architecture Framework 1 Understandable? Architecture Framework n

3 Standards 3 of 30 Definition is an established norm or requirement. It is usually a formal document that establishes uniform engineering or technical criteria, methods, processes and practices [Wikipedia Encyclopedia] Types of Standard Guideline Style an authoritative source of advice for designers a means of transferring knowledge to designers as part of educational courses The combination of distinctive features of literary or artistic expression, execution, or performance characterizing a particular person, group, school, or era. Specification A detailed, exact statement of particulars, especially a statement prescribing materials, dimensions, and quality of work for something to be built, installed, or manufactured.

4 Process Standard 4 of 30 What is Process Standard? Roles and responsibilities to team Specifying the types of components used by the component-based development Specifying the activities that need to occur in a design, their order, and the intended interaction Enforcing a separation of design and build/code efforts Why Process Standard? To provide a uniform foundation for teamwork To provide a communication means To provide common understanding To provide criteria for assessing performance and quality improvement

5 Systems Engineering(SE) Standards 5 of 30 Process Standards EIA 632 ISO IEEE 1220 CMMI * Architecture Frameworks FEAF DoDAF Zachman FW MoDAF Method Standards Modeling Methods HP SADT OOSE Other Modeling & Simulation Standards UML/SysML IDEF0 HLA Other Modeling Simulation Interchange Standards MOF/XMI STEP/AP-233 CADM

6 Evolution of SE and SW Process Standards 6 of 30 Systems Engineering 1969 MIL-STD- 499 DIDs 1974 MIL-STD- 499A Software Engineering MIL-STD MIL-STD- 1679A 1985 DOD-STD Data Item Descriptions 1987 DOD-STD DOD-STD- 2167A 1988 DOD-STD- 7935A MIL-Std- 499B 1994 EIA/IS- 632 (Interim) 1994 IEEE (Trial Use) 1994 MIL-STD ANSI/EIA IEEE ISO/IEC IEEE/EIA IEEE 1498 /EIA 640 (Draft) 1995 EIA/IEEE J-STD-016 (Interim) 1999 EIA/IS- 731 (SE-CM) 2002 ISO/IEC CMMI Instructions/ Handbooks/ Manuals/ Guides Supersedes Derived From 2003 ISO/IEC Guide ISO/IEC IEEE 1220 Harmon ISO/IEC Harmon DIDs Defense Specification 1995 MIL-STD- 961D 2003 MIL-STD- 961E Source : INCOSE & JOC

7 SE Process: MIL-STD 499B(1994) 7 of 30 System Analysis & Control (Balance) PROCESS INPUT o Customer Needs / Objectives / Requirements - Missions - Measures of Effectiveness - Environments - Constraints o Technology Base o Outputs From Prior Phase o Program Decision Requirements o Requirements Applied Through Specifications and Standards Requirements Analysis o Analysis Missions & Environments o Identify Functional Requirements o Define / Refine Performance & Design Constraint Requirements Requirements Loop Func tional Analysis / Alloc ation o Decompose to Lower-Level Functions o Allocate Performance & Other Limiting Requirements to All Functional Levels o Define / Refine Functional Interfaces (Internal / External) o Define / Refine / Integrate Functional Architecture Design Loop Synthe sis Verification o Transform Architectures (Functional to Physical) o Define Alternative System Concepts, Configuration Items & System Elements o Define / Refine Physical Interfaces (Internal / External) o Select Preferred Product & Process Solutions o Trade-Off Studies o Effectiveness Analysis o Risk Management o Configuration Mgmt o Interface Management o Data Management o Performance Based Progress Measurement - SEMS - TPM - Technical Reviews MIL-STD 499B PROCESS OUTPUT o Phase Dependent - Decision Support Data - System Architecture - Specifications & Baselines Concentrates on integration of disciplines, full life-cycle coverage, assurance of interface integrity, management of technical risks, and validation that the system meets the needs and requirements.

8 SE Process: EIA/IS-632(1994) 8 of 30 Process Input Customer Needs / Objectives / Requirements - Mission / Operations - Measures of Effectiveness - Environments - Constraints Technology Base Prior Output Data Program Decision Requirements Requirements from Tailored Standards & Specifications Requirements Analysis Analyze Missions & Environment Identify Functional Requirements Define / Refine Performance & Design Constraint Requirements Requirements Loop Verification Systems Analysis & Control Functional Analysis / Allocation Decomposition to Lower-Level Functions Allocate Performance & Other limiting Requirements to Lower-Level Functions Define / Refine Functional Interfaces (internal / External) Define / Refine / Integrate Functional Architecture Design Loop Select Preferred Alternatives Trade-off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement - SEMS - TPMs - Technical Reviews Synthesis Transform Architectures (Functional to Physical) Define Alternate Product Concepts Define / refine Functional Interfaces (Internal / External) Define Alternative Product & Process Solutions Integrated Decision Database Decision Support Data System Functional & Physical Architectures Specifications & Baselines Balanced System Solution Process Output EIA: Electronic Industries Alliance

9 SE Process: ANSI/EIA-632(1998) 9 of 30 Planning Process Technical Management Assessment Process Control Process Acquisition Request Plans, Directives, & Status Note: under revision to harmonize w ISO Systems Analysis Process Acquisition and Supply Supply Process Acquisition Process System Design Requirements Definition Process Solution Definition Process Requirements Validation Process Product Realization Implementation Process Transition to Use Process Technical Support CONOPS & Requirements Architectures/Designs Products Product Verification Process Product Validation Process Outcomes & Feedback System Products Note: provides detailed activities and outcomes for each process

10 SE Process: IEEE 1220(1998) 10 of 30 Process Inputs Requirements Analysis Requirements Baseline validation Functional Analysis Functional Verification Synthesis Physical Verification Requirements baseline Validated Requirements baseline Functional architecture Validated functional architecture Physical architecture Verified physical architecture Requirements and constraints conflicts Requirements trade-offs and impacts Decomposition and requirement allocation alternatives Decomposition/allocation trade-offs and impacts Design solution requirements alternatives Design solution trade-offs and impacts Control Requirements trade studies System Functional trade studies Analysis Design trade studies Process Outputs

11 ISO 15288: System Life-Cycle Process(2002) 11 of 30 Enterprise & Agreement Processes Enterprise Environment Management Investment Management System Life Cycle Processes Management Resource Management Planning Assessment Control Decision-making Stakeholder Requirements Definition System Life Cycle Processes Project Processes Implementation Risk Management Technical Processes Requirements Analysis Configuration Management Integration Information Management Architectural Design Quality Management Verification Transition Validation Acquisition Operation Maintenance Disposal Supply Source: INCOSE SE Handbook, v3.0

12 Coverage of Level of Detail Scope of SE Standards 12 of 30 IEEE 1220 EIA 632 MIL-STD-499B EIA/IS 632 ISO/IEC Breadth of Scope Source: S. Sheard, SPC and J. Lake, SMi; 2004

13 Frameworks at Process Assessment View 13 of 30 SDCE SCAMPI ISO Six Sigma EIA 731 PSM SCE ANSI/EIA 632 CBA IPI CMMI IPD- CMM* EIA/IS 632 People CMM SA- CMM SECAM SW-CMM FAAiCMM # FAM* * IEEE 1220 SE-CMM MIL-STD 499B* PSP ISO/IEC SAM TSP SSE- CMM Baldrige Q9000 DOD- STD- 7935A J-STD 016 RTCA DO-178B TL9000 DOD- STD- 2167A MIL-STD- 498 ISO 9000 series DOD- STD IEEE/EIA ISO/IEC ISO/IEC Process Stds Quality Stds Maturity or Capability Models Appraisal methods Guidelines Italic = obsolete boxed = integrating supersedes based on uses/references Source:

14 What is CMMI? 14 of 30 CMMI Capability Maturity Model Integration A proven industry framework to improve product quality and development efficiency for both hardware and software Sponsored by US DoD in cooperation with Carnegie Mellon University and Software Engineering Institute (SEI) Historical Background DoD created SEI at Carnegie Mellon University, early 1990s Interested in CMM relationship to ISO 9000 standards Industry and DoD asked SEI for merger/consolidation included ISO SEI merged process improvement models (SE, SW, Integrated Product and Process Development, SW Acquisition) IPPD (Integrated Product and Process Development) A systematic approach to product development (acquisition) which increases customer satisfaction through a timely collaboration of necessary disciplines throughout the life cycle.

15 Overview of CMMI Evolution 15 of 30 CMM for Software v1.1(1993) Software CMM v2, draft C(1997) INCOSE SECAM * (1996) EIA 731 SECM ** (1998) Systems Engineering CMM v1.1(1995) Integrated Product Development CMM (1997) CMMI for Acquisition v1.2 (2007) v1.02(2000) v1.1(2002) CMMI for Development v1.2(2006) CMMI for Services v1.2 (2007) * SECAM: Systems Engineering Capability Assessment Model ** SECM : Systems Engineering Capability Model

16 CMMI Models and Options 16 of 30 Models for Areas of Interest Product and service development CMMI for Development CMMI-DEV v1.2 (Released Aug 2006) Product and service acquisition CMMI for Acquisition CMMI-ACQ v1.2 (Released Nov 2007) Service establishment, management and delivery CMMI for Service CMMI-SVC v1.2 (Released Feb 2009) CMMI Product Suit (DEV + SEV + ACQ) CMMI v1.3 (to be released) Representation options Essentially the same content but organized different ways Staged Maturity Levels to Measure Process Improvement Predefined sets of process areas define an improvement path for the organization Continuous Capability Levels to Measure Process Improvement Improvements are characterized relative to an individual process area

17 CMMI Process Areas(PAs) 17 of 30 PA: Aspects of product development that are to be covered by organizational processes Aspect Process Management Project Management Engineering Support SE/SW Process Areas(PAs) Organizational Process Focus (OPF) Organizational Process Definition (OPD) Organizational Training (OT) Organizational Process Performance (OPP) Organizational Innovation and Deployment (OID) Project Planning (PP) Project Monitoring and Control (PMC) Supplier Agreement Management (SAM) Integrated Project Management (IPM) Risk Management (RSKM) Quantitative Project Management (QPM) Requirements Management (REQM) Requirements Development (RD) Technical Solution (TS) Product Integration (PI) Verification (VER) Validation (VAL) Configuration Management (CM) Process and Product Quality Assurance (PPQA) Measurement and Analysis (MA) Causal Analysis and Resolution (CAR) Decision Analysis and Resolution (DAR)

18 CMMI Staged Focus on Continuous Process Improvement (2 PAs) Optimizing (Level 5) 18 of 30 Organizational Innovation and Deployment (OID) Causal Analysis and Resolution (CAR) Quantitative Management (2 PAs) Process Standardization (11 PAs) Basic Project Management (7 PAs) Initial (Level 1) Managed (Level 2) Defined (Level 3) Quantitatively Managed (Level 4) Organizational Process Performance (OPP) Quantitative Project Management (QPM) Requirements Development (RD) Technical Solution (TS) Product Integration (PI) Verification (VER) Validation (VAL) Organizational Process Focus (OPF) Organizational Process Definition (OPD) Organization Training (OT) Integrated Project Management (IPM) * Risk Management(RSKM) Decision Analysis and Resolution (DAR) Requirements Management (REQM) Project Planning (PP) Project Monitoring and Control (PMC) Supplier Agreement Management (SAM) Measurement and Analysis (M&A) Process and Product Quality Assurance (PPQA) Configuration Management (CM)

19 CMMI Continuous 19 of 30 CMMI Process Management Project Management Engineering Support Organizational Process Focus(OPF) Organizational Process Definition(OPD) Organizational Training(OT) Organizational Process Performance(OPP) Organizational Innovation and Deployment(OID) Project Planning(PP) Project Monitoring and Control(PMC) Supplier Agreement Mgmt.(SAM) Integrated Project Mgmt.(IPM) Risk Management(RM) Quantitative Project Mgmt.(QPM) Requirements Management(RM) Requirements Development(RD) Technical Solution(TS) Product Integration(PI) Verification Validation Configuration Mgmt.(CM) Process and Product Quality Assurance(PPQA) Measurement & Analysis(MA) Decision Analysis and Resolution(DAR) Causal Analysis and Resolution(CAR) IPPD Acquisition Organizational Environment for Integration(OEI) Integrated Team(IE) Supplier Selection and Monitoring(SSM) Integrated Supplier Management(ISM) Quantitative Supplier Management(QSM)

20 Improvements in CMMI DEV v of 30 CMMI Issues in DoD Sponsor Report Programs execute at lower maturity levels than their organizations have achieved and advertised High-maturity practices are not consistently applied at the project level after contract award How to ensure new projects will incorporate CMMI processes Appraisal sampling procedures how to ensure adequate coverage of the organizational unit Appraiser quality training, consistency Lack of agreement on what constitutes Levels 4 and 5 Need to converge to a single representation Content of appraisal disclosure statements is lacking Inadequate training and education for acquirers Summary Improvements in CMMI-DEV v1.2 [August, 2006] New material added to CMMI v1.2 to ensure processes used at project start-up Appraisal Disclosure Statement (ADS) improved Sampling rules improved High maturity appraiser certification instituted CMMI guide for Acquisition Orgs to leverage Supplier s efforts 3/07 CMMI Acquisition in final draft Source: NDIA SE Conf., 10/06 K. Baldwin

21 CMMI DEV v1.2(2006) 21 of 30 V 1.1 (2002) V 1.2 (2006) Supplier Sourcing Integrated Product and Process Development IPPD Organizational Goal (OPD) Project Goal (IPM) SW Related Examples SE Related Examples SW Related Examples SE Related Examples Hardware Related Examples CMMI Core CMMI Core (now includes SS) Sources incl EIA-731(SECM) Source: SEI

22 DoD 5000 Acquisition Process 22 of 30 Specification contained in several directives Provide a disciplined approach to integrating the acquisition process DODD The Defense Acquisition System DODI Operation of the Defense Acquisition System DOD Cost Analysis Guidance and Procedures User Needs & Technology Opportunities Process entry at Milestones A, B, or C Entrance criteria met before entering phase Evolutionary Acquisition or Single Step to Full Capability A B (Program Initiation) C Initial Operational Capability Full Operational Capability Concept Refinement Technology Development System Development & Demonstration Production & Deployment Operations & Support Concept Decision Design Readiness Review LRIP/IOT&E FRP Decision Review Pre-Systems Acquisition Systems Acquisition Sustainment

23 SE Guidelines and CMMI 23 of 30 DOD 5000 Acquisition Process EIA 632 Processes for Engineering a System IEEE/EIA Software Life Cycle Processes Supports EIA/IS 731 Systems Engineering Capability IPPD CMM CMMI SW-CMM Software Capability Maturity Model SA-CMM Software Acquisition

24 SE Standards/Models Mapping - Life Cycle Phases 24 of 30 ISO EIA 632 IEEE 1220 CMMI-DEV DoD/DAG [DoDI ] Concept Pre-system Definition Concept Concept, Exploration, Vision Concept, Development Development System Def., Subsystem design, Detailed design System Def., Subsystem design, Detailed design Feasibility, Design, Development Tech Development, System Development & Demonstration Production End product, Physical Production Utilization Utilization Operations Support Support Production, Manufacturing, Delivery Support, Maintenance, Sustainment Production & Deployment Operations & Support [O&S] O&S, Sustainment Retirement Retirement Disposal, Phase Out O&S, Disposal

25 SE Standards/Models Mapping - Management 25 of 30 ISO EIA-632 IEEE-1220 CMMI-DEV Project Planning Planning Planning Tech Effort, SE Integration, of SE Effort Project Planning, Integrated PM, Quantitative PM Project Assessment Assessment Control Project Monitoring & Control, M&A, Quantitative PM Project Control Control Control Project Monitoring & Control Decision Making Systems Analysis Systems Analysis Measurement & Analysis (M&A), Decision Analysis & Resolution, Quantitative PM, Causal Analysis & Resolution, DoD/DAG [DoDI ] Technical Planning; Interface Mngt. Technical Assessment Interface Mngt. Decision Analysis Risk Mngt. Systems Analysis Systems Analysis Risk Mngt. Risk Mngt. Configuration Management (CM) Information Mngt. Agreement, Acquisition & Supply Enterprise: Environment, Life Cycle, Resource, & Quality Mngt. CM Control, Info Dissemination Acquisition & Supply Environment & Enterprise Support CM, Int. repository/ Data pkg. Control, Integrated DB/pkg. QM, Product & Process Improvement CM; Requirements Mngt. Integrated PM, CM Supplier Agreement Mngt. Organizational processes, Process & Product QA CM; Requirements Mngt. Technical Data Mngt.

26 SE Standards/Models Mapping - Technical 26 of 30 ISO EIA-632 IEEE-1220 CMMI-DEV Stakeholder Requirements Definition Requirements Analysis Requirements Definition Requirements Analysis Requirements Development Systems Analysis (SA) Requirements & Functional Analysis, SA Architectural Design Solution Definition Synthesis, SA, Implementation Integration Implementation, Production Modeling, Spec. tree, SBS Prototyping, Fabrication, Assembly, Production Integration Verification System Verification Functional and Design Verification, Tech reviews Validation Transition Operation, Maintenance and Disposal Requirements and End Products Validation Transition to Use Requirements Validation, Tech Reviews, Test Requirements Development Technical Solution Technical Solution Product Integration Verification Validation Product Integration, Org. Innovation & Deployment, Org. Training Field Support Support Operations, Support, Maintenance, Sustainment, Disposal DoD/DAG [DoDI ] Requirements Development Logical Analysis Design Solution Implementation Integration Verification Validation Transition

27 Abbreviations(1) 27 of 30 ANSI American National Standards Institute CADM C4ISR Architecture Data Model CBA IPI CMM-Based Appraisal for Internal Process Improvement CMMI Capability Maturity Model Integration DID Data Item Descriptions DoD United States Department of Depense DoDAF DoD Architecture Framework DoD/DAG DoD Defense Acquisition Guidebook DoD-STD DoD Standard EIA Electronics Industries Alliance FAA-iCMM Federal Aviation Administration Integrated Capability Maturity Model FAM Federal Aviation Administration Appraisal Method FEAF Federal Enterprise Architecture Framework HLA High Level Architecture. HP Hewlett-Packard IDEF0 Integration DEFinition language 0 IDP-CMM Integrated Product Development CMM

28 Abbreviations(2) 28 of 30 IEC International Electrotechnical Commission IEEE Institute of Electrical and Electronics Engineers IEEE CS IEEE Computer Society INCOSE International Council on Systems Engineering ISO International Organization for Standardization JOC Joint Operation Concept J-STD Joint Standard JTC1 ISO/IEC Joint Technical Committee 1 MIL-STD Military Standard MoDAF Ministry of Defense Architecture Framework MOF/XMI Meta Object Facility/XML Metadata Interchange OOSE Object-Oriented Software Engineering People CMM People Capability Maturity Model PSP Personal Software Process RTCA/DO-178B Radio Technical Commission for Aeronautics/Design Objective-178B Q9000 Quality 9000

29 Abbreviations(3) 29 of 30 SA-CMM Software Acquisition Capability Maturity Model SADT System Analysis & Design Technique SCE Software Capability Evaluations SDCE Software Development Capability Evaluation SECAM Systems Engineering Capability Assessment Model SE-CMM Systems Engineering Capability Maturity Model SAM SE-CMM Appraisal Method SSE-CMM Systems Security Engineering Capability Maturity Model STEP/AP-233 Standard for Exchange of Product Data/Application Protocol 233 SW-CMM Software-Capability Maturity Model TL9000 Telecommunications Leadership 9000 TSP Team Software Process UML/SysML Unified Modeling Language/Systems Modeling Language Zachman FW Zachman Framework

30 SE Sources 30 of 30 Web site links: ISO 15288: EIA 632: IEEE 1220: SEI-CMMI: Systems & Software Consortium: DAU-DAG: DoD(AT&L) SE: AF Center for SE; INCOSE Standards TC References: SE Standards & Models Compared ; J. Lake (SMi) and S. Sheard (SPC), INCOSE 2004 Evolution of a Standard EIA-632 ; R. Harwell, INCOSE 2006 Cross-Cultural Issues Associated with the Application of ISO/IEC Standard ; T. Ferris, INCOSE 2006 INCOSE Insight: Special Feature: Standards in SE, April 2007; see particularly K. Crowder, D. Kitterman, T. Doran, R. Harwell, and S. Arnold articles.