System Cost Modeling Using Proxy Estimation and COSYSMO
|
|
- Chloe Tate
- 6 years ago
- Views:
Transcription
1 System Cost Modeling Using Proxy Estimation and COSYSMO October 21, 2014 Reggie Cole Lockheed Martin Senior Fellow Kevin Woodward Lockheed Martin Fellow 1
2 We Have a Problem That COSYSMO Can Address BBP 3.0 Mandates: Should-Cost Design-to-Cost Design for Affordability The Tool Gap But We Have a Tool Gap Early-Stage Cost Modeling System Cost Modeling COSYSMO Can Be Extended to Cover the System Cost Modeling Gap 2
3 Background on Previous Work Between 2007 and 2012 We realized that COSYSMO could provide insight into changing SE effort not just an initial estimate Which in turn allowed us to understand how the overall system scope was changing in other words it was a proxy We found a way to change the proxy into system cost estimate COCOMO Forum 2012 We presented the initial approach, Proxy Estimation Costing for Systems (PECS) We started using what we called PECS for design-to-cost analysis and analysis of alternatives COCOMO Forum 2013 We conducted a workshop on the approach and made the decision to consider integrating it with the next revision of COSYSMO Over the Past Year We have continued to use the approach, starting planning for broader validation and started discussing how the approach would be integrated with COSYSMO 3
4 SE Effort is a Proxy Measure of Overall System Size and Complexity System Engineering Effort is a Proxy Measure for System Cost There is strong evidence for the link between systems engineering effort and program cost dating back to a NASA study in the 1980s The optimal relationship between systems engineering effort and overall program cost is 10% - 15% Industry has long used a parametric relationship between software cost and systems engineering cost for software-intensive systems Systems engineering effort can be an effective proxy measure for overall system cost But We Can Convert the Systems Engineering Effort Into a System Cost Estimate Develop a bias function the that turns the biased proxy estimator into an unbiased true estimator Use the established relationship between SE effort and total system effort to partially de-bias the proxy estimate Add in additional parameters to complete the de-biasing process 4
5 Actual/Planned Cost Putting It All Together Size Drivers (Problem Space) Customer Requirements System Interfaces Major Algorithms Operational Scenarios Complexity Drivers (Problem/Solution) Requirements Understanding Architecture Understanding Level of Service Requirements Migration Complexity Technology Risk Documentation Needs Installations/Platform Diversity Levels of Recursion in the Design Stakeholder Team Cohesion Personnel/Team Capability Personnel Experience/Continuity Process Capability Multisite Coordination Tool Support Reuse Factors (Solution Space) New Modified Deleted Adopted Managed SE Effort is an estimator for total system cost but it is a biased estimator Estimator De-Biasing Monte Carlo Analysis of System Cost Estimator Bias Function is Based on the Well- Established Relationship Between SE Effort and Overall Program Effort 0% 4% 8% 12% 16% 20% 24% 28% Where : Cal Conv SE Effort = SE Quality * SE Cost/Actual Cost Cal Labor CostSystem Effort SE StochasticAdders Cost FConv F F Effort Rate :COSYSMO Calibration Factor (Deterministic) : Factor for Converting SE Effort tototalprogram Effort (Stochastic) SE Labor :SE Effort ComputedUsing COSYSMO (Stochastic) StochasticAdders : Labor Rate (Stochastic) Cost F Deter min isticadder s Deter min isticadder s : Additional Factors (e.g., travel, material, etc.) (Stochastic) Cost Rate : Additional Factors (G & A,ODC, MR,Fee, etc.) (Deterministic) Cost Three different COSYMO scenarios optimistic, expected & pessimistic provide the basis for the Monte Carlo analysis of system cost 5
6 Adjusting Our View of COSYSMO Parameters Our view of the size drivers can be preserved their context doesn t change under COSYSMO extension Our view of reuse requires the most extreme adjustment we are not just talking about systems engineering artifacts Our view of the cost drivers needs to be broadened to include all aspects of the system, not just systems engineering 6
7 Adjusting Our View of Cost Drivers Cost Drivers Requirements Understanding Architecture Understanding Level of Service Requirements Migration Complexity Technology Risk Level of Documentation Required Diversity of Installed Platforms Level of Design Recursion Stakeholder Team Cohesion Personnel / Team Capability Personnel Experience / Continuity Process Capability Multisite Coordination Level of Tool Support Precedented systems and unprecedented systems are fundamentally different System modification and reuse have a significant effect on some cost drivers Need to consider the entire team including subcontractors Need to consider the all processes and tools 7
8 Adjusting Our View of Reuse Factors New Elements These are elements that need to be engineered and developed. Just reusing systems engineering artifacts is not sufficient. Reuse Factors New Elements Modified Elements Deleted Elements Adopted Elements Managed Elements Modified Elements These are elements that offer some form of reuse. Enhanced COTS or reusable components that need modification fall into this category. Adopted Elements These are elements that offer significant reuse with minimal modification and do not require full retesting. COTS typically falls into this category. For Requirements Think Functional Components For Interfaces Think Connection Points For Algorithms Think Functional Components For Scenarios Think Implications to Both Managed Elements These are elements that are already in the system and require minimal regression testing. A previously deployed element falls into this category. 8
9 The Bias Function Cal Labor CostSystem Effort SE StochasticAdders Cost FConv Where : F F Cal Conv Effort Rate : COSYSM O Calibration Factor (Deterministic) : Factor for Converting SE Effort tototal Program Effort (Stochastic) SE Labor :SE Effort Computed Using COSYSM O (Stochastic) StochasticAdders : Labor Rate (Stochastic) Cost F Deter min isticadder s : Additional Cost Rate : Additional Deter min isticadder s Factors (e.g., travel, material, etc.) (Stochastic) Variable Type Description Cost Factors (G & A,ODC, MR,Fee, etc.) (Deterministic) COSYSMO Calibration Factor Deterministic Scalar Value Organization-specific calibration factor Effort Conversion Factor Triangular Distributed Random Variable Three-point estimate of factor to convert SE effort to total program effort (nominally 0.08, 0.12 and 0.16) SE Effort Triangular Distributed Random Variable Three-point estimate for SE effort, generated using COSYSMO Labor Rate Triangular Distributed Random Variable Three-point estimate for composite labor rate Material Costs Triangular Distributed Random Variable Three-point estimate for material costs Travel Costs Triangular Distributed Random Variable Three-point estimate for travel costs We are going to discuss each of these factors! 9
10 SE Effort (Effort SE ) COSYSMO provides a Proxy Estimate of the system cost. We will not try to de-bias it right now.that is the next step. Size Drivers (Problem Space) Customer Requirements System Interfaces Major Algorithms Operational Scenarios Complexity Drivers (Problem/Solution) Requirements Understanding Architecture Understanding Level of Service Requirements Migration Complexity Technology Risk Documentation Needs Installations/Platform Diversity Levels of Recursion in the Design Stakeholder Team Cohesion Personnel/Team Capability Personnel Experience/Continuity Process Capability Multisite Coordination Tool Support Since we want to perform Monte Carlo simulation of costs, we would like to generate a distribution of the proxy costs. Three different COSYMO scenarios optimistic, expected & pessimistic provide the basis for a sampling distribution. Optimistic Expected Pessimistic Reuse Factors (Solution Space) New Modified Deleted Adopted Managed COSYSMO Estimate of Hours Becomes the Parameters for Either Triangular or Beta Pert Distribution Triangular Distribution Beta Pert Distribution 10
11 Actual/Planned Cost Program Overrun Effort Conversion Factor (F Conv ) This is probably the most important factor in the bias function! Total Program Overrun 32 NASA Programs Definition $ Definition Percent = Target + Definition$ Actual + Definition$ Program Overrun = Target + Definition$ R 2 = Definition Percent of Total Estimate Studies provide some insight into what the value should be Heuristic approaches for determining SE costs for software intensive systems are also consistent with these studies All indications point to a range of 0.08 to 0.16 for F Conv And this range is consistent with all the data we ve collected to date for relatively healthy programs And it provides the basis for our random variable parameters % 4% 8% 12% 16% 20% 24% 28% Pessimistic Expected Optimistic SE Effort = SE Quality * SE Cost/Actual Cost Triangular Distribution Beta Pert Distribution 11
12 Other Stochastic Adder Factors Labor Costs Labor costs vary especially in early stages and needs to be treated as a random variable Any number of distributions would probably be OK Beta Pert would be a good default If hours are the item of interest rather than cost, this factor can be omitted Material Costs Material costs vary especially in early stages and needs to be treated as a random variable Any number of distributions would probably be OK Beta Pert would be a good default but there is at least one study that looks at using a normal distribution If hours are the item of interest rather than cost, this factor can be omitted Travel Costs Travel costs vary especially in early stages and needs to be treated as a random variable Any number of distributions would probably be OK Beta Pert would be a good default If hours are the item of interest rather than cost, this factor can be omitted Other Any number of other stochastic adders can be treated similarly 12
13 Other Deterministic Adders Some Factors Are Well Known To the Point They Can Be Considered Deterministic They are often set and apply across programs Examples include: G&A Costs Other Direct costs Management Reserve Fee 13
14 Consideration of Additional Parameters 2013 Workshop Identified the Need to Take a Closer Look at the Parameters The meaning, interpretation and scope of existing COSYSMO parameters COCOMO parameters that might be meaningful when COSYSMO is used in this way 14
15 Analysis of Additional Parameters COSYSMO COCOMO There seems to be a lot of system cost modeling relevancy in the COCOMO parameters There seems to be a lot of correlation between COSYSMO and COCOMO with respect to system cost modeling 15
16 The Key Use Cases Should-Cost Analysis Establishing a should-cost for which cost estimates from bidders can be evaluated Establishing a DTC target for performing DTC analysis Design-to-Cost Analysis Performing cost vs. capability trades as way to provide more affordable solutions Analysis of Alternatives Evaluating alternative solution strategies It s not just about the problem space the solution space can be evaluated too 16
17 Should-Cost Analysis Example Optimistic Expected Pessimistic Requirements Baseline Requirements Interfaces Algorithms Architecture Baseline Scenarios Use a Plug Number for Adders Anticipated Distribution of Labor Rates Anticipated Distribution of Material Costs Anticipated Travel Costs Anticipated Supplier Fees Bias Function Risky Range Target Cost Target Reserve 17
18 DTC Example Cost Analysis Requirements Baseline Requirements Interfaces Optimistic Expected Pessimistic Architecture Baseline Algorithms Scenarios Three COSYSMO Scenarios for Each Capability Use a Common Number for Adders Anticipated Distribution of Labor Rates Anticipated Distribution of Material Costs Anticipated Travel Costs Anticipated Supplier Fees Bias Function A Cost Curve is Produced for Each Capability Take the 80% Confidence Cost as the Capability Cost 18
19 DTC Example Capability Trade-Off Capabilities Sorted By Cost Colors Map Mission Utility Priorities RED = High YELLOW = Medium Green = Low Capabilities Sorted By Mission Utility (Cost for Priority 1 Capabilities Only) (Capabilities at DTC Target) (Cost for Priority 1&2 Capabilities) (Cost for All Capabilities) 19
20 Analysis of Alternatives Example 20-Year Old C2 System The system was unprecedented at the time Twenty years later, a replacement system is needed due to obsolescence and needed changes Alternative Solutions Full Replacement System Develop and deploy a new replacement system COTS/GOTS/NDI-Based Replacement System Use a combination existing non-obsolete components and COTS components Modify components as necessary to meet requirements 20
21 The Two Key Alternatives Newly Developed System Ground-Up Development of System Requirements Refinement, Architecture, Detailed Design Soup-to-Nuts But It is No Longer an Unprecedented System So Requirements/Architecture Understanding, etc. Are High Refurbished System Using Modified NDI Use of NDI is Maximized Additional Components Developed as Necessary to Meet Requirements Reuse Considerations Drive This Alternative 21
22 COSYSMO Size and Cost Drivers Size Drivers for the Two Alternatives Are Largely the Same Cost Drivers for the Two Alternatives Are Very Similar With a Few Notable Exceptions Cost Drivers Requirements Understanding Architecture Understanding Level of Service Requirements Migration Complexity Technology Risk Level of Documentation Required Diversity of Installed Platforms Level of Design Recursion Stakeholder Team Cohesion Personnel / Team Capability Personnel Experience / Continuity Process Capability Multisite Coordination Level of Tool Support System modification and reuse have an effect on some cost drivers 22
23 COSYSMO Reuse Factors Reuse Factors New Elements Modified Elements Deleted Elements Adopted Elements Managed Elements New Elements These are elements that need to be engineered and developed. Just reusing systems engineering artifacts is not sufficient. Modified Elements These are elements that offer some form of reuse. Enhanced COTS or reusable components that need modification fall into this category. Deleted Elements For the NDI Alternative, Some Elements May Need to Be Deleted/Retired Adopted Elements These are elements that offer significant reuse with minimal modification and do not require full retesting. COTS typically falls into this category. Most Elements Are New for the Development Alternative Most Elements Are Modified for the NDI Alternative Elements That Need to Be Retired Should Be Treated as Deleted Elements Elements That Are Wrapped Can Be Treated as Adopted for the NDI Alternative Managed Elements These are elements that are already in the system and require minimal regression testing. A previously deployed element falls into this category. Elements That Stay in Place Without Modification (or Wrapping) Can Be Treated as Managed 23
24 Cost Analysis Approach Requirements Baseline Requirements Interfaces Optimistic Expected Pessimistic Architecture Baseline Algorithms Scenarios Three COSYSMO Scenarios for Each Alternative Use a Common Number for Adders Anticipated Distribution of Labor Rates Anticipated Distribution of Material Costs Anticipated Travel Costs Anticipated Supplier Fees Bias Function A Cost Curve is Produced for Each Capability Take the 80% Confidence Cost as the Capability Cost 24
25 But This is Not Really COSYSMO Right? The Scope of COSYSMO is Systems Engineering Effort But the scope of this approach is total delivered system cost COSYSMO is a Fully Parametric Model But this is a hybrid model that consists of parametric modeling and Monte Carlo simulation This Approach is Not COSYSMO It uses COSYSMO to develop the proxy estimate in other words, COSYSMO serves as an input Eventually This Will Likely Become Part of COSYSMO Those discussions are ongoing 25
26 Summary COSYSMO provides the basis for estimation of systems engineering effort and a biased proxy estimator for overall system cost There is a well-established relationship between systems engineering effort and overall effort used to de-bias the COSYSMO-modeled effort This approach can improve system cost modeling but it is not a replacement for existing models This approach occupies an important niche fully parametric system cost modeling in the early stages of system definition This approach can serve as a powerful affordability analysis tool supporting should-cost, DTC and AoA 26
27 27
Methodology for the Cost Benefit Analysis of a Large Scale Multi-phasic Software Enterprise Migration
Methodology for the Cost Benefit Analysis of a Large Scale Multi-phasic Software Enterprise Migration Bryce Meyer Jerry Jackson Jim Wessel Software Engineering Institute Carnegie Mellon University Pittsburgh,
More informationEconomic Impact of Reuse on Systems Engineering
Economic Impact of Reuse on Systems Engineering Dr. Ricardo Valerdi Massachusetts Institute of Technology rvalerdi@mit.edu 4 th Annual IeMRC Conference Loughborough University September 2, 2009 IeMRC 4
More informationReducing Risk and Uncertainty in COSYSMO Size and Cost Drivers: Some Techniques for Enhancing Accuracy
Reducing Risk and Uncertainty in COSYSMO Size and Cost Drivers: Some Techniques for Enhancing Accuracy Ricardo Valerdi MIT; 77 Massachusetts Ave., Cambridge, MA 02139 rvalerdi@mit.edu John E. Gaffney,
More informationAddressing the Challenges of Systems Engineering Estimation
Addressing the Challenges of Systems Engineering Estimation Karen McRitchie/Kathy Kha, Galorath Incorporated 2016 Copyright Galorath Incorporated 1 ABSTRACT Cost is a crucial factor in evaluating the viability
More informationCOSYSMO: A Systems Engineering Cost Model
COSYSMO: A Systems Engineering Cost Model Ricardo Valerdi and Barry W. Boehm Abstract: Building on the synergy between Systems engineering and Software Engineering, we have developed a parametric model
More informationSEER for Systems Engineering Webinar February 24, Copyright Galorath Incorporated 1
SEER for Systems Engineering Webinar February 24, 2016 2016 Copyright Galorath Incorporated 1 Why estimate systems engineering effort? Research has shown that adequate SE effort on the frontend leads to
More informationSystems of Systems Cost Estimation Solutions
Systems of Systems Cost Estimation Solutions Josh Wilson Content Background Characteristics of a System of Systems (SoS) System Engineering (SE) / System of Systems Engineering (SoSE) Cost Estimating solution
More informationCOSYSMO-IP COnstructive SYStems Engineering Cost Model Information Processing. Headed in a new direction
COSYSMO-IP COnstructive SYStems Engineering Cost Model Information Processing Headed in a new direction Dr. Barry Boehm Ricardo Valerdi Gary Thomas Don Reifer October 24, 2002 Outline Workshop Objectives
More informationCost Estimation IV for Next-Generation Ground Systems Focusing on COSYSMO 3.0: The Expert-Based Model
Cost Estimation IV for Next-Generation Ground Systems Focusing on COSYSMO 3.0: The Expert-Based Model Jim Alstad USC Center for Systems and Software Engineering GSAW 2017 Looking Beyond the Horizon Renaissance
More informationOn the Use of Architectural Products for Cost Estimation
Paper #167 On the Use of Architectural Products for Cost Estimation Ricardo Valerdi Massachusetts Institute of Technology Cambridge, MA rvalerdi@mit.edu Indrajeet Dixit University of Southern California
More informationCOSYSMO 3.0: The Expert-Based Model
COSYSMO 3.0: The Expert-Based Model Jim Alstad USC Center for Systems and Software Engineering 32nd International Forum on COCOMO and Systems/Software Cost Modeling University of Southern California October
More informationPSM. Practical Software and Systems Measurement A foundation for objective project management. COSYSMO Requirements Volatility Workshop
Practical Software and Systems Measurement A foundation for objective project management PSM COSYSMO Requirements Volatility Workshop July 27 2010 Dr. Ricardo Valerdi Mauricio Peña PSM Users Group Conference
More informationCOSYSMO: A Systems Engineering Cost Model
COSYSMO: A Systems Engineering Cost Model Barry W. Boehm, Donald J. Reifer, Ricardo Valerdi University of Southern California Center for Software Engineering 941 W. 37th Place, SAL Room 328 Los Angeles,
More informationCOSYSMO: COnstructive SYStems Engineering Cost MOdel. Ricardo Valerdi USC Annual Research Review March 11, 2002
COSYSMO: COnstructive SYStems Engineering Cost MOdel Ricardo Valerdi USC Annual Research Review March 11, 2002 March 2002 Outline Background on COSYSMO EIA632 Approach Delphi Survey Delphi Round 1 Results
More informationCOSYSMO 3.0: An Extended, Unified Cost Estimating Model For Systems Engineering
USC Center for Systems and Software Engineering COSYSMO 3.0: An Extended, Unified Cost Estimating Model For Systems Engineering Sponsor: DASD(SE) By Dr James P Alstad 6 th Annual SERC Doctoral Students
More informationCOSYSMO: Constructive Systems Engineering Cost Model
COSYSMO: Constructive Systems Engineering Cost Model Barry Boehm, USC CSE Annual Research Review February 6, 2001 Outline Background Scope Proposed Approach Strawman Model Size & complexity Cost & schedule
More informationSoftware Technology Conference
30 April 2003 Costing COTS Integration Software Technology Conference Salt Lake City Linda Brooks 1 Objective Provide a roadmap for doing an estimate for a Commercial Off-the-Shelf (COTS) software intensive
More informationUnderstanding and Managing Uncertainty in Schedules
Understanding and Managing Uncertainty in Schedules Realistic Plans for Project Success Presented by: John Owen MPUG Project Integration Month July 20 th, 2016 John Owen 2 1981-1985 Worley Engineering
More informationTest Workflow. Michael Fourman Cs2 Software Engineering
Test Workflow Michael Fourman Introduction Verify the result from implementation by testing each build Plan the tests in each iteration Integration tests for every build within the iteration System tests
More informationCurrent and Future Challenges for Ground System Cost Estimation
Current and Future Challenges for Ground System Cost Estimation Barry Boehm, Jim Alstad, USC-CSSE GSAW 2014 Working Group Session 11F Cost Estimation for Next-Generation Ground Systems February 26, 2014
More informationEnabling Repeatable SE Cost Estimation with COSYSMO and MBSE
1 Enabling Repeatable SE Cost Estimation with COSYSMO and MBSE Dr. Gan Wang, BAE Systems Mr. Barry Papke, No Magic, Inc. Dr. Saulius Pavalkis, No Magic, Inc. PSM Users Group Conference June 12-16, 2017
More informationHeuristics for Systems Engineering Cost Estimation
Heuristics for Systems Engineering Cost Estimation 14 th Annual PSM Users Group Conference New Orleans, LA Dr. Ricardo Valerdi Massachusetts Institute of Technology July 27, 2010 [rvalerdi@mit.edu] Theory
More informationIlities Tradespace and Affordability Program (itap)
Ilities Tradespace and Affordability Program (itap) By Barry Boehm, USC Russell Peak, GTRI 6 th Annual SERC Sponsor Research Review December 4, 2014 Georgetown University School of Continuing Studies 640
More informationSoftware Cost Risk Estimation and Management at the Jet Propulsion Laboratory
Software Cost Risk Estimation and Management at the Jet Propulsion Laboratory Jairus Hihn Karen Lum 17 th International Forum on COCOMO and Software Cost Modeling October 22-25, 25, 2002 Background & Context
More informationCost Estimation of Human Systems Integration
Cost Estimation of Human Systems Integration 1stLt. Kevin Liu, USMC SM in Technology & Policy, June 2010 Research Advisors: R. Valerdi and D.H. Rhodes The views expressed in this presentation are those
More informationBAE Systems Insyte Software Estimation
BAE Systems Software Estimation Steve Webb BAE Systems Estimating Focus Group Chairman Engineering Estimation & Measurement Manager 22 April 2008 1 Background BAE Systems Estimating Focus Group covers
More informationSimulation Analytics
Simulation Analytics Powerful Techniques for Generating Additional Insights Mark Peco, CBIP mark.peco@gmail.com Objectives Basic capabilities of computer simulation Categories of simulation techniques
More informationA Parametric Approach to Project Cost Risk Analysis
A Parametric Approach to Project Cost Risk Analysis By Evin Stump Senior Systems Engineer Galorath Incorporated Preface Risk arises when the assignment of the probability of an event is statistically possible
More informationRisk Mitigation: Some Good News after the Cost / Schedule Risk Analysis Results
Risk Mitigation: Some Good News after the Cost / Schedule Risk Analysis Results David T. Hulett, Ph.D. Hulett & Associates, LLC ICEAA Professional Development and Training Workshop San Diego, CA June 9-12,
More informationDeveloping a Cost Estimation Probability Model of a Large Multi-Year System An Experience Report
Developing a Cost Estimation Probability Model of a Large Multi-Year System An Experience Report NDIA 2012 Kathleen Dangle, Madeline Diep, and Forrest Shull Fraunhofer Context of Our Experience Program
More informationOptimizing Systems Architecture and Whole of Life Costs through Design Profit
Optimizing Systems Architecture and Whole of Life Costs through Design Profit NDIA Systems Engineering Conference ERS Track October 29, 2014 David Foreman Dan McCarthy foremand@leandesign.com danmcc@leandesign.com
More informationPractical Systems and Software Measurement. Affordability Measurement: Exploring Qualitative Approaches (14939)
Affordability Measurement: Exploring Qualitative Approaches (14939) Pete McLoone, Chair, Affordability Measurement Working Group NDIA 15 th Annual Systems Engineering Conference October 22-25, 2012 San
More informationUser s Guide. Galorath Incorporated
SEER for Systems Engineering User's Guide Page 1 SEER for Systems Engineering User s Guide Galorath Incorporated www.galorath.com Corporate Headquarters El Segundo, CA USA Phone: +1 (310) 414 3222 E-mail:
More informationSystems Engineers provide a Key Contribution and Role in System Integration and Test
s Engineers provide a Key Contribution and Role in Integration and Test National Defense Industrial Association (NDIA) 9 th Annual s Engineering Conference October 23-26/2006 Test & Evaluation Track, Tuesday
More informationSoftware Maintenance, Sustaining Engineering, and Operational Support
Software Maintenance, Sustaining Engineering, and Operational Support Estimating Software Maintenance Costs for U.S. Army Weapons Systems Office of the Deputy Assistant Secretary of the Army for Cost and
More informationFactors Influencing System-of-Systems Architecting and Integration Costs
Paper # (unknown) Factors Influencing System-of-Systems Architecting and Integration Costs Jo Ann Lane University of Southern California Center for Software Engineering 941 W. 37th Place, SAL Room 328
More informationCompetency Models Eight competency models were created for each position within the training organization. These were:
W hat differentiates the BEST from the REST? How do we define exceptional performance? Competencies provide an objective platform of skills, knowledge, and behaviors that identify what is required for
More informationTesting Close to and Post-Release: System, Acceptance, and Regression Testing
Testing Close to and Post-Release: System, Acceptance, and Regression Testing CSCE 747 - Lecture 23-04/05/2016 The V-Model of Development Requirements Elicitation System Specification Acceptance Test Plan
More informationCOCOMO III. Brad Clark, PhD USC Center for Systems and Software Engineering 2017 Annual Research Review April 4, 2017
COCOMO III Brad Clark, PhD USC 2017 Annual Research Review April 4, 2017 The COCOMO III Project COCOMO (COnstructure COst MOdel) is the most widely used, free, open source software cost estimation model
More informationCSCI 510 Final Exam, Fall 2017 v10 of solution & rubric Monday, December 11, questions, 300 points
CSCI 510 Final Exam, Fall 2017 v10 of solution & rubric Monday, December 11, 2017 4 questions, 300 points If registered DEN student, please circle: Yes Last Name: First Name: USC ID: Question 1 (48) Question
More informationModeling Software Defect Introduction
Modeling Software Defect Introduction Sunita Devnani-Chulani (sdevnani@sunset.usc.edu) California Software Symposium November 7, 1997 OMO IISunita Devnani-Chulani chart 1 Presentation Outline Motivation
More informationA Methodology and Implementation For Software System Cost and Risk Estimation
A Methodology and Implementation For Software System Cost and Risk Estimation John Gaffney, Lockheed Martin Systems & Software Resource Center Jeanne Bridel, Lockheed Martin Transportation and Security
More informationProject Time Management
Project Time Management Project Time Management Project Time Management includes the processes required to manage timely completion of the project. Plan schedule management The process of establishing
More informationAvoiding Overruns in the Specification of Non-Functional Requirements
Avoiding Overruns in the Specification of Non-Functional Requirements Barry Boehm, USC CSSE GSAW 2016 March 2, 2016 Summary: Avoiding NFR Overruns The Multiplicative Effect of NFRs on Cost Response-time
More informationBenefits & Case Studies
Moody s CreditCycle TM Benefits & Case Studies Existing vintages under alternative scenarios AUTO BANKCARD CONSUMER FINANCE FIRST MORTGAGE HOME EQUITY STUDENT LOAN AND MORE Future vintages under alternative
More informationPLANNING AND ESTIMATING
Slide 9.1 Overview Slide 9.2 PLANNING AND ESTIMATING Planning and the software process Estimating duration and cost Components of a software project management plan Software project management plan framework
More informationSoftware Reuse Economics
Software Reuse Economics Barry Boehm DARPA Workshop January 14, 1997 http://sunset.usc.edu Barry Boehm - 1 Outline Motivation Software Reuse Economics Framework Return on Investment Elements Investments
More informationCOSOSIMO Parameter Definitions Jo Ann Lane University of Southern California Center for Software Engineering
Constructive System-of-Systems Integration Cost Model COSOSIMO Parameter Definitions Jo Ann Lane University of Southern California Center for Software Engineering jolane@usc.edu Introduction The Constructive
More informationProject Plan. Mike McKerns, Caltech. Building the Project Plan Managing the Project Plan Updates to Plan for Common Algorithms
Project Plan Mike McKerns, Caltech Building the Project Plan Managing the Project Plan Updates to Plan for Common Algorithms Goals & Objectives The goal of DANSE is to build a software system for neutron
More informationUtilizing Optimization Techniques to Enhance Cost and Schedule Risk Analysis
1 Utilizing Optimization Techniques to Enhance Cost and Schedule Risk Analysis Colin Smith, Brandon Herzog SCEA 2012 2 Table of Contents Introduction to Optimization Optimization and Uncertainty Analysis
More informationEmbracing Product Line Engineering for Spacecraft FSW
Embracing Product Line Engineering for Spacecraft FSW December 13, 2016 Michael Phillips, Lockheed Martin Chief Software Engineer Michael McKenzie, Lockheed Martin, Product Line Chief Architect Adam Johnson,
More informationNPS Total Ownership Cost Models
NPS Total Ownership Cost Models Raymond Madachy Naval Postgraduate School rjmadach@nps.edu Systems Engineering Research Center Annual Technical Research Review March 19, 2014 Objective Total Ownership
More informationIntroduction. Project Scheduling. Morgan State University ARCH 738: REAL ESTATE PROJECT MANAGEMENT. Jason E. Charalambides, PhD, M.
Project Scheduling ARCH 738: REAL ESTATE PROJECT MANAGEMENT Morgan State University Jason E. Charalambides, PhD, M.ASCE, AIA, ENV_SP (This material has been prepared for educational purposes) Introduction
More informationDeltek Acumen 7/15/16. Learning Objectives. Introduction to Project Risk Analysis. Planning, Risk, Acceleration. The 5 steps. Worked examples Q&A
Deltek Acumen Planning, Risk, Acceleration Tom Polen Director, Solution Architecture Learning Objectives The 5 steps 1. Capturing uncertainty: calibrating the schedule 2. Identifying risk events: accounting
More informationCOSYSMO-IP COnstructive SYStems Engineering Cost Model Information Processing. Headed in a new direction. Workshop Outbrief
COSYSMO-IP COnstructive SYStems Engineering Cost Model Information Processing Headed in a new direction Ricardo Valerdi Workshop Outbrief October 25, 2002 Outline Workshop Objectives Issues and Answers
More informationSystem Cost Modeling and SysML Integration
System Cost Modeling and SysML Integration Ray Madachy, Naval Postgraduate School Kristin Giammarco, Naval Postgraduate School CPT Dennis Edwards, United States Military Academy, West Point David Jacques,
More informationCOM M. Halpern
M. Halpern Research Note 31 October 2003 Commentary Using a PLM Framework to Structure Software Diversity Implementing a five-layer framework can enable you to deploy and manage the broad array of diverse
More informationPerformance modeling of interacting humanmachine distributed processes:
Performance modeling of interacting humanmachine distributed processes: Building a Simulation Model to Characterize Interacting Workflows and to Explore New Workflow Alternatives Janet E. Wedgwood (PI)
More informationSoftware Engineering & Architecture
Software Engineering & Architecture 10. SOFTWARE EVOLUTION Martin Kropp University of Applied Sciences Northwestern Switzerland Institute for Mobile and Distributed Systems References Based on the PowerPoint
More informationEstimating SOA, As Easy as 1 2 3
Estimating SOA, As Easy as 1 2 3 Arlene Minkiewicz Chief Scientist 17000 Commerce Parkway Mt. Laure, NJ 08054 arlene.minkiewicz@pricesystems.com 856-608-7222 Agenda Introduction What is Service Oriented
More informationSynthesis of Existing Cost Models to Meet System of Systems Needs
Paper #128 Synthesis of Existing Cost Models to Meet System of Systems Needs Jo Ann Lane University of Southern California Center for Software Engineering 941 W. 37th Place, SAL Room 328 Los Angeles, CA
More informationProject Management. Opportunity or Oxymoron? Stacy Munechika, PMP, PMI-ACP. PMI Rochester Chapter Professional Development Day May 2017
Project Management Opportunity or Oxymoron? Stacy Munechika, PMP, PMI-ACP PMI Rochester Chapter Professional Development Day May 2017 What makes project outcomes difficult to predict? Survey answers from
More informationA Cost Estimating Methodology for Very Small Satellites
A Cost Estimating Methodology for Very Small Satellites & Dr. Ricardo Valerdi The Aerospace Corporation Civil & Commercial Program Office, Planetary & Robotic Missions Directorate, Economic & Market Analysis
More informationA Cost Estimating Methodology for Very Small Satellites
A Cost Estimating Methodology for Very Small Satellites & Dr. Ricardo Valerdi The Aerospace Corporation Civil & Commercial Program Office, Planetary & Robotic Missions Directorate, Economic & Market Analysis
More informationIntroduction of RUP - The Rational Unified Process
Introduction of RUP - The Rational Unified Process Jong-Hoon Lee Dependable Software Laboratory Konkuk University References Textbook: The Rational Unified Process Made Easy A Practitioner s Guide to the
More informationThe Value of Systems Engineering
National Defense Industrial Association 6th Annual CMMI Technology Conference November 2006 The Value of Systems Engineering What do we know about it? How do we discover more? Al Mink Systems Value / GMU
More informationCSSE 372 Software Project Management: SW Estimation Case Study and COCOMO-II
CSSE 372 Software Project Management: SW Estimation Case Study and COCOMO-II Shawn Bohner Office: Moench Room F212 Phone: (812) 877-8685 Email: bohner@rose-hulman.edu Learning Outcomes: Estimation Estimate
More informationExecutive Planning Sessions Launch Point to a Great Future
Executive Planning Sessions Launch Point to a Great Future IN TODAY S ENVIRONMENT, executives and senior teams at financial services firms often focus most of their attention on the day-to-day demands
More informationA Proposed Community Roadmap for Advancing the Practice of Model-Based Systems Engineering in Government Programs and Enterprises
A Proposed Community Roadmap for Advancing the Practice of Model-Based Systems Engineering in Government Programs and Enterprises Ryan Noguchi Director, System of Systems Engineering Office 3 November
More informationUncertainty in transport models. IDA workshop 7th May 2014
Uncertainty in transport models IDA workshop 7th May 2014 Presentation outline Rationale Uncertainty in transport models How uncertainty is quantified Case study General comments 2 DTU Transport, Technical
More informationAdapting software project estimation to the reality of changing development technologies
Adapting software project estimation to the reality of changing development technologies Introduction Estimating software projects where significant amounts of new technology are being used is a difficult
More informationComplex Systems of Systems (CSOS) : Software Benefits,Risks,and Strategies
Complex Systems of Systems (CSOS) : Software Benefits,Risks,and Strategies Barry Boehm, USC Vic Basili, Fraunhofer Maryland SIS Acquisition Conference January 28, 2003 10/22/02 USC-CSE 1 Complex Systems
More informationProgram Evaluation and Review Technique (PERT)
Program Evaluation and Review Technique (PERT) PERT Bar charts and CPM networks assume all activity durations are constant or deterministic. The assumption of constant durations may not be realistic because
More informationSoftware Cost Metrics Manual
MOTIVATION Software Cost Metrics Manual Mr. Wilson Rosa Dr. Barry Boehm Mr. Don Reifer Dr. Brad Clark Dr. Ray Madachy 21 st Systems & Software Technology Conference April 22, 2009 DOD desires more credible
More informationSoftware Cost Estimating Body of Knowledge
Software Cost Estimating Body of Knowledge Estimation Maturity Estimated training time: 60 minutes Slides are used with permission from Galorath Inc. All rights reserved. Acknowledgements Esteban Sanchez
More informationBusiness Architecture Fundamentals
Course Description 3 day - expert led hands-on In this turbulent and increasingly competitive global economy, and the rapid pace of change in business models involving changing technology and customer
More informationCost Model Comparison Report
Cost Model Comparison Report October 31, 2006 Update Version Prepared for: NASA Ames Prepared by: University of Southern California Center for Software Engineering 941 West 37 th Place Los Angeles, CA
More informationC S E USC. University of Southern California Center for Software Engineering
COCOMO II: Airborne Radar System Example Dr. Ray Madachy C-bridge Internet Solutions Center for Software Engineering 15th International Forum on COCOMO and Software Cost Modeling October 24, 2000 C S E
More informationThe Cost of Organizational Structures and Interfaces
The Cost of Organizational Structures and Interfaces prepared for Ground System Architectures Workshop by Darryl W. Webb Business and Operations Analysis Subdivision Systems Engineering Division The Aerospace
More informationFirst, a detailed description of function points Then, how to use function points and lines of code for cost estimation.
Cost Page 1 Cost modeling Monday, October 05, 2009 11:17 AM First, a detailed description of function points Then, how to use function points and lines of code for cost estimation. Reading: SEPA Chapter
More informationCode Review: OutSystems Platform
Code Review: OutSystems Platform Overall Impression of OutSystems Platform: Ten times easier and way more productive than existing procedural techniques. QAT Global - PoC Requirements Unrestricted application
More informationMaking Better Architectural Choices with the Architecture Valuation Framework. Voytek Janisz
Making Better Architectural Choices with the Valuation Framework Voytek Janisz Value of Current State RTB A (period, drivers) State A RTB A ( ) Value =? /Benefit RTB B RTB A State B RTB B ( ) Time RTB
More informationIBM Software Services for Lotus To support your business objectives. Maximize your portal solution through a rapid, low-risk deployment.
IBM Software Services for Lotus To support your business objectives Maximize your portal solution through a rapid, low-risk deployment. For businesses around the world, Web portals help increase productivity.
More informationEstimating Size and Effort
Estimating Size and Effort Massimo Felici and Conrad Hughes mfelici@staffmail.ed.ac.uk conrad.hughes@ed.ac.uk http://www.inf.ed.ac.uk/teaching/courses/sapm/ Slides: Dr James A. Bednar SAPM Spring 2009:
More informationMarket Systems Enhancement
Market Systems Enhancement Update for the Technology Committee MISO Board of Directors November 28, 2017 Executive Summary Market System Enhancement Program is refining its seven-year plan, including key
More informationArchitecture Analysis
Architecture Analysis Boeing s Experiences using the SEI ATAM and QAW Processes Presented by: Don O Connell Associate Technical Fellow BOEING is a trademark of Boeing Management Company. Architecture Tradeoff
More informationUse of the Air Force HSI Requirements Pocket Guide to Improve Writing and Interpretation of Human-Centered Requirements
Use of the Air Force HSI Requirements Pocket Guide to Improve Writing and Interpretation of Human-Centered Requirements Kevin Liu, 1st LT, USMC Bridget Simpkiss, Air Force Human Systems Integration Office
More informationProject Management Professional (PMP) Exam Prep Course 6 - Project Schedule Management
Project Management Professional (PMP) Exam Prep Course 6 - Project Slide 1 Looking Glass Development, LLC (303) 663-5402 / (888) 338-7447 4610 S. Ulster St. #150 Denver, CO 80237 information@lookingglassdev.com
More informationNew Opportunities for System Architecture Measurement
New Opportunities for System Architecture Measurement System Engineering Conference October 2012 Paul Kohl Lockheed Martin Dr. Ronald S. Carson -- Boeing 1 Background The United States Government Accountability
More informationSoftware Architecture Challenges for Complex Systems of Systems
Software Architecture Challenges for Complex Systems of Systems Barry Boehm, USC-CSE CSE Annual Research Review March 6, 2003 (boehm@sunset.usc.edu) (http://sunset.usc.edu) 3/18/03 USC-CSE 1 Complex Systems
More informationJust How Good is COCOMO and Parametric Estimation?
Just How Good is COCOMO and Parametric Estimation? Tim Menzies (NC State) Barry Boehm (USC) Ye Yang (Stevens) Jairus Hihn (JPL) Naveen Lekkalapudi (WVU) October 21-23, 2014 29 th International Forum on
More informationAffordable Systems: Balancing the Capability, Schedule, Flexibility, and Technical Debt Tradespace
Affordable Systems: Balancing the Capability, Schedule, Flexibility, and Technical Debt Tradespace Jo Ann Lane, Supannika Koolmanojwong, and Barry Boehm University of Southern California 941 Bloom Walk
More informationDMSMS Updates. Parts Standardization and Management Committee Meeting Long Beach, California November 4, 2014
DMSMS Updates Parts Standardization and Management Committee Meeting Long Beach, California November 4, 2014 Overview I. DMSMS Management for Materials and Mechanical Items II. Intellectual Property Strategy
More informationRequirements Analysis and Design Definition. Chapter Study Group Learning Materials
Requirements Analysis and Design Definition Chapter Study Group Learning Materials 2015, International Institute of Business Analysis (IIBA ). Permission is granted to IIBA Chapters to use and modify this
More informationTech Note: Smart Home Modeling the Internet-of- Things with SysML Part 4 Smart Home to Smart Grid
75 Fifth Street NW, Suite 312 Atlanta, GA 30308, USA voice: +1-404-592-6897 web: www.intercax.com email: info@intercax.com Dr. Dirk Zwemer, InterCAX LLC Tech Note: Smart Home Modeling the Internet-of-
More informationSendai Framework for Disaster Risk Reduction and 2030 Agenda for Sustainable Development
Sendai Framework for Disaster Risk Reduction 2015-2030 and 2030 Agenda for Sustainable Development Introduction the overall structure of the Online Monitoring System, Technical Guidance Notes and Disaster
More informationDemystifying the Worlds of M&S and MBSE
Demystifying the Worlds of M&S and MBSE October 24, 2012 bradford.j.newman@lmco.com mike.coughenour@lmco.com jim.brake@lmco.com The Two Worlds 2 3 4 Modeling and Simulation (M&S) Background History of
More informationQUICKLOOK PROJECT PROPOSAL
QUICKLOOK PROJECT PROPOSAL Version 1.06 By Tactical Science Solutions, Inc. in support of the Tactical Satellite-3 design effort February 15, 2007 Group: Tactical Science Solutions, Inc. Authors: David
More informationTotal Engineering Estimation Data Collection Needs Demand Data Collection Processes Alex Shernoff
. Approved for Public Release. Total Engineering Estimation Data Collection Needs Demand Data Collection Processes Alex Shernoff 2009 BAE Systems, Inc. All rights reserved. 1 Data Collection Needs The
More informationWhere Do We Go From Here? Prospering in a Post Health Care Reform World
Where Do We Go From Here? Prospering in a Post Health Care Reform World Findings from the 2011 MetLife Broker and Consultant Study Date : September 26,2011 Ronald Leopld MD, MBA, MPH Metropolitan Life
More information