Enterprise Systems-of-Systems Model for Digital Thread Enabled Acquisition

Transcription

1 Enterprise s-of-s Model for Digital Thread Enabled Acquisition Sponsor: DASD(SE) By Tom McDermott (Stevens) Molly Nadolski (Ga Tech), Paul Collopy (UAH), Chris Paredis (GT/Clemson) 10 th Annual SERC Sponsor Research Review November 8, 2018 FHI 360 CONFERENCE CENTER 1825 Connecticut Avenue NW, 8th Floor Washington, DC SSRR 2018 November 8, 2018

2 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igrams Outcomes & Next Steps SSRR 2017 November 8,

3 SERC Project RT-182 Digital Thread Enabled Acquisition This research was conducted to evaluate the impacts of DE on current DoD acquisition enterprise processes. The following questions guided the research: What changes are likely to emerge from the transition to DE processes, methods, and tools? What are the enablers and barriers to such innovation in the DoD acquisition enterprise? What stakeholders will be affected and how will they likely embrace or oppose change? How might stakeholders be incentivized to embrace innovation and how will this be measured? What are the leading and long-term indicators of change? How might the value of such changes be predicted and measured? SSRR 2017 November 8,

4 Specific Questions of Interest How will DE help the acquisition enterprise respond to the realm of the possible with warfighter needs? What are the opportunities that can be gained from deeper information in the authoritative source of truth? How will DE make the acquisition process more efficient and reduce rework? Can DE make it easier to ingest new processes and incorporate acquisition expertise into acquisition tools? How do DE documented architecture principles add value to development and acquisition processes? How will DE environments capture and maintain lessons learned within and across programs? How can DE improve the performance of the acquisition workforce, at every skill level? SSRR 2017 November 8,

5 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igrams Outcomes & Next Steps SSRR 2017 November 8,

6 Enterprise SoS Process Descriptive Models Graphic: W. Rouse & M. Pennock, Complex Enterprise s, 5th Annual SERC Sponsor Research Review February 25, 2014 Graphic: SSRR smumn.edu/facpages/~dbucknam/rat_cartoon.jpg 2017 November 8,

7 Full Process & Project Scope 1. Context Analysis 2. Central Questions of Interest 3. Identify Structure & Phenomena Background Research Interviews 4. Visualize Relationships igram Narratives & Diagrams 5. Identify Areas of Exploration Innovation Analysis Key stakeholders Critical enablers & barriers to change 6. Identify Data Sets to Parameterize What are the measurement areas that will drive change? What measures are collected versus what should be collected Framework: Facilitation: Model Design: 1. View the as a Multi-Layer Enterprise Rouse, W.B, Modeling and Visualization of Complex s and Enterprises, Wiley, Loper M., Ed., Modeling and Simulation in the s Lifecycle, Springer, Agree on Central Questions of Interest 3. Identify Structure & Phenomena 4. Visualize Relationships 5. Identify Areas of Exploration 6. Identify Data Sets to Parameterize 7. Identify Relevant Computational Models Agree on Context & Boundaries Conceptualize Models and abstractions Develop Narratives & Diagrams Develop Data Models Integrate Computational Models SSRR 2017 November 8, Test/ Verify

8 In Practice: Enterprise igrams 1. The Central problem Questions situation: of unstructured Interest 6. Innovation Feasible, desirable Development changes 7. Stakeholder Action to Reconciliation, improve the Measures problem of situation Change 2. The problem Stakeholder situation: Interviews expressed 3. Structured text Design Workshop, 5. Dramatization Actors & and Dialogue Enablers 4. igram(s) Design Real world s thinking 4a. Formal system concept 4b. Other systems thinking A qualitative stakeholder-driven process to produce quantitative goals SSRR 2017 November 8,

9 Stakeholder Interviews & Research 15 Project Visits Completed, 25 People Interviewed DASD/SE Aerospace Corp JHU APL SAF/AQ Army PM-Aviation Army Future Vertical Lift Program Office Ground-Based Strategic Deterrent Program Office SPAWAR San Diego TARDEC J8 JCIDS office DOT&E NASA-Langley NASA-Marshall JPL Also: ~50 documents reviewed 6 facilitated meetings with DASD/SE team SSRR 2017 November 8,

10 DE Transformation igrams SSRR 2017 November 8,

11 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igrams Outcomes & Next Steps SSRR 2017 November 8,

12 People Processes Institutions Domain Context Analysis (Selected Phrases) Enabling Environment Key Actors & Resources Interactions/Activities Outcomes/Outputs Operational Context Manufacturing 4.0 drivers Curate models across domains, fidelity, Goal 1: Formalize the development, increasing complexity Global innovation in DE phases and the lifecycle integration and use of models to DoD DE Strategy inform enterprise and program decision making Map the realm of the possible with warfighter needs Develop, mature, and INCOSE and other Digital program documents Goal 2: Provide an enduring use IT infrastructures professional organizations Enterprise owns the ontology and data authoritative source of truth (AST) Define and govern layer for analytical approaches Goal 4: Establish a supporting authoritative source of Libraries of reusable models infrastructure and environment truth Pay once for data, reuse everywhere Lexicon, taxonomies, ontologies Paperless system and technical information Comfort with technology Usability of DE methods & tools Organizational and cultural resistance Learning systems that adapt to individual abilities Communities: Standards, guides Communicators/ matchmakers Model governance/version control mgmt. Better informed Decision makers Leadership & messaging Older vs younger workforce Human capital - skills A-Teams & B/C-Teams - performance Digital twin that injects data back into the models data accessible from a single portal Eliminate human process of finding and using data Everything needed is on desktop, what s been done before is there to reuse Enhance collaboration Humans can focus on creative work and machines can take care of mundane tasks Understand incremental value of all trades, done dynamically Goal 3: Incorporate technical innovations to improve the engineering practice opportunities that can be gained from deeper information in the AST make the process more efficient and reduce rework capture and maintain lessons learned Goal 5: Transform Culture and Workforce easier to ingest new processes and incorporate acquisition expertise into the tools make the B-team and C-team players perform more at the A-Team level SSRR 2017 November 8,

13 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igram; Authoritative Source of Truth Outcomes & Next Steps SSRR 2017 November 8,

14 Increasing Authoritative Source of Truth Complexity Is too great to be understood by individual Program Office Staff Program Managers Responsible for Critical to Leads to inability to sustain Configuration Management Driving strategy from the Strategy Domain Actors Structure Processes/ Resources Legend drives Characteristics Size Connectedness Safety Security Reliability To set Government Program/ Enterprises Hire an DoD Policy Is a feature of today s Has existing To provide Which governs Provide IT Savvy Workforce More distributed More flexible Weapon s Other Programs Standards Is a good starting place for Which are dependent on provide Authoritative Source of Truth Common Data Baselines (like FMECA) Model Libraries Central Data Repository Constituent s Needing a s-of- s Analysis Initial Source of Help manage Must manage the Must ensure To develop Needs access to Define Makes up the Data & Model Availability AI-enabled Big Data Tools Procurement Developers Resides in Working for Weapon Acquisition Concept Development Production Sustainment Domain Specific Federated Data Set Instantly on the Scale and Complexity Ontology & Data Standards Endurance Deciding Central Data Storage Of the Who produce Create Buy-in Single Portal Computing Cloud Server Of the Tech Data Procurement Digital Models Contractor Owned Government Owned Feed a Test Data Extracted from of of Validated by enabling Enables Version Control defines Built & used by Govern Competition supports Everything is on the Desktop when Needed for Finding & Using Data By better managing Updates Interoperability for enabling Knowledge Translation Future s Engineers Manage need spurs Data & Model Evolution To Eliminate/ Reduce/ Control Innovation Use Improving Realm of the Possible Between Trust Managing the For the Warfighter For the Agility Design Escapes/ Defects

15 Increasing Authoritative Source of Truth Complexity Leads to inability to sustain Configuration Management Driving strategy from the To set Government Program/ Enterprises DoD Policy To provide Which governs Provide Authoritative Source of Truth Common Data Baselines (like FMECA) Model Libraries Central Data Repository Strategy Domain Actors Structure Processes/ Resources Legend

16 Increasing Authoritative Source of Truth Complexity Is too great to be understood by individual Program Office Staff Program Managers drives Characteristics Size Connectedness Safety Security Is a feature of today s Weapon s Other Programs Which are dependent on provide Constituent s Needing a s-of- s Analysis Define Procurement Developers Working for Weapon Acquisition Concept Reliability Initial Source of To develop Development Production Sustainment Needs access to Authoritative Source of Truth Common Data Baselines (like FMECA) Model Libraries Central Data Repository Strategy Domain Actors Structure Processes/ Resources Legend

17 Increasing Authoritative Source of Truth Complexity drives Characteristics Size Connectedness Safety Security Reliability Has existing Standards Is a good starting place for Authoritative Source of Truth Common Data Baselines (like FMECA) Model Libraries Central Data Repository Resides in Central Data Storage Single Portal Strategy Domain Computing Cloud Server Everything is on the Desktop when Needed Actors Structure Processes/ Resources for Finding & Using Data By better managing To Eliminate/ Reduce/ Control Design Escapes/ Defects Legend

18 Increasing Authoritative Source of Truth Complexity Is too great to be understood by individual Program Office Staff Program Managers Critical to Leads to inability to sustain Procurement Developers Deciding Who produce Tech Data Procurement of Create Buy-in Digital Models Contractor Owned Government Owned Configuration Management Feed a Validated by Driving strategy from the Strategy Domain Government Program/ Enterprises Which governs Authoritative Source of Truth Common Data Baselines (like FMECA) Model Libraries Central Data Repository Help manage Makes up the Data & Model Availability Resides in AI-enabled Big Data Tools Domain Specific Federated Data Set Instantly on the Central Data Storage Single Portal Computing Cloud Server Test Data Extracted from Everything is on the Desktop when Needed Actors Structure Processes/ Resources for Finding & Using Data To Eliminate/ Reduce/ Control Design Escapes/ Defects Legend

19 Authoritative Source of Truth Digital Models Contractor Owned Government Owned Validated by Built & used by supports for Knowledge Translation Use Warfighter Test Data Extracted from Enables Future s Engineers Between Trust For the Central Data Storage Single Portal Strategy Domain Computing Cloud Server Everything is on the Desktop when Needed Improving Agility Actors Structure Processes/ Resources for Finding & Using Data To Eliminate/ Reduce/ Control Design Escapes/ Defects Legend

20 Authoritative Source of Truth Digital Models Contractor Owned Government Owned Built & used by supports for Knowledge Translation Future s Engineers Government Program/ Enterprises Hire an IT Savvy Workforce Central Data Storage Single Portal of Version Control Govern Manage Data & Model Evolution Strategy Domain More distributed More flexible Computing Cloud Server Actors Structure Processes/ Resources Must manage the Must ensure Scale and Complexity Endurance Of the Of the Legend

21 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igram; Workforce and Culture Outcomes & Next Steps SSRR 2017 November 8,

22 Must be about Domain Actors Structure Processes/ Resources Legend s Seeing increasing Complexity Driving change in Program Office Workforce Program Manageme nt Business/ Financial Management Procurement Prod./ Quality Assurance Test & Eval uses Has mature Is no silver bullet for good uses MBSE Limits delegation to Will lead to more technica l Do not Have the Hav e the Communication Struggle with formal crossdisciplinary Across disciplines Across roles With stakeholders Digital Models Ability to model across Less receptive to More receptive to Driving transition to Workforce Manufacturing Software Hardware Engineerin g Test & Eval Leading to improved Program Collaboration Workforce and Culture Disciplinary Roles Performed by Experienced Engineers Link together Younger Engineers To do Will help Bridge the modelers to acquirers gap Frustrated with lack of Digital Requiring reprioritizatio n of the Lack formal Concern Aging Workforce Provide Knowledge Transfer Broaden perspectives with uses Digital Tools Pace of Adoptio n of Provide effective visualization Customize user experience Different uses of similar tools Support collaboration on Digital Collaboration Platforms Rely too much on Leads to cause s To create the necessar y Attritio n an d Heroes Will reduce Central Data Storage Single Portal Computing Cloud Server Everything is on the Desktop when Needed for Will be set by Tool Vendors Finding & Using Data Needed to Must incentivize Must invest in to DE Initiatives Shared knowledge/ Authoritative Source of Truth Guidebook Chapter on MBSE Communities of Practice/ Interest Innovation spaces & projects Creat e Buyin Mus t Leadership Must provide Messaging Create better informed requirements Make better informed decisions Ability to assert completeness Do the same things faster Communicate better More work flexibility Reduce risk Wit h Strategic vector/ Commander s intent Must produc e Needed to Must support investmen t in Transform Workforce and Culture Must persist to into More A Players Improving Agility

23 Must be about Has mature Workforce and Culture s Seeing increasing uses Is no silver bullet for good MBSE Ability to model across Disciplinary Roles uses Complexity Driving change in Program Office Workforce Program Manageme nt Business/ Financial Management Procurement Prod./ Quality Assurance Test & Eval Do not Have the Hav e the Communication Across disciplines Across roles Workforce Manufacturing Software Hardware Engineerin g Test & Eval Domain With stakeholders Actors Structure Processes/ Resources Legend

24 Must be about s Seeing increasing uses Has mature Is no silver bullet for good uses MBSE Ability to model across Less receptive to Workforce and Culture Disciplinary Roles Performed by Experienced Engineers Concern Aging Workforce Provide Rely too much on Leads to Heroes Will reduce Complexity Digital Models Link together Knowledge Transfer Attritio n Limits delegation to More receptive to Driving transition to Younger Engineers Frustrated with lack of Broaden perspectives with Pace of Adoptio n cause s Digital of To create the necessar y Domain Actors Structure Processes/ Resources Legend

25 Must be about Workforce and Culture DE Initiatives s Shared knowledge/ Authoritative Source of Truth Seeing increasing Complexity Attritio n Will reduce Guidebook Chapter on MBSE Communities of Practice/ Interest Innovation spaces & projects Wit h Must support investmen t in Driving transition to Younger Engineers Frustrated with lack of Digital uses Pace of Adoptio n of cause s To create the necessary Will be set by Tool Vendors Must incentivize Central Data Storage Single Portal Creat e Buyin Mus t Leadership Must provide Strategic vector/ Commander s intent Must produc e Transform Workforce and Culture Must persist to Domain Actors Structure Processes/ Resources Digital Tools Provide effective visualization Customize user experience Different uses of similar tools Support collaboration on Digital Collaboration Platforms and Everything is on the Desktop when Needed for Computing Cloud Server Finding & Using Data Needed to to Messaging Create better informed requirements Make better informed decisions Ability to assert completeness Do the same things faster Communicate better More work flexibility Reduce risk Needed to into More A Players Improving Agility Legend

26 Workforce & Culture Most stakeholders and experts do agree there is a cultural change at play Divergence in perspective in regards to what this might look like Change in the old guard to new guard, whether or not there are workforce capabilities and the talent will look like Substantial workforce shift: new tools which bring in digital natives and will be a merger of new technology and existing experience Are there capabilities and resources to address the changes? Tensions between the old and new guard Evolution of s and Modeling roles & methods Digital collaboration and access to truth data is a key enabler Commitment of leadership is essential Investment, common messaging, safe places to experiment What innovations will drive the future DE desktop environment? SSRR 2017 November 8,

27 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igram; Inform Enterprise and Program Decision Making Outcomes & Next Steps SSRR 2017 November 8,

28 Inform Enterprise and Program Decision Making SME knowledge Domain Actors Structure Processes/ Resources Legend for Capability Assessment Link to Operational Planning & Force Structure Feeds into Digital Requirements To produce the CDD define Starts the Authoritative Source of Truth Digital Data Models Simulation Feed into Government Model Concerns Quality Control Satisfy Capabilities, not Requirements Appropriate abstractions Define context Right fidelity Enterprise Architecture Development Process Of the Standards Development Model Developers Model Development & Curation Vendor Model Concerns Better understand IF s Inject context & return design Pull the digital thread Support the Digital Twin Good Cross- Program Functional Models More time for needs Design to Support More Robust AoAs With continuity through Model Management Concerns Model sharing Modeling SW Interoperability inform Milestone B Make s more Efficient Milestone A Model security Workflows s Behaviors Rethink Configuration Management Integrate Robust SE Process Eliminate Checklists Avoid Box- Checking Decision making And process to get to capturing for For future Lessons Learned Ontologies s Digital program history Domain specific models Metadata Acquisition Behaviors Simulate before Spending Creating better Proposals Produces a Being a better Customer capturing Digital Model for Human Understanding To output Communication Media to Immediate knowledge of for Prototyping Different Models representing same capabilities at different scales Acquisition Cost savings To Eliminate/ Reduce/ Control Decision Makers Initially little Simulate Operations at Scale Models form Patterns Digital Thread Early Stage Program Development Increase effort in Program Manager Concerns level trades & analyses Design changes Design escapes Cost savings A living Digital Twin

29 Inform Enterprise and Program Decision Making Domain specific models SME knowledge Feeds into Authoritative Source of Truth Ontologies Digital Data Models Simulation Model Development & Curation Metadata Different Models representing same capabilities at different scales Domain Actors Structure Processes/ Resources Legend

30 Inform Enterprise and Program Decision Making s Behaviors Rethink Configuration Management Integrate Robust SE Process Eliminate Checklists Avoid Box- Checking Acquisition Behaviors Simulate before Spending Creating better Proposals Being a better Customer Decision making for s Produces a Digital Model for Human Understanding To output Domain Communication Media for Decision Makers Actors Structure Processes/ Resources Legend

31 Inform Enterprise and Program Decision Making SME knowledge Feeds into Authoritative Source of Truth Digital Data for Models Simulation Capability Assessment Link to Operational Planning & Force Structure define Government Model Concerns Appropriate abstractions Define context Right fidelity Digital Requirements To produce the CDD Starts the Feed into Enterprise Architecture Development Process Good Cross- Program Functional Models needs Support More Robust AoAs And process to get to Domain Actors Quality Control Of the More time for With continuity through Milestone B Milestone A capturing Structure Processes/ Resources Satisfy Capabilities, not Requirements Design to Make s more Efficient Digital program history A living Digital Twin Legend

32 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igram; Other Insights Outcomes & Next Steps SSRR 2017 November 8,

33 Agile Adversary Technical Innovations to Improve Practice maintain advantage over Superior weapons systems Effective technical innovation enables drives need for requires makes SE more efficient Superior Capabilities achieve through Superior Reasoning/Inference Capabilities The Cloud Implemented in Data Technologies Simulation Algorithms Human-in-the-loop Multidisciplinary Simulate at Scale performs HPC Infrastructure Energy Efficient results in Complexity implemented in Federated Model Repository enables scales with requires achieve through Superior Communication Capabilities supported by Authoritative Source of Truth Digital Collaboration supports Agile Scalable Cost effective Assuring mission success achieve through SE Modeling languages Formal/ Unambiguous Intuitive Superior Interpretation Capabilities incorporated in achieve through Superior Creation/Definition Capabilities supports Superior Modeling Capabilities Modelers Machine Learning Data Analytics to generate use IoT Generate data for More Comprehensive Models Digital Twin serve as input to serve as input to Real-Time Data Repositories Materials DB Weather DB informs Reasoning Algorithms Model Checking Consistency & Completeness Checking Formal Verification performs Visualization Capabilities Tradespace Scalable performs Exploration Capabilities Tradespace Exploration Optimization performs Uncertainty Characterization Quantification Domain Actors Structure Processes/ Resources Acquisition Stakeholders Program Office Contractors Supply Chain Layered Language Architects use Ontology express knowledge SMEs Knowledge Repositories Unstructured Structured generate Communities of Practice Models form Patterns Decision Makers provides insight to Data Viz VR/AR Validation Calibration decision making Legend form

34 Digital Infrastructure Today s Infrastructure Facing Upcoming s Need to Move Beyond Current Resources DE Capability Greater Scale MS Office Tools Building MBSE Tools Must Eliminate Greater Complexity Data Repositories like the Wild West Processes Managing Manual Processes Finding Data Using Data 60 days to get data off test range Need Replace with Need Policy for Using IT to Real Time Quick Look Buy Data from Others Manage Data Configuration Management Search for Relevant Data Automated Data Extraction Transition to Manage Comprehensive, Effective Configuration Management Manage Transition MBSE language Parametric Tools Spec Doc Writers To Level Trades and Analysis Enables Enable Return to s of s Available on Enables High Fidelity Models Support Leads to Rigorous s Necessitates Integrated Tools Databases Available on The Cloud Available on Threats Living Digital Twin Interconnected Libraries of Information Focus on Development Focus on Outcomes Domain Actors Interoperable Complete Package Foster Different Levels Feeds in the Loop Augmented Reality Simulation Training Enables Enables Structure Processes/ Resources Legend Collaboration across Disciplines and Locations Enables Operations Tomorrow s Digital

35 Digital Information Exchange Change how we curate data and models Change the nature of AoAs Presented at inaugural DEIXWG meeting, INCOSE IS 2017 Change Reqs process Change what s Engineers do SSRR 2017 November 8,

36 Agenda Introduction Methodology: Multi-level Sociotechnical Modeling & Enterprise s Analysis SERC Project RT-182 Digital Thread Enabled Acquisition Context Background: DE Transformation igrams Outcomes & Next Steps SSRR 2017 November 8,

37 Outcomes and Next Steps Created holistic model of DoD Acquisition Enterprise change as DE is gradually adopted Good agreement across stakeholders on the nature of the strategy Descriptive modeling process reveals scope of change Testing insights in multiple forums using igrams Base models informing other activities: Digital Working Group (DEWG) Digital Information Exchange Working Group (DEIXWG) SSRR 2017 November 8,

38 Next Phase DE Metrics Theme: A Program Office Guide to Successful DE Transition Work with several DoD program offices, contractors, and tool providers Identify measures of success, and define multi-level measurement models Near- and long-term change indicators Identify potential innovation game-changers Define enablers and barriers to innovation Define cross-sector innovation opportunities SSRR 2017 November 8,

39 Future Research Needs Model Curation and Certitude. Must develop a rigorous approach to verify, validate, and accredit the models that are incorporated into the Authoritative Source of Truth, particularly quality and range of valid use. Metadata standards for the Authoritative Source of Truth. Extend SET work on ontologies and metadata/metamodel libraries and tools. Human Capital. This will be a significant shift in the workplace, leading to an IT/Data Savvy workforce. Training programs must evolve with the strategy. Bringing in the first and last phases. Need to engage and define how the capabilities assessment and development, operational, and test functions adopt and benefit from DE. Evolution of Benefits of DE. A sustained program that encourages exploring the art of the possible and understanding of the unique use cases that will evolve should be pursued. SSRR 2017 November 8,

40 Questions? Thank you! SSRR 2018 November 8, 2018