Leveraging Model Based Engineering for Test Planning

Transcription

1 Leveraging Model Based Engineering for Test Planning 2016 Annual International Test and Evaluation Symposium October 3-6, 2017 Michael Steele, Wyatt Brigham, Brian Hokinson Test Planning & s Practioner 1

2 Topics Covered What is Model-based Engineering Relationships Within Model Useful to T&E Assessing Capability Using Models Planning for s to Test Cases Modeling Risk within Test Plan Tracing Governance s Identifying the Need for Enabling Products

3 MBE Definition 1 An approach to engineering that uses models as an integral part of the technical baseline that includes the requirements, analysis, design, implementation, and verification of a capability, system, and/or product throughout the acquisition life cycle. 1 Final Report of the Model Based Engineering (MBE) Subcommittee, 10 February 2011, National Defense Industries Association This paper focuses on one aspect of MBE for an end product evaluating Capability

4 Capability 2 Measure of the ability of an entity (department, organization, person, system) to achieve its objectives, specially in relation to its overall mission. 2 Source: T&E Must Not Neglect Evaluation of Capability Proving Capability Enables T&E to Meet The Pace Of Need

5 A Basic Model Mission Operational Task Operational Activity End Product Item Function Interface Component Capability Derived 5 User Needs are Modeled to Drive the End Product Design

6 DoDAF Capability View Capability One of Many DoDAF Views With Useful Information to T&E 6 Source:

7 Governance Test Information within the DoDAF Capability View Measurements Resources Activities Conditions Capability Often Overlooked by the T&E Professional 7

8 Measurements Capability Need Mission Tasks key performance parameter KPP Other Attributes Utility to Users critical operational issue KSA CTP critical technical parameters COI key system attribute MOE/MOP MOE/MOS measure of effectiveness / measure of performance MOP(s) MOS(s) measure of suitability Verification and Validation Activities 8 Capabilities Lead to MOP/MOS Evaluated by T&E derived from DAU SYS101

9 An Architecture Model 9 Architecture Copyright 2011 Vitech Corp. All Rights Reserved. Copied with Permission as described in ISBN

10 An Architecture Model Link Interface Component Mission Capability 10 Activities & Tasks Item Function Architecture Model Links System With Operational Elements

11 Test Model from Product Model Product Architecture Verification Test Activity Enabling Product Test Item Configuration 11 From Your MBE Tool of Choice, Plan Tests Using Product Design Elements

12 based basis of specifies specified by Defining Test Activities Capability cause caused by result of verified by verifies results in Risk Risk Mitigation Verification Allocations Governance & Mission Threads Executed by resolved by executes resolves ~ Test Activity Function elicited by elicits elaborates elaborated by Use Case elaborates elaborated by Basic Set of Model Data to Start Test Planning s Analysis Yields Test Activities 12

13 Elements of a Test Plan Product Risk Mitigation Verification Enabling Product MOP/MOS Governance Test Activity Resources Test Item Configuration Detailed Method of Test Test Case Test Point Time on Condition MBE Helps Define Scope of Test Program 13

14 Combined Product & Test Model comprises Capability Mission1 Verification requirement basis of achieves verified by Operational Activity results in elaborates implemented by establishes Use Case elaborates Function Test Activity describes allocated to captures elaborates Link Component Resource consumes Use Case connects to built from produces elicited by Component Verification requirement Risk forms fulfilled by resolved by Interface Test Configuration Verification Event Test Procedure Test Activity forms employed by employs employed by joined by executed by Legend Product Model Class Repeated Class Test Model Class relationship between Classes based of DoDAF 2.0 CORE9 Schema 14 Unified Integration Test & Evaluation Model

15 Conclusion 15 Test Model Unified Within Product Model Enables Matching hardware & software capabilities and resulting test item configuration to milestones Configuration of enabling products e.g., laboratory simulations and emulators; special test equipment; and instrumentation Rapid Assessment of Change Requests Impact Generation of Test Plan or updated sections Enables T&E to Keep Pace With Need

16