June Mark Fiebrandt JTEM Operations Research Analyst

Transcription

1 June 2010 Mark Fiebrandt JTEM Operations Research Analyst

2 Abstract This tutorial provides background, overview, and status of efforts to produce an overarching process for utilizing a JMT for test and evaluation of systems in a joint environment. This includes a process to decompose JMTs to testable measures that will measure the impact of the system on joint capabilities and warfighter effects. Special emphasis is placed on the methods and processes used for JMT decomposition, demonstrating that JMTs, combined with measures and architectural products, will provide the foundation for a quantifiable operational context and an effective evaluation strategy. Additionally, the case will be made that reusable measures at the mission and task level will standardize and accelerate planning, providing benefit to all end users. Presentation of a use case will illustrate how an initial set of measures was decomposed for the Joint Close Air Support and Joint Personnel Recovery mission threads. The tutorial will also provide the way ahead for making the JMT decomposition to measures process and initial JMT measures available to end users. 2

3 Agenda 1. Joint Environment Requirements 2. Joint Threads 3. Joint Thread Framework 4. Joint Thread Tier 1 Development a) Step 1 Development b) Step 2 Development 5. Joint Thread Tier 2 Development x

4 Agenda x Joint Environment Requirements

5 Joint Environment (JME) Joint Environment (JOE): The environment of land, sea, and/or airspace within which a joint force commander employs capabilities to execute assigned missions. (JCIDS Manual, Jul 2009) Joint Environment (JME): A subset of the joint operational environment composed of force and non-force entities; conditions, circumstances and influences within which forces employ capabilities to execute joint tasks to meet a specific mission objective. (JCIDS Manual, Jul 2009) 6

6 Joint Environment (JME) Relation to Joint Thread Development Joint Environment (JME): A subset of the joint operational environment composed of force and non-force entities; conditions, circumstances and influences within which forces employ capabilities to execute joint tasks to meet a specific mission objective. (JCIDS Manual) Independent variables (test factors) SoS configurations System attributes DOTMLPF Conditions: - Environment & Threat Varied across test trials Constants s Functions Constant across test trials Dependent variables measures measures System/SoS Attribute measures Measure changes across test trials A joint mission thread (JMT) is an operational and technical description of the end to end set of activities and systems that accomplish the execution of a joint mission. (CJCSI E) 7

7 Agenda x Joint Threads

8 Why Joint Threads Focuses the community on needed warfighting capability Provides the tester with a blueprint for the needed test environment Test Architecture, /Metrics, Systems, Forces, TTPs, Nets, Info Exchange, Instrumentation Provides the joint operational context for a System-of- Systems JMTs required to provide operational context for Joint Analysis, Assessments, Training, Experiments, T&E and M&S BUT Jointly validated, fully documented JMTs don t exist!

9 JMT Development Products Tier 1: JMT generic data description totally JMT: AV-1(High Level), OV-1, OV-2, OV-4, OV-5a, reusable architecture-based info sets SV-1,, High-Level Executable Architecture (EA) & IV Tier 2: JMT Strands : (Additional) AV-1 (Specific), OV-2, OV-3, OV-4, OV-5b, OV-6c, SV-1, SV-3, SV-5s, SV-6, SV-10c, SvcV-3, SvcV-5, Baseline EA, or documents that show: Node/System Pairing Message Order Distributions Timings Decision processes System attributes System Functionality (IAW JCSFL) Information Exchange Requirements (IERs) Message composition Interoperability Matrix Data Exchange Requirements (DERs) System Capabilities JMT Strand Tier 2 information represents specific documentation required to answer a particular question or solve a problem. JMT Strands are unique JMT segments that will have specific actors for each node, might use a Service-specific set of TTPs or CONOPS, may be AOR-specific or use a unique set of systems and apps all subset of Tier 1 information (OV-5, SV-1, etc.). Tool suite will include S-CAE, Architecture-Driven Analysis (ADA) EAs, augmented by: Joint Doctrine Education and Training Electronic Information System (JDEIS) Joint Common System Function List (JCSFL) Joint Style Guide (Army s Joint Test Threads +)

10 JFCOM s Joint Thread (JMT) Proposed Initial List Initial JMT List Counter IED Joint Close Air Support (JCAS) Air and Missile Defense Joint Personnel Recovery (JPR) CND/CNA/CNE EW/EA CWMD Global Force Management Medical Evacuation Joint Suppression of Air Enemy Defense (JSEAD) Joint Fires Time Sensitive Targeting Anti Air Warfare Interdiction Counter Mine Mine Operations Counter Drug Amphibious Assault Tactical Airlift PSYOP Maritime Interception Defensive Countermeasures Military Deception Non Combat Evacuation Non-Lethal Attack Joint Context to Clarify Joint Requirements & Improve Interoperability and Integration Joint Close Air Support Source: JFCOM J89 JMT Development located at > AKO Home > Joint Thread Architectures & Testing Working Group > Joint Thread Architectures & Testing Working

11 Agenda x Joint Thread Framework

12 JCIDS Joint Capability Definition Capability: The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action Ref. - CJCSI G, Mar 2009 Desired Effects to achieve Set of s Combinations of Means and Ways to perform The ability of: means and ways under specified standards and conditions to perform a set of tasks in order to achieve desired effects 13

13 Joint Capability Definition Impact on Standards & Conditions Desired Effect The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action Means & Ways s

14 WHAT Joint Capability Definition Impact on WHEN & WHERE Standards & Conditions WHY Desired Effect The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action WHO & HOW Means & Ways s

15 WHAT Joint Capability Definition Impact on Standards = measures + criteria WHEN & WHERE Standards & Conditions Conditions = environment + threat + Joint WHY Desired Effect The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action WHO & HOW Means & Ways possess functions s

16 WHAT Joint Capability Definition Impact on Standards = measures + criteria WHEN & WHERE Standards & Conditions Conditions = environment + threat + Joint WHY Desired Effect The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action WHO & HOW Means & Ways possess functions s

17 Reference Model What Why Desired Effects Performance Non-Materiel Materiel Who How Who How well / Attributes Functions SoS How functional Set of Conditions Threat Environment Joint Capability System Functions System SoS/System Attributes to cause to perform possess Activities Effects Functions Performer Standards evaluated by 18

18 Functional Requirements and Requirements and JMT Definition Examples Measure military effect (mission accomplishment)* Warfighter Requirements Desired effect Isolate the adversary : (1) Enemy accessibility to C2 (2) Blue systems operability Measure military effect (task performance) Warfighter Performance Requirements Activity CAS employment : (1) Employments where achieved desired target damage (2) Employments where information exchanges were timely SoS Measure SoS functionality SoS Functional Requirements SoS Parameter Services interoperability : (1) Services functional over time (2) User access to services System Measure System functionality System Functional Requirements System Parameter Suitability : (1) System reliability (2) System supportability *Source: DOT&E memo dtd 6Jan2010, Reporting of OT&E Results 19

19 Purpose The JMT are intended to evaluate causality of applying military capabilities to achieve mission desired effects.

20 Agenda x Joint Thread Development

21 JMT Tier 1 Decomposition WHEN & WHERE Tier 1 assess mission effects and task performance of generic operational nodes in a joint mission Standards & Conditions WHY Decomposition = Desired Effects Attributes The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action WHO & HOW Means & Ways Nodes Decomposition WHAT = Sub-tasks Attributes

22 JMT Tier 1 Decomposition Desired Effects Matrix 1 Attributes Matrix 2 Nodes OV-1 Matrix 3 s Matrix 4 Attributes Matrix 7 s & Activities Decomposition Matrix 8 Joint/Service Lists Matrix 5 Joint/Service List Matrix 6

23 Agenda x Joint Thread Development STEP 1

24 JMT Tier 1 Decomposition Desired Effects Matrix 1 Attributes Matrix 2 Nodes OV-1 Matrix 3 s Matrix 4 Attributes Matrix 7 s & Activities Decomposition Matrix 8 Joint/Service Lists Matrix 5 Joint/Service List Matrix 6

25 Step 1: Decomposition Desired Effects Attributes 1. : The task, together with the purpose, that clearly indicates the action to be taken and the reason therefore. (JP 1-02) 2. Statement: A mission describes the organization s essential task (or tasks) and purpose a clear statement of the action to be taken and the reason for doing so. (UJTL Manual Aug 2008) Short sentence or paragraph that describes the organization's essential task (or tasks) and purpose-a clear statement of the action to be taken and the reason for doing so. (JP 5-0) statement contains the elements of who, what, when, where, and why, but seldom specifies how. (JP 5-0) Example: Conduct an integrated joint close air support with a common and standardized doctrine, organization, training, materiel and facilities that will be interoperable and effective in a joint mission environment. (JP 5-0) 3. objectives: (JP 5-0) The mission is then further defined with objectives, that are: The clearly defined, decisive, and attainable goal toward which every operation is directed. The specific target of the action taken (for example, a definite terrain feature, the seizure or holding of which is essential to the commander s plan, or an enemy force or capability without regard to terrain features). Examples: (1) To delay, disrupt, destroy, or degrade enemy operational forces or critical tasks and facilities (including command, control, and intelligence (C2I) targets), (2) To affect the enemy's will to fight

26 Step 1: Decomposition Desired Effects Attributes Sources of Information: JMT All View 1 (AV-1) Joint Doctrine Analytic Agenda OPLANs/CONOPS Example: : Joint Personnel Recovery statement: Prevent, plan, prepare, execute, and adapt military, diplomatic, and civil efforts to conduct Joint Personnel Recovery for isolated personnel who are separated (as an individual or group) from their unit while participating in a USsponsored military activity or mission and who are, or may be, in a situation where they must survive, evade, resist, or escape in order to recover and reintegrate those isolated personnel into their organization. (Source: JP3-50) Objectives: (Source: JPR JMT) Protect the force Enable military missions Defeat adversary attempts to exploit a known asymmetric vulnerability

27 Step 1: Decomposition Desired Effects Attributes Definition - Desired Effects: The Joint Operation Planning Process, discusses the use of desired and undesired effects in joint operation planning as a way to clarify the relationship between objectives and tasks. (JP 5-0) Effects describe system behavior in the operational environment desired effects are the conditions related to achieving objectives; and tasks direct friendly action. (CBA Guide v3) Examples: (1) Threat forces destroyed or neutralized in JOA (2) Enemy unwillingness to fight Sources of Information: JMT All View 1 (AV-1) Joint Doctrine Analytic Agenda OPLANs/CONOPS

28 Step 1: Decomposition Desired Effects Attributes Guidelines: Follow the JMT All View 1 (AV-1) Use other sources as needed (Joint Doctrine, Analytic Agenda, OPLANs/CONOPS) Ensure the effects describe system behavior in the operational environment Map to mission objectives Ask the question, If I can achieve this desired effect, then I will have helped to accomplish my mission objective? Example: (For Joint Personnel Recovery JMT) Desired Effects: (Source: JP 3-50, pg ix) Return isolated personnel to duty Sustain morale Increase operational performance Deny adversary the opportunity to influence our military strategy and national will by exploiting the intelligence and propaganda value of isolated personnel

29 Step 1: Decomposition Desired Effects Attributes Matrix 1

30 Step 1: Decomposition Desired Effects Attributes Definition - Attributes: An attribute is defined as a quantitative or qualitative characteristic of an element or its actions At the mission level, the focus is on describing actions When appropriate, SWarF prioritized attributes associated with relevant JCAs should be used. Sources of Information: JMT All View 1 (AV-1) Joint Doctrine Analytic Agenda OPLANs/CONOPS

31 Step 1: Decomposition Desired Effects Attributes Guidelines: Start with mission desired effect Pick out modifying language that characterizes the activity Match this language with a measureable attribute (SWarF, other attribute lists) Should be at least one attribute for each desired effect Example: (For Joint Personnel Recovery JMT) Desired Effects: Return isolated personnel to duty (Source: JP 3-50, pg ix) Before recovered isolated personnel can be returned to duty they must be medically cleared, complete a SERE/intelligence debrief, and have some form of decompression

32 Step 1: Decomposition Desired Effects Attributes Example (continued): (For Joint Personnel Recovery JMT) Desired Effects: Return isolated personnel to duty (Source: JP 3-50, pg ix) What are the characteristics for this Desired Effect? Returned Medically cleared Debriefed Decompressed What are the possible attribute(s) for this Desired Effect? Completed? Must complete recovery Readiness? Must be ready for duty

33 Step 1: Decomposition Desired Effects Attributes Matrix 2

34 Step 1: Decomposition Desired Effects Attributes Definition - : measures are intended to measure effects. The data used for evaluation are appropriately called measures of effectiveness, because they measure the military effect (mission accomplishment) that comes from the use of the system in its expected environment. (DOT&E memo, dated Jan 06, 2010) Sources of Information: JMT All View 1 (AV-1) Joint Doctrine Analytic Agenda OPLANs/CONOPS

35 Step 1: Decomposition Desired Effects Attributes Guidelines: Start with mission attribute definition Keep measures simple. Write according to guidelines in UJTL Manual Determine the scale (time, length, quality, etc) Should be at least one measure for each attribute Example: (For Joint Personnel Recovery JMT) Desired Effects: Return isolated personnel to duty (Source: JP 3-50, pg ix) Attribute: Readiness Readiness is a state of preparedness of forces or weapon system or systems to meet a mission or to engage in military operations

36 Step 1: Decomposition Desired Effects Attributes Example (continued): (For Joint Personnel Recovery JMT) Desired Effects: Return isolated personnel to duty (Source: JP 3-50, pg ix) Attribute: Readiness What are the characteristics for this Attribute? Trained personnel Material condition Supplies Number of units (personnel) available What are the possible measures for this Attribute? Percent Of JPR missions where key personnel where properly trained Percent Of JPR missions where adequate resources where available Readiness is based on adequate and trained personnel, material condition, supplies/reserves of support system and ammunition, numbers of units available, etc (DAU Glossary, 13th Edition Nov 2009)

37 Step 1: Decomposition Desired Effects Attributes Matrix 3

38 Agenda x Joint Thread Development STEP 2

39 JMT Tier 1 Decomposition Desired Effects Matrix 1 Attributes Matrix 2 Nodes OV-1 Matrix 3 s Matrix 4 Attributes Matrix 7 s & Activities Decomposition Matrix 8 Joint/Service Lists Matrix 5 Joint/Service List Matrix 6

40 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Definition Nodes: Attributes The operational nodes are those key functional nodes required to perform the mission Key nodes should be shown in the OV-1 Each operational node is provided a functional title that is not system specific Example: An operational node may be shown as a - strike aircraft. Identifying the node as a F/A-18, would be incorrect for a Tier 1 JMT Sources of Information: JMT View 1 (OV-1) Guidelines: Use the JMT View 1 (OV-1) Ensure the operational nodes are generic and not system specific Organizational names are OK if it is a joint organization that will not differ in the JMT Tier 2s

41 Step 2: Decomposition Nodes Activities * Joint/Service Lists List Statement *Note: For identifying relevant tasks. See Joint/Service List description Prevent, plan, prepare, execute, and adapt military, diplomatic, and civil efforts to conduct Joint Personnel Recovery for isolated personnel who are separated (as an individual or group) from their unit while participating in a US-sponsored military activity or mission and who are, or may be, in a situation where they must survive, evade, resist, or escape in order to recover and reintegrate those isolated personnel into their organization. Objectives Protect the force Enable military missions Attributes Defeat adversary attempts to exploit a known asymmetric vulnerability Desired Effects Return isolated personnel to duty Sustain morale Increase operational performance Deny adversary the opportunity to influence our military strategy and national will by exploiting the intelligence and propaganda value of isolated personnel to help achieve Adapt Execute Plan Prepare Prevent s Provides the ability to perform

42 Nodes *Note: For identifying relevant tasks. See Joint/Service List description Definition Activities: Activities * Joint/Service Lists Attributes List A task is an action or activity. When we discuss activities, we are really referring to tasks. (Note: DoDAF 2.0 uses the term activities ) s can be decomposed to multiple levels as needed Sub-tasks Sub-sub-tasks First level of tasks should be found in the OV-1 Step 2: Decomposition OV-2 Search Team Matrix 4 4. Execute Sources of Information: First level of tasks should be found in the OV-1 Lower level task decomposition should be in OV-2s and OV-5s PRCC 3. Plan 4. Execute 5. Adapt JPRC 1. Prevent 2. Prepare 3. Plan 4. Execute 5. Adapt DPMO 4. Execute BCD 4. Execute

43 Step 2: Decomposition Nodes *Note: For identifying relevant tasks. See Joint/Service List description Activities * Joint/Service Lists Attributes List Matrix 4 Guidelines: Use the JMT Views OV-2 and OV-5 Use other sources as needed Use operational nodes, not system specific Map subordinate tasks as needed. Stop when all sub-tasks have same nodes Sub-tasks Sub-sub-tasks Example: Use the Execute - Locate sub-task

44 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 4 Attributes

45 Nodes *Note: For identifying relevant tasks. See Joint/Service List description Definition Joint/Service Lists: Activities * Joint/Service Lists Attributes List Universal Joint List (UJTL) is a documented list of joint tasks Service task lists also exist from each Service that documents Service specific tasks. Note: Air Force no longer maintains a task list Sources of Information: Step 2: Decomposition Matrix 5 Joint Doctrine, Education, & Training Electronic Information System Joint and Service task lists provide an authoritative source for existing task descriptions and measures

46 Step 2: Decomposition Nodes *Note: For identifying relevant tasks. See Joint/Service List description Guidelines: Activities * Joint/Service Lists Attributes List Matrix 5 Example: Start with the primary joint task that the JMT is based on (ex. JPR JMT is based on TA 6.2: Execute Personnel Recovery Operations). Determine which supporting joint and service tasks listed in the primary joint task can be mapped to sub-tasks in the JMT. Focus mostly on operational and tactical tasks, as strategic national and strategic theater tasks will probably not help in identifying JMT task measures Consider supporting tasks listed in other relevant joint tasks as possible tasks to include in the matrix. When in doubt on listing a task, do it. It may produce good measures Execute Locate sub-task

47 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 5 Attributes

48 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Definition Joint/Service List : Attributes Matrix 6 Joint and Service Lists provide measures for each task Joint/Service List measures support task measure decomposition, but are not assumed to be complete and sufficient The intent is to identify and list those task measures for possible use in the JMT Sources of Information: Joint Doctrine, Education, & Training Electronic Information System Joint and Service task list measures can provide a basis for development of the JMT task measures

49 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Guidelines: Attributes Matrix 6 List measures documented in each Joint and Service task identified in matrix 5 Eliminate duplicates when they exist, but maintain mapping to relevant tasks Example: Execute Locate sub-task

50 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 6 Attributes

51 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Definition - Attributes: An attribute is defined as a quantitative or qualitative characteristic of an element or its actions At the task level, the focus is still on describing actions When appropriate, SWarF prioritized attributes associated with relevant JCAs should be used Sources of Information: JMT All View 1 (AV-1) and Views (OVs) Joint Doctrine Analytic Agenda OPLANs/CONOPS Joint/Service Lists (Matrix 5) Attributes Matrix 7

52 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Guidelines: Attributes Matrix 7 Every task has multiple dimensions of performance that can be observed and the criteria to specify an acceptable level of performance for each dimension. At a minimum, most tasks can be measured in terms of the time required to initiate or to complete a task (i.e. response time), the rate at which progress is being made (e.g., rate of movement), an overall level of completion or success (e.g., of fires to target) in terms of power (e.g., engagement range), lethality (e.g., rate transmitted). Key dimensions of task performance should be found in the commander s guidance and concept of operations. Source: UJTL Manual, Appendix B, Enclosure B, page 4 Some Common Attributes Timeliness: The time required to initiate or to complete a task (i.e. response time) Effectiveness: The rate at which progress is being made in a task(e.g., rate of movement) Completion: An overall level of completion or success with a task(e.g., of fires to target) in terms of power (e.g., engagement range) Lethality: The rate of kill in a task (e.g., P k ) Accuracy: The degree of precision in a task

53 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Guidelines: Attributes Matrix 7 Review warfighter requirements for task performance attributes. Review related Joint and Service tasks listed in Matrix 6 for relevant attributes. Consider the commonly used task attributes. Develop task descriptions from JMT products and joint doctrine. Use to identify potential task attributes. Ask the question, Does the task need to be (insert the attribute)? to verify if the attribute is appropriate to evaluating the task. Ensure there are at least one attribute for each task. Attributes mapped to sub-tasks should also map to the parent task. Example: Execute Locate- Execute Search Plan sub-task Attributes Attributes System/SoS Attributes Development Flow

54 Step 2: Decomposition Example: (For Joint Personnel Recovery JMT) 4.0 Locate s 4.1 Execute Search Plan: Determine the location and status of the isolated personnel (precisely find; fast response) 4.2 Verify/Fuse Location: Verify and fuse isolated personnel s location information to provide accurate and reliable coordinates for refining recovery plans. Goal is for latest, most reliable location information. 4.3 Authenticate IP: Authenticate isolated personnel using ISOPREP data and other methods 4.4 Share Location: Use available information to refine isolated personnel s location with reliable and accurate information What are the characteristics for the sub-task: 4.1 Execute Search Plan? Accuracy Of executing the search plan Timeliness In executing the search plan Goodness In how well conducted the search plan What are the characteristics for the task: 4.0 Locate? Accuracy Of information provided Timeliness In performing the task to provide IP location Goodness In providing the IP information Information Reliability Of the IP information Completeness Of the IP information Matrix 7

55 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 7 Attributes

56 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 8 Attributes Definition - : Each task will have measures associated with it that will evaluate an attribute measures should provide the basis for meeting warfighter requirements for performing tasks These measures will be referred to as Sources of Information: JMT All View 1 (AV-1) and Views (OVs) Joint Doctrine Analytic Agenda OPLANs/CONOPS Joint/Service List (Matrix 6)

57 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Guidelines: Matrix 8 Attributes Write measures utilizing the general guidance provided in UJTL Manual. Use established measures from task lists only when appropriate. There should be at least one measure identified for each attribute. Determine a scale and description for each measure. may span numerous level of tasks; ex. A measure of timeliness for a sub-task may also require a measure of timeliness for the parent task. A short list of measures is often better than a long list of measures. Example: (For Joint Personnel Recovery JMT) Execute Locate Execute Search Plan sub-task

58 Step 2: Decomposition Example: (Execute Locate Execute Search Plan sub-task) 4.0 Locate s 4.1 Execute Search Plan: Determine the location and status of the isolated personnel (precisely find; fast response) 4.2 Verify/Fuse Location: Verify and fuse isolated personnel s location information to provide accurate and reliable coordinates for refining recovery plans. Goal is for latest, most reliable location information. 4.3 Authenticate IP: Authenticate isolated personnel using ISOPREP data and other methods 4.4 Share Location: Use available information to refine isolated personnel s location with reliable and accurate information What are possible measures for this sub-task: 4.1 Execute Search Plan? Accuracy: Percent - Of instances where search was executed according to plan Timeliness: Time - To commence search from time tasked Time To locate IP Goodness: Percent Of instances where IP was located What are possible measures for the task: 4.0 Locate? Accuracy: Percent - Of instances where shared info = ground truth Matrix 8 Timeliness: Time To execute Locate task when resulted in accurate info Percent Of instances where able to locate IP within given time (Source:TA 6.2) Goodness: Percent Of instances where IP was located Info Reliability: Percent Of instances where improved/maintained info reliability Completeness: Percent Of instances where shared info was complete

59 Step 2: Decomposition Nodes Activities * Joint/Service Lists List *Note: For identifying relevant tasks. See Joint/Service List description Matrix 8 Attributes

60 JMT Tier 1 Decomposition Desired Effects Matrix 1 Attributes Matrix 2 Nodes OV-1 Matrix 3 s Matrix 4 Attributes Matrix 7 s & Activities Decomposition Matrix 8 Joint/Service Lists Matrix 5 Joint/Service List Matrix 6

61 JMT Tier 1 Decomposition Impact on System Testing - Example Joint Thread: Joint Personnel Recovery System under Test: F/A-18 Node: Search Aircraft Relevant s: 4.0 Locate 4.1 Execute Search Plan 4.2 Verify/Fuse location Relevant : Matrix 8 measures Relevant : Matrix 3 measures

62 Agenda x Joint Thread Development Tier 2

63 JMT Tier 2 Decomposition WHEN & WHERE Tier 2 assess System & SoS functionality within Standards a specific JMT Tier 2 strand and its & impact on mission Conditions effects and task performance WHY Decomposition = Desired Effects Attributes The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action Decomposition WHAT = Sub-tasks Attributes WHO & HOW Convert Means & Ways Nodes to specified Systems that establishes a SoS configuration

64 JMT Tier 2 Decomposition

65 Linked slides

66 Battlespace Awareness ISR Comprehensive Persistent Survivable Integrated Timely Credible Adaptable Innovative C2 Interoperability Understanding Timeliness Accessibility Simplicity Completeness Agility Accuracy Relevance Robustness Trust Environment Comprehensive Timely Integrated Persistent Credible Survivable Adaptable Innovative Information Transport Enterprise Services Net-centric Net Management Information Assurance Accessible Accessible Accessible Security Capacity Interoperable Dynamic Available Accurate Survivable Flexible Timely Timely Timely Agile Accurate Throughput Reliable Integrated Visible Expeditionary Accurate Maintainable Responsive Latency Relevant Complete Controllable Deployment & Distribution Visibility Scalable Reconfigurable Complete Responsive Robust Supply Responsivene ss Maintain Logistics Logistics Services Contract Support Engineering Sustainability Responsiveness Responsiveness Effective Reliability Sustainability Responsiveness Attainability Attainability Expeditionary Velocity Flexibility Attainability Sustainability Flexibility Agile/Tailorable Precision Survivability Flexibility Flexibility Survivability Networked Capacity Attainability Economy Economy Sustainability Integrated Economy Survivability Survivable Simplicity Precise Simplicity Simplicity Simplicity Economy SwarF Prioritized List of Attributes (Source: JCIDS Appendix A, Enclosure A) Enduring/ Persistence

67 Back-up Charts 68

68 Joint 1. : The task, together with the purpose, that clearly indicates the action to be taken and the reason therefore. (JP 1-02) 2. Statement: A mission describes the organization s essential task (or tasks) and purpose a clear statement of the action to be taken and the reason for doing so. (UJTL Manual Aug 2008) Short sentence or paragraph that describes the organization's essential task (or tasks) and purpose-a clear statement of the action to be taken and the reason for doing so. (JP 5-0) statement contains the elements of who, what, when, where, and why, but seldom specifies how. (JP 5-0) Example: Conduct an integrated joint close air support with a common and standardized doctrine, organization, training, materiel and facilities that will be interoperable and effective in a joint mission environment. (JP 5-0) 3. objectives: (JP 5-0) The mission is then further defined with objectives, that are: The clearly defined, decisive, and attainable goal toward which every operation is directed. The specific target of the action taken (for example, a definite terrain feature, the seizure or holding of which is essential to the commander s plan, or an enemy force or capability without regard to terrain features). Examples: (1) To delay, disrupt, destroy, or degrade enemy operational forces or critical tasks and facilities (including command, control, and intelligence (C2I) targets), (2) To affect the enemy's will to fight 4. Desired Effects: The Joint Operation Planning Process, discusses the use of desired and undesired effects in joint operation planning as a way to clarify the relationship between objectives and tasks. (JP 5-0) effects describe system behavior in the operational environment desired effects are the conditions related to achieving objectives; and tasks direct friendly action. (CBA Guide v3) Examples: (1) Threat forces destroyed or neutralized in JOA (2) Enemy unwillingness to fight 69

69 Joint 1. : MOEs assess changes in system behavior, capability, or operational environment. They measure the attainment of an end state, achievement of an objective, or creation of an effect; they do not measure task performance. (JP 5-0) Examples: (1) Percent of enemy forces destroyed, delayed, disrupted, or degraded, (2) Percent of enemy forces that desert or surrender 2. : A task is an action or activity (derived from an analysis of the mission and concept of operations) assigned to an individual or organization to provide a capability. (UJTL Manual, Aug 2008) MOPs assess friendly actions that is tied to measuring task accomplishment. (JP 1-02) Generally quantitative, but also can apply qualitative attributes to task accomplishment. (JP 5-0) MOPs are used in most aspects of combat assessment, since it typically seeks specific, quantitative data or a direct observation of an event to determine accomplishment of tactical tasks. But MOPs have relevance for noncombat operations as well (e.g., tons of relief supplies delivered or noncombatants evacuated). (JP 5-0) MOPs also can be used to measure operational and strategic tasks, but the type of measurement may not be as precise or as easy to observe. (JP 5-0) Examples: (1) Time to get ordnance on target after initiating air-to-surface attack request (2) Number targets attacked IAW requests for fires 70

70 Terms of Reference Activity: An Activity is work, specific to a single organization, weapon system, or individual, that transforms inputs into outputs or changes their state. (DoDAF 2.0) Attribute: A quantitative or qualitative characteristic of an element or its actions. (CJCSI G) Capability: The ability to achieve a desired effect under specified standards and conditions through combinations of means and ways across DOTMLPF to perform a set of tasks to execute a specified course of action (CJCSI G, Mar 2009) Condition: (1) Those variables of an operational environment or situation in which a unit, system, or individual is expected to operate and may affect performance. (UJTL Manual), (2) The sample of adversaries and operating conditions the scenario (Capability-Based Assessment User s Guide v3 dated Mar 2009) Criterion: The minimum acceptable level of performance associated with a particular measure of [task] performance. It is often expressed as hours, days, percent, occurrences, minutes, miles, or some other command-stated measure. (UJTL Manual Aug 2008) Effect [ Desired]: (JP 1-02) (1) The physical or behavioral state of a system that results from an action, a set of actions, or another effect, (2) The result, outcome, or consequence of an action, (3) A change to a condition, behavior, or degree of freedom 71

71 Terms of Reference Function [System/] : The action for which a person or thing is specially designed, fitted, used or intended to accomplish or execute. (DoDAF 2.0) Joint Environment : A subset of the joint operational environment composed of force and nonforce entities; conditions, circumstances and influences within which forces employ capabilities to execute joint tasks to meet a specific mission objective. (TSSG) Joint Thread: An operational and technical description of the end to end set of activities and systems that accomplish the execution of a joint mission. (CJCSI E) KPP/KSA/CTP: Attributes/parameters of a system that are considered critical (JCIDS) Means: (1) Forces, units, equipment, and resources (TOR for JCA reassessment), (2) Solutions represent means, or resources that can be employed (Capability-Based Assessment User s Guide v3 dated Mar 2009), (3) Means are based on DOTMLPF organization, materiel, personnel, & facility resources Measure: A parameter that provides the basis for describing varying levels of accomplishment. (UJTL Manual Aug 2008) Measure of Effectiveness []: A criterion used to assess changes in system behavior, capability, or operational environment that is tied to measuring the attainment of an end state, achievement of an objective, or creation of an effect (JP 1-02) 72

72 Terms of Reference Measure of Performance []: A criterion used to assess friendly actions that is tied to measuring task accomplishment. (JP 1-02) Measure of System/SoS Attribute: A parameter that describes varying levels of attributes. (CTM) : The task, together with the purpose, that clearly indicates the action to be taken and the reason therefore. (JP 1-02) Node: An element of a system that represents a person, place, or physical thing. (JP 1-02) : An action or activity (derived from an analysis of the mission and concept of operations) assigned to an individual or organization to provide a capability. (UJTL Manual Aug 2008) Note: This term and its definition to be included in JP 1-02 Standard: A standard provides a way of expressing the acceptable proficiency that a joint organization or force must perform under a specified set of conditions. A standard consists of one or more measures for a task and a criterion for each measure. (UJTL Manual Aug 2008) System: A functionally, physically, and/or behaviorally related group of regularly interacting or interdependent elements; that group of elements forming a unified whole. (JP 1-02) Ways: (1) Doctrine, tactics, techniques, and procedures, competencies, and concepts (TOR for JCA reassessment), (2) Functions [are] considered ways (Capability-Based Assessment User s Guide v3 dated Mar 2009), (3) Ways are based on DOTMLPF doctrine, training, and leadership. 73