Engineering and Manufacturing Development YOU ARE HERE. As homework, you read the SPAW MS B TEMP and wrote down any mistakes you noticed.

Transcription

1 TEMP Review Exercise CDD Validation Dev. RFP Release MDD A B C FRP IOC FOC Materiel Solution Analysis Tech Maturation & Risk Reduction Engineering and Manufacturing Development Production & Deployment Operations & Support YOU ARE HERE As homework, you read the SPAW MS B TEMP and wrote down any mistakes you noticed. Remember the J-SPAW is an ACAT 1C, JROC Interest Program and is on the OSD T&E Oversight List for DT&E / OT&E / LFT&E. 1

2 TEMP Review Exercise Given Key CDD requirements J-SPAW TEMP submitted in support of Milestone B Objective: Analyze a Milestone B TEMP Overview Analyze a Milestone B TEMP (for errors in content, format, etc.) Prepare and present a briefing to the class on the results of your analysis Categorize the errors found by where you found them (TEMP Part 1, Part 2, etc.) Each team will brief the errors they found from only one part of the TEMP 2

3 Limited User Test (LUT) For the J-SPAW TEMP we gave you: Assume that a LUT is the same thing as an Operational Assessment (OA) LUT Phase I occurs during EMD Production & Deployment (PD) LUT occurs prior to IOT&E Typical OA objectives: Estimate potential operational effectiveness & suitability Examine / assess key risk areas, & COIs that need to be resolved earlier than IOT&E Help identify best design; examine operational aspects of system design, adequacy of CONOPS, etc. OAs often support the MS C Review (the SPAW PD LUT supports decisions concerning readiness for IOT&E and/or readiness for production) 3

4 What is a TEMP? Executive level strategy and primary T&E planning and management document for entire life cycle - Contract Between All Stakeholders Overall T&E structure, major elements, and objectives Consistent with Acquisition Strategy Sufficient detail to permit planning for timely availability of test resources required to support the T&E program Road Map for integrated simulation, test, and evaluation plans; resource requirements; and schedules Note: The Program Manager will use the DAG TEMP format and content as guidance in formulating DT&E plans, per DoDI , Encl 4, par 5a 4

5 TEMP Suggested Content Should include the following items: Acquisition strategy tie-in Time-phased threats to mission accomplishment Technical risk reduction testing (new or critical technologies from Technology Development Strategy) Component and sub-system developmental testing Critical operational and live fire issues Scope and structure of the operational and live fire evaluations Major T&E design considerations T&E schedule Anticipated M&S used for future system evaluations T&E funding estimates for programming and budgeting Rigorous use of experimental design within the development of the test design (See the TEMP Guidebook TEMP Format, which is in this section of your student book.) 5

6 Develop the TEMP via the T&E WIPT process Provide sufficient details about future DT&E activities (in Part III) Be specific while eliminating the fluff A TEMP is a master strategy document, not a detailed test plan To reduce the size of TEMPs, use pointers to other documents where more details are present, such as: Software development plans Modeling and simulation plans Logistic support plans Include T&E WIPT Subgroups (that is, RAM, Supportability M&S, Threat, Live Fire, etc.) in the T&E planning Leverage all testing TEMP Development Process 6

7 Deadly Sins Affecting TEMP Premature Submission: Submitting a TEMP for approval when an issue(s) precluding approval exists Failure to Pre-Coordinate: OSD: DT&E and DOT&E Incomplete: Approval - Requirements/Test Crosswalk Matrix missing - Classified data not integrated - submitted separately - Too many TBDs in Part IV (Resources) Size: Body of plan, excluding annexes, not kept to a manageable length Annexes: Not kept to a minimum Reference Documents: ICD/CDD/CPD & STAR not approved / unavailable 7

8 TEMP Do s and Don ts Do have strict configuration control over TEMP Do have Part IV (Resources) based upon Part III Do have Requirements/Test Crosswalk Matrix as Attachment 1 Do know the TEMP Approval Authority before developing the TEMP Do treat the TEMP as a Contract among all Stakeholders Do ensure that Core T&E WIPT members agree with any change(s) required to obtain TEMP approval after providing their signature on the TEMP s T&E WIPT Coordination Sheet 8

9 TEMP Do s and Don ts (cont.) Do check to ensure TEMP agrees with key documents such as contracting docs (RFP, SSP), SEP, etc. Don t attempt to gain TEMP approval before obtaining COIC approval Don t allow Concur with Comment on final T&E WIPT Coordination Don t have TEMP simply refer to System Evaluation Plan to avoid unnecessary tiering 9

10 TEMP Guidance What Reviewers are Looking For The following guidance/documents are on the Student CD-ROM: DASD(DT&E) TEMP Review Guides In the DoD folder DOT&E Memos (in the DoD, IT, & Statistics folders) Use of Design of Experiments in OT&E Cybersecurity Several other memos DTM on Reliability (in the Reliability folder) Service specific guidance (in the Air Force, 10 Army, Marine Corps, and Navy folders)

11 DASD(DT&E) TEMP checklist DASD(DT&E) TEMP Tenets Checklist (on student CD) has: 1.Evaluation framework with testable and measurable criteria 2.Adequate scope and reasonable phasing 3.Reliability growth 4.Certifications 5.Analytical basis (STAT) 6.Achievable schedule 7.Exit / entrance criteria for TRR and major T&E phases 8.T&E WIPT / Integrated Test Team 9.Resources & resource mapping 10.Management (Chief Developmental Tester, Lead Govt. DT&E Organization identified) 11

12 TEMP Exercise Tasks Read the J-SPAW MS B TEMP Analyze the TEMP for errors in content, format, etc. This TEMP was submitted in support of Milestone B Ignore the sections that say omitted for training purposes Are the DT, OT, LFT&E & resources appropriate? Does the TEMP provide enough information to address Milestone B, Milestone C, FRP-DR and beyond? Suggest that one person from each team compare the J- SPAW TEMP to the DAG TEMP format in Student Guide In the real world, the TEMP would be compared to the CDD, and other sources of information. For the sake of time, we will NOT do that during this exercise. Prepare and present a team briefing to the class on the results of your analysis (errors, adequacy, etc.) Present by TEMP paragraph #s, followed by your comments

13 TEMP Exercise Tasks (cont.) Each team will analyze a part of the TEMP in their team briefing: Part I (including any mistakes on Tables 1-1 and 1-2) Part II and all three cover / signature pages Part III (sections 3.1 through 3.4) Part III (section 3.5 through end of Part III) Part IV You will have 60 minutes to develop your team briefing 13