EXAM2 (Develop the TEMP and Test Planning, Best Manufacturing Practices, Scheduling, Request for Proposal, Work Breakdown Structure, Leadership and Ethics, Systems Engineering in Acquisition, Systems Engineering Process Model, Technical Management Processes, Risk Management) Flashcards
(146 cards)
Understand the purpose of T&E and why we test
The purpose of test and evaluation (T&E) in a development and acquisition program is to help reduce or manage risks in:
Development
Acquisition
Utilization
We test to measure specific individual performance factors.
Recognize the customers of T&E
Developers / Acquisition Managers
Designers and Engineers
End-Users
Recognize the various test agencies
Director, Operational Test and Evaluation (DOT&E)
Army Test and Evaluation Command (ATEC)
Army Evaluation Center (AEC)
Operational Test Command (OTC)
Recognize the types of DT&E and OT&E
Types of OT&E (Operational Testing)
Early Operational Assessment (EOA)
Operational Assessment (OA)
Initial Operational Test and Evaluation (IOT&E)
Follow-on Operational Test and Evaluation (FOT&E)
Types of DT&E (Developmental Test and Evaluation)
Research Effort/Test
Technical Feasibility Test (TFT)
Engineering Development Test (EDT)
Production Qualification Test (PQT)
Production Verification Test (PVT)
First Article Test (FAT)
Production Acceptance Test and Evaluation (PAT&E)
Define test and evaluation
Test: Program, procedure or process to obtain, verify, or provide data to determine the degree to which a system or systems meet, exceed or fail to meet stated objectives
Obtains raw data (1’s and 0’s)
Measures specific, individual performance factors
Is resource intensive
Evaluation: Independent process to review, analyze, and assess data obtained from testing or other sources
Produces analyzed information from test data, modeling and simulation, or other sources
Draws conclusions by looking at how the factors interact
Is intellectually intensive
Define operational effectiveness and operational suitability
Operational Effectiveness: How well it does the job?
Operational Suitability: How well it can be supported?
Understand the purpose of Live Fire Testing and when it applies
Purpose of Live Fire Testing:
Determines crew survivability and/or system vulnerability
Confirms lethality of munitions/missiles against intended target set
Mandated by FY87 Defense Authorization Bill
Applies to:
ACAT I and II major vehicles and weapons platforms
Conventional weapons that provide some degree of protection
Major munitions greater than 1M rounds
Note - Can be waived - LFT can be waived with justification
Prior to program initiation
Impractical or too expense
Must still accomplish an alternative
To determine vulnerability
Survivability, and lethality
Define Interoperability and JITC’s (Joint Interoperability Test Command) role
Interoperability - The ability of systems, units, or forces to provide data, information, materiel, and services to and accept the same from other systems, units, or forces and to use the data, information, materiel, and services so exchanged to enable them to operate effectively together.
JITC issues a Interoperability Test Certification indicating: System has successfully passed interoperability testing and has met the NR-KPP
Testing is performed on Low Rate Initial Production (LRIP) production representative systems
Recognize the importance of T&E to milestone decisions
Before Milestone A: Approved T&E Strategy
Before Milestone B: Approved TEMP; Identification of LRIP quantities – Only 10% max without waiver; DT&E Report
Before Milestone C: Updated TEMP; Final DT&E Report; Operational Assessment
Define Verification and Validation
Verification that the system meets the performance specifications accomplished through Developmental Testing. (Did you build it right?)
Validation that the system fulfills the user’s required capabilities accomplished through Operational Testing. (Did you build the right thing?)
Define concurrent testing, combined testing, and integrated testing
Concurrent Testing- Circumstances in which developmental testing and operational testing take place at the same time as two parallel, but separate and distinct, activities.
Combined Testing- Single test program conducted to support developmental test and operational test objectives.
Integrated Testing- The collaborative planning and collaborative execution of test phases and events to provide shared data in support of independent analysis, evaluation, and reporting by all stakeholders, particularly the development (both contractor and government) and operational test and evaluation communities.
Identify the forum in which the operational tester brings together all the representatives of agencies involved in the Operational or Force Development Test to determine overall readiness for test
T&E WIPT
Understand the purpose of the T&E WIPT and when it is formed
The T&E WIPT is a defined forum serving the PM, and PMO, as the test and evaluation subject matter experts responsible for supporting the PM, and other program WIPTs, on all aspects of a program’s test and evaluation effort. This effort includes T&E program strategy, design, development, oversight, and the analysis, assessment and reporting of test results.
The T&E WIPT should be established and chartered as early as possible during the Material Solutions Analysis phase so that it is involved in program strategy discussions and plans.
Recognize why independent agencies conduct and oversee OT&E
Recognize why independent agencies conduct and oversee OT&E
Recognize T&E planning and its function
As the essential feedback mechanism for the Systems Engineering Process
Understand that the Test and Evaluation Master Plan (TEMP)
Must be updated periodically to ensure that it stays current and integrates the various disciplines as the program evolves through its life cycle
Understand that Developmental Test and Evaluation (DT&E) is
Essential in determining a system’s readiness for Initial Operational Test and Evaluation (IOT&E)
Understand that Operational Test and Evaluation (OT&E)
Helps determine system operational suitability and effectiveness, and it addresses Critical Operational Issues (COIs) that are defined by the User
The Logistics Demonstration is normally conducted
On those tasks performed at field level and some sustainment level by User representatives
Understand that the Test and Evaluation Master Plan (TEMP)
Is prepared by the Program Manager (PM) in conjunction with principal Test Integration Working Group (TIWG) members
NDIs (Non-developmental item) are
Any previously developed items regardless of the source of development-used exclusively for governmental purposes by federal, state, local, or allied governments
The DoD Acquisition Guidebook states that
Producibility is the design effort priority.
Manufacturing integrated into the design process results in
Reduced program risk
Factors leading to increased cost and production delays
Changing design requirements
Late design releases
Lack of production planning
Unstable funding