111 Testing

Question 1

State the purpose of a Testing program

Answer 1

Ensure Quality testing to effectively assess trainees achievement of learning objectives

Question 2

State the primary course source data for creating test items

Answer 2

JDTA

Question 3

List the usable course data to be used when the primary course source data is not available or has not been created

Answer 3

OCCSTDs, CTTL, PPP table and COI

Question 4

Define the following tests:
Formal
Informal

Answer 4

Formal- graded, used toward final grade

Informal- May or may not be graded. Doesn’t count toward final grade

Question 5

Define the following proficiency levels and definition of the 3 levels contain within each:
Skill
Knowledge

Answer 5

Skill Level 1- Imitation
Level 2- Repetition
Level 3 - Habit
Knowledge Level 1- Knowledge/ Comprehension
Level 2- Application/ Analysis
Level 3- Synthesis/ Evaluation

Question 6

List the 5 categories for performance and knowledge tests

Answer 6

Pre-test
Progress Test
Comprehensive Test
Oral Test
Quiz

Question 7

Discuss the process of piloting a test

Answer 7

Reviewed by SME to ensure proper assessment of LO
Review and approval by CCMM sent to LSO for final approval
Test a group of students under actual conditions w/ knowledge that test doesn’t count towards final grade
curriculum development will develop trainee critique to evaluate after test
Review results

Question 8

Describe the use of each test instrument as they relate to knowledge and performance tests

Answer 8

Job, Assignment, Problem Sheets
Essay, Case study, Completion, Labeling
Matching, Multiple choice, T/F
Validation of Test instrument- content validated: grammar, assess LO, appropriate level, open/closed and stated in course

Question 9

What are the 2 grading systems used

Answer 9

Criterion-referenced test- what we do

Norm-referenced test- curve, Navy Advancement

Question 10

Discuss test failure policies and associated grading criteria within your learning environment

Answer 10

Min score 75%
1st fail= 1 week MNS, remediation from instructor and retest
2nd fail in 3 wks= ARB
1 Knowledge and 1 PT fail in same area= ARB
Same test fail twice= STOP training and go to BMS to await ARB

Question 11

Discuss during performance test design, how the skill learning objective criticality is determined

Answer 11

High- value of 3- is skill used during job performance
Moderate- value of 2- skill influences job performance
Low- value of 1- skill has little influence on job performance

Question 12

Discuss during knowledge test design, how the knowledge learning objective criticality is determined to perform a task

Answer 12

using course source data
criticality of performance
factors listed in the Testing plan

Question 13

LIst the 10 sections of a testing plan

Answer 13

Course data
Course roles and responsibilities
Course waivers
Test development
Test administration
Course tests and test types
Grading Criteria
Remediation
Test and Test item Analysis
Documentation

Question 14

State the purpose of test and test item analysis

Answer 14

Determine statistical validity:
difficulty index- calculation of difficulty
index of discrimination- with norm-reference testing
effectiveness of alternatives- multiple choice
test item analysis is documented in the courses testing plan

Question 15

In a remediation program, discuss what primary and secondary goal is

Answer 15

Primary- motivate and assist trainees in achieving the critical learning objectives by more instruction
Secondary- Remove barriers to learning

Question 16

Discuss the 3 methods of remediation available to instructors

Answer 16

Targeted- student has issues (small portion) in accomplishing objectives during normal class time. one on one mentorship of SME
Scalable- student lacks with major portion of objectives. Direct engagement
Iterative- retained nothing. one on one total recall

Question 17

Discuss the following of the remediation program
Retest
Setback
Drop from training and attrites
Counseling
ARB

Answer 17

Retest-when trainee fails
Setback- when trainee needs more time for objectives
Drop and attrites- every effort made, DFT if unsuited, unwilling, unable to learn. Attrite- if released form navy
Counseling- in a and c schools for performance and personal problems
ARB- when all else fails