111 testing

Question 1

State the purpose of testing program

Answer 1

To assess the trainee’s achievement of learning objective

Question 2

State the primary course source data of creating test items

Answer 2

JDTA
OCCSTDS
CTTL/PPP
COI

Question 3

List usable course source data to be used when primary course source data (JDTA) is not available

Answer 3

OCCSTDS
CTTL
PPP
COI

Question 4

What are the two types of test

Answer 4

Formal- used in calculation of final grade
Informal- grade will not be in calculation of the final grade

Question 5

What are the level of proficiency for skill

Answer 5

Level 1: Imitation
Level 2: Repetition
Level 3: Habit

Question 6

What are the level of proficiency for Knowledge

Answer 6

Level 1: Knowledge/Comprehension
Level 2: Application/Analysis
Level 3: Synthesis/Evaluation

Question 7

List five categories for performance and knowledge tests

Answer 7

[PPCOQ]
Pre-test
Progress
Comprehensive
Oral
Quiz

Question 8

Explain process of piloting a test

Answer 8

to assess test reliability and validity. Includes review by SME, pilot by CCMM and forwarded to LSO for approval.
Cannot fail a test.

Question 9

Describe the use of test instrument

Answer 9

Job sheet- step by step performance
Problem sheet-present practical problems, similar to those encountered on the job
Multiple choice- most versatile format
Labeling- to measure recall in pictures, schematics, diagrams, or drawings
Essay- answered with written response
Validation of test instrument- content must be validated

Question 10

What are the two types of testing methods used in testing

Answer 10

Criterion-referenced test-assess required level of skill or knowledge
Norm-referenced- estimates in relation to a group norm ex. advancement exam

Question 11

Discuss test failure policies and grading criteria

Answer 11

Test (if failed), re-train, re-test. If passed, highest score is 80%

Question 12

Identify ten section of a testing plan

Answer 12

C4T3GRD
Course data
Course roles and responsibilities
Course waivers
Course tests and test types
Test development
Test administration
Test and test item analysis
Grading criteria
Remediation
Documentation

Question 13

State the purpose of test and test item analysis

Answer 13

to determine statistical validity of tests. 3 types of analysis used are: Difficulty index, Index of discrimination, and effectiveness of alternatives

Question 14

What is the primary and secondary goal of remediation

Answer 14

primary- motivate and assist trainee
secondary- remove barriers of learning

Question 15

Discuss 3 methods of remediation

Answer 15

Targeted-One objective. one-on-one mentorship
Scalable- Major portion of a course. use recall approach
Iterative- Each major objective area. Use total recall approach

Question 16

Define sections of a remediation program

Answer 16

Retest- may cover portion of test or entire test
Setback- next class convening
Drop from training and attrites
Counseling-counseled for performance and personal problems
ARB

Question 17

When is ARB may be necessary

Answer 17

Trainee course average falls below minimum passing grade
unable to achieve the objective.
Below expected academic progress
Objectives after an academic setback on those same objectives