Utility

Question 1

Bookmark Method

Answer 1

n IRT-based method of setting cut scores that uses an item book, where items are placed in ascending order of difficulty and with experts making judgments and literally “bookmarking” items that exhibit the optimal level of difficulty for test items

Question 2

Compensatory model of selection

Answer 2

A model of applicant selection based on the assumption that high scores on one attribute can balance out low scores on another attribute

Question 3

Cut Score

Answer 3

a reference point (usually numerical) derived as a result of judgment and used to divide a set of data into two or more classifications, with some action to be taken or some inference to be made on the basis of these classifications

Question 4

Fixed cut score

Answer 4

a reference point in a distribution of test scores used to divide a set of data into two or more classifications that is typically set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification; contrast with relative cut score

Question 5

Hit Rate

Answer 5

the proportion of people who are accurately identified as possessing or not possessing a particular trait, behavior, characteristic, or attribute based on test scores

Question 6

miss rate

Answer 6

the proportion of people a test or other measurement procedure fails to identify accurately with respect to the possession or exhibition of a trait, behavior, characteristic, or attribute; a “miss” in this context is an inaccurate classification or prediction; may be subdivided into false positives and false negatives

Question 7

Known Groups Method

Answer 7

a system of collecting data on a predictor of interest from groups known to possess (and not to possess) a trait, attribute, or ability of interest

Question 8

Multiple cut scores

Answer 8

The use of two or more cut scores with reference to one predictor for the purpose of categorizing testtakers into more than two groups, or the use of a different cut score for each predictor when using multiple predictors for selection,

Question 9

Norm-referenced cut score

Answer 9

reference point in a distribution of test scores used to divide a set of data into two classifications based on norm-related considerations rather than on the relationship of test scores to a criterion

Question 10

Relative cut score

Answer 10

a reference point in a distribution of test scores used to divide a set of data into two classifications based on norm-related considerations rather than on the relationship of test scores to a criterion

Question 11

Top-down selection

Answer 11

It is a process of awarding available positions to applicants whereby the highest scorer is awarded the first position, the next highest scorer the next position, and so forth until all positions are filled

Question 12

Utility analysis

Answer 12

A family of techniques designed to evaluate the costs and benefits of testing and not testing in terms of likely outcomes

Question 13

Test

Answer 13

A measuring device or procedure