Test Development

Question 1

is an umbrella term for all that goes into the process of creating a test

Answer 1

Test Conceptualization

Question 2

The thought that “there ought to be a test for…” is impetus to
developing a new test.

Answer 2

TC

Question 3

The stimulus could be knowledge of psychometric problems with other
tests, a new social phenomenon, or any number of things.

Answer 3

T C

Question 4

The process of setting rules for
assigning numbers in measurement.

Answer 4

Scaling

Question 5

are instruments
to measure some trait, state, or ability and may be categorized in many ways

Answer 5

Scaling

Question 6

was very influential in the
development of sound scaling methods

Answer 6

LL Thorndike

Question 7

grouping of words, statements, or symbols on which
judgments of the strength of a particular trait, attitude, or emotion are
indicated by the test taker.

Answer 7

Rating Scales

Question 8

Developed to be “a practical means of assessing
what people believe, the strength of their convictions, as well as individual differences in moral
tolerance” (p

Answer 8

Morally Debatable Behavior Scale Revision

Question 9

Each item presents the test taker with five alternative responses (sometimes seven), usually on an agree–disagree or
approve–disapprove continuum.

Answer 9

Likert Scale

Question 10

Offers a continuum of responses that allow for measurements of
attitudes on various topics

Answer 10

Likert Scale

Question 11

Test takers must choose between two alternatives according to some rule.

Answer 11

Method of Pair Comparisons

Question 12

For each pair of options, test takers receive a higher score for
selecting the option deemed more justifiable by the majority of a group
of judges.

Answer 12

Method of Pair Comparisons

Question 13

Entails judgments of a stimulus in
comparison with every other stimulus on the scale

Answer 13

Comparative Scaling (Sorting Task)

Question 14

Stimuli are placed into one of two or more
alternative categories that differ quantitatively with respect to some
continuum.

Answer 14

Categorical Scaling

Question 15

Items range sequentially from weaker to stronger
expressions of the attitude, belief, or feeling being measured.

Answer 15

Guttman Scale

Question 16

provide a list of terms
and the individual
selects that most
characteristic of
herself or himse

Answer 16

Adjective checklist

Question 17

provide a list of adjectives that must be sorted into nine piles of increasing similarity to the target person.

Answer 17

Q - Sorts

Question 18

Guide for item Writing

Answer 18

Define clearly what you wish to measure
2. Generate pool of items
3. Avoid items that are exceptionally long
4. Be aware of the reading level of those taking the scale and the
reading level of the items
5. Avoid items that convey two or more ideas at the same time
6. Consider using questions that mix positive and negative
wording

Question 19

The reservoir or well from which items will or will not be
drawn for the final version of the tes

Answer 19

Test Pool

Question 20

Includes variables such as the form, plan, structure, arrangement, and layout of individual test items.

Answer 20

Item Format

Question 21

Items require test takers to select a
response from a set of alternative responses

Answer 21

Selected-response format

Question 22

Items require test takers to supply or to create the correct answer, not merely to select it.

Answer 22

Constructed response format

Question 23

Multiple-choice format has three elements:

Answer 23

1) a stem, (2) a correct
alternative or option, and (3) several incorrect alternatives or options
variously referred to as distractors or foils.

Question 24

Distractions

Answer 24

b: standardized behavioral
samples; c: reliable assessment instruments; and d: theory-linked measures

Question 25

A relatively large and easily accessible collection of test questions.

Answer 25

Item Bank

Question 26

An interactive, computer- administered test-taking process wherein items presented to the test taker are based in part on the test taker’s performance on previous items.

Answer 26

Computerized Adaptive Testing

Question 27

A discrepancy between scoring in an anchor protocol and the scoring of another protocol is referred

Answer 27

Scoring Drift

Question 28

refers to the revalidation of a test on a sample of test takers other than those on whom test performance was originally found to be a valid predictor of some criterion.

Answer 28

Cross Validation

Question 29

test validation process conducted on two or more tests using the same sample of test takers.

Answer 29

Co validation

Question 30

Allows test developers to evaluate the validity of items in relation to a criterion measure.

Answer 30

Item validity Index

Question 31

Indicates how adequately an item separates or discriminates between high scorers and low scorers on an entire test.

Answer 31

Item discriminatory Index

Question 32

The quality of each alternative within a multiple-choice item can be readily assessed with reference to the comparative performance of upper and lower scorers.

Answer 32

Analysis of item alternatives:

Question 33

is an item that favors one particular group of examinees in relation to another when differences in group ability are controlle

Answer 33

Biased Test Item