Chapter 5: Measurement Concepts

Question 1

A Likert scale is an example of which type of scale of measurement?

Answer 1

Ordinal

Question 2

Which correlation is the strongest?
-.87
\+.86
\+.30
.00

Answer 2

-.87

Question 3

The correlation of scores from one test administration with another administration
of the same test at a later date would be an example of which type of reliability?

Answer 3

Test-retest

Question 4

A test developer creates a new instrument to measure depression. He correlates this with an existing assessment that measures self-esteem. The test developer hopes not to find a high correlation to support the new instrument’s validity. Which type of validity is this?

Answer 4

Discriminant

Question 5

T/F: In order for a test to be valid, it must be reliable.

Answer 5

True

Question 6

What is a nominal scale?

Answer 6

Naming or classifying only

Does not possess magnitude, equal internals or an absolute zero

Question 7

What is an ordinal scale?

Answer 7

Order or rank of nominal categories Magnitude only

Question 8

What is an interval scale?

Answer 8

Equal distance among ranks or intervals; magnitude, equal intervals

Question 9

What is a ratio scale?

Answer 9

Possesses magnitude, equal intervals, absolute zero

Question 10

What are the key concepts related to reliability?

Answer 10

Measurement error
Correlation
Coefficient of determination

Question 11

What is reliability?

Answer 11

How consistently a test measures a variable

The extent to which it eliminates chance and other extraneous factors in its results

Question 12

Explain Measurement Error

Answer 12

Positive or negative bias within an observed score
True score can never be known
Individual error, test error, testing condition error

Question 13

What is the formula to show how error impacts scores?

Answer 13

observed score (X)=true score (T) + error score (e)

Question 14

What is correlation?

Answer 14

The degree to which two sets of measures are related

Question 15

What is reliability in regard to correlation?

Answer 15

Reliability is the relationship of one score with another actual or hypothetical test and an estimate of the test scores, not the test

Question 16

Does correlation indicate causation?

Answer 16

No

Question 17

What are the types of reliability?

Answer 17

Test-retest
Alternate-forms/parallel-forms
Internal consistency (split-half reliability, interitem consistency)
Interrater

Question 18

What is test-retest reliability?

Answer 18

Same individuals, two administrations

Question 19

What is alternate-forms reliability?

Answer 19

Consistency of scores of individuals within the same group on two alternate by equivalent forms of the same test

Question 20

What is internal consistency reliability?

Answer 20

Consistency of responses to the different items or parts of a test during a single test and administration

Question 21

What are two common measures of internal consistency?

Answer 21

Split-half reliability

Interitem consistency

Question 22

What is interrater reliability?

Answer 22

The degree of agreement between two or more independent judges

Question 23

How is interrater reliability calculated?

Answer 23

By dividing the number of agreements that an event occurred by the number of possible agreements

Question 24

What is validity?

Answer 24

The extent to which meaningful and appropriate inferences can be made

Question 25

What are the two types of invalidity?

Answer 25

Construct underrepresentation | Construct irrelevant variance

Question 26

What are the types of validity?

Answer 26

Face validity (not evidence of validity) Content validity Criterion-related validity (concurrent/predictive) Construct validity (convergent/discriminant) Treatment validity

Question 27

What is content validity?

Answer 27

Representativeness of items from a "population" of items

Question 28

What is criterion-related validity?

Answer 28

Calculated by comparing test scores with performance on a criterion measure. Can be represented or not by a test score

Question 29

What is concurrent validity?

Answer 29

Test scores and criterion performance scores are collected at the same time

Question 30

What is predictive validity?

Answer 30

Criterion performance scores of interest are collected at a later time

Question 31

What are the base rates of predictive validity?

Answer 31

The proportion of people in a population who represent the particular characteristic or behavior that is being predicted

Question 32

What is incremental validity?

Answer 32

The extent to which a particular assessment adds to the accuracy of predictions obtained from other tests or other less extensive methods of assessment

Question 33

What are the predictive validity concepts?

Answer 33

False negative- predict falsely False positive- fail to predict Sensitivity- the accuracy of a cutoff score in detecting those people who belong in a particular category Specificity- the accuracy of a cutoff score in excluding those without that condition

Question 34

What is construct validity?

Answer 34

Explaining the psychological meaning of the variable (construct) measured by the test- factor analysis

Question 35

What is convergent validity?

Answer 35

Test correlates positively and strongly with tools it should

Question 36

What is discriminant validity?

Answer 36

Test correlates negatively and strongly with tools it should

Question 37

What are the steps in assessment development?

Answer 37

* Test items are written according to the objectives and purpose of the test * Items are then checked for cultural bias and other concerns * Items are then piloted * Tests of reliability and validity are done * A scoring system is developed * Norms are established

Question 38

Gender, race, political affiliation, mode in a data distribution, or presence or absence of a diagnostic criterion are examples of what scale?

Answer 38

Nominal Scale

Question 39

Degree of job satisfaction, university national rankings, and median values or percentile ranks of a data distribution are examples of what scale?

Answer 39

Ordinal Scale

Question 40

Temperature, checklist of behaviors, and standard deviation are examples of what scale?

Answer 40

Interval Scale

Question 41

What is the simplest scale?

Answer 41

Nominal Scale

Question 42

What is the most advanced and precise measurement scale?

Answer 42

Ratio Scale

Question 43

Time and height are examples of what scale?

Answer 43

Ratio Scale

Question 44

Can no measurement error exist or possible?

Answer 44

No

Question 45

What can be calculated to provide more information about the shared variance between two variables?

Answer 45

Coefficient of determination