CH5 Reliability and Validity

Question 1

a quality of measure concerning how dependable it is

Answer 1

reliability

Question 2

a quality of measure concerning how accurate it is; study is doing what is intended

Answer 2

validity

Question 3

variables that average a set of items to measure the same concept

Answer 3

composite variables

Question 4

the degree to which the various items in a composite variable lead to a consistent response, thus tapping into the same concept

Answer 4

internal reliability

Question 5

reveals how much different coders or observers agree with one another when looking at the same data

Answer 5

intercoder reliability

Question 6

quality of measurement referring to how detailed and specific it is

Answer 6

precision

Question 7

method that assesses robustness by testing the similarity of results after administering one subset of an item to a sample and then another subset

Answer 7

split half method

Question 8

method that assesses robustness by administering a measure to the same sample at two different times

Answer 8

test-retest method

Question 9

how well a measure captures the “truth” (even if there are no standards of comparison)

Answer 9

validity

Question 10

the degree to which the study establishes a causal effect of the IV on the DV

Answer 10

internal validity of the study

Question 11

the degree to which the measures truly and accurately capture concepts

Answer 11

internal validity of the measures

Question 12

a dimension concerning whether a measure looks valid; the most basic and shallow measure of internal validity; used to establish more rigorous assessments

Answer 12

face validity

Question 13

concerns how closely a measure is associated with some other factor; measures what is expected to be measured; if a test or measurement accurately predicts or matches something it’s supposed to predict.

Answer 13

criterion-related validity

Question 14

how closely the measure is associated with a preexisting measure (NOT ON EXAM)

Answer 14

concurrent validity (criterion-related validity)

Question 15

how closely a measure is correlated with something it should be correlated with (NOT ON EXAM)

Answer 15

predictive validity (criterion-related validity)

Question 16

concerns how well a measure encompasses the many different meanings of a single concept

Answer 16

content validity

Question 17

concerns how multiple indicators are connected to some underlying factors

Answer 17

construct validity

Question 18

concerns the degree to which the results of a study can generalize beyond the study

Answer 18

external validity