Study Guide 11: Construct Related Evidence

Question 1

Campbell & Fiske (1959):

Answer 1

developed multitrait-multimethod matrix

Question 2

Convergent evidence

Answer 2

degree to which test scores are correlated with tests of related constructs

Question 3

Cronbach & Meehl (1955)

Answer 3

developed the idea of nomological network to give meaning and structure to constructs

Question 4

Discriminant evidence

Answer 4

degree to which test scores are uncorrelated with tests of unrelated constructs

Question 5

Known groups validity or contrasted group studies

Answer 5

validity is determined by the degree to which an instrument/test can demonstrate different scores for groups known to vary (or not vary) on the variables being measured.

Question 6

Method effects or common method variance:

Answer 6

Occurs when HTMM correlation > HTHM correlation and shows that use of the same method will inflate the correlation effect.

Question 7

Multitrait-multimethod matrix (MTMM):

Answer 7

Provides guidelines for evaluating construct validity.
By considering the effects of trait and method variance on correlations among measures, researchers can gauge quality of convergent and discriminant validity evidence.

Question 8

Nomological network

Answer 8

interconnection between a construct and other related constructs (correlations), embedded in theoretical context

Question 9

Quantifying construct validity (QCV):

Answer 9

quantifying the degree of “fit” between theoretical predictions for convergent and discriminant correlations and actual sets of correlations obtained.

Question 10

R2 (or r2):

Answer 10

squared correlation – sometimes interpreted as being the proportion of variance in one variable explained by another variable. Criticized for sometimes being statistically incorrect, non-intuitive metric, and minimizing the importance and magnitude of correlations.

Question 11

Validity coefficient

Answer 11

correlation between test scores and highly relevant variables

Question 12

Validity generalization

Answer 12

process of evaluating a test’s validity coefficients across a large set of studies. It is intended to evaluate predictive utility of test scores across settings, times, situations, etc. Provides 3 pieces of info: general level of predictive validity, degree of variability among individual studies, and sources of variability.