CHP. 5 - Construct Validity

Question 1

3 Common Methods of Measurement

Answer 1

• Self-Report (individual reporting their own behavior)
• Observational (scientists record physical traces of behavior)
• Physiological (record biological data)

Question 1

Construct Validity

Answer 1

Helps us determine if method used to operationalize variable is reliable & accurate

Question 2

Quantitative Variables

Answer 2

Coded with meaningful numbers
- ordinal, interval, & ratio scale
- ex. height, weight, scale of well-being

Question 3

Categorical Variables

Answer 3

One variable is NOT quantitatively “higher” than another
- nominal scale
- levels are distinct categories
- ex. race, specifies, country

Question 4

Ordinal Scale

Answer 4

Ranked order
- degree of variation between units is NOT equal

Question 5

Interval Scale

Answer 5

Numerals represent equal distances between levels
- no “true 0”
- ex. IQ, SAT scores, temp in F or C

Question 6

Ratio Scale

Answer 6

Numerals represent equal intervals & there is a true 0
- 0 = absence of what’s being measured (typically can’t have negative values)
- ex. height, weight, age, temp in K

Question 7

Item vs. Scale

Answer 7

• Scale refers to the summation of data for all items
• Item refers to an individual question

Question 8

Likert Item

Answer 8

Question response scored from 1 to 5 (strongly agree to strongly disagree)

Question 9

Semantic Differential Scale

Answer 9

Measure subjective perception of 2 opposite things
- ex. messy to clean, cold to warm

Question 10

What must construct validity have?

Answer 10

Reliability & validity

Question 11

3 Types of Reliability

Answer 11

• Test-retest
• Inter-rater
• Internal

Question 12

Test-Retest Reliability

Answer 12

Reliability of a measure over time
- relatively stable over time

Question 13

Inter-Rater Reliability

Answer 13

Scores are the same no matter who measures or observes

Question 14

Internal Reliability

Answer 14

With-in study consistency
- ex. participants respond with same pattern regardless of how question is rephrased

Question 15

Correlation Coefficient (r)

Answer 15

Determines effect size (between -1 & 1)
- when r is close to 0 = weak/no effect size
- when r is positive = positive association
- when r is negative = negative association
- closer to extremes = stronger relationship

Question 16

Kappa (k)

Answer 16

Used when observers are recording categorical variables
- k close to 1 = observers agreed

Question 17

Cronbach’s Alpha (C-alpha)

Answer 17

Used for internal validity
- C-Alpha closer to 1 = more reliable

Question 18

Types of Validity

Answer 18

Subjective:
- face
- content

Empirical:
- Criterion
- Convergent
- Discriminate

Question 19

Face Validity

Answer 19

Extent to which a measure appears to measure the intended construct
- judgement call
- weakest defense for overall construct validity

Question 20

Content Validity

Answer 20

Does the measure fully capture all parts of a construct?
- capture the “whole pie”

Question 21

Criterion Validity

Answer 21

Does a new measure correlate with a relevant behavioral outcome?
- can use known groups
- ex. spatial working memory with mice w/hippocampal lesion

Question 22

Convergent Validity

Answer 22

Measures of the same construct should have strong correlation
- how closely a new scale is related to other variables & other measures of same construct
- ex. spatial working memory with MWM & Barnes maze

Question 23

Discriminate Validity

Answer 23

Not only should the construct correlate with related variables, but should NOT correlate with dissimilar, unrelated ones
- measures of different constructs should have weak/no correlation
- ex. spatial working memory & attention