Chapter 5 Flashcards
(22 cards)
Reliability
How consistent is this type of measurement?
True Score
Is the measured value close to the true score? (Accuracy)
Measurement Error
Is there inconsistency in the measurement/does it have high variability? (Precision)
Validity
Is this the right way to measure this?
Reactivity
Subject’s awareness of how the measurement works
Measurement Scales
Nominal
- Label (Qualitative)
- No Rank or Order
Lowest
Measurement Scales
Ordinal
- Labels
- Rank or Order
- Distance Random
Higher than nominal
Measurement Scales
Interval
- Numerical
- Rank or Order
- No “True” 0
- Distance NOT Random
Higher than ordinal
Measurement
Ratio
- Numerical
- Distance NOT Random
- “0” Value
Highest
6 Ways to Determine Validity
Face Validity
Does it seem right?
6 Ways to Determine Validity
Content Validity
Does it seem right based on how other people do it?
6 Ways to Determine Validity
Predictive
Can it predict behavior?
6 Ways to Determine Validity
Concurrent Validity
Does it correlate with how the person is currently behaving?
6 Ways to Determine Validity
Convergent
Does it correlate with another type of measurement of the same thing?
6 Ways to Determine Validity
Discrimination
Does it NOT correlate with something that isn’t related?
Pearson’s R
How close a correlation is to a straight line.
Pearson’s R
Strong Positive Correlation
1 (Perfect Straight Line)
Pearson’s R
Strong Negative Correlation
-1 (Perfect Straight Line)
Ways to Test Reliability
Split-Half Reliability
- Split Questions/Items in half
- Do the results correlate?
Ways to Test Reliability
Cronchbach’s Alpha
- Split-Half Test
- Tests with every possible set of halves
Ways to Test Reliability
Item-Total Correlation
Measurement from each question or item is compared to the measurement for everything
Ways to Test Reliability
Interrater
Person making observations & recording data
2 or more raters observe same thing –> consistent ratings?
