Reliability and Validity Flashcards
(18 cards)
Reliability means what about the number?
You can TRUST the number.
True scores are only ________ and cannot be ________.
Theoretical and Measured
X = T + E
X = True score + Error score
As reliability goes ______ error goes _____.
up and down
Interval Consistency =
Split half and coefficient alpha
If the coefficient alpha is 0.9 it shows:
Internal Homogeneoty
N•rxx/1+(N-1)rxx
or
2•r/1+r
Spearman Brown
With Spearman Brown N=
N= change in length of the test (new divided by old).
If you have a reliability of 0.45 and want one of 0.6, how much should you lengthen the test?
N=rd(1-rxx)/rxx(1-rd)
rd= reliability desired
you’ll get 1.83 so multiply your items by 1.83 and you’ll get you answer
(N/N-1)•(Sx2-£pq/Sx2)
KR20; used when you have false data
Generally displayed as T/F or 1/0
Sy•SQRT(1-rxx)
Standard error of the measurement usually a (+,-)
r•2/SQRTr11•r22
r12 or the correction for attenuation. Used o find the correlation of there were perfect reliability with no standard error
Nonsystematic error is _____.
Random
Face Validity shows:
Do the questions look like they’re testing what they say they’re testing for
Content Validity shows
Is the content testing what it said it will be testing.
Criterion Validity has 2 kinds _______ and ______. It was based on _____.
Concurrent
Predictive
The real world
Concurrent Validity
Comparing your test to another test at the same time.
Predictive Validity
Predicting something in the future. Ex: SAT scores predicting college GPA