Reliability and Validity Flashcards

(18 cards)

1
Q

Reliability means what about the number?

A

You can TRUST the number.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

True scores are only ________ and cannot be ________.

A

Theoretical and Measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

X = T + E

A

X = True score + Error score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

As reliability goes ______ error goes _____.

A

up and down

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Interval Consistency =

A

Split half and coefficient alpha

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

If the coefficient alpha is 0.9 it shows:

A

Internal Homogeneoty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

N•rxx/1+(N-1)rxx
or
2•r/1+r

A

Spearman Brown

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

With Spearman Brown N=

A

N= change in length of the test (new divided by old).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

If you have a reliability of 0.45 and want one of 0.6, how much should you lengthen the test?

A

N=rd(1-rxx)/rxx(1-rd)
rd= reliability desired
you’ll get 1.83 so multiply your items by 1.83 and you’ll get you answer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

(N/N-1)•(Sx2-£pq/Sx2)

A

KR20; used when you have false data

Generally displayed as T/F or 1/0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Sy•SQRT(1-rxx)

A

Standard error of the measurement usually a (+,-)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

r•2/SQRTr11•r22

A

r12 or the correction for attenuation. Used o find the correlation of there were perfect reliability with no standard error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Nonsystematic error is _____.

A

Random

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Face Validity shows:

A

Do the questions look like they’re testing what they say they’re testing for

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Content Validity shows

A

Is the content testing what it said it will be testing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Criterion Validity has 2 kinds _______ and ______. It was based on _____.

A

Concurrent
Predictive
The real world

17
Q

Concurrent Validity

A

Comparing your test to another test at the same time.

18
Q

Predictive Validity

A

Predicting something in the future. Ex: SAT scores predicting college GPA