Lecture 2.1 Flashcards

1
Q

reliability score

A
  • always between 0 and 1
  • correlation between scores
  • e.g. items, trials
  • reflects repeatability and consistency
    = ration actual vs test score
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

error score and T

A
  • positive: T larger than X

- negative: T smaller than X

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

causes of measurement error

A
  • item selection
  • sample (also of behavior)
  • examinee
  • examiner
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

systematic errors

A
  • via manual or test construction

- validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

unsystematic errors assumptions

A
  • random
  • average to 0 when data is large enough
  • not related to eachother
  • are not realted to T
  • affect consistency
  • reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Three assumptions about CTT

A
  • focus on unsystematic errors
  • are normally distributed
  • CI is most accurate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

within one SD

A
  • 67.2%
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

within two SD

A
  • 95.4%
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

reliability formula

A
  • true score diveded by observed score
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

small CI

A
  • instrument is reliable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

kinds of CIs

A
  • 68
  • 95
  • 98
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

methods of reliability

A
  • test-retest
  • alternate forms
  • Spearman Brown/split half
  • coefficient alpha
  • KR20
  • inter-scorer / inter-rater
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

disadvantages of test-retest

A
  • practice effects

- prone to fluctuation in construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

alternate forms advantages

A
  • no practice effects
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

alternate forms disadvantages

A
  • version might measure something different

- very expensive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

split half disadvantages to reliability

A
  • reduced reliability
  • is always an underestimation of measurement errors
  • the shorter the test the more errors count
  • > is always corrected with Spearman Brown
17
Q

alpha increases when

A
  • more items
  • less variance
  • higher consistency
18
Q

KR20

A
  • Kuder Richardson 20
  • always for yes/no tests
  • problem: too low when test contains different aspects, and vice versa