Assessing Reliability Flashcards

inter-rater reliability, test-retest, split half

1
Q

what are the two types of reliability

A

internal and external

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

external reliability

A

the extent to which a test produces consistent
results over several occasions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

internal reliability

A

the extent to which a test or measure is consistent
within itself e.g. the use of standardised instructions and procedures for
all participants.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what are reliability issues

A
  1. Lack of operationalisation of the variables
  2. order effects
  3. lack of standardised procedures
  4. inconsistency of measuring tools
  5. uncontrolled environment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

how can order effects be combatted

A

counterbalancing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is counterbalancing

A

This involves splitting
the population/sample into two halves; the first half complete condition one
followed by condition two, the second half complete condition two followed
by condition one. This in effect negates the impact of order/practice effects, as both conditions are affected equally, and increases internal reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

why is lab environment better

A

helps to overcome most reliability issues. The
greater the level of control, the lower the risk of extraneous variables effecting
results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

split half reliability

A

splitting a participant’s test answers in
half and seeing whether s/he got the same or similar scores on the two halves. If so,
internal reliability is high/individual questions would need to be
re-ordered or redesigned to improve reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

test retest reliability

A

testing and retesting the same participants over
time, with the same test, and comparing their scores. If the scores are the same, the
test has external reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

inter-rater reliability

A

where two or more psychologists produce consistent
results by using a standardised procedure, agreed coding system, or correlation of
their data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly