reliability

Question 1

How do you measure inter-observer reliability?

Answer 1

total no. of agreements/ total no. of observations
(no less than +0.8)

Question 2

How do you measure test-retest reliability?

Answer 2

score A / score B
(no less than +0.8)

Question 3

What is test-retest reliability?

Answer 3

administering the same task to the same participant/s on different occasions

Question 4

What is inter-observer reliability?

Answer 4

can be a small-scale trial of observation to check if two or more researcher are applying the behavioural categories in the same way or compare the results from both observers at the end

Question 5

What is reliability?

Answer 5

measures consistency and if we can get the same results if we conducted the same research multiple times

Question 6

How do you improve reliability in questionnaires?

Answer 6

-use test-retest reliability
-if correlation coefficient is less than +.8 then some of the questions may need to be replaced/ rewritten to be less ambiguous + change some open qs to closed qs

Question 7

How do you improve reliability in interviews?

Answer 7

-use the same interviewer BUT if more is necessary, they must be properly trained to reduce subjective bias
-make sure no questions are too leading or ambiguous

Question 8

How do you improve reliability in observations?

Answer 8

-operationalise behavioural categories
-behavioural categories should not overlap
-all behaviours should be covered on the checklist
-when reliability is low observers may need to be properly trained or have a thorough discussion and come to an agreement on behavioural categories

Question 9

How do you improve reliability in experiments?

Answer 9

-have a standardised procedure
-use participants from the same demographic background when replicating

Question 10

Why should you allow sufficient time between first and second tests of the test-retest reliability?

Answer 10

to avoid order effects
-there must be sufficient time between tests and retest to ensure that the participant cannot recall the answers to the questions to a survey but not so long that the attitudes opinions or abilities may have changed

Question 11

What kind of reliability is used in content anaylsis?

Answer 11

inter-rater reliability

Question 12

What kind of reliability is used in interviews?

Answer 12

inter-interviewer reliability