Reliability + Validity

Question 1

What is reliability?

Answer 1

-consistency of a research study
-if measured repeatedly = results should apparent if reliable

Question 2

What are the 3 ways to assess reliability?

Answer 2

1. Stability
2. Inter-rater reliability
3. Internal reliability

Question 3

What is stability?

Answer 3

-multiple researchers have the same results over a period of time

Question 4

What is inter-rater reliability?

Answer 4

-do all researchers agree

Question 5

What is internal reliability?

Answer 5

-do indicators of measure yield consistent results

Question 6

What is the test-retest?

Answer 6

-same P’s being tested over a period of time on two or more separate occasions using the same procedures

Question 7

What does it mean if the results are the same from a test-retest?

Answer 7

-can argue that the study has external reliability
-can repeat study between cultures + finding similar results

Question 8

What is inter-observer reliability?

Answer 8

-when you have two or more judges who independently asses and score the same P or object

Question 9

How can you check inter-observer reliability?

Answer 9

-correlational analysis
-Spearman’s rank

Question 10

How can you improve reliability?

Answer 10

1. Use of objective + operationalised measures
2. Observer training
3. Use standardised procedures
4. Replace open Q’s with closed Q’s

Question 11

What is internal validity?

Answer 11

-the extent to which casual conclusions can be drawn

Question 12

What is external validity?

Answer 12

-the extent to which results can be applied outside of the research

Question 13

What is ecological validity?

Answer 13

-extent to which findings from a study can be generalised to other settings
-form of external validity

Question 14

What is population validity?

Answer 14

-describes how easily the sample can be extrapolated to a population as a whole

Question 15

What is temporal validity?

Answer 15

-extent to which findings from a study can be vernalised to other historical times + eras

Question 16

What is concurrent validity?

Answer 16

-extent to which a psychological measure relates to an existing similar measure

Question 17

What is face validity?

Answer 17

-a measure is scrutinised to determine whether it appears to measure what it is supposed to measure

Question 18

What are the 2 ways to assess validity?

Answer 18

1. Face validity
2. Concurrent validity

Question 19

What are the 4 ways to improving validity?

Answer 19

1. Types of expriment
2. Questionnaires
3. Observations
4. Qualitative research

Question 20

How can experiments improve validity?

Answer 20

-use a control group - more confident that changes in the DV were due to manipulations at the IV level
-standardise procedures - minims impact of P’s reactivity and investigator effects on validity of the outcome
-goals + behavioural categories - clearly defined + operationalised

Question 21

How can questionnaires improve validity?

Answer 21

-incorporate a lie scale
-measures consistency of response
-control for the effects of social desirability bias
-may be enhanced by an anonymous respondent

Question 22

What is predictive validity?

Answer 22

-extent to which performance on a test is related to later performance that the test was designed to predict

Question 23

How can qualitative research improve validity?

Answer 23

-depth + detail associated with case studies
-may still have to demonstrate interpretative validity of conclusions
-through coherence of narrative
-enhanced through triangulation

Question 24

What is interpretive validity?

Answer 24

-extent to which the researchers interpretation of events matches that of their P’s

Question 25

What is triangulation?

Answer 25

-the use of a number of different sources as evidence

Question 26

When can you accept the correlation?

Answer 26

-if its 0.8 or higher
-shows a strong correlation