Types of Validity (face, concurrent, ecological, temporal)

Question 1

Validity

Answer 1

is concerned with whether the findings from a study are genuine or accurate. In other words, whether the researcher is measuring what they are claiming to measure and whether the findings can be generalised beyond the research setting

Question 2

types of validity

Answer 2

internal/ external

Question 3

internal validity

Answer 3

concerned with what goes on inside a study. It is specifically about whether in an experiment, the findings have been caused by the independent variable.

Extraneous variables such as demand characteristics and investigator effects pose a major threat to internal validity.

Question 4

external validity

Answer 4

validity is concerned with what goes on outside a study. It refers to the extent to which the findings can be generalised beyond the specific research study. Two examples of external validity include:

*Ecological validity refers to the extent to which findings from one study can be generalised to other settings. For example, whether the results obtained in a lab experiment can be obtained from a study conducted in a less artificial environment. NOTE: not all lab experiments lack ecological validity!!!

*Temporal validity refers to the extent to which findings from one study can be obtained at other times or in different historical eras. For example, can the same findings from Asch’s conformity studies be obtained today?

Question 5

2 Ways assessing validity

Answer 5

face, concurrent

Question 6

face validity

Answer 6

this involves getting an expert to look at the test, measure or scale used in a study to confirm that it does measure what it claims to measure. For example, looking at a questionnaire to see whether the questions are measuring what they are supposed to be measuring. An experiment which is meant to investigate memory could be assessed for validity in a similar way by looking at the requirements of the memory task involved to see if it is really testing memory.

Question 7

concurrent validity

Answer 7

this involves comparing a test, measure or scale with an already well established one. For example, a new psychological test claiming to measure sociability has been devised. To test whether it has concurrent validity, participants complete the test AND another well-established test known to measure sociability. A strong positive correlation between participants’ scores on both tests should be obtained if they are both measuring sociability. If this is the case, we conclude that the new test has concurrent validity.

Question 8

Improving Validity in experiments

Answer 8

*Use a standardised procedure and/or double-blind design to reduce investigator effects.

*Use a single-blind design and/or independent groups design to reduce demand characteristics.

*Use a control group – this way, the researcher can have a better idea about whether the results are really due to the independent variable.

*Use tasks that participants would undertake in everyday situations.

Question 9

Improving Validity in Questionnaires/ psychological tests

Answer 9

*Allow participants to remain anonymous as this will increase the likelihood of them providing honest responses.

*Only include items/questions that measure what is supposed to be measured.

Question 10

Improving Validity in interviews

Answer 10

*Ensure all interviewers are properly trained to avoid leading participants and to ensure any rating systemis used in the correct way.

*Only include questions that measure what is supposed to be measured.

Question 11

Improving Validity in Observational techniques

Answer 11

*Where possible, conduct covert observations as participants are less likely to change their natural behaviour.

*Ensure that the behavioural categories have been well operationalised so that they measuring the behaviour intended. Behavioural categories should not overlap or be ambiguous.

*Limit observer bias by ensuring observers are properly trained in using the coding system.

Question 12

Improving Validity in Qualitative methods (eg case studies, unstructured interviews)

Answer 12

*Use direct quotes from participants to support the researcher’s interpretation of data.

*Triangulation – use several methods to collect data eg interviews from parents and friends, observations, and diary methods. This can also improve the accuracy of a researcher’s interpretation of data.