MET 14 - Testing validity Flashcards
(11 cards)
1
Q
What is validity?
A
The extent to which an observed effect is genuine – does it measure what it was supposed to measure, and can it be generalised beyond the research setting within which It was found
2
Q
What is face validity?
A
A basic form of validity in which a measure is scrutinised to determine whether it appears to measure what it is supposed to measure
3
Q
What is concurrent validity?
A
- The extent to which a psychological measure relates to an existing similar measure that is said to be valid
- Has a correlation of 0.8 or more
4
Q
What is ecological validity?
A
- The extent to which findings from a research study can be generalised to other settings and situations
- A form of external validity
5
Q
What is temporal validity?
A
- The extent to which findings from a research study can be generalised to other historical times and eras
- A form of external validity
6
Q
How do you assess face validity?
A
By simply ‘eyeballing’ the measuring instrument or by passing it to an expert to check
7
Q
How do you assess concurrent validity?
A
- A new intelligence test, for instance, may be administered to a group of participants and the IQ scores they achieve may be compared with their performance on a well-established test (such as the Stanford- Binet test)
- Close agreement between the two sets of data would indicate that the new test has high concurrent validity - and close agreement is indicated if the correlation between the two sets of scores exceeds +.80
8
Q
How can validity be improved in experiements?
A
- Using a control, which means that a researcher is better able to assess whether changes in the dependent variable were due to the effect of the independent variable
- Experimenters many also standardise procedures to minimise the impact of participant reactivity and investigator effects on the validity of the outcome
- The use of single-blind and double-blind procedures is designed to achieve the same aim
- In a single-blind procedure participants are not made aware of the aims of the study until they have taken part (to reduce the effects of demand characteristics)
- In a double-blind procedure, a third party conducts the investigation without knowing its main purpose (which reduces the effects of both demand characteristics and investigator effects, improving validity)
9
Q
How can validity be improved in questionnaires?
A
- Many questionnaires and psychological tests incorporate a lie scale within questions in order to assess the consistency of a respondent’s response and to control the effects of social desirability bias
- Validity may be enhanced by assuring respondents that all data submitted will remain anonymous
10
Q
How can validity be improved in observations?
A
- Having the observer remain undetected by carrying out cover observations meaning the behaviour of those observed is likely to be natural and authentic
- Behavioural categories that are too broad, overlapping or ambiguous may have a negative impact on the validity of the data collected
11
Q
How can validity be improved in qualitative research?
A
- Qualitative methods of research are usually thought of as having higher ecological validity than more quantitative, less interpretative methods of research
- This is because the depth and detail associated with case studies and interviews, for instance, is better able to reflect a participant’s reality
- However, a researcher may still have to demonstrate the interpretive validity of their conclusions
- This is the extent to which the researcher’s interpretation of events matches that of their participants
- This can be demonstrated through such things as the coherence of the researcher’s narrative and the inclusion of direct quotes from participants within the report
- Validity is further enhanced through triangulation - the use of a number of different sources as evidence, for example, data compiled through interviews with friends and family, personal diaries, observations, etc
