4.2.3 reliability and validity Flashcards
(22 cards)
define what is meant by internal validity (2).
(1) the study measures what it intends to measure
as (2) confounding variables have been controlled and will not effect the results.
define what is meant by external validity. (2)
(1) whether the study paints a true picture of real-life behaviours (e.g if tasks have mundane realism)
(2) would apply and be generalisable to different places, different times, or different people (population validity)
define what is meant by concurrent validity (1).
1) validating a measurement by comparing it with an established
measurement that has known validity.
define what is meant by construct validity. (1)
1) the most sophisticated test of validity as it looks at whether the overall
results reflect the phenomena as a whole (external validity).
describe how to assess face validity. (2)
1) whether the test appears (at face value) to measure what it
claims to, and hence is objective.
2) tests where the purpose is clear, even to
naïve respondents, are said to have high face validity.
describe how to assess predictive validity. (2)
1) the degree to which a test accurately forecasts a future
outcome on a more broadly related topic.
describe how to assess content validity.(2)
1) objectively checking whether the method of measuring
behaviour is accurate, and decides whether it is a fair test that achieves the
aims of the study (internal validity).
2) this can be achieved by asking an expert
in that specific area of behaviour to check the validity
describe how to assess concurrent validity.(2)
1) validating a measurement by comparing it with an established
measurement that has known validity.
2) if similar results occur on both tests,
then this new test is valid. if not, then the new test would have to be
redesigned +tested
describe how to assess construct validity.(2)
1) looks at whether the overall results reflect the
phenomena as a whole (external validity).
2) achieved by checking the existing definitions of the behaviour being studied, redesigning the test if
it measures a different construct.
define what is meant by the term ‘demand characteristics’ (2).
a type of confounding variable (1)
where participants unconsciously work out
the aim and act differently (2).
define what is meant by the term ‘researcher bias’ (2).
(1) where the researcher either directly or indirectly influences the results of a study,
(2) either through the process of designing the study or through the way the research is conducted or analysed.
define what is meant by the term ‘social desirability bias’ (2).
(1) participants give the response that they think will show them in the best possible light.
(2) this may mean that their responses are not a true reflection of their real thoughts/feelings
explain how ‘researcher bias’ could be overcome. (3)
1) double-blind procedure
2) means that neither the researcher collecting the data, nor the participant involved knows the true aims of the study
3) researchers don’t know the aims + can’t give hints or tips to participants
explain how ‘demand characteristics’ could be overcome. (3)
1) single-blind procedures
2) participants being unaware of the research hypothesis until after their role is complete, researcher knows the aim
3) use of independent group design
explain how ‘social desirability’ could be overcome. (3)
1) giving participants anonymity and confidentiality -> feel more comfortable providing accurate, authentic answers, w/o shame
2) ask them face-to-face, where people are less likely to deliberately mislead researchers
3) researchers explaining to the importance of providing accurate and honest responses
explain how ‘internal validity’ could be improved. (2)
(1) changes to the location of the research and nature of the task
(2) ensuring that research is conducted in the field rather than the lab, or with realistic tasks that a person would normally complete in day-to-day life
explain how ‘external validity’ could be improved. (2)
1)changes to the sampling technique
2)target population
define the term ‘predictive validity’. (1)
the degree to which a test accurately forecasts a future outcome on a more broadly related topic.
define the term ‘concurrent validity’. (1)
validating a measurement by comparing it with an established one that has known validity.
define the term ‘content validity’. (2)
1) objectively checks whether the method of measuring behaviour is accurate
2)decides whether it is a fair test which achieves the aims of the study.
define the term ‘face validity’. (2)
1)the least sophisticated measure of validity.
2) simply whether the test appears to measure what it claims, hence, it is subjective.
