research methods-book 3 Flashcards
(47 cards)
What is reliability?
The consistency of research findings by replicating a study.
Produces consistent results.
What are the two ways of assessing reliability?
- Test and retest.
- Inter-observer.
What is test and retest reliability?
Do the test once and repeat with the same participants.
-standardised
What is inter-observer reliability?
Completed in observations.
Multiple observers record data and then compare and correlate results.
Observers have to reach an agreement.
How does the test and retest method assess reliability?
The scores from both tests are then correlated.
Looking for the relationship between co-variables.
Analyse correlating through a statistical test. To determine the level of significance.
How does the inter-observer method assess reliability?
Avoids any bias as results are discussed.
Makes results more trustworthy.
How can you improve reliability?
- Questionnaires
- Interviews
- Observations
- Experiments
How can you improve reliability in questionnaires?
Test and retest - same participants and same set of questions.
- Consistent questions/ standardised procedures will produce similar results.
How can you improve reliability in interviews?
Inter-observer - same interviewer and use a structured interview.
- Observer would agree on a set criteria to observe. = behavioural categories and produces consistent results.
How can you improve reliability in observations?
Inter-observer - operationalised variables = clear outline of the variables.
- Observers agree a set of behavioural categories and are clear on what is being measured and can agree on the outcome.
How can you improve reliability in experiments?
Test and retest - standardised procedure = conditions/participants are the same.
- Consistent method that can be replicated.
What is the ink blot test?
Rorschach’s ink blot test tested personality.
Personality is an abstract (different) concept.
Aim is to reveal a persons unconscious wishes, desires and thoughts.
How can the ink blot test be seen as unreliable?
Subjective and produces inconsistent results.
Test and retest would not work.
How could we assess the reliability of the ink blot test?
- Questionnaire
- Content analysis - theme/category
Explain how Aubrey should test the reliability of questionnaires?
(3 marks)
A way Aubrey could test the reliability of the questionnaire is by using test and retest. This is because a questionnaire is easily repeated as it can use the same set of questions at two different points. The data from both questionnaires can be correlated to determine the reliability of the questionnaire.
What is validity?
“trustworthy”
Has the researcher actually measured what it claims to - hypothesis.
What are the two types of validity?
- External validity
- Internal validity
What is internal validity?
The extent to which the results are due to the tested variable rather than extraneous variables.
What is external validity?
When results can be generalised (be applied) to other people, settings and over time.
What is high internal validity?
“good”
Means the extraneous variable is well controlled.
The independent variable produces the change in the dependent variable.
What is low internal validity?
“bad”
Extraneous variable has not been controlled.
The change in the dependent variable could be because of something other than the independent variable.
What are the two ways of assessing internal validity?
- Face validity
- Concurrent validity
What is face validity?
Look at the test and the results to see if it “looks” valid.
What is concurrent validity?
The extent or checking that a measure relates to an existing similar measure.