Research Methods AO1 Flashcards
1
Q
What is the aim of an experiment?
A
Purpose of the investigation
2
Q
What are hypotheses?
A
Testable, operationalised statements
3
Q
What are directional and non directional hypotheses?
A
Identifying a difference/correlation or not, choice depends on previous theory or research
4
Q
What are extraneous variables?
A
Nuisance variables but randomly distributed, can affect DV if not controlled
5
Q
What are confounding variables?
A
Vary systematically with IV, can’t tell if change in DV is due to IV or CV
6
Q
What are demand characteristics?
A
Participants second guess study aims, alter behaviour
7
Q
What are investigator effects?
A
Influence of researcher on DV/design decisions
8
Q
What is randomisation?
A
Chance methods to reduce researcher’s bias
9
Q
What is standardisation?
A
Ensuring all participants have the same experience
10
Q
What is the independent variable?
A
Aspect of experiment that is manipulated/changes naturally so effect on DV can be measured
11
Q
What is the dependent variable?
A
Variable that is measured by researcher, any effect should be caused by change in IV
12
Q
What is operationalisation?
A
Defining variables so they can be measured
13
Q
What are independent groups?
A
Participants in each condition of experiment are different
14
Q
What are repeated measures?
A
All participants take part in all conditions
15
Q
What are matched pairs?
A
Similar participants paired on participant variables, allocated to condition A or B
16
Q
Evaluate independent groups
A
Participant variables not controlled (use random allocation)
Less economical
No order effects
17
Q
Evaluate repeated measures
A
Order effects (use counterbalancing)
Demand characteristics
Participant variables controlled
More economical
18
Q
Evaluate matched pairs
A
No order effects
Cannot match participants exactly
Time consuming
19
Q
What are lab experiments?
A
IV manipulated in controlled setting, participants go to researcher
20
Q
What are field experiments?
A
IV manipulated in natural setting, researcher goes to participant
21
Q
What are natural experiments?
A
IV changed naturally. DV/setting may be natural or in a lab
22
Q
What are quasi experiments?
A
IV based on an existing difference between people, effect on DV recorded
23
Q
Evaluate lab experiments
A
High internal validity, control of CV/EV, cause and effect shown
Replication more possible, support for findings
Low external validity, mundane realism, artificial tasks, ungeneralisable
Low internal validity, demand characteristics
24
Q
Evaluate field experiments
A
High external validity, more authentic, realism
Lower internal validity, less control
Ethical issues, consent not possible
25
Evaluate natural experiments
Only option for practical/ethical reasons
High external validity, real world problems
Limited opportunities
No random allocations
Low realism in a lab
No manipulation of IV, can't claim cause and effect
26
Evaluate quasi experiments
If in lab, same issues
No random allocation
No manipulation of IV, can't claim cause and effect
27
What is random sampling?
Equal chance of selection, lottery
28
What is systematic sampling?
Selecting every nth person from list
29
What is stratified sampling?
Sample reflects proportion of people in different population strata
30
What is opportunity sampling?
Choosing whoever is available
31
What is volunteer sampling?
Participants self select (through adverts for example)
32
Evaluate random sampling
Potentially unbiased
Control CV/EV
Time consuming
May not work
33
Evaluate systematic sampling
Objective method
Time consuming
Those selected may refuse
34
Evaluate stratified sampling
Representative
Cannot account for all subgroups
35
Evaluate opportunity sampling
Convenient
Unrepresentitive
36
Evaluate volunteer sampling
Easy
Participants engaged
Volunteer bias
Responsive to cues
37
What are ethical issues?
Conflict of rights of participants and aims of research
38
What is informed consent?
Advise participant what is involved, reveals research aims
Signed consent form, presumptive, prior general, retrospective
39
What is deception?
Misleading participants, withholding information
OK if not distressing
Debriefing, right to withdraw/withhold data, counselling
40
What is protection from harm?
Psychological/physical risk should be 'normal'
41
What is privacy and confidentiality?
Right to control and protect personal data
Use numbers, not names, data not shared with other researchers
42
What are pilot studies?
Check procedures and techniques, make changes
43
What is single-blind?
Participants aren't aware of aims/conditions until end
44
What is double-blind?
Neither participants nor individual conducting research know the aim/condition
45
What are control groups/conditions?
Used as a comparison or baseline, no variables manipulated
46
What are naturalistic observations?
Behaviour observed where it would normally occur
No control over variables
47
What are controlled observations?
Some control over environment, such as manipulation of variables
48
What are covert/overt observations?
Observing without or with participants knowledge
49
What are participant/non-participant observations?
Join group or remain outsider
50
Evaluate observations
Capture what people do
Observer bias
No casual relationships shown
51
Evaluate naturalistic observations
Low internal validity, control difficult
High external validity, everyday life
52
Evaluate controlled observations
High internal validity, extraneous variables controlled
Low external validity, except if covert
53
Evaluate covert and overt observations
Covert: low demand characteristics, ethically questionable
Overt: behaviour may be affected, more ethical
54
Evaluate participant and non participant observation
Participant: increased external validity, lose objectivity
Non-participant: more objectivity as increased internal validity, less insight
55
What are ways of recording data in observational design?
Record everything (unstructured) or categories (structured)
56
What are behavioural categories in observational design?
Target behaviours broken down into observable components
57
What are sampling methods in observation design?
Continuous
Event sampling: count events
Time sampling: count at timed intervals
58
Evaluate structured vs unstructured observational designs
Structured: numerical, easier to analyse
Unstructured: may just be eye catching information, qualitative data harder to analyse, observer bias
59
Evaluate behavioural categories in observational design
Must be observable
Avoid dustbin category, all possible forms of behaviour listed
No overlap
59
Evaluate sampling methods in observational design
Event: useful for infrequent behaviour, misses complexity
Time: less effort but may not represent whole behaviour
60
What are questionnaires?
Pre-set list
Can use to measure DV in experiments
61
What are closed and open questions?
Fixed choice or not, quantitative data or not
62
Evaluate questionnaires
Distribute to many people
Fixed choice
Easy to analyse
Social desirability response biasE
63
Evaluate closed and open questions
Quantitative or qualitative data, effects ease of analysis
64
What are structured interviews?
Pre-set questions, fixed order, face-to-face
65
What are unstructured interviews?
No formula, general topic
Questions based on responses
66
What are semi-structured interviews?
Some pre-set questions with follow-ups
67
Evaluate structured interviews
Easy to replicate
Interviewer can't elaborate/explain
68
Evaluate unstructured intervuews
Flexible
Increased interviewer bias
Analysis more difficult
Social desirability bias reduced by rapport
69
What designs can be used in questionnaires
Likert scale, rating scale, fixed choice
70
How can interviews be designed?
Standardised schedule, avoids interviewer bias
Comfortable setting for rapport
Ethical issues
71
How should good questions be made?
Don't overuse jargon, not too technical
Replace loaded phrases with neutral ones, don't use emotive language or leading questions
Ask one question only, no double barrelled questions or doubled negatives
72
What are the three types of correlation?
Positive, negative and zero
73
What is the difference between correlations and experiments?
No manipulation of variables, no cause and effect
74
Evaluate correlations
Useful starting point
Quick
Economical
Secondary data
Can't demonstrate cause and effect
Intervening variables
May be misinterpreted
75
What is qualitative data?
Written, non numerical description of participants thoughts, feelings, etc
76
What is quantitative data?
Expressed numerically rather than words
77
Evaluate qualitative data
Rich in detail
Greater external validity
Difficult to analyse
May be subjective
78
Evaluate quantitative data
Easy to analyse (graphs)
Less biased
Narrower in meaning
79
What is primary data?
Collected first hand for purpose of investigation
80
What is secondary data?
Collected by someone other than researcher
81
Evaluate primary data
Fits the job
Targets relevant information
Requires time
82
Evaluate secondary data
Inexpensive
Easy to access
Variation in quality, may be outdated
83
What is a meta analysis?
Type of secondary data, statistical analysis of larger number of studies
Produces effect size
84
Evaluate meta analysis
Large sample
High validity
Publication bias/file drawer problem
85
How to calculate mean?
Add up, divide by number
86
What is the median?
The middle value
87
What is the mode?
Most frequently occurring value
88
Evaluate the mean
Most sensitive and representative measure of central tendency
Easily distorted by extreme values
89
Evaluate the median
Less affected by extremes, not sensitive
90
Evaluate the mode
Relevant to categorical data
Crude, unrepresentative
91
How to calculate the range?
Subtract the lowest from the highest (add 1)
92
What is standard deviation?
How much scores (on average) deviate from mean
93
Evaluate the range
East to calculate
Unrepresentative if there are extremes
94
Evaluate standard deviation
More precise than range
Distorted by extreme values
95
How to conduct the sign test?
Convert to nominal data
Add up pluses, add up minuses
S = less frequent sign
Compare calculated S value with critical value, if S <= critical value, difference is significant
96
What are the aims of peer review?
Allocate funding
Validate quality of research
Suggest amendments/improvements
97
Evaluate peer review
Anonymity, may permit unjustified criticisms by rivals
Publication bias, file drawer problem, creates false impression of current knowledge
Burying groundbreaking research, maintains status quo
98
Give examples of psychological research and the economy
Attachment research: role of father, equal care from both parents means more effective contribution to economy
Mental health: absenteeism due to depression has a cost, psychological research reduced mental disorder (new drugs, CBT)
99
What are correlations?
Relationship between two continuous co-variables
100
What are correlation coefficients?
Represents strength and direction of relationship
101
How to interpret what co-efficitents mean?
The closer to -1 or +1, the stronger the relationship
Sign tells direction
102
What are case studies?
Detailed analysis of unusual individual or event, may also be 'typical' behaviours
103
What are the characteristics of a case study?
May involve case history
Qualitative (interviews) and quantitative (psychological tests) data
Tend to be longitudinal
104
Evaluate case studies
Insight into unusual cases
Generate hypotheses for future studies
Generalisation from small samples is a problem
Conclusions based on subjective interpretation of researcher
Subjective data from participants
105
What is content analysis?
A form of observation where communication is studied indirectly
106
How is coding and quantitative data used in content analysis
Data categorised into meaningful units, analysed by counting words etc
107
How is thematic analysis and qualitative data used in content analysis
Recurrent ideas that keep appearing in communication identified and described
108
Evaluate content analysis
Fewer ethical issues than case studies
High external validity
Flexible approach, can be adapted
Information may be studied out of context
May be subjective
Reflexivity aims to address issue of bias
109
What is reliability?
Any measurement should produce the same result unless the thing it is measuring has changed
110
What is test-retest?
The same test administered to the same person on different occasions, results compared
111
What is inter-observer reliability?
Observers compare data in a pilot study or at end of actual study to make sure behavioural categories are consistently applied
112
What is the null hypothesis?
States no difference between conditions
Statistical tests determine whether this should be accepted or rejected
113
What are levels of significance?
The point at which researcher can accept the alternative hypothesis (usually 5% in psychology)
114
How should statistical tables be used in psychology?
Calculated and critical values, calculated must be compared with critical to determine significance
One tailed or two tailed test required? What is n or df value? Which level of significance is required?
More stringent LoS should be used when human cost or one off study
115
What is a type 1 error?
Incorrect rejection of a true null hypothesis
More likely if significant level too lenient
Optimistic error
116
What is a type 2 error?
Incorrect acceptence of false null hypothesis
More likely if significance level too stringent
Pessimistic error
117
What is Mann-Whitney U test?
Non-parametric test
Difference between two sets of data
Unrelated design
Data at least ordinal level
118
What is Wilcoxon T test?
Non parametric test
Difference between two sets of data
Related design
Data at least ordinal level
119
What is the unrelated t-test?
Parametric test
Difference between two sets of data
Unrelated design
Data at interval level
120
What is a parametric test?
Used with interval level data, normal distribution expected and satisfied homogenity of variance (sd squared)
Data drawn from population with expected normal distribution and both sets have homogeneity of variance
121
What is a related t-test?
Parametric test
Test of difference between two sets of data
Related design
Data at interval level
122
What is Spearman's rho?
Test of correlation between co-variables
Data at least ordinal level
123
What is Pearson's r?
Test of correlation between co variables
Data at interval level
Parametric test
124
What is chi squared?
Test of difference between two sets of data or association between co-variables
Data is independent
Nominal data
125
What is rule of R?
Tests with R in their name are those where calculated value must be equal to or more than critical value
126
What is statistical testing used for?
Determine whether to accept or reject null hypothesis
127
How to decide on stats test?
1. Difference or correlation? Correlation includes tests of association
2. Experimental design? Related or unrelated?
3. Level of measurement? Nominal, ordinal or interval?
128
What is nominal data?
Data represented in form of categories
129
What is ordinal data?
Ordered data, unequal intervals, can be placed in rank order, such as using a rating scale
130
What is interval data?
Based on numerical and public scales of measurements, units of equal size, like temperature
131
How to measure reliability
Two sets of scores should correlate at least +.08 for reliability
132
How to improve the reliability of questionnaires?
Questionnaire with low test-retest reliability may need to have some items changed to closed questions as less ambigious
133
How to improve the reliability of interviews?
Should avoid questions that are leading or ambiguous, ensure interviewers are trained
134
How to improve reliability of observations?
Behavioural categories should be properly operationalised, more training may be needed
135
How to improve reliability of experiments?
Standardised procedures ensure consistency when testing different participants
136
What is validity?
Whether a test, scale, etc produced a legitimate result which represents behaviour in the real world
137
What is internal and external validity?
Whether something measures what it was designed to measure, and whether findings can be generalised
138
What is ecological validity?
Extent to which findings can be generalised from one setting to other settings
Mundane realism of task may affect ecological validity
139
What is temporal validity?
Whether findings from a study hold true over time
140
What are different ways of assessing validity?
Face validity: does a test measure what it is supposed to 'on the face of it'
Concurrent validity: do results match with a previously established test?
141
How to improve validity of experimental research?
Use of a control group, standardised procedures, single blind and double blindH
142
How to improve validity of questionnaires?
Use lie scales and anonymity to reduce social desirability bias
143
How to improve validity of observations?
Use covert observations so more authentic behaviour, well defined behavioural categories
144
How to improve validity of qualitative research?
Depth and detail may increase validity, but further enhanced through triangulation
145
What is the abstract?
Short summary of key elements in the report
146
What is the introduction?
Literature review, including aim and hypothesis
147
What is the method?
How research conducted, includes design, sample, apparatus/materials, procedure, ethics
148
What is in the result section?
Descriptive and inferrential statistics, raw data in appendix
149
What is the discussion?
Analysis of results, links to previous research, limitations and wider implications
150
What is referencing?
List of sources, generally includes authors, date, title, volume/page numbers/publisher/source
151
What are paradigms and paradigm shifts?
Scientific subjects have a shared set of assumptions, scientific revolution occurs when shift
152
What is theory construction and hypothesis testing?
Theory construction occurs through gathering evidence from direct observation
Theory should produce testable hypothesis, permitting validity to be assessed
153
What is falsifiability?
Scientific theories must hold up for hypothesis testing, possibility of being proved false
154
What is replicability?
Scientific theory shown to be trusted, findings must be shown to be repeatable across time and context
Methods should be repeatable, reliable
155
What is objectivity and the empirical method?
Scientists must minimise all sources of personal bias and gather evidence through direct observations and experience
