Research Methods Flashcards
(322 cards)
1
Q
What is reliability?
A
How consistent findings from a controlled investigation are within itself and overtime
2
Q
What is validity?
A
Extent to which a study is consistent in measuring what it claims to be, and if the findings can be generalised beyond the setting of study
3
Q
What are the 2 types of internal validity?
A
Face validity and concurrent validity
4
Q
What is face validity?
A
Extent to which a study appears to measure what it claims to
5
Q
What is concurrent validity?
A
Extent to which test produces same results as an established measure
6
Q
What are the 3 types of external validity?
A
Temporal validity, ecological validity, population validity
7
Q
What is temporal validity?
A
Study generalised across time
8
Q
What is ecological validity?
A
Study generalised to other settings or conditions
9
Q
What is population validity?
A
Study generalised to other groups of people
10
Q
What is the word associated with reliability?
A
Consistancy
11
Q
What is internal reliability?
A
How consistent different parts of the test are within itself
12
Q
What is external reliability?
A
How consistent a study is when replicated
13
Q
How is external reliability assessed?
A
Test-retest reliability or inter-observer reliability
14
Q
How does test-retest reliability work?
A
Test is given to participants and after a short interval same/similar test is given again
15
Q
What should happen for something to have inter-observer reliability
A
Consistent results between observers/raters
16
Q
How does inter-observer reliability work?
A
Observers agree on categories and independently observe/rate people at the same time
17
Q
To have high reliability/validity, what must comparing date have?
A
A correlation coefficient of +0.8 or higher when tested for significance using Pearson’s R or Spearman’s Rho at the 5% level
18
Q
What are ethical issues, and name the 4?
A
Conflict between participants’ rights and researchers’ need to gain valuable, meaningful and valid findings
Informed consent, deception, protection from harm, privacy/confidentiality
19
Q
What is deception?
A
Deliberately misleading/withholding information
20
Q
How are privacy and confidentiality dealt with?
A
Privacy- the participant has a right to control information they release
Confidentiality- data protection act, anonymity
21
Q
What is the British Psychological Society (BPS) code of ethics and what do they do?
A
Quasi-legal document psychologists have a professional duty to observe. A cost-benefit analysis is done, with the cost being Ψ reputation ruined or participant damage and the benefit being valuable research.
22
Q
If under 16, can consent be given?
A
Yes, by a parent
23
Q
What is done to deal with informed consent?
A
A consent form
24
Q
How is a consent form written?
A
In Verbaitim…
Dear Participant…
-Aim + procedure
-Can withdraw
-Can withdraw data
-Data anonymous
-Ask any questions
-Debrief at the end
Circle YES/NO
Name____
Sign____
Date____
25
What are 3 alternate ways of consent?
Presumptive consent- similar group consent, so consent of this group is presumed
Prior general consent- participants consent for a number of studies in one
Retrospective consent- consent in debreif
26
How is deception and protection from physical/psychological harm dealt with?
-full debrief with true aims, all info and right to withhold data
-reassure normal behaviour
-offer provided counselling
27
What is an aim, and how can one be written?
A general statement stating what the researcher intends to investigate- the purpose of the study
To investigate...
28
What is a hypothesis?
Stated at the start of a study, it's a clear, precise and testable statement stating the relationship between the variables to be investigated
29
What are the 2 types of hypotheses?
Alternative
Null
30
What are the 2 types of alternative hypotheses?
Directional/one-tailed
Non-directional/two-tailed
31
What is a directional/one-tailed hypothesis, and when is one used?
Predicts specific outcome
Previous research done or a replication of research
32
What is a non-directional/two-tailed hypothesis, and when is one used?
There will be a difference... indicates no direction
No research done before or contradictory research
33
What is a null hypothesis?
Hypothesis that the research hypothesis is tested against, states that the researcher won't find what they expect
34
What does operationalisation mean?
Clearly defining variables in terms of how they can be measured
35
Give 3 ways in which you can operationalise variables
Counting
Rating scales
Time period
36
What are extraneous variables?
All other variables/features of the research other than the IV/DV/variables studied that have the potential to affect the DV if not controlled. Doesn't vary systematically with the IV.
37
What are confounding variables?
An EV that varies systematically with the IV, and affects the DV to the extent where the researcher is unsure if the IV is the true source of change to the DV.
38
What are the 5 types of confounding variables?
Participant variables
participant effects
Situational variables
Demand characteristics
Investigator effects
39
What are participant variables?
Individual differences in participants eg: age memory
40
Give 2 ways participant variables be controlled
Repeated measures design
Random allocation
41
What are participant effects?
Participant reactivity
Social desirability bias
Hawthorne effect (change due to attention)
42
Give 2 ways participant effects can be controlled
Single-blind trial
Experimental realism
43
What are situational variables?
Features of the research environment eg: time
44
Give 2 ways situational variables can be controlled
Pilot study
Standardised procedure
45
What are demand characteristics?
Cues that tell the participant what is expected of them/what the investigator hopes to find
46
Give 4 ways demand characteristics can be controlled
Pilot study
Standardisation
Experimental realism
Matched pairs design
47
What are investigator effects?
(Un)conscious cues from the investigator that impact the outcome of the study
48
What are direct investigator effects, and how can these be controlled (2)?
Unconscious cues given during interaction
Double-blind trial
Standardisation
49
What are indirect investigator effects, and how can these be controlled (3)?
Bias in the research design
Pilot study
Counter-balancing if repeated measure design
Random allocation
50
What is a pilot study?
A small-scale trial run before an investigation with smaller + similar participants
51
What is the purpose of a pilot study?
Improves validity + reliability and saves time/money
52
What do pilot studies do?
Check the research is clear and controlled, any potential issues are identified
Change thinks that don't work, modify designs/procedures
53
What is standardisation?
Keeping everything the same for all participants in a condition so the investigation is fair and validity is increased
54
What are standardised procedures?
Exercising control by ensuring all participants have the same experience
55
What are standardised instructions?
Exercising control by ensuring all participants have the same instructions in the same way
56
What should stay the same when using standardised procedures?
Place
Equipment
Materials
Conditions
Time
Instructions
57
How are standardised instructions written?
Procedures explained
Can ask any questions
Written verbatim
58
What is the schema for the experimental method?
Difference
Comparison groups
Causal
Bar graph
59
What is the experimental method?
The only method to make causal conclusions as the IV is directly manipulated to measure the effect on the DV
60
What is the independent variable (IV)?
The variable manipulated/changes naturally and the direct effect on the DV is measured
61
What is the dependent variable (DV)?
The variable affected by the IV and is measured, the change should only be caused by the IV
62
Why do levels of the IV/experimental comparison groups exist?
A comparison needs to be made to determine the effects of the IV on the DV
63
What are the 2 different types of experimental comparison groups?
Comparison of 2 experimental conditions
Comparison to a control condition
64
How do you write a directional experimental hypothesis?
IV → DV → IV
65
How do you write a non-directional experimental hypothesis?
There will be a difference in DV between IV + IV
66
What are the 4 types of experiments?
Lab
Field
Natural
Quasi
67
What are the 2 types of true experiments
Lab
Field
68
What is a lab experiment?
In a highly controlled environment
The IV is directly manipulated to produce a change in the DV
Participants are randomly allocated
69
What are 3 strengths of a lab experiment?
High internal validity (variable control)
Replication possible increasing validity + reliability
Strong causal relationship
70
What are 3 weaknesses of a lab experiment?
Low ecological validity + mundane realism
Demand characteristics
Investigator effects
71
What is a field experiment?
A controlled experiment in a natural/ordinary environment
The IV is directly manipulated to produce a change in the DV
Participants are usually unaware
72
What are 3 strengths of a field experiment?
High external validity + mundane realism
Reduced demand characteristics as unaware
Casual relationship
73
What are 3 weaknesses of a field experiment?
Low internal validity + reliability (hard to control EVs + CVs)
Ethical issues (consent + privacy)
Participant variables
74
What is a natural experiment?
The IV is naturally occurring and the researcher takes advantage of this, will vary
Effect on the DV observed
Tentative causal relationship
75
What are 3 strengths of a natural experiment?
Allows for research which can't be done ethically
High external validity
Low demand characteristics
76
What are 2 weaknesses of a natural experiment?
Low internal validity (no RA)
Low reliability (replication)
77
What is a quasi-experiment?
The IV conditions already exist in participants
Often controlled in a laboratory
78
What are 2 strengths of a quasi-experiment?
High internal validity (if controlled)
Can compare when impossible to manipulate variables
79
What are 2 weaknesses of a quasi-experiment
Participant variables lower internal validity (no RA)
Demand characteristics (if unnatural)
80
What are the 3 designs for experiments?
Independent groups
Repeated measures
Matched pairs
81
What is an independent groups design?
Different participants used in each condition
Results are compared
Random allocation used
82
What are 3 strengths of using an independent groups design?
Order effects avoided
Demand characteristics lowered
Same test used
83
Although also less economical, what is the main disadvantage of using an independent groups design? How can this be controlled?
Participant variables act as EVs
-random allocation of participants
-matched pairs design
84
What is a repeated measures design?
All participants experience all conditions with a suitable time interval inbetween
85
What are 2 strengths of using a repeated measures design?
Participant variables controlled
Fewer participants needed so less time recruiting, more economical
86
What are 3 disadvantages of using a repeated measures design? How can these be controlled?
Order effects (practice, boredom, fatigue)
-counter-balancing distributes effect
-half do condition 1 then 2, half do condition 2 then 1
Demand characteristics (more opportunity to guess aim)
-single-blind technique
-experimental realism
Different tests used
-random allocation of questions
87
What is a matched pairs design?
Different but similar participants are used paired on a key variable
88
How would you match pairs in a matched pairs design?
1. Identify suitable variable
2. Variable is measured in participants eg: IQ test
3. Paired on similarity
4. Each participant in pair randomly allocated to condition
89
What are the strengths of using a matched pairs design?
Order effects avoided
Demand characteristics reduced
Same test can be used
Participant variables controlled
90
What are 2 disadvantages of using a matched pairs design?
Participant variables (matching not perfect)
-control with pilot study to make sure all PV are considered
Time consuming + expensive as more participants required
91
How should validity be improved in an experiment?
Control group
Single/double-blind to reduce participant reactivity/investigator effects
Standardisation (also for reliability)
92
What do correlations do?
Illustrate the strength and direction of the relationship between 2 or more co-variables
93
What does strength mean in terms of correlations?
Between -1 and 1
Perfect, high, low, no correlation
94
What does direction mean in terms of correlations?
Positive/negative
95
What is a correlation coefficient?
A number indicating the strength and direction of the relationship between the co-variables
96
What are the 4 types of correlations?
Positive
Negative
No correlation
Curvi-linear
97
What are the 2 reasons as to why a correlation may be used?
Variables cannot be manipulated (eg: for ethical reasons)
Want to investigate relationship, not difference, between variables (maybe before designing an experiment)
98
What are the 4 reasons why a cause-and-effect relationship cannot be established with a correlation?
1. Not an experiment, no IV is manipulated
2. No causal conclusions
3. Direction of the influence between the co-variables unknown
4. May be a third factor affecting the co-variables
99
How do you write a directional hypothesis for a correlation?
There will be a +/- correlation between ... and ...
100
How do you write a non-directional hypothesis for a correlation?
There will be a relationship between ... and ...
101
What are 2 strengths of a correlational analysis?
Useful starting point
-assessing strength and direction provides precise quantifiable measure of relation
If it's strong, may suggest hypothesis for future
Quick + economical
-no control/manipulation
-secondary data
Less time consuming
102
What are 2 weaknesses of a correlational analysis?
May have flawed methodology
-method used to measure the variables may be flawed
Lowers validity
Cannot demonstrate cause and effect
-none manipulated
-not sure which variable caused change
-may be third untested variable
Base a research design on false, misinterpreted information
103
What is an observation?
Recording observable behaviour to study complex interactions, often used as a technique within the experimental method
104
What are the 6 types of observations?
Naturalistic or controlled
Covert or overt
Participant or non-participant
105
What is a naturalistic observation?
Takes place in the setting the target behaviour would usually occur
All aspects of the environment are free to vary and not interfered
106
What is a strength and a weakness of a naturalistic observation?
High external validity
Lack of control (low internal validity + reliability)
107
What is a controlled observation?
Controlled, specific and measureable
ALl aspects of the environment not free to vary
Control over EVs via manipulation
108
What are 2 strengths and 2 weaknesses of a controlled observation?
Can replicate to improve reliability
High control improves validity
Low ecological validity
Demand characteristics
109
What is a covert observation?
Participants are unaware they're being observed
110
What is a strength and weakness of a covert observation?
Reduced demand characteristics
Ethical issues as may not want to be observed
111
What is an overt observation?
Participants know they're being observed and have given consent
112
What is a strength and weakness of an overt observation?
More ethically acceptable
Increased demand characteristics (decreased accuracy)
113
What is a participant observation?
The observer becomes part of the group, overtly or covertly
114
What is a strength and 2 weaknesses of a participant observation?
Increased insight and understanding improves validity
Lack of objectivity as may identify with the group
May influence and decrease natural behaviour
115
What is a non-participant observation?
The researcher is seperate and records behaviour in a more objective manner
116
What is a strength and a weakness of a non-participant observation?
More objectivity due to psychological distance, increasing accuracy
Lack of insight
117
What are behavioural categories?
When a target behaviour is broken into operationalised components via coding
118
What 5 things should behavioural categories be?
Visible
Objective
Self-evident
Mutually exclusive
Cover all behaviours
119
What do behavioural categories/behavioural checklists increase?
Reliability
120
What are the 2 ways to record observational data?
Structured observation
Unstructured observation
121
What are structured observations?
Target behaviour tallied using pre-determined checklist from a pilot study
122
What are unstructured observations?
Everything is recorded with no pre-set criteria, usually small scale
123
What is a strength and weakness of using a structured observation?
Recording is easy + systematic, quantifies information to analyse and compare
If not all behaviour is covered in the checklist, important behaviours ignored reducing accuracy
124
What is a strength and 2 weaknesses of using an unstructured observation?
Data is rich in depth + detail improving accuracy
Observer bias
Difficult to record + analyse qualitative data
125
What are the 3 sampling methods for observations?
Continuous recording
Event sampling
Time sampling
126
What is continuous recording?
Key feature of unstructured observation, all behaviour is recorded although not practical for complex behaviours
127
What is event sampling?
Recording each time a target behaviour occurs
Useful for complex behaviours, but if the behaviour is too complex, details may be overlooked
128
What is time sampling?
Recording in a pre-established time frame
Reduces the number of observations made but may be unreprasentitive
129
How can ethics be ensured during an observation?
Informed consent- usually resumptive or retrospective
Privacy- confidentiality + anonymity ensured
130
How can validity be improved for observations?
Behavioural categories (via pilot study)
Naturalistic/covert to reduce demand characteristics
Various people for population validity
131
How can reliability be improved for observations?
Train observers and allow to practise
Operationalised behavioural categories that cover everything and don't overlap
132
What is a meta-analysis?
The process of combining results from a number of studies (secondary data) involving the same aims/hypotheses and methods of research. Results are then reviewed together
133
How does a meta-analysis work?
Data is statistically tested to assess effect size
Provides a joint, overall conclusion
134
What is effect size?
A measure of the strength of relationship/difference between 2 variables
The bigger the number, stronger effect
135
What are 2 strengths of a meta-analysis?
Reviews lots of data to be more confident in conclusions
Larger, varied and more representative sample so more generalisable and increased population validity
136
What is a weakness of a meta-analysis?
Publication bias
-not all relevant studies selected
-negative/insignificant left out
Only represents some data in the analysis, incorrect + biased conclusions
137
What is a content analysis? (speaking generally)
AN observational research technique where behaviour is studied indirectly be analysing artefacts/communications
138
What is the aim of a content analysis?
Summarising + describing artefacts/communications systematically to identify patterns/themes and draw conclusions
139
What is a content analysis?
When qualitative data is categorised and the frequency is counter by producing quantitative data
140
How is a content analysis carried out?
Categorise- view the artefact multiple times and code (identify relevant categories) give an eg of a category
Count- re-view artefact and tally the number of examples in each category to produce quantitative data
Compare- summarise in descriptive statistics to draw conclusions
141
What is a thematic analysis?
Used to keep participant perspectives, qualitative data is analysed, summarised and described in themes
142
How is a thematic analysis carried out?
Code via familiarisation- carefully view to look for behaviour/words/images repeatedly occurring
Reduce this to 3/4 theme, which are ideas repeatedly occurring
Re-view, and provide egs of behaviour using quotes and descriptions to draw conclusions
143
What are 3 strengths of a content analysis?
Non-invasive, reducing ethical issues, as data is in the public domain
High ecological validity _ internal validity as genuine communications
Replicable, reliability can be tested
144
What are 3 weaknesses of a content analysis?
Lack of causality
Outside of the context, observer bias may occur and reduce objectivity
Culture bias, interpretation is the language/culture of the observer
145
In a content analysis, how can objectivity be improved to increase validity?
Double-blind technique
146
In a content analysis, how can culture bias be reduced to increase validity?
Triangulation, compare results from a variety of different studies about the same artefact
147
How can reliability be ensured in a content analysis?
Coding system must be clear, concise and easy to use
148
What is a case study?
A specific, detailed, in-depth investigation of an individual, group, institution or event carried out in the real world
149
How is a case study done in 3 steps?
Info is gathered from a variety of sources using many different research techniques, mostly qualitative
A case history is constructed by combing and organising findings
Usually longitudinal, may also involve data from others eg: family
150
What are 2 strengths of a case study?
Only possible method for rare events (eg: HM) or sensitive events (eg: Romanian orphans)
Rich detailed data, info isn't overlooked, greater understanding of human behaviour (this can generate hypotheses and lead to revising contradictory theories), high ecological validity
151
What are 4 weaknesses of a case study?
Difficult to generalise- unique, low sample size, reduces external validity
Researcher bias- subjective selection of info on report, may lose objectivity with connection
Lack of causality- only after a key event, can't be sure of changes
Reliability- hard to recall past events, can't be replicated
152
How can the validity of case studies be improved?
Interpretive validity- use direct quotes
Triangulation- variety of sources for coherence
153
What are self-report techniques?
Participants giving information to the researcher about their own feelings, opinions and behaviour by responding to questions
154
What are questionnaires?
Pre-set list of written questions/items participants that people respond to
155
What are open questions, and what type of data do they produce?
Have no fixed range of answers so participants can answer how they wish
Qualitative
156
What are closed questions, and what type of data do they produce?
Have a fixed number of responses
Quantitative
157
What is a pro and con of qualitative data for open questions?
Rich in depth, best for attitudinal research
Difficult to collate, summarise, analyse
158
What is a pro and con of quantitative data for closed questions?
Easy to analyse, compare and test statistically
Lacks depth + detail, can't explain why
159
What are 2 strengths of questionnaires?
Large amounts of data to a large number of people, cost-effective + representative so increases external validity
Easy to administer + replicate, can establish reliability
160
What are 2 weaknesses of questionnaires?
May not be truthful due to social desirability bias reducing validity
Response bias/acquiescence bias as answer too quickly or don't read, inaccurate
161
What are interviews?
Face-to-face/over-the-phone interaction between an interviewer and interviewee
162
What are the 3 types of interviews?
Structured
Semi-structured
Unstructured
163
What are structured interviews?
Pre-determined set of questions asked in a fixed order in real time
164
What are semi-structured interviews?
In between other types, most used in everyday life, for example at a job interview
There is a pre-set list of questions but the interviewer can ask follow-up questions
165
What are unstructured interviews?
Like a conversation, with no set questions, just a general aim and topic discussed
Free-flowing and the interviewee is encouraged to elaborate
166
What is a strength and weakness of structured interviews?
Standardised, easy to replicate with decreased differences between interviewers
Can't deviate from the questions, limiting the richness of the data
167
What is a strength and weakness of unstructured interviews?
Flexible so can follow-up and gain greater insight
Lots of information so difficult to analyse the relevant information and draw firm conclusions
168
How may social desirability bias be increased or decreased in interviews? (compared to questionnaires)
Not anonymous, so risk of untruthfulness to present themselves in the best light
Can establish a rapport with the interviewer so sensitive/personal information is answered trruthfully
169
How can validity be improved in interviews and questionnaires in 6 ways?
Use relevant questions
Pilot study
Lie scales
Anonymity
Representative samples
Distracting questions
170
How can reliability be improved in interviews in 4 ways?
Same interviewer
Train interviewers to prevent asking leading questions
Standardised
Use structured interview to decrease bias and make the interview replicable
171
How can reliability be improved in interviews in 3 ways?
Deselect unclear questions
Rewrite ambiguous questions
Use closed questions
172
How do you design an open question?
Explain...
Tell...
Describe...
173
How do you design a closed question?
Likert scale
Rating scale
Fixed choice option
174
What does a likert scale question look like?
Rate strength of (dis)agreement
Strongly agree
Agree
Neutral
Disagree
Strongly disagree
175
What does a rating scale question look like?
Value representing the strength of feelings
Very fun
1
2
3
4
5
Not fun at all
176
What does a fixed-choice option question look like?
Choose from a list of what applies
▢
▢
▢
▢ N/A
▢ Other
177
How do you design an interview well?
Standardised interview schedule (question list)
Take notes/record
Group/1to1 in calm, relaxed place
Start with neutral questions
Ensure confidentiality
178
What should NOT be used when designing self-report questions?
1. Jargon
2. Emotive language
3. Leading questions
4. Double-barrelled questions
5. Double-negative questions
No overlapping boxes in fixed choice questions
179
What are the 4 types of data?
Primary or secondary
Quantitative or qualitative
180
What is primary data?
Original data collected directly, first-hand by the researcher from the participants specifically for the purpose of the study
181
What are 2 strengths and a weakness of using primary data?
High control over quality/quantity of data, improving validity + reliability
Designed specifically to fit the aims and hypotheses of the study
Time consuming + expensive to recruit participants, conduct the study and analyse data
182
What is secondary data?
Data collected for a different purpose by another person, exists before the study but used to test the aims and hypothesis of the study?
183
What are 2 strengths and 2 weaknesses of using secondary data?
Simpler + cheaper as less time + equipment needed
May have had statistical testing so the significance is shown
May not fit the needs of the study
May be inaccurate (eg: outdated)
184
What is quantitative data?
Measures numberically
More objective/scientific measure
Easier to analyse
Superficial data
Easily replicated
185
What is qualitative data?
Non-numberical + descriptive
Open to subjective interpretation
Harder to analyse (done via content)
Rich, detailed data
Not easily replicated/generalised
186
What are the 3 levels of measurement that quantitative data can be categorised into?
Nominal
Ordinal
Interval
187
What is nominal data?
Placed into discreet categories and the frequency is counted using a contingency table used
188
What is the measure of central tendency, measure of dispersion, graph, and example for nominal data?
Mode
N/A
Bar/pie
Favourite food
189
What is ordinal data?
Data ordered/ranked from high to low
Non-scientific/non-standardised as the difference is unknown and not fixed
190
What is the measure of central tendency, measure of dispersion, graph, and example for ordinal data?
Median
Range
Bar/scatter
Satisfaction rating
191
What is interval data?
Based on a standardised numerical scale with fixed intervals
Scientific, technical public scales of measurement
192
What is the measure of central tendency, measure of dispersion, graph, and example for interval data?
Mean
Standard deviation
Histogram
Number of calories consumed
193
How do you convert interval data to ordinal data?
Give the same number of ranks as participants, rank from highest to lowest
Tied scores are given the average rank of the spaces occupied
194
How do you convert interval data to nominal data?
Draw a contingency table with a title
Tally data into appropriate categories
195
What is a measure of central tendency, and what are the 3?
An average best describing the data set
Mean
Median
Mode
196
What is the mean, and what type of data is it used for?
Average value when all values in the data set are added and divided by the total number of the values
Interval/ratio data, no extreme values
197
What is the median, and what type of data is it used for?
The middle value when values are placed in rank order
Ordinal/extreme values
198
What is the mode, and what type of data is it used for?
Value occuring most frequently, may be bi-modal or have no mode
Nominal
199
What is a strength and weakness of using the mean as a measure of central tendency?
Most sensitive measure as includes all values so more representative
As highly sensitive, extreme values distort the mean making it unrepresentative
200
What is a strength and weakness of using the median as a measure of central tendency?
Not distorted by extreme values so if there is there are EVs, the value is representative
Less sensitive measure, not all scores included, not representative
201
What is a strength and weakness of using the mode as a measure of central tendency?
Easy, not influenced by extreme values so representative, also only one that can be used for nominal data
Crude, communicates little about the data, not as useful if more than 1 mode
202
What is a measure of dispersion, and what are the 2?
How spread out/similar the data is
Range
Standard deviation
203
What is the range?
The difference between the highest and lowest value
204
What is standard deviation?
Average distance of data from the mean
205
What is a strength and weakness of using the range as a measure of dispersion?
Quick and easy to calculate so can get feel for dispersion
Distorted by extreme values and no indication of dispersion between the maximum and minimum value, unreprasentitive
206
What is a strength and weakness of using standard deviation as a measure of dispersion?
Most sensitive taking all scores into account so more accurate
Time-consuming, also distorted by extreme values so not a fair respresentation
207
How can conclusions be drawn from descriptive statistics?
The mean/median is the same/slightly/higher/lower
This suggests... group A is/no difference
HOWEVER/ALSO
The range/SD is smaller for...
This suggests... less variation/more consistent, more had similar results
208
What are the 3 types of data distributions?
Normal distribution
Positively skewed distribution
Negatively skewed distribution
209
What does a normal distribution look like?
Bell-shaped, no bias to left/right so symmetrical
Mean=median=mode at the highest peak
50% of data less than the mean and 50% more than the mean
210
What is an example of a human characteristic with a normal distribution?
IQ
211
What % of the population is within 1 standard deviation of the mean with a normal distribution?
68%
212
What % of the population is within 2 standard deviations of the mean with a normal distribution?
95%
213
What % of the population is within 3 standard deviations of the mean with a normal distribution?
99.7%
214
What are skewed distributions?
Scores not distributed symmetrically so the data clusters at one end
215
What does a positive distribution look like?
Concentrated to left, long tail on right
Mean highest value, mode lowest value, median inbetween
216
What does a negative distribution look like?
Concentrated to right, long tail on left
Mean lowest value, mode highest value, median inbetween
217
How do you fix a positively skewed distribution?
1. recognise the test is too hard as there are too many low scores (floor effect)
2. Adjust the difficulty by making easier more accessible questions
3. There will be fewer low scores, achieving normal distribution
218
How do you fix a negatively skewed distribution?
1. Recognise the test is too easy as too many high scores (ceiling effect)
2. Adjust the difficulty by adding harder questions
3. Fewer achieve a high score, achieving normal distribution
219
Why does the mean shift for skewed distributions?
The mean is affected by extreme values
220
What must graphs have? (AHA)
Appearance- must reflect graph accurately
Headings- relationship vs difference
Axes- labelled + operationalised, start at 0 (can us broken line), use same scale
221
What type of data are contingency tables used for, and what are they?
Discrete/nominal
Examines relationships, can compare
Data connected vertically horizontally, with MCT or MD, not raw stats
222
What type of data are scattergrams used for, and what are they?
Pairs of scores
Examines relationship (strength + direction) between co-variables, participant scores are plotted (not group)
223
What type of data are bar charts used for, and what are they?
Discrete/nominal
Shows difference, compares levels of the IV
Spaces, same-size bars
If comparative, key needed
224
What type of data are histograms used for, and what are they?
Continuous/interval (grouped)
Shows how data is distributed
Bars are couching as it is continuous
yaxis is frequency xaxis is groups
225
What are 3 other types of graphs not specifically listed in the specification?
Pie charts
Line graphs
Frequency polygons
226
What does ≈ mean?
Approximately equal to
227
What is the equation for %increase or decrease?
Difference
————— x100
Original
228
In the %change equation, how do you know which number the 'original' is?
If % increase- original is smaller number
If % decrease- original is bigger number
229
What is a population?
A group of people with specific characteristics who are the focus of the researchers interest
Often called the target population as they're a subset of the general population
230
What is a sample?
A group of people selected from a target population in a research investigation, and are presumed to be representative of that population
231
What does a representative sample look like?
Group of people forming the sample accurately reflect the target population as they have a similar distribution of relevant characteristics
232
What is generalisation?
Extent to which findings/conclusions from an investigation can be broadly applied to the population
233
When is generalisation possible in sampling?
If the sample is representative of the target population
234
What is bias in sampling?
When certain groups are over/under-represented in a target population
235
Why is bias bad in sampling?
Limits the extent generalisations can be made to the target population
236
What are the 5 sampling techniques?
Random
Systematic
Stratified
Opportunity
Volunteer
237
What is a random sample?
Where every member of the target population has an equal change of being selected
238
How is a random sample obtained in 4 steps?
1. Obtain a complete list of all in a target population
2. Assign every name to a number
3. Use hat/computer randomiser
4. The people assigned to the first n numbers drawn form the sample
239
What are 2 strengths of using a random sample?
Unbias as EV and CV distributed evenly, increased internal validity
Free from researcher bias
240
What are 3 weaknesses of using a random sample?
Still possible for the randomised list to be unrepresentative
Difficult + time consuming to obtain list
Selected participants may refuse to participate, affecting how representative the sample is
241
What is a systematic sample?
Every nth member of the target population is selected
242
How is a systematic sample obtained in 3 steps?
1. Sampling frame produced (organised list of all in a target population, randomly or alphabetically)
2. Sampling system is chosen, random or deliberately (population/sample size)
3. Researcher selectors every nth person from the sampling frame until the sample is complete
243
What are 2 strengths of using a systematic sample?
Unbiased if randomised
Free from researcher bias (if start randomly selected)
244
What are 3 weaknesses of using a systematic sample?
If a periodic trait exists in the population, or not randomised, not representative
Time-consuming
Selected participants may refuse to participate (affects how representative)
245
What is a stratified sample?
The composition of the sample reflects the proportions of people in certain subgroups (strata)
246
How is a stratified sample obtained in 3 steps?
1. Identify the strata that make up the population
2. Calculate the proportion for each stratum based on the proportion of the population
3. Participants that make up each stratum selected randomly
247
What is a strength of using a stratified sample?
Most representative as proportionally reflected, so can be generalised
248
What are 3 weaknesses of using a stratified sample?
Cannot reflect all so not a complete representation
Time-consuming
Selected participants may refuse (affects how representative)
249
What is an opportunity sample?
People who are available, willing to participate and fits the researcher's criteria
250
How is an opportunity sample obtained?
The researcher approaches people around the time of the study and asks them to participate
251
What are 2 strengths of using an opportunity sample?
Convinient, saving time + money
Must be used for natural experiments
252
What are 2 weaknesses of using an opportunity sample?
Unrepresentative as people drawn from a specific area
Researcher bias as they have complete control over participant selection
253
What is a volunteer sample?
Participants select themselves to form the sample (self-selection)
254
How is a volunteer sample obtained?
An advert is placed in a place the target population would see it (eg: newspaper, common room noticeboard) and volunteers respond to the advert
255
What are 2 strengths of a volunteer sample?
Convenient + time-effective
Engaging + willing participants who won't sabotage the study
256
What are 2 weaknesses of a volunteer sample?
Volunteer bias attracts a certain profile of those who are keen, helpful, curious, cooperative- demand characteristics
Can be unrepresentative, reducing validity
257
How are reports written?
Conventionally + academically
Standardised with all relevant info
258
Why are reports written?
Refine understanding + theories of human behaviour
Allows replication
259
What is the order of a scientific report?
Title
Abstract
Introduction
Method
results
Discussion and conclusion
References
260
What is the purpose of a title in reports? What must it include?
Gives focus of study
Must include key variables
261
What is an abstract?
Short summary of the report with key details (aim + hypotheses, method, results, conclusion, implications)
Approx 150-200 words
262
What is the purpose of an abstract?
Allows reader to have a quick overview of the report and decide if they want to read it
263
What is the purpose of an introduction?
Provide rationale/context for research, reviews previous research + background on theories/concepts
Logical- starts broad and narrows down to aims + hypotheses with key variables
264
What is the purpose of the method?
Provides detailed description of what was done so other researchers can replicate
All needs to be explained + justified
265
What are the 5 subsections of the method?
Design with key variables
Sample, sampling method + target population, give sample demographics whilst not compromising anonymity
Apparatus/materials
Procedure, exactly how carried out beginning-end, verbatim record of all said to participants, control of EV + CV
Ethics- how were these addressed
266
What is the purpose of the result?
Give summary of key findings
267
What is reported in the results?
Descriptive statistics (tables/graphs/MCT/MD)
Inferential stats (accept/reject null)
Qualitative analysis
268
What is the purpose of the discussion/conclusion?
Interprets study + considers implications
269
What is done in the discussion/conclusion?
1. Summarise/explain findings in verbal form in context of intro evidence/other research
2. Limitations (validity) + how to be addressed in future study
2. Wider implications (RW, contribution to knowledge base, future research)
270
What is the purpose of the references?
Gives full standerdised details of any course cited to...
avoid plagiarism,
give credit
allow access of sources
271
What is the format for a journal article?
Author, date, article title, *journal title*, volume (issue), pages
272
What is the format for a book?
Author, date, *book title*, place of publication, publisher
273
What is the format for a web page?
Source, title, date, weblink, date accessed
274
What is a peer review?
Process where research papers are independently scrutinised by experts/peers in same/similar field before publication
275
What do peers assess for in peer review?
Validity/accuracy
Significance
Originality/contribution to body of psychological knowledge
High quality
276
What do peers do in peer review?
Ensure objectivity + anonymity
Decides whether research is published/reviewed/rejected
277
What are 4 purposes of peer review?
Improves + validates quality/integrity of research
- ensures high standard, can suggest amendments/improvements
- increases probability of weakness/errors identifies and addressed
- research taken seriously and adds to body of scientific knowledge to frequently become mainstream thinking
Prevents dissemination (spread) of irrelevent/flawed/fraudulent findings
- as if entered public domain, integrity of field and psychology damaged
- loss of trust in scientific claims
Considers wider context/relevance/significance/originality
- ensures research has clear + accurate + relevant practical applications with no negative consequences
Allocates research funding
- evaluates aims/quality/value
- peer review panel helps government bodies/charities decide which research is likely worthwhile
278
What is a strength of peer review?
Establishes validity of research
- may lead to social policy change
- if not valid, may have negative consequences
279
What is a strength/weakness of peer review?
Anonymity leads to honesty and objectivity
BUT
Minority may criticise rival researcher as in competition for funding
Thus, some journals favour open reviewing
280
What are 2 weaknesses of peer review?
Publication bias
- tendency to publish +/significant findings as increases credibility and circulation of publications
- avoids publishing less significant/replications (file drawer phenomenon)
Creates misconception of facts --> biases reviews and meta-analyses
Status quo, findings may be suppressed if contradictory
- PR may be assessing acceptability not validity
SLows rate of change of the paradigm within the discipline
281
What are the 6 features of science?
Objectivity
Empirical method
Falsifiability
Replicability
Theory construction
Hypothesis testing
282
What is 'objectivity' as a feature of science?
All bias minimised and personal opinions eliminated
Keeping critical distance to not distort/influence the research process
Operationalisation, standardisation and control
283
What is 'the empirical method' as a feature of science?
Scientific process objectively gathering evidence via direct experimentation/observation
Prevents abstract theories leading to bad treatment
284
Is objectivity via the empirical method achievable in psychology?
Behaviourist/biological/cognitive approaches use direct experimentation + observation to develop + refine theories
Psychodynamic/humanistic approaches use subjective methods as believe behaviour is unique + different
Some things can't be directly observed, have to use inference which is subject to bias
285
What is 'falsifiability' as a feature of science?
Theory is only scientific is possible to establish as false
Popper said not possible to confirm theory, can only disconfirm
Even if theory repeatedly tested, may not be true
So focus on disproving hypothesis (confirming null)
Theories gradually fine-tuned via continual hypothesis testing
286
Is falsifiability achievable in psychology?
Behaviourist/biological/cognitive approaches produce falsifiable hypotheses eg: Milgram
Psychodynamic/humanistic/evolutionary unfalsifiable as cannot undergo testing
287
What is 'replicability' as a feature of science?
Extent to which scientific procedures + findings can be repeated in different contexts + time
Important as increases reliability, which has a role in determining validity
Strengthens theory as less likely findings due to chance
Done via operationalisation/standardisation/controlling/peer review
288
Is replicability achievable in psychology?
Behaviourist/biological/cognitive approaches generate testable hypotheses with empirical method allowing for replication
But true replication almost impossible as humans are dynamic + influenced by many factors
289
What is 'theory construction' as a feature of science?
Process of developing explanations for the causes of behaviour by systematically + empirically collecting evidence and organising into coherent account
Popper's hypothetico-deductive model states theories come first which generate falsifiable hypotheses, which are tested + fine-tuned via the empirical method
290
What is a theory?
Set of general laws to explain events/behaviour
291
What is 'hypothesis testing' as a feature of science?
Process of gathering evidence
A good theory should suggest multiple testable hypotheses
If there is no empirical evidence, theories modified
292
Has psychology developed theories allowing for hypothesis testing?
Many theories explain + can predict behaviour and propose hypotheses for empirical evidence, eg: Bickman
Some lack predictive power eg: psychodynamic
Humanistic has no theories as doesn't want to predict + control behaviour as individuals do that
293
What is a paradigm?
Shared set of assumptions and methods agreed on within a discipline
294
Why is psychology a pre-science according to Kuhn?
Too much internal disagreement and conflicting approaches
295
What is a paradigm shift?
Result of a scientific revolution when there is a change in the dominant unifying theory of a discipline due to new/contradictory evidence
296
What are the paradigm shifts in psychology?
1870s- introspection
1900s- psychoanalysis
Beginning of 20th century- observable behaviour
1950s- humanistic
1960s- cognitive
1980s- biological
21st century- cognitive neuroscience
297
Is psychology a science?
According to Kuhn, no...
Lacks universal paradigm, many conflicting perspectives
Many methods of investigating human behaviour (eg: experiment, case study)
Maybe yes...
Universal agreement that psychology is the study of the mind and behaviour
Has undergone many paradigm shifts
298
What is the purpose of inferential statistics?
Allows researchers to make inferences about whether differences/relationships are significant (not due to chance) and thus can be applied to a target population
299
What do statistical tests decide?
If null is accepted/rejected
As hypotheses must be falsifiable, seek to falsify null
300
What is probability?
Degree of certainty the difference/relationship is real, or if it occurred by chance
301
What is the usual level of significance in psychology?
5%
p ≤ 0.05
302
Why is the 5% level of significance used in psychology?
95% certain results not by chance- can never be 100% sure as haven't tested all members of target population under all circumstances: so this is an acceptable level of error
Strikes balance between risk of making Type I / Type II errors
303
When would the 1% level of significance be used?
Replication
Challenging a theory
Controversial
Socially sensitive
Life/death
304
What type of error is more likely to occur with the 1% significance level?
Type II
305
When would the 10% level of significance be used?
Unresearched area (with a non-directional hypothesis)
306
What type of error is more likely to occur with the 10% significance level?
Type I
307
What is a type I error, and why does it occur?
False positive
As level of significance too lenient, too optimistic so the null is rejected when should be accepted
Stating there is a real difference/relationship when there isn't
308
What is a type II error, and why does it occur?
False negative
As level of significance too stringent, too pessimistic so null is accepted when should be rejected
Stating there is no real difference/relationship when there is
309
What are 3 ways to reduce Type I/II errors?
Use less stringent (reduces Type II) or less lenient (reduces Type I) level of significance
Use 5% significance level as strikes balance between risk of Type I/II errors
Increase sample
310
How do you choose what statistical test to use?
Note: must be interval AND normally distributed
311
What is the difference between a relationship and an association?
Relationship is linear
Association not linear
312
What are the 3 parametric tests? What does this mean?
Unrelated T-test
Related T-test
Pearson's R
More sensitive in measuring significance as use mean and standard deviation
313
What are 3 things to note when using the unrelated T-test?
If the calculated value if negative, ignore sign when comparing to critical value
Uses df= (sum of ppts in both groups) - 2
Difference must be in direction predicted
314
What are 2 things to note when using the related T-test?
Uses df= number of participants - 1
Difference must be in direction predicted
315
What do parametric tests assume?
Participants drawn from normally distributed population
Homogeneity of variance (standard deviation)
316
What are 4 things to note when using the Mann-Whitney test?
Group with smallest ranked sum is used
2 N values
Data from both groups ranked as 1 set, lowest value = rank 1
Difference must be in direction predicted
317
What are 3 things to note when using the Wilcoxon test?
T = sum of ranks of less frequent sign
N, excluding participants with no difference
Rank/order the difference between 2 conditions
Difference must be in direction predicted
318
What are 4 things to note when using Spearman's rho test?
If calcuated value negative, ignore sign when comparing to critical value
N
Data ranked separately, square of difference between ranks is summed
Sign of calculated value must be in same direction as hypothesis
319
What are 3 things to note when using the Peaarson's r test?
If calcuated value negative, ignore sign when comparing to critical value
Df = number of participants - 2
Sign of calculated value must be in same direction as hypothesis
320
What are 2 things to note when using the Chi-Squared test?
Df = (number of rows -1) x (number of columns -1)
Results recorded in contingency table
321
What are the 5 steps for how to calculate the sign test?
1. Convert data to nominal and record the sign of difference, keep consistent
2. If no difference remove from sample (N)
3. Count total number of +/-, total of less frequent sign = calculated/observed/S
4. Compare to critical value table know: significance, one/two-tailed, N
5. Calculated value must be ≤ critical value
322
How do you state a conclusion after an inferential test?
Calculated value of ___ is more/less/equal to critical value of ___
at a significance level of ___% for a one/two tailed test.
Therefore, the null hypothesis is accepted/rejected.
There is/is not a significant difference... *link to stem.
