Research Methods⚗️ Flashcards

1
Q

BPS code of human research ethics in ethical reasoning

A

Respect, scientific integrity, social responsibility and minimise harm:
Assess potential risk benefit of research
Clarify conditions but should use judgement to avoid bad outcome

Consider choices and consequences and decide on course of action
Avoid being accountable for unexpected outcome or one you are unhappy with

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

BPS code of ethics-accountability

A

Respect autonomy, dignity of people

Submits application for ethical approval
Academics review
Identify problems and give feedback
Revise applications and re-submit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

BPS code of ethics-research malpractice

A

Fabrication or deliberate manipulation of data
Plagiarism
Incorrect data processing
Dubious analysis practice

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

BPS-code of ethics and conduct

A

For people who practice psychology
Respect, competence, responsibility and integrity

Health and care professions council (HCPC)
Regulate psychologists, approve training, take action when fail to meet standards
Caution, set conditions, suspend and strike

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Other ethical codes

A

UK government Universal ethical code for scientists
Sheffield uni ethics policy
Department of psychology ethics policy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

BPS code of ethics-consent

A

Clear info to participant (aims, methods, data storage)
Scientific integrity
Risks and benefits
Social responsibility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Coercion

A

Research as ‘free therapy’ or financial gains
Free to withdraw without reason or consequence
Friends and family may feel coerced to take part
Info sheet and consent form

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Anonymity and confidentiality

A

Anonymity - no info collected to identify participant. Anonymous data does not have to conform to GDPR

confidentiality- info could identify but is kept confidential. Must comply with GDPR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

GDPR

A

general data protection regulation
Personal data allowing identification is protected

Participants must be informed cannot access, delete or transfer their data or withdraw after

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How to work with non anonymous data

A

Fully informed of how and why data is processed
Ensure happy to use anonymised data

Qualitative data can be anonymised in interview transcripts (pseudonyms)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Handling data

A

Interviews recorded, should know how stored/who has access

Aware recordings will be deleted once been transcribed to be confidential

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Storing data

A

Consent forms separate from participant lists and data
No participant numbers on consent forms
Store all data in password protected drive (University drive)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Accountability-protection of researcher

A

Qualitative work a physical risk
Carry phone and tell people your location
Risk of being challenged if sensitive topic
Less mistakes if follow ethics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Accountability-participant trust and debriefing

A

Trust- risk of exposure, trust researcher to respect privacy, recordings not available to those beyond the research

Debrief- still happy to use data, know who to contact to withdraw, should leave in same or better mood

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Accountability- minimise harm

A

Frame interview questions, signpost to support
Never go outside expertise or offer counselling
Suggest withdrawal if distressed. Avoid making decision for them
Can withhold aims

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Stages of a write up for qualitative and quantitative

A

Qualitative- intro, methodology, analysis, conclusion, discussion

Quantitative- intro, method, results, conclusion, discussion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Epistemology

A

What is knowledge, belief, truth

Determine what is fact

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Epistemological perspectives

A

POSITIVISM- one reality uncovered through observation (quantitative)
POST POSITIVISM-some objectivity, research in a social context. What people say about their experience
SOCIAL CONSTRUCTIVISM-range of valid views
RELATIVISM -reality relative to history and culture (qualitative)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Reflexivity

A

Researcher reflects on own attitudes, values and experiences
Social and political context

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Qualitative research

A

INDUCTIVE, start with observations and form theory
Find general themes, no single answer
Focus on context (words) make predictions
Literature can inform
Subjective representations of reality, humans have viewpoints and should acknowledge reflexivity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Good research question

A

Match question to relativist approach, extract unique meaning of the world
Question guides the method and reveals epistemological position
Lend to qualitative methodology e.g. focus group
Well constructed, answerable and specific
Existing literature as context, reviews help define the question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What does the choice of research question influence

A
The method you use 
Epistemological position (usually, relativist, positive)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Interviews

A

Exploratory, acknowledge diversity of experience
Skilled interviewer brings out topics
Allow flexibility but follow topics
Follow up questions and probes to explore for long detailed answers
Meaningful interesting and answerable
Display question for focus group, order of questions and wording is important
Draft, pilot and revise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Role of interviewer

A

Questions not neutral, interviewer is integral to data and influences it
Data is coproduced between interviewer and participant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Interview prep and practicalities

A

Consider length, amount of participants
Run a pilot and practice
Prepare interview schedule

Quiet room, safety and confidentiality
Check equipment, toilets, fire exits etc
Introduce purpose of research, relaxed and friendly
Check consent
Learn questions off by heart if possible
Active listening, respond and end well

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Iterative process of research question in qualitative

A

Identify what you need to know
Derive research questions from literature without answering question that has been answered
Question may become more focused or develop different direction from literature reviews
Grounded theory-can delay literature review until after data collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

When do literature reviews happen

A

Development of research question
During planning stages (rationale)
End of project (literature not considered, check for relevant studies not published since)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are literature reviews used for

A

Find what has already been done
Understand kinds of questions people in topic have asked
Get to grips with issues relevant to area of interest
Construct account about research
Funnel from bigger general issues to sub themes and areas

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Transcription types

A

Orthographic- verbatim postscript
Non orthographic-paralinguistics, extra linguistics Jeff

PLAYSCRIPT AND JEFFERSONIAN (Systematic representation of language in written form)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

playscript

A

Orthographic
Hesitations, false starts
Used for analysis of the meaning of speech such as thematic or phenomenological analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Jeffersonian

A

Non orthographic
Reflects interview as social interaction, more systematic
Used for conversation analysis, time consuming and may be less widely applicable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Ontology and epistemology

A

Ontology- is there a reality or not(realism, relativism)

Epistemology- how do we know if there is a reality (positivism, social constructionism)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Critical realism

A

Perception of reality comes from within and without

Biological mechanisms drive perception common to all living things, people agree on some truths

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Thematic analysis

A

Extract common topics and themes
Use of quotes to illustrate key aspects in wider themes
Themes-Coherent and meaningful concepts in data with minimal overlap allowing categorisation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Creating themes process

A

Familiarise with data (re-read, initial observation)
Generate initial codes (short version)
Search for higher order themes
Reviewing themes (overlap, reorder, check themes in relation to codes and define nature of each theme and relationship between in thematic map)
Define and name themes (how fits overall data)
Write up (consolidate narrative, select extracts and show how reflects end product and context of literature)

36
Q

Common errrors of thematic analysis

A

Extracts with no analysis, must be interpreted
Using interview questions as themes or to describe responses
Weak analysis, themes not coherent or reflect data
Mismatch between data and analysis
Must make theoretical position clear

37
Q

Data and theory driven thematic analysis

A

Data- avoid starting with predetermined theory, be open minded but still have some reflexivity

Theory- apply or test theory, establish holistic sense of experiences, key points and how interviewer shapes data

38
Q

Sample variation

A

Any sample from population will vary

Can be measured with SD (unsystematic variation)

39
Q

Wide error bars

A

More unsystematic variation, difficult to find effects based on conditions in the study

40
Q

Standard error

A

Estimate of deviation between sample and population mean
Errors can occur when sample taken from wrong population (sampling error) -measure of unsystematic variation
95% CI error bars estimate the effects we should find in a population

41
Q

Error and effect

A

If more error (unsystematic variation) than effect (systematic variation)

Unlikely to find an effect in the population or is hidden by variation
Not significant effect
Effect due to differences in sample, not experimental manipulation

42
Q

Standard error positive value and negative

A

Positive value- more effect than error

43
Q

P value

A

How likely to see effect in sample of no effect in population (null)
If smaller than 5% then is significant, effect is likely to exist in the population

44
Q

Inferential statistics

A

Generalise from a small sample to population (not necessarily qualitative)

Have not tested whole population so don’t know population mean and standard deviation
Small samples will not be representative of population/unsystematic

45
Q

Effect size

A

Measure of how important the difference/effect is that was found in the sample

46
Q

Partial eta squared

A

Np2 shows total variance explained by treatment effect (systematic variation)
value as a proportion
The differences between scores attributed to experimental manipulation, the rest is due to other factors

47
Q

1 way anovas

A

(Like a t test) with more than 2 conditions

To test whether there is a difference between the levels of the factor
If significant- there are differences, can explore data in post hoc tests

48
Q

Anova IVs conditions names

A

IVs- factors

Conditions-levels

49
Q

Equation F ratio

A

Systematic and unsystematic variance (the EFFECT, between groups variance) ÷
Unsystematic variance alone (the ERROR, within groups variance)

Removes the effect =giving an F RATIO

50
Q

Treatment effect

A

Comprises of the effect (difference from manipulation)

But also error (unsystematic variation)

51
Q

The F ratio results and what they mean

A

If F greater than 1- more effect than error

If F smaller than 1- more error than effect

52
Q

Rounding up numbers

A

All values rounded to two decimal places apart from p value

53
Q

What does it mean if anova is significant

A

There are differences between groups and was an effect of treatment

-now need to find out which groups differ by doing separate t tests on the groups (post hoc tests)

54
Q

Writing up an independent anova

A

A one way between participants anova shows there was a significant effect of… F (effect df, error df)= [F value] , p [ p value ], np2 [np2 value ]
The effect demonstrates that [np2 value as %] of the variance in errors can be attributed to…
This suggests that…had an effect on…

55
Q

Post hoc tests

A

To see where there are differences between the levels (omnibus test)

1 way independent ANOVA- independent t test
1 way repeated measures ANOVA- paired t test

56
Q

Post hoc t tests and bonferroni correction

A

Establish whether significant difference between levels
Alpha cut off at 5% prevents type 1 error but needs to be Bonferroni corrected for the levels

0.05 ÷ amount of levels to keep it at 5%

57
Q

Reporting post hoc test

A

Bonferroni corrected post hoc tests revealed that…
(mean, SD) compared to (mean, SD) ; t (df)= [t value] , p = [p value]
These results suggest…

(Use sig 2 tailed )

58
Q

Maunchley’s test of sphericity

A

Want to be not significant- assumption of equal variance so can do a post hoc test
IF SIGNIFICANT- Read GREENHOUSE GEISSER for the dfs and the significance (p)
If Greenhouse geisser still not significant then cannot carry out post hoc tests
If Maunchley significant and has outliers, normal distribution-NON PARAMETRIC

ONLY FOR REPEATED MEASURES

59
Q

Non parametric anova

A

When violate expectations of a parametric ANOVA
If LEVENES/MAUNCHLEYS TEST IS SIGNIFICANT=non parametric
Rank scores not raw scores, manages variations of distributions, outliers and sphericity

60
Q

Kruskall Wallis-non parametric

A

Between participants

H (df)=H value, p=p value

Mann Whitney post hoc U value, p value
Use medians

61
Q

Reporting Kruskall Wallis

A

As the data were not normally distributed, a Kruskall-Wallis one way ANOVA was performed for…
The results showed significant difference between…
H (df)= (H value), p (asymp sig)
Bonferroni corrected post hoc Mann-Whitney U tests revealed more.. (median) than…(median); U (u value), p (sig) and more..than…
This suggests

62
Q

Friedman test-non parametric

A

Within participants
x2 (df)=chi square, p=p value

Wilcoxon post hoc Z value, p value
Use medians

63
Q

Two way Factorial ANOVA

A

More than one factor (IVs)
Differences between more than 2 conditions or groups

Tests the interaction between the factors, tells us whether impact of IV is the same regardless of other IV or whether DV varies as a result of an IV

64
Q

What does Factorial anova produce for each factor mean

A

MAIN EFFECT for each factor-Marginal mean (based on means for each type in that IV)
INTERACTION between factors (IVs)

If interaction, lines will be crossed over on the graph

65
Q

Factorial ANOVA how to write up main effects of IVs and the interaction between the IVs

A

F (effect df, error df)= F value, p value, np2 value

Look to significance to see if main effects are significant

66
Q

Following up a significant interaction

Factorial anova

A

Bonferroni corrected t tests (simple effects test)
Run independent t test to test differences between the levels of 1 factor (learning style) in each level of the other factor

Run on conditions involved in interactions e.g.2 levels in each factor (4 simple effects tests)

67
Q

Reporting factorial ANOVA simple tests

A

Bonferroni corrected simple effects tests showed that visual style outperformed [auditory] (mean, SD) when [visualisation was used] t (df)=t value, p=p value

[auditory style using auditory] performed better (mean, SD) than those with[ auditory and visualisation] (mean,SD); t (df)=t value, p=p value
THEN SWITCH THEM ROUND

68
Q

Cohen’s d

A

For tests with 2 comparisons
Measure of the overlap between 2 means in standard deviations

High overlap in graph =small Cohen’s d and small effect size
(The magnitude of the F ratio)

69
Q

Why does 1 way repeated measures ANOVA not take individual differences into account?

A

There is only one group of participants, sampling error is included but individual differences between participants are not included as unsystematic variance

70
Q

What does a main effect of the factors mean without an interaction?

A

No impact of either factor on the DV

and no impact of factor 1 compared to 2 on DV

71
Q

What does an interaction mean

A

Effect of Factors on DV when they interact together

72
Q

Assumptions of non parametric anova

A

Continuous DV
Normal distribution (but is okay if there are equal sample sizes)
No outliers
Equal variance

73
Q

Non parametric omnibus test

A

Non parametric t tests carried out if p value is significant
Bonferroni corrected

74
Q

Stainar Kvale’s criteria

A

Knowledgable, clear, structured, gentle, sensitive, open, steering, critical, remembers, interprets

75
Q

Graphing non parametric data

A

Error bars with mean and standard error are not appropriate

Use bar graph based on median without error bars

76
Q

LEVENES test

A

If not significant then do non parametric (Friedman)

77
Q

Deductive and inductive

A

Deductive- theory driven

Inductive-data driven

78
Q

How ANOVA assesses impact of experimental conditions

A

Size of error (unsystematic variance) in relation to effect (systematic variation)=F ratio
Partial eta square indicates proportion of variance

79
Q

Assumptions of a 1 way anova

A
Continuous DV
No outliers (bar and whisker)
Normal distribution (Histograms)
Equal variance in each group (levene’s test INDEPENDENT Maunchley’s REPEATED MEASURES)
if non significant then is no significant differences between error variances and assumptions)
79
Q

Post hoc tests for parametric and non parametric

A

Parametric- M, SD

Non parametric- Mdn

79
Q

Non parametric anova and the tests and omnibus tests used

A

Between participant-Mann Whitney U- Kruskall Wallis H

Within participant-wilcoxon Z signed rank -Friedman test X2

80
Q

Simple effects tests for factorial Anova

A

Bonferroni corrected t tests test differences between levels of 1 factor in each level of the other factor

81
Q

What assumption can be violated but still have parametric anova

A

Can still do parametric anova IF sample sizes are equal

82
Q

Types of one to one interviews and questions

A

Structured
Semi structured
Unstructured

Closed 
Open 
Leading 
Non leading 
Probes
Main questions (open, non leading and descriptive)
83
Q

Coding

A

Generate short relevant labels
Semantic and conceptual understanding
Codes must be specific and work independently of the data, must successfully evoke relevant features of the data

84
Q

Writing up narrative

A

Integral part, weave together coherent story

Contextualise analysis in relation to existing literature

85
Q

Interpreting 95% confidence interval graph

A

Between-summaries for groups of cases
Within-summaries for separate variables

If confidence intervals overlap: any effects in sample are unlikely to be found in the population
Longer bars- wider range of results, also shows the trends