Research Methods⚗️ Flashcards

(56 cards)

1
Q

P value

A

Probability of finding effect in sample if no effect in population (unsystematic variation)
If probability less than 0.05 can reject null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

CI

A

95% confidence interval around the mean difference

Range of scores likely to indicate the true population mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

T value

A

Calculation of p value based on calculation of t value

If mean difference increases then t value increases and p value decreases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Effect sizes

A

Indicate if differences are psychological significant (not just statistically)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Independent T test

A

Between participants

Difference between variables (continuous DV, categorical IV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Independent t test df

A

Total sample size - 2
(Two means are used)

Data that can be freely varied and still get same descriptive statistics in the sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Independent and dependent t test assumptions

A

Data approximately normally distributed (histogram clear skew, if not use non-parametric test)
No clear outliers (boxplot, points outside the box)
Spread of scores (variance) is relatively equal in both groups, error bars
Levene’s test affects accuracy of t test if not equal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Paired t test

A

Within participants

Difference between variables (continuous DV, categorical IV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Paired t test df

A

Df=total sample size - 1
One mean used

Data that can be freely varied and still get same descriptive statistics in the sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Levene’s test

Assuming variance

A

Not significant (p more than 0.05) no significant difference in variance in each group (assume equal variance)

Significant (p less than 0.05) significant difference in the variance in each group (do not assume equal variance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Independent t and paired t reporting results

A

Group 1 were (significantly) better (mean, SD) than group 2 (mean,SD)
t (df) =T VALUE, p = SIG 2 TAILED VALUE

This suggests that group 1 were better than group 2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Cohen’s d

A

Interprets magnitude of an effect independent of the scale used
For both independent and paired t test

Use mean and SD for both groups/conditions
Larger value indicates more pronounced effect (can be negative if opposite direction)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Calculating effect sizes

A

After finding a significant effect in a null hypothesis

Calculate Cohen’s d using the Cohen’s d calculator
Compare value to levels of effect size and state magnitude of effect
Bigger effect sizes indicate more important effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Pearson’s correlation

A

Relationship between two variables

Continuous IV and continuous DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Scatterplot relationship conclusions

A

How much trend resembles a linear pattern

Variation in x explained by differences in y scores or vice versa
Relationship between x and y can be explained by z
Relationship is chance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Correlation coefficient

A

Measure of effect

Direction (positive or negative) and strength of relationship (the more it resembles a straight line, between 0 and 1)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Correlation value strengths

A
R= 0.01-0.39 weak
R= 0.40-0.69 moderate 
R= 0.70-0.99 strong
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Pearson’s correlation assumptions

A

Data normally distributed (histogram clear skew, if not use non-parametric test)
No clear outliers (boxplot, points outside the box)
Linearity (plot on scattergraph to check)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Pearson’s correlation df

A

Total sample size (N) -2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Pearson’s correlation shared variance

A

R squared
Variation in scores in one variable that can be explained by variation in the other variable
Stronger relationship = more overlap and shared variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Pearson’s correlation reporting results

A

The findings show a (STRENGTH AND DIRECTION OF CORRELATION from TEST SCORE) between A and B
The relationship was (SIGNIFICANT OR INSIGNIFICANT),
r (df) = TEST SCORE, p= SIG 2 TAILED
This shows that A…

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What happens if p is 0.000

A

You write p< .001

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Chi squared test

A

Relationship between variables

Categorical IV and categorical DV (transformed from continuous)

24
Q

Calculating chi squared test

A

Compare observed and expected values, bigger difference indicates larger Chi-squared value (more likely to reject null)

25
Chi squared assumptions
No more than quarter of cells should have expected value more than 5 No individual cell should have expected value more than 1 Numbers in each cell should be independent, categories are mutually exclusive
26
Cramer’s v effect sizes
Less than 0.10 trivial 0. 10-0.30 small 0. 30-0.50 medium 0. 50+ large Larger indicates more important relationship (chi squared) Shared variance= v squared
27
Reporting cramer’s v for chi squared
Cramer’s v = This is interpreted as a (small/medium/large) effect ( x100)= percentage of the variation in A explained by B
28
Report chi squared
In the sample, % of A and % of B did something Chi squared test showed a (significant) relationship between two variables xsquared (df, N=NUMBER IN SAMPLE)=CHI SQUARE VALUE, P=ASYMPTOTIC SIGNIFICANCE This suggests that A is more likely to...
29
Non parametric tests
Not normally distributed (check with histograms) Uses ranks (focus where score stands in relation to others) Less powerful, median most appropriate
30
Parametric tests with their non parametric equivalents
Independent t -Mann Whitney Paired t test-Wilcoxon Pearson’s correlation- Spearman’s Rho
31
Mann Whitney
Alternative to independent t test, Compare mean ranks of two independent groups (between) Categorical and continuous Ordered according to score (temporarily disregard group) Rank scores in order, average ranks of duplicate scores
32
Reporting Mann Whitney and Wilcoxon
There was a (significant) difference between A (median) compared to B (median) Mann Whitney U= MANN WHITNEY DATA, p=ASYMP 2 This suggests that... WILCOXON- use Z instead of U Z value negative value can be stated as positive
33
Wilcoxon signed rank
Alternative to paired t test Compare mean ranks of participants who scored higher on (within) Categorical and continuous condition 1 to mean ranks of those who scored higher on condition 2
34
Spearman’s Rho
Alternative to Pearson’s correlation Compare correlation using ranked scores Continuous IV and continuous DV
35
Reporting spearman’s Rho
Spearman’s correlation showed that there is a (strong positive) relationship between A and B Rs= CORRELATION COEFFICIENT MYATTRAC, P=SIG 2 TAILED This suggests that...
36
Epistemology
Aim of research is to understand or gain knowledge about the world (patterns, behaviour, principles)
37
Approaches to research (philosophical)
Positivism- only one reality, uncover through observations Post positivism-acknowledge need for falsification, use observation Phenomenological- reality socially constructed, use dialogue to make sense of subjective experience Constructionism- not one reality, socially/culturally produced through interaction Relativism-not one reality, relative to historical, cultural and social context
38
Methodology
Strategy or approach to research | Qualitative or quantitative
39
Quantitative
More positivist, uncover one reality Deductive- start with theory, specific hypotheses, see if reality makes sense Analysis- constructs (thoughts, behaviour)of interest are coded to numbers
40
Qualitative
Relativist, not one reality, subjective experience Inductive-observations from people, form more general theory. Aim to find general themes or viewpoints Analysis-focus on content, emphasis on words not numbers
41
Qualitative methods
Direct data collection- interviews, focus groups, questionnaire Indirect data collection-observations, analysis of online material
42
Qualitative criticisms
Subjective, influenced by personal bias Does not represent population (but doesn’t aim to) Cannot be replicated (does not aim to) Not systematic
43
Qualitative research methods-interviews
STRUCTURED-predetermined questions in order, ask same questions to all to compares minimise bias, descriptive or exploratory SEMI STRUCTURED- Flexible schedule of questions, few are set, open to new directions. Inductive approach, explanatory or exploratory
44
Conducting interviews good practice
``` Simple language, no jargon Prompt when necessary Rapport for comfort Active listening, nodding Body language, eye contact ```
45
Focus groups
Group dynamic, reflect on viewpoint. Range of perspectives Avoid sensitive topics (may withhold) Researcher as facilitator (steer it)
46
Qualitative research methods- observations
NATURALISTIC-everyday setting, unaware of observation. Can be archived data. No direct manipulation PARTICIPANT OBSERVATION-researcher immersed in setting/activities NON PARTICIPANT OBSERVATION-Researcher observes, no active part
47
Ethical and practical considerations of research methods
Consent-problem in naturalistic setting, knowledge can influence findings Confidentiality/anonymity-how answers will be used Debrief-a problem in naturalistic setting Uncertain if have all data, if everything has been raised Researcher/participant bias
48
Four main steps in data analysis (content/theme)
Anchor data to research question Transcribe data- orthographic (verbatim) vs non orthographic (paralinguistics etc) Initial reading of data- themes and how interviewer may have shaped data Systematic data- driven by research question,cyclical refinement Aim to find structure
49
Content analysis
Combines qualitative and quantitative Extract common topics and themes, count how often they occur Deductive (predefined areas) or inductive (emerges from data)
50
Content analysis steps
``` Familiarise with data Generate initial codes Search for higher order themes Review topics and themes Inter rater reliability check Count occurrences of each topic/ theme Write report ```
51
Codes for content analysis
Code should fit with data Aim for as few codes as possible but still represent the data Present only relevant info in write up
52
Thematic analysis
Extract common topics and themes Use quotes to illustrate key aspects covered in wider themes Distinction between major and minor themes
53
Grounded theory
Start with data and develops themes to generate theory (inductive)
54
Reflexivity
Important in qualitative analysis to be reliable and systematic Aware of researcher’s influence on data
55
phenomenological analysis
Analysis of a subjective interpretation of a topic
56
df for everything
Independent t test -2 Paired t test -1 Pearsons correction -2 chi square Says it on the column