Research methods Flashcards
1
Q
Briefly describe the Tuskegee Syphilis study in 1932-1972
A
Looked at effects of syphilis on untreated African-American men
Participants didn’t know they were in a study, most didn’t know they had syphilis
No consent given
Treatment was withheld even when penicillin was available.
2
Q
When was the Nuremberg code made?
A
1947
3
Q
What are the 10 points of the Nuremberg code?
A
1) Voluntary, well-informed consent of human subject
2) Experiment should aim at positive results for society that can’t be obtained any other way
3) Should be based on previous knowledge that justifies the experiment
4) Experiment should be set up in a way which avoids unnecessary physical or mental suffering or injuries
5) Shouldn’t be conducted when there is any reason that it implies a risk of death or disabling injury
6) Risks should be in proportion to & not exceed the expected humanitarian benefit
7) Preparation and facilities must be provided to protect subjects against risk
8) Staff conducting experiments must be fully trained and scientifically qualified
9) Human subjects must be free to immediately quit the experiment at any point
10) Staff must stop the experiment at any point when they observe that continuation would be harmful
4
Q
Describe the Willowbrook hepatitis experiments
A
Experiments on children living in residential care with mental health problems or learning disabilities.
Intentionally infected children with hepatitis and observed progression
5
Q
When was the declaration of Helsinki made?
A
1964
6
Q
What is the Helskini declaration?
A
Ethical principles for research involving human participants
7
Q
What are the basic principles of the declaration of Helsinki?
A
Respect for the individual, their right to self determination and the right to make informed decisions
Participant’s welfare must take precedence over interests of science and society
Ethical considerations must take precedence over laws and regulations
8
Q
What studies require ethical approval?
A
Studies involving human / animal participants
Gathering novel data or information
Creating knowledge that can be generalised beyond the patient sample or setting
9
Q
What projects don’t require ethical approval?
A
Service evaluations
Clinical audits
10
Q
What ethics committee do you need to apply for if using NHS staff, patients or site?
A
NHS health research authority
11
Q
What points need to be included for ethical approval?
A
Scientific rational Rigorous methodology Informed consent Vulnerability of participant groups Data protection, confidentiality and records management Research safety and wellbeing
12
Q
What information must be included in the rigorous methodology for ethical approval?
A
Adherence to established methodology
Methods must be appropriate for producing new knowledge
Methods must be appropriate and feasible for proposed setting and sample
Study materials or equipment should be valid and reliable
Show skills for robust data management and analysis within the team
13
Q
What methods are there for participant recruitment>
A
Face to face in clinic
Posters
Social media
14
Q
What participant groups are considered vulnerable?
A
Children Patients with dementia Patients with learning difficulties People with mental health problems People in care facilities Over-researched populations
15
Q
What is the definition of research?
A
Study which is trying to generate new knowledge about patients or conditions or healthcare services that will be generally true across a wider population than it is actually studying.
16
Q
What is the definition of a service evaluation?
A
Evaluate or assess some part of a local healthcare service. Aims to improve service based on evidence collected.
Results from this project will only feed back into this particular service
17
Q
What is a clinical audit?
A
Quality improvement process that seeks to improve patient care and outcomes through systematic review of care against explicit criteria and implementation of change.
18
Q
What are the 5 stages of the audit cycle?
A
Identify Method Analyse Change Monitor
19
Q
What does the identify stage in the audit cycle include?
A
Guidelines Evidence Patient and public involvement Process design Agree standards
20
Q
What methods can be used for data collection of service evaluations or audits?
A
Patient notes / record review Survey of staff - paper / online Survey of patients - paper / online Telephone interview Face to face interview Focus groups
21
Q
What are the problems with using patients notes to gather research data?
A
Limited type of information available
Need to ensure there are no patient identifies
22
Q
What points need to be considered when creating a questionnaire?
A
What do we want to achieve? What information do we need to know to help this? Who should we ask and how should we ask them? Types of questions Choosing categories - standardised - analyse by age or scale - demographic factors Question writing
23
Q
What is the format of questionnaire questions determined by?
A
What we want to know
What types of data we want to generate
What types of analysis we want to do
24
Q
What are the 3 types of questions for a questionnaire?
A
Closed questions with yes / no or categorical answer
Closed statements answered on a scale
Open-ended questions
25
What are Likert scales?
Respondents specify level of agreement or disagreement on a symmetric scale for a series of statements
26
What can Likert scales be used for?
```
Knowledge
Beliefs
Attitudes
Symptoms
Traits
```
27
What assumptions do Likert scales assume?
Bipolar scaling method
| Assumes distance between each response is equal
28
What should be considered when writing questions for Likert scales?
Is the question / statement loaded with social desirability?
Does the question require knowledge or information the respondent might not have?
Is the statement based on 2 premises?
29
Why do likert scales require many items?
Unlikely to identify a single item which represents the whole issue being measured
Reduces error of random responses or misunderstandings
Can design questionnaires to reduce skew
30
How are Likert scales analysed?
Add up scores across similar questions to make a scale (total score)
Report mean total score and standard deviation
31
What is a RCT?
Study in which participants are allocated randomly between an intervention e.g. treatment and a control group e.g. no treatment or standard treatment
32
Why are RCTs conducted?
Safety
- ascertain safe dose
- demonstrate safety and tolerability of new compound
- monitor adverse events profile
Efficacy / effectiveness
- demonstrate efficacy of new drug
- show the treatment T is superior or equivalent to treatment X
- demonstrate effectiveness and cost effectiveness
33
What is a confounder?
Variable that influences both the dependent variable and independent variable causing a spurious association
34
What does equipoise provide?
Ethical basis for medical research that involves assigning patients to the different treatment arms of a clinical trial
35
What is internal validity in an RCT?
Is the independent variable causing the dependent variable in the study?
36
What is external validity in an RCT?
To what extent can these findings be generalised to other people, situations and times
37
What is bias?
Any departure of results from the truth
38
How does bias occur in an RCT?
When systematic error is introduced into sampling
Testing by selecting
Encouraging one outcome or answer over others
39
What is the definition of bias in statistics?
A tendency of an estimate to deviate in one direction from a true value
40
What is selection bias in an RCT?
Systematic differences between baseline characteristics of groups that are compared
Study sample doesn't represent target population
41
What is performance bias in an RCT?
Systematic differences between groups in the care that is provided or in exposure to factors other than the interventions of interest
42
What is attrition bias?
Systematic differences between groups in withdrawals from a study
43
What is observer / detection bias?
Systematic differences between groups in how outcomes are determined
Outcome measures don't adequately capture outcome of interest.
44
What types of trials can be blinded?
Drug trials
Surgery vs non surgical
Psychological interventions
45
What is a single blinded RCT?
Patients are blinded
46
What is a double blinded RCT?
Blinding of patients and treating physicians
47
What is a triple blinded RCT?
Blinding of patients, treating physicians and study investigators
48
What is a P-value?
Probability that the difference observed could have occurred by chance if the groups compared were really alike
49
What type of study causes a high p-value?
Few observations with high variability
50
What type of study causes a low p-value?
Many observations with low variability
51
What is the clinically important effect?
Smallest difference in outcome between treatment groups that would demonstrate a clear advantage of 1 treatment over another in terms of chosen outcome measures
52
Why is it important to calculate sample size?
Too few participants - if you get a null hypothesis you don't know if you have evidence of no effect or no evidence of an effect
Too many participants is unethical and expensive
53
What are parametric tests?
Make assumptions about the data, particularly that its normally distributed
54
Describe a right skew
Skewed part is to the right
Most cases are to the left
There is more count in the tail than expected in a normal distribution
Positive skew
55
Describe a left skew
Skewed part is to the left
Most cases are to the right
There is more count in the tail than expected in a normal distribution
Negative skew
56
What are the problems with a skewed distribution?
Mean is different from the median
| The mean is highly influenced by the tail of the distribution
57
When is a T-test done?
Does one group have higher scores than another?
58
When is a chi-squared test done?
Does one group have a higher proportion of an outcome than another? (categorical)
59
What assumptions have to be made to carry out a T-test for an RCT?
Randomly sampled
Independent observations
Variances for each group are equal
Sample is large enough
60
When do you do an ANOVA test instead of a T-test?
If there are more than 2 groups
61
What are non-parametric tests?
Distribution free tests
| Fewer assumptions but less power
62
What statistical tests are used for non-parametric tests?
Mann-Whitney U replace T-test
Kuskal Wallis replaces ANOVA
Spearmans Rho replaces correlation
63
When is the Mann-Whitney U / Wilcoxon rank sum test used?
To compare non-normally distributed continuous variables between groups if randomly sampled and independent observations
64
What are examples of qualitative data?
```
Patient voice in interviews
Policy documents
Historical records
Open answers on questionnaires
Viewpoints of clinician
Media reports
```
65
What is qualitative research?
Multi-method in focus, involving an interpretive naturalistic approach to its subject matter. Qualitative researches study things in their natural settings, attempting to make sense of or interpret phenomena in terms of the meanings people bring to them
66
What are the benefits of qualitative research?
```
Depth and detail
Openness in possible responses
Avoid pre-judgements
No need for restrictive hypothesis
Good if we lack understanding of a concept and need more info
```
67
What are the limitations of qualitative research?
Results are highly subject
Not usually generalisable
Cant compare groups
Transcription and analysis can be time consuming
Rich data is hard to analyse on scale so need fewer participants
Complexities in data can be difficult to present
68
Describe the differences between qualitative and quantitative
Qualitative's social theory is action whereas quantitative is structure
Qualitative methods involve observation and interview. Quantitative involve experimental survey.
Qualitative reasoning is inductive but quantitative is deductive
Qualitative questions are what is X? Quantitative is how many X's?
Sampling method is theoretical for qualitative and statistical for quantitative
69
What are the reasons to use qualitative research?
```
Takes an interpretative, naturalistic approach to its subject matter
Sets a patient-centred agenda
Challenges received wisdom
Theory can emerge from the data
Can inform quantitative studies
```
70
What methods can be used for qualitative research?
Observation
Textual analysis / analysis of documents
Focus groups
Interviews
71
What is the purpose of textual analysis for qualitative research?
Understanding how language is used
Understanding how stories or public opinion develop over time
Looking for biases or deviations from the truth
Understanding patients' lived experience and how they make meaning from it
72
Describe a focus group
Typically 8-10 participants
Group discussion about specified topics
Often a series of focus groups is conducted
Led by moderator / facilitator
Tape-recorded and transcribed
Revelations of views can spark off other participants to reveal broader insights than are possible from individual interviews
73
What are the 3 ways of structuring an interview?
Structured
Semi-structured
Unstructured / in depth
74
What does the recruitment sample depend on for qualitative research?
Purpose of the research
Resources available
Time available
Access to population
75
What are the different types of sampling for qualitative research?
Extreme / deviant case
Homogenous
Typical case
Snowball
76
What are the ways to evaluate validity of qualitative research?
Triangulation
Respondent validation
Further interviews or focus groups
Subsequent analysis / independent assessment
77
What are the 6 steps for planning and carrying out a qualitative study?
1) Formulate research Q
2) Choose method
3) Select and recruit sample
4) Design interview schedule and data collection
5) Interpretation of data
6) Validity checks
78
What is prevalence?
Frequency of cases in a given population at a designated time
79
What are cross-sectional studies?
Survey or test individuals in a population individually to determine prevalence of disease
Can also measure exposure
80
What is point prevalence?
Prevalence at a moment of time
81
What is period prevalence used for?
Measure things that fluctuate e.g. hay fever symptoms
82
What are the strengths of cross-sectional studies?
Measure prevalence and thus disease burden in whole population and subpopulations
Compare prevalence in exposed and non exposed to risk factors
Quick and inexpensive
Can be used to initially explore a hypothesis prior to another type of study
83
What are the weaknesses of cross-sectional studies?
Not suitable for rare diseases
Not suitable for diseases of short duration
Can't separate cause and effect as they are measured at same time
Can't measure rate of new changes arising and any changes therein.
84
What are cohort studies?
Group of people is followed through the and the onset of a disease / health event is measured
85
What is incidence?
Number of instances of disease / illness onset in a given period in a defined population
86
What are the strengths of cohort studies?
Can calculate incidence and relative risk
Can offer some evidence of cause-effect relationship
Can identify more than 1 disease related to single exposure
Good when exposure is rare
Minimises selection and information bias
87
What are the weaknesses of cohort studies?
```
Potential for losses to follow up
Often requires larger sample
Less suitable for rare diseases
Expensive
If retrospective, data availability and quality may be poor
```
88
How is relative risk calculated?
Incidence of disease among exposed divided by indigence of disease among non-exposed
89
What does a RR of less than 1.0 mean?
Risk in exposed group is less than risk in non-exposed group
| Exposure may be protective against disease
90
What does a RR of equal 1.0 mean?
Risk in exposed group = risk in non-exposed group
| Exposure isn't associated with disease
91
What does a RR of more than 1.0 mean?
Risk in exposed group is higher than risk in non-exposed group
Exposure may be a risk factor for the disease
92
What does a RR of 1.5 mean?
Risk of outcome is 50% higher in exposed than unexposed group
93
What does a RR of 0.8 mean?
Risk of outcome is 20% lower in exposed than unexposed group
94
What are case control studies?
Groups who differ at outset on disease status
| 2 groups of participants - 1 with condition (cases), 1 without condition (controls)
95
What are the strengths of case-control studies?
Can offer some evidence of cause-effect relationship
Can identify multiple exposures
Good when disease / outcome is rare
Minimises selection and information bias
Retrospective -cheaper and often shorter duration
96
What are the weaknesses of case-control studies?
Can't calculate prevalence or incidence
Less suitable for rare exposures
Can be hard to ensure exposure occurred before onset
Retrospective data availability and quality may be poor
Suitable control group may be difficult to find
97
How is risk calculated?
Outcome of interest divided by total number of all possible outcomes
98
How is the odds calculated?
Outcome of interest divided by outcome not of interest
99
How is an odds ratio calculated?
Odds in exposed divided by odds in unexposed
100
What is relative risk?
Incidence of disease in exposed divided by incidence of disease in unexposed
Calculated using total population at risk of developing disease
101
What is RR and OR not the same?
Odds ratio will always overestimate RR
102
What are confidence intervals?
Describe the range of values with a given probability e.g. 95% that the true value of a variable is contained within that range
103
What is sensitivity?
Proportion of people who have the disease who correctly test positive
104
What is specificity?
Proportion of people without the disease who correctly test negative
105
What is a positive predictive value?
Likelihood patient with positive test actually has the disease
106
What is a negative predictive value?
Likelihood patient with negative test result doesn't have the disease
107
What happens to PPV and NPV as prevalence increases?
PPV increases
| NPV decreases
108
What happens to predictive values as a disease becomes more common?
There will be less false positives for every true positive
There will be more false negatives for every true positive
Due to underlying frequency of disease increasing in the given population
109
What are the types of scientific report?
```
Journal article
Conference abstract
Conference proceeding
Monograph or book
Database or dataset
Algorithm or code
```
110
What is a good scientific question?
```
Clearly state
Answerable
Maps onto at least 1 study design
Important
Not already answered
```
111
What should the title of a scientific research question include?
State in brief the study design, population and question addressed
112
What should an abstract include?
```
Background
Aim of study
Methods
Results
Conclusion
```
113
What does IMRaD stand for?
Introduction
Methods
Results
Discussion
114
What should be included in the introduction section of a scientific report?
Why this research is important or necessary
1) Describe problem or situation that motivates research
2) Describe current state of research in field
3) Reveal a gap or problem in the field
4) Explain how the present research is a solution to that problem
Present any hypothesis at end
115
What should be included in the methods section of a scientific report?
Study design - population, sample, methods, procedure, equipment, analyses
Ethics statements
116
What should be included in the results section of a scientific report?
Description of study sample, response rate and participant characteristics
Presentation of findings
Tables and figures
Adjusted comparisons
117
What should be included in the discussion section of a scientific report?
```
Summary of findings
Reflect on meaning of data
Connect findings to previous research
Strengths of study
Specific limitations
Suggest additional research
Clinical and/or research and/or policy implications of study
```
118
What are some guidelines for method reporting?
```
STROBE
CONSORT
COREQ
SQUIRE
PRISMA
```
119
How should you describe the population in a scientific report?
Target population
| Study population
120
What is a type I error?
Study finds an association between A and B where none really exists so null hypothesis is wrongly rejected
121
What is a type II error?
Study finds no association between A and B when there really is one so the null hypothesis is wrongly accepted
122
Why does selection bias occur?
Recruitment from a setting which doesn't represent target population
Those who agree to take part differ from those who don't
Those who drop out differ to those who stay in
123
Why is it important to report studies in a standardised way?
Failure to understand quality of medical evidence is an ethical issue
May fail to introduce an effective treatment
May disrupt delivery of a treatment that works
May create a market for ineffective or dangerous therapies
124
Describe the hierarchy of evidence from bottom up
```
Case reports / opinion papers and letters
Animal trials
Cross sectional studies
Case control studies
Cohort studies
RCT
Meta-analysis and systematic reviews
```
125
What is a review?
Generic term for any attempt to synthesise the results & conclusions of 2 or more publications on a given topic
126
What are the types of review?
Traditional literature reviews / narrative reviews
| Systematic reviews / meta analysis
127
Describe narrative reviews
Usually based on narrative or commentary & are produced by a ‘content expert’
Unsystematic approaches to collecting & summarising evidence can lead to bias
- Bias arising from studies included in review
- Bias arising from studies not included in review
- Bias arising from way review is done
128
What is a systematic review?
Summary of medical literature that uses explicit & reproducible methods to systematically search, critically appraise & synthesise on a specific issue.
Synthesises the results of multiple primary studies related to each other by using strategies that reduce bias & random errors
129
What is the aim of systematic reviews?
Systematic eg in its identification of literature
Explicit eg in its statement of objectives, materials & methods
Reproducible eg in its methodology & conclusions
130
What are the key elements of a systematic review?
Well formulated question
Comprehensive database search
Unbiased selection & abstraction process
Critical appraisal of selected studies
Synthesis of data & interpretation of results (evidence synthesis)
131
What is PICO-ST?
```
Population
Intervention
Comparison
Outcomes
Setting
Timing
```
132
What is SPIDER?
```
Sample
Phenomenon of Interest
Design
Evaluation
Research type
```
133
What are the limitations of systematic reviews?
May be no trials / evidence
If you apply all your criteria effectively & get <5 studies, this is fine
Trials may be of poor quality
Results may still be inconclusive
Practice doesn’t change just because you have evidence of effect / effectiveness
134
What is a meta analysis?
Statistical combination of ≥2 studies to produce single estimate of effect of the health care intervention under consideration
135
What is a meta-synthesis?
Group of methods used to synthesise qualitative (or mixed) data to produce summary result / re-analysis of previous studies / study findings
136
What are the strengths of meta-analysis?
Statistically pools results from a range of trials
Effect of an intervention is seen over a bigger sample size than possible in a single trial
Results of each study are weighted for sample size
Results from a range of settings can be compared
Can evaluate homogeneity of results ie variability of effect sizes
Can explore variability ie test moderators of effect size (eg study quality)
137
What are the weaknesses of meta-analysis?
Heterogeneity – studies which measure things differently are difficult to combine or combination becomes meaningless
Publication bias
Requires lot of effort & subject-area expertise
Mechanics of statistics may obscure theory
