L05 - AAAA systematic reviews Flashcards

1
Q

What does ‘assess’ in the AAAA framework constitute?

A
  • Formulate a clear clinical question (PICO framework)

- Identify the study design that would provide the most accurate answer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does ‘access’ in the AAAA framework constitute?

A
  • Search for and retrieve the research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does ‘identify’ in the AAAA framework constitute?

A
  • Identify the strengths and weaknesses of the research you find and understand what the results mean
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does ‘act’ in the AAAA framework constitute?

A
  • Apply the evidence, taking into account its limitations, alongside other information (e.g. patient pref)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is positive results bias?

A

When authors are more likely to submit, or editors accept, positive than negative or inconclusive results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is outcome reporting bias?

A

When several outcomes within a trial are measured but are reported selectively depending on the strength and direction of those results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the PICO framework?

A
P = Patient popn - how describe group of patients
I = Intervention or issue 
C = comparator - main alt intervention (comparison intervention)
O = Outcomes - context
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Advantages of systematic reviews?

A
  • Can be best source of evidence on effects and effectiveness of healthcare interventions
  • Assimilation of large amounts of research evidence
  • Provide reliable unbiased estimates of effect
  • Inc precision of estimates of effects
  • Proc inf about the generalisability and consistency of effect
  • Identify what info is missing
  • Useful for making decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is evidence based medicine?

A
  • Mix of indiv clinical expertise, best external evidence and patient values/ expectations
  • Optimise dec making by using best available research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are some reasons for differences between RCT’s?

A
  • Chance
  • Reporting of available evidence
  • Selection from available evidence
    Differences in:
  • Ppl
  • Intervention/ comparator
  • Care other than what being investigated
  • Assessment of treatment effects
  • Follow-up
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is publication bias?

A

The outcome of an experiment or research study influences the decision whether to publish or otherwise distribute it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the different types of publication bias?

A
  • +VE results bias

- Outcome reporting bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is positive results bias?

A

When authors more likely to submit or editors accept, positive than negative or inconclusive results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is outcome reporting bias?

A

When several outcomes within a trial are measured but are reported selectively depending on the strength and direction of those results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the benefits of reviews?

A
  • Vol of lit condensed
  • New info made accessible
  • Relevant info
  • Saves time?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a systematic review?

A

The research method used to synthesis multiple pieces of research evidence on the effectiveness of a treatment

  • Review of all lit
  • On one particular topic
  • Using scientific methods
17
Q

List the hierarchy or evidence (for effectiveness)

A
  1. Systematic reviews
  2. RCT’s
  3. Cohort studies
  4. Case control studies
  5. Case series and reports
  6. Expert opinion ‘anecdotal’ evidence
18
Q

What are the stages in a systematic review?

A
  1. Define question (what/ why/ PICO)
  2. Write protocol - desc of methods
  3. Search for evidence/ studies - comprehensive identification of relevant studies
  4. Select relevant studies from search - unbiased selection of studies for review
  5. Appraise studies - unbiased assessment of methodological quality of each study
  6. Extract, analyse and summarise data - unbia extraction
  7. Interpret review results
  8. Discussion and conclusions
19
Q

Why is writing a protocol an important stage of writing a systematic review?

A
  • Desc of methods
  • Ensures methods and problems are considered a priority
  • Avoids introducing bias
20
Q

How might you search f for evidence/ studies in a systematic review?

A
  • Bibliographic databases
  • MEDLINE, EMBASE
  • Non-eng lang lit
  • Grey lit hard to identify)
21
Q

How would you select relevant studies from the search in a systematic review?

A

Two reviewers independently using pre-defined criteria (based on PICO) to select relevant studies from the search
- reduces errors

22
Q

How would you appraise studies in a systematic review?

A

Two reviewers independetly using checklist (e.g. CASP - critical appraisal skills programme)
- reduces errors

23
Q

How would you extract, analyse and summarise data in a systematic review?

A

Two reviewers independently using predefined approach to identify relevant data

  • Predefined analysis of data
  • Use of validated appropriate methods of numerical data synthesis (meta-analysis)
  • Predefined exploration of possible effect modifiers
24
Q

What is a meta-analysis?

A

A statistical analysis that combines the results of multiple scientific studies that address the same question (each study has some degree of error reported)

25
Q

How is the result from a meta-analysis displayed?

A

Displayed as a forest plot

26
Q

What does the square represent in a forest plot?

A

Middle of square = the result (the relative risk for a study)

27
Q

What does the line represent in a forest plot?

A

Line = the confidence interval

28
Q

What does the diamond represent in a forest plot?

A

Diamond = summarised results (meta-analysis)

Width of diamond = the CI

29
Q

What does the size of the square represent in a forest plot?

A

Square size = weight given to the study in the review

30
Q

How would you interpret review results in a systematic review?

A

Consider the results in the context of the quality of the studies included in the review

31
Q

How would you discuss and conclude results in a systematic review?

A

Consider the implications of the review findings in the context of current practice and knowledge and outline specific future research
- Summary of findings

32
Q

What are the advantages of systematic reviews?

A
  1. Can be best source of evidence on the effects and effectiveness of healthcare interventions
  2. Assimilation of large amounts of research evidence
  3. Reliable unbiased estimates of effect
  4. Inc precision of estimates of effects
  5. Provide info about the generalisability and consistency of effect
  6. Identify what info is missing
  7. Useful for making decisions
33
Q

Where can you find systematic reviews of effectiveness in healthcare?

A
  1. Cochrane library
  2. Epistemonikos
  3. NHS evidence
  4. MEDLINE (and/ or EMBASE)
34
Q

What is the 3 part process of CASP?

A
  • Is the review trustworthy/ valid? (screening questions/ detailed questions)
  • What were the review’s results?
  • How will the result’s help? (relevance)
35
Q

What are some crtical appraisal questions for systematic reviews?

A
  1. Did the review ask a clearly focused question
    - In terms of PICO easily identifiable?
  2. Did the review include the right type of study?
    - Address the review’s questions?
    - Appropriate study design?
  3. Did the reviewers try to identify all relevant studies?
    - Bibliographic databases?
    - Follow up from ref lists?
    - Personal contact with experts?
    - Unpublished studies?
    - Non-Eng lang studies?
  4. How did the R decide which studies to include and did they assess the quality (validity) of the incl studies?
    - Clear predetermined strat to determine which studies to incl in review
    - How assess quality?
    - Defined sel criteria based on PICO
    - Defined validity process (CASP checklist)
    - > one assessor
  5. If the results of the studies comb tgt (meta-ana) was it reasonable to do so?
    - Results of each study clearly displayed?
    - Results similar from study to study?
  6. How results presented and what is main result?
    - How expressed results (relative risk, mean diff)
    - Size of result and how meaningful
    - Sum-up result in one sentence?
  7. Precision of results?
    - CI reported
    - p-value reported where CI are unavailable
  8. Can results be app to local popn?
    - Can provide same I in your setting?
    - Local setting differ from review?
    - popn sample covered diff from your popn so that diff results prod?
  9. Were all important outcomes considered?
    Outcomes from POV of
    - indiv
    - policy makers and professionals
    - Fam/ carers
    - Wider community
  10. Should policy or practice change as a result of evidence contained in this review?
    - Benefit reported outweigh harm/ cost?
    - Info not reported can it be filled in from elsewhere?
36
Q

What is methodological heterogeneity?

A

Different study designs combined

37
Q

What is clinical heterogeneity?

A

Different patient characteristics, settings and interventions

38
Q

What is statistical heterogeneity?

A

Differences in reported effect size between the trials (Chi sqr test, I^2)