Critical Appraisal Jan Flashcards

1
Q

What is the framework for an answerable question?

A

PICO
P= patient/population
I= intervention
C= control
O= outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What to search for with therapy questions?

A

What is the best treatment taking into account benefits and harm

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What to search for with diagnostic questions?

A

What is the best test? How can we tell if it’s wrong?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Best study design for diagnostic question?

A

Cross sectional study which analyses data at a single point in time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What to search for with prognostic questions?

A

What is going to happen if…

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Best study design for prognosis?

A

Cohort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What to search for with aetiology questions?

A

What has caused this to happen?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Best study design for aetiology?

A

Case control
Cohort study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What to search for with evaluation/acceptance questions?

A

What do patients think about it?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Best study design for evaluation?

A

Survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the benefits of a systematic review?

A

Larger sample size
Includes all evidence related to question, including unpublished.
Indicates need for further research and can do sub group analyses.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is bias?

A

Systematic introduction of error into study that affects study in non-random way.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How should a study be assessed?

A

Bias
Applicability
Limits
Overall value of research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Why is critical appraisal important?

A

Evidence for effective patient care.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the principal steps of critical appraisal?

A

What are the results?
Are the results valid?
Are they applicable to patient care?

-> Study MUST use a clearly focused question and right type of study for question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is hand searching in research?

A

Searching for medical journals not indexed in Medline or Embase

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Why is a systematic review not beneficial for some studies?

A

Provides an average for a larger population, not useful for patient subgroups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the important areas that a critically relevant study has?

A

Clearly focused question
Uses right study design
Attempts to identify all relevant study with a search strategy
Assessment of study quality
Main result and how its presented (eg odds ratio)
Precision of results (using p value)
Applicability
Considers all outcomes
Should the polcity be changed?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Why is a search strategy important for critical appraisal?

A

You may find important studies that are untranslated to English. Attempts to contact author are important. It is also ideal for excluding irrelevant studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How to organise a search on a database?

A

Identify key concepts in the hypothesis to use as a search term, and finding their related synonyms to find as many relevant articles as possible.
E.g Does physical activity in the elderly delay dementia?
Key concepts will be:
Physical activity so synonyms include running, walking and exercis*
Elderly so synonyms include geriatric, old,
Dementia so synonyms include Alzhiemer’s

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How to search for phrases on a database?

A

Quotations should be put around the search term.

22
Q

What is the first important step when doing a search?

A

Unticking ‘Map Term to Subject Heading.’

23
Q

When is ‘OR’ used in searching?

A

Used for linking a group of related terms when searching on database, e.g exercis* OR walking OR running.

24
Q

When is ‘AND’ used in searching?

A

Combining the separate search concepts to find relevant articles mentioning all.

25
Q

What is a background question?

A

Questions to gain knowledge about the pathology of the condition.

26
Q

What is a foreground question?

A

Questions to gain knowledge of how to manage a patient’s condition, for diagnosis, prognosis and which treatment is most effective and the outcomes. This can be searched by framing a foreground question using the PICO framework.

27
Q

How is a systematic review critically appraised for its subject?

A

Whether:
All relevant studies have been identified
The search strategy is documented
Inclusion of the right studies which address the focused question

28
Q

How is a systematic review critically appraised for outcomes?

A

Based on:
Reviewers being blind to the authors
Quality of the accessed studies
Homogeneity of the included studies
Presentation of main outcomes
Weaknesses and strengths of the included studies

29
Q

How is an RCT critically appraised for the subject?

A

Whether:
—> Random allocation occured in the cohort
—> Assessment of the validity of each included trial
—> The similarity between the groups (should be as similar as possible) which should be in the baseline characteristics section for variables that affect the outcome
—>The inclusion/exclusion criteria for the study
—> The baseline data for assessing intervention effectiveness can be compared

30
Q

How is an RCT critically appraised for the study duration?

A

Whether:
Participants, clinicians and reviewers were blinded to allocation
If Follow up was long enough to measure effects
Proportion lost to follow up
Was the study complete?

31
Q

How is an RCT critically appraised for outcomes?

A

Based on:
Intention-to-treat analysis
An objective independent assessment was carried out

32
Q

How is a cohort study critically appraised?

A

Whether:
Cohort is representative of population
Both groups are comparable
Confounding factors are managed via techniques such as stratification

33
Q

How is a cohort study critically appraised in the study duration?

A

Whether:
Participants/assessors were blinded
If the duration of the study was long enough to measure disease
Proportion lost to follow up

34
Q

How is a cohort study critically appraised for its outcomes?

A

Based on:
Detection of confounding factors
Outcome is accurately measured using odds ratio or another objective measurement
Objective independent assessment of the study

35
Q

How is a case control study critically appraised for its subject?

A

Whether:
There is random selection of the control
Groups are comparable
Addresses a focused queston
Confounding factors are managed via techniques such as stratification

36
Q

How is a case control study critically appraised for its study duration?

A

Whether:
Blinding occurs of participants and assessors
Duration is long enough to assess exposures

37
Q

How is a case control critically appraised for outcomes?

A

Based on:
Cases and controls being assessed using the same method
All selected participants are included in the analysis
There is an independent objective assessment
Measurement of effect estimate using relative risk ratio

38
Q

What can bias the results of an RCT?

A

Attrition bias between the two groups, where either the control or exposure group has unequal loss of participants.

39
Q

What is the ideal loss to follow up number?

A

Maximum of 20%.

40
Q

When can blinding not be performed for an RCT?

A

For safety reasons, such as the use of warfarin.

41
Q

What is a dichotomous outcome?

A

Answers fall into a category of ‘yes’ or ‘no’

42
Q

What is a continuous outcome?

A

Answers with a range of values.

43
Q

What is an important feature that should be included in a critical appraisal of observational studies?

A

Observational studies include cohort and case-control studies, which must have confounding factors identified and using techniques to mitigate their effect, due to their influence on the outcome in the groups.

The measurement of exposures should also be identified.

44
Q

How can confounding factors be reduced?

A

Balancing the confounding factors across groups with:
Restriction
Stratification
Matching
Multiple regression techniques

45
Q

What type of bias is caused by loss to follow-up?

A

Follow-up within a study is keeping track of all participants in order to prevent attrition bias and measurement error. This is the difference between the measured value and the true value, which increases the risk of a Type 2 statistical error.

—> Short follow up has a risk of association not being measured. A long follow up does not affect the detection of associations but it is costly and unethical collection of scientific info with no value.

46
Q

What is a type 1 statistical error?

A

Rejection of the null hypothesis when the null hypothesis is true.

47
Q

What is a Type 2 statistical error?

A

Accepting the null hypothesis when the null hypothesis is wrong.

48
Q

How can we determine the strength between outcome and association?

A

Using measures of effect like relative risk or odds ratio, where a value less than 1.5 is weak.

49
Q

Which value indicates the precision of the effect estimate?

A

Confidence intervals, a range of values where it is likely that the mean lies within.

50
Q

What is intention-to-treat analysis?

A

All participants are evaluated based on the original group they were randomised into, which maintains the balancing for factors across groups and allows the results to be more generalisable because patients do not always comply with treatment plans.

51
Q

What is per-protocol analysis?

A

Only participants who followed the protocol exactly are evaluated for effect outcome. The issue with this is a risk of overestimating effects and should not be the only analysis form used.

52
Q

What is as-treated analysis?

A

Regardless of original group allocation, participants are evaluated based on the actual treatment/group they align most with, which is useful for measuring intervention side effects