Topic 9 - Study Designs Flashcards

1
Q

A study design plans for selecting study _____ and obtaining _____ about them

A

A study design plans for selecting study subjects and obtaining data about them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A descriptive study is a study undertaken without a specific ________.

A

A descriptive study is a study undertaken without a specific hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

An Observational studies (AKA Analytical studies)
* Test a __________: Concerned with an ________ causing a certain ______ (disease)
* _____ is an important characteristic of these studies: One of _____ criteria for causation

A
  • Test a hypothesis: Concerned with an exposure causing a certain outcome (disease)
  • Time is an important characteristics of these studies: One of Hill’s criteria for causation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Experimental studies

  • Test the effect of an _______ (e.g. therapy, challenge)
  • ______ or _____ setting
  • Non-_______ and ________
A
  • Test the effect of an intervention (e.g. therapy, challenge)
  • Laboratory or Field setting
  • Non-randomized and Randomized
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a research synthesis?

A
  • Research Synthesis
  • Non-systematic reviews, Systematic reviews, and Meta-analyses
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Descriptive studies describe?

A

Attributes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Explanatory studies explains?

A

Associations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Repeated associations are a summary of?

A

Summary of what consistently changes disease status ?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

List the study designs in order from least to greatest strength of evidence?

A

Cohort = best amount of info (almost a control trial - due to different arms and groups being monitored over time)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Case reports are used for:
______ (or very _____) cases
- _____ or _____ condition
- _______/____ manifestation or _______ of a common condition
- Could help to build _________

A

Single (or very few) cases
- Rare or new condition
- Unusual/new manifestation or management of a common condition
- Could help to build hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Case series describe the _______ course of a condition shared by a ______ of subjects
- Document the ____/_____/______
- ________ estimation when representative of cases in the population

A

Case series describe the clinical course of a condition shared by a group of subjects
- Document the Who/When/Where
- Prognosis estimation when representative of cases in the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Surveys describe the _______ & ________ of a condition in a population at a point in time
- Focus on _____ feature at the time
- Requires proper _______ protocol and collection of information (___________)
- ________ valid when representative sampling

A

Describe the frequency & distribution of a condition in a population at a point in time
- Focus on one single feature at the time
- Requires proper sampling protocol and collection of information (questionnaire)
- Extrapolation valid when representative sampling

not looking at risk factors, only looking at presence, or lack thereof, of disease

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Case-control
* Investigating ____ factors for _____ diseases
* …you can also think about _______
situations

A

Case-control
* Investigating risk factors for rare
diseases
* …you can also think about outbreak
situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

This case below is an example of what type of study design?

Perfect dataset with medical records
for every dog in a country and details
about exposure in first year of life
* Risk of bladder cancer
* Benzidine + : 32 per 100,000
* Benzidine - : 20 per 100,000
* Risk Ratio = 1.6
* Odds Ratio = 1.55
* (60 x 278,943) / (57 x 188,940)

A

Case-control

Contd.

  • Instead, enroll ALL dogs with bladder
    cancer and a sample of dogs who did
    not
  • Can’t calculate risk of bladder in E+
    or E- because we don’t know the
    size of the population at risk
  • Risk in E+ is definitely not 24%
    of the population (60 / 249)
  • OR = 1.55
  • (60 x 279) / (57x189)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q
A

Once you collect first few cases, go back in time and ask them questions related to past: where did you eat, go, etc. anything you think led to them testing positive.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the advantages of case-control studies?

A
  • Efficient with rare diseases
  • Quick to undertake
  • Cheaper than other studies
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the disadvantages of case-control studies?

  • No information on disease ____ or ______ in the studied population
  • Reliant on _________ of study participants
  • Difficult to ensure _________ selection of control group
A
  • No information on disease risk or incidence in the studied population
  • Reliant on recollection of study participants
  • Difficult to ensure unbiased selection of control group
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are cross sectional studies?

A

Sample of individuals from a population taken at a single or relatively short period of time
* “Snap-shot” in time

Often requires
* Surveys (sampling strategy)
* Questionnaires

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q
A

Seeing what is occurring at a single moment in time.
Look for breed, age, sex, risk factors, exposure to anything you think might be related to disease.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are the advantages of an observational studies?

  • _______ to undertake
  • Can estimate ____ (________)
  • ________ than other studies
    • No ________-___ period
A
  • Quick to undertake
  • Can estimate risk (prevalence)
  • Cheaper than other studies
    • No follow-up period
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are the disadvantages of cross-sectional studies?

  • No information on disease ______ in the studied population
  • Not suitable for diseases of ______ duration
    • Imagine a X-sec study for milk fever!
      • First 24-hrs post-parturition
  • Difficult to investigate _______/_____ relationships
  • Don’t know if E__ occurred before D__

Not good for ____ studies because if you are showing up randomly for a moment in time, you are most likely not going to get anything.

A
  • No information on disease incidence
    in the studied population
  • Not suitable for diseases of short
    duration
    • Imagine a X-sec study for milk fever!
      • First 24-hrs post-parturition
  • Difficult to investigate cause/effect
    relationships
  • Don’t know if E+ occurred before D+

Not good for rare studies because if you are showing up randomly for a moment in time, you are most likely not going to get anything.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What are cohort studies?

  • Comparing disease ______ over _____ among groups (cohorts) with different ______
  • ________ or _________
A
  • Comparing disease incidence over time among groups (cohorts) with different exposures
  • Prospective or Retrospective
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q
A

Observational studies
More powerful studies go forward in time
Less powerful studies go back in time b/c they get history charts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What are the advantages of cohort studies?

  • Absolute incidence of disease in E__and E__
  • Exposure is recorded _______ disease
  • Well-suited for _____ exposures (but must be a fairly _______ disease; if doctor is doing a rare treatment for a common disease)
    • No need to reflect E__ or E___ prevalence from population
A
  • Absolute incidence of disease in E+
    and E-
  • Exposure is recorded BEFORE disease
  • Well-suited for rare exposures (but must be a fairly common disease; if doctor is doing a rare treatment for a common disease)
    • No need to reflect E+ or E- prevalence from population
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What are the disadvantages of cohort studies?

  • ______ follow-up period
  • _________
  • Losses to follow-up are problems
    • Introduce potential _____
  • Rare diseases require ______ groups
A
  • Long follow-up period
  • Expensive
  • Losses to follow-up are problems
    • Introduce potential bias
  • Rare diseases require LARGE groups
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are some examples of hybrid studies?

A

Nested case-control
Case-crossover
Panel
Repeated survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is an ecological study?

Unit of analysis is a _____ (e.g. cities, state, countries, etc.)
* Summary measures of ______ and summary measures of ______ are compared and inference is made at the individual level
*Never take these results seriously?

A

Unit of analysis is a group (e.g. cities, state, countries, etc.)
* Summary measures of exposure and summary measures of outcomes are compared and
inference is made at the individual level
*Never take these results seriously?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are the advantages of ecological studies?

  • Extremely _____ and _______ to perform
  • Provide clues about associations between?
A
  • Extremely quick and inexpensive to perform
  • Provide clues about associations between E+ and D+
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What are the disadvantages of ecological studies?

  • Extremely prone to ______!!!!
  • “Ecological ________”
    • Assumption that an observed relationship in ________ data will hold at the ________ level!
A
  • Extremely prone to bias!!!!
  • “Ecological Fallacy”
    • Assumption that an observed relationship in aggregated data will hold at the individual level!
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q
A

Questions should be of individuals, not of the entire country.
Pointless!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q
A
32
Q

What is the difference in regards to intervention between observational and experimental studies ?

A

Intervention

Observational = no
Experimental = yes

33
Q

Experimental (intervention) studies utilize ________ settings to reduce _______.

A

Experimental (intervention) studies utilize controlled settings to reduce variation.

34
Q

What are the pros of experimental studies?

Pros: Stronger evidence of ________
* ________
* Confounders are fixed by ______ or controlled by ________ allocation

A

Pros: Stronger evidence of causation
* Prospective
* Confounders are fixed by design or controlled by random allocation

35
Q

What are the cons of experimental studies?

Cons: _________ range of hypothesis
* ______ or _____ factors investigated
* Not always ‘___-____’ (_____)

A

Cons: Limited range of hypothesis
* Single or few factors investigated
* Not always ‘do-able’ (ethics)

36
Q

What is a lab experimental study?

_________ allocation
Strict controlled ‘__-_____’ conditions
Pros: _________ level of evidence (for causation)
Cons: _____-to-________ level of relevance to ‘real-world’
Very ________, ____ & ______ intensive

A

Controlled allocation
Strict controlled ‘in-house’ conditions
Pros: Highest level of evidence (for causation)
Cons: Low-to-moderate level of relevance to ‘real-world’
Very expensive, time & labour intensive

37
Q

What is a controlled trial experimental study?

A

Controlled allocation
‘Real-world’ conditions
Pros: Very high level of evidence (for causation)
Highest level of relevance to ‘real world’
Cons: Very expensive, time & labour intensive

38
Q
A

Homogenous: make all subjects the same to control environment as much as possible

Randomization is crucial

39
Q

What are controlled trials?

A
40
Q

Controlled trials
* The study of an _________ (treatment, preventive factor) allocated (________) among animals _________ exposed to disease
* Goal is to test an ________

A

Controlled trials
* The study of an intervention (treatment, preventive factor) allocated (randomly) among animals naturally exposed to disease
* Goal is to test an intervention

41
Q

What are the essential features of controlled trials?

  • Comparison group (__________ treatment)
    • Often a ‘control’ group = ______
  • ____________ allocation
    • Addresses issues with selection ______
  • _________ (AKA masking)
    • Addresses issues with _______ and selection _____
A
  • Comparison group (alternative treatment)
    • Often a ‘control’ group = placebo
  • Random allocation
    • Addresses issues with selection bias
  • Blinding (AKA masking)
    • Addresses issues with information and selection bias
42
Q
A

Population has to have a condition and then see if the condition remains or goes away over time.

Want the doctors and patients to be blind to treatment

43
Q

What are the issues can arise in a controlled trial study?

  • Bias towards ___________…
  • Hawthorn effect:
    • Participants in trial tend to ______ many behaviors, regardless of _________
  • Placebo effect:
    • A _______ effect that cannot be attributed to the _______ of the placebo itself

Both of these effects ________ the condition of patients without them being the real treatment.
Unfortunately makes it more difficult for study to find the _____ effects.

A
  • Bias towards improvement…
  • Hawthorn effect:
    • Participants in trial tend to change many behaviors, regardless of intervention
  • Placebo effect:
    • A beneficial effect that cannot be attributed to the properties of the placebo itself

Both of these effects improve the condition of patients without them being the real treatment.
Unfortunately makes it more difficult for study to find a real effectl.

44
Q
A

The higher on the y axis, the better you get.
Just b/c in study they get better –> hawthorne effect
thinking when they take something they will feel better –> placebo

45
Q

Looking for lameness scores in dogs with secondary arthritis. Asking owners if lameness was getting better over time vs. pressure plate in animal and if it was making condition better or worse? owners saying animal getting better even though they were not

A
46
Q

What are controlled trials?
* Measuring ________ effect
* Intention-to-treat
* All ________ patients and _______ allocated to treatment are included in the analysis
“once randomized, always analyzed”
* Per-protocol
* Includes only those patients who completed the treatment _________ allocated (as per the ______)

A

Controlled trials
* Measuring treatment effect
* Intention-to-treat
* All enrolled patients and randomly allocated to treatment are included in the analysis
“once randomized, always analyzed”
* Per-protocol
* Includes only those patients who completed the treatment originally allocated (as per the protocol)

47
Q
A
48
Q

What are other terms used to refer to controlled trials?

A
49
Q
A

Intervention
control group as comparison group is important
looking for improvement of disease condition

50
Q
A

B/c treatment, you expect patients in treatment group to have a lower risk of disease compared to the placebo group.

51
Q

How do you calculate a risk ratio?

A
52
Q

Risk ratio in a controlled trial is called?

A

Risk difference (attributable risk)
* AKA: Attributable Risk Reduction (ARR)

53
Q

What is the Number needed to treat (NNT)?

A

Tells you on average how many people need this treatment in order to cure one person.

Number needed to treat (NNT)
* Average number of patients who need to be treated
to prevent one additional bad outcome
* “Number of patients that need to be treated for one to
benefit compared with a control in a controlled trial”
* It is the inverse of the RD

54
Q
A
55
Q
A
56
Q

What can happen in controlled trials?

A
  • Loss to follow-up (a type of selection bias)
  • Losses should be minimal (<20%)
  • Were they equal in both groups?
  • If losses were related to the exposure and also to the outcome = BIAS (untestable)

Make sure you don’t lose anyone along the way.
Worry when we have reached 20% loss in a group. Need to make sure you are losing the same number in each group, if not matching then you need to worry about bias

EXAMPLE
If patients who didn’t respond to treatment died (or dropped out) before the end of the study, the treatment effect could look much better than it actually is!

b/c it would only effect people who did not respond

57
Q

Randomize: allocating patients uniformly across treatment groups

Blind: removes potential selection bias

If you do both, everything should be fine

Relisten to randomize

A
58
Q

What is a narrative review?

A

Very qualitative in nature.
* Subjective (reviewer bias)
* No details on how studies were selected for inclusion
* Tend to weight studies equally (or subjectively)
* No quantitative summary
* Conducted by subject-matter experts
* Pre-conceived notions?
* Suitable for obtaining a broad overview of an area
* Not for decision-making!

59
Q

What is a systematic review?

  • Systematic review (best option for __________ data)
    –> Features
  • _______ question
  • Written protocol for review (________ and ________)
    • Explicit (replicable) methods; meaning search terms are well defined.
  • Thorough literature _______
  • _________ data extraction tool
  • Does not require subject matter ______
    –> Purpose
  • Ensure ____ evidence considered
  • Minimize potential for _____ in drawing conclusions
  • Identify _____ in knowledge – precursor of research
  • ______ decision
A
  • Systematic review (best option for reviewing data)
    –> Features
  • Specific question
  • Written protocol for review (transparent and repeatable)
    • Explicit (replicable) methods; meaning search terms are well defined.
  • Thorough literature review
  • Standard data extraction tool
  • Does not require subject matter expertise
    –> Purpose
  • Ensure all evidence considered
  • Minimize potential for bias in drawing conclusions
  • Identify gaps in knowledge – precursor of research
  • Policy decision
60
Q

Controlled trials get more points

A
61
Q

If you are able to extract data from each study (odds ratio, animal from each study) –> pool together –> metaanalysis (qualitative review on steroids)

A
62
Q
  • Qualitative
  • Weighting of studies based on assessment of quality of methods
A
63
Q
  • Quantitative
  • “Meta-analysis”… see next section
  • Weighting of studies based on precision of results
    • Options to include study quality
  • Quantitative outcome (multiple)
A
64
Q

What are the steps of a systematic review?

A

Qualitative review is still considered a systematic review because you went through all of the steps

65
Q
A
66
Q
A
67
Q
A
68
Q

Meta-analysis is the statistical methodology used to combine data from ___ or ____ studies that have addressed the ___ question
“The statistical analysis of a _____ collection of analysis results from _____ studies for the purpose of ______ the findings” – Glass, 1976

A
  • Meta-analysis is the statistical methodology used to combine data from two or more studies that have addressed the same question
    “The statistical analysis of a large collection of analysis results from individual studies for the purpose of integrating the findings” – Glass, 1976
69
Q

What are the objectives of a meta-analysis?

  • Provide an overall ________ of an association
  • Explore sources of _______ in the observed effect across studies
A
  • Provide an overall estimate of an association
  • Explore sources of variation in the observed effect across studies
70
Q

What are the advantages of a meta-analysis?

  • Ensures that all data _______ and appropriate _____
  • Gain in _______ power
    • Allows for ______, non-________ results to contribute
  • Document _______ in study results
  • Investigate ______ for variability
  • _______ impacts of potential _____
A
  • Ensures that all data considered and appropriate weight
  • Gain in statistical power
    • Allows for small, non-significant results to contribute
  • Document variability in study results
  • Investigate reasons for variability
  • Quantify impacts of potential bias
71
Q

Types of Meta-analysis:
1. _________ estimates
2. ________ patient data

–> What can you measure?
- ________ outcomes!!!
- ____, ____, ____
- _____ Difference and _______ Mean Difference
- _______ trials are best!

A

Types of Meta-analysis:
1. Summary estimates
2. Individual patient data

–> What can you measure?
- Quantitative outcomes!!!
- OR, RR, RD
- Mean Difference and Standardized Mean Difference
- Controlled trials are best!

72
Q

How does meta-analysis pool weight across studies?

  • _________ average treatment effects
  • Study weighted by their _______
    • More _____ = more _____!
  • Example: Effect of bovine somatotropin (rBST) on risk ratio
    for clinical mastitis
  • 1.27 (95%CI: 1.13-1.43)
A
  • Weighted average treatment effects
  • Study weighted by their precision
    • More precise = more weight!
  • Example: Effect of bovine somatotropin (rBST) on risk ratio
    for clinical mastitis
  • 1.27 (95%CI: 1.13-1.43)
73
Q

What is an extra-advantages of a meta-analysis

Use a ________ plot to see when you gained sufficient evidence over time to make decision!

A

Use a cumulative plot to see when you gained sufficient evidence over time to make decision!

74
Q
A

as you have smaller sample sizes, your standard error gets wider;.
RR < 1 –> no effect (small sample sizes). Studies without effects do not tend to get published, whihc keads to publication bias.

75
Q

Meta-analysis
* Applicable for many study designs
* Traditionally used with RCTs
* More standardized with clearly defined intervention/comparison groups
* Observational studies
* Possible, but more difficult
* Issues with heterogeneity
* More prone to biases
* Diagnostic test evaluation
* Estimate DSe and DSp

A
76
Q

Meta-analysis are applicable to many study designs.

A