lecture 22 Flashcards

1
Q

what is internal validity

A

whether the study design, conduct, and analysis answer the research questions without bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is external validity

A

whether the findings can be applicable to broader populations, also known as generalisability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what does increasing the size of a sample when random sampling do

A
  • reduces sample variability
  • increases likelihood of getting a representative sample
  • increases precision of parameter estimate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what is estimating population parameters

A

when you use the findings from your study population to estimate what would occur in the source population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what are the 2 methods of measuring the influence of sampling error

A

confidence intervals
p values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

how does a 95% confidence interval work

A

if your repeated a study 100 times with a random sample each time, 100 estimates and 100 confidence intervals

then….

  • 95 of them = the parameter would lie within that studies 95% confidence interval
  • 5 of them = the parameter would not lie within the studies 95% confidence interval
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is an interpretation of what a confidence interval is

A

we are 95% confident that the true population value lies between the limits of the confidence interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what does a smaller confidence interval mean

A

more precise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what does increasing the sample size of a study do to the confidence interval

A

increasing the sample size can make the confidence interval narrower

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what can a confidence interval help us decide about a study

A

whether it is clinically important

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is the estimate or point estimate

A

the measure found in the study sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what is the parameter

A

the true value of the measure in the population that the study is trying to discover

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what do confidence intervals give us a sense of

A

how precisely we are estimating the population parameter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what are p vales

A

probability of getting study estimate (or one further from the null) when there is really no association, just because of sampling error (chance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what logic do p values use

A

logic of hypothesis testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

in the 2 by 2 table of association vs no association what do p-values tell us about

A

when we find association in the study results and there is no association in the parameter

17
Q

what is the null hypothesis

A

when there really is no association in the population

18
Q

when the parameter equals null values the ratio and difference measures equal ….

A

odds ratio and relative risk = 1

risk difference = 0

19
Q

what is the alternative hypothesis

A

when there really is an association in the population

20
Q

when the parameter does not equal the null value the ratio and difference measures will equal ….

A

odds ratio and relative risk = will not equal 1

risk difference = will not equal 0

21
Q

what is the symbol for null hypothesis

22
Q

what is the symbol for alternative hypothesis

23
Q

example of interpreting a p value when the …

odds ratio = 2.3
p = 0.03

A

the probability of finding an OR of 2.3 (or further from the null) when the null hypothesis is true is 0.03 (or 3%)

24
Q

what is the threshold for p values

25
what is said if the p value is less than 0.05
- reject Ho - accept HA association is 'statistically significant'
26
what is said if the p value is greater than 0.05
- fail to reject Ho - reject HA association is 'not statistically significant'
27
interpretation of p value when it is less than 0.05
since the p value is less than 0.05 the association is statistically significant. chance is an unlikely explanation of the study finding
28
interpretation of a p value when it is greater than 0.05
since the p value is greater than 0.05 the association if not statistically significant. the study finding is consistent with chance as an explanation
29
what are type II errors
when incorrectly fail to reject Ho when should have (p should have been < 0.05 but got > 0.05)
30
what are type II errors usually from
typically due to having too few people in the study
31
what does sample size mean for the p value
bigger sample size = more likely to get small p value smaller sample size = less likely to get small p value
32
what is said if the 95% confidence interval includes the null value
p > 0.05 not statistically significant
33
what is said if the 95% confidence interval doesn't include the null value
p < 0.05 statistically significant
34
how should you report p values
useful to report p values not just statistically or not statistically significant
35
why are p values problematic
- arbitrary threshold - only about Ho = just gives evidence about consistency with the null hypothesis - nothing about importance
36
what should be considered when evaluating internal validity
- chance = confidence intervals - bias = strengths and limitations - confounding = comparing analysis phase (like multivariable analysis etc)