Stats Exam 3 Flashcards
(88 cards)
1
Q
Central Limit Theorem
A
- Random samples from a normally distributed population are normally distributed
- As n increases (> 30), random samples from skewed distributions become normally distributed
- The means of all sample means is the population mean. (also true for proportions)
- The standard deviation of normally distributed sample means and proportions are: ….
2
Q
What can Z scores tell you about sample means
A
Z scores can also tell us how far a sample mean is from the population mean, and therefore how likely or unlikely a given sample mean is
3
Q
What happens to Z as n increases
A
Z approaches zero
4
Q
Central Limit Theorem also applies to…
A
CLT also applies to proportions which are used for categorical data
5
Q
3 forms of inference
A
- Point estimation
- Confidence intervals
- Hypothesis Testing
6
Q
Point Estimation
A
using a single values form a sample to estimate a population parameter
7
Q
Confidence Intervals
A
(Interval Estimation)
- Using a range of values to estimate a parameter
- Stating our confidence that an interval captures a parameter
* smaller interval/rang, less confidence
8
Q
Hypothesis Testing
A
using samples and probability to support or reject assumptions about population parameters
9
Q
sampling error
A
random sampling produces samples that aren’t exactly like the population
10
Q
interval estimation
A
incorporates the likely size of the sampling error associated with the point estimate
11
Q
weakness of point estimation
A
without quantifying the likely among of estimation error, point estimates are of limited use (sampling error)
12
Q
Confidence Interval (CI)
A
a range of plausible values for a parameter in addition to the level of confidence that the parameter is included within the interval
13
Q
2 components of CI
A
- Interval
- Confidence
a range of values that is likely to include to u
principle of “confidence” is the same in both scenarios
14
Q
margin of error for means
A
-an absolute quantity Size of an interval (precision) partly chosen --> z score partly natural --> sd partly experimentally determined --> n
15
Q
confidence intervals downside
A
- created when we do NOT know the population mean
- Establish a range of values that “probably” includes the population mean
- how probable depends entirely on the choice of a z score
16
Q
steps to find z score?
A
- Find Z score for a … CI
- Calculate Standard Error
- Calculate Margin of Error
- Apply Margin of Error to Point Estimate
17
Q
hypotheses
A
claims or statement about population parameters (never about samples)
18
Q
null hypothesis
A
the no effect, no difference, nothing special difference
generally does not reflect the researchers belief
19
Q
alternative hypotheses
A
Ha
3 possible forms:
1. a parameter is greater than some value Ha:u>#
2. a parameter is less than some values: Ha:u
20
Q
one tailed Ha
A
can be supported by sample statistics from only one tail of a distribution (less/greater)
21
Q
two tailed Ha
A
can be supported by sample statistics from both tails (different)
22
Q
critical regions
A
tail regions of sampling distributions that contain unlikely values, that when observed lead us to reject Ho
23
Q
critical values
A
specific standardized scores (like Z scores) that separate critical regions form the rest of the curve
24
Q
alpha
A
=significance level
- a= the area under a normal curve with unlikely (extreme) observations, such that when observed, we reject the null hypothesis and support the Ha
- a= the acceptable rate of a type 1 error, mistakenly rejecting the null
- a & Ha determine the critical values
25
One tailed Ha & alpha
C.V puts alpha in one tail
26
Two tailed Ha & alpha
2 C.V.s that split alpha into 2 tails
27
Hypothesis Testing Steps
1. Write the Ha and Ho and statistical terms
2. choose alpha and determine critical values
3. calculate a test statistic. For tests with one sample, 3 choices
4. Compare test statistic to a CV of calculate a p value
5. State conclusions in context
28
p value
probability that the difference between the sample mean and the population mean occurred by chance alone
29
T scores for sample means
- almost identical to Z scores (same assumptions)
- used when we don't know the population standard deviation
- substitute the sample standard deviation into the standard error expression
30
degrees of freedom
df=n-1
31
choose between t score and z score?
do z score it will be more accurate
32
Type 1 error
rejecting the null, when the null is actually true
- occurs when we get an extreme test statistic by chance alone
- p(type 1 error) = alpha
- alpha is chosen in advance
33
Type 2 error
failing to reject the null, when the null is false
- must be calculated
- p(type 2 error)= beta
34
Power
the ability to reject a false null hypothesis
35
Power calculations
are used to determine the sample size needed to reveal the smallest difference that is actually interesting between two hypothesized values of a parameter
36
ANOVA
Analysis of Variance
| -used to compare >2 sample means
37
ANOVA hypotheses
Ho: the means all come from the same population
Ha: the means do not all come from the same population
38
why not multiple t-test?
the total risk of a type 1 error for a group of related tests is more important than the type 1 error risk for any one test
--multiple tests increase the total risk of a type 1 error
39
familywise error rate
the probabililty of observing at least one type 1 error for a group of related tests
40
ANOVA Ho
differences in sample means are explained by random sampling variation within groups
41
ANOVA Ha
differences in sample means are due in part to real variation between groups, because at least one group comes from a different population
42
F test
variation between groups/ variation within groups
43
F test statistic
- a ratio of any two variances
- F=1 means the variances are no different
- F is not =1 means the variances are different
44
If ANOVA Ho is true we usually see...
F= 1 or F>1
45
If ANOVA Ho is false we usually see..
F>1 or F >>>>1
46
How much bigger must F be for an ANOVA?
1. ANOVA is always a right tailed test
| 2. Like for t statistic, different F distributions and critical values exist for different degrees of freedom
47
F distribution degrees of freedom
numerator: k-1
denominator: N-k
48
Assumptions for ANOVA to be valid
1. Normal distributions
| 2. Sample standard deviations are roughly equal: Largest sd/ smallest sd
49
SS(total) total sum of squares
is a measure of the total variation (around the grand mean) in all the sample data combined
50
SS(model)
=SS(groups) the variation between sample means, weighted by sample size
51
SS(within groups)
=SS(error) =SS(residuals)
| variability common to all the populations being considered
52
SS(total) =
SS(model) + SS(residuals)
53
MS (something) =
Average variation. gives us a measure of relative variation allowing us to compare variation in different parts of a model
54
Post hoc tests (multiple comparisons)
are mostly modified t tests that reduce type 2 error rate
55
sampling variability
sample results change from sample to sample
56
parameter
a number that describes the population
57
statistic
a number that is computed from a sample
58
statistical inference
inferring something about the population based on what is measured in the sample
59
unbiased estimator
-x- can be an unbiased estimator for u and p^ can be an unbiased estimator for p if the distribution of sample means is exactly centered at the value of population mean
60
census
sample the whole population
61
margin of error (m)
represents the maximum estimation error for a given level of confidence
62
statistical hypothesis testing
assessing evidence provided by the data in favor or against some claim about the population
63
p value
reject Ho and accept Ha
| results are statistically significant
64
p value >0.05
can't reject H0 and reject Ha
| results are not statistically significant
65
test statistic
a measure of how far the sample proportion is from the null value po, the values that the null hypothesis claims is the value of p
66
two independent samples
comparing two means
67
matched pairs
paired t test
| samples are dependent
68
1 way ANOVA
comparing more than two means that are independent of each other
69
repeated measures ANOVA
comparing more than two means that are dependent on each other
70
three types of t-tests
1-sample
2-independent samples
2-dependent samples
71
independent samples
the individuals of one sample are not meaningfully connected to those of another sample
-two randomly selected groups
72
matched pairs (dependent) samples
the observations of one sample are somehow paired or related to those of another sample
-pre/post -twins -parents &children
73
homoscendasticity
assumes equal variance in our 2 samples
74
2 scenarios for dependent sample
1. repeated measures
| 2. matched pairs
75
parameter
A characteristic of a population
76
statistic
A characteristic of a sample
77
sampling variability
Multiple samples taken from the same population will vary from each other due to chance events.
78
sampling distribution
The shape, center and spread of the values taken by all of the samples of a certain size taken from a single population
79
Proportion
A probability that a member from a population takes on a certain characteristic. Proportions are based on countable, categorical data = the number of individuals that display a characteristic / the total number of individuals.
80
Standard Deviation of Sample Proportions (AKA standard error)
When sample proportions are normally distributed they will vary from the population proportion with a standard error
81
Statistical Inference
The Process of Inferring something about a population based on something known about a sample
82
Confidence
In the context of interval estimation, “confidence” is the probability that our interval actually captures the population parameter. Confidence is, unfortunately, inversely related to the size (precision) of our interval.
83
Margin of Error
The maximum amount of error we give to a point estimate, and which is used to build a confidence interval. The margin of error size is influenced by two things: 1) our confidence, which in turn determines a z score, and 2) the sampling variation, which is determined by a standard error
84
Estimating the sample size needed to create a specific CI
This is something researchers do in the planning stages of research and can be used as justification for a certain amount of money in a research proposal. Simply solve the margin of error equation for n. The researcher must also decide on a confidence (see above), choose an acceptable margin of error, and plug in a best guess standard error value taken from previous research, or in the case of proportions, .25 can be used as a conservative estimate of the p*(1-p). Note: Whenever n is not a whole number, round up
85
statistical hypothesis testing
Assessing evidence provided by the data in favor of, or against some claim about the population.
86
4 steps to hypothesis testing
1) Stating the claims
a. Claim 1 (the null hypothesis, Ho): The mean or proportion is equal to some value.
b. Claim 2 (alternate hypothesis, Ha): The mean or proportion is is less than, or is greater than, or is not equal to some value.
2) Choosing a sample and collecting data
3) Assessing the evidence. Calculating the probability of observing a sample statistics at least as extreme as the one observed, if the null hypothesis (claim 1) is true and the alternate hypothesis is false.
4) Making conclusions. Choosing whether to reject, or fail to reject the null hypothesis (claim 1), or to support, or fail to support the alternate claim (claim 2)
87
assumptions of the independent sample t-test
1. The 2 samples are independent
2. The distribution of the response Y in both populations is normal
3. Both samples are random
4. The two populations being compared should have similar variances. If the sample sizes of the 2 groups are equal, the t-test is robust to the presence of unequal variances.
88
Assumptions of the matched pairs t-test
1. The sample data consist of matched pairs
2. Both samples are simple random samples
3. The number of matched pairs is > 30 and/or the pairs of the values have differences that are normally distributed.
