Test 3 Flashcards
(39 cards)
Null Hypothesis (Ho)
no true effect on pop; the apparent effect could be a matter of sampling error
Alternative Hypothesis (H1)
true effect in population (often called research hypothesis)
What do we estimate with hypothesis testing?
We estimate the probability that the null hypothesis is true
- If prob is very low (.05 or less) then reject Ho and decide that the apparent effect is probably a true effect
- If prob is greater than .05, then fail to reject Ho and conclude that any apparent effect may be a matter of sampling error
Z formula for hypothesis testing
z = m - μ / σm
remember that σm = σ / square root of N
Nondirectional (two-tailed) test
The alternative hypothesis is that the treatment has an effect, without specifying the direction:
H1: μT ≠ μu
ALWAYS use this in class
Directional (one-tailed)
If there is an empirical and or theoretical basis for believing that the effect can only occur in one direction, then a directional test may be used:
H1: μT > μu
or H1: μT < μu
Significance level α
α = probability of rejecting the null hypothesis when it is in fact true
Set at .05 or .01
Try to minimize claims that a treatment has an effect when it does not
Type I Error
When you reject null but the null is true
p = α
Type II Error
When you fail to reject null but the null is false
p = β
Correct decision p = 1 - β
when you reject null when null is false
- power
Correct decision p = 1 - α
when you fail to reject null when null is true
Power
probability of rejecting the null hypothesis when it is in fact false (p= 1 - β)
How do you increase power?
by:
- Increasing sample size
- Increasing alpha, but cannot go higher than .05
- Using a one-tailed test (if the effect is in the predicted direction)
Underlying assumptions (hypothesis testing)
- At least an interval level of measurement
- Random sample
- The sampling dist. of the mean is normally distributed, which is likely when:
- —-The sample is selected from a population that is normally distributed
- —-N is very large (central limit theorem)
Robustness
probability of a type I error (rejecting Ho when it is true) is close to α even when the assumptions underlying the use of an inferential statistic are violated
Cohen’s d for hypothesis testing
effect size d = m - μ / σ small: d < .2 med: d is .2 - .8 large: d > .8
t statistic
t = m - μ / sm
What is the difference between t and z distributions?
t distributions change with the sample size (or technically the df, which is n-1)
- as sample size (df) decreases, t becomes flatter and more heavy (higher probabilities) in the tails
When a re T-tests are most commonly used to make statistical inferences about the effect of an IV on a DV?
when: The IV has only 2 levels Often experimental conditions - Treatment and control The DV is measured on an interval scale
Types of Two-Independent Samples
Between-subjects (independent groups)
Within-subjects (related samples, repeated measures)
Between-subjects (independent groups)
Comparisons are made between separate (independent) groups (samples) of participants
Each group is assigned to a different level of the IV
To get comparable groups, use RA
Within-subjects (related samples, repeated measures)
Participants are either not separated into independent groups (repeated measures) or are related to one another
Most often, each individual participates at all levels of the IV- thus, the same individuals are compared over different levels of the IV
Two kinds of Two-sample t-tests
Independent Samples
Related samples
Independent Samples
Use with independent-groups designs
Compare separate groups of individuals