t- test

Question 1

What does a one sample hypothesis consist of?

Answer 1

These relate the mean of a sample to a prespecified comparison value.

E.g. Attendance in class is more than 80%
E.g. Medical doctor’s stress levels are higher than the average stress in the UK

(Null hypothesis states there’s no difference between the two)

Question 2

What does a hypothesis do?

Answer 2

A hypothesis looks to compare the null hypothesis of no effect with the alternative hypothesis.

These don’t start on equal footing; we assume the null is true until proven otherwise.

Question 3

Why do we need a null hypothesis?

Answer 3

• We start with the null and put the burden of proof on the alternative hypothesis.
• We know everything about our statistics when there is no effect

There are many ways for an effect to have occurred (alternative hypothesis) but there is only one way an effect cant occur (null hypothesis)

Question 4

What is a test statistic designed to do?

Answer 4

show the extent to which a data sample is different to the null hypothesis

Question 5

What’s the calculation for a one sample t- test?

Answer 5

T- value = (Mean observed data) minus (the comparison value) divided by (standard error of the mean observed data)

Question 6

What’s the comparison value in a t- test?

Answer 6

the difference between our observations and our hypothesis

Question 7

What is the standard error of the mean in a t- test?

Answer 7

tests how close a sample mean is to the population mean

Question 8

What does a one sample t- test do?

Answer 8

tests whether the mean of a sample is different to a comparison value

Question 9

How were tests done before the t- test was introduced?

Answer 9

the answer was to restrict analyses to very large samples where we can be confident in the standard deviation

But this is very impractical

Question 10

What is the students t- test?

Answer 10

• When we have loads of data what we expect to see when the null is true is a normal distribution
• What the t- test allows us to do is with sample sizes we can adjust that expectation allowing us to account for the extra noise by expecting to see large t- values
• So when the sample size is small we need a bigger t value to see significance

Question 11

What is a two sample hypothesis?

Answer 11

Independent samples hypotheses = e.g. Football players run 200m faster than rugby players (null would say they are the same/ no difference)

Dependant samples hypotheses = e.g. students attention spans are longer on days with fewer teaching sessions (null would say they are the same/ no difference)

Question 12

What are independent and dependant samples also known as?

Answer 12

Within subjects design (dependent samples) (paired samples) (repeated measures)
Participants contribute to both conditions

Between subjects design (independent samples)
Each participant is contributing to a single condition

Question 13

When should you use at-test?

Answer 13

• Comparisons of two group means or a single mean to a reference value
• Data must be interval or ratio type (as a t test needs both an interpretable mean and standard deviation)
• Assumptions must be met

Question 14

What are the assumptions of a t- test?

Answer 14

• Appropriate data type
• Assumption of normality
• Data observations are independent
• Groups have equal variance

Question 15

What is the calculation for independent samples t-test?

Answer 15

The difference between the two means of both groups, all divided by the pooled (put together) standard error of that difference

Question 16

What does a big number at the top of a independent samples t test fraction cause?

Answer 16

The difference is large compared to our confidence in the estimate

Question 17

What does a big number at the bottom of a independent samples t test fraction cause?

Answer 17

The difference is small compared to our confidence of the estimate

Question 18

What does a large positive t- value mean in an independent samples?

Answer 18

the mean of group 1 is above the mean of group 2 (around 15 is large)

Question 19

What does a near to 0 t value mean in independent samples?

Answer 19

the mean of group 1 is indistinguishable from the mean of group 2

Question 20

What does a large negative t-value mean in an independent samples?

Answer 20

the mean of group 1 is below the mean of group 2

Question 21

What is homogeneity of variance and what is the test for it?

Answer 21

• The levene’s test = tests for homogeneity of variance
• A significant levene’s test indicates that the groups are likely to have different variances

And therefore pooled estimate of standard deviation is not appropriate

Question 22

What is the Welches t- test?

Answer 22

Uses an unpooled measure of standard deviation
Valid for when groups have different variance

Question 22

What is the calculation for welches t- test?

Answer 22

The difference between the two means of both groups, all divided by the unpooled standard error of that difference

Question 23

What is the paired/ dependant samples t-test?

Answer 23

• Compares the means of two dependant distributions
• computes a one sample t-test between the paired difference and zero

Question 24

What is the calculation for a paired/ dependant samples t-test?

Answer 24

(Mean of paired differences) minus (zero) divided by (the standard error of the mean paired difference)

Question 25

What is a t distribution?

Answer 25

the sampling distribution of t values if the null hypothesis (no effect) was true and we were able to run an infinity of t tests (as many experiments as we like) - The higher the line of our t distribution the more probable it was to observe that particular t value in this experiment. - Data has to be normally distributed

Question 26

What does a t distributions shape depend on?

Answer 26

The distribution of t values wed expect to see isn't just one distribution its a family of distribution, that distribution changes shape subtly depending on the degrees of freedom in our test (number of observations/ sample) - At small sample sizes = we are more likely to see extreme values

Question 27

What is the degrees of freedom calculation for a one sample t- test?

Answer 27

DF = N -1

Question 28

What is the degrees of freedom calculation for an independent samples t- test?

Answer 28

DF = N1 + N2 - 2

Question 29

What is the degrees of freedom calculation for a paired sample t- test?

Answer 29

DF = N - 1

Question 30

What is the 6 step process to reporting a p value

Answer 30

- Type T (to show its a t test) - In brackets specify the degrees of freedom - Equals and show t value - Report p value after test statistics - Report exact p values to two or three decimals (p = .006) - Report p values less than .001 as p < .001 - Report effect size after p values

Question 31

What is an effect size?

Answer 31

Purely the size of the difference between the two groups

Question 32

What statistic measures the effect size? and how do you report this

Answer 32

Cohen's D Report effect size after p values Report exact sizes to two decimal places

Question 33

What is a p value?

Answer 33

The probability of a chance result being at least as extreme as the one observed in your data under the assumption that the null hypothesis is true

Question 34

How can a small sample effect the Shapiro wilk test?

Answer 34

More likely to say it's no different from normality (more normal)

Question 35

How can a large sample effect the Shapiro wilk test?

Answer 35

more likely to say significant difference from normality (less normal)

Question 36

What is a QQ plot?

Answer 36

- Takes a distribution and computes its quantiles - We can compute the quantiles of two different distributions - E.g the quantiles of a normal distributions compared to the quantiles of our data - Once plotted if the quantiles from the data align closely to the normal data the points should lie closely to the line Could be a shapiro wilk alternative

Question 37

When do you run rank based non parametric tests?

Answer 37

- Can also be used for normally distributed data - Valid for ordinal interval and ratio data - Valid for comparing medians rather than means - It's a robust measure of central tendency as it looks at the rank of the data

Question 38

What is the Wilcoxon signed rank test an alternative for?

Answer 38

One sample and paired t test non parametric alternative

Question 39

What is the step by step process of the Wilcoxon signed rank test?

Answer 39

- Starts with the data set subtracted by the comparison value - First we Abs sort = the sort of the absolute values of our data by there distance from 0 (ignoring the sign) - We then compute the ranks (e.g. smallest data point is 1, largest is 10) - We give back the sign of the data - Once we have the signed ranks we then make two groups, 1 for the positives and one for the negatives - We add up the positives separately and we add up the negatives - The group that adds up the smallest = is our Wilcoxon w - That number is then compared to a distribution of expected ranks - This then gives the probability of getting the result that we've observed (p value)

Question 40

What is the Wilcoxon Mann Whitney U test?

Answer 40

- sorts it from smallest to largest (not ab sort) it doesn't ignore the sign - The smallest value (most negative) gets rank of 1 and so on No signed rank - So we take our ranks and line them up with our original data - Add up the ranks from the different groups - If the sums from the groups are similar we can accept the null hypothesis (not a large effect)

Question 41

How are Wilcoxon rank tests reported?

Answer 41

There is a test statistic (W) and p- value and an effect size (Rank biserial correlation) but no degrees of freedom