Chapter 2. Test for Significance Flashcards

1
Q

the process by which we
determine the probability that there
is a significant difference between
two samples

A

Significance Testing (Hypothesis testing)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Indeterminate error is sufficient to explain any
difference in the values
being compared.

  • no significant difference hypothesis
A

Null Hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

The difference between the
values is too great to be explained by random error
and, therefore, must be real.

  • have a significant difference
A

Alternative Hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

A null hypothesis is retained whenever the evidence is insufficient to prove it is incorrect. Because of the way in which significance tests are conducted, it is impossible to prove that a null hypothesis is true.

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

the confidence level for retaining the null hypothesis (95%), or the probability that the null hypothesis will be incorrectly rejected

A

Significance Level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Retain Null = statistically the same

Reject Null = significant difference

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

If there is greater than a 5% chance of a result as extreme as the sample result when the null hypothesis is true, then the null hypothesis is retained. This does not necessarily mean that the researcher accepts the null hypothesis as true—only that there is not currently enough evidence to conclude that it is true.

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Rejecting the null hypothesis means that a relationship does exist between a set of variables and the effect is statistically significant (p > 0.05)

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The null hypothesis cannot be proven, although the hypothesis test begins with an assumption that the hypothesis is true, and the final result indicates the failure of the rejection of the null hypothesis. Thus, it is always advisable to state ‘fail to reject the null hypothesis’ instead of ‘accept the null hypothesis.

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Two-tailed test

A
  • comparison
  • key words: significant difference, same effect, generate the same…
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

One-tailed test

A
  • key words: greater than, lower than, more effective, less effective…
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Type I Error

A
  • The risk of falsely rejecting
    the null hypothesis (𝛼)
  • risk is always equivalent to α
  • false positive

Example:
Ho: he likes you back
Truth: he likes you back
Decision: falsely rejected Ho (missed your chance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Type II Error

A
  • The risk of falsely retaining
    the null hypothesis (β).
  • (β) - depends on sample size and variance
  • false negative

Example:
Ho: he likes you back
Truth: he doesn’t like you back
Decision: accepted Ho (wrongly invited him)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Minimizing a type 1 error by
decreasing 𝛼, for example,
increases the likelihood of a type 2 error

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

F-Test

A

a test designed to indicate
whether there is a significant
difference between two
methods based on their
standard deviations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Always write the formula Ysa!!!

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

F-Test
- higher value is always on the numerator

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

F is defined in terms of the
variances of the two methods, where the variance is the
square of the standard deviation

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

If 𝑭𝒄𝒂𝒍𝒄 > 𝑭𝒕𝒂𝒃𝒍𝒆, then the
variances being compared are

A

Significantly different

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

If 𝑭𝒄𝒂𝒍𝒄 < 𝑭𝒕𝒂𝒃𝒍𝒆, then the
variances being compared are

A

Statistically the same

20
Q

The purpose of significance testing is

A

provide evidence to reject the null hypothesis

21
Q

Null hypothesis

A

Something we believe/expect to be true; no difference hypothesis

have no significant difference

22
Q

Alternative hypothesis

A

have significant difference

23
Q

comparison is made between two
sets of replicate measurements
made by two different means

A

t-test

24
Q

If 𝒕𝒄𝒂𝒍𝒄 > 𝒕𝒕𝒂𝒃𝒍𝒆, then the data
being compared have

A

Significant Difference

25
Q

If 𝒕𝒄𝒂𝒍𝒄 > 𝒕𝒕𝒂𝒃𝒍𝒆, then the data
being compared have

A

significant difference

26
Q

Several ways and several situations in which t-test can be
used:

A

▸ t- test when a reference value is known
▸ Comparison of the means of two methods
▸ Paired t-Test
▸ t-test to compare different samples

27
Q

➢ used to obtain an improved estimate of the precision of a
method and for calculating the precision of the two sets of data

➢ provides a more reliable estimate of the precision of a method
than is obtained from a single set

➢ if random error is assumed to be the same for each set, then
the data of the different sets can be pooled

A

Pooled Standard deviation

28
Q

side = denominator
top = numerator

(0.05, numerator, denominator)

A
29
Q

➢ two methods are used to make
single measurements on
several different samples.

➢ No measurement has been
duplicated

A

Paired t-Test

30
Q

▸ Analysis of Variance

▸ allows comparisons among more than
two population means

▸ use a single test to determine whether
there is or is not a difference among
the population means rather than
pairwise comparisons as is done with
the t test.

A

ANOVA

31
Q

𝐻0: 𝜇1 = 𝜇2 = 𝜇3 = ⋯ = 𝜇𝑖

𝐻𝐴 : at least two of the 𝜇𝑖’s
are different

A
32
Q

Applications

A
  1. Is there a difference in the results of five analysts determining calcium
    by a volumetric method?
  2. Will four different solvent compositions have differing influences on the
    yield of a chemical synthesis?
  3. Are the results of manganese determinations by three different
    analytical methods different?
  4. Is there any difference in the fluorescence of a complex ion at six
    different values of pH?
33
Q

The basic principle of ANOVA is to
compare the variations between the
factor levels (groups) to that within
factor levels

A
34
Q

When H0 is TRUE, the variation between the group MEANS IS CLOSE to
the variation WITHIN groups.

A
35
Q

When H0 is FALSE, the variation between
the group mean is LARGE compared to the variation within groups.

A
36
Q

Grand mean can be calculated as the weighted average of the individual
group means,

A

Single Factor ANOVA

37
Q

A statistical t value is calculated
and compared with a tabulated
value for the given number of
tests at the desired confidence
level

A

t-test when a reference value is known

38
Q

use this when comparing
two methods, that is, when
analyzing a sample by two
different methods

A

comparison of the means of two methods

39
Q

▸ use this when comparing two
methods with individual
differences (𝐷𝑖)

▸ average difference is calculated and the individual
deviations of each from are
used to compute a standard
deviation, sd

A

paired t-test

40
Q

To calculate the variance ratio needed in the F test, it is necessary to
obtain several other quantities– the sums of squares:.

A
  1. The sum of the squares due to the factor SSF
  2. The sum of the squares due to error SSE
  3. The total sum of the squares SST is obtained as the sum of SSF and SSE: SST = SSF + SSE
41
Q

Assumptions:
1. equal variance (variances of the I populations are assumed to be
identical-tested through Hartley test)
- the largest s should not be much more than twice the smallest
s for equal variances to be assumed.

  1. each of the I populations is assumed to follow a Gaussian distribution
A
42
Q

If 𝑭𝒄𝒂𝒍𝒄 > 𝑭𝒕𝒂𝒃𝒍𝒆, then the
variances being compared are

A

SIGNIFICANTLY DIFFERENT

43
Q

If 𝑭𝒄𝒂𝒍𝒄 < 𝑭𝒕𝒂𝒃𝒍𝒆, then the
variances being compared are

A

STATISTICALLY THE SAME

44
Q

a statistical measure (expressed as a number) that describes the size and
direction of a relationship between two or more variables.

A

correlation

45
Q

A correlation between variables does not automatically
mean that the change in one variable is the cause of the
change in the values of the other variable.

A
46
Q

indicates that one event is the result of the occurrence of
the other event(i.e. there is a causal relationship between
the two events)

This is also referred to as cause and effect.

A

causation

47
Q

study examples on ppt and solve chapter 7 problems

A