Sampling, Measurement, Hypothesis Testing

Question 1

Those participating in a study constitute a ______

Answer 1

sample

Question 2

The sample may be considered a subset of a general group called the ________

Answer 2

population

Question 3

When the sample reflects the attributes of the target population it is ________

Answer 3

representative

Question 4

When the sample does NOT reflect the attributes of the target population it is ______

Answer 4

biased

Question 5

Random sampling

Answer 5

Each member of the population has an equal chance of being selected as a member of the sample

Question 6

Stratified sampling

Answer 6

The proportions of important subgroups (ex; female and male) in the population are represented precisely

Question 7

Cluster sampling

Answer 7

The researcher randomly selects a cluster of people all having some feature in common

Question 8

Convenience sample

Answer 8

A group of individuals who meet the general requirements of the study are recruited in a variety of non-random ways
- Often form the “subject pool”

Question 9

Sometimes a specific type of person is recruited for the study. This is a convenience sampling strategy called…

Answer 9

purposive sampling

Question 10

Quota sampling

Answer 10

• Attempts to accomplish the same goal as stratified sampling (representing subgroups proportionally)
• Non-random
• May use “subject pool” to recruit participants

Question 11

Snowball sampling

Answer 11

Researcher asks people who already completed their study to recruit additional subjects

Question 12

Researchers develop measures from ______

Answer 12

constructs

Question 13

Construct

Answer 13

Hypothetical factors that cannot be observed directly but is inferred from certain behaviours

Question 14

Constructs are defined using…

Answer 14

operational definitions

Question 15

Attention span as the _____ and letter identification as the…

Answer 15

construct, behaviour to measure the construct

Question 16

Burnout as the ______ and score on self-reported Burnout index as the…

Answer 16

construct, behaviour to measure the construct

Question 17

Determining is a measure is any good requires assessing two key factors:

Answer 17

1. Reliability

2. Validity

Question 18

Reliability

Answer 18

• Results are repeatable

- If there is a lot of measurement error, reliability is low and vice versa

Question 19

Validity

Answer 19

Measures what it is designed to measure

Question 20

Content validity

Answer 20

Whether the content of the items on a test make sense in terms of the construct being measured

Question 21

Face validity

Answer 21

Whether the measure seems valid to those who are taking it

Question 22

Criterion validity

Answer 22

Whether the measure is related to some behavioural outcome or criterion that has been established prior to research

Question 23

Criterion validity: Predicative

Answer 23

Whether the measure can accurately forecast some future behaviour

Question 24

Criterion validity: Concurrent

Answer 24

Whether the measure is meaningfully related to some other measure of behaviour

Question 25

Construct validity

Answer 25

Whether a test adequately measures some construct and it connects directly with the operational definition Accumulates as research produces supportive results

Question 26

Construct validity: Convergent

Answer 26

Scores on a test measuring some construct should relate to scores on other tests that are theoretically related to the construct

Question 27

Construct validity: Discriminative

Answer 27

Scores on a test measuring some construct should NOT be related to scores on other tests that are theoretically unrelated to the construct

Question 28

Validity assumes reliability but...

Answer 28

reliability does not assume validity

Question 29

Nominal scales

Answer 29

- The number we assign to events serves only to classify them into one group or another - Studies using these scales typically assign people to names of categories and count the number of people falling into each category

Question 30

Ordinal scales

Answer 30

Sets of rankings, showing the relative standing of objects or individuals

Question 31

Interval scales

Answer 31

- Each unit increase in the scale is assumed to reflect the same change in the underlying measure - Zero does not mean the absence of an attribute - Think temperature

Question 32

Ratio scales

Answer 32

- Each unit increase in the scale is assumed to reflect the same change in the underlying measure - Zero does mean the absence of an attribute - Think height

Question 33

Descriptive statistics

Answer 33

Summarize data collected from sample

Question 34

Inferential statistics

Answer 34

Allow you to draw conclusions about your data that can be applied to the wider population

Question 35

Descriptive statistics include...

Answer 35

- Measures of central tendency - Measures of variability - Measures of association

Question 36

Inferential statistics include...

Answer 36

hypothesis testing

Question 37

When is the median useful?

Answer 37

When scores are very different from the rest it is beneficial to calculate the median. This is because the mean with give a distorted view

Question 38

When is the interquartile range useful?

Answer 38

Useful for the same reason the median is useful - when there are outliers

Question 39

The variance and standard deviation rely on the mean and thus...

Answer 39

should only be used when data is fairly normally distributed

Question 40

On a Normal Distribution, 68% of all scores...

Answer 40

falls within a single standard deviation on either side of the mean

Question 41

On a Normal Distribution, 95% of all scores...

Answer 41

fall within two standard deviations on either side of the mean

Question 42

If you reject the null, you are rejecting the idea that...

Answer 42

there is no difference or relationship between conditions and saying that there is a statistically significant difference between conditions

Question 43

If you fail to reject the null, you are failing to reject the idea that...

Answer 43

there is no difference or relationship between conditions and saying that there is no statistically significant difference between conditions

Question 44

If p-value is LESS than alpha (0.05)...

Answer 44

Conclude that there is a statistically significant difference between conditions

Question 45

Type I error

Answer 45

Rejecting the null when it is in fact true is called a Type I error There is no real difference but you think there is because of the results in your study

Question 46

Type II error

Answer 46

When you fail to reject the null but you are wrong There really is a difference but you failed to find it in your study

Question 47

Confidence intervals

Answer 47

Based on the data for a sample, we can be 95% confident the calculated interval captures the population mean

Question 48

Non-overlapping confidence intervals indicate...

Answer 48

a meaningful difference between the two conditions of the study

Question 49

Power

Answer 49

The chance of being able to reject the null when it is in fact false is referred to as the power of the statistical test

Question 50

A test is said to have high power if it results in a _____ probability that a real difference will be found in a particular study

Answer 50

high

Question 51

As power increases, the chance of a _____ error decreases and vice versa

Answer 51

Type II