Quiz 3

Question 1

What is reliability?

Answer 1

Consistency of a measurement or test

Question 2

Four types of reliability

Answer 2

Test, retest reliability
Inter rater reliability
Parallel forms, reliability
Internal consistency

Question 3

Test, retest reliability (how it is calculated and determined)

Answer 3

Administer the same test to same group at two different times

Calculate the correlation efficient (Pearsons r) between the two sets of scores

Question 4

Inter rater reliability (how it is determined and calculated)

Answer 4

Have multiple rater/observers score or categorize the same set of data

Uses Cohen’s kappa for categorical, fleiss’ kappa four more than two Raters, , ICC for continuous data

Question 5

Parallel forms, reliability ( how it is determined and calculated)

Answer 5

Develop two equivalent versions of a test,

give both versions to the same group

Compute the correlation between the two sets of scores

Question 6

Internal consistency(how it is determined and calculated)

Answer 6

Look at how well the items within the list are related

Use cronbachs alpha in split half reliability

Higher alpha (>0.7) means better consistency

Question 7

Independent variable

Answer 7

A variable you change or control (the cause)

Question 8

Dependent variable

Answer 8

The variable you measure or observe (the effect)

Question 9

Validity

Answer 9

How well a test measures what it is supposed to measure

Question 10

Three types of validity

Answer 10

Content validity
Construct validity
Criterion related validity

Question 11

How content validity is determined and calculated

Answer 11

Not usually statistical, based on expert judgment, sometimes a content validity ratio is calculated using expert ratings

Question 12

How construct validity is determining calculated

Answer 12

Uses factor analysis and checks correlations

Question 13

How criterion related validity is determined in calculated

Answer 13

Correlation coefficients (pearsons r) between the test and an external criterion

Predictive and concurrent

Question 14

Example of when something can be reliable, but not valid

Answer 14

Survey is designed to measure math ability, but only includes basic math questions

Reliable because everybody gets a similar score each time

Not valid because it doesn’t truly measure math ability

Question 15

What is a hypothesis?

Answer 15

An educated guess

Question 16

Role of hypothesis

Answer 16

To reflect the general problem statement or question that is driving research

Question 17

Define sampling error

Answer 17

A measure of how well a sample represents the population

Question 18

General goal of hypothesis testing

Answer 18

To rule out simply error as a plausible explanation for the results of research study

Question 19

Define hypothesis testing

Answer 19

Technique to help determine whether a specific treatment has an effect on the individuals in a population

Question 20

When is hypothesis test used?(3)

Answer 20

Sample is selected from the population

Treatment is administered to the sample

After treatment, the individuals in sample are measured

Question 21

Types of hypothesis

Answer 21

Research hypothesis
Null hypothesis

Question 22

Null hypothesis

Answer 22

Statements that contain two or more things that are equal(unrelated) to one another(no difference)

Refers to populations and are written in Greek symbols

Question 23

Research hypothesis

Answer 23

Statement that there is a relationship between two variables

Statement of inequality

Refers to samples and are written in Roman symbols

Question 24

Two types of research hypothesis

Answer 24

Directional and non-directional

Question 25

Define non-directional research hypothesis

Answer 25

Reflects a difference, but the direction is not specified Uses a two tail test (normal curve)

Question 26

What does a non-directional two tail hypothesis predict

Answer 26

That the independent variable will have an effect on the dependent variable BUT the direction of the effect is not specified

Question 27

Example of non-directional

Answer 27

A researcher might hypothesis that college students will perform differently from elementary school students on a memory task without predicting which group of students will perform better

Question 28

Define directional research hypothesis

Answer 28

Reflects a difference in the direction is specified Uses a one tail test

Question 29

What does directional hypothesis predict?

Answer 29

Direction of the relationship between the independent and dependent variable

Question 30

Example of directional hypothesis

Answer 30

Participants who have been deprived of sleep for 24 hours will have more cold symptoms in the following week after exposure to a virus then non-sleep deprived participant