Validity & Reliability

Question 1

(Validity & Reliability) How do you check for test-reset reliability?

Answer 1

Repeat the study with the same participants (to see if the same results are obtained the second time).

Question 2

(Validity & Reliability) How do you check for inter-rater reliability?

Answer 2

Check one observer’s findings against those of another observer (to see if they are consistent with each other).

Question 3

(Validity & Reliability) How do you check for spilt-half reliability?

Answer 3

Compare items within a test to see if they are giving the same findings (e.g. compare odd-numbered items with even-numbered items.

Question 4

(Validity & Reliability) What are the 4 ways to improve reliability?

Answer 4

• Make the procedure standardised.
• Make the study replicable.
• Make the sample large enough.
• Ensure questionnaires contai multiple items all related to the same construct.

Question 5

(Validity & Reliability) Ways to improve reliability: Why would you standardised the procedure?

Answer 5

So that all participants have the same experience.

Question 6

(Validity & Reliability) Ways to improve reliability: Why would you make the study replicable?

Answer 6

To be able to check that the original study was reporting an effect that will be consistently seen).

Question 7

(Validity & Reliability) Ways to improve reliability: Why would you make the sample large enough?

Answer 7

To reveal the typical, consistently occurring response (i.e. that has not been distorted by flukes or anomalies).

Question 8

(Validity & Reliability) Ways to improve reliability: Why would you ensure that the questionnaires contain multiple items all related to the same construct?

Answer 8

To be able to find out a participant’s ‘settled’ response.

Question 9

(Validity & Reliability) Describe face validity.

Answer 9

Whether, on the face of it, the test looks like it is measuring what is supposed to be measured.

Question 10

(Validity & Reliability) Describe construct validity.

Answer 10

Whether the test has been shown to measure what it is supposed to be measuring (i.e. the desired construct).

Question 11

(Validity & Reliability) Describe concurrent validity.

Answer 11

Whether results on one test concur with results on another tests (such as measuring the same construct).

Question 12

(Validity & Reliability) Describe criterion (predictive) validity.

Answer 12

Whether results on a test can predict results on other (similar) tests in the future.

Question 13

(Validity & Reliability) Describe ecological validity.

Answer 13

Does the study represent a real-life situation?

Question 14

(Validity & Reliability) Describe population validity?

Answer 14

Can the sample be generalised from?

Question 15

(Validity & Reliability) List the 4 types of internal validity.

Answer 15

Face, construct, concurrent and criterion (predictive).

Question 16

(Validity & Reliability) List the 2 types of external validity.

Answer 16

Ecological and population.

Question 17

(Validity & Reliability) Ways to improve validity: Impose ________ to reduce the impact of __________ variables.

Answer 17

Controls
Extraneous

Question 18

(Validity & Reliability) Ways to improve validity: ______________ repeated measures design experiments.

Answer 18

Counterbalance

Question 19

(Validity & Reliability) Ways to improve validity: Use _______ participants design to control for __________ variables.

Answer 19

Matched
Participant

Question 20

(Validity & Reliability) Ways to improve validity: Avoid asking _______ questions.

Answer 20

Leading

Question 21

(Validity & Reliability) Ways to improve validity: Reduce ______ characteristics by not telling participants the full ___ of a study and/or by asking ___________ questions.

Answer 21

Demand
Aim
Smokescreen

Question 22

(Validity & Reliability) Ways to improve validity: Reduce social ___________ bias by guaranteeing anonymity to participants.

Answer 22

Desirability

Question 23

(Validity & Reliability) Ways to improve validity: Pre-test materials to reduce ________ bias.

Answer 23

Cultural

Question 24

(Validity & Reliability) Ways to improve validity: Carry out ______ _____ studies to reduce researcher/observer bias.

Answer 24

Double blind

Question 25

(Validity & Reliability) Ways to improve validity: Reverse items in questionnaires to avoid ________ ________ set.

Answer 25

Standard response

Question 26

(Validity & Reliability) Ways to improve validity: Ensure the sample is representative pf the ______ population (e.g. use ______ sampling).

Answer 26

Target
Random

Question 27

(Validity & Reliability) Ways to improve validity: Conduct _____ experiments to improve the _________ validity.

Answer 27

Field
Ecological