Chapter 9

Question 1

Checking reliability for quantitative research

Answer 1

1. Sample size
2. Test-retest

Question 2

Sample size

Answer 2

The larger your sample, the more accurate. Margin of error: the extent of the error that you will accept.

Question 3

Test-retest

Answer 3

By repeating the method you can check whether your research is reliable.

Question 4

Checking reliability for qualitative research

Answer 4

1. Inter-rater reliability/ intersubjectivity
2. Triangulation
3. Iteration

Question 5

Reliability

Answer 5

The extent to which the research is free of random errors.

Question 6

Random error

Answer 6

Errors that arise through a coincidental cause, as a result of unexpected factors.

Question 7

Replicability requirement

Answer 7

It must be possible to replicate the research at another time, by another researcher, using other subjects and under different circumstances.

Question 8

Inter-rater reliability/intersubjectivity

Answer 8

The extent to which there is agreement between the researchers about the research findings.

Question 9

Margins of error

Answer 9

The margin that you allow for errors in your research.

Question 10

Four-eye principle

Answer 10

A kind of feedback that you get by asking colleagues or fellow students to check your research.

Question 11

Pilot project

Answer 11

Pilot interview or survey.

Question 12

Member check

Answer 12

The client is involved in examining the research project.

Question 13

Checking reliability for quantitative and qualitative research

Answer 13

1. Standardization
2. Pilot interview
3. Four-eye principle
4. Reporting and justification:
5. Member check

Question 14

Standardization

Answer 14

Designing standards for questionnaires.

Question 15

Validity

Answer 15

The extent to which the research is free of systematic errors.

Question 16

Systematic errors

Answer 16

Errors that have a systematic (not coincidental) cause that (consistently) lead to a result that is different to the expected value measurement.

Question 17

Internal validity

Answer 17

Extent to which accurate conclusions can be drawn from the results.

Question 18

Mortality

Answer 18

Test subject drop out that leads to the systematic skewing of the results.

Question 19

Test effect

Answer 19

Research participants react differently because they are taking part in research.

Question 20

Maturation

Answer 20

Changes during the research that leads to the systematic skewing of the results.

Question 21

External incident (history)

Answer 21

External incidents that lead to the systematic skewing of the results.

Question 22

Jeopardized internal validity

Answer 22

• Selection
• Growth
• External incidents
• Instruments
• Mortality
• Test effect
• Maturation

Question 23

Selection

Answer 23

You only researching the answers from some people, not from everyone your drawing a conclusion from.

Question 24

Growth

Answer 24

If the research goes on for to long, changes will automatically take place.

Question 25

Instrumentation

Answer 25

Changes in the measuring instruments that leads to the systematic skewing of the results.

Question 26

Construct validity

Answer 26

The validity of measuring instruments that are used in surveys and experiments. ‘Measuring what you intend to measure’. Extend to which you are measuring what you want to measure

Question 27

External validity/population validity

Answer 27

The extent to which a sample resembles the population in terms of relevent attributes; it determines the statistical generalizability of the research.

Question 28

Theoretical generalizability

Answer 28

The extent to which the findings can be generalized to apply to other situations and groups that have not been researched.

Question 29

Statistical generalizability

Answer 29

Extrapolation of the conclusions to the population.

Question 30

Construct validity

Answer 30

Extent to which you are measuring what you want to measure.

Question 31

Usability

Answer 31

The extent to which research has practical relevance.

Question 32

Conceptual usability

Answer 32

The results are used to start a debate on a specific subject.

Question 33

Instrumental usability

Answer 33

The results are used to draft policies.

Question 34

Valorization value

Answer 34

The knowledge that you gain with applied research.