Validity Flashcards

(41 cards)

1
Q

what is internal validity

A

the ability of your research design to test the hypothesis
for what it was designed for

= change in the independent variable caused change in the dependent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what can threat internal validity

A
  1. extraneous variables

2. confounding variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

extraneous variables

A

(alternative explanations for the observed effect) = rival hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

confounding variables

A

= if two independent variables influence the dependent at the same level and you cannot distinguish which variable has actually caused the observed effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Threats to internal validity

A
  1. History
  2. Maturation
  3. Testing (pretesting)
  4. Instrumentation
  5. Statistical regression
  6. Biased selection of participants
  7. Experimental mortality
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Threat: History

A

multiple observations over time

-> different events can occur in between = affecting the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Threat: Maturation

A

Effect of age or fatigue

  • can affect performance changes (confounding variable)
  • cannot difference which variable caused the outcome
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Threat: testing

A

making pretests before the actual treatment
- subjects get presensitized
= better performance afterwards

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Threat: Instrumentation

A

unobserved changes in an criteria or measurement instrument.

- difficult to distinguish what caused the actual response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Statistical regression

A

if you have chosen participants which an extreme score,

- Tendency in the second test/measurement = regression to the population mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Biased selection of participants

A

initial differences in the subjects–> leads to changes in the performance/results
- cannot separate the effect of the independent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Experimental Mortality

A

participants drop out of the study due to death, moving

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

external validity

A

study results can be generalized beyond the research setting
- applying to real world problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the aim of for external validity ?

A

gaining inside into the underlying mechanisms of the studied behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Threats to external validity

A
  1. Highly controlled laboratory settings
  2. Reactive testing
  3. Interaction: selection particip. bias and IV
  4. reactivity of experimental arrangements
  5. multiple treatment inference
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

reactive testing

A

pretest influences participant’s reaction on an experimental variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Interaction: selection bias

A

study results can only be applied to studied group of subjects (e.g college students, gender )

18
Q

Reactivity of the experimental arrangements

A
  • artificial setting of the experimental situation

- participant’s knowledge that they part of the study

19
Q

multiple treatment inference

A
  • treatment in the first condition may affect the performance in the later condition (e.g. fatigue)
20
Q

Problem with internal and external validity ? interaction

A

if one increases the other usually decreases

21
Q

What kinds of research settings are available ?

A
  1. Laboratory setting

2. Field setting

22
Q

What are the characteristics of the laboratory setting ?

A

=mostly artificial setting
+ control over extraneous variables (which could affect your dependent variable)
subcategory: simulation

23
Q

What are the characteristics of the field setting ?

A

= studying behavior in naturally environment
+ higher generalization
- no control over extraneous variables (confounding variables)

24
Q

What is a sample?

A

small subgroup of a larger population

25
What does generalization mean?
that you can apply the findings of your sample study to the larger population
26
What does random sample mean
if you sample randomly, every person has the equal chance of being chosen for your study
27
Why do we use random sampling
- highest level of generality | - if you have the intention to apply it directly to real-life problems
28
What is deception
when you either actively or passively mislead the participant - withholding information about the experiment
29
What types of deception do we have ?
1. active deception | 2. passive deception
30
What means active perception ?
That you really have the intention to withhold information about the study - misleading the purpose of the study - making false promises to the participants - providing misleading information to the participant - using placebos and not mentioned drugs - using pseudo-participants
31
What is passive deception?
- unrecognized conditioning of the participants - concealed/invisible observations - unrecognized participant observations - using projective techniques and other personality tests
32
Non response bias
if a large part of your participants fail to give answer you back or send you back the questionnaire
33
What are the categories of deception?
1. Intentional deception | 2. Unintentional deception
34
Intentional deception
not fully report details of your study
35
Unintentional deception
not fully informing your participants what is the study about and what does it involve
36
What is the problem with deception
elaborate hoax | - damage trust into research (less likely to act as a volunteer again in future studies
37
What are the solutions for deception?
1. Role play 2. inform the participant that deception will be used 3. Debriefing
38
What is economic sampling ?
that you have enough participants to ensure that your study will be valid
39
Factors of economic sampling ?
1. Amount of acceptable error | 2. Expected magnitude of the populations
40
What is sampling error ?
that the characteristics of the sample differ from the characteristics of the population
41
What means debriefing ?
informing the participant after the study about used deception and the general purpose of the study Goal: restore participant's self esteem