Research Methods Flashcards

1
Q

Why is experience not a good basis for ideas?

A

We only see one version of a situation rather than every possible combination.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are two reasons why intuition can be flawed?

A
  1. Overconfidence
  2. Confirmation bias
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Theory-data cycle

A

Develop theories of behaviour, which lead to hypotheses, which are tested by collecting data.

Data consistent with a hypothesis increase support for a theory; data inconsistent with a hypothesis decrease support for a theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Variable

A

Something of interest that can take on different values from person to person.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Measured variable

A

Researcher observes and records value in numeric form.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Manipulated variable

A

Researcher assigns each individual to one level of a variable or another.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Operationalizing a variable

A

Turning a variable into a specific number or value.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are 3 methods for operationalizing measured variables?

A
  1. Self report
  2. Physiological
  3. Observation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the 3 kinds of research?

A

Surveys
Descriptive
Correlational

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a survey? What do they try and find out? How do they do it? How effective are they?

A

a. What do people do on average?
b. Descriptive/self-report
c. Sample
d. If random sampling is used, a sample as small as 1500 people can generalize to the population of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the two types of descriptive study?

A

a. Naturalistic observation: Use observational measures to record behaviours unobtrusively
b. Case studies: Study one or a few people, often extensively and over a long period of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a correlational study?

A

a. Measure two or more variables and quantify relationships between them
b. Scatterplots: Assign measured variable to each axis and plot one dot to represent where each individual falls. If correlation positive, high values on one variable go with high values on the other. If negative, high values on one go with low values on the other. If correlation is zero, values are not systematically related at all.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What can and can’t correlation let us predict?

A

• Positive or negative correlation allows us to predict people’s standing in one variable from the other
• Correlation necessary but not sufficient for causation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are independent and dependent variables in an experiment?

A

• One variable (the hypothesized cause) is manipulated, often by randomly assigning individuals to two groups. The other variable (the hypothesized effect) is measured for all individuals.
• Independent variable: the manipulated variable
• Dependent variable: the measured variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What 3 things must an experiment do to establish causation?

A

○ Covariance: independent variable groups differ on the dependent variable

○Temporal precedence: Prove independent variable occurs first, followed by the dependent variable. Because experiments manipulate independent variable and then measure the dependent, they almost always meet this criterion.

○ Rule out alternative explanations. Random assignment usually rules out lots. But must carefully control any other extraneous variables too.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Random assignment vs random sampling

A

• Random assignment is used only in experiments–random method like coin flip used to assign participants to one experimental condition or the other. Helps rule out alternative explanations.
• Random sampling can be used in any type of study, but most commonly used in surveys. Lets us generalize results from sample to population of interest.

17
Q

What are the advantages and disadvantages of descriptive, correlational, and experimental research?

A
  1. Descriptive: tells us what people typically do, but not when they do it or who is most likely to do it
  2. Correlational: how variables are related to each other, variables that can’t be manipulated
  3. Experimental: support causal claims
18
Q

What is validity?

A

The appropriateness of the claim or conclusion

19
Q

How do you assess construct validity?

A
  1. Validity: the appropriateness of the claim or conclusion
    1. Construct validity: how well the study operationalized its measured and manipulated variables
    2. Operationalizations of measured variables should be reliable (consistent) and should measure what it’s supposed to measure
20
Q

How do you assess external validity?

A
  1. External validity concerns who was included in the study and how they were selected. If a study is externally valid then its results can be generalized from the sample to the population of interest.
    1. Random samples have external validity in as much as they can be generalized to the population they were sampled from
    2. Studies conducted on one type of person may not be externally valid if they were meant to understand different types of people
21
Q

When does a study have internal validity?

A
  1. Internal validity is mainly relevant when a study is trying to support a causal claim. A study is internally valid if the researchers have ruled out any relevant alternative explanations for the relationship.
    1. Well conducted experiments tend to have good internal validity, because of random assignment and carefully controlled independent variables
    2. Correlational studies don’t tend to have good internal validity because they can’t rule out alternative explanations for the association between the variables
22
Q

How can we evaluate claims in popular media? (5)

A
  1. What am I being asked to believe?
    1. What evidence is there?
    2. How strong is the result?
    3. Are they making a causal claim?
    4. Has the study been replicated?
23
Q

Frequency distribution

A

Bar graph that shows the possible values of a variable and how many people are at each value

24
Q

Central tendency

A

Average, described by mean, median, and mode

25
Q

Variability

A

We describe how variable a batch of scores are by using standard deviation or variance

26
Q

Effect size

A

Quantification of the strength of the relationship between two variables

27
Q

R

A

Correlation coefficient

Used in correlational studies graphed with a scatterplot

R=.1 small
R=.5 strong

28
Q

D

A

Difference between two conditions.

Difference between the two group means, divided by the standard deviation.

.2 small
.8 strong

29
Q

Inferential statistics

A

Uses sample results to estimate what’s true about the broader population

30
Q

Statistical significance

A

Assesses the probability that an effect size found in a sample represents your population.

When effect sizes are large they’re more likely to be called statistically significant.

31
Q

Meta-analysis

A

Combines the effect size estimates from a large number of studies on the same question to get a better estimate of the effect size of a population.

32
Q

Three principles of ethical research on humans

A
  1. Autonomy: informed consent.
  2. Beneficence: No harm, benefit society.
  3. Justice: Types of people studied must be those who benefit from it.
33
Q

What environmental factors for animal research must researchers follow guidelines about?

A

Living space, food, housing conditions, stimulation.

34
Q

What are the three Rs of ethical research on animals?

A
  1. Replacement: find alternatives to animals wherever possible
    1. Refinement: adjust procedures to minimize distress
    2. Reduction: use designs that require fewest animals possible
35
Q

Animal welfare vs animal rights

A

Animal welfare: Animals should be protected from suffering
Animal rights: Animals shouldn’t be used bc they can’t give informed consent

36
Q

Why is replication important?

A

It helps establish whether a study’s original findings reflect a true effect. Some notable replication efforts work with large and diverse samples.

37
Q

What are the two reasons a study may fail to replicate?

A
  1. Not a true effect
    1. Problems with the replication study
38
Q

When are studies less likely to replicate?

A
  1. Questionable research practices
  2. HARKing
  3. P-hacking
  4. Underreporting nonsignificant results
39
Q

What two cultural factors strengthen reliability and validity?

A
  1. Open science
  2. Preregistration of hypotheses