Test 3 Flashcards

1
Q

Validity

A

Validity: the extent to which empirical evidence and theoretical rationales support the adequacy and appropriateness of conclusions drawn from some form of assessment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Construct validity:

A

Construct validity: the ability of a measurement tool or test to accurately measure what it’s supposed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Internal validity:

A

Internal validity: the extent to which a piece of evidence supports a claim about cause and effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

External validity:

A

External validity: the extent to which the findings of a study are relevant to subjects and settings beyond those in the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Increasing internal validity often means

A

sacrificing external validity

And vice versa

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

External validity asks the question of generalizability:

A

To what: situations, people, settings, and variables can an effect be generalized?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Ask a research question about a population. ->
Take a representative sample from the population. ->
Answer the research question by studying the sample. ->
Generalize results from the study of the sample to population.
“What is true of the sample is true of the population”

A

Ask a research question about a population. ->
Take a representative sample from the population. ->
Answer the research question by studying the sample. ->
Generalize results from the study of the sample to population.
“What is true of the sample is true of the population”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The Artificiality Criticism

A

Scientific experiments are useless because they are artificial and not like “real life”
This assumes that “Real Life” is a better setting for experiments than a controlled laboratory setting.
Why is that a poor assumption to make?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Scenario Number one:

Experiment generalizes to real world.

A

If scenario one is the goal, then EV is required.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Scenario number two:

Real world inspires Experiment.

A

If Scenario two is the goal, the EV is not required.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Harlows Monkeys
In the 50s it was believed that a baby’s attachment to their mother was because they fed the baby.
Hunger reduction model of maternal love.
Are the infant monkeys representative of all infant monkeys?
Does the experimental setting approximate real life?
Is the subject’s behavior is influenced by the experimental setting?
Then FAIL: little external validity.

A

Harlows Monkeys
In the 50s it was believed that a baby’s attachment to their mother was because they fed the baby.
Hunger reduction model of maternal love.
Are the infant monkeys representative of all infant monkeys?
Does the experimental setting approximate real life?
Is the subject’s behavior is influenced by the experimental setting?
Then FAIL: little external validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why conduct controlled experiments if the results don’t/can’t apply to the real world?
Because:

A

There are inherent benefits to doing these things in and of themselves.

  1. Ask whether something can happen rather than does happen
  2. prediction may specify that something should happen in the lab, so test it out.
  3. Demonstrate the power of the phenomenon by showing that it occurs in a contrived setting.
  4. Use the Lab to produce conditions that otherwise do not exist in the real world.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Experimental findings not intended to be generalized can still be worthwhile in theory development!

A

Harlow’s experiment failed to meet the requirements of external validity.
Harlow had no intention of generalizing these results.
He showed that the hunger reduction model didn’t hold up as it should.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Theoretical proposition:

A

Theoretical proposition: Parent approval/disapproval shape childrens grammatically correct speech.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Prediction: The observed parents ought to do this (disconfirmed by study).

A

Subjects are of interest precisely because they are unrepresentative.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Past theories and evidence → current theory and evidence → predictions

A

Past theories and evidence → current theory and evidence → predictions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

“BREAKTHROUGH” HEADLINES

A

• Media headlines often present research findings as “major breakthroughs” . May spread misinformation and exaggeration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

CONNECTIVITY PRINCIPLE

A
  • Science obeys the connectivity principle:
  • A new theory must account for new evidence as well as previously established empirical facts

• May explain observations (old and new) in a different or unconventional
way

. But it must explain them all to be a true scientific advance • I.e., the new explanation must make sense given what we already know • Cumulative process of science

19
Q

BEWARE OF VIOLATIONS OF CONNECTIVITY

A

• Pseudoscience often dismisses previous data as irrelevant in light of

a new “breakthrough” theory • Novelty and “radical departures” are emphasized

• Pseudoscience relies on long-held “wisdom” AND novelty and
“radical departures”

20
Q

“GREAT-LEAP” MODEL

A

People tend to believe that scientific advances occur with “great leaps”

Reality: progress and setbacks

21
Q

Gradual synthesis:

A

• Progress occurs as the community of scientists gradually begins to agree that the evidence supports one explanation over another

22
Q

. Case studies

A
  • In depth research about one specific person or group

* Not representative

23
Q

• Correlational studies

A
  • Implies relationships between variables • Does not determine cause and effect
  • Limitations in regard to directionality and third variables
24
Q

• Quasi-Experiments

A

• Like a correlational study in that variables aren’t manipulated • Like an experiment in that one preexisting variable is used to group

individuals and is treated like an IV

25
Q

• Experiments

A
  • Can determine cause and effect
  • Manipulate one variable (IV), control all other variables, and measure another variable (DV)
  • Often utilizes random assignment
  • Issues of confounding variables and validity
26
Q

FLAWS IN RESEARCH

A

• Flaws and limitations, threats to internal/external validity • Ambiguity of interpretation of data from any one study

27
Q

Principle of converging evidence: Support for theories comes about when the preponderance of evidence from many different types of studies point to the same answer

A

Principle of converging evidence: Support for theories comes about when the preponderance of evidence from many different types of studies point to the same answer

28
Q

WHAT CONSTITUTES CONVERGING EVIDENCE?

A

• Two key factors:

The results of many studies consistently support one theory

  • They collectively eliminate competing theories
  • When evidence from a wide range of studies all point in a similar direction, evidence has

Converged

29
Q

SCIENTIFIC CONSENSUS

A
  • Methods & Convergence
  • Should expect many different methods to be used in research
  • Fields of psychology should be careful not to become over-reliant on one method of study
  • The research process often proceeds from weaker methods to more powerful ones
  • Case study correlation
30
Q

• Meta-analysis:

A

• Meta-analysis: statistical method for combining results of many Studies

31
Q

META-ANALYSES

A

• A statistical method of combining findings from a large number of

studies of the same topic to determine an overall pattern

  • Procedure:
  • define the effect of interest .
  • search the published literature • code the characteristics of the studies you find

calculate effect size

. E.g., correlation coefficient, standardized mean difference, odds ratio

32
Q

Meta Analyses

A

Two reasons why Mas are better than primary studies:

Condense volumes of research into a single meaningful investigation.

Results are more reliable than a single primary study.

Problem: the “file-drawer problem”
Non-significant results are less likely to be published.

Solution: failsafe
The number of non-significant results need to change the conclusion of the MA.

33
Q

Effect size:

A
Cohen’s d
One measure of effect size.
Effect size represented in numbers.
Small d=.20
Moderate d=.50
Large d=.80
Effect size represented in distributions.
34
Q

Multiple Causation and interactions.

A

The search for the magic bullet.
What is the Magic Bullet?
The (one and only, all-purpose) cause of something.

But more psychological phenomena are more complex than that?

Multiple causation
When not one but many factors/variables contribute to a psychological phenomenon.

Multiple causation is different from converging evidence.
CE: when multiple studies point to one theory.

Many phenomena are influenced or “caused” by more than one factor.

35
Q

What causes breast cancer?

A
Biological factors:
Genes
Family history
Age
Environmental factors:
Diet
Exercise
Obesity
Alcohol consumption
Exposure to carcinogens
36
Q

But factors also interact with one another

A

Family history and alcohol consumption, age and obesity, ect.

37
Q

Interactions

A

Sometimes these multiple causes interact with one another.
Interaction: the joint effect of two or more variables on another variable

Interaction effects occur when variables have not only separate effects but also combined effects on an outcome.

38
Q

The smiley face example:

A

What this demonstrates:
The two factors combine in such a way that, to earn the highest tip, women should include a happy face and men should not.

Happens with many different constructs psychology is interested in.
Problem: the more factors you measure as IVs or predictors, the harder it is to interpret the effects on the DV.

Types of variables that can be tested
Last example dealt with categorical IVs ie man or woman.
Can also test for interactions with continuous IVs

39
Q

Social media use

A

Question: do people who use social media a lot have less face to face time.
Positive correlation r=.12

40
Q

Question: does this change depending on personality traits.

People who are more introverted would get more face to face time with facebook use.

A

Question: does this change depending on personality traits.

People who are more introverted would get more face to face time with facebook use.

41
Q

Some of Harlow’s experiments on monkeys tested which of the following.

A

The hunger reduction model of maternal love.

42
Q

Advances in science occur in fits and starts, progress and setbacks. This concept is known the _____ model.

A

Gradual synthesis model.

43
Q

An interaction occurs when there are combined effects of two or more variables on another variable.

A

True