Unit 3 Flashcards

1
Q

Thorndike

A

Supernormal psychology of animals, law of effect
chicks and cats

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Law of Effect
+4 elements

A

Behaviour is a function of consequences.
Four key elements: environment, behaviour occurring, change in environment post-behaviour, change in behaviour produced by this consequence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Metzgar

A

Released mice into habitat. Followed up with more mice, then released an owl; knowing the environment paid off.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Skinner Box

A

Chamber with a food-magazine that drops pellets of food into a tray

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Operant Learning

A

instrumental learning, response learning, consequence learning, R-S learning;
when behaviour is altered by consequence
- behaviour is operating on environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Reinforcement

A

increase in strength of behaviour due to consequences
Reinforcement = ↑Strength of behaviour ∵Consequences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Catania’s requirements

A

three req for experience to qualify as a reinforcement
1. Behaviour must have consequence
2. Behaviour must increase strength
3. Increased strength must be ∵ of the consequence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Positive reinforcement

A

consequence of behaviour is the appearance/increase in intensity of stimulus
behaviour -> reinforcer -> increase behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Positive reinforcer

A

Stimulus in positive reinforcement.
Usually sought out or positive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Reward learning

A

aka Positive Reinforcement; consequences are considered rewarding
Skinner dislikes this term

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Negative reinforcement

A

the consequence of a behaviour is the decrease of intensity or removal of a stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Negative reinforcer

A

Stimulus in negative reinforcement; usually escaped or avoided

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Escape learning

A

aka Negative reinforcement from escaping

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Behavioural momentum

A

Nevin’s term - behaviour that is reinforced many times is more likely to persist when obstructed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Primary reinforcers

A

Innately effective; Baum “phylogenetically significant events”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Unconditioned reinforcers

A

aka Primary Reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Satiation

A

when reinforcers lose their effectiveness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Secondary reinforcers

A

not innate but rather are the result of learning experiences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Conditioned reinforcers

A

aka secondary reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Generalized reinforcer

A

a reinforcer paired with other reinforcers
e.g., money

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Natural reinforcer

A

spontaneously follow a behaviour
brush your teeth -> mouth feelings clean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Automatic reinforcers

A

aka natural reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Contrived reinforcers

A

provided for the purpose of behaviour modification

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Motivating operation

A

anything that changes the effectiveness of a consequence
two types

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Establishing operations

A

increase the effectiveness of a consequence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Abolishing operations

A

decrease the effectiveness of a consequence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

ESB

A

electrical stimulation of the brain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Reward pathway

A

the septal region that separates the cerebral hemispheres

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Dopamine

A

NT, precursor of epinephrine (adrenaline)

30
Q

Hull’s Drive-Reduction Theory

A

Suggests that reinforcers decrease drives, and that is where their value comes from

31
Q

Drives

A

Innate motivational states; e.g., hunger

32
Q

Premack’s Relative Value Theory

A

All behaviours have relative values and these values determine the reinforcing properties

33
Q

Premack principle

A

high-probability behaviour reinforced low-probability behaviour

34
Q

Response-deprivation Theory

A

Suggests that each behaviour has a baseline and when the baseline is not met, the individual will engage in behaviours to increase the desired behaviour.

35
Q

Two-Process theory

A

negative reinforcement theory; pavlovian and operant learning

36
Q

Sidman’s avoidance procedure

A

rats avoid shock by pushing a lever - two-process theory - there is no escape, so why does the rat press the lever? What reinforces it?

37
Q

One-process theory

A

Operant learning avoidance theory

38
Q

Thorndike studied animal learning as a way of measuring animal _____.

A

intelligence

39
Q

According to Thorndike’s law of _____, the strength of a behaviour depends on its _____.

A

effect
consequences

40
Q

Positive and negative reinforcement have this in common: Both _____ behaviour.

A

strengthen

41
Q

The defining feature of primary reinforcers is that they are not dependent on_____.

A

learning

42
Q

_____ refers to the likelihood that a reinforcer will follow a behaviour.

A

Contingency

43
Q

In general, the more you increase the amount of a reinforcer, the _____ benefit you get from the increase.

A

less

44
Q

A motivating operation is anything that change the effectiveness of a _____.

A

reinforcer

45
Q

Positive reinforcement is associated with the release of _____ in the brain.

A

dopamine

46
Q

According to the Premack principle, _____ behaviour reinforces _____ behaviour.

A

high-probability

low-probability

47
Q

According to the response-deprivation theory, schoolchildren are eager to go to recess because they have been deprived of the opportunity to _____.

A

move

48
Q

The two processes in the two-process theory are _____ and _____.

A

Pavlovian conditioning

Operant learning

49
Q

Shaping

A

the reinforcement of successive approximations of a desired behaviour

50
Q

Behaviour Chain

A

a sequence of behaviours that is connected

51
Q

Chaining

A

teaching a behaviour through steps:
task anaylsis -> forward/backward chaining

52
Q

Task analysis

A

The breakdown of a task into component elements

53
Q

Forward chaining

A

reinforce performance of the first link in the chain. Repeat until task is performed without hesitation, then add another task.

54
Q

Backward chaining

A

beginning with the final link in the chain and repeating until perfected. Then added the second to last (second to last -> last) until perfected. Repeat.

55
Q

Problem

A

A situation where reinforcement is available but the necessary behaviour is not.

56
Q

Superstitious behaviour

A

any behaviour that occurs repeatedly even without reinforcers to maintain it

57
Q

Learned helplessness

A

learning to be helpless

58
Q

Learned industriousness

A

learning to not quit

59
Q

Shaping is the reinforcement of successive _____ of a desired behaviour.

A

approximations

60
Q

What are parts of the chain known as brushing one’s teeth?

A

going to bathroom, getting toothbrush, getting tooth paste, applying toothpaste to tooth brush, wetting toothbrush, brushing teeth

61
Q

How would you use backward chaining to train a rat to run a maze?

A

put reward at the end of the maze
release rat very close to end
after success, release slightly further from reward, repeat

62
Q

Two forms of chaining are _____ and _____.

A

backward
forward

63
Q

A problem is a situation in which _____ is available, but the behaviour necessary to produce it is not.

A

a reinforcer

64
Q

Harlow’s data show that “insightful” solutions may be arrived at _____ as a result of a number of learning experiences.

A

gradually

65
Q

The experiment by Epstein and colleagues demonstrated that insightful problem solving is largely a product of _____.

A

reinforcement/ reinforcement history

66
Q

The idea of increasing creativity by means of reinforcement seems illogical at first because reinforcement _____ .

A

strengthens a behaviour that occurs

67
Q

How could an auto manufacturer increase the creativity of its designers?

A

contingency between innovative designs and reinforcing consequences
e.g., time off or bonuses or royalties for original design

68
Q

Superstitious behaviour by definition does not produce _____.

A

reinforcers to maintain it

69
Q

Exposure to _____ aversives leads to learned helplessness.

A

inescapable

70
Q

Learning industriousness is the opposite of _____ .

A