Lecture 5 Flashcards

1
Q

Explain operant conditioning

A
  • S-R learning
  • stimulus that follows response
  • biologically significant stimulus which strengthens bond between S and R
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Can something be rewarding but not reinforcing?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the biologically significant stimulus associated with smoking?

A

the nicotine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are learned/conditioned reinforcers associated with smoking?

A

smell of smoke, tobacco

- not rewarding at beginning but become nice with time (associated with nicotine)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are primary reinforcers?

A

stimuli needed for survival = food, water, sex

  • sensory stimulation and novelty (novelty = reinforcing)
  • not learned (reinforcing from day 1)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are secondary reinforcers?

A
Also referred to conditioned reinforcers
- a previously neutral stimulus that acquired the capacity to strengthen S-R association because it was repeatedly paired with food, or with some other primary reinforcer
E.g. chimps pressing lever for token
token --> banana
- learned
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are social reinforcers?

A

stimuli whose reinforcing properties derive uniquely from the behaviour of other members of the same species - praise, affection, attention
- usually a blend of primary and secondary reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What type of learning is involved in shaping?

A

classical conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Explain shaping

A
  1. rat looks a lever –> click –> food (repeat)
  2. rat gets close to lever –> click –> food (repeat)
  3. rat presses lever –> click –> food
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

In shaping with rats, what is the conditioned reinforcer?

A

the click

  • happens immediately after the response
  • need a powerful stimulus to condition this reinforcer effectively
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Who created the law of effect?

A

Edward Thorndike

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Explain the law of effect

A

gradual modification of non-reflexive behaviour influenced by experience
- satisfaction “stamps in” the connection between S and R

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

In operant conditioning, a strengthened bond leads to?

A

increased frequency of behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Explain Law of effect proposed by Mark Bouton

A

Instrumental learning generally works so that organisms develop responses that maximize benefit (obtain stimuli with positive incentive value) and minimize cost (prevent stimuli with negative incentive value)

–> instrumental behaviour increases or decreases depending on the environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Obtain incentive stimulus leads to?

A

reward learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Obtain aversive stimulus leads to?

A

punishment learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Prevent incentive stimuli leads to?

A

omission learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Prevent aversive stimuli leads to?

A

avoidance learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Law of effect states:

A

A response will increase if it is followed by a satisfying outcome
- the only way we know whether the outcome is satisfying is if the response increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Explain the paradoxical reward effect

A

Removal of reward –> frequency of behaviour increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Is satisfaction a necessary component to learning?

A

No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the opposite of a positive reinforcement?

A

punishment

- decreases behaviour when presenting stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the most important aspect to learning?

A

Reinforcement

- makes a behaviour more frequent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Morphine injections - reinforcing vs. rewarding

A

No self report of pleasure but continue to respond

- therefore it isn’t rewarding but is reinforcing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
What is often the cause of frustration?
Expectation of an outcome
26
What is the contiguity theory (Edwin Guthrie)?
operant conditioning when S, R and S* occur together in time
27
Explain the stop action principle
any specific bodily position and muscle movements occurring when the S* is delivered will have a higher probability of occurring in the future = superstitious behaviour
28
What are superstitious behaviours?
- followed by a reinforcer - become very frequent - no link between behaviour and reinforcer
29
What is the cognitive theory - Edward Tolman?
during operant conditioning, animals make S-S* associations - R's are highly flexible - primary role of S* = motivate behaviour
30
What is the reinforcement theory (B.F. Skinner)?
Involves a reinforcing stimulus - an event that enhances storage of information about situations in which it is encountered = "stamping in" - this increased storage increases the probability that the behaviour leading to the reinforcer will be repeated in the future (even in the absence of the reinforcer)
31
What is the memory effect?
Explains why S is presented in the future and R is more likely to occur (strengthened bonds in brain between S and R)
32
What is a reinforcer?
an event that follows a response and changes the probability that the response will be emitted in the future
33
How can an event change behaviour when the new behaviour occurs in the absence of the event?
change in behaviour that outlast the reinforcer - memory was created - acting on basis of memory
34
How in memory consolidation enhanced?
reinforcing events enhance the acquisition and storage of info in the brain - gives motivational value to surrounding stimuli - more stimuli in presence of reinforcer --> remember better
35
What is learning?
the formation of representations of the relationships among objects and events
36
What effect does a representation of a reinforcer have on behaviour?
it is motivating
37
What is a memory trace?
a trace of what was just seen/performed in the brain
38
When is a trace memory consolidated?
When it is still alive and experiences a reinforcers - acting on memory consolidation - fragile memory representation --> stable memory representation
39
What factors inhibit memory consolidation?
- learning other information - ECT - traumas
40
What factors facilitate memory consolidation?
- emotional events | - reinforcing stimuli
41
Explain the Huston passive avoidance task
Group 1: fed in their home cage immediately after training Group 2: fed in their home cage hours after training - -> Group 1 remained on the platform longer in test trial - food reinforcers influenced the animals behaviour by strengthening the representation of the contingent relationship between stepping down and shock - the animals learned nothing about the rewarding motivating properties of food
42
Effect of electrical stimulation on memory consolidation
- post training electrical stimulation of the reticular formation enhances retention of both appetitive/aversive tasks - stimulation of the MFB --> strong reinforcing properties (animals will self-stimulate these regions)
43
Explain the effect of providing drugs of abuse following training
- train rats on maze --> bring to a different room and induce intoxication (AFTER training) - wait a few days and re-test - post training drug --> better memory - dose dependent; small window for memory consolidation
44
What is motivational salience?
importance
45
Explain attribution of conditioned motivation
One effect of introducing a reinforcer into a learning situation is to confer motivating power (e.g. motivational salience) on previously non-motivating stimuli - the stimulus acquires secondary reinforcing properties --> conditioned motivator
46
When nicotine is removed, how long will smoking continue?
Cues maintain responding - something about the smoking behaviour, taste, smoke int he lungs --> reinforcing for a smoke - cues associated with nicotine become very strong reinforcers = conditioned reinforcers --> capable to maintain and attract behaviour over time
47
What is the difference between wanting and liking?
``` Reward = liking Reinforcement = wanting (motivation - drive/energy that fuels action) ```
48
How can liking be measured?
taste reactivity - sweet --> liking expression - bitter --> disliking expression
49
How can wanting be measured?
Animal going toward something
50
What is the effect of 6-hydroxydopamine lesions to the VTA (producing severe aphagia)
Dopamine depletion - as pathways degenerate, animal stops eating/drinking - stimulus is there, dopamine missing --> aren't attracted (want is going, but liking is preserved) - dopamine involved in reinforcement
51
Which of the following is false about operant conditioning? - it involves S-R associations - the response can be reflexive - it usually involves a reinforcer - it always involves reward
It always involves reward
52
Which is the reinforcing stimulus in smoking?
nicotine
53
Which of the following is true about operant conditioning?
stimuli are linked to responses
54
Satisfaction?
has a questionable role in learning
55
Which of the following is true about operant conditioning?
positive reinforcement increases behaviour
56
which of the following is true?
- drugs that stimulate dopamine enhance memory - electrical stimulation of brain dopamine is reinforcing - food enhances memory consolidation
57
Salience
importance
58
Conditioned
learned
59
Attricution
Acquisition
60
incentive stimulus
CS or US