Module 20: Operant Conditioning

Question 1

Learning

Answer 1

The process of acquiring through experience new and relatively enduring information or behaviors.

Question 2

Associative learning

Answer 2

Learning that certain event occur together. The events may be two stimuli (as in classical conditioning) or a response and its consequence (as in operant conditioning).

Question 3

Stimulus

Answer 3

Any event or situation that evokes a response.

Question 4

Respondent behavior

Answer 4

Behavior that occurs as an automatic response to some stimulus.

Question 5

Operant conditioning

Answer 5

A type of learning in which a behavior becomes more likely to recur if followed by a reinforcer or less likely to recur if followed by a punisher.

Question 6

Operant behavior

Answer 6

Behavior that operates on the environment, producing consequences.

Question 7

B.F. Skinner

Answer 7

Modern behaviorism’s most influential and controversial figure.

Question 8

Law of effect

Answer 8

Thorndike’s principle that behaviors followed by favorable consequences become more likely, and that behaviors followed by unfavorable consequences become less likely.

Question 9

Operant chamber

Answer 9

In operant conditioning research a chamber (also known as a Skinner box) containing a bar or key that an animal can manipulate to obtain a food or water reinforcer; attached devices record the animal’s rate of bar pressing or key pressing.

Question 10

Reinforcement

Answer 10

In operant conditioning, any event that strengthens the behavior it follows.

Question 11

Shaping

Answer 11

An operant conditioning procedure in which reinforcers guide behaviors toward closer and closer approximations of the desired behavior.

Question 12

Positive reinforcement

Answer 12

Increasing behaviors by presenting positive reinforcers. A positive reinforcer is any stimulus that, when presented after a response, strengthens the response.

Question 13

Negative reinforcement

Answer 13

Increasing behaviors by stopping or reducing aversive stimuli. A negative reinforcer is any stimulus that, when removed after a response, strengthens the response.
- is not punishment!

Question 14

Primary reinforcer

Answer 14

An innately reinforcing stimulus. Such as one that satisfies a biological need.
- Getting food when hungry

Question 15

Conditioned reinforcer

Answer 15

A stimulus that gains its reinforcing power through its association with a primary reinforcer; also known as a secondary reinforcer.
- Money

Question 16

Delayed reinforcers

Answer 16

• Before performing wanted behavior, rat will perform many unwanted behaviors
• If you present food immediately after one of these unwanted behaviors, the rat will repeat the rewarded behavior.
• Humans can respond to delayed reinforcers –> paycheck at the end of the week.

Question 17

Reinforcement schedule

Answer 17

A pattern that defines how often a desired response will be reinforced.

Question 18

Continuous reinforcement

Answer 18

Reinforcing the desired response every time it occurs.

• Learning occurs rapidly, but so does extinction
• When reinforcement stops, the behavior soon stops

Question 19

Partial (intermittent) reinforcement schedule

Answer 19

Reinforcing a behavior only part of the time; results in slower acquisition of a response but much greater resistance to extinction than does continuous reinforcement.

• Slot machines reward gamblers occasionally and unpredictably
• Best procedure for making a behavior persist

Question 20

Fixed-ratio schedules

Answer 20

A reinforcement schedule that reinforces a response only after a specified number of responses.

• Every so many
• Reward us with free drink after every 10 purchased

Question 21

Variable-ratio schedules

Answer 21

A reinforcement schedule that reinforces a response after an unpredictable number of responses.

• What slot machine players experience
• Also what makes it so hard to extinguish even when they don’t produce desirable results.

Question 22

Fixed-interval schedules

Answer 22

A reinforcement schedule that reinforces a response only after a specified time has elapsed.

• Every so often
• Reinforcement for behavior after a fixed time
• Tuesday discount prices

Question 23

Variable-interval schedules

Answer 23

A reinforcement schedule that reinforces a response at unpredictable time intervals.

• Unpredictably often
• The longed-for message that finally rewards persistence in checking our phones.

Question 24

Punishment

Answer 24

An event that tends to decrease the behavior that it follows.

Question 25

Positive punishment

Answer 25

• Administer an aversive stimulus

- Traffic ticket for speeding

Question 26

Negative punishment

Answer 26

• Withdraw a rewarding stimulus

- Take away teen’s driving privileges