Brainscape's Knowledge GenomeTM


Top Flashcards (Certified)
All Flashcards

351 - Fundamentals of Learning > Schedules of Reinforcement > Flashcards

Schedules of Reinforcement Flashcards

1
Q

in the real world, instrumental responses _____ get reinforced each time they occur
what is the name for this concept

A

rarely
intermittent schedules of reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is a schedule of reinforcement and what do they determine for the isntrumental bhv

A

program or rule that determines which repsonse is followed by delivery of the reinforcer

rate pattern and persistence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what could a delivery of a reinforcer depend on

A

occurance of a certain nb of responses
time
presence of certian stimuli
occurrence of other responses
combination of these factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what do the different delivery of reinforcer schedules influence

A

how an isntrumental response is learned
how it is maintained
pattern of responding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

schedules of reinforcement are highly relevant to the ______ of bhv

A

motivation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

T or F: whether someone works hard or is lazy depends on their personality

A

F: more on schedule of reinforcement used

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what are some human applications for scheduled reinforcements for motivation

A

employers, workers, teachers, students

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

how are schedules of reinf studied in the lab

A

skinner box

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

who discovered brain stimulation reward (BSR)

A

Olds and Milner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what did Olds and Milner find

A

rats press lever for electrical stimulation of certian areas in the brain (brain stimulation reward)
- self-stimulate till exhaustion (ignore food and water)
- press lever at very high rates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

which areas of the rbain support self-stimulation

A

multiple

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

T or F. some sites of the brain sustain self-stim, while others are aversive

A

T

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how often were animals reinforced in the first experiments

A

for every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is the simplest form of operant bhv

A

fixed ratio 1 (FR1) / continuous reinforcement (CRF)
1 pellet delivered/press of lever

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is an exmaple of continuous reinforcement

A

contingency management programs for substance use treatment (reward for clean urine test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what was the problem with FR1

A

time and resource consuming, dont need to reinforce every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is a simplle reinforcement schedule

A

1 single factor determines which occurrence of the instrumental response is reinforced (module 1 thing at a time)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what is the name for when reinforcement is not provided on every response

A

partial reinforcement (intimate reinf)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what factors can be manipulated in operant responding schedules

A

ratio: nb responses required for reward
interval: time/delay btw each reward

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

how can the ratio and interval variables vary

A

fixed or variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what are ratio schedules based on

A

ratio of responses required to recieve reinforcem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is FR

A

fixed ratio schedule: reinforcm delivered after specific nb of responses
FR5: reinforcem every 5 responses
FR1: every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what do fixed ratio schedules cause in bhv

A

post-reinfrocem pause (PRP): break in responding after each reinforcer
(Pre-ratio pause)
relates to procrastination

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what is VR and RR

A

Variable ratio: nb presses required is unpredictable but varies around some mean (4,3,5,2,1 wihtout replacem)
random raito: with replacem, 1,2,3,4 or 5 every time
RR6: reinf every 4,5,6,7,8 repsonses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
T or F. the range of the VR can vary
T
26
what are life examples of variable ratio schedules
gambling, golfing, fishing
27
what is FI + example
fixed interval: reinf for the 1st press after a fixed delay FI2: reinf given 2min after 1st repsonse paid/hour
28
what is VI + example
variable itnerval: reinf for 1st press after variable delay VI10: reinf given 8,9,10,11,12 min after 1st response self-employed, uber: will make average hourly rate, but some hours better than others
29
example of FI vs VI for exams, which would u study more for
FI: fixed exams VI: pop quizes +++
30
all ratios and intervals besides FR1 are cases of ____ ______
partial reinforcm: not every response is rewarded
31
why have so many different ratio schedules
different learning techniques
32
what is the best schedule for initial learning
FR1: fast, easy if FR10 initially, will take a long time for animal to understand what to do
33
disadvantage of FR1
satiety and reduced effort cuz so easy
34
what is the best way to get steady continuous bhv
variable raito and interval cuz cant predict, just always work cuz it might be just 1 away
35
which (interval or ratio) produces steady reliable bhv over long periods of time
interval schedules
36
Most jobs are on what type of schedule
fixed interval
37
which schedule (I or R) will deliver higher rates of responding and why
ratio schedule promote shorter inter-response times (IRT)
38
what is Inter-response times (IRT) and how do they vary in ratio and interval schedules
time btw 2 responses being reinforced Ratio: rapid responding = reinforced Interval: reinforced only after allotted time, doesnt promote higher response rates
39
which schedules provides more direct feedback function on performance
ratio the more u work the more u get rewarded interval: limit of rew in given time, (max)
40
in ___ schedule, u cant increase reinf rate above a certain limit no matter how much ++ response
interval
41
what jobs are on ratio schedule
doctors, lawyers, hairdressers $ depend on nb of clients can lead to burnout
42
what jobs are on interval schedules
maxi, post office +effort =/= +$ only hope hard work is recognized and results in raise
43
is variability/uncertainty rewarding itself?
yes,
44
does variability promote gambling bhv
yes by sensitixing our rew pathways (amphetamine)
45
variable or fixed ratios are a source of stress and anxiety
variable
46
what happens if u progressively increase ratio/interval
discouraged, give up
47
what technique is used to measure motivation
progressive ratio (PR) nm repsonses for rew increases every trial
48
what is the end point measured in progressive ratio
break point (BP): last ratio attained BEFORE giving up
49
what is an example of progressive ratio in life
$ pay for a coffe effort in studying
50
what imp finding of pigeons in a pelican
still have bhv 6 yrs later
51
why did pigeons in pelican fail
public perception, technological advances
52
how are choices in real life more complex
constantly making decisions nb of choices are extensive reinforcements are diverse
53
how do we study decision-making
concurrent schedule: choose btw 2 response alternative, each reif on its own schedule of reinf (at the same time)
54
T or F. in a concurrent schedule, animal needs to chose 1 at a time
F. animal is free to change back and forth btw response at any time
55
what is best option: VI60 or FR10?
FR if easy VI if hard min effort for max rew
56
how to calculate response rate
Bl/(Bl+Br)
57
distribution of bhv in concurrent schedules is influenced by _____ ________
reinf schedules
58
can the reinf rate be calculated
rl/(rl+rr)
59
T or F. when reinf schedules on both options are the same, response and reinf rate will likely match
T
60
what happens in concurrent schedules when 2 response alternative are not reinf on same schedule
matching law: relative rate of response on a particular repsonse doesnt depend on rate of reinf of that response alone, depends on rates of reinf of other alternative activities the ind may perform we always favor best reinf, but always do both to check we are not missing anything schedules we use to motivate ppl have to account for alternatives in their environment
61
when does matching law not apply
undermatching: reduced sensitivity to particular resp or reinf - dont chose it so often cuz less valuable - sick of chocolate, so wont do bhv to get it anymore, too tired to do physical activity overmatching: response bias to particular type of resp or reinf - chose more cuz resp or outcome is prefered - prefer to walk longer than sprint short - prefer to get ice cream than chocolate
62
what is choice with commitment
once selection is made, other alternatives no longer available (university) (apt)
63
how is choice with commitment tested in animals
concurrent-chain schedules - choice link: chose A or B schedule - terminal link: B closed till A is completed (commitment)
64
if given choice of A: VI and B:FI, which is more popular
VI prefered over FI for same overall rate of reinf overvalue immediate rew even if less often
65
do we always chose most optimal outcome when given choice
no, can be made to choose suboptimal ex: 1. 0.2=1 ; 0.8=0 2. 0.2=0.5 ; 0.8=0.5 2. is overall more beneficial, but we take 2 cuz there is certainty. we understand what the markers predict, sense of control (intolerance to uncertainty)
66
what is self-control
complex choice choose large delayed rew or immediate small rew
67
why is it hard to motivate to do work for large but delayed rew
we want immediate delay discounting: value of reinf declines w/ time (25$ today or 50$ in 2 yrs)
68
delay discounting can also act as a measure of ____
impulsivity
69
how can we measure self-control
choice btw 2 levers: 2 now vs 4 later effort stays the same (press lever)
70
why would keeping lever be problematic for self-control experiment
animal wont be able to determine what schedule is
71
what type of function does delay discounting take mathematically
hyhperbolic decay
72
what does the delay discounting equation say
big delay = small value big magnitude = less affected by time rapid decline as time goes, then more steady
73
what can be inferred from delay discounting
when choice of immediate rew = delay rew: rate of discount
74
what does delay discounting depend on
impulsivity high : 100$ = 50$ in 10 days low: 100$ = 5$ in 10 days
75
what modification of delay discounting experiment makes it easier to have self-control
increasing delay for small and big rew if u have to wait for both, will be willing to wait longer for big rew
76
how does delay discounting vary with age
wait more with age, less impulsive
77
what is low delay discounting rate correlated with
high IQ, education level, income, GPA
78
what is the relation btw delay discounting and addiction
steeper delay discounting correlates with addiction cause or consequence
79
how to determine if addiction or delay discounting comes first
longitudinal study: low self-control is predictive of drug abuse
80
T.F. self control can be trained
yes, by repeatedly using delayed rew

351 - Fundamentals of Learning (11 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2025 Bold Learning Solutions. Terms and Conditions