chapter test 5 6 & 7 Flashcards
(167 cards)
1
Q
Behavior causation
A
ultimate causes
(evolutionary history); (learning history)
proximate causes
(current stimuli) ; (CNS)
2
Q
Proximate causes
A
close in time to behavior (stimulus)
3
Q
ultimate causes
A
distant in time
(learning history)
4
Q
two types of learning histories
A
pavlovian conditioning
operant conditioning
5
Q
learning
A
relatively permanent changes in environment behavior relations to certain types of experiences.
6
Q
classical conditioning is….
A
the conditioning of reflexes
two (or more) stimuli are paired
NS—–association— + –> UR
7
Q
Any behavior that is followed by pleasant is likely to be repeated, and any behavior followed by unpleasant consequences is likely to be stopped
A
the law of Effect (Thorndike’s Law)
8
Q
The Law of Effect
A
Behavior is determines its consequences
9
Q
Thorndikes experiment is can be regarded as a….
A
discrete trials
trial & error vs trial & success
10
Q
B.F Skinner
A
Operant conditioning
free operant experiment—-measuring behavior over time in restricted environment
11
Q
two term contingency operant conditioning
A
R——————–S
Response——–Stimulus (consequence)
12
Q
operant behavior
A
operates on the environment, changes the environment, and is changed as a result of the environment
13
Q
environment
A
all stimuli that affect behavior at any given moment
14
Q
a stimulus that follows a response and increases the probability of similar responses under similar circumstances
A
reinforcement procedure and process
15
Q
reinforcement (procedure and process)
A
a stimulus change follows a response and increases the probability of similar responses under similar circumstances
16
Q
the procedure of reinforcement…
A
Stimulus change follows a response
17
Q
the process of reinforcement
A
increases the probability of similar responses under similar circumstances
18
Q
one instance of behavior
A
response
19
Q
response
A
one instance of behavior
20
Q
increases the probability (rate or frequency, duration, magnitude etc), of similar responses (response class)
A
reinforcement process
21
Q
the reinforcer is added after the response (+)
A
positive reinforcement
22
Q
reinforcer is subtracted after the response (-)
A
negative reinforcement
23
Q
three characteristics to be called reinforcement
A
the behavior must be a consequence
the behavior must increase in strength
the consequence must be the reason it increases in strength
24
Q
negative reinforcement is also called…
A
escape learning
avoidance learning
25
when the aversive stimulus is present and you do something to get rid of it
escape learning
26
when the aversive stimulus is not present yet, and you do something to avoid it
avoidance learning
27
operant conditioning association example chart
Kids Behavior
S(d)----R--------S(R+)
parent's behavior
EO/S(d)-------R-----S(R-)
28
response dimension that can be reinforced
response rate (# of responses over time)
response magnitude (or intensity)
response duration (how long the response lasts)
response topography (form)
latency - the time a stimulus is presented and a total response occurs
reinforce randomness/variability/creativity of response (responding differently each time)
29
terminology
reinforcement vs. reinforcer vs. reward
30
the actual consequence
--in positive reinforcement was added
--in negative reinforcement what is subtracted
reinforcer
31
something to give to someone for a job well done
reward
32
Unconditioned (primary) reinforcers
food
water
sexual arousal
sleep
warmth/coolth
pain removal
control of environment
sensory stimulation
33
some_______reinforcers lose their effectiveness temporarily through_______
unconditioned
satiation
34
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
35
3 practical advantages of conditioned (or generalized) reinforcers
satiation doesn't occur
easier to reinforce immediately
less disruptive than primary reinforcers
36
events that naturally follow a response
are usually not deliberately mediated by other individuals
automatic reinforcers
37
variables that affect operant conditioning
contingency
temporal contiguity
reinforcer magnitude
motivating operations
38
all things equal, the greater the _____________between responses and their consequences, the quicker and stronger the conditioning
contingency
temporal contiguity
39
all things equal, the greater ___________, the quicker and stronger the conditioning (reinforcer characteristics)
reinforcer magnitude
40
all things equal, the lower the ____________, the quicker and stronger the conditioning (behavior characteristics)
response effort
41
operates on the environment, changes the environment, and is changed as a result
operant behavior
42
reinforcer
increases the probability of similar responses under similar circumstances
43
reinforcement
a stimulus change following a response with a consequence that results in an increase in the probability of similar responses under similar circumstances
44
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
45
_______ is an equal opportunity consequence
reinforcement
46
motivating operations
establishing operations
--alter the effectiveness of a reinforcer
---evoke behavior that has produced that reinforcer
47
3 term contingency motivating operations
EO----R-----S(R+)
EO----R-----S(R-)
47
(EO) Establishing operations
alter the effectiveness of a reinforcer
evoke behavior that has produced that reinforcer
motivating operations
48
high probability behaviors reinforce low probability behaviors
Premacks' Principle
49
considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors.
Premack's relative value theory
50
when deprived from engaging in a behavior below the baseline, engaging in it back to baseline becomes reinforcing to other behaviors
response-deprivation theory
51
selection by consequences
behavior like species evolves
52
reinforcement is like natural selection
Behavior evolves over time
behavior is inherently variable
Environment selects behavior
Behavior retention
53
a procedure
the differential reinforcement of successive approximation towards a final or target behavior
shaping
54
shaping:
the differential reinforcement of (2 words)__________ towards or target behavior
successive approximation
55
events that follow spontaneously from a behavior.
Natural reinforcers
56
events that are provided by someone for the purpose of modifying behavior.
Contrived reinforcers
57
the degree of correlation between a behavior and its consequence
Contingency
58
A term used to refer to the strength of a reinforced behavior.
Behavioral momentum
59
the gap in time between a behavior and its reinforcing consequence
Temporal contiguity
60
anything that changes the effectiveness of a con- sequence
Motivating operation
61
The reward center of the brain, in particular, an area in the septal region running from the middle of the brain to the frontal cortex where dopamine is the most important neurotransmitter
Reward pathway/dopamine
62
attributes a reinforcer’s effectiveness to the reduction of a drive.
Hull’s drive reduction theory
63
High-probability behavior reinforces low-probability behavior.
Premack principle
64
behavior becomes reinforcing when the individual is prevented from engaging in the behavior at its normal frequency.
Response deprivation theory
65
the reinforcement of successive approximations of a target (desired) behavior
Shaping
66
the process of reinforcing each of a series of related behaviors to form a behavior chain
Chaining
67
procedure of breaking a task down into its component elements
Task analysis
68
begin chaining by reinforcing performance of the first link in the chain
Forward chaining
69
begin chaining with the last link in the chain and work backward toward the first component (link)
Backward chaining
70
A series of related behaviors, the last of which produces reinforcement
Behavior chain –
71
a situation in which reinforcement is available but the behavior necessary to produce it is not
Problem
72
the response that produces reinforcement
solution
73
a sudden appearance of the solution (in the mind?)
Insight
74
novelty
Common feature (of creativity)
75
Common feature (of creativity)
novelty
76
any behavior that occurs repeatedly even though it does not produce the reinforcers that maintain it
Superstitious behavior
77
The tendency to give up on a problem as a result of previous exposure to insoluble problems
Learned helplessness
78
The tendency to persist at a problem as a result of previous reinforcement of persistence at difficult problems
Learned industriousness
79
a procedure in which a sequence of responses that make up a more complex chain is reinforced
chaining
80
a series of responses that occur consecutively
behavior chain
81
Behavior chain example chart
conditioned reinforcement S(D)------R---->S(r+)
Unconditioned reinforcement
S(D)-------R--------S(R+)
82
Chaining
1. construct a task analysis (TA): breakdown all steps of behavior chain
2. reinforce one response in the chain at a time until it occurs, then reinforce when two responses occur, then when three
Two chaining procedures
---forward chaining
---backward chaining
83
when there is a reinforcer available but no behavior available to produce the reinforcer
problem
84
the response that produces the reinforcement
solution
85
the use of imaginations or orignal ideas
reification--making something abstract concrete or real
creativity
86
randomness (a dimension of behavior)--can be reinforced
novelty
87
based on the definition of (reinforcement),
why does it seem absurd that reinforcement can increase novel behavior?
similarity is random
88
as acquisition of behavior
Most people use the term learning
89
changes in which no new behavior occurs
changes in the pattern of behavior
Learning includes
90
rules describing the contingency between behavior and reinforcement
Schedule of reinforcement
91
distinctive patterns of behavior (produced by different schedules)
Schedule effects
92
a behavior is reinforced every time it occurs (or every response produces a reinforcer)
Continuous schedule (of reinforcement
93
reinforcement occurs for some responses but not others.
Intermittent schedule
94
Four simple schedules of reinforcement
FR - Fixed Ratio
VR - variable ratio
FI - Fixed interval
VI - variable interval
95
reinforcement occurs after a set (or fixed) number of responses.
Fixed ratio
96
reinforcement occurs after an average number of responses
Variable ratio
97
reinforcement occurs after the first response after a set (or fixed) amount of time.
Fixed interval
98
a pause after reinforcement
Post-reinforcement pause
99
reinforcement occurs after the first response after an average amount of time.
Variable interval
100
the rate at which behavior occurs once it has resumed following reinforcement
Run rate
101
reinforcement is withheld from a previously reinforced behavior (or a schedule which no responses are reinforced)
Extinction
102
a sudden increase in the response dimensions of a behavior when reinforcement is withheld
Extinction burst –
103
the reappearance of previously reinforced behavior
Resurgence
104
the sudden reappearance of behavior following extinction and a period of time
Spontaneous recovery
105
other simple schedules
FT - fixed time
VT - variable time
FD - fixed duration
VD - variable duration
progressive ratio schedule
break point
106
reinforcement is delivered after a fixed amount of time regardless of what behavior occurs
fixed time
107
reinforcement is delivered after an average amount of time regardless of what behavior occurs
Variable time
108
reinforcement is contingent on the continuous performance of a behavior for a fixed period of time
Fixed duration
109
reinforcement is contingent on the continuous performance of a behavior for an average period of time
Variable duration
110
the requirement for reinforcement increases in a predetermined way following each reinforcer
Progressive ratio schedule –
111
the point which behavior stops on a progressive schedule
Break point
112
the procedure of gradually increasing the number of responses required to reinforcement
Stretching the ratio
113
the disruption of the pattern of responding due to stretching the ratio too abruptly
Ratio strain
114
6 types of complex schedules
multiple schedules
mixed schedules
chain schedule
tandem schedule
cooperative schedule
concurrent schedule
115
two or more simple schedules alternate each associated with a particular stimulus
Multiple schedule
116
two or more simple schedules alternate with neither associated with a particular stimulus
Mixed schedule
117
reinforcement is delivered contingent on the completion of the last in a series of schedules each associated with a different stimulus
Chain schedule
118
Reinforcement is contingent on the completion of a last in a series of schedules none of which is associated with a particular stimulus
Tandem schedule
119
reinforcement is dependent on the behavior of two or more individuals
Cooperative schedule
120
two or more schedules are available simultaneously
Concurrent schedule
121
the tendency of behavior to be more resistant to extinction following intermittent reinforcement than continuous reinforcemen
Partial reinforcement effect
122
the principle that the rate of responding on two or more reinforcement schedules will match the rate of reinforcement on each schedule
Matching law –
123
the rules describing the contingencies change systematically
progressive schedules
124
schedules in which the requirement for reinforcement increases in a predetermined way
progressive ratio schedule
125
the rate of responding (# response/times)
the pattern of responding
schedule effects
126
five schedules of reinforcment
Continuous schedule
1.CRF (FR1) - continuous reinforcement
Intermittent schedules
2. FR - fixed ration
3. VR - variable ratio
interval schedules
4. FI - fixed interval
5. VI - variable interval
127
leads to fast aquisition of response
high response rate
good to use when shaping/teaching new behavior
CRF characteristics
128
CRF is the same as....
FR- 1 (fixed ratio of 1)
129
a fixed or set number of response is reinforced
fixed ratio
130
the two effects of schedules that we are going to look at...
rate and pattern of responding
131
characteristics of FR schedules
high response rate
--overall rate
--run rate
break and run pattern of responding
132
break and run =.....
pause and respond
133
why is there a pause____
there is a relationship to amount of effort and the lenght of the pause
pre-ratio pause
post reinforcement pause
134
the rate of response which includes the pauses -r/t
overall rate
135
the rate minus the pauses -r/t-prp
run rate
136
an average number of responses is reinforced
variable ratio
137
total responses divided by number of total reinforcers, (or)
sum of individual FR values divided by the total FR schedules
VR - variable ratio
138
characteristics of VR schedules
high, steady response rate
no PRP, except when there is no low FR in the series
139
high, steady response rate
no PRP, except when there is a low FR in the series
characteristics of VR schedules
140
generates persistent behavior
VR Schedules
141
the first response that occurs after a specific interval produces reinforcement
FI - fixed interval schedules
142
After every minute minute, the first response is reinforced
FI - 1 min
143
Moderately high response rate
A scalloped shaped curve pattern
FI - characteristics
144
FI - characteristics
Moderately high response rate
Scallop-shape curve pattern
145
the number of response over time
rate
146
the first response after an average amount of time produces reinforcement
VI - variable interval
147
characteristics of VI - variable interval schedule
low, steady rate of responding
consistent responding with few or very short pauses
148
VR schedule examples
sales person working on commission
gambling
pick up lines
applying for jobs
149
VI - variable interval real-life examples
refreshing your new social media app
checking emails
fishing
150
FR schedule real life examples
assemble 10 beams for fence and your done for the day and get paid
passcode on phone: FR 4/6 for 4/6 code password an so on
151
a schedule in which 0 reinforcers are delivered for responding
a schedule in which no response produces a reinforcer
witholding ____________( from a previously_________ behavior
extinction
reinforcement
reinforced
152
extinction Burts
decrease in the probability of similar responses under similar circumstances
extinction effects
153
momentary (immediate) increase in..
response rate
magnitude
duration
variability - shaping
emotional responding
extinction burst characteristics
154
the _______ of extinction depends on the _________ of reinforcement for the ___________ behavior
rate
history
extinguished
155
the rate of extinction depenents on the history of reinforcement for the extinguished behavior
frequency of reinforcement
magnitude of reinforcement
response effort
schedule of reinforcement
156
extinction will proceed faster if....
the frequency and magnitude of reinforcement and a response effort are low, and the schedulee is a CRF
157
behavior on an intermitten schedule is more diffiuclt to extinguishe than one on CRF
PRE - partial reinforcement extinction effect
158
response-independent schedules
FT - fixed time schedule
VT - variable time schedule
159
stimulus that has been shown to be a reinforcer is delivered after a fixed amount of time
Fixed time (FT)
160
A stimulus that has been shown to be a reinforcer is delivered after an average amount of time
Variable time
161
Two or more simple schedules are combined.
Compound Schedules
161
Two or more simple schedules, each associated with a different stimulus, are completed sequentially
Chain Schedule
162
Two or more simple schedules, not associated with different stimuli, are completed sequentially.
Tandem schedule
163
Spontaneous_____ after ________ and a period of _________, the extinguished behavior__________ under similar circumstances
recovery
extinction
time
recovers
164
gradually increasing the number of responses required for reinforcement (shaping response rate)
stretching the ratio
165
rapid increase in the response requirement
ratio strain
