lol Flashcards
(106 cards)
1
Q
what is intelligence?
A
what you do when you dont know what to do - piaget
2
Q
intelligence theories?
A
IQ, Catell (fluid vs. crystallized), specific vs. general, instrumental vs. social affective
3
Q
aristotle?
A
an empiricist, formed first theory of associationism, argued that memory is dependent on associations between pairs of events - so recalling one member of the pair elicits anticipation of the other!
4
Q
aristotle vs plato!
A
draw it out idiot
5
Q
aristotles questions?
A
- how are associations made
- emergence of nature/nurture
- questions abt. learning in humans/animals
- are learning and memory universal?
6
Q
classical vs. instrumental condtioning!
A
draw it out idiot
7
Q
3 major dopaminergic pathways in brain (main one?)
A
mesolimbic
8
Q
instrumental conditioning for thorndike
A
law of effect
- it is about S-R learning
- association strengthened if S followed by satisfying event
- association weakened if S followed by annoying event
9
Q
importance of outcomes (all four)
A
- reward: produces good outcome
- punishment: produces bad outcome
- omission: prevents good outcome
- avoidance/escape: prevents bad outcome
10
Q
importance of outcomes chart!
A
draw it out idiot
11
Q
+ reinforcement
A
response produces appetitive S, reinforcement
12
Q
+ punishment
A
response produces aversive S, punishment
13
Q
(- reinforcement
A
response eliminates occurence of aversive S, reinforcement (escape)
14
Q
(- punishment
A
response eliminates occurence of appetitive S, punishment (omission)
15
Q
sign tracking chart
A
draw it out idiot
16
Q
pavlovian classical example
A
bell (CS) —- Food (US)
\ \
\ \
\ \
salivate (CR) salivate (UR)
17
Q
what is generalization?
A
when one CS generalizes to another!
18
Q
two historic views of classical conditoning?
A
SR and SS
19
Q
SR learning (Drawn out)
A
bell (CS) Food (US)
\
\
\
salivate (CR) salivate (UR)
20
Q
SS learning (Drawn out)
A
bell (CS) ——–> Food (US)
salivate (CR) salivate (UR)
21
Q
temporary separation of CS/US in classical conditioning leads to
A
decrease in sign tracking, increase in goal tracking
22
Q
what type of tracking is resistant to outcome devaluation
A
sign tracking!
23
Q
is it possible to respond to a CS that was never paired with the US (mechanism)?
A
US devaluation
- higher order conditioning
- sensory preconditoning
24
Q
dog bite scenario!
A
draw out idiot
25
generalization
tendency to respond the way way to different but similar stimuli
26
higher (second order conditoning)
when CS can elicit CR without being paired with US
- additional NS presented after initial NS has been paired with US to elicit CR
27
sensory preconditioning
initially paired two NS, pairing one with US. if the other can elicit a response than sensory preconditoning has occurred
28
emotional classical conditioning: fear in rats
conditioned response is often freezing. The CS supresses bar pressing >> response is supressed. suppression is the DV of conditoned fear
29
supression ratio
( responding CS) / (responding CS + responding pre-CS)
30
what type of tracking is autoshaping in pigeons?
sign tracking!
31
strength of conditioning (4)!
1. timing
2. novelty of CS/US
3. intensity of CS/US
4. pseudoconditoning
32
four types of CS/US associations
delay
trace
simultaneous
backwards
33
best timing for conditoning
short ISI's (interstimulus intervals), long ITI's (intertrial intervals)
34
two types of counterfeit conditoning
sensitization
pseudoconditioning
35
how to win CS competetion?
1. be more noticeable -- overshadowing
2. be there sooner -- blocking
36
opposite of overshadowing?
compound potentation
37
what is compound potentiation?
when there is more conditoning to a weak stimulus if combined with a salient stimulus
38
difference between overshadowing and blockign
overshadowing occurs only in one phase
39
learning only occurs when...
CS provides new info on US!
40
rescorla/wagner (key!)
US modulation, blocking, surprise
41
mackintosh (key!)
CS modulation, attention, latent inhibtion
42
pearce-hall (key!)
US nd CS modulation, attnetion, negative transfer
43
Wagner (SOP and AESOP) (key!)
priming, affective dimension
44
rescor wagner three types
1. novel CS -- US: US is unexpected, positive prediction error, larger error = greater learning
2. well learned CS -- US: expected, no error prediction, no learning!
3. CS-US association -- no US: absence is unexpected, negative prediction, decreased association
45
what did rescorla/wagner contribute habituation to?
decrease in stimulus suprise with self and retrieval priming
46
RW assumption
CSs compete for associative weight - surprise dimension!
47
mathematical dimension (Draw it first)
delta V = change in associative strength
alpha = CS saliency
beta = US saliency
lambda = ceiling (asymptote of learning
V = learning parameter (how well CS predicts US)
[ lambda - V ] = surprisingness of US
48
when does V decrease?
with extinction!
49
what will strong US impact
associative strength or lambda
50
what will salient CS impact
rate of learning!
51
suppression ratio?
less learning with high suppression ratio. if new stimulus is presented with another that was previously conditioned, little or no conditioning will occur (high suppression ratio)
52
trick to get very efficient extinction
combine CS with other excitators!
53
comparator theory
conditioning to context is fundamental to contingency
(CS US and context are associated)
54
comparator theory doesnt explain
extinction of inhibition, latent inhibition, issues with blocking
55
low suppression ratio =
more conditioning
56
what does comparator theory suggest
we learn to ignore redundant predictors of US, abt the ineffectivenss of CS
57
mackintosh model what is key
alpha (CS saliency) is key!
58
pearce-hall?
pairing a CS with a weak US slows down condiioning when CS is paired with a strong US -- negative transfer
59
pearce hall important!
organisms attent ot uncertain predictors! surprise!
60
kaye/pearce
suprisingness of US matter, alpha is high, exlpains negative transfer and latent inhibition
61
hybrid attnetional models (combo)
1. cues with high predictive value (mackintosh)
2. cues high in uncertainty (pearce-hall)
+ RW: surprisingness of US+CS!!!
62
primed stimulus
= less suprising
63
two types of priming
- self-generated (Via sensory memory)
- retrieval-generated (from long term memory via. retrieval)
64
what kind of priming is blocking?
retrieval generated!
65
SOP
originally PDP, standard operating procedure (sometimes oppenent process), address time, connectionist model
66
both types of priming can...
reduce surprise
67
what does SOP suggest
1. processing is parallel not serial
2. processing is distributed not localized
68
AESOP
affective extention of SOP, adds emotional qualities
CS gets linked to sensory and affective nodes!
69
contiguity?
CS occurs with US
70
contingency?
CS predicts US
71
classical vs. AESOP view of dog bite!
draw out idiot
72
pearce said AESOP is...
configural - the whole set is conditioned to US
73
what does adding diff CSs do?
weaken the value, eg. only AB loses 33% of conditioning
74
classical vs. operant
operant outcome is contingent on response. both have learning curve, both have extinction.
75
who believes in contiguity and what is at its core
guthrie, stimulus elemtns
76
thorndike
guthrie
tolman
thorndike: S-R, rewards enforce
guthrie: S-R, rewards are very salient
tolman: S-S, rewards motivate
77
two main methods of skinner box
1.discrete trial: many stand alone trials, controlled by experimenter
2.free-operant: animal controls apparatus
78
EDT advantages and disadvantages
- adv. less mistakes, no negative emotions, very fast training
- Dadv. modifications/reversals in training are difficult
79
conditoned/secondary reinforcers are
like clicker. classically conditioned discriminative stimulus.
clicker = pavlovian for food
80
negative contrast?
human and animals both sensitive to reinforcers of different vlues
81
why use clicker (3)?
1. necessary bc of distance
2. spatital/temporal precision is necessary
3. training behaviour chains
82
types of schedules
fixed ratio
variable ratio
fixed interval
variable interval
83
best schedules?
variable ratio, variable interval
84
other types of schedules?
compound
1. mixed - alternating 2
2. multiple - alternating 2 types, w diff DS
3. tandem - one then next
4. chained - tandem/multiple + diff DS
85
what is matching law (when organism chooses)
rate of responding on a particular choice will match the relative role of reinforcement on that choice
- eg. pigeon pecks twice as much at lever every 1 min compared to 2min
86
what explains matching law?
1. animals trying to maximize reinforcement
2. melioration = improve local rate of reinforcement
87
drive reduction
hull, homeostatic, deficit, incentives
88
premack
differential probability - contingency
- more probable responses reinforce less probable responses
89
behavioural regulation
bliss point, about max reinforcement
90
selection by consequences
learning is like natural selection -- only an analogy
- needs trait and selective gent
91
selection by consequences requires
1. variation
2. fitness consequences
3. mode of inheritance
4. limited resources
92
motivation
hypothetical constuct, needs intervening variables
93
do you need reinforcement for learning
no
94
learning will always extinguish if not reinforced
no
95
habit learning =
instrumental in nature, motor learning, basal ganglia
96
motor learning, motivation and emotion =
all linked in brain, heavily driven by dopaminergic system
97
drive theory - resistance to extinction depedns on
1. drive (degree of food deprivation)
2. habit (amount of prior reinforcement)
98
drive theory formul
behaviour strength = D x H
99
incentive theory formul
behaviour strength = D x H x K
or
behaviour strength = need x learning x incentive
100
incentive =
motivational effect of reward (this idea comes from classical conditoning!)
101
motivational states =
occasion settors, facilitators
102
OS are...
environmental cues (CSs) that faciliate conditoning. CS that confirms a CS-US pairing
103
elation vs depression
elation = positive contrast effect
depression = negative contrast effect
104
over-learning extinction effect
many rewarded trials can increase the rate of extinction
105
sequential theory variables defined
N = nonreinforced trials
r = reinforced trials w small rewards
R = reinforced trials w big rewards
106
sequential theory most resistant to extinction?
rNR!
