Learning and Reward Flashcards

1
Q

what are the main learning theories/ questions?

A
  1. how is classical conditioning (paired associated) different from operant conditioning (punishment/reward)?
  2. the social learning question: how does watching others influence learning?
  3. how is learning influenced by the biology of reward?
  4. how does learning occur on a neuron level?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what are the distinctions between the studies of watson, pavlov, skinner, and bandura?

A

pavlov = classical conditioning

watson= “behaviorism,” classical conditioning “little albert” - can turn anybody into anything? based on idea of “blank state” (ex. babies)

skinner = operant conditioning

bandura = social learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

how is classic conditioning different from operant conditioning?

A

CC organism is passive/ OC organism is active

CC responses are reflexes/ OC responses are voluntary

CC responses are elicited/ OC responses are emitted

CC reinforcement is unrelated to learning the association (2 things are paired together - ex. startled when hearing a noise)/ OC reinforcement is contingent on desired response (rewards)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the basic concepts in classical conditioning?

A

associative learning - neutral stimulus can produce reflexive behavior

stimulus substitution - stimuli are associated and one comes to substitute for another

learning becomes more complex

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what were the different components in pavlov’s dog research? what occured?

A

US = unlearned stimulus (food)

UR = unlearned response (salivate)

the US automatically elicits the UR (reflex) - natural, nothing was conditioned

when conditioning occured- learning occured…

CS = conditioned/learned stimulus (bell)

CR= conditioned/learned response (salivate to the bell)

no longer need US to get what was UR (salivating) - bell predicts meat - conditioned response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what happens with conditioning?

A

CS (previously neutral stimulus) is PAIRED repeatedly with the US

over trials (temporal pairings), the CS comes to automatically elicit a response (CR) that closely resembles the UCR

CR is not identical to the UR reflex - similar in form but not as strong

it is a learned automatic associative response with similar form to UR

*has to be temporal pairing (happens right in a row of something)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is stimulus generalization?

A

generalizing among stimuli

ex. dogs associating meat with researcher paired with white coat, coming in at a certain time, etc and then start to drool

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

once a stimulus acquired conditioned properties through stimulus substitution, what happens?

A

the brain learns

can have stimulus generalization, discrimination, and extinction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is stimulus discrimination?

A

discriminating among stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is extinction?

A

extinguishing learned associations

ex. when they ring a bell and don’t come in with meat, they will slowly start to stop salivating until it becomes unlearned again

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

when signaling stimulus occurs without the actual thing being showed, what has happened?

A

condition is learned

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Who is john watson? what did he apply in his research?

A

researched the case of little albert

applied pavlov’s associative learning (classical conditioning) to albert’s emotional learning of fear

discovered that we can learn emotional responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what were the different effects of conditioning on little albert?

A

before conditioning

US = noise and UR =crying (fear/startled)

during conditioning

US paired with UR + CS (white rat)

after conditioning

CR (fearful crying) > CS (white rat)

cries with just seeing the rat and not hearing the noise, led to question - is this why phobias are learned?, stimulus generalization was learned with other furry white animals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

how were the CC principles - stimulus substitution, generalization, discrimination, and extinction - presented in the case of little albert?

A

stimulus substitution? noise for rat

stimulus generalization? was afraid of other animals (rabit, dog, fur coat, etc)

stimulus discrimination? wasn’t afriad of larger animals/ non white animals

extinction? would have to make little albert unlearn his fears, present it in a relaxing manner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what are mower’s 2 factor theory of avoidance learning?

A
  1. classical conditioning - conditioned to fear something (CS)
    ex. developing fear - paired rat with noise led to fear of the rat
  2. operant conditioning (instrumental)

the individual learns a response to get away from CS

this is an operant conditioning process - avoiding the CS (fear) involves negative reinforcement (removal of negative experience i.e. fear)

ex. plane - never go on a plane again and avoid it in a non fear state therefore you will never unlearn/ extinguish fear because of avoidance - strengthens fear

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is reinforcement in relationship to fears?

A

avoidance responses are strengthened and this strengthing is “reinforcement”

all reinfocement involves an increase in the behavior preceding it (avoidance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

how is fear maintained?

A

thorugh operant conditioning

extinction to CS (feared stimuli) never happens

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what are some examples of classical conditioning?

A

salivating in response to thought of food

sexual interests

drug overdoses

coaine and money pairing

smoking - craving develops in certain contexts

advertising - get people to buy products and get positive responses (ex. corona and beach imagery)

anticipatory nausea - cancer patients in hospitals in response to chemo (anticipating their feelings)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what is systematic desensitization?

A

treatment for phobias

the undoing process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

do phobias and addictions have learned components?

A

YES

counter conditioning - bring up fear and then having an individual learn to be relaxed (unlearning pairing of fear and object)

systematic desensitization - CS/CR 1 (fear) > CS/CR 2 (relaxation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

how does classical conditioning work with sexual arousal?

A

US = erotic imagery > UR= arousal

CS = previously neutral (ex. shoes) > CR= sexual arousal to CS

independent arousal to shoes > shoe fetish

can treat by unlearning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

how does classical conditioning work with drug tolerance?

A

classical conditioning - body adjusting to effects of drugs

conditioned to stimuli that normally precedes drug use - causes a physiological response that helps the body prepare for the drug

*therefore many overdoses happen because they are taking usual drug dose in a different location

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what are the effects of emotional learning?

A

postive and negative emotions are acquired - some associative process - form connections

CER (conditioned emotional response)

emotionally changed conditional response elicited by a previous neutral stimulus

ex. police cars, 9/11, ocean and jaws, foods like/ hated, music, smells, people, etc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what are phobias? what do they involve?

A

classified under anxiety disorders

involve panic attacks typically if exposed to feared situation (intense fear response)

some examples…

agoraphobia - fear panic attacks, therefore making an individual avoid many situations

social phobia - thinking people look at you negatively and therefore you don’t want to interact with others

specific phobias like heights, snakes, closed spaces, etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

how does virtual therapy for fears help? (video example)

A

man deathly afraid of heights virtually went down an elevator, crossed a bridge, and went on a plane

after treatment he could go up the elevator

*must be exposed to worst fears in order in overcome fears and learn how to be unafraid in situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

what is systematic desensitization?

A

a “cognitive -behavioral” method of treatment for phobias using the principle of “counterconditioning”

SD takes classical conditioning into realm of cognition

visual imagery and mental associations are actively engaged

overrides learned response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

what is counterconditioning?

A

a CC procedure for weakening a CR by associating the CS (fear-producing stimulus) with a new response incompatible with the fear

an SD technique

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

how is counterconditioning performed?

A
  1. the therapist, with the client, develops a hierarchy of feared situations
    ex. CS’s (seeing picutres of snakes to napping with a boa around your neck) - lowest to hights fears
  2. person is taught relaxation and coping imagery and skills
  3. then, client applies learned skills while imagining CS’s
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

how does SD work?

A

pair new and incompatible responses (relaxation, normal breathing, coping thoughts/images, voluntary parasympathetic activity in general) with images of CS’s

leads to new CS-CR associations over trials, called “higher-order conditioning”

extinction processes involves learning fear-inhibition behaviors via counterconditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

what happens when phobic indiviuals practice SD? what is the result?

A

conditioned fear (a CR) is counterconditioned by newly developed incompatible responses

practice involves repeated trials (this is form of pairings of stimuli)

result - diminishment of fear achieved through an increases of capacity and motivation for active coping/management of anxiety-producing situations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

what are fundamental to behavioral change?

A

exposure and extinction as a result of SD

in classical conditioning terms - breaking old associative bonds (CS/UCS relations) through exposure to CS, extinction, and re-conditioning leads to learning of new associative bonds

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

what is an example of desensitization?

A

snake phobic

irrational fear is cured

after a few sessions he can come in, see snake, and touch it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

what is flooding?

A

a technique used for desenitization

where you are overwhelmed and exposed to what you’re afraid of all at the same time to the point where your fear is exhausted

used rarely (if you can’t get down to relaxed state, it will just elevate your fear)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

how is operant conditioning different from classical conditioning?

A

“operant” is skinner’s word for behavior that operates on the environment, that have effects which are “instrumental” in producing desired results

instrumental learning = operant conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

what is skinner’s philosophy?

A

consequences of behavior determine the probability that the behavior will occur again

36
Q

what brain process does operant conditioning rely on?

A

dopamine based reward system centered in the nucleus accumbens

ex. drugs and gambling

37
Q

what part of the brain does classical conditioning rely on?

A

the amygdala

(for fear)

38
Q

what are the basic concepts in operant conditioning?

A

reinforcement, punishment

positive and negative reinforcement

shaping

schedules of reinforcement and their effects on learning

39
Q

what does reinfocement do to behavior?

A

it INCREASES or strengthens the probability of behavior

both positive and negative reinforcers

40
Q

what is a reinforcer?

A

any stimulus that increases/strengthens the behavior which precedes it

41
Q

what experiments did skinner perform?

A

built on thornike’s law of effect and coined the term “reinforcer”

he used the “skinner box” to illustrate “shaping” - the pigeons were trained animals that were shaped by rewarding the pigeon step by step (eventually turned in a full circle to get food)

42
Q

what types of reinforcers can there be?

A

primary - food/ water/ basic needs

secondary - money, good grade, compliment

43
Q

what is positive reinforcement?

A

when a plesant/ positive stimulus follows a behavior and strengthens it

ex. something nice - like a compliment

44
Q

what is negative reinforcement?

A

negative reinforcer - removal of an aversive stimulus

leads to an increase in the behavior that preceded the removal of the negative stimulus

SUBTRACTION of something negative

ex. stopping electric shock or walking the stairs if afraid of elevator (removal of fear)

45
Q

what is punishment do? how do positive and negative reinforcement effect chances of behavior?

A

punishment REDUCES the probability of behavior

positive reinforcement (reward) INCREASES chances of behavior

negative reinforcement INCREASES behavior by removing aversive stimuli

ex. kid is forced to sit in the nurse’s office when he misbehaves - if not reducing the behavior NOT punishment although you think it is

neg - removed from class and his fears/ things he dislikes

pos - likes going to the office

46
Q

what is positive punishment?

A

decreases behavior by presenting an aversive stimulus

presenting with something negative

ex. hitting/spanking/fining

47
Q

what is negative punishment?

A

decreases the probability of behavior by removing a positive stimulus

SUBTRACTING something liked

ex. taking away license

48
Q

what is effective in parental punishment?

A

reinforcement is the best way to change behavior

rewarding positive behavior is better than punishment (when perform bad actions, not caught all the time)

49
Q

what are the schedules of reinforcement? what type of conditioning does this influence?

A

operant conditioning

fixed schedules (fixed ratio and interval) = predicatable/ known

ex. ratio - every 5th box filled (based on number of times)

interval - scheduled exams (based on time) - study inconsistently and then more when it approches

variable schedules (variable ratio and interval) - don’t know

ex. ratio - slot machines - hardest to extinguish, how addictive behaviors start “next time will pay off” mentality

interval - pop quizes (have to study consistently)

50
Q

what are raito schedules based on?

A

units of behavior and produce fast learning

51
Q

what are interval schedules based on?

A

units of time and produce slower learning

52
Q

what does continous reinforcement create? what type of reinforcement is more common?

A

fast learning

BUT is rare in the real world

usually done when you are 1st leanring something (best way to learn) - ex. potty training has rewards until it is learned

partial reinforcement = more common

most behavior is reinforced only intermittently (start slwing down reinforcement once learned)

53
Q

what is the difference between fixed and variable schedules?

A

fixed schedules are invariant

variable schedules are unpredictable

54
Q

what does behavioral persistence result from?

A

the “partial-reinforcement extinction effect”

55
Q

what is an animal and coaching teaching tip?

A

start with fixed ratio 1:1

then “fade” to partial schedules with increasingly infrequent reinforcement

*do with people with autism/ other problems as well

56
Q

what gives positive stimulus?

A

positive reinforcement

57
Q

what takes away negative stimulus?

A

negative reinforcement

58
Q

what gives negative stimulus?

A

positive punishment

59
Q

what takes away positive stimulus?

A

negative punishment

60
Q

if you have alcohol to feel relax/ rewarded or to have fun with friends what kind of stimulus is this?

A

positive reinforcement

61
Q

what are negative reinforcers for the following…

anxiety

headaches

A

anxiety - washing hands or staying home to reduce anxiety

headaches - taking aspirin

62
Q

if you have alcohol to take away anxiousness/ anger what kind of response is this?

A

negative reinforcement

63
Q

what is the fundamental idea of punishment? what is a punisher

A

weakening or reducing the probability of behavior

punisher: any stimulus that weakens the strength of, or reduces the probability of a behavior
ex. shock, social disapproval

64
Q

a parent gives a whining child candy and then the child hugs the parent.

what behavior is negatively/ positively reinforced for the parent?

what is positively reinforced for the child?

what are the effects?

A

parent: negative = taking away whining

positive = receiving hug

(whining is the “aversive” stimulus,” then identify the removed aversive stimulus that is likely to increase in frequency - hug)

kid: positive = receiving candy

effects = kid more likely to whine because it was positively reinforced (intermitent ratio schedule) - once done, hard to stop

65
Q

the “overjustification effect” - why is external reward used?

A

it can change likelihood of engaging in behavior by changing MEANING

something already meaningful - now add an external reward (ex. adding trophies to soccer games or paying people for volunteering)

risk = changing meaning so you are not doing something just to do it

66
Q

what is the social learning theory?

A

focuses on the importance of observing and modeling behaviors, attitudes, and emotions

learning involves cognitive, behavioral, and environmental influences

67
Q

what was Bandura’s study?

A

bobo doll

when the bobo doll was punched by/ kicked/ etc. by a woman - watched by kids

exposure led to kid’s aggressive behavior through modeling

kid’s without exposure performed no violence

**learn aggression through modeling (more likely to engage in behavior)

68
Q

what were the statistics of the Bandura study?

A

experimental groups: (out of 16)

aggressive model rewarded = 15

aggressive model punished = 8

control groups:

non-aggressive model =7

no model = 5

69
Q

what did bandura’s studies prove?

A

proved to social learning theorists that direct reinforcement and punishment is unnecessary for learning

we do not need to be shaped directly - our behavior is influenced by observational learning and cognitive processes

* we DO learn through modeling and observation

70
Q

what did bandura’s study teach? we can learn through which manner?

A

observational learning is powerfully adaptive

suggests aggression, fear, and other emotions are learned

ex. parent afraid of dogs leads to a child’s fear

can teach through demonstration

71
Q

what did bandura’s study teach in relation to phobias?

A

a child that is afraid of a dog but able to observe a child playing with a dog will significantly reduce child’s fear of dog

implication = phobias respond to social process

72
Q

how are mirror neurons used during observational learning?

A

activated when we observe someone engage in a behavior

same neurons as if engaged in activity themselves

may help learn by observation

73
Q

how is dopamine involved in learning/reward?

A

involved in motivation/emotion - biologically make activity rewarding and meaningful

crucial for positive reinforcement - operant conditioning

abscence reduces drive/motor control (ex. people who take antagonists block response and make people less happy)

74
Q

how does the brain function in learning/reward? what primary and secondary causes increase reward?

A

experience of pleasure results from activation of dopamine neurons in the nucleus accumbens (limbic system)

amphetamine, cocaine increase dopamine (primary)

money, grades, other rewards (secondary) also activate dopamine systems - rely on dopamine

75
Q

what is the biological basis of reward?

A

self-stimulation is a model of reward

dopamine signals reward

76
Q

what experiment involved the biological basis of reward?

A

intercranial self-stimulation used when a rat turned on a light

electrode was implanted in the nucleus accumben (activated dopamine resceptors)

made it pleasureable and rewarding

77
Q

what does the ICSS activate? what does interfering do?

A

ICSS activates dopamine receptors

nucleus accumbens are therefore activated

interfering with dopamine eliminates ICSS and other naturally motivated behaviors so things become less pleasureable

78
Q

how does learning occur at the neuronal level?

A

1948 - donald hebb postulated that learning results form alterations in synaptic connections

“cells that fire together wire together”

synapses alter based on use

increase in activity leads to increase in synapses/connections/neurons activated in the brain

things that seem very natural have seemless connections (use these connections a lot)

79
Q

what is habituation? how does if affect behavioral response?

A

a DECREASE in behavioral response

follows repeated exposure to non-threatening stimuli

orient to something and neurons quit firing and don’t activate

STOP pre-synaptic release of neurotransmitters

80
Q

what is sensitization? how does it affect behavioral response?

A

an INCREASE in behavioral response

follows exposures to a threatening situation (neurons fire more often)

INCREASE pre-synaptic release of neurotransmitters

81
Q

if a dog salivates when it receives food and then a can opener is used and the dog salivates just at the sound of the can opener… what is the US? what is the UR?

A

US= food

UR= salivation

82
Q

if a puppy is rewarded for all processes of rolling over until it completely rolls over, what is this process?

A

shaping

(opernant conditioning)

83
Q

if judy does not steal cookies because she sees her brother get punished by her dad, what is the reaction?

A

vicarious learning

84
Q

what is the neuron associated with reward?

A

dopamine

85
Q

what happens when sensitization occurs?

A

increases release of neurotransmitters