Lecture 10 Flashcards
Two key brain areas in operant conditioning are the dorsal striatum for (__ —> __) learning and the orbitotrontal cortex for (__ —> __) learning.
SD; R; R; O
Two key brain areas in operant conditioning are the ____ ____ for (SD —> R) learning and the ____ ____ for (R —> O) learning.
Dorsal striatum; orbitofrontal cortex
The ____ ____ is part of the basal ganglia, a group of interconnected subcortical structures important for ____ ____ and learning.
Dorsal striatum; motor control
The basal ganglia include the ____, ____, and the ____ ____ (external and internal segments)
Caudate; Putamen; Globus Pallidus
In primates, the ____ and ____ are distinct structures, while in rodents they are combined into one structure called the ____
Caudate; putamen; Striatum
Within the basal ganglia, the ____ pathway generally increases movement, while the ____ pathway generally decreases movement.
Direct; indirect
Which dopamine receptors are responsible for direct/indirect pathways?
D1 = direct pathway
D2 = indirect pathway
Dopamine neurons in the ____ ____ part compacta and ____ ____ ____ (VTA) project to the striatum and frontal cortex, heavily influencing operant behavior.
Substantia Nigra; ventral tegmental area
____ neurons in the Substantia Nigra par compacta and ventral tegmental area project to the ____ and ____ ____, heavily influencing operant behavior.
Dopamine; striatum; frontal cortex
the ____ ____ (brain structure) is especially critical for learning the association between a discriminative stimulus (SD) and a response (R)
Dorsal striatum
When the dorsal striatum is inactivated, animals have trouble learning new (SD —> R) links based on ____ or ____.
Reinforcement; punishment
The ____ ____ helps predict the specific outcomes of a response (R —> O)
Orbitofrontal cortex
Orbitofrontal cortex neurons can fire differently depending on whether a ____ or a ____ is expected.
Reinforcer; punisher
Competition between brain systems mediates different types of leaning and memory. For example, ____ is responsible for place navigation, while ____ is responsible for response navigation.
Hippocampus; Striatum
Competition between brain systems mediates different types of leaning and memory. For example, Hippocampus is responsible for ____ navigation, while striatum is responsible for ____ navigation.
Place; Response
In ____ navigation, rats learn the direction they need to go to get food, while in ____ navigation, rats learn to use environmental cues to direct the path.
Place; response
Initially, rats use a ____ strategy (in the first week), but after additional training they use a ____ strategy (~2 weeks) — it takes time (repetitions) to develop a habit
Place; response
In the first week, inactivating ____ ____ (Str) does not change the strategy mice use to navigate the maze. However, inactivating ____ (HPC) results in more rats using a ____ strategy, argues that it is needed for using ____ strategy.
Dorsal striatum; hippocampus; response; place
In the second week (after additional training), inactivating ____ doesn’t change the strategy mice use, but ____ inactivation blocks their use of ____ strategy and shifts them back to using ____ strategy.
Hippocampus; striatum; response; place
Predicting specific outcomes:
Single neuron recording in ____ ____ revealed that during the delay between response & outcome, neurons show specificity for whether they are expecting or reinforcing or punishing outcome.
Orbitofrontal cortex
When mice conditioned to expect sucrose after the Go response but received a quinine instead, how does it affect neuonal response in the orbitofrontal cortex?
There were increased neuronal responses in mice that expect sucrose but got quinine.
____ ____ is the immediate small reward or larger delayed reward — longer the delay, more likely to choose the immediate reward because it is not perceived to have more effects than the small one in the near future
Delay discounting
In self-control, ____ ____ lesions shift preference to ____ reward.
Orbitofrontal cortex; immediate
The ____ ____ ____ is a major source of ____ released in frontal cortex. While rats can be trained to press lever to stimulate the region and were found to continuously respond until they collapse, they do not appear to enjoy it. This demonstrates that the area may be more associated with ____, and that ____ is not equal to ____.
Ventral tegmental area; dopamine; arousal; wanting; liking
