Cognitive Modelling ARTICLES Flashcards

Diffusion Model of Decision Making & Value learning through reinforcement learning

1
Q

What does the diffusion model aim to explain?

A

Two-choice decision-making by modeling evidence accumulation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two main criteria in the diffusion model?

A

Evidence thresholds for decision alternatives.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What determines the time to make a decision in the diffusion model?

A

The time to accumulate enough evidence to cross a threshold.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is ‘drift rate’ in the diffusion model?

A

The rate at which evidence accumulates toward a decision.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How does stimulus difficulty affect drift rate?

A

More difficult stimuli lead to lower drift rates.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does between-trial variability in the model account for?

A

Differences in starting points and drift rates across trials.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does the term ‘non-decision time’ refer to?

A

Time spent on processes other than decision-making, such as encoding and response.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does the model explain the speed-accuracy tradeoff?

A

By adjusting the distance between decision thresholds.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the significance of response time distributions in the model?

A

They provide a detailed fit to empirical data on decision speed and accuracy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How do the model’s parameters vary with stimulus discriminability?

A

Higher discriminability increases drift rate and reduces decision time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What role does noise play in the diffusion process?

A

It introduces variability in evidence accumulation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the function of setting different thresholds in the model?

A

To prioritize speed or accuracy depending on task demands.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What experimental data supports the diffusion model?

A

Distributions of reaction times and error rates under varying conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How does starting point variability influence decision outcomes?

A

It biases decisions toward one threshold over the other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a key advantage of the diffusion model over simpler decision models?

A

Its ability to predict both choice accuracy and detailed response time patterns.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What historical models influenced the development of the diffusion model?

A

Sequential sampling and random walk models.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How are ‘fast errors’ explained by the model?

A

They occur when the starting point is closer to the incorrect threshold.

18
Q

What is a ‘first passage time’ in the context of the model?

A

The time at which the evidence first reaches a decision boundary.

19
Q

Why is the diffusion model particularly useful in cognitive neuroscience?

A

It links decision-making processes to neural mechanisms like firing rates.

20
Q

What types of tasks are best suited for diffusion model analysis?

A

Speeded, two-choice decision-making tasks.

21
Q

What is reinforcement learning?

A

A trial-and-error method to learn decision-making strategies that maximize rewards.

22
Q

What are prediction errors in reinforcement learning?

A

Differences between expected and received rewards.

23
Q

What role do dopamine neurons play in reinforcement learning?

A

They signal prediction errors.

24
Q

What is the Rescorla-Wagner model?

A

A mathematical model of learning based on prediction error updates.

25
What is temporal difference learning?
An extension of reinforcement learning that predicts long-term rewards.
26
How do dopamine neurons respond to unexpected rewards?
With phasic increases in firing rate.
27
What is the significance of blocking in learning theory?
It shows that previously learned associations can prevent new learning.
28
How do dopamine neurons react to predicted rewards?
They show no phasic activity.
29
What is the role of the striatum in reinforcement learning?
It integrates reward signals from dopamine neurons.
30
What is the main idea behind the Bellman Equation?
It represents value as the sum of immediate reward and future rewards.
31
What is a major application of reinforcement learning in neuroscience?
Understanding decision-making and reward processing.
32
How does the prediction error change with increased learning?
It decreases as predictions become more accurate.
33
What is the learning rate in the Rescorla-Wagner model?
A parameter controlling the size of prediction updates.
34
How do drugs of abuse affect the dopamine system?
They enhance dopamine activity, reinforcing addictive behaviors.
35
What is second-order conditioning?
Learning associations between stimuli that predict other reward-predictive cues.
36
How does variability in dopamine neuron responses reflect learning?
It tracks changes in prediction errors over time.
37
What is the impact of stochastic rewards on learning?
They create variability in prediction error signals and slower learning curves.
38
What does a negative prediction error indicate?
That a reward was less than expected or omitted.
39
How are reinforcement learning theories tested experimentally?
Using tasks that vary reward probability and timing.
40
What is the relationship between motivation and dopamine?
Dopamine signals influence motivation to perform rewarded actions.
41
IN-CLASS MINI-QUIZ QUESTION 1: The linear ballistic accumulator (LBA) and the diffusion decision model (DDM) belong to the same class of decision-making models. Describe a key feature or assumption shared by these 2 models.
42
IN-CLASS MINI-QUIZ QUESTION 2: Describe a benefit of combining behavioral and neural data with cognitive modelling, as is done in model-based cognitive neuroscience.