Tut 6 Flashcards

1
Q

What was Edward thorndike findings regarding operant conditioning ?

A
  • Cat taks in box
    1. First Response = fighting to become free
    2. By luck lead to the correct combination
    3. After a few tries cat learned -> gain food if combiantion was correct
  • Figured out law of effect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the law of effect according thorndike ?

A
  • Postive feedback increase the response

- Which lead to a strong s+r association

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a discriminative stimulus ?

A

A stimulus that signals whether a particular response will lead to a particular outcome.
- SD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is operant conditioning ?

A

SD-> R->O

  • Stimuli-> Respond->outcome
  • Also called instrumentall conditioning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What did tolman say about S+R framework ?

A
  • it is more goal directed behavior

- it is not only a mechanism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Who exposed the differnt between classical and operant conditioning ?

A
  • Skinner
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the difference in operant and classical conditioning ?

A
  • in classcial conditioning: organisms experience an outcome wheter or not they perform a Response
  • Ex: Airpuff happens no matter if eyeblink took place
  • operant conditioning : The outcome O depends on whether the organism performs the response R. (cat example)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What do operant and classical condition have in common ? -> Regarding learning curve

A
  • First tries their learning increases dramaticlly in both then it goes slower
  • Association or pairing can get lost if not paired for a long time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What did skinner accomplished what thorndike has not done ?

A
  • Free operant paradigm

- Thorndike -> choose how many trials went on (discrete trials)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does Free operant paradigm mean ?

A
  • organism can decide how many trials they want
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What did the skinner box contain of ? (regarding operant conditioning)

A
  • S was the light in box
  • R pressing (lever or button )
  • O gaining food
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the habbit slip ?

A
  • When SD+R association so strong is that no other respond options are realized to come to the concluison even easier
  • Ex: rat only once food at the end of the maze and ignors foodon ground
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How do we determine the correct repsond ?

A
  • via shaping

- via changing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How does shaping work ?

A
  • Gradually steps learned by influence of constructor
  • food is dropped when it does something correct
  • next time lvl will be more difficult so outcome changed to a more closer related task comparing to major goal
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How does changing work ?

A
  • Breaks major response into smaller responses

- so each response is trained individually and laiter on gets connected to the goal respond

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a reinforcer ?

A
  • a consequence of behavior that leads to increased likelihood of that behavior in the future
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the primary reinforcers ?

A
  • biological value to the organism

- Food, sex, water

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the Hull drive reduction theory ?

A
  • the drive for motivation is mainly because u do want a reduction of primmary reinforcer
  • u need to lower ur reinforcer
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are secondary reinforcer ?

A
  • no biological value, but paired with (or predict the arrival of) primary reinforcers !
  • Money -> u can buy with money sex
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is the negative contrast effect ?

A
  • Giving the less preferred reinforcer the entire time -> high repsond
  • giving first the prefeered reinforcer and laiter the less preffered lead to less strong respond
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is a punihser ?

A
  • A consequence of behavior that leads to decreased likelihood of that behavior occurring again in the future.
  • pian/ jail
  • opposite of reinforcer
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What does punishment lead to ?

A
  • more variable behavior- > stop one behavior so search for another
  • cheating -> driving faster then allowed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

When is punishment more affective ?

A
  • Strong intensitiy punishment right away
  • temporal (not all the time)
  • When there is no initial intensity ! (so no tollerance)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

When is punishment less affective ?

A
  • when there is a reinforcemnt at the same time as the punishemnt
25
Q

What is the Differential reinforcement of alternative behaviors ?

A

A method to decrease unwanted behaviors by instead reinforcing preferred alternate behaviors.
- Also treatment for addiction

26
Q

What are the time affectsregarding operant conditioning/classical conditioning ?

A
  • Immediate outcomes produce the fastest learning

- long delay can be inlfuenced by other behvaiors in itnterval

27
Q

What does self control regarding society mean ?

A
  • willingless to not gain a small immediate reward in favor of a larger future reward
28
Q

What is postive reinforcment ?

A
  • sommething got added

- Praise = well done after outcome

29
Q

What is postive punishment ?

A
  • something got added

- dissaproval/screaming after outcome

30
Q

What is negative reinforcemnt ? ?

A
  • something got subtracted

- SD (headache) + R (Aspirin) = O (no headache)

31
Q

What is negative punishment ?

A
  • sometging to subbtract

Ex: SD (playtime break) + R (aggressive behavior) = O (loss of playtime)

32
Q

What do we usually use for a reinforcemnt system and what do we not use that often ?

A
  • Continuous reinforcement schedules (each respond follows a reinforcemnt) is used a lot
  • partial reinforcement schedule is not used a lot
33
Q

What is the Fixed ratio partial schedule ?

A
  • particular set of numbers/ trials that lead to a reinforcment (every ten trials)
  • there is a post pause after reinforcment
34
Q

What is the Fixed interval partial schedule ?

A
  • particular set of time where trials are running that lead to a reinforcment (every ten minuets)
  • there is a post pause reinforcment ( no respondd cause animal does not know exactly when it comes )
35
Q

What is the Variable ratio partial schedule ?

A
  • Average number of trials there is a repsond ( average on 10 means maybe 8 or 12 trials)
  • no post reinforcment pause cause it is not clear when the reinforcemnt occurs
  • fatsers learning
36
Q

What is the varaiable interval partial schedule ?

A
  • Average number of minuets there is a repsond ( average on 10 min means maybe 8 or 12 mins)
  • no post reinforcment pause cause it is not clear when the reinforcemnt occurs
37
Q

What is behavioral economics ?

A
  • is the study of how organisms manage their time and resources among possible options
  • General -> You try to orgnise ur time/ money to maximizes your “subjective value
38
Q

What ist the premarck principel / Theory?

A
  • opportunity to perform a highly frequent behavior can reinforce a less frequent behavior
  • Watching tv as a reinforcer to study
39
Q

What is the bliss point regarding the behavioral economics ?

A
  • the most optimal way to gain the maximum of ur subjective value
40
Q

What are the key component of operant conditioning ?

A
  • Dorsal striatum

- orbifrontal cortex

41
Q

What is the function of the Dorsal stratium ?

A
  • good for SD +R association

- it is based on feedback about reinforcemnt and punishment

42
Q

What is the function of the orbifrontal cortex ?

A
  • learning about possible outcomes
  • Each neuron codes a diff outcome
  • they are specialised
43
Q

What is the extinction mimicry ?

A
  • It is a drug which supress the dopamine system then u do not press the lever
44
Q

What is the incentive hypothesis of dopamine function ?

A
  • having higehst lvl of dopamine before reinforcment
  • weakest right after
  • Good hypothesis to solve the extinction mimicry
  • about wanting
45
Q

What is the Anhedonia hypthesis ?

A
  • highest dopamine lvl after reinforcment
  • bad hypothesis to solve the extinction mimicry
  • about liking
46
Q

What ist the reward prediction hypothesis ?

A
  • based on prediction error
  • if the outcome is Predict then no change in dopamine lvl
  • if expected and it happens then there is an increase
  • if expected and not happening then decrease
  • Good hypothesis to solve the extinction mimicry
47
Q

What is the hedonic value ?

A
  • How much we like a reinfocer
48
Q

What is the motivational value ?

A
  • meaning how much we want
49
Q

What is key for SD+R Association regariding the values ?

A
  • Both signals have to work !

- hedonic value + motivational value

50
Q

Where is dopamine produced and by what is triggered ?

A
  • Produced in VTA and triggered by

- primary reinforcemnt and secondary reinforment

51
Q

What is the dopamine system and what happens when it is damaged ? VTA Dpoamine system

A
  • Produced in VTA -> nucleus accumcus -> dorsal stratium
  • if damaged then it is still able to like but not to want
  • Activity of dopamine at the beginning of learning is high in stimuli and respond
  • druing learning only lvl of dopaimne is high in stimuli
  • if respond is missing decrease of dopamine
52
Q

What is the liking system ? (opiod system)

A
  • Primary reinforcers activate the release of edogeneous opioids which actiavtes receptors which are also reposnible for heroin
53
Q

How does drug addcition work ?

A
  • ur seeking for a high or to avoid the withdrawl
  • the wanting system it disconnects to the liking system after a while
  • greater concentrations of dopamine in dorsal stratium
54
Q

What is the problem with dopamine regarding cocaine ?

A
  • the reuptake is not happening in synapse regarding dopamine
55
Q

What is the problem with Amphetamine reagrding dopmaine ?

A
  • more release of dopamine
56
Q

What is pathological addiction ?

A
  • as a strong habit which lead to harmful consequences-> drinking
57
Q

Name an example of behavioral addiction and compare it with drug addcition ?

A
  • Contain the same symptons then drug addcition

- Gambling

58
Q

What are the treatment of addiction ?

A
  • Extinction (see medical treatment)
    -> blocking opiate rec
  • Distancing ( avoiding triggering stimuli)
  • Reinforcement of alternate behaviors (eg
    giving money for staying abstinent)
  • Delaying reinforcement (weakening R-C
    associations)
59
Q

What are the two personality factory which influence internet addcition ?

A
  • Defective ego autonomy

- Being sensation seeking