exam 2 Flashcards

Question

# define positive, negative, reinforcement, punishment (will be on test!!!!)

Answer 1

positive: behavior making something more likely to happen negative: behavior makes something less likely to happen reinforcement: anything you do to make response go up punishment: anything you do to make response go down

Answer 2

1) positive reinforcement: BP -> food 2) positive punishment: BP -> shock 3) negative punishment: free food, BP -> no food 4) negative reinforcement: free shock, BP -> turns shock off

Answer 3

1) positive reinforcement: good behavior -> cookie 2) positive punishment: misbehave -> yell 3) negative punishment: bad behavior -> take phone away 4) negative reinforcement: escape: bad date, safety call -> leave, so you set up safety call next time avoidance: ask friends about boy, they say no -> avoid bad date

Answer 4

1) discrete trial: counting trial 1, trial 2... | 2) free operant techniques: rat BP, pigeon pecking at light

Answer 5

1) straight runway: rat is in a straight runway with hidden food at the other side, collecting your data by measuring speed or time to get to end 2) T-maze: rat is in a T shaped maze with food in one of the corners, collecting your data by looking at where the rat turns, % of correct turns

Answer 6

1) more applicable to scenarios in real life, the species can make choice freely 2) define behavior base don how it operates in the environment, behavior is defined by the effect it has on the world (outcome)

Answer 7

reward the rat when he does behaviors close to the desired behavior (shaping by successive approximations) ex. facing food (reward), walking towards food (reward), sniffing level (reward) etc.

Answer 8

the tenure system when you're done grad school you need publications on your resume so you do small, safe studies not big risky ones this is an operant contingency

Answer 9

drive reduction theory: reinforcers are events that satisfy biological needs/drives (hunger, thirst, sexual arousal, pain avoidance) or the "pleasure theory" that says reinforcements are stimuli; released dopamine in the "pleasure center"

Answer 10

if reinforcers are events that satisfy needs, punishers are events that make needs worse put male rat in straight line cage with receptive female rat on the other side, have the rat run across and start mating with the female but take him out in the middle of mating drive reduction theory says that the rat will eventually stop running but he actually runs faster sometimes increases in drive states are rewarding (drive reduction is not right)

Answer 11

problem with "pleasure theory" is sensory reinforcement 1) monkeys press button to open a shade and look at lab even though its not pleasurable 2) rats will press a bar to run through an empty maze, no biological pleasure 3) infants will suck a pacifier harder to view vacation slides which are pleasurable 4) humans will spend money to solve crosswords or go to horror films, none of these are pleasurable

Answer 12

considers preferences between events BP -> food -given choice between bar pressing and eating, rats would pick eating -bar pressing is less probable behavior and eating food is more probable behavior -so reinforcement is when something you're less likely to do leads to something you're more likely to do -punishments are when something you're more likely to do leads to sometimes you're less likely to do (BP -> shock)

Answer 13

1) teach rat grooming (less) -> running (more), this is reinforcement so grooming will go up 2) teach rat eating (more) -> running (less), this is punishment so eating will go down

Answer 14

the same event can be either reinforcing or punishing (depends on the situation)

Answer 15

1) reinforcing autistic children to complete math problems complete math problems (less) -> cookies (more) * *in order to find out what kids like to be used as reinforcer do a "free observation"** ``` 2) training preschoolers to sit still sit still (less) -> run and scream like savage (more) ```

Answer 16

expectation: its not what you get its what you get compared to what you expect this is the intrinsic nature of all creatures to react this way to reward

Answer 17

humans placed in FMRI (measures brain activity), they were tasked with counting how many dots were on a screen and told another person is doing the same thing. a participant gets told how well both of you are doing and everyone gets paid different amounts for performance (even though everyone gets paid the same) results: biology of reward, when someone did better than the other person BIG increase in pleasure center, small increase for same completion, and decrease in pleasure center when someone did worse than the other person

Answer 18

monkeys give stone to experimenter to get food when both monkeys get a cucumber they are equally happy when one monkey gets a cucumber and the other one gets a grape the cucumber monkey is not happy at all and throws the cucumber at experimenter

Answer 19

punishment 1) creates anger/ aggression 2) hard to deliver on-time punishment (if you want behavior to be controlled by punishment, the punishment needs to happen right away) 3) promotes punishment- avoidance not behavior of interest (ex. not picking up dog poop when its dark so no one can see)

Answer 20

sensory reinforcement Volkswagen Fun Theory 1) walking up stairs: make the stairs "piano" and people will take the stairs more than escalator 2) using the bottle bank (recycling): made it look like arcade game and people get points for putting in bottles 3) not littering in park: made the trash can sound extremely deep, people threw out trash and began to pick up other peoples trash Cancun 1) underwater museum, people go underwater to look at the sculptures rather than go to the coral reef and damage it

Answer 21

timing delay between response and reward, long delays reduce the effectiveness of reward

Answer 22

show experiment on paper if pigeons were rational creatures they would choose the light where out of 8 seconds, 4 seconds were food compared to 2 seconds, but they choose the other light because the initial delay affects their ability to make choices

Answer 23

1) maybe associated the food with something in the four second delay 2) maybe forgot they pecked green, STM right: 3) delay discounting: rewards in the future have less value

Answer 24

conditioned reinforcement and immediacy

Answer 25

L-> food | BP -> food OR BP-> light both of these will work because L is the conditioned reinforcer (it gets its value by being associated with food) money is the conditioned reinforcer in humans

Answer 26

Prius -> pay 5k more -----> better world, fuel savings Corolla-> pay 5k less -----> worse pollution, spend more conditioned reinforcement or social reward: Toyota gave Prius social reward so that people would buy it right away even though the positive effects (better world, fuel saving) are not seen right away (eg. distinct shape and says HYBRID) immediate feedback: car shows MPG depending on MPH, so get rewarded for behavior of good driving (braking, accelerating slower, etc)

Answer 27

1) delay: responses need immediate consequences | 2) pattern of reward that comes after response

Answer 28

ratio schedules: theres a direct relationship between number of responses and number of rewards interval schedules: reward available only after time passes

Answer 29

1) fixed ratio: constant or fixed number of responses = 1 reward ex. FR1 = 1 behavior = 1 reward 2) variable ratio: theres an average # of responses needed to get a reward, but changes trial to trail ex. VR50 = average of 50 behaviors needed for 1 reward

Answer 30

draw on paper post reinforcement pause: rats don't feel like continuously lever pressing so they'll take breaks before next food pellet (same with humans when they have four papers due) FR schedules are used to test strength of drug reward ex. using drug as reward for BP, slowly increase FR requirement and ask what is the highest ratio you get to before the animal gives up

Answer 31

draw on paper high rates of responses that are continuous, instead of knowing FR50 the reward could be right there so the rats are more motivated to do behavior applicable to humans using slot machines because the reward could be right there

Answer 32

1) fixed interval: the amount of time that passes is always the same from reward to reward 2) variable interval: on average some amount time has to pass but it changes reward to reward

Answer 33

draw on paper less responding overall (compared to FR and and VR) because theres no relationship between response and reward lever pressing increases as it gets close to one minute (FI scallop) ex. us in class after test, don't study right away until it gets close to test

Answer 34

draw on paper unsure when the reward is, it could be right there so they're more motivated to do behavior applicable to us because of pop quizzes

Answer 35

interval schedule: salary (biweekly, monthly) | ratio schedule: commission

Answer 36

1) more responding on ratio than interval 2) fixed schedules produce pauses, variable schedules produce continuous behavior 3) interval schedules are not the same as delay to reward BP -> (30 sec) food (delay to reward) time between rewards but BP-> food immediately (interval schedules)

Answer 37

all schedules represent it except for FR1 ex. FR1 BP -> food FR10 BP -> food then, switch everyone to extinction FR1 notices change immediately FR10 doesn't notice extinction until 10th BP ** in general, partial reinforcement makes you resistant to extinction (maintain long term behavior)**

Answer 38

your amount of behavior should match the amount of reward in other words, if two options A + B on interval schedules then % responses to A = % reward available on A (straight line graph)

Answer 39

reduce teen drug use or pregnancy create other options to draw people away from dugs and sex -> after school programs, every hour spend on B is not spent on A

Answer 40

longer delay matched with less behavior and shorter delay matched with more behavior creatures should match behavior to the inverse of delay (3x delay = 1/3 behavior) in essence creatures are maximizing reward/unit time (pay rate)

Answer 41

original: matching law says this happened because of the minimal delay, 2 seconds with no delay at all feels better than 4 seconds delay then 4 seconds food preference reversal: matching law says this happened because their perception of pay rate has changed with the longer added delay

Answer 42

1) provide immediate reward: positive reinforcement (if i put in 6%, Arcadia puts in 8%) & negative reinforcement (money goes in pretax so you avoid tax) 2) precommitment: choose to put the money aside at the beginning of the year through automatic deduction

Answer 43

show experiment on paper | social security system takes out 6% of gross pay and goes to government, given back to people when they retire

Answer 44

foraging is searching for resources in a VI VI schedule it pays to switch back and forth but in a VR VR schedule its better to stay with the better alternative (exclusive choice for lower ratio)

Answer 45

draw study on paper evolution should have built creatures that maximize energy/time two people throw same size bread in a pond at 10/min and 5/min ratios and the prediction is that groups of ducks should be allocated in ratio of those rewards results: the ducks match as group reward rates (22 & 11) within two minutes and when the ratios switch sides the ducks switch sides too

Answer 46

same throwing rate but 2:1 ratio of bread sizes step 1: ducks first allocated 50/50 step 2: ducks later reallocated 2/3:1/3 **ducks first pay attention to throwing rate but then they look at food/ unit time and can readjust**

Answer 47

1) which patch should i enter next? - the one that has the higher than average return rate 2) when I'm in a patch when should i leave? - when expected return drops below average

Answer 48

draw it on paper there are two foods to choose from (ratios in calories), the food ratios flip and then the # of guppies flip there are some guppies who only eat worms and some who only eat fruit flies, so they don't switch -these guppies with food preferences gain less weight because they give up going to the higher return weight

Answer 49

sunfish eat vegetation mats and plankton early summer: vegetation > plankton late summer: plankton > vegetation in general, sunfish eat more vegetation in early summer and more plankton in late summer but... large sunfish change preference, small sunfish stay with vegetation for predator avoidance (big fish get bigger because they can change to the optimal choice, small fish cannot)

Answer 50

people place more value on things they already own people who own the hoodie would sell it for $45 people who just picture a random hoodie would sell it for $30

Answer 51

a patch is depleting scenario 1: next patch is far away scenario 2: next patch is close by the closer the next patch the sooner you should leave the current patch

Answer 52

draw on paper two meadows one with massed flowers one with spaced flowers you can predict how much nectar bees will leave per flower if you know things about bees in the meadow where the flowers are close bees leave more nectar in the flower compared to where the flowers are spaced far apart this is because its harder to get the last bit of nectar out so the bees won't suck all of it out they'll just move to next flower

Answer 53

1) reward amount (matching law for quantity) 2) reward delay (matching law for delay) 3) expected alternatives (decisions made by present self are not the same as decisions made for your future self)

Answer 54

1) people are selfish and competitive: humans are built to maximize reward/time, so people work harder in capitalist societies because they're working for themselves 2) selfishness is a product of capitalism and can be trained away... "ideal socialist man": people trained to no longer work for themselves but for society

Answer 55

1) turn cows to state -> nothing -> small unknown reward 2) try to keep cows -> nothing & punishment -> small unknown reward 3) kill all animals -> food and $ now -> everyone starves later people chose this option this caused Lenin to create the New Economic Policy: people chose what they did because of the concept of reward (immediate reward)

Answer 56

97% of land was held by government and 3% was allocated to private farming 25% of agricultural output came from private farming because people worked hard for the immediate reward, whereas in land owned by government people got nothing

Answer 57

1) open vs. closed economies 2) elastic v. inelastic rewards/ goods 3) effect of substitutes 4) effect of constraints on wealth/income

Answer 58

closed: no source of reward other than what you earn open: there are sources of reward you don't work for (unemployment insurance, welfare, etc) the more closed a system, the harder one should work for reward

Answer 59

if open: breaking point = FR50 (rate of responding decreases) if closed: breaking point = FR250

Answer 60

1) inelastic: as price changes, demand does not ex. gas, food in closed economy 2) elastic: as price goes up, you consume less ex. luxury items in open economy (clothes, car, etc.)

Answer 61

(closed) press left-> stimulation of pleasure center (open) press right -> food people used to say that stimulation > food, but this is not true because the food is in an open economy to make this study better: make both economies closed increase price (FR) rats do end up favoring food, we just did this experiment wrong

Answer 62

government policy acts as though they are elastic, but they are actually inelastic

Answer 63

lack of substitutes produces inelasticity

Answer 64

press R -> water press L -> food slowly raise the FR requirement for food, but because food is inelastic (no substitutes) they will never stop working for it press R-> root beer press L -> Tom Collins mix slowly raise the FR requirement for Tom Collins, but because there is a substitute they'll stop working for it

Answer 65

buy in Philly --(price & tax)--> cigs buy suburbs --(price)--> cigs people will switch and buy suburbs because its cheaper (those who can afford transportation) so cigs are elastic but for people who are poor and cant afford transportation they have to buy cigs in city so they're inelastic

Answer 66

on paper partial: methadone some people switch to methadone but others don't perfect: legal heroin some countries have done this

Answer 67

income constraints should reveal elasticity | at high incomes, everything is inelastic but at low incomes elasticity is revealed

Answer 68

press R-> food press L-> pleasure center stimulation when you can press as much as you like the pleasure center is more inelastic, but when presses are restricted rats switch to food the inelasticity of food is revealed by: 1) raising price (FR) 2) reducing income (presses allowed)

Answer 69

consider whether you want positive or negative reinforcement loss aversion is when losses of size x hurt more than gains of size x feel good use plastic -> nothing use own bag -> 25 cent reward use plastic -> charged 25 cents use own bag -> nothing the latter is more powerful because losses loom larger than gains

exam 2 Flashcards

(93 cards)