How do we automatically judge the value of different choices?
Glimcher, P. W. (2014). Chapter 20—Value-Based Decision Making. In P. W. Glimcher & E. Fehr (Eds.), Neuroeconomics (Second Edition) (pp. 373–391). https://doi.org/10.1016/B978-0-12-416008-8.00020-6
The topic of this article is moving towards understanding the basic mechanism by which the human brain makes choices. The critical reading questions focused on topics including the different theories on how humans make decisions, different senses involved in decision-making, and different parts of the brain that aid in decision-making. The classroom discussion talked about topics including law of least effort, laziness and how that affects system 1 and 2, and pupil size in human and primates during a task.
This summary document includes all the article questions that were answered during class. There were no unanswered questions left to answer, the class answered all twenty-six questions. After looking over the questions and answers for the document, all questions were answered with an appropriate response.
Neurosynth term: “decision making”
1: Battistuzzi L, Franiuk M, Kasparian N, Rania N, Migliorini L, Varesco L.Eur J Cancer Care (Engl). 2019 May 5:e13083. doi: 10.1111/ecc.13083. [Epub ahead of print] PMID: 31056822
2: Lamb CC, Wolfberg A, Lyytinen K. Haemophilia. 2019 May 5. doi: 10.1111/hae.13766. [Epub ahead of print] PMID: 31056808
3: Peahl AF, Tarr EE, Has P, Hampton BS. J Surg Educ. 2019 May 2. pii: S1931-7204(19)30090-X. doi: 10.1016/j.jsurg.2019.04.004. [Epub ahead of print] PMID: 31056465
4: McDougle SD, Butcher PA, Parvin DE, Mushtaq F, Niv Y, Ivry RB, Taylor JA. Curr Biol. 2019 Apr 12. pii: S0960-9822(19)30409-9. doi: 10.1016/j.cub.2019.04.011. [Epub ahead of print] PMID: 31056386
5: Cruz R, Belter L, Wasnock M, Nazarelli A, Jarecki J. Clin Ther. 2019 May 3. pii: S0149-2918(19)30127-4. doi: 10.1016/j.clinthera.2019.03.012. [Epub ahead of print] PMID:31056304
Causse, M., Péran, P., Dehais, F., Caravasso, C. F., Zeffiro, T., Sabatini, U., & Pastor, J. (2013). Affective decision making under uncertainty during a plausible aviation task: an fMRI study. NeuroImage, 71, 19–29. https://doi.org/10.1016/j.neuroimage.2012.12.060
Hosseini, S. M. H., Rostami, M., Yomogida, Y., Takahashi, M., Tsukiura, T., & Kawashima, R. (2010). Aging and decision making under uncertainty: behavioral and neural evidence for the preservation of decision making in the absence of learning in old age. NeuroImage, 52(4), 1514–1520. https://doi.org/10.1016/j.neuroimage.2010.05.008
Madlon-Kay, S., Pesaran, B., & Daw, N. D. (2013). Action selection in multi-effector decision making. NeuroImage, 70, 66–79. https://doi.org/10.1016/j.neuroimage.2012.12.001
Mitchell, D. G. V., Luo, Q., Avny, S. B., Kasprzycki, T., Gupta, K., Chen, G., … Blair, R. J. R. (2009). Adapting to dynamic stimulus-response values: differential contributions of inferior frontal, dorsomedial, and dorsolateral regions of prefrontal cortex to decision making. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 29(35), 10827–10834. https://doi.org/10.1523/JNEUROSCI.0963-09.2009
Northoff, G., Grimm, S., Boeker, H., Schmidt, C., Bermpohl, F., Heinzel, A., … Boesiger, P. (2006). Affective judgment and beneficial decision making: ventromedial prefrontal activity correlates with performance in the Iowa Gambling Task. Human Brain Mapping, 27(7), 572–587. https://doi.org/10.1002/hbm.20202
It’s only part reality because the brain works more complexly than to function in neat, organized ways. The segregation of the decision-making system into two neat components is pedagogy because it is mostly used as a theory so that the way the system works can be taught and understood more easily. -VideoSport
This phenomena describes the outcome of some sort of competition or debate. The winner of the competition gets to take all the rewards, and second or third place receive nothing. So it does no good to try hard unless it's harder than the hardest working individuals there. This sort of competition encourages its participants to cheat or try to cut corners more, compared to trying to do a quality job. As the rewards aren’t divided up depending on the most quality work, but only how you fared in comparison to your opponents.
“Winner Take All Incentive Systems, Competition, and Cheating Teachers, Soccer Players, and Research Subjects.” Psychology Today. Accessed February 5, 2019. http://www.psychologytoday.com/blog/work-matters/201006/winner-take-all-incentive-systems-competition-and-cheating-teachers-soccer.
-AgentCharter
like a mound bc GFOD, in LIP neurons are wired, neuron fires action potentials which excites the neighbors and causes them to fire action potentials too
Schoasticity is a randomly determined process or probability. (Stochastic. (2019). In Wikipedia. Retrieved from https://en.wikipedia.org/w/index.php?title=Stochastic&oldid=877625483) - WindowComrade
Idiosyncratic is another word for unique or peculiar. An idiosyncratic preferences, therefore, are the unique preferences that drive decision making for individuals. In the context of the article, researchers can approach studying decision making in a variety of ways, with perceptual decision making and idiosyncratic preferences as two options.
Wikipedia contributors, “Idiosyncrasy,” Wikipedia, The Free Encyclopedia, https://en.wikipedia.org/w/index.php?title=Idiosyncrasy&oldid=879085703 (accessed February 5, 2019).
MileImport
“a characteristic, habit, mannerism, or the like, that is peculiar to an individual.” (“the definition of idiosyncrasy,” n.d.) the definition of idiosyncrasy. (n.d.). Retrieved February 5, 2019, from https://www.dictionary.com/browse/idiosyncrasy
This talks about how people’s preferences are neither correct or incorrect. They are based on past experiences, therefore emotional decisions are not based on the decision’s correctness.
-IsotopeNirvana
(Glimcher, 2014)
NitroMotor: “The expected utility theory deals with the analysis of situations where individuals must make a decision without knowing which outcomes may result from that decision, this is, decision making under //uncertainty//. These individuals will choose the act that will result in the highest expected utility, being this the sum of the products of probability and //utility// over all possible outcomes. The decision made will also depend on the agent’s //risk aversion// and the utility of other agents.” Basically, each individual makes decisions based on their perceived utility or value of the probable outcomes. $100 has much higher utility to a homeless person than a millionaire, so that person will choose a conservative behavior that is more likely to get some of the money, rather than taking more risks which may result in no reward. https://policonomics.com/expected-utility-theory/
(“Expected utility theory | Policonomics,” n.d.)
SincereZigzag:
(Aumann & Brandenburger, 1995)
Cool Active
Mixed Strategy Nash Equilibrium is a form of game theory that involves calculating payoffs by using “X” by “X” celled tables. Using expected payoffs and probabilities allows the user to analyze the potential choices.
Calculating Payoffs of Mixed Strategy Nash Equilibria – Game Theory 101. (n.d.). Retrieved February 5, 2019, from http://gametheory101.com/courses/game-theory-101/calculating-payoffs-of-mixed-strategy-nash-equilibria/
Signal detection theory : Have you ever felt your phone vibrate in your pocket and check your phone and you have no notifications? It’s actually a common occurrence. Signal detection theory, which at its most basic, states that the detection of a stimulus depends on both the intensity of the stimulus and the physical/psychological state of the individual. Basically, we notice things based on how strong they are and on how much we're paying attention.
(Signal detection theory - part 1, n.d.)
(“Signal Detection Theory,” n.d.)
Expected Utility Theory- Expected utility theory is a major theory of decision making under risk. Decision making under risk is a type of decision-making in which the probability distribution of the results is known. This expected utility theory is assumed in numerous theories of economics
MobileSuper
(Takemura, 2014)
BanditMeter: Lateral Intraparietal cortex, it is involved in visual movement and attention. The LIP is associated with spatial and temporal attention in vision.
Bisley, James W., and Michael E. Goldberg. “Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention.” Science 299, no. 5603 (January 3, 2003): 81. https://doi.org/10.1126/science.1077395.
Orquin, J. L., & Mueller Loose, S. (2013). Attention and choice: A review on eye movements in decision making. Acta Psychologica, 144(1), 190–206. https://doi.org/10.1016/j.actpsy.2013.06.003
vmPFC sends output to and received input from memory, emotion and reward related structures such as the amygdala, hippocampus, and caudate nucleus.
Wheeler, E. Z. (2006, June 21). Examining Theories of Ventromedial Prefrontal Cortex Function [University of Pittsburgh ETD]. Retrieved February 5, 2019, from http://d-scholarship.pitt.edu/7587/
Medial Prefrontal cortex: some people say it mediates decision making, and other say it is involved in retrieval of long-term memory.
The Role of Medial Prefrontal Cortex in Memory and Decision Making. (n.d.). Retrieved February 5, 2019, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3562704/
SodaOxford
ExactTulip: “In animal studies, working memory was originally used to explain hippocampal functions 20,21,22,23,24,25,26]. However, working memory has now become the most important concept for interpreting and understanding prefrontal cortical functions in both humans and animals (Funahashi, 2017).”
Funahashi, S. (2017). Working Memory in the Prefrontal Cortex. Brain Sciences, 7(5). https://doi.org/10.3390/brainsci7050049
“According to this “component processes” view of working memory, no processes (and correspondingly no brain structures) are unique or specific to working memory. Rather, working memory results from various combinations of processes that in other constellations can be functionally described in other terms than working memory (Eriksson, Vogel, Lansner, Bergström, & Nyberg, 2015). ”
Eriksson, J., Vogel, E. K., Lansner, A., Bergström, F., & Nyberg, L. (2015). Neurocognitive architecture of working memory. Neuron, 88(1), 33–46. https://doi.org/10.1016/j.neuron.2015.09.020
The “chunking” theory of learning is a main component of working memory, considering it enables the user to recall information with greater ease while executing a specific task. When considering both the hypothalamus and prefrontal cortex, in addition to various other regions of the brain, are activated during memory processes, it seems that the chunking method of retaining information is the work of a collective whole rather than individualized brain regions.
RavioliJaguar: the Ventromedial Prefrontal Cortex (vmPFC) plays a major part in human decision making. This region assists in predicting values of the different options in instances of certainty and uncertainty. Those with lesions in the vmPFC showed that they would be able to make decisions based on preferences of the options but their choices were inconsistent.
Fellows, L. K., & Farah, M. J. (2007). The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cerebral Cortex (New York, N.Y.: 1991), 17(11), 2669–2674. https://doi.org/10.1093/cercor/bhl176
The dorsolateral prefrontal cortex (dlPFC) was examined in a study using the Iowa Gambling Task. This tasks takes the form of a card game in which participants select cards from one of four decks in an effort to win play money. Two of the decks are associated with large wins, but occasional even larger losses. The other two conceal smaller wins, but even smaller losses. As the game proceeds, normal individuals generally learn to avoid the risky decks, instead adopting a conservative strategy of accepting smaller wins to avoid large losses (Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition, 50(1–3), 7–15.) They found that damage to dlPFC impairs individuals from being able to play the IGT task and avoid the most losses
Fellows, L. K., & Farah, M. J. (2005). Different Underlying Impairments in Decision-making Following Ventromedial and Dorsolateral Frontal Lobe Damage in Humans. Cerebral Cortex, 15(1), 58–63. //https://doi.org/10.1093/cercor/bhh108//
It appears as if the release of dopamine is more so dependent on the potential for knowing when a reward would be received and less so about the actual size of the reward. For example, more firing would occur if someone was more uncertain about receiving the reward even if the reward itself was large (Anselme & Robinson, 2013).
Anselme, P., & Robinson, M. J. F. (2013). What motivates gambling behavior? Insight into dopamine’s role. Frontiers in Behavioral Neuroscience, 7. https://doi.org/10.3389/fnbeh.2013.00182
-TelecomElegant
NitroMotor: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4826767/
“Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards—an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction error), remain at baseline activity for fully predicted rewards, and show depressed activity with less reward than predicted (negative prediction error). The dopamine signal increases nonlinearly with reward value and codes formal economic utility.”
(Schultz, 2016) (Schultz, 2016)
ZeroCanary: According to this experiment, subjects who had low levels on serotonin, were significantly less sensitive to rewards compared to the subjects whose serotonin levels were not tampered with (control group).
Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R. (2012). Serotonin selectively modulates reward value in human decision-making. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 32(17), 5833–5842. https://doi.org/10.1523/JNEUROSCI.0053-12.2012
Gongscratch: Serotonin and dopamine impact different structures in the brain. Dopamine is released in the nucleus accumbens and hippocampus while serotonin is focused more in hypothalamus. While serotonin has more to do with impulsivity and aggression, I would imagine that the data would be similarly correlated to the findings found with dopamine based on their similar relationships with reward and addiction.
Blum, K., Cull, J. G., Braverman, E. R., & Comings, D. E. (1996). Reward Deficiency Syndrome. American Scientist, 84(2), 132–145.
Studies have shown that serotonin levels alter the rate of delayed reward value in both animal and human models, which is associated with impulsive behavior. Low serotonin levels cause impulsive behavior, as proven by the result of more frequent small reward choices when compared to control serotonin levels.
Schweighofer, N., Bertin, M., et al. (2008). Low serotonin levels increase delayed reward discounting in humans. The Journal of Neuroscience, 28(17), 4528-4532.
Paint Level
Exposure to drugs can desensitize the brain to dopamine. Addiction is not only related to drugs being reinforced through dopamine release. People will build up a tolerance to the drug and then they will need it to even feel normal, let alone happy. Initially, the drug will give them a huge dopamine release and as they do it more, they need more of the drug to get to that same level. That is what people call “chasing the high” because they are taking more and more of it to try to get that feeling they had at first. This causes addicts to build up such a high tolerance that they have to take a ton of it to feel any dopamine release. Dopamine is definitely related to addiction, but mostly that the drug can desensitize the brain to dopamine so that the addict needs more drugs to be happy and feel that dopamine release.
What Role Does Dopamine Play in Addiction? (2013, September 30). Retrieved February
-PoloBravo
PolarisUnique: “Family members, partners, and close friends are sensitive to vulnerabilities of their social partners, but in some domains and according to their partners' age they perceive a greater (or smaller) risk than their partners perceive for themselves.”
**(Rolison, Hanoch, & Freund, 2018)**
-IsotopeNirvana
Adolphs, R. (1999). Social cognition and the human brain. Trends in Cognitive Sciences, 3(12), 469–479. https://doi.org/10.1016/S1364-6613(99)01399-6Arg max. (2018). In //Wikipedia//. Retrieved from https://en.wikipedia.org/w/index.php?title=Arg_max&oldid=873249289
Causse, M., Péran, P., Dehais, F., Caravasso, C. F., Zeffiro, T., Sabatini, U., & Pastor, J. (2013). Affective decision making under uncertainty during a plausible aviation task: an fMRI study. NeuroImage, 71, 19–29. https://doi.org/10.1016/j.neuroimage.2012.12.060
Christopoulos, V. N., Kagan, I., & Andersen, R. A. (2018). Lateral intraparietal area (LIP) is largely effector-specific in free-choice decisions. Scientific Reports, 8(1), 8611. https://doi.org/10.1038/s41598-018-26366-9
Dorris, M. C., & Glimcher, P. W. (2004). Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron, 44(2), 365–378. https://doi.org/10.1016/j.neuron.2004.09.009
Eriksson, J., Vogel, E. K., Lansner, A., Bergström, F., & Nyberg, L. (2015). Neurocognitive architecture of working memory. Neuron, 88(1), 33–46. https://doi.org/10.1016/j.neuron.2015.09.020
Expected utility theory | Policonomics. (n.d.). Retrieved February 5, 2019, from https://policonomics.com/expected-utility-theory/
Exploring Parallels Between Human And Animal Decision-Making. (2016, September 13). Retrieved February 5, 2019, from https://thedecisionlab.com/parallels-between-human-animal-decision-making/
Fellows, L. K., & Farah, M. J. (2007). The role of ventromedial prefrontal cortex in decision making: judgment under uncertainty or judgment per se? Cerebral Cortex (New York, N.Y.: 1991), 17(11), 2669–2674. https://doi.org/10.1093/cercor/bhl176
Funahashi, S. (2017). Working Memory in the Prefrontal Cortex. Brain Sciences, 7(5). https://doi.org/10.3390/brainsci7050049
Glimcher, P. W. (2014). Chapter 20 - Value-Based Decision Making. In P. W. Glimcher & E. Fehr (Eds.), Neuroeconomics (Second Edition) (pp. 373–391). https://doi.org/10.1016/B978-0-12-416008-8.00020-6
Hosseini, S. M. H., Rostami, M., Yomogida, Y., Takahashi, M., Tsukiura, T., & Kawashima, R. (2010). Aging and decision making under uncertainty: behavioral and neural evidence for the preservation of decision making in the absence of learning in old age. NeuroImage, 52(4), 1514–1520. https://doi.org/10.1016/j.neuroimage.2010.05.008
Jensen, G. (2018). Behavioral Stochasticity. Encyclopedia of Animal Cognition and Behavior, 1–5. https://doi.org/10.1007/978-3-319-47829-6_1520-1
Madlon-Kay, S., Pesaran, B., & Daw, N. D. (2013). Action selection in multi-effector decision making. NeuroImage, 70, 66–79. https://doi.org/10.1016/j.neuroimage.2012.12.001
Mitchell, D. G. V., Luo, Q., Avny, S. B., Kasprzycki, T., Gupta, K., Chen, G., … Blair, R. J. R. (2009). Adapting to dynamic stimulus-response values: differential contributions of inferior frontal, dorsomedial, and dorsolateral regions of prefrontal cortex to decision making. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 29(35), 10827–10834. https://doi.org/10.1523/JNEUROSCI.0963-09.2009
Northoff, G., Grimm, S., Boeker, H., Schmidt, C., Bermpohl, F., Heinzel, A., … Boesiger, P. (2006). Affective judgment and beneficial decision making: ventromedial prefrontal activity correlates with performance in the Iowa Gambling Task. Human Brain Mapping, 27(7), 572–587. https://doi.org/10.1002/hbm.20202
Orquin, J. L., & Mueller Loose, S. (2013). Attention and choice: A review on eye movements in decision making. Acta Psychologica, 144(1), 190–206. https://doi.org/10.1016/j.actpsy.2013.06.003
Pearson-Fuhrhop, K. M., Minton, B., Acevedo, D., Shahbaba, B., & Cramer, S. C. (2013). Genetic Variation in the Human Brain Dopamine System Influences Motor Learning and Its Modulation by L-Dopa. PLoS ONE, 8(4). https://doi.org/10.1371/journal.pone.0061197
Pesaran, B., Nelson, M. J., & Andersen, R. A. (2008). Free choice activates a decision circuit between frontal and parietal cortex. Nature, 453(7193), 406–409. https://doi.org/10.1038/nature06849
Rolison, J. J., Hanoch, Y., & Freund, A. M. (2018). Perception of Risk for Older Adults: Differences in Evaluations for Self versus Others and across Risk Domains. Gerontology, 1–13. https://doi.org/10.1159/000494352
Seymour, B., Daw, N. D., Roiser, J. P., Dayan, P., & Dolan, R. (2012). Serotonin selectively modulates reward value in human decision-making. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 32(17), 5833–5842. https://doi.org/10.1523/JNEUROSCI.0053-12.2012
Signal Detection Theory: Definition & Examples - Video & Lesson Transcript. (n.d.). Retrieved February 5, 2019, from Study.com website: http://study.com/academy/lesson/signal-detection-theory-definition-examples.html
Signal detection theory - part 1. (n.d.). Retrieved from https://www.khanacademy.org/science/health-and-medicine/nervous-system-and-sensory-infor/sensory-perception-topic/v/signal-detection-theory-part-1]]
Stochastic. (2019). In Wikipedia. Retrieved from https://en.wikipedia.org/w/index.php?title=Stochastic&oldid=877625483
The Role of Medial Prefrontal Cortex in Memory and Decision Making. (n.d.). Retrieved February 5, 2019, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3562704/
What Role Does Dopamine Play in Addiction? (2013, September 30). Retrieved February 5, 2019, from Inspire Malibu website: https://www.inspiremalibu.com/blog/drug-addiction/dopamine-and-addiction/
Wheeler, E. Z. (2006, June 21). Examining Theories of Ventromedial Prefrontal Cortex Function [University of Pittsburgh ETD]. Retrieved February 5, 2019, from http://d-scholarship.pitt.edu/7587/
Wickens, T. D. (2002). Elementary Signal Detection Theory. Oxford University Press.
2019-05-06