1
|
Khorisantono PA, Huang 黃飛揚 FY, Sutcliffe MPF, Fletcher PC, Farooqi IS, Grabenhorst F. A Neural Mechanism in the Human Orbitofrontal Cortex for Preferring High-Fat Foods Based on Oral Texture. J Neurosci 2023; 43:8000-8017. [PMID: 37845034 PMCID: PMC10669766 DOI: 10.1523/jneurosci.1473-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 09/17/2023] [Accepted: 09/19/2023] [Indexed: 10/18/2023] Open
Abstract
Although overconsumption of high-fat foods is a major driver of weight gain, the neural mechanisms that link the oral sensory properties of dietary fat to reward valuation and eating behavior remain unclear. Here we combine novel food-engineering approaches with functional neuroimaging to show that the human orbitofrontal cortex (OFC) translates oral sensations evoked by high-fat foods into subjective economic valuations that guide eating behavior. Male and female volunteers sampled and evaluated nutrient-controlled liquid foods that varied in fat and sugar ("milkshakes"). During oral food processing, OFC activity encoded a specific oral-sensory parameter that mediated the influence of the foods' fat content on reward value: the coefficient of sliding friction. Specifically, OFC responses to foods in the mouth reflected the smooth, oily texture (i.e., mouthfeel) produced by fatty liquids on oral surfaces. Distinct activity patterns in OFC encoded the economic values associated with particular foods, which reflected the subjective integration of sliding friction with other food properties (sugar, fat, viscosity). Critically, neural sensitivity of OFC to oral texture predicted individuals' fat preferences in a naturalistic eating test: individuals whose OFC was more sensitive to fat-related oral texture consumed more fat during ad libitum eating. Our findings suggest that reward systems of the human brain sense dietary fat from oral sliding friction, a mechanical food parameter that likely governs our daily eating experiences by mediating interactions between foods and oral surfaces. These findings identify a specific role for the human OFC in evaluating oral food textures to mediate preference for high-fat foods.SIGNIFICANCE STATEMENT Fat and sugar enhance the reward value of food by imparting a sweet taste and rich mouthfeel but also contribute to overeating and obesity. Here we used a novel food-engineering approach to realistically quantify the physical-mechanical properties of high-fat liquid foods on oral surfaces and used functional neuroimaging while volunteers sampled these foods and placed monetary bids to consume them. We found that a specific area of the brain's reward system, the orbitofrontal cortex, detects the smooth texture of fatty foods in the mouth and links these sensory inputs to economic valuations that guide eating behavior. These findings can inform the design of low-calorie fat-replacement foods that mimic the impact of dietary fat on oral surfaces and neural reward systems.
Collapse
Affiliation(s)
- Putu A Khorisantono
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Fei-Yang Huang 黃飛揚
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX1 3TA, United Kingdom
| | - Michael P F Sutcliffe
- Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom
| | - Paul C Fletcher
- Wellcome Trust-MRC Institute of Metabolic Science, Addenbrooke's Hospital, Cambridge CB2 0QQ, United Kingdom
| | - I Sadaf Farooqi
- Wellcome Trust-MRC Institute of Metabolic Science, Addenbrooke's Hospital, Cambridge CB2 0QQ, United Kingdom
| | - Fabian Grabenhorst
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX1 3TA, United Kingdom
| |
Collapse
|
2
|
Pastor-Bernier A, Volkmann K, Chi U Seak L, Stasiak A, Plott CR, Schultz W. Studying neural responses for multi-component economic choices in human and non-human primates using concept-based behavioral choice experiments. STAR Protoc 2023; 4:102296. [PMID: 37294630 PMCID: PMC10323126 DOI: 10.1016/j.xpro.2023.102296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 02/24/2023] [Accepted: 04/19/2023] [Indexed: 06/11/2023] Open
Abstract
Realistic, everyday rewards contain multiple components, such as taste and size. However, our reward valuations and the associated neural reward signals are single dimensional (vector to scalar transformation). Here, we present a protocol to identify these single-dimensional neural responses for multi-component choice options in humans and monkeys using concept-based behavioral choice experiments. We describe the use of stringent economic concepts to develop and implement behavioral tasks. We detail regional neuroimaging in humans and fine-grained neurophysiology in monkeys and describe approaches for data analysis. For complete details on the use and execution of this protocol, please refer to our work on humans Seak et al.1 and Pastor-Bernier et al.2 and monkeys Pastor-Bernier et al. 3, Pastor-Bernier et al.4, and Pastor-Bernier et al.5.
Collapse
Affiliation(s)
- Alexandre Pastor-Bernier
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Konstantin Volkmann
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Leo Chi U Seak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Arkadiusz Stasiak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK
| | - Charles R Plott
- Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, CA 91125, USA
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, UK.
| |
Collapse
|
3
|
Rolls ET, Deco G, Huang CC, Feng J. Human amygdala compared to orbitofrontal cortex connectivity, and emotion. Prog Neurobiol 2023; 220:102385. [PMID: 36442728 DOI: 10.1016/j.pneurobio.2022.102385] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/14/2022] [Accepted: 11/24/2022] [Indexed: 11/26/2022]
Abstract
The amygdala and orbitofrontal cortex have been implicated in emotion. To understand these regions better in humans, their effective connectivity with 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography. The human amygdala has effective connectivity from few cortical regions compared to the orbitofrontal cortex: primarily from auditory cortex A5 and the related superior temporal gyrus and temporal pole regions; the piriform (olfactory) cortex; the lateral orbitofrontal cortex 47m; somatosensory cortex; the hippocampus, entorhinal cortex, perirhinal cortex, and parahippocampal TF; and from the cholinergic nucleus basalis. The amygdala has effective connectivity to the hippocampus, entorhinal and perirhinal cortex; to the temporal pole; and to the lateral orbitofrontal cortex. The orbitofrontal cortex has effective connectivity from gustatory, olfactory, and temporal visual, auditory and pole cortex, and to the pregenual anterior and posterior cingulate cortex, hippocampal system, and prefrontal cortex, and provides for rewards and punishers to be used in reported emotions, and memory and navigation to goals. Given the paucity of amygdalo-neocortical connectivity in humans, it is proposed that the human amygdala is involved primarily in autonomic and conditioned responses via brainstem connectivity, rather than in reported (declarative) emotion.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; Department of Computer Science, University of Warwick, Coventry, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China.
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona, 08018, Spain Brain and Cognition, Pompeu Fabra University, Barcelona, Spain; Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| |
Collapse
|
4
|
Klein-Flügge MC, Jensen DEA, Takagi Y, Priestley L, Verhagen L, Smith SM, Rushworth MFS. Relationship between nuclei-specific amygdala connectivity and mental health dimensions in humans. Nat Hum Behav 2022; 6:1705-1722. [PMID: 36138220 PMCID: PMC7613949 DOI: 10.1038/s41562-022-01434-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2020] [Accepted: 07/14/2022] [Indexed: 01/14/2023]
Abstract
There has been increasing interest in using neuroimaging measures to predict psychiatric disorders. However, predictions usually rely on large brain networks and large disorder heterogeneity. Thus, they lack both anatomical and behavioural specificity, preventing the advancement of targeted interventions. Here we address both challenges. First, using resting-state functional magnetic resonance imaging, we parcellated the amygdala, a region implicated in mood disorders, into seven nuclei. Next, a questionnaire factor analysis provided subclinical mental health dimensions frequently altered in anxious-depressive individuals, such as negative emotions and sleep problems. Finally, for each behavioural dimension, we identified the most predictive resting-state functional connectivity between individual amygdala nuclei and highly specific regions of interest, such as the dorsal raphe nucleus in the brainstem or medial frontal cortical regions. Connectivity in circumscribed amygdala networks predicted behaviours in an independent dataset. Our results reveal specific relations between mental health dimensions and connectivity in precise subcortical networks.
Collapse
Affiliation(s)
- Miriam C Klein-Flügge
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK.
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK.
- Department of Psychiatry, Warneford Hospital, University of Oxford, Oxford, UK.
| | - Daria E A Jensen
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Department of Psychiatry, Warneford Hospital, University of Oxford, Oxford, UK
| | - Yu Takagi
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
- Department of Psychiatry, Warneford Hospital, University of Oxford, Oxford, UK
- Graduate School of Frontier Biosciences, Osaka University, Suita, Japan
| | - Luke Priestley
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | - Lennart Verhagen
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Stephen M Smith
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | - Matthew F S Rushworth
- Wellcome Centre for Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (FMRIB) and Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| |
Collapse
|
5
|
Zheng J, Skelin I, Lin JJ. Neural computations underlying contextual processing in humans. Cell Rep 2022; 40:111395. [PMID: 36130515 PMCID: PMC9552771 DOI: 10.1016/j.celrep.2022.111395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 03/28/2022] [Accepted: 08/29/2022] [Indexed: 12/01/2022] Open
Abstract
Context shapes our perception of facial expressions during everyday social interactions. We interpret a person’s face in a hostile situation negatively and judge the same face under pleasant circumstances positively. Critical to our adaptive fitness, context provides situation-specific framing to resolve ambiguity and guide our interpersonal behavior. This context-specific modulation of facial expression is thought to engage the amygdala, hippocampus, and orbitofrontal cortex; however, the underlying neural computations remain unknown. Here we use human intracranial electroencephalograms (EEGs) directly recorded from these regions and report bidirectional theta-gamma interactions within the amygdala-hippocampal network, facilitating contextual processing. Contextual information is subsequently represented in the orbitofrontal cortex, where a theta phase shift binds context and face associations within theta cycles, endowing faces with contextual meanings at behavioral timescales. Our results identify theta phase shifts as mediating associations between context and face processing, supporting flexible social behavior. Context influences our perception of facial expressions. Zheng et al. show that contextual modulation of faces relies on medial temporal lobe-orbitofrontal cortex communications in humans. High gamma bursts occur in rhythm with theta oscillations, with cross-regional theta-gamma phase shifts binding context-face associations.
Collapse
Affiliation(s)
- Jie Zheng
- Department of Biomedical Engineering, University of California, Irvine, Irvine, CA 92697, USA.
| | - Ivan Skelin
- Department of Neurology, University of California, Davis, Davis, CA 95817, USA; The Center for Mind and Brain, University of California, Davis, Davis, CA 95618, USA
| | - Jack J Lin
- Department of Neurology, University of California, Davis, Davis, CA 95817, USA; The Center for Mind and Brain, University of California, Davis, Davis, CA 95618, USA.
| |
Collapse
|
6
|
Poudel R, Tobia MJ, Riedel MC, Salo T, Flannery JS, Hill-Bowen LD, Dick AS, Laird AR, Parra CM, Sutherland MT. Risky decision-making strategies mediate the relationship between amygdala activity and real-world financial savings among individuals from lower income households: A pilot study. Behav Brain Res 2022; 428:113867. [PMID: 35385783 PMCID: PMC10739684 DOI: 10.1016/j.bbr.2022.113867] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Revised: 03/06/2022] [Accepted: 03/28/2022] [Indexed: 11/19/2022]
Abstract
Lower financial savings among individuals experiencing adverse social determinants of health (SDoH) increases vulnerabilities during times of crisis. SDoH including low socioeconomic status (low-SES) influence cognitive abilities as well as health and life outcomes that may perpetuate poverty and disparities. Despite evidence suggesting a role for financial growth in minimizing SDoH-related disparities and vulnerabilities, neurobiological mechanisms linked with financial behavior remain to be elucidated. As such, we examined the relationships between brain activity during decision-making (DM), laboratory-based task performance, and money savings behavior. Participants (N = 24, 14 females) from low-SES households (income<$20,000/year) underwent fMRI scanning while performing the Balloon Analogue Risk Task (BART), a DM paradigm probing risky- and strategic-DM processes. Participants also completed self-report instruments characterizing relevant personality characteristics and then engaged in a community outreach financial program where amount of money saved was tracked over a 6-month period. Regarding BART-related brain activity, we observed expected activity in regions implicated in reward and emotional processing including the amygdala. Regarding brain-behavior relationships, we found that laboratory-based BART performance mediated the impact of amygdala activity on real-world behavior. That is, elevated amygdala activity was linked with BART strategic-DM which, in turn, was linked with more money saved after 6 months. In exploratory analyses, this mediation was moderated by emotion-related personality characteristics such that, only individuals reporting lower alexithymia demonstrated a relationship between amygdala activity and savings. These outcomes suggest that DM-related amygdala activity and/or emotion-related personality characteristics may provide utility as an endophenotypic marker of individual's financial savings behavior.
Collapse
Affiliation(s)
- Ranjita Poudel
- Department of Psychology, Florida International University, Miami, FL, United States
| | - Michael J Tobia
- Department of Physics, Florida International University, Miami, FL, United States
| | - Michael C Riedel
- Department of Physics, Florida International University, Miami, FL, United States
| | - Taylor Salo
- Department of Psychology, Florida International University, Miami, FL, United States
| | - Jessica S Flannery
- Department of Psychology, Florida International University, Miami, FL, United States
| | - Lauren D Hill-Bowen
- Department of Psychology, Florida International University, Miami, FL, United States
| | - Anthony S Dick
- Department of Psychology, Florida International University, Miami, FL, United States
| | - Angela R Laird
- Department of Physics, Florida International University, Miami, FL, United States
| | - Carlos M Parra
- College of Business, Florida International University, Miami, FL, United States
| | - Matthew T Sutherland
- Department of Psychology, Florida International University, Miami, FL, United States.
| |
Collapse
|
7
|
Grabenhorst F, Schultz W. Functions of primate amygdala neurons in economic decisions and social decision simulation. Behav Brain Res 2021; 409:113318. [PMID: 33901436 PMCID: PMC8164162 DOI: 10.1016/j.bbr.2021.113318] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 04/21/2021] [Accepted: 04/21/2021] [Indexed: 01/15/2023]
Abstract
Long implicated in aversive processing, the amygdala is now recognized as a key component of the brain systems that process rewards. Beyond reward valuation, recent findings from single-neuron recordings in monkeys indicate that primate amygdala neurons also play an important role in decision-making. The reward value signals encoded by amygdala neurons constitute suitable inputs to economic decision processes by being sensitive to reward contingency, relative reward quantity and temporal reward structure. During reward-based decisions, individual amygdala neurons encode both the value inputs and corresponding choice outputs of economic decision processes. The presence of such value-to-choice transitions in single amygdala neurons, together with other well-defined signatures of decision computation, indicate that a decision mechanism may be implemented locally within the primate amygdala. During social observation, specific amygdala neurons spontaneously encode these decision signatures to predict the choices of social partners, suggesting neural simulation of the partner's decision-making. The activity of these 'simulation neurons' could arise naturally from convergence between value neurons and social, self-other discriminating neurons. These findings identify single-neuron building blocks and computational architectures for decision-making and social behavior in the primate amygdala. An emerging understanding of the decision function of primate amygdala neurons can help identify potential vulnerabilities for amygdala dysfunction in human conditions afflicting social cognition and mental health.
Collapse
Affiliation(s)
- Fabian Grabenhorst
- Department of Physiology, Development & Neuroscience, University of Cambridge, Cambridge, CB2 3DY, UK.
| | - Wolfram Schultz
- Department of Physiology, Development & Neuroscience, University of Cambridge, Cambridge, CB2 3DY, UK.
| |
Collapse
|
8
|
Meta-analytic clustering dissociates brain activity and behavior profiles across reward processing paradigms. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2021; 20:215-235. [PMID: 31872334 DOI: 10.3758/s13415-019-00763-7] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Reward learning is a ubiquitous cognitive mechanism guiding adaptive choices and behaviors, and when impaired, can lead to considerable mental health consequences. Reward-related functional neuroimaging studies have begun to implicate networks of brain regions essential for processing various peripheral influences (e.g., risk, subjective preference, delay, social context) involved in the multifaceted reward processing construct. To provide a more complete neurocognitive perspective on reward processing that synthesizes findings across the literature while also appreciating these peripheral influences, we used emerging meta-analytic techniques to elucidate brain regions, and in turn networks, consistently engaged in distinct aspects of reward processing. Using a data-driven, meta-analytic, k-means clustering approach, we dissociated seven meta-analytic groupings (MAGs) of neuroimaging results (i.e., brain activity maps) from 749 experimental contrasts across 176 reward processing studies involving 13,358 healthy participants. We then performed an exploratory functional decoding approach to gain insight into the putative functions associated with each MAG. We identified a seven-MAG clustering solution that represented dissociable patterns of convergent brain activity across reward processing tasks. Additionally, our functional decoding analyses revealed that each of these MAGs mapped onto discrete behavior profiles that suggested specialized roles in predicting value (MAG-1 & MAG-2) and processing a variety of emotional (MAG-3), external (MAG-4 & MAG-5), and internal (MAG-6 & MAG-7) influences across reward processing paradigms. These findings support and extend aspects of well-accepted reward learning theories and highlight large-scale brain network activity associated with distinct aspects of reward processing.
Collapse
|
9
|
Seak LCU, Volkmann K, Pastor-Bernier A, Grabenhorst F, Schultz W. Single-Dimensional Human Brain Signals for Two-Dimensional Economic Choice Options. J Neurosci 2021; 41:3000-3013. [PMID: 33568490 PMCID: PMC8018883 DOI: 10.1523/jneurosci.1555-20.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Revised: 10/28/2020] [Accepted: 11/03/2020] [Indexed: 11/29/2022] Open
Abstract
Rewarding choice options typically contain multiple components, but neural signals in single brain voxels are scalar and primarily vary up or down. In a previous study, we had designed reward bundles that contained the same two milkshakes with independently set amounts; we had used psychophysics and rigorous economic concepts to estimate two-dimensional choice indifference curves (ICs) that represented revealed stochastic preferences for these bundles in a systematic, integrated manner. All bundles on the same ICs were equally revealed preferred (and thus had same utility, as inferred from choice indifference); bundles on higher ICs (higher utility) were preferred to bundles on lower ICs (lower utility). In the current study, we used the established behavior for testing with functional magnetic resonance imaging (fMRI). We now demonstrate neural responses in reward-related brain structures of human female and male participants, including striatum, midbrain, and medial orbitofrontal cortex (mid-OFC) that followed the characteristic pattern of ICs: similar responses along ICs (same utility despite different bundle composition), but monotonic change across ICs (different utility). Thus, these brain structures integrated multiple reward components into a scalar signal, well beyond the known subjective value coding of single-component rewards.SIGNIFICANCE STATEMENT Rewards have several components, like the taste and size of an apple, but it is unclear how each component contributes to the overall value of the reward. While choice indifference curves (ICs) of economic theory provide behavioral approaches to this question, it is unclear whether brain responses capture the preference and utility integrated from multiple components. We report activations in striatum, midbrain, and orbitofrontal cortex (OFC) that follow choice ICs representing behavioral preferences over and above variations of individual reward components. In addition, the concept-driven approach encourages future studies on natural, multicomponent rewards that are prone to irrational choice of normal and brain-damaged individuals.
Collapse
Affiliation(s)
- Leo Chi U Seak
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Konstantin Volkmann
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Alexandre Pastor-Bernier
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Fabian Grabenhorst
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| |
Collapse
|
10
|
Vestergaard MD, Schultz W. Retrospective Valuation of Experienced Outcome Encoded in Distinct Reward Representations in the Anterior Insula and Amygdala. J Neurosci 2020; 40:8938-8950. [PMID: 33077553 PMCID: PMC7659459 DOI: 10.1523/jneurosci.2130-19.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2019] [Revised: 08/12/2020] [Accepted: 08/25/2020] [Indexed: 11/21/2022] Open
Abstract
Our ability to evaluate an experience retrospectively is important because it allows us to summarize its total value, and this summary value can then later be used as a guide in deciding whether the experience merits repeating, or whether instead it should rather be avoided. However, when an experience unfolds over time, humans tend to assign disproportionate weight to the later part of the experience, and this can lead to poor choice in repeating, or avoiding experience. Using model-based computational analyses of fMRI recordings in 27 male volunteers, we show that the human brain encodes the summary value of an extended sequence of outcomes in two distinct reward representations. We find that the overall experienced value is encoded accurately in the amygdala, but its merit is excessively marked down by disincentive anterior insula activity if the sequence of experienced outcomes declines temporarily. Moreover, the statistical strength of this neural code can separate efficient decision-makers from suboptimal decision-makers. Optimal decision-makers encode overall value more strongly, and suboptimal decision-makers encode the disincentive markdown (DM) more strongly. The separate neural implementation of the two distinct reward representations confirms that suboptimal choice for temporally extended outcomes can be the result of robust neural representation of a displeasing aspect of the experience such as temporary decline.SIGNIFICANCE STATEMENT One of the numerous foibles that prompt us to make poor decisions is known as the "Banker's fallacy," the tendency to focus on short-term growth at the expense of long-term value. This effect leads to unwarranted preference for happy endings. Here, we show that the anterior insula in the human brain marks down the overall value of an experience as it unfolds over time if the experience entails a sequence of predominantly negative temporal contrasts. By contrast, the amygdala encodes overall value accurately. These results provide neural indices for the dichotomy of decision utility and experienced utility popularized as Thinking fast and slow by Daniel Kahneman.
Collapse
Affiliation(s)
- Martin D Vestergaard
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom
| |
Collapse
|
11
|
Pastor-Bernier A, Volkmann K, Stasiak A, Grabenhorst F, Schultz W. Experimentally revealed stochastic preferences for multicomponent choice options. JOURNAL OF EXPERIMENTAL PSYCHOLOGY. ANIMAL LEARNING AND COGNITION 2020; 46:367-384. [PMID: 32718155 PMCID: PMC7547871 DOI: 10.1037/xan0000269] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Revised: 05/26/2020] [Accepted: 05/27/2020] [Indexed: 11/08/2022]
Abstract
Realistic, everyday rewards contain multiple components. An apple has taste and size. However, we choose in single dimensions, simply preferring some apples to others. How can such single-dimensional preference relationships refer to multicomponent choice options? Here, we measured how stochastic choices revealed preferences for 2-component milkshakes. The preferences were intuitively graphed as indifference curves that represented the orderly integration of the 2 components as trade-off: parts of 1 component were given up for obtaining 1 additional unit of the other component without a change in preference. The well-ordered, nonoverlapping curves satisfied leave-one-out tests, followed predictions by machine learning decoders and correlated with single-dimensional Becker-DeGroot-Marschak (BDM) auction-like bids for the 2-component rewards. This accuracy suggests a decision process that integrates multiple reward components into single-dimensional estimates in a systematic fashion. In interspecies comparisons, human performance matched that of highly experienced laboratory monkeys, as measured by accuracy of the critical trade-off between bundle components. These data describe the nature of choices of multicomponent choice options and attest to the validity of the rigorous economic concepts and their convenient graphic schemes for explaining choices of human and nonhuman primates. The results encourage formal behavioral and neural investigations of normal, irrational, and pathological economic choices. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
12
|
Zangemeister L, Grabenhorst F, Schultz W. Neural activity in human ventromedial prefrontal cortex reflecting the intention to save reward. Soc Cogn Affect Neurosci 2019; 14:1255-1261. [PMID: 31993656 PMCID: PMC7137725 DOI: 10.1093/scan/nsaa013] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2019] [Revised: 11/19/2019] [Accepted: 01/20/2020] [Indexed: 11/14/2022] Open
Abstract
Saving behavior usually requires individuals to perform several consecutive choices before collecting the final reward. The overt behavior is preceded by an intention to perform an appropriate choice sequence. We studied saving sequences for which each participant rated the intention numerically as willingness to save. Each sequence resulted in a specific reward amount and thus had a particular value for the participant, which we assessed with a Becker-DeGroot-Marschak auction-like mechanism. Using functional MRI, we found that blood-oxygen-level-dependent signals in human ventromedial prefrontal cortex (vmPFC) correlated with the participant's stated intention before each choice sequence. An adjacent vmPFC region showed graded activation that reflected the value of the sequence. These results demonstrate an involvement of vmPFC in intentional processes preceding sequential economic choices.
Collapse
Affiliation(s)
- Leopold Zangemeister
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, U.K
| | - Fabian Grabenhorst
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, U.K
| | - Wolfram Schultz
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge CB2 3DY, U.K
| |
Collapse
|
13
|
Neuronal Activity in the Primate Amygdala during Economic Choice. J Neurosci 2019; 40:1286-1301. [PMID: 31871277 DOI: 10.1523/jneurosci.0961-19.2019] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2019] [Revised: 11/25/2019] [Accepted: 11/27/2019] [Indexed: 01/27/2023] Open
Abstract
Multiple lines of evidence link economic choices to the orbitofrontal cortex (OFC), but other brain regions may contribute to the computation and comparison of economic values. A particularly strong candidate is the basolateral amygdala (BLA). Amygdala lesions impair performance in reinforcer devaluation tasks, suggesting that the BLA contributes to value computation. Furthermore, previous studies of the BLA have found neuronal activity consistent with a value representation. Here, we recorded from the BLA of two male rhesus macaques choosing between different juices. Offered quantities varied from trial to trial, and relative values were inferred from choices. Approximately one-third of BLA cells were task-related. Our analyses revealed the presence of three groups of neurons encoding variables offer value, chosen value, and chosen juice In this respect, the BLA appeared similar to the OFC. The two areas differed for the proportion of neurons in each group, as the fraction of chosen value cells was significantly higher in the BLA. Importantly, the activity of these neurons reflected the subjective nature of value. Firing rates in the BLA were sustained throughout the trial and maximal after juice delivery. In contrast, firing rates in the OFC were phasic and maximal shortly after offer presentation. Our results suggest that the BLA supports economic choice and reward expectation.SIGNIFICANCE STATEMENT Economic choices rely on the orbitofrontal cortex (OFC), but other brain regions may contribute to this behavior. A strong candidate is the basolateral amygdala (BLA). Previous results are consistent with a neuronal representation of value, but the role of the BLA in economic decisions remains unclear. Here, we recorded from monkeys choosing between juices. Neurons in the BLA encoded three decision variables: offer value, chosen value, and chosen juice These variables were also identified in the OFC. The two areas differed in the proportion of cells encoding each variable and in the activation timing. In the OFC, firing rates peaked shortly after offer presentation; in the BLA, firing rates were sustained and peaked after juice delivery. These results suggest that the BLA supports choices and reward expectation.
Collapse
|
14
|
Rosenthal-von der Pütten AM, Krämer NC, Maderwald S, Brand M, Grabenhorst F. Neural Mechanisms for Accepting and Rejecting Artificial Social Partners in the Uncanny Valley. J Neurosci 2019; 39:6555-6570. [PMID: 31263064 PMCID: PMC6697392 DOI: 10.1523/jneurosci.2956-18.2019] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2018] [Revised: 04/02/2019] [Accepted: 04/30/2019] [Indexed: 12/03/2022] Open
Abstract
Artificial agents are becoming prevalent across human life domains. However, the neural mechanisms underlying human responses to these new, artificial social partners remain unclear. The uncanny valley (UV) hypothesis predicts that humans prefer anthropomorphic agents but reject them if they become too humanlike-the so-called UV reaction. Using fMRI, we investigated neural activity when subjects evaluated artificial agents and made decisions about them. Across two experimental tasks, the ventromedial prefrontal cortex (VMPFC) encoded an explicit representation of subjects' UV reactions. Specifically, VMPFC signaled the subjective likability of artificial agents as a nonlinear function of humanlikeness, with selective low likability for highly humanlike agents. In exploratory across-subject analyses, these effects explained individual differences in psychophysical evaluations and preference choices. Functionally connected areas encoded critical inputs for these signals: the temporoparietal junction encoded a linear humanlikeness continuum, whereas nonlinear representations of humanlikeness in dorsomedial prefrontal cortex (DMPFC) and fusiform gyrus emphasized a human-nonhuman distinction. Following principles of multisensory integration, multiplicative combination of these signals reconstructed VMPFC's valuation function. During decision making, separate signals in VMPFC and DMPFC encoded subjects' decision variable for choices involving humans or artificial agents, respectively. A distinct amygdala signal predicted rejection of artificial agents. Our data suggest that human reactions toward artificial agents are governed by a neural mechanism that generates a selective, nonlinear valuation in response to a specific feature combination (humanlikeness in nonhuman agents). Thus, a basic principle known from sensory coding-neural feature selectivity from linear-nonlinear transformation-may also underlie human responses to artificial social partners.SIGNIFICANCE STATEMENT Would you trust a robot to make decisions for you? Autonomous artificial agents are increasingly entering our lives, but how the human brain responds to these new artificial social partners remains unclear. The uncanny valley (UV) hypothesis-an influential psychological framework-captures the observation that human responses to artificial agents are nonlinear: we like increasingly anthropomorphic artificial agents, but feel uncomfortable if they become too humanlike. Here we investigated neural activity when humans evaluated artificial agents and made personal decisions about them. Our findings suggest a novel neurobiological conceptualization of human responses toward artificial agents: the UV reaction-a selective dislike of highly humanlike agents-is based on nonlinear value-coding in ventromedial prefrontal cortex, a key component of the brain's reward system.
Collapse
Affiliation(s)
- Astrid M Rosenthal-von der Pütten
- Social Psychology: Media and Communication, University Duisburg-Essen, 47048 Duisburg, Germany,
- Individual and Technology, RWTH Aachen University, 52062 Aachen, Germany
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, 45141 Essen, Germany
| | - Nicole C Krämer
- Social Psychology: Media and Communication, University Duisburg-Essen, 47048 Duisburg, Germany
| | - Stefan Maderwald
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, 45141 Essen, Germany
| | - Matthias Brand
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, 45141 Essen, Germany
- General Psychology: Cognition and Center for Behavioral Addiction Research (CeBAR), University Duisburg-Essen, 47048 Duisburg, Germany, and
| | - Fabian Grabenhorst
- Department of Physiology, Development and Neuroscience, University of Cambridge, CB2 3DY Cambridge, United Kingdom
| |
Collapse
|
15
|
Weston CSE. Four Social Brain Regions, Their Dysfunctions, and Sequelae, Extensively Explain Autism Spectrum Disorder Symptomatology. Brain Sci 2019; 9:E130. [PMID: 31167459 PMCID: PMC6627615 DOI: 10.3390/brainsci9060130] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2019] [Revised: 05/31/2019] [Accepted: 06/03/2019] [Indexed: 12/13/2022] Open
Abstract
Autism spectrum disorder (ASD) is a challenging neurodevelopmental disorder with symptoms in social, language, sensory, motor, cognitive, emotional, repetitive behavior, and self-sufficient living domains. The important research question examined is the elucidation of the pathogenic neurocircuitry that underlies ASD symptomatology in all its richness and heterogeneity. The presented model builds on earlier social brain research, and hypothesizes that four social brain regions largely drive ASD symptomatology: amygdala, orbitofrontal cortex (OFC), temporoparietal cortex (TPC), and insula. The amygdala's contributions to ASD largely derive from its major involvement in fine-grained intangible knowledge representations and high-level guidance of gaze. In addition, disrupted brain regions can drive disturbance of strongly interconnected brain regions to produce further symptoms. These and related effects are proposed to underlie abnormalities of the visual cortex, inferior frontal gyrus (IFG), caudate nucleus, and hippocampus as well as associated symptoms. The model is supported by neuroimaging, neuropsychological, neuroanatomical, cellular, physiological, and behavioral evidence. Collectively, the model proposes a novel, parsimonious, and empirically testable account of the pathogenic neurocircuitry of ASD, an extensive account of its symptomatology, a novel physiological biomarker with potential for earlier diagnosis, and novel experiments to further elucidate the mechanisms of brain abnormalities and symptomatology in ASD.
Collapse
|
16
|
Hernandez CM, Orsini CA, Labiste CC, Wheeler AR, Ten Eyck TW, Bruner MM, Sahagian TJ, Harden SW, Frazier CJ, Setlow B, Bizon JL. Optogenetic dissection of basolateral amygdala contributions to intertemporal choice in young and aged rats. eLife 2019; 8:46174. [PMID: 31017572 PMCID: PMC6530979 DOI: 10.7554/elife.46174] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2019] [Accepted: 04/23/2019] [Indexed: 11/13/2022] Open
Abstract
Across species, aging is associated with an increased ability to choose delayed over immediate gratification. These experiments used young and aged rats to test the role of the basolateral amygdala (BLA) in intertemporal decision making. An optogenetic approach was used to inactivate the BLA in young and aged rats at discrete time points during choices between levers that yielded a small, immediate vs. a large, delayed food reward. BLA inactivation just prior to decisions attenuated impulsive choice in both young and aged rats. In contrast, inactivation during receipt of the small, immediate reward increased impulsive choice in young rats but had no effect in aged rats. BLA inactivation during the delay or intertrial interval had no effect at either age. These data demonstrate that the BLA plays multiple, temporally distinct roles during intertemporal choice, and show that the contribution of BLA to choice behavior changes across the lifespan.
Collapse
Affiliation(s)
- Caesar M Hernandez
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Caitlin A Orsini
- Department of Psychiatry, University of Florida, Gainesville, United States
| | - Chase C Labiste
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Alexa-Rae Wheeler
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Tyler W Ten Eyck
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Matthew M Bruner
- Department of Neuroscience, University of Florida, Gainesville, United States
| | - Todd J Sahagian
- Department of Pharmacodynamics, University of Florida, Gainesville, United States
| | - Scott W Harden
- Department of Pharmacodynamics, University of Florida, Gainesville, United States
| | - Charles J Frazier
- Department of Pharmacodynamics, University of Florida, Gainesville, United States
| | - Barry Setlow
- Department of Psychiatry, University of Florida, Gainesville, United States
| | - Jennifer L Bizon
- Department of Neuroscience, University of Florida, Gainesville, United States
| |
Collapse
|
17
|
Weston CSE. Amygdala Represents Diverse Forms of Intangible Knowledge, That Illuminate Social Processing and Major Clinical Disorders. Front Hum Neurosci 2018; 12:336. [PMID: 30186129 PMCID: PMC6113401 DOI: 10.3389/fnhum.2018.00336] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2018] [Accepted: 08/02/2018] [Indexed: 01/21/2023] Open
Abstract
Amygdala is an intensively researched brain structure involved in social processing and multiple major clinical disorders, but its functions are not well understood. The functions of a brain structure are best hypothesized on the basis of neuroanatomical connectivity findings, and of behavioral, neuroimaging, neuropsychological and physiological findings. Among the heaviest neuroanatomical interconnections of amygdala are those with perirhinal cortex (PRC), but these are little considered in the theoretical literature. PRC integrates complex, multimodal, meaningful and fine-grained distributed representations of objects and conspecifics. Consistent with this connectivity, amygdala is hypothesized to contribute meaningful and fine-grained representations of intangible knowledge for integration by PRC. Behavioral, neuroimaging, neuropsychological and physiological findings further support amygdala mediation of a diversity of such representations. These representations include subjective valence, impact, economic value, noxiousness, importance, ingroup membership, social status, popularity, trustworthiness and moral features. Further, the formation of amygdala representations is little understood, and is proposed to be often implemented through embodied cognition mechanisms. The hypothesis builds on earlier work, and makes multiple novel contributions to the literature. It highlights intangible knowledge, which is an influential but insufficiently researched factor in social and other behaviors. It contributes to understanding the heavy but neglected amygdala-PRC interconnections, and the diversity of amygdala-mediated intangible knowledge representations. Amygdala is a social brain region, but it does not represent species-typical social behaviors. A novel proposal to clarify its role is postulated. The hypothesis is also suggested to illuminate amygdala's involvement in several core symptoms of autism spectrum disorder (ASD). Specifically, novel and testable explanations are proposed for the ASD symptoms of disorganized visual scanpaths, apparent social disinterest, preference for concrete cognition, aspects of the disorder's heterogeneity, and impairment in some activities of daily living. Together, the presented hypothesis demonstrates substantial explanatory potential in the neuroscience, social and clinical domains.
Collapse
|
18
|
Decision Making: A Role for the Amygdala in Translating Goals into Choices. Curr Biol 2016; 26:R1177-R1179. [DOI: 10.1016/j.cub.2016.09.050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|