1
|
Valdebenito-Oyarzo G, Martínez-Molina MP, Soto-Icaza P, Zamorano F, Figueroa-Vargas A, Larraín-Valenzuela J, Stecher X, Salinas C, Bastin J, Valero-Cabré A, Polania R, Billeke P. The parietal cortex has a causal role in ambiguity computations in humans. PLoS Biol 2024; 22:e3002452. [PMID: 38198502 PMCID: PMC10824459 DOI: 10.1371/journal.pbio.3002452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 01/23/2024] [Accepted: 11/28/2023] [Indexed: 01/12/2024] Open
Abstract
Humans often face the challenge of making decisions between ambiguous options. The level of ambiguity in decision-making has been linked to activity in the parietal cortex, but its exact computational role remains elusive. To test the hypothesis that the parietal cortex plays a causal role in computing ambiguous probabilities, we conducted consecutive fMRI and TMS-EEG studies. We found that participants assigned unknown probabilities to objective probabilities, elevating the uncertainty of their decisions. Parietal cortex activity correlated with the objective degree of ambiguity and with a process that underestimates the uncertainty during decision-making. Conversely, the midcingulate cortex (MCC) encodes prediction errors and increases its connectivity with the parietal cortex during outcome processing. Disruption of the parietal activity increased the uncertainty evaluation of the options, decreasing cingulate cortex oscillations during outcome evaluation and lateral frontal oscillations related to value ambiguous probability. These results provide evidence for a causal role of the parietal cortex in computing uncertainty during ambiguous decisions made by humans.
Collapse
Affiliation(s)
- Gabriela Valdebenito-Oyarzo
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - María Paz Martínez-Molina
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Patricia Soto-Icaza
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Francisco Zamorano
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
- Facultad de Ciencias para el Cuidado de la Salud, Campus Los Leones, Universidad San Sebastián, Santiago, Chile
| | - Alejandra Figueroa-Vargas
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Josefina Larraín-Valenzuela
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Ximena Stecher
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
| | - César Salinas
- Unidad de Neuroimágenes Cuantitativas avanzadas (UNICA), Departamento de Imágenes, Clínica Alemana de Santiago, Santiago, Chile
| | - Julien Bastin
- Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences, Grenoble, France
| | - Antoni Valero-Cabré
- Causal Dynamics, Plasticity and Rehabilitation Group, FRONTLAB team, Institut du Cerveau et de la Moelle Epinière (ICM), CNRS UMR 7225, INSERM U 1127 and Sorbonne Université, Paris, France
- Cognitive Neuroscience and Information Technology Research Program, Open University of Catalonia (UOC), Barcelona, Spain
- Laboratory for Cerebral Dynamics Plasticity and Rehabilitation, Boston University, School of Medicine, Boston, Massachusetts, United States of America
| | - Rafael Polania
- Decision Neuroscience Lab, Department of Health Sciences and Technology, ETH Zurich, Zurich, Switzerland
| | - Pablo Billeke
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social, (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| |
Collapse
|
2
|
Brown LS, Cho JR, Bolkan SS, Nieh EH, Schottdorf M, Tank DW, Brody CD, Witten IB, Goldman MS. Neural circuit models for evidence accumulation through choice-selective sequences. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.01.555612. [PMID: 38234715 PMCID: PMC10793437 DOI: 10.1101/2023.09.01.555612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.
Collapse
|
3
|
Parr AC, Riek HC, Coe BC, Pari G, Masellis M, Marras C, Munoz DP. Genetic variation in the dopamine system is associated with mixed-strategy decision-making in patients with Parkinson's disease. Eur J Neurosci 2023; 58:4523-4544. [PMID: 36453013 DOI: 10.1111/ejn.15875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 11/16/2022] [Accepted: 11/25/2022] [Indexed: 12/02/2022]
Abstract
Decision-making during mixed-strategy games requires flexibly adapting choice strategies in response to others' actions and dynamically tracking outcomes. Such decisions involve diverse cognitive processes, including reinforcement learning, which are affected by disruptions to the striatal dopamine system. We therefore investigated how genetic variation in dopamine function affected mixed-strategy decision-making in Parkinson's disease (PD), which involves striatal dopamine pathology. Sixty-six PD patients (ages 49-85, Hoehn and Yahr Stages 1-3) and 22 healthy controls (ages 54-75) competed in a mixed-strategy game where successful performance depended on minimizing choice biases (i.e., flexibly adapting choices trial by trial). Participants also completed a fixed-strategy task that was matched for sensory input, motor outputs and overall reward rate. Factor analyses were used to disentangle cognitive from motor aspects within both tasks. Using a within-subject, multi-centre design, patients were examined on and off dopaminergic therapy, and genetic variation was examined via a multilocus genetic profile score representing the additive effects of three single nucleotide polymorphisms (SNPs) that influence dopamine transmission: rs4680 (COMT Val158 Met), rs6277 (C957T) and rs907094 (encoding DARPP-32). PD and control participants displayed comparable mixed-strategy choice behaviour (overall); however, PD patients with genetic profile scores indicating higher dopamine transmission showed improved performance relative to those with low scores. Exploratory follow-up tests across individual SNPs revealed better performance in individuals with the C957T polymorphism, reflecting higher striatal D2/D3 receptor density. Importantly, genetic variation modulated cognitive aspects of performance, above and beyond motor function, suggesting that genetic variation in dopamine signalling may underlie individual differences in cognitive function in PD.
Collapse
Affiliation(s)
- Ashley C Parr
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Giovanna Pari
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
- Movement Disorder Clinic, Kingston General Hospital, Kingston, Ontario, Canada
| | - Mario Masellis
- Cognitive Neurology Research Unit, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - Connie Marras
- Movement Disorders Clinic, Krembil Neuroscience Centre, University Health Network, Toronto, Ontario, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| |
Collapse
|
4
|
Wang H, Kwan AC. Competitive and cooperative games for probing the neural basis of social decision-making in animals. Neurosci Biobehav Rev 2023; 149:105158. [PMID: 37019249 PMCID: PMC10175234 DOI: 10.1016/j.neubiorev.2023.105158] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/29/2023] [Accepted: 04/02/2023] [Indexed: 04/07/2023]
Abstract
In a social environment, it is essential for animals to consider the behavior of others when making decisions. To quantitatively assess such social decisions, games offer unique advantages. Games may have competitive and cooperative components, modeling situations with antagonistic and shared objectives between players. Games can be analyzed by mathematical frameworks, including game theory and reinforcement learning, such that an animal's choice behavior can be compared against the optimal strategy. However, so far games have been underappreciated in neuroscience research, particularly for rodent studies. In this review, we survey the varieties of competitive and cooperative games that have been tested, contrasting strategies employed by non-human primates and birds with rodents. We provide examples of how games can be used to uncover neural mechanisms and explore species-specific behavioral differences. We assess critically the limitations of current paradigms and propose improvements. Together, the synthesis of current literature highlights the advantages of using games to probe the neural basis of social decisions for neuroscience studies.
Collapse
Affiliation(s)
- Hongli Wang
- Interdepartmental Neuroscience Program, Yale University School of Medicine, New Haven, CT, USA
| | - Alex C Kwan
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA; Department of Neuroscience, Yale University School of Medicine, New Haven, CT, USA; Meinig School of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Psychiatry, Weill Cornell Medicine, New York, NY 10065, USA.
| |
Collapse
|
5
|
Reyna VF, Müller SM, Edelson SM. Critical tests of fuzzy trace theory in brain and behavior: uncertainty across time, probability, and development. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2023; 23:746-772. [PMID: 36828988 PMCID: PMC9957613 DOI: 10.3758/s13415-022-01058-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 12/22/2022] [Indexed: 02/26/2023]
Abstract
Uncertainty permeates decisions from the trivial to the profound. Integrating brain and behavioral evidence, we discuss how probabilistic (varied outcomes) and temporal (delayed outcomes) uncertainty differ across age and individuals; how critical tests adjudicate between theories of uncertainty (prospect theory and fuzzy-trace theory); and how these mechanisms might be represented in the brain. The same categorical gist representations of gains and losses account for choices and eye-tracking data in both value-allocation (add money to gambles) and risky-choice tasks, disconfirming prospect theory and confirming predictions of fuzzy-trace theory. The analysis is extended to delay discounting and disambiguated choices, explaining hidden-zero effects that similarly turn on categorical distinctions between some gain and no gain, certain gain and uncertain gain, gain and loss, and now and later. Bold activation implicates dorsolateral prefrontal and posterior parietal cortices in gist strategies that are not just one tool in a grab-bag of cognitive options but rather are general strategies that systematically predict behaviors across many different tasks involving probabilistic and temporal uncertainty. High valuation (e.g., ventral striatum; ventromedial prefrontal cortex) and low executive control (e.g., lateral prefrontal cortex) contribute to risky and impatient choices, especially in youth. However, valuation in ventral striatum supports reward-maximizing and gist strategies in adulthood. Indeed, processing becomes less "rational" in the sense of maximizing gains and more noncompensatory (eye movements indicate fewer tradeoffs) as development progresses from adolescence to adulthood, as predicted. Implications for theoretically predicted "public-health paradoxes" are discussed, including gist versus verbatim thinking in drug experimentation and addiction.
Collapse
Affiliation(s)
| | - Silke M. Müller
- Department General Psychology: Cognition, University of Duisburg-Essen, Duisburg, Germany
| | | |
Collapse
|
6
|
Perisse E, Miranda M, Trouche S. Modulation of aversive value coding in the vertebrate and invertebrate brain. Curr Opin Neurobiol 2023; 79:102696. [PMID: 36871400 DOI: 10.1016/j.conb.2023.102696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 01/30/2023] [Accepted: 01/31/2023] [Indexed: 03/06/2023]
Abstract
Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.
Collapse
Affiliation(s)
- Emmanuel Perisse
- Institute of Functional Genomics, University of Montpellier, CNRS, Inserm, 141 rue de la Cardonille, 34094 Montpellier Cedex 5, France.
| | - Magdalena Miranda
- Institute of Functional Genomics, University of Montpellier, CNRS, Inserm, 141 rue de la Cardonille, 34094 Montpellier Cedex 5, France
| | - Stéphanie Trouche
- Institute of Functional Genomics, University of Montpellier, CNRS, Inserm, 141 rue de la Cardonille, 34094 Montpellier Cedex 5, France.
| |
Collapse
|
7
|
Neuronal Response to Reward and Luminance in Macaque LIP During Saccadic Choice. Neurosci Bull 2022; 39:14-28. [PMID: 36114983 PMCID: PMC9849667 DOI: 10.1007/s12264-022-00948-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 06/18/2022] [Indexed: 01/22/2023] Open
Abstract
Recent work in decision neuroscience suggests that visual saliency can interact with reward-based choice, and the lateral intraparietal cortex (LIP) is implicated in this process. In this study, we recorded from LIP neurons while monkeys performed a two alternative choice task in which the reward and luminance associated with each offer were varied independently. We discovered that the animal's choice was dictated by the reward amount while the luminance had a marginal effect. In the LIP, neuronal activity corresponded well with the animal's choice pattern, in that a majority of reward-modulated neurons encoded the reward amount in the neuron's preferred hemifield with a positive slope. In contrast, compared to their responses to low luminance, an approximately equal proportion of luminance-sensitive neurons responded to high luminance with increased or decreased activity, leading to a much weaker population-level response. Meanwhile, in the non-preferred hemifield, the strength of encoding for reward amount and luminance was positively correlated, suggesting the integration of these two factors in the LIP. Moreover, neurons encoding reward and luminance were homogeneously distributed along the anterior-posterior axis of the LIP. Overall, our study provides further evidence supporting the neural instantiation of a priority map in the LIP in reward-based decisions.
Collapse
|
8
|
Zhang Z, Yin C, Yang T. Evidence accumulation occurs locally in the parietal cortex. Nat Commun 2022; 13:4426. [PMID: 35907908 PMCID: PMC9339004 DOI: 10.1038/s41467-022-32210-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Accepted: 07/20/2022] [Indexed: 11/09/2022] Open
Abstract
Decision making often entails evidence accumulation, a process that is represented by neural activities in a network of multiple brain areas. Yet, it has not been identified where exactly the accumulation originates. We reason that a candidate brain area should both represent evidence accumulation and information that is used to compute evidence. Therefore, we designed a two-stage probabilistic reasoning task in which the evidence for accumulation had to be first determined from sensory signals orthogonal to decisions. With a linear encoding model, we decomposed the responses of posterior parietal neurons to each stimulus into an early and a late component that represented two dissociable stages of decision making. The former reflected the transformation from sensory inputs to accumulable evidence, and the latter reflected the accumulation of evidence and the formation of decisions. The presence of both computational stages indicates that evidence accumulation signal in the parietal cortex is computed locally.
Collapse
Affiliation(s)
- Zhewei Zhang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China.,University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Chaoqun Yin
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China
| | - Tianming Yang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China.
| |
Collapse
|
9
|
Brain potential responses involved in decision-making in weightlessness. Sci Rep 2022; 12:12992. [PMID: 35906468 PMCID: PMC9338282 DOI: 10.1038/s41598-022-17234-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 07/22/2022] [Indexed: 11/08/2022] Open
Abstract
The brain is essential to human adaptation to any environment including space. We examined astronauts’ brain function through their electrical EEG brain potential responses related to their decision of executing a docking task in the same virtual scenario in Weightlessness and on Earth before and after the space stay of 6 months duration. Astronauts exhibited a P300 component in which amplitude decreased during, and recovered after, their microgravity stay. This effect is discussed as a post-value-based decision-making closing mechanism; The P300 amplitude decrease in weightlessness is suggested as an emotional stimuli valence reweighting during which orbitofrontal BA10 would play a major role. Additionally, when differentiating the bad and the good docks on Earth and in Weightlessness and keeping in mind that astronauts were instantaneously informed through a visual cue of their good or bad performance, it was observed that the good dockings resulted in earlier voltage redistribution over the scalp (in the 150–250 ms period after the docking) than the bad dockings (in the 250–400 ms) in Weightlessness. These results suggest that in Weightlessness the knowledge of positive or negative valence events is processed differently than on Earth.
Collapse
|
10
|
Efficiently irrational: deciphering the riddle of human choice. Trends Cogn Sci 2022; 26:669-687. [PMID: 35643845 PMCID: PMC9283329 DOI: 10.1016/j.tics.2022.04.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 04/18/2022] [Accepted: 04/20/2022] [Indexed: 11/18/2022]
Abstract
For the past half-century, cognitive and social scientists have struggled with the irrationalities of human choice behavior; people consistently make choices that are logically inconsistent. Is human choice behavior evolutionarily adaptive or is it an inefficient patchwork of competing mechanisms? In this review, I present an interdisciplinary synthesis arguing for a novel interpretation: choice is efficiently irrational. Connecting findings across disciplines suggests that observed choice behavior reflects a precise optimization of the trade-off between the costs of increasing the precision of the choice mechanism and the declining benefits that come as precision increases. Under these constraints, a rationally imprecise strategy emerges that works toward optimal efficiency rather than toward optimal rationality. This approach rationalizes many of the puzzling inconsistencies of human choice behavior, explaining why these inconsistencies arise as an optimizing solution in biological choosers.
Collapse
|
11
|
Parr AC, Calancie OG, Coe BC, Khalid-Khan S, Munoz DP. Impulsivity and Emotional Dysregulation Predict Choice Behavior During a Mixed-Strategy Game in Adolescents With Borderline Personality Disorder. Front Neurosci 2022; 15:667399. [PMID: 35237117 PMCID: PMC8882924 DOI: 10.3389/fnins.2021.667399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Accepted: 12/28/2021] [Indexed: 11/13/2022] Open
Abstract
Impulsivity and emotional dysregulation are two core features of borderline personality disorder (BPD), and the neural mechanisms recruited during mixed-strategy interactions overlap with frontolimbic networks that have been implicated in BPD. We investigated strategic choice patterns during the classic two-player game, Matching Pennies, where the most efficient strategy is to choose each option randomly from trial-to-trial to avoid exploitation by one’s opponent. Twenty-seven female adolescents with BPD (mean age: 16 years) and twenty-seven age-matched female controls (mean age: 16 years) participated in an experiment that explored the relationship between strategic choice behavior and impulsivity in both groups and emotional dysregulation in BPD. Relative to controls, BPD participants showed marginally fewer reinforcement learning biases, particularly decreased lose-shift biases, increased variability in reaction times (coefficient of variation; CV), and a greater percentage of anticipatory decisions. A subset of BPD participants with high levels of impulsivity showed higher overall reward rates, and greater modulation of reaction times by outcome, particularly following loss trials, relative to control and BPD participants with lower levels of impulsivity. Additionally, BPD participants with higher levels of emotional dysregulation showed marginally increased reward rate and increased entropy in choice patterns. Together, our preliminary results suggest that impulsivity and emotional dysregulation may contribute to variability in mixed-strategy decision-making in female adolescents with BPD.
Collapse
Affiliation(s)
- Ashley C. Parr
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, United States
- Division of Child and Youth Mental Health, Kingston Health Sciences Centre, Kingston, ON, Canada
- *Correspondence: Ashley C. Parr,
| | - Olivia G. Calancie
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
- Division of Child and Youth Mental Health, Kingston Health Sciences Centre, Kingston, ON, Canada
| | - Brian C. Coe
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
| | - Sarosh Khalid-Khan
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
- Division of Child and Youth Mental Health, Kingston Health Sciences Centre, Kingston, ON, Canada
| | - Douglas P. Munoz
- Centre for Neuroscience Studies, Queen’s University, Kingston, ON, Canada
- Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, ON, Canada
- Douglas P. Munoz,
| |
Collapse
|
12
|
Woo TF, Law CK, Ting KH, Chan CCH, Kolling N, Watanabe K, Chau BKH. Distinct Causal Influences of Dorsolateral Prefrontal Cortex and Posterior Parietal Cortex in Multiple-Option Decision Making. Cereb Cortex 2021; 32:1390-1404. [PMID: 34470053 DOI: 10.1093/cercor/bhab278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 07/14/2021] [Accepted: 07/15/2021] [Indexed: 11/13/2022] Open
Abstract
Our knowledge about neural mechanisms underlying decision making is largely based on experiments that involved few options. However, it is more common in daily life to choose between many options, in which processing choice information selectively is particularly important. The current study examined whether the dorsolateral prefrontal cortex (dlPFC) and posterior parietal cortex (PPC) are of particular importance to multiple-option decision making. Sixty-eight participants received anodal high definition-transcranial direct current stimulation (HD-tDCS) to focally enhance dlPFC or PPC in a double-blind sham-controlled design. Participants then performed a multiple-option decision making task. We found longer fixations on poorer options were related to less optimal decisions. Interestingly, this negative impact was attenuated after applying anodal HD-tDCS over dlPFC, especially in choices with many options. This suggests that dlPFC has a causal role in filtering choice-irrelevant information. In contrast, these effects were absent after participants received anodal HD-tDCS over PPC. Instead, the choices made by these participants were more biased towards the best options presented on the side contralateral to the stimulation. This suggests PPC has a causal role in value-based spatial selection. To conclude, the dlPFC has a role in filtering undesirable options, whereas the PPC emphasizes the desirable contralateral options.
Collapse
Affiliation(s)
- Tsz-Fung Woo
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong
| | - Chun-Kit Law
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong
| | - Kin-Hung Ting
- University Research Facility in Behavioral and Systems Neuroscience, The Hong Kong Polytechnic University, Hong Kong
| | - Chetwyn C H Chan
- Department of Psychology, The Education University of Hong Kong, Hong Kong
| | - Nils Kolling
- Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.,Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, OX3 9DU, UK.,Oxford Centre for Human Brain Activity (OHBA), University of Oxford, Oxford, OX3 7JX, UK
| | - Kei Watanabe
- Department of Frontier Biosciences, Osaka University, Osaka 565-0871, Japan
| | - Bolton K H Chau
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hong Kong.,University Research Facility in Behavioral and Systems Neuroscience, The Hong Kong Polytechnic University, Hong Kong
| |
Collapse
|
13
|
Podvalny E, King LE, He BJ. Spectral signature and behavioral consequence of spontaneous shifts of pupil-linked arousal in human. eLife 2021; 10:68265. [PMID: 34463255 PMCID: PMC8486382 DOI: 10.7554/elife.68265] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 08/27/2021] [Indexed: 12/21/2022] Open
Abstract
Arousal levels perpetually rise and fall spontaneously. How markers of arousal—pupil size and frequency content of brain activity—relate to each other and influence behavior in humans is poorly understood. We simultaneously monitored magnetoencephalography and pupil in healthy volunteers at rest and during a visual perceptual decision-making task. Spontaneously varying pupil size correlates with power of brain activity in most frequency bands across large-scale resting state cortical networks. Pupil size recorded at prestimulus baseline correlates with subsequent shifts in detection bias (c) and sensitivity (d’). When dissociated from pupil-linked state, prestimulus spectral power of resting state networks still predicts perceptual behavior. Fast spontaneous pupil constriction and dilation correlate with large-scale brain activity as well but not perceptual behavior. Our results illuminate the relation between central and peripheral arousal markers and their respective roles in human perceptual decision-making.
Collapse
Affiliation(s)
- Ella Podvalny
- Neuroscience Institute, New York University School of Medicine, New York, United States
| | - Leana E King
- Neuroscience Institute, New York University School of Medicine, New York, United States
| | - Biyu J He
- Neuroscience Institute, New York University School of Medicine, New York, United States.,Departments of Neurology, Neuroscience & Physiology, and Radiology, New York University School of Medicine, New York, United States
| |
Collapse
|
14
|
Hwang EJ, Sato TR, Sato TK. A Canonical Scheme of Bottom-Up and Top-Down Information Flows in the Frontoparietal Network. Front Neural Circuits 2021; 15:691314. [PMID: 34475815 PMCID: PMC8406690 DOI: 10.3389/fncir.2021.691314] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Accepted: 07/21/2021] [Indexed: 11/25/2022] Open
Abstract
Goal-directed behavior often involves temporal separation and flexible context-dependent association between sensory input and motor output. The control of goal-directed behavior is proposed to lie in the frontoparietal network, but the computational architecture of this network remains elusive. Based on recent rodent studies that measured and manipulated projection neurons in the frontoparietal network together with findings from earlier primate studies, we propose a canonical scheme of information flows in this network. The parietofrontal pathway transmits the spatial information of a sensory stimulus or internal motor bias to drive motor programs in the frontal areas. This pathway might consist of multiple parallel connections, each controlling distinct motor effectors. The frontoparietal pathway sends the spatial information of cognitively processed motor plans through multiple parallel connections. Each of these connections could support distinct spatial functions that use the motor target information, including attention allocation, multi-body part coordination, and forward estimation of movement state (i.e., forward models). The parallel pathways in the frontoparietal network enable dynamic interactions between regions that are tuned for specific goal-directed behaviors. This scheme offers a promising framework within which the computational architecture of the frontoparietal network and the underlying circuit mechanisms can be delineated in a systematic way, providing a holistic understanding of information processing in this network. Clarifying this network may also improve the diagnosis and treatment of behavioral deficits associated with dysfunctional frontoparietal connectivity in various neurological disorders including Alzheimer's disease.
Collapse
Affiliation(s)
- Eun Jung Hwang
- Stanson Toshok Center for Brain Function and Repair, Brain Science Institute, Rosalind Franklin University of Medicine and Science, North Chicago, IL, United States
- Cell Biology and Anatomy, Chicago Medical School, Rosalind Franklin University of Medicine and Science, North Chicago, IL, United States
| | - Takashi R. Sato
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, United States
| | - Tatsuo K. Sato
- Department of Physiology, Monash University, Clayton, VIC, Australia
- Neuroscience Program, Biomedicine Discovery Institute, Monash University, Clayton, VIC, Australia
- PRESTO, Japan Science and Technology Agency, Kawaguchi, Japan
| |
Collapse
|
15
|
Zhang B, Kan JYY, Yang M, Wang X, Tu J, Dorris MC. Transforming absolute value to categorical choice in primate superior colliculus during value-based decision making. Nat Commun 2021; 12:3410. [PMID: 34099726 PMCID: PMC8184840 DOI: 10.1038/s41467-021-23747-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 04/23/2021] [Indexed: 11/09/2022] Open
Abstract
Value-based decision making involves choosing from multiple options with different values. Despite extensive studies on value representation in various brain regions, the neural mechanism for how multiple value options are converted to motor actions remains unclear. To study this, we developed a multi-value foraging task with varying menu of items in non-human primates using eye movements that dissociates value and choice, and conducted electrophysiological recording in the midbrain superior colliculus (SC). SC neurons encoded "absolute" value, independent of available options, during late fixation. In addition, SC neurons also represent value threshold, modulated by available options, different from conventional motor threshold. Electrical stimulation of SC neurons biased choices in a manner predicted by the difference between the value representation and the value threshold. These results reveal a neural mechanism directly transforming absolute values to categorical choices within SC, supporting highly efficient value-based decision making critical for real-world economic behaviors.
Collapse
Affiliation(s)
- Beizhen Zhang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, China. .,University of Chinese Academy of Sciences, Beijing, China.
| | - Janis Ying Ying Kan
- Department of Biomedical and Molecular Sciences, Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Mingpo Yang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, China
| | - Xiaochun Wang
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, China
| | - Jiahao Tu
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, China
| | - Michael Christopher Dorris
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
16
|
Testard C, Tremblay S, Platt M. From the field to the lab and back: neuroethology of primate social behavior. Curr Opin Neurobiol 2021; 68:76-83. [PMID: 33567386 PMCID: PMC8243779 DOI: 10.1016/j.conb.2021.01.005] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 01/11/2021] [Accepted: 01/12/2021] [Indexed: 12/21/2022]
Abstract
Social mammals with more numerous and stronger social relationships live longer, healthier lives. Despite the established importance of social relationships, our understanding of the neurobiological mechanisms by which they are pursued, formed, and maintained in primates remains largely confined to highly controlled laboratory settings which do not allow natural, dynamic social interactions to unfold. In this review, we argue that the neurobiological study of primate social behavior would benefit from adopting a neuroethological approach, that is, a perspective grounded in natural, species-typical behavior, with careful selection of animal models according to the scientific question at hand. We highlight macaques and marmosets as key animal models for human social behavior and summarize recent findings in the social domain for both species. We then review pioneering studies of dynamic social behaviors in small animals, which can inspire studies in larger primates where the technological landscape is now ripe for an ethological overhaul.
Collapse
Affiliation(s)
- Camille Testard
- Department of Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Sébastien Tremblay
- Department of Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Michael Platt
- Department of Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA; Psychology Department, University of Pennsylvania, Philadelphia, PA 19104, USA; Marketing Department, The Wharton School of Business, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
17
|
Abstract
Remapping is a property of some cortical and subcortical neurons that update their responses around the time of an eye movement to account for the shift of stimuli on the retina due to the saccade. Physiologically, remapping is traditionally tested by briefly presenting a single stimulus around the time of the saccade and looking at the onset of the response and the locations in space to which the neuron is responsive. Here we suggest that a better way to understand the functional role of remapping is to look at the time at which the neural signal emerges when saccades are made across a stable scene. Based on data obtained using this approach, we suggest that remapping in the lateral intraparietal area is sufficient to play a role in maintaining visual stability across saccades, whereas in the frontal eye field, remapped activity carries information that affects future saccadic choices and, in a separate subset of neurons, is used to maintain a map of locations in the scene that have been previously fixated.
Collapse
Affiliation(s)
- James W Bisley
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.,Jules Stein Eye Institute, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.,Department of Psychology and the Brain Research Institute, UCLA, Los Angeles, CA, USA
| | - Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Yelda Alkan
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| |
Collapse
|
18
|
Mirpour K, Bisley JW. The roles of the lateral intraparietal area and frontal eye field in guiding eye movements in free viewing search behavior. J Neurophysiol 2021; 125:2144-2157. [PMID: 33949898 DOI: 10.1152/jn.00559.2020] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The lateral intraparietal area (LIP) and frontal eye field (FEF) have been shown to play significant roles in oculomotor control, yet most studies have found that the two areas behave similarly. To identify the unique roles each area plays in guiding eye movements, we recorded 200 LIP neurons and 231 FEF neurons from four animals performing a free viewing visual foraging task. We analyzed how neuronal responses were modulated by stimulus identity and the animals' choice of where to make a saccade. We additionally analyzed the comodulation of the sensory signals and the choice signal to identify how the sensory signals drove the choice. We found a clearly defined division of labor: LIP provided a stable map integrating task rules and stimulus identity, whereas FEF responses were dynamic, representing more complex information and, just before the saccade, were integrated with task rules and stimulus identity to decide where to move the eye.NEW & NOTEWORTHY The lateral intrapareital area (LIP) and frontal eye field (FEF) are known to contribute to guiding eye movements, but little is known about the unique roles that each area plays. Using a free viewing visual search task, we found that LIP provides a stable map of the visual world, integrating task rules and stimulus identity. FEF activity is consistently modulated by more complex information but, just before the saccade, integrates all the information to make the final decision about where to move.
Collapse
Affiliation(s)
- Koorosh Mirpour
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, California
| | - James W Bisley
- Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, California.,Jules Stein Eye Institute, David Geffen School of Medicine at UCLA, Los Angeles, California.,Department of Psychology and the Brain Research Institute, UCLA, Los Angeles, California
| |
Collapse
|
19
|
Chang FY, Wiratman W, Ugawa Y, Kobayashi S. Event-Related Potentials During Decision-Making in a Mixed-Strategy Game. Front Neurosci 2021; 15:552750. [PMID: 33815035 PMCID: PMC8017162 DOI: 10.3389/fnins.2021.552750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2020] [Accepted: 02/03/2021] [Indexed: 11/13/2022] Open
Abstract
The decisions we make are sometimes influenced by interactions with other agents. Previous studies have suggested that the prefrontal cortex plays an important role in decision-making and that the dopamine system underlies processes of motivation, motor preparation, and reinforcement learning. However, the physiological mechanisms underlying how the prefrontal cortex and the dopaminergic system are involved in decision-making remain largely unclear. The present study aimed to determine how decision strategies influence event-related potentials (ERPs). We also tested the effect of levodopa, a dopamine precursor, on decision-making and ERPs in a randomized double-blind placebo-controlled investigation. The subjects performed a matching-pennies task against an opposing virtual computer player by choosing between right and left targets while their ERPs were recorded. According to the rules of the matching-pennies task, the subject won the trial when they chose the same side as the opponent, and lost otherwise. We set three different task rules: (1) with the alternation (ALT) rule, the computer opponent made alternating choices of right and left in sequential trials; (2) with the random (RAND) rule, the opponent randomly chose between right and left; and (3) with the GAME rule, the opponent analyzed the subject's past choices to predict the subject's next choice, and then chose the opposite side. A sustained medial ERP became more negative toward the time of the subject's target choice. A biphasic potential appeared when the opponent's choice was revealed after the subject's response. The ERPs around the subject's choice were greater in RAND and GAME than in ALT, and the negative peak was enhanced by levodopa. In addition to these medial ERPs, we observed lateral frontal ERPs tuned to the choice direction. The signals emerged around the choice period selectively in RAND and GAME when levodopa was administered. These results suggest that decision processes are modulated by the dopamine system when a complex and strategic decision is required, which may reflect decision updating with dopaminergic prediction error signals.
Collapse
Affiliation(s)
- Fang-Yu Chang
- Department of Neurology, School of Medicine, Fukushima Medical University, Fukushima, Japan
| | - Winnugroho Wiratman
- Department of Neurology, Faculty of Medicine, Universitas Indonesia, Cipto Mangunkusumo Hospital, Jakarta, Indonesia
| | - Yoshikazu Ugawa
- Department of Human Neurophysiology, Fukushima Medical University, Fukushima, Japan.,Department of Neurology, Takeda General Hospital, Fukushima, Japan
| | | |
Collapse
|
20
|
Zhang M, Bian Y. An analysis of the brain structures underlying the link between pathological Internet use and anxiety. Addict Behav 2021; 112:106632. [PMID: 32905867 DOI: 10.1016/j.addbeh.2020.106632] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Revised: 08/23/2020] [Accepted: 08/24/2020] [Indexed: 12/21/2022]
Abstract
Pathological Internet use (PIU) is associated with various maladaptive problems and is becoming increasingly common among adolescents. Anxiety has been discovered as an important predictor of PIU, with the neural basis underlying the link between these two variables remaining unclear. In this study, PIU variations, individual anxiety levels, and T1-weighted structural magnetic resonance images (MRI) were collected from 95 healthy male adolescents. Voxel-based morphometry (VBM) was then applied to identify the brain regions related to individual variations in PIU, with mediation analyses being conducted to explore the relationship between brain structure, anxiety, and PIU. The results revealed that the PIU tendency is positively correlated with regional grey matter density (rGMD) in the right inferior parietal lobe (IPL), which is known to be involved in inhibitory control. Furthermore, the mediation analysis revealed that the rGMD in the right IPL mediates the association between anxiety and PIU, which is consistent with the mood enhancement theory and the Interaction of Person-Affect-Cognition-Execution (I-PACE) model. This mediation model suggests that individuals with higher anxiety might be more likely to use the Internet, with the rGMD in the right IPL being where the underlying cognitive mechanism of the relationship between these two variables lies. This study's findings possess implications for society's understandings of the correlations between anxiety and PIU from a brain structural perspective, which may then help in preventing the progression of PIU among adolescents.
Collapse
|
21
|
Thiery T, Saive AL, Combrisson E, Dehgan A, Bastin J, Kahane P, Berthoz A, Lachaux JP, Jerbi K. Decoding the neural dynamics of free choice in humans. PLoS Biol 2020; 18:e3000864. [PMID: 33301439 PMCID: PMC7755286 DOI: 10.1371/journal.pbio.3000864] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Revised: 12/22/2020] [Accepted: 10/05/2020] [Indexed: 11/19/2022] Open
Abstract
How do we choose a particular action among equally valid alternatives? Nonhuman primate findings have shown that decision-making implicates modulations in unit firing rates and local field potentials (LFPs) across frontal and parietal cortices. Yet the electrophysiological brain mechanisms that underlie free choice in humans remain ill defined. Here, we address this question using rare intracerebral electroencephalography (EEG) recordings in surgical epilepsy patients performing a delayed oculomotor decision task. We find that the temporal dynamics of high-gamma (HG, 60-140 Hz) neural activity in distinct frontal and parietal brain areas robustly discriminate free choice from instructed saccade planning at the level of single trials. Classification analysis was applied to the LFP signals to isolate decision-related activity from sensory and motor planning processes. Compared with instructed saccades, free-choice trials exhibited delayed and longer-lasting HG activity during the delay period. The temporal dynamics of the decision-specific sustained HG activity indexed the unfolding of a deliberation process, rather than memory maintenance. Taken together, these findings provide the first direct electrophysiological evidence in humans for the role of sustained high-frequency neural activation in frontoparietal cortex in mediating the intrinsically driven process of freely choosing among competing behavioral alternatives.
Collapse
Affiliation(s)
- Thomas Thiery
- Cognitive & Computational Neuroscience Lab, Psychology Department, University of Montreal, Québec, Canada
| | - Anne-Lise Saive
- Cognitive & Computational Neuroscience Lab, Psychology Department, University of Montreal, Québec, Canada
| | - Etienne Combrisson
- Cognitive & Computational Neuroscience Lab, Psychology Department, University of Montreal, Québec, Canada
- Centre de Recherche en Neurosciences de Lyon (CRNL), Lyon, France
| | - Arthur Dehgan
- Cognitive & Computational Neuroscience Lab, Psychology Department, University of Montreal, Québec, Canada
| | - Julien Bastin
- Grenoble Institut des Neurosciences, Grenoble, France
| | | | | | | | - Karim Jerbi
- Cognitive & Computational Neuroscience Lab, Psychology Department, University of Montreal, Québec, Canada
- MILA (Québec Artificial Intelligence Institute), Montréal, Québec, Canada
- Centre UNIQUE (Union Neurosciences & Intelligence Artificielle), Montréal, Québec, Canada
| |
Collapse
|
22
|
Abstract
How does the brain combine information predictive of the value of a visually guided task (incentive value) with information predictive of where task-relevant stimuli may occur (spatial certainty)? Human behavioural evidence indicates that these two predictions may be combined additively to bias visual selection (Additive Hypothesis), whereas neuroeconomic studies posit that they may be multiplicatively combined (Expected Value Hypothesis). We sought to adjudicate between these two alternatives. Participants viewed two coloured placeholders that specified the potential value of correctly identifying an imminent letter target if it appeared in that placeholder. Then, prior to the target’s presentation, an endogenous spatial cue was presented indicating the target’s more likely location. Spatial cues were parametrically manipulated with regard to the information gained (in bits). Across two experiments, performance was better for targets appearing in high versus low value placeholders and better when targets appeared in validly cued locations. Interestingly, as shown with a Bayesian model selection approach, these effects did not interact, clearly supporting the Additive Hypothesis. Even when conditions were adjusted to increase the optimality of a multiplicative operation, support for it remained. These findings refute recent theories that expected value computations are the singular mechanism driving the deployment of endogenous spatial attention. Instead, incentive value and spatial certainty seem to act independently to influence visual selection.
Collapse
|
23
|
Wispinski NJ, Gallivan JP, Chapman CS. Models, movements, and minds: bridging the gap between decision making and action. Ann N Y Acad Sci 2020; 1464:30-51. [DOI: 10.1111/nyas.13973] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2018] [Revised: 08/20/2018] [Accepted: 09/06/2018] [Indexed: 11/29/2022]
Affiliation(s)
| | - Jason P. Gallivan
- Centre for Neuroscience StudiesQueen's University Kingston Ontario Canada
- Department of PsychologyQueen's University Kingston Ontario Canada
- Department of Biomedical and Molecular SciencesQueen's University Kingston Ontario Canada
| | - Craig S. Chapman
- Faculty of Kinesiology, Sport, and RecreationUniversity of Alberta Edmonton Alberta Canada
- Neuroscience and Mental Health Institute, University of Alberta Edmonton Alberta Canada
| |
Collapse
|
24
|
Rojek-Giffin M, Lebreton M, Scholte HS, van Winden F, Ridderinkhof KR, De Dreu CKW. Neurocognitive Underpinnings of Aggressive Predation in Economic Contests. J Cogn Neurosci 2020; 32:1276-1288. [PMID: 32073348 DOI: 10.1162/jocn_a_01545] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Competitions are part and parcel of daily life and require people to invest time and energy to gain advantage over others and to avoid (the risk of) falling behind. Whereas the behavioral mechanisms underlying competition are well documented, its neurocognitive underpinnings remain poorly understood. We addressed this using neuroimaging and computational modeling of individual investment decisions aimed at exploiting one's counterpart ("attack") or at protecting against exploitation by one's counterpart ("defense"). Analyses revealed that during attack relative to defense (i) individuals invest less and are less successful; (ii) computations of expected reward are strategically more sophisticated (reasoning level k = 4 vs. k = 3 during defense); (iii) ventral striatum activity tracks reward prediction errors; (iv) risk prediction errors were not correlated with neural activity in either ROI or whole-brain analyses; and (v) successful exploitation correlated with neural activity in the bilateral ventral striatum, left OFC, left anterior insula, left TPJ, and lateral occipital cortex. We conclude that, in economic contests, coming out ahead (vs. not falling behind) involves sophisticated strategic reasoning that engages both reward and value computation areas and areas associated with theory of mind.
Collapse
|
25
|
Meade CS, Bell RP, Towe SL, Hall SA. Cocaine-related alterations in fronto-parietal gray matter volume correlate with trait and behavioral impulsivity. Drug Alcohol Depend 2020; 206:107757. [PMID: 31805488 PMCID: PMC6980751 DOI: 10.1016/j.drugalcdep.2019.107757] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Revised: 11/05/2019] [Accepted: 11/18/2019] [Indexed: 12/20/2022]
Abstract
BACKGROUND Chronic cocaine use is associated with structural brain abnormalities within prefrontal regions implicated in impulsivity. Despite high levels of impulsivity among persons who use cocaine, it is not known how reductions in gray matter volume (GMV) may relate to trait and behavioral measures of impulsivity. METHODS The sample included 39 active cocaine users (COC+) and 40 controls with no history of cocaine use (COC-). Participants had a brain scan on a 3 T MRI machine and completed out-of-scanner measures of trait impulsivity and delayed reward discounting. Whole-brain voxel-based morphometry was used to compare GMV between COC+ and COC-. Within regions that differed between groups, voxelwise correlations were conducted to examine the relationship between GMV and impulsivity. RESULTS In a whole-brain analysis, COC+ had broad reductions in GMV compared to COC- in bilateral frontal, parietal, occipital, and cerebellar regions. Lower GMV correlated with trait impulsivity in lateral prefrontal regions and with delayed reward discounting in medial prefrontal regions, while lower GMV correlated with both measures in the posterior parietal cortex. COC+ demonstrated significantly higher impulsivity than COC- on all measures, but the nature of the correlation with GMV was similar in both groups. CONCLUSIONS Reflecting the multi-faceted nature of impulsivity, these results show that trait and behavioral measures of impulsivity map differentially onto altered brain morphology. While the brain-behavior patterns were similar in COC+ and COC-, suggesting that impulsivity varies on a continuous spectrum, cocaine-related abnormalities in frontal-parietal brain systems may contribute to heightened impulsivity.
Collapse
Affiliation(s)
- Christina S Meade
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC, 27708, USA; Brain Imaging and Analysis Center, Duke University Medical Center, Durham, NC, 27708, USA.
| | - Ryan P Bell
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC, 27708, USA
| | - Sheri L Towe
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC, 27708, USA
| | - Shana A Hall
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC, 27708, USA
| |
Collapse
|
26
|
Parr AC, Coe BC, Munoz DP, Dorris MC. A novel fMRI paradigm to dissociate the behavioral and neural components of mixed-strategy decision making from non-strategic decisions in humans. Eur J Neurosci 2019; 51:1914-1927. [PMID: 31596980 DOI: 10.1111/ejn.14586] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 08/22/2019] [Accepted: 09/18/2019] [Indexed: 11/30/2022]
Abstract
During competitive interactions, such as predator-prey or team sports, the outcome of one's actions is dependent on both their own choices and those of their opponents. Success in these rivalries requires that individuals choose dynamically and unpredictably, often adopting a mixed strategy. Understanding the neural basis of strategic decision making is complicated by the fact that it recruits various cognitive processes that are often shared with non-strategic forms of decision making, such as value estimation, working memory, response inhibition, response selection, and reward processes. Although researchers have explored neural activity within key brain regions during mixed-strategy games, how brain activity differs in the context of strategic interactions versus non-strategic choices is not well understood. We developed a novel behavioral paradigm to dissociate choice behavior during mixed-strategy interactions from non-strategic choices, and we used task-based functional magnetic resonance imaging (fMRI) to contrast brain activation. In a block design, participants competed in the classic mixed-strategy game, "matching pennies," against a dynamic computer opponent designed to exploit predictability in players' response patterns. Results were contrasted with a non-strategic task that had comparable sensory input, motor output, and reward rate; thus, differences in behavior and brain activation reflect strategic processes. The mixed-strategy game was associated with activation of a distributed cortico-striatal network compared to the non-strategic task. We propose that choosing in mixed-strategy contexts requires additional cognitive demands present to a lesser degree during the control task, illustrating the strength of this design in probing function of cognitive systems beyond core sensory, motor, and reward processes.
Collapse
Affiliation(s)
- Ashley C Parr
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.,Department of Psychiatry, University of Pittsburgh, Pittsburgh, Pennsylvania
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.,Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Michael C Dorris
- Institute of Neuroscience, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai, China
| |
Collapse
|
27
|
Abstract
This article proposes that biologically plausible theories of behavior can be constructed by following a method of "phylogenetic refinement," whereby they are progressively elaborated from simple to complex according to phylogenetic data on the sequence of changes that occurred over the course of evolution. It is argued that sufficient data exist to make this approach possible, and that the result can more effectively delineate the true biological categories of neurophysiological mechanisms than do approaches based on definitions of putative functions inherited from psychological traditions. As an example, the approach is used to sketch a theoretical framework of how basic feedback control of interaction with the world was elaborated during vertebrate evolution, to give rise to the functional architecture of the mammalian brain. The results provide a conceptual taxonomy of mechanisms that naturally map to neurophysiological and neuroanatomical data and that offer a context for defining putative functions that, it is argued, are better grounded in biology than are some of the traditional concepts of cognitive science.
Collapse
Affiliation(s)
- Paul Cisek
- Department of Neuroscience, University of Montréal, Montréal, Québec, Canada.
| |
Collapse
|
28
|
Grzeczkowski L, Cretenoud AF, Mast FW, Herzog MH. Motor response specificity in perceptual learning and its release by double training. J Vis 2019; 19:4. [DOI: 10.1167/19.6.4] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Lukasz Grzeczkowski
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Germany
| | - Aline F. Cretenoud
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
| | - Fred W. Mast
- Department of Psychology, University of Bern, Switzerland
| | - Michael H. Herzog
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
| |
Collapse
|
29
|
Hamel-Thibault A, Thénault F, Whittingstall K, Bernier PM. Delta-Band Oscillations in Motor Regions Predict Hand Selection for Reaching. Cereb Cortex 2019; 28:574-584. [PMID: 27999125 DOI: 10.1093/cercor/bhw392] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2016] [Accepted: 12/01/2016] [Indexed: 11/13/2022] Open
Abstract
Current models hold that action selection is achieved by competitive interactions between co-existing motor representations associated with each potential action. Critically, selection via competition requires biasing signals to enable one of these alternatives to be selected. This study tested the hypothesis that selection is related to the prestimulus excitability of neuronal ensembles in which movements are encoded, as assessed through the phase of delta-band oscillations (2-4 Hz). Electroencephalography was recorded while participants performed speeded reaches toward appearing visual targets using the hand of their choice. The target locations were controlled such that only targets for which the left and right hands were selected equally often were used for analysis. Results revealed that hand selection as well as reach reaction times strongly depended upon the instantaneous phase of delta at the moment of target onset. This effect was maximal over contralateral motor regions, and occurred in the absence of prestimulus alpha- (8-12 Hz) and beta-band (15-30 Hz) amplitude modulations. These findings demonstrate that the excitability of motor regions acts as a modulatory factor for hand choice during reaching. They extend current models by showing that action selection is related to the underlying brain state independently of previously known decision variables.
Collapse
Affiliation(s)
- Audrey Hamel-Thibault
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke, Sherbrooke, Québec J1K 2R1, Canada
| | - François Thénault
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke, Sherbrooke, Québec J1K 2R1, Canada
| | - Kevin Whittingstall
- Département de médecine nucléaire et de radiobiologie, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Québec J1H 5N4, Canada.,Département de radiologie diagnostique, Faculté de médecine et des sciences de la santé, Université de Sherbrooke, Sherbrooke, Québec J1H 5N4, Canada
| | - Pierre-Michel Bernier
- Département de kinanthropologie, Faculté des sciences de l'activité physique, Université de Sherbrooke, Sherbrooke, Québec J1K 2R1, Canada
| |
Collapse
|
30
|
Bahmani H, Li Q, Logothetis NK, Keliris GA. Responses of Neurons in Lateral Intraparietal Area Depend on Stimulus-Associated Reward During Binocular Flash Suppression. Front Syst Neurosci 2019; 13:9. [PMID: 30914928 PMCID: PMC6422913 DOI: 10.3389/fnsys.2019.00009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 02/25/2019] [Indexed: 11/13/2022] Open
Abstract
Discovering neural correlates of subjective perception and dissociating them from sensory input has fascinated neuroscientists for a long time. Bistable and multistable perception phenomena have exhibited great experimental potential to address this question. Here, we performed electrophysiological recordings from single neurons in lateral intraparietal area (LIP) of rhesus macaques during stimulus and perceptual transitions induced by binocular flash suppression (BFS). LIP neurons demonstrated transient bursts of activity after stimulus presentation and stimulus or perceptual switches but only a minority of cells demonstrated stimulus and perceptual selectivity. To enhance LIP neural selectivity, we performed a second experiment in which the competing stimuli were associated with asymmetric rewards. We found that transient and sustained activities substantially increased while the proportion of stimulus selective neurons remained approximately the same, albeit with increased selectivity magnitude. In addition, we observed mild increases in the proportion of perceptually selective neurons which also showed increase magnitude of selectivity. Importantly, the increased selectivity of cells after the reward manipulation was not directly reflecting the reward size per se but an enhancement in stimulus differentiation. Based on our results, we conjecture that LIP contributes to perceptual transitions and serves a modulatory role in perceptual selection taking into account the stimulus behavioral value.
Collapse
Affiliation(s)
- Hamed Bahmani
- Department of Physiology of Cognitive Processes, Max Planck Institute for Biological Cybernetics, Tuebingen, Germany.,Bernstein Center for Computational Neuroscience, Tuebingen, Germany
| | - Qinglin Li
- Department of Physiology of Cognitive Processes, Max Planck Institute for Biological Cybernetics, Tuebingen, Germany.,Bernstein Center for Computational Neuroscience, Tuebingen, Germany
| | - Nikos K Logothetis
- Department of Physiology of Cognitive Processes, Max Planck Institute for Biological Cybernetics, Tuebingen, Germany.,Division of Imaging Science and Biomedical Engineering, University of Manchester, Manchester, United Kingdom
| | - Georgios A Keliris
- Department of Physiology of Cognitive Processes, Max Planck Institute for Biological Cybernetics, Tuebingen, Germany.,Bernstein Center for Computational Neuroscience, Tuebingen, Germany.,Bio-Imaging Lab, Department of Biomedical Sciences, University of Antwerp, Wilrijk, Belgium
| |
Collapse
|
31
|
Chivukula S, Jafari M, Aflalo T, Yong NA, Pouratian N. Cognition in Sensorimotor Control: Interfacing With the Posterior Parietal Cortex. Front Neurosci 2019; 13:140. [PMID: 30872993 PMCID: PMC6401528 DOI: 10.3389/fnins.2019.00140] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2017] [Accepted: 02/07/2019] [Indexed: 12/19/2022] Open
Abstract
Millions of people worldwide are afflicted with paralysis from a disruption of neural pathways between the brain and the muscles. Because their cortical architecture is often preserved, these patients are able to plan movements despite an inability to execute them. In such people, brain machine interfaces have great potential to restore lost function through neuroprosthetic devices, circumventing dysfunctional corticospinal circuitry. These devices have typically derived control signals from the motor cortex (M1) which provides information highly correlated with desired movement trajectories. However, sensorimotor control simultaneously engages multiple cognitive processes such as intent, state estimation, decision making, and the integration of multisensory feedback. As such, cortical association regions upstream of M1 such as the posterior parietal cortex (PPC) that are involved in higher order behaviors such as planning and learning, rather than in encoding movement itself, may enable enhanced, cognitive control of neuroprosthetics, termed cognitive neural prosthetics (CNPs). We illustrate in this review, through a small sampling, the cognitive functions encoded in the PPC and discuss their neural representation in the context of their relevance to motor neuroprosthetics. We aim to highlight through examples a role for cortical signals from the PPC in developing CNPs, and to inspire future avenues for exploration in their research and development.
Collapse
Affiliation(s)
- Srinivas Chivukula
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, United States
| | - Matiar Jafari
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, United States
| | - Tyson Aflalo
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA, United States
| | - Nicholas Au Yong
- Department of Neurological Surgery, Los Angeles Medical Center, University of California, Los Angeles, Los Angeles, CA, United States
| | - Nader Pouratian
- Department of Neurological Surgery, Los Angeles Medical Center, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|
32
|
Frank DW, Sabatinelli D. Hemodynamic and electrocortical reactivity to specific scene contents in emotional perception. Psychophysiology 2019; 56:e13340. [DOI: 10.1111/psyp.13340] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2018] [Revised: 12/21/2018] [Accepted: 01/04/2019] [Indexed: 12/19/2022]
Affiliation(s)
- David W. Frank
- Department of Neuroscience, BioImaging Research Center University of Georgia Athens Georgia
- Department of Behavioral Science MD Anderson Cancer Center Houston Texas
| | - Dean Sabatinelli
- Department of Neuroscience, BioImaging Research Center University of Georgia Athens Georgia
- Department of Psychology University of Georgia Athens Georgia
| |
Collapse
|
33
|
Matching pennies games as asymmetric models of conflict. Behav Brain Sci 2019; 42:e128. [DOI: 10.1017/s0140525x19000864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
AbstractDe Dreu and Gross (D&G) seem to have disregarded some relevant experimental literature on games of conflict, most notably variations on “matching pennies” games. While in such games, “attacker” and “defender” are typically not explicitly labelled, players’ differentiated roles yield naturally to such notions. These studies partly validate some of D&G's findings and interpretations.
Collapse
|
34
|
Lateral intraparietal area (LIP) is largely effector-specific in free-choice decisions. Sci Rep 2018; 8:8611. [PMID: 29872059 PMCID: PMC5988653 DOI: 10.1038/s41598-018-26366-9] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2017] [Accepted: 05/08/2018] [Indexed: 01/08/2023] Open
Abstract
Despite many years of intense research, there is no strong consensus about the role of the lateral intraparietal area (LIP) in decision making. One view of LIP function is that it guides spatial attention, providing a “saliency map” of the external world. If this were the case, it would contribute to target selection regardless of which action would be performed to implement the choice. On the other hand, LIP inactivation has been shown to influence spatial selection and oculomotor metrics in free-choice decisions, which are made using eye movements, arguing that it contributes to saccade decisions. To dissociate between a more general attention role and a more effector specific saccade role, we reversibly inactivated LIP while non-human primates freely selected between two targets, presented in the two hemifields, with either saccades or reaches. Unilateral LIP inactivation induced a strong choice bias to ipsilesional targets when decisions were made with saccades. Interestingly, the inactivation also caused a reduction of contralesional choices when decisions were made with reaches, albeit the effect was less pronounced. These findings suggest that LIP is part of a network for making oculomotor decisions and is largely effector-specific in free-choice decisions.
Collapse
|
35
|
Abstract
Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.
Collapse
Affiliation(s)
- Michel Failing
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, 1081 BT, Amsterdam, The Netherlands.
| | - Jan Theeuwes
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, 1081 BT, Amsterdam, The Netherlands
| |
Collapse
|
36
|
Extinction as a deficit of the decision-making circuitry in the posterior parietal cortex. HANDBOOK OF CLINICAL NEUROLOGY 2018. [PMID: 29519457 DOI: 10.1016/b978-0-444-63622-5.00008-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register]
Abstract
Extinction is a common neurologic deficit that often occurs as one of a constellation of symptoms seen with lesions of the posterior parietal cortex (PPC). Although extinction has typically been considered a deficit in the allocation of attention, new findings, particularly from nonhuman primate studies, point to one potential and important source of extinction as damage to decision-making circuits for actions within the PPC. This new understanding provides clues to potential therapies for extinction. Also the finding that the PPC is important for action decisions and action planning has led to new neuroprosthetic applications using PPC recordings as control signals to assist paralyzed patients.
Collapse
|
37
|
Kubanek J, Snyder LH. Reward Size Informs Repeat-Switch Decisions and Strongly Modulates the Activity of Neurons in Parietal Cortex. Cereb Cortex 2018; 27:447-459. [PMID: 26491065 DOI: 10.1093/cercor/bhv230] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Behavior is guided by previous experience. Good, positive outcomes drive a repetition of a previous behavior or choice, whereas poor or bad outcomes lead to an avoidance. How these basic drives are implemented by the brain has been of primary interest to psychology and neuroscience. We engaged animals in a choice task in which the size of a reward outcome strongly governed the animals' subsequent decision whether to repeat or switch the previous choice. We recorded the discharge activity of neurons implicated in reward-based choice in 2 regions of parietal cortex. We found that the tendency to retain previous choice following a large (small) reward was paralleled by a marked decrease (increase) in the activity of parietal neurons. This neural effect is independent of, and of sign opposite to, value-based modulations reported in parietal cortex previously. This effect shares the same basic properties with signals previously reported in the limbic system that detect the size of the recently obtained reward to mediate proper repeat-switch decisions. We conclude that the size of the obtained reward is a decision variable that guides the decision between retaining a choice or switching, and neurons in parietal cortex strongly respond to this novel decision variable.
Collapse
Affiliation(s)
- Jan Kubanek
- Department of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO 63110, USA.,Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Lawrence H Snyder
- Department of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO 63110, USA.,Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| |
Collapse
|
38
|
Neural Signature of Value-Based Sensorimotor Prioritization in Humans. J Neurosci 2017; 37:10725-10737. [PMID: 28982706 DOI: 10.1523/jneurosci.1164-17.2017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2017] [Revised: 09/21/2017] [Accepted: 09/26/2017] [Indexed: 11/21/2022] Open
Abstract
In situations in which impending sensory events demand fast action choices, we must be ready to prioritize higher-value courses of action to avoid missed opportunities. When such a situation first presents itself, stimulus-action contingencies and their relative value must be encoded to establish a value-biased state of preparation for an impending sensorimotor decision. Here, we sought to identify neurophysiological signatures of such processes in the human brain (both female and male). We devised a task requiring fast action choices based on the discrimination of a simple visual cue in which the differently valued sensory alternatives were presented 750-800 ms before as peripheral "targets" that specified the stimulus-action mapping for the upcoming decision. In response to the targets, we identified a discrete, transient, spatially selective signal in the event-related potential (ERP), which scaled with relative value and strongly predicted the degree of behavioral bias in the upcoming decision both across and within subjects. This signal is not compatible with any hitherto known ERP signature of spatial selection and also bears novel distinctions with respect to characterizations of value-sensitive, spatially selective activity found in sensorimotor areas of nonhuman primates. Specifically, a series of follow-up experiments revealed that the signal was reliably invoked regardless of response laterality, response modality, sensory feature, and reward valence. It was absent, however, when the response deadline was relaxed and the strategic need for biasing removed. Therefore, more than passively representing value or salience, the signal appears to play a versatile and active role in adaptive sensorimotor prioritization.SIGNIFICANCE STATEMENT In many situations such as fast-moving sports, we must be ready to act fast in response to sensory events and, in our preparation, prioritize courses of action that lead to greater rewards. Although behavioral effects of value biases in sensorimotor decision making have been widely studied, little is known about the neural processes that set these biases in place beforehand. Here, we report the discovery of a transient, spatially selective neural signal in humans that encodes the relative value of competing decision alternatives and strongly predicts behavioral value biases in decisions made ∼500 ms later. Follow-up manipulations of value differential, reward valence, response modality, sensory features, and time constraints establish that the signal reflects an active, feature- and effector-general preparatory mechanism for value-based prioritization.
Collapse
|
39
|
Ventromedial Prefrontal Cortex Damage Is Associated with Decreased Ventral Striatum Volume and Response to Reward. J Neurosci 2017; 36:5047-54. [PMID: 27147657 DOI: 10.1523/jneurosci.4236-15.2016] [Citation(s) in RCA: 52] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2015] [Accepted: 03/14/2016] [Indexed: 01/23/2023] Open
Abstract
UNLABELLED The ventral striatum and ventromedial prefrontal cortex (vmPFC) are two central nodes of the "reward circuit" of the brain. Human neuroimaging studies have demonstrated coincident activation and functional connectivity between these brain regions, and animal studies have demonstrated that the vmPFC modulates ventral striatum activity. However, there have been no comparable data in humans to address whether the vmPFC may be critical for the reward-related response properties of the ventral striatum. In this study, we used fMRI in five neurosurgical patients with focal vmPFC lesions to test the hypothesis that the vmPFC is necessary for enhancing ventral striatum responses to the anticipation of reward. In support of this hypothesis, we found that, compared with age- and gender-matched neurologically healthy subjects, the vmPFC-lesioned patients had reduced ventral striatal activity during the anticipation of reward. Furthermore, we observed that the vmPFC-lesioned patients had decreased volumes of the accumbens subregion of the ventral striatum. Together, these functional and structural neuroimaging data provide novel evidence for a critical role for the vmPFC in contributing to reward-related activity of the ventral striatum. These results offer new insight into the functional and structural interactions between key components of the brain circuitry underlying human affective function and decision-making. SIGNIFICANCE STATEMENT Maladaptive decision-making is a common problem across multiple mental health disorders. Developing new pathophysiologically based strategies for diagnosis and treatment thus requires a better understanding of the brain circuits responsible for adaptive decision-making and related psychological subprocesses (e.g., reward valuation, anticipation, and motivation). Animal studies provide evidence that these functions are mediated through direct interactions between two key nodes of a posited "reward circuit," the ventral striatum and the ventromedial prefrontal cortex (vmPFC). For the first time in humans, we demonstrate that damage to the vmPFC results in decreased ventral striatum activity during reward anticipation. These data provide unique evidence on the causal mechanisms by which the vmPFC and ventral striatum interact during the anticipation of rewards.
Collapse
|
40
|
Funahashi S. Prefrontal Contribution to Decision-Making under Free-Choice Conditions. Front Neurosci 2017; 11:431. [PMID: 28798662 PMCID: PMC5526964 DOI: 10.3389/fnins.2017.00431] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2017] [Accepted: 07/12/2017] [Indexed: 12/02/2022] Open
Abstract
Executive function is thought to be the coordinated operation of multiple neural processes and allows to accomplish a current goal flexibly. The most important function of the prefrontal cortex is the executive function. Among a variety of executive functions in which the prefrontal cortex participates, decision-making is one of the most important. Although the prefrontal contribution to decision-making has been examined using a variety of behavioral tasks, recent studies using fMRI have shown that the prefrontal cortex participates in decision-making under free-choice conditions. Since decision-making under free-choice conditions represents the very first stage for any kind of decision-making process, it is important that we understand its neural mechanism. Although few studies have examined this issue while a monkey performed a free-choice task, those studies showed that, when the monkey made a decision to subsequently choose one particular option, prefrontal neurons showing selectivity to that option exhibited transient activation just before presentation of the imperative cue. Further studies have suggested that this transient increase is caused by the irregular fluctuation of spontaneous firing just before cue presentation, which enhances the response to the cue and biases the strength of the neuron's selectivity to the option. In addition, this biasing effect was observed only in neurons that exhibited sustained delay-period activity, indicating that this biasing effect not only influences the animal's decision for an upcoming choice, but also is linked to working memory mechanisms in the prefrontal cortex.
Collapse
|
41
|
Murakami M, Shteingart H, Loewenstein Y, Mainen ZF. Distinct Sources of Deterministic and Stochastic Components of Action Timing Decisions in Rodent Frontal Cortex. Neuron 2017; 94:908-919.e7. [PMID: 28521140 DOI: 10.1016/j.neuron.2017.04.040] [Citation(s) in RCA: 58] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2016] [Revised: 03/06/2017] [Accepted: 04/27/2017] [Indexed: 11/26/2022]
Abstract
The selection and timing of actions are subject to determinate influences such as sensory cues and internal state as well as to effectively stochastic variability. Although stochastic choice mechanisms are assumed by many theoretical models, their origin and mechanisms remain poorly understood. Here we investigated this issue by studying how neural circuits in the frontal cortex determine action timing in rats performing a waiting task. Electrophysiological recordings from two regions necessary for this behavior, medial prefrontal cortex (mPFC) and secondary motor cortex (M2), revealed an unexpected functional dissociation. Both areas encoded deterministic biases in action timing, but only M2 neurons reflected stochastic trial-by-trial fluctuations. This differential coding was reflected in distinct timescales of neural dynamics in the two frontal cortical areas. These results suggest a two-stage model in which stochastic components of action timing decisions are injected by circuits downstream of those carrying deterministic bias signals.
Collapse
Affiliation(s)
- Masayoshi Murakami
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal.
| | - Hanan Shteingart
- The Edmond & Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel
| | - Yonatan Loewenstein
- The Edmond & Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel; Department of Neurobiology, The Alexander Silberman Institute of Life Sciences and the Federmann Center for the Study of Rationality, The Hebrew University of Jerusalem, 9190401 Jerusalem, Israel
| | - Zachary F Mainen
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal.
| |
Collapse
|
42
|
Abstract
Investigation of natural behavior has contributed a number of insights to our understanding of visual guidance of actions by highlighting the importance of behavioral goals and focusing attention on how vision and action play out in time. In this context, humans make continuous sequences of sensory-motor decisions to satisfy current behavioral goals, and the role of vision is to provide the relevant information for making good decisions in order to achieve those goals. This conceptualization of visually guided actions as a sequence of sensory-motor decisions has been formalized within the framework of statistical decision theory, which structures the problem and provides the context for much recent progress in vision and action. Components of a good decision include the task, which defines the behavioral goals, the rewards and costs associated with those goals, uncertainty about the state of the world, and prior knowledge.
Collapse
Affiliation(s)
- Mary M Hayhoe
- Center for Perceptual Systems, University of Texas at Austin, Texas 78712;
| |
Collapse
|
43
|
Fouragnan E, Queirazza F, Retzler C, Mullinger KJ, Philiastides MG. Spatiotemporal neural characterization of prediction error valence and surprise during reward learning in humans. Sci Rep 2017; 7:4762. [PMID: 28684734 PMCID: PMC5500565 DOI: 10.1038/s41598-017-04507-w] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Accepted: 05/17/2017] [Indexed: 02/01/2023] Open
Abstract
Reward learning depends on accurate reward associations with potential choices. These associations can be attained with reinforcement learning mechanisms using a reward prediction error (RPE) signal (the difference between actual and expected rewards) for updating future reward expectations. Despite an extensive body of literature on the influence of RPE on learning, little has been done to investigate the potentially separate contributions of RPE valence (positive or negative) and surprise (absolute degree of deviation from expectations). Here, we coupled single-trial electroencephalography with simultaneously acquired fMRI, during a probabilistic reversal-learning task, to offer evidence of temporally overlapping but largely distinct spatial representations of RPE valence and surprise. Electrophysiological variability in RPE valence correlated with activity in regions of the human reward network promoting approach or avoidance learning. Electrophysiological variability in RPE surprise correlated primarily with activity in regions of the human attentional network controlling the speed of learning. Crucially, despite the largely separate spatial extend of these representations our EEG-informed fMRI approach uniquely revealed a linear superposition of the two RPE components in a smaller network encompassing visuo-mnemonic and reward areas. Activity in this network was further predictive of stimulus value updating indicating a comparable contribution of both signals to reward learning.
Collapse
Affiliation(s)
- Elsa Fouragnan
- Institute of Neuroscience & Psychology, University of Glasgow, Glasgow, UK.
- Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Filippo Queirazza
- Institute of Neuroscience & Psychology, University of Glasgow, Glasgow, UK
| | - Chris Retzler
- Institute of Neuroscience & Psychology, University of Glasgow, Glasgow, UK
- Department of Behavioural & Social Sciences, University of Huddersfield, Huddersfield, UK
| | - Karen J Mullinger
- Sir Peter Mansfield Magnetic Resonance Center, School of Physics and Astronomy, University of Nottingham, Nottingham, UK
- Birmingham University Imaging Centre, School of Psychology, University of Birmingham, Birmingham, UK
| | | |
Collapse
|
44
|
Shadlen MN, Shohamy D. Decision Making and Sequential Sampling from Memory. Neuron 2017; 90:927-39. [PMID: 27253447 DOI: 10.1016/j.neuron.2016.04.036] [Citation(s) in RCA: 170] [Impact Index Per Article: 24.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2016] [Revised: 04/18/2016] [Accepted: 04/22/2016] [Indexed: 12/16/2022]
Abstract
Decisions take time, and as a rule more difficult decisions take more time. But this only raises the question of what consumes the time. For decisions informed by a sequence of samples of evidence, the answer is straightforward: more samples are available with more time. Indeed, the speed and accuracy of such decisions are explained by the accumulation of evidence to a threshold or bound. However, the same framework seems to apply to decisions that are not obviously informed by sequences of evidence samples. Here, we proffer the hypothesis that the sequential character of such tasks involves retrieval of evidence from memory. We explore this hypothesis by focusing on value-based decisions and argue that mnemonic processes can account for regularities in choice and decision time. We speculate on the neural mechanisms that link sampling of evidence from memory to circuits that represent the accumulated evidence bearing on a choice. We propose that memory processes may contribute to a wider class of decisions that conform to the regularities of choice-reaction time predicted by the sequential sampling framework.
Collapse
Affiliation(s)
- Michael N Shadlen
- Howard Hughes Medical Institute and Department of Neuroscience, Columbia University, New York, NY 10032, USA; Zuckerman Mind Brain Behavior Institute and Kavli Institute for Brain Science, Columbia University, New York, NY 10032, USA.
| | - Daphna Shohamy
- Department of Psychology, Columbia University, New York, NY 10032, USA; Zuckerman Mind Brain Behavior Institute and Kavli Institute for Brain Science, Columbia University, New York, NY 10032, USA.
| |
Collapse
|
45
|
Hélie S, Shamloo F, Novak K, Foti D. The roles of valuation and reward processing in cognitive function and psychiatric disorders. Ann N Y Acad Sci 2017; 1395:33-48. [PMID: 28415138 DOI: 10.1111/nyas.13327] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
In neuroeconomics, valuation refers to the process of assigning values to states and actions on the basis of the animal's current representation of the environment, while reward processing corresponds to processing the feedback received from the environment to update the values of states and actions. In this article, we review the brain circuits associated with valuation and reward processing and argue that these are fundamental processes critical to many cognitive functions. Specifically, we focus on the role of valuation and reward processing in attention, memory, decision making, and learning. Next, the extant neuroimaging literature on a number of psychiatric disorders is reviewed (i.e., addiction, pathological gambling, schizophrenia, and mood disorders), and an argument is made that associated deficits in cognitive functions can be explained in terms of abnormal valuation and reward processing. The review concludes with the impact of this framework in clinical settings and prescriptions for future research, in particular with regard to the conversions of qualitatively different valuation systems into a system of common currency.
Collapse
Affiliation(s)
- Sébastien Hélie
- Department of Psychological Sciences, Purdue University, West Lafayette, Indiana
| | - Farzin Shamloo
- Department of Psychological Sciences, Purdue University, West Lafayette, Indiana
| | - Keisha Novak
- Department of Psychological Sciences, Purdue University, West Lafayette, Indiana
| | - Dan Foti
- Department of Psychological Sciences, Purdue University, West Lafayette, Indiana
| |
Collapse
|
46
|
Abstract
In natural behavior, animals have access to multiple sources of information, but only a few of these sources are relevant for learning and actions. Beyond choosing an appropriate action, making good decisions entails the ability to choose the relevant information, but fundamental questions remain about the brain's information sampling policies. Recent studies described the neural correlates of seeking information about a reward, but it remains unknown whether, and how, neurons encode choices of instrumental information, in contexts in which the information guides subsequent actions. Here we show that parietal cortical neurons involved in oculomotor decisions encode, before an information sampling saccade, the reduction in uncertainty that the saccade is expected to bring for a subsequent action. These responses were distinct from the neurons' visual and saccadic modulations and from signals of expected reward or reward prediction errors. Therefore, even in an instrumental context when information and reward gains are closely correlated, individual cells encode decision variables that are based on informational factors and can guide the active sampling of action-relevant cues.
Collapse
|
47
|
Abstract
In this review, we summarize findings supporting the existence of multiple behavioral strategies for controlling reward-related behavior, including a dichotomy between the goal-directed or model-based system and the habitual or model-free system in the domain of instrumental conditioning and a similar dichotomy in the realm of Pavlovian conditioning. We evaluate evidence from neuroscience supporting the existence of at least partly distinct neuronal substrates contributing to the key computations necessary for the function of these different control systems. We consider the nature of the interactions between these systems and show how these interactions can lead to either adaptive or maladaptive behavioral outcomes. We then review evidence that an additional system guides inference concerning the hidden states of other agents, such as their beliefs, preferences, and intentions, in a social context. We also describe emerging evidence for an arbitration mechanism between model-based and model-free reinforcement learning, placing such a mechanism within the broader context of the hierarchical control of behavior.
Collapse
Affiliation(s)
- John P O'Doherty
- Division of Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125;
| | - Jeffrey Cockburn
- Division of Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125;
| | - Wolfgang M Pauli
- Division of Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125;
| |
Collapse
|
48
|
Coutlee CG, Kiyonaga A, Korb FM, Huettel SA, Egner T. Reduced Risk-Taking following Disruption of the Intraparietal Sulcus. Front Neurosci 2016; 10:588. [PMID: 28066171 PMCID: PMC5179562 DOI: 10.3389/fnins.2016.00588] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2016] [Accepted: 12/07/2016] [Indexed: 11/28/2022] Open
Abstract
Decision makers frequently encounter opportunities to pursue great gains—assuming they are willing to accept greater risks. Previous neuroimaging studies have shown that activity in the intraparietal sulcus (IPS) and the inferior frontal junction (IFJ) are associated with individual preferences for economic risk (“known unknowns,” e.g., a 50% chance of winning $5) and ambiguity (“unknown unknowns,” e.g., an unknown chance of winning $5), respectively. Whether processing in these regions causally enables risk-taking for individual decisions, however, remains unknown. To examine this question, we assessed the decision to engage in risk-taking after disrupting neural processing in the IPS and IFJ of healthy human participants using repetitive transcranial magnetic stimulation. While stimulation of the IFJ resulted in general slowing of decision times, disrupting neural processing within the IPS selectively suppressed risk-taking, biasing choices toward certain options featuring both lower risks and lower expected rewards. Our results are the first to demonstrate the necessity of intact IPS function for choosing uncertain outcomes when faced with calculable risks and rewards. Engagement of IPS during decision making may support a willingness to accept uncertain outcomes for a chance to obtain greater gains.
Collapse
Affiliation(s)
- Christopher G Coutlee
- Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| | - Anastasia Kiyonaga
- Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| | - Franziska M Korb
- Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| | - Scott A Huettel
- Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| | - Tobias Egner
- Department of Psychology and Neuroscience, Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| |
Collapse
|
49
|
Coupling between One-Dimensional Networks Reconciles Conflicting Dynamics in LIP and Reveals Its Recurrent Circuitry. Neuron 2016; 93:221-234. [PMID: 27989463 DOI: 10.1016/j.neuron.2016.11.023] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2015] [Revised: 07/13/2016] [Accepted: 11/07/2016] [Indexed: 11/20/2022]
Abstract
Little is known about the internal circuitry of the primate lateral intraparietal area (LIP). During two versions of a delayed-saccade task, we found radically different network dynamics beneath similar population average firing patterns. When neurons are not influenced by stimuli outside their receptive fields (RFs), dynamics of the high-dimensional LIP network during slowly varying activity lie predominantly in one multi-neuronal dimension, as described previously. However, when activity is suppressed by stimuli outside the RF, slow LIP dynamics markedly deviate from a single dimension. The conflicting results can be reconciled if two LIP local networks, each underlying an RF location and dominated by a single multi-neuronal activity pattern, are suppressively coupled to each other. These results demonstrate the low dimensionality of slow LIP local dynamics, and suggest that LIP local networks encoding the attentional and movement priority of competing visual locations actively suppress one another.
Collapse
|
50
|
Temporal coding of reward-guided choice in the posterior parietal cortex. Proc Natl Acad Sci U S A 2016; 113:13492-13497. [PMID: 27821752 DOI: 10.1073/pnas.1606479113] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Making a decision involves computations across distributed cortical and subcortical networks. How such distributed processing is performed remains unclear. We test how the encoding of choice in a key decision-making node, the posterior parietal cortex (PPC), depends on the temporal structure of the surrounding population activity. We recorded spiking and local field potential (LFP) activity in the PPC while two rhesus macaques performed a decision-making task. We quantified the mutual information that neurons carried about an upcoming choice and its dependence on LFP activity. The spiking of PPC neurons was correlated with LFP phases at three distinct time scales in the theta, beta, and gamma frequency bands. Importantly, activity at these time scales encoded upcoming decisions differently. Choice information contained in neural firing varied with the phase of beta and gamma activity. For gamma activity, maximum choice information occurred at the same phase as the maximum spike count. However, for beta activity, choice information and spike count were greatest at different phases. In contrast, theta activity did not modulate the encoding properties of PPC units directly but was correlated with beta and gamma activity through cross-frequency coupling. We propose that the relative timing of local spiking and choice information reveals temporal reference frames for computations in either local or large-scale decision networks. Differences between the timing of task information and activity patterns may be a general signature of distributed processing across large-scale networks.
Collapse
|