1
|
Steinemann N, Stine GM, Trautmann E, Zylberberg A, Wolpert DM, Shadlen MN. Direct observation of the neural computations underlying a single decision. eLife 2024; 12:RP90859. [PMID: 39422555 PMCID: PMC11488853 DOI: 10.7554/elife.90859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2024] Open
Abstract
Neurobiological investigations of perceptual decision-making have furnished the first glimpse of a flexible cognitive process at the level of single neurons. Neurons in the parietal and prefrontal cortex are thought to represent the accumulation of noisy evidence, acquired over time, leading to a decision. Neural recordings averaged over many decisions have provided support for the deterministic rise in activity to a termination bound. Critically, it is the unobserved stochastic component that is thought to confer variability in both choice and decision time. Here, we elucidate this drift-diffusion signal on individual decisions. We recorded simultaneously from hundreds of neurons in the lateral intraparietal cortex of monkeys while they made decisions about the direction of random dot motion. We show that a single scalar quantity, derived from the weighted sum of the population activity, represents a combination of deterministic drift and stochastic diffusion. Moreover, we provide direct support for the hypothesis that this drift-diffusion signal approximates the quantity responsible for the variability in choice and reaction times. The population-derived signals rely on a small subset of neurons with response fields that overlap the choice targets. These neurons represent the integral of noisy evidence. Another subset of direction-selective neurons with response fields that overlap the motion stimulus appear to represent the integrand. This parsimonious architecture would escape detection by state-space analyses, absent a clear hypothesis.
Collapse
Affiliation(s)
- Natalie Steinemann
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Gabriel M Stine
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Eric Trautmann
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Ariel Zylberberg
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
| | - Daniel M Wolpert
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Kavli Institute, Columbia UniversityNew YorkUnited States
| | - Michael N Shadlen
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
- Kavli Institute, Columbia UniversityNew YorkUnited States
| |
Collapse
|
2
|
Fettiplace MR, Vincent KF, Cho A, Dillon E, Stapley BM, Stewart V, Solt K. Dopaminergic psychostimulants cause arousal from isoflurane-induced sedation without reversing memory impairment in rats. Br J Anaesth 2024; 133:793-803. [PMID: 38965013 PMCID: PMC11443133 DOI: 10.1016/j.bja.2024.05.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 04/30/2024] [Accepted: 05/04/2024] [Indexed: 07/06/2024] Open
Abstract
BACKGROUND Dopaminergic psychostimulants can restore arousal in anaesthetised animals, and dopaminergic signalling contributes to hippocampal-dependent memory formation. We tested the hypothesis that dopaminergic psychostimulants can antagonise the amnestic effects of isoflurane on visuospatial working memory. METHODS Sixteen adult Sprague-Dawley rats were trained on a trial-unique nonmatching-to-location (TUNL) task which assessed the ability to identify a novel touchscreen location after a fixed delay. Once trained, the effects of low-dose isoflurane (0.3 vol%) on task performance and activity, assessed by infrared beam breaks, were assessed. We attempted to rescue deficits in performance and activity with a dopamine D1 receptor agonist (chloro-APB), a noradrenergic reuptake inhibitor (atomoxetine), and a mixed dopamine/norepinephrine releasing agent (dextroamphetamine). Anaesthetic induction, emergence, and recovery from anaesthesia were also investigated. RESULTS Low-dose isoflurane impaired working memory in a sex-independent and intra-trial delay-independent manner as assessed by task performance, and caused an overall reduction in activity. Administration of chloro-APB, atomoxetine, or dextroamphetamine did not restore visuospatial working memory, but chloro-APB and dextroamphetamine recovered arousal to levels observed in the baseline awake state. Performance did not differ between induction and emergence. Animals recovered to baseline performance within 15 min of discontinuing isoflurane. CONCLUSIONS Low-dose isoflurane impairs visuospatial working memory in a nondurable and delay-independent manner that potentially implicates non-hippocampal structures in isoflurane-induced memory deficits. Dopaminergic psychostimulants counteracted sedation but did not reverse memory impairments, suggesting that isoflurane-induced amnesia and isoflurane-induced sedation have distinct underlying mechanisms that can be antagonised independently.
Collapse
Affiliation(s)
- Michael R Fettiplace
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA; Department of Anaesthesia, Harvard Medical School, Boston, MA, USA.
| | - Kathleen F Vincent
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA; Department of Anaesthesia, Harvard Medical School, Boston, MA, USA
| | - Angel Cho
- Touro College of Osteopathic Medicine, New York, NY, USA
| | - Emmaline Dillon
- Department of Cell Biology and Physiology, Brigham Young University, Provo, UT, USA
| | - Brendan M Stapley
- Department of Cell Biology and Physiology, Brigham Young University, Provo, UT, USA
| | - Victoria Stewart
- University of California Irvine School of Medicine, Irvine, CA, USA
| | - Ken Solt
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA; Department of Anaesthesia, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
3
|
Vivar-Lazo M, Fetsch CR. Neural basis of concurrent deliberation toward a choice and degree of confidence. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.06.606833. [PMID: 39149300 PMCID: PMC11326179 DOI: 10.1101/2024.08.06.606833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Decision confidence plays a key role in flexible behavior and (meta)cognition, but its underlying neural mechanisms remain elusive. To uncover the latent dynamics of confidence formation at the level of population activity, we designed a decision task for nonhuman primates that measures choice, reaction time, and confidence with a single eye movement on every trial. Monkey behavior was well fit by a bounded accumulator model instantiating parallel processing of evidence, rejecting a serial model in which the choice is resolved first followed by post-decision accumulation for confidence. Neurons in area LIP reflected concurrent accumulation, exhibiting covariation of choice and confidence signals across the population, and within-trial dynamics consistent with parallel updating at near-zero time lag. The results demonstrate that monkeys can process a single stream of evidence in service of two computational goals simultaneously-a categorical decision and associated level of confidence-and illuminate a candidate neural substrate for this ability.
Collapse
Affiliation(s)
- Miguel Vivar-Lazo
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher R Fetsch
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
- Solomon H. Snyder Department of Neuroscience, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
4
|
Luo TZ, Kim TD, Gupta D, Bondy AG, Kopec CD, Elliot VA, DePasquale B, Brody CD. Transitions in dynamical regime and neural mode underlie perceptual decision-making. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.10.15.562427. [PMID: 37904994 PMCID: PMC10614809 DOI: 10.1101/2023.10.15.562427] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
Perceptual decision-making is the process by which an animal uses sensory stimuli to choose an action or mental proposition. This process is thought to be mediated by neurons organized as attractor networks 1,2 . However, whether attractor dynamics underlie decision behavior and the complex neuronal responses remains unclear. Here we use an unsupervised, deep learning-based method to discover decision-related dynamics from the simultaneous activity of neurons in frontal cortex and striatum of rats while they accumulate pulsatile auditory evidence. We found that trajectories evolved along two sequential regimes, the first dominated by sensory inputs, and the second dominated by the autonomous dynamics, with flow in a direction (i.e., "neural mode") largely orthogonal to that in the first regime. We propose that the second regime corresponds to decision commitment. We developed a simplified model that approximates the coupled transition in dynamics and neural mode and allows precise inference, from each trial's neural activity, of a putative internal decision commitment time in that trial. The simplified model captures diverse and complex single-neuron temporal profiles, such as ramping and stepping 3-5 . It also captures trial-averaged curved trajectories 6-8 , and reveals distinctions between brain regions. The putative neurally-inferred commitment times ("nTc") occurred at times broadly distributed across trials, and not time-locked to stimulus onset, offset, or response onset. Nevertheless, when trials were aligned to nTc, behavioral analysis showed that, as predicted by a decision commitment time, sensory evidence before nTc affected the subjects' decision, but evidence after nTc did not. Our results show that the formation of a perceptual choice involves a rapid, coordinated transition in both the dynamical regime and the neural mode of the decision process, and suggest the moment of commitment to be a useful entry point for dissecting mechanisms underlying rapid changes in internal state.
Collapse
|
5
|
Kang JU, Mooshagian E, Snyder LH. Functional organization of posterior parietal cortex circuitry based on inferred information flow. Cell Rep 2024; 43:114028. [PMID: 38581681 PMCID: PMC11090617 DOI: 10.1016/j.celrep.2024.114028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 02/09/2024] [Accepted: 03/15/2024] [Indexed: 04/08/2024] Open
Abstract
Many studies infer the role of neurons by asking what information can be decoded from their activity or by observing the consequences of perturbing their activity. An alternative approach is to consider information flow between neurons. We applied this approach to the parietal reach region (PRR) and the lateral intraparietal area (LIP) in posterior parietal cortex. Two complementary methods imply that across a range of reaching tasks, information flows primarily from PRR to LIP. This indicates that during a coordinated reach task, LIP has minimal influence on PRR and rules out the idea that LIP forms a general purpose spatial processing hub for action and cognition. Instead, we conclude that PRR and LIP operate in parallel to plan arm and eye movements, respectively, with asymmetric interactions that likely support eye-hand coordination. Similar methods can be applied to other areas to infer their functional relationships based on inferred information flow.
Collapse
Affiliation(s)
- Jung Uk Kang
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA.
| | - Eric Mooshagian
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Lawrence H Snyder
- Department of Neuroscience, Washington University School of Medicine, St. Louis, MO 63110, USA
| |
Collapse
|
6
|
Walsh K, McGovern DP, Dully J, Kelly SP, O'Connell RG. Prior probability cues bias sensory encoding with increasing task exposure. eLife 2024; 12:RP91135. [PMID: 38564237 PMCID: PMC10987094 DOI: 10.7554/elife.91135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024] Open
Abstract
When observers have prior knowledge about the likely outcome of their perceptual decisions, they exhibit robust behavioural biases in reaction time and choice accuracy. Computational modelling typically attributes these effects to strategic adjustments in the criterion amount of evidence required to commit to a choice alternative - usually implemented by a starting point shift - but recent work suggests that expectations may also fundamentally bias the encoding of the sensory evidence itself. Here, we recorded neural activity with EEG while participants performed a contrast discrimination task with valid, invalid, or neutral probabilistic cues across multiple testing sessions. We measured sensory evidence encoding via contrast-dependent steady-state visual-evoked potentials (SSVEP), while a read-out of criterion adjustments was provided by effector-selective mu-beta band activity over motor cortex. In keeping with prior modelling and neural recording studies, cues evoked substantial biases in motor preparation consistent with criterion adjustments, but we additionally found that the cues produced a significant modulation of the SSVEP during evidence presentation. While motor preparation adjustments were observed in the earliest trials, the sensory-level effects only emerged with extended task exposure. Our results suggest that, in addition to strategic adjustments to the decision process, probabilistic information can also induce subtle biases in the encoding of the evidence itself.
Collapse
Affiliation(s)
- Kevin Walsh
- School of Psychological Sciences, Monash UniversityMelbourneAustralia
| | | | - Jessica Dully
- Institute of Psychiatry, Psychology & Neuroscience, King's College LondonLondonUnited Kingdom
| | - Simon P Kelly
- School of Electrical Engineering, University College DublinDublinIreland
- Trinity College Institute of Neuroscience, Trinity College DublinDublinIreland
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience, Trinity College DublinDublinIreland
- School of Psychology, Trinity College DublinDublinIreland
| |
Collapse
|
7
|
Ivanov V, Manenti GL, Plewe SS, Kagan I, Schwiedrzik CM. Decision-making processes in perceptual learning depend on effectors. Sci Rep 2024; 14:5644. [PMID: 38453977 PMCID: PMC10920771 DOI: 10.1038/s41598-024-55508-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 02/24/2024] [Indexed: 03/09/2024] Open
Abstract
Visual perceptual learning is traditionally thought to arise in visual cortex. However, typical perceptual learning tasks also involve systematic mapping of visual information onto motor actions. Because the motor system contains both effector-specific and effector-unspecific representations, the question arises whether visual perceptual learning is effector-specific itself, or not. Here, we study this question in an orientation discrimination task. Subjects learn to indicate their choices either with joystick movements or with manual reaches. After training, we challenge them to perform the same task with eye movements. We dissect the decision-making process using the drift diffusion model. We find that learning effects on the rate of evidence accumulation depend on effectors, albeit not fully. This suggests that during perceptual learning, visual information is mapped onto effector-specific integrators. Overlap of the populations of neurons encoding motor plans for these effectors may explain partial generalization. Taken together, visual perceptual learning is not limited to visual cortex, but also affects sensorimotor mapping at the interface of visual processing and decision making.
Collapse
Affiliation(s)
- Vladyslav Ivanov
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany
- Sensorimotor Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
| | - Giorgio L Manenti
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
- Leibniz ScienceCampus Primate Cognition, Göttingen, Germany
- Systems Neuroscience Program, Graduate School for Neurosciences, Biophysics and Molecular Biosciences (GGNB), 37077, Göttingen, Germany
| | - Sandrin S Plewe
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
- Leibniz ScienceCampus Primate Cognition, Göttingen, Germany
| | - Igor Kagan
- Leibniz ScienceCampus Primate Cognition, Göttingen, Germany
- Decision and Awareness Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
| | - Caspar M Schwiedrzik
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany.
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany.
- Leibniz ScienceCampus Primate Cognition, Göttingen, Germany.
| |
Collapse
|
8
|
Gherman S, Markowitz N, Tostaeva G, Espinal E, Mehta AD, O'Connell RG, Kelly SP, Bickel S. Intracranial electroencephalography reveals effector-independent evidence accumulation dynamics in multiple human brain regions. Nat Hum Behav 2024:10.1038/s41562-024-01824-9. [PMID: 38366105 DOI: 10.1038/s41562-024-01824-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 01/10/2024] [Indexed: 02/18/2024]
Abstract
Neural representations of perceptual decision formation that are abstracted from specific motor requirements have previously been identified in humans using non-invasive electrophysiology; however, it is currently unclear where these originate in the brain. Here we capitalized on the high spatiotemporal precision of intracranial EEG to localize such abstract decision signals. Participants undergoing invasive electrophysiological monitoring for epilepsy were asked to judge the direction of random-dot stimuli and respond either with a speeded button press (N = 24), or vocally, after a randomized delay (N = 12). We found a widely distributed motor-independent network of regions where high-frequency activity exhibited key characteristics consistent with evidence accumulation, including a gradual buildup that was modulated by the strength of the sensory evidence, and an amplitude that predicted participants' choice accuracy and response time. Our findings offer a new view on the brain networks governing human decision-making.
Collapse
Affiliation(s)
- Sabina Gherman
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA.
| | - Noah Markowitz
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Gelana Tostaeva
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
| | - Elizabeth Espinal
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Department of Psychological and Brain Sciences, Drexel University, Philadelphia, PA, USA
| | - Ashesh D Mehta
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA
- Departments of Neurology and Neurosurgery, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Simon P Kelly
- School of Electrical and Electronic Engineering and UCD Centre for Biomedical Engineering, University College Dublin, Dublin, Ireland
| | - Stephan Bickel
- The Feinstein Institutes for Medical Research, Northwell Health, Manhasset, NY, USA.
- Departments of Neurology and Neurosurgery, Zucker School of Medicine at Hofstra/Northwell, Hempstead, NY, USA.
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute, Orangeburg, NY, USA.
| |
Collapse
|
9
|
Pourmohammadi A, Sanayei M. Context-specific and context-invariant computations of interval timing. Front Neurosci 2023; 17:1249502. [PMID: 37799342 PMCID: PMC10547875 DOI: 10.3389/fnins.2023.1249502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 09/06/2023] [Indexed: 10/07/2023] Open
Abstract
Introduction An accurate sense of time is crucial in flexible sensorimotor control and other cognitive functions. However, it remains unknown how multiple timing computations in different contexts interact to shape our behavior. Methods We asked 41 healthy human subjects to perform timing tasks that differed in the sensorimotor domain (sensory timing vs. motor timing) and effector (hand vs. saccadic eye movement). To understand how these different behavioral contexts contribute to timing behavior, we applied a three-stage Bayesian model to behavioral data. Results Our results demonstrate that the Bayesian model for each effector could not describe bias in the other effector. Similarly, in each task the model-predicted data could not describe bias in the other task. These findings suggest that the measurement stage of interval timing is context-specific in the sensorimotor and effector domains. We also showed that temporal precision is context-invariant in the effector domain, unlike temporal accuracy. Discussion This combination of context-specific and context-invariant computations across sensorimotor and effector domains suggests overlapping and distributed computations as the underlying mechanism of timing in different contexts.
Collapse
Affiliation(s)
- Ahmad Pourmohammadi
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Mehdi Sanayei
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
- Center for Translational Neuroscience (CTN), Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
10
|
Visser YF, Medendorp WP, Selen LPJ. Muscular reflex gains reflect changes of mind in reaching. J Neurophysiol 2023; 130:640-651. [PMID: 37584102 DOI: 10.1152/jn.00197.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 07/18/2023] [Accepted: 08/10/2023] [Indexed: 08/17/2023] Open
Abstract
Decisions for action are accompanied by a continual processing of sensory information, sometimes resulting in a revision of the initial choice, called a change of mind (CoM). Although the motor system is tuned during the formation of a reach decision, it is unclear whether its preparatory state differs between CoM and non-CoM decisions. To test this, participants (n = 14) viewed a random-dot motion (RDM) stimulus of various coherence levels for a random viewing duration. At the onset of a mechanical perturbation that rapidly stretched the pectoralis muscle, they indicated the perceived motion direction by making a reaching movement to one of two targets. Using electromyography (EMG), we quantified the reflex gains of the pectoralis and posterior deltoid muscles. Results show that reflex gains scaled with both the coherence level and the viewing duration of the stimulus. We fit a drift diffusion model (DDM) to the behavioral choices. The decision variable (DV), derived from the DDM, correlated well with the measured reflex gain at the single-trial level. However, when matched on DV magnitude, reflex gains were significantly lower in CoM than non-CoM trials. We conclude that the internal state of the motor system, as measured by the spinal reflexes, reflects the continual deliberation on sensory evidence for action selection, including the postdecisional evidence that can lead to a change of mind.NEW & NOTEWORTHY Using behavioral findings, EMG, and computational modeling, we show that not only the perceptual decision outcome but also the accumulating evidence for that outcome is continuously sent to the relevant muscles. Moreover, we show that an upcoming change of mind can be detected in the motor periphery, suggesting that a correlate of the internal decision making process is being sent along.
Collapse
Affiliation(s)
- Yvonne F Visser
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - W Pieter Medendorp
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Luc P J Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| |
Collapse
|
11
|
Matsumiya K, Furukawa S. Perceptual decisions interfere more with eye movements than with reach movements. Commun Biol 2023; 6:882. [PMID: 37648896 PMCID: PMC10468498 DOI: 10.1038/s42003-023-05249-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 08/16/2023] [Indexed: 09/01/2023] Open
Abstract
Perceptual judgements are formed through invisible cognitive processes. Reading out these judgements is essential for advancing our understanding of decision making and requires inferring covert cognitive states based on overt motor actions. Although intuition suggests that these actions must be related to the formation of decisions about where to move body parts, actions have been reported to be influenced by perceptual judgements even when the action is irrelevant to the perceptual judgement. However, despite performing multiple actions in our daily lives, how perceptual judgements influence multiple judgement-irrelevant actions is unknown. Here we show that perceptual judgements affect only saccadic eye movements when simultaneous judgement-irrelevant saccades and reaches are made, demonstrating that perceptual judgement-related signals continuously flow into the oculomotor system alone when multiple judgement-irrelevant actions are performed. This suggests that saccades are useful for making inferences about covert perceptual decisions, even when the actions are not tied to decision making.
Collapse
Affiliation(s)
| | - Shota Furukawa
- Graduate School of Information Sciences, Tohoku University, Sendai, Japan
| |
Collapse
|
12
|
Balsdon T, Verdonck S, Loossens T, Philiastides MG. Secondary motor integration as a final arbiter in sensorimotor decision-making. PLoS Biol 2023; 21:e3002200. [PMID: 37459392 PMCID: PMC10393169 DOI: 10.1371/journal.pbio.3002200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 08/01/2023] [Accepted: 06/15/2023] [Indexed: 08/02/2023] Open
Abstract
Sensorimotor decision-making is believed to involve a process of accumulating sensory evidence over time. While current theories posit a single accumulation process prior to planning an overt motor response, here, we propose an active role of motor processes in decision formation via a secondary leaky motor accumulation stage. The motor leak adapts the "memory" with which this secondary accumulator reintegrates the primary accumulated sensory evidence, thus adjusting the temporal smoothing in the motor evidence and, correspondingly, the lag between the primary and motor accumulators. We compare this framework against different single accumulator variants using formal model comparison, fitting choice, and response times in a task where human observers made categorical decisions about a noisy sequence of images, under different speed-accuracy trade-off instructions. We show that, rather than boundary adjustments (controlling the amount of evidence accumulated for decision commitment), adjustment of the leak in the secondary motor accumulator provides the better description of behavior across conditions. Importantly, we derive neural correlates of these 2 integration processes from electroencephalography data recorded during the same task and show that these neural correlates adhere to the neural response profiles predicted by the model. This framework thus provides a neurobiologically plausible description of sensorimotor decision-making that captures emerging evidence of the active role of motor processes in choice behavior.
Collapse
Affiliation(s)
- Tarryn Balsdon
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, United Kingdom
| | - Stijn Verdonck
- Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium
| | - Tim Loossens
- Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium
| | - Marios G Philiastides
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, United Kingdom
| |
Collapse
|
13
|
Abstract
Neural mechanisms of perceptual decision making have been extensively studied in experimental settings that mimic stable environments with repeating stimuli, fixed rules, and payoffs. In contrast, we live in an ever-changing environment and have varying goals and behavioral demands. To accommodate variability, our brain flexibly adjusts decision-making processes depending on context. Here, we review a growing body of research that explores the neural mechanisms underlying this flexibility. We highlight diverse forms of context dependency in decision making implemented through a variety of neural computations. Context-dependent neural activity is observed in a distributed network of brain structures, including posterior parietal, sensory, motor, and subcortical regions, as well as the prefrontal areas classically implicated in cognitive control. We propose that investigating the distributed network underlying flexible decisions is key to advancing our understanding and discuss a path forward for experimental and theoretical investigations.
Collapse
Affiliation(s)
- Gouki Okazawa
- Center for Neural Science, New York University, New York, NY, USA;
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY, USA;
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
14
|
Thura D, Cabana JF, Feghaly A, Cisek P. Integrated neural dynamics of sensorimotor decisions and actions. PLoS Biol 2022; 20:e3001861. [PMID: 36520685 PMCID: PMC9754259 DOI: 10.1371/journal.pbio.3001861] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 09/29/2022] [Indexed: 12/23/2022] Open
Abstract
Recent theoretical models suggest that deciding about actions and executing them are not implemented by completely distinct neural mechanisms but are instead two modes of an integrated dynamical system. Here, we investigate this proposal by examining how neural activity unfolds during a dynamic decision-making task within the high-dimensional space defined by the activity of cells in monkey dorsal premotor (PMd), primary motor (M1), and dorsolateral prefrontal cortex (dlPFC) as well as the external and internal segments of the globus pallidus (GPe, GPi). Dimensionality reduction shows that the four strongest components of neural activity are functionally interpretable, reflecting a state transition between deliberation and commitment, the transformation of sensory evidence into a choice, and the baseline and slope of the rising urgency to decide. Analysis of the contribution of each population to these components shows meaningful differences between regions but no distinct clusters within each region, consistent with an integrated dynamical system. During deliberation, cortical activity unfolds on a two-dimensional "decision manifold" defined by sensory evidence and urgency and falls off this manifold at the moment of commitment into a choice-dependent trajectory leading to movement initiation. The structure of the manifold varies between regions: In PMd, it is curved; in M1, it is nearly perfectly flat; and in dlPFC, it is almost entirely confined to the sensory evidence dimension. In contrast, pallidal activity during deliberation is primarily defined by urgency. We suggest that these findings reveal the distinct functional contributions of different brain regions to an integrated dynamical system governing action selection and execution.
Collapse
Affiliation(s)
- David Thura
- Groupe de recherche sur la signalisation neurale et la circuiterie, Department of Neuroscience, Université de Montréal, Montréal, Québec, Canada
| | - Jean-François Cabana
- Groupe de recherche sur la signalisation neurale et la circuiterie, Department of Neuroscience, Université de Montréal, Montréal, Québec, Canada
| | - Albert Feghaly
- Groupe de recherche sur la signalisation neurale et la circuiterie, Department of Neuroscience, Université de Montréal, Montréal, Québec, Canada
| | - Paul Cisek
- Groupe de recherche sur la signalisation neurale et la circuiterie, Department of Neuroscience, Université de Montréal, Montréal, Québec, Canada
- * E-mail:
| |
Collapse
|
15
|
Allocation of Visuospatial Attention Indexes Evidence Accumulation for Reach Decisions. eNeuro 2022; 9:ENEURO.0313-22.2022. [PMID: 36302633 PMCID: PMC9651207 DOI: 10.1523/eneuro.0313-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 12/24/2022] Open
Abstract
Visuospatial attention is a prerequisite for the performance of visually guided movements: perceptual discrimination is regularly enhanced at target locations before movement initiation. It is known that this attentional prioritization evolves over the time of movement preparation; however, it is not clear whether this build-up simply reflects a time requirement of attention formation or whether, instead, attention build-up reflects the emergence of the movement decision. To address this question, we combined behavioral experiments, psychophysics, and computational decision-making models to characterize the time course of attention build-up during motor preparation. Participants (n = 46, 29 female) executed center-out reaches to one of two potential target locations and reported the identity of a visual discrimination target (DT) that occurred concurrently at one of various time-points during movement preparation and execution. Visual discrimination increased simultaneously at the two potential target locations but was modulated by the experiment-wide probability that a given location would become the final goal. Attention increased further for the location that was then designated as the final goal location, with a time course closely related to movement initiation. A sequential sampling model of decision-making faithfully predicted key temporal characteristics of attentional allocation. Together, these findings provide evidence that visuospatial attentional prioritization during motor preparation does not simply reflect that a spatial location has been selected as movement goal, but rather indexes the time-extended, cumulative decision that leads to the selection, hence constituting a link between perceptual and motor aspects of sensorimotor decisions.
Collapse
|
16
|
Hadjidimitrakis K, De Vitis M, Ghodrati M, Filippini M, Fattori P. Anterior-posterior gradient in the integrated processing of forelimb movement direction and distance in macaque parietal cortex. Cell Rep 2022; 41:111608. [DOI: 10.1016/j.celrep.2022.111608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 07/16/2022] [Accepted: 10/14/2022] [Indexed: 11/09/2022] Open
|
17
|
So N, Shadlen MN. Decision formation in parietal cortex transcends a fixed frame of reference. Neuron 2022; 110:3206-3215.e5. [PMID: 35998631 PMCID: PMC9639165 DOI: 10.1016/j.neuron.2022.07.019] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/29/2022] [Accepted: 07/18/2022] [Indexed: 11/17/2022]
Abstract
Neurons in the lateral intraparietal cortex represent the formation of a decision when it is linked to a specific action, such as an eye movement to a choice target. However, these neurons should be unable to represent a decision that transpires across actions that would disrupt this linkage. We investigated this limitation by simultaneously recording many neurons from two rhesus monkeys. Although intervening actions disrupt the representation by single neurons, the ensemble achieves continuity of the decision process by passing information from currently active neurons to neurons that will become active after the action. In this way, the representation of an evolving decision can be generalized across actions and transcends the frame of reference that specifies the neural response fields. The finding extends previous observations of receptive field remapping, thought to support the stability of perception across eye movements, to the continuity of a thought process, such as a decision.
Collapse
Affiliation(s)
- NaYoung So
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA; Howard Hughes Medical Institute, Columbia University, New York, NY 10027, USA.
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY 10027, USA; Howard Hughes Medical Institute, Columbia University, New York, NY 10027, USA; Kavli Institute, Columbia University, New York, NY 10027, USA.
| |
Collapse
|
18
|
Vaccari FE, Diomedi S, Filippini M, Hadjidimitrakis K, Fattori P. New insights on single-neuron selectivity in the era of population-level approaches. Front Integr Neurosci 2022; 16:929052. [PMID: 36249900 PMCID: PMC9554653 DOI: 10.3389/fnint.2022.929052] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 09/02/2022] [Indexed: 11/13/2022] Open
Abstract
In the past, neuroscience was focused on individual neurons seen as the functional units of the nervous system, but this approach fell short over time to account for new experimental evidence, especially for what concerns associative and motor cortices. For this reason and thanks to great technological advances, a part of modern research has shifted the focus from the responses of single neurons to the activity of neural ensembles, now considered the real functional units of the system. However, on a microscale, individual neurons remain the computational components of these networks, thus the study of population dynamics cannot prescind from studying also individual neurons which represent their natural substrate. In this new framework, ideas such as the capability of single cells to encode a specific stimulus (neural selectivity) may become obsolete and need to be profoundly revised. One step in this direction was made by introducing the concept of “mixed selectivity,” the capacity of single cells to integrate multiple variables in a flexible way, allowing individual neurons to participate in different networks. In this review, we outline the most important features of mixed selectivity and we also present recent works demonstrating its presence in the associative areas of the posterior parietal cortex. Finally, in discussing these findings, we present some open questions that could be addressed by future studies.
Collapse
Affiliation(s)
| | - Stefano Diomedi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Matteo Filippini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna, Italy
- *Correspondence: Patrizia Fattori
| | | | - Patrizia Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna, Italy
- Matteo Filippini
| |
Collapse
|
19
|
Umakantha A, Purcell BA, Palmeri TJ. Relating a Spiking Neural Network Model and the Diffusion Model of Decision-Making. COMPUTATIONAL BRAIN & BEHAVIOR 2022; 5:279-301. [PMID: 36408474 PMCID: PMC9673774 DOI: 10.1007/s42113-022-00143-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/26/2022] [Indexed: 06/16/2023]
Abstract
Many models of decision making assume accumulation of evidence to threshold as a core mechanism to predict response probabilities and response times. A spiking neural network model (Wang, 2002) instantiates these mechanisms at the level of biophysically-plausible pools of neurons with excitatory and inhibitory connections, and has numerous model parameters tuned by physiological measures. The diffusion model (Ratcliff, 1978) is a cognitive model that can be fitted to a range of behaviors and conditions. We investigated how parameters of the cognitive-level diffusion model relate to the parameters of a neural-level spiking model. In each simulated "experiment", we generated "data" from the spiking neural network by factorially combining a manipulation of choice difficulty (via the input to the spiking model) and a manipulation of one of the core parameters of the spiking model. We then fitted the diffusion model to these simulated data to observe how manipulation of each core spiking model parameter mapped on to fitted drift rate, response threshold, and non-decision time. Manipulations of parameters in the spiking model related to input sensitivity, threshold, and stimulus processing time mapped on to their conceptual analogues in the diffusion model, namely drift rate, threshold, and non-decision time. Manipulations of parameters in the spiking model with no direct analogue to the diffusion model, non-stimulus-specific background input, strength of recurrent excitation, and receptor conductances, mapped on to threshold in the diffusion model. We discuss implications of these results for interpretations of fits of the diffusion model to behavioral data.
Collapse
Affiliation(s)
- Akash Umakantha
- Neuroscience Institute, Carnegie Mellon University
- Machine Learning Department, Carnegie Mellon University
| | | | - Thomas J. Palmeri
- Psychology Department, Vanderbilt University
- Vanderbilt Vision Research Center, Vanderbilt University
| |
Collapse
|
20
|
Seideman JA, Stanford TR, Salinas E. A conflict between spatial selection and evidence accumulation in area LIP. Nat Commun 2022; 13:4463. [PMID: 35915096 PMCID: PMC9343639 DOI: 10.1038/s41467-022-32209-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 07/20/2022] [Indexed: 11/09/2022] Open
Abstract
The lateral intraparietal area (LIP) contains spatially selective neurons that help guide eye movements and, according to numerous studies, do so by accumulating sensory evidence in favor of one choice (e.g., look left) or another (look right). To examine this functional link, we trained two monkeys on an urgent motion discrimination task, a task with which the evolution of both the recorded neuronal activity and the subject's choice can be tracked millisecond by millisecond. We found that while choice accuracy increased steeply with increasing sensory evidence, at the same time, the LIP selection signal became progressively weaker, as if it hindered performance. This effect was consistent with the transient deployment of spatial attention to disparate locations away from the relevant sensory cue. The results demonstrate that spatial selection in LIP is dissociable from, and may even conflict with, evidence accumulation during informed saccadic choices.
Collapse
Affiliation(s)
- Joshua A Seideman
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC, 27157-1010, USA
| | - Terrence R Stanford
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC, 27157-1010, USA
| | - Emilio Salinas
- Department of Neurobiology and Anatomy, Wake Forest School of Medicine, 1 Medical Center Blvd., Winston-Salem, NC, 27157-1010, USA.
| |
Collapse
|
21
|
Alefantis P, Lakshminarasimhan K, Avila E, Noel JP, Pitkow X, Angelaki DE. Sensory Evidence Accumulation Using Optic Flow in a Naturalistic Navigation Task. J Neurosci 2022; 42:5451-5462. [PMID: 35641186 PMCID: PMC9270913 DOI: 10.1523/jneurosci.2203-21.2022] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 04/01/2022] [Accepted: 04/22/2022] [Indexed: 11/21/2022] Open
Abstract
Sensory evidence accumulation is considered a hallmark of decision-making in noisy environments. Integration of sensory inputs has been traditionally studied using passive stimuli, segregating perception from action. Lessons learned from this approach, however, may not generalize to ethological behaviors like navigation, where there is an active interplay between perception and action. We designed a sensory-based sequential decision task in virtual reality in which humans and monkeys navigated to a memorized location by integrating optic flow generated by their own joystick movements. A major challenge in such closed-loop tasks is that subjects' actions will determine future sensory input, causing ambiguity about whether they rely on sensory input rather than expectations based solely on a learned model of the dynamics. To test whether subjects integrated optic flow over time, we used three independent experimental manipulations, unpredictable optic flow perturbations, which pushed subjects off their trajectory; gain manipulation of the joystick controller, which changed the consequences of actions; and manipulation of the optic flow density, which changed the information borne by sensory evidence. Our results suggest that both macaques (male) and humans (female/male) relied heavily on optic flow, thereby demonstrating a critical role for sensory evidence accumulation during naturalistic action-perception closed-loop tasks.SIGNIFICANCE STATEMENT The temporal integration of evidence is a fundamental component of mammalian intelligence. Yet, it has traditionally been studied using experimental paradigms that fail to capture the closed-loop interaction between actions and sensations inherent in real-world continuous behaviors. These conventional paradigms use binary decision tasks and passive stimuli with statistics that remain stationary over time. Instead, we developed a naturalistic visuomotor visual navigation paradigm that mimics the causal structure of real-world sensorimotor interactions and probed the extent to which participants integrate sensory evidence by adding task manipulations that reveal complementary aspects of the computation.
Collapse
Affiliation(s)
- Panos Alefantis
- Center for Neural Science, New York University, New York, New York 10003
| | | | - Eric Avila
- Center for Neural Science, New York University, New York, New York 10003
| | - Jean-Paul Noel
- Center for Neural Science, New York University, New York, New York 10003
| | - Xaq Pitkow
- Department of Neuroscience, Baylor College of Medicine, Houston, Texas 77030
- Department of Electrical and Computer Engineering, Rice University, Houston, Texas 77005-1892
- Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, Texas 77030
| | - Dora E Angelaki
- Center for Neural Science, New York University, New York, New York 10003
- Tandon School of Engineering, New York University, New York, New York 11201
| |
Collapse
|
22
|
Identifying control ensembles for information processing within the cortico-basal ganglia-thalamic circuit. PLoS Comput Biol 2022; 18:e1010255. [PMID: 35737720 PMCID: PMC9258830 DOI: 10.1371/journal.pcbi.1010255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Revised: 07/06/2022] [Accepted: 05/27/2022] [Indexed: 11/20/2022] Open
Abstract
In situations featuring uncertainty about action-reward contingencies, mammals can flexibly adopt strategies for decision-making that are tuned in response to environmental changes. Although the cortico-basal ganglia thalamic (CBGT) network has been identified as contributing to the decision-making process, it features a complex synaptic architecture, comprised of multiple feed-forward, reciprocal, and feedback pathways, that complicate efforts to elucidate the roles of specific CBGT populations in the process by which evidence is accumulated and influences behavior. In this paper we apply a strategic sampling approach, based on Latin hypercube sampling, to explore how variations in CBGT network properties, including subpopulation firing rates and synaptic weights, map to variability of parameters in a normative drift diffusion model (DDM), representing algorithmic aspects of information processing during decision-making. Through the application of canonical correlation analysis, we find that this relationship can be characterized in terms of three low-dimensional control ensembles within the CBGT network that impact specific qualities of the emergent decision policy: responsiveness (a measure of how quickly evidence evaluation gets underway, associated with overall activity in corticothalamic and direct pathways), pliancy (a measure of the standard of evidence needed to commit to a decision, associated largely with overall activity in components of the indirect pathway of the basal ganglia), and choice (a measure of commitment toward one available option, associated with differences in direct and indirect pathways across action channels). These analyses provide mechanistic predictions about the roles of specific CBGT network elements in tuning the way that information is accumulated and translated into decision-related behavior.
Collapse
|
23
|
Shushruth S, Zylberberg A, Shadlen MN. Sequential sampling from memory underlies action selection during abstract decision-making. Curr Biol 2022; 32:1949-1960.e5. [PMID: 35354066 PMCID: PMC9090972 DOI: 10.1016/j.cub.2022.03.014] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 03/02/2022] [Accepted: 03/03/2022] [Indexed: 12/17/2022]
Abstract
The study of perceptual decision-making in monkeys has provided insights into the process by which sensory evidence is integrated toward a decision. When monkeys make decisions with the knowledge of the motor actions the decisions bear upon, the process of evidence integration is instantiated by neurons involved in the selection of said actions. It is less clear how monkeys make decisions when unaware of the actions required to communicate their choice-what we refer to as "abstract" decisions. We investigated this by training monkeys to associate the direction of motion of a noisy random-dot display with the color of two targets. Crucially, the targets were displayed at unpredictable locations after the motion stimulus was extinguished. We found that the monkeys postponed decision formation until the targets were revealed. Neurons in the parietal association area LIP represented the integration of evidence leading to a choice, but as the stimulus was no longer visible, the samples of evidence must have been retrieved from short-term memory. Our results imply that when decisions are temporally unyoked from the motor actions they bear upon, decision formation is protracted until they can be framed in terms of motor actions.
Collapse
Affiliation(s)
- S Shushruth
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA; Howard Hughes Medical Institute, New York, NY 10027, USA; Kavli Institute, Columbia University, 612 West 130th Street, New York, NY 10027, USA.
| |
Collapse
|
24
|
A leaky evidence accumulation process for perceptual experience. Trends Cogn Sci 2022; 26:451-461. [DOI: 10.1016/j.tics.2022.03.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 03/08/2022] [Accepted: 03/09/2022] [Indexed: 11/23/2022]
|
25
|
Manning C, Hassall CD, Hunt LT, Norcia AM, Wagenmakers EJ, Snowling MJ, Scerif G, Evans NJ. Visual Motion and Decision-Making in Dyslexia: Reduced Accumulation of Sensory Evidence and Related Neural Dynamics. J Neurosci 2022; 42:121-134. [PMID: 34782439 PMCID: PMC8741156 DOI: 10.1523/jneurosci.1232-21.2021] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 09/15/2021] [Accepted: 09/20/2021] [Indexed: 11/21/2022] Open
Abstract
Children with and without dyslexia differ in their behavioral responses to visual information, particularly when required to pool dynamic signals over space and time. Importantly, multiple processes contribute to behavioral responses. Here we investigated which processing stages are affected in children with dyslexia when performing visual motion processing tasks, by combining two methods that are sensitive to the dynamic processes leading to responses. We used a diffusion model which decomposes response time and accuracy into distinct cognitive constructs, and high-density EEG. Fifty children with dyslexia (24 male) and 50 typically developing children (28 male) 6-14 years of age judged the direction of motion as quickly and accurately as possible in two global motion tasks (motion coherence and direction integration), which varied in their requirements for noise exclusion. Following our preregistered analyses, we fitted hierarchical Bayesian diffusion models to the data, blinded to group membership. Unblinding revealed reduced evidence accumulation in children with dyslexia compared with typical children for both tasks. Additionally, we identified a response-locked EEG component which was maximal over centro-parietal electrodes which indicated a neural correlate of reduced drift rate in dyslexia in the motion coherence task, thereby linking brain and behavior. We suggest that children with dyslexia tend to be slower to extract sensory evidence from global motion displays, regardless of whether noise exclusion is required, thus furthering our understanding of atypical perceptual decision-making processes in dyslexia.SIGNIFICANCE STATEMENT Reduced sensitivity to visual information has been reported in dyslexia, with a lively debate about whether these differences causally contribute to reading difficulties. In this large preregistered study with a blind modeling approach, we combine state-of-the art methods in both computational modeling and EEG analysis to pinpoint the stages of processing that are atypical in children with dyslexia in two visual motion tasks that vary in their requirement for noise exclusion. We find reduced evidence accumulation in children with dyslexia across both tasks, and identify a neural marker, allowing us to link brain and behavior. We show that children with dyslexia exhibit general difficulties with extracting sensory evidence from global motion displays, not just in tasks that require noise exclusion.
Collapse
Affiliation(s)
- Catherine Manning
- Department of Experimental Psychology, University of Oxford, Oxford, Oxfordshire, United Kingdom, OX2 6GG
- School of Psychology and Clinical Language Sciences, University of Reading, Reading, Berkshire, United Kingdom, RG6 6ES
| | - Cameron D Hassall
- Department of Psychiatry, University of Oxford, Oxford, Oxfordshire, United Kingdom, OX3 7JX
| | - Laurence T Hunt
- Department of Psychiatry, University of Oxford, Oxford, Oxfordshire, United Kingdom, OX3 7JX
| | - Anthony M Norcia
- Department of Psychology, Stanford University, Stanford, CA 94305, US
| | - Eric-Jan Wagenmakers
- Faculty of Social and Behavioural Sciences, University of Amsterdam, 1001 NH Amsterdam, The Netherlands
| | - Margaret J Snowling
- Department of Experimental Psychology, University of Oxford, Oxford, Oxfordshire, United Kingdom, OX2 6GG
| | - Gaia Scerif
- Department of Experimental Psychology, University of Oxford, Oxford, Oxfordshire, United Kingdom, OX2 6GG
| | - Nathan J Evans
- School of Psychology, University of Queensland, Brisbane, QLD 4072 Australia
| |
Collapse
|
26
|
Scott JT, Bourne JA. Modelling behaviors relevant to brain disorders in the nonhuman primate: Are we there yet? Prog Neurobiol 2021; 208:102183. [PMID: 34728308 DOI: 10.1016/j.pneurobio.2021.102183] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 10/27/2021] [Accepted: 10/27/2021] [Indexed: 12/30/2022]
Abstract
Recent years have seen a profound resurgence of activity with nonhuman primates (NHPs) to model human brain disorders. From marmosets to macaques, the study of NHP species offers a unique window into the function of primate-specific neural circuits that are impossible to examine in other models. Examining how these circuits manifest into the complex behaviors of primates, such as advanced cognitive and social functions, has provided enormous insights to date into the mechanisms underlying symptoms of numerous neurological and neuropsychiatric illnesses. With the recent optimization of modern techniques to manipulate and measure neural activity in vivo, such as optogenetics and calcium imaging, NHP research is more well-equipped than ever to probe the neural mechanisms underlying pathological behavior. However, methods for behavioral experimentation and analysis in NHPs have noticeably failed to keep pace with these advances. As behavior ultimately lies at the junction between preclinical findings and its translation to clinical outcomes for brain disorders, approaches to improve the integrity, reproducibility, and translatability of behavioral experiments in NHPs requires critical evaluation. In this review, we provide a unifying account of existing brain disorder models using NHPs, and provide insights into the present and emerging contributions of behavioral studies to the field.
Collapse
Affiliation(s)
- Jack T Scott
- Australian Regenerative Medicine Institute, Monash University, Clayton, VIC, Australia
| | - James A Bourne
- Australian Regenerative Medicine Institute, Monash University, Clayton, VIC, Australia.
| |
Collapse
|
27
|
Schreiner DC, Yalcinbas EA, Gremel CM. A Push For Examining Subjective Experience in Value-Based Decision-Making. Curr Opin Behav Sci 2021; 41:45-49. [PMID: 34056054 PMCID: PMC8153361 DOI: 10.1016/j.cobeha.2021.03.020] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Subjective experience is a powerful contributor to value-based decision-making. Not every decision is the same, nor made in isolation. Rather, decision-making relies on historical information and internal states for adaptive control. Hence, it is inherently continuous with respect to time - one decision or action evolves into the next. However, forays into the neurobiological underpinnings of decision-making have too frequently ignored the contribution of such continuous subjective experience, instead tying circuit activity and brain area involvement to discrete averaged behaviors and task parameters. While much information has been gained through these investigations, recent works have demonstrated the potential for a greater understanding of neural mechanisms when the continuous, experiential nature of behavior is integrated into the investigation. Such integration has important implications for disease states with disordered decision-making such as addiction, where subjective experience is a large contributor to the disorder.
Collapse
Affiliation(s)
- Drew C. Schreiner
- The Department of Psychology, University of California San Diego, La Jolla, CA 92093, USA
| | - Ege A. Yalcinbas
- The Neurosciences Graduate Program, University of California San Diego, La Jolla, CA 92093, USA
| | - Christina M. Gremel
- The Department of Psychology, University of California San Diego, La Jolla, CA 92093, USA
- The Neurosciences Graduate Program, University of California San Diego, La Jolla, CA 92093, USA
| |
Collapse
|
28
|
Zhou Y, Rosen MC, Swaminathan SK, Masse NY, Zhu O, Freedman DJ. Distributed functions of prefrontal and parietal cortices during sequential categorical decisions. eLife 2021; 10:e58782. [PMID: 34491201 PMCID: PMC8423442 DOI: 10.7554/elife.58782] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Accepted: 07/13/2021] [Indexed: 12/19/2022] Open
Abstract
Comparing sequential stimuli is crucial for guiding complex behaviors. To understand mechanisms underlying sequential decisions, we compared neuronal responses in the prefrontal cortex (PFC), the lateral intraparietal (LIP), and medial intraparietal (MIP) areas in monkeys trained to decide whether sequentially presented stimuli were from matching (M) or nonmatching (NM) categories. We found that PFC leads M/NM decisions, whereas LIP and MIP appear more involved in stimulus evaluation and motor planning, respectively. Compared to LIP, PFC showed greater nonlinear integration of currently visible and remembered stimuli, which correlated with the monkeys' M/NM decisions. Furthermore, multi-module recurrent networks trained on the same task exhibited key features of PFC and LIP encoding, including nonlinear integration in the PFC-like module, which was causally involved in the networks' decisions. Network analysis found that nonlinear units have stronger and more widespread connections with input, output, and within-area units, indicating putative circuit-level mechanisms for sequential decisions.
Collapse
Affiliation(s)
- Yang Zhou
- Department of Neurobiology, The University of ChicagoChicagoUnited States
- School of Psychological and Cognitive Sciences, PKU-IDG/McGovern Institute for Brain Research, Peking-Tsinghua Center for Life Sciences, Peking UniversityBeijingChina
| | - Matthew C Rosen
- Department of Neurobiology, The University of ChicagoChicagoUnited States
| | | | - Nicolas Y Masse
- Department of Neurobiology, The University of ChicagoChicagoUnited States
| | - Ou Zhu
- Department of Neurobiology, The University of ChicagoChicagoUnited States
| | - David J Freedman
- Department of Neurobiology, The University of ChicagoChicagoUnited States
- Neuroscience Institute, The University of ChicagoChicagoUnited States
| |
Collapse
|
29
|
Jun EJ, Bautista AR, Nunez MD, Allen DC, Tak JH, Alvarez E, Basso MA. Causal role for the primate superior colliculus in the computation of evidence for perceptual decisions. Nat Neurosci 2021; 24:1121-1131. [PMID: 34183869 PMCID: PMC8338902 DOI: 10.1038/s41593-021-00878-6] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Accepted: 05/21/2021] [Indexed: 02/05/2023]
Abstract
Trained monkeys performed a two-choice perceptual decision-making task in which they reported the perceived orientation of a dynamic Glass pattern, before and after unilateral, reversible, inactivation of a brainstem area-the superior colliculus (SC)-involved in preparing eye movements. We found that unilateral SC inactivation produced significant decision biases and changes in reaction times consistent with a causal role for the primate SC in perceptual decision-making. Fitting signal detection theory and sequential sampling models to the data showed that SC inactivation produced a decrease in the relative evidence for contralateral decisions, as if adding a constant offset to a time-varying evidence signal for the ipsilateral choice. The results provide causal evidence for an embodied cognition model of perceptual decision-making and provide compelling evidence that the SC of primates (a brainstem structure) plays a causal role in how evidence is computed for decisions-a process usually attributed to the forebrain.
Collapse
|
30
|
Okazawa G, Hatch CE, Mancoo A, Machens CK, Kiani R. Representational geometry of perceptual decisions in the monkey parietal cortex. Cell 2021; 184:3748-3761.e18. [PMID: 34171308 PMCID: PMC8273140 DOI: 10.1016/j.cell.2021.05.022] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 12/23/2020] [Accepted: 05/17/2021] [Indexed: 11/22/2022]
Abstract
Lateral intraparietal (LIP) neurons represent formation of perceptual decisions involving eye movements. In circuit models for these decisions, neural ensembles that encode actions compete to form decisions. Consequently, representation and readout of the decision variables (DVs) are implemented similarly for decisions with identical competing actions, irrespective of input and task context differences. Further, DVs are encoded as partially potentiated action plans through balance of activity of action-selective ensembles. Here, we test those core principles. We show that in a novel face-discrimination task, LIP firing rates decrease with supporting evidence, contrary to conventional motion-discrimination tasks. These opposite response patterns arise from similar mechanisms in which decisions form along curved population-response manifolds misaligned with action representations. These manifolds rotate in state space based on context, indicating distinct optimal readouts for different tasks. We show similar manifolds in lateral and medial prefrontal cortices, suggesting similar representational geometry across decision-making circuits.
Collapse
Affiliation(s)
- Gouki Okazawa
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Christina E Hatch
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Allan Mancoo
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - Christian K Machens
- Champalimaud Research, Champalimaud Centre for the Unknown, 1400-038 Lisbon, Portugal
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, New York, NY 10016, USA; Department of Psychology, New York University, New York, NY 10003, USA.
| |
Collapse
|
31
|
Ramirez AD, Aksay ERF. Ramp-to-threshold dynamics in a hindbrain population controls the timing of spontaneous saccades. Nat Commun 2021; 12:4145. [PMID: 34230474 PMCID: PMC8260785 DOI: 10.1038/s41467-021-24336-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 06/11/2021] [Indexed: 02/06/2023] Open
Abstract
Organisms have the capacity to make decisions based solely on internal drives. However, it is unclear how neural circuits form decisions in the absence of sensory stimuli. Here we provide a comprehensive map of the activity patterns underlying the generation of saccades made in the absence of visual stimuli. We perform calcium imaging in the larval zebrafish to discover a range of responses surrounding spontaneous saccades, from cells that display tonic discharge only during fixations to neurons whose activity rises in advance of saccades by multiple seconds. When we lesion cells in these populations we find that ablation of neurons with pre-saccadic rise delays saccade initiation. We analyze spontaneous saccade initiation using a ramp-to-threshold model and are able to predict the times of upcoming saccades using pre-saccadic activity. These findings suggest that ramping of neuronal activity to a bound is a critical component of self-initiated saccadic movements.
Collapse
Affiliation(s)
- Alexandro D Ramirez
- Institute for Computational Biomedicine and the Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA.
| | - Emre R F Aksay
- Institute for Computational Biomedicine and the Department of Physiology and Biophysics, Weill Cornell Medicine, New York, NY, USA
| |
Collapse
|
32
|
Stanford TR, Salinas E. Urgent Decision Making: Resolving Visuomotor Interactions at High Temporal Resolution. Annu Rev Vis Sci 2021; 7:323-348. [PMID: 34171199 DOI: 10.1146/annurev-vision-100419-103842] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Measuring when exactly perceptual decisions are made is crucial for defining how the activation of specific neurons contributes to behavior. However, in traditional, nonurgent visuomotor tasks, the uncertainty of this temporal measurement is very large. This is a problem not only for delimiting the capacity of perception, but also for correctly interpreting the functional roles ascribed to choice-related neuronal responses. In this article, we review psychophysical, neurophysiological, and modeling work based on urgent visuomotor tasks in which this temporal uncertainty can be effectively overcome. The cornerstone of this work is a novel behavioral metric that describes the evolution of the subject's perceptual judgment moment by moment, allowing us to resolve numerous perceptual events that unfold within a few tens of milliseconds. In this framework, the neural distinction between perceptual evaluation and motor selection processes becomes particularly clear, as the conclusion of one is not contingent on that of the other. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Terrence R Stanford
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, North Carolina 27157, USA; ,
| | - Emilio Salinas
- Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, North Carolina 27157, USA; ,
| |
Collapse
|
33
|
Abstract
Visual perceptual learning (VPL) is an improvement in visual function following training. Although the practical utility of VPL was once thought to be limited by its specificity to the precise stimuli used during training, more recent work has shown that such specificity can be overcome with appropriate training protocols. In contrast, relatively little is known about the extent to which VPL exhibits motor specificity. Previous studies have yielded mixed results. In this work, we have examined the effector specificity of VPL by training observers on a motion discrimination task that maintains the same visual stimulus (drifting grating) and task structure, but that requires different effectors to indicate the response (saccade vs. button press). We find that, in these conditions, VPL transfers fully between a manual and an oculomotor response. These results are consistent with the idea that VPL entails the learning of a decision rule that can generalize across effectors.
Collapse
Affiliation(s)
- Asmara Awada
- Department of Neurology and Neurosurgery, McGill University, Montreal, Canada.,
| | - Shahab Bakhtiari
- Department of Computer Science, McGill University, Montreal, Canada.,
| | - Christopher C Pack
- Department of Neurology and Neurosurgery, McGill University, Montreal, Canada.,
| |
Collapse
|
34
|
Abstract
The discovery of neural signals that reflect the dynamics of perceptual decision formation has had a considerable impact. Not only do such signals enable detailed investigations of the neural implementation of the decision-making process but they also can expose key elements of the brain's decision algorithms. For a long time, such signals were only accessible through direct animal brain recordings, and progress in human neuroscience was hampered by the limitations of noninvasive recording techniques. However, recent methodological advances are increasingly enabling the study of human brain signals that finely trace the dynamics of the unfolding decision process. In this review, we highlight how human neurophysiological data are now being leveraged to furnish new insights into the multiple processing levels involved in forming decisions, to inform the construction and evaluation of mathematical models that can explain intra- and interindividual differences, and to examine how key ancillary processes interact with core decision circuits.
Collapse
Affiliation(s)
- Redmond G O'Connell
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, Dublin 2, Ireland;
| | - Simon P Kelly
- School of Electrical and Electronic Engineering and UCD Centre for Biomedical Engineering, University College Dublin, Belfield, Dublin 4, Ireland;
| |
Collapse
|
35
|
Basso MA, Bickford ME, Cang J. Unraveling circuits of visual perception and cognition through the superior colliculus. Neuron 2021; 109:918-937. [PMID: 33548173 PMCID: PMC7979487 DOI: 10.1016/j.neuron.2021.01.013] [Citation(s) in RCA: 79] [Impact Index Per Article: 26.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Revised: 12/29/2020] [Accepted: 01/13/2021] [Indexed: 12/11/2022]
Abstract
The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.
Collapse
Affiliation(s)
- Michele A Basso
- Fuster Laboratory of Cognitive Neuroscience, Department of Psychiatry and Biobehavioral Sciences, Jane and Terry Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, USA.
| | | | - Jianhua Cang
- University of Virginia, Charlottesville, VA, USA
| |
Collapse
|
36
|
Kang YH, Löffler A, Jeurissen D, Zylberberg A, Wolpert DM, Shadlen MN. Multiple decisions about one object involve parallel sensory acquisition but time-multiplexed evidence incorporation. eLife 2021; 10:63721. [PMID: 33688829 PMCID: PMC8112870 DOI: 10.7554/elife.63721] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2020] [Accepted: 03/06/2021] [Indexed: 01/31/2023] Open
Abstract
The brain is capable of processing several streams of information that bear on different aspects of the same problem. Here, we address the problem of making two decisions about one object, by studying difficult perceptual decisions about the color and motion of a dynamic random dot display. We find that the accuracy of one decision is unaffected by the difficulty of the other decision. However, the response times reveal that the two decisions do not form simultaneously. We show that both stimulus dimensions are acquired in parallel for the initial ∼0.1 s but are then incorporated serially in time-multiplexed bouts. Thus, there is a bottleneck that precludes updating more than one decision at a time, and a buffer that stores samples of evidence while access to the decision is blocked. We suggest that this bottleneck is responsible for the long timescales of many cognitive operations framed as decisions.
Collapse
Affiliation(s)
- Yul Hr Kang
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Anne Löffler
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States
| | - Danique Jeurissen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| |
Collapse
|
37
|
Variable Statistical Structure of Neuronal Spike Trains in Monkey Superior Colliculus. J Neurosci 2021; 41:3234-3253. [PMID: 33622775 DOI: 10.1523/jneurosci.1491-20.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 01/27/2021] [Accepted: 01/28/2021] [Indexed: 12/22/2022] Open
Abstract
Popular models of decision-making propose that noisy sensory evidence accumulates until reaching a bound. Behavioral evidence as well as trial-averaged ramping of neuronal activity in sensorimotor regions of the brain support this idea. However, averaging activity across trials can mask other processes, such as rapid shifts in decision commitment, calling into question the hypothesis that evidence accumulation is encoded by delay period activity of individual neurons. We mined two sets of data from experiments in four monkeys in which we recorded from superior colliculus neurons during two different decision-making tasks and a delayed saccade task. We applied second-order statistical measures and spike train simulations to determine whether spiking statistics were similar or different in the different tasks and monkeys, despite similar trial-averaged activity across tasks and monkeys. During a motion direction discrimination task, single-trial delay period activity behaved statistically consistent with accumulation. During an orientation detection task, the activity behaved superficially like accumulation, but statistically consistent with stepping. Simulations confirmed both findings. Importantly, during a simple saccade task, with similar trial-averaged activity, neither process explained spiking activity, ruling out interpretations based on differences in attention, reward, or motor planning. These results highlight the need for exploring single-trial spiking dynamics to understand cognitive processing and raise the interesting hypothesis that the superior colliculus participates in different aspects of decision-making depending on task differences.SIGNIFICANCE STATEMENT How are decisions based on sensory information transformed into actions? We report that single-trial neuronal activity dynamics in the superior colliculus of monkeys show differences in decision-making tasks depending on task idiosyncrasies and requirements and despite similar trial-averaged ramping activity. These results highlight the importance of exploring single-trial spiking dynamics to understand cognitive processing and raise the interesting hypothesis that the superior colliculus participates in different aspects of decision-making depending on task requirements.
Collapse
|
38
|
Parés-Pujolràs E, Travers E, Ahmetoglu Y, Haggard P. Evidence accumulation under uncertainty - a neural marker of emerging choice and urgency. Neuroimage 2021; 232:117863. [PMID: 33617993 DOI: 10.1016/j.neuroimage.2021.117863] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 02/01/2021] [Accepted: 02/09/2021] [Indexed: 12/26/2022] Open
Abstract
To interact meaningfully with its environment, an agent must integrate external information with its own internal states. However, information about the environment is often noisy. In this study, we identify a neural correlate that tracks how asymmetries between competing alternatives evolve over the course of a decision. In our task participants had to monitor a stream of discrete visual stimuli over time and decide whether or not to act, on the basis of either strong or ambiguous evidence. We found that the classic P3 event-related potential evoked by sequential evidence items tracked decision-making processes and predicted participants' categorical choices on a single trial level, both when evidence was strong and when it was ambiguous. The P3 amplitudes in response to evidence supporting the eventually selected option increased over trial time as decisions evolved, being maximally different from the P3 amplitudes evoked by competing evidence at the time of decision. Computational modelling showed that both the neural dynamics and behavioural primacy and recency effects can be explained by a combination of (a) competition between mutually inhibiting accumulators for the two categorical choice outcomes, and (b) a context-dependant urgency signal. In conditions where evidence was presented at a low rate, urgency increased faster than in conditions when evidence was very frequent. We also found that the readiness potential, a classic marker of endogenously initiated actions, was observed preceding movements in all conditions - even when those were strongly driven by external evidence.
Collapse
Affiliation(s)
| | - Eoin Travers
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| | - Yoana Ahmetoglu
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| |
Collapse
|
39
|
Espinoza-Monroy M, de Lafuente V. Discrimination of Regular and Irregular Rhythms Explained by a Time Difference Accumulation Model. Neuroscience 2021; 459:16-26. [PMID: 33549694 DOI: 10.1016/j.neuroscience.2021.01.035] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Revised: 01/20/2021] [Accepted: 01/28/2021] [Indexed: 02/07/2023]
Abstract
Perceiving the temporal regularity in a sequence of repetitive sensory events facilitates the preparation and execution of relevant behaviors with tight temporal constraints. How we estimate temporal regularity from repeating patterns of sensory stimuli is not completely understood. We developed a decision-making task in which participants had to decide whether a train of visual, auditory, or tactile pulses, had a regular or an irregular temporal pattern. We tested the hypothesis that subjects categorize stimuli as irregular by accumulating the time differences between the predicted and observed times of sensory pulses defining a temporal rhythm. Results suggest that instead of waiting for a single large temporal deviation, participants accumulate timing-error signals and judge a pattern as irregular when the amount of evidence reaches a decision threshold. Model fits of bounded integration showed that this accumulation occurs with negligible leak of evidence. Consistent with previous findings, we show that participants perform better when evaluating the regularity of auditory pulses, as compared with visual or tactile stimuli. Our results suggest that temporal regularity is estimated by comparing expected and measured pulse onset times, and that each prediction error is accumulated towards a threshold to generate a behavioral choice.
Collapse
Affiliation(s)
- Marisol Espinoza-Monroy
- Instituto de Neurobiología, Universidad Nacional Autónoma de México, Querétaro, QRO 76230, Mexico
| | - Victor de Lafuente
- Instituto de Neurobiología, Universidad Nacional Autónoma de México, Querétaro, QRO 76230, Mexico.
| |
Collapse
|
40
|
Mohan K, Zhu O, Freedman DJ. Interaction between neuronal encoding and population dynamics during categorization task switching in parietal cortex. Neuron 2020; 109:700-712.e4. [PMID: 33326754 DOI: 10.1016/j.neuron.2020.11.022] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 09/29/2020] [Accepted: 11/18/2020] [Indexed: 11/18/2022]
Abstract
Primates excel at categorization, a cognitive process for assigning stimuli into behaviorally relevant groups. Categories are encoded in multiple brain areas and tasks, yet it remains unclear how neural encoding and dynamics support cognitive tasks with different demands. We recorded from parietal cortex during flexible switching between categorization tasks with distinct cognitive and motor demands and also studied recurrent neural networks (RNNs) trained on the same tasks. In the one-interval categorization task (OIC), monkeys rapidly reported their decisions with a saccade. In the delayed match-to-category (DMC) task, monkeys decided whether sequentially presented stimuli were categorical matches. Neuronal category encoding generalized across tasks, but categorical encoding was more binary-like in the DMC task and more graded in the OIC task. Furthermore, analysis of trained RNNs supports the hypothesis that binary-like encoding in DMC arises through compression of graded feature encoding by attractor dynamics underlying stimulus maintenance and/or comparison in working memory.
Collapse
Affiliation(s)
- Krithika Mohan
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA.
| | - Ou Zhu
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA
| | - David J Freedman
- Department of Neurobiology, The University of Chicago, Chicago, IL 60637, USA; Grossman Institute for Neuroscience, Quantitative Biology and Human Behavior, The University of Chicago, Chicago, IL 60637, USA.
| |
Collapse
|
41
|
Friston KJ, Parr T, Yufik Y, Sajid N, Price CJ, Holmes E. Generative models, linguistic communication and active inference. Neurosci Biobehav Rev 2020; 118:42-64. [PMID: 32687883 PMCID: PMC7758713 DOI: 10.1016/j.neubiorev.2020.07.005] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 06/26/2020] [Accepted: 07/08/2020] [Indexed: 11/24/2022]
Abstract
This paper presents a biologically plausible generative model and inference scheme that is capable of simulating communication between synthetic subjects who talk to each other. Building on active inference formulations of dyadic interactions, we simulate linguistic exchange to explore generative models that support dialogues. These models employ high-order interactions among abstract (discrete) states in deep (hierarchical) models. The sequential nature of language processing mandates generative models with a particular factorial structure-necessary to accommodate the rich combinatorics of language. We illustrate linguistic communication by simulating a synthetic subject who can play the 'Twenty Questions' game. In this game, synthetic subjects take the role of the questioner or answerer, using the same generative model. This simulation setup is used to illustrate some key architectural points and demonstrate that many behavioural and neurophysiological correlates of linguistic communication emerge under variational (marginal) message passing, given the right kind of generative model. For example, we show that theta-gamma coupling is an emergent property of belief updating, when listening to another.
Collapse
Affiliation(s)
- Karl J Friston
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, 12 Queen Square, London, WC1N 3AR, UK.
| | - Thomas Parr
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, 12 Queen Square, London, WC1N 3AR, UK.
| | - Yan Yufik
- Virtual Structures Research, Inc., 12204 Saint James Rd, Potomac, MD 20854, USA.
| | - Noor Sajid
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, 12 Queen Square, London, WC1N 3AR, UK.
| | - Catherine J Price
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, 12 Queen Square, London, WC1N 3AR, UK.
| | - Emma Holmes
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, 12 Queen Square, London, WC1N 3AR, UK.
| |
Collapse
|
42
|
Kawabata M, Soma S, Saiki-Ishikawa A, Nonomura S, Yoshida J, Ríos A, Sakai Y, Isomura Y. A spike analysis method for characterizing neurons based on phase locking and scaling to the interval between two behavioral events. J Neurophysiol 2020; 124:1923-1941. [PMID: 33085554 DOI: 10.1152/jn.00200.2020] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
Standard analysis of neuronal functions assesses the temporal correlation between animal behaviors and neuronal activity by aligning spike trains with the timing of a specific behavioral event, e.g., visual cue. However, spike activity is often involved in information processing dependent on a relative phase between two consecutive events rather than a single event. Nevertheless, less attention has so far been paid to such temporal features of spike activity in relation to two behavioral events. Here, we propose "Phase-Scaling analysis" to simultaneously evaluate the phase locking and scaling to the interval between two events in task-related spike activity of individual neurons. This analysis method can discriminate conceptual "scaled"-type neurons from "nonscaled"-type neurons using an activity variation map that combines phase locking with scaling to the interval. Its robustness was validated by spike simulation using different spike properties. Furthermore, we applied it to analyzing actual spike data from task-related neurons in the primary visual cortex (V1), posterior parietal cortex (PPC), primary motor cortex (M1), and secondary motor cortex (M2) of behaving rats. After hierarchical clustering of all neurons using their activity variation maps, we divided them objectively into four clusters corresponding to nonscaled-type sensory and motor neurons and scaled-type neurons including sustained and ramping activities, etc. Cluster/subcluster compositions for V1 differed from those of PPC, M1, and M2. The V1 neurons showed the fastest functional activities among those areas. Our method was also applicable to determine temporal "forms" and the latency of spike activity changes. These findings demonstrate its utility for characterizing neurons.NEW & NOTEWORTHY Phase-Scaling analysis is a novel technique to unbiasedly characterize the temporal dependency of functional neuron activity on two behavioral events and objectively determine the latency and form of the activity change. This powerful analysis can uncover several classes of latently functioning neurons that have thus far been overlooked, which may participate differently in intermediate processes of a brain function. The Phase-Scaling analysis will yield profound insights into neural mechanisms for processing internal information.
Collapse
Affiliation(s)
- Masanori Kawabata
- Department of Physiology and Cell Biology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.,Graduate School of Brain Sciences, Tamagawa University, Tokyo, Japan
| | - Shogo Soma
- Brain Science Institute, Tamagawa University, Tokyo, Japan.,Department of Molecular Cell Physiology, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Akiko Saiki-Ishikawa
- Brain Science Institute, Tamagawa University, Tokyo, Japan.,Department of Neurobiology, Northwestern University, Evanston, Illinois
| | - Satoshi Nonomura
- Department of Physiology and Cell Biology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.,Brain Science Institute, Tamagawa University, Tokyo, Japan.,Systems Neuroscience Section, Primate Research Institute, Kyoto University, Aichi, Japan
| | - Junichi Yoshida
- Brain Science Institute, Tamagawa University, Tokyo, Japan.,Dominick P. Purpura Department of Neuroscience, Albert Einstein College of Medicine, New York
| | - Alain Ríos
- Department of Physiology and Cell Biology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.,Graduate School of Brain Sciences, Tamagawa University, Tokyo, Japan
| | - Yutaka Sakai
- Graduate School of Brain Sciences, Tamagawa University, Tokyo, Japan.,Brain Science Institute, Tamagawa University, Tokyo, Japan
| | - Yoshikazu Isomura
- Department of Physiology and Cell Biology, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan.,Graduate School of Brain Sciences, Tamagawa University, Tokyo, Japan.,Brain Science Institute, Tamagawa University, Tokyo, Japan
| |
Collapse
|
43
|
Proksch S, Comstock DC, Médé B, Pabst A, Balasubramaniam R. Motor and Predictive Processes in Auditory Beat and Rhythm Perception. Front Hum Neurosci 2020; 14:578546. [PMID: 33061902 PMCID: PMC7518112 DOI: 10.3389/fnhum.2020.578546] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 08/18/2020] [Indexed: 11/30/2022] Open
Abstract
In this article, we review recent advances in research on rhythm and musical beat perception, focusing on the role of predictive processes in auditory motor interactions. We suggest that experimental evidence of the motor system's role in beat perception, including in passive listening, may be explained by the generation and maintenance of internal predictive models, concordant with the Active Inference framework of sensory processing. We highlight two complementary hypotheses for the neural underpinnings of rhythm perception: The Action Simulation for Auditory Prediction hypothesis (Patel and Iversen, 2014) and the Gradual Audiomotor Evolution hypothesis (Merchant and Honing, 2014) and review recent experimental progress supporting each of these hypotheses. While initial formulations of ASAP and GAE explain different aspects of beat-based timing-the involvement of motor structures in the absence of movement, and physical entrainment to an auditory beat respectively-we suggest that work under both hypotheses provide converging evidence toward understanding the predictive role of the motor system in the perception of rhythm, and the specific neural mechanisms involved. We discuss future experimental work necessary to further evaluate the causal neural mechanisms underlying beat and rhythm perception.
Collapse
Affiliation(s)
- Shannon Proksch
- Sensorimotor Neuroscience Laboratory, Cognitive & Information Sciences, University of California, Merced, Merced, CA, United States
| | - Daniel C Comstock
- Sensorimotor Neuroscience Laboratory, Cognitive & Information Sciences, University of California, Merced, Merced, CA, United States
| | - Butovens Médé
- Sensorimotor Neuroscience Laboratory, Cognitive & Information Sciences, University of California, Merced, Merced, CA, United States
| | - Alexandria Pabst
- Sensorimotor Neuroscience Laboratory, Cognitive & Information Sciences, University of California, Merced, Merced, CA, United States
| | - Ramesh Balasubramaniam
- Sensorimotor Neuroscience Laboratory, Cognitive & Information Sciences, University of California, Merced, Merced, CA, United States
| |
Collapse
|
44
|
Krug K. Coding Perceptual Decisions: From Single Units to Emergent Signaling Properties in Cortical Circuits. Annu Rev Vis Sci 2020; 6:387-409. [PMID: 32600168 DOI: 10.1146/annurev-vision-030320-041223] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Spiking activity in single neurons of the primate visual cortex has been tightly linked to perceptual decisions. Any mechanism that reads out these perceptual signals to support behavior must respect the underlying neuroanatomy that shapes the functional properties of sensory neurons. Spatial distribution and timing of inputs to the next processing levels are critical, as conjoint activity of precursor neurons increases the spiking rate of downstream neurons and ultimately drives behavior. I set out how correlated activity might coalesce into a micropool of task-sensitive neurons signaling a particular percept to determine perceptual decision signals locally and for flexible interarea transmission depending on the task context. As data from more and more neurons and their complex interactions are analyzed, the space of computational mechanisms must be constrained based on what is plausible within neurobiological limits. This review outlines experiments to test the new perspectives offered by these extended methods.
Collapse
Affiliation(s)
- Kristine Krug
- Lehrstuhl für Sensorische Physiologie, Institut für Biologie, Otto-von-Guericke-Universität Magdeburg, 39120 Magdeburg, Germany; .,Leibniz-Institut für Neurobiologie, 39118 Magdeburg, Germany.,Department of Physiology, Anatomy, and Genetics, Oxford University, Oxford OX1 3PT, United Kingdom
| |
Collapse
|
45
|
Gür E, Duyan YA, Türkakın E, Arkan S, Karson A, Balcı F. Aging impairs perceptual decision-making in mice: integrating computational and neurobiological approaches. Brain Struct Funct 2020; 225:1889-1902. [PMID: 32566973 DOI: 10.1007/s00429-020-02101-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2019] [Accepted: 06/12/2020] [Indexed: 11/24/2022]
Abstract
Decision-making is one of the cognitive domains which has been under-investigated in animal models of cognitive aging along with its neurobiological correlates. This study investigated the latent variables of the decision process using the hierarchical drift-diffusion model (HDDM). Neurobiological correlates of these processes were examined via immunohistochemistry. Young (n = 11, 4 months old), adult (n = 10, 10 months old), and old (n = 10, 18 months old) mice were tested in a perceptual decision-making task (i.e. two-alternative forced-choice; 2AFC). Observed data showed that there was an age-dependent decrease in the accuracy rate of old mice while response times were comparable between age groups. HDDM results revealed that age-dependent accuracy difference was a result of a decrease in the quality of evidence integration during decision-making. Significant positive correlations observed between evidence integration rate and the number of tyrosine hydroxylase positive (TH+) neurons in the ventral tegmental area (VTA) and axon terminals in dorsomedial striatum (DMS) suggest that decrease in the quality of evidence integration in aging is related to decreased function of mesocortical and nigrostriatal dopamine.
Collapse
Affiliation(s)
- Ezgi Gür
- Timing and Decision-Making Laboratory, Department of Psychology, Koç University, 34450, Istanbul, Turkey
- Koç University Research Center for Translational Medicine, 34450, Istanbul, Turkey
| | - Yalçın Akın Duyan
- Timing and Decision-Making Laboratory, Department of Psychology, Koç University, 34450, Istanbul, Turkey
- Koç University Research Center for Translational Medicine, 34450, Istanbul, Turkey
| | - Esin Türkakın
- Timing and Decision-Making Laboratory, Department of Psychology, Koç University, 34450, Istanbul, Turkey
- Koç University Research Center for Translational Medicine, 34450, Istanbul, Turkey
| | - Sertan Arkan
- Timing and Decision-Making Laboratory, Department of Psychology, Koç University, 34450, Istanbul, Turkey
- Koç University Research Center for Translational Medicine, 34450, Istanbul, Turkey
- Physiology Department, Kocaeli University, Umuttepe Campus, 41380, Kocaeli, Turkey
| | - Ayşe Karson
- Physiology Department, Kocaeli University, Umuttepe Campus, 41380, Kocaeli, Turkey
| | - Fuat Balcı
- Timing and Decision-Making Laboratory, Department of Psychology, Koç University, 34450, Istanbul, Turkey.
- Koç University Research Center for Translational Medicine, 34450, Istanbul, Turkey.
| |
Collapse
|
46
|
Manning C, Wagenmakers EJ, Norcia AM, Scerif G, Boehm U. Perceptual Decision-Making in Children: Age-Related Differences and EEG Correlates. COMPUTATIONAL BRAIN & BEHAVIOR 2020; 4:53-69. [PMID: 33604512 PMCID: PMC7870772 DOI: 10.1007/s42113-020-00087-7] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Children make faster and more accurate decisions about perceptual information as they get older, but it is unclear how different aspects of the decision-making process change with age. Here, we used hierarchical Bayesian diffusion models to decompose performance in a perceptual task into separate processing components, testing age-related differences in model parameters and links to neural data. We collected behavioural and EEG data from 96 6- to 12-year-old children and 20 adults completing a motion discrimination task. We used a component decomposition technique to identify two response-locked EEG components with ramping activity preceding the response in children and adults: one with activity that was maximal over centro-parietal electrodes and one that was maximal over occipital electrodes. Younger children had lower drift rates (reduced sensitivity), wider boundary separation (increased response caution) and longer non-decision times than older children and adults. Yet, model comparisons suggested that the best model of children's data included age effects only on drift rate and boundary separation (not non-decision time). Next, we extracted the slope of ramping activity in our EEG components and covaried these with drift rate. The slopes of both EEG components related positively to drift rate, but the best model with EEG covariates included only the centro-parietal component. By decomposing performance into distinct components and relating them to neural markers, diffusion models have the potential to identify the reasons why children with developmental conditions perform differently to typically developing children and to uncover processing differences inapparent in the response time and accuracy data alone.
Collapse
Affiliation(s)
- Catherine Manning
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | | | | | - Gaia Scerif
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Udo Boehm
- University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
47
|
Lakshminarasimhan KJ, Avila E, Neyhart E, DeAngelis GC, Pitkow X, Angelaki DE. Tracking the Mind's Eye: Primate Gaze Behavior during Virtual Visuomotor Navigation Reflects Belief Dynamics. Neuron 2020; 106:662-674.e5. [PMID: 32171388 PMCID: PMC7323886 DOI: 10.1016/j.neuron.2020.02.023] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2019] [Revised: 12/24/2019] [Accepted: 02/19/2020] [Indexed: 01/02/2023]
Abstract
To take the best actions, we often need to maintain and update beliefs about variables that cannot be directly observed. To understand the principles underlying such belief updates, we need tools to uncover subjects' belief dynamics from natural behavior. We tested whether eye movements could be used to infer subjects' beliefs about latent variables using a naturalistic navigation task. Humans and monkeys navigated to a remembered goal location in a virtual environment that provided optic flow but lacked explicit position cues. We observed eye movements that appeared to continuously track the goal location even when no visible target was present there. Accurate goal tracking was associated with improved task performance, and inhibiting eye movements in humans impaired navigation precision. These results suggest that gaze dynamics play a key role in action selection during challenging visuomotor behaviors and may possibly serve as a window into the subject's dynamically evolving internal beliefs.
Collapse
Affiliation(s)
- Kaushik J Lakshminarasimhan
- Center for Neural Science, New York University, New York, NY, USA; Center for Theoretical Neuroscience, Columbia University, New York, NY, USA.
| | - Eric Avila
- Center for Neural Science, New York University, New York, NY, USA
| | - Erin Neyhart
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
| | | | - Xaq Pitkow
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA; Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
| | - Dora E Angelaki
- Center for Neural Science, New York University, New York, NY, USA; Tandon School of Engineering, New York University, New York, NY, USA
| |
Collapse
|
48
|
Hernández-Pérez R, Rojas-Hortelano E, de Lafuente V. Integrating Somatosensory Information Over Time. Neuroscience 2020; 433:72-80. [DOI: 10.1016/j.neuroscience.2020.02.037] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 01/17/2020] [Accepted: 02/21/2020] [Indexed: 10/24/2022]
|
49
|
Stine GM, Zylberberg A, Ditterich J, Shadlen MN. Differentiating between integration and non-integration strategies in perceptual decision making. eLife 2020; 9:55365. [PMID: 32338595 PMCID: PMC7217695 DOI: 10.7554/elife.55365] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Accepted: 04/24/2020] [Indexed: 01/26/2023] Open
Abstract
Many tasks used to study decision-making encourage subjects to integrate evidence over time. Such tasks are useful to understand how the brain operates on multiple samples of information over prolonged timescales, but only if subjects actually integrate evidence to form their decisions. We explored the behavioral observations that corroborate evidence-integration in a number of task-designs. Several commonly accepted signs of integration were also predicted by non-integration strategies. Furthermore, an integration model could fit data generated by non-integration models. We identified the features of non-integration models that allowed them to mimic integration and used these insights to design a motion discrimination task that disentangled the models. In human subjects performing the task, we falsified a non-integration strategy in each and confirmed prolonged integration in all but one subject. The findings illustrate the difficulty of identifying a decision-maker’s strategy and support solutions to achieve this goal.
Collapse
Affiliation(s)
- Gabriel M Stine
- Department of Neuroscience, Columbia University, New York, United States
| | - Ariel Zylberberg
- Mortimer B. Zuckerman Mind Brain Behavior Institute and The Kavli Institute for Brain Science, Columbia University, New York, United States.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Jochen Ditterich
- Center for Neuroscience and Department of Neurobiology, Physiology & Behavior, University of California, Davis, United States
| | - Michael N Shadlen
- Department of Neuroscience, Columbia University, New York, United States.,Mortimer B. Zuckerman Mind Brain Behavior Institute and The Kavli Institute for Brain Science, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| |
Collapse
|
50
|
Khamechian MB, Daliri MR. Decoding Adaptive Visuomotor Behavior Mediated by Non-linear Phase Coupling in Macaque Area MT. Front Neurosci 2020; 14:230. [PMID: 32317912 PMCID: PMC7147352 DOI: 10.3389/fnins.2020.00230] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Accepted: 03/02/2020] [Indexed: 12/20/2022] Open
Abstract
The idea that a flexible behavior relies on synchronous neural activity within intra- and inter-associated cortical areas has been a matter of intense research in human and animal neuroscience. The neurophysiological mechanisms underlying this behavioral correlate of the synchronous activity are still unknown. It has been suggested that the strength of neural synchrony at the level of population is an important neural code to guide an efficient transformation of the sensory input into the behavioral action. In this study, we have examined the non-linear synchronization between neural ensembles in area MT of the macaque visual cortex by employing a non-linear cross-frequency coupling technique, namely bicoherence. We trained a macaque monkey to detect a brief change in the cued stimulus during a visuomotor detection task. The results show that the non-linear phase synchronization in the high-gamma frequency band (100-250 Hz) predicts the animal's reaction time. The strength of non-linear phase synchronization is selective to the target stimulus location. In addition, the non-linearity characteristics of neural synchronization are selectively modulated when the monkey covertly attends to the stimulus inside the neuron's receptive field. This additional evidence indicates that non-linear neuronal synchronization may be affected by a cognitive function like spatial attention. Our neural and behavioral observations reflect that two crucial processes may be involved in processing of visuomotor information in area MT: (I) a non-linear cortical process (measured by the bicoherence) and (II) a linear process (measured by the spectral power).
Collapse
Affiliation(s)
- Mohammad Bagher Khamechian
- Neuroscience and Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology, Tehran, Iran
| | - Mohammad Reza Daliri
- Neuroscience and Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology, Tehran, Iran
- Cognitive Neurobiology Laboratory, School of Cognitive Sciences (SCS), Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| |
Collapse
|