1
|
Steinemann N, Stine GM, Trautmann E, Zylberberg A, Wolpert DM, Shadlen MN. Direct observation of the neural computations underlying a single decision. eLife 2024; 12:RP90859. [PMID: 39422555 PMCID: PMC11488853 DOI: 10.7554/elife.90859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2024] Open
Abstract
Neurobiological investigations of perceptual decision-making have furnished the first glimpse of a flexible cognitive process at the level of single neurons. Neurons in the parietal and prefrontal cortex are thought to represent the accumulation of noisy evidence, acquired over time, leading to a decision. Neural recordings averaged over many decisions have provided support for the deterministic rise in activity to a termination bound. Critically, it is the unobserved stochastic component that is thought to confer variability in both choice and decision time. Here, we elucidate this drift-diffusion signal on individual decisions. We recorded simultaneously from hundreds of neurons in the lateral intraparietal cortex of monkeys while they made decisions about the direction of random dot motion. We show that a single scalar quantity, derived from the weighted sum of the population activity, represents a combination of deterministic drift and stochastic diffusion. Moreover, we provide direct support for the hypothesis that this drift-diffusion signal approximates the quantity responsible for the variability in choice and reaction times. The population-derived signals rely on a small subset of neurons with response fields that overlap the choice targets. These neurons represent the integral of noisy evidence. Another subset of direction-selective neurons with response fields that overlap the motion stimulus appear to represent the integrand. This parsimonious architecture would escape detection by state-space analyses, absent a clear hypothesis.
Collapse
Affiliation(s)
- Natalie Steinemann
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Gabriel M Stine
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Eric Trautmann
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
| | - Ariel Zylberberg
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
| | - Daniel M Wolpert
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Kavli Institute, Columbia UniversityNew YorkUnited States
| | - Michael N Shadlen
- Zuckerman Mind Brain and Behavior Institute, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical InstituteChevy ChaseUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
- Kavli Institute, Columbia UniversityNew YorkUnited States
| |
Collapse
|
2
|
Vivar-Lazo M, Fetsch CR. Neural basis of concurrent deliberation toward a choice and degree of confidence. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.08.06.606833. [PMID: 39149300 PMCID: PMC11326179 DOI: 10.1101/2024.08.06.606833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Decision confidence plays a key role in flexible behavior and (meta)cognition, but its underlying neural mechanisms remain elusive. To uncover the latent dynamics of confidence formation at the level of population activity, we designed a decision task for nonhuman primates that measures choice, reaction time, and confidence with a single eye movement on every trial. Monkey behavior was well fit by a bounded accumulator model instantiating parallel processing of evidence, rejecting a serial model in which the choice is resolved first followed by post-decision accumulation for confidence. Neurons in area LIP reflected concurrent accumulation, exhibiting covariation of choice and confidence signals across the population, and within-trial dynamics consistent with parallel updating at near-zero time lag. The results demonstrate that monkeys can process a single stream of evidence in service of two computational goals simultaneously-a categorical decision and associated level of confidence-and illuminate a candidate neural substrate for this ability.
Collapse
Affiliation(s)
- Miguel Vivar-Lazo
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher R Fetsch
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins University, Baltimore, MD, USA
- Solomon H. Snyder Department of Neuroscience, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
3
|
Rangelov D, Fellrath J, Mattingley JB. Integrated Perceptual Decisions Rely on Parallel Evidence Accumulation. J Neurosci 2024; 44:e2368232024. [PMID: 38960720 PMCID: PMC11326863 DOI: 10.1523/jneurosci.2368-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 06/02/2024] [Accepted: 06/25/2024] [Indexed: 07/05/2024] Open
Abstract
The ability to make accurate and timely decisions, such as judging when it is safe to cross the road, is the foundation of adaptive behavior. While the computational and neural processes supporting simple decisions on isolated stimuli have been well characterized, decision-making in the real world often requires integration of discrete sensory events over time and space. Most previous experimental work on perceptual decision-making has focused on tasks that involve only a single, task-relevant source of sensory input. It remains unclear, therefore, how such integrative decisions are regulated computationally. Here we used psychophysics, electroencephalography, and computational modeling to understand how the human brain combines visual motion signals across space in the service of a single, integrated decision. To that purpose, we presented two random-dot kinematograms in the left and the right visual hemifields. Coherent motion signals were shown briefly and concurrently in each location, and healthy adult human participants of both sexes reported the average of the two motion signals. We directly tested competing predictions arising from influential serial and parallel accounts of visual processing. Using a biologically plausible model of motion filtering, we found evidence in favor of parallel integration as the fundamental computational mechanism regulating integrated perceptual decisions.
Collapse
Affiliation(s)
- Dragan Rangelov
- Queensland Brain Institute, The University of Queensland, St Lucia, Queensland 4072, Australia
- School of Economics, The University of Queensland, St Lucia, Queensland 4072, Australia
| | - Julia Fellrath
- Lausanne University Hospital, The University of Lausanne, Lausanne 1005, Switzerland
| | - Jason B Mattingley
- Queensland Brain Institute, The University of Queensland, St Lucia, Queensland 4072, Australia
- School of Psychology, The University of Queensland, St Lucia, Queensland 4072, Australia
| |
Collapse
|
4
|
Noel JP, Balzani E, Savin C, Angelaki DE. Context-invariant beliefs are supported by dynamic reconfiguration of single unit functional connectivity in prefrontal cortex of male macaques. Nat Commun 2024; 15:5738. [PMID: 38982106 PMCID: PMC11233555 DOI: 10.1038/s41467-024-50203-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Accepted: 07/02/2024] [Indexed: 07/11/2024] Open
Abstract
Natural behaviors occur in closed action-perception loops and are supported by dynamic and flexible beliefs abstracted away from our immediate sensory milieu. How this real-world flexibility is instantiated in neural circuits remains unknown. Here, we have male macaques navigate in a virtual environment by primarily leveraging sensory (optic flow) signals, or by more heavily relying on acquired internal models. We record single-unit spiking activity simultaneously from the dorsomedial superior temporal area (MSTd), parietal area 7a, and the dorso-lateral prefrontal cortex (dlPFC). Results show that while animals were able to maintain adaptive task-relevant beliefs regardless of sensory context, the fine-grain statistical dependencies between neurons, particularly in 7a and dlPFC, dynamically remapped with the changing computational demands. In dlPFC, but not 7a, destroying these statistical dependencies abolished the area's ability for cross-context decoding. Lastly, correlational analyses suggested that the more unit-to-unit couplings remapped in dlPFC, and the less they did so in MSTd, the less were population codes and behavior impacted by the loss of sensory evidence. We conclude that dynamic functional connectivity between neurons in prefrontal cortex maintain a stable population code and context-invariant beliefs during naturalistic behavior.
Collapse
Affiliation(s)
- Jean-Paul Noel
- Center for Neural Science, New York University, New York City, NY, USA.
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA.
| | - Edoardo Balzani
- Center for Neural Science, New York University, New York City, NY, USA
- Flatiron Institute, Simons Foundation, New York, NY, USA
| | - Cristina Savin
- Center for Neural Science, New York University, New York City, NY, USA
| | - Dora E Angelaki
- Center for Neural Science, New York University, New York City, NY, USA
| |
Collapse
|
5
|
Xue C, Markman SK, Chen R, Kramer LE, Cohen MR. Task interference as a neuronal basis for the cost of cognitive flexibility. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.04.583375. [PMID: 38496626 PMCID: PMC10942291 DOI: 10.1101/2024.03.04.583375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/19/2024]
Abstract
Humans and animals have an impressive ability to juggle multiple tasks in a constantly changing environment. This flexibility, however, leads to decreased performance under uncertain task conditions. Here, we combined monkey electrophysiology, human psychophysics, and artificial neural network modeling to investigate the neuronal mechanisms of this performance cost. We developed a behavioural paradigm to measure and influence participants' decision-making and perception in two distinct perceptual tasks. Our data revealed that both humans and monkeys, unlike an artificial neural network trained for the same tasks, make less accurate perceptual decisions when the task is uncertain. We generated a mechanistic hypothesis by comparing this neural network trained to produce correct choices with another network trained to replicate the participants' choices. We hypothesized, and confirmed with further behavioural, physiological, and causal experiments, that the cost of task flexibility comes from what we term task interference. Under uncertain conditions, interference between different tasks causes errors because it results in a stronger representation of irrelevant task features and entangled neuronal representations of different features. Our results suggest a tantalizing, general hypothesis: that cognitive capacity limitations, both in health and disease, stem from interference between neural representations of different stimuli, tasks, or memories.
Collapse
Affiliation(s)
- Cheng Xue
- Department of Neurobiology, University of Chicago, IL, USA
| | - Sol K Markman
- Department of Neurobiology, University of Chicago, IL, USA
- Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, MA, USA
| | - Ruoyi Chen
- Department of Biological Sciences, Carnegie Mellon University, PA, USA
| | - Lily E Kramer
- Department of Neurobiology, University of Chicago, IL, USA
| | | |
Collapse
|
6
|
Karami B, Schwiedrzik CM. Visual perceptual learning of feature conjunctions leverages non-linear mixed selectivity. NPJ SCIENCE OF LEARNING 2024; 9:13. [PMID: 38429339 PMCID: PMC10907723 DOI: 10.1038/s41539-024-00226-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 02/16/2024] [Indexed: 03/03/2024]
Abstract
Visual objects are often defined by multiple features. Therefore, learning novel objects entails learning feature conjunctions. Visual cortex is organized into distinct anatomical compartments, each of which is devoted to processing a single feature. A prime example are neurons purely selective to color and orientation, respectively. However, neurons that jointly encode multiple features (mixed selectivity) also exist across the brain and play critical roles in a multitude of tasks. Here, we sought to uncover the optimal policy that our brain adapts to achieve conjunction learning using these available resources. 59 human subjects practiced orientation-color conjunction learning in four psychophysical experiments designed to nudge the visual system towards using one or the other resource. We find that conjunction learning is possible by linear mixing of pure color and orientation information, but that more and faster learning takes place when both pure and mixed selectivity representations are involved. We also find that learning with mixed selectivity confers advantages in performing an untrained "exclusive or" (XOR) task several months after learning the original conjunction task. This study sheds light on possible mechanisms underlying conjunction learning and highlights the importance of learning by mixed selectivity.
Collapse
Affiliation(s)
- Behnam Karami
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany
| | - Caspar M Schwiedrzik
- Neural Circuits and Cognition Lab, European Neuroscience Institute Göttingen - A Joint Initiative of the University Medical Center Göttingen and the Max Planck Society, Grisebachstraße 5, 37077, Göttingen, Germany.
- Perception and Plasticity Group, German Primate Center - Leibniz Institute for Primate Research, Kellnerweg 4, 37077, Göttingen, Germany.
| |
Collapse
|
7
|
Löffler A, Zylberberg A, Shadlen MN, Wolpert DM. Judging the difficulty of perceptual decisions. eLife 2023; 12:RP86892. [PMID: 37975792 PMCID: PMC10656101 DOI: 10.7554/elife.86892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2023] Open
Abstract
Deciding how difficult it is going to be to perform a task allows us to choose between tasks, allocate appropriate resources, and predict future performance. To be useful for planning, difficulty judgments should not require completion of the task. Here, we examine the processes underlying difficulty judgments in a perceptual decision-making task. Participants viewed two patches of dynamic random dots, which were colored blue or yellow stochastically on each appearance. Stimulus coherence (the probability, pblue, of a dot being blue) varied across trials and patches thus establishing difficulty, |pblue -0.5|. Participants were asked to indicate for which patch it would be easier to decide the dominant color. Accuracy in difficulty decisions improved with the difference in the stimulus difficulties, whereas the reaction times were not determined solely by this quantity. For example, when the patches shared the same difficulty, reaction times were shorter for easier stimuli. A comparison of several models of difficulty judgment suggested that participants compare the absolute accumulated evidence from each stimulus and terminate their decision when they differed by a set amount. The model predicts that when the dominant color of each stimulus is known, reaction times should depend only on the difference in difficulty, which we confirm empirically. We also show that this model is preferred to one that compares the confidence one would have in making each decision. The results extend evidence accumulation models, used to explain choice, reaction time, and confidence to prospective judgments of difficulty.
Collapse
Affiliation(s)
- Anne Löffler
- Zuckerman Mind Brain Behavior Institute, Columbia UniversityNew YorkUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
- Kavli Institute for Brain Science, Columbia UniversityNew YorkUnited States
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Columbia UniversityNew YorkUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Columbia UniversityNew YorkUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
- Kavli Institute for Brain Science, Columbia UniversityNew YorkUnited States
- Howard Hughes Medical Institute, Columbia UniversityNew YorkUnited States
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Columbia UniversityNew YorkUnited States
- Department of Neuroscience, Columbia UniversityNew YorkUnited States
| |
Collapse
|
8
|
Noel JP, Balzani E, Savin C, Angelaki DE. Context-invariant beliefs are supported by dynamic reconfiguration of single unit functional connectivity in prefrontal cortex. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.07.30.551169. [PMID: 37577498 PMCID: PMC10418097 DOI: 10.1101/2023.07.30.551169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2023]
Abstract
Natural behaviors occur in closed action-perception loops and are supported by dynamic and flexible beliefs abstracted away from our immediate sensory milieu. How this real-world flexibility is instantiated in neural circuits remains unknown. Here we have macaques navigate in a virtual environment by primarily leveraging sensory (optic flow) signals, or by more heavily relying on acquired internal models. We record single-unit spiking activity simultaneously from the dorsomedial superior temporal area (MSTd), parietal area 7a, and the dorso-lateral prefrontal cortex (dlPFC). Results show that while animals were able to maintain adaptive task-relevant beliefs regardless of sensory context, the fine-grain statistical dependencies between neurons, particularly in 7a and dlPFC, dynamically remapped with the changing computational demands. In dlPFC, but not 7a, destroying these statistical dependencies abolished the area's ability for cross-context decoding. Lastly, correlation analyses suggested that the more unit-to-unit couplings remapped in dlPFC, and the less they did so in MSTd, the less were population codes and behavior impacted by the loss of sensory evidence. We conclude that dynamic functional connectivity between prefrontal cortex neurons maintains a stable population code and context-invariant beliefs during naturalistic behavior with closed action-perception loops.
Collapse
Affiliation(s)
- Jean-Paul Noel
- Center for Neural Science, New York University, New York City, NY, USA
| | - Edoardo Balzani
- Center for Neural Science, New York University, New York City, NY, USA
| | - Cristina Savin
- Center for Neural Science, New York University, New York City, NY, USA
| | - Dora E. Angelaki
- Center for Neural Science, New York University, New York City, NY, USA
| |
Collapse
|
9
|
Löffler A, Zylberberg A, Shadlen MN, Wolpert DM. Judging the difficulty of perceptual decisions. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.13.528254. [PMID: 36824715 PMCID: PMC9949003 DOI: 10.1101/2023.02.13.528254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
Abstract
Deciding how difficult it is going to be to perform a task allows us to choose between tasks, allocate appropriate resources, and predict future performance. To be useful for planning, difficulty judgments should not require completion of the task. Here we examine the processes underlying difficulty judgments in a perceptual decision making task. Participants viewed two patches of dynamic random dots, which were colored blue or yellow stochastically on each appearance. Stimulus coherence (the probability, p blue , of a dot being blue) varied across trials and patches thus establishing difficulty, p blue - 0.5 . Participants were asked to indicate for which patch it would be easier to decide the dominant color. Accuracy in difficulty decisions improved with the difference in the stimulus difficulties, whereas the reaction times were not determined solely by this quantity. For example, when the patches shared the same difficulty, reaction times were shorter for easier stimuli. A comparison of several models of difficulty judgment suggested that participants compare the absolute accumulated evidence from each stimulus and terminate their decision when they differed by a set amount. The model predicts that when the dominant color of each stimulus is known, reaction times should depend only on the difference in difficulty, which we confirm empirically. We also show that this model is preferred to one that compares the confidence one would have in making each decision. The results extend evidence accumulation models, used to explain choice, reaction time and confidence to prospective judgments of difficulty.
Collapse
Affiliation(s)
- Anne Löffler
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
- Department of Neuroscience, Columbia University, New York, NY 10027, USA
- Kavli Institute for Brain Science, Columbia University, NY 10027, USA
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
- Department of Neuroscience, Columbia University, New York, NY 10027, USA
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
- Department of Neuroscience, Columbia University, New York, NY 10027, USA
- Kavli Institute for Brain Science, Columbia University, NY 10027, USA
- Howard Hughes Medical Institute, Columbia University, NY 10027, USA
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
- Department of Neuroscience, Columbia University, New York, NY 10027, USA
| |
Collapse
|
10
|
Cazettes F, Mazzucato L, Murakami M, Morais JP, Augusto E, Renart A, Mainen ZF. A reservoir of foraging decision variables in the mouse brain. Nat Neurosci 2023; 26:840-849. [PMID: 37055628 PMCID: PMC10280691 DOI: 10.1038/s41593-023-01305-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 03/15/2023] [Indexed: 04/15/2023]
Abstract
In any given situation, the environment can be parsed in different ways to yield decision variables (DVs) defining strategies useful for different tasks. It is generally presumed that the brain only computes a single DV defining the current behavioral strategy. Here to test this assumption, we recorded neural ensembles in the frontal cortex of mice performing a foraging task admitting multiple DVs. Methods developed to uncover the currently employed DV revealed the use of multiple strategies and occasional switches in strategy within sessions. Optogenetic manipulations showed that the secondary motor cortex (M2) is needed for mice to use the different DVs in the task. Surprisingly, we found that regardless of which DV best explained the current behavior, M2 activity concurrently encoded a full basis set of computations defining a reservoir of DVs appropriate for alternative tasks. This form of neural multiplexing may confer considerable advantages for learning and adaptive behavior.
Collapse
Affiliation(s)
| | - Luca Mazzucato
- Departments of Biology, Mathematics & Physics, Institute of Neuroscience, University of Oregon, Eugene, OR, USA
| | - Masayoshi Murakami
- Champalimaud Foundation, Lisbon, Portugal
- Department of Neurophysiology, University of Yamanashi, Yamanashi, Japan
| | | | | | | | | |
Collapse
|
11
|
Shushruth S, Zylberberg A, Shadlen MN. Sequential sampling from memory underlies action selection during abstract decision-making. Curr Biol 2022; 32:1949-1960.e5. [PMID: 35354066 PMCID: PMC9090972 DOI: 10.1016/j.cub.2022.03.014] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 03/02/2022] [Accepted: 03/03/2022] [Indexed: 12/17/2022]
Abstract
The study of perceptual decision-making in monkeys has provided insights into the process by which sensory evidence is integrated toward a decision. When monkeys make decisions with the knowledge of the motor actions the decisions bear upon, the process of evidence integration is instantiated by neurons involved in the selection of said actions. It is less clear how monkeys make decisions when unaware of the actions required to communicate their choice-what we refer to as "abstract" decisions. We investigated this by training monkeys to associate the direction of motion of a noisy random-dot display with the color of two targets. Crucially, the targets were displayed at unpredictable locations after the motion stimulus was extinguished. We found that the monkeys postponed decision formation until the targets were revealed. Neurons in the parietal association area LIP represented the integration of evidence leading to a choice, but as the stimulus was no longer visible, the samples of evidence must have been retrieved from short-term memory. Our results imply that when decisions are temporally unyoked from the motor actions they bear upon, decision formation is protracted until they can be framed in terms of motor actions.
Collapse
Affiliation(s)
- S Shushruth
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA; Howard Hughes Medical Institute, New York, NY 10027, USA; Kavli Institute, Columbia University, 612 West 130th Street, New York, NY 10027, USA.
| |
Collapse
|
12
|
Lisi M, Morgan MJ, Solomon JA. Perceptual decisions and oculomotor responses rely on temporally distinct streams of evidence. Commun Biol 2022; 5:189. [PMID: 35233079 PMCID: PMC8888581 DOI: 10.1038/s42003-022-03141-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 02/08/2022] [Indexed: 11/09/2022] Open
Abstract
Perceptual decisions often require the integration of noisy sensory evidence over time. This process is formalized with sequential sampling models, where evidence is accumulated up to a decision threshold before a choice is made. Although intuition suggests that decision formation must precede the preparation of a motor response (i.e., the action used to communicate the choice), neurophysiological findings have suggested that these two processes might be one and the same. To test this idea, we developed a reverse-correlation protocol in which the visual stimuli that influence decisions can be distinguished from those guiding motor responses. In three experiments, we found that the temporal weighting function of oculomotor responses did not overlap with the relatively early weighting function of stimulus properties having an impact on decision formation. These results support a timeline in which perceptual decisions are formed, at least in part, prior to the preparation of a motor response.
Collapse
Affiliation(s)
- Matteo Lisi
- Centre for Applied Vision Research, City, University of London, London, UK.
- Department of Psychology, University of Essex, Colchester, UK.
- Department of Psychology, Royal Holloway, University of London, Egham, UK.
| | - Michael J Morgan
- Centre for Applied Vision Research, City, University of London, London, UK
| | - Joshua A Solomon
- Centre for Applied Vision Research, City, University of London, London, UK.
| |
Collapse
|
13
|
Zylberberg A. Decision prioritization and causal reasoning in decision hierarchies. PLoS Comput Biol 2021; 17:e1009688. [PMID: 34971552 PMCID: PMC8719712 DOI: 10.1371/journal.pcbi.1009688] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 11/28/2021] [Indexed: 12/02/2022] Open
Abstract
From cooking a meal to finding a route to a destination, many real life decisions can be decomposed into a hierarchy of sub-decisions. In a hierarchy, choosing which decision to think about requires planning over a potentially vast space of possible decision sequences. To gain insight into how people decide what to decide on, we studied a novel task that combines perceptual decision making, active sensing and hierarchical and counterfactual reasoning. Human participants had to find a target hidden at the lowest level of a decision tree. They could solicit information from the different nodes of the decision tree to gather noisy evidence about the target's location. Feedback was given only after errors at the leaf nodes and provided ambiguous evidence about the cause of the error. Despite the complexity of task (with 107 latent states) participants were able to plan efficiently in the task. A computational model of this process identified a small number of heuristics of low computational complexity that accounted for human behavior. These heuristics include making categorical decisions at the branching points of the decision tree rather than carrying forward entire probability distributions, discarding sensory evidence deemed unreliable to make a choice, and using choice confidence to infer the cause of the error after an initial plan failed. Plans based on probabilistic inference or myopic sampling norms could not capture participants' behavior. Our results show that it is possible to identify hallmarks of heuristic planning with sensing in human behavior and that the use of tasks of intermediate complexity helps identify the rules underlying human ability to reason over decision hierarchies.
Collapse
Affiliation(s)
- Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York, United States of America
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, New York, United States of America
| |
Collapse
|
14
|
Wang S, Feng SF, Bornstein AM. Mixing memory and desire: How memory reactivation supports deliberative decision-making. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2021; 13:e1581. [PMID: 34665529 DOI: 10.1002/wcs.1581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Revised: 08/24/2021] [Accepted: 09/16/2021] [Indexed: 11/09/2022]
Abstract
Memories affect nearly every aspect of our mental life. They allow us to both resolve uncertainty in the present and to construct plans for the future. Recently, renewed interest in the role memory plays in adaptive behavior has led to new theoretical advances and empirical observations. We review key findings, with particular emphasis on how the retrieval of many kinds of memories affects deliberative action selection. These results are interpreted in a sequential inference framework, in which reinstatements from memory serve as "samples" of potential action outcomes. The resulting model suggests a central role for the dynamics of memory reactivation in determining the influence of different kinds of memory in decisions. We propose that representation-specific dynamics can implement a bottom-up "product of experts" rule that integrates multiple sets of action-outcome predictions weighted based on their uncertainty. We close by reviewing related findings and identifying areas for further research. This article is categorized under: Psychology > Reasoning and Decision Making Neuroscience > Cognition Neuroscience > Computation.
Collapse
Affiliation(s)
- Shaoming Wang
- Department of Psychology, New York University, New York, New York, USA
| | - Samuel F Feng
- Department of Mathematics, Khalifa University of Science and Technology, Abu Dhabi, UAE.,Khalifa University Centre for Biotechnology, Khalifa University of Science and Technology, Abu Dhabi, UAE
| | - Aaron M Bornstein
- Department of Cognitive Sciences, University of California-Irvine, Irvine, California, USA.,Center for the Neurobiology of Learning & Memory, University of California-Irvine, Irvine, California, USA.,Institute for Mathematical Behavioral Sciences, University of California-Irvine, Irvine, California, USA
| |
Collapse
|
15
|
Meirhaeghe N, Sohn H, Jazayeri M. A precise and adaptive neural mechanism for predictive temporal processing in the frontal cortex. Neuron 2021; 109:2995-3011.e5. [PMID: 34534456 PMCID: PMC9737059 DOI: 10.1016/j.neuron.2021.08.025] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 07/02/2021] [Accepted: 08/18/2021] [Indexed: 12/14/2022]
Abstract
The theory of predictive processing posits that the brain computes expectations to process information predictively. Empirical evidence in support of this theory, however, is scarce and largely limited to sensory areas. Here, we report a precise and adaptive mechanism in the frontal cortex of non-human primates consistent with predictive processing of temporal events. We found that the speed of neural dynamics is precisely adjusted according to the average time of an expected stimulus. This speed adjustment, in turn, enables neurons to encode stimuli in terms of deviations from expectation. This lawful relationship was evident across multiple experiments and held true during learning: when temporal statistics underwent covert changes, neural responses underwent predictable changes that reflected the new mean. Together, these results highlight a precise mathematical relationship between temporal statistics in the environment and neural activity in the frontal cortex that may serve as a mechanism for predictive temporal processing.
Collapse
Affiliation(s)
- Nicolas Meirhaeghe
- Harvard-MIT Division of Health Sciences & Technology, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Hansem Sohn
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| | - Mehrdad Jazayeri
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA,Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
| |
Collapse
|
16
|
Musslick S, Cohen JD. Rationalizing constraints on the capacity for cognitive control. Trends Cogn Sci 2021; 25:757-775. [PMID: 34332856 DOI: 10.1016/j.tics.2021.06.001] [Citation(s) in RCA: 52] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Revised: 06/02/2021] [Accepted: 06/02/2021] [Indexed: 12/16/2022]
Abstract
Humans are remarkably limited in: (i) how many control-dependent tasks they can execute simultaneously, and (ii) how intensely they can focus on a single task. These limitations are universal assumptions of most theories of cognition. Yet, a rationale for why humans are subject to these constraints remains elusive. This feature review draws on recent insights from psychology, neuroscience, and machine learning, to suggest that constraints on cognitive control may result from a rational adaptation to fundamental, computational dilemmas in neural architectures. The reviewed literature implies that limitations in multitasking may result from a trade-off between learning efficacy and processing efficiency and that limitations in the intensity of commitment to a single task may reflect a trade-off between cognitive stability and flexibility.
Collapse
Affiliation(s)
- Sebastian Musslick
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, USA.
| | - Jonathan D Cohen
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544, USA; Department of Psychology, Princeton University, Princeton, NJ 08544, USA
| |
Collapse
|
17
|
Booras A, Stevenson T, McCormack CN, Rhoads ME, Hanks TD. Change point detection with multiple alternatives reveals parallel evaluation of the same stream of evidence along distinct timescales. Sci Rep 2021; 11:13098. [PMID: 34162943 PMCID: PMC8222317 DOI: 10.1038/s41598-021-92470-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 06/08/2021] [Indexed: 11/09/2022] Open
Abstract
In order to behave appropriately in a rapidly changing world, individuals must be able to detect when changes occur in that environment. However, at any given moment, there are a multitude of potential changes of behavioral significance that could occur. Here we investigate how knowledge about the space of possible changes affects human change point detection. We used a stochastic auditory change point detection task that allowed model-free and model-based characterization of the decision process people employ. We found that subjects can simultaneously apply distinct timescales of evidence evaluation to the same stream of evidence when there are multiple types of changes possible. Informative cues that specified the nature of the change led to improved accuracy for change point detection through mechanisms involving both the timescales of evidence evaluation and adjustments of decision bounds. These results establish three important capacities of information processing for decision making that any proposed neural mechanism of evidence evaluation must be able to support: the ability to simultaneously employ multiple timescales of evidence evaluation, the ability to rapidly adjust those timescales, and the ability to modify the amount of information required to make a decision in the context of flexible timescales.
Collapse
Affiliation(s)
- Alexa Booras
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Tanner Stevenson
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Connor N. McCormack
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA
| | - Marie E. Rhoads
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA ,grid.19006.3e0000 0000 9632 6718Department of Neuroscience, University of California Los Angeles, Los Angeles, CA USA
| | - Timothy D. Hanks
- grid.27860.3b0000 0004 1936 9684Center for Neuroscience, University of California Davis, Davis, CA USA ,grid.27860.3b0000 0004 1936 9684Department of Neurology, University of California Davis, Sacramento, CA USA
| |
Collapse
|
18
|
Kang YH, Löffler A, Jeurissen D, Zylberberg A, Wolpert DM, Shadlen MN. Multiple decisions about one object involve parallel sensory acquisition but time-multiplexed evidence incorporation. eLife 2021; 10:63721. [PMID: 33688829 PMCID: PMC8112870 DOI: 10.7554/elife.63721] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2020] [Accepted: 03/06/2021] [Indexed: 01/31/2023] Open
Abstract
The brain is capable of processing several streams of information that bear on different aspects of the same problem. Here, we address the problem of making two decisions about one object, by studying difficult perceptual decisions about the color and motion of a dynamic random dot display. We find that the accuracy of one decision is unaffected by the difficulty of the other decision. However, the response times reveal that the two decisions do not form simultaneously. We show that both stimulus dimensions are acquired in parallel for the initial ∼0.1 s but are then incorporated serially in time-multiplexed bouts. Thus, there is a bottleneck that precludes updating more than one decision at a time, and a buffer that stores samples of evidence while access to the decision is blocked. We suggest that this bottleneck is responsible for the long timescales of many cognitive operations framed as decisions.
Collapse
Affiliation(s)
- Yul Hr Kang
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Anne Löffler
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States
| | - Danique Jeurissen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Department of Brain and Cognitive Sciences, University of Rochester, Rochester, United States
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, United States.,Kavli Institute for Brain Science, Columbia University, New York, United States.,Howard Hughes Medical Institute, Columbia University, New York, United States
| |
Collapse
|