1
|
Boundy-Singer ZM, Ziemba CM, Hénaff OJ, Goris RLT. How does V1 population activity inform perceptual certainty? J Vis 2024; 24:12. [PMID: 38884544 PMCID: PMC11185272 DOI: 10.1167/jov.24.6.12] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Accepted: 05/06/2024] [Indexed: 06/18/2024] Open
Abstract
Neural population activity in sensory cortex informs our perceptual interpretation of the environment. Oftentimes, this population activity will support multiple alternative interpretations. The larger the spread of probability over different alternatives, the more uncertain the selected perceptual interpretation. We test the hypothesis that the reliability of perceptual interpretations can be revealed through simple transformations of sensory population activity. We recorded V1 population activity in fixating macaques while presenting oriented stimuli under different levels of nuisance variability and signal strength. We developed a decoding procedure to infer from V1 activity the most likely stimulus orientation as well as the certainty of this estimate. Our analysis shows that response magnitude, response dispersion, and variability in response gain all offer useful proxies for orientation certainty. Of these three metrics, the last one has the strongest association with the decoder's uncertainty estimates. These results clarify that the nature of neural population activity in sensory cortex provides downstream circuits with multiple options to assess the reliability of perceptual interpretations.
Collapse
Affiliation(s)
- Zoe M Boundy-Singer
- Center for Perceptual Systems, University of Texas at Austin, Austin, TX, USA
| | - Corey M Ziemba
- Center for Perceptual Systems, University of Texas at Austin, Austin, TX, USA
| | | | - Robbe L T Goris
- Center for Perceptual Systems, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
2
|
Tump AN, Wollny-Huttarsch D, Molleman L, Kurvers RHJM. Earlier social information has a stronger influence on judgments. Sci Rep 2024; 14:105. [PMID: 38168146 PMCID: PMC10762246 DOI: 10.1038/s41598-023-50345-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 12/19/2023] [Indexed: 01/05/2024] Open
Abstract
People's decisions are often informed by the choices of others. Evidence accumulation models provide a mechanistic account of how such social information enters the choice process. Previous research taking this approach has suggested two fundamentally different cognitive mechanisms by which people incorporate social information. On the one hand, individuals may update their evidence level instantaneously when observing social information. On the other hand, they may gradually integrate social information over time. These accounts make different predictions on how the timing of social information impacts its influence. The former predicts that timing has no impact on social information uptake. The latter predicts that social information which arrives earlier has a stronger impact because its impact increases over time. We tested both predictions in two studies in which participants first observed a perceptual stimulus. They then entered a deliberation phase in which social information arrived either early or late before reporting their judgment. In Experiment 1, early social information remained visible until the end and was thus displayed for longer than late social information. In Experiment 2, which was preregistered, early and late social information were displayed for an equal duration. In both studies, early social information had a larger impact on individuals' judgments. Further, an evidence accumulation analysis found that social information integration was best explained by both an immediate update of evidence and continuous integration over time. Because in social systems, timing plays a key role (e.g., propagation of information in social networks), our findings inform theories explaining the temporal evolution of social impact and the emergent social dynamics.
Collapse
Affiliation(s)
- Alan Novaes Tump
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany.
- Exzellenzcluster Science of Intelligence, Technical University Berlin, Berlin, Germany.
| | - David Wollny-Huttarsch
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Lucas Molleman
- Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands
- Tilburg School of Social and Behavioral Sciences, Tilburg University, Tilburg, Netherlands
| | - Ralf H J M Kurvers
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
- Exzellenzcluster Science of Intelligence, Technical University Berlin, Berlin, Germany
| |
Collapse
|
3
|
Lange RD, Shivkumar S, Chattoraj A, Haefner RM. Bayesian encoding and decoding as distinct perspectives on neural coding. Nat Neurosci 2023; 26:2063-2072. [PMID: 37996525 PMCID: PMC11003438 DOI: 10.1038/s41593-023-01458-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2021] [Accepted: 09/08/2023] [Indexed: 11/25/2023]
Abstract
The Bayesian brain hypothesis is one of the most influential ideas in neuroscience. However, unstated differences in how Bayesian ideas are operationalized make it difficult to draw general conclusions about how Bayesian computations map onto neural circuits. Here, we identify one such unstated difference: some theories ask how neural circuits could recover information about the world from sensory neural activity (Bayesian decoding), whereas others ask how neural circuits could implement inference in an internal model (Bayesian encoding). These two approaches require profoundly different assumptions and lead to different interpretations of empirical data. We contrast them in terms of motivations, empirical support and relationship to neural data. We also use a simple model to argue that encoding and decoding models are complementary rather than competing. Appreciating the distinction between Bayesian encoding and Bayesian decoding will help to organize future work and enable stronger empirical tests about the nature of inference in the brain.
Collapse
Affiliation(s)
- Richard D Lange
- Department of Neurobiology, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Computer Science, Rochester Institute of Technology, Rochester, NY, USA.
| | - Sabyasachi Shivkumar
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Ankani Chattoraj
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| | - Ralf M Haefner
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| |
Collapse
|
4
|
Flocco CG, Methner A, Burkart F, Geppert A, Overmann J. Touching the (almost) untouchable: a minimally invasive workflow for microbiological and biomolecular analyses of cultural heritage objects. Front Microbiol 2023; 14:1197837. [PMID: 37601377 PMCID: PMC10435870 DOI: 10.3389/fmicb.2023.1197837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 06/27/2023] [Indexed: 08/22/2023] Open
Abstract
Microbiological and biomolecular approaches to cultural heritage research have expanded the established research horizon from the prevalent focus on the cultural objects' conservation and human health protection to the relatively recent applications to provenance inquiry and assessment of environmental impacts in a global context of a changing climate. Standard microbiology and molecular biology methods developed for other materials, specimens, and contexts could, in principle, be applied to cultural heritage research. However, given certain characteristics common to several heritage objects-such as uniqueness, fragility, high value, and restricted access, tailored approaches are required. In addition, samples of heritage objects may yield low microbial biomass, rendering them highly susceptible to cross-contamination. Therefore, dedicated methodology addressing these limitations and operational hurdles is needed. Here, we review the main experimental challenges and propose a standardized workflow to study the microbiome of cultural heritage objects, illustrated by the exploration of bacterial taxa. The methodology was developed targeting the challenging side of the spectrum of cultural heritage objects, such as the delicate written record, while retaining flexibility to adapt and/or upscale it to heritage artifacts of a more robust constitution or larger dimensions. We hope this tailored review and workflow will facilitate the interdisciplinary inquiry and interactions among the cultural heritage research community.
Collapse
Affiliation(s)
- Cecilia G. Flocco
- Department of Microbial Ecology and Diversity Research, Leibniz Institute DSMZ- German Collection of Microorganisms and Cell Cultures GmbH, Braunschweig, Germany
| | - Anika Methner
- Department of Microbial Ecology and Diversity Research, Leibniz Institute DSMZ- German Collection of Microorganisms and Cell Cultures GmbH, Braunschweig, Germany
| | - Franziska Burkart
- Department of Microbial Ecology and Diversity Research, Leibniz Institute DSMZ- German Collection of Microorganisms and Cell Cultures GmbH, Braunschweig, Germany
| | - Alicia Geppert
- Department of Microbial Ecology and Diversity Research, Leibniz Institute DSMZ- German Collection of Microorganisms and Cell Cultures GmbH, Braunschweig, Germany
| | - Jörg Overmann
- Department of Microbial Ecology and Diversity Research, Leibniz Institute DSMZ- German Collection of Microorganisms and Cell Cultures GmbH, Braunschweig, Germany
- Microbiology, Technical University of Braunschweig, Braunschweig, Germany
| |
Collapse
|
5
|
Abstract
Neural mechanisms of perceptual decision making have been extensively studied in experimental settings that mimic stable environments with repeating stimuli, fixed rules, and payoffs. In contrast, we live in an ever-changing environment and have varying goals and behavioral demands. To accommodate variability, our brain flexibly adjusts decision-making processes depending on context. Here, we review a growing body of research that explores the neural mechanisms underlying this flexibility. We highlight diverse forms of context dependency in decision making implemented through a variety of neural computations. Context-dependent neural activity is observed in a distributed network of brain structures, including posterior parietal, sensory, motor, and subcortical regions, as well as the prefrontal areas classically implicated in cognitive control. We propose that investigating the distributed network underlying flexible decisions is key to advancing our understanding and discuss a path forward for experimental and theoretical investigations.
Collapse
Affiliation(s)
- Gouki Okazawa
- Center for Neural Science, New York University, New York, NY, USA;
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Roozbeh Kiani
- Center for Neural Science, New York University, New York, NY, USA;
- Department of Psychology, New York University, New York, NY, USA
| |
Collapse
|
6
|
Drevet J, Drugowitsch J, Wyart V. Efficient stabilization of imprecise statistical inference through conditional belief updating. Nat Hum Behav 2022; 6:1691-1704. [PMID: 36138224 DOI: 10.1038/s41562-022-01445-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Accepted: 08/11/2022] [Indexed: 01/14/2023]
Abstract
Statistical inference is the optimal process for forming and maintaining accurate beliefs about uncertain environments. However, human inference comes with costs due to its associated biases and limited precision. Indeed, biased or imprecise inference can trigger variable beliefs and unwarranted changes in behaviour. Here, by studying decisions in a sequential categorization task based on noisy visual stimuli, we obtained converging evidence that humans reduce the variability of their beliefs by updating them only when the reliability of incoming sensory information is judged as sufficiently strong. Instead of integrating the evidence provided by all stimuli, participants actively discarded as much as a third of stimuli. This conditional belief updating strategy shows good test-retest reliability, correlates with perceptual confidence and explains human behaviour better than previously described strategies. This seemingly suboptimal strategy not only reduces the costs of imprecise computations but also, counterintuitively, increases the accuracy of resulting decisions.
Collapse
Affiliation(s)
- Julie Drevet
- Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et de la Recherche Médicale (Inserm), Paris, France.
- Département d'Études Cognitives, École Normale Supérieure, Université PSL, Paris, France.
| | - Jan Drugowitsch
- Department of Neurobiology, Harvard Medical School, Boston, MA, USA
| | - Valentin Wyart
- Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et de la Recherche Médicale (Inserm), Paris, France.
- Département d'Études Cognitives, École Normale Supérieure, Université PSL, Paris, France.
| |
Collapse
|
7
|
Lange RD, Haefner RM. Task-induced neural covariability as a signature of approximate Bayesian learning and inference. PLoS Comput Biol 2022; 18:e1009557. [PMID: 35259152 PMCID: PMC8963539 DOI: 10.1371/journal.pcbi.1009557] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 03/29/2022] [Accepted: 10/12/2021] [Indexed: 11/30/2022] Open
Abstract
Perception is often characterized computationally as an inference process in which uncertain or ambiguous sensory inputs are combined with prior expectations. Although behavioral studies have shown that observers can change their prior expectations in the context of a task, robust neural signatures of task-specific priors have been elusive. Here, we analytically derive such signatures under the general assumption that the responses of sensory neurons encode posterior beliefs that combine sensory inputs with task-specific expectations. Specifically, we derive predictions for the task-dependence of correlated neural variability and decision-related signals in sensory neurons. The qualitative aspects of our results are parameter-free and specific to the statistics of each task. The predictions for correlated variability also differ from predictions of classic feedforward models of sensory processing and are therefore a strong test of theories of hierarchical Bayesian inference in the brain. Importantly, we find that Bayesian learning predicts an increase in so-called “differential correlations” as the observer’s internal model learns the stimulus distribution, and the observer’s behavioral performance improves. This stands in contrast to classic feedforward encoding/decoding models of sensory processing, since such correlations are fundamentally information-limiting. We find support for our predictions in data from existing neurophysiological studies across a variety of tasks and brain areas. Finally, we show in simulation how measurements of sensory neural responses can reveal information about a subject’s internal beliefs about the task. Taken together, our results reinterpret task-dependent sources of neural covariability as signatures of Bayesian inference and provide new insights into their cause and their function. Perceptual decision-making has classically been studied in the context of feedforward encoding/ decoding models. Here, we derive predictions for the responses of sensory neurons under the assumption that the brain performs hierarchical Bayesian inference, including feedback signals that communicate task-specific prior expectations. Interestingly, those predictions stand in contrast to some of the conclusions drawn in the classic framework. In particular, we find that Bayesian learning predicts the increase of a type of correlated variability called “differential correlations” over the course of learning. Differential correlations limit information, and hence are seen as harmful in feedforward models. Since our results are also specific to the statistics of a given task, and since they hold under a wide class of theories about how Bayesian probabilities may be represented by neural responses, they constitute a strong test of the Bayesian Brain hypothesis. Our results can explain the task-dependence of correlated variability in prior studies and suggest a reason why these kinds of correlations are surprisingly common in empirical data. Interpreted in a probabilistic framework, correlated variability provides a window into an observer’s task-related beliefs.
Collapse
Affiliation(s)
- Richard D. Lange
- Brain and Cognitive Sciences, University of Rochester, Rochester, New York, United States of America
- Center for Visual Science, University of Rochester, Rochester, New York, United States of America
- * E-mail: (RDL); (RMH)
| | - Ralf M. Haefner
- Brain and Cognitive Sciences, University of Rochester, Rochester, New York, United States of America
- Center for Visual Science, University of Rochester, Rochester, New York, United States of America
- * E-mail: (RDL); (RMH)
| |
Collapse
|