1
|
Ma F, Lin H, Zhou J. Prediction, inference, and generalization in orbitofrontal cortex. Curr Biol 2025; 35:R266-R272. [PMID: 40199253 DOI: 10.1016/j.cub.2025.02.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/10/2025]
Abstract
Our understanding of the orbitofrontal cortex (OFC) has significantly evolved over the past few decades. This prefrontal region has been associated with a wide range of cognitive functions, including a popular view that it primarily signals the expected value of each possible option, allowing downstream areas to use these value signals for decision-making. However, the discovery of rich, task-related information within the OFC and its essential role in inference-based behaviors has shifted our perspective and led to the proposal that the OFC holds a cognitive map used by both humans and animals for making predictions and inferences. Recent studies have further shown that these cognitive maps can be abstracted and generalized, serving both immediate and future needs. In this review, we trace the research journey leading to these evolving insights, discuss the potential neural mechanisms supporting the OFC's roles in prediction, inference, and generalization, and compare the OFC with the hippocampus, another critical region for cognitive mapping, while also exploring the interactions between these two areas.
Collapse
Affiliation(s)
- Fengjun Ma
- Beijing Institute for Brain Research, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 102206, China; College of Biological Sciences, China Agricultural University, Beijing 100193, China; Chinese Institute for Brain Research, Beijing 102206, China
| | - Huixin Lin
- Beijing Institute for Brain Research, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 102206, China; Chinese Institute for Brain Research, Beijing 102206, China; Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China
| | - Jingfeng Zhou
- Chinese Institute for Brain Research, Beijing 102206, China; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
2
|
Mill RD, Cole MW. Dynamically shifting from compositional to conjunctive brain representations supports cognitive task learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2025:2023.06.27.546751. [PMID: 37425922 PMCID: PMC10327096 DOI: 10.1101/2023.06.27.546751] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
During cognitive task learning, neural representations must be rapidly constructed for novel task performance, then optimized for robust practiced task performance. How the geometry of neural representations changes to enable this transition from novel to practiced performance remains unknown. We hypothesized that practice involves a shift from compositional representations (task-general activity patterns that can be flexibly reused across tasks) to conjunctive representations (task-specific activity patterns specialized for the current task). Functional MRI during learning of multiple complex tasks substantiated this dynamic shift from compositional to conjunctive representations, which was associated with reduced cross-task interference (via pattern separation) and behavioral improvement. Further, we found that conjunctions originated in subcortex (hippocampus and cerebellum) and slowly spread to cortex, extending multiple memory systems theories to encompass cognitive task learning. The strengthening of conjunctive representations hence serves as a computational signature of learning, reflecting cortical-subcortical dynamics that optimize task representations in the human brain. Highlights Learning shifts multi-task representations from compositional to conjunctive formatsCortical conjunctions uniquely associate with improved behavior and pattern separationThese conjunctions strengthen over separated learning events and index switch costsSubcortical regions are critical for cross-region binding of task rule information.
Collapse
|
3
|
Wittmann MK, Lin Y, Pan D, Braun MN, Dickson C, Spiering L, Luo S, Harbison C, Abdurahman A, Hamilton S, Faber NS, Khalighinejad N, Lockwood PL, Rushworth MFS. Basis functions for complex social decisions in dorsomedial frontal cortex. Nature 2025:10.1038/s41586-025-08705-9. [PMID: 40074892 DOI: 10.1038/s41586-025-08705-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Accepted: 01/27/2025] [Indexed: 03/14/2025]
Abstract
Navigating social environments is a fundamental challenge for the brain. It has been established that the brain solves this problem, in part, by representing social information in an agent-centric manner; knowledge about others' abilities or attitudes is tagged to individuals such as 'oneself' or the 'other'1-6. This intuitive approach has informed the understanding of key nodes in the social parts of the brain, the dorsomedial prefrontal cortex (dmPFC) and the anterior cingulate cortex (ACC)7-9. However, the patterns or combinations in which individuals might interact with one another is as important as the identities of the individuals. Here, in four studies using functional magnetic resonance imaging, behavioural experiments and a social group decision-making task, we show that the dmPFC and ACC represent the combinatorial possibilities for social interaction afforded by a given situation, and that they do so in a compressed format resembling the basis functions used in spatial, visual and motor domains10-12. The basis functions align with social interaction types, as opposed to individual identities. Our results indicate that there are deep analogies between abstract neural coding schemes in the visual and motor domain and the construction of our sense of social identity.
Collapse
Affiliation(s)
- Marco K Wittmann
- Department of Experimental Psychology, University College London, London, UK.
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK.
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Yongling Lin
- Department of Experimental Psychology, University College London, London, UK
- State Key Laboratory of Cognitive Neuroscience and Learning, Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Deng Pan
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Moritz N Braun
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Department of Psychology, Saarland University, Saarbrücken, Germany
| | - Cormac Dickson
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
| | - Lisa Spiering
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Shuyi Luo
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Caroline Harbison
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Ayat Abdurahman
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Sorcha Hamilton
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Department of Psychiatry, University of Oxford, Oxford, UK
- Department of Psychology, University of Bath, Bath, UK
| | - Nadira S Faber
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Department of Psychology, University of Bremen, Bremen, Germany
- Uehiro Oxford Institute, University of Oxford, Oxford, UK
| | - Nima Khalighinejad
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Patricia L Lockwood
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
- Institute for Mental Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Matthew F S Rushworth
- Wellcome Integrative Neuroimaging (WIN), Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Integrative Neuroimaging (WIN), Centre for Functional MRI of the Brain (MRI), Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| |
Collapse
|
4
|
Bein O, Niv Y. Schemas, reinforcement learning and the medial prefrontal cortex. Nat Rev Neurosci 2025; 26:141-157. [PMID: 39775183 DOI: 10.1038/s41583-024-00893-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/03/2024] [Indexed: 01/11/2025]
Abstract
Schemas are rich and complex knowledge structures about the typical unfolding of events in a context; for example, a schema of a dinner at a restaurant. In this Perspective, we suggest that reinforcement learning (RL), a computational theory of learning the structure of the world and relevant goal-oriented behaviour, underlies schema learning. We synthesize literature about schemas and RL to offer that three RL principles might govern the learning of schemas: learning via prediction errors, constructing hierarchical knowledge using hierarchical RL, and dimensionality reduction through learning a simplified and abstract representation of the world. We then suggest that the orbitomedial prefrontal cortex is involved in both schemas and RL due to its involvement in dimensionality reduction and in guiding memory reactivation through interactions with posterior brain regions. Last, we hypothesize that the amount of dimensionality reduction might underlie gradients of involvement along the ventral-dorsal and posterior-anterior axes of the orbitomedial prefrontal cortex. More specific and detailed representations might engage the ventral and posterior parts, whereas abstraction might shift representations towards the dorsal and anterior parts of the medial prefrontal cortex.
Collapse
Affiliation(s)
- Oded Bein
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.
- Weill Cornell Institute of Geriatric Psychiatry, Department of Psychiatry, Weill Cornell Medicine, New York, NY, USA.
| | - Yael Niv
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
- Psychology Department, Princeton University, Princeton, NJ, USA
| |
Collapse
|
5
|
Liu Z, Zhang Y, Wen C, Yuan J, Zhang J, Seger CA. Emergence of Categorical Representations in Parietal and Ventromedial Prefrontal Cortex across Extended Training. J Neurosci 2025; 45:e1315242024. [PMID: 39746819 DOI: 10.1523/jneurosci.1315-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Revised: 12/09/2024] [Accepted: 12/15/2024] [Indexed: 01/04/2025] Open
Abstract
How do the neural representations underlying category learning change as skill develops? We examined perceptual category learning using a prototype learning task known to recruit a corticostriatal system including the posterior striatum, motor cortex, visual cortex, and intraparietal sulcus (IPS). Male and female human participants practiced categorizing stimuli as category members or nonmembers (A vs not-A) across 3 d, with fMRI data collected at the beginning and end. Univariate analyses found that corticostriatal activity in regions associated with habitual instrumental learning was recruited across both sessions, but activity in regions associated with goal-directed instrumental learning decreased from Day 1 to Day 3. Multivoxel pattern analysis (MVPA) indicated that after training, the trained category could be more easily decoded from the IPS when compared with a novel category. Representational similarity analysis (RSA) showed development of category representations in the IPS and motor cortex. In addition, RSA revealed evidence for category-related representations including prototype representation in the ventromedial prefrontal cortex which may reflect parallel development of schematic memory for the category structure. Overall, the results converge to show how performance of category decisions and representations of the category structure emerge after extensive training across the corticostriatal system underlying perceptual category learning.
Collapse
Affiliation(s)
- Zhiya Liu
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Yitao Zhang
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Chudan Wen
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Jingzhao Yuan
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Jingxian Zhang
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Carol A Seger
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China
- Key Laboratory of Brain, Cognition, and Education Sciences of the Ministry of Education, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
- Molecular, Cellular and Integrative Neurosciences Program, Department of Psychology, Colorado State University, Fort Collins, Colorado 80523
| |
Collapse
|
6
|
Kerrén C, Reznik D, Doeller CF, Griffiths BJ. Exploring the role of dimensionality transformation in episodic memory. Trends Cogn Sci 2025:S1364-6613(25)00021-X. [PMID: 39952797 DOI: 10.1016/j.tics.2025.01.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 01/20/2025] [Accepted: 01/20/2025] [Indexed: 02/17/2025]
Abstract
Episodic memory must accomplish two adversarial goals: encoding and storing a multitude of experiences without exceeding the finite neuronal structure of the brain, and recalling memories in vivid detail. Dimensionality reduction and expansion ('dimensionality transformation') enable the brain to meet these demands. Reduction compresses sensory input into simplified, storable codes, while expansion reconstructs vivid details. Although these processes are essential to memory, their neural mechanisms for episodic memory remain unclear. Drawing on recent insights from cognitive psychology, systems neuroscience, and neuroanatomy, we propose two accounts of how dimensionality transformation occurs in the brain: structurally (via corticohippocampal pathways) and functionally (through neural oscillations). By examining cross-species evidence, we highlight neural mechanisms that may support episodic memory and identify crucial questions for future research.
Collapse
Affiliation(s)
- Casper Kerrén
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Daniel Reznik
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Christian F Doeller
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Kavli Institute for Systems Neuroscience, Centre for Neural Computation, Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer's Disease, NTNU Norwegian University of Science and Technology, Trondheim, Norway
| | | |
Collapse
|
7
|
Luo X, Mok RM, Roads BD, Love BC. Coordinating multiple mental faculties during learning. Sci Rep 2025; 15:5319. [PMID: 39939457 PMCID: PMC11822098 DOI: 10.1038/s41598-025-89732-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2024] [Accepted: 02/07/2025] [Indexed: 02/14/2025] Open
Abstract
Complex behavior is supported by the coordination of multiple brain regions. How do brain regions coordinate absent a homunculus? We propose coordination is achieved by a controller-peripheral architecture in which peripherals (e.g., the ventral visual stream) aim to supply needed inputs to their controllers (e.g., the hippocampus and prefrontal cortex) while expending minimal resources. We developed a formal model within this framework to address how multiple brain regions coordinate to support rapid learning from a few example images. The model captured how higher-level activity in the controller shaped lower-level visual representations, affecting their precision and sparsity in a manner that paralleled brain measures. In particular, the peripheral encoded visual information to the extent needed to support the smooth operation of the controller. Alternative models optimized by gradient descent irrespective of architectural constraints could not account for human behavior or brain responses, and, typical of standard deep learning approaches, were unstable trial-by-trial learners. While previous work offered accounts of specific faculties, such as perception, attention, and learning, the controller-peripheral approach is a step toward addressing next generation questions concerning how multiple faculties coordinate.
Collapse
Affiliation(s)
- Xiaoliang Luo
- Department of Experimental Psychology, University College London, 26 Bedford Way, London, WC1H 0AP, UK.
| | - Robert M Mok
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Rd, Cambridge, CB2 7EF, UK
- Department of Psychology, Royal Holloway, University of London, Egham, TW20 0EX, UK
| | - Brett D Roads
- Department of Experimental Psychology, University College London, 26 Bedford Way, London, WC1H 0AP, UK
| | - Bradley C Love
- Department of Experimental Psychology, University College London, 26 Bedford Way, London, WC1H 0AP, UK
- The Alan Turing Institute, 96 Euston Rd, London, NW1 2DB, UK
| |
Collapse
|
8
|
Wang MC, Soltani A. Contributions of Attention to Learning in Multidimensional Reward Environments. J Neurosci 2025; 45:e2300232024. [PMID: 39681464 PMCID: PMC11823339 DOI: 10.1523/jneurosci.2300-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Revised: 10/09/2024] [Accepted: 11/08/2024] [Indexed: 12/18/2024] Open
Abstract
Real-world choice options have many features or attributes, whereas the reward outcome from those options only depends on a few features or attributes. It has been shown that humans learn and combine feature-based with more complex conjunction-based learning to tackle challenges of learning in naturalistic reward environments. However, it remains unclear how different learning strategies interact to determine what features or conjunctions should be attended to and control choice behavior, and how subsequent attentional modulations influence future learning and choice. To address these questions, we examined the behavior of male and female human participants during a three-dimensional learning task in which reward outcomes for different stimuli could be predicted based on a combination of an informative feature and conjunction. Using multiple approaches, we found that both choice behavior and reward probabilities estimated by participants were most accurately described by attention-modulated models that learned the predictive values of both the informative feature and the informative conjunction. Specifically, in the reinforcement learning model that best fit choice data, attention was controlled by the difference in the integrated feature and conjunction values. The resulting attention weights modulated learning by increasing the learning rate on attended features and conjunctions. Critically, modulating decision-making by attention weights did not improve the fit of data, providing little evidence for direct attentional effects on choice. These results suggest that in multidimensional environments, humans direct their attention not only to selectively process reward-predictive attributes but also to find parsimonious representations of the reward contingencies for more efficient learning.
Collapse
Affiliation(s)
- Michael Chong Wang
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover 03755, New Hampshire
| | - Alireza Soltani
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover 03755, New Hampshire
| |
Collapse
|
9
|
Stroud JP, Wojcik M, Jensen KT, Kusunoki M, Kadohisa M, Buckley MJ, Duncan J, Stokes MG, Lengyel M. Effects of noise and metabolic cost on cortical task representations. eLife 2025; 13:RP94961. [PMID: 39836111 PMCID: PMC11750133 DOI: 10.7554/elife.94961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2025] Open
Abstract
Cognitive flexibility requires both the encoding of task-relevant and the ignoring of task-irrelevant stimuli. While the neural coding of task-relevant stimuli is increasingly well understood, the mechanisms for ignoring task-irrelevant stimuli remain poorly understood. Here, we study how task performance and biological constraints jointly determine the coding of relevant and irrelevant stimuli in neural circuits. Using mathematical analyses and task-optimized recurrent neural networks, we show that neural circuits can exhibit a range of representational geometries depending on the strength of neural noise and metabolic cost. By comparing these results with recordings from primate prefrontal cortex (PFC) over the course of learning, we show that neural activity in PFC changes in line with a minimal representational strategy. Specifically, our analyses reveal that the suppression of dynamically irrelevant stimuli is achieved by activity-silent, sub-threshold dynamics. Our results provide a normative explanation as to why PFC implements an adaptive, minimal representational strategy.
Collapse
Affiliation(s)
- Jake Patrick Stroud
- Computational and Biological Learning Lab, Department of Engineering, University of CambridgeCambridgeUnited Kingdom
| | - Michal Wojcik
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - Kristopher Torp Jensen
- Computational and Biological Learning Lab, Department of Engineering, University of CambridgeCambridgeUnited Kingdom
| | - Makoto Kusunoki
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - Mikiko Kadohisa
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - Mark J Buckley
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - John Duncan
- MRC Cognition and Brain Sciences Unit, University of CambridgeCambridgeUnited Kingdom
| | - Mark G Stokes
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of OxfordOxfordUnited Kingdom
| | - Mate Lengyel
- Computational and Biological Learning Lab, Department of Engineering, University of CambridgeCambridgeUnited Kingdom
- Center for Cognitive Computation, Department of Cognitive Science, Central European UniversityBudapestHungary
| |
Collapse
|
10
|
Zhang M, Yu Q. The representation of abstract goals in working memory is supported by task-congruent neural geometry. PLoS Biol 2024; 22:e3002461. [PMID: 39700265 DOI: 10.1371/journal.pbio.3002461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 01/06/2025] [Accepted: 11/29/2024] [Indexed: 12/21/2024] Open
Abstract
Successful goal-directed behavior requires the maintenance and implementation of abstract task goals on concrete stimulus information in working memory. Previous working memory research has revealed distributed neural representations of task information across cortex. However, how the distributed task representations emerge and communicate with stimulus-specific information to implement flexible goal-directed computations is still unclear. Here, leveraging electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) in human participants along with state space analyses, we provided converging evidence in support of a low-dimensional neural geometry of goal information congruent with a designed task space, which first emerged in frontal cortex during goal maintenance and then transferred to posterior cortex through frontomedial-to-posterior theta coherence for implementation on stimulus-specific representations. Importantly, the fidelity of the goal geometry was associated with memory performance. Collectively, our findings suggest that abstract goals in working memory are represented in an organized, task-congruent neural geometry for communications from frontal to posterior cortex to enable computations necessary for goal-directed behaviors.
Collapse
Affiliation(s)
- Mengya Zhang
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Qing Yu
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| |
Collapse
|
11
|
Roads BD, Love BC. The Dimensions of dimensionality. Trends Cogn Sci 2024; 28:1118-1131. [PMID: 39153897 DOI: 10.1016/j.tics.2024.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 07/16/2024] [Accepted: 07/17/2024] [Indexed: 08/19/2024]
Abstract
Cognitive scientists often infer multidimensional representations from data. Whether the data involve text, neuroimaging, neural networks, or human judgments, researchers frequently infer and analyze latent representational spaces (i.e., embeddings). However, the properties of a latent representation (e.g., prediction performance, interpretability, compactness) depend on the inference procedure, which can vary widely across endeavors. For example, dimensions are not always globally interpretable and the dimensionality of different embeddings may not be readily comparable. Moreover, the dichotomy between multidimensional spaces and purportedly richer representational formats, such as graph representations, is misleading. We review what the different notions of dimension in cognitive science imply for how these latent representations should be used and interpreted.
Collapse
Affiliation(s)
- Brett D Roads
- Department of Experimental Psychology, University College London, London, WC1E, UK.
| | - Bradley C Love
- Department of Experimental Psychology, University College London, London, WC1E, UK
| |
Collapse
|
12
|
Moneta N, Grossman S, Schuck NW. Representational spaces in orbitofrontal and ventromedial prefrontal cortex: task states, values, and beyond. Trends Neurosci 2024; 47:1055-1069. [PMID: 39547861 DOI: 10.1016/j.tins.2024.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2024] [Revised: 10/16/2024] [Accepted: 10/17/2024] [Indexed: 11/17/2024]
Abstract
The orbitofrontal cortex (OFC) and ventromedial-prefrontal cortex (vmPFC) play a key role in decision-making and encode task states in addition to expected value. We review evidence suggesting a connection between value and state representations and argue that OFC / vmPFC integrate stimulus, context, and outcome information. Comparable encoding principles emerge in late layers of deep reinforcement learning (RL) models, where single nodes exhibit similar forms of mixed-selectivity, which enables flexible readout of relevant variables by downstream neurons. Based on these lines of evidence, we suggest that outcome-maximization leads to complex representational spaces that are insufficiently characterized by linear value signals that have been the focus of most prior research on the topic. Major outstanding questions concern the role of OFC/ vmPFC in learning across tasks, in encoding of task-irrelevant aspects, and the role of hippocampus-PFC interactions.
Collapse
Affiliation(s)
- Nir Moneta
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany; Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany.
| | - Shany Grossman
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany.
| | - Nicolas W Schuck
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195 Berlin, Germany.
| |
Collapse
|
13
|
Xie Y, Mack ML. Reconciling category exceptions through representational shifts. Psychon Bull Rev 2024; 31:2621-2633. [PMID: 38639836 DOI: 10.3758/s13423-024-02501-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/28/2024] [Indexed: 04/20/2024]
Abstract
Real-world categories often contain exceptions that disobey the perceptual regularities followed by other members. Prominent psychological and neurobiological theories indicate that exception learning relies on the flexible modulation of object representations, but the specific representational shifts key to learning remain poorly understood. Here, we leveraged behavioral and computational approaches to elucidate the representational dynamics during the acquisition of exceptions that violate established regularity knowledge. In our study, participants (n = 42) learned novel categories in which regular and exceptional items were introduced successively; we then fitted a computational model to individuals' categorization performance to infer latent stimulus representations before and after exception learning. We found that in the representational space, exception learning not only drove confusable exceptions to be differentiated from regular items, but also led exceptions within the same category to be integrated based on shared characteristics. These shifts resulted in distinct representational clusters of regular items and exceptions that constituted hierarchically structured category representations, and the distinct clustering of exceptions from regular items was associated with a high ability to generalize and reconcile knowledge of regularities and exceptions. Moreover, by having a second group of participants (n = 42) to judge stimuli's similarity before and after exception learning, we revealed misalignment between representational similarity and behavioral similarity judgments, which further highlights the hierarchical layouts of categories with regularities and exceptions. Altogether, our findings elucidate the representational dynamics giving rise to generalizable category structures that reconcile perceptually inconsistent category members, thereby advancing the understanding of knowledge formation.
Collapse
Affiliation(s)
- Yongzhen Xie
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - Michael L Mack
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| |
Collapse
|
14
|
Ruffini G, Castaldo F, Lopez-Sola E, Sanchez-Todo R, Vohryzek J. The Algorithmic Agent Perspective and Computational Neuropsychiatry: From Etiology to Advanced Therapy in Major Depressive Disorder. ENTROPY (BASEL, SWITZERLAND) 2024; 26:953. [PMID: 39593898 PMCID: PMC11592617 DOI: 10.3390/e26110953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Revised: 10/15/2024] [Accepted: 10/29/2024] [Indexed: 11/28/2024]
Abstract
Major Depressive Disorder (MDD) is a complex, heterogeneous condition affecting millions worldwide. Computational neuropsychiatry offers potential breakthroughs through the mechanistic modeling of this disorder. Using the Kolmogorov theory (KT) of consciousness, we developed a foundational model where algorithmic agents interact with the world to maximize an Objective Function evaluating affective valence. Depression, defined in this context by a state of persistently low valence, may arise from various factors-including inaccurate world models (cognitive biases), a dysfunctional Objective Function (anhedonia, anxiety), deficient planning (executive deficits), or unfavorable environments. Integrating algorithmic, dynamical systems, and neurobiological concepts, we map the agent model to brain circuits and functional networks, framing potential etiological routes and linking with depression biotypes. Finally, we explore how brain stimulation, psychotherapy, and plasticity-enhancing compounds such as psychedelics can synergistically repair neural circuits and optimize therapies using personalized computational models.
Collapse
Affiliation(s)
- Giulio Ruffini
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
| | - Francesca Castaldo
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
| | - Edmundo Lopez-Sola
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
| | - Roser Sanchez-Todo
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
| | - Jakub Vohryzek
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
- Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, Oxford OX3 9BX, UK
| |
Collapse
|
15
|
Zhang J, Li H, Qu J, Liu X, Feng X, Fu X, Mei L. Language proficiency is associated with neural representational dimensionality of semantic concepts. BRAIN AND LANGUAGE 2024; 258:105485. [PMID: 39388908 DOI: 10.1016/j.bandl.2024.105485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 09/28/2024] [Accepted: 10/04/2024] [Indexed: 10/12/2024]
Abstract
Previous studies suggest that semantic concepts are characterized by high-dimensional neural representations and that language proficiency affects semantic processing. However, it is not clear whether language proficiency modulates the dimensional representations of semantic concepts at the neural level. To address this question, the present study adopted principal component analysis (PCA) and representational similarity analysis (RSA) to examine the differences in representational dimensionalities (RDs) and in semantic representations between words in highly proficient (Chinese) and less proficient (English) language. PCA results revealed that language proficiency increased the dimensions of lexical representations in the left inferior frontal gyrus, temporal pole, inferior temporal gyrus, supramarginal gyrus, angular gyrus, and fusiform gyrus. RSA results further showed that these regions represented semantic information and that higher semantic representations were observed in highly proficient language relative to less proficient language. These results suggest that language proficiency is associated with the neural representational dimensionality of semantic concepts.
Collapse
Affiliation(s)
- Jingxian Zhang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Huiling Li
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Jing Qu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xiaoyu Liu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xiaoxue Feng
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xin Fu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Leilei Mei
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China.
| |
Collapse
|
16
|
Kikumoto A, Bhandari A, Shibata K, Badre D. A transient high-dimensional geometry affords stable conjunctive subspaces for efficient action selection. Nat Commun 2024; 15:8513. [PMID: 39353961 PMCID: PMC11445473 DOI: 10.1038/s41467-024-52777-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 09/18/2024] [Indexed: 10/03/2024] Open
Abstract
Flexible action selection requires cognitive control mechanisms capable of mapping the same inputs to different output actions depending on the context. From a neural state-space perspective, this requires a control representation that separates similar input neural states by context. Additionally, for action selection to be robust and time-invariant, information must be stable in time, enabling efficient readout. Here, using EEG decoding methods, we investigate how the geometry and dynamics of control representations constrain flexible action selection in the human brain. Participants performed a context-dependent action selection task. A forced response procedure probed action selection different states in neural trajectories. The result shows that before successful responses, there is a transient expansion of representational dimensionality that separated conjunctive subspaces. Further, the dynamics stabilizes in the same time window, with entry into this stable, high-dimensional state predictive of individual trial performance. These results establish the neural geometry and dynamics the human brain needs for flexible control over behavior.
Collapse
Affiliation(s)
- Atsushi Kikumoto
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US.
- RIKEN Center for Brain Science, Wako, Saitama, Japan.
| | - Apoorva Bhandari
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US
| | | | - David Badre
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US
- Carney Institute for Brain Science, Brown University, Providence, Rhode Island, US
| |
Collapse
|
17
|
Fleming SM, Shea N. Quality space computations for consciousness. Trends Cogn Sci 2024; 28:896-906. [PMID: 39025769 DOI: 10.1016/j.tics.2024.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 07/20/2024]
Abstract
The quality space hypothesis about conscious experience proposes that conscious sensory states are experienced in relation to other possible sensory states. For instance, the colour red is experienced as being more like orange, and less like green or blue. Recent empirical findings suggest that subjective similarity space can be explained in terms of similarities in neural activation patterns. Here, we consider how localist, workspace, and higher-order theories of consciousness can accommodate claims about the qualitative character of experience and functionally support a quality space. We review existing empirical evidence for each of these positions, and highlight novel experimental tools, such as altering local activation spaces via brain stimulation or behavioural training, that can distinguish these accounts.
Collapse
Affiliation(s)
- Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College London, London, UK; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK; Department of Experimental Psychology, University College London, London, UK; Canadian Institute for Advanced Research (CIFAR), Brain, Mind, and Consciousness Program, Toronto, ON, Canada.
| | - Nicholas Shea
- Institute of Philosophy, School of Advanced Study, University of London, London, UK; Faculty of Philosophy, University of Oxford, Oxford, UK.
| |
Collapse
|
18
|
Son G, Walther DB, Mack ML. Brief category learning distorts perceptual space for complex scenes. Psychon Bull Rev 2024; 31:2234-2248. [PMID: 38438711 DOI: 10.3758/s13423-024-02484-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2024] [Indexed: 03/06/2024]
Abstract
The formation of categories is known to distort perceptual space: representations are pushed away from category boundaries and pulled toward categorical prototypes. This phenomenon has been studied with artificially constructed objects, whose feature dimensions are easily defined and manipulated. How such category-induced perceptual distortions arise for complex, real-world scenes, however, remains largely unknown due to the technical challenge of measuring and controlling scene features. We address this question by generating realistic scene images from a high-dimensional continuous space using generative adversarial networks and using the images as stimuli in a novel learning task. Participants learned to categorize the scene images along arbitrary category boundaries and later reconstructed the same scenes from memory. Systematic biases in reconstruction errors closely tracked each participant's subjective category boundaries. These findings suggest that the perception of global scene properties is warped to align with a newly learned category structure after only a brief learning experience.
Collapse
Affiliation(s)
- Gaeun Son
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada.
| | - Dirk B Walther
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
19
|
Ezzyat Y, Clements A. Neural Activity Differentiates Novel and Learned Event Boundaries. J Neurosci 2024; 44:e2246232024. [PMID: 38871462 PMCID: PMC11411582 DOI: 10.1523/jneurosci.2246-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 04/22/2024] [Accepted: 05/25/2024] [Indexed: 06/15/2024] Open
Abstract
People parse continuous experiences at natural breakpoints called event boundaries, which is important for understanding an environment's causal structure and for responding to uncertainty within it. However, it remains unclear how different forms of uncertainty affect the parsing of continuous experiences and how such uncertainty influences the brain's processing of ongoing events. We exposed human participants of both sexes (N = 34) to a continuous sequence of semantically meaningless images. We generated sequences from random walks through a graph that grouped images into temporal communities. After learning, we asked participants to segment another sequence at natural breakpoints (event boundaries). Participants segmented the sequence at learned transitions between communities, as well as at novel transitions, suggesting that people can segment temporally extended experiences into events based on learned structure as well as prediction error. Greater segmentation at novel boundaries was associated with enhanced parietal scalp electroencephalography (EEG) activity between 250 and 450 ms after the stimulus onset. Multivariate classification of EEG activity showed that novel and learned boundaries evoked distinct patterns of neural activity, particularly theta band power in posterior electrodes. Learning also led to distinct neural representations for stimuli within the temporal communities, while neural activity at learned boundary nodes showed predictive evidence for the adjacent community. The data show that people segment experiences at both learned and novel boundaries and suggest that learned event boundaries trigger retrieval of information about the upcoming community that could underlie anticipation of the next event in a sequence.
Collapse
Affiliation(s)
- Youssef Ezzyat
- Department of Psychology, Wesleyan University, Middletown, Connecticut 06459
- Program in Neuroscience & Behavior, Wesleyan University, Middletown, Connecticut 06459
| | - Abby Clements
- Program in Neuroscience, Swarthmore College, Swarthmore, Pennsylvania 19081
| |
Collapse
|
20
|
Owen LLW, Manning JR. High-level cognition is supported by information-rich but compressible brain activity patterns. Proc Natl Acad Sci U S A 2024; 121:e2400082121. [PMID: 39178232 PMCID: PMC11363287 DOI: 10.1073/pnas.2400082121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 07/08/2024] [Indexed: 08/25/2024] Open
Abstract
To efficiently yet reliably represent and process information, our brains need to produce information-rich signals that differentiate between moments or cognitive states, while also being robust to noise or corruption. For many, though not all, natural systems, these two properties are often inversely related: More information-rich signals are less robust, and vice versa. Here, we examined how these properties change with ongoing cognitive demands. To this end, we applied dimensionality reduction algorithms and pattern classifiers to functional neuroimaging data collected as participants listened to a story, temporally scrambled versions of the story, or underwent a resting state scanning session. We considered two primary aspects of the neural data recorded in these different experimental conditions. First, we treated the maximum achievable decoding accuracy across participants as an indicator of the "informativeness" of the recorded patterns. Second, we treated the number of features (components) required to achieve a threshold decoding accuracy as a proxy for the "compressibility" of the neural patterns (where fewer components indicate greater compression). Overall, we found that the peak decoding accuracy (achievable without restricting the numbers of features) was highest in the intact (unscrambled) story listening condition. However, the number of features required to achieve comparable classification accuracy was also lowest in the intact story listening condition. Taken together, our work suggests that our brain networks flexibly reconfigure according to ongoing task demands and that the activity patterns associated with higher-order cognition and high engagement are both more informative and more compressible than the activity patterns associated with lower-order tasks and lower engagement.
Collapse
Affiliation(s)
- Lucy L. W. Owen
- Department of Psychiatry and Human Behavior, Carney Institute for Brain Sciences, Brown University, Providence, RI02906
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH03755
- Department of Computer Science, University of Montana, Missoula, MT59812
| | - Jeremy R. Manning
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH03755
| |
Collapse
|
21
|
Broschard MB, Turner BM, Tranel D, Freeman JH. Dissociable Roles of the Dorsolateral and Ventromedial Prefrontal Cortex in Human Categorization. J Neurosci 2024; 44:e2343232024. [PMID: 38997159 PMCID: PMC11340282 DOI: 10.1523/jneurosci.2343-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 06/21/2024] [Accepted: 06/27/2024] [Indexed: 07/14/2024] Open
Abstract
Models of human categorization predict the prefrontal cortex (PFC) serves a central role in category learning. The dorsolateral prefrontal cortex (dlPFC) and ventromedial prefrontal cortex (vmPFC) have been implicated in categorization; however, it is unclear whether both are critical for categorization and whether they support unique functions. We administered three categorization tasks to patients with PFC lesions (mean age, 69.6 years; 5 men, 5 women) to examine how the prefrontal subregions contribute to categorization. These included a rule-based (RB) task that was solved via a unidimensional rule, an information integration (II) task that was solved by combining information from two stimulus dimensions, and a deterministic/probabilistic (DP) task with stimulus features that had varying amounts of category-predictive information. Compared with healthy comparison participants, both patient groups had impaired performance. Impairments in the dlPFC patients were largest during the RB task, whereas impairments in the vmPFC patients were largest during the DP task. A hierarchical model was fit to the participants' data to assess learning deficits in the patient groups. PFC damage was correlated with a regularization term that limited updates to attention after each trial. Our results suggest that the PFC, as a whole, is important for learning to orient attention to relevant stimulus information. The dlPFC may be especially important for rule-based learning, whereas the vmPFC may be important for focusing attention on deterministic (highly diagnostic) features and ignoring less predictive features. These results support overarching functions of the dlPFC in executive functioning and the vmPFC in value-based decision-making.
Collapse
Affiliation(s)
- Matthew B Broschard
- The Picower Institute of Learning and Memory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
| | - Brandon M Turner
- Department of Psychology, The Ohio State University, Columbus, Ohio 43210
| | - Daniel Tranel
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
- Department of Neurology, University of Iowa, Iowa City, Iowa 52242
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
| |
Collapse
|
22
|
Broschard MB, Kim J, Love BC, Halverson HE, Freeman JH. Disrupting dorsal hippocampus impairs category learning in rats. Neurobiol Learn Mem 2024; 212:107941. [PMID: 38768684 DOI: 10.1016/j.nlm.2024.107941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 03/19/2024] [Accepted: 05/16/2024] [Indexed: 05/22/2024]
Abstract
Categorization requires a balance of mechanisms that can generalize across common features and discriminate against specific details. A growing literature suggests that the hippocampus may accomplish these mechanisms by using fundamental mechanisms like pattern separation, pattern completion, and memory integration. Here, we assessed the role of the rodent dorsal hippocampus (HPC) in category learning by combining inhibitory DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and simulations using a neural network model. Using touchscreens, we trained rats to categorize distributions of visual stimuli containing black and white gratings that varied along two continuous dimensions. Inactivating the dorsal HPC impaired category learning and generalization, suggesting that the rodent HPC plays an important role during categorization. Hippocampal inactivation had no effect on a control discrimination task that used identical trial procedures as the categorization tasks, suggesting that the impairments were specific to categorization. Model simulations were conducted with variants of a neural network to assess the impact of selective deficits on category learning. The hippocampal inactivation groups were best explained by a model that injected random noise into the computation that compared the similarity between category stimuli and existing memory representations. This model is akin to a deficit in mechanisms of pattern completion, which retrieves similar memory representations using partial information.
Collapse
Affiliation(s)
- Matthew B Broschard
- The Picower Institute of Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA; Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA
| | - Jangjin Kim
- Department of Psychology, Kyungpool National University, Daegu, South Korea
| | - Bradley C Love
- Department of Experimental Psychology and The Alan Turing Institute, University College London, London, UK
| | - Hunter E Halverson
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA.
| |
Collapse
|
23
|
Holton E, Grohn J, Ward H, Manohar SG, O'Reilly JX, Kolling N. Goal commitment is supported by vmPFC through selective attention. Nat Hum Behav 2024; 8:1351-1365. [PMID: 38632389 PMCID: PMC11272579 DOI: 10.1038/s41562-024-01844-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 02/01/2024] [Indexed: 04/19/2024]
Abstract
When striking a balance between commitment to a goal and flexibility in the face of better options, people often demonstrate strong goal perseveration. Here, using functional MRI (n = 30) and lesion patient (n = 26) studies, we argue that the ventromedial prefrontal cortex (vmPFC) drives goal commitment linked to changes in goal-directed selective attention. Participants performed an incremental goal pursuit task involving sequential decisions between persisting with a goal versus abandoning progress for better alternative options. Individuals with stronger goal perseveration showed higher goal-directed attention in an interleaved attention task. Increasing goal-directed attention also affected abandonment decisions: while pursuing a goal, people lost their sensitivity to valuable alternative goals while remaining more sensitive to changes in the current goal. In a healthy population, individual differences in both commitment biases and goal-oriented attention were predicted by baseline goal-related activity in the vmPFC. Among lesion patients, vmPFC damage reduced goal commitment, leading to a performance benefit.
Collapse
Affiliation(s)
- Eleanor Holton
- Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Jan Grohn
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
| | - Harry Ward
- Centre for Experimental Medicine and Rheumatology, Queen Mary University London (QMUL), London, UK
| | - Sanjay G Manohar
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Jill X O'Reilly
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
| | - Nils Kolling
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
- Stem Cell and Brain Research Institute U1208, Inserm, Université Claude Bernard Lyon 1, Bron, France
| |
Collapse
|
24
|
Chen F, Li P, Chen H, Seger CA, Liu Z. Prototype or Exemplar Representations in the 5/5 Category Learning Task. Behav Sci (Basel) 2024; 14:470. [PMID: 38920801 PMCID: PMC11200643 DOI: 10.3390/bs14060470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 05/22/2024] [Accepted: 05/29/2024] [Indexed: 06/27/2024] Open
Abstract
Theories of category learning have typically focused on how the underlying category structure affects the category representations acquired by learners. However, there is limited research as to how other factors affect what representations are learned and utilized and how representations might change across the time course of learning. We used a novel "5/5" categorization task developed from the well-studied 5/4 task with the addition of one more stimulus to clarify an ambiguity in the 5/4 prototypes. We used multiple methods including computational modeling to identify whether participants categorized on the basis of exemplar or prototype representations. We found that, overall, for the stimuli we used (schematic robot-like stimuli), learning was best characterized by the use of prototypes. Most importantly, we found that relative use of prototype and exemplar strategies changed across learning, with use of exemplar representations decreasing and prototype representations increasing across blocks.
Collapse
Affiliation(s)
- Fang Chen
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
- Department of Psychology, College of Education and Sports Sciences, Yangtze University, Jingzhou 434023, China
| | - Peijuan Li
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| | - Hao Chen
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| | - Carol A. Seger
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
- Department of Psychology, Molecular, Cellular and Integrative Neurosciences Program, Colorado State University, Fort Collins, CO 80523, USA
| | - Zhiya Liu
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| |
Collapse
|
25
|
Zhou D, Bornstein AM. Expanding horizons in reinforcement learning for curious exploration and creative planning. Behav Brain Sci 2024; 47:e118. [PMID: 38770877 DOI: 10.1017/s0140525x23003394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Curiosity and creativity are expressions of the trade-off between leveraging that with which we are familiar or seeking out novelty. Through the computational lens of reinforcement learning, we describe how formulating the value of information seeking and generation via their complementary effects on planning horizons formally captures a range of solutions to striking this balance.
Collapse
Affiliation(s)
- Dale Zhou
- Neurobiology and Behavior, 519 Biological Sciences Quad, University of California, Irvine, CA, USA ://dalezhou.com
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
| | - Aaron M Bornstein
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
- Department of Cognitive Sciences, 2318 Social & Behavioral Sciences Gateway, University of California, Irvine, CA, USA
| |
Collapse
|
26
|
Qu C, Huang Y, Philippe R, Cai S, Derrington E, Moisan F, Shi M, Dreher JC. Transcranial direct current stimulation suggests a causal role of the medial prefrontal cortex in learning social hierarchy. Commun Biol 2024; 7:304. [PMID: 38461216 PMCID: PMC10924847 DOI: 10.1038/s42003-024-05976-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 02/27/2024] [Indexed: 03/11/2024] Open
Abstract
Social hierarchies can be inferred through observational learning of social relationships between individuals. Yet, little is known about the causal role of specific brain regions in learning hierarchies. Here, using transcranial direct current stimulation, we show a causal role of the medial prefrontal cortex (mPFC) in learning social versus non-social hierarchies. In a Training phase, participants acquired knowledge about social and non-social hierarchies by trial and error. During a Test phase, they were presented with two items from hierarchies that were never encountered together, requiring them to make transitive inferences. Anodal stimulation over mPFC impaired social compared with non-social hierarchy learning, and this modulation was influenced by the relative social rank of the members (higher or lower status). Anodal stimulation also impaired transitive inference making, but only during early blocks before learning was established. Together, these findings demonstrate a causal role of the mPFC in learning social ranks by observation.
Collapse
Affiliation(s)
- Chen Qu
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Yulong Huang
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Rémi Philippe
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France
- Université Claude Bernard Lyon 1, Lyon, France
| | - Shenggang Cai
- School of Economics and Management, South China Normal University, Guangzhou, China
- Key Lab for Behavioral Economic Science & Technology, South China Normal University, Guangzhou, China
| | - Edmund Derrington
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France
- Université Claude Bernard Lyon 1, Lyon, France
| | | | - Mengke Shi
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Jean-Claude Dreher
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France.
- Université Claude Bernard Lyon 1, Lyon, France.
| |
Collapse
|
27
|
Qiu L, Li H, Ma M, Fang C. Effect of antibiotic exposure on the characteristics of activated sludge in a landfill leachate biological treatment system. ENVIRONMENTAL TECHNOLOGY 2024; 45:1596-1607. [PMID: 36377722 DOI: 10.1080/09593330.2022.2148568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 11/09/2022] [Indexed: 06/16/2023]
Abstract
Changes in the activated sludge performance in an anaerobic/aerobic biological treatment system for leachate was discussed under the condition of tetracycline (TC) exposure. The results show that a low concentration of TC did not have an obvious effect on the removal of chemical oxygen demand (COD) while a high concentration of TC had a certain promoting effect. Under the stimulation of TC, the particle size distribution of anaerobic/aerobic sludge tended to be more uniform, the particle size of anaerobic sludge decreased while the settleability increased; however, the particle size of aerobic sludge increased due to bulking. With the addition of TC, the concentration of most heavy metal ions in sludge samples increased.TC exposure results in the release of a large amount of extracellular polymeric substances (EPS), thus leading to a smoother surface of anaerobic sludge and a rougher surface of aerobic sludge. The high removal efficiency of COD under the high concentration of TC was also presumed to be due to EPS promoting the microbial absorption of anaerobic substances in the leachate. The results clearly showed that TC had a bacteriostatic effect. After antibiotic exposure, the abundance and diversity index of bacteria in each reactor decreased obviously, the microbial community evolved, and the dominant species at the genus and phylum levels of anaerobic/aerobic reactors changed. This study provides a better understanding the effect of TC on activated sludge and has reference value for the management of antibiotic exposure in leachate treatment facilities.
Collapse
Affiliation(s)
- Libo Qiu
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| | - Hong Li
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| | - Mengfei Ma
- College of Civil Engineering, Southeast University, Nanjing, People's Republic of China
| | - Chengran Fang
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| |
Collapse
|
28
|
Spens E, Burgess N. A generative model of memory construction and consolidation. Nat Hum Behav 2024; 8:526-543. [PMID: 38242925 PMCID: PMC10963272 DOI: 10.1038/s41562-023-01799-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 12/05/2023] [Indexed: 01/21/2024]
Abstract
Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.
Collapse
Affiliation(s)
- Eleanor Spens
- UCL Institute of Cognitive Neuroscience, University College London, London, UK.
| | - Neil Burgess
- UCL Institute of Cognitive Neuroscience, University College London, London, UK.
- UCL Queen Square Institute of Neurology, University College London, London, UK.
| |
Collapse
|
29
|
Zheng L, Gao Z, Doner S, Oyao A, Forloines M, Grilli MD, Barnes CA, Ekstrom AD. Hippocampal contributions to novel spatial learning are both age-related and age-invariant. Proc Natl Acad Sci U S A 2023; 120:e2307884120. [PMID: 38055735 PMCID: PMC10723126 DOI: 10.1073/pnas.2307884120] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 10/30/2023] [Indexed: 12/08/2023] Open
Abstract
Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional MRI of the medial temporal lobes. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.
Collapse
Affiliation(s)
- Li Zheng
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Zhiyao Gao
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA94305
| | - Stephanie Doner
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Alexis Oyao
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Martha Forloines
- Alzheimer’s Disease Center, Department of Neurology, University of California, Davis, Sacramento, CA95816
| | - Matthew D. Grilli
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| | - Carol A. Barnes
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| | - Arne D. Ekstrom
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| |
Collapse
|
30
|
Sučević J, Schapiro AC. A neural network model of hippocampal contributions to category learning. eLife 2023; 12:e77185. [PMID: 38079351 PMCID: PMC10712951 DOI: 10.7554/elife.77185] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Accepted: 11/06/2023] [Indexed: 12/18/2023] Open
Abstract
In addition to its critical role in encoding individual episodes, the hippocampus is capable of extracting regularities across experiences. This ability is central to category learning, and a growing literature indicates that the hippocampus indeed makes important contributions to this form of learning. Using a neural network model that mirrors the anatomy of the hippocampus, we investigated the mechanisms by which the hippocampus may support novel category learning. We simulated three category learning paradigms and evaluated the network's ability to categorize and recognize specific exemplars in each. We found that the trisynaptic pathway within the hippocampus-connecting entorhinal cortex to dentate gyrus, CA3, and CA1-was critical for remembering exemplar-specific information, reflecting the rapid binding and pattern separation capabilities of this circuit. The monosynaptic pathway from entorhinal cortex to CA1, in contrast, specialized in detecting the regularities that define category structure across exemplars, supported by the use of distributed representations and a relatively slower learning rate. Together, the simulations provide an account of how the hippocampus and its constituent pathways support novel category learning.
Collapse
Affiliation(s)
- Jelena Sučević
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - Anna C Schapiro
- Department of Psychology, University of PennsylvaniaPhiladelphiaUnited States
| |
Collapse
|
31
|
Zheng L, Gao Z, Doner S, Oyao A, Forloines M, Grilli MD, Barnes CA, Ekstrom AD. Hippocampal contributions to novel spatial learning are both age-related and age-invariant. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.28.546918. [PMID: 37425879 PMCID: PMC10326977 DOI: 10.1101/2023.06.28.546918] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional magnetic resonance imaging (fMRI) of the medial temporal lobe. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.
Collapse
Affiliation(s)
- Li Zheng
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Zhiyao Gao
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94305
| | - Stephanie Doner
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Alexis Oyao
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Martha Forloines
- Alzheimer s Disease Center, Department of Neurology, University of California, Davis, Sacramento, CA 95816
| | - Matthew D Grilli
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| | - Carol A Barnes
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| | - Arne D Ekstrom
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| |
Collapse
|
32
|
Mok RM, Love BC. A multilevel account of hippocampal function in spatial and concept learning: Bridging models of behavior and neural assemblies. SCIENCE ADVANCES 2023; 9:eade6903. [PMID: 37478189 PMCID: PMC10361583 DOI: 10.1126/sciadv.ade6903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 06/20/2023] [Indexed: 07/23/2023]
Abstract
A complete neuroscience requires multilevel theories that address phenomena ranging from higher-level cognitive behaviors to activities within a cell. We propose an extension to the level of mechanism approach where a computational model of cognition sits in between behavior and brain: It explains the higher-level behavior and can be decomposed into lower-level component mechanisms to provide a richer understanding of the system than any level alone. Toward this end, we decomposed a cognitive model into neuron-like units using a neural flocking approach that parallels recurrent hippocampal activity. Neural flocking coordinates units that collectively form higher-level mental constructs. The decomposed model suggested how brain-scale neural populations coordinate to form assemblies encoding concept and spatial representations and why so many neurons are needed for robust performance at the cognitive level. This multilevel explanation provides a way to understand how cognition and symbol-like representations are supported by coordinated neural populations (assemblies) formed through learning.
Collapse
Affiliation(s)
- Robert M. Mok
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge CB2 7EF, UK
| | - Bradley C. Love
- UCL Department of Experimental Psychology, 26 Bedford Way, London WC1H 0AP, UK
- The Alan Turing Institute, London, United Kingdom
| |
Collapse
|
33
|
Shine JM, Lewis LD, Garrett DD, Hwang K. The impact of the human thalamus on brain-wide information processing. Nat Rev Neurosci 2023; 24:416-430. [PMID: 37237103 DOI: 10.1038/s41583-023-00701-0] [Citation(s) in RCA: 85] [Impact Index Per Article: 42.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/30/2023] [Indexed: 05/28/2023]
Abstract
The thalamus is a small, bilateral structure in the diencephalon that integrates signals from many areas of the CNS. This critical anatomical position allows the thalamus to influence whole-brain activity and adaptive behaviour. However, traditional research paradigms have struggled to attribute specific functions to the thalamus, and it has remained understudied in the human neuroimaging literature. Recent advances in analytical techniques and increased accessibility to large, high-quality data sets have brought forth a series of studies and findings that (re-)establish the thalamus as a core region of interest in human cognitive neuroscience, a field that otherwise remains cortico-centric. In this Perspective, we argue that using whole-brain neuroimaging approaches to investigate the thalamus and its interaction with the rest of the brain is key for understanding systems-level control of information processing. To this end, we highlight the role of the thalamus in shaping a range of functional signatures, including evoked activity, interregional connectivity, network topology and neuronal variability, both at rest and during the performance of cognitive tasks.
Collapse
Affiliation(s)
- James M Shine
- Brain and Mind Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Laura D Lewis
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA
| | - Douglas D Garrett
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, Germany
- Center for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany
| | - Kai Hwang
- Cognitive Control Collaborative, Department of Psychological and Brain Sciences, The University of Iowa, Iowa City, IA, USA.
- Department of Psychiatry, The University of Iowa, Iowa City, IA, USA.
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, USA.
| |
Collapse
|
34
|
Sherrill KR, Molitor RJ, Karagoz AB, Atyam M, Mack ML, Preston AR. Generalization of cognitive maps across space and time. Cereb Cortex 2023; 33:7971-7992. [PMID: 36977625 PMCID: PMC10492577 DOI: 10.1093/cercor/bhad092] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 02/24/2023] [Accepted: 02/25/2023] [Indexed: 03/30/2023] Open
Abstract
Prominent theories posit that associative memory structures, known as cognitive maps, support flexible generalization of knowledge across cognitive domains. Here, we evince a representational account of cognitive map flexibility by quantifying how spatial knowledge formed one day was used predictively in a temporal sequence task 24 hours later, biasing both behavior and neural response. Participants learned novel object locations in distinct virtual environments. After learning, hippocampus and ventromedial prefrontal cortex (vmPFC) represented a cognitive map, wherein neural patterns became more similar for same-environment objects and more discriminable for different-environment objects. Twenty-four hours later, participants rated their preference for objects from spatial learning; objects were presented in sequential triplets from either the same or different environments. We found that preference response times were slower when participants transitioned between same- and different-environment triplets. Furthermore, hippocampal spatial map coherence tracked behavioral slowing at the implicit sequence transitions. At transitions, predictive reinstatement of virtual environments decreased in anterior parahippocampal cortex. In the absence of such predictive reinstatement after sequence transitions, hippocampus and vmPFC responses increased, accompanied by hippocampal-vmPFC functional decoupling that predicted individuals' behavioral slowing after a transition. Collectively, these findings reveal how expectations derived from spatial experience generalize to support temporal prediction.
Collapse
Affiliation(s)
- Katherine R Sherrill
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX 78712, USA
| | - Robert J Molitor
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Ata B Karagoz
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Manasa Atyam
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, ON M5G 1E6, Canada
| | - Alison R Preston
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX 78712, USA
- Department of Psychology, University of Texas at Austin, Austin, TX 78712, USA
| |
Collapse
|
35
|
Rosenblau G, Frolichs K, Korn CW. A neuro-computational social learning framework to facilitate transdiagnostic classification and treatment across psychiatric disorders. Neurosci Biobehav Rev 2023; 149:105181. [PMID: 37062494 PMCID: PMC10236440 DOI: 10.1016/j.neubiorev.2023.105181] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 03/14/2023] [Accepted: 04/13/2023] [Indexed: 04/18/2023]
Abstract
Social deficits are among the core and most striking psychiatric symptoms, present in most psychiatric disorders. Here, we introduce a novel social learning framework, which consists of neuro-computational models that combine reinforcement learning with various types of social knowledge structures. We outline how this social learning framework can help specify and quantify social psychopathology across disorders and provide an overview of the brain regions that may be involved in this type of social learning. We highlight how this framework can specify commonalities and differences in the social psychopathology of individuals with autism spectrum disorder (ASD), personality disorders (PD), and major depressive disorder (MDD) and improve treatments on an individual basis. We conjecture that individuals with psychiatric disorders rely on rigid social knowledge representations when learning about others, albeit the nature of their rigidity and the behavioral consequences can greatly differ. While non-clinical cohorts tend to efficiently adapt social knowledge representations to relevant environmental constraints, psychiatric cohorts may rigidly stick to their preconceived notions or overly coarse knowledge representations during learning.
Collapse
Affiliation(s)
- Gabriela Rosenblau
- Department of Psychological and Brain Sciences, George Washington University, Washington DC, USA; Autism and Neurodevelopmental Disorders Institute, George Washington University, Washington DC, USA.
| | - Koen Frolichs
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany; Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Christoph W Korn
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany; Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
36
|
Moneta N, Garvert MM, Heekeren HR, Schuck NW. Task state representations in vmPFC mediate relevant and irrelevant value signals and their behavioral influence. Nat Commun 2023; 14:3156. [PMID: 37258534 PMCID: PMC10232498 DOI: 10.1038/s41467-023-38709-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 05/09/2023] [Indexed: 06/02/2023] Open
Abstract
The ventromedial prefrontal-cortex (vmPFC) is known to contain expected value signals that inform our choices. But expected values even for the same stimulus can differ by task. In this study, we asked how the brain flexibly switches between such value representations in a task-dependent manner. Thirty-five participants alternated between tasks in which either stimulus color or motion predicted rewards. We show that multivariate vmPFC signals contain a rich representation that includes the current task state or context (motion/color), the associated expected value, and crucially, the irrelevant value of the alternative context. We also find that irrelevant value representations in vmPFC compete with relevant value signals, interact with task-state representations and relate to behavioral signs of value competition. Our results shed light on vmPFC's role in decision making, bridging between its role in mapping observations onto the task states of a mental map, and computing expected values for multiple states.
Collapse
Affiliation(s)
- Nir Moneta
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany.
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany.
- Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany.
| | - Mona M Garvert
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103, Leipzig, Germany
| | - Hauke R Heekeren
- Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany
- Department of Education and Psychology, Freie Universität Berlin, 14195, Berlin, Germany
- Institute of Psychology, Universität Hamburg, 20146, Hamburg, Germany
| | - Nicolas W Schuck
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany.
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany.
- Institute of Psychology, Universität Hamburg, 20146, Hamburg, Germany.
| |
Collapse
|
37
|
Liu Z, Liao S, Seger CA. Rule and Exemplar-based Transfer in Category Learning. J Cogn Neurosci 2023; 35:628-644. [PMID: 36638230 DOI: 10.1162/jocn_a_01963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
We compared the neural systems involved in transfer to novel stimuli via rule application versus exemplar processing. Participants learned a categorization task involving abstraction of a complex rule and then categorized different types of transfer stimuli without feedback. Rule stimuli used new features and therefore could only be categorized using the rule. Exemplar stimuli included only one of the features necessary to apply the rule and therefore required participants to categorize based on similarity to individual previously learned category members. Consistent and inconsistent stimuli were formed so that both the rule and feature similarity indicated the same category (consistent) or opposite categories (inconsistent). We found that all conditions eliciting rule-based transfer recruited a medial prefrontal-anterior hippocampal network associated with schematic memory. In contrast, exemplar-based transfer recruited areas of the intraparietal sulcus associated with learning and executing stimulus-category mappings along with the posterior hippocampus. These results support theories of categorization that postulate complementary learning and generalization strategies based on schematic and exemplar mechanisms.
Collapse
Affiliation(s)
- Zhiya Liu
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China
| | - Siyao Liao
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China
| | - Carol A Seger
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Colorado State University, Department of Psychology, Molecular, Cellular and Integrative Neurosciences Program, Fort Collins, CO
| |
Collapse
|
38
|
Pettine WW, Raman DV, Redish AD, Murray JD. Human generalization of internal representations through prototype learning with goal-directed attention. Nat Hum Behav 2023; 7:442-463. [PMID: 36894642 DOI: 10.1038/s41562-023-01543-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Accepted: 01/31/2023] [Indexed: 03/11/2023]
Abstract
The world is overabundant with feature-rich information obscuring the latent causes of experience. How do people approximate the complexities of the external world with simplified internal representations that generalize to novel examples or situations? Theories suggest that internal representations could be determined by decision boundaries that discriminate between alternatives, or by distance measurements against prototypes and individual exemplars. Each provide advantages and drawbacks for generalization. We therefore developed theoretical models that leverage both discriminative and distance components to form internal representations via action-reward feedback. We then developed three latent-state learning tasks to test how humans use goal-oriented discrimination attention and prototypes/exemplar representations. The majority of participants attended to both goal-relevant discriminative features and the covariance of features within a prototype. A minority of participants relied only on the discriminative feature. Behaviour of all participants could be captured by parameterizing a model combining prototype representations with goal-oriented discriminative attention.
Collapse
Affiliation(s)
| | | | - A David Redish
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - John D Murray
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
39
|
Abstract
A schema refers to a structured body of prior knowledge that captures common patterns across related experiences. Schemas have been studied separately in the realms of episodic memory and spatial navigation across different species and have been grounded in theories of memory consolidation, but there has been little attempt to integrate our understanding across domains, particularly in humans. We propose that experiences during navigation with many similarly structured environments give rise to the formation of spatial schemas (for example, the expected layout of modern cities) that share properties with but are distinct from cognitive maps (for example, the memory of a modern city) and event schemas (such as expected events in a modern city) at both cognitive and neural levels. We describe earlier theoretical frameworks and empirical findings relevant to spatial schemas, along with more targeted investigations of spatial schemas in human and non-human animals. Consideration of architecture and urban analytics, including the influence of scale and regionalization, on different properties of spatial schemas may provide a powerful approach to advance our understanding of spatial schemas.
Collapse
|
40
|
Labek K, Sittenberger E, Kienhöfer V, Rabl L, Messina I, Schurz M, Stingl JC, Viviani R. The gradient model of brain organization in decisions involving “empathy for pain”. Cereb Cortex 2022; 33:5839-5850. [PMID: 36537039 DOI: 10.1093/cercor/bhac464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2022] [Revised: 09/20/2022] [Accepted: 09/26/2022] [Indexed: 12/24/2022] Open
Abstract
Abstract
Influential models of cortical organization propose a close relationship between heteromodal association areas and highly connected hubs in the default mode network. The “gradient model” of cortical organization proposes a close relationship between these areas and highly connected hubs in the default mode network, a set of cortical areas deactivated by demanding tasks. Here, we used a decision-making task and representational similarity analysis with classic “empathy for pain” stimuli to probe the relationship between high-level representations of imminent pain in others and these areas. High-level representations were colocalized with task deactivations or the transitions from activations to deactivations. These loci belonged to 2 groups: those that loaded on the high end of the principal cortical gradient and were associated by meta-analytic decoding with the default mode network, and those that appeared to accompany functional repurposing of somatosensory cortex in the presence of visual stimuli. These findings suggest that task deactivations may set out cortical areas that host high-level representations. We anticipate that an increased understanding of the cortical correlates of high-level representations may improve neurobiological models of social interactions and psychopathology.
Collapse
Affiliation(s)
- Karin Labek
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
| | - Elisa Sittenberger
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Valerie Kienhöfer
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Luna Rabl
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Irene Messina
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
- Scienze e Tecniche Psicologiche,Universitas Mercatorum , Piazza Mattei 10, 00186 Rome , Italy
| | - Matthias Schurz
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Innsbruck Digital Science Center (DiSC), , Innrain 15, 6020 Innsbruck , Austria
| | - Julia C Stingl
- University Clinic Aachen Clinical Pharmacology, , Wendlingweg 2, 52074 Aachen , Germany
| | - Roberto Viviani
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| |
Collapse
|
41
|
Structure learning enhances concept formation in synthetic Active Inference agents. PLoS One 2022; 17:e0277199. [PMID: 36374909 PMCID: PMC9662737 DOI: 10.1371/journal.pone.0277199] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 10/24/2022] [Indexed: 11/16/2022] Open
Abstract
Humans display astonishing skill in learning about the environment in which they operate. They assimilate a rich set of affordances and interrelations among different elements in particular contexts, and form flexible abstractions (i.e., concepts) that can be generalised and leveraged with ease. To capture these abilities, we present a deep hierarchical Active Inference model of goal-directed behaviour, and the accompanying belief update schemes implied by maximising model evidence. Using simulations, we elucidate the potential mechanisms that underlie and influence concept learning in a spatial foraging task. We show that the representations formed–as a result of foraging–reflect environmental structure in a way that is enhanced and nuanced by Bayesian model reduction, a special case of structure learning that typifies learning in the absence of new evidence. Synthetic agents learn associations and form concepts about environmental context and configuration as a result of inferential, parametric learning, and structure learning processes–three processes that can produce a diversity of beliefs and belief structures. Furthermore, the ensuing representations reflect symmetries for environments with identical configurations.
Collapse
|
42
|
Safron A, Çatal O, Verbelen T. Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition. Front Syst Neurosci 2022; 16:787659. [PMID: 36246500 PMCID: PMC9563348 DOI: 10.3389/fnsys.2022.787659] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 09/02/2022] [Indexed: 11/24/2022] Open
Abstract
Simultaneous localization and mapping (SLAM) represents a fundamental problem for autonomous embodied systems, for which the hippocampal/entorhinal system (H/E-S) has been optimized over the course of evolution. We have developed a biologically-inspired SLAM architecture based on latent variable generative modeling within the Free Energy Principle and Active Inference (FEP-AI) framework, which affords flexible navigation and planning in mobile robots. We have primarily focused on attempting to reverse engineer H/E-S "design" properties, but here we consider ways in which SLAM principles from robotics may help us better understand nervous systems and emergent minds. After reviewing LatentSLAM and notable features of this control architecture, we consider how the H/E-S may realize these functional properties not only for physical navigation, but also with respect to high-level cognition understood as generalized simultaneous localization and mapping (G-SLAM). We focus on loop-closure, graph-relaxation, and node duplication as particularly impactful architectural features, suggesting these computational phenomena may contribute to understanding cognitive insight (as proto-causal-inference), accommodation (as integration into existing schemas), and assimilation (as category formation). All these operations can similarly be describable in terms of structure/category learning on multiple levels of abstraction. However, here we adopt an ecological rationality perspective, framing H/E-S functions as orchestrating SLAM processes within both concrete and abstract hypothesis spaces. In this navigation/search process, adaptive cognitive equilibration between assimilation and accommodation involves balancing tradeoffs between exploration and exploitation; this dynamic equilibrium may be near optimally realized in FEP-AI, wherein control systems governed by expected free energy objective functions naturally balance model simplicity and accuracy. With respect to structure learning, such a balance would involve constructing models and categories that are neither too inclusive nor exclusive. We propose these (generalized) SLAM phenomena may represent some of the most impactful sources of variation in cognition both within and between individuals, suggesting that modulators of H/E-S functioning may potentially illuminate their adaptive significances as fundamental cybernetic control parameters. Finally, we discuss how understanding H/E-S contributions to G-SLAM may provide a unifying framework for high-level cognition and its potential realization in artificial intelligences.
Collapse
Affiliation(s)
- Adam Safron
- Center for Psychedelic and Consciousness Research, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Cognitive Science Program, Indiana University, Bloomington, IN, United States
- Institute for Advanced Consciousness Studies, Santa Monica, CA, United States
| | - Ozan Çatal
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| | - Tim Verbelen
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| |
Collapse
|
43
|
Gao Z, Zheng L, Krieger-Redwood K, Halai A, Margulies DS, Smallwood J, Jefferies E. Flexing the principal gradient of the cerebral cortex to suit changing semantic task demands. eLife 2022; 11:e80368. [PMID: 36169281 PMCID: PMC9555860 DOI: 10.7554/elife.80368] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 09/27/2022] [Indexed: 11/13/2022] Open
Abstract
Understanding how thought emerges from the topographical structure of the cerebral cortex is a primary goal of cognitive neuroscience. Recent work has revealed a principal gradient of intrinsic connectivity capturing the separation of sensory-motor cortex from transmodal regions of the default mode network (DMN); this is thought to facilitate memory-guided cognition. However, studies have not explored how this dimension of connectivity changes when conceptual retrieval is controlled to suit the context. We used gradient decomposition of informational connectivity in a semantic association task to establish how the similarity in connectivity across brain regions changes during familiar and more original patterns of retrieval. Multivoxel activation patterns at opposite ends of the principal gradient were more divergent when participants retrieved stronger associations; therefore, when long-term semantic information is sufficient for ongoing cognition, regions supporting heteromodal memory are functionally separated from sensory-motor experience. In contrast, when less related concepts were linked, this dimension of connectivity was reduced in strength as semantic control regions separated from the DMN to generate more flexible and original responses. We also observed fewer dimensions within the neural response towards the apex of the principal gradient when strong associations were retrieved, reflecting less complex or varied neural coding across trials and participants. In this way, the principal gradient explains how semantic cognition is organised in the human cerebral cortex: the separation of DMN from sensory-motor systems is a hallmark of the retrieval of strong conceptual links that are culturally shared.
Collapse
Affiliation(s)
- Zhiyao Gao
- Department of Psychology, University of YorkNew YorkUnited Kingdom
| | - Li Zheng
- Department of Psychology, University of ArizonaTucsonUnited States
| | | | - Ajay Halai
- MRC Cognition and Brain Sciences Unit, University of CambridgeCambridgeUnited Kingdom
| | - Daniel S Margulies
- Integrative Neuroscience and Cognition Center (UMR 8002), Centre National de la Recherche ScientifiqueParisFrance
| | | | | |
Collapse
|
44
|
Pudhiyidath A, Morton NW, Viveros Duran R, Schapiro AC, Momennejad I, Hinojosa-Rowland DM, Molitor RJ, Preston AR. Representations of Temporal Community Structure in Hippocampus and Precuneus Predict Inductive Reasoning Decisions. J Cogn Neurosci 2022; 34:1736-1760. [PMID: 35579986 PMCID: PMC10262802 DOI: 10.1162/jocn_a_01864] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Our understanding of the world is shaped by inferences about underlying structure. For example, at the gym, you might notice that the same people tend to arrive around the same time and infer that they are friends that work out together. Consistent with this idea, after participants are presented with a temporal sequence of objects that follows an underlying community structure, they are biased to infer that objects from the same community share the same properties. Here, we used fMRI to measure neural representations of objects after temporal community structure learning and examine how these representations support inference about object relationships. We found that community structure learning affected inferred object similarity: When asked to spatially group items based on their experience, participants tended to group together objects from the same community. Neural representations in perirhinal cortex predicted individual differences in object grouping, suggesting that high-level object representations are affected by temporal community learning. Furthermore, participants were biased to infer that objects from the same community would share the same properties. Using computational modeling of temporal learning and inference decisions, we found that inductive reasoning is influenced by both detailed knowledge of temporal statistics and abstract knowledge of the temporal communities. The fidelity of temporal community representations in hippocampus and precuneus predicted the degree to which temporal community membership biased reasoning decisions. Our results suggest that temporal knowledge is represented at multiple levels of abstraction, and that perirhinal cortex, hippocampus, and precuneus may support inference based on this knowledge.
Collapse
|
45
|
Majumdar G, Yazin F, Banerjee A, Roy D. Emotion dynamics as hierarchical Bayesian inference in time. Cereb Cortex 2022; 33:3750-3772. [PMID: 36030379 DOI: 10.1093/cercor/bhac305] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 07/06/2022] [Accepted: 07/07/2022] [Indexed: 11/13/2022] Open
Abstract
What fundamental property of our environment would be most valuable and optimal in characterizing the emotional dynamics we experience in daily life? Empirical work has shown that an accurate estimation of uncertainty is necessary for our optimal perception, learning, and decision-making. However, the role of this uncertainty in governing our affective dynamics remains unexplored. Using Bayesian encoding, decoding and computational modeling, on a large-scale neuroimaging and behavioral data on a passive movie-watching task, we showed that emotions naturally arise due to ongoing uncertainty estimations about future outcomes in a hierarchical neural architecture. Several prefrontal subregions hierarchically encoded a lower-dimensional signal that highly correlated with the evolving uncertainty. Crucially, the lateral orbitofrontal cortex (lOFC) tracked the temporal fluctuations of this uncertainty and was predictive of the participants' predisposition to anxiety. Furthermore, we observed a distinct functional double-dissociation within OFC with increased connectivity between medial OFC and DMN, while with that of lOFC and FPN in response to the evolving affect. Finally, we uncovered a temporally predictive code updating an individual's beliefs spontaneously with fluctuating outcome uncertainty in the lOFC. A biologically relevant and computationally crucial parameter in the theories of brain function, we propose uncertainty to be central to the definition of complex emotions.
Collapse
Affiliation(s)
- Gargi Majumdar
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Fahd Yazin
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Arpan Banerjee
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Dipanjan Roy
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India.,Centre for Brain Science and Applications, School of AIDE, IIT Jodhpur, NH 62, Surpura Bypass Rd, Karwar, Rajasthan 342030, India
| |
Collapse
|
46
|
Sheng J, Zhang L, Liu C, Liu J, Feng J, Zhou Y, Hu H, Xue G. Higher-dimensional neural representations predict better episodic memory. SCIENCE ADVANCES 2022; 8:eabm3829. [PMID: 35442734 PMCID: PMC9020666 DOI: 10.1126/sciadv.abm3829] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
Episodic memory enables humans to encode and later vividly retrieve information about our rich experiences, yet the neural representations that support this mental capacity are poorly understood. Using a large fMRI dataset (n = 468) of face-name associative memory tasks and principal component analysis to examine neural representational dimensionality (RD), we found that the human brain maintained a high-dimensional representation of faces through hierarchical representation within and beyond the face-selective regions. Critically, greater RD was associated with better subsequent memory performance both within and across participants, and this association was specific to episodic memory but not general cognitive abilities. Furthermore, the frontoparietal activities could suppress the shared low-dimensional fluctuations and reduce the correlations of local neural responses, resulting in greater RD. RD was not associated with the degree of item-specific pattern similarity, and it made complementary contributions to episodic memory. These results provide a mechanistic understanding of the role of RD in supporting accurate episodic memory.
Collapse
|
47
|
Abstract
In human neuroscience, studies of cognition are rarely grounded in non-task-evoked, 'spontaneous' neural activity. Indeed, studies of spontaneous activity tend to focus predominantly on intrinsic neural patterns (for example, resting-state networks). Taking a 'representation-rich' approach bridges the gap between cognition and resting-state communities: this approach relies on decoding task-related representations from spontaneous neural activity, allowing quantification of the representational content and rich dynamics of such activity. For example, if we know the neural representation of an episodic memory, we can decode its subsequent replay during rest. We argue that such an approach advances cognitive research beyond a focus on immediate task demand and provides insight into the functional relevance of the intrinsic neural pattern (for example, the default mode network). This in turn enables a greater integration between human and animal neuroscience, facilitating experimental testing of theoretical accounts of intrinsic activity, and opening new avenues of research in psychiatry.
Collapse
|
48
|
Stiso J, Lynn CW, Kahn AE, Rangarajan V, Szymula KP, Archer R, Revell A, Stein JM, Litt B, Davis KA, Lucas TH, Bassett DS. Neurophysiological Evidence for Cognitive Map Formation during Sequence Learning. eNeuro 2022; 9:ENEURO.0361-21.2022. [PMID: 35105662 PMCID: PMC8896554 DOI: 10.1523/eneuro.0361-21.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 12/03/2021] [Accepted: 01/03/2022] [Indexed: 12/29/2022] Open
Abstract
Humans deftly parse statistics from sequences. Some theories posit that humans learn these statistics by forming cognitive maps, or underlying representations of the latent space which links items in the sequence. Here, an item in the sequence is a node, and the probability of transitioning between two items is an edge. Sequences can then be generated from walks through the latent space, with different spaces giving rise to different sequence statistics. Individual or group differences in sequence learning can be modeled by changing the time scale over which estimates of transition probabilities are built, or in other words, by changing the amount of temporal discounting. Latent space models with temporal discounting bear a resemblance to models of navigation through Euclidean spaces. However, few explicit links have been made between predictions from Euclidean spatial navigation and neural activity during human sequence learning. Here, we use a combination of behavioral modeling and intracranial encephalography (iEEG) recordings to investigate how neural activity might support the formation of space-like cognitive maps through temporal discounting during sequence learning. Specifically, we acquire human reaction times from a sequential reaction time task, to which we fit a model that formulates the amount of temporal discounting as a single free parameter. From the parameter, we calculate each individual's estimate of the latent space. We find that neural activity reflects these estimates mostly in the temporal lobe, including areas involved in spatial navigation. Similar to spatial navigation, we find that low-dimensional representations of neural activity allow for easy separation of important features, such as modules, in the latent space. Lastly, we take advantage of the high temporal resolution of iEEG data to determine the time scale on which latent spaces are learned. We find that learning typically happens within the first 500 trials, and is modulated by the underlying latent space and the amount of temporal discounting characteristic of each participant. Ultimately, this work provides important links between behavioral models of sequence learning and neural activity during the same behavior, and contextualizes these results within a broader framework of domain general cognitive maps.
Collapse
Affiliation(s)
- Jennifer Stiso
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Christopher W Lynn
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY 10016
- Joseph Henry Laboratories of Physics, Princeton University, Princeton, NJ 08544
| | - Ari E Kahn
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544
| | - Vinitha Rangarajan
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Karol P Szymula
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Ryan Archer
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Andrew Revell
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Joel M Stein
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Brian Litt
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Kathryn A Davis
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Timothy H Lucas
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Dani S Bassett
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Department of Electrical and Systems Engineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104
- Department of Physics and Astronomy, College of Arts and Sciences, University of Pennsylvania, Philadelphia, PA 19104
- The Santa Fe Institute, Santa Fe, NM 87501
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY 10016
| |
Collapse
|
49
|
Hornsby AN, Love BC. Sequential consumer choice as multi-cued retrieval. SCIENCE ADVANCES 2022; 8:eabl9754. [PMID: 35213230 PMCID: PMC8880769 DOI: 10.1126/sciadv.abl9754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Accepted: 01/03/2022] [Indexed: 06/14/2023]
Abstract
Whether adding songs to a playlist or groceries during an online shop, how do we decide what to choose next? We develop a model that predicts such open-ended, sequential choices using a process of cued retrieval from long-term memory. Using the past choice to cue subsequent retrievals, this model predicts the sequential purchases and response times of nearly 5 million grocery purchases made by more than 100,000 online shoppers. Products can be associated in different ways, such as by their episodic association or semantic overlap, and we find that consumers query multiple forms of associative knowledge when retrieving options. Attending to certain knowledge sources, as estimated by our model, predicts important retrieval errors, such as the propensity to forget or add unwanted products. Our results demonstrate how basic memory retrieval mechanisms shape choices in real-world, goal-directed tasks.
Collapse
Affiliation(s)
- Adam N. Hornsby
- Dunnhumby, 184 Shepherds Bush Road, London W6 7NL, UK
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
| | - Bradley C. Love
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
- The Alan Turing Institute, London UK
| |
Collapse
|
50
|
Zhou D, Lynn CW, Cui Z, Ciric R, Baum GL, Moore TM, Roalf DR, Detre JA, Gur RC, Gur RE, Satterthwaite TD, Bassett DS. Efficient coding in the economics of human brain connectomics. Netw Neurosci 2022; 6:234-274. [PMID: 36605887 PMCID: PMC9810280 DOI: 10.1162/netn_a_00223] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 12/08/2021] [Indexed: 01/07/2023] Open
Abstract
In systems neuroscience, most models posit that brain regions communicate information under constraints of efficiency. Yet, evidence for efficient communication in structural brain networks characterized by hierarchical organization and highly connected hubs remains sparse. The principle of efficient coding proposes that the brain transmits maximal information in a metabolically economical or compressed form to improve future behavior. To determine how structural connectivity supports efficient coding, we develop a theory specifying minimum rates of message transmission between brain regions to achieve an expected fidelity, and we test five predictions from the theory based on random walk communication dynamics. In doing so, we introduce the metric of compression efficiency, which quantifies the trade-off between lossy compression and transmission fidelity in structural networks. In a large sample of youth (n = 1,042; age 8-23 years), we analyze structural networks derived from diffusion-weighted imaging and metabolic expenditure operationalized using cerebral blood flow. We show that structural networks strike compression efficiency trade-offs consistent with theoretical predictions. We find that compression efficiency prioritizes fidelity with development, heightens when metabolic resources and myelination guide communication, explains advantages of hierarchical organization, links higher input fidelity to disproportionate areal expansion, and shows that hubs integrate information by lossy compression. Lastly, compression efficiency is predictive of behavior-beyond the conventional network efficiency metric-for cognitive domains including executive function, memory, complex reasoning, and social cognition. Our findings elucidate how macroscale connectivity supports efficient coding and serve to foreground communication processes that utilize random walk dynamics constrained by network connectivity.
Collapse
Affiliation(s)
- Dale Zhou
- Department of Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Christopher W. Lynn
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY, USA,Joseph Henry Laboratories of Physics, Princeton University, Princeton, NJ, USA
| | - Zaixu Cui
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Rastko Ciric
- Department of Bioengineering, Schools of Engineering and Medicine, Stanford University, Stanford, CA, USA
| | - Graham L. Baum
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Tyler M. Moore
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - David R. Roalf
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - John A. Detre
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Ruben C. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Raquel E. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Theodore D. Satterthwaite
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Dani S. Bassett
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Department of Physics & Astronomy, College of Arts and Sciences, University of Pennsylvania, Philadelphia, PA, USA,Department of Bioengineering, School of Engineering and Applied Sciences, University of Pennsylvania, Philadelphia, PA, USA,Department of Electrical & Systems Engineering, School of Engineering and Applied Sciences, University of Pennsylvania, Philadelphia, PA, USA,Santa Fe Institute, Santa Fe, NM, USA,* Corresponding Author:
| |
Collapse
|