1
|
Zhang M, Yu Q. The representation of abstract goals in working memory is supported by task-congruent neural geometry. PLoS Biol 2024; 22:e3002461. [PMID: 39700265 DOI: 10.1371/journal.pbio.3002461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 11/29/2024] [Indexed: 12/21/2024] Open
Abstract
Successful goal-directed behavior requires the maintenance and implementation of abstract task goals on concrete stimulus information in working memory. Previous working memory research has revealed distributed neural representations of task information across cortex. However, how the distributed task representations emerge and communicate with stimulus-specific information to implement flexible goal-directed computations is still unclear. Here, leveraging electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) in human participants along with state space analyses, we provided converging evidence in support of a low-dimensional neural geometry of goal information congruent with a designed task space, which first emerged in frontal cortex during goal maintenance and then transferred to posterior cortex through frontomedial-to-posterior theta coherence for implementation on stimulus-specific representations. Importantly, the fidelity of the goal geometry was associated with memory performance. Collectively, our findings suggest that abstract goals in working memory are represented in an organized, task-congruent neural geometry for communications from frontal to posterior cortex to enable computations necessary for goal-directed behaviors.
Collapse
Affiliation(s)
- Mengya Zhang
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| | - Qing Yu
- Institute of Neuroscience, Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, China
| |
Collapse
|
2
|
Roads BD, Love BC. The Dimensions of dimensionality. Trends Cogn Sci 2024; 28:1118-1131. [PMID: 39153897 DOI: 10.1016/j.tics.2024.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Revised: 07/16/2024] [Accepted: 07/17/2024] [Indexed: 08/19/2024]
Abstract
Cognitive scientists often infer multidimensional representations from data. Whether the data involve text, neuroimaging, neural networks, or human judgments, researchers frequently infer and analyze latent representational spaces (i.e., embeddings). However, the properties of a latent representation (e.g., prediction performance, interpretability, compactness) depend on the inference procedure, which can vary widely across endeavors. For example, dimensions are not always globally interpretable and the dimensionality of different embeddings may not be readily comparable. Moreover, the dichotomy between multidimensional spaces and purportedly richer representational formats, such as graph representations, is misleading. We review what the different notions of dimension in cognitive science imply for how these latent representations should be used and interpreted.
Collapse
Affiliation(s)
- Brett D Roads
- Department of Experimental Psychology, University College London, London, WC1E, UK.
| | - Bradley C Love
- Department of Experimental Psychology, University College London, London, WC1E, UK
| |
Collapse
|
3
|
Moneta N, Grossman S, Schuck NW. Representational spaces in orbitofrontal and ventromedial prefrontal cortex: task states, values, and beyond. Trends Neurosci 2024; 47:1055-1069. [PMID: 39547861 DOI: 10.1016/j.tins.2024.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2024] [Revised: 10/16/2024] [Accepted: 10/17/2024] [Indexed: 11/17/2024]
Abstract
The orbitofrontal cortex (OFC) and ventromedial-prefrontal cortex (vmPFC) play a key role in decision-making and encode task states in addition to expected value. We review evidence suggesting a connection between value and state representations and argue that OFC / vmPFC integrate stimulus, context, and outcome information. Comparable encoding principles emerge in late layers of deep reinforcement learning (RL) models, where single nodes exhibit similar forms of mixed-selectivity, which enables flexible readout of relevant variables by downstream neurons. Based on these lines of evidence, we suggest that outcome-maximization leads to complex representational spaces that are insufficiently characterized by linear value signals that have been the focus of most prior research on the topic. Major outstanding questions concern the role of OFC/ vmPFC in learning across tasks, in encoding of task-irrelevant aspects, and the role of hippocampus-PFC interactions.
Collapse
Affiliation(s)
- Nir Moneta
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany; Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany.
| | - Shany Grossman
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany.
| | - Nicolas W Schuck
- Institute of Psychology, Universität Hamburg, 20146 Hamburg, Germany; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195 Berlin, Germany.
| |
Collapse
|
4
|
Xie Y, Mack ML. Reconciling category exceptions through representational shifts. Psychon Bull Rev 2024; 31:2621-2633. [PMID: 38639836 DOI: 10.3758/s13423-024-02501-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/28/2024] [Indexed: 04/20/2024]
Abstract
Real-world categories often contain exceptions that disobey the perceptual regularities followed by other members. Prominent psychological and neurobiological theories indicate that exception learning relies on the flexible modulation of object representations, but the specific representational shifts key to learning remain poorly understood. Here, we leveraged behavioral and computational approaches to elucidate the representational dynamics during the acquisition of exceptions that violate established regularity knowledge. In our study, participants (n = 42) learned novel categories in which regular and exceptional items were introduced successively; we then fitted a computational model to individuals' categorization performance to infer latent stimulus representations before and after exception learning. We found that in the representational space, exception learning not only drove confusable exceptions to be differentiated from regular items, but also led exceptions within the same category to be integrated based on shared characteristics. These shifts resulted in distinct representational clusters of regular items and exceptions that constituted hierarchically structured category representations, and the distinct clustering of exceptions from regular items was associated with a high ability to generalize and reconcile knowledge of regularities and exceptions. Moreover, by having a second group of participants (n = 42) to judge stimuli's similarity before and after exception learning, we revealed misalignment between representational similarity and behavioral similarity judgments, which further highlights the hierarchical layouts of categories with regularities and exceptions. Altogether, our findings elucidate the representational dynamics giving rise to generalizable category structures that reconcile perceptually inconsistent category members, thereby advancing the understanding of knowledge formation.
Collapse
Affiliation(s)
- Yongzhen Xie
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada.
| | - Michael L Mack
- Department of Psychology, University of Toronto, 100 St. George Street, Toronto, ON, M5S 3G3, Canada
| |
Collapse
|
5
|
Ruffini G, Castaldo F, Lopez-Sola E, Sanchez-Todo R, Vohryzek J. The Algorithmic Agent Perspective and Computational Neuropsychiatry: From Etiology to Advanced Therapy in Major Depressive Disorder. ENTROPY (BASEL, SWITZERLAND) 2024; 26:953. [PMID: 39593898 PMCID: PMC11592617 DOI: 10.3390/e26110953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Revised: 10/15/2024] [Accepted: 10/29/2024] [Indexed: 11/28/2024]
Abstract
Major Depressive Disorder (MDD) is a complex, heterogeneous condition affecting millions worldwide. Computational neuropsychiatry offers potential breakthroughs through the mechanistic modeling of this disorder. Using the Kolmogorov theory (KT) of consciousness, we developed a foundational model where algorithmic agents interact with the world to maximize an Objective Function evaluating affective valence. Depression, defined in this context by a state of persistently low valence, may arise from various factors-including inaccurate world models (cognitive biases), a dysfunctional Objective Function (anhedonia, anxiety), deficient planning (executive deficits), or unfavorable environments. Integrating algorithmic, dynamical systems, and neurobiological concepts, we map the agent model to brain circuits and functional networks, framing potential etiological routes and linking with depression biotypes. Finally, we explore how brain stimulation, psychotherapy, and plasticity-enhancing compounds such as psychedelics can synergistically repair neural circuits and optimize therapies using personalized computational models.
Collapse
Affiliation(s)
- Giulio Ruffini
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
| | - Francesca Castaldo
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
| | - Edmundo Lopez-Sola
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
| | - Roser Sanchez-Todo
- Brain Modeling Department, Neuroelectrics, 08035 Barcelona, Spain; (E.L.-S.); (R.S.-T.)
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
| | - Jakub Vohryzek
- Computational Neuroscience Group, UPF, 08005 Barcelona, Spain;
- Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, Oxford OX3 9BX, UK
| |
Collapse
|
6
|
Zhang J, Li H, Qu J, Liu X, Feng X, Fu X, Mei L. Language proficiency is associated with neural representational dimensionality of semantic concepts. BRAIN AND LANGUAGE 2024; 258:105485. [PMID: 39388908 DOI: 10.1016/j.bandl.2024.105485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 09/28/2024] [Accepted: 10/04/2024] [Indexed: 10/12/2024]
Abstract
Previous studies suggest that semantic concepts are characterized by high-dimensional neural representations and that language proficiency affects semantic processing. However, it is not clear whether language proficiency modulates the dimensional representations of semantic concepts at the neural level. To address this question, the present study adopted principal component analysis (PCA) and representational similarity analysis (RSA) to examine the differences in representational dimensionalities (RDs) and in semantic representations between words in highly proficient (Chinese) and less proficient (English) language. PCA results revealed that language proficiency increased the dimensions of lexical representations in the left inferior frontal gyrus, temporal pole, inferior temporal gyrus, supramarginal gyrus, angular gyrus, and fusiform gyrus. RSA results further showed that these regions represented semantic information and that higher semantic representations were observed in highly proficient language relative to less proficient language. These results suggest that language proficiency is associated with the neural representational dimensionality of semantic concepts.
Collapse
Affiliation(s)
- Jingxian Zhang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Huiling Li
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Jing Qu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xiaoyu Liu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xiaoxue Feng
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Xin Fu
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Leilei Mei
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, South China Normal University, Ministry of Education, Guangzhou 510631, China; Center for Studies of Psychological Application, South China Normal University, 510631, Guangzhou, China; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou 510631, China; School of Psychology, South China Normal University, Guangzhou 510631, China.
| |
Collapse
|
7
|
Kikumoto A, Bhandari A, Shibata K, Badre D. A transient high-dimensional geometry affords stable conjunctive subspaces for efficient action selection. Nat Commun 2024; 15:8513. [PMID: 39353961 PMCID: PMC11445473 DOI: 10.1038/s41467-024-52777-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 09/18/2024] [Indexed: 10/03/2024] Open
Abstract
Flexible action selection requires cognitive control mechanisms capable of mapping the same inputs to different output actions depending on the context. From a neural state-space perspective, this requires a control representation that separates similar input neural states by context. Additionally, for action selection to be robust and time-invariant, information must be stable in time, enabling efficient readout. Here, using EEG decoding methods, we investigate how the geometry and dynamics of control representations constrain flexible action selection in the human brain. Participants performed a context-dependent action selection task. A forced response procedure probed action selection different states in neural trajectories. The result shows that before successful responses, there is a transient expansion of representational dimensionality that separated conjunctive subspaces. Further, the dynamics stabilizes in the same time window, with entry into this stable, high-dimensional state predictive of individual trial performance. These results establish the neural geometry and dynamics the human brain needs for flexible control over behavior.
Collapse
Affiliation(s)
- Atsushi Kikumoto
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US.
- RIKEN Center for Brain Science, Wako, Saitama, Japan.
| | - Apoorva Bhandari
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US
| | | | - David Badre
- Department of Cognitive and Psychological Sciences, Brown University, Rhode Island, US
- Carney Institute for Brain Science, Brown University, Providence, Rhode Island, US
| |
Collapse
|
8
|
Fleming SM, Shea N. Quality space computations for consciousness. Trends Cogn Sci 2024; 28:896-906. [PMID: 39025769 DOI: 10.1016/j.tics.2024.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 07/20/2024]
Abstract
The quality space hypothesis about conscious experience proposes that conscious sensory states are experienced in relation to other possible sensory states. For instance, the colour red is experienced as being more like orange, and less like green or blue. Recent empirical findings suggest that subjective similarity space can be explained in terms of similarities in neural activation patterns. Here, we consider how localist, workspace, and higher-order theories of consciousness can accommodate claims about the qualitative character of experience and functionally support a quality space. We review existing empirical evidence for each of these positions, and highlight novel experimental tools, such as altering local activation spaces via brain stimulation or behavioural training, that can distinguish these accounts.
Collapse
Affiliation(s)
- Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College London, London, UK; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK; Department of Experimental Psychology, University College London, London, UK; Canadian Institute for Advanced Research (CIFAR), Brain, Mind, and Consciousness Program, Toronto, ON, Canada.
| | - Nicholas Shea
- Institute of Philosophy, School of Advanced Study, University of London, London, UK; Faculty of Philosophy, University of Oxford, Oxford, UK.
| |
Collapse
|
9
|
Son G, Walther DB, Mack ML. Brief category learning distorts perceptual space for complex scenes. Psychon Bull Rev 2024; 31:2234-2248. [PMID: 38438711 DOI: 10.3758/s13423-024-02484-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/20/2024] [Indexed: 03/06/2024]
Abstract
The formation of categories is known to distort perceptual space: representations are pushed away from category boundaries and pulled toward categorical prototypes. This phenomenon has been studied with artificially constructed objects, whose feature dimensions are easily defined and manipulated. How such category-induced perceptual distortions arise for complex, real-world scenes, however, remains largely unknown due to the technical challenge of measuring and controlling scene features. We address this question by generating realistic scene images from a high-dimensional continuous space using generative adversarial networks and using the images as stimuli in a novel learning task. Participants learned to categorize the scene images along arbitrary category boundaries and later reconstructed the same scenes from memory. Systematic biases in reconstruction errors closely tracked each participant's subjective category boundaries. These findings suggest that the perception of global scene properties is warped to align with a newly learned category structure after only a brief learning experience.
Collapse
Affiliation(s)
- Gaeun Son
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada.
| | - Dirk B Walther
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
10
|
Ezzyat Y, Clements A. Neural Activity Differentiates Novel and Learned Event Boundaries. J Neurosci 2024; 44:e2246232024. [PMID: 38871462 PMCID: PMC11411582 DOI: 10.1523/jneurosci.2246-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 04/22/2024] [Accepted: 05/25/2024] [Indexed: 06/15/2024] Open
Abstract
People parse continuous experiences at natural breakpoints called event boundaries, which is important for understanding an environment's causal structure and for responding to uncertainty within it. However, it remains unclear how different forms of uncertainty affect the parsing of continuous experiences and how such uncertainty influences the brain's processing of ongoing events. We exposed human participants of both sexes (N = 34) to a continuous sequence of semantically meaningless images. We generated sequences from random walks through a graph that grouped images into temporal communities. After learning, we asked participants to segment another sequence at natural breakpoints (event boundaries). Participants segmented the sequence at learned transitions between communities, as well as at novel transitions, suggesting that people can segment temporally extended experiences into events based on learned structure as well as prediction error. Greater segmentation at novel boundaries was associated with enhanced parietal scalp electroencephalography (EEG) activity between 250 and 450 ms after the stimulus onset. Multivariate classification of EEG activity showed that novel and learned boundaries evoked distinct patterns of neural activity, particularly theta band power in posterior electrodes. Learning also led to distinct neural representations for stimuli within the temporal communities, while neural activity at learned boundary nodes showed predictive evidence for the adjacent community. The data show that people segment experiences at both learned and novel boundaries and suggest that learned event boundaries trigger retrieval of information about the upcoming community that could underlie anticipation of the next event in a sequence.
Collapse
Affiliation(s)
- Youssef Ezzyat
- Department of Psychology, Wesleyan University, Middletown, Connecticut 06459
- Program in Neuroscience & Behavior, Wesleyan University, Middletown, Connecticut 06459
| | - Abby Clements
- Program in Neuroscience, Swarthmore College, Swarthmore, Pennsylvania 19081
| |
Collapse
|
11
|
Owen LLW, Manning JR. High-level cognition is supported by information-rich but compressible brain activity patterns. Proc Natl Acad Sci U S A 2024; 121:e2400082121. [PMID: 39178232 PMCID: PMC11363287 DOI: 10.1073/pnas.2400082121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 07/08/2024] [Indexed: 08/25/2024] Open
Abstract
To efficiently yet reliably represent and process information, our brains need to produce information-rich signals that differentiate between moments or cognitive states, while also being robust to noise or corruption. For many, though not all, natural systems, these two properties are often inversely related: More information-rich signals are less robust, and vice versa. Here, we examined how these properties change with ongoing cognitive demands. To this end, we applied dimensionality reduction algorithms and pattern classifiers to functional neuroimaging data collected as participants listened to a story, temporally scrambled versions of the story, or underwent a resting state scanning session. We considered two primary aspects of the neural data recorded in these different experimental conditions. First, we treated the maximum achievable decoding accuracy across participants as an indicator of the "informativeness" of the recorded patterns. Second, we treated the number of features (components) required to achieve a threshold decoding accuracy as a proxy for the "compressibility" of the neural patterns (where fewer components indicate greater compression). Overall, we found that the peak decoding accuracy (achievable without restricting the numbers of features) was highest in the intact (unscrambled) story listening condition. However, the number of features required to achieve comparable classification accuracy was also lowest in the intact story listening condition. Taken together, our work suggests that our brain networks flexibly reconfigure according to ongoing task demands and that the activity patterns associated with higher-order cognition and high engagement are both more informative and more compressible than the activity patterns associated with lower-order tasks and lower engagement.
Collapse
Affiliation(s)
- Lucy L. W. Owen
- Department of Psychiatry and Human Behavior, Carney Institute for Brain Sciences, Brown University, Providence, RI02906
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH03755
- Department of Computer Science, University of Montana, Missoula, MT59812
| | - Jeremy R. Manning
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH03755
| |
Collapse
|
12
|
Broschard MB, Turner BM, Tranel D, Freeman JH. Dissociable Roles of the Dorsolateral and Ventromedial Prefrontal Cortex in Human Categorization. J Neurosci 2024; 44:e2343232024. [PMID: 38997159 PMCID: PMC11340282 DOI: 10.1523/jneurosci.2343-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 06/21/2024] [Accepted: 06/27/2024] [Indexed: 07/14/2024] Open
Abstract
Models of human categorization predict the prefrontal cortex (PFC) serves a central role in category learning. The dorsolateral prefrontal cortex (dlPFC) and ventromedial prefrontal cortex (vmPFC) have been implicated in categorization; however, it is unclear whether both are critical for categorization and whether they support unique functions. We administered three categorization tasks to patients with PFC lesions (mean age, 69.6 years; 5 men, 5 women) to examine how the prefrontal subregions contribute to categorization. These included a rule-based (RB) task that was solved via a unidimensional rule, an information integration (II) task that was solved by combining information from two stimulus dimensions, and a deterministic/probabilistic (DP) task with stimulus features that had varying amounts of category-predictive information. Compared with healthy comparison participants, both patient groups had impaired performance. Impairments in the dlPFC patients were largest during the RB task, whereas impairments in the vmPFC patients were largest during the DP task. A hierarchical model was fit to the participants' data to assess learning deficits in the patient groups. PFC damage was correlated with a regularization term that limited updates to attention after each trial. Our results suggest that the PFC, as a whole, is important for learning to orient attention to relevant stimulus information. The dlPFC may be especially important for rule-based learning, whereas the vmPFC may be important for focusing attention on deterministic (highly diagnostic) features and ignoring less predictive features. These results support overarching functions of the dlPFC in executive functioning and the vmPFC in value-based decision-making.
Collapse
Affiliation(s)
- Matthew B Broschard
- The Picower Institute of Learning and Memory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
| | - Brandon M Turner
- Department of Psychology, The Ohio State University, Columbus, Ohio 43210
| | - Daniel Tranel
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
- Department of Neurology, University of Iowa, Iowa City, Iowa 52242
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, Iowa 52242
| |
Collapse
|
13
|
Broschard MB, Kim J, Love BC, Halverson HE, Freeman JH. Disrupting dorsal hippocampus impairs category learning in rats. Neurobiol Learn Mem 2024; 212:107941. [PMID: 38768684 DOI: 10.1016/j.nlm.2024.107941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 03/19/2024] [Accepted: 05/16/2024] [Indexed: 05/22/2024]
Abstract
Categorization requires a balance of mechanisms that can generalize across common features and discriminate against specific details. A growing literature suggests that the hippocampus may accomplish these mechanisms by using fundamental mechanisms like pattern separation, pattern completion, and memory integration. Here, we assessed the role of the rodent dorsal hippocampus (HPC) in category learning by combining inhibitory DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and simulations using a neural network model. Using touchscreens, we trained rats to categorize distributions of visual stimuli containing black and white gratings that varied along two continuous dimensions. Inactivating the dorsal HPC impaired category learning and generalization, suggesting that the rodent HPC plays an important role during categorization. Hippocampal inactivation had no effect on a control discrimination task that used identical trial procedures as the categorization tasks, suggesting that the impairments were specific to categorization. Model simulations were conducted with variants of a neural network to assess the impact of selective deficits on category learning. The hippocampal inactivation groups were best explained by a model that injected random noise into the computation that compared the similarity between category stimuli and existing memory representations. This model is akin to a deficit in mechanisms of pattern completion, which retrieves similar memory representations using partial information.
Collapse
Affiliation(s)
- Matthew B Broschard
- The Picower Institute of Learning and Memory, Massachusetts Institute of Technology, Cambridge, MA, USA; Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA
| | - Jangjin Kim
- Department of Psychology, Kyungpool National University, Daegu, South Korea
| | - Bradley C Love
- Department of Experimental Psychology and The Alan Turing Institute, University College London, London, UK
| | - Hunter E Halverson
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, USA.
| |
Collapse
|
14
|
Holton E, Grohn J, Ward H, Manohar SG, O'Reilly JX, Kolling N. Goal commitment is supported by vmPFC through selective attention. Nat Hum Behav 2024; 8:1351-1365. [PMID: 38632389 PMCID: PMC11272579 DOI: 10.1038/s41562-024-01844-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 02/01/2024] [Indexed: 04/19/2024]
Abstract
When striking a balance between commitment to a goal and flexibility in the face of better options, people often demonstrate strong goal perseveration. Here, using functional MRI (n = 30) and lesion patient (n = 26) studies, we argue that the ventromedial prefrontal cortex (vmPFC) drives goal commitment linked to changes in goal-directed selective attention. Participants performed an incremental goal pursuit task involving sequential decisions between persisting with a goal versus abandoning progress for better alternative options. Individuals with stronger goal perseveration showed higher goal-directed attention in an interleaved attention task. Increasing goal-directed attention also affected abandonment decisions: while pursuing a goal, people lost their sensitivity to valuable alternative goals while remaining more sensitive to changes in the current goal. In a healthy population, individual differences in both commitment biases and goal-oriented attention were predicted by baseline goal-related activity in the vmPFC. Among lesion patients, vmPFC damage reduced goal commitment, leading to a performance benefit.
Collapse
Affiliation(s)
- Eleanor Holton
- Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - Jan Grohn
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
| | - Harry Ward
- Centre for Experimental Medicine and Rheumatology, Queen Mary University London (QMUL), London, UK
| | - Sanjay G Manohar
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Jill X O'Reilly
- Department of Experimental Psychology, University of Oxford, Oxford, UK
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
| | - Nils Kolling
- Wellcome Centre for Integrative Neuroimaging (WIN), University of Oxford, Oxford, UK
- Stem Cell and Brain Research Institute U1208, Inserm, Université Claude Bernard Lyon 1, Bron, France
| |
Collapse
|
15
|
Chen F, Li P, Chen H, Seger CA, Liu Z. Prototype or Exemplar Representations in the 5/5 Category Learning Task. Behav Sci (Basel) 2024; 14:470. [PMID: 38920801 PMCID: PMC11200643 DOI: 10.3390/bs14060470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 05/22/2024] [Accepted: 05/29/2024] [Indexed: 06/27/2024] Open
Abstract
Theories of category learning have typically focused on how the underlying category structure affects the category representations acquired by learners. However, there is limited research as to how other factors affect what representations are learned and utilized and how representations might change across the time course of learning. We used a novel "5/5" categorization task developed from the well-studied 5/4 task with the addition of one more stimulus to clarify an ambiguity in the 5/4 prototypes. We used multiple methods including computational modeling to identify whether participants categorized on the basis of exemplar or prototype representations. We found that, overall, for the stimuli we used (schematic robot-like stimuli), learning was best characterized by the use of prototypes. Most importantly, we found that relative use of prototype and exemplar strategies changed across learning, with use of exemplar representations decreasing and prototype representations increasing across blocks.
Collapse
Affiliation(s)
- Fang Chen
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
- Department of Psychology, College of Education and Sports Sciences, Yangtze University, Jingzhou 434023, China
| | - Peijuan Li
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| | - Hao Chen
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| | - Carol A. Seger
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
- Department of Psychology, Molecular, Cellular and Integrative Neurosciences Program, Colorado State University, Fort Collins, CO 80523, USA
| | - Zhiya Liu
- Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China; (F.C.); (P.L.); (H.C.)
| |
Collapse
|
16
|
Zhou D, Bornstein AM. Expanding horizons in reinforcement learning for curious exploration and creative planning. Behav Brain Sci 2024; 47:e118. [PMID: 38770877 DOI: 10.1017/s0140525x23003394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Curiosity and creativity are expressions of the trade-off between leveraging that with which we are familiar or seeking out novelty. Through the computational lens of reinforcement learning, we describe how formulating the value of information seeking and generation via their complementary effects on planning horizons formally captures a range of solutions to striking this balance.
Collapse
Affiliation(s)
- Dale Zhou
- Neurobiology and Behavior, 519 Biological Sciences Quad, University of California, Irvine, CA, USA ://dalezhou.com
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
| | - Aaron M Bornstein
- Center for the Neurobiology of Learning and Memory, Qureshey, Research Laboratory, University of California, Irvine, CA, USA ://aaron.bornstein.org/
- Department of Cognitive Sciences, 2318 Social & Behavioral Sciences Gateway, University of California, Irvine, CA, USA
| |
Collapse
|
17
|
Qu C, Huang Y, Philippe R, Cai S, Derrington E, Moisan F, Shi M, Dreher JC. Transcranial direct current stimulation suggests a causal role of the medial prefrontal cortex in learning social hierarchy. Commun Biol 2024; 7:304. [PMID: 38461216 PMCID: PMC10924847 DOI: 10.1038/s42003-024-05976-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2022] [Accepted: 02/27/2024] [Indexed: 03/11/2024] Open
Abstract
Social hierarchies can be inferred through observational learning of social relationships between individuals. Yet, little is known about the causal role of specific brain regions in learning hierarchies. Here, using transcranial direct current stimulation, we show a causal role of the medial prefrontal cortex (mPFC) in learning social versus non-social hierarchies. In a Training phase, participants acquired knowledge about social and non-social hierarchies by trial and error. During a Test phase, they were presented with two items from hierarchies that were never encountered together, requiring them to make transitive inferences. Anodal stimulation over mPFC impaired social compared with non-social hierarchy learning, and this modulation was influenced by the relative social rank of the members (higher or lower status). Anodal stimulation also impaired transitive inference making, but only during early blocks before learning was established. Together, these findings demonstrate a causal role of the mPFC in learning social ranks by observation.
Collapse
Affiliation(s)
- Chen Qu
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Yulong Huang
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Rémi Philippe
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France
- Université Claude Bernard Lyon 1, Lyon, France
| | - Shenggang Cai
- School of Economics and Management, South China Normal University, Guangzhou, China
- Key Lab for Behavioral Economic Science & Technology, South China Normal University, Guangzhou, China
| | - Edmund Derrington
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France
- Université Claude Bernard Lyon 1, Lyon, France
| | | | - Mengke Shi
- Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Jean-Claude Dreher
- Laboratory of Neuroeconomics, Institut des Sciences Cognitives Marc Jeannerod, CNRS, Lyon, France.
- Université Claude Bernard Lyon 1, Lyon, France.
| |
Collapse
|
18
|
Qiu L, Li H, Ma M, Fang C. Effect of antibiotic exposure on the characteristics of activated sludge in a landfill leachate biological treatment system. ENVIRONMENTAL TECHNOLOGY 2024; 45:1596-1607. [PMID: 36377722 DOI: 10.1080/09593330.2022.2148568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 11/09/2022] [Indexed: 06/16/2023]
Abstract
Changes in the activated sludge performance in an anaerobic/aerobic biological treatment system for leachate was discussed under the condition of tetracycline (TC) exposure. The results show that a low concentration of TC did not have an obvious effect on the removal of chemical oxygen demand (COD) while a high concentration of TC had a certain promoting effect. Under the stimulation of TC, the particle size distribution of anaerobic/aerobic sludge tended to be more uniform, the particle size of anaerobic sludge decreased while the settleability increased; however, the particle size of aerobic sludge increased due to bulking. With the addition of TC, the concentration of most heavy metal ions in sludge samples increased.TC exposure results in the release of a large amount of extracellular polymeric substances (EPS), thus leading to a smoother surface of anaerobic sludge and a rougher surface of aerobic sludge. The high removal efficiency of COD under the high concentration of TC was also presumed to be due to EPS promoting the microbial absorption of anaerobic substances in the leachate. The results clearly showed that TC had a bacteriostatic effect. After antibiotic exposure, the abundance and diversity index of bacteria in each reactor decreased obviously, the microbial community evolved, and the dominant species at the genus and phylum levels of anaerobic/aerobic reactors changed. This study provides a better understanding the effect of TC on activated sludge and has reference value for the management of antibiotic exposure in leachate treatment facilities.
Collapse
Affiliation(s)
- Libo Qiu
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| | - Hong Li
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| | - Mengfei Ma
- College of Civil Engineering, Southeast University, Nanjing, People's Republic of China
| | - Chengran Fang
- College of Civil Engineering, Zhejiang University of Technology, Hangzhou, People's Republic of China
| |
Collapse
|
19
|
Spens E, Burgess N. A generative model of memory construction and consolidation. Nat Hum Behav 2024; 8:526-543. [PMID: 38242925 PMCID: PMC10963272 DOI: 10.1038/s41562-023-01799-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 12/05/2023] [Indexed: 01/21/2024]
Abstract
Episodic memories are (re)constructed, share neural substrates with imagination, combine unique features with schema-based predictions and show schema-based distortions that increase with consolidation. Here we present a computational model in which hippocampal replay (from an autoassociative network) trains generative models (variational autoencoders) to (re)create sensory experiences from latent variable representations in entorhinal, medial prefrontal and anterolateral temporal cortices via the hippocampal formation. Simulations show effects of memory age and hippocampal lesions in agreement with previous models, but also provide mechanisms for semantic memory, imagination, episodic future thinking, relational inference and schema-based distortions including boundary extension. The model explains how unique sensory and predictable conceptual elements of memories are stored and reconstructed by efficiently combining both hippocampal and neocortical systems, optimizing the use of limited hippocampal storage for new and unusual information. Overall, we believe hippocampal replay training generative models provides a comprehensive account of memory construction, imagination and consolidation.
Collapse
Affiliation(s)
- Eleanor Spens
- UCL Institute of Cognitive Neuroscience, University College London, London, UK.
| | - Neil Burgess
- UCL Institute of Cognitive Neuroscience, University College London, London, UK.
- UCL Queen Square Institute of Neurology, University College London, London, UK.
| |
Collapse
|
20
|
Zheng L, Gao Z, Doner S, Oyao A, Forloines M, Grilli MD, Barnes CA, Ekstrom AD. Hippocampal contributions to novel spatial learning are both age-related and age-invariant. Proc Natl Acad Sci U S A 2023; 120:e2307884120. [PMID: 38055735 PMCID: PMC10723126 DOI: 10.1073/pnas.2307884120] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 10/30/2023] [Indexed: 12/08/2023] Open
Abstract
Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional MRI of the medial temporal lobes. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.
Collapse
Affiliation(s)
- Li Zheng
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Zhiyao Gao
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA94305
| | - Stephanie Doner
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Alexis Oyao
- Psychology Department, University of Arizona, Tucson, AZ85721
| | - Martha Forloines
- Alzheimer’s Disease Center, Department of Neurology, University of California, Davis, Sacramento, CA95816
| | - Matthew D. Grilli
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| | - Carol A. Barnes
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| | - Arne D. Ekstrom
- Psychology Department, University of Arizona, Tucson, AZ85721
- Evelyn F. McKnight Brain Institute, University of Arizona, Tucson, AZ85721
| |
Collapse
|
21
|
Sučević J, Schapiro AC. A neural network model of hippocampal contributions to category learning. eLife 2023; 12:e77185. [PMID: 38079351 PMCID: PMC10712951 DOI: 10.7554/elife.77185] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Accepted: 11/06/2023] [Indexed: 12/18/2023] Open
Abstract
In addition to its critical role in encoding individual episodes, the hippocampus is capable of extracting regularities across experiences. This ability is central to category learning, and a growing literature indicates that the hippocampus indeed makes important contributions to this form of learning. Using a neural network model that mirrors the anatomy of the hippocampus, we investigated the mechanisms by which the hippocampus may support novel category learning. We simulated three category learning paradigms and evaluated the network's ability to categorize and recognize specific exemplars in each. We found that the trisynaptic pathway within the hippocampus-connecting entorhinal cortex to dentate gyrus, CA3, and CA1-was critical for remembering exemplar-specific information, reflecting the rapid binding and pattern separation capabilities of this circuit. The monosynaptic pathway from entorhinal cortex to CA1, in contrast, specialized in detecting the regularities that define category structure across exemplars, supported by the use of distributed representations and a relatively slower learning rate. Together, the simulations provide an account of how the hippocampus and its constituent pathways support novel category learning.
Collapse
Affiliation(s)
- Jelena Sučević
- Department of Experimental Psychology, University of OxfordOxfordUnited Kingdom
| | - Anna C Schapiro
- Department of Psychology, University of PennsylvaniaPhiladelphiaUnited States
| |
Collapse
|
22
|
Zheng L, Gao Z, Doner S, Oyao A, Forloines M, Grilli MD, Barnes CA, Ekstrom AD. Hippocampal contributions to novel spatial learning are both age-related and age-invariant. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.28.546918. [PMID: 37425879 PMCID: PMC10326977 DOI: 10.1101/2023.06.28.546918] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
Older adults show declines in spatial memory, although the extent of these alterations is not uniform across the healthy older population. Here, we investigate the stability of neural representations for the same and different spatial environments in a sample of younger and older adults using high-resolution functional magnetic resonance imaging (fMRI) of the medial temporal lobe. Older adults showed, on average, lower neural pattern similarity for retrieving the same environment and more variable neural patterns compared to young adults. We also found a positive association between spatial distance discrimination and the distinctiveness of neural patterns between environments. Our analyses suggested that one source for this association was the extent of informational connectivity to CA1 from other subfields, which was dependent on age, while another source was the fidelity of signals within CA1 itself, which was independent of age. Together, our findings suggest both age-dependent and independent neural contributions to spatial memory performance.
Collapse
Affiliation(s)
- Li Zheng
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Zhiyao Gao
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94305
| | - Stephanie Doner
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Alexis Oyao
- Psychology Department, University of Arizona, Tucson, AZ 85719
| | - Martha Forloines
- Alzheimer s Disease Center, Department of Neurology, University of California, Davis, Sacramento, CA 95816
| | - Matthew D Grilli
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| | - Carol A Barnes
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| | - Arne D Ekstrom
- Psychology Department, University of Arizona, Tucson, AZ 85719
- Evelyn McKnight Brain Institute, University of Arizona, Tucson, AZ 85719
| |
Collapse
|
23
|
Mok RM, Love BC. A multilevel account of hippocampal function in spatial and concept learning: Bridging models of behavior and neural assemblies. SCIENCE ADVANCES 2023; 9:eade6903. [PMID: 37478189 PMCID: PMC10361583 DOI: 10.1126/sciadv.ade6903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Accepted: 06/20/2023] [Indexed: 07/23/2023]
Abstract
A complete neuroscience requires multilevel theories that address phenomena ranging from higher-level cognitive behaviors to activities within a cell. We propose an extension to the level of mechanism approach where a computational model of cognition sits in between behavior and brain: It explains the higher-level behavior and can be decomposed into lower-level component mechanisms to provide a richer understanding of the system than any level alone. Toward this end, we decomposed a cognitive model into neuron-like units using a neural flocking approach that parallels recurrent hippocampal activity. Neural flocking coordinates units that collectively form higher-level mental constructs. The decomposed model suggested how brain-scale neural populations coordinate to form assemblies encoding concept and spatial representations and why so many neurons are needed for robust performance at the cognitive level. This multilevel explanation provides a way to understand how cognition and symbol-like representations are supported by coordinated neural populations (assemblies) formed through learning.
Collapse
Affiliation(s)
- Robert M. Mok
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge CB2 7EF, UK
| | - Bradley C. Love
- UCL Department of Experimental Psychology, 26 Bedford Way, London WC1H 0AP, UK
- The Alan Turing Institute, London, United Kingdom
| |
Collapse
|
24
|
Shine JM, Lewis LD, Garrett DD, Hwang K. The impact of the human thalamus on brain-wide information processing. Nat Rev Neurosci 2023; 24:416-430. [PMID: 37237103 DOI: 10.1038/s41583-023-00701-0] [Citation(s) in RCA: 65] [Impact Index Per Article: 32.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/30/2023] [Indexed: 05/28/2023]
Abstract
The thalamus is a small, bilateral structure in the diencephalon that integrates signals from many areas of the CNS. This critical anatomical position allows the thalamus to influence whole-brain activity and adaptive behaviour. However, traditional research paradigms have struggled to attribute specific functions to the thalamus, and it has remained understudied in the human neuroimaging literature. Recent advances in analytical techniques and increased accessibility to large, high-quality data sets have brought forth a series of studies and findings that (re-)establish the thalamus as a core region of interest in human cognitive neuroscience, a field that otherwise remains cortico-centric. In this Perspective, we argue that using whole-brain neuroimaging approaches to investigate the thalamus and its interaction with the rest of the brain is key for understanding systems-level control of information processing. To this end, we highlight the role of the thalamus in shaping a range of functional signatures, including evoked activity, interregional connectivity, network topology and neuronal variability, both at rest and during the performance of cognitive tasks.
Collapse
Affiliation(s)
- James M Shine
- Brain and Mind Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Laura D Lewis
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA
| | - Douglas D Garrett
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, Germany
- Center for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany
| | - Kai Hwang
- Cognitive Control Collaborative, Department of Psychological and Brain Sciences, The University of Iowa, Iowa City, IA, USA.
- Department of Psychiatry, The University of Iowa, Iowa City, IA, USA.
- Iowa Neuroscience Institute, The University of Iowa, Iowa City, IA, USA.
| |
Collapse
|
25
|
Mill RD, Cole MW. Neural representation dynamics reveal computational principles of cognitive task learning. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.27.546751. [PMID: 37425922 PMCID: PMC10327096 DOI: 10.1101/2023.06.27.546751] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/11/2023]
Abstract
During cognitive task learning, neural representations must be rapidly constructed for novel task performance, then optimized for robust practiced task performance. How the geometry of neural representations changes to enable this transition from novel to practiced performance remains unknown. We hypothesized that practice involves a shift from compositional representations (task-general activity patterns that can be flexibly reused across tasks) to conjunctive representations (task-specific activity patterns specialized for the current task). Functional MRI during learning of multiple complex tasks substantiated this dynamic shift from compositional to conjunctive representations, which was associated with reduced cross-task interference (via pattern separation) and behavioral improvement. Further, we found that conjunctions originated in subcortex (hippocampus and cerebellum) and slowly spread to cortex, extending multiple memory systems theories to encompass task representation learning. The formation of conjunctive representations hence serves as a computational signature of learning, reflecting cortical-subcortical dynamics that optimize task representations in the human brain.
Collapse
|
26
|
Sherrill KR, Molitor RJ, Karagoz AB, Atyam M, Mack ML, Preston AR. Generalization of cognitive maps across space and time. Cereb Cortex 2023; 33:7971-7992. [PMID: 36977625 PMCID: PMC10492577 DOI: 10.1093/cercor/bhad092] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 02/24/2023] [Accepted: 02/25/2023] [Indexed: 03/30/2023] Open
Abstract
Prominent theories posit that associative memory structures, known as cognitive maps, support flexible generalization of knowledge across cognitive domains. Here, we evince a representational account of cognitive map flexibility by quantifying how spatial knowledge formed one day was used predictively in a temporal sequence task 24 hours later, biasing both behavior and neural response. Participants learned novel object locations in distinct virtual environments. After learning, hippocampus and ventromedial prefrontal cortex (vmPFC) represented a cognitive map, wherein neural patterns became more similar for same-environment objects and more discriminable for different-environment objects. Twenty-four hours later, participants rated their preference for objects from spatial learning; objects were presented in sequential triplets from either the same or different environments. We found that preference response times were slower when participants transitioned between same- and different-environment triplets. Furthermore, hippocampal spatial map coherence tracked behavioral slowing at the implicit sequence transitions. At transitions, predictive reinstatement of virtual environments decreased in anterior parahippocampal cortex. In the absence of such predictive reinstatement after sequence transitions, hippocampus and vmPFC responses increased, accompanied by hippocampal-vmPFC functional decoupling that predicted individuals' behavioral slowing after a transition. Collectively, these findings reveal how expectations derived from spatial experience generalize to support temporal prediction.
Collapse
Affiliation(s)
- Katherine R Sherrill
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX 78712, USA
| | - Robert J Molitor
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Ata B Karagoz
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Manasa Atyam
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, ON M5G 1E6, Canada
| | - Alison R Preston
- Center for Learning and Memory, University of Texas at Austin, Austin, TX 78712, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX 78712, USA
- Department of Psychology, University of Texas at Austin, Austin, TX 78712, USA
| |
Collapse
|
27
|
Rosenblau G, Frolichs K, Korn CW. A neuro-computational social learning framework to facilitate transdiagnostic classification and treatment across psychiatric disorders. Neurosci Biobehav Rev 2023; 149:105181. [PMID: 37062494 PMCID: PMC10236440 DOI: 10.1016/j.neubiorev.2023.105181] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 03/14/2023] [Accepted: 04/13/2023] [Indexed: 04/18/2023]
Abstract
Social deficits are among the core and most striking psychiatric symptoms, present in most psychiatric disorders. Here, we introduce a novel social learning framework, which consists of neuro-computational models that combine reinforcement learning with various types of social knowledge structures. We outline how this social learning framework can help specify and quantify social psychopathology across disorders and provide an overview of the brain regions that may be involved in this type of social learning. We highlight how this framework can specify commonalities and differences in the social psychopathology of individuals with autism spectrum disorder (ASD), personality disorders (PD), and major depressive disorder (MDD) and improve treatments on an individual basis. We conjecture that individuals with psychiatric disorders rely on rigid social knowledge representations when learning about others, albeit the nature of their rigidity and the behavioral consequences can greatly differ. While non-clinical cohorts tend to efficiently adapt social knowledge representations to relevant environmental constraints, psychiatric cohorts may rigidly stick to their preconceived notions or overly coarse knowledge representations during learning.
Collapse
Affiliation(s)
- Gabriela Rosenblau
- Department of Psychological and Brain Sciences, George Washington University, Washington DC, USA; Autism and Neurodevelopmental Disorders Institute, George Washington University, Washington DC, USA.
| | - Koen Frolichs
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany; Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Christoph W Korn
- Section Social Neuroscience, Department of General Psychiatry, University of Heidelberg, Heidelberg, Germany; Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
28
|
Moneta N, Garvert MM, Heekeren HR, Schuck NW. Task state representations in vmPFC mediate relevant and irrelevant value signals and their behavioral influence. Nat Commun 2023; 14:3156. [PMID: 37258534 PMCID: PMC10232498 DOI: 10.1038/s41467-023-38709-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Accepted: 05/09/2023] [Indexed: 06/02/2023] Open
Abstract
The ventromedial prefrontal-cortex (vmPFC) is known to contain expected value signals that inform our choices. But expected values even for the same stimulus can differ by task. In this study, we asked how the brain flexibly switches between such value representations in a task-dependent manner. Thirty-five participants alternated between tasks in which either stimulus color or motion predicted rewards. We show that multivariate vmPFC signals contain a rich representation that includes the current task state or context (motion/color), the associated expected value, and crucially, the irrelevant value of the alternative context. We also find that irrelevant value representations in vmPFC compete with relevant value signals, interact with task-state representations and relate to behavioral signs of value competition. Our results shed light on vmPFC's role in decision making, bridging between its role in mapping observations onto the task states of a mental map, and computing expected values for multiple states.
Collapse
Affiliation(s)
- Nir Moneta
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany.
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany.
- Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany.
| | - Mona M Garvert
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103, Leipzig, Germany
| | - Hauke R Heekeren
- Einstein Center for Neurosciences Berlin, Charité Universitätsmedizin Berlin, 10117, Berlin, Germany
- Department of Education and Psychology, Freie Universität Berlin, 14195, Berlin, Germany
- Institute of Psychology, Universität Hamburg, 20146, Hamburg, Germany
| | - Nicolas W Schuck
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, 14195, Berlin, Germany.
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, 14195, Berlin, Germany.
- Institute of Psychology, Universität Hamburg, 20146, Hamburg, Germany.
| |
Collapse
|
29
|
Liu Z, Liao S, Seger CA. Rule and Exemplar-based Transfer in Category Learning. J Cogn Neurosci 2023; 35:628-644. [PMID: 36638230 DOI: 10.1162/jocn_a_01963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
We compared the neural systems involved in transfer to novel stimuli via rule application versus exemplar processing. Participants learned a categorization task involving abstraction of a complex rule and then categorized different types of transfer stimuli without feedback. Rule stimuli used new features and therefore could only be categorized using the rule. Exemplar stimuli included only one of the features necessary to apply the rule and therefore required participants to categorize based on similarity to individual previously learned category members. Consistent and inconsistent stimuli were formed so that both the rule and feature similarity indicated the same category (consistent) or opposite categories (inconsistent). We found that all conditions eliciting rule-based transfer recruited a medial prefrontal-anterior hippocampal network associated with schematic memory. In contrast, exemplar-based transfer recruited areas of the intraparietal sulcus associated with learning and executing stimulus-category mappings along with the posterior hippocampus. These results support theories of categorization that postulate complementary learning and generalization strategies based on schematic and exemplar mechanisms.
Collapse
Affiliation(s)
- Zhiya Liu
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China
| | - Siyao Liao
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China
| | - Carol A Seger
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Colorado State University, Department of Psychology, Molecular, Cellular and Integrative Neurosciences Program, Fort Collins, CO
| |
Collapse
|
30
|
Pettine WW, Raman DV, Redish AD, Murray JD. Human generalization of internal representations through prototype learning with goal-directed attention. Nat Hum Behav 2023; 7:442-463. [PMID: 36894642 DOI: 10.1038/s41562-023-01543-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Accepted: 01/31/2023] [Indexed: 03/11/2023]
Abstract
The world is overabundant with feature-rich information obscuring the latent causes of experience. How do people approximate the complexities of the external world with simplified internal representations that generalize to novel examples or situations? Theories suggest that internal representations could be determined by decision boundaries that discriminate between alternatives, or by distance measurements against prototypes and individual exemplars. Each provide advantages and drawbacks for generalization. We therefore developed theoretical models that leverage both discriminative and distance components to form internal representations via action-reward feedback. We then developed three latent-state learning tasks to test how humans use goal-oriented discrimination attention and prototypes/exemplar representations. The majority of participants attended to both goal-relevant discriminative features and the covariance of features within a prototype. A minority of participants relied only on the discriminative feature. Behaviour of all participants could be captured by parameterizing a model combining prototype representations with goal-oriented discriminative attention.
Collapse
Affiliation(s)
| | | | - A David Redish
- Department of Neuroscience, University of Minnesota, Minneapolis, MN, USA
| | - John D Murray
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
31
|
Abstract
A schema refers to a structured body of prior knowledge that captures common patterns across related experiences. Schemas have been studied separately in the realms of episodic memory and spatial navigation across different species and have been grounded in theories of memory consolidation, but there has been little attempt to integrate our understanding across domains, particularly in humans. We propose that experiences during navigation with many similarly structured environments give rise to the formation of spatial schemas (for example, the expected layout of modern cities) that share properties with but are distinct from cognitive maps (for example, the memory of a modern city) and event schemas (such as expected events in a modern city) at both cognitive and neural levels. We describe earlier theoretical frameworks and empirical findings relevant to spatial schemas, along with more targeted investigations of spatial schemas in human and non-human animals. Consideration of architecture and urban analytics, including the influence of scale and regionalization, on different properties of spatial schemas may provide a powerful approach to advance our understanding of spatial schemas.
Collapse
|
32
|
Labek K, Sittenberger E, Kienhöfer V, Rabl L, Messina I, Schurz M, Stingl JC, Viviani R. The gradient model of brain organization in decisions involving “empathy for pain”. Cereb Cortex 2022; 33:5839-5850. [PMID: 36537039 DOI: 10.1093/cercor/bhac464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2022] [Revised: 09/20/2022] [Accepted: 09/26/2022] [Indexed: 12/24/2022] Open
Abstract
Abstract
Influential models of cortical organization propose a close relationship between heteromodal association areas and highly connected hubs in the default mode network. The “gradient model” of cortical organization proposes a close relationship between these areas and highly connected hubs in the default mode network, a set of cortical areas deactivated by demanding tasks. Here, we used a decision-making task and representational similarity analysis with classic “empathy for pain” stimuli to probe the relationship between high-level representations of imminent pain in others and these areas. High-level representations were colocalized with task deactivations or the transitions from activations to deactivations. These loci belonged to 2 groups: those that loaded on the high end of the principal cortical gradient and were associated by meta-analytic decoding with the default mode network, and those that appeared to accompany functional repurposing of somatosensory cortex in the presence of visual stimuli. These findings suggest that task deactivations may set out cortical areas that host high-level representations. We anticipate that an increased understanding of the cortical correlates of high-level representations may improve neurobiological models of social interactions and psychopathology.
Collapse
Affiliation(s)
- Karin Labek
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
| | - Elisa Sittenberger
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Valerie Kienhöfer
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Luna Rabl
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| | - Irene Messina
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
- Scienze e Tecniche Psicologiche,Universitas Mercatorum , Piazza Mattei 10, 00186 Rome , Italy
| | - Matthias Schurz
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Innsbruck Digital Science Center (DiSC), , Innrain 15, 6020 Innsbruck , Austria
| | - Julia C Stingl
- University Clinic Aachen Clinical Pharmacology, , Wendlingweg 2, 52074 Aachen , Germany
| | - Roberto Viviani
- University of Innsbruck Institute of Psychology, , Universitätsstraße 5-7, 6020 Innsbruck , Austria
- University of Ulm Psychiatry and Psychotherapy Clinic III, , Leimgrubenweg 12, 89075 Ulm , Germany
| |
Collapse
|
33
|
Structure learning enhances concept formation in synthetic Active Inference agents. PLoS One 2022; 17:e0277199. [PMID: 36374909 PMCID: PMC9662737 DOI: 10.1371/journal.pone.0277199] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 10/24/2022] [Indexed: 11/16/2022] Open
Abstract
Humans display astonishing skill in learning about the environment in which they operate. They assimilate a rich set of affordances and interrelations among different elements in particular contexts, and form flexible abstractions (i.e., concepts) that can be generalised and leveraged with ease. To capture these abilities, we present a deep hierarchical Active Inference model of goal-directed behaviour, and the accompanying belief update schemes implied by maximising model evidence. Using simulations, we elucidate the potential mechanisms that underlie and influence concept learning in a spatial foraging task. We show that the representations formed–as a result of foraging–reflect environmental structure in a way that is enhanced and nuanced by Bayesian model reduction, a special case of structure learning that typifies learning in the absence of new evidence. Synthetic agents learn associations and form concepts about environmental context and configuration as a result of inferential, parametric learning, and structure learning processes–three processes that can produce a diversity of beliefs and belief structures. Furthermore, the ensuing representations reflect symmetries for environments with identical configurations.
Collapse
|
34
|
Safron A, Çatal O, Verbelen T. Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition. Front Syst Neurosci 2022; 16:787659. [PMID: 36246500 PMCID: PMC9563348 DOI: 10.3389/fnsys.2022.787659] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 09/02/2022] [Indexed: 11/24/2022] Open
Abstract
Simultaneous localization and mapping (SLAM) represents a fundamental problem for autonomous embodied systems, for which the hippocampal/entorhinal system (H/E-S) has been optimized over the course of evolution. We have developed a biologically-inspired SLAM architecture based on latent variable generative modeling within the Free Energy Principle and Active Inference (FEP-AI) framework, which affords flexible navigation and planning in mobile robots. We have primarily focused on attempting to reverse engineer H/E-S "design" properties, but here we consider ways in which SLAM principles from robotics may help us better understand nervous systems and emergent minds. After reviewing LatentSLAM and notable features of this control architecture, we consider how the H/E-S may realize these functional properties not only for physical navigation, but also with respect to high-level cognition understood as generalized simultaneous localization and mapping (G-SLAM). We focus on loop-closure, graph-relaxation, and node duplication as particularly impactful architectural features, suggesting these computational phenomena may contribute to understanding cognitive insight (as proto-causal-inference), accommodation (as integration into existing schemas), and assimilation (as category formation). All these operations can similarly be describable in terms of structure/category learning on multiple levels of abstraction. However, here we adopt an ecological rationality perspective, framing H/E-S functions as orchestrating SLAM processes within both concrete and abstract hypothesis spaces. In this navigation/search process, adaptive cognitive equilibration between assimilation and accommodation involves balancing tradeoffs between exploration and exploitation; this dynamic equilibrium may be near optimally realized in FEP-AI, wherein control systems governed by expected free energy objective functions naturally balance model simplicity and accuracy. With respect to structure learning, such a balance would involve constructing models and categories that are neither too inclusive nor exclusive. We propose these (generalized) SLAM phenomena may represent some of the most impactful sources of variation in cognition both within and between individuals, suggesting that modulators of H/E-S functioning may potentially illuminate their adaptive significances as fundamental cybernetic control parameters. Finally, we discuss how understanding H/E-S contributions to G-SLAM may provide a unifying framework for high-level cognition and its potential realization in artificial intelligences.
Collapse
Affiliation(s)
- Adam Safron
- Center for Psychedelic and Consciousness Research, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Cognitive Science Program, Indiana University, Bloomington, IN, United States
- Institute for Advanced Consciousness Studies, Santa Monica, CA, United States
| | - Ozan Çatal
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| | - Tim Verbelen
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| |
Collapse
|
35
|
Gao Z, Zheng L, Krieger-Redwood K, Halai A, Margulies DS, Smallwood J, Jefferies E. Flexing the principal gradient of the cerebral cortex to suit changing semantic task demands. eLife 2022; 11:e80368. [PMID: 36169281 PMCID: PMC9555860 DOI: 10.7554/elife.80368] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 09/27/2022] [Indexed: 11/13/2022] Open
Abstract
Understanding how thought emerges from the topographical structure of the cerebral cortex is a primary goal of cognitive neuroscience. Recent work has revealed a principal gradient of intrinsic connectivity capturing the separation of sensory-motor cortex from transmodal regions of the default mode network (DMN); this is thought to facilitate memory-guided cognition. However, studies have not explored how this dimension of connectivity changes when conceptual retrieval is controlled to suit the context. We used gradient decomposition of informational connectivity in a semantic association task to establish how the similarity in connectivity across brain regions changes during familiar and more original patterns of retrieval. Multivoxel activation patterns at opposite ends of the principal gradient were more divergent when participants retrieved stronger associations; therefore, when long-term semantic information is sufficient for ongoing cognition, regions supporting heteromodal memory are functionally separated from sensory-motor experience. In contrast, when less related concepts were linked, this dimension of connectivity was reduced in strength as semantic control regions separated from the DMN to generate more flexible and original responses. We also observed fewer dimensions within the neural response towards the apex of the principal gradient when strong associations were retrieved, reflecting less complex or varied neural coding across trials and participants. In this way, the principal gradient explains how semantic cognition is organised in the human cerebral cortex: the separation of DMN from sensory-motor systems is a hallmark of the retrieval of strong conceptual links that are culturally shared.
Collapse
Affiliation(s)
- Zhiyao Gao
- Department of Psychology, University of YorkNew YorkUnited Kingdom
| | - Li Zheng
- Department of Psychology, University of ArizonaTucsonUnited States
| | | | - Ajay Halai
- MRC Cognition and Brain Sciences Unit, University of CambridgeCambridgeUnited Kingdom
| | - Daniel S Margulies
- Integrative Neuroscience and Cognition Center (UMR 8002), Centre National de la Recherche ScientifiqueParisFrance
| | | | | |
Collapse
|
36
|
Pudhiyidath A, Morton NW, Viveros Duran R, Schapiro AC, Momennejad I, Hinojosa-Rowland DM, Molitor RJ, Preston AR. Representations of Temporal Community Structure in Hippocampus and Precuneus Predict Inductive Reasoning Decisions. J Cogn Neurosci 2022; 34:1736-1760. [PMID: 35579986 PMCID: PMC10262802 DOI: 10.1162/jocn_a_01864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Our understanding of the world is shaped by inferences about underlying structure. For example, at the gym, you might notice that the same people tend to arrive around the same time and infer that they are friends that work out together. Consistent with this idea, after participants are presented with a temporal sequence of objects that follows an underlying community structure, they are biased to infer that objects from the same community share the same properties. Here, we used fMRI to measure neural representations of objects after temporal community structure learning and examine how these representations support inference about object relationships. We found that community structure learning affected inferred object similarity: When asked to spatially group items based on their experience, participants tended to group together objects from the same community. Neural representations in perirhinal cortex predicted individual differences in object grouping, suggesting that high-level object representations are affected by temporal community learning. Furthermore, participants were biased to infer that objects from the same community would share the same properties. Using computational modeling of temporal learning and inference decisions, we found that inductive reasoning is influenced by both detailed knowledge of temporal statistics and abstract knowledge of the temporal communities. The fidelity of temporal community representations in hippocampus and precuneus predicted the degree to which temporal community membership biased reasoning decisions. Our results suggest that temporal knowledge is represented at multiple levels of abstraction, and that perirhinal cortex, hippocampus, and precuneus may support inference based on this knowledge.
Collapse
|
37
|
Majumdar G, Yazin F, Banerjee A, Roy D. Emotion dynamics as hierarchical Bayesian inference in time. Cereb Cortex 2022; 33:3750-3772. [PMID: 36030379 DOI: 10.1093/cercor/bhac305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 07/06/2022] [Accepted: 07/07/2022] [Indexed: 11/13/2022] Open
Abstract
What fundamental property of our environment would be most valuable and optimal in characterizing the emotional dynamics we experience in daily life? Empirical work has shown that an accurate estimation of uncertainty is necessary for our optimal perception, learning, and decision-making. However, the role of this uncertainty in governing our affective dynamics remains unexplored. Using Bayesian encoding, decoding and computational modeling, on a large-scale neuroimaging and behavioral data on a passive movie-watching task, we showed that emotions naturally arise due to ongoing uncertainty estimations about future outcomes in a hierarchical neural architecture. Several prefrontal subregions hierarchically encoded a lower-dimensional signal that highly correlated with the evolving uncertainty. Crucially, the lateral orbitofrontal cortex (lOFC) tracked the temporal fluctuations of this uncertainty and was predictive of the participants' predisposition to anxiety. Furthermore, we observed a distinct functional double-dissociation within OFC with increased connectivity between medial OFC and DMN, while with that of lOFC and FPN in response to the evolving affect. Finally, we uncovered a temporally predictive code updating an individual's beliefs spontaneously with fluctuating outcome uncertainty in the lOFC. A biologically relevant and computationally crucial parameter in the theories of brain function, we propose uncertainty to be central to the definition of complex emotions.
Collapse
Affiliation(s)
- Gargi Majumdar
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Fahd Yazin
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Arpan Banerjee
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India
| | - Dipanjan Roy
- Cognitive Brain Dynamics Lab, National Brain Research Centre, NH 8, Manesar, Gurgaon, Haryana 122052, India.,Centre for Brain Science and Applications, School of AIDE, IIT Jodhpur, NH 62, Surpura Bypass Rd, Karwar, Rajasthan 342030, India
| |
Collapse
|
38
|
Sheng J, Zhang L, Liu C, Liu J, Feng J, Zhou Y, Hu H, Xue G. Higher-dimensional neural representations predict better episodic memory. SCIENCE ADVANCES 2022; 8:eabm3829. [PMID: 35442734 PMCID: PMC9020666 DOI: 10.1126/sciadv.abm3829] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 03/03/2022] [Indexed: 06/14/2023]
Abstract
Episodic memory enables humans to encode and later vividly retrieve information about our rich experiences, yet the neural representations that support this mental capacity are poorly understood. Using a large fMRI dataset (n = 468) of face-name associative memory tasks and principal component analysis to examine neural representational dimensionality (RD), we found that the human brain maintained a high-dimensional representation of faces through hierarchical representation within and beyond the face-selective regions. Critically, greater RD was associated with better subsequent memory performance both within and across participants, and this association was specific to episodic memory but not general cognitive abilities. Furthermore, the frontoparietal activities could suppress the shared low-dimensional fluctuations and reduce the correlations of local neural responses, resulting in greater RD. RD was not associated with the degree of item-specific pattern similarity, and it made complementary contributions to episodic memory. These results provide a mechanistic understanding of the role of RD in supporting accurate episodic memory.
Collapse
|
39
|
Abstract
In human neuroscience, studies of cognition are rarely grounded in non-task-evoked, 'spontaneous' neural activity. Indeed, studies of spontaneous activity tend to focus predominantly on intrinsic neural patterns (for example, resting-state networks). Taking a 'representation-rich' approach bridges the gap between cognition and resting-state communities: this approach relies on decoding task-related representations from spontaneous neural activity, allowing quantification of the representational content and rich dynamics of such activity. For example, if we know the neural representation of an episodic memory, we can decode its subsequent replay during rest. We argue that such an approach advances cognitive research beyond a focus on immediate task demand and provides insight into the functional relevance of the intrinsic neural pattern (for example, the default mode network). This in turn enables a greater integration between human and animal neuroscience, facilitating experimental testing of theoretical accounts of intrinsic activity, and opening new avenues of research in psychiatry.
Collapse
|
40
|
Stiso J, Lynn CW, Kahn AE, Rangarajan V, Szymula KP, Archer R, Revell A, Stein JM, Litt B, Davis KA, Lucas TH, Bassett DS. Neurophysiological Evidence for Cognitive Map Formation during Sequence Learning. eNeuro 2022; 9:ENEURO.0361-21.2022. [PMID: 35105662 PMCID: PMC8896554 DOI: 10.1523/eneuro.0361-21.2022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 12/03/2021] [Accepted: 01/03/2022] [Indexed: 12/29/2022] Open
Abstract
Humans deftly parse statistics from sequences. Some theories posit that humans learn these statistics by forming cognitive maps, or underlying representations of the latent space which links items in the sequence. Here, an item in the sequence is a node, and the probability of transitioning between two items is an edge. Sequences can then be generated from walks through the latent space, with different spaces giving rise to different sequence statistics. Individual or group differences in sequence learning can be modeled by changing the time scale over which estimates of transition probabilities are built, or in other words, by changing the amount of temporal discounting. Latent space models with temporal discounting bear a resemblance to models of navigation through Euclidean spaces. However, few explicit links have been made between predictions from Euclidean spatial navigation and neural activity during human sequence learning. Here, we use a combination of behavioral modeling and intracranial encephalography (iEEG) recordings to investigate how neural activity might support the formation of space-like cognitive maps through temporal discounting during sequence learning. Specifically, we acquire human reaction times from a sequential reaction time task, to which we fit a model that formulates the amount of temporal discounting as a single free parameter. From the parameter, we calculate each individual's estimate of the latent space. We find that neural activity reflects these estimates mostly in the temporal lobe, including areas involved in spatial navigation. Similar to spatial navigation, we find that low-dimensional representations of neural activity allow for easy separation of important features, such as modules, in the latent space. Lastly, we take advantage of the high temporal resolution of iEEG data to determine the time scale on which latent spaces are learned. We find that learning typically happens within the first 500 trials, and is modulated by the underlying latent space and the amount of temporal discounting characteristic of each participant. Ultimately, this work provides important links between behavioral models of sequence learning and neural activity during the same behavior, and contextualizes these results within a broader framework of domain general cognitive maps.
Collapse
Affiliation(s)
- Jennifer Stiso
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Christopher W Lynn
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY 10016
- Joseph Henry Laboratories of Physics, Princeton University, Princeton, NJ 08544
| | - Ari E Kahn
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544
| | - Vinitha Rangarajan
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Karol P Szymula
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
| | - Ryan Archer
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Andrew Revell
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Joel M Stein
- Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Brian Litt
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Kathryn A Davis
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Timothy H Lucas
- Department of Neurology, Hospital of the University of Pennsylvania, Philadelphia, PA 19104
| | - Dani S Bassett
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Department of Electrical and Systems Engineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104
- Department of Physics and Astronomy, College of Arts and Sciences, University of Pennsylvania, Philadelphia, PA 19104
- The Santa Fe Institute, Santa Fe, NM 87501
- Department of Bioengineering, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY 10016
| |
Collapse
|
41
|
Hornsby AN, Love BC. Sequential consumer choice as multi-cued retrieval. SCIENCE ADVANCES 2022; 8:eabl9754. [PMID: 35213230 PMCID: PMC8880769 DOI: 10.1126/sciadv.abl9754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Accepted: 01/03/2022] [Indexed: 06/14/2023]
Abstract
Whether adding songs to a playlist or groceries during an online shop, how do we decide what to choose next? We develop a model that predicts such open-ended, sequential choices using a process of cued retrieval from long-term memory. Using the past choice to cue subsequent retrievals, this model predicts the sequential purchases and response times of nearly 5 million grocery purchases made by more than 100,000 online shoppers. Products can be associated in different ways, such as by their episodic association or semantic overlap, and we find that consumers query multiple forms of associative knowledge when retrieving options. Attending to certain knowledge sources, as estimated by our model, predicts important retrieval errors, such as the propensity to forget or add unwanted products. Our results demonstrate how basic memory retrieval mechanisms shape choices in real-world, goal-directed tasks.
Collapse
Affiliation(s)
- Adam N. Hornsby
- Dunnhumby, 184 Shepherds Bush Road, London W6 7NL, UK
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
| | - Bradley C. Love
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
- The Alan Turing Institute, London UK
| |
Collapse
|
42
|
Zhou D, Lynn CW, Cui Z, Ciric R, Baum GL, Moore TM, Roalf DR, Detre JA, Gur RC, Gur RE, Satterthwaite TD, Bassett DS. Efficient coding in the economics of human brain connectomics. Netw Neurosci 2022; 6:234-274. [PMID: 36605887 PMCID: PMC9810280 DOI: 10.1162/netn_a_00223] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 12/08/2021] [Indexed: 01/07/2023] Open
Abstract
In systems neuroscience, most models posit that brain regions communicate information under constraints of efficiency. Yet, evidence for efficient communication in structural brain networks characterized by hierarchical organization and highly connected hubs remains sparse. The principle of efficient coding proposes that the brain transmits maximal information in a metabolically economical or compressed form to improve future behavior. To determine how structural connectivity supports efficient coding, we develop a theory specifying minimum rates of message transmission between brain regions to achieve an expected fidelity, and we test five predictions from the theory based on random walk communication dynamics. In doing so, we introduce the metric of compression efficiency, which quantifies the trade-off between lossy compression and transmission fidelity in structural networks. In a large sample of youth (n = 1,042; age 8-23 years), we analyze structural networks derived from diffusion-weighted imaging and metabolic expenditure operationalized using cerebral blood flow. We show that structural networks strike compression efficiency trade-offs consistent with theoretical predictions. We find that compression efficiency prioritizes fidelity with development, heightens when metabolic resources and myelination guide communication, explains advantages of hierarchical organization, links higher input fidelity to disproportionate areal expansion, and shows that hubs integrate information by lossy compression. Lastly, compression efficiency is predictive of behavior-beyond the conventional network efficiency metric-for cognitive domains including executive function, memory, complex reasoning, and social cognition. Our findings elucidate how macroscale connectivity supports efficient coding and serve to foreground communication processes that utilize random walk dynamics constrained by network connectivity.
Collapse
Affiliation(s)
- Dale Zhou
- Department of Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Christopher W. Lynn
- Initiative for the Theoretical Sciences, Graduate Center, City University of New York, New York, NY, USA,Joseph Henry Laboratories of Physics, Princeton University, Princeton, NJ, USA
| | - Zaixu Cui
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Rastko Ciric
- Department of Bioengineering, Schools of Engineering and Medicine, Stanford University, Stanford, CA, USA
| | - Graham L. Baum
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - Tyler M. Moore
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - David R. Roalf
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - John A. Detre
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Ruben C. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Raquel E. Gur
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Theodore D. Satterthwaite
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Penn-Children’s Hospital of Philadelphia Lifespan Brain Institute, Philadelphia, PA, USA
| | - Dani S. Bassett
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA,Department of Physics & Astronomy, College of Arts and Sciences, University of Pennsylvania, Philadelphia, PA, USA,Department of Bioengineering, School of Engineering and Applied Sciences, University of Pennsylvania, Philadelphia, PA, USA,Department of Electrical & Systems Engineering, School of Engineering and Applied Sciences, University of Pennsylvania, Philadelphia, PA, USA,Santa Fe Institute, Santa Fe, NM, USA,* Corresponding Author:
| |
Collapse
|
43
|
Varga NL, Manns JR. Delta-modulated cortical alpha oscillations support new knowledge generation through memory integration. Neuroimage 2021; 244:118600. [PMID: 34562576 PMCID: PMC8796818 DOI: 10.1016/j.neuroimage.2021.118600] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 08/20/2021] [Accepted: 09/18/2021] [Indexed: 11/05/2022] Open
Abstract
The ability to generate new knowledge depends on integration of separate information. For example, in one episode an individual may learn that apple seeds are called pips. In a separate episode, the individual may then learn that pips contain cyanide. Integration of the related facts in memory may then support derivation of the new knowledge that apple seeds contain cyanide. Past studies show that adults form relational memories that represent the commonalities among discrete events, and that such integrated representation supports the ability to infer new knowledge. Although these integrated representations are thought to result from linking separate memories to the same neuronal ensemble, the neural mechanisms that underlie formation of such linkages are not well understood. Here we examined whether self-derivation of new, integrated knowledge was supported by oscillatory coherence, a means of linking discrete neuronal ensembles. Cortical alpha coherence was greater when adults encoded new facts that could be integrated with existing knowledge, relative to encoding unrelated facts, particularly in participants who showed better performance on the subsequent test of knowledge generation via fact integration. In high performers, posterior alpha amplitude was also modulated by delta phase, a form of cross-frequency coupling previously implicated in coordinating information stored widely throughout the cortex. Examination of the timing and topography of these respective signatures suggested that these oscillatory dynamics work in concert to encode and represent new knowledge with respect to prior knowledge that is reactivated, thus revealing fundamental mechanisms through which related memories are linked into integrated knowledge structures.
Collapse
Affiliation(s)
- Nicole L Varga
- Department of Psychology, Emory University, Atlanta, GA 30322, USA; Center for Learning and Memory, The University of Texas at Austin, Austin, TX 78712, USA.
| | - Joseph R Manns
- Department of Psychology, Emory University, Atlanta, GA 30322, USA.
| |
Collapse
|
44
|
Learning exceptions to the rule in human and model via hippocampal encoding. Sci Rep 2021; 11:21429. [PMID: 34728698 PMCID: PMC8563716 DOI: 10.1038/s41598-021-00864-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 10/13/2021] [Indexed: 11/09/2022] Open
Abstract
Category learning helps us process the influx of information we experience daily. A common category structure is "rule-plus-exceptions," in which most items follow a general rule, but exceptions violate this rule. People are worse at learning to categorize exceptions than rule-following items, but improved exception categorization has been positively associated with hippocampal function. In light of model-based predictions that the nature of existing memories of related experiences impacts memory formation, here we use behavioural and computational modelling data to explore how learning sequence impacts performance in rule-plus-exception categorization. Our behavioural results indicate that exception categorization accuracy improves when exceptions are introduced later in learning, after exposure to rule-followers. To explore whether hippocampal learning systems also benefit from this manipulation, we simulate our task using a computational model of hippocampus. The model successful replicates our behavioural findings related to exception learning, and representational similarity analysis of the model's hidden layers suggests that model representations are impacted by trial sequence: delaying the introduction of an exception shifts its representation closer to its own category members. Our results provide novel computational evidence of how hippocampal learning systems can be targeted by learning sequence and bolster extant evidence of hippocampus's role in category learning.
Collapse
|
45
|
Broschard MB, Kim J, Love BC, Wasserman EA, Freeman JH. Prelimbic cortex maintains attention to category-relevant information and flexibly updates category representations. Neurobiol Learn Mem 2021; 185:107524. [PMID: 34560284 PMCID: PMC8633767 DOI: 10.1016/j.nlm.2021.107524] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Accepted: 09/15/2021] [Indexed: 11/23/2022]
Abstract
Category learning groups stimuli according to similarity or function. This involves finding and attending to stimulus features that reliably inform category membership. Although many of the neural mechanisms underlying categorization remain elusive, models of human category learning posit that prefrontal cortex plays a substantial role. Here, we investigated the role of the prelimbic cortex (PL) in rat visual category learning by administering excitotoxic lesions before category training and then evaluating the effects of the lesions with computational modeling. Using a touchscreen apparatus, rats (female and male) learned to categorize distributions of category stimuli that varied along two continuous dimensions. For some rats, categorizing the stimuli encouraged selective attention towards a single stimulus dimension (i.e., 1D tasks). For other rats, categorizing the stimuli required divided attention towards both stimulus dimensions (i.e., 2D tasks). Testing sessions then examined generalization to novel exemplars. PL lesions impaired learning and generalization for the 1D tasks, but not the 2D tasks. Then, a neural network was fit to the behavioral data to examine how the lesions affected categorization. The results suggest that the PL facilitates category learning by maintaining attention to category-relevant information and updating category representations.
Collapse
Affiliation(s)
- Matthew B Broschard
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA 52242, USA.
| | - Jangjin Kim
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA 52242, USA
| | - Bradley C Love
- Department of Experimental Psychology and The Alan Turing Institute, University College London, London, UK
| | - Edward A Wasserman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA 52242, USA
| | - John H Freeman
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA 52242, USA
| |
Collapse
|
46
|
Zhou J, Gardner MPH, Schoenbaum G. Is the core function of orbitofrontal cortex to signal values or make predictions? Curr Opin Behav Sci 2021; 41:1-9. [PMID: 33869678 PMCID: PMC8052096 DOI: 10.1016/j.cobeha.2021.02.011] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
One dominant hypothesis about the function of the orbitofrontal cortex (OFC) is that the OFC signals the subjective values of possible outcomes to other brain areas for learning and decision making. This popular view generally neglects the fact that OFC is not necessary for simple value-based behavior (i.e., when values have been directly experienced). An alternative, emerging view suggests that OFC plays a more general role in representing structural information about the task or environment, derived from prior experience, and relevant to predicting behavioral outcomes, such as value. From this perspective, value signaling is simply one derivative of the core underlying function of OFC. New data in favor of both views have been accumulating rapidly. Here we review these new data in discussing the relative merits of these two ideas.
Collapse
Affiliation(s)
- Jingfeng Zhou
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| | - Matthew P H Gardner
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| | - Geoffrey Schoenbaum
- Intramural Research Program of the National Institute on Drug Abuse, Baltimore MD, USA
| |
Collapse
|
47
|
Learning and Representation of Hierarchical Concepts in Hippocampus and Prefrontal Cortex. J Neurosci 2021; 41:7675-7686. [PMID: 34330775 DOI: 10.1523/jneurosci.0657-21.2021] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 07/02/2021] [Accepted: 07/08/2021] [Indexed: 11/21/2022] Open
Abstract
A key aspect of conceptual knowledge is that it can be flexibly applied at different levels of abstraction, implying a hierarchical organization. It is yet unclear how this hierarchical structure is acquired and represented in the brain. Here we investigate the computations underlying the acquisition and representation of the hierarchical structure of conceptual knowledge in the hippocampal-prefrontal system of 32 human participants (22 females). We assessed the hierarchical nature of learning during a novel tree-like categorization task via computational model comparisons. The winning model allowed to extract and quantify estimates for accumulation and updating of hierarchical compared with single-feature-based concepts from behavior. We find that mPFC tracks accumulation of hierarchical conceptual knowledge over time, and mPFC and hippocampus both support trial-to-trial updating. As a function of those learning parameters, mPFC and hippocampus further show connectivity changes to rostro-lateral PFC, which ultimately represented the hierarchical structure of the concept in the final stages of learning. Our results suggest that mPFC and hippocampus support the integration of accumulated evidence and instantaneous updates into hierarchical concept representations in rostro-lateral PFC.SIGNIFICANCE STATEMENT A hallmark of human cognition is the flexible use of conceptual knowledge at different levels of abstraction, ranging from a coarse category level to a fine-grained subcategory level. While previous work probed the representational geometry of long-term category knowledge, it is unclear how this hierarchical structure inherent to conceptual knowledge is acquired and represented. By combining a novel hierarchical concept learning task with computational modeling of categorization behavior and concurrent fMRI, we differentiate the roles of key concept learning regions in hippocampus and PFC in learning computations and the representation of a hierarchical category structure.
Collapse
|
48
|
Schlichting ML, Gumus M, Zhu T, Mack ML. The structure of hippocampal circuitry relates to rapid category learning in humans. Hippocampus 2021; 31:1179-1190. [PMID: 34379847 DOI: 10.1002/hipo.23382] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Revised: 07/17/2021] [Accepted: 07/24/2021] [Indexed: 11/06/2022]
Abstract
Prior work suggests that complementary white matter pathways within the hippocampus (HPC) differentially support the learning of specific versus general information. In particular, while the trisynaptic pathway (TSP) rapidly forms memories for specific experiences, the monosynaptic pathway (MSP) slowly learns generalities. However, despite the theorized significance of such circuitry, characterizing how information flows within the HPC to support learning in humans remains a challenge. We leveraged diffusion-weighted imaging as a proxy for individual differences in white matter structure linking key regions along with TSP (HPC subfields CA3 and CA1 ) and MSP (entorhinal cortex and CA1 ) and related these differences in hippocampal structure to category learning ability. We hypothesized that learning to categorize the "exception" items that deviated from category rules would benefit from TSP-supported mnemonic specificity. Participant-level estimates of TSP- and MSP-related integrity were constructed from HPC subfield connectomes of white matter streamline density. Consistent with theories of TSP-supported learning mechanisms, we found a specific association between the integrity of CA3 -CA1 white matter connections and exception learning. These results highlight the significant role of HPC circuitry in complex human learning.
Collapse
Affiliation(s)
| | - Melisa Gumus
- Department of Psychology, University of Toronto, Toronto, Canada.,Institute of Medical Science, University of Toronto, Toronto, Canada
| | - Teresa Zhu
- Department of Psychology, University of Toronto, Toronto, Canada
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, Canada
| |
Collapse
|
49
|
Cortese A, Yamamoto A, Hashemzadeh M, Sepulveda P, Kawato M, De Martino B. Value signals guide abstraction during learning. eLife 2021; 10:68943. [PMID: 34254586 PMCID: PMC8331191 DOI: 10.7554/elife.68943] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 07/12/2021] [Indexed: 12/22/2022] Open
Abstract
The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals – the ventromedial prefrontal cortex – prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.
Collapse
Affiliation(s)
- Aurelio Cortese
- Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan.,Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Asuka Yamamoto
- Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan.,School of Information Science, Nara Institute of Science and Technology, Nara, Japan
| | - Maryam Hashemzadeh
- Department of Computing Science, University of Alberta, Edmonton, Canada
| | - Pradyumna Sepulveda
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Mitsuo Kawato
- Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan.,RIKEN Center for Artificial Intelligence Project, Kyoto, Japan
| | - Benedetto De Martino
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| |
Collapse
|
50
|
Raykov PP, Keidel JL, Oakhill J, Bird CM. Activation of Person Knowledge in Medial Prefrontal Cortex during the Encoding of New Lifelike Events. Cereb Cortex 2021; 31:3494-3505. [PMID: 33866362 PMCID: PMC8355471 DOI: 10.1093/cercor/bhab027] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Revised: 01/21/2021] [Accepted: 01/21/2021] [Indexed: 02/06/2023] Open
Abstract
Our knowledge about people can help us predict how they will behave in particular situations and interpret their actions. In this study, we investigated the cognitive and neural effects of person knowledge on the encoding and retrieval of novel life-like events. Healthy human participants learnt about two characters over a week by watching 6 episodes of one of two situation comedies, which were both centered on a young couple. In the scanner, they watched and then silently recalled 20 new scenes from both shows that were all set in unfamiliar locations: 10 from their trained show and 10 from the untrained show. After scanning, participants' recognition memory was better for scenes from the trained show. The functional magnetic resonance imaging (fMRI) patterns of brain activity when watching the videos were reinstated during recall, but this effect was not modulated by training. However, person knowledge boosted the similarity in fMRI patterns of activity in the medial prefrontal cortex (MPFC) when watching the new events involving familiar characters. Our findings identify a role for the MPFC in the representation of schematic person knowledge during the encoding of novel, lifelike events.
Collapse
Affiliation(s)
- Petar P Raykov
- School of Psychology, University of Sussex, Falmer BN1 9QH, UK
| | - James L Keidel
- School of Psychology, University of Sussex, Falmer BN1 9QH, UK
| | - Jane Oakhill
- School of Psychology, University of Sussex, Falmer BN1 9QH, UK
| | - Chris M Bird
- School of Psychology, University of Sussex, Falmer BN1 9QH, UK
| |
Collapse
|