1
|
Siena MJ, Simons JS. Metacognitive Awareness and the Subjective Experience of Remembering in Aphantasia. J Cogn Neurosci 2024; 36:1578-1598. [PMID: 38319889 DOI: 10.1162/jocn_a_02120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
Individuals with aphantasia, a nonclinical condition typically characterized by mental imagery deficits, often report reduced episodic memory. However, findings have hitherto rested largely on subjective self-reports, with few studies experimentally investigating both objective and subjective aspects of episodic memory in aphantasia. In this study, we tested both aspects of remembering in aphantasic individuals using a custom 3-D object and spatial memory task that manipulated visuospatial perspective, which is considered to be a key factor determining the subjective experience of remembering. Objective and subjective measures of memory performance were taken for both object and spatial memory features under different perspective conditions. Surprisingly, aphantasic participants were found to be unimpaired on all objective memory measures, including those for object memory features, despite reporting weaker overall mental imagery experience and lower subjective vividness ratings on the memory task. These results add to newly emerging evidence that aphantasia is a heterogenous condition, where some aphantasic individuals may lack metacognitive awareness of mental imagery rather than mental imagery itself. In addition, we found that both participant groups remembered object memory features with greater precision when encoded and retrieved in the first person versus third person, suggesting a first-person perspective might facilitate subjective memory reliving by enhancing the representational quality of scene contents.
Collapse
|
2
|
Maier PM, Iggena D, Ploner CJ, Finke C. Memory consolidation affects the interplay of place and response navigation. Cortex 2024; 175:12-27. [PMID: 38701643 DOI: 10.1016/j.cortex.2024.04.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 02/11/2024] [Accepted: 04/12/2024] [Indexed: 05/05/2024]
Abstract
Navigation through space is based on memory representations of landmarks ('place') or movement sequences ('response'). Over time, memory representations transform through consolidation. However, it is unclear how the transformation affects place and response navigation in humans. In the present study, healthy adults navigated to target locations in a virtual maze. The preference for using place and response strategies and the ability to recall place and response memories were tested after a delay of one hour (n = 31), one day (n = 30), or two weeks (n = 32). The different delays captured early-phase synaptic changes, changes after one night of sleep, and long-delay changes due to the reorganization of navigation networks. Our results show that the relative contributions of place and response navigation changed as a function of time. After a short delay of up to one day, participants preferentially used a place strategy and exhibited a high degree of visual landmark exploration. After a longer delay of two weeks, place strategy use decreased significantly. Participants now equally relied on place and response strategy use and increasingly repeated previously taken paths. Further analyses indicate that response strategy use predominantly occurred as a compensatory strategy in the absence of sufficient place memory. Over time, place memory faded before response memory. We suggest that the observed shift from place to response navigation is context-dependent since detailed landmark information, which strongly relied on hippocampal function, decayed faster than sequence information, which required less detail and depended on extra-hippocampal areas. We conclude that changes in place and response navigation likely reflect the reorganization of navigation networks during systems consolidation.
Collapse
Affiliation(s)
- Patrizia M Maier
- Charité - Universitätsmedizin Berlin, Department of Neurology, Berlin, Germany; Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and Brain, Berlin, Germany
| | - Deetje Iggena
- Charité - Universitätsmedizin Berlin, Department of Neurology, Berlin, Germany; Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and Brain, Berlin, Germany
| | - Christoph J Ploner
- Charité - Universitätsmedizin Berlin, Department of Neurology, Berlin, Germany
| | - Carsten Finke
- Charité - Universitätsmedizin Berlin, Department of Neurology, Berlin, Germany; Humboldt-Universität zu Berlin, Faculty of Philosophy, Berlin School of Mind and Brain, Berlin, Germany.
| |
Collapse
|
3
|
Sosa M, Plitt MH, Giocomo LM. Hippocampal sequences span experience relative to rewards. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.12.27.573490. [PMID: 38234842 PMCID: PMC10793396 DOI: 10.1101/2023.12.27.573490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
Hippocampal place cells fire in sequences that span spatial environments and non-spatial modalities, suggesting that hippocampal activity can anchor to the most behaviorally salient aspects of experience. As reward is a highly salient event, we hypothesized that sequences of hippocampal activity can anchor to rewards. To test this, we performed two-photon imaging of hippocampal CA1 neurons as mice navigated virtual environments with changing hidden reward locations. When the reward moved, the firing fields of a subpopulation of cells moved to the same relative position with respect to reward, constructing a sequence of reward-relative cells that spanned the entire task structure. The density of these reward-relative sequences increased with task experience as additional neurons were recruited to the reward-relative population. Conversely, a largely separate subpopulation maintained a spatially-based place code. These findings thus reveal separate hippocampal ensembles can flexibly encode multiple behaviorally salient reference frames, reflecting the structure of the experience.
Collapse
Affiliation(s)
- Marielena Sosa
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
| | - Mark H. Plitt
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
- Present address: Department of Molecular and Cell Biology, University of California Berkeley; Berkeley, CA, USA
| | - Lisa M. Giocomo
- Department of Neurobiology, Stanford University School of Medicine; Stanford, CA, USA
| |
Collapse
|
4
|
Muessig L, Ribeiro Rodrigues F, Bjerknes TL, Towse BW, Barry C, Burgess N, Moser EI, Moser MB, Cacucci F, Wills TJ. Environment geometry alters subiculum boundary vector cell receptive fields in adulthood and early development. Nat Commun 2024; 15:982. [PMID: 38302455 PMCID: PMC10834499 DOI: 10.1038/s41467-024-45098-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 01/15/2024] [Indexed: 02/03/2024] Open
Abstract
Boundaries to movement form a specific class of landmark information used for navigation: Boundary Vector Cells (BVCs) are neurons which encode an animal's location as a vector displacement from boundaries. Here we characterise the prevalence and spatial tuning of subiculum BVCs in adult and developing male rats, and investigate the relationship between BVC spatial firing and boundary geometry. BVC directional tunings align with environment walls in squares, but are uniformly distributed in circles, demonstrating that environmental geometry alters BVC receptive fields. Inserted barriers uncover both excitatory and inhibitory components to BVC receptive fields, demonstrating that inhibitory inputs contribute to BVC field formation. During post-natal development, subiculum BVCs mature slowly, contrasting with the earlier maturation of boundary-responsive cells in upstream Entorhinal Cortex. However, Subiculum and Entorhinal BVC receptive fields are altered by boundary geometry as early as tested, suggesting this is an inherent feature of the hippocampal representation of space.
Collapse
Affiliation(s)
- Laurenz Muessig
- Department of Cell and Developmental Biology, University College London, London, WC1E 6BT, UK
| | | | - Tale L Bjerknes
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, 7491, Norway
| | - Benjamin W Towse
- Institute of Cognitive Neuroscience, University College London, London, WC1N 3AZ, UK
| | - Caswell Barry
- Department of Cell and Developmental Biology, University College London, London, WC1E 6BT, UK
| | - Neil Burgess
- Institute of Cognitive Neuroscience, University College London, London, WC1N 3AZ, UK
- UCL Queen Square Institute of Neurology, University College London, London, WC1N 3BG, UK
| | - Edvard I Moser
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, 7491, Norway
| | - May-Britt Moser
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, 7491, Norway
| | - Francesca Cacucci
- Department of Neuroscience, Physiology and Pharmacology; University College London, London, WC1E 6BT, UK
| | - Thomas J Wills
- Department of Cell and Developmental Biology, University College London, London, WC1E 6BT, UK.
| |
Collapse
|
5
|
Chen D, Axmacher N, Wang L. Grid codes underlie multiple cognitive maps in the human brain. Prog Neurobiol 2024; 233:102569. [PMID: 38232782 DOI: 10.1016/j.pneurobio.2024.102569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 01/07/2024] [Accepted: 01/10/2024] [Indexed: 01/19/2024]
Abstract
Grid cells fire at multiple positions that organize the vertices of equilateral triangles tiling a 2D space and are well studied in rodents. The last decade witnessed rapid progress in two other research lines on grid codes-empirical studies on distributed human grid-like representations in physical and multiple non-physical spaces, and cognitive computational models addressing the function of grid cells based on principles of efficient and predictive coding. Here, we review the progress in these fields and integrate these lines into a systematic organization. We also discuss the coordinate mechanisms of grid codes in the human entorhinal cortex and medial prefrontal cortex and their role in neurological and psychiatric diseases.
Collapse
Affiliation(s)
- Dong Chen
- CAS Key Laboratory of Mental Health, Institute of Psychology, 100101, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, 100101, Beijing, China
| | - Nikolai Axmacher
- Department of Neuropsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr University Bochum, 44801, Bochum, Germany
| | - Liang Wang
- CAS Key Laboratory of Mental Health, Institute of Psychology, 100101, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, 100101, Beijing, China.
| |
Collapse
|
6
|
Iggena D, Jeung S, Maier PM, Ploner CJ, Gramann K, Finke C. Multisensory input modulates memory-guided spatial navigation in humans. Commun Biol 2023; 6:1167. [PMID: 37963986 PMCID: PMC10646091 DOI: 10.1038/s42003-023-05522-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 10/30/2023] [Indexed: 11/16/2023] Open
Abstract
Efficient navigation is supported by a cognitive map of space. The hippocampus plays a key role for this map by linking multimodal sensory information with spatial memory representations. However, in human navigation studies, the full range of sensory information is often unavailable due to the stationarity of experimental setups. We investigated the contribution of multisensory information to memory-guided spatial navigation by presenting a virtual version of the Morris water maze on a screen and in an immersive mobile virtual reality setup. Patients with hippocampal lesions and matched controls navigated to memorized object locations in relation to surrounding landmarks. Our results show that availability of multisensory input improves memory-guided spatial navigation in both groups. It has distinct effects on navigational behaviour, with greater improvement in spatial memory performance in patients. We conclude that congruent multisensory information shifts computations to extrahippocampal areas that support spatial navigation and compensates for spatial navigation deficits.
Collapse
Affiliation(s)
- Deetje Iggena
- Charité - Universitätsmedizin Berlin, Department of Neurology, Augustenburger Platz 1, 13353, Berlin, Germany.
- Humboldt-Universität zu Berlin, Berlin School of Mind and Brain, Unter den Linden 6, 10099, Berlin, Germany.
| | - Sein Jeung
- Technische Universität Berlin, Department of Biological Psychology and Neuroergonomics, Fasanenstraße 1, 10623, Berlin, Germany
- Norwegian University of Science and Technology, Kavli Institute for Systems Neuroscience, Olav Kyrres gate 9,7030, Trondheim, Norway
- Max-Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, 04103, Leipzig, Germany
| | - Patrizia M Maier
- Charité - Universitätsmedizin Berlin, Department of Neurology, Augustenburger Platz 1, 13353, Berlin, Germany
- Humboldt-Universität zu Berlin, Berlin School of Mind and Brain, Unter den Linden 6, 10099, Berlin, Germany
| | - Christoph J Ploner
- Charité - Universitätsmedizin Berlin, Department of Neurology, Augustenburger Platz 1, 13353, Berlin, Germany
| | - Klaus Gramann
- Technische Universität Berlin, Department of Biological Psychology and Neuroergonomics, Fasanenstraße 1, 10623, Berlin, Germany
- University of California, San Diego, Center for Advanced Neurological Engineering, 9500 Gilman Dr, La Jolla, CA, 92093, USA
| | - Carsten Finke
- Charité - Universitätsmedizin Berlin, Department of Neurology, Augustenburger Platz 1, 13353, Berlin, Germany
- Humboldt-Universität zu Berlin, Berlin School of Mind and Brain, Unter den Linden 6, 10099, Berlin, Germany
| |
Collapse
|
7
|
Dabaghian Y. Grid cells, border cells, and discrete complex analysis. Front Comput Neurosci 2023; 17:1242300. [PMID: 37881247 PMCID: PMC10595009 DOI: 10.3389/fncom.2023.1242300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 09/22/2023] [Indexed: 10/27/2023] Open
Abstract
We propose a mechanism enabling the appearance of border cells-neurons firing at the boundaries of the navigated enclosures. The approach is based on the recent discovery of discrete complex analysis on a triangular lattice, which allows constructing discrete epitomes of complex-analytic functions and making use of their inherent ability to attain maximal values at the boundaries of generic lattice domains. As it turns out, certain elements of the discrete-complex framework readily appear in the oscillatory models of grid cells. We demonstrate that these models can extend further, producing cells that increase their activity toward the frontiers of the navigated environments. We also construct a network model of neurons with border-bound firing that conforms with the oscillatory models.
Collapse
Affiliation(s)
- Yuri Dabaghian
- Department of Neurology, The University of Texas, McGovern Medical Center at Houston, Houston, TX, United States
| |
Collapse
|
8
|
Parra-Barrero E, Vijayabaskaran S, Seabrook E, Wiskott L, Cheng S. A map of spatial navigation for neuroscience. Neurosci Biobehav Rev 2023; 152:105200. [PMID: 37178943 DOI: 10.1016/j.neubiorev.2023.105200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 04/13/2023] [Accepted: 04/24/2023] [Indexed: 05/15/2023]
Abstract
Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.
Collapse
Affiliation(s)
- Eloy Parra-Barrero
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany
| | - Sandhiya Vijayabaskaran
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany
| | - Eddie Seabrook
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany
| | - Laurenz Wiskott
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany
| | - Sen Cheng
- Institute for Neural Computation, Faculty of Computer Science, Ruhr University Bochum, Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Bochum, Germany.
| |
Collapse
|
9
|
Ginosar G, Aljadeff J, Las L, Derdikman D, Ulanovsky N. Are grid cells used for navigation? On local metrics, subjective spaces, and black holes. Neuron 2023; 111:1858-1875. [PMID: 37044087 DOI: 10.1016/j.neuron.2023.03.027] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 11/18/2022] [Accepted: 03/20/2023] [Indexed: 04/14/2023]
Abstract
The symmetric, lattice-like spatial pattern of grid-cell activity is thought to provide a neuronal global metric for space. This view is compatible with grid cells recorded in empty boxes but inconsistent with data from more naturalistic settings. We review evidence arguing against the global-metric notion, including the distortion and disintegration of the grid pattern in complex and three-dimensional environments. We argue that deviations from lattice symmetry are key for understanding grid-cell function. We propose three possible functions for grid cells, which treat real-world grid distortions as a feature rather than a bug. First, grid cells may constitute a local metric for proximal space rather than a global metric for all space. Second, grid cells could form a metric for subjective action-relevant space rather than physical space. Third, distortions may represent salient locations. Finally, we discuss mechanisms that can underlie these functions. These ideas may transform our thinking about grid cells.
Collapse
Affiliation(s)
- Gily Ginosar
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Johnatan Aljadeff
- Department of Neurobiology, University of California, San Diego, La Jolla, CA 92093, USA
| | - Liora Las
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Dori Derdikman
- Department of Neuroscience, Rappaport Faculty of Medicine and Research Institute, Technion, Haifa 31096, Israel.
| | - Nachum Ulanovsky
- Department of Brain Sciences, Weizmann Institute of Science, Rehovot 76100, Israel.
| |
Collapse
|
10
|
Baczkowski BM, Haaker J, Schwabe L. Inferring danger with minimal aversive experience. Trends Cogn Sci 2023; 27:456-467. [PMID: 36941184 DOI: 10.1016/j.tics.2023.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 01/11/2023] [Accepted: 02/23/2023] [Indexed: 03/22/2023]
Abstract
Learning about threats is crucial for survival and fundamentally rests upon Pavlovian conditioning. However, Pavlovian threat learning is largely limited to detecting known (or similar) threats and involves first-hand exposure to danger, which inevitably poses a risk of harm. We discuss how individuals leverage a rich repertoire of mnemonic processes that operate largely in safety and significantly expand our ability to recognize danger beyond Pavlovian threat associations. These processes result in complementary memories - acquired individually or through social interactions - that represent potential threats and the relational structure of our environment. The interplay between these memories allows danger to be inferred rather than directly learned, thereby flexibly protecting us from potential harm in novel situations despite minimal prior aversive experience.
Collapse
Affiliation(s)
- Blazej M Baczkowski
- Department of Cognitive Psychology, Universität Hamburg, Von-Melle-Park 5, 20146 Hamburg, Germany
| | - Jan Haaker
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246 Hamburg, Germany
| | - Lars Schwabe
- Department of Cognitive Psychology, Universität Hamburg, Von-Melle-Park 5, 20146 Hamburg, Germany.
| |
Collapse
|
11
|
Momennejad I. A rubric for human-like agents and NeuroAI. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210446. [PMID: 36511409 PMCID: PMC9745874 DOI: 10.1098/rstb.2021.0446] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Accepted: 10/27/2022] [Indexed: 12/15/2022] Open
Abstract
Researchers across cognitive, neuro- and computer sciences increasingly reference 'human-like' artificial intelligence and 'neuroAI'. However, the scope and use of the terms are often inconsistent. Contributed research ranges widely from mimicking behaviour, to testing machine learning methods as neurally plausible hypotheses at the cellular or functional levels, or solving engineering problems. However, it cannot be assumed nor expected that progress on one of these three goals will automatically translate to progress in others. Here, a simple rubric is proposed to clarify the scope of individual contributions, grounded in their commitments to human-like behaviour, neural plausibility or benchmark/engineering/computer science goals. This is clarified using examples of weak and strong neuroAI and human-like agents, and discussing the generative, corroborate and corrective ways in which the three dimensions interact with one another. The author maintains that future progress in artificial intelligence will need strong interactions across the disciplines, with iterative feedback loops and meticulous validity tests-leading to both known and yet-unknown advances that may span decades to come. This article is part of a discussion meeting issue 'New approaches to 3D vision'.
Collapse
Affiliation(s)
- Ida Momennejad
- Microsoft Research NYC, Reinforcement Learning Station, 300 Lafayette, New York, NY 10012, USA
| |
Collapse
|
12
|
Jeung S, Hilton C, Berg T, Gehrke L, Gramann K. Virtual Reality for Spatial Navigation. Curr Top Behav Neurosci 2023; 65:103-129. [PMID: 36512288 DOI: 10.1007/7854_2022_403] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.
Collapse
Affiliation(s)
- Sein Jeung
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, Norway
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Christopher Hilton
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Timotheus Berg
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Lukas Gehrke
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Klaus Gramann
- Department of Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany.
- Center for Advanced Neurological Engineering, University of California, San Diego, CA, USA.
| |
Collapse
|
13
|
Congruence-based contextual plausibility modulates cortical activity during vibrotactile perception in virtual multisensory environments. Commun Biol 2022; 5:1360. [PMID: 36509971 PMCID: PMC9744907 DOI: 10.1038/s42003-022-04318-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 11/29/2022] [Indexed: 12/14/2022] Open
Abstract
How congruence cues and congruence-based expectations may together shape perception in virtual reality (VR) still need to be unravelled. We linked the concept of plausibility used in VR research with congruence-based modulation by assessing brain responses while participants experienced vehicle riding experiences in VR scenarios. Perceptual plausibility was manipulated by sensory congruence, with multisensory stimulations confirming with common expectations of road scenes being plausible. We hypothesized that plausible scenarios would elicit greater cortical responses. The results showed that: (i) vibrotactile stimulations at expected intensities, given embedded audio-visual information, engaged greater cortical activities in frontal and sensorimotor regions; (ii) weaker plausible stimulations resulted in greater responses in the sensorimotor cortex than stronger but implausible stimulations; (iii) frontal activities under plausible scenarios negatively correlated with plausibility violation costs in the sensorimotor cortex. These results potentially indicate frontal regulation of sensory processing and extend previous evidence of contextual modulation to the tactile sense.
Collapse
|
14
|
Safron A, Çatal O, Verbelen T. Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition. Front Syst Neurosci 2022; 16:787659. [PMID: 36246500 PMCID: PMC9563348 DOI: 10.3389/fnsys.2022.787659] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 09/02/2022] [Indexed: 11/24/2022] Open
Abstract
Simultaneous localization and mapping (SLAM) represents a fundamental problem for autonomous embodied systems, for which the hippocampal/entorhinal system (H/E-S) has been optimized over the course of evolution. We have developed a biologically-inspired SLAM architecture based on latent variable generative modeling within the Free Energy Principle and Active Inference (FEP-AI) framework, which affords flexible navigation and planning in mobile robots. We have primarily focused on attempting to reverse engineer H/E-S "design" properties, but here we consider ways in which SLAM principles from robotics may help us better understand nervous systems and emergent minds. After reviewing LatentSLAM and notable features of this control architecture, we consider how the H/E-S may realize these functional properties not only for physical navigation, but also with respect to high-level cognition understood as generalized simultaneous localization and mapping (G-SLAM). We focus on loop-closure, graph-relaxation, and node duplication as particularly impactful architectural features, suggesting these computational phenomena may contribute to understanding cognitive insight (as proto-causal-inference), accommodation (as integration into existing schemas), and assimilation (as category formation). All these operations can similarly be describable in terms of structure/category learning on multiple levels of abstraction. However, here we adopt an ecological rationality perspective, framing H/E-S functions as orchestrating SLAM processes within both concrete and abstract hypothesis spaces. In this navigation/search process, adaptive cognitive equilibration between assimilation and accommodation involves balancing tradeoffs between exploration and exploitation; this dynamic equilibrium may be near optimally realized in FEP-AI, wherein control systems governed by expected free energy objective functions naturally balance model simplicity and accuracy. With respect to structure learning, such a balance would involve constructing models and categories that are neither too inclusive nor exclusive. We propose these (generalized) SLAM phenomena may represent some of the most impactful sources of variation in cognition both within and between individuals, suggesting that modulators of H/E-S functioning may potentially illuminate their adaptive significances as fundamental cybernetic control parameters. Finally, we discuss how understanding H/E-S contributions to G-SLAM may provide a unifying framework for high-level cognition and its potential realization in artificial intelligences.
Collapse
Affiliation(s)
- Adam Safron
- Center for Psychedelic and Consciousness Research, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Cognitive Science Program, Indiana University, Bloomington, IN, United States
- Institute for Advanced Consciousness Studies, Santa Monica, CA, United States
| | - Ozan Çatal
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| | - Tim Verbelen
- IDLab, Department of Information Technology, Ghent University—imec, Ghent, Belgium
| |
Collapse
|
15
|
Buckley MG, Myles LA, Easton A, McGregor A. The spatial layout of doorways and environmental boundaries shape the content of event memories. Cognition 2022; 225:105091. [DOI: 10.1016/j.cognition.2022.105091] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 03/03/2022] [Accepted: 03/04/2022] [Indexed: 11/03/2022]
|
16
|
Andonovski N. Episodic representation: A mental models account. Front Psychol 2022; 13:899371. [PMID: 35936308 PMCID: PMC9355728 DOI: 10.3389/fpsyg.2022.899371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2022] [Accepted: 06/30/2022] [Indexed: 11/13/2022] Open
Abstract
This paper offers a modeling account of episodic representation. I argue that the episodic system constructs mental models: representations that preserve the spatiotemporal structure of represented domains. In prototypical cases, these domains are events: occurrences taken by subjects to have characteristic structures, dynamics and relatively determinate beginnings and ends. Due to their simplicity and manipulability, mental event models can be used in a variety of cognitive contexts: in remembering the personal past, but also in future-oriented and counterfactual imagination. As structural representations, they allow surrogative reasoning, supporting inferences about their constituents which can be used in reasoning about the represented events.
Collapse
|
17
|
de Cothi W, Nyberg N, Griesbauer EM, Ghanamé C, Zisch F, Lefort JM, Fletcher L, Newton C, Renaudineau S, Bendor D, Grieves R, Duvelle É, Barry C, Spiers HJ. Predictive maps in rats and humans for spatial navigation. Curr Biol 2022; 32:3676-3689.e5. [PMID: 35863351 DOI: 10.1016/j.cub.2022.06.090] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 05/19/2022] [Accepted: 06/29/2022] [Indexed: 11/25/2022]
Abstract
Much of our understanding of navigation comes from the study of individual species, often with specific tasks tailored to those species. Here, we provide a novel experimental and analytic framework integrating across humans, rats, and simulated reinforcement learning (RL) agents to interrogate the dynamics of behavior during spatial navigation. We developed a novel open-field navigation task ("Tartarus maze") requiring dynamic adaptation (shortcuts and detours) to frequently changing obstructions on the path to a hidden goal. Humans and rats were remarkably similar in their trajectories. Both species showed the greatest similarity to RL agents utilizing a "successor representation," which creates a predictive map. Humans also displayed trajectory features similar to model-based RL agents, which implemented an optimal tree-search planning procedure. Our results help refine models seeking to explain mammalian navigation in dynamic environments and highlight the utility of modeling the behavior of different species to uncover the shared mechanisms that support behavior.
Collapse
Affiliation(s)
- William de Cothi
- Department of Cell and Developmental Biology, University College London, London, UK; Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK.
| | - Nils Nyberg
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Eva-Maria Griesbauer
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Carole Ghanamé
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Fiona Zisch
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK; The Bartlett School of Architecture, University College London, London, UK
| | - Julie M Lefort
- Department of Cell and Developmental Biology, University College London, London, UK
| | - Lydia Fletcher
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Coco Newton
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Sophie Renaudineau
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Daniel Bendor
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK
| | - Roddy Grieves
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK; Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Éléonore Duvelle
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK; Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Caswell Barry
- Department of Cell and Developmental Biology, University College London, London, UK
| | - Hugo J Spiers
- Institute of Behavioral Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, London, UK.
| |
Collapse
|
18
|
Bellmund JLS, Deuker L, Montijn ND, Doeller CF. Mnemonic construction and representation of temporal structure in the hippocampal formation. Nat Commun 2022; 13:3395. [PMID: 35739096 PMCID: PMC9226117 DOI: 10.1038/s41467-022-30984-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 05/20/2022] [Indexed: 11/10/2022] Open
Abstract
The hippocampal-entorhinal region supports memory for episodic details, such as temporal relations of sequential events, and mnemonic constructions combining experiences for inferential reasoning. However, it is unclear whether hippocampal event memories reflect temporal relations derived from mnemonic constructions, event order, or elapsing time, and whether these sequence representations generalize temporal relations across similar sequences. Here, participants mnemonically constructed times of events from multiple sequences using infrequent cues and their experience of passing time. After learning, event representations in the anterior hippocampus reflected temporal relations based on constructed times. Temporal relations were generalized across sequences, revealing distinct representational formats for events from the same or different sequences. Structural knowledge about time patterns, abstracted from different sequences, biased the construction of specific event times. These findings demonstrate that mnemonic construction and the generalization of relational knowledge combine in the hippocampus, consistent with the simulation of scenarios from episodic details and structural knowledge.
Collapse
Affiliation(s)
- Jacob L S Bellmund
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Lorena Deuker
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Nicole D Montijn
- Department of Clinical Psychology, Utrecht University, Utrecht, The Netherlands
| | - Christian F Doeller
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
- Kavli Institute for Systems Neuroscience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Jebsen Centre for Alzheimer's Disease, Norwegian University of Science and Technology, Trondheim, Norway.
- Wilhelm Wundt Institute of Psychology, Leipzig University, Leipzig, Germany.
| |
Collapse
|
19
|
Nyberg N, Duvelle É, Barry C, Spiers HJ. Spatial goal coding in the hippocampal formation. Neuron 2022; 110:394-422. [PMID: 35032426 DOI: 10.1016/j.neuron.2021.12.012] [Citation(s) in RCA: 42] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 10/18/2021] [Accepted: 12/08/2021] [Indexed: 12/22/2022]
Abstract
The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.
Collapse
Affiliation(s)
- Nils Nyberg
- Institute of Behavioural Neuroscience, Department of Experimental Psychology, University College London, London, UK.
| | - Éléonore Duvelle
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Caswell Barry
- Department of Cell and Developmental Biology, University College London, London, UK
| | - Hugo J Spiers
- Institute of Behavioural Neuroscience, Department of Experimental Psychology, University College London, London, UK.
| |
Collapse
|
20
|
Buckley MG, Austen JM, Myles LAM, Smith S, Ihssen N, Lew AR, McGregor A. The effects of spatial stability and cue type on spatial learning: Implications for theories of parallel memory systems. Cognition 2021; 214:104802. [PMID: 34225248 DOI: 10.1016/j.cognition.2021.104802] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 05/25/2021] [Accepted: 06/03/2021] [Indexed: 11/30/2022]
Abstract
Some theories of spatial learning predict that associative rules apply under only limited circumstances. For example, learning based on a boundary has been claimed to be immune to cue competition effects because boundary information is the basis for the formation of a cognitive map, whilst landmark learning does not involve cognitive mapping. This is referred to as the cue type hypothesis. However, it has also been claimed that cue stability is a prerequisite for the formation of a cognitive map, meaning that whichever cue type was perceived as stable would enter a cognitive map and thus be immune to cue competition, while unstable cues will be subject to cue competition, regardless of cue type. In experiments 1 and 2 we manipulated the stability of boundary and landmark cues when learning the location of two hidden goals. One goal location was constant with respect to the boundary, and the other constant with respect to the landmark cues. For both cue types, the presence of distal orientation cues provided directional information. For half the participants the landmark cues were unstable relative to the boundary and orientation cues, whereas for the remainder of the participants the boundary was unstable relative to landmarks and orientation cues. In a second stage of training, all cues remained stable so that both goal locations could be learned with respect to both landmark and boundary information. According to the cue type hypothesis, boundary information should block learning about landmarks regardless of cue stability. According to the cue stability hypothesis, however, landmarks should block learning about the boundary when the landmarks appear stable relative to the boundary. Regardless of cue type or stability the results showed reciprocal blocking, contrary to both formulations of incidental cognitive mapping. Experiment 3 established that the results of Experiments 1 and 2 could not be explained in terms of difficulty in learning certain locations with respect to different cue types. In a final experiment, following training in which both landmarks and boundary cues signalled two goal locations, a new goal location was established with respect to the landmark cues, before testing with the boundary, which had never been used to define the new goal location. The results of this novel test of the interaction between boundary and landmark cues indicated that new learning with respect to the landmark had a profound effect on navigation with respect to the boundary, counter to the predictions of incidental cognitive mapping of boundaries.
Collapse
Affiliation(s)
- Matthew G Buckley
- Department of Psychology, Durham University, UK; School of Psychology, Aston University, UK.
| | | | | | - Shamus Smith
- School of Electrical Engineering and Computing, University of Newcastle, Australia
| | | | - Adina R Lew
- Department of Psychology, Lancaster University, UK
| | | |
Collapse
|
21
|
Geometric models reveal behavioural and neural signatures of transforming experiences into memories. Nat Hum Behav 2021; 5:905-919. [PMID: 33574605 DOI: 10.1038/s41562-021-01051-6] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Accepted: 01/08/2021] [Indexed: 01/30/2023]
Abstract
How do we preserve and distort our ongoing experiences when encoding them into episodic memories? The mental contexts in which we interpret experiences are often person-specific, even when the experiences themselves are shared. Here we develop a geometric framework for mathematically characterizing the subjective conceptual content of dynamic naturalistic experiences. We model experiences and memories as trajectories through word-embedding spaces whose coordinates reflect the universe of thoughts under consideration. Memory encoding can then be modelled as geometrically preserving or distorting the 'shape' of the original experience. We applied our approach to data collected as participants watched and verbally recounted a television episode while undergoing functional neuroimaging. Participants' recountings preserved coarse spatial properties (essential narrative elements) but not fine spatial scale (low-level) details of the episode's trajectory. We also identified networks of brain structures sensitive to these trajectory shapes.
Collapse
|
22
|
Abstract
Hippocampus and entorhinal cortex form cognitive maps that represent relations among memories within a multidimensional space. While these relational maps have long been proposed to contribute to episodic memory, recent work suggests that they also support concept formation by representing relevant features for discriminating among related concepts. Cognitive maps may be refined by medial prefrontal cortex, which selects dimensions to represent based on their behavioral relevance. Hippocampal pattern completion, which is critical for retrieval of episodic memories, may also contribute to generalization of existing concepts to new exemplars. Navigation within hippocampal cognitive maps, which is guided by grid coding in entorhinal cortex, may contribute to imagination through recombination of event elements or concept features.
Collapse
Affiliation(s)
- Neal W Morton
- The Center for Learning & Memory, The University of Texas at Austin, 1 University Station Stop C7000, Austin, TX 78712-0805, USA
| | - Alison R. Preston
- The Center for Learning & Memory, The University of Texas at Austin, 1 University Station Stop C7000, Austin, TX 78712-0805, USA
- Department of Psychology, The University of Texas at Austin, 108 E Dean Keeton Stop A8000, Austin, TX 78712-1043, USA
- Department of Neuroscience, The University of Texas at Austin, 1 University Station Stop C7000, Austin, TX 78712-0805, USA
| |
Collapse
|
23
|
Kuhrt D, St John NR, Bellmund JLS, Kaplan R, Doeller CF. An immersive first-person navigation task for abstract knowledge acquisition. Sci Rep 2021; 11:5612. [PMID: 33692382 PMCID: PMC7947005 DOI: 10.1038/s41598-021-84599-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 12/22/2020] [Indexed: 11/09/2022] Open
Abstract
Advances in virtual reality (VR) technology have greatly benefited spatial navigation research. By presenting space in a controlled manner, changing aspects of the environment one at a time or manipulating the gain from different sensory inputs, the mechanisms underlying spatial behaviour can be investigated. In parallel, a growing body of evidence suggests that the processes involved in spatial navigation extend to non-spatial domains. Here, we leverage VR technology advances to test whether participants can navigate abstract knowledge. We designed a two-dimensional quantity space-presented using a head-mounted display-to test if participants can navigate abstract knowledge using a first-person perspective navigation paradigm. To investigate the effect of physical movement, we divided participants into two groups: one walking and rotating on a motion platform, the other group using a gamepad to move through the abstract space. We found that both groups learned to navigate using a first-person perspective and formed accurate representations of the abstract space. Interestingly, navigation in the quantity space resembled behavioural patterns observed in navigation studies using environments with natural visuospatial cues. Notably, both groups demonstrated similar patterns of learning. Taken together, these results imply that both self-movement and remote exploration can be used to learn the relational mapping between abstract stimuli.
Collapse
Affiliation(s)
- Doerte Kuhrt
- Kavli Institute for Systems Neurocience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Natalie R St John
- Kavli Institute for Systems Neurocience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway
| | - Jacob L S Bellmund
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Raphael Kaplan
- Kavli Institute for Systems Neurocience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway
| | - Christian F Doeller
- Kavli Institute for Systems Neurocience, Centre for Neural Computation, The Egil and Pauline Braathen and Fred Kavli Centre for Cortical Microcircuits, Norwegian University of Science and Technology, Trondheim, Norway. .,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| |
Collapse
|
24
|
Place R, Nitz DA. Cognitive Maps: Distortions of the Hippocampal Space Map Define Neighborhoods. Curr Biol 2021; 30:R340-R342. [PMID: 32315629 DOI: 10.1016/j.cub.2020.02.085] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
In place of continuous overhead satellite views of an environment, the brain often relies on first-person experiences to estimate spatial relationships between locations. Using new methods, a recent study has found the spatial metric observed in hippocampal activity adapts to encode local environmental terrain.
Collapse
Affiliation(s)
- Ryan Place
- Department of Cognitive Science, MC 0515, University of California San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA.
| | - Douglas A Nitz
- Department of Cognitive Science, MC 0515, University of California San Diego, 9500 Gilman Dr., La Jolla, CA 92093, USA.
| |
Collapse
|
25
|
Dabaghian Y. From Topological Analyses to Functional Modeling: The Case of Hippocampus. Front Comput Neurosci 2021; 14:593166. [PMID: 33505262 PMCID: PMC7829363 DOI: 10.3389/fncom.2020.593166] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2020] [Accepted: 12/02/2020] [Indexed: 11/13/2022] Open
Abstract
Topological data analyses are widely used for describing and conceptualizing large volumes of neurobiological data, e.g., for quantifying spiking outputs of large neuronal ensembles and thus understanding the functions of the corresponding networks. Below we discuss an approach in which convergent topological analyses produce insights into how information may be processed in mammalian hippocampus—a brain part that plays a key role in learning and memory. The resulting functional model provides a unifying framework for integrating spiking data at different timescales and following the course of spatial learning at different levels of spatiotemporal granularity. This approach allows accounting for contributions from various physiological phenomena into spatial cognition—the neuronal spiking statistics, the effects of spiking synchronization by different brain waves, the roles played by synaptic efficacies and so forth. In particular, it is possible to demonstrate that networks with plastic and transient synaptic architectures can encode stable cognitive maps, revealing the characteristic timescales of memory processing.
Collapse
Affiliation(s)
- Yuri Dabaghian
- Department of Neurology, The University of Texas McGovern Medical School, Houston, TX, United States
| |
Collapse
|
26
|
Charalambous E, Hanna S, Penn A. Aha! I know where I am: the contribution of visuospatial cues to reorientation in urban environments. SPATIAL COGNITION AND COMPUTATION 2021. [DOI: 10.1080/13875868.2020.1865359] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Affiliation(s)
- Efrosini Charalambous
- Bartlett School of Architecture, University College London Bartlett Faculty of the Built Environment, London, United Kingdom of Great Britain and Northern Ireland
| | - Sean Hanna
- Bartlett School of Architecture, University College London Bartlett Faculty of the Built Environment, London, United Kingdom of Great Britain and Northern Ireland
| | - Alan Penn
- Bartlett School of Architecture, University College London Bartlett Faculty of the Built Environment, London, United Kingdom of Great Britain and Northern Ireland
| |
Collapse
|
27
|
Peer M, Brunec IK, Newcombe NS, Epstein RA. Structuring Knowledge with Cognitive Maps and Cognitive Graphs. Trends Cogn Sci 2021; 25:37-54. [PMID: 33248898 PMCID: PMC7746605 DOI: 10.1016/j.tics.2020.10.004] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 10/16/2020] [Accepted: 10/17/2020] [Indexed: 12/21/2022]
Abstract
Humans and animals use mental representations of the spatial structure of the world to navigate. The classical view is that these representations take the form of Euclidean cognitive maps, but alternative theories suggest that they are cognitive graphs consisting of locations connected by paths. We review evidence suggesting that both map-like and graph-like representations exist in the mind/brain that rely on partially overlapping neural systems. Maps and graphs can operate simultaneously or separately, and they may be applied to both spatial and nonspatial knowledge. By providing structural frameworks for complex information, cognitive maps and cognitive graphs may provide fundamental organizing schemata that allow us to navigate in physical, social, and conceptual spaces.
Collapse
Affiliation(s)
- Michael Peer
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Iva K Brunec
- Department of Psychology, Temple University, Philadelphia, PA 19122, USA
| | - Nora S Newcombe
- Department of Psychology, Temple University, Philadelphia, PA 19122, USA
| | - Russell A Epstein
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
28
|
Boundary-anchored neural mechanisms of location-encoding for self and others. Nature 2020; 589:420-425. [PMID: 33361808 DOI: 10.1038/s41586-020-03073-y] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2019] [Accepted: 11/12/2020] [Indexed: 11/08/2022]
Abstract
Everyday tasks in social settings require humans to encode neural representations of not only their own spatial location, but also the location of other individuals within an environment. At present, the vast majority of what is known about neural representations of space for self and others stems from research in rodents and other non-human animals1-3. However, it is largely unknown how the human brain represents the location of others, and how aspects of human cognition may affect these location-encoding mechanisms. To address these questions, we examined individuals with chronically implanted electrodes while they carried out real-world spatial navigation and observation tasks. We report boundary-anchored neural representations in the medial temporal lobe that are modulated by one's own as well as another individual's spatial location. These representations depend on one's momentary cognitive state, and are strengthened when encoding of location is of higher behavioural relevance. Together, these results provide evidence for a common encoding mechanism in the human brain that represents the location of oneself and others in shared environments, and shed new light on the neural mechanisms that underlie spatial navigation and awareness of others in real-world scenarios.
Collapse
|
29
|
Abstract
Humans and other animals use multiple strategies for making decisions. Reinforcement-learning theory distinguishes between stimulus-response (model-free; MF) learning and deliberative (model-based; MB) planning. The spatial-navigation literature presents a parallel dichotomy between navigation strategies. In "response learning," associated with the dorsolateral striatum (DLS), decisions are anchored to an egocentric reference frame. In "place learning," associated with the hippocampus, decisions are anchored to an allocentric reference frame. Emerging evidence suggests that the contribution of hippocampus to place learning may also underlie its contribution to MB learning by representing relational structure in a cognitive map. Here, we introduce a computational model in which hippocampus subserves place and MB learning by learning a "successor representation" of relational structure between states; DLS implements model-free response learning by learning associations between actions and egocentric representations of landmarks; and action values from either system are weighted by the reliability of its predictions. We show that this model reproduces a range of seemingly disparate behavioral findings in spatial and nonspatial decision tasks and explains the effects of lesions to DLS and hippocampus on these tasks. Furthermore, modeling place cells as driven by boundaries explains the observation that, unlike navigation guided by landmarks, navigation guided by boundaries is robust to "blocking" by prior state-reward associations due to learned associations between place cells. Our model, originally shaped by detailed constraints in the spatial literature, successfully characterizes the hippocampal-striatal system as a general system for decision making via adaptive combination of stimulus-response learning and the use of a cognitive map.
Collapse
|
30
|
Steel A, Robertson CE, Taube JS. Current Promises and Limitations of Combined Virtual Reality and Functional Magnetic Resonance Imaging Research in Humans: A Commentary on Huffman and Ekstrom (2019). J Cogn Neurosci 2020; 33:159-166. [PMID: 33054553 DOI: 10.1162/jocn_a_01635] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Real-world navigation requires movement of the body through space, producing a continuous stream of visual and self-motion signals, including proprioceptive, vestibular, and motor efference cues. These multimodal cues are integrated to form a spatial cognitive map, an abstract, amodal representation of the environment. How the brain combines these disparate inputs and the relative importance of these inputs to cognitive map formation and recall are key unresolved questions in cognitive neuroscience. Recent advances in virtual reality technology allow participants to experience body-based cues when virtually navigating, and thus it is now possible to consider these issues in new detail. Here, we discuss a recent publication that addresses some of these issues (D. J. Huffman and A. D. Ekstrom. A modality-independent network underlies the retrieval of large-scale spatial environments in the human brain. Neuron, 104, 611-622, 2019). In doing so, we also review recent progress in the study of human spatial cognition and raise several questions that might be addressed in future studies.
Collapse
|
31
|
Keinath AT, Rechnitz O, Balasubramanian V, Epstein RA. Environmental deformations dynamically shift human spatial memory. Hippocampus 2020; 31:89-101. [PMID: 32941670 DOI: 10.1002/hipo.23265] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2020] [Revised: 09/02/2020] [Accepted: 09/05/2020] [Indexed: 12/30/2022]
Abstract
Place and grid cells in the hippocampal formation are commonly thought to support a unified and coherent cognitive map of space. This mapping mechanism faces a challenge when a navigator is placed in a familiar environment that has been deformed from its original shape. Under such circumstances, many transformations could plausibly serve to map a navigator's familiar cognitive map to the deformed space. Previous empirical results indicate that the firing fields of rodent place and grid cells stretch or compress in a manner that approximately matches the environmental deformation, and human spatial memory exhibits similar distortions. These effects have been interpreted as evidence that reshaping a familiar environment elicits an analogously reshaped cognitive map. However, recent work has suggested an alternative explanation, whereby deformation-induced distortions of the grid code are attributable to a mechanism that dynamically anchors grid fields to the most recently experienced boundary, thus causing history-dependent shifts in grid phase. This interpretation raises the possibility that human spatial memory will exhibit similar history-dependent dynamics. To test this prediction, we taught participants the locations of objects in a virtual environment and then probed their memory for these locations in deformed versions of this environment. Across three experiments with variable access to visual and vestibular cues, we observed the predicted pattern, whereby the remembered locations of objects were shifted from trial to trial depending on the boundary of origin of the participant's movement trajectory. These results provide evidence for a dynamic anchoring mechanism that governs both neuronal firing and spatial memory.
Collapse
Affiliation(s)
- Alexandra T Keinath
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Ohad Rechnitz
- Rappaport Faculty of Medicine and Research Institute, Technion - Israel Institute of Technology, Haifa, Israel
| | | | - Russell A Epstein
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| |
Collapse
|
32
|
Wu CM, Schulz E, Garvert MM, Meder B, Schuck NW. Similarities and differences in spatial and non-spatial cognitive maps. PLoS Comput Biol 2020; 16:e1008149. [PMID: 32903264 PMCID: PMC7480875 DOI: 10.1371/journal.pcbi.1008149] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Accepted: 07/13/2020] [Indexed: 11/30/2022] Open
Abstract
Learning and generalization in spatial domains is often thought to rely on a "cognitive map", representing relationships between spatial locations. Recent research suggests that this same neural machinery is also recruited for reasoning about more abstract, conceptual forms of knowledge. Yet, to what extent do spatial and conceptual reasoning share common computational principles, and what are the implications for behavior? Using a within-subject design we studied how participants used spatial or conceptual distances to generalize and search for correlated rewards in successive multi-armed bandit tasks. Participant behavior indicated sensitivity to both spatial and conceptual distance, and was best captured using a Bayesian model of generalization that formalized distance-dependent generalization and uncertainty-guided exploration as a Gaussian Process regression with a radial basis function kernel. The same Gaussian Process model best captured human search decisions and judgments in both domains, and could simulate realistic learning curves, where we found equivalent levels of generalization in spatial and conceptual tasks. At the same time, we also find characteristic differences between domains. Relative to the spatial domain, participants showed reduced levels of uncertainty-directed exploration and increased levels of random exploration in the conceptual domain. Participants also displayed a one-directional transfer effect, where experience in the spatial task boosted performance in the conceptual task, but not vice versa. While confidence judgments indicated that participants were sensitive to the uncertainty of their knowledge in both tasks, they did not or could not leverage their estimates of uncertainty to guide exploration in the conceptual task. These results support the notion that value-guided learning and generalization recruit cognitive-map dependent computational mechanisms in spatial and conceptual domains. Yet both behavioral and model-based analyses suggest domain specific differences in how these representations map onto actions.
Collapse
Affiliation(s)
- Charley M. Wu
- Department of Psychology, Harvard University, Cambridge, Massachusetts, United States of America
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | - Eric Schulz
- Max Planck Research Group Computational Principles of Intelligence, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Mona M. Garvert
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, Berlin, Germany
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
| | - Björn Meder
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
- Max Planck Research Group iSearch, Max Planck Institute for Human Development, Berlin, Germany
- Department of Psychology, University of Erfurt, Erfurt, Germany
| | - Nicolas W. Schuck
- Max Planck Research Group NeuroCode, Max Planck Institute for Human Development, Berlin, Germany
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Berlin, Germany
| |
Collapse
|
33
|
Brunec IK, Ozubko JD, Ander T, Guo R, Moscovitch M, Barense MD. Turns during navigation act as boundaries that enhance spatial memory and expand time estimation. Neuropsychologia 2020; 141:107437. [DOI: 10.1016/j.neuropsychologia.2020.107437] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2019] [Revised: 02/25/2020] [Accepted: 03/10/2020] [Indexed: 11/29/2022]
|
34
|
Momennejad I. Learning Structures: Predictive Representations, Replay, and Generalization. Curr Opin Behav Sci 2020; 32:155-166. [DOI: 10.1016/j.cobeha.2020.02.017] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|