1
|
Zhang Z, Tang F, Li Y, Feng X. A spatial transformation-based CAN model for information integration within grid cell modules. Cogn Neurodyn 2024; 18:1861-1876. [PMID: 39104694 PMCID: PMC11297887 DOI: 10.1007/s11571-023-10047-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Revised: 10/13/2023] [Accepted: 11/26/2023] [Indexed: 08/07/2024] Open
Abstract
The hippocampal-entorhinal circuit is considered to play an important role in the spatial cognition of animals. However, the mechanism of the information flow within the circuit and its contribution to the function of the grid-cell module are still topics of discussion. Prevailing theories suggest that grid cells are primarily influenced by self-motion inputs from the Medial Entorhinal Cortex, with place cells serving a secondary role by contributing to the visual calibration of grid cells. However, recent evidence suggests that both self-motion inputs and visual cues may collaboratively contribute to the formation of grid-like patterns. In this paper, we introduce a novel Continuous Attractor Network model based on a spatial transformation mechanism. This mechanism enables the integration of self-motion inputs and visual cues within grid-cell modules, synergistically driving the formation of grid-like patterns. From the perspective of individual neurons within the network, our model successfully replicates grid firing patterns. From the view of neural population activity within the network, the network can form and drive the activated bump, which describes the characteristic feature of grid-cell modules, namely, path integration. Through further exploration and experimentation, our model can exhibit significant performance in path integration. This study provides a new insight into understanding the mechanism of how the self-motion and visual inputs contribute to the neural activity within grid-cell modules. Furthermore, it provides theoretical support for achieving accurate path integration, which holds substantial implications for various applications requiring spatial navigation and mapping.
Collapse
Affiliation(s)
- Zhihui Zhang
- The State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, No.114, Nanta Street Heping District, Shenyang, 110016 Liaoning China
- University of Science and Technology of China, No.96, JinZhai Road Baohe District, Hefei, 230026 Anhui China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, No.135, Chuangxin Road Hunnan District, Shenyang, 110169 Liaoning China
| | - Fengzhen Tang
- The State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, No.114, Nanta Street Heping District, Shenyang, 110016 Liaoning China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, No.135, Chuangxin Road Hunnan District, Shenyang, 110169 Liaoning China
| | - Yiping Li
- The State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, No.114, Nanta Street Heping District, Shenyang, 110016 Liaoning China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, No.135, Chuangxin Road Hunnan District, Shenyang, 110169 Liaoning China
| | - Xisheng Feng
- The State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, No.114, Nanta Street Heping District, Shenyang, 110016 Liaoning China
- University of Science and Technology of China, No.96, JinZhai Road Baohe District, Hefei, 230026 Anhui China
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, No.135, Chuangxin Road Hunnan District, Shenyang, 110169 Liaoning China
| |
Collapse
|
2
|
Liao Y, Yu N, Yan J. A Navigation Path Search and Optimization Method for Mobile Robots Based on the Rat Brain's Cognitive Mechanism. Biomimetics (Basel) 2023; 8:427. [PMID: 37754178 PMCID: PMC10526878 DOI: 10.3390/biomimetics8050427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 09/11/2023] [Accepted: 09/11/2023] [Indexed: 09/28/2023] Open
Abstract
Rats possess exceptional navigational abilities, allowing them to adaptively adjust their navigation paths based on the environmental structure. This remarkable ability is attributed to the interactions and regulatory mechanisms among various spatial cells within the rat's brain. Based on these, this paper proposes a navigation path search and optimization method for mobile robots based on the rat brain's cognitive mechanism. The aim is to enhance the navigation efficiency of mobile robots. The mechanism of this method is based on developing a navigation habit. Firstly, the robot explores the environment to search for the navigation goal. Then, with the assistance of boundary vector cells, the greedy strategy is used to guide the robot in generating a locally optimal path. Once the navigation path is generated, a dynamic self-organizing model based on the hippocampal CA1 place cells is constructed to further optimize the navigation path. To validate the effectiveness of the method, this paper designs several 2D simulation experiments and 3D robot simulation experiments, and compares the proposed method with various algorithms. The experimental results demonstrate that the proposed method not only surpasses other algorithms in terms of path planning efficiency but also yields the shortest navigation path. Moreover, the method exhibits good adaptability to dynamic navigation tasks.
Collapse
Affiliation(s)
- Yishen Liao
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Y.L.); (J.Y.)
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing 100124, China
- Engineering Research Center of Digital Community, Ministry of Education, Beijing 100124, China
| | - Naigong Yu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Y.L.); (J.Y.)
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing 100124, China
- Engineering Research Center of Digital Community, Ministry of Education, Beijing 100124, China
| | - Jinhan Yan
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Y.L.); (J.Y.)
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing 100124, China
- Engineering Research Center of Digital Community, Ministry of Education, Beijing 100124, China
| |
Collapse
|
3
|
Saleem AB, Busse L. Interactions between rodent visual and spatial systems during navigation. Nat Rev Neurosci 2023:10.1038/s41583-023-00716-7. [PMID: 37380885 DOI: 10.1038/s41583-023-00716-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/31/2023] [Indexed: 06/30/2023]
Abstract
Many behaviours that are critical for animals to survive and thrive rely on spatial navigation. Spatial navigation, in turn, relies on internal representations about one's spatial location, one's orientation or heading direction and the distance to objects in the environment. Although the importance of vision in guiding such internal representations has long been recognized, emerging evidence suggests that spatial signals can also modulate neural responses in the central visual pathway. Here, we review the bidirectional influences between visual and navigational signals in the rodent brain. Specifically, we discuss reciprocal interactions between vision and the internal representations of spatial position, explore the effects of vision on representations of an animal's heading direction and vice versa, and examine how the visual and navigational systems work together to assess the relative distances of objects and other features. Throughout, we consider how technological advances and novel ethological paradigms that probe rodent visuo-spatial behaviours allow us to advance our understanding of how brain areas of the central visual pathway and the spatial systems interact and enable complex behaviours.
Collapse
Affiliation(s)
- Aman B Saleem
- UCL Institute of Behavioural Neuroscience, Department of Experimental Psychology, University College London, London, UK.
| | - Laura Busse
- Division of Neuroscience, Faculty of Biology, LMU Munich, Munich, Germany.
- Bernstein Centre for Computational Neuroscience Munich, Munich, Germany.
| |
Collapse
|
4
|
Jeon I, Kim T. Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network. Front Comput Neurosci 2023; 17:1092185. [PMID: 37449083 PMCID: PMC10336230 DOI: 10.3389/fncom.2023.1092185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 06/12/2023] [Indexed: 07/18/2023] Open
Abstract
Although it may appear infeasible and impractical, building artificial intelligence (AI) using a bottom-up approach based on the understanding of neuroscience is straightforward. The lack of a generalized governing principle for biological neural networks (BNNs) forces us to address this problem by converting piecemeal information on the diverse features of neurons, synapses, and neural circuits into AI. In this review, we described recent attempts to build a biologically plausible neural network by following neuroscientifically similar strategies of neural network optimization or by implanting the outcome of the optimization, such as the properties of single computational units and the characteristics of the network architecture. In addition, we proposed a formalism of the relationship between the set of objectives that neural networks attempt to achieve, and neural network classes categorized by how closely their architectural features resemble those of BNN. This formalism is expected to define the potential roles of top-down and bottom-up approaches for building a biologically plausible neural network and offer a map helping the navigation of the gap between neuroscience and AI engineering.
Collapse
Affiliation(s)
| | - Taegon Kim
- Brain Science Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea
| |
Collapse
|
5
|
Gateway identity and spatial remapping in a combined grid and place cell attractor. Neural Netw 2023; 157:226-239. [DOI: 10.1016/j.neunet.2022.10.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 08/04/2022] [Accepted: 10/18/2022] [Indexed: 11/09/2022]
|
6
|
Whelan MT, Jimenez-Rodriguez A, Prescott TJ, Vasilaki E. A robotic model of hippocampal reverse replay for reinforcement learning. BIOINSPIRATION & BIOMIMETICS 2022; 18:015007. [PMID: 36327454 DOI: 10.1088/1748-3190/ac9ffc] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 11/03/2022] [Indexed: 06/16/2023]
Abstract
Hippocampal reverse replay, a phenomenon in which recently active hippocampal cells reactivate in the reverse order, is thought to contribute to learning, particularly reinforcement learning (RL), in animals. Here, we present a novel computational model which exploits reverse replay to improve stability and performance on a homing task. The model takes inspiration from the hippocampal-striatal network, and learning occurs via a three-factor RL rule. To augment this model with hippocampal reverse replay, we derived a policy gradient learning rule that associates place-cell activity with responses in cells representing actions and a supervised learning rule of the same form, interpreting the replay activity as a 'target' frequency. We evaluated the model using a simulated robot spatial navigation task inspired by the Morris water maze. Results suggest that reverse replay can improve performance stability over multiple trials. Our model exploits reverse reply as an additional source for propagating information about desirable synaptic changes, reducing the requirements for long-time scales in eligibility traces combined with low learning rates. We conclude that reverse replay can positively contribute to RL, although less stable learning is possible in its absence. Analogously, we postulate that reverse replay may enhance RL in the mammalian hippocampal-striatal system rather than provide its core mechanism.
Collapse
Affiliation(s)
- Matthew T Whelan
- Department of Computer Science, The University of Sheffield, Sheffield, United Kingdom
- Sheffield Robotics, Sheffield, United Kingdom
| | - Alejandro Jimenez-Rodriguez
- Department of Computer Science, The University of Sheffield, Sheffield, United Kingdom
- Sheffield Robotics, Sheffield, United Kingdom
| | - Tony J Prescott
- Department of Computer Science, The University of Sheffield, Sheffield, United Kingdom
- Sheffield Robotics, Sheffield, United Kingdom
| | - Eleni Vasilaki
- Department of Computer Science, The University of Sheffield, Sheffield, United Kingdom
- Sheffield Robotics, Sheffield, United Kingdom
| |
Collapse
|
7
|
Aziz A, Sreeharsha PSS, Natesh R, Chakravarthy VS. An integrated deep learning‐based model of spatial cells that combines self‐motion with sensory information. Hippocampus 2022; 32:716-730. [DOI: 10.1002/hipo.23461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 07/10/2022] [Accepted: 07/16/2022] [Indexed: 11/06/2022]
Affiliation(s)
- Azra Aziz
- Computational Neuroscience Lab Indian Institute of Technology Madras Chennai India
| | | | - Rohan Natesh
- Department of Electronics Engineering Indian Institute of Technology (BHU) Varanasi India
| | - Vaddadhi S. Chakravarthy
- Computational Neuroscience Lab Indian Institute of Technology Madras Chennai India
- Center for Complex Systems and Dynamics Indian Institute of Technology Madras Chennai India
| |
Collapse
|
8
|
Riva G, Wiederhold BK. What the Metaverse Is (Really) and Why We Need to Know About It. CYBERPSYCHOLOGY, BEHAVIOR AND SOCIAL NETWORKING 2022; 25:355-359. [PMID: 35696299 DOI: 10.1089/cyber.2022.0124] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Major technology companies are investing significant sums of money in the creation of the metaverse whose main feature will be the fusion between the virtual world and the physical world. To allow this possibility is one of the less obvious features of the metaverse: the metaverse works like our minds. This ability makes the metaverse a significantly different technology from its predecessors. If television and social media are persuasive technologies, because of their ability to influence people's attitudes and behaviors, the metaverse is instead a transformative technology, capable of modifying what people think reality is. To achieve this goal, the technologies of the metaverse hack different key cognitive mechanisms: the experience of being in a place and in a body, the processes of brain-to-brain attunement and synchrony, and the ability of experiencing and inducing emotions. Clearly, these possibilities define totally new scenarios with positive and negative outcomes. Educating ourselves as to its promise, and the challenges it may present, is a necessity. This requires a "humane," integrated, and multidisciplinary approach, with stakeholders at the supranational level joining in the conversation.
Collapse
Affiliation(s)
- Giuseppe Riva
- Humane Technology Lab, Università Cattolica del Sacro Cuore, Milan, Italy.,Applied Technology for Neuro-Psychology, Lab. Istituto Auxologico Italiano, Milan, Italy
| | - Brenda K Wiederhold
- Virtual Reality Medical Center, Scripps Memorial Hospital, La Jolla, California, USA.,Interactive Media Institute, San Diego, California, USA
| |
Collapse
|
9
|
Yu N, Liao Y, Yu H, Sie O. Construction of the rat brain spatial cell firing model on a quadruped robot. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2022. [DOI: 10.1049/cit2.12091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Naigong Yu
- Faculty of Information Technology Beijing University of Technology Beijing China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System Beijing China
- Engineering Research Center of Digital Community Ministry of Education Beijing China
| | - Yishen Liao
- Faculty of Information Technology Beijing University of Technology Beijing China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System Beijing China
- Engineering Research Center of Digital Community Ministry of Education Beijing China
| | - Hejie Yu
- Faculty of Information Technology Beijing University of Technology Beijing China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System Beijing China
- Engineering Research Center of Digital Community Ministry of Education Beijing China
| | - Ouattara Sie
- Faculty of Information Technology Beijing University of Technology Beijing China
- Beijing Key Laboratory of Computational Intelligence and Intelligent System Beijing China
- Engineering Research Center of Digital Community Ministry of Education Beijing China
- College of Robotic Université Félix Houphouët‐Boigny Abidjan Côte d'Ivoire
| |
Collapse
|
10
|
The human source memory system struggles to distinguish virtual reality and reality. COMPUTERS IN HUMAN BEHAVIOR REPORTS 2021. [DOI: 10.1016/j.chbr.2021.100111] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
|
11
|
Riva G, Wiederhold BK, Mantovani F. Surviving COVID-19: The Neuroscience of Smart Working and Distance Learning. CYBERPSYCHOLOGY BEHAVIOR AND SOCIAL NETWORKING 2021; 24:79-85. [PMID: 33577414 DOI: 10.1089/cyber.2021.0009] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
The persistence of the coronavirus-caused respiratory disease (COVID-19) and the related restrictions to mobility and social interactions are forcing a significant portion of students and workers to reorganize their daily activities to accommodate the needs of distance learning and agile work (smart working). What is the impact of these changes on the bosses/teachers' and workers/students' experience? This article uses recent neuroscience research findings to explore how distance learning and smart working impact the following three pillars that reflect the organization of our brain and are at the core of school and office experiences: (a) the learning/work happens in a dedicated physical place; (b) the learning/work is carried out under the supervision of a boss/professor; and (c) the learning/work is distributed between team members/classmates. For each pillar, we discuss its link with the specific cognitive processes involved and the impact that technology has on their functioning. In particular, the use of videoconferencing affects the functioning of Global Positioning System neurons (neurons that code our navigation behavior), mirror neurons, self-attention networks, spindle cells, and interbrain neural oscillations. These effects have a significant impact on many identity and cognitive processes, including social and professional identity, leadership, intuition, mentoring, and creativity. In conclusion, just moving typical office and learning processes inside a videoconferencing platform, as happened in many contexts during the COVID-19 pandemic, can in the long term erode corporate cultures and school communities. In this view, an effective use of technology requires us to reimagine how work and teaching are done virtually, in creative and bold new ways.
Collapse
Affiliation(s)
- Giuseppe Riva
- Applied Technology for Neuro-Psychology Lab, IRCCS Istituto Auxologico Italiano, Milan, Italy.,Humane Technology Lab, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Brenda K Wiederhold
- Virtual Reality Medical Center, La Jolla, California, USA.,Virtual Reality Medical Institute, Brussels, Belgium
| | - Fabrizia Mantovani
- Centre for Studies in Communication Sciences "Luigi Anolli" (CESCOM), Department of Human Sciences for Education "Riccardo Massa," University of Milano Bicocca, Milan, Italy
| |
Collapse
|