1
|
Webb TW, Frankland SM, Altabaa A, Segert S, Krishnamurthy K, Campbell D, Russin J, Giallanza T, O'Reilly R, Lafferty J, Cohen JD. The relational bottleneck as an inductive bias for efficient abstraction. Trends Cogn Sci 2024; 28:829-843. [PMID: 38729852 DOI: 10.1016/j.tics.2024.04.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 03/29/2024] [Accepted: 04/01/2024] [Indexed: 05/12/2024]
Abstract
A central challenge for cognitive science is to explain how abstract concepts are acquired from limited experience. This has often been framed in terms of a dichotomy between connectionist and symbolic cognitive models. Here, we highlight a recently emerging line of work that suggests a novel reconciliation of these approaches, by exploiting an inductive bias that we term the relational bottleneck. In that approach, neural networks are constrained via their architecture to focus on relations between perceptual inputs, rather than the attributes of individual inputs. We review a family of models that employ this approach to induce abstractions in a data-efficient manner, emphasizing their potential as candidate models for the acquisition of abstract concepts in the human mind and brain.
Collapse
|
2
|
Kurth-Nelson Z, Sullivan S, Leibo JZ, Guitart-Masip M. Dynamic diversity is the answer to proxy failure. Behav Brain Sci 2024; 47:e77. [PMID: 38738350 DOI: 10.1017/s0140525x23002923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2024]
Abstract
We argue that a diverse and dynamic pool of agents mitigates proxy failure. Proxy modularity plays a key role in the ongoing production of diversity. We review examples from a range of scales.
Collapse
Affiliation(s)
- Zeb Kurth-Nelson
- Google DeepMind, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
| | - Steve Sullivan
- Department of Anesthesiology and Perioperative Medicine, Oregon Health and Science University, Portland, OR, USA
| | | | - Marc Guitart-Masip
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
- Aging Research Center, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
- Center for Psychiatry Research, Region Stockholm, Stockholm, Sweden. Center for Cognitive
- Computational Neuropsychiatry (CCNP), Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
3
|
Abstract
The body of research on visual working memory (VWM)-the system often described as a limited memory store of visual information in service of ongoing tasks-is growing rapidly. The discovery of numerous related phenomena, and the many subtly different definitions of working memory, signify a challenge to maintain a coherent theoretical framework to discuss concepts, compare models and design studies. A lack of robust theory development has been a noteworthy concern in the psychological sciences, thought to be a precursor to the reproducibility crisis (Oberauer & Lewandowsky, Psychonomic Bulletin & Review, 26, 1596-1618, 2019). I review the theoretical landscape of the VWM field by examining two prominent debates-whether VWM is object-based or feature-based, and whether discrete-slots or variable-precision best describe VWM limits. I share my concerns about the dualistic nature of these debates and the lack of clear model specification that prevents fully determined empirical tests. In hopes of promoting theory development, I provide a working theory map by using the broadly encompassing memory for latent representations model (Hedayati et al., Nature Human Behaviour, 6, 5, 2022) as a scaffold for relevant phenomena and current theories. I illustrate how opposing viewpoints can be brought into accordance, situating leading models of VWM to better identify their differences and improve their comparison. The hope is that the theory map will help VWM researchers get on the same page-clarifying hidden intuitions and aligning varying definitions-and become a useful device for meaningful discussions, development of models, and definitive empirical tests of theories.
Collapse
Affiliation(s)
- William Xiang Quan Ngiam
- Department of Psychology, University of Chicago, Chicago, Illinois, USA.
- Institute of Mind and Biology, University of Chicago, Chicago, Illinois, USA.
| |
Collapse
|
4
|
Yu X, Li J, Zhu H, Tian X, Lau E. Electrophysiological hallmarks for event relations and event roles in working memory. Front Neurosci 2024; 17:1282869. [PMID: 38328555 PMCID: PMC10847304 DOI: 10.3389/fnins.2023.1282869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 12/22/2023] [Indexed: 02/09/2024] Open
Abstract
The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.
Collapse
Affiliation(s)
- Xinchi Yu
- Program of Neuroscience and Cognitive Science, University of Maryland, College Park, MD, United States
- Department of Linguistics, University of Maryland, College Park, MD, United States
| | - Jialu Li
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Hao Zhu
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Xing Tian
- Division of Arts and Sciences, New York University Shanghai, Shanghai, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Ellen Lau
- Program of Neuroscience and Cognitive Science, University of Maryland, College Park, MD, United States
- Department of Linguistics, University of Maryland, College Park, MD, United States
| |
Collapse
|
5
|
Ngiam WXQ, Loetscher KB, Awh E. Object-based encoding constrains storage in visual working memory. J Exp Psychol Gen 2024; 153:86-101. [PMID: 37695325 PMCID: PMC10840914 DOI: 10.1037/xge0001479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
The fundamental unit of visual working memory (WM) has been debated for decades. WM could be object-based, such that capacity is set by the number of individuated objects, or feature-based, such that capacity is determined by the total number of feature values stored. The present work examined whether object- or feature-based models would best explain how multifeature objects (i.e., color/orientation or color/shape) are encoded into visual WM. If maximum capacity is limited by the number of individuated objects, then above-chance performance should be restricted to the same number of items as in a single-feature condition. By contrast, if the capacity is determined by independent storage resources for distinct features-without respect to the objects that contain those features-then successful storage of feature values could be distributed across a larger number of objects than when only a single feature is relevant. We conducted four experiments using a whole-report task in which subjects reported both features from every item in a six-item array. The crucial finding was that above-chance recall-for both single- and multifeatured objects-was restricted to the first three or four responses, while the later responses were best modeled as guesses. Thus, whole-report with multifeature objects reveals a distribution of recalled features that indicates an object-based limit on WM capacity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
| | | | - Edward Awh
- Department of Psychology, University of Chicago
| |
Collapse
|
6
|
Yoo KS. Motion prediction using brain waves based on artificial intelligence deep learning recurrent neural network. J Exerc Rehabil 2023; 19:219-227. [PMID: 37662525 PMCID: PMC10468292 DOI: 10.12965/jer.2346242.121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 07/10/2023] [Indexed: 09/05/2023] Open
Abstract
Electroencephalogram (EEG) research has gained widespread use in various research domains due to its valuable insights into human body movements. In this study, we investigated the optimization of motion discrimination prediction by employing an artificial intelligence deep learning recurrent neural network (gated recurrent unit, GRU) on unique EEG data generated from specific movement types among EEG signals. The experiment involved participants categorized into five difficulty levels of postural control, targeting gymnasts in their twenties and college students majoring in physical education (n=10). Machine learning techniques were applied to extract brain-motor patterns from the collected EEG data, which consisted of 32 channels. The EEG data underwent spectrum analysis using fast Fourier transform conversion, and the GRU model network was utilized for machine learning on each EEG frequency domain, thereby improving the performance index of the learning operation process. Through the development of the GRU network algorithm, the performance index achieved up to a 15.92% improvement compared to the accuracy of existing models, resulting in motion recognition accuracy ranging from a minimum of 94.67% to a maximum of 99.15% between actual and predicted values. These optimization outcomes are attributed to the enhanced accuracy and cost function of the GRU network algorithm's hidden layers. By implementing motion identification optimization based on artificial intelligence machine learning results from EEG signals, this study contributes to the emerging field of exercise rehabilitation, presenting an innovative paradigm that reveals the interconnectedness between the brain and the science of exercise.
Collapse
Affiliation(s)
- Kyoung-Seok Yoo
- Department of Sport Sciences, Hannam University, Daejeon,
Korea
| |
Collapse
|
7
|
Crivelli-Decker J, Clarke A, Park SA, Huffman DJ, Boorman ED, Ranganath C. Goal-oriented representations in the human hippocampus during planning and navigation. Nat Commun 2023; 14:2946. [PMID: 37221176 PMCID: PMC10206082 DOI: 10.1038/s41467-023-35967-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 01/10/2023] [Indexed: 05/25/2023] Open
Abstract
Recent work in cognitive and systems neuroscience has suggested that the hippocampus might support planning, imagination, and navigation by forming cognitive maps that capture the abstract structure of physical spaces, tasks, and situations. Navigation involves disambiguating similar contexts, and the planning and execution of a sequence of decisions to reach a goal. Here, we examine hippocampal activity patterns in humans during a goal-directed navigation task to investigate how contextual and goal information are incorporated in the construction and execution of navigational plans. During planning, hippocampal pattern similarity is enhanced across routes that share a context and a goal. During navigation, we observe prospective activation in the hippocampus that reflects the retrieval of pattern information related to a key-decision point. These results suggest that, rather than simply representing overlapping associations or state transitions, hippocampal activity patterns are shaped by context and goals.
Collapse
Affiliation(s)
- Jordan Crivelli-Decker
- Center for Neuroscience, University of California, Davis, CA, USA.
- Department of Psychology, University of California, Davis, CA, USA.
| | - Alex Clarke
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Seongmin A Park
- Center for Neuroscience, University of California, Davis, CA, USA
- Center for Mind and Brain, University of California, Davis, CA, USA
| | - Derek J Huffman
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, Colby College, Waterville, ME, USA
| | - Erie D Boorman
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Charan Ranganath
- Center for Neuroscience, University of California, Davis, CA, USA
- Department of Psychology, University of California, Davis, CA, USA
| |
Collapse
|
8
|
Reagh ZM, Ranganath C. Flexible reuse of cortico-hippocampal representations during encoding and recall of naturalistic events. Nat Commun 2023; 14:1279. [PMID: 36890146 PMCID: PMC9995562 DOI: 10.1038/s41467-023-36805-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 02/17/2023] [Indexed: 03/10/2023] Open
Abstract
Although every life event is unique, there are considerable commonalities across events. However, little is known about whether or how the brain flexibly represents information about different event components at encoding and during remembering. Here, we show that different cortico-hippocampal networks systematically represent specific components of events depicted in videos, both during online experience and during episodic memory retrieval. Regions of an Anterior Temporal Network represented information about people, generalizing across contexts, whereas regions of a Posterior Medial Network represented context information, generalizing across people. Medial prefrontal cortex generalized across videos depicting the same event schema, whereas the hippocampus maintained event-specific representations. Similar effects were seen in real-time and recall, suggesting reuse of event components across overlapping episodic memories. These representational profiles together provide a computationally optimal strategy to scaffold memory for different high-level event components, allowing efficient reuse for event comprehension, recollection, and imagination.
Collapse
Affiliation(s)
- Zachariah M Reagh
- Department of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA.
| | - Charan Ranganath
- UC Davis Center for Neuroscience, University of California, Davis, CA, USA.,Department of Psychology, University of California, Davis, CA, USA
| |
Collapse
|
9
|
Yu X, Lau E. The Binding Problem 2.0: Beyond Perceptual Features. Cogn Sci 2023; 47:e13244. [PMID: 36744750 DOI: 10.1111/cogs.13244] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/22/2022] [Accepted: 01/04/2023] [Indexed: 02/07/2023]
Abstract
The "binding problem" has been a central question in vision science for some 30 years: When encoding multiple objects or maintaining them in working memory, how are we able to represent the correspondence between a specific feature and its corresponding object correctly? In this letter we argue that the boundaries of this research program in fact extend far beyond vision, and we call for coordinated pursuit across the broader cognitive science community of this central question for cognition, which we dub "Binding Problem 2.0".
Collapse
Affiliation(s)
- Xinchi Yu
- Program of Neuroscience and Cognitive Science, University of Maryland.,Department of Linguistics, University of Maryland
| | - Ellen Lau
- Program of Neuroscience and Cognitive Science, University of Maryland.,Department of Linguistics, University of Maryland
| |
Collapse
|
10
|
Zheng Y, Liu XL, Nishiyama S, Ranganath C, O’Reilly RC. Correcting the hebbian mistake: Toward a fully error-driven hippocampus. PLoS Comput Biol 2022; 18:e1010589. [PMID: 36219613 PMCID: PMC9586412 DOI: 10.1371/journal.pcbi.1010589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 10/21/2022] [Accepted: 09/19/2022] [Indexed: 11/18/2022] Open
Abstract
The hippocampus plays a critical role in the rapid learning of new episodic memories. Many computational models propose that the hippocampus is an autoassociator that relies on Hebbian learning (i.e., "cells that fire together, wire together"). However, Hebbian learning is computationally suboptimal as it does not learn in a way that is driven toward, and limited by, the objective of achieving effective retrieval. Thus, Hebbian learning results in more interference and a lower overall capacity. Our previous computational models have utilized a powerful, biologically plausible form of error-driven learning in hippocampal CA1 and entorhinal cortex (EC) (functioning as a sparse autoencoder) by contrasting local activity states at different phases in the theta cycle. Based on specific neural data and a recent abstract computational model, we propose a new model called Theremin (Total Hippocampal ERror MINimization) that extends error-driven learning to area CA3-the mnemonic heart of the hippocampal system. In the model, CA3 responds to the EC monosynaptic input prior to the EC disynaptic input through dentate gyrus (DG), giving rise to a temporal difference between these two activation states, which drives error-driven learning in the EC→CA3 and CA3↔CA3 projections. In effect, DG serves as a teacher to CA3, correcting its patterns into more pattern-separated ones, thereby reducing interference. Results showed that Theremin, compared with our original Hebbian-based model, has significantly increased capacity and learning speed. The model makes several novel predictions that can be tested in future studies.
Collapse
Affiliation(s)
- Yicong Zheng
- Department of Psychology, University of California, Davis, California, United States of America
- Center for Neuroscience, University of California, Davis, California, United States of America
| | - Xiaonan L. Liu
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, People’s Republic of China
| | - Satoru Nishiyama
- Graduate School of Education, Kyoto University, Kyoto, Japan
- Japan Society for the Promotion of Science, Tokyo, Japan
| | - Charan Ranganath
- Department of Psychology, University of California, Davis, California, United States of America
- Center for Neuroscience, University of California, Davis, California, United States of America
| | - Randall C. O’Reilly
- Department of Psychology, University of California, Davis, California, United States of America
- Center for Neuroscience, University of California, Davis, California, United States of America
- Department of Computer Science, University of California, Davis, California, United States of America
- * E-mail:
| |
Collapse
|