1
|
Lu Q, Nguyen TT, Zhang Q, Hasson U, Griffiths TL, Zacks JM, Gershman SJ, Norman KA. Reconciling shared versus context-specific information in a neural network model of latent causes. Sci Rep 2024; 14:16782. [PMID: 39039131 PMCID: PMC11263346 DOI: 10.1038/s41598-024-64272-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 06/06/2024] [Indexed: 07/24/2024] Open
Abstract
It has been proposed that, when processing a stream of events, humans divide their experiences in terms of inferred latent causes (LCs) to support context-dependent learning. However, when shared structure is present across contexts, it is still unclear how the "splitting" of LCs and learning of shared structure can be simultaneously achieved. Here, we present the Latent Cause Network (LCNet), a neural network model of LC inference. Through learning, it naturally stores structure that is shared across tasks in the network weights. Additionally, it represents context-specific structure using a context module, controlled by a Bayesian nonparametric inference algorithm, which assigns a unique context vector for each inferred LC. Across three simulations, we found that LCNet could (1) extract shared structure across LCs in a function learning task while avoiding catastrophic interference, (2) capture human data on curriculum effects in schema learning, and (3) infer the underlying event structure when processing naturalistic videos of daily events. Overall, these results demonstrate a computationally feasible approach to reconciling shared structure and context-specific structure in a model of LCs that is scalable from laboratory experiment settings to naturalistic settings.
Collapse
Affiliation(s)
- Qihong Lu
- Department of Psychology and Princeton Neuroscience Institute, Princeton University, Princeton, USA.
| | - Tan T Nguyen
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, USA
| | - Qiong Zhang
- Department of Psychology and Department of Computer Science, Rutgers University, New Brunswick, USA
| | - Uri Hasson
- Department of Psychology and Princeton Neuroscience Institute, Princeton University, Princeton, USA
| | - Thomas L Griffiths
- Department of Psychology and Princeton Neuroscience Institute, Princeton University, Princeton, USA
- Department of Computer Science, Princeton University, Princeton, USA
| | - Jeffrey M Zacks
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, USA
| | - Samuel J Gershman
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, USA
| | - Kenneth A Norman
- Department of Psychology and Princeton Neuroscience Institute, Princeton University, Princeton, USA
| |
Collapse
|
2
|
Siefert EM, Uppuluri S, Mu J, Tandoc MC, Antony JW, Schapiro AC. Memory Reactivation during Sleep Does Not Act Holistically on Object Memory. J Neurosci 2024; 44:e0022242024. [PMID: 38604779 PMCID: PMC11170671 DOI: 10.1523/jneurosci.0022-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 03/12/2024] [Accepted: 03/20/2024] [Indexed: 04/13/2024] Open
Abstract
Memory reactivation during sleep is thought to facilitate memory consolidation. Most sleep reactivation research has examined how reactivation of specific facts, objects, and associations benefits their overall retention. However, our memories are not unitary, and not all features of a memory persist in tandem over time. Instead, our memories are transformed, with some features strengthened and others weakened. Does sleep reactivation drive memory transformation? We leveraged the Targeted Memory Reactivation technique in an object category learning paradigm to examine this question. Participants (20 female, 14 male) learned three categories of novel objects, where each object had unique, distinguishing features as well as features shared with other members of its category. We used a real-time EEG protocol to cue the reactivation of these objects during sleep at moments optimized to generate reactivation events. We found that reactivation improved memory for distinguishing features while worsening memory for shared features, suggesting a differentiation process. The results indicate that sleep reactivation does not act holistically on object memories, instead supporting a transformation where some features are enhanced over others.
Collapse
Affiliation(s)
- Elizabeth M Siefert
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Sindhuja Uppuluri
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Jianing Mu
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - Marlie C Tandoc
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| | - James W Antony
- Department of Psychology and Child Development, California Polytechnic State University, San Luis Obispo, California 93407
| | - Anna C Schapiro
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 19104
| |
Collapse
|
3
|
Chen HT, van der Meer MAA. Paradoxical replay can protect contextual task representations from destructive interference when experience is unbalanced. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.09.593332. [PMID: 38766204 PMCID: PMC11100794 DOI: 10.1101/2024.05.09.593332] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Experience replay is a powerful mechanism to learn efficiently from limited experience. Despite several decades of compelling experimental results, the factors that determine which experiences are selected for replay remain unclear. A particular challenge for current theories is that on tasks that feature unbalanced experience, rats paradoxically replay the less-experienced trajectory. To understand why, we simulated a feedforward neural network with two regimes: rich learning (structured representations tailored to task demands) and lazy learning (unstructured, task-agnostic representations). Rich, but not lazy, representations degraded following unbalanced experience, an effect that could be reversed with paradoxical replay. To test if this computational principle can account for the experimental data, we examined the relationship between paradoxical replay and learned task representations in the rat hippocampus. Strikingly, we found a strong association between the richness of learned task representations and the paradoxicality of replay. Taken together, these results suggest that paradoxical replay specifically serves to protect rich representations from the destructive effects of unbalanced experience, and more generally demonstrate a novel interaction between the nature of task representations and the function of replay in artificial and biological systems.
Collapse
Affiliation(s)
- Hung-Tu Chen
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, NH 03755
| | | |
Collapse
|
4
|
Sandini G, Sciutti A, Morasso P. Artificial cognition vs. artificial intelligence for next-generation autonomous robotic agents. Front Comput Neurosci 2024; 18:1349408. [PMID: 38585280 PMCID: PMC10995397 DOI: 10.3389/fncom.2024.1349408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 02/20/2024] [Indexed: 04/09/2024] Open
Abstract
The trend in industrial/service robotics is to develop robots that can cooperate with people, interacting with them in an autonomous, safe and purposive way. These are the fundamental elements characterizing the fourth and the fifth industrial revolutions (4IR, 5IR): the crucial innovation is the adoption of intelligent technologies that can allow the development of cyber-physical systems, similar if not superior to humans. The common wisdom is that intelligence might be provided by AI (Artificial Intelligence), a claim that is supported more by media coverage and commercial interests than by solid scientific evidence. AI is currently conceived in a quite broad sense, encompassing LLMs and a lot of other things, without any unifying principle, but self-motivating for the success in various areas. The current view of AI robotics mostly follows a purely disembodied approach that is consistent with the old-fashioned, Cartesian mind-body dualism, reflected in the software-hardware distinction inherent to the von Neumann computing architecture. The working hypothesis of this position paper is that the road to the next generation of autonomous robotic agents with cognitive capabilities requires a fully brain-inspired, embodied cognitive approach that avoids the trap of mind-body dualism and aims at the full integration of Bodyware and Cogniware. We name this approach Artificial Cognition (ACo) and ground it in Cognitive Neuroscience. It is specifically focused on proactive knowledge acquisition based on bidirectional human-robot interaction: the practical advantage is to enhance generalization and explainability. Moreover, we believe that a brain-inspired network of interactions is necessary for allowing humans to cooperate with artificial cognitive agents, building a growing level of personal trust and reciprocal accountability: this is clearly missing, although actively sought, in current AI. The ACo approach is a work in progress that can take advantage of a number of research threads, some of them antecedent the early attempts to define AI concepts and methods. In the rest of the paper we will consider some of the building blocks that need to be re-visited in a unitary framework: the principles of developmental robotics, the methods of action representation with prospection capabilities, and the crucial role of social interaction.
Collapse
Affiliation(s)
| | | | - Pietro Morasso
- Italian Institute of Technology, Cognitive Architecture for Collaborative Technologies (CONTACT) and Robotics, Brain and Cognitive Sciences (RBCS) Research Units, Genoa, Italy
| |
Collapse
|
5
|
Siefert E, Uppuluri S, Mu. J, Tandoc M, Antony J, Schapiro A. Memory reactivation during sleep does not act holistically on object memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.12.14.571683. [PMID: 38168451 PMCID: PMC10760132 DOI: 10.1101/2023.12.14.571683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2024]
Abstract
Memory reactivation during sleep is thought to facilitate memory consolidation. Most sleep reactivation research has examined how reactivation of specific facts, objects, and associations benefits their overall retention. However, our memories are not unitary, and not all features of a memory persist in tandem over time. Instead, our memories are transformed, with some features strengthened and others weakened. Does sleep reactivation drive memory transformation? We leveraged the Targeted Memory Reactivation technique in an object category learning paradigm to examine this question. Participants (20 female, 14 male) learned three categories of novel objects, where each object had unique, distinguishing features as well as features shared with other members of its category. We used a real-time EEG protocol to cue the reactivation of these objects during sleep at moments optimized to generate reactivation events. We found that reactivation improved memory for distinguishing features while worsening memory for shared features, suggesting a differentiation process. The results indicate that sleep reactivation does not act holistically on object memories, instead supporting a transformation process where some features are enhanced over others.
Collapse
Affiliation(s)
- E.M. Siefert
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, 19104, USA
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - S. Uppuluri
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - J. Mu.
- Department of Psychology and Child Development, California Polytechnic State University, San Luis Obispo, CA, 93407, USA
| | - M.C. Tandoc
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | | | - A.C. Schapiro
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, 19104, USA
| |
Collapse
|
6
|
Held LK, Cracco E, Bardi L, Kiraga M, Cristianelli E, Brass M, Abrahamse EL, Braem S. Associative Visuomotor Learning Using Transcranial Magnetic Stimulation Induces Stimulus-Response Interference. J Cogn Neurosci 2024; 36:522-533. [PMID: 38165734 DOI: 10.1162/jocn_a_02100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2024]
Abstract
Classical conditioning states that the systematic co-occurrence of a neutral stimulus with an unconditioned stimulus can cause the neutral stimulus to, over time, evoke the same response as the unconditioned stimulus. On a neural level, Hebbian learning suggests that this type of learning occurs through changes in synaptic plasticity when two neurons are simultaneously active, resulting in increased connectivity between them. Inspired by associative learning theories, we here investigated whether the mere co-activation of visual stimuli and stimulation of the primary motor cortex using TMS would result in stimulus-response associations that can impact future behavior. During a learning phase, we repeatedly paired the presentation of a specific color (but not other colors) with a TMS pulse over the motor cortex. Next, participants performed a two-alternative forced-choice task where they had to categorize simple shapes and we studied whether the shapes' task-irrelevant color (and its potentially associated involuntary motor activity) affected the required motor response. Participants showed more errors on incongruent trials for stimuli that were previously paired with high intensity TMS pulses, but only when tested on the same day. Using a drift diffusion model for conflict tasks, we further demonstrate that this interference occurred early, and gradually increased as a function of associated TMS intensity. Taken together, our findings show that the human brain can learn stimulus-response associations using externally induced motor cortex stimulation. Although we were inspired by the Hebbian learning literature, future studies should investigate whether Hebbian or other learning processes were also what brought about this effect.
Collapse
Affiliation(s)
| | | | - Lara Bardi
- Ghent University, Belgium
- Institut des Sciences Cognitives Marc Jeannerod, Bron, France
- Université Claude Bernard, Lyon 1, Villeurbanne, France
| | | | | | - Marcel Brass
- Ghent University, Belgium
- Humboldt Universität zu Berlin, Germany
| | - Elger L Abrahamse
- Tilburg University, The Netherlands
- Atlántico Medio University, Spain
| | | |
Collapse
|
7
|
Gurnani H, Cayco Gajic NA. Signatures of task learning in neural representations. Curr Opin Neurobiol 2023; 83:102759. [PMID: 37708653 DOI: 10.1016/j.conb.2023.102759] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 06/28/2023] [Accepted: 07/20/2023] [Indexed: 09/16/2023]
Abstract
While neural plasticity has long been studied as the basis of learning, the growth of large-scale neural recording techniques provides a unique opportunity to study how learning-induced activity changes are coordinated across neurons within the same circuit. These distributed changes can be understood through an evolution of the geometry of neural manifolds and latent dynamics underlying new computations. In parallel, studies of multi-task and continual learning in artificial neural networks hint at a tradeoff between non-interference and compositionality as guiding principles to understand how neural circuits flexibly support multiple behaviors. In this review, we highlight recent findings from both biological and artificial circuits that together form a new framework for understanding task learning at the population level.
Collapse
Affiliation(s)
- Harsha Gurnani
- Department of Biology, University of Washington, Seattle, WA, USA. https://twitter.com/HarshaGurnani
| | - N Alex Cayco Gajic
- Laboratoire de Neuroscience Cognitives, Ecole Normale Supérieure, Université PSL, Paris, France.
| |
Collapse
|