1
|
Wu M, Liu F, Wang H, Yao L, Wei C, Zheng Q, Han J, Liu Z, Liu Y, Duan H, Ren W, Sun Z. Characterizing the dynamic learning process: Implications of a quantitative analysis. Behav Brain Res 2024; 463:114915. [PMID: 38368954 DOI: 10.1016/j.bbr.2024.114915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2023] [Revised: 02/05/2024] [Accepted: 02/15/2024] [Indexed: 02/20/2024]
Abstract
Understanding the neural mechanisms involved in learning processes is crucial for unraveling the complexities of behavior and cognition. Sudden change from the untrained level to the fully-learned level is a pivotal feature of instrumental learning. However, the concept of change point and suitable methods to conveniently analyze the characteristics of sudden change in groups remain elusive, which might hinder a fuller understanding of the neural mechanism underlying dynamic leaning process. In the current study, we investigated the learning processes of mice that were trained in an aversive instrumental learning task, and introduced a novel strategy to analyze behavioral variations in instrumental learning, leading to improved clarity on the concept of sudden change and enabling comprehensive group analysis. By applying this novel strategy, we examined the effects of cocaine and a cannabinoid receptor agonist on instrumental learning. Intriguingly, our analysis revealed significant differences in timing and occurrence of sudden changes that were previously overlooked using traditional analysis. Overall, our research advances understanding of behavioral variation during instrumental learning and the interplay between learning behaviors and neurotransmitter systems, contributing to a deeper comprehension of learning processes and informing future investigations and therapeutic interventions.
Collapse
Affiliation(s)
- Meilin Wu
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Fuhong Liu
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Hao Wang
- College of Life Sciences, Shaanxi Normal University, Xi'an 710062, China
| | - Li Yao
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Chunling Wei
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Qiaohua Zheng
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Jing Han
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Zhiqiang Liu
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Yihui Liu
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Haijun Duan
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China
| | - Wei Ren
- MOE Key Laboratory of Modern Teaching Technology, Shaanxi Normal University, Xi'an 710062, China; Faculty of Education, Shaanxi Normal University, Xi'an 710062, China.
| | - Zongpeng Sun
- School of Psychology, Shaanxi Normal University, Xi'an 710062, China.
| |
Collapse
|
2
|
Bhasin BJ, Raymond JL, Goldman MS. Synaptic weight dynamics underlying systems consolidation of a memory. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.20.586036. [PMID: 38585936 PMCID: PMC10996481 DOI: 10.1101/2024.03.20.586036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Systems consolidation is a common feature of learning and memory systems, in which a long-term memory initially stored in one brain region becomes persistently stored in another region. We studied the dynamics of systems consolidation in simple circuit architectures modeling core features of many memory systems: an early- and late-learning brain region and two sites of plasticity. We show that the synaptic dynamics of the circuit during consolidation of an analog memory can be understood as a temporal integration process, by which transient changes in activity driven by plasticity in the early-learning area are accumulated into persistent synaptic changes at the late-learning site. This simple principle leads to two constraints on the circuit operation for consolidation to be implemented successfully. First, the plasticity rule at the late-learning site must stably support a continuum of possible outputs for a given input. We show that this is readily achieved by heterosynaptic but not standard Hebbian rules, that it naturally leads to a speed-accuracy tradeoff in systems consolidation, and that it provides a concrete circuit instantiation for how systems consolidation solves the stability-plasticity dilemma. Second, to turn off the consolidation process and prevent erroneous changes at the late-learning site, neural activity in the early-learning area must be reset to its baseline activity. We propose two biologically plausible implementations for this reset that suggest novel roles for core elements of the cerebellar circuit.
Collapse
Affiliation(s)
- Brandon J Bhasin
- Department of Bioengineering, Stanford University, Stanford, CA 94305
- Center for Neuroscience, University of California, Davis, CA 95616
| | - Jennifer L Raymond
- Department of Neurobiology, Stanford University School of Medicine, Stanford, CA 94305
| | - Mark S Goldman
- Center for Neuroscience, University of California, Davis, CA 95616
- Departments of Neurobiology, Physiology, and Behavior, and Ophthalmology and Vision Science, University of California, Davis, CA 95616
| |
Collapse
|
3
|
Bergoin R, Torcini A, Deco G, Quoy M, Zamora-López G. Inhibitory neurons control the consolidation of neural assemblies via adaptation to selective stimuli. Sci Rep 2023; 13:6949. [PMID: 37117236 PMCID: PMC10147639 DOI: 10.1038/s41598-023-34165-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2022] [Accepted: 04/25/2023] [Indexed: 04/30/2023] Open
Abstract
Brain circuits display modular architecture at different scales of organization. Such neural assemblies are typically associated to functional specialization but the mechanisms leading to their emergence and consolidation still remain elusive. In this paper we investigate the role of inhibition in structuring new neural assemblies driven by the entrainment to various inputs. In particular, we focus on the role of partially synchronized dynamics for the creation and maintenance of structural modules in neural circuits by considering a network of excitatory and inhibitory [Formula: see text]-neurons with plastic Hebbian synapses. The learning process consists of an entrainment to temporally alternating stimuli that are applied to separate regions of the network. This entrainment leads to the emergence of modular structures. Contrary to common practice in artificial neural networks-where the acquired weights are typically frozen after the learning session-we allow for synaptic adaptation even after the learning phase. We find that the presence of inhibitory neurons in the network is crucial for the emergence and the post-learning consolidation of the modular structures. Indeed networks made of purely excitatory neurons or of neurons not respecting Dale's principle are unable to form or to maintain the modular architecture induced by the stimuli. We also demonstrate that the number of inhibitory neurons in the network is directly related to the maximal number of neural assemblies that can be consolidated, supporting the idea that inhibition has a direct impact on the memory capacity of the neural network.
Collapse
Affiliation(s)
- Raphaël Bergoin
- ETIS, UMR 8051, ENSEA, CY Cergy Paris Université, CNRS, 6 Av. du Ponceau, 95000, Cergy-Pontoise, France.
- Center for Brain and Cognition, Department of Information and Communications Technologies, Pompeu Fabra University, Carrer Ramón Trias i Fargas 25-27, 08005, Barcelona, Spain.
| | - Alessandro Torcini
- Laboratoire de Physique Théorique et Modélisation, UMR 8089, CY Cergy Paris Université, CNRS, 2 Av. Adolphe Chauvin, 95032, Cergy-Pontoise, France
| | - Gustavo Deco
- Center for Brain and Cognition, Department of Information and Communications Technologies, Pompeu Fabra University, Carrer Ramón Trias i Fargas 25-27, 08005, Barcelona, Spain
- Instituciò Catalana de Recerca i Estudis Avançats (ICREA), Passeig Lluis Companys 23, 08010, Barcelona, Spain
| | - Mathias Quoy
- ETIS, UMR 8051, ENSEA, CY Cergy Paris Université, CNRS, 6 Av. du Ponceau, 95000, Cergy-Pontoise, France
- IPAL, CNRS, 1 Fusionopolis Way #21-01 Connexis (South Tower), Singapore, 138632, Singapore
| | - Gorka Zamora-López
- Center for Brain and Cognition, Department of Information and Communications Technologies, Pompeu Fabra University, Carrer Ramón Trias i Fargas 25-27, 08005, Barcelona, Spain
| |
Collapse
|
4
|
Mazzucato L. Neural mechanisms underlying the temporal organization of naturalistic animal behavior. eLife 2022; 11:76577. [PMID: 35792884 PMCID: PMC9259028 DOI: 10.7554/elife.76577] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 06/07/2022] [Indexed: 12/17/2022] Open
Abstract
Naturalistic animal behavior exhibits a strikingly complex organization in the temporal domain, with variability arising from at least three sources: hierarchical, contextual, and stochastic. What neural mechanisms and computational principles underlie such intricate temporal features? In this review, we provide a critical assessment of the existing behavioral and neurophysiological evidence for these sources of temporal variability in naturalistic behavior. Recent research converges on an emergent mechanistic theory of temporal variability based on attractor neural networks and metastable dynamics, arising via coordinated interactions between mesoscopic neural circuits. We highlight the crucial role played by structural heterogeneities as well as noise from mesoscopic feedback loops in regulating flexible behavior. We assess the shortcomings and missing links in the current theoretical and experimental literature and propose new directions of investigation to fill these gaps.
Collapse
Affiliation(s)
- Luca Mazzucato
- Institute of Neuroscience, Departments of Biology, Mathematics and Physics, University of Oregon
| |
Collapse
|
5
|
Wolff SBE, Ko R, Ölveczky BP. Distinct roles for motor cortical and thalamic inputs to striatum during motor skill learning and execution. SCIENCE ADVANCES 2022; 8:eabk0231. [PMID: 35213216 PMCID: PMC8880788 DOI: 10.1126/sciadv.abk0231] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 01/03/2022] [Indexed: 05/11/2023]
Abstract
The acquisition and execution of motor skills are mediated by a distributed motor network, spanning cortical and subcortical brain areas. The sensorimotor striatum is an important cog in this network, yet the roles of its two main inputs, from motor cortex and thalamus, remain largely unknown. To address this, we silenced the inputs in rats trained on a task that results in highly stereotyped and idiosyncratic movement patterns. While striatal-projecting motor cortex neurons were critical for learning these skills, silencing this pathway after learning had no effect on performance. In contrast, silencing striatal-projecting thalamus neurons disrupted the execution of the learned skills, causing rats to revert to species-typical pressing behaviors and preventing them from relearning the task. These results show distinct roles for motor cortex and thalamus in the learning and execution of motor skills and suggest that their interaction in the striatum underlies experience-dependent changes in subcortical motor circuits.
Collapse
Affiliation(s)
| | - Raymond Ko
- Department of Organismic and Evolutionary Biology and Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
| | | |
Collapse
|
6
|
Remme MWH, Bergmann U, Alevi D, Schreiber S, Sprekeler H, Kempter R. Hebbian plasticity in parallel synaptic pathways: A circuit mechanism for systems memory consolidation. PLoS Comput Biol 2021; 17:e1009681. [PMID: 34874938 PMCID: PMC8683039 DOI: 10.1371/journal.pcbi.1009681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2021] [Revised: 12/17/2021] [Accepted: 11/24/2021] [Indexed: 12/03/2022] Open
Abstract
Systems memory consolidation involves the transfer of memories across brain regions and the transformation of memory content. For example, declarative memories that transiently depend on the hippocampal formation are transformed into long-term memory traces in neocortical networks, and procedural memories are transformed within cortico-striatal networks. These consolidation processes are thought to rely on replay and repetition of recently acquired memories, but the cellular and network mechanisms that mediate the changes of memories are poorly understood. Here, we suggest that systems memory consolidation could arise from Hebbian plasticity in networks with parallel synaptic pathways-two ubiquitous features of neural circuits in the brain. We explore this hypothesis in the context of hippocampus-dependent memories. Using computational models and mathematical analyses, we illustrate how memories are transferred across circuits and discuss why their representations could change. The analyses suggest that Hebbian plasticity mediates consolidation by transferring a linear approximation of a previously acquired memory into a parallel pathway. Our modelling results are further in quantitative agreement with lesion studies in rodents. Moreover, a hierarchical iteration of the mechanism yields power-law forgetting-as observed in psychophysical studies in humans. The predicted circuit mechanism thus bridges spatial scales from single cells to cortical areas and time scales from milliseconds to years.
Collapse
Affiliation(s)
- Michiel W. H. Remme
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Urs Bergmann
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Denis Alevi
- Department for Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
| | - Susanne Schreiber
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
- Einstein Center for Neurosciences Berlin, Berlin, Germany
| | - Henning Sprekeler
- Department for Electrical Engineering and Computer Science, Technische Universität Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
- Einstein Center for Neurosciences Berlin, Berlin, Germany
- Excellence Cluster Science of Intelligence, Berlin, Germany
| | - Richard Kempter
- Department of Biology, Institute for Theoretical Biology, Humboldt-Universität zu Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
- Einstein Center for Neurosciences Berlin, Berlin, Germany
| |
Collapse
|