1
|
Ohki T, Kunii N, Chao ZC. Efficient, continual, and generalized learning in the brain - neural mechanism of Mental Schema 2.0. Rev Neurosci 2023; 34:839-868. [PMID: 36960579 DOI: 10.1515/revneuro-2022-0137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 02/26/2023] [Indexed: 03/25/2023]
Abstract
There has been tremendous progress in artificial neural networks (ANNs) over the past decade; however, the gap between ANNs and the biological brain as a learning device remains large. With the goal of closing this gap, this paper reviews learning mechanisms in the brain by focusing on three important issues in ANN research: efficiency, continuity, and generalization. We first discuss the method by which the brain utilizes a variety of self-organizing mechanisms to maximize learning efficiency, with a focus on the role of spontaneous activity of the brain in shaping synaptic connections to facilitate spatiotemporal learning and numerical processing. Then, we examined the neuronal mechanisms that enable lifelong continual learning, with a focus on memory replay during sleep and its implementation in brain-inspired ANNs. Finally, we explored the method by which the brain generalizes learned knowledge in new situations, particularly from the mathematical generalization perspective of topology. Besides a systematic comparison in learning mechanisms between the brain and ANNs, we propose "Mental Schema 2.0," a new computational property underlying the brain's unique learning ability that can be implemented in ANNs.
Collapse
Affiliation(s)
- Takefumi Ohki
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo, Tokyo 113-0033, Japan
| | - Naoto Kunii
- Department of Neurosurgery, The University of Tokyo, Tokyo 113-0033, Japan
| | - Zenas C Chao
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo, Tokyo 113-0033, Japan
| |
Collapse
|
2
|
Chen C, Meng J, Belkacem AN, Lu L, Liu F, Yi W, Li P, Liang J, Huang Z, Ming D. Hierarchical fusion detection algorithm for sleep spindle detection. Front Neurosci 2023; 17:1105696. [PMID: 36968486 PMCID: PMC10035334 DOI: 10.3389/fnins.2023.1105696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 02/07/2023] [Indexed: 03/11/2023] Open
Abstract
BackgroundSleep spindles are a vital sign implying that human beings have entered the second stage of sleep. In addition, they can effectively reflect a person’s learning and memory ability, and clinical research has shown that their quantity and density are crucial markers of brain function. The “gold standard” of spindle detection is based on expert experience; however, the detection cost is high, and the detection time is long. Additionally, the accuracy of detection is influenced by subjectivity.MethodsTo improve detection accuracy and speed, reduce the cost, and improve efficiency, this paper proposes a layered spindle detection algorithm. The first layer used the Morlet wavelet and RMS method to detect spindles, and the second layer employed an improved k-means algorithm to improve spindle detection efficiency. The fusion algorithm was compared with other spindle detection algorithms to prove its effectiveness.ResultsThe hierarchical fusion spindle detection algorithm showed good performance stability, and the fluctuation range of detection accuracy was minimal. The average value of precision was 91.6%, at least five percentage points higher than other methods. The average value of recall could reach 89.1%, and the average value of specificity was close to 95%. The mean values of accuracy and F1-score in the subject sample data were 90.4 and 90.3%, respectively. Compared with other methods, the method proposed in this paper achieved significant improvement in terms of precision, recall, specificity, accuracy, and F1-score.ConclusionA spindle detection method with high steady-state accuracy and fast detection speed is proposed, which combines the Morlet wavelet with window RMS and an improved k-means algorithm. This method provides a powerful tool for the automatic detection of spindles and improves the efficiency of spindle detection. Through simulation experiments, the sampled data were analyzed and verified to prove the feasibility and effectiveness of this method.
Collapse
Affiliation(s)
- Chao Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Jiayuan Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Abdelkader Nasreddine Belkacem
- Department of Computer and Network Engineering, College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Lin Lu
- Zhonghuan Information College Tianjin University of Technology, Tianjin, China
| | - Fengyue Liu
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing, China
| | - Penghai Li
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, China
| | - Jun Liang
- Department of Rehabilitation, Tianjin Medical University General Hospital, Tianjin, China
| | - Zhaoyang Huang
- Department of Neurology, Xuanwu Hospital, Capital Medical University, Beijing, China
- Beijing Key Laboratory of Neuromodulation, Beijing, China
- *Correspondence: Zhaoyang Huang,
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Dong Ming,
| |
Collapse
|
3
|
Halonen R, Kuula L, Lahti J, Räikkönen K, Pesonen AK. The association between overnight recognition accuracy and slow oscillation-spindle coupling is moderated by BDNF Val66Met. Behav Brain Res 2022; 428:113889. [DOI: 10.1016/j.bbr.2022.113889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 03/30/2022] [Accepted: 04/05/2022] [Indexed: 11/02/2022]
|
4
|
Association of polygenic risk for schizophrenia with fast sleep spindle density depends on pro-cognitive variants. Eur Arch Psychiatry Clin Neurosci 2022; 272:1193-1203. [PMID: 35723738 PMCID: PMC9508216 DOI: 10.1007/s00406-022-01435-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Accepted: 05/15/2022] [Indexed: 11/14/2022]
Abstract
Cognitive impairment is a common feature in schizophrenia and the strongest prognostic factor for long-term outcome. Identifying a trait associated with the genetic background for cognitive outcome in schizophrenia may aid in a deeper understanding of clinical disease subtypes. Fast sleep spindles may represent such a biomarker as they are strongly genetically determined, associated with cognitive functioning and impaired in schizophrenia and unaffected relatives. We measured fast sleep spindle density in 150 healthy adults and investigated its association with a genome-wide polygenic score for schizophrenia (SCZ-PGS). The association between SCZ-PGS and fast spindle density was further characterized by stratifying it to the genetic background of intelligence. SCZ-PGS was positively associated with fast spindle density. This association mainly depended on pro-cognitive genetic variants. Our results strengthen the evidence for a genetic background of spindle abnormalities in schizophrenia. Spindle density might represent an easily accessible marker for a favourable cognitive outcome which should be further investigated in clinical samples.
Collapse
|
5
|
Bartsch U, Corbin LJ, Hellmich C, Taylor M, Easey KE, Durant C, Marston HM, Timpson NJ, Jones MW. Schizophrenia-associated variation at ZNF804A correlates with altered experience-dependent dynamics of sleep slow waves and spindles in healthy young adults. Sleep 2021; 44:zsab191. [PMID: 34329479 PMCID: PMC8664578 DOI: 10.1093/sleep/zsab191] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 07/06/2021] [Indexed: 12/12/2022] Open
Abstract
The rs1344706 polymorphism in ZNF804A is robustly associated with schizophrenia and schizophrenia is, in turn, associated with abnormal non-rapid eye movement (NREM) sleep neurophysiology. To examine whether rs1344706 is associated with intermediate neurophysiological traits in the absence of disease, we assessed the relationship between genotype, sleep neurophysiology, and sleep-dependent memory consolidation in healthy participants. We recruited healthy adult males with no history of psychiatric disorder from the Avon Longitudinal Study of Parents and Children (ALSPAC) birth cohort. Participants were homozygous for either the schizophrenia-associated 'A' allele (N = 22) or the alternative 'C' allele (N = 18) at rs1344706. Actigraphy, polysomnography (PSG) and a motor sequence task (MST) were used to characterize daily activity patterns, sleep neurophysiology and sleep-dependent memory consolidation. Average MST learning and sleep-dependent performance improvements were similar across genotype groups, albeit more variable in the AA group. During sleep after learning, CC participants showed increased slow-wave (SW) and spindle amplitudes, plus augmented coupling of SW activity across recording electrodes. SW and spindles in those with the AA genotype were insensitive to learning, whilst SW coherence decreased following MST training. Accordingly, NREM neurophysiology robustly predicted the degree of overnight motor memory consolidation in CC carriers, but not in AA carriers. We describe evidence that rs1344706 polymorphism in ZNF804A is associated with changes in the coordinated neural network activity that supports offline information processing during sleep in a healthy population. These findings highlight the utility of sleep neurophysiology in mapping the impacts of schizophrenia-associated common genetic variants on neural circuit oscillations and function.
Collapse
Affiliation(s)
- Ullrich Bartsch
- School of Physiology, Pharmacology & Neuroscience, University of Bristol, Bristol, UK
- Translational Neuroscience, Eli Lilly & Co Ltd UK, Erl Wood Manor, Windlesham, UK
- UK DRI Health Care & Technology at Imperial College London and the University of Surrey, Surrey Sleep Research Centre, University of Surrey, Clinical Research Building, Egerton Road, Guildford, Surrey, UK
| | - Laura J Corbin
- MRC Integrative Epidemiology Unit at University of Bristol, Bristol, UK
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Charlotte Hellmich
- School of Physiology, Pharmacology & Neuroscience, University of Bristol, Bristol, UK
| | - Michelle Taylor
- MRC Integrative Epidemiology Unit at University of Bristol, Bristol, UK
| | - Kayleigh E Easey
- MRC Integrative Epidemiology Unit at University of Bristol, Bristol, UK
- UK Centre for Tobacco and Alcohol Studies, School of Psychological Science, University of Bristol, Bristol, UK
| | - Claire Durant
- Clinical Research and Imaging Centre (CRIC), University of Bristol, Bristol, UK
| | - Hugh M Marston
- Translational Neuroscience, Eli Lilly & Co Ltd UK, Erl Wood Manor, Windlesham, UK
- Böhringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Nicholas J Timpson
- MRC Integrative Epidemiology Unit at University of Bristol, Bristol, UK
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Matthew W Jones
- School of Physiology, Pharmacology & Neuroscience, University of Bristol, Bristol, UK
| |
Collapse
|
6
|
Wang Z, Wilson CM, Ge Y, Nemes J, LaValle C, Boutté A, Carr W, Kamimori G, Haghighi F. DNA Methylation Patterns of Chronic Explosive Breaching in U.S. Military Warfighters. Front Neurol 2020; 11:1010. [PMID: 33192958 PMCID: PMC7645105 DOI: 10.3389/fneur.2020.01010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 07/31/2020] [Indexed: 02/01/2023] Open
Abstract
Background: Injuries from exposure to explosions rose dramatically during the Iraq and Afghanistan wars, which motivated investigation of blast-related neurotrauma. We have undertaken human studies involving military "breachers" -exposed to controlled, low-level blast during a 3-days explosive breaching course. Methods: We screened epigenetic profiles in peripheral blood samples from 59 subjects (in two separate U.S. Military training sessions) using Infinium MethylationEPIC BeadChips. Participants had varying numbers of exposures to blast over their military careers (empirically defined as high ≥ 40, and conversely, low < 39 breaching exposures). Daily self-reported physiological symptoms were recorded. Tinnitus, memory problems, headaches, and sleep disturbances are most frequently reported. Results: We identified 14 significantly differentially methylated regions (DMRs) within genes associated with cumulative blast exposure in participants with high relative to low cumulative blast exposure. Notably, NTSR1 and SPON1 were significantly differentially methylated in high relative to low blast exposed groups, suggesting that sleep dysregulation may be altered in response to chronic cumulative blast exposure. In comparing lifetime blast exposure at baseline (prior to exposure in current training), and top associated symptoms, we identified significant DMRs associated with tinnitus, sleep difficulties, and headache. Notably, we identified KCNN3, SOD3, MUC4, GALR1, and WDR45B, which are implicated in auditory function, as differentially methylated associated with self-reported tinnitus. These findings suggest neurobiological mechanisms behind auditory injuries in our military warfighters and are particularly relevant given tinnitus is not only a primary disability among veterans, but has also been demonstrated in active duty medical records for populations exposed to blast in training. Additionally, we found that differentially methylated regions associated with the genes CCDC68 and COMT track with sleep difficulties, and those within FMOD and TNXB track with pain and headache. Conclusion: Sleep disturbances, as well as tinnitus and chronic pain, are widely reported in U.S. military service members and veterans. As we have previously demonstrated, DNA methylation encapsulates lifetime exposure to blast. The current data support previous findings and recapitulate transcriptional regulatory alterations in genes involved in sleep, auditory function, and pain. These data uncovered novel epigenetic and transcriptional regulatory mechanism underlying the etiological basis of these symptoms.
Collapse
Affiliation(s)
- Zhaoyu Wang
- James J. Peters VA Medical Center, Medical Epigenetics, Bronx, NY, United States
| | - Caroline M. Wilson
- James J. Peters VA Medical Center, Medical Epigenetics, Bronx, NY, United States
- Icahn School of Medicine at Mount Sinai, Nash Family Department of Neuroscience, New York, NY, United States
| | - Yongchao Ge
- Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Jeffrey Nemes
- Center for Military Psychiatry and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | - Christina LaValle
- Center for Military Psychiatry and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | - Angela Boutté
- Center for Military Psychiatry and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | - Walter Carr
- Center for Military Psychiatry and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD, United States
- Oak Ridge Institute for Science and Education, Oak Ridge, TN, United States
| | - Gary Kamimori
- Center for Military Psychiatry and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | - Fatemeh Haghighi
- James J. Peters VA Medical Center, Medical Epigenetics, Bronx, NY, United States
- Icahn School of Medicine at Mount Sinai, Nash Family Department of Neuroscience, New York, NY, United States
| |
Collapse
|