1
|
Bukh AV, Rybalova EV, Shepelev IA, Vadivasova TE. Classification of musical intervals by spiking neural networks: Perfect student in solfége classes. CHAOS (WOODBURY, N.Y.) 2024; 34:063102. [PMID: 38829796 DOI: 10.1063/5.0210790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 05/12/2024] [Indexed: 06/05/2024]
Abstract
We investigate a spike activity of a network of excitable FitzHugh-Nagumo neurons, which is under constant two-frequency auditory signals. The neurons are supplemented with linear frequency filters and nonlinear input signal converters. We show that it is possible to configure the network to recognize a specific frequency ratio (musical interval) by selecting the parameters of the neurons, input filters, and coupling between neurons. A set of appropriately configured subnetworks with different topologies and coupling strengths can serve as a classifier for musical intervals. We have found that the selective properties of the classifier are due to the presence of a specific topology of coupling between the neurons of the network.
Collapse
Affiliation(s)
- A V Bukh
- Institute of Physics, Saratov State University, 83 Astrakhanskaya Street, Saratov 410012, Russia
| | - E V Rybalova
- Institute of Physics, Saratov State University, 83 Astrakhanskaya Street, Saratov 410012, Russia
| | - I A Shepelev
- Institute of Physics, Saratov State University, 83 Astrakhanskaya Street, Saratov 410012, Russia
- Almetyevsk State Petroleum Institute, 2 Lenin Street, Almetyevsk 423462, Russia
| | - T E Vadivasova
- Institute of Physics, Saratov State University, 83 Astrakhanskaya Street, Saratov 410012, Russia
| |
Collapse
|
2
|
Mu S, Shan S, Li L, Jing S, Li R, Zheng C, Cui X. DMA-HPCNet: Dual Multi-Level Attention Hybrid Pyramid Convolution Neural Network for Alzheimer's Disease Classification. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1955-1964. [PMID: 38717874 DOI: 10.1109/tnsre.2024.3398640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/23/2024]
Abstract
Computer-aided diagnosis (CAD) plays a crucial role in the clinical application of Alzheimer's disease (AD). In particular, convolutional neural network (CNN)-based methods are highly sensitive to subtle changes caused by brain atrophy in medical images (e.g., magnetic resonance imaging, MRI). Due to computational resource constraints, most CAD methods focus on quantitative features in specific regions, neglecting the holistic nature of the images, which poses a challenge for a comprehensive understanding of pathological changes in AD. To address this issue, we propose a lightweight dual multi-level hybrid pyramid convolutional neural network (DMA-HPCNet) to aid clinical diagnosis of AD. Specifically, we introduced ResNet as the backbone network and modularly extended the hybrid pyramid convolution (HPC) block and the dual multi-level attention (DMA) module. Among them, the HPC block is designed to enhance the acquisition of information at different scales, and the DMA module is proposed to sequentially extract different local and global representations from the channel and spatial domains. Our proposed DMA-HPCNet method was evaluated on baseline MRI slices of 443 subjects from the ADNI dataset. Experimental results show that our proposed DMA-HPCNet model performs efficiently in AD-related classification tasks with low computational cost.
Collapse
|
3
|
Lutes N, Nadendla VSS, Krishnamurthy K. Convolutional spiking neural networks for intent detection based on anticipatory brain potentials using electroencephalogram. Sci Rep 2024; 14:8850. [PMID: 38632436 PMCID: PMC11024189 DOI: 10.1038/s41598-024-59469-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 04/11/2024] [Indexed: 04/19/2024] Open
Abstract
Spiking neural networks (SNNs) are receiving increased attention because they mimic synaptic connections in biological systems and produce spike trains, which can be approximated by binary values for computational efficiency. Recently, the addition of convolutional layers to combine the feature extraction power of convolutional networks with the computational efficiency of SNNs has been introduced. This paper studies the feasibility of using a convolutional spiking neural network (CSNN) to detect anticipatory slow cortical potentials (SCPs) related to braking intention in human participants using an electroencephalogram (EEG). Data was collected during an experiment wherein participants operated a remote-controlled vehicle on a testbed designed to simulate an urban environment. Participants were alerted to an incoming braking event via an audio countdown to elicit anticipatory potentials that were measured using an EEG. The CSNN's performance was compared to a standard CNN, EEGNet and three graph neural networks via 10-fold cross-validation. The CSNN outperformed all the other neural networks, and had a predictive accuracy of 99.06% with a true positive rate of 98.50%, a true negative rate of 99.20% and an F1-score of 0.98. Performance of the CSNN was comparable to the CNN in an ablation study using a subset of EEG channels that localized SCPs. Classification performance of the CSNN degraded only slightly when the floating-point EEG data were converted into spike trains via delta modulation to mimic synaptic connections.
Collapse
Affiliation(s)
- Nathan Lutes
- Department of Mechanical and Aerospace Engineering, Missouri University of Science and Technology, Rolla, MO, 65409, USA
| | | | - K Krishnamurthy
- Department of Mechanical and Aerospace Engineering, Missouri University of Science and Technology, Rolla, MO, 65409, USA.
| |
Collapse
|
4
|
Wang Y, Gu X, Hou W, Zhao M, Sun L, Guo C. Dual Semi-Supervised Learning for Classification of Alzheimer's Disease and Mild Cognitive Impairment Based on Neuropsychological Data. Brain Sci 2023; 13:brainsci13020306. [PMID: 36831850 PMCID: PMC9954645 DOI: 10.3390/brainsci13020306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Revised: 01/27/2023] [Accepted: 02/07/2023] [Indexed: 02/16/2023] Open
Abstract
Deep learning has shown impressive diagnostic abilities in Alzheimer's disease (AD) research in recent years. However, although neuropsychological tests play a crucial role in screening AD and mild cognitive impairment (MCI), there is still a lack of deep learning algorithms only using such basic diagnostic methods. This paper proposes a novel semi-supervised method using neuropsychological test scores and scarce labeled data, which introduces difference regularization and consistency regularization with pseudo-labeling. A total of 188 AD, 402 MCI, and 229 normal controls (NC) were enrolled in the study from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. We first chose the 15 features most associated with the diagnostic outcome by feature selection among the seven neuropsychological tests. Next, we proposed a dual semi-supervised learning (DSSL) framework that uses two encoders to learn two different feature vectors. The diagnosed 60 and 120 subjects were randomly selected as training labels for the model. The experimental results show that DSSL achieves the best accuracy and stability in classifying AD, MCI, and NC (85.47% accuracy for 60 labels and 88.40% accuracy for 120 labels) compared to other semi-supervised methods. DSSL is an excellent semi-supervised method to provide clinical insight for physicians to diagnose AD and MCI.
Collapse
Affiliation(s)
- Yan Wang
- Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China
| | - Xuming Gu
- Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China
| | - Wenju Hou
- Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China
| | - Meng Zhao
- Department of Neurology and Neuroscience Center, The First Hospital of Jilin University, Changchun 130021, China
| | - Li Sun
- Department of Neurology and Neuroscience Center, The First Hospital of Jilin University, Changchun 130021, China
| | - Chunjie Guo
- Department of Radiology, The First Hospital of Jilin University, Changchun 130021, China
- Correspondence: ; Tel.: +86-1580-430-0151
| |
Collapse
|
5
|
Scatigno C, Festa G. Neutron Imaging and Learning Algorithms: New Perspectives in Cultural Heritage Applications. J Imaging 2022; 8:jimaging8100284. [PMID: 36286378 PMCID: PMC9605401 DOI: 10.3390/jimaging8100284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 10/04/2022] [Accepted: 10/12/2022] [Indexed: 11/06/2022] Open
Abstract
Recently, learning algorithms such as Convolutional Neural Networks have been successfully applied in different stages of data processing from the acquisition to the data analysis in the imaging context. The aim of these algorithms is the dimensionality of data reduction and the computational effort, to find benchmarks and extract features, to improve the resolution, and reproducibility performances of the imaging data. Currently, no Neutron Imaging combined with learning algorithms was applied on cultural heritage domain, but future applications could help to solve challenges of this research field. Here, a review of pioneering works to exploit the use of Machine Learning and Deep Learning models applied to X-ray imaging and Neutron Imaging data processing is reported, spanning from biomedicine, microbiology, and materials science to give new perspectives on future cultural heritage applications.
Collapse
|
6
|
Deep Learning-Based Diagnosis of Alzheimer’s Disease. J Pers Med 2022; 12:jpm12050815. [PMID: 35629237 PMCID: PMC9143671 DOI: 10.3390/jpm12050815] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/15/2022] [Accepted: 05/16/2022] [Indexed: 12/27/2022] Open
Abstract
Alzheimer’s disease (AD), the most familiar type of dementia, is a severe concern in modern healthcare. Around 5.5 million people aged 65 and above have AD, and it is the sixth leading cause of mortality in the US. AD is an irreversible, degenerative brain disorder characterized by a loss of cognitive function and has no proven cure. Deep learning techniques have gained popularity in recent years, particularly in the domains of natural language processing and computer vision. Since 2014, these techniques have begun to achieve substantial consideration in AD diagnosis research, and the number of papers published in this arena is rising drastically. Deep learning techniques have been reported to be more accurate for AD diagnosis in comparison to conventional machine learning models. Motivated to explore the potential of deep learning in AD diagnosis, this study reviews the current state-of-the-art in AD diagnosis using deep learning. We summarize the most recent trends and findings using a thorough literature review. The study also explores the different biomarkers and datasets for AD diagnosis. Even though deep learning has shown promise in AD diagnosis, there are still several challenges that need to be addressed.
Collapse
|
7
|
Jiang M, Yan B, Li Y, Zhang J, Li T, Ke W. Image Classification of Alzheimer’s Disease Based on External-Attention Mechanism and Fully Convolutional Network. Brain Sci 2022; 12:brainsci12030319. [PMID: 35326275 PMCID: PMC8946519 DOI: 10.3390/brainsci12030319] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 02/11/2022] [Accepted: 02/16/2022] [Indexed: 01/27/2023] Open
Abstract
Automatic and accurate classification of Alzheimer’s disease is a challenging and promising task. Fully Convolutional Network (FCN) can classify images at the pixel level. Adding an attention mechanism to the Fully Convolutional Network can effectively improve the classification performance of the model. However, the self-attention mechanism ignores the potential correlation between different samples. Aiming at this problem, we propose a new method for image classification of Alzheimer’s disease based on the external-attention mechanism. The external-attention module is added after the fourth convolutional block of the fully convolutional network model. At the same time, the double normalization method of Softmax and L1 norm is introduced to obtain a better classification performance and richer feature information of the disease probability map. The activation function Softmax can increase the degree of fitting of the neural network to the training set, which transforms linearity into nonlinearity, thereby increasing the flexibility of the neural network. The L1 norm can avoid the attention map being affected by especially large (especially small) eigenvalues. The experiments in this paper use 550 three-dimensional MRI images and use five-fold cross-validation. The experimental results show that the proposed image classification method for Alzheimer’s disease, combining the external-attention mechanism with double normalization, can effectively improve the classification performance of the model. With this method, the accuracy of the MLP-A model is 92.36%, the accuracy of the MLP-B model is 98.55%, and the accuracy of the fusion model MLP-C is 98.73%. The classification performance of the model is higher than similar models without adding any attention mechanism, and it is better than other comparison methods.
Collapse
Affiliation(s)
- Mingfeng Jiang
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China; (M.J.); (B.Y.)
| | - Bin Yan
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China; (M.J.); (B.Y.)
| | - Yang Li
- School of Information Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, China; (M.J.); (B.Y.)
- Correspondence:
| | - Jucheng Zhang
- Department of Clinical Engineering, The Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310019, China;
| | - Tieqiang Li
- Department of Clinical Science, Intervention and Technology, Karolinska Institutet, 171 77 Stockholm, Sweden;
| | - Wei Ke
- School of Applied Sciences, Macao Polytechnic Institute, Macao SAR 999078, China;
| |
Collapse
|
8
|
Jiang F, Zhu Q, Tian T. Breast Cancer Detection Based on Modified Harris Hawks Optimization and Extreme Learning Machine Embedded with Feature Weighting. Neural Process Lett 2022. [DOI: 10.1007/s11063-021-10700-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
9
|
Shanmugam JV, Duraisamy B, Simon BC, Bhaskaran P. Alzheimer’s disease classification using pre-trained deep networks. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103217] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|