1
|
Al Fahoum A, Zyout A. Wavelet Transform, Reconstructed Phase Space, and Deep Learning Neural Networks for EEG-Based Schizophrenia Detection. Int J Neural Syst 2024; 34:2450046. [PMID: 39010724 DOI: 10.1142/s0129065724500461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/17/2024]
Abstract
This study proposes an innovative expert system that uses exclusively EEG signals to diagnose schizophrenia in its early stages. For diagnosing psychiatric/neurological disorders, electroencephalogram (EEG) testing is considered a financially viable, safe, and reliable alternative. Using the reconstructed phase space (RPS) and the continuous wavelet transform, the researchers maximized the differences between the EEG nonstationary signals of normal and schizophrenia individuals, which cannot be observed in the time, frequency, or time-frequency domains. This reveals significant information, highlighting more distinguishable features. Then, a deep learning network was trained to enhance the accuracy of the resulting image classification. The algorithm's efficacy was confirmed through three distinct methods: employing 70% of the dataset for training, 15% for validation, and the remaining 15% for testing. This was followed by a 5-fold cross-validation technique and a leave-one-out classification approach. Each method was iterated 100 times to ascertain the algorithm's robustness. The performance metrics derived from these tests - accuracy, precision, sensitivity, F1 score, Matthews correlation coefficient, and Kappa - indicated remarkable outcomes. The algorithm demonstrated steady performance across all evaluation strategies, underscoring its relevance and reliability. The outcomes validate the system's accuracy, precision, sensitivity, and robustness by showcasing its capability to autonomously differentiate individuals diagnosed with schizophrenia from those in a state of normal health.
Collapse
Affiliation(s)
- Amjed Al Fahoum
- Biomedical Systems and Informatics Engineering Department, Yarmouk University, Irbid 21163, Jordan
| | - Ala'a Zyout
- Biomedical Systems and Informatics Engineering Department, Yarmouk University, Irbid 21163, Jordan
| |
Collapse
|
2
|
Xu X, Luo H, Yi Z, Zhang H. A Forward Learning Algorithm for Neural Memory Ordinary Differential Equations. Int J Neural Syst 2024; 34:2450048. [PMID: 38909317 DOI: 10.1142/s0129065724500485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/24/2024]
Abstract
The deep neural network, based on the backpropagation learning algorithm, has achieved tremendous success. However, the backpropagation algorithm is consistently considered biologically implausible. Many efforts have recently been made to address these biological implausibility issues, nevertheless, these methods are tailored to discrete neural network structures. Continuous neural networks are crucial for investigating novel neural network models with more biologically dynamic characteristics and for interpretability of large language models. The neural memory ordinary differential equation (nmODE) is a recently proposed continuous neural network model that exhibits several intriguing properties. In this study, we present a forward-learning algorithm, called nmForwardLA, for nmODE. This algorithm boasts lower computational dimensions and greater efficiency. Compared with the other learning algorithms, experimental results on MNIST, CIFAR10, and CIFAR100 demonstrate its potency.
Collapse
Affiliation(s)
- Xiuyuan Xu
- Department of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065 Sichuan, P. R. China
| | - Haiying Luo
- Department of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065 Sichuan, P. R. China
| | - Zhang Yi
- Department of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065 Sichuan, P. R. China
| | - Haixian Zhang
- Department of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065 Sichuan, P. R. China
| |
Collapse
|
3
|
Chen W, Yu Z, Yang C, Lu Y. Abnormal Behavior Recognition Based on 3D Dense Connections. Int J Neural Syst 2024; 34:2450049. [PMID: 39010725 DOI: 10.1142/s0129065724500497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/17/2024]
Abstract
Abnormal behavior recognition is an important technology used to detect and identify activities or events that deviate from normal behavior patterns. It has wide applications in various fields such as network security, financial fraud detection, and video surveillance. In recent years, Deep Convolution Networks (ConvNets) have been widely applied in abnormal behavior recognition algorithms and have achieved significant results. However, existing abnormal behavior detection algorithms mainly focus on improving the accuracy of the algorithms and have not explored the real-time nature of abnormal behavior recognition. This is crucial to quickly identify abnormal behavior in public places and improve urban public safety. Therefore, this paper proposes an abnormal behavior recognition algorithm based on three-dimensional (3D) dense connections. The proposed algorithm uses a multi-instance learning strategy to classify various types of abnormal behaviors, and employs dense connection modules and soft-threshold attention mechanisms to reduce the model's parameter count and enhance network computational efficiency. Finally, redundant information in the sequence is reduced by attention allocation to mitigate its negative impact on recognition results. Experimental verification shows that our method achieves a recognition accuracy of 95.61% on the UCF-crime dataset. Comparative experiments demonstrate that our model has strong performance in terms of recognition accuracy and speed.
Collapse
Affiliation(s)
- Wei Chen
- School of Electrical and Control Engineering, North China University of Technology, Beijing 100144, P. R. China
| | - Zhanhe Yu
- School of Information Science and Technology, North China University of Technology, Beijing 100144, P. R. China
| | - Chaochao Yang
- School of Electrical and Control Engineering, North China University of Technology, Beijing 100144, P. R. China
| | - Yuanyao Lu
- School of Information Science and Technology, North China University of Technology, Beijing 100144, P. R. China
| |
Collapse
|
4
|
Ji D, He L, Dong X, Li H, Zhong X, Liu G, Zhou W. Epileptic Seizure Prediction Using Spatiotemporal Feature Fusion on EEG. Int J Neural Syst 2024; 34:2450041. [PMID: 38770650 DOI: 10.1142/s0129065724500412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Electroencephalography (EEG) plays a crucial role in epilepsy analysis, and epileptic seizure prediction has significant value for clinical treatment of epilepsy. Currently, prediction methods using Convolutional Neural Network (CNN) primarily focus on local features of EEG, making it challenging to simultaneously capture the spatial and temporal features from multi-channel EEGs to identify the preictal state effectively. In order to extract inherent spatial relationships among multi-channel EEGs while obtaining their temporal correlations, this study proposed an end-to-end model for the prediction of epileptic seizures by incorporating Graph Attention Network (GAT) and Temporal Convolutional Network (TCN). Low-pass filtered EEG signals were fed into the GAT module for EEG spatial feature extraction, and followed by TCN to capture temporal features, allowing the end-to-end model to acquire the spatiotemporal correlations of multi-channel EEGs. The system was evaluated on the publicly available CHB-MIT database, yielding segment-based accuracy of 98.71%, specificity of 98.35%, sensitivity of 99.07%, and F1-score of 98.71%, respectively. Event-based sensitivity of 97.03% and False Positive Rate (FPR) of 0.03/h was also achieved. Experimental results demonstrated this system can achieve superior performance for seizure prediction by leveraging the fusion of EEG spatiotemporal features without the need of feature engineering.
Collapse
Affiliation(s)
- Dezan Ji
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Landi He
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xingchen Dong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Haotian Li
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Xiangwen Zhong
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Guoyang Liu
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| | - Weidong Zhou
- School of Integrated Circuits, Shandong University, Jinan 250100, P. R. China
- Shenzhen Institute of Shandong University, Shenzhen 518057, P. R. China
| |
Collapse
|
5
|
Martinez-Murcia FJ, Arco JE, Jimenez-Mesa C, Segovia F, Illan IA, Ramirez J, Gorriz JM. Bridging Imaging and Clinical Scores in Parkinson's Progression via Multimodal Self-Supervised Deep Learning. Int J Neural Syst 2024; 34:2450043. [PMID: 38770651 DOI: 10.1142/s0129065724500436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Neurodegenerative diseases pose a formidable challenge to medical research, demanding a nuanced understanding of their progressive nature. In this regard, latent generative models can effectively be used in a data-driven modeling of different dimensions of neurodegeneration, framed within the context of the manifold hypothesis. This paper proposes a joint framework for a multi-modal, common latent generative model to address the need for a more comprehensive understanding of the neurodegenerative landscape in the context of Parkinson's disease (PD). The proposed architecture uses coupled variational autoencoders (VAEs) to joint model a common latent space to both neuroimaging and clinical data from the Parkinson's Progression Markers Initiative (PPMI). Alternative loss functions, different normalization procedures, and the interpretability and explainability of latent generative models are addressed, leading to a model that was able to predict clinical symptomatology in the test set, as measured by the unified Parkinson's disease rating scale (UPDRS), with R2 up to 0.86 for same-modality and 0.441 cross-modality (using solely neuroimaging). The findings provide a foundation for further advancements in the field of clinical research and practice, with potential applications in decision-making processes for PD. The study also highlights the limitations and capabilities of the proposed model, emphasizing its direct interpretability and potential impact on understanding and interpreting neuroimaging patterns associated with PD symptomatology.
Collapse
Affiliation(s)
- Francisco J Martinez-Murcia
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Center for Advanced Studies, Ludwig-Maximilien Universität München, München, Germany
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Juan Eloy Arco
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Carmen Jimenez-Mesa
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Fermin Segovia
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Ignacio A Illan
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Javier Ramirez
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Juan Manuel Gorriz
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Center for Advanced Studies, Ludwig-Maximilien Universität München, München, Germany
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| |
Collapse
|
6
|
Li C, Li P, Zhang Y, Li N, Si Y, Li F, Cao Z, Chen H, Chen B, Yao D, Xu P. Effective Emotion Recognition by Learning Discriminative Graph Topologies in EEG Brain Networks. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:10258-10272. [PMID: 37022389 DOI: 10.1109/tnnls.2023.3238519] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Multichannel electroencephalogram (EEG) is an array signal that represents brain neural networks and can be applied to characterize information propagation patterns for different emotional states. To reveal these inherent spatial graph features and increase the stability of emotion recognition, we propose an effective emotion recognition model that performs multicategory emotion recognition with multiple emotion-related spatial network topology patterns (MESNPs) by learning discriminative graph topologies in EEG brain networks. To evaluate the performance of our proposed MESNP model, we conducted single-subject and multisubject four-class classification experiments on two public datasets, MAHNOB-HCI and DEAP. Compared with existing feature extraction methods, the MESNP model significantly enhances the multiclass emotional classification performance in the single-subject and multisubject conditions. To evaluate the online version of the proposed MESNP model, we designed an online emotion monitoring system. We recruited 14 participants to conduct the online emotion decoding experiments. The average online experimental accuracy of the 14 participants was 84.56%, indicating that our model can be applied in affective brain-computer interface (aBCI) systems. The offline and online experimental results demonstrate that the proposed MESNP model effectively captures discriminative graph topology patterns and significantly improves emotion classification performance. Moreover, the proposed MESNP model provides a new scheme for extracting features from strongly coupled array signals.
Collapse
|
7
|
Zheng X, Yang Y, Li D, Deng Y, Xie Y, Yi Z, Ma L, Xu L. Precise Localization for Anatomo-Physiological Hallmarks of the Cervical Spine by Using Neural Memory Ordinary Differential Equation. Int J Neural Syst 2024:2450056. [PMID: 39049777 DOI: 10.1142/s0129065724500564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/27/2024]
Abstract
In the evaluation of cervical spine disorders, precise positioning of anatomo-physiological hallmarks is fundamental for calculating diverse measurement metrics. Despite the fact that deep learning has achieved impressive results in the field of keypoint localization, there are still many limitations when facing medical image. First, these methods often encounter limitations when faced with the inherent variability in cervical spine datasets, arising from imaging factors. Second, predicting keypoints for only 4% of the entire X-ray image surface area poses a significant challenge. To tackle these issues, we propose a deep neural network architecture, NF-DEKR, specifically tailored for predicting keypoints in cervical spine physiological anatomy. Leveraging neural memory ordinary differential equation with its distinctive memory learning separation and convergence to a singular global attractor characteristic, our design effectively mitigates inherent data variability. Simultaneously, we introduce a Multi-Resolution Focus module to preprocess feature maps before entering the disentangled regression branch and the heatmap branch. Employing a differentiated strategy for feature maps of varying scales, this approach yields more accurate predictions of densely localized keypoints. We construct a medical dataset, SCUSpineXray, comprising X-ray images annotated by orthopedic specialists and conduct similar experiments on the publicly available UWSpineCT dataset. Experimental results demonstrate that compared to the baseline DEKR network, our proposed method enhances average precision by 2% to 3%, accompanied by a marginal increase in model parameters and the floating-point operations (FLOPs). The code (https://github.com/Zhxyi/NF-DEKR) is available.
Collapse
Affiliation(s)
- Xi Zheng
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, P. R. China
| | - Yi Yang
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Road, Chengdu 610041, P. R. China
| | - Dehan Li
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, P. R. China
| | - Yi Deng
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Road, Chengdu 610041, P. R. China
| | - Yuexiong Xie
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, P. R. China
| | - Zhang Yi
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, P. R. China
| | - Litai Ma
- Department of Orthopedics, Orthopedic Research Institute, West China Hospital, Sichuan University, No. 37 Guo Xue Road, Chengdu 610041, P. R. China
| | - Lei Xu
- Machine Intelligence Laboratory, College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, P. R. China
| |
Collapse
|
8
|
Roecher E, Mösch L, Zweerings J, Thiele FO, Caspers S, Gaebler AJ, Eisner P, Sarkheil P, Mathiak K. Motion Artifact Detection for T1-Weighted Brain MR Images Using Convolutional Neural Networks. Int J Neural Syst 2024:2450052. [PMID: 38989919 DOI: 10.1142/s0129065724500527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2024]
Abstract
Quality assessment (QA) of magnetic resonance imaging (MRI) encompasses several factors such as noise, contrast, homogeneity, and imaging artifacts. Quality evaluation is often not standardized and relies on the expertise, and vigilance of the personnel, posing limitations especially with large datasets. Machine learning based on convolutional neural networks (CNNs) is a promising approach to address these challenges by performing automated inspection of MR images. In this study, a CNN for the detection of random head motion artifacts (RHM) in T1-weighted MRI as one aspect of image quality is proposed. A two-step approach aimed to first identify images exhibiting pronounced motion artifacts, and second to evaluate the feasibility of a more detailed three-class classification. The utilized dataset consisted of 420 T1-weighted whole-brain image volumes with isotropic resolution. Human experts assigned each volume to one of three classes of artifact prominence. Results demonstrate an accuracy of 95% for the identification of images with pronounced artifact load. The addition of an intermediate class retained an accuracy of 76%. The findings highlight the potential of CNN-based approaches to increase the efficiency of post-hoc QAs in large datasets by flagging images with potentially relevant artifact loads for closer inspection.
Collapse
Affiliation(s)
- Erik Roecher
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
| | - Lucas Mösch
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
| | - Jana Zweerings
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
| | | | - Svenja Caspers
- Institute for Anatomy I, Medical Faculty & University, Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | - Arnim Johannes Gaebler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
- JARA-BRAIN, Jülich Aachen Research Alliance (JARA), Translational Brain Medicine, Germany
- Institute of Neurophysiology, Faculty of Medicine, RWTH Aachen, Germany
| | - Patrick Eisner
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
| | - Pegah Sarkheil
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, Faculty of Medicine, RWTH Aachen, Germany
- JARA-BRAIN, Jülich Aachen Research Alliance (JARA), Translational Brain Medicine, Germany
| |
Collapse
|
9
|
Ahuja C, Sethia D. Harnessing Few-Shot Learning for EEG signal classification: a survey of state-of-the-art techniques and future directions. Front Hum Neurosci 2024; 18:1421922. [PMID: 39050382 PMCID: PMC11266297 DOI: 10.3389/fnhum.2024.1421922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 05/31/2024] [Indexed: 07/27/2024] Open
Abstract
This paper presents a systematic literature review, providing a comprehensive taxonomy of Data Augmentation (DA), Transfer Learning (TL), and Self-Supervised Learning (SSL) techniques within the context of Few-Shot Learning (FSL) for EEG signal classification. EEG signals have shown significant potential in various paradigms, including Motor Imagery, Emotion Recognition, Visual Evoked Potentials, Steady-State Visually Evoked Potentials, Rapid Serial Visual Presentation, Event-Related Potentials, and Mental Workload. However, challenges such as limited labeled data, noise, and inter/intra-subject variability have impeded the effectiveness of traditional machine learning (ML) and deep learning (DL) models. This review methodically explores how FSL approaches, incorporating DA, TL, and SSL, can address these challenges and enhance classification performance in specific EEG paradigms. It also delves into the open research challenges related to these techniques in EEG signal classification. Specifically, the review examines the identification of DA strategies tailored to various EEG paradigms, the creation of TL architectures for efficient knowledge transfer, and the formulation of SSL methods for unsupervised representation learning from EEG data. Addressing these challenges is crucial for enhancing the efficacy and robustness of FSL-based EEG signal classification. By presenting a structured taxonomy of FSL techniques and discussing the associated research challenges, this systematic review offers valuable insights for future investigations in EEG signal classification. The findings aim to guide and inspire researchers, promoting advancements in applying FSL methodologies for improved EEG signal analysis and classification in real-world settings.
Collapse
Affiliation(s)
- Chirag Ahuja
- Department of Computer Science and Engineering, Delhi Technological University, New Delhi, India
| | - Divyashikha Sethia
- Department of Software Engineering, Delhi Technology University, New Delhi, India
| |
Collapse
|
10
|
Ren Q, Zhang L, Liu S, Liu JX, Shang J, Liu X. A Delayed Spiking Neural Membrane System for Adaptive Nearest Neighbor-Based Density Peak Clustering. Int J Neural Syst 2024:2450050. [PMID: 38973024 DOI: 10.1142/s0129065724500503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/09/2024]
Abstract
Although the density peak clustering (DPC) algorithm can effectively distribute samples and quickly identify noise points, it lacks adaptability and cannot consider the local data structure. In addition, clustering algorithms generally suffer from high time complexity. Prior research suggests that clustering algorithms grounded in P systems can mitigate time complexity concerns. Within the realm of membrane systems (P systems), spiking neural P systems (SN P systems), inspired by biological nervous systems, are third-generation neural networks that possess intricate structures and offer substantial parallelism advantages. Thus, this study first improved the DPC by introducing the maximum nearest neighbor distance and K-nearest neighbors (KNN). Moreover, a method based on delayed spiking neural P systems (DSN P systems) was proposed to improve the performance of the algorithm. Subsequently, the DSNP-ANDPC algorithm was proposed. The effectiveness of DSNP-ANDPC was evaluated through comprehensive evaluations across four synthetic datasets and 10 real-world datasets. The proposed method outperformed the other comparison methods in most cases.
Collapse
Affiliation(s)
- Qianqian Ren
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Lianlian Zhang
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Shaoyi Liu
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Jin-Xing Liu
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Junliang Shang
- School of Computer Science, Qufu Normal University, Rizhao 276826, P. R. China
| | - Xiyu Liu
- Academy of Management Science, Business School, Shandong Normal University, Jinan 250300, P. R. China
| |
Collapse
|
11
|
Choi K, Choe Y, Park H. Reinforcement Learning May Demystify the Limited Human Motor Learning Efficacy Due to Visual-Proprioceptive Mismatch. Int J Neural Syst 2024; 34:2450037. [PMID: 38655914 DOI: 10.1142/s0129065724500370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
Vision and proprioception have fundamental sensory mismatches in delivering locational information, and such mismatches are critical factors limiting the efficacy of motor learning. However, it is still not clear how and to what extent this mismatch limits motor learning outcomes. To further the understanding of the effect of sensory mismatch on motor learning outcomes, a reinforcement learning algorithm and the simplified biomechanical elbow joint model were employed to mimic the motor learning process in a computational environment. By applying a reinforcement learning algorithm to the motor learning of elbow joint flexion task, simulation results successfully explained how visual-proprioceptive mismatch limits motor learning outcomes in terms of motor control accuracy and task completion speed. The larger the perceived angular offset between the two sensory modalities, the lower the motor control accuracy. Also, the more similar the peak reward amplitude of the two sensory modalities, the lower the motor control accuracy. In addition, simulation results suggest that insufficient exploration rate limits task completion speed, and excessive exploration rate limits motor control accuracy. Such a speed-accuracy trade-off shows that a moderate exploration rate could serve as another important factor in motor learning.
Collapse
Affiliation(s)
- Kyungrak Choi
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Yoonsuck Choe
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Hangue Park
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea
- Department of Intelligent Precision Healthcare Convergence, Sungkyunkwan University, Suwon, South Korea
| |
Collapse
|
12
|
Zhang L, Xu F, Neri F. An Asynchronous Spiking Neural Membrane System for Edge Detection. Int J Neural Syst 2024; 34:2450023. [PMID: 38490956 DOI: 10.1142/s0129065724500230] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/17/2024]
Abstract
Spiking neural membrane systems (SN P systems) are a class of bio-inspired models inspired by the activities and connectivity of neurons. Extensive studies have been made on SN P systems with synchronization-based communication, while further efforts are needed for the systems with rhythm-based communication. In this work, we design an asynchronous SN P system with resonant connections where all the enabled neurons in the same group connected by resonant connections should instantly produce spikes with the same rhythm. In the designed system, each of the three modules implements one type of the three operations associated with the edge detection of digital images, and they collaborate each other through the resonant connections. An algorithm called EDSNP for edge detection is proposed to simulate the working of the designed asynchronous SN P system. A quantitative analysis of EDSNP and the related methods for edge detection had been conducted to evaluate the performance of EDSNP. The performance of the EDSNP in processing the testing images is superior to the compared methods, based on the quantitative metrics of accuracy, error rate, mean square error, peak signal-to-noise ratio and true positive rate. The results indicate the potential of the temporal firing and the proper neuronal connections in the SN P system to achieve good performance in edge detection.
Collapse
Affiliation(s)
- Luping Zhang
- Jiangxi Engineering Technology Research Center of Nuclear, Geoscience Data Science and System, Jiangxi Engineering Laboratory on Radioactive Geoscience and Big Data Technology, School of Information Engineering, East China University of Technology, Nanchang 330013, Jiangxi, P. R. China
| | - Fei Xu
- Key Laboratory of Image Information Processing and Intelligent Control of Education Ministry of China, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, P. R. China
| | - Ferrante Neri
- NICE Research Group, School of Computer Science and Electronic Engineering, University of Surrey, Guildford, Surrey GU2 7XH, UK
| |
Collapse
|
13
|
Ermini I, Zandron C. Modular Spiking Neural Membrane Systems for Image Classification. Int J Neural Syst 2024; 34:2450021. [PMID: 38453666 DOI: 10.1142/s0129065724500217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Abstract
A variant of membrane computing models called Spiking Neural P systems (SNP systems) closely mimics the structure and behavior of biological neurons. As third-generation neural networks, SNP systems have flexible architectures allowing the design of bio-inspired machine learning algorithms. This paper proposes Modular Spiking Neural P (MSNP) systems to solve image classification problems, a novel SNP system to be applied in scenarios where hundreds or even thousands of different classes are considered. A main issue to face in such situations is related to the structural complexity of the network. MSNP systems devised in this work allow to approach the general classification problem by dividing it in smaller parts, that are then faced by single entities of the network. As a benchmark dataset, the Oxford Flowers 102 dataset is considered, consisting of more than 8000 pictures of flowers belonging to the 102 species commonly found in the UK. These classes sometimes present large variations within them, may be also very similar to one another, and different images of the same subject may differ a lot. The work describes the architecture of the MSNP system, based on modules focusing on a specific class, their training phase, and the evaluation of the model both concerning result accuracy as well as energy consumption. Experimental results on image classification problems show that the model achieves good results, but is strongly connected to image quality, mainly depending on the frequency of images, remarkable changes of pose, images not centered, and subject mostly not shown.
Collapse
Affiliation(s)
- Iris Ermini
- Dipartimento di Informatica, Sistemistica e Comunicazione, Università degli Studi di Milano-Bicocca, Viale Sarca 336/14 Milano 20126, Italy
| | - Claudio Zandron
- Dipartimento di Informatica, Sistemistica e Comunicazione, Università degli Studi di Milano-Bicocca, Viale Sarca 336/14 Milano 20126, Italy
| |
Collapse
|
14
|
Cunlin H, Ye Y, Nenggang X. Self-supervised motor imagery EEG recognition model based on 1-D MTCNN-LSTM network. J Neural Eng 2024; 21:036014. [PMID: 38757187 DOI: 10.1088/1741-2552/ad48bc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 05/08/2024] [Indexed: 05/18/2024]
Abstract
Objective.Aiming for the research on the brain-computer interface (BCI), it is crucial to design a MI-EEG recognition model, possessing a high classification accuracy and strong generalization ability, and not relying on a large number of labeled training samples.Approach.In this paper, we propose a self-supervised MI-EEG recognition method based on self-supervised learning with one-dimensional multi-task convolutional neural networks and long short-term memory (1-D MTCNN-LSTM). The model is divided into two stages: signal transform identification stage and pattern recognition stage. In the signal transform recognition phase, the signal transform dataset is recognized by the upstream 1-D MTCNN-LSTM network model. Subsequently, the backbone network from the signal transform identification phase is transferred to the pattern recognition phase. Then, it is fine-tuned using a trace amount of labeled data to finally obtain the motion recognition model.Main results.The upstream stage of this study achieves more than 95% recognition accuracy for EEG signal transforms, up to 100%. For MI-EEG pattern recognition, the model obtained recognition accuracies of 82.04% and 87.14% with F1 scores of 0.7856 and 0.839 on the datasets of BCIC-IV-2b and BCIC-IV-2a.Significance.The improved accuracy proves the superiority of the proposed method. It is prospected to be a method for accurate classification of MI-EEG in the BCI system.
Collapse
Affiliation(s)
- Hu Cunlin
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| | - Ye Ye
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| | - Xie Nenggang
- College of Mechanical Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
- College of Management Science and Engineering, Anhui University of Technology, Maanshan, Anhui 243002, People's Republic of China
| |
Collapse
|
15
|
Avola D, Cinque L, Mambro AD, Fagioli A, Marini MR, Pannone D, Fanini B, Foresti GL. Spatio-Temporal Image-Based Encoded Atlases for EEG Emotion Recognition. Int J Neural Syst 2024; 34:2450024. [PMID: 38533631 DOI: 10.1142/s0129065724500242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2024]
Abstract
Emotion recognition plays an essential role in human-human interaction since it is a key to understanding the emotional states and reactions of human beings when they are subject to events and engagements in everyday life. Moving towards human-computer interaction, the study of emotions becomes fundamental because it is at the basis of the design of advanced systems to support a broad spectrum of application areas, including forensic, rehabilitative, educational, and many others. An effective method for discriminating emotions is based on ElectroEncephaloGraphy (EEG) data analysis, which is used as input for classification systems. Collecting brain signals on several channels and for a wide range of emotions produces cumbersome datasets that are hard to manage, transmit, and use in varied applications. In this context, the paper introduces the Empátheia system, which explores a different EEG representation by encoding EEG signals into images prior to their classification. In particular, the proposed system extracts spatio-temporal image encodings, or atlases, from EEG data through the Processing and transfeR of Interaction States and Mappings through Image-based eNcoding (PRISMIN) framework, thus obtaining a compact representation of the input signals. The atlases are then classified through the Empátheia architecture, which comprises branches based on convolutional, recurrent, and transformer models designed and tuned to capture the spatial and temporal aspects of emotions. Extensive experiments were conducted on the Shanghai Jiao Tong University (SJTU) Emotion EEG Dataset (SEED) public dataset, where the proposed system significantly reduced its size while retaining high performance. The results obtained highlight the effectiveness of the proposed approach and suggest new avenues for data representation in emotion recognition from EEG signals.
Collapse
Affiliation(s)
- Danilo Avola
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Luigi Cinque
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Angelo Di Mambro
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Alessio Fagioli
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Marco Raoul Marini
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Daniele Pannone
- Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy
| | - Bruno Fanini
- Institute of Heritage Science, National Research Council, Area della Ricerca Roma 1, SP35d, 9, Montelibretti 00010, Italy
| | - Gian Luca Foresti
- Department of Computer Science, Mathematics and Physics, University of Udine, Via delle Scienze 206, Udine 33100, Italy
| |
Collapse
|
16
|
Kang JH, Bae JH, Jeon YJ. Age-Related Characteristics of Resting-State Electroencephalographic Signals and the Corresponding Analytic Approaches: A Review. Bioengineering (Basel) 2024; 11:418. [PMID: 38790286 PMCID: PMC11118246 DOI: 10.3390/bioengineering11050418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 04/18/2024] [Accepted: 04/23/2024] [Indexed: 05/26/2024] Open
Abstract
The study of the effects of aging on neural activity in the human brain has attracted considerable attention in neurophysiological, neuropsychiatric, and neurocognitive research, as it is directly linked to an understanding of the neural mechanisms underlying the disruption of the brain structures and functions that lead to age-related pathological disorders. Electroencephalographic (EEG) signals recorded during resting-state conditions have been widely used because of the significant advantage of non-invasive signal acquisition with higher temporal resolution. These advantages include the capability of a variety of linear and nonlinear signal analyses and state-of-the-art machine-learning and deep-learning techniques. Advances in artificial intelligence (AI) can not only reveal the neural mechanisms underlying aging but also enable the assessment of brain age reliably by means of the age-related characteristics of EEG signals. This paper reviews the literature on the age-related features, available analytic methods, large-scale resting-state EEG databases, interpretations of the resulting findings, and recent advances in age-related AI models.
Collapse
Affiliation(s)
- Jae-Hwan Kang
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34054, Republic of Korea; (J.-H.K.); (J.-H.B.)
- Aging Convergence Research Center, Korea Research Institute of Bioscience and Biotechnology, Daejeon 34141, Republic of Korea
| | - Jang-Han Bae
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34054, Republic of Korea; (J.-H.K.); (J.-H.B.)
- Aging Convergence Research Center, Korea Research Institute of Bioscience and Biotechnology, Daejeon 34141, Republic of Korea
| | - Young-Ju Jeon
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon 34054, Republic of Korea; (J.-H.K.); (J.-H.B.)
- Aging Convergence Research Center, Korea Research Institute of Bioscience and Biotechnology, Daejeon 34141, Republic of Korea
| |
Collapse
|
17
|
Madni HA, Umer RM, Foresti GL. Robust Federated Learning for Heterogeneous Model and Data. Int J Neural Syst 2024; 34:2450019. [PMID: 38414421 DOI: 10.1142/s0129065724500199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/29/2024]
Abstract
Data privacy and security is an essential challenge in medical clinical settings, where individual hospital has its own sensitive patients data. Due to recent advances in decentralized machine learning in Federated Learning (FL), each hospital has its own private data and learning models to collaborate with other trusted participating hospitals. Heterogeneous data and models among different hospitals raise major challenges in robust FL, such as gradient leakage, where participants can exploit model weights to infer data. Here, we proposed a robust FL method to efficiently tackle data and model heterogeneity, where we train our model using knowledge distillation and a novel weighted client confidence score on hematological cytomorphology data in clinical settings. In the knowledge distillation, each participant learns from other participants by a weighted confidence score so that knowledge from clean models is distributed other than the noisy clients possessing noisy data. Moreover, we use symmetric loss to reduce the negative impact of data heterogeneity and label diversity by reducing overfitting the model to noisy labels. In comparison to the current approaches, our proposed method performs the best, and this is the first demonstration of addressing both data and model heterogeneity in end-to-end FL that lays the foundation for robust FL in laboratories and clinical applications.
Collapse
Affiliation(s)
- Hussain Ahmad Madni
- Department of Mathematics, Computer Science and Physics (DMIF), University of Udine, Udine 33100, Italy
| | - Rao Muhammad Umer
- Institute of AI for Health, Helmholtz Zentrum München - German Research, Center for Environmental Health, Neuherberg 85764, Germany
| | - Gian Luca Foresti
- Department of Mathematics, Computer Science and Physics (DMIF), University of Udine, Udine 33100, Italy
| |
Collapse
|
18
|
Chen L, Leng L, Yang Z, Teoh ABJ. Enhanced Multitask Learning for Hash Code Generation of Palmprint Biometrics. Int J Neural Syst 2024; 34:2450020. [PMID: 38414422 DOI: 10.1142/s0129065724500205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/29/2024]
Abstract
This paper presents a novel multitask learning framework for palmprint biometrics, which optimizes classification and hashing branches jointly. The classification branch within our framework facilitates the concurrent execution of three distinct tasks: identity recognition and classification of soft biometrics, encompassing gender and chirality. On the other hand, the hashing branch enables the generation of palmprint hash codes, optimizing for minimal storage as templates and efficient matching. The hashing branch derives the complementary information from these tasks by amalgamating knowledge acquired from the classification branch. This approach leads to superior overall performance compared to individual tasks in isolation. To enhance the effectiveness of multitask learning, two additional modules, an attention mechanism module and a customized gate control module, are introduced. These modules are vital in allocating higher weights to crucial channels and facilitating task-specific expert knowledge integration. Furthermore, an automatic weight adjustment module is incorporated to optimize the learning process further. This module fine-tunes the weights assigned to different tasks, improving performance. Integrating the three modules above has shown promising accuracies across various classification tasks and has notably improved authentication accuracy. The extensive experimental results validate the efficacy of our proposed framework.
Collapse
Affiliation(s)
- Lin Chen
- Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition, Nanchang Hangkong University, Nanchang, Jiangxi, P. R. China
| | - Lu Leng
- Key Laboratory of Jiangxi Province for Image Processing and Pattern Recognition, Nanchang Hangkong University, Nanchang, Jiangxi, P. R. China
| | - Ziyuan Yang
- College of Computer Science, Sichuan University, Chengdu, Sichuan, P. R. China
| | - Andrew Beng Jin Teoh
- School of Electrical and Electronic Engineering, College of Engineering, Yonsei University Seoul, Republic of Korea
| |
Collapse
|
19
|
Niu H, Yi Z, He T. A Bidirectional Feedforward Neural Network Architecture Using the Discretized Neural Memory Ordinary Differential Equation. Int J Neural Syst 2024; 34:2450015. [PMID: 38318709 DOI: 10.1142/s0129065724500151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Deep Feedforward Neural Networks (FNNs) with skip connections have revolutionized various image recognition tasks. In this paper, we propose a novel architecture called bidirectional FNN (BiFNN), which utilizes skip connections to aggregate features between its forward and backward paths. The BiFNN accepts any FNN as a plugin that can incorporate any general FNN model into its forward path, introducing only a few additional parameters in the cross-path connections. The backward path is implemented as a nonparameter layer, utilizing a discretized form of the neural memory Ordinary Differential Equation (nmODE), which is named [Formula: see text]-net. We provide a proof of convergence for the [Formula: see text]-net and evaluate its initial value problem. Our proposed architecture is evaluated on diverse image recognition datasets, including Fashion-MNIST, SVHN, CIFAR-10, CIFAR-100, and Tiny-ImageNet. The results demonstrate that BiFNNs offer significant improvements compared to embedded models such as ConvMixer, ResNet, ResNeXt, and Vision Transformer. Furthermore, BiFNNs can be fine-tuned to achieve comparable performance with embedded models on Tiny-ImageNet and ImageNet-1K datasets by loading the same pretrained parameters.
Collapse
Affiliation(s)
- Hao Niu
- College of Computer Science, Sichuan University, Chengdu 610065, P. R. China
| | - Zhang Yi
- College of Computer Science, Sichuan University, Chengdu 610065, P. R. China
| | - Tao He
- College of Computer Science, Sichuan University, Chengdu 610065, P. R. China
| |
Collapse
|
20
|
Aironi C, Cornell S, Squartini S. A Graph-Based Neural Approach to Linear Sum Assignment Problems. Int J Neural Syst 2024; 34:2450011. [PMID: 38231046 DOI: 10.1142/s0129065724500114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2024]
Abstract
Linear assignment problems are well-known combinatorial optimization problems involving domains such as logistics, robotics and telecommunications. In general, obtaining an optimal solution to such problems is computationally infeasible even in small settings, so heuristic algorithms are often used to find near-optimal solutions. In order to attain the right assignment permutation, this study investigates a general-purpose learning strategy that uses a bipartite graph to describe the problem structure and a message passing Graph Neural Network (GNN) model to learn the correct mapping. Comparing the proposed structure with two existing DNN solutions, simulation results show that the proposed approach significantly improves classification accuracy, proving to be very efficient in terms of processing time and memory requirements, due to its inherent parameter sharing capability. Among the many practical uses that require solving allocation problems in everyday scenarios, we decided to apply the proposed approach to address the scheduling of electric smart meters access within an electricity distribution smart grid infrastructure, since near-real-time energy monitoring is a key element of the green transition that has become increasingly important in recent times. The results obtained show that the proposed graph-based solver, although sub-optimal, exhibits the highest scalability, compared with other state-of-the-art heuristic approaches. To foster the reproducibility of the results, we made the code available at https://github.com/aircarlo/GNN_LSAP.
Collapse
Affiliation(s)
- Carlo Aironi
- Department of Information Engineering, Università Politecnica delle Marche, Italy
| | - Samuele Cornell
- Department of Information Engineering, Università Politecnica delle Marche, Italy
| | - Stefano Squartini
- Department of Information Engineering, Università Politecnica delle Marche, Italy
| |
Collapse
|
21
|
Guo Y, Liu J, Wu Y, Jiang X, Wang Y, Meng L, Liu X, Shu F, Dai C, Chen W. sEMG-Based Inter-Session Hand Gesture Recognition via Domain Adaptation with Locality Preserving and Maximum Margin. Int J Neural Syst 2024; 34:2450010. [PMID: 38369904 DOI: 10.1142/s0129065724500102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Surface electromyography (sEMG)-based gesture recognition can achieve high intra-session performance. However, the inter-session performance of gesture recognition decreases sharply due to the shift in data distribution. Therefore, developing a robust model to minimize the data distribution difference is crucial to improving the user experience. In this work, based on the inter-session gesture recognition task, we propose a novel algorithm called locality preserving and maximum margin criterion (LPMM). The LPMM algorithm integrates three main modules, including domain alignment, pseudo-label selection, and iteration result selection. Domain alignment is designed to preserve the neighborhood structure of the feature and minimize the overlap of different classes. The pseudo-label selection and iteration result selection can avoid the decrease in accuracy caused by mislabeled samples. The proposed algorithm was evaluated on two of the most widely used EMG databases. It achieves a mean accuracy of 98.46% and 71.64%, respectively, which is superior to state-of-the-art domain adaptation methods.
Collapse
Affiliation(s)
- Yao Guo
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Jiayan Liu
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Yonglin Wu
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Xinyu Jiang
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Yalin Wang
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Long Meng
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Xiangyu Liu
- College of Communication and Art Design, University of Shanghai for Science and Technology, Shanghai, P. R. China
| | - Feng Shu
- Academy for Engineering and Technology, Fudan University, Shanghai, P. R. China
| | - Chenyun Dai
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| | - Wei Chen
- School of Information Science and Technology, Fudan University, Shanghai, P. R. China
| |
Collapse
|
22
|
Zhang C, Xue Y, Neri F, Cai X, Slowik A. Multi-Objective Self-Adaptive Particle Swarm Optimization for Large-Scale Feature Selection in Classification. Int J Neural Syst 2024; 34:2450014. [PMID: 38352979 DOI: 10.1142/s012906572450014x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Feature selection (FS) is recognized for its role in enhancing the performance of learning algorithms, especially for high-dimensional datasets. In recent times, FS has been framed as a multi-objective optimization problem, leading to the application of various multi-objective evolutionary algorithms (MOEAs) to address it. However, the solution space expands exponentially with the dataset's dimensionality. Simultaneously, the extensive search space often results in numerous local optimal solutions due to a large proportion of unrelated and redundant features [H. Adeli and H. S. Park, Fully automated design of super-high-rise building structures by a hybrid ai model on a massively parallel machine, AI Mag. 17 (1996) 87-93]. Consequently, existing MOEAs struggle with local optima stagnation, particularly in large-scale multi-objective FS problems (LSMOFSPs). Different LSMOFSPs generally exhibit unique characteristics, yet most existing MOEAs rely on a single candidate solution generation strategy (CSGS), which may be less efficient for diverse LSMOFSPs [H. S. Park and H. Adeli, Distributed neural dynamics algorithms for optimization of large steel structures, J. Struct. Eng. ASCE 123 (1997) 880-888; M. Aldwaik and H. Adeli, Advances in optimization of highrise building structures, Struct. Multidiscip. Optim. 50 (2014) 899-919; E. G. González, J. R. Villar, Q. Tan, J. Sedano and C. Chira, An efficient multi-robot path planning solution using a* and coevolutionary algorithms, Integr. Comput. Aided Eng. 30 (2022) 41-52]. Moreover, selecting an appropriate MOEA and determining its corresponding parameter values for a specified LSMOFSP is time-consuming. To address these challenges, a multi-objective self-adaptive particle swarm optimization (MOSaPSO) algorithm is proposed, combined with a rapid nondominated sorting approach. MOSaPSO employs a self-adaptive mechanism, along with five modified efficient CSGSs, to generate new solutions. Experiments were conducted on ten datasets, and the results demonstrate that the number of features is effectively reduced by MOSaPSO while lowering the classification error rate. Furthermore, superior performance is observed in comparison to its counterparts on both the training and test sets, with advantages becoming increasingly evident as the dimensionality increases.
Collapse
Affiliation(s)
- Chenyi Zhang
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, P. R. China
| | - Yu Xue
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, P. R. China
| | - Ferrante Neri
- NICE Research Group, School of Computer Science and Electronic Engineering, University of Surrey Guildford, GU2 7XS, UK
| | - Xu Cai
- School of Information and Control Engineering, China University of Mining and Technology, Xuzhou, P. R. China
| | - Adam Slowik
- Department of Electronics and Computer Science, Koszalin University of Technology, Koszalin 75-453, Poland
| |
Collapse
|
23
|
Zhao R, Xie Z, Zhuang Y, L H Yu P. Automated Quality Evaluation of Large-Scale Benchmark Datasets for Vision-Language Tasks. Int J Neural Syst 2024; 34:2450009. [PMID: 38318751 DOI: 10.1142/s0129065724500096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Large-scale benchmark datasets are crucial in advancing research within the computer science communities. They enable the development of more sophisticated AI models and serve as "golden" benchmarks for evaluating their performance. Thus, ensuring the quality of these datasets is of utmost importance for academic research and the progress of AI systems. For the emerging vision-language tasks, some datasets have been created and frequently used, such as Flickr30k, COCO, and NoCaps, which typically contain a large number of images paired with their ground-truth textual descriptions. In this paper, an automatic method is proposed to assess the quality of large-scale benchmark datasets designed for vision-language tasks. In particular, a new cross-modal matching model is developed, which is capable of automatically scoring the textual descriptions of visual images. Subsequently, this model is employed to evaluate the quality of vision-language datasets by automatically assigning a score to each 'ground-truth' description for every image picture. With a good agreement between manual and automated scoring results on the datasets, our findings reveal significant disparities in the quality of the ground-truth descriptions included in the benchmark datasets. Even more surprising, it is evident that a small portion of the descriptions are unsuitable for serving as reliable ground-truth references. These discoveries emphasize the need for careful utilization of these publicly accessible benchmark databases.
Collapse
Affiliation(s)
- Ruibin Zhao
- Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR, P. R. China
- School of Computer Science and Information Engineering, Chuzhou University, Chuzhou, P. R. China
| | - Zhiwei Xie
- Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR, P. R. China
| | - Yipeng Zhuang
- Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR, P. R. China
| | - Philip L H Yu
- Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR, P. R. China
| |
Collapse
|
24
|
Mammone N, Ieracitano C, Spataro R, Guger C, Cho W, Morabito FC. A Few-Shot Transfer Learning Approach for Motion Intention Decoding from Electroencephalographic Signals. Int J Neural Syst 2024; 34:2350068. [PMID: 38073546 DOI: 10.1142/s0129065723500685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2024]
Abstract
In this study, a few-shot transfer learning approach was introduced to decode movement intention from electroencephalographic (EEG) signals, allowing to recognize new tasks with minimal adaptation. To this end, a dataset of EEG signals recorded during the preparation of complex sub-movements was created from a publicly available data collection. The dataset was divided into two parts: the source domain dataset (including 5 classes) and the support (target domain) dataset, (including 2 classes) with no overlap between the two datasets in terms of classes. The proposed methodology consists in projecting EEG signals into the space-frequency-time domain, in processing such projections (rearranged in channels × frequency frames) by means of a custom EEG-based deep neural network (denoted as EEGframeNET5), and then adapting the system to recognize new tasks through a few-shot transfer learning approach. The proposed method achieved an average accuracy of 72.45 ± 4.19% in the 5-way classification of samples from the source domain dataset, outperforming comparable studies in the literature. In the second phase of the study, a few-shot transfer learning approach was proposed to adapt the neural system and make it able to recognize new tasks in the support dataset. The results demonstrated the system's ability to adapt and recognize new tasks with an average accuracy of 80 ± 0.12% in discriminating hand opening/closing preparation and outperforming reported results in the literature. This study suggests the effectiveness of EEG in capturing information related to the motor preparation of complex movements, potentially paving the way for BCI systems based on motion planning decoding. The proposed methodology could be straightforwardly extended to advanced EEG signal processing in other scenarios, such as motor imagery or neural disorder classification.
Collapse
Affiliation(s)
- Nadia Mammone
- DICEAM, University Mediterranea of Reggio Calabria Via Zehender, Loc. Feo di Vito, Reggio Calabria, 89122, Italy
| | - Cosimo Ieracitano
- DICEAM, University Mediterranea of Reggio Calabria Via Zehender, Loc. Feo di Vito, Reggio Calabria, 89122, Italy
| | - Rossella Spataro
- ALS Clinical Research Center, BiND, University of Palermo, Palermo, Italy
- Intensive Rehabilitation Unit, Villa delle Ginestre Hospital, Palermo, Italy
| | | | - Woosang Cho
- g.tec Medical Engineering GmbH, 4521, Schiedlberg, Austria
| | - Francesco Carlo Morabito
- DICEAM, University Mediterranea of Reggio Calabria Via Zehender, Loc. Feo di Vito, Reggio Calabria, 89122, Italy
| |
Collapse
|
25
|
Ma Y, Zhang W, Du M, Jing H, Zheng N. Hierarchical Bayesian Causality Network to Extract High-Level Semantic Information in Visual Cortex. Int J Neural Syst 2024; 34:2450002. [PMID: 38084473 DOI: 10.1142/s0129065724500023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
Functional MRI (fMRI) is a brain signal with high spatial resolution, and visual cognitive processes and semantic information in the brain can be represented and obtained through fMRI. In this paper, we design single-graphic and matched/unmatched double-graphic visual stimulus experiments and collect 12 subjects' fMRI data to explore the brain's visual perception processes. In the double-graphic stimulus experiment, we focus on the high-level semantic information as "matching", and remove tail-to-tail conjunction by designing a model to screen the matching-related voxels. Then, we perform Bayesian causal learning between fMRI voxels based on the transfer entropy, establish a hierarchical Bayesian causal network (HBcausalNet) of the visual cortex, and use the model for visual stimulus image reconstruction. HBcausalNet achieves an average accuracy of 70.57% and 53.70% in single- and double-graphic stimulus image reconstruction tasks, respectively, higher than HcorrNet and HcasaulNet. The results show that the matching-related voxel screening and causality analysis method in this paper can extract the "matching" information in fMRI, obtain a direct causal relationship between matching information and fMRI, and explore the causal inference process in the brain. It suggests that our model can effectively extract high-level semantic information in brain signals and model effective connections and visual perception processes in the visual cortex of the brain.
Collapse
Affiliation(s)
- Yongqiang Ma
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, P. R. China
| | - Wen Zhang
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, P. R. China
| | - Ming Du
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, P. R. China
| | - Haodong Jing
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, P. R. China
| | - Nanning Zheng
- National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, P. R. China
| |
Collapse
|
26
|
Ganjali M, Mehridehnavi A, Rakhshani S, Khorasani A. Unsupervised Neural Manifold Alignment for Stable Decoding of Movement from Cortical Signals. Int J Neural Syst 2024; 34:2450006. [PMID: 38063378 DOI: 10.1142/s0129065724500060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
The stable decoding of movement parameters using neural activity is crucial for the success of brain-machine interfaces (BMIs). However, neural activity can be unstable over time, leading to changes in the parameters used for decoding movement, which can hinder accurate movement decoding. To tackle this issue, one approach is to transfer neural activity to a stable, low-dimensional manifold using dimensionality reduction techniques and align manifolds across sessions by maximizing correlations of the manifolds. However, the practical use of manifold stabilization techniques requires knowledge of the true subject intentions such as target direction or behavioral state. To overcome this limitation, an automatic unsupervised algorithm is proposed that determines movement target intention before manifold alignment in the presence of manifold rotation and scaling across sessions. This unsupervised algorithm is combined with a dimensionality reduction and alignment method to overcome decoder instabilities. The effectiveness of the BMI stabilizer method is represented by decoding the two-dimensional (2D) hand velocity of two rhesus macaque monkeys during a center-out-reaching movement task. The performance of the proposed method is evaluated using correlation coefficient and R-squared measures, demonstrating higher decoding performance compared to a state-of-the-art unsupervised BMI stabilizer. The results offer benefits for the automatic determination of movement intents in long-term BMI decoding. Overall, the proposed method offers a promising automatic solution for achieving stable and accurate movement decoding in BMI applications.
Collapse
Affiliation(s)
- Mohammadali Ganjali
- Department of Biomedical Engineering, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Alireza Mehridehnavi
- Department of Biomedical Engineering, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Sajed Rakhshani
- Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Abed Khorasani
- Department of Neurology, Northwestern University, Chicago, IL, 60611, USA
- Neuroscience Research Center, Institute of Neuropharmacology, Kerman University of Medical Sciences, Kerman, Iran
| |
Collapse
|
27
|
Dózsa T, Deuschle F, Cornelis B, Kovács P. Variable Projection Support Vector Machines and Some Applications Using Adaptive Hermite Expansions. Int J Neural Syst 2024; 34:2450004. [PMID: 38073547 DOI: 10.1142/s0129065724500047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
In this paper, we develop the so-called variable projection support vector machine (VP-SVM) algorithm that is a generalization of the classical SVM. In fact, the VP block serves as an automatic feature extractor to the SVM, which are trained simultaneously. We consider the primal form of the arising optimization task and investigate the use of nonlinear kernels. We show that by choosing the so-called adaptive Hermite function system as the basis of the orthogonal projections in our classification scheme, several real-world signal processing problems can be successfully solved. In particular, we test the effectiveness of our method in two case studies corresponding to anomaly detection. First, we consider the detection of abnormal peaks in accelerometer data caused by sensor malfunction. Then, we show that the proposed classification algorithm can be used to detect abnormalities in ECG data. Our experiments show that the proposed method produces comparable results to the state-of-the-art while retaining desired properties of SVM classification such as light weight architecture and interpretability. We implement the proposed method on a microcontroller and demonstrate its ability to be used for real-time applications. To further minimize computational cost, discrete orthogonal adaptive Hermite functions are introduced for the first time.
Collapse
Affiliation(s)
- Tamás Dózsa
- Department of Numerical Analysis, HUN-REN Institute for Computer Science and Control, Eötvös Loránd University, Budapest H-1111, Hungary
| | - Federico Deuschle
- Siemens Digital Industries Software, 68 Interleuvenlaan KU Leuven, Department of Mechanical Engineering, Leuven B-3001, Belgium
| | - Bram Cornelis
- Siemens Digital Industries Software, 68 Interleuvenlaan KU Leuven, Department of Mechanical Engineering, Leuven B-3001, Belgium
| | - Péter Kovács
- Department of Numerical Analysis, Eötvös Loránd University, Pázmány Péter sétány 1/C Budapest 1117, Hungary
| |
Collapse
|
28
|
Leng J, Zhu J, Yan Y, Yu X, Liu M, Lou Y, Liu Y, Gao L, Sun Y, He T, Yang Q, Feng C, Wang D, Zhang Y, Xu Q, Xu F. Multilevel Laser-Induced Pain Measurement with Wasserstein Generative Adversarial Network - Gradient Penalty Model. Int J Neural Syst 2024; 34:2350067. [PMID: 38149912 DOI: 10.1142/s0129065723500673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2023]
Abstract
Pain is an experience of unpleasant sensations and emotions associated with actual or potential tissue damage. In the global context, billions of people are affected by pain disorders. There are particular challenges in the measurement and assessment of pain, and the commonly used pain measuring tools include traditional subjective scoring methods and biomarker-based measures. The main tools for biomarker-based analysis are electroencephalography (EEG), electrocardiography and functional magnetic resonance. The EEG-based quantitative pain measurements are of immense value in clinical pain management and can provide objective assessments of pain intensity. The assessment of pain is now primarily limited to the identification of the presence or absence of pain, with less research on multilevel pain. High power laser stimulation pain experimental paradigm and five pain level classification methods based on EEG data augmentation are presented. First, the EEG features are extracted using modified S-transform, and the time-frequency information of the features is retained. Based on the pain recognition effect, the 20-40[Formula: see text]Hz frequency band features are optimized. Afterwards the Wasserstein generative adversarial network with gradient penalty is used for feature data augmentation. It can be inferred from the good classification performance of features in the parietal region of the brain that the sensory function of the parietal lobe region is effectively activated during the occurrence of pain. By comparing the latest data augmentation methods and classification algorithms, the proposed method has significant advantages for the five-level pain dataset. This research provides new ways of thinking and research methods related to pain recognition, which is essential for the study of neural mechanisms and regulatory mechanisms of pain.
Collapse
Affiliation(s)
- Jiancai Leng
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Jianqun Zhu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Yihao Yan
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Xin Yu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Ming Liu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Yitai Lou
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Yanbing Liu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Licai Gao
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Yuan Sun
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Tianzheng He
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Qingbo Yang
- School of Mathematics and Statistics, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Chao Feng
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| | - Dezheng Wang
- Rehabilitation Center, Qilu Hospital of Shandong University, Jinan 250012, P. R. China
| | - Yang Zhang
- Rehabilitation Center, Qilu Hospital of Shandong University, Jinan 250012, P. R. China
| | - Qing Xu
- Shandong Institute of Scientific and Technical Information, Jinan 250101, P. R. China
| | - Fangzhou Xu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, P. R. China
| |
Collapse
|
29
|
Villarrubia-Martin EA, Rodriguez-Benitez L, Jimenez-Linares L, Muñoz-Valero D, Liu J. A Hybrid Online Off-Policy Reinforcement Learning Agent Framework Supported by Transformers. Int J Neural Syst 2023; 33:2350065. [PMID: 37857407 DOI: 10.1142/s012906572350065x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2023]
Abstract
Reinforcement learning (RL) is a powerful technique that allows agents to learn optimal decision-making policies through interactions with an environment. However, traditional RL algorithms suffer from several limitations such as the need for large amounts of data and long-term credit assignment, i.e. the problem of determining which actions actually produce a certain reward. Recently, Transformers have shown their capacity to address these constraints in this area of learning in an offline setting. This paper proposes a framework that uses Transformers to enhance the training of online off-policy RL agents and address the challenges described above through self-attention. The proposal introduces a hybrid agent with a mixed policy that combines an online off-policy agent with an offline Transformer agent using the Decision Transformer architecture. By sequentially exchanging the experience replay buffer between the agents, the agent's learning training efficiency is improved in the first iterations and so is the training of Transformer-based RL agents in situations with limited data availability or unknown environments.
Collapse
Affiliation(s)
- Enrique Adrian Villarrubia-Martin
- Department of Technologies and Information Systems, Universidad de Castilla-La Mancha, Paseo de la Universidad 4, 13005 Ciudad Real, Spain
| | - Luis Rodriguez-Benitez
- Department of Technologies and Information Systems, Universidad de Castilla-La Mancha, Paseo de la Universidad 4, 13005 Ciudad Real, Spain
| | - Luis Jimenez-Linares
- Department of Technologies and Information Systems, Universidad de Castilla-La Mancha, Paseo de la Universidad 4, 13005 Ciudad Real, Spain
| | - David Muñoz-Valero
- Department of Technologies and Information Systems, Universidad de Castilla-La Mancha, Avenida Carlos III, s/n, 45004 Toledo, Spain
| | - Jun Liu
- School of Computing, University of Ulster, Northern Ireland, UK
| |
Collapse
|
30
|
Teran-Pineda D, Thurnhofer-Hemsi K, Domínguez E. Human Gait Activity Recognition Using Multimodal Sensors. Int J Neural Syst 2023; 33:2350058. [PMID: 37779221 DOI: 10.1142/s0129065723500582] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/03/2023]
Abstract
Human activity recognition is an application of machine learning with the aim of identifying activities from the gathered activity raw data acquired by different sensors. In medicine, human gait is commonly analyzed by doctors to detect abnormalities and determine possible treatments for the patient. Monitoring the patient's activity is paramount in evaluating the treatment's evolution. This type of classification is still not enough precise, which may lead to unfavorable reactions and responses. A novel methodology that reduces the complexity of extracting features from multimodal sensors is proposed to improve human activity classification based on accelerometer data. A sliding window technique is used to demarcate the first dominant spectral amplitude, decreasing dimensionality and improving feature extraction. In this work, we compared several state-of-art machine learning classifiers evaluated on the HuGaDB dataset and validated on our dataset. Several configurations to reduce features and training time were analyzed using multimodal sensors: all-axis spectrum, single-axis spectrum, and sensor reduction.
Collapse
Affiliation(s)
- Diego Teran-Pineda
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| | - Karl Thurnhofer-Hemsi
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| | - Enrique Domínguez
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| |
Collapse
|
31
|
You R, He F, Lin W. Decoupled Edge Guidance Network for Automatic Checkout. Int J Neural Syst 2023; 33:2350049. [PMID: 37567859 DOI: 10.1142/s0129065723500491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2023]
Abstract
Automatic checkout (ACO) aims at correctly generating complete shopping lists from checkout images. However, the domain gap between the single product in training data and multiple products in checkout images endows ACO tasks with a major difficulty. Despite remarkable advancements in recent years, resolving the significant domain gap remains challenging. It is possibly because networks trained solely on synthesized images may struggle to generalize well to realistic checkout scenarios. To this end, we propose a decoupled edge guidance network (DEGNet), which integrates synthesized and checkout images via a supervised domain adaptation approach and further learns common domain representations using a domain adapter. Specifically, an edge embedding module is designed for generating edge embedding images to introduce edge information. On this basis, we develop a decoupled feature extractor that takes original images and edge embedding images as input to jointly utilize image information and edge information. Furthermore, a novel proposal divide-and-conquer strategy (PDS) is proposed for the purpose of augmenting high-quality samples. Through experimental evaluation, DEGNet achieves state-of-the-art performance on the retail product checkout (RPC) dataset, with checkout accuracy (cAcc) results of 93.47% and 95.25% in the average mode of faster RCNN and cascade RCNN frameworks, respectively. Codes are available at https://github.com/yourbikun/DEGNet.
Collapse
Affiliation(s)
- Rongbiao You
- School of Opto-Electronic and Communication Engineering, Xiamen University of Technology, Xiamen 361024, P. R. China
| | - Fuxiong He
- School of Computer and Cyber Security, Fujian Normal University, Fuzhou 350117, P. R. China
| | - Weiming Lin
- School of Opto-Electronic and Communication Engineering, Xiamen University of Technology, Xiamen 361024, P. R. China
- Fujian Key Laboratory of Communication Network and Information Processing, Xiamen University of Technology, Xiamen 361024, P. R. China
| |
Collapse
|
32
|
Xu J, Hu L, Qiao R, Hu Y, Tian Y. Music-emotion EEG coupling effects based on representational similarity. J Neurosci Methods 2023; 398:109959. [PMID: 37661055 DOI: 10.1016/j.jneumeth.2023.109959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 08/05/2023] [Accepted: 08/30/2023] [Indexed: 09/05/2023]
Abstract
BACKGROUND Music can evoke intense emotions and music emotion is a complex cognitive process. However, we know little about the cognitive mechanisms underlying these processes, and there are significant individual differences in the emotional responses to the same musical stimuli. NEW METHOD We used the inter-subject representational similarity analysis (IS-RSA) method to investigate the shared music emotion responses across multiple participants. In addition, we extended IS-RSA to estimate the group cross-frequency coupling effects of music emotion. Based on the cross-frequency coupling IS-RSA, we analyzed the differences in cross-frequency coupling patterns under different music emotions using MI. Comparison of existing methods: most current IS-RSA analyses focus on within-frequency band analysis. However, the cognitive processing of music emotion involves not only activation and brain network connections differences within frequency bands but also information communication between frequency bands. RESULTS The results of the within-frequency band IS-RSA analysis showed that the theta and gamma frequency bands play important roles in the inter-participant consistency of music emotion. The inter-frequency band IS-RSA analysis showed that the theta-beta coupling pattern exhibited stronger inter-participant consistency compared to the theta-gamma coupling pattern, and the theta-beta coupling had significant consistent representation across various music conditions. Through the significant regions of cross-frequency coupling representation similarity analysis, we performed phase-amplitude coupling analysis on FC4-C6 and FC4-Pz connections. For the theta-beta coupling pattern, we found that the MI of these two connections exhibited different coupling patterns under different music conditions, and they showed a significant decrease compared to the baseline period.
Collapse
Affiliation(s)
- Jiayang Xu
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| | - Liangliang Hu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; West China institute of children's brain and cognition, Chongqing university of education, Chongqing 400065, China
| | - Rui Qiao
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| | - Yilin Hu
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| | - Yin Tian
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; Institute for Advanced Sciences,Chongqing University of Posts and Telecommunications, Chongqing 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China.
| |
Collapse
|
33
|
Shang B, Duan F, Fu R, Gao J, Sik H, Meng X, Chang C. EEG-based investigation of effects of mindfulness meditation training on state and trait by deep learning and traditional machine learning. Front Hum Neurosci 2023; 17:1033420. [PMID: 37719770 PMCID: PMC10500069 DOI: 10.3389/fnhum.2023.1033420] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 06/16/2023] [Indexed: 09/19/2023] Open
Abstract
Introduction This study examines the state and trait effects of short-term mindfulness-based stress reduction (MBSR) training using convolutional neural networks (CNN) based deep learning methods and traditional machine learning methods, including shallow and deep ConvNets as well as support vector machine (SVM) with features extracted from common spatial pattern (CSP) and filter bank CSP (FBCSP). Methods We investigated the electroencephalogram (EEG) measurements of 11 novice MBSR practitioners (6 males, 5 females; mean age 35.7 years; 7 Asians and 4 Caucasians) during resting and meditation at early and late training stages. The classifiers are trained and evaluated using inter-subject, mix-subject, intra-subject, and subject-transfer classification strategies, each according to a specific application scenario. Results For MBSR state effect recognition, trait effect recognition using meditation EEG, and trait effect recognition using resting EEG, from shallow ConvNet classifier we get mix-subject/intra-subject classification accuracies superior to related previous studies for both novice and expert meditators with a variety of meditation types including yoga, Tibetan, and mindfulness, whereas from FBSCP + SVM classifier we get inter-subject classification accuracies of 68.50, 85.00, and 78.96%, respectively. Conclusion Deep learning is superior for state effect recognition of novice meditators and slightly inferior but still comparable for both state and trait effects recognition of expert meditators when compared to the literatures. This study supports previous findings that short-term meditation training has EEG-recognizable state and trait effects.
Collapse
Affiliation(s)
- Baoxiang Shang
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
- Department of Neurosurgery, Shenzhen University General Hospital, Shenzhen University, Shenzhen, China
| | - Feiyan Duan
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
- Deepbay Innovation Technology Corporation Ltd., Shenzhen, China
| | - Ruiqi Fu
- Shenzhen Key Laboratory of Smart Healthcare Engineering, Southern University of Science and Technology, Shenzhen, China
| | - Junling Gao
- Buddhist Practice and Counselling Science Lab, Centre of Buddhist Studies, The University of Hong Kong, Hong Kong, Hong Kong SAR, China
| | - Hinhung Sik
- Buddhist Practice and Counselling Science Lab, Centre of Buddhist Studies, The University of Hong Kong, Hong Kong, Hong Kong SAR, China
| | - Xianghong Meng
- Department of Neurosurgery, Shenzhen University General Hospital, Shenzhen University, Shenzhen, China
| | - Chunqi Chang
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
| |
Collapse
|