1
|
Maleki Varnosfaderani S, Forouzanfar M. The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century. Bioengineering (Basel) 2024; 11:337. [PMID: 38671759 PMCID: PMC11047988 DOI: 10.3390/bioengineering11040337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 03/25/2024] [Accepted: 03/26/2024] [Indexed: 04/28/2024] Open
Abstract
As healthcare systems around the world face challenges such as escalating costs, limited access, and growing demand for personalized care, artificial intelligence (AI) is emerging as a key force for transformation. This review is motivated by the urgent need to harness AI's potential to mitigate these issues and aims to critically assess AI's integration in different healthcare domains. We explore how AI empowers clinical decision-making, optimizes hospital operation and management, refines medical image analysis, and revolutionizes patient care and monitoring through AI-powered wearables. Through several case studies, we review how AI has transformed specific healthcare domains and discuss the remaining challenges and possible solutions. Additionally, we will discuss methodologies for assessing AI healthcare solutions, ethical challenges of AI deployment, and the importance of data privacy and bias mitigation for responsible technology use. By presenting a critical assessment of AI's transformative potential, this review equips researchers with a deeper understanding of AI's current and future impact on healthcare. It encourages an interdisciplinary dialogue between researchers, clinicians, and technologists to navigate the complexities of AI implementation, fostering the development of AI-driven solutions that prioritize ethical standards, equity, and a patient-centered approach.
Collapse
Affiliation(s)
| | - Mohamad Forouzanfar
- Département de Génie des Systèmes, École de Technologie Supérieure (ÉTS), Université du Québec, Montréal, QC H3C 1K3, Canada
- Centre de Recherche de L’institut Universitaire de Gériatrie de Montréal (CRIUGM), Montréal, QC H3W 1W5, Canada
| |
Collapse
|
2
|
Mallick S, Baths V. Novel deep learning framework for detection of epileptic seizures using EEG signals. Front Comput Neurosci 2024; 18:1340251. [PMID: 38590939 PMCID: PMC11000706 DOI: 10.3389/fncom.2024.1340251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 03/04/2024] [Indexed: 04/10/2024] Open
Abstract
Introduction Epilepsy is a chronic neurological disorder characterized by abnormal electrical activity in the brain, often leading to recurrent seizures. With 50 million people worldwide affected by epilepsy, there is a pressing need for efficient and accurate methods to detect and diagnose seizures. Electroencephalogram (EEG) signals have emerged as a valuable tool in detecting epilepsy and other neurological disorders. Traditionally, the process of analyzing EEG signals for seizure detection has relied on manual inspection by experts, which is time-consuming, labor-intensive, and susceptible to human error. To address these limitations, researchers have turned to machine learning and deep learning techniques to automate the seizure detection process. Methods In this work, we propose a novel method for epileptic seizure detection, leveraging the power of 1-D Convolutional layers in combination with Bidirectional Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) and Average pooling Layer as a single unit. This unit is repeatedly used in the proposed model to extract the features. The features are then passed to the Dense layers to predict the class of the EEG waveform. The performance of the proposed model is verified on the Bonn dataset. To assess the robustness and generalizability of our proposed architecture, we employ five-fold cross-validation. By dividing the dataset into five subsets and iteratively training and testing the model on different combinations of these subsets, we obtain robust performance measures, including accuracy, sensitivity, and specificity. Results Our proposed model achieves an accuracy of 99-100% for binary classifications into seizure and normal waveforms, 97.2%-99.2% accuracy for classifications into normal-interictal-seizure waveforms, 96.2%-98.4% accuracy for four class classification and accuracy of 95.81%-98% for five class classification. Discussion Our proposed models have achieved significant improvements in the performance metrics for the binary classifications and multiclass classifications. We demonstrate the effectiveness of the proposed architecture in accurately detecting epileptic seizures from EEG signals by using EEG signals of varying lengths. The results indicate its potential as a reliable and efficient tool for automated seizure detection, paving the way for improved diagnosis and management of epilepsy.
Collapse
Affiliation(s)
- Sayani Mallick
- Cognitive Neuroscience Laboratory, Department of Electrical and Electronics Engineering, BITS Pilani, KK Birla Goa Campus, Pilani, Goa, India
| | - Veeky Baths
- Cognitive Neuroscience Laboratory, Department of Biological Sciences, BITS Pilani, KK Birla Goa Campus, Pilani, Goa, India
| |
Collapse
|
3
|
Lan Z, Lempereur M, Gueret G, Houx L, Cacioppo M, Pons C, Mensah J, Rémy-Néris O, Aïssa-El-Bey A, Rousseau F, Brochard S. Towards a diagnostic tool for neurological gait disorders in childhood combining 3D gait kinematics and deep learning. Comput Biol Med 2024; 171:108095. [PMID: 38350399 DOI: 10.1016/j.compbiomed.2024.108095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 01/31/2024] [Accepted: 02/01/2024] [Indexed: 02/15/2024]
Abstract
Gait abnormalities are frequent in children and can be caused by different pathologies, such as cerebral palsy, neuromuscular disease, toe walker syndrome, etc. Analysis of the "gait pattern" (i.e., the way the person walks) using 3D analysis provides highly relevant clinical information. This information is used to guide therapeutic choices; however, it is underused in diagnostic processes, probably because of the lack of standardization of data collection methods. Therefore, 3D gait analysis is currently used as an assessment rather than a diagnostic tool. In this work, we aimed to determine if deep learning could be combined with 3D gait analysis data to diagnose gait disorders in children. We tested the diagnostic accuracy of deep learning methods combined with 3D gait analysis data from 371 children (148 with unilateral cerebral palsy, 60 with neuromuscular disease, 19 toe walkers, 60 with bilateral cerebral palsy, 25 stroke, and 59 typically developing children), with a total of 6400 gait cycles. We evaluated the accuracy, sensitivity, specificity, F1 score, Area Under the Curve (AUC) score, and confusion matrix of the predictions by ResNet, LSTM, and InceptionTime deep learning architectures for time series data. The deep learning-based models had good to excellent diagnostic accuracy (ranging from 0.77 to 0.99) for discrimination between healthy and pathological gait, discrimination between different etiologies of pathological gait (binary and multi-classification); and determining stroke onset time. LSTM performed best overall. This study revealed that the gait pattern contains specific, pathology-related information. These results open the way for an extension of 3D gait analysis from evaluation to diagnosis. Furthermore, the method we propose is a data-driven diagnostic model that can be trained and used without human intervention or expert knowledge. Furthermore, the method could be used to distinguish gait-related pathologies and their onset times beyond those studied in this research.
Collapse
Affiliation(s)
- Zhengyang Lan
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; IMT Atlantique, LaTIM U1101 INSERM, Brest, France
| | - Mathieu Lempereur
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France.
| | - Gwenael Gueret
- CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France
| | - Laetitia Houx
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France; Fondation Ildys, Brest, France
| | - Marine Cacioppo
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France
| | - Christelle Pons
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France; Fondation Ildys, Brest, France
| | - Johanne Mensah
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France; Fondation Ildys, Brest, France
| | - Olivier Rémy-Néris
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France
| | | | - François Rousseau
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; IMT Atlantique, LaTIM U1101 INSERM, Brest, France
| | - Sylvain Brochard
- Laboratoire de Traitement de l'Information Médicale INSERM U1101, Brest, France; Université de Bretagne Occidentale, Brest, France; CHU de Brest, Hôpital Morvan, service de médecine physique et de réadaptation, Brest, France; Fondation Ildys, Brest, France
| |
Collapse
|
4
|
Hernández-Nava G, Salazar-Colores S, Cabal-Yepez E, Ramos-Arreguín JM. Parallel Ictal-Net, a Parallel CNN Architecture with Efficient Channel Attention for Seizure Detection. SENSORS (BASEL, SWITZERLAND) 2024; 24:716. [PMID: 38339433 PMCID: PMC10856983 DOI: 10.3390/s24030716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 12/28/2023] [Accepted: 12/29/2023] [Indexed: 02/12/2024]
Abstract
Around 70 million people worldwide are affected by epilepsy, a neurological disorder characterized by non-induced seizures that occur at irregular and unpredictable intervals. During an epileptic seizure, transient symptoms emerge as a result of extreme abnormal neural activity. Epilepsy imposes limitations on individuals and has a significant impact on the lives of their families. Therefore, the development of reliable diagnostic tools for the early detection of this condition is considered beneficial to alleviate the social and emotional distress experienced by patients. While the Bonn University dataset contains five collections of EEG data, not many studies specifically focus on subsets D and E. These subsets correspond to EEG recordings from the epileptogenic zone during ictal and interictal events. In this work, the parallel ictal-net (PIN) neural network architecture is introduced, which utilizes scalograms obtained through a continuous wavelet transform to achieve the high-accuracy classification of EEG signals into ictal or interictal states. The results obtained demonstrate the effectiveness of the proposed PIN model in distinguishing between ictal and interictal events with a high degree of confidence. This is validated by the computing accuracy, precision, recall, and F1 scores, all of which consistently achieve around 99% confidence, surpassing previous approaches in the related literature.
Collapse
Affiliation(s)
- Gerardo Hernández-Nava
- Faculty of Engineering, Autonomous University of Querétaro, Queretaro 76140, Mexico; (G.H.-N.); (J.-M.R.-A.)
| | | | - Eduardo Cabal-Yepez
- Multidisciplinary Studies Department, Campus Yuriria, University of Guanajuato, Guanajuato 38954, Mexico;
| | - Juan-Manuel Ramos-Arreguín
- Faculty of Engineering, Autonomous University of Querétaro, Queretaro 76140, Mexico; (G.H.-N.); (J.-M.R.-A.)
| |
Collapse
|
5
|
Kaplan E, Chan WY, Altinsoy HB, Baygin M, Barua PD, Chakraborty S, Dogan S, Tuncer T, Acharya UR. PFP-HOG: Pyramid and Fixed-Size Patch-Based HOG Technique for Automated Brain Abnormality Classification with MRI. J Digit Imaging 2023; 36:2441-2460. [PMID: 37537514 PMCID: PMC10584767 DOI: 10.1007/s10278-023-00889-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 07/18/2023] [Accepted: 07/24/2023] [Indexed: 08/05/2023] Open
Abstract
Detecting neurological abnormalities such as brain tumors and Alzheimer's disease (AD) using magnetic resonance imaging (MRI) images is an important research topic in the literature. Numerous machine learning models have been used to detect brain abnormalities accurately. This study addresses the problem of detecting neurological abnormalities in MRI. The motivation behind this problem lies in the need for accurate and efficient methods to assist neurologists in the diagnosis of these disorders. In addition, many deep learning techniques have been applied to MRI to develop accurate brain abnormality detection models, but these networks have high time complexity. Hence, a novel hand-modeled feature-based learning network is presented to reduce the time complexity and obtain high classification performance. The model proposed in this work uses a new feature generation architecture named pyramid and fixed-size patch (PFP). The main aim of the proposed PFP structure is to attain high classification performance using essential feature extractors with both multilevel and local features. Furthermore, the PFP feature extractor generates low- and high-level features using a handcrafted extractor. To obtain the high discriminative feature extraction ability of the PFP, we have used histogram-oriented gradients (HOG); hence, it is named PFP-HOG. Furthermore, the iterative Chi2 (IChi2) is utilized to choose the clinically significant features. Finally, the k-nearest neighbors (kNN) with tenfold cross-validation is used for automated classification. Four MRI neurological databases (AD dataset, brain tumor dataset 1, brain tumor dataset 2, and merged dataset) have been utilized to develop our model. PFP-HOG and IChi2-based models attained 100%, 94.98%, 98.19%, and 97.80% using the AD dataset, brain tumor dataset1, brain tumor dataset 2, and merged brain MRI dataset, respectively. These findings not only provide an accurate and robust classification of various neurological disorders using MRI but also hold the potential to assist neurologists in validating manual MRI brain abnormality screening.
Collapse
Affiliation(s)
- Ela Kaplan
- Department of Radiology, Elazig Fethi Sekin City Hospital, Elazig, Turkey
| | - Wai Yee Chan
- Imaging Department, Gleneagles Hospital Kuala Lumpur, Jalan Ampang, Kampung Berembang, 50450, Kuala Lumpur, Wilayah Persekutuan Kuala Lumpur, Malaysia
| | - Hasan Baki Altinsoy
- Department of Radiology, Faculty of Medicine, Duzce University, Duzce, Turkey
| | - Mehmet Baygin
- Department of Computer Engineering, College of Engineering, Erzurum Technical University, Erzurum, Turkey
| | - Prabal Datta Barua
- School of Business (Information System), University of Southern Queensland, Springfield, Australia
| | - Subrata Chakraborty
- Faculty of Science, Agriculture, Business and Law, School of Science and Technology, University of New England, Armidale, NSW, 2351, Australia
- Center for Advanced Modelling and Geospatial Information Systems, Faculty of Engineering and IT, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Sengul Dogan
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey.
| | - Turker Tuncer
- Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia
| |
Collapse
|
6
|
Pre-processed and combined EEG data for epileptic seizure classification using deep learning. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/13/2023]
|
7
|
Naku W, Nambisan AK, Roman M, Zhu C, Gerald RE, Huang J. Identification of Volatile Organic Liquids by Combining an Array of Fiber-Optic Sensors and Machine Learning. ACS OMEGA 2023; 8:4597-4607. [PMID: 36777572 PMCID: PMC9909791 DOI: 10.1021/acsomega.2c05451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 01/17/2023] [Indexed: 06/18/2023]
Abstract
In this paper, we report an array of fiber-optic sensors based on the Fabry-Perot interference principle and machine learning-based analyses for identifying volatile organic liquids (VOLs). Three optical fiber tip sensors with different surfaces were included in the array of sensors to improve the accuracy for identifying liquids: an intrinsic (unmodified) flat cleaved endface, a hydrophobic-coated endface, and a hydrophilic-coated endface. The time-transient responses of evaporating droplets from the optical fiber tip sensors were monitored and collected following the controlled immersion tests of 11 different organic liquids. A continuous wavelet transform was used to convert the time-transient response signal into images. These images were then utilized to train convolution neural networks for classification (identification of VOLs). We show that diversity in the information collected using the array of three sensors helps machine learning-based methods perform significantly better. We explore different pipelines for combining the information from the array of sensors within a machine learning framework and their effect on the robustness of models. The results showed that the machine learning-based methods achieved high accuracy in their classification of different liquids based on their droplet evaporation time-transient events.
Collapse
Affiliation(s)
- Wassana Naku
- Department
of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri 65409, United States
| | - Anand K. Nambisan
- Department
of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri 65409, United States
| | - Muhammad Roman
- Department
of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri 65409, United States
| | - Chen Zhu
- Research
Center for Optical Fiber Sensing, Zhejiang Laboratory, Hangzhou 311100, China
| | - Rex E. Gerald
- Department
of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri 65409, United States
| | - Jie Huang
- Department
of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, Missouri 65409, United States
| |
Collapse
|
8
|
Shibu CJ, Sreedharan S, Arun KM, Kesavadas C, Sitaram R. Explainable artificial intelligence model to predict brain states from fNIRS signals. Front Hum Neurosci 2023; 16:1029784. [PMID: 36741783 PMCID: PMC9892761 DOI: 10.3389/fnhum.2022.1029784] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Accepted: 11/21/2022] [Indexed: 01/20/2023] Open
Abstract
Objective: Most Deep Learning (DL) methods for the classification of functional Near-Infrared Spectroscopy (fNIRS) signals do so without explaining which features contribute to the classification of a task or imagery. An explainable artificial intelligence (xAI) system that can decompose the Deep Learning mode's output onto the input variables for fNIRS signals is described here. Approach: We propose an xAI-fNIRS system that consists of a classification module and an explanation module. The classification module consists of two separately trained sliding window-based classifiers, namely, (i) 1-D Convolutional Neural Network (CNN); and (ii) Long Short-Term Memory (LSTM). The explanation module uses SHAP (SHapley Additive exPlanations) to explain the CNN model's output in terms of the model's input. Main results: We observed that the classification module was able to classify two types of datasets: (a) Motor task (MT), acquired from three subjects; and (b) Motor imagery (MI), acquired from 29 subjects, with an accuracy of over 96% for both CNN and LSTM models. The explanation module was able to identify the channels contributing the most to the classification of MI or MT and therefore identify the channel locations and whether they correspond to oxy- or deoxy-hemoglobin levels in those locations. Significance: The xAI-fNIRS system can distinguish between the brain states related to overt and covert motor imagery from fNIRS signals with high classification accuracy and is able to explain the signal features that discriminate between the brain states of interest.
Collapse
Affiliation(s)
- Caleb Jones Shibu
- Department of Computer Science, University of Arizona, Tucson, AZ, United States
| | - Sujesh Sreedharan
- Division of Artificial Internal Organs, Department of Medical Devices Engineering, Biomedical Technology Wing, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Trivandrum, India
| | - KM Arun
- Department of Imaging Sciences and Interventional Radiology, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Trivandrum, India
| | - Chandrasekharan Kesavadas
- Department of Imaging Sciences and Interventional Radiology, Sree Chitra Tirunal Institute for Medical Sciences and Technology, Trivandrum, India
| | - Ranganatha Sitaram
- Department of Diagnostic Imaging, St. Jude Children’s Research Hospital, Memphis, TN, United States
| |
Collapse
|
9
|
Natheir S, Christie S, Yilmaz R, Winkler-Schwartz A, Bajunaid K, Sabbagh AJ, Werthner P, Fares J, Azarnoush H, Del Maestro R. Utilizing artificial intelligence and electroencephalography to assess expertise on a simulated neurosurgical task. Comput Biol Med 2023; 152:106286. [PMID: 36502696 DOI: 10.1016/j.compbiomed.2022.106286] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 10/18/2022] [Accepted: 10/25/2022] [Indexed: 11/17/2022]
Abstract
Virtual reality surgical simulators have facilitated surgical education by providing a safe training environment. Electroencephalography (EEG) has been employed to assess neuroelectric activity during surgical performance. Machine learning (ML) has been applied to analyze EEG data split into frequency bands. Although EEG is widely used in fields requiring expert performance, it has yet been used to classify surgical expertise. Thus, the goals of this study were to (a) develop an ML model to accurately differentiate skilled and less-skilled performance using EEG data recorded during a simulated surgery, (b) explore the relative importance of each EEG bandwidth to expertise, and (c) analyze differences in EEG band powers between skilled and less-skilled individuals. We hypothesized that EEG recordings during a virtual reality surgery task would accurately predict the expertise level of the participant. Twenty-one participants performed three simulated brain tumor resection procedures on the NeuroVR™ platform (CAE Healthcare, Montreal, Canada) while EEG data was recorded. Participants were divided into 2 groups. The skilled group was composed of five neurosurgeons and five senior neurosurgical residents (PGY4-6), and the less-skilled group was composed of six junior residents (PGY1-3) and five medical students. A total of 13 metrics from EEG frequency bands and ratios (e.g., alpha, theta/beta ratio) were generated. Seven ML model types were trained using EEG activity to differentiate between skilled and less-skilled groups. The artificial neural network achieved the highest testing accuracy of 100% (AUROC = 1.0). Model interpretation via Shapley analysis identified low alpha (8-10 Hz) as the most important metric for classifying expertise. Skilled surgeons displayed higher (p = 0.044) low-alpha than the less-skilled group. Furthermore, skilled surgeons displayed significantly lower TBR (p = 0.048) and significantly higher beta (13-30 Hz, p = 0.049), beta 1 (15-18 Hz, p = 0.014), and beta 2 (19-22 Hz, p = 0.015), thus establishing these metrics as important markers of expertise. ACGME CORE COMPETENCIES: Practice-Based Learning and Improvement.
Collapse
Affiliation(s)
- Sharif Natheir
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada.
| | - Sommer Christie
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Khalid Bajunaid
- Department of Surgery, College of Medicine, University of Jeddah, Jeddah, Saudi Arabia
| | - Abdulrahman J Sabbagh
- Division of Neurosurgery, Department of Surgery, College of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia; Clinical Skills and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Penny Werthner
- University of Calgary, Faculty of Kinesiology, Calgary, Alberta, Canada
| | - Jawad Fares
- Department of Neurological Surgery Feinberg School of Medicine, Northwestern University Chicago, Illinois, USA
| | - Hamed Azarnoush
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Rolando Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
10
|
RNN and BiLSTM Fusion for Accurate Automatic Epileptic Seizure Diagnosis Using EEG Signals. LIFE (BASEL, SWITZERLAND) 2022; 12:life12121946. [PMID: 36556313 PMCID: PMC9784456 DOI: 10.3390/life12121946] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 11/17/2022] [Accepted: 11/18/2022] [Indexed: 11/24/2022]
Abstract
Epilepsy is a common neurological condition. The effects of epilepsy are not restricted to seizures alone. They comprise a wide spectrum of problems that might impair and reduce quality of life. Even with medication, 30% of epilepsy patients still have recurring seizures. An epileptic seizure is caused by significant neuronal electrical activity, which affects brain activity. EEG shows these changes as high-amplitude spiky and sluggish waves. Recognizing seizures on an electroencephalogram (EEG) manually by a professional neurologist is a time-consuming and labor-intensive process, hence an efficient automated approach is necessary for the identification of epileptic seizure. One technique to increase the speed and accuracy with which a diagnosis of epileptic seizures could be made is by utilizing computer-aided diagnosis systems that are built on deep neural networks, or DNN. This study introduces a fusion of recurrent neural networks (RNNs) and bi-directional long short-term memories (BiLSTMs) for automatic epileptic seizure identification via EEG signal processing in order to tackle the aforementioned informational challenges. An electroencephalogram's (EEG) raw data were first normalized after undergoing pre-processing. A RNN model was fed the normalized EEG sequence data and trained to accurately extract features from the data. Afterwards, the features were passed to the BiLSTM layers for processing so that further temporal information could be retrieved. In addition, the proposed RNN-BiLSTM model was tested in an experimental setting using the freely accessible UCI epileptic seizure dataset. Experimental findings of the suggested model have achieved avg values of 98.90%, 98.50%, 98. 20%, and 98.60%, respectively, for accuracy, sensitivity, precision, and specificity. To further verify the new model's efficacy, it is compared to other models, such as the RNN-LSTM and the RNN-GRU learning models, and is shown to have improved the same metrics by 1.8%, 1.69%, 1.95%, and 2.2% on using 5-fold. Additionally, the proposed method was compared to state-of-the-art approaches and proved to be a more accurate categorization of such techniques.
Collapse
|
11
|
Cizmeci H, Ozcan C, Durgut R. Channel selection and feature extraction on deep EEG classification using metaheuristic and Welch PSD. Soft comput 2022. [DOI: 10.1007/s00500-022-07413-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
12
|
Karunakar Reddy V, Kumar AV R. Multi-channel neuro signal classification using Adam-based coyote optimization enabled deep belief network. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
13
|
Ai Q, Zhao M, Chen K, Zhao X, Ma L, Liu Q. Flexible coding scheme for robotic arm control driven by motor imagery decoding. J Neural Eng 2022; 19. [PMID: 35896097 DOI: 10.1088/1741-2552/ac84a9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Accepted: 07/27/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Brain computer interface (BCI) technology is a new way of information exchange, which can effectively convert physiological signals into control instructions of machines. Due to its spontaneity and device-independence, motor imagery (MI) electroencephalography (EEG) signal is used as a common BCI signal source to achieve direct control of external devices. However, the generalization ability of current classification model of MI tasks is still limited. Moreover, the real time prototype is far from established in practice. APPROACH In order to solve these problems, this paper proposed an optimized neural network architecture based on our previous work. Firstly, the artifact components in MI-EEG signal are removed by using the threshold and threshold function related to the artifact removal evaluation index, and then the data is augmented by the empirical mode decomposition (EMD) algorithm. Furthermore, ensemble learning (EL) method and fine-tuning strategy in transfer learning (TL) are used to optimize the classification model. Finally, combined with the flexible binary encoding strategy, the EEG signal recognition results are mapped to the control commands of the robotic arm, which realizes the multiple degree of freedom control of the robotic arm. MAIN RESULTS The results show that EMD has an obvious data amount enhancement effect on small dataset, and the EL and TL can improve intra-subject and inter-subject model evaluation performance, respectively. The use of binary coding method realizes the expansion of control instructions, i.e., four kinds of MI-EEG signals are used to complete the control of 7 degrees of freedom of the robotic arm. SIGNIFICANCE Our work not only improves the classification accuracy of subject and the generality of classification model, but also extends the BCI control instruction set.
Collapse
Affiliation(s)
- Qingsong Ai
- School of Information Engineering, Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, Wuhan, Hubei, 430070, CHINA
| | - Mengyuan Zhao
- School of Information Engineering, Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, Wuhan, Hubei, 430070, CHINA
| | - Kun Chen
- School of Information Engineering, Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, Wuhan, Hubei, 430070, CHINA
| | - Xuefei Zhao
- Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, Wuhan, Hubei, 430070, CHINA
| | - Li Ma
- Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, 430070, CHINA
| | - Quan Liu
- School of Information Engineering, Wuhan University of Technology, No.122,Luoshi Road, Hongshan District, Wuhan, Hubei, 430070, CHINA
| |
Collapse
|
14
|
Effect of time windows in LSTM networks for EEG-based BCIs. Cogn Neurodyn 2022; 17:385-398. [PMID: 37007196 PMCID: PMC10050242 DOI: 10.1007/s11571-022-09832-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 05/26/2022] [Accepted: 06/04/2022] [Indexed: 11/03/2022] Open
Abstract
AbstractPeople with impaired motor function could be helped by an effective brain–computer interface (BCI) based on a real-time electroencephalogram (EEG) and artificial intelligence algorithms. However, current methodologies for interpreting patient instructions from an EEG are not accurate enough to be completely safe in a real-world situation , where a poor decision would place their physical integrity at risk, such as when traveling in an electric wheelchair in a city. For various reasons, such as the low signal-to-noise ratio of portable EEGs or the effects of signal contamination (disturbances due to user movement, temporal variation of the features of EEG signals, etc.), a long short-term memory network (LSTM) (a type of recurrent neural network) that is able to learn data flow patterns from EEG signals could improve the classification of the actions taken by the user. In this paper, the effectiveness of using an LSTM with a low-cost wireless EEG device in real time is tested, and the time window that maximizes its classification accuracy is studied. The goal is to be able to implement it in the BCI of a smart wheelchair with a simple coded command protocol, such as opening or closing the eyes, which could be executed by patients with reduced mobility. Results show a higher resolution of the LSTM with an accuracy range between 77.61 and 92.14% compared to traditional classifiers (59.71%), and an optimal time window of around 7 s for the task done by users in this work. In addition, tests in real-life contexts show that a trade-off between accuracy and response times is necessary to ensure detection.
Collapse
|
15
|
Wang Z, Ma Z, Liu W, An Z, Huang F. A Depression Diagnosis Method Based on the Hybrid Neural Network and Attention Mechanism. Brain Sci 2022; 12:834. [PMID: 35884641 PMCID: PMC9313113 DOI: 10.3390/brainsci12070834] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 06/23/2022] [Accepted: 06/24/2022] [Indexed: 02/01/2023] Open
Abstract
Depression is a common but easily misdiagnosed disease when using a self-assessment scale. Electroencephalograms (EEGs) provide an important reference and objective basis for the identification and diagnosis of depression. In order to improve the accuracy of the diagnosis of depression by using mainstream algorithms, a high-performance hybrid neural network depression detection method is proposed in this paper combined with deep learning technology. Firstly, a concatenating one-dimensional convolutional neural network (1D-CNN) and gated recurrent unit (GRU) are employed to extract the local features and to determine the global features of the EEG signal. Secondly, the attention mechanism is introduced to form the hybrid neural network. The attention mechanism assigns different weights to the multi-dimensional features extracted by the network, so as to screen out more representative features, which can reduce the computational complexity of the network and save the training time of the model while ensuring high precision. Moreover, dropout is applied to accelerate network training and address the over-fitting problem. Experiments reveal that the 1D-CNN-GRU-ATTN model has more effectiveness and a better generalization ability compared with traditional algorithms. The accuracy of the proposed method in this paper reaches 99.33% in a public dataset and 97.98% in a private dataset, respectively.
Collapse
Affiliation(s)
- Zhuozheng Wang
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Z.M.); (W.L.)
| | - Zhuo Ma
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Z.M.); (W.L.)
| | - Wei Liu
- Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; (Z.M.); (W.L.)
| | - Zhefeng An
- Advising Center for Student Development, Beijing University of Technology, Beijing 100124, China;
| | - Fubiao Huang
- Department of Occupational Therapy, China Rehabilitation Research Center, Beijing 100068, China;
| |
Collapse
|
16
|
CS-RNN: efficient training of recurrent neural networks with continuous skips. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07227-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
17
|
Phutela N, Relan D, Gabrani G, Kumaraguru P, Samuel M. Stress Classification Using Brain Signals Based on LSTM Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7607592. [PMID: 35528348 PMCID: PMC9071939 DOI: 10.1155/2022/7607592] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 02/14/2022] [Accepted: 02/28/2022] [Indexed: 12/17/2022]
Abstract
The early diagnosis of stress symptoms is essential for preventing various mental disorder such as depression. Electroencephalography (EEG) signals are frequently employed in stress detection research and are both inexpensive and noninvasive modality. This paper proposes a stress classification system by utilizing an EEG signal. EEG signals from thirty-five volunteers were analysed which were acquired using four EEG sensors using a commercially available 4-electrode Muse EEG headband. Four movie clips were chosen as stress elicitation material. Two clips were selected to induce stress as it contains emotionally inductive scenes. The other two clips were chosen that do not induce stress as it has many comedy scenes. The recorded signals were then used to build the stress classification model. We compared the Multilayer Perceptron (MLP) and Long Short-Term Memory (LSTM) for classifying stress and nonstress group. The maximum classification accuracy of 93.17% was achieved using two-layer LSTM architecture.
Collapse
Affiliation(s)
- Nishtha Phutela
- Department of Computer Science and Engineering, BML Munjal University, Gurugram, India
| | - Devanjali Relan
- Department of Computer Science and Engineering, BML Munjal University, Gurugram, India
| | - Goldie Gabrani
- College of Engineering, Vivekananda Institute of Professional Studies Technical Campus, New Delhi, India
| | - Ponnurangam Kumaraguru
- Department of Computer Science, International Institute of Information Technology, Hyderabad, India
| | - Mesay Samuel
- Computing and Software Engineering, Arba Minch University, Arba Minch, Ethiopia
| |
Collapse
|
18
|
Deep Learning-Based Approach for Emotion Recognition Using Electroencephalography (EEG) Signals Using Bi-Directional Long Short-Term Memory (Bi-LSTM). SENSORS 2022; 22:s22082976. [PMID: 35458962 PMCID: PMC9033053 DOI: 10.3390/s22082976] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/30/2022] [Accepted: 03/31/2022] [Indexed: 01/28/2023]
Abstract
Emotions are an essential part of daily human communication. The emotional states and dynamics of the brain can be linked by electroencephalography (EEG) signals that can be used by the Brain–Computer Interface (BCI), to provide better human–machine interactions. Several studies have been conducted in the field of emotion recognition. However, one of the most important issues facing the emotion recognition process, using EEG signals, is the accuracy of recognition. This paper proposes a deep learning-based approach for emotion recognition through EEG signals, which includes data selection, feature extraction, feature selection and classification phases. This research serves the medical field, as the emotion recognition model helps diagnose psychological and behavioral disorders. The research contributes to improving the performance of the emotion recognition model to obtain more accurate results, which, in turn, aids in making the correct medical decisions. A standard pre-processed Database of Emotion Analysis using Physiological signaling (DEAP) was used in this work. The statistical features, wavelet features, and Hurst exponent were extracted from the dataset. The feature selection task was implemented through the Binary Gray Wolf Optimizer. At the classification stage, the stacked bi-directional Long Short-Term Memory (Bi-LSTM) Model was used to recognize human emotions. In this paper, emotions are classified into three main classes: arousal, valence and liking. The proposed approach achieved high accuracy compared to the methods used in past studies, with an average accuracy of 99.45%, 96.87% and 99.68% of valence, arousal, and liking, respectively, which is considered a high performance for the emotion recognition model.
Collapse
|
19
|
Utilization of Unsupervised Machine Learning for Detection of Duct Voids inside PSC Box Girder Bridges. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12031270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
The PSC box girder bridge is a pre-stressed box girder bridge that accounts for a considerable part of large-scale bridges. However, when concrete is poured, even small mistakes might result in voids that appear during long-term maintenance. In this paper, we present a technique for detecting the void in the duct inside the PSC box girder bridge. Data are acquired utilizing the non-destructive impact-echo (IE) approach to detect these voids. IE creates time-series data as signal data initially; however, we want to use a CNN auto-encoder (AE). A scalogram, which is a kind of wavelet transformation, is used to convert time series data into an image. An AE is a type of unsupervised learning that aims to minimize the difference between the input and output. By comparing histograms, the difference is calculated. To begin, we create scalogram images from all IE signal data, which were randomly sampled as 98% normal and 2% void. The CNN AE is then trained and evaluated utilizing all the data. Finally, we examine the input and output histogram similarity distributions. As a consequence, only 4% of the normal data had a similarity of less than two standard deviations from the mean, whereas 34.7% of the void data did. As a result, the existence of voids inside the PSC duct could be demonstrated to be predictive in the absence of annotated data.
Collapse
|
20
|
Cherian R, Kanaga EG. Theoretical and Methodological Analysis of EEG based Seizure Detection and Prediction: An Exhaustive Review. J Neurosci Methods 2022; 369:109483. [DOI: 10.1016/j.jneumeth.2022.109483] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 01/13/2022] [Accepted: 01/13/2022] [Indexed: 02/07/2023]
|
21
|
Prognosis of automated sleep staging based on two-layer ensemble learning stacking model using single-channel EEG signal. Soft comput 2021. [DOI: 10.1007/s00500-021-06218-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
22
|
Artificial Intelligence and Its Application to Minimal Hepatic Encephalopathy Diagnosis. J Pers Med 2021; 11:jpm11111090. [PMID: 34834442 PMCID: PMC8626051 DOI: 10.3390/jpm11111090] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 10/20/2021] [Accepted: 10/21/2021] [Indexed: 12/12/2022] Open
Abstract
Hepatic encephalopathy (HE) is a brain dysfunction caused by liver insufficiency and/or portosystemic shunting. HE manifests as a spectrum of neurological or psychiatric abnormalities. Diagnosis of overt HE (OHE) is based on the typical clinical manifestation, but covert HE (CHE) has only very subtle clinical signs and minimal HE (MHE) is detected only by specialized time-consuming psychometric tests, for which there is still no universally accepted gold standard. Significant progress has been made in artificial intelligence and its application to medicine. In this review, we introduce how artificial intelligence has been used to diagnose minimal hepatic encephalopathy thus far, and we discuss its further potential in analyzing speech and handwriting data, which are probably the most accessible data for evaluating the cognitive state of the patient.
Collapse
|
23
|
Kaliraman B, Duhan M. Experimental analysis for classification of EEG signals using deep learning framework for optimizing accuracy and cost. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-202490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Electroencephalogram (EEG) signals are essential in brain-computer interface systems. Nowadays, these signals are employed in various medical applications. In the past few years, EEG signals gain more attention in security systems to identify users, as these signals are unique for each individual. The current study explores deep learning frameworks for EEG-based user identification. Data from 107 users were considered for the study, which is acquired using 64 channels. Several experimental tests are performed over both convolutional neural network (CNN) and recurrent neural networks (RNN) using a 10-fold cross-validation process to check system effectiveness. In CNN, 1-D Convolutional layer is employed for the processing of EEG signals. In RNN, LSTM and GRU are used to check system accuracy. For performance measure various metrices were considered such as accuracy, precision, recall and kappa score. Acquired results suggest that gated recurrent unit (GRU) outperforms other models in terms of accuracy and complexity both. GRU model has 91.2% accuracy and has three layers only, which reduces the model’s complexity. The training cost is also decreasing due to the low complexity of the model.
Collapse
|
24
|
Lyu Q, Gong S, Yin J, Dyson JM, Cheng W. Soft Wearable Healthcare Materials and Devices. Adv Healthc Mater 2021; 10:e2100577. [PMID: 34019737 DOI: 10.1002/adhm.202100577] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Revised: 04/25/2021] [Indexed: 12/16/2022]
Abstract
In spite of advances in electronics and internet technologies, current healthcare remains hospital-centred. Disruptive technologies are required to translate state-of-art wearable devices into next-generation patient-centered diagnosis and therapy. In this review, recent advances in the emerging field of soft wearable materials and devices are summarized. A prerequisite for such future healthcare devices is the need of novel materials to be mechanically compliant, electrically conductive, and biologically compatible. It is begun with an overview of the two viable design strategies reported in the literatures, which is followed by description of state-of-the-art wearable healthcare devices for monitoring physical, electrophysiological, chemical, and biological signals. Self-powered wearable bioenergy devices are also covered and sensing systems, as well as feedback-controlled wearable closed-loop biodiagnostic and therapy systems. Finally, it is concluded with an overall summary and future perspective.
Collapse
Affiliation(s)
- Quanxia Lyu
- Department of Chemical Engineering Monash University Clayton VIC 3800 Australia
| | - Shu Gong
- Department of Chemical Engineering Monash University Clayton VIC 3800 Australia
| | - Jialiang Yin
- Department of Chemical Engineering Monash University Clayton VIC 3800 Australia
| | - Jennifer M. Dyson
- Department of Biochemistry & Molecular Biology Biomedicine Discovery Institute Clayton VIC 3800 Australia
- Faculty of Engineering Monash Institute of Medical Engineering (MIME) Monash University Clayton VIC 3800 Australia
| | - Wenlong Cheng
- Department of Chemical Engineering Monash University Clayton VIC 3800 Australia
| |
Collapse
|
25
|
Idowu OP, Ilesanmi AE, Li X, Samuel OW, Fang P, Li G. An integrated deep learning model for motor intention recognition of multi-class EEG Signals in upper limb amputees. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 206:106121. [PMID: 33957375 DOI: 10.1016/j.cmpb.2021.106121] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Accepted: 04/14/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE Recognition of motor intention based on electroencephalogram (EEG) signals has attracted considerable research interest in the field of pattern recognition due to its notable application of non-muscular communication and control for those with severe motor disabilities. In analysis of EEG data, achieving a higher classification performance is dependent on the appropriate representation of EEG features which is mostly characterized by one unique frequency before applying a learning model. Neglecting other frequencies of EEG signals could deteriorate the recognition performance of the model because each frequency has its unique advantages. Motivated by this idea, we propose to obtain distinguishable features with different frequencies by introducing an integrated deep learning model to accurately classify multiple classes of upper limb movement intentions. METHODS The proposed model is a combination of long short-term memory (LSTM) and stacked autoencoder (SAE). To validate the method, four high-level amputees were recruited to perform five motor intention tasks. The acquired EEG signals were first preprocessed before exploring the consequence of input representation on the performance of LSTM-SAE by feeding four frequency bands related to the tasks into the model. The learning model was further improved by t-distributed stochastic neighbor embedding (t-SNE) to eliminate feature redundancy, and to enhance the motor intention recognition. RESULTS The experimental results of the classification performance showed that the proposed model achieves an average performance of 99.01% for accuracy, 99.10% for precision, 99.09% for recall, 99.09% for f1_score, 99.77% for specificity, and 99.0% for Cohen's kappa, across multi-subject and multi-class scenarios. Further evaluation with 2-dimensional t-SNE revealed that the signal decomposition has a distinct multi-class separability in the feature space. CONCLUSION This study demonstrated the predominance of the proposed model in its ability to accurately classify upper limb movements from multiple classes of EEG signals, and its potential application in the development of a more intuitive and naturalistic prosthetic control.
Collapse
Affiliation(s)
- Oluwagbenga Paul Idowu
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen Engineering Laboratory of Neural Rehabilitation Technology, Shenzhen 518055, China
| | - Ademola Enitan Ilesanmi
- School of ICT, Sirindhorn International Institute of Technology, Thammasat University, Thailand
| | - Xiangxin Li
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen Engineering Laboratory of Neural Rehabilitation Technology, Shenzhen 518055, China
| | - Oluwarotimi Williams Samuel
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen Engineering Laboratory of Neural Rehabilitation Technology, Shenzhen 518055, China
| | - Peng Fang
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen Engineering Laboratory of Neural Rehabilitation Technology, Shenzhen 518055, China.
| | - Guanglin Li
- Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China; Shenzhen Engineering Laboratory of Neural Rehabilitation Technology, Shenzhen 518055, China.
| |
Collapse
|
26
|
Saeedi A, Saeedi M, Maghsoudi A, Shalbaf A. Major depressive disorder diagnosis based on effective connectivity in EEG signals: a convolutional neural network and long short-term memory approach. Cogn Neurodyn 2021; 15:239-252. [PMID: 33854642 PMCID: PMC7969675 DOI: 10.1007/s11571-020-09619-0] [Citation(s) in RCA: 54] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 07/13/2020] [Accepted: 07/16/2020] [Indexed: 02/07/2023] Open
Abstract
Deep learning techniques have recently made considerable advances in the field of artificial intelligence. These methodologies can assist psychologists in early diagnosis of mental disorders and preventing severe trauma. Major Depression Disorder (MDD) is a common and serious medical condition whose exact manifestations are not fully understood. So, early discovery of MDD patients helps to cure or limit the adverse effects. Electroencephalogram (EEG) is prominently used to study brain diseases such as MDD due to having high temporal resolution information, and being a noninvasive, inexpensive and portable method. This paper has proposed an EEG-based deep learning framework that automatically discriminates MDD patients from healthy controls. First, the relationships among EEG channels in the form of effective brain connectivity analysis are extracted by Generalized Partial Directed Coherence (GPDC) and Direct directed transfer function (dDTF) methods. A novel combination of sixteen connectivity methods (GPDC and dDTF in eight frequency bands) was used to construct an image for each individual. Finally, the constructed images of EEG signals are applied to the five different deep learning architectures. The first and second algorithms were based on one and two-dimensional convolutional neural network (1DCNN-2DCNN). The third method is based on long short-term memory (LSTM) model, while the fourth and fifth algorithms utilized a combination of CNN with LSTM model namely, 1DCNN-LSTM and 2DCNN-LSTM. The proposed deep learning architectures automatically learn patterns in the constructed image of the EEG signals. The efficiency of the proposed algorithms is evaluated on resting state EEG data obtained from 30 healthy subjects and 34 MDD patients. The experiments show that the 1DCNN-LSTM applied on constructed image of effective connectivity achieves best results with accuracy of 99.24% due to specific architecture which captures the presence of spatial and temporal relations in the brain connectivity. The proposed method as a diagnostic tool is able to help clinicians for diagnosing the MDD patients for early diagnosis and treatment.
Collapse
Affiliation(s)
- Abdolkarim Saeedi
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Maryam Saeedi
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Arash Maghsoudi
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
27
|
Ramalakshmi K, SrinivasaRaghavan V. Soft computing-based edge-enhanced dominant peak and discrete Tchebichef extraction for image segmentation and classification using DCML-IC. Soft comput 2021. [DOI: 10.1007/s00500-020-05306-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
28
|
Gong S, Xing K, Cichocki A, Li J. Deep Learning in EEG: Advance of the Last Ten-Year Critical Period. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2021.3079712] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
29
|
Velasquez-Martinez L, Caicedo-Acosta J, Acosta-Medina C, Alvarez-Meza A, Castellanos-Dominguez G. Regression Networks for Neurophysiological Indicator Evaluation in Practicing Motor Imagery Tasks. Brain Sci 2020; 10:E707. [PMID: 33020435 PMCID: PMC7600302 DOI: 10.3390/brainsci10100707] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 09/21/2020] [Accepted: 09/25/2020] [Indexed: 11/21/2022] Open
Abstract
Motor Imagery (MI) promotes motor learning in activities, like developing professional motor skills, sports gestures, and patient rehabilitation. However, up to 30% of users may not develop enough coordination skills after training sessions because of inter and intra-subject variability. Here, we develop a data-driven estimator, termed Deep Regression Network (DRN), which jointly extracts and performs the regression analysis in order to assess the efficiency of the individual brain networks in practicing MI tasks. The proposed double-stage estimator initially learns a pool of deep patterns, extracted from the input data, in order to feed a neural regression model, allowing for infering the distinctiveness between subject assemblies having similar variability. The results, which were obtained on real-world MI data, prove that the DRN estimator fosters pre-training neural desynchronization and initial training synchronization to predict the bi-class accuracy response, thus providing a better understanding of the Brain-Computer Interface inefficiency of subjects.
Collapse
Affiliation(s)
- Luisa Velasquez-Martinez
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170004, Colombia; (J.C.-A.); (C.A.-M.); (A.A.-M.); (G.C.-D.)
| | | | | | | | | |
Collapse
|
30
|
Ranga V, Gupta S, Meena J, Agrawal P. Automated human mind reading using EEG signals for seizure detection. J Med Eng Technol 2020; 44:237-246. [PMID: 32657667 DOI: 10.1080/03091902.2020.1791988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Epilepsy is one of the most occurring neurological disease globally emerged back in 4000 BC. It is affecting around 50 million people of all ages these days. The trait of this disease is recurrent seizures. In the past few decades, the treatments available for seizure control have improved a lot with the advancements in the field of medical science and technology. Electroencephalogram (EEG) is a widely used technique for monitoring the brain activity and widely popular for seizure region detection. It is performed before surgery and also to predict seizure at the time operation which is useful in neuro stimulation device. But in most of cases visual examination is done by neurologist in order to detect and classify patterns of the disease but this requires a lot of pre-domain knowledge and experience. This all in turns put a pressure on neurosurgeons and leads to time wastage and also reduce their accuracy and efficiency. There is a need of some automated systems in arena of information technology like use of neural networks in deep learning which can assist neurologists. In the present paper, a model is proposed to give an accuracy of 98.33% which can be used for development of automated systems. The developed system will significantly help neurologists in their performance.
Collapse
Affiliation(s)
- Virender Ranga
- Department of Computer Engineering, National Institute of Technology, Kurukshetra, India
| | - Shivam Gupta
- Department of Computer Science and Engineering, Indian Institute of Information Technology, Sonepat, Haryana, India (Mentor National Institute of Technology, Kurukshetra, Haryana, India)
| | - Jyoti Meena
- Department of Computer Engineering, National Institute of Technology, Kurukshetra, India
| | - Priyansh Agrawal
- Department of Computer Engineering, National Institute of Technology, Kurukshetra, India
| |
Collapse
|