1
|
Senadheera I, Hettiarachchi P, Haslam B, Nawaratne R, Sheehan J, Lockwood KJ, Alahakoon D, Carey LM. AI Applications in Adult Stroke Recovery and Rehabilitation: A Scoping Review Using AI. SENSORS (BASEL, SWITZERLAND) 2024; 24:6585. [PMID: 39460066 PMCID: PMC11511449 DOI: 10.3390/s24206585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/08/2024] [Accepted: 10/09/2024] [Indexed: 10/28/2024]
Abstract
Stroke is a leading cause of long-term disability worldwide. With the advancements in sensor technologies and data availability, artificial intelligence (AI) holds the promise of improving the amount, quality and efficiency of care and enhancing the precision of stroke rehabilitation. We aimed to identify and characterize the existing research on AI applications in stroke recovery and rehabilitation of adults, including categories of application and progression of technologies over time. Data were collected from peer-reviewed articles across various electronic databases up to January 2024. Insights were extracted using AI-enhanced multi-method, data-driven techniques, including clustering of themes and topics. This scoping review summarizes outcomes from 704 studies. Four common themes (impairment, assisted intervention, prediction and imaging, and neuroscience) were identified, in which time-linked patterns emerged. The impairment theme revealed a focus on motor function, gait and mobility, while the assisted intervention theme included applications of robotic and brain-computer interface (BCI) techniques. AI applications progressed over time, starting from conceptualization and then expanding to a broader range of techniques in supervised learning, artificial neural networks (ANN), natural language processing (NLP) and more. Applications focused on upper limb rehabilitation were reviewed in more detail, with machine learning (ML), deep learning techniques and sensors such as inertial measurement units (IMU) used for upper limb and functional movement analysis. AI applications have potential to facilitate tailored therapeutic delivery, thereby contributing to the optimization of rehabilitation outcomes and promoting sustained recovery from rehabilitation to real-world settings.
Collapse
Affiliation(s)
- Isuru Senadheera
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Prasad Hettiarachchi
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Brendon Haslam
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| | - Rashmika Nawaratne
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Jacinta Sheehan
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Kylee J. Lockwood
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Damminda Alahakoon
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Leeanne M. Carey
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| |
Collapse
|
2
|
Luo S, Ren P, Wu J, Wu X, Zhang X. Feature extraction method of EEG based on wavelet packet reconstruction and deep learning model of VR motion sickness feature classification and prediction. PLoS One 2024; 19:e0305733. [PMID: 39028732 PMCID: PMC11259303 DOI: 10.1371/journal.pone.0305733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 05/31/2024] [Indexed: 07/21/2024] Open
Abstract
The surging popularity of virtual reality (VR) technology raises concerns about VR-induced motion sickness, linked to discomfort and nausea in simulated environments. Our method involves in-depth analysis of EEG data and user feedback to train a sophisticated deep learning model, utilizing an enhanced GRU network for identifying motion sickness patterns. Following comprehensive data pre-processing and feature engineering to ensure input accuracy, a deep learning model is trained using supervised and unsupervised techniques for classifying and predicting motion sickness severity. Rigorous training and validation procedures confirm the model's robustness across diverse scenarios. Research results affirm our deep learning model's 84.9% accuracy in classifying and predicting VR-induced motion sickness, surpassing existing models. This information is vital for improving the VR experience and advancing VR technology.
Collapse
Affiliation(s)
- Shuhang Luo
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
| | - Peng Ren
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
- Engineering Research Center of Medical and Health Sensing Technology, Xuzhou Medical University, Xuzhou, China
| | - Jiawei Wu
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
| | - Xiang Wu
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
| | - Xiao Zhang
- School of Medical Information and Engineering, Xuzhou Medical University, Xuzhou, China
| |
Collapse
|
3
|
Fan Y, Wang H, Zhu X, Cao X, Yi C, Chen Y, Jia J, Lu X. FER-PCVT: Facial Expression Recognition with Patch-Convolutional Vision Transformer for Stroke Patients. Brain Sci 2022; 12:1626. [PMID: 36552086 PMCID: PMC9776282 DOI: 10.3390/brainsci12121626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 11/19/2022] [Accepted: 11/23/2022] [Indexed: 11/29/2022] Open
Abstract
Early rehabilitation with the right intensity contributes to the physical recovery of stroke survivors. In clinical practice, physicians determine whether the training intensity is suitable for rehabilitation based on patients' narratives, training scores, and evaluation scales, which puts tremendous pressure on medical resources. In this study, a lightweight facial expression recognition algorithm is proposed to diagnose stroke patients' training motivations automatically. First, the properties of convolution are introduced into the Vision Transformer's structure, allowing the model to extract both local and global features of facial expressions. Second, the pyramid-shaped feature output mode in Convolutional Neural Networks is also introduced to reduce the model's parameters and calculation costs significantly. Moreover, a classifier that can better classify facial expressions of stroke patients is designed to improve performance further. We verified the proposed algorithm on the Real-world Affective Faces Database (RAF-DB), the Face Expression Recognition Plus Dataset (FER+), and a private dataset for stroke patients. Experiments show that the backbone network of the proposed algorithm achieves better performance than Pyramid Vision Transformer (PvT) and Convolutional Vision Transformer (CvT) with fewer parameters and Floating-point Operations Per Second (FLOPs). In addition, the algorithm reaches an 89.44% accuracy on the RAF-DB dataset, which is higher than other recent studies. In particular, it obtains an accuracy of 99.81% on the private dataset, with only 4.10M parameters.
Collapse
Affiliation(s)
- Yiming Fan
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
| | - Hewei Wang
- Department of Rehabilitation, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Xiaoyu Zhu
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
| | - Xiangming Cao
- Department of Oncology, Jiangyin People’s Hospital Affiliated to Nantong University, Wuxi 214400, China
| | - Chuanjian Yi
- Department of Rehabilitation, The Affiliated Hospital of Qingdao University, Qingdao 266000, China
| | - Yao Chen
- Department of Rehabilitation, Shanghai Third Rehabilitation Hospital, Shanghai 200436, China
| | - Jie Jia
- Department of Rehabilitation, Huashan Hospital, Fudan University, Shanghai 200040, China
| | - Xiaofeng Lu
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
- Wenzhou Institute, Shanghai University, Wenzhou 325000, China
| |
Collapse
|
4
|
A new data augmentation convolutional neural network for human emotion recognition based on ECG signals. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103580] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
5
|
Fusion of EEG-Based Activation, Spatial, and Connection Patterns for Fear Emotion Recognition. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3854513. [PMID: 35463262 PMCID: PMC9020909 DOI: 10.1155/2022/3854513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Accepted: 03/19/2022] [Indexed: 11/29/2022]
Abstract
At present, emotion recognition based on electroencephalograms (EEGs) has attracted much more attention. Current studies of affective brain-computer interfaces (BCIs) focus on the recognition of happiness and sadness using brain activation patterns. Fear recognition involving brain activities in different spatial distributions and different brain functional networks has been scarcely investigated. In this study, we propose a multifeature fusion method combining energy activation, spatial distribution, and brain functional connection network (BFCN) features for fear emotion recognition. The affective brain pattern was identified by not only the power activation features of differential entropy (DE) but also the spatial distribution features of the common spatial pattern (CSP) and the EEG phase synchronization features of phase lock value (PLV). A total of 15 healthy subjects took part in the experiment, and the average accuracy rate was 85.00% ± 8.13%. The experimental results showed that the fear emotions of subjects were fully stimulated and effectively identified. The proposed fusion method on fear recognition was thus validated and is of great significance to the development of effective emotional BCI systems.
Collapse
|
6
|
Murugappan M, Zheng BS, Khairunizam W. Recurrent Quantification Analysis-Based Emotion Classification in Stroke Using Electroencephalogram Signals. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2021. [DOI: 10.1007/s13369-021-05369-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
7
|
Safi MS, Safi SMM. Early detection of Alzheimer’s disease from EEG signals using Hjorth parameters. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102338] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
|
8
|
Wen Yean C, Wan Ahmad WK, Mustafa WA, Murugappan M, Rajamanickam Y, Adom AH, Omar MI, Zheng BS, Junoh AK, Razlan ZM, Bakar SA. An Emotion Assessment of Stroke Patients by Using Bispectrum Features of EEG Signals. Brain Sci 2020; 10:E672. [PMID: 32992930 PMCID: PMC7601112 DOI: 10.3390/brainsci10100672] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2020] [Revised: 09/11/2020] [Accepted: 09/22/2020] [Indexed: 01/06/2023] Open
Abstract
Emotion assessment in stroke patients gives meaningful information to physiotherapists to identify the appropriate method for treatment. This study was aimed to classify the emotions of stroke patients by applying bispectrum features in electroencephalogram (EEG) signals. EEG signals from three groups of subjects, namely stroke patients with left brain damage (LBD), right brain damage (RBD), and normal control (NC), were analyzed for six different emotional states. The estimated bispectrum mapped in the contour plots show the different appearance of nonlinearity in the EEG signals for different emotional states. Bispectrum features were extracted from the alpha (8-13) Hz, beta (13-30) Hz and gamma (30-49) Hz bands, respectively. The k-nearest neighbor (KNN) and probabilistic neural network (PNN) classifiers were used to classify the six emotions in LBD, RBD and NC. The bispectrum features showed statistical significance for all three groups. The beta frequency band was the best performing EEG frequency-sub band for emotion classification. The combination of alpha to gamma bands provides the highest classification accuracy in both KNN and PNN classifiers. Sadness emotion records the highest classification, which was 65.37% in LBD, 71.48% in RBD and 75.56% in NC groups.
Collapse
Affiliation(s)
- Choong Wen Yean
- Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (C.W.Y.); (M.I.O.); (B.S.Z.)
| | - Wan Khairunizam Wan Ahmad
- Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (W.A.M.); (A.H.A.)
| | - Wan Azani Mustafa
- Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (W.A.M.); (A.H.A.)
| | - Murugappan Murugappan
- Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Doha Area, 7th Ring Road, Kuwait City 13133, Kuwait;
| | - Yuvaraj Rajamanickam
- School of Electrical and Electronic Engineering, Nanyang Technological University (NTU), 50 Nanyang Avenue, Singapore 639798, Singapore;
| | - Abdul Hamid Adom
- Faculty of Electrical Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (W.A.M.); (A.H.A.)
| | - Mohammad Iqbal Omar
- Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (C.W.Y.); (M.I.O.); (B.S.Z.)
| | - Bong Siao Zheng
- Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (C.W.Y.); (M.I.O.); (B.S.Z.)
| | - Ahmad Kadri Junoh
- Institute of Engineering Mathematics, Universiti Malaysia Perlis, Arau 02600, Perlis, Malaysia;
| | - Zuradzman Mohamad Razlan
- Faculty of Mechanical Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (Z.M.R.); (S.A.B.)
| | - Shahriman Abu Bakar
- Faculty of Mechanical Engineering Technology, Universiti Malaysia Perlis (UniMAP), Arau 02600, Perlis, Malaysia; (Z.M.R.); (S.A.B.)
| |
Collapse
|
9
|
He H, Tan Y, Ying J, Zhang W. Strengthen EEG-based emotion recognition using firefly integrated optimization algorithm. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2020.106426] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
10
|
Rashid M, Sulaiman N, P P Abdul Majeed A, Musa RM, Ab Nasir AF, Bari BS, Khatun S. Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front Neurorobot 2020; 14:25. [PMID: 32581758 PMCID: PMC7283463 DOI: 10.3389/fnbot.2020.00025] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 04/08/2020] [Indexed: 12/12/2022] Open
Abstract
Brain-Computer Interface (BCI), in essence, aims at controlling different assistive devices through the utilization of brain waves. It is worth noting that the application of BCI is not limited to medical applications, and hence, the research in this field has gained due attention. Moreover, the significant number of related publications over the past two decades further indicates the consistent improvements and breakthroughs that have been made in this particular field. Nonetheless, it is also worth mentioning that with these improvements, new challenges are constantly discovered. This article provides a comprehensive review of the state-of-the-art of a complete BCI system. First, a brief overview of electroencephalogram (EEG)-based BCI systems is given. Secondly, a considerable number of popular BCI applications are reviewed in terms of electrophysiological control signals, feature extraction, classification algorithms, and performance evaluation metrics. Finally, the challenges to the recent BCI systems are discussed, and possible solutions to mitigate the issues are recommended.
Collapse
Affiliation(s)
- Mamunur Rashid
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Norizam Sulaiman
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Anwar P P Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Rabiu Muazu Musa
- Centre for Fundamental and Continuing Education, Universiti Malaysia Terengganu, Kuala Nerus, Malaysia
| | - Ahmad Fakhri Ab Nasir
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Bifta Sama Bari
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Sabira Khatun
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| |
Collapse
|
11
|
Liu ZT, Xie Q, Wu M, Cao WH, Li DY, Li SH. Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection. IEEE Trans Cogn Dev Syst 2019. [DOI: 10.1109/tcds.2018.2868121] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
12
|
Zhao J, Mao X, Chen L. Speech emotion recognition using deep 1D & 2D CNN LSTM networks. Biomed Signal Process Control 2019. [DOI: 10.1016/j.bspc.2018.08.035] [Citation(s) in RCA: 194] [Impact Index Per Article: 38.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
|