1
|
Abidi MH. Multimodal data-based human motion intention prediction using adaptive hybrid deep learning network for movement challenged person. Sci Rep 2024; 14:30633. [PMID: 39719464 DOI: 10.1038/s41598-024-82624-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2024] [Accepted: 12/06/2024] [Indexed: 12/26/2024] Open
Abstract
Recently, social demands for a good quality of life have increased among the elderly and disabled people. So, biomedical engineers and robotic researchers aimed to fuse these techniques in a novel rehabilitation system. Moreover, these models utilized the biomedical signals acquired from the human body's particular organ, cells, or tissues. The human motion intention prediction mechanism plays an essential role in various applications, such as assistive and rehabilitation robots, that execute specific tasks among elders and physically impaired individuals. However, more complications are increased in the human-machine-based interaction techniques, creating more scope for personalized assistance for the human motion intention prediction system. Therefore, in this paper, an Adaptive Hybrid Network (AHN) is implemented for effective human motion intention prediction. Initially, multimodal data like electroencephalogram (EEG)/Electromyography (EMG) signals and sensor measures data are collected from the available data resource. The gathered EEG/EMG signals are then converted into spectrogram images and sent to AH-CNN-LSTM, which is the integration of an Adaptive Hybrid Convolution Neural Network (AH-CNN) with a Long Short-Term Memory (LSTM) network. Similarly, the data details of sensor measures are directly subjected to AH-CNN-Res-LSTM, which is the combination of Adaptive Hybrid CNN with Residual Network and LSTM (Res-LSTM) to get the predictive result. Further, to enhance the prediction, the parameters in both the AH-CNN-LSTM and AH-CNN-Res-LSTM techniques are optimized using the Improved Yellow Saddle Goatfish Algorithm (IYSGA). The efficiency of the implemented model is computed by conducting the comparison experiment of the proposed technique with other standard models. The performance outcome of the developed method outperformed the other traditional methods.
Collapse
Affiliation(s)
- Mustufa Haider Abidi
- Advanced Manufacturing Institute, King Saud University, Riyadh, 11421, Saudi Arabia.
- King Salman Center for Disability Research, Riyadh, 11614, Saudi Arabia.
| |
Collapse
|
2
|
Shi Y, Tang S, Li Y, He Z, Tang S, Wang R, Zheng W, Chen Z, Zhou Y. Continual learning for seizure prediction via memory projection strategy. Comput Biol Med 2024; 181:109028. [PMID: 39173485 DOI: 10.1016/j.compbiomed.2024.109028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 06/30/2024] [Accepted: 08/12/2024] [Indexed: 08/24/2024]
Abstract
Despite extensive algorithms for epilepsy prediction via machine learning, most models are tailored for offline scenarios and cannot handle actual scenarios where data changes over time. Catastrophic forgetting(CF) for learned electroencephalogram(EEG) data occurs when EEG changes dynamically in the clinical setting. This paper implements a continual learning(CL) strategy Memory Projection(MP) for epilepsy prediction, which can be combined with other algorithms to avoid CF. Such a strategy enables the model to learn EEG data from each patient in dynamic subspaces with weak correlation layer by layer to minimize interference and promote knowledge transfer. Regularization Loss Reconstruction Algorithm and Matrix Dimensionality Reduction Algorithm are introduced into the core of MP. Experimental results show that MP exhibits excellent performance and low forgetting rates in sequential learning of seizure prediction. The forgetting rate of accuracy and sensitivity under multiple experiments are below 5%. When learning from multi-center datasets, the forgetting rates for accuracy and sensitivity decrease to 0.65% and 1.86%, making it comparable to state-of-the-art CL strategies. Through ablation experiments, we have analyzed that MP can operate with minimal storage and computational cost, which demonstrates practical potential for seizure prediction in clinical scenarios.
Collapse
Affiliation(s)
- Yufei Shi
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Shishi Tang
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Yuxuan Li
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Zhipeng He
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Shengsheng Tang
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Ruixuan Wang
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, 510006, Guangdong, China
| | - Weishi Zheng
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, 510006, Guangdong, China
| | - Ziyi Chen
- The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China
| | - Yi Zhou
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, 510080, Guangdong, China.
| |
Collapse
|
3
|
Chen Z, Zhang Y, Zhou Z, Wang L, Zhang H, Wang P, Xu J. An efficient ANN SoC for detecting Alzheimer's disease based on recurrent computing. Comput Biol Med 2024; 181:108993. [PMID: 39173486 DOI: 10.1016/j.compbiomed.2024.108993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2024] [Revised: 05/22/2024] [Accepted: 08/02/2024] [Indexed: 08/24/2024]
Abstract
Alzheimer's Disease (AD) is an irreversible, degenerative condition that, while incurable, can have its progression slowed or impeded. While there are numerous methods utilizing neural networks for AD detection, there is a scarcity of High-performance AD detection chips. Moreover, excessively complex neural networks are not conducive to on-chip implementation and clinical applications. This study addresses the challenges of high misdiagnosis rates and significant hardware costs inherent in traditional AD detection techniques. A novel and efficient AD detection framework based on a recurrent computational strategy is proposed. The framework harnesses an Artificial Neural Network (ANN) embedded within a System on Chip (SoC) to perform sophisticated Electroencephalogram (EEG) analysis. The approach began by employing a reduced IEEE754 single-precision encoding method to hardware-encode the preprocessed EEG data, thereby minimizing the memory storage area. Next, data remapping techniques were utilized to ensure the continuity of the input data read addresses and reduce the memory access pressure during neural network computations. Subsequently, hierarchical and Processing Element (PE) reuse technologies were leveraged to perform the multiply-accumulate operations of the ANN. Finally, a step function was chosen to establish binary classification circuits dedicated to AD detection. Experimental results indicate that the optimized SoC achieves a 70 % reduction in area and a 50 % reduction in power consumption compared to traditional designs. For various neural network models, the detection model proposed in this paper incurs less overhead, with a training speed 3 to 4 times faster than other traditional models, and a high accuracy rate of 98.53 %.
Collapse
Affiliation(s)
- Zhikang Chen
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang, China.
| | - Yuejun Zhang
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang, China.
| | - Ziyu Zhou
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang, China.
| | - Lixun Wang
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang, China.
| | - Huihong Zhang
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, 315211, Zhejiang, China.
| | - Pengjun Wang
- Electrical and Electronic Engineering, Wenzhou University, Wenzhou, 325035, Zhejiang, China.
| | - Jinyan Xu
- Department of Neurology, The First Affiliated Hospital of Ningbo University, Ningbo, 315020, China.
| |
Collapse
|
4
|
Studier-Fischer A, Bressan M, Qasim AB, Özdemir B, Sellner J, Seidlitz S, Haney CM, Egen L, Michel M, Dietrich M, Salg GA, Billmann F, Nienhüser H, Hackert T, Müller BP, Maier-Hein L, Nickel F, Kowalewski KF. Spectral characterization of intraoperative renal perfusion using hyperspectral imaging and artificial intelligence. Sci Rep 2024; 14:17262. [PMID: 39068299 PMCID: PMC11283474 DOI: 10.1038/s41598-024-68280-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 07/22/2024] [Indexed: 07/30/2024] Open
Abstract
Accurate intraoperative assessment of organ perfusion is a pivotal determinant in preserving organ function e.g. during kidney surgery including partial nephrectomy or kidney transplantation. Hyperspectral imaging (HSI) has great potential to objectively describe and quantify this perfusion as opposed to conventional surrogate techniques such as ultrasound flowmeter, indocyanine green or the subjective eye of the surgeon. An established live porcine model under general anesthesia received median laparotomy and renal mobilization. Different scenarios that were measured using HSI were (1) complete, (2) gradual and (3) partial malperfusion. The differences in spectral reflectance as well as HSI oxygenation (StO2) between different perfusion states were compelling and as high as 56.9% with 70.3% (± 11.0%) for "physiological" vs. 13.4% (± 3.1%) for "venous congestion". A machine learning (ML) algorithm was able to distinguish between these perfusion states with a balanced prediction accuracy of 97.8%. Data from this porcine study including 1300 recordings across 57 individuals was compared to a human dataset of 104 recordings across 17 individuals suggesting clinical transferability. Therefore, HSI is a highly promising tool for intraoperative microvascular evaluation of perfusion states with great advantages over existing surrogate techniques. Clinical trials are required to prove patient benefit.
Collapse
Affiliation(s)
- A Studier-Fischer
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
- Department of Urology and Urosurgery, Medical Faculty of the University of Heidelberg, University Medical Center Mannheim, Mannheim, Germany.
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany.
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany.
| | - M Bressan
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - A Bin Qasim
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
| | - B Özdemir
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany
| | - J Sellner
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - S Seidlitz
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - C M Haney
- Department of Urology and Urosurgery, Medical Faculty of the University of Heidelberg, University Medical Center Mannheim, Mannheim, Germany
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany
| | - L Egen
- Department of Urology and Urosurgery, Medical Faculty of the University of Heidelberg, University Medical Center Mannheim, Mannheim, Germany
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany
| | - M Michel
- Department of Urology and Urosurgery, Medical Faculty of the University of Heidelberg, University Medical Center Mannheim, Mannheim, Germany
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany
| | - M Dietrich
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - G A Salg
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - F Billmann
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - H Nienhüser
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - T Hackert
- Department of General, Visceral, and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - B P Müller
- Department of Digestive Surgery, University Digestive Healthcare Center, Basel, Switzerland
| | - L Maier-Hein
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
| | - F Nickel
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- Department of General, Visceral, and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - K F Kowalewski
- Department of Urology and Urosurgery, Medical Faculty of the University of Heidelberg, University Medical Center Mannheim, Mannheim, Germany
- Division of Intelligent Systems and Robotics in Urology (ISRU), German Cancer Research Center (DKFZ) Heidelberg, Heidelberg, Germany
- DKFZ Hector Cancer Institute at the University Medical Center Mannheim, Mannheim, Germany
| |
Collapse
|