1
|
Dong R, Zhang X, Li H, Masengo G, Zhu A, Shi X, He C. EEG generation mechanism of lower limb active movement intention and its virtual reality induction enhancement: a preliminary study. Front Neurosci 2024; 17:1305850. [PMID: 38352938 PMCID: PMC10861750 DOI: 10.3389/fnins.2023.1305850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 12/28/2023] [Indexed: 02/16/2024] Open
Abstract
Introduction Active rehabilitation requires active neurological participation when users use rehabilitation equipment. A brain-computer interface (BCI) is a direct communication channel for detecting changes in the nervous system. Individuals with dyskinesia have unclear intentions to initiate movement due to physical or psychological factors, which is not conducive to detection. Virtual reality (VR) technology can be a potential tool to enhance the movement intention from pre-movement neural signals in clinical exercise therapy. However, its effect on electroencephalogram (EEG) signals is not yet known. Therefore, the objective of this paper is to construct a model of the EEG signal generation mechanism of lower limb active movement intention and then investigate whether VR induction could improve movement intention detection based on EEG. Methods Firstly, a neural dynamic model of lower limb active movement intention generation was established from the perspective of signal transmission and information processing. Secondly, the movement-related EEG signal was calculated based on the model, and the effect of VR induction was simulated. Movement-related cortical potential (MRCP) and event-related desynchronization (ERD) features were extracted to analyze the enhancement of movement intention. Finally, we recorded EEG signals of 12 subjects in normal and VR environments to verify the effectiveness and feasibility of the above model and VR induction enhancement of lower limb active movement intention for individuals with dyskinesia. Results Simulation and experimental results show that VR induction can effectively enhance the EEG features of subjects and improve the detectability of movement intention. Discussion The proposed model can simulate the EEG signal of lower limb active movement intention, and VR induction can enhance the early and accurate detectability of lower limb active movement intention. It lays the foundation for further robot control based on the actual needs of users.
Collapse
Affiliation(s)
- Runlin Dong
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Xiaodong Zhang
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- Shaanxi Key Laboratory of Intelligent Robots, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Hanzhe Li
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Gilbert Masengo
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Aibin Zhu
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- Shaanxi Key Laboratory of Intelligent Robots, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Xiaojun Shi
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Chen He
- General Department, AVIC Creative Robotics Co., Ltd., Xi’an, Shaanxi, China
| |
Collapse
|
2
|
Su D, Hu Z, Wu J, Shang P, Luo Z. Review of adaptive control for stroke lower limb exoskeleton rehabilitation robot based on motion intention recognition. Front Neurorobot 2023; 17:1186175. [PMID: 37465413 PMCID: PMC10350518 DOI: 10.3389/fnbot.2023.1186175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 06/13/2023] [Indexed: 07/20/2023] Open
Abstract
Stroke is a significant cause of disability worldwide, and stroke survivors often experience severe motor impairments. Lower limb rehabilitation exoskeleton robots provide support and balance for stroke survivors and assist them in performing rehabilitation training tasks, which can effectively improve their quality of life during the later stages of stroke recovery. Lower limb rehabilitation exoskeleton robots have become a hot topic in rehabilitation therapy research. This review introduces traditional rehabilitation assessment methods, explores the possibility of lower limb exoskeleton robots combining sensors and electrophysiological signals to assess stroke survivors' rehabilitation objectively, summarizes standard human-robot coupling models of lower limb rehabilitation exoskeleton robots in recent years, and critically introduces adaptive control models based on motion intent recognition for lower limb exoskeleton robots. This provides new design ideas for the future combination of lower limb rehabilitation exoskeleton robots with rehabilitation assessment, motion assistance, rehabilitation treatment, and adaptive control, making the rehabilitation assessment process more objective and addressing the shortage of rehabilitation therapists to some extent. Finally, the article discusses the current limitations of adaptive control of lower limb rehabilitation exoskeleton robots for stroke survivors and proposes new research directions.
Collapse
Affiliation(s)
- Dongnan Su
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Zhigang Hu
- School of Medical Technology and Engineering, Henan University of Science and Technology, Luoyang, China
- Henan Intelligent Rehabilitation Medical Robot Engineering Research Center, Henan University of Science and Technology, Luoyang, China
| | - Jipeng Wu
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Peng Shang
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Zhaohui Luo
- State-Owned Changhong Machinery Factory, Guilin, China
| |
Collapse
|
3
|
Li HB, Guan XR, Li Z, Zou KF, He L. Estimation of Knee Joint Angle from Surface EMG Using Multiple Kernels Relevance Vector Regression. SENSORS (BASEL, SWITZERLAND) 2023; 23:4934. [PMID: 37430848 DOI: 10.3390/s23104934] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 05/04/2023] [Accepted: 05/19/2023] [Indexed: 07/12/2023]
Abstract
In wearable robots, the application of surface electromyography (sEMG) signals in motion intention recognition is a hot research issue. To improve the viability of human-robot interactive perception and to reduce the complexity of the knee joint angle estimation model, this paper proposed an estimation model for knee joint angle based on the novel method of multiple kernel relevance vector regression (MKRVR) through offline learning. The root mean square error, mean absolute error, and R2_score are used as performance indicators. By comparing the estimation model of MKRVR and least squares support vector regression (LSSVR), the MKRVR performs better on the estimation of the knee joint angle. The results showed that the MKRVR can estimate the knee joint angle with a continuous global MAE of 3.27° ± 1.2°, RMSE of 4.81° ± 1.37°, and R2 of 0.8946 ± 0.07. Therefore, we concluded that the MKRVR for the estimation of the knee joint angle from sEMG is viable and could be used for motion analysis and the application of recognition of the wearer's motion intentions in human-robot collaboration control.
Collapse
Affiliation(s)
- Hui-Bin Li
- School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
| | - Xiao-Rong Guan
- School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
| | - Zhong Li
- School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
| | - Kai-Fan Zou
- School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
| | - Long He
- School of Mechanical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
- Zhiyuan Research Institute, Hangzhou 310013, China
| |
Collapse
|
4
|
Zhang X, Li H, Dong R, Lu Z, Li C. Electroencephalogram and surface electromyogram fusion-based precise detection of lower limb voluntary movement using convolution neural network-long short-term memory model. Front Neurosci 2022; 16:954387. [PMID: 36213740 PMCID: PMC9538146 DOI: 10.3389/fnins.2022.954387] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 08/26/2022] [Indexed: 11/13/2022] Open
Abstract
The electroencephalogram (EEG) and surface electromyogram (sEMG) fusion has been widely used in the detection of human movement intention for human–robot interaction, but the internal relationship of EEG and sEMG signals is not clear, so their fusion still has some shortcomings. A precise fusion method of EEG and sEMG using the CNN-LSTM model was investigated to detect lower limb voluntary movement in this study. At first, the EEG and sEMG signal processing of each stage was analyzed so that the response time difference between EEG and sEMG can be estimated to detect lower limb voluntary movement, and it can be calculated by the symbolic transfer entropy. Second, the data fusion and feature of EEG and sEMG were both used for obtaining a data matrix of the model, and a hybrid CNN-LSTM model was established for the EEG and sEMG-based decoding model of lower limb voluntary movement so that the estimated value of time difference was about 24 ∼ 26 ms, and the calculated value was between 25 and 45 ms. Finally, the offline experimental results showed that the accuracy of data fusion was significantly higher than feature fusion-based accuracy in 5-fold cross-validation, and the average accuracy of EEG and sEMG data fusion was more than 95%; the improved average accuracy for eliminating the response time difference between EEG and sEMG was about 0.7 ± 0.26% in data fusion. In the meantime, the online average accuracy of data fusion-based CNN-LSTM was more than 87% in all subjects. These results demonstrated that the time difference had an influence on the EEG and sEMG fusion to detect lower limb voluntary movement, and the proposed CNN-LSTM model can achieve high performance. This work provides a stable and reliable basis for human–robot interaction of the lower limb exoskeleton.
Collapse
Affiliation(s)
- Xiaodong Zhang
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- Shaanxi Key Laboratory of Intelligent Robots, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- Wearable Human Enhancement Technology Innovation Center, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Hanzhe Li
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- Wearable Human Enhancement Technology Innovation Center, Xi’an Jiaotong University, Xi’an, Shaanxi, China
- *Correspondence: Hanzhe Li,
| | - Runlin Dong
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Zhufeng Lu
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| | - Cunxin Li
- School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, China
| |
Collapse
|
5
|
Human Joint Torque Estimation Based on Mechanomyography for Upper Extremity Exosuit. ELECTRONICS 2022. [DOI: 10.3390/electronics11091335] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Human intention recognition belongs to the algorithm basis for exoskeleton robots to generate synergic movements and provide corresponding assistance. In this article, we acquire and analyze the mechanomyography (MMG) to estimate the current joint torque and apply this method to the rehabilitation training research of the upper extremity exosuit. In order to obtain relatively pure biological signals, a MMG processing method based on the Hilbert-Huang Transform (HHT) is proposed to eliminate the mixed noise and motion artifacts. After extracting features and forming the dataset, a random forest regression (RFR) model is designed to build the mapping relationship between MMG and human joint output through offline learning. In addition, an upper extremity exosuit is constructed for multi-joint assistance. Based on the above research, we develop a torque estimation-based control strategy and make it responsible for the intention understanding and motion servo of this customized system. Finally, an actual test verifies the accuracy and reliability of this recognition algorithm, and an efficiency evaluation experiment also proves the feasibility for power assistance.
Collapse
|
6
|
Zhang X, Lu Z, Zhang T, Li H, Wang Y, Tao Q. Realizing the Application of EEG Modeling in BCI Classification: Based on a Conditional GAN Converter. Front Neurosci 2021; 15:727394. [PMID: 34867150 PMCID: PMC8636039 DOI: 10.3389/fnins.2021.727394] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Accepted: 10/04/2021] [Indexed: 11/13/2022] Open
Abstract
Electroencephalogram (EEG) modeling in brain-computer interface (BCI) provides a theoretical foundation for its development. However, limited by the lack of guidelines in model parameter selection and the inability to obtain personal tissue information in practice, EEG modeling in BCI is mainly focused on the theoretical qualitative level which shows a gap between the theory and its application. Based on such problems, this work combined the surface EEG simulation with a converter based on the generative adversarial network (GAN), to establish the connection from simulated EEG to its application in BCI classification. For the scalp EEGs modeling, a mathematical model was built according to the physics of surface EEG, which consisted of the parallel 3-population neural mass model, the equivalent dipole, and the forward computation. For application, a converter based on the conditional GAN was designed, to transfer the simulated theoretical-only EEG to its practical version, in the lack of individual bio-information. To verify the feasibility, based on the latest microexpression-assisted BCI paradigm proposed by our group, the converted simulated EEGs were used in the training of BCI classifiers. The results indicated that, compared with training with insufficient real data, by adding the simulated EEGs, the overall performance showed a significant improvement (P = 0.04 < 0.05), and the test performance can be improved by 2.17% ± 4.23, in which the largest increase was up to 12.60% ± 1.81. Through this work, the link from theoretical EEG simulation to BCI classification has been initially established, providing an enhanced novel solution for the application of EEG modeling in BCI.
Collapse
Affiliation(s)
- Xiaodong Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Zhufeng Lu
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Teng Zhang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Hanzhe Li
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Yachun Wang
- School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, China.,Shaanxi Key Laboratory of Intelligent Robot, Xi'an Jiaotong University, Xi'an, China
| | - Qing Tao
- School of Mechanical Engineering, Xinjiang University, Wulumuqi, China
| |
Collapse
|