Electrocorticography to Investigate Age-Related Brain Lateralization on Pediatric Motor Inhibition

Decoding micro-electrocorticographic signals by using explainable 3D convolutional neural network to predict finger movements

BACKGROUND

Electroencephalography (EEG) and electrocorticography (ECoG) recordings have been used to decode finger movements by analyzing brain activity. Traditional methods focused on single bandpass power changes for movement decoding, utilizing machine learning models requiring manual feature extraction.

NEW METHOD

This study introduces a 3D convolutional neural network (3D-CNN) model to decode finger movements using ECoG data. The model employs adaptive, explainable AI (xAI) techniques to interpret the physiological relevance of brain signals. ECoG signals from epilepsy patients during awake craniotomy were processed to extract power spectral density across multiple frequency bands. These data formed a 3D matrix used to train the 3D-CNN to predict finger trajectories.

RESULTS

The 3D-CNN model showed significant accuracy in predicting finger movements, with root-mean-square error (RMSE) values of 0.26-0.38 for single finger movements and 0.20-0.24 for combined movements. Explainable AI techniques, Grad-CAM and SHAP, identified the high gamma (HG) band as crucial for movement prediction, showing specific cortical regions involved in different finger movements. These findings highlighted the physiological significance of the HG band in motor control.

COMPARISON WITH EXISTING METHODS

The 3D-CNN model outperformed traditional machine learning approaches by effectively capturing spatial and temporal patterns in ECoG data. The use of xAI techniques provided clearer insights into the model's decision-making process, unlike the "black box" nature of standard deep learning models.

CONCLUSIONS

The proposed 3D-CNN model, combined with xAI methods, enhances the decoding accuracy of finger movements from ECoG data. This approach offers a more efficient and interpretable solution for brain-computer interface (BCI) applications, emphasizing the HG band's role in motor control.

A Differentiable Dynamic Model for Musculoskeletal Simulation and Exoskeleton Control

An exoskeleton, a wearable device, was designed based on the user's physical and cognitive interactions. The control of the exoskeleton uses biomedical signals reflecting the user intention as input, and its algorithm is calculated as an output to make the movement smooth. However, the process of transforming the input of biomedical signals, such as electromyography (EMG), into the output of adjusting the torque and angle of the exoskeleton is limited by a finite time lag and precision of trajectory prediction, which result in a mismatch between the subject and exoskeleton. Here, we propose an EMG-based single-joint exoskeleton system by merging a differentiable continuous system with a dynamic musculoskeletal model. The parameters of each muscle contraction were calculated and applied to the rigid exoskeleton system to predict the precise trajectory. The results revealed accurate torque and angle prediction for the knee exoskeleton and good performance of assistance during movement. Our method outperformed other models regarding the rate of convergence and execution time. In conclusion, a differentiable continuous system merged with a dynamic musculoskeletal model supported the effective and accurate performance of an exoskeleton controlled by EMG signals.