Assessing movement factors in upper limb kinematics decoding from EEG signals

Modeling the cortical response elicited by wrist manipulation via a nonlinear delay differential embedding

Regarding motor processes, modeling healthy people's brains is essential to understand the brain activity in people with motor impairments. However, little research has been undertaken when external forces disturb limbs, having limited information on physiological pathways. Therefore, in this paper, a nonlinear delay differential embedding model is used to estimate the brain response elicited by externally controlled wrist movement in healthy individuals. The aim is to improve the understanding of the relationship between a controlled wrist movement and the generated cortical activity of healthy people, helping to disclose the underlying mechanisms and physiological relationships involved in the motor event. To evaluate the model, a public database from the Delft University of Technology is used, which contains electroencephalographic recordings of ten healthy subjects while wrist movement was externally provoked by a robotic system. In this work, the cortical response related to movement is identified via Independent Component Analysis and estimated based on a nonlinear delay differential embedding model. After a cross-validation analysis, the model performance reaches 90.21% ± 4.46% Variance Accounted For, and Correlation 95.14% ± 2.31%. The proposed methodology allows to select the model degree, to estimate a general predominant operation mode of the cortical response elicited by wrist movement. The obtained results revealed two facts that had not previously been reported: the movement's acceleration affects the cortical response, and a common delayed activity is shared among subjects. Going forward, identifying biomarkers related to motor tasks could aid in the evaluation of rehabilitation treatments for patients with upper limbs motor impairments.

Decoding movement kinematics from EEG using an interpretable convolutional neural network

Continuous decoding of hand kinematics has been recently explored for the intuitive control of electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs). Deep neural networks (DNNs) are emerging as powerful decoders, for their ability to automatically learn features from lightly pre-processed signals. However, DNNs for kinematics decoding lack in the interpretability of the learned features and are only used to realize within-subject decoders without testing other training approaches potentially beneficial for reducing calibration time, such as transfer learning. Here, we aim to overcome these limitations by using an interpretable convolutional neural network (ICNN) to decode 2-D hand kinematics (position and velocity) from EEG in a pursuit tracking task performed by 13 participants. The ICNN is trained using both within-subject and cross-subject strategies, and also testing the feasibility of transferring the knowledge learned on other subjects on a new one. Moreover, the network eases the interpretation of learned spectral and spatial EEG features. Our ICNN outperformed most of the other state-of-the-art decoders, showing the best trade-off between performance, size, and training time. Furthermore, transfer learning improved kinematics prediction in the low data regime. The network attributed the highest relevance for decoding to the delta-band across all subjects, and to higher frequencies (alpha, beta, low-gamma) for a cluster of them; contralateral central and parieto-occipital sites were the most relevant, reflecting the involvement of sensorimotor, visual and visuo-motor processing. The approach improved the quality of kinematics prediction from the EEG, at the same time allowing interpretation of the most relevant spectral and spatial features.

Literature review of stroke assessment for upper-extremity physical function via EEG, EMG, kinematic, and kinetic measurements and their reliability

BACKGROUND

Significant clinician training is required to mitigate the subjective nature and achieve useful reliability between measurement occasions and therapists. Previous research supports that robotic instruments can improve quantitative biomechanical assessments of the upper limb, offering reliable and more sensitive measures. Furthermore, combining kinematic and kinetic measurements with electrophysiological measurements offers new insights to unlock targeted impairment-specific therapy. This review presents common methods for analyzing biomechanical and neuromuscular data by describing their validity and reporting their reliability measures.

METHODS

This paper reviews literature (2000-2021) on sensor-based measures and metrics for upper-limb biomechanical and electrophysiological (neurological) assessment, which have been shown to correlate with clinical test outcomes for motor assessment. The search terms targeted robotic and passive devices developed for movement therapy. Journal and conference papers on stroke assessment metrics were selected using PRISMA guidelines. Intra-class correlation values of some of the metrics are recorded, along with model, type of agreement, and confidence intervals, when reported.

RESULTS

A total of 60 articles are identified. The sensor-based metrics assess various aspects of movement performance, such as smoothness, spasticity, efficiency, planning, efficacy, accuracy, coordination, range of motion, and strength. Additional metrics assess abnormal activation patterns of cortical activity and interconnections between brain regions and muscle groups; aiming to characterize differences between the population who had a stroke and the healthy population.

CONCLUSION

Range of motion, mean speed, mean distance, normal path length, spectral arc length, number of peaks, and task time metrics have all demonstrated good to excellent reliability, as well as provide a finer resolution compared to discrete clinical assessment tests. EEG power features for multiple frequency bands of interest, specifically the bands relating to slow and fast frequencies comparing affected and non-affected hemispheres, demonstrate good to excellent reliability for populations at various stages of stroke recovery. Further investigation is needed to evaluate the metrics missing reliability information. In the few studies combining biomechanical measures with neuroelectric signals, the multi-domain approaches demonstrated agreement with clinical assessments and provide further information during the relearning phase. Combining the reliable sensor-based metrics in the clinical assessment process will provide a more objective approach, relying less on therapist expertise. This paper suggests future work on analyzing the reliability of metrics to prevent biasedness and selecting the appropriate analysis.

Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals

Brain-machine interfaces (BMIs) have become increasingly popular in restoring the lost motor function in individuals with disabilities. Several research studies suggest that the CNS may employ synergies or movement primitives to reduce the complexity of control rather than controlling each DoF independently, and the synergies can be used as an optimal control mechanism by the CNS in simplifying and achieving complex movements. Our group has previously demonstrated neural decoding of synergy-based hand movements and used synergies effectively in driving hand exoskeletons. In this study, ten healthy right-handed participants were asked to perform six types of hand grasps representative of the activities of daily living while their neural activities were recorded using electroencephalography (EEG). From half of the participants, hand kinematic synergies were derived, and a neural decoder was developed, based on the correlation between hand synergies and corresponding cortical activity, using multivariate linear regression. Using the synergies and the neural decoder derived from the first half of the participants and only cortical activities from the remaining half of the participants, their hand kinematics were reconstructed with an average accuracy above 70%. Potential applications of synergy-based BMIs for controlling assistive devices in individuals with upper limb motor deficits, implications of the results in individuals with stroke and the limitations of the study were discussed.

Response of the Cerebral Cortex to Resistance and Non-resistance Exercise Under Different Trajectories: A Functional Near-Infrared Spectroscopy Study

Background: At present, the effects of upper limb movement are generally evaluated from the level of motor performance. The purpose of this study is to evaluate the response of the cerebral cortex to different upper limb movement patterns from the perspective of neurophysiology.

Method: Thirty healthy adults (12 females, 18 males, mean age 23.9 ± 0.9 years) took resistance and non-resistance exercises under four trajectories (T1: left and right straight-line movement; T2: front and back straight-line movement; T3: clockwise and anticlockwise drawing circle movement; and T4: clockwise and anticlockwise character ⁕ movement). Each movement included a set of periodic motions composed of a 30-s task and a 30-s rest. Functional near-infrared spectroscopy (fNIRS) was used to measure cerebral blood flow dynamics. Primary somatosensory cortex (S1), supplementary motor area (SMA), pre-motor area (PMA), primary motor cortex (M1), and dorsolateral prefrontal cortex (DLPFC) were chosen as regions of interests (ROIs). Activation maps and symmetric heat maps were applied to assess the response of the cerebral cortex to different motion patterns.

Result: The activation of the brain cortex was significantly increased during resistance movement for each participant. Specifically, S1, SMA, PMA, and M1 had higher participation during both non-resistance movement and resistance movement. Compared to non-resistance movement, the resistance movement caused an obvious response in the cerebral cortex. The task state and the resting state were distinguished more obviously in the resistance movement. Four trajectories can be distinguished under non-resistance movement.

Conclusion: This study confirmed that the response of the cerebral motor cortex to different motion patterns was different from that of the neurophysiological level. It may provide a reference for the evaluation of resistance training effects in the future.

Reconstruction of hand, elbow and shoulder actual and imagined trajectories in 3D space using EEG current source dipoles

OBJECTIVE

Growing evidence suggests that EEG electrode (sensor) potential time series (PTS) of slow cortical potentials (SCPs) hold motor neural correlates that can be used for motion trajectory prediction (MTP), commonly by multiple linear regression (mLR). It is not yet known whether arm-joint trajectories can be reliably decoded from current sources, computed from sensor data, from which brain areas they can be decoded and using which neural features.

APPROACH

In this study, the PTS of 44 sensors were fed into sLORETA source localization software to compute current source activity in 30 regions of interest (ROIs) found in a recent meta-analysis to be engaged in action execution, motor imagery and motor preparation. The current sources PTS and band-power time series (BTS) in several frequency bands and time lags were used to predict actual and imagined trajectories in 3D space of the three velocity components of the hand, elbow and shoulder of nine subjects using an mLR model.

MAIN RESULTS

For all arm joints and movement types, current source SCPs PTS contributed most to trajectory reconstruction with time lags 150ms, 116ms and 84ms providing the highest contribution, and current source BTS in any of the tested frequency bands was not informative. Person's correlation coefficient (r) averaged across movement types, arm joints and velocity components using source data was slightly lower than using sensor data (r=0.25 and r=0.28, respectively). For each ROI, the three current source dipoles had different contribution to the reconstruction of each of the three velocity components.

SIGNIFICANCE

Overall, our results demonstrate the feasibility of predicting of actual and imagined 3D trajectories of all arm joints from current sources, computed from scalp EEG. These findings may be used by developers of a future BCI as a validated set of contributing ROIs.

Neural decoding of continuous upper limb movements: a meta-analysis

OBJECTIVE

EEG-based motion trajectory decoding makes a promising approach for neurotechnology which can be used for neural control of motion reconstruction and neurorehabilitation tools. However, the feasibility and validity of continuous motion decoding by non-invasive brain activity are not clear. The main aim of this study was to perform a meta-analysis across studies that examined the ability of EEG-based continuous motion decoding of upper limb movements.

APPROACH

Pearson's correlation coefficient (CC) was used to evaluate the model performance of the studies and considered as an effect size. To estimate the overall effect size of neural decoding of motion trajectory across studies, characteristics of included studies were addressed and the random effect model was applied to the heterogeneous studies which estimated overall effect size distribution. Furthermore, the significant difference between the two subgroups of imagined and executed movements was analysed.

MAIN RESULTS

The mean of the overall effect size was computed 0.46 across the nonhomogeneous studies. The results showed no significant difference between imagined and executed movements (Chi²=0.28, df = 1, p = 0.60).

SIGNIFICANCE

Meta-analysis results confirm that imagination like execution movements can be used for neural decoding of motion trajectory in neural motor control systems. Also, nonlinear compare with linear model statistically confirmed to be more beneficial for complex movements. Furthermore, a new approach of synergy-based motion decoding can be significantly effective to increase model performance and more research needs to evaluate this method for different levels of complexity of movements.IMPLICATIONS FOR REHABILITATIONNeural decoding methods base on EEG as a non-invasive brain activity, are more user friendly for neurorehabilitation than invasive methods that developing of it makes it more applicable for reconstructing activities of daily living.Neurotechnology for neural control of motion reconstruction, makes the rehabilitation tools to be more synchrony with human intentional movement that can be used to improve the brain neuroplastisity in stroke or other paralysed people.The feasibility and validity of imagined movements equal with executed movements show that amputee people also can benefit EEG-based motion decoding for controling rehabilitation tools just by imagination of their intentional movements.For neurorehabilitation tools, comparing the study outcomes illucidate that the approach of synergy-based motor control in brain activities concluded significantly high performance that highlighted the need it to more investigated in future research.

Intra- and Inter-subject Variability in EEG-Based Sensorimotor Brain Computer Interface: A Review

Brain computer interfaces (BCI) for the rehabilitation of motor impairments exploit sensorimotor rhythms (SMR) in the electroencephalogram (EEG). However, the neurophysiological processes underpinning the SMR often vary over time and across subjects. Inherent intra- and inter-subject variability causes covariate shift in data distributions that impede the transferability of model parameters amongst sessions/subjects. Transfer learning includes machine learning-based methods to compensate for inter-subject and inter-session (intra-subject) variability manifested in EEG-derived feature distributions as a covariate shift for BCI. Besides transfer learning approaches, recent studies have explored psychological and neurophysiological predictors as well as inter-subject associativity assessment, which may augment transfer learning in EEG-based BCI. Here, we highlight the importance of measuring inter-session/subject performance predictors for generalized BCI frameworks for both normal and motor-impaired people, reducing the necessity for tedious and annoying calibration sessions and BCI training.

Characteristics of Kinematic Parameters in Decoding Intended Reaching Movements Using Electroencephalography (EEG)

The utility of premovement electroencephalography (EEG) for decoding movement intention during a reaching task has been demonstrated. However, the kind of information the brain represents regarding the intended target during movement preparation remains unknown. In the present study, we investigated which movement parameters (i.e., direction, distance, and positions for reaching) can be decoded in premovement EEG decoding. Eight participants performed 30 types of reaching movements that consisted of 1 of 24 movement directions, 7 movement distances, 5 horizontal target positions, and 5 vertical target positions. Event-related spectral perturbations were extracted using independent components, some of which were selected via an analysis of variance for further binary classification analysis using a support vector machine. When each parameter was used for class labeling, all possible binary classifications were performed. Classification accuracies for direction and distance were significantly higher than chance level, although no significant differences were observed for position. For the classification in which each movement was considered as a different class, the parameters comprising two vectors representing each movement were analyzed. In this case, classification accuracies were high when differences in distance were high, the sum of distances was high, angular differences were large, and differences in the target positions were high. The findings further revealed that direction and distance may provide the largest contributions to movement. In addition, regardless of the parameter, useful features for classification are easily found over the parietal and occipital areas.

Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury

We show that persons with spinal cord injury (SCI) retain decodable neural correlates of attempted arm and hand movements. We investigated hand open, palmar grasp, lateral grasp, pronation, and supination in 10 persons with cervical SCI. Discriminative movement information was provided by the time-domain of low-frequency electroencephalography (EEG) signals. Based on these signals, we obtained a maximum average classification accuracy of 45% (chance level was 20%) with respect to the five investigated classes. Pattern analysis indicates central motor areas as the origin of the discriminative signals. Furthermore, we introduce a proof-of-concept to classify movement attempts online in a closed loop, and tested it on a person with cervical SCI. We achieved here a modest classification performance of 68.4% with respect to palmar grasp vs hand open (chance level 50%).

Non-invasive decoding of hand movements from electroencephalography based on a hierarchical linear regression model

A non-invasive brain-computer interface (BCI) is an assistive technology with basic communication and control capabilities that decodes continuous electroencephalography (EEG) signals generated by the human brain and converts them into commands to control external devices naturally. However, the decoding efficiency is limited at present because it is unclear which decoding parameters can be used to effectively improve the overall decoding performance. In this paper, five subjects performed experiments involving self-initiated upper-limb movements during three experimental phases. The decoding method based on a hierarchical linear regression (HLR) model was devised to investigate the influence of decoding efficiency according to the characteristic parameters of brain functional networks. Then the optimal set of channels and most sensitive frequency bands were selected using the p value from a Kruskal-Wallis test in the experimental phases. Eventually, the trajectories of free movement and conical helix movement could be decoded using HLR. The experimental result showed that the Pearson correlation coefficient (R) between the measured and decoded paths is 0.66 with HLR, which was higher than the value of 0.46 obtained with the multiple linear regression model. The HLR from a decoding efficiency perspective holds promise for the development of EEG-based BCI to aid in the restoration of hand movements in post-stroke rehabilitation.

Estimation of Neuromuscular Primitives from EEG Slow Cortical Potentials in Incomplete Spinal Cord Injury Individuals for a New Class of Brain-Machine Interfaces

One of the current challenges in human motor rehabilitation is the robust application of Brain-Machine Interfaces to assistive technologies such as powered lower limb exoskeletons. Reliable decoding of motor intentions and accurate timing of the robotic device actuation is fundamental to optimally enhance the patient's functional improvement. Several studies show that it may be possible to extract motor intentions from electroencephalographic (EEG) signals. These findings, although notable, suggests that current techniques are still far from being systematically applied to an accurate real-time control of rehabilitation or assistive devices. Here we propose the estimation of spinal primitives of multi-muscle control from EEG, using electromyography (EMG) dimensionality reduction as a solution to increase the robustness of the method. We successfully apply this methodology, both to healthy and incomplete spinal cord injury (SCI) patients, to identify muscle contraction during periodical knee extension from the EEG. We then introduce a novel performance metric, which accurately evaluates muscle primitive activations.

From classic motor imagery to complex movement intention decoding: The noninvasive Graz-BCI approach

In this chapter, we give an overview of the Graz-BCI research, from the classic motor imagery detection to complex movement intentions decoding. We start by describing the classic motor imagery approach, its application in tetraplegic end users, and the significant improvements achieved using coadaptive brain-computer interfaces (BCIs). These strategies have the drawback of not mirroring the way one plans a movement. To achieve a more natural control-and to reduce the training time-the movements decoded by the BCI need to be closely related to the user's intention. Within this natural control, we focus on the kinematic level, where movement direction and hand position or velocity can be decoded from noninvasive recordings. First, we review movement execution decoding studies, where we describe the decoding algorithms, their performance, and associated features. Second, we describe the major findings in movement imagination decoding, where we emphasize the importance of estimating the sources of the discriminative features. Third, we introduce movement target decoding, which could allow the determination of the target without knowing the exact movement-by-movement details. Aside from the kinematic level, we also address the goal level, which contains relevant information on the upcoming action. Focusing on hand-object interaction and action context dependency, we discuss the possible impact of some recent neurophysiological findings in the future of BCI control. Ideally, the goal and the kinematic decoding would allow an appropriate matching of the BCI to the end users' needs, overcoming the limitations of the classic motor imagery approach.

Classification of upper limb center-out reaching tasks by means of EEG-based continuous decoding techniques

Background

One of the current challenges in brain-machine interfacing is to characterize and decode upper limb kinematics from brain signals, e.g. to control a prosthetic device. Recent research work states that it is possible to do so based on low frequency EEG components. However, the validity of these results is still a matter of discussion. In this paper, we assess the feasibility of decoding upper limb kinematics from EEG signals in center-out reaching tasks during passive and active movements.

Methods

The decoding of arm movement was performed using a multidimensional linear regression. Passive movements were analyzed using the same methodology to study the influence of proprioceptive sensory feedback in the decoding. Finally, we evaluated the possible advantages of classifying reaching targets, instead of continuous trajectories.

Results

The results showed that arm movement decoding was significantly above chance levels. The results also indicated that EEG slow cortical potentials carry significant information to decode active center-out movements. The classification of reached targets allowed obtaining the same conclusions with a very high accuracy. Additionally, the low decoding performance obtained from passive movements suggests that discriminant modulations of low-frequency neural activity are mainly related to the execution of movement while proprioceptive feedback is not sufficient to decode upper limb kinematics.

Conclusions

This paper contributes to the assessment of feasibility of using linear regression methods to decode upper limb kinematics from EEG signals. From our findings, it can be concluded that low frequency bands concentrate most of the information extracted from upper limb kinematics decoding and that decoding performance of active movements is above chance levels and mainly related to the activation of cortical motor areas. We also show that the classification of reached targets from decoding approaches may be a more suitable real-time methodology than a direct decoding of hand position.