Design and effectiveness evaluation of mirror myoelectric interfaces: a novel method to restore movement in hemiplegic patients

A hybrid brain-muscle-machine interface for stroke rehabilitation: Usability and functionality validation in a 2-week intensive intervention

Introduction: The primary constraint of non-invasive brain-machine interfaces (BMIs) in stroke rehabilitation lies in the poor spatial resolution of motor intention related neural activity capture. To address this limitation, hybrid brain-muscle-machine interfaces (hBMIs) have been suggested as superior alternatives. These hybrid interfaces incorporate supplementary input data from muscle signals to enhance the accuracy, smoothness and dexterity of rehabilitation device control. Nevertheless, determining the distribution of control between the brain and muscles is a complex task, particularly when applied to exoskeletons with multiple degrees of freedom (DoFs). Here we present a feasibility, usability and functionality study of a bio-inspired hybrid brain-muscle machine interface to continuously control an upper limb exoskeleton with 7 DoFs. Methods: The system implements a hierarchical control strategy that follows the biologically natural motor command pathway from the brain to the muscles. Additionally, it employs an innovative mirror myoelectric decoder, offering patients a reference model to assist them in relearning healthy muscle activation patterns during training. Furthermore, the multi-DoF exoskeleton enables the practice of coordinated arm and hand movements, which may facilitate the early use of the affected arm in daily life activities. In this pilot trial six chronic and severely paralyzed patients controlled the multi-DoF exoskeleton using their brain and muscle activity. The intervention consisted of 2 weeks of hBMI training of functional tasks with the system followed by physiotherapy. Patients' feedback was collected during and after the trial by means of several feedback questionnaires. Assessment sessions comprised clinical scales and neurophysiological measurements, conducted prior to, immediately following the intervention, and at a 2-week follow-up. Results: Patients' feedback indicates a great adoption of the technology and their confidence in its rehabilitation potential. Half of the patients showed improvements in their arm function and 83% improved their hand function. Furthermore, we found improved patterns of muscle activation as well as increased motor evoked potentials after the intervention. Discussion: This underscores the significant potential of bio-inspired interfaces that engage the entire nervous system, spanning from the brain to the muscles, for the rehabilitation of stroke patients, even those who are severely paralyzed and in the chronic phase.

Myoelectric control and virtual reality to enhance motor rehabilitation after stroke

Effective upper-limb rehabilitation for severely impaired stroke survivors is still missing. Recent studies endorse novel motor rehabilitation approaches such as robotic exoskeletons and virtual reality systems to restore the function of the paretic limb of stroke survivors. However, the optimal way to promote the functional reorganization of the central nervous system after a stroke has yet to be uncovered. Electromyographic (EMG) signals have been employed for prosthetic control, but their application to rehabilitation has been limited. Here we propose a novel approach to promote the reorganization of pathological muscle activation patterns and enhance upper-limb motor recovery in stroke survivors by using an EMG-controlled interface to provide personalized assistance while performing movements in virtual reality (VR). We suggest that altering the visual feedback to improve motor performance in VR, thereby reducing the effect of deviations of the actual, dysfunctional muscle patterns from the functional ones, will actively engage patients in motor learning and facilitate the restoration of functional muscle patterns. An EMG-controlled VR interface may facilitate effective rehabilitation by targeting specific changes in the structure of muscle synergies and in their activations that emerged after a stroke-offering the possibility to provide rehabilitation therapies addressing specific individual impairments.

Multi-layer CNN-LSTM network with self-attention mechanism for robust estimation of nonlinear uncertain systems

Introduction

With the help of robot technology, intelligent rehabilitation of patients with lower limb motor dysfunction caused by stroke can be realized. A key factor constraining the clinical application of rehabilitation robots is how to realize pattern recognition of human movement intentions by using the surface electromyography (sEMG) sensors to ensure unhindered human-robot interaction.

Methods

A multilayer CNN-LSTM prediction network incorporating the self-attention mechanism (SAM) is proposed, in this paper, which can extract and learn the periodic and trend characteristics of the sEMG signals, and realize the accurate autoregressive prediction of the human motion information. Firstly, the multilayer CNN-LSTM network utilizes the CNN layer for initial feature extraction of data, and the LSTM network is used to improve the enhancement of the historical time-series features. Then, the SAM is used to improve the global feature extraction performance and parallel computation speed of the network.

Results

In comparison with existing test is carried out using actual data from five healthy subjects as well as a clinical hemiplegic patient to verify the superiority and practicality of the proposed algorithm. The results show that most of the model's prediction R > 0.9 for different motion states of healthy subjects; in the experiments oriented to the motion characteristics of patient subjects, the angle prediction results of R > 0.99 for the untrained data on the affected side, which proves that our proposed model also has a better effect on the angle prediction of the affected side.

Discussion

The main contribution of this paper is to realize continuous motion estimation of ankle joint for healthy and hemiplegic individuals under non-ideal conditions (weak sEMG signals, muscle fatigue, high muscle tension, etc.), which improves the pattern recognition accuracy and robustness of the sEMG sensor-based system.

Real-Time Control of a Multi-Degree-of-Freedom Mirror Myoelectric Interface During Functional Task Training

Motor learning mediated by motor training has in the past been explored for rehabilitation. Myoelectric interfaces together with exoskeletons allow patients to receive real-time feedback about their muscle activity. However, the number of degrees of freedom that can be simultaneously controlled is limited, which hinders the training of functional tasks and the effectiveness of the rehabilitation therapy. The objective of this study was to develop a myoelectric interface that would allow multi-degree-of-freedom control of an exoskeleton involving arm, wrist and hand joints, with an eye toward rehabilitation. We tested the effectiveness of a myoelectric decoder trained with data from one upper limb and mirrored to control a multi-degree-of-freedom exoskeleton with the opposite upper limb (i.e., mirror myoelectric interface) in 10 healthy participants. We demonstrated successful simultaneous control of multiple upper-limb joints by all participants. We showed evidence that subjects learned the mirror myoelectric model within the span of a five-session experiment, as reflected by a significant decrease in the time to execute trials and in the number of failed trials. These results are the necessary precursor to evaluating if a decoder trained with EMG from the healthy limb could foster learning of natural EMG patterns and lead to motor rehabilitation in stroke patients.

FITFES: A Wearable Myoelectrically Controlled Functional Electrical Stimulator Designed Using a User-Centered Approach

Myoelectrically Controlled Functional Electrical Stimulation (MeCFES) has proven to be a useful tool in the rehabilitation of the hemiplegic arm. This paper reports the steps involved in the development of a wearable MeCFES device (FITFES) through a user-centered design. We defined the minimal viable features and functionalities requirements for the device design from a questionnaire-based survey among physiotherapists with experience in functional electrical stimulation. The result was a necklace layout that poses minimal hindrance to task-oriented movement therapy, the context in which it is aimed to be used. FITFES is battery-powered and embeds a standard low power Bluetooth module, enabling wireless control by using PC/Mobile devices vendor specific built-in libraries. It is designed to deliver a biphasic, charge-balanced stimulation current pulses of up to 113 mA with a maximum differential voltage of 300 V. The power consumption for typical clinical usage is 320 mW at 20mA stimulation current and of less than [Formula: see text] in sleep mode, thus ensuring an estimated full day of FITFES therapy on a battery charge. We conclude that a multidisciplinary user-centered approach can be successfully applied to the design of a clinically and ergonomically viable prototype of a wearable myoelectrically controlled functional electrical stimulator to be used in rehabilitation.

Preliminary Assessment of a Postural Synergy-Based Exoskeleton for Post-Stroke Upper Limb Rehabilitation

Upper limb exoskeletons have drawn significant attention in neurorehabilitation because of the anthropomorphic mechanical structure analogous to human anatomy. Whereas, the training movements are typically unorganized because most exoskeletons ignore the natural movement characteristic of human upper limbs, particularly inter-joint postural synergy. This paper introduces a newly developed exoskeleton (Armule) for upper limb rehabilitation with a postural synergy design concept, which can reproduce activities of daily living (ADL) motion with the characteristics of human natural movements. The semitransparent active control strategy with the interactive force guidance and visual feedback ensured the active participation of users. Eight participants with hemiplegia due to a first-ever, unilateral stroke were recruited and included. They participated in exoskeleton therapy sessions for 4 weeks, with passive/active training under trajectories and postures with the characteristics of human natural movements. The primary outcome was the Fugl-Meyer Assessment for Upper Extremities (FMA-UE). The secondary outcomes were the Action Research Arm Test(ARAT), modified Barthel Index (mBI), and metric measured with the exoskeleton After the 4-weeks intervention, all subjects showed significant improvements in the following clinical measures: the FMA-UE (difference, 11.50 points, p = 0.002), the ARAT (difference, 7.75 points ), and the mBI (difference, 17.50 points, p = 0.003 ) score. Besides, all subjects showed significant improvements in kinematic and interaction force metrics measured with the exoskeleton. These preliminary results demonstrate that the Armule exoskeleton could improve individuals' motor control and ADL function after stroke, which might be associated with kinematic and interaction force optimization and postural synergy modification during functional tasks.

Functional synergy recruitment index as a reliable biomarker of motor function and recovery in chronic stroke patients

Objective. Stroke affects the expression of muscle synergies underlying motor control, most notably in patients with poorer motor function. The majority of studies on muscle synergies have conventionally approached this analysis by assuming alterations in the inner structures of synergies after stroke. Although different synergy-based features based on this assumption have to some extent described pathological mechanisms in post-stroke neuromuscular control, a biomarker that reliably reflects motor function and recovery is still missing.Approach. Based on the theory of muscle synergies, we alternatively hypothesize that functional synergy structures are physically preserved and measure the temporal correlation between the recruitment profiles of healthy modules by paretic and healthy muscles, a feature hereafter reported as the FSRI. We measured clinical scores and extracted the muscle synergies of both ULs of 18 chronic stroke survivors from the electromyographic activity of 8 muscles during bilateral movements before and after 4 weeks of non-invasive BMI controlled robot therapy and physiotherapy. We computed the FSRI as well as features quantifying inter-limb structural differences and evaluated the correlation of these synergy-based measures with clinical scores.Main results. Correlation analysis revealed weak relationships between conventional features describing inter-limb synergy structural differences and motor function. In contrast, FSRI values during specific or combined movement data significantly correlated with UL motor function and recovery scores. Additionally, we observed that BMI-based training with contingent positive proprioceptive feedback led to improved FSRI values during the specific trained finger extension movement.Significance. We demonstrated that FSRI can be used as a reliable physiological biomarker of motor function and recovery in stroke, which can be targeted via BMI-based proprioceptive therapies and adjuvant physiotherapy to boost effective rehabilitation.

[Mirror-type rehabilitation training with dynamic adjustment and assistance for shoulder joint]

The real physical image of the affected limb, which is difficult to move in the traditional mirror training, can be realized easily by the rehabilitation robots. During this training, the affected limb is often in a passive state. However, with the gradual recovery of the movement ability, active mirror training becomes a better choice. Consequently, this paper took the self-developed shoulder joint rehabilitation robot with an adjustable structure as an experimental platform, and proposed a mirror training system completed by next four parts. First, the motion trajectory of the healthy limb was obtained by the Inertial Measurement Units (IMU). Then the variable universe fuzzy adaptive proportion differentiation (PD) control was adopted for inner loop, meanwhile, the muscle strength of the affected limb was estimated by the surface electromyography (sEMG). The compensation force for an assisted limb of outer loop was calculated. According to the experimental results, the control system can provide real-time assistance compensation according to the recovery of the affected limb, fully exert the training initiative of the affected limb, and make the affected limb achieve better rehabilitation training effect.

Systematic review of novel technology-based interventions for ischemic stroke

PURPOSE

To identify novel technologies pertinent to the prevention, diagnosis, treatment, and rehabilitation of ischemic stroke, and recommend the technologies that show the most promise in advancing ischemic stroke care.

METHOD

A systematic literature search on PubMed and Medscape was performed. Articles were assessed based on pre-determined criteria. Included journal articles were evaluated for specific characteristics and reviewed according to a structured paradigm. A search on www.clinicaltrials.gov was performed to identify pre-clinical ischemic stroke technological interventions. All clinical trial results were included. An additional search on PubMed was conducted to identify studies on robotic neuroendovascular procedures.

RESULTS

Thirty journal articles and five clinical trials were analyzed. Articles were categorized as follows: six studies pertinent to pre-morbidity and prevention of ischemic stroke, three studies relevant to the diagnosis of ischemic stroke, 16 studies about post-ischemic stroke rehabilitation, and five studies on robotic neuroendovascular interventions.

CONCLUSIONS

Novel technologies across the spectrum of ischemic stroke care were identified, and the ones that appear to have the most clinical utility are recommended. Future investigation of the feasibility and long-term efficacy of the recommended technologies in clinical settings is warranted.

A novel energy-motion model for continuous sEMG decoding: from muscle energy to motor pattern

At present, sEMG-based gesture recognition requires vast amounts of training data; otherwise it is limited to a few gestures. Objective. This paper presents a novel dynamic energy model that decodes continuous hand actions by training small amounts of sEMG data. Approach. The activation of forearm muscles can set the corresponding fingers in motion or state with movement trends. The moving fingers store kinetic energy, and the fingers with movement trends store potential energy. The kinetic energy and potential energy in each finger are dynamically allocated due to the adaptive-coupling mechanism of five-fingers in actual motion. Meanwhile, the sum of the two energies remains constant at a certain muscle activation. We regarded hand movements with the same direction of acceleration for five-finger as the same in energy mode and divided hand movements into ten energy modes. Independent component analysis and machine learning methods were used to model associations between sEMG signals and energy modes and expressed gestures by energy form adaptively. This theory imitates the self-adapting mechanism in actual tasks. Thus, ten healthy subjects were recruited, and three experiments mimicking activities of daily living were designed to evaluate the interface: (1) the expression of untrained gestures, (2) the decoding of the amount of single-finger energy, and (3) real-time control. Main results. (1) Participants completed the untrained hand movements (100/100, p < 0.0001). (2) The interface performed better than chance in the experiment where participants pricked balloons with a needle tip (779/1000, p < 0.0001). (3) In the experiment where participants punched a hole in the plasticine on the balloon, the success rate was over 95% (97.67 ± 5.04%, p < 0.01). Significance. The model can achieve continuous hand actions with speed or force information by training small amounts of sEMG data, which reduces learning task complexity.