Proposal of a Wearable Multimodal Sensing-Based Serious Games Approach for Hand Movement Training After Stroke

Post-stroke hand gesture recognition via one-shot transfer learning using prototypical networks

BACKGROUND

In-home rehabilitation systems are a promising, potential alternative to conventional therapy for stroke survivors. Unfortunately, physiological differences between participants and sensor displacement in wearable sensors pose a significant challenge to classifier performance, particularly for people with stroke who may encounter difficulties repeatedly performing trials. This makes it challenging to create reliable in-home rehabilitation systems that can accurately classify gestures.

METHODS

Twenty individuals who suffered a stroke performed seven different gestures (mass flexion, mass extension, wrist volar flexion, wrist dorsiflexion, forearm pronation, forearm supination, and rest) related to activities of daily living. They performed these gestures while wearing EMG sensors on the forearm, as well as FMG sensors and an IMU on the wrist. We developed a model based on prototypical networks for one-shot transfer learning, K-Best feature selection, and increased window size to improve model accuracy. Our model was evaluated against conventional transfer learning with neural networks, as well as subject-dependent and subject-independent classifiers: neural networks, LGBM, LDA, and SVM.

RESULTS

Our proposed model achieved 82.2% hand-gesture classification accuracy, which was better (P<0.05) than one-shot transfer learning with neural networks (63.17%), neural networks (59.72%), LGBM (65.09%), LDA (63.35%), and SVM (54.5%). In addition, our model performed similarly to subject-dependent classifiers, slightly lower than SVM (83.84%) but higher than neural networks (81.62%), LGBM (80.79%), and LDA (74.89%). Using K-Best features improved the accuracy in 3 of the 6 classifiers used for evaluation, while not affecting the accuracy in the other classifiers. Increasing the window size improved the accuracy of all the classifiers by an average of 4.28%.

CONCLUSION

Our proposed model showed significant improvements in hand-gesture recognition accuracy in individuals who have had a stroke as compared with conventional transfer learning, neural networks and traditional machine learning approaches. In addition, K-Best feature selection and increased window size can further improve the accuracy. This approach could help to alleviate the impact of physiological differences and create a subject-independent model for stroke survivors that improves the classification accuracy of wearable sensors.

TRIAL REGISTRATION NUMBER

The study was registered in Chinese Clinical Trial Registry with registration number CHiCTR1800017568 in 2018/08/04.

Behavior Change Approaches in Digital Technology-Based Physical Rehabilitation Interventions Following Stroke: Scoping Review

BACKGROUND

Digital health technologies (DHTs) are increasingly used in physical stroke rehabilitation to support individuals in successfully engaging with the frequent, intensive, and lengthy activities required to optimize recovery. Despite this, little is known about behavior change within these interventions.

OBJECTIVE

This scoping review aimed to identify if and how behavior change approaches (ie, theories, models, frameworks, and techniques to influence behavior) are incorporated within physical stroke rehabilitation interventions that include a DHT.

METHODS

Databases (Embase, MEDLINE, PsycINFO, CINAHL, Cochrane Library, and AMED) were searched using keywords relating to behavior change, DHT, physical rehabilitation, and stroke. The results were independently screened by 2 reviewers. Sources were included if they reported a completed primary research study in which a behavior change approach could be identified within a physical stroke rehabilitation intervention that included a DHT. Data, including the study design, DHT used, and behavior change approaches, were charted. Specific behavior change techniques were coded to the behavior change technique taxonomy version 1 (BCTTv1).

RESULTS

From a total of 1973 identified sources, 103 (5%) studies were included for data charting. The most common reason for exclusion at full-text screening was the absence of an explicit approach to behavior change (165/245, 67%). Almost half (45/103, 44%) of the included studies were described as pilot or feasibility studies. Virtual reality was the most frequently identified DHT type (58/103, 56%), and almost two-thirds (65/103, 63%) of studies focused on upper limb rehabilitation. Only a limited number of studies (18/103, 17%) included a theory, model, or framework for behavior change. The most frequently used BCTTv1 clusters were feedback and monitoring (88/103, 85%), reward and threat (56/103, 54%), goals and planning (33/103, 32%), and shaping knowledge (33/103, 32%). Relationships between feedback and monitoring and reward and threat were identified using a relationship map, with prominent use of both of these clusters in interventions that included virtual reality.

CONCLUSIONS

Despite an assumption that DHTs can promote engagement in rehabilitation, this scoping review demonstrates that very few studies of physical stroke rehabilitation that include a DHT overtly used any form of behavior change approach. From those studies that did consider behavior change, most did not report a robust underpinning theory. Future development and research need to explicitly articulate how including DHTs within an intervention may support the behavior change required for optimal engagement in physical rehabilitation following stroke, as well as establish their effectiveness. This understanding is likely to support the realization of the transformative potential of DHTs in stroke rehabilitation.

Tapping Into Skeletal Muscle Biomechanics for Design and Control of Lower Limb Exoskeletons: A Narrative Review

Lower limb exoskeletons and exosuits ("exos") are traditionally designed with a strong focus on mechatronics and actuation, whereas the "human side" is often disregarded or minimally modeled. Muscle biomechanics principles and skeletal muscle response to robot-delivered loads should be incorporated in design/control of exos. In this narrative review, we summarize the advances in literature with respect to the fusion of muscle biomechanics and lower limb exoskeletons. We report methods to measure muscle biomechanics directly and indirectly and summarize the studies that have incorporated muscle measures for improved design and control of intuitive lower limb exos. Finally, we delve into articles that have studied how the human-exo interaction influences muscle biomechanics during locomotion. To support neurorehabilitation and facilitate everyday use of wearable assistive technologies, we believe that future studies should investigate and predict how exoskeleton assistance strategies would structurally remodel skeletal muscle over time. Real-time mapping of the neuromechanical origin and generation of muscle force resulting in joint torques should be combined with musculoskeletal models to address time-varying parameters such as adaptation to exos and fatigue. Development of smarter predictive controllers that steer rather than assist biological components could result in a synchronized human-machine system that optimizes the biological and electromechanical performance of the combined system.

Current Technology Developments Can Improve the Quality of Research and Level of Evidence for Rehabilitation Interventions: A Narrative Review

The current important limitations to the implementation of Evidence-Based Practice (EBP) in the rehabilitation field are related to the validation process of interventions. Indeed, most of the strict guidelines that have been developed for the validation of new drugs (i.e., double or triple blinded, strict control of the doses and intensity) cannot-or can only partially-be applied in rehabilitation. Well-powered, high-quality randomized controlled trials are more difficult to organize in rehabilitation (e.g., longer duration of the intervention in rehabilitation, more difficult to standardize the intervention compared to drug validation studies, limited funding since not sponsored by big pharma companies), which reduces the possibility of conducting systematic reviews and meta-analyses, as currently high levels of evidence are sparse. The current limitations of EBP in rehabilitation are presented in this narrative review, and innovative solutions are suggested, such as technology-supported rehabilitation systems, continuous assessment, pragmatic trials, rehabilitation treatment specification systems, and advanced statistical methods, to tackle the current limitations. The development and implementation of new technologies can increase the quality of research and the level of evidence supporting rehabilitation, provided some adaptations are made to our research methodology.

Integrating Rehabilomics into the Multi-Omics Approach in the Management of Multiple Sclerosis: The Way for Precision Medicine?

Over recent years, significant improvements have been made in the understanding of (epi)genetics and neuropathophysiological mechanisms driving the different forms of multiple sclerosis (MS). For example, the role and importance of the bidirectional communications between the brain and the gut-also referred to as the gut-brain axis-in the pathogenesis of MS is receiving increasing interest in recent years and is probably one of the most promising areas of research for the management of people with MS. However, despite these important advances, it must be noted that these data are not-yet-used in rehabilitation. Neurorehabilitation is a cornerstone of MS patient management, and there are many techniques available to clinicians and patients, including technology-supported rehabilitation. In this paper, we will discuss how new findings on the gut microbiome could help us to better understand how rehabilitation can improve motor and cognitive functions. We will also see how the data gathered during the rehabilitation can help to get a better diagnosis of the patients. Finally, we will discuss how these new techniques can better guide rehabilitation to lead to precision rehabilitation and ultimately increase the quality of patient care.

Automatic Upper-Limb Brunnstrom Recovery Stage Evaluation via Daily Activity Monitoring

Motor function assessment is crucial for post-stroke rehabilitation. Conventional evaluation methods are subjective, heavily depending on the experience of therapists. In light of the strong correlation between the stroke severity level and the performance of activities of daily living (ADLs), we explored the possibility of automatically evaluating the upper-limb Brunnstrom Recovery Stage (BRS) via three typical ADLs (tooth brushing, face washing and drinking). Multimodal data (acceleration, angular velocity, surface electromyography) were synchronously collected from 5 upper-limb-worn sensor modules. The performance of BRS evaluation system is known to be variable with different system parameters (e.g., number of sensor modules, feature types and classifiers). We systematically searched for the optimal parameters from different data segmentation strategies (five window lengths and four overlaps), 42 types of features, 12 feature optimization techniques and 9 classifiers with the leave-one-subject-out cross-validation. To achieve reliable and low-cost monitoring, we further explored whether it was possible to obtain a satisfactory result using a relatively small number of sensor modules. As a result, the proposed approach can correctly recognize the stages of all 27 participants using only three sensor modules with the optimized data segmentation parameters (window length: 7s, overlap: 50%), extracted features (simple square integral, slope sign change, modified mean absolute value 1 and modified mean absolute value 2), the feature optimization method (principal component analysis) and the logistic regression classifier. According to the literature, this is the first study to comprehensively optimize sensor configuration and parameters in each stage of the BRS classification framework. The proposed approach can serve as a factor-screening tool towards the automatic BRS classification and is promising to be further used at home.

Interactive Application of Data Glove Based on Emotion Recognition and Judgment System

In this paper, the interactive application of data gloves based on emotion recognition and judgment system is investigated. A system of emotion recognition and judgment is established based on the set of optimal features of physiological signals, and then a data glove with multi-channel data transmission based on the recognition of hand posture and emotion is constructed. Finally, the system of virtual hand control and a manipulator driven by emotion is built. Five subjects were selected for the test of the above systems. The test results show that the virtual hand and manipulator can be simultaneously controlled by the data glove. In the case that the subjects do not make any hand gesture change, the system can directly control the gesture of the virtual hand by reading the physiological signal of the subject, at which point the gesture control and emotion control can be carried out at the same time. In the test of the manipulator driven by emotion, only the results driven by two emotional trends achieve the desired purpose.