Long-term Effectiveness and Adoption of a Cellphone Augmented Reality System on Patients with Stroke: Randomized Controlled Trial

Post-stroke hand gesture recognition via one-shot transfer learning using prototypical networks

BACKGROUND

In-home rehabilitation systems are a promising, potential alternative to conventional therapy for stroke survivors. Unfortunately, physiological differences between participants and sensor displacement in wearable sensors pose a significant challenge to classifier performance, particularly for people with stroke who may encounter difficulties repeatedly performing trials. This makes it challenging to create reliable in-home rehabilitation systems that can accurately classify gestures.

METHODS

Twenty individuals who suffered a stroke performed seven different gestures (mass flexion, mass extension, wrist volar flexion, wrist dorsiflexion, forearm pronation, forearm supination, and rest) related to activities of daily living. They performed these gestures while wearing EMG sensors on the forearm, as well as FMG sensors and an IMU on the wrist. We developed a model based on prototypical networks for one-shot transfer learning, K-Best feature selection, and increased window size to improve model accuracy. Our model was evaluated against conventional transfer learning with neural networks, as well as subject-dependent and subject-independent classifiers: neural networks, LGBM, LDA, and SVM.

RESULTS

Our proposed model achieved 82.2% hand-gesture classification accuracy, which was better (P<0.05) than one-shot transfer learning with neural networks (63.17%), neural networks (59.72%), LGBM (65.09%), LDA (63.35%), and SVM (54.5%). In addition, our model performed similarly to subject-dependent classifiers, slightly lower than SVM (83.84%) but higher than neural networks (81.62%), LGBM (80.79%), and LDA (74.89%). Using K-Best features improved the accuracy in 3 of the 6 classifiers used for evaluation, while not affecting the accuracy in the other classifiers. Increasing the window size improved the accuracy of all the classifiers by an average of 4.28%.

CONCLUSION

Our proposed model showed significant improvements in hand-gesture recognition accuracy in individuals who have had a stroke as compared with conventional transfer learning, neural networks and traditional machine learning approaches. In addition, K-Best feature selection and increased window size can further improve the accuracy. This approach could help to alleviate the impact of physiological differences and create a subject-independent model for stroke survivors that improves the classification accuracy of wearable sensors.

TRIAL REGISTRATION NUMBER

The study was registered in Chinese Clinical Trial Registry with registration number CHiCTR1800017568 in 2018/08/04.

The efficacy of virtual reality for upper limb rehabilitation in stroke patients: a systematic review and meta-analysis

BACKGROUND

Stroke frequently gives rise to incapacitating motor impairments in the upper limb. Virtual reality (VR) rehabilitation has exhibited potential for augmenting upper extremity recovery; nonetheless, the optimal techniques for such interventions remain a topic of uncertainty. The present systematic review and meta-analysis were undertaken to comprehensively compare VR-based rehabilitation with conventional occupational therapy across a spectrum of immersion levels and outcome domains.

METHODS

A systematic search was conducted in PubMed, IEEE, Scopus, Web of Science, and PsycNET databases to identify randomized controlled trials about upper limb rehabilitation in stroke patients utilizing VR interventions. The search encompassed studies published in the English language up to March 2023. The identified studies were stratified into different categories based on the degree of immersion employed: non-immersive, semi-immersive, and fully-immersive settings. Subsequent meta-analyses were executed to assess the impact of VR interventions on various outcome measures.

RESULTS

Of the 11,834 studies screened, 55 studies with 2142 patients met the predefined inclusion criteria. VR conferred benefits over conventional therapy for upper limb motor function, functional independence, Quality of life, Spasticity, and dexterity. Fully immersive VR showed the greatest gains in gross motor function, while non-immersive approaches enhanced fine dexterity. Interventions exceeding six weeks elicited superior results, and initiating VR within six months post-stroke optimized outcomes.

CONCLUSIONS

This systematic review and meta-analysis demonstrates that adjunctive VR-based rehabilitation enhances upper limb motor recovery across multiple functional domains compared to conventional occupational therapy alone after stroke. Optimal paradigms likely integrate VR's immersive capacity with conventional techniques.

TRIAL REGISTRATION

This systematic review and meta-analysis retrospectively registered in the OSF registry under the identifier [ https://doi.org/10.17605/OSF.IO/YK2RJ ].

Ηand dexterities assessment in stroke patients based on augmented reality and machine learning through a box and block test

A popular and widely suggested measure for assessing unilateral hand motor skills in stroke patients is the box and block test (BBT). Our study aimed to create an augmented reality enhanced version of the BBT (AR-BBT) and evaluate its correlation to the original BBT for stroke patients. Following G-power analysis, clinical examination, and inclusion-exclusion criteria, 31 stroke patients were included in this study. AR-BBT was developed using the Open Source Computer Vision Library (OpenCV). The MediaPipe's hand tracking library uses a palm and a hand landmark machine learning model to detect and track hands. A computer and a depth camera were employed in the clinical evaluation of AR-BBT following the principles of traditional BBT. A strong correlation was achieved between the number of blocks moved in the BBT and the AR-BBT on the hemiplegic side (Pearson correlation = 0.918) and a positive statistically significant correlation (p = 0.000008). The conventional BBT is currently the preferred assessment method. However, our approach offers an advantage, as it suggests that an AR-BBT solution could remotely monitor the assessment of a home-based rehabilitation program and provide additional hand kinematic information for hand dexterities in AR environment conditions. Furthermore, it employs minimal hardware equipment.

Challenges and promises of mixed-reality interventions in acquired brain injury rehabilitation: A scoping review

BACKGROUND

Acquired brain injury (ABI) can lead to significant impairments and difficulties in everyday life, necessitating the need for rehabilitation. Mixed-reality (MR) technologies have revolutionized the delivery of neurorehabilitation therapies. However, inconsistencies in research methodology, diverse study populations and designs, and exaggerated claims in the research, media, and private consumer sectors have impacted the knowledge base of the field, including within the context of ABI rehabilitation.

OBJECTIVE

This scoping review aims to explore MR-systems in ABI rehabilitation, while assessing the evidence base and technology readiness levels of these systems.

METHODS

Seven databases were searched for studies, which were screened and analyzed by two independent raters. The types of MR systems, levels of evidence, and technology readiness levels were extracted and analyzed using descriptive analyses.

RESULTS

Twenty-six studies were included in the review, all of which focused on ABI etiologies stemming from strokes. Across studies, upper-limb motor rehabilitation was the most common rehabilitation target of MR interventions, followed by gait, cognition, and lower-extremity functioning. At present, overall results indicate low evidence for MR-applications in ABI rehabilitation, with a median technology readiness level of 6, corresponding to system prototypes being tested in relevant environments.

CONCLUSION

Although challenges regarding system usability and design were reported, results appear promising with ongoing research. With variability across studies, technologies, and populations, determining the effectiveness of MR interventions in ABI remains a challenge, necessitating the need for ongoing innovation, research, and development of these systems.