Rehabilitation Exergames: Use of Motion Sensing and Machine Learning to Quantify Exercise Performance in Healthy Volunteers

Personalized rehabilitation approach for reaching movement using reinforcement learning

Musculoskeletal disorders challenge significantly the performance of many daily life activities, thus impacting the quality of life. The efficiency of the traditional physical therapy programs is limited by ecological parameters such as intervention duration and frequency, number of caregivers, geographic accessibility, as well as by subjective factors such as patient's motivation and perseverance in training. The implementation of VR rehabilitation systems may address these limitations, but the technology still needs to be improved and clinically validated. Furthermore, current applications generally lack flexibility and personalization. A VR rehabilitation game simulation is developed, which focuses on the upper-limb movement of reaching, an essential movement involved in numerous daily life activities. Its novelty consists in the integration of a machine learning algorithm, enabling highly adaptive and patient-customized therapeutic intervention. An immersive VR system for the rehabilitation of reaching movement using a bubble popping game is proposed. In the virtual space, the patient is presented with bubbles appearing at different locations and is asked to reach the bubble with the injured limb and pop it. The implementation of a Q-learning algorithm enables the game to adjust the location of the next bubble according to the performance of the patient, represented by his kinematic characteristics. Two test cases simulate the performance of the patient during a training program of 10 days/sessions, in order to validate the effectiveness of the algorithm, demonstrated by the spatial and temporal distribution of the bubbles in each evolving scenario. The results show that the algorithm learns the patient's capabilities and successfully adapts to them, following the reward policy dictated by the therapist; moreover, the algorithm is highly responsive to kinematic features' variation, while demanding a reasonable number of iterations. A novel approach for upper limb rehabilitation is presented, making use of immersive VR and reinforcement learning. The simulation suggests that the algorithm offers adaptive capabilities and high flexibility, needed in the comprehensive personalization of a rehabilitation process. Future work will demonstrate the concept in clinical trials.

Understanding Senior Adults' Needs, Preferences, and Experiences of Commercial Exergames for Health: Usability Study

BACKGROUND

Many senior adults are at risk of mental and physical disorders due to a lack of sufficient exercise. Therefore, adherent exercise should be urgently promoted to improve senior adults' muscle strength, preventing falls and conditions caused by physical and cognitive decline. However, off-the-shelf exercise games, so-called exergames, are mainly targeted at the younger generation or children, while senior adults are neglected, when this age group strongly needs exercise. Exergames could serve as a health intervention for promoting exercise.

OBJECTIVE

This study aimed to investigate senior adults' experience, perceptions, and acceptance of game technology to promote exercise in order to suggest game design guidelines.

METHODS

In this usability study, participants engaged in playing Nintendo Switch and Xbox Kinect games, after which semistructured interviews were conducted. Before the gameplay, the participants provided their background information, exercise habits, and use of technology products. Next, all participants completed a workshop including 3 activities (brief instructions on how to play the games: 20 minutes; playing the selected exergames: 80 minutes; semistructured interviews: 20 minutes) for 2 hours a day for 3 days each. The participants played the latest Nintendo Switch games (eg, Just Dance, Boxing, Ring Fit Adventure) and Xbox Kinect games (eg, Kinect Adventures!, Mini Games). Just Dance, Zumba, and Boxing were played in activity 1; Ring Fit Adventure and Mini Games in activity 2; and Kinect Adventures! in activity 3. Reflexive thematic analysis was applied to identify the relative themes generated from the interviews.

RESULTS

In total, 22 participants (mean age 70.4, SD 6.1 years) were enrolled in the workshop in May 2021. The results of the generated themes included incomprehension of game instructions, psychological perception of game technology, and game art preferences. The subthemes generated from game art preferences included favorite game genres, characters, and scenes.

CONCLUSIONS

There is a significant need for customized game tutorials considering senior adults' cognitive and physical aging. Furthermore, the adventure game genre is preferable to other games. Humanlike game characters are preferable, especially those with a fit and healthy body shape. Nature scenes are more enjoyable than indoor stages or rooms. Furthermore, the game intensity design and playing time should be carefully planned to meet the World Health Organization's criteria for physical activity in older adults. Intelligent recommendation systems might be helpful to support older adults with various health conditions. The guidelines suggested in this study might be beneficial for game design, exercise training, and game technology adoption of exergames for older adults to improve health.

Effects of a Gamified Agent-Based System for Personalized Elderly Care: Pilot Usability Study

BACKGROUND

The global percentage of older people has increased significantly over the last decades. Information and communication technologies have become essential to develop and motivate them to pursue healthier ways of living. This paper examines a personalized coaching health care service designed to maintain living conditions and active aging among older people. Among the technologies the service includes, we highlight the use of both gamification and cognitive assistant technologies designed to support older people and an application combining a cognitive virtual assistant to directly interact with the older person and provide feedback on their current health condition and several gamification techniques to motivate the older person to stay engaged with the application and pursuit of healthier daily habits.

OBJECTIVE

This pilot study aimed to investigate the feasibility and usability of a gamified agent-based system for older people and obtain preliminary results on the effectiveness of the intervention regarding physical activity health outcomes.

METHODS

The study was designed as an intervention study comparing pre- and posttest results. The proposed gamified agent-based system was used by 12 participants over 7 days (1 week), and step count data were collected with access to the Google Fit application programming interface. Step count data after the intervention were compared with average step count data before the intervention (average daily values over a period of 4 weeks before the intervention). A　1-tailed Student t test was used to determine the relationship between the dependent and independent variables. Usability was measured using the System Usability Scale questionnaire, which was answered by 8 of the 12 participants in the study.

RESULTS

The posttest results showed significant pre- to posttest changes (P=.30; 1-tailed Student t test) with a moderate effect size (Cohen d=0.65). The application obtained an average usability score of 78.

CONCLUSIONS

The presented pilot was validated, showing the positive health effects of using gamification techniques and a virtual cognitive assistant. Additionally, usability metrics considered for this study confirmed high adherence and interest from most participants in the pilot.

A gait stability evaluation method based on wearable acceleration sensors

In this study, an accurate tool is provided for the evaluation of the effect of joint motion effect on gait stability. This quantitative gait evaluation method relies exclusively on the analysis of data acquired using acceleration sensors. First, the acceleration signal of lower limb motion is collected dynamically in real-time through the acceleration sensor. Second, an algorithm based on improved dynamic time warping (DTW) is proposed and used to calculate the gait stability index of the lower limbs. Finally, the effects of different joint braces on gait stability are analyzed. The experimental results show that the joint brace at the ankle and the knee reduces the range of motions of both ankle and knee joints, and a certain impact is exerted on the gait stability. In comparison to the ankle joint brace, the knee joint brace inflicts increased disturbance on the gait stability. Compared to the joint motion of the braced side, which showed a large deviation, the joint motion of the unbraced side was more similar to that of the normal walking process. In this paper, the quantitative evaluation algorithm based on DTW makes the results more intuitive and has potential application value in the evaluation of lower limb dysfunction, clinical training and rehabilitation.

Home-Based Rehabilitation of the Shoulder Using Auxiliary Systems and Artificial Intelligence: An Overview

Advancements in modern medicine have bolstered the usage of home-based rehabilitation services for patients, particularly those recovering from diseases or conditions that necessitate a structured rehabilitation process. Understanding the technological factors that can influence the efficacy of home-based rehabilitation is crucial for optimizing patient outcomes. As technologies continue to evolve rapidly, it is imperative to document the current state of the art and elucidate the key features of the hardware and software employed in these rehabilitation systems. This narrative review aims to provide a summary of the modern technological trends and advancements in home-based shoulder rehabilitation scenarios. It specifically focuses on wearable devices, robots, exoskeletons, machine learning, virtual and augmented reality, and serious games. Through an in-depth analysis of existing literature and research, this review presents the state of the art in home-based rehabilitation systems, highlighting their strengths and limitations. Furthermore, this review proposes hypotheses and potential directions for future upgrades and enhancements in these technologies. By exploring the integration of these technologies into home-based rehabilitation, this review aims to shed light on the current landscape and offer insights into the future possibilities for improving patient outcomes and optimizing the effectiveness of home-based rehabilitation programs.

Exergames to Improve Rehabilitation for Shoulder Injury: Systematic Review and GRADE Evidence Synthesis

INTRODUCTION

The use of exergames has become an increasingly frequent intervention in rehabilitation, referred to as a fun and motivating activity that involves patients. This systematic review aimed to evaluate the effectiveness of exergames in the rehabilitation of the shoulder joint compared to other types of care.

METHODS

We performed a systematic review and GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) evidence synthesis. The search was conducted using the following databases: MEDLINE, CINAHL, SPORTDiscus, SCOPUS, SciELO, Psychology and Behavioral Sciences Collection, Cochrane Central Register of Controlled Trials, and PEDRo. Databases were searched from the first record until July 2021. Randomized controlled trials using exergames as an intervention were included.

RESULTS

The search resulted in 1,048 records. A total of 10 articles published between 2013 and 2020 met inclusion criteria and were reviewed for this study. A positive impact was observed in using exergames to increase shoulders' range of motion, namely, extension, flexion, abduction, internal and external rotation, and functionality postinjury.

CONCLUSIONS

The results of this review provide evidence of the benefits of exergames in shoulder joint rehabilitation. However, more robust clinical trials need to be developed that assess the effectiveness of using exergames as a complement to traditional rehabilitation and assess participants' degree of satisfaction, motivation, and adherence.

Automated assessment of balance rehabilitation exercises: A data-driven scoring model (Preprint)

Background

Balance rehabilitation programs represent the most common treatments for balance disorders. Nonetheless, lack of resources and lack of highly expert physiotherapists are barriers for patients to undergo individualized rehabilitation sessions. Therefore, balance rehabilitation programs are often transferred to the home environment, with a considerable risk of the patient misperforming the exercises or failing to follow the program at all. Holobalance is a persuasive coaching system with the capacity to offer full-scale rehabilitation services at home. Holobalance involves several modules, from rehabilitation program management to augmented reality coach presentation.

Objective

The aim of this study was to design, implement, test, and evaluate a scoring model for the accurate assessment of balance rehabilitation exercises, based on data-driven techniques.

Methods

The data-driven scoring module is based on an extensive data set (approximately 1300 rehabilitation exercise sessions) collected during the Holobalance pilot study. It can be used as a training and testing data set for training machine learning (ML) models, which can infer the scoring components of all physical rehabilitation exercises. In that direction, for creating the data set, 2 independent experts monitored (in the clinic) 19 patients performing 1313 balance rehabilitation exercises and scored their performance based on a predefined scoring rubric. On the collected data, preprocessing, data cleansing, and normalization techniques were applied before deploying feature selection techniques. Finally, a wide set of ML algorithms, like random forests and neural networks, were used to identify the most suitable model for each scoring component.

Results

The results of the trained model improved the performance of the scoring module in terms of more accurate assessment of a performed exercise, when compared with a rule-based scoring model deployed at an early phase of the system (k-statistic value of 15.9% for sitting exercises, 20.8% for standing exercises, and 26.8% for walking exercises). Finally, the resulting performance of the model resembled the threshold of the interobserver variability, enabling trustworthy usage of the scoring module in the closed-loop chain of the Holobalance coaching system.

Conclusions

The proposed set of ML models can effectively score the balance rehabilitation exercises of the Holobalance system. The models had similar accuracy in terms of Cohen kappa analysis, with interobserver variability, enabling the scoring module to infer the score of an exercise based on the collected signals from sensing devices. More specifically, for sitting exercises, the scoring model had high classification accuracy, ranging from 0.86 to 0.90. Similarly, for standing exercises, the classification accuracy ranged from 0.85 to 0.92, while for walking exercises, it ranged from 0.81 to 0.90.

Trial Registration

ClinicalTrials.gov NCT04053829; https://clinicaltrials.gov/ct2/show/NCT04053829

A Study Protocol for Occupational Rehabilitation in Multiple Sclerosis

Digital medical solutions can be very helpful in restorative neurology, as they allow the patients to practice their rehabilitation activities remotely. This work discloses ReMoVES, an IoMT system providing telemedicine services, in the context of Multiple Sclerosis rehabilitation, within the frame of the project STORMS. A rehabilitative protocol of exercises can be provided as ReMoVES services and integrated into the Individual Rehabilitation Project as designed by a remote multidimensional medical team. In the present manuscript, the first phase of the study is described, including the definition of the needs to be addressed, the employed technology, the design and the development of the exergames, and the possible practical/professional and academic consequences. The STORMS project has been implemented with the aim to act as a starting point for the development of digital telerehabilitation solutions that support Multiple Sclerosis patients, improving their living conditions. This paper introduces a study protocol and it addresses pre-clinical research needs, where system issues can be studied and better understood how they might be addressed. It also includes tools to favor remote patient monitoring and to support the clinical staff.

Feasibility and Effectiveness of a Motion Tracking-Based Online Fitness Program for Office Workers

The development of technology-based home fitness has emerged from the booming digital healthcare market and recent demands for at-home fitness and health equipment due to the COVID-19 pandemic. Digital healthcare company Alyce Healthcare recently developed Weelo, which is a web-based online fitness program. Weelo recommends an exercise protocol through machine-learning-enabled recognition of the user’s motion and provides visual and auditory feedback. We evaluated whether Weelo improves physical and mental well-being to assess its capabilities and effectiveness. Thirty-two participants performed a total of 20 exercise sessions following the Weelo guide on a laptop. The participants were evaluated using a before and after exercise program, body composition, handgrip strength, six-minute walk test, modified star excursion balance test, short form 36, fatigue severity scale, Beck depression index, and a satisfaction survey. Overall, there was a significant improvement in muscle strength, endurance, and balance ability, as well as an improved quality of life and significant reduction in fatigue and depression. Participants showed high motivation to continue following the Weelo exercise program. In conclusion, utilizing Weelo improved physical and mental well-being and is considered to be an individual-use indoor exercise program that serves as an alternative to traditional face-to-face exercise.