Usability of an Immersive Augmented Reality Based Telerehabilitation System with Haptics (ARTESH) for Synchronous Remote Musculoskeletal Examination

Evidence-based position paper on Physical and Rehabilitation Medicine (PRM) professional practice on telerehabilitation. The European PRM position (UEMS PRM Section)

INTRODUCTION

The evidence on the utility and effectiveness of rehabilitation interventions delivered via telerehabilitation is growing rapidly. Telerehabilitation is expected to have a key role in rehabilitation in the future.

AIM

The aim of this evidence-based position paper (EBPP) is to improve PRM physicians' professional practice in telerehabilitation to be delivered to improve functioning and to reduce activity limitations and/or participation restrictions in individuals with a variety of disabling health conditions.

METHODS

To produce recommendations for PRM physicians on telerehabilitation, a systematic review of the literature and a consensus procedure by means of a Delphi process have been performed involving the delegates of all European countries represented in the UEMS PRM Section.

RESULTS

The systematic literature review is reported together with the 32 recommendations resulting from the Delphi procedure.

CONCLUSIONS

It is recommended that PRM physicians deliver rehabilitation services remotely, via digital means or using communication technologies to eligible individuals, whenever required and feasible in a variety of health conditions in favor of the patient and his/her family, based on evidence of effectiveness and in compliance with relevant regulations. This EBPP represents the official position of the European Union through the UEMS PRM Section and designates the professional role of PRM physicians in telerehabilitation.

Telehealth in PM&R: Past, present, and future in clinical practice and opportunities for translational research

Telehealth refers to the use of telecommunication devices and other forms of technology to provide services outside of the traditional in-person health care delivery system. Growth in the use of telehealth creates new challenges and opportunities for implementation in clinical practice. The American Academy of Physical Medicine and Rehabilitation (AAPM&R) assembled an expert group to develop a white paper to examine telehealth innovation in Physical Medicine and Rehabilitation (PM&R). The resultant white paper summarizes how telehealth is best used in the field of PM&R while highlighting current knowledge deficits and technological limitations. The report identifies new and transformative opportunities for PM&R to advance translational research related to telehealth and enhance patient care.

Comparison of in-person and synchronous remote musculoskeletal exam using augmented reality and haptics: A pilot study

INTRODUCTION

Utilization of telemedicine for health care delivery increased rapidly during the coronavirus disease 2019 (COVID-19) pandemic. However, physical examination during telehealth visits remains limited. A novel telerehabilitation system-The Augmented Reality-based Telerehabilitation System with Haptics (ARTESH)-shows promise for performing synchronous, remote musculoskeletal examination.

OBJECTIVE

To assess the potential of ARTESH in remotely examining upper extremity passive range of motion (PROM) and maximum isometric strength (MIS).

DESIGN

In this cross-sectional pilot study, we compared the in-person (reference standard) and remote evaluations (ARTESH) of participants' upper extremity PROM and MIS in 10 shoulder and arm movements. The evaluators were blinded to each other's results.

SETTING

Participants underwent in-person evaluations at a Veterans Affairs hospital's outpatient Physical Medicine and Rehabilitation (PM&R) clinic, and underwent remote examination using ARTESH with the evaluator located at a research lab 30 miles away, connected via a high-speed network.

PATIENTS

Fifteen participants with upper extremity pain and/or weakness.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Inter-rater agreement between in-person and remote evaluations on 10 PROM and MIS movements and presence/absence of pain with movement was calculated.

RESULTS

The highest inter-rater agreements were noted in shoulder abduction and protraction PROM (kappa (κ) = 0.44, confidence interval (CI): -0.1 to 1.0), and in elbow flexion, shoulder abduction, and shoulder protraction MIS (κ = 0.63, CI: 0 to 1.0).

CONCLUSIONS

This pilot study suggests that synchronous tele-physical examination using the ARTESH system with augmented reality and haptics has the potential to provide enhanced value to existing telemedicine platforms. With the additional technological and procedural improvements and with an adequately powered study, the accuracy of ARTESH-enabled remote tele-physical examinations can be better evaluated.

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

BACKGROUND

The distinctive features of the digital reality platforms, namely augmented reality (AR), virtual reality (VR), and mixed reality (MR) have extended to medical education, training, simulation, and patient care. Furthermore, this digital reality technology seamlessly merges with information and communication technology creating an enriched telehealth ecosystem. This review provides a composite overview of the prospects of telehealth delivered using the MR platform in clinical settings.

OBJECTIVE

This review identifies various clinical applications of high-fidelity digital display technology, namely AR, VR, and MR, delivered using telehealth capabilities. Next, the review focuses on the technical characteristics, hardware, and software technologies used in the composition of AR, VR, and MR in telehealth.

METHODS

We conducted a scoping review using the methodological framework and reporting design using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Full-length articles in English were obtained from the Embase, PubMed, and Web of Science databases. The search protocol was based on the following keywords and Medical Subject Headings to obtain relevant results: "augmented reality," "virtual reality," "mixed-reality," "telemedicine," "telehealth," and "digital health." A predefined inclusion-exclusion criterion was developed in filtering the obtained results and the final selection of the articles, followed by data extraction and construction of the review.

RESULTS

We identified 4407 articles, of which 320 were eligible for full-text screening. A total of 134 full-text articles were included in the review. Telerehabilitation, telementoring, teleconsultation, telemonitoring, telepsychiatry, telesurgery, and telediagnosis were the segments of the telehealth division that explored the use of AR, VR, and MR platforms. Telerehabilitation using VR was the most commonly recurring segment in the included studies. AR and MR has been mainly used for telementoring and teleconsultation. The most important technical features of digital reality technology to emerge with telehealth were virtual environment, exergaming, 3D avatars, telepresence, anchoring annotations, and first-person viewpoint. Different arrangements of technology-3D modeling and viewing tools, communication and streaming platforms, file transfer and sharing platforms, sensors, high-fidelity displays, and controllers-formed the basis of most systems.

CONCLUSIONS

This review constitutes a recent overview of the evolving digital AR and VR in various clinical applications using the telehealth setup. This combination of telehealth with AR, VR, and MR allows for remote facilitation of clinical expertise and further development of home-based treatment. This review explores the rapidly growing suite of technologies available to users within the digital health sector and examines the opportunities and challenges they present.

Perceptions of Augmented Reality in Remote Medical Care: Interview Study of Emergency Telemedicine Providers (Preprint)

BACKGROUND

Augmented reality (AR) and virtual reality (VR) have increasingly appeared in the medical literature in the past decade, with AR recently being studied for its potential role in remote health care delivery and communication. Recent literature describes AR's implementation in real-time telemedicine contexts across multiple specialties and settings, with remote emergency services in particular using AR to enhance disaster support and simulation education. Despite the introduction of AR in the medical literature and its potential to shape the future of remote medical services, studies have yet to investigate the perspectives of telemedicine providers regarding this novel technology.

OBJECTIVE

This study aimed to understand the applications and challenges of AR in telemedicine anticipated by emergency medicine providers with a range of experiences in using telemedicine and AR or VR technology.

METHODS

Across 10 academic medical institutions, 21 emergency medicine providers with variable exposures to telemedicine and AR or VR technology were recruited for semistructured interviews via snowball sampling. The interview questions focused on various potential uses of AR, anticipated obstacles that prevent its implementation in the telemedicine area, and how providers and patients might respond to its introduction. We included video demonstrations of a prototype using AR during the interviews to elicit more informed and complete insights regarding AR's potential in remote health care. Interviews were transcribed and analyzed via thematic coding.

RESULTS

Our study identified 2 major areas of use for AR in telemedicine. First, AR is perceived to facilitate information gathering by enhancing observational tasks such as visual examination and granting simultaneous access to data and remote experts. Second, AR is anticipated to supplement distance learning of both minor and major procedures and nonprocedural skills such as cue recognition and empathy for patients and trainees. AR may also supplement long-distance education programs and thereby support less specialized medical facilities. However, the addition of AR may exacerbate the preexisting financial, structural, and literacy barriers to telemedicine. Providers seek value demonstrated by extensive research on the clinical outcome, satisfaction, and financial benefits of AR. They also seek institutional support and early training before adopting novel tools such as AR. Although an overall mixed reception is anticipated, consumer adoption and awareness are key components in AR's adoption.

CONCLUSIONS

AR has the potential to enhance the ability to gather observational and medical information, which would serve a diverse set of applications in remote health care delivery and education. However, AR faces obstacles similar to those faced by the current telemedicine technology, such as lack of access, infrastructure, and familiarity. This paper discusses the potential areas of investigation that would inform future studies and approaches to implementing AR in telemedicine.

Virtual reality applications for rehabilitation of COVID-19 patients: A systematic review

BACKGROUND AND AIMS

The COVID-19 pandemic has changed people's lifestyles as well as the way healthcare services are delivered. Undoubtedly, the difficulties associated with COVID-19 infection and rehabilitation and those associated with quarantine and viral preventive efforts may exacerbate the need for virtual reality to be used as a part of a complete rehabilitation strategy for these individuals. Thus, the present research aimed to evaluate the potential uses of virtual reality for the rehabilitation of individuals suffering from COVID-19.

METHODS

From 2019 to March 1, 2022, a systematic search was conducted in PubMed, Cochran Library, Scopus, Science Direct, ProQuest, and Web of Science databases. The papers were selected based on search terms and those that discussed the use of virtual reality in the rehabilitation of COVID-19 patients were reviewed. Each step of the study was reviewed by two authors.

RESULTS

A total of 699 papers were found during the first search. Three papers were chosen for further investigation after a thorough evaluation of the publications' titles, abstracts, and full texts. Cross-sectional studies, randomized controlled clinical trials, and case reports comprised 33%, 33%, and 33% of the publications, respectively. Based on the results, people suffering from COVID-19 were the focus of two papers (66%) that employed immersion virtual reality for cognitive rehabilitation, whereas one study (33%) used non-immersive virtual reality for physical rehabilitation. In two papers (66%), virtual reality was also offered to patients in the form of a game.

CONCLUSION

According to the results of the present research, virtual reality games may enhance functional and cognitive consequences, contentment levels among patients, and their ability to take charge of their own health care. In light of the obstacles faced by COVID-19 patients, alterations in the delivery of healthcare, and the significance of rehabilitation in this group during quarantine, new techniques have been considered for these patients to maintain treatment, return to regular life, and enhance their standard of life.

Augmented Reality in Physical Therapy: Systematic Review and Meta-analysis

Background

Augmented reality (AR) is a rapidly expanding technology; it comprises the generation of new images from digital information in the real physical environment of a person, which simulates an environment where the artificial and real are mixed. The use of AR in physiotherapy has shown benefits in certain areas of patient health. However, these benefits have not been studied as a whole.

Objective

This study aims to ascertain the current scientific evidence on AR therapy as a complement to physiotherapy and to determine the areas in which it has been used the most and which variables and methods have been most effective.

Methods

A systematic review registered in PROSPERO (International Prospective Register of Systematic Reviews) was conducted following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta‐Analyses) recommendations. The search was conducted from July to August 2021 in the PubMed, PEDro, Web of Science, Scopus, and Cochrane Library scientific databases using the keywords augmented reality, physiotherapy, physical therapy, exercise therapy, rehabilitation, physical medicine, fitness, and occupational therapy. The methodological quality was evaluated using the PEDro scale and the Scottish Intercollegiate Guidelines Network scale to determine the degree of recommendation. The Cochrane Collaboration tool was used to evaluate the risk of bias.

Results

In total, 11 articles were included in the systematic review. Of the 11 articles, 4 (36%) contributed information to the meta-analysis. Overall, 64% (7/11) obtained a good level of evidence, and most had a B degree of recommendation of evidence. A total of 308 participants were analyzed. Favorable results were found for the Berg Balance Scale (standardized mean change 0.473, 95% CI −0.0877 to 1.0338; z=1.65; P=.10) and the Timed Up and Go test (standardized mean change −1.211, 95% CI −3.2005 to 0.7768; z=−1.194; P=.23).

Conclusions

AR, in combination with conventional therapy, has been used for the treatment of balance and fall prevention in geriatrics, lower and upper limb functionality in stroke, pain in phantom pain syndrome, and turning in place in patients with Parkinson disease with freezing of gait. AR is effective for the improvement of balance; however, given the small size of the samples and the high heterogeneity of the studies, the results were not conclusive. Future studies using larger sample sizes and with greater homogeneity in terms of the devices used and the frequency and intensity of the interventions are needed.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42020180766; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=180766

Exploring the Acceptability and Feasibility of Providing a Balance Tele-Rehabilitation Programme to Older Adults at Risk for Falls: An Initial Assessment

Falls are a major health concern. The HOLOBALANCE tele-rehabilitation system was developed to deliver an evidence based, multi-sensory balance rehabilitation programme, to the elderly at risk of falls. The system delivers a series of balance physiotherapy exercises and cognitive and auditory training tasks prescribed by an expert balance physiotherapist following an initial balance assessment. The HOLOBALANCE system uses augmented reality (AR) to deliver exercises and games, and records task performance via a combination of body worn sensors and a depth camera. The HOLOBALANCE tele-rehabilitation system provides feedback to the supervising clinical team regarding task performance, participant usage and user feedback. Herewith we present the findings from the first 25 study participants regarding the feasibility and acceptability of the proposed system. The results of the clinical study indicate that the system is acceptable by the end users and also feasible for using in hospital and home environments.

Telehealth and chronic pain management from rapid adaptation to long-term implementation in pain medicine: A narrative review

The COVID-19 pandemic called for drastic changes to expand and rapidly implement telehealth to prevent breach of care for chronic patients. Responding to the challenge of implementing remote care in chronic pain services, a specialty highly dependent on doctor-patient rapport, physical examination, and frequent follow-up visits requires extensive adaptation involving administrative processes and clinical routines. We present our experience of a successful rapid adaptation to telemedicine paradigm as a response to the COVID-19 pandemic during a time of marked restriction of access to ambulatory hospital services for pediatric and adult chronic pain patients. This narrative review covers current scientific evidence for the use of telehealth for chronic pain management and describes in detail the challenges to implement telemedicine in ambulatory clinics from different perspectives. Best practices for telehealth use are recommended. A proposal for remote physical examination of pain patients is made, based on available evidence in the fields of musculoskeletal medicine and neurology comparing in-person vs remote physical examination. As an internal quality control process, an informal online survey was conducted to assess thoughts and experiences among patients and caregivers using telemedicine consultation services at the pediatric pain clinic. Providing chronic pain management services through telehealth is a viable option for many patients and health care professionals. This is reliant on the availability of appropriate materials and training, with guidelines for both patients and health care workers. With the rapid pace of technological advancements, even further integration of telehealth into routine health care is possible.

Using Biometric Technology for Telehealth and Telerehabilitation

This article discusses the use of physical and biometric sensors in telerehabilitation. It also discusses synchronous tele-physical assessment using haptics and augmented reality and asynchronous physical assessment using remote pose estimation. The article additionally focuses on computational models that have the potential to monitor and evaluate changes in kinematic and kinetic properties during telerehabilitation using biometric sensors such as electromyography and other wearable and noncontact sensors based on force and speed. And finally, the article discusses how virtual reality environments can be facilitated in telerehabilitation.

Telerehabilitation: Development, Application, and Need for Increased Usage in the COVID-19 Era for Patients with Spinal Pathology

The coronavirus disease 2019 (COVID-19) pandemic has triggered governments worldwide to implement severe restrictions on physical therapy protocols in order to better control the spread of the virus. One of the mechanisms of providing physical therapy patient care during this era is via telemedicine. Telerehabilitation or telerehab is a technological visual-audio system that serves patients, including those with a spine injury, ailment, or postoperatively, with neurological deficits. In this scoping review, we discuss the development of telerehab, the technological advances in the field, and the usage of telerehab specifically pertaining to spine patients, and comment on the advancement of telerehab in the time of COVID-19. There is preliminary evidence that suggests that the adoption of telerehab in lieu of face-to-face interventions is beneficial for reducing pain and improving physical function in patients afflicted with chronic nonmalignant musculoskeletal pain from low back pain, lumbar stenosis, neck pain, and osteoarthritis. Availability is important, as the necessary technology should be accessible to all participants. Safety and security should be addressed, as the passage of patient data over the Internet requires secure confidentiality. Ease-of-use is crucial to promote practicality, user-friendly operation, and adherence to therapy. The combination of evidence-based methodologies with cost-effective services will serve as a basis for the further expansion of vital telerehab services and increases reimbursement by health insurance providers.