It's not about the capture, it's about what we can learn": a qualitative study of experts' opinions and experiences regarding the use of wearable sensors to measure gait and physical activity

The impact of age on physical functioning after treatment for breast cancer, as measured by patient-reported outcome measures: A systematic review

PURPOSE

This systematic review aims to explore the impact of age on physical functioning post-treatment for early-stage, locally advanced, or locally recurrent breast cancer, as measured by patient-reported outcome measures (PROMs), identify PROMs used and variations in physical functioning terms/labels.

METHODS

MEDLINE, EmBase, PsycINFO, CINAHL and AMED were searched, along with relevant key journals and reference lists. Risk of bias (quality) assessment was conducted using a Critical Appraisal Skills Programme checklist. Data was synthesised through tables and narrative.

RESULTS

28,207 titles were extracted from electronic databases, resulting in 44 studies with age sub-groups, and 120 without age sub-groups. Of those with findings on the impact of age, there was variability in the way findings were reported and 21 % found that age did not have a significant impact. However, 66 % of the studies found that with older age, physical functioning declined post-treatment. Comorbidities were associated with physical functioning declines. However, findings from sub-groups (breast cancer stage, treatment type and time post-treatment) lacked concordance. Twenty-eight types of PROM were used: the EORTC QLQ-C30 was most common (50.6 %), followed by the SF-36 (32.3 %). There were 145 terms/labels for physical functioning: 'physical functioning/function' was used most often (82.3 %).

CONCLUSIONS

Findings point towards an older age and comorbidities being associated with more physical functioning declines. However, it was not possible to determine if stage, treatment type and time since treatment had any influence. More consistent use of the terminology 'physical functioning/function' would aid future comparisons of study results.

Cardiac interoception in the museum: A novel measure of experience

Interoception is the perception of the body's internal signals in response to various external and internal stimuli. The present study uses a novel method adapted from the CARdiac Elevation Detection Task to examine cardiac interoception objectively and subjectively in a unique context-in the presence of art. Self-report questionnaires were used to measure subjective interoceptive awareness, subjective interoceptive accuracy, and aesthetic appreciation. For objective interoceptive accuracy and sensibility, a wearable device (Shimmer) measured heart rate (HR) and connected to a mobile application to prompt two questions: "Is your heart beating faster than usual?" and "How confident are you in your previous response?" Participants explored an art gallery for 40 minutes while the Shimmer measured their HR and randomly prompted them to answer the questions. Using a Generalized Estimating Equation model, interoceptive sensibility was not found to predict the odds of submitting a correct response. It was also found that art does not improve participants' perceptions of their HR. Finally, there was no relation between aesthetic appreciation and subjective or objective cardiac interoception. Despite lack of statistical significance, the current study's method presents an improved method by examining interoceptive accuracy in the moment under ecological conditions. To date, findings and methods used in interoception are inconsistent or flawed; the value in the current study lies in the development and demonstration of a method to examine how the environment influences the body and self-awareness across a wide variety of contexts, thereby offering a possible standardized measure of interoception for investigators to adopt.

Breaking down the Digital Fortress: The Unseen Challenges in Healthcare Technology-Lessons Learned from 10 Years of Research

Healthcare is undergoing a fundamental shift in which digital health tools are becoming ubiquitous, with the promise of improved outcomes, reduced costs, and greater efficiency. Healthcare professionals, patients, and the wider public are faced with a paradox of choice regarding technologies across multiple domains. Research is continuing to look for methods and tools to further revolutionise all aspects of health from prediction, diagnosis, treatment, and monitoring. However, despite its promise, the reality of implementing digital health tools in practice, and the scalability of innovations, remains stunted. Digital health is approaching a crossroads where we need to shift our focus away from simply looking at developing new innovations to seriously considering how we overcome the barriers that currently limit its impact. This paper summarises over 10 years of digital health experiences from a group of researchers with backgrounds in physical therapy-in order to highlight and discuss some of these key lessons-in the areas of validity, patient and public involvement, privacy, reimbursement, and interoperability. Practical learnings from this collective experience across patient cohorts are leveraged to propose a list of recommendations to enable researchers to bridge the gap between the development and implementation of digital health tools.

The Wearable Activity Tracker Checklist for Healthcare (WATCH): a 12-point guide for the implementation of wearable activity trackers in healthcare

Increasing physical activity in patients offers dual benefits, fostering improved patient health and recovery, while also bolstering healthcare system efficiency by minimizing costs related to extended hospital stays, complications, and readmissions. Wearable activity trackers offer valuable opportunities to enhance physical activity across various healthcare settings and among different patient groups. However, their integration into healthcare faces multiple implementation challenges related to the devices themselves, patients, clinicians, and systemic factors. This article presents the Wearable Activity Tracker Checklist for Healthcare (WATCH), which was recently developed through an international Delphi study. The WATCH provides a comprehensive framework for implementation and evaluation of wearable activity trackers in healthcare. It covers the purpose and setting for usage; patient, provider, and support personnel roles; selection of relevant metrics; device specifications; procedural steps for issuance and maintenance; data management; timelines; necessary adaptations for specific scenarios; and essential resources (such as education and training) for effective implementation. The WATCH is designed to support the implementation of wearable activity trackers across a wide range of healthcare populations and settings, and in those with varied levels of experience. The overarching goal is to support broader, sustained, and systematic use of wearable activity trackers in healthcare, therefore fostering enhanced physical activity promotion and improved patient outcomes.

Mobilise-D insights to estimate real-world walking speed in multiple conditions with a wearable device

This study aimed to validate a wearable device's walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson's Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and - 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application.Trial registration: ISRCTN - 12246987.

Digital Biomarkers and the Evolution of Spine Care Outcomes Measures: Smartphones and Wearables

Over the past generation, outcome measures in spine care have evolved from a reliance on clinician-reported assessment toward recognizing the importance of the patient's perspective and the wide incorporation of patient-reported outcomes (PROs). While patient-reported outcomes are now considered an integral component of outcomes assessments, they cannot wholly capture the state of a patient's functionality. There is a clear need for quantitative and objective patient-centered outcome measures. The pervasiveness of smartphones and wearable devices in modern society, which passively collect data related to health, has ushered in a new era of spine care outcome measurement. The patterns emerging from these data, so-called "digital biomarkers," can accurately describe characteristics of a patient's health, disease, or recovery state. Broadly, the spine care community has thus far concentrated on digital biomarkers related to mobility, although the researcher's toolkit is anticipated to expand in concert with advancements in technology. In this review of the nascent literature, we describe the evolution of spine care outcome measurements, outline how digital biomarkers can supplement current clinician-driven and patient-driven measures, appraise the present and future of the field in the modern era, as well as discuss present limitations and areas for further study, with a focus on smartphones (see Supplemental Digital Content , http://links.lww.com/NEU/D809 , for a similar appraisal of wearable devices).

Feasibility and usability of a digital health technology system to monitor mobility and assess medication adherence in mild-to-moderate Parkinson's disease

Introduction

Parkinson's disease (PD) is a neurodegenerative disorder which requires complex medication regimens to mitigate motor symptoms. The use of digital health technology systems (DHTSs) to collect mobility and medication data provides an opportunity to objectively quantify the effect of medication on motor performance during day-to-day activities. This insight could inform clinical decision-making, personalise care, and aid self-management. This study investigates the feasibility and usability of a multi-component DHTS to remotely assess self-reported medication adherence and monitor mobility in people with Parkinson's (PwP).

Methods

Thirty participants with PD [Hoehn and Yahr stage I (n = 1) and II (n = 29)] were recruited for this cross-sectional study. Participants were required to wear, and where appropriate, interact with a DHTS (smartwatch, inertial measurement unit, and smartphone) for seven consecutive days to assess medication adherence and monitor digital mobility outcomes and contextual factors. Participants reported their daily motor complications [motor fluctuations and dyskinesias (i.e., involuntary movements)] in a diary. Following the monitoring period, participants completed a questionnaire to gauge the usability of the DHTS. Feasibility was assessed through the percentage of data collected, and usability through analysis of qualitative questionnaire feedback.

Results

Adherence to each device exceeded 70% and ranged from 73 to 97%. Overall, the DHTS was well tolerated with 17/30 participants giving a score > 75% [average score for these participants = 89%, from 0 (worst) to 100 (best)] for its usability. Usability of the DHTS was significantly associated with age (ρ = −0.560, BCa 95% CI [−0.791, −0.207]). This study identified means to improve usability of the DHTS by addressing technical and design issues of the smartwatch. Feasibility, usability and acceptability were identified as key themes from PwP qualitative feedback on the DHTS.

Conclusion

This study highlighted the feasibility and usability of our integrated DHTS to remotely assess medication adherence and monitor mobility in people with mild-to-moderate Parkinson's disease. Further work is necessary to determine whether this DHTS can be implemented for clinical decision-making to optimise management of PwP.

Acceptability of wearable devices for measuring mobility remotely: Observations from the Mobilise-D technical validation study

Background

This study aimed to explore the acceptability of a wearable device for remotely measuring mobility in the Mobilise-D technical validation study (TVS), and to explore the acceptability of using digital tools to monitor health.

Methods

Participants (N = 106) in the TVS wore a waist-worn device (McRoberts Dynaport MM + ) for one week. Following this, acceptability of the device was measured using two questionnaires: The Comfort Rating Scale (CRS) and a previously validated questionnaire. A subset of participants (n = 36) also completed semi-structured interviews to further determine device acceptability and to explore their opinions of the use of digital tools to monitor their health. Questionnaire results were analysed descriptively and interviews using a content analysis.

Results

The device was considered both comfortable (median CRS (IQR; min-max) = 0.0 (0.0; 0-20) on a scale from 0-20 where lower scores signify better comfort) and acceptable (5.0 (0.5; 3.0-5.0) on a scale from 1-5 where higher scores signify better acceptability). Interviews showed it was easy to use, did not interfere with daily activities, and was comfortable. The following themes emerged from participants' as being important to digital technology: altered expectations for themselves, the use of technology, trust, and communication with healthcare professionals.

Conclusions

Digital tools may bridge existing communication gaps between patients and clinicians and participants are open to this. This work indicates that waist-worn devices are supported, but further work with patient advisors should be undertaken to understand some of the key issues highlighted. This will form part of the ongoing work of the Mobilise-D consortium.

Reverse Engineering of Digital Measures: Inviting Patients to the Conversation

Background

Digital measures offer an unparalleled opportunity to create a more holistic picture of how people who are patients behave in their real-world environments, thereby establishing a better connection between patients, caregivers, and the clinical evidence used to drive drug development and disease management. Reaching this vision will require achieving a new level of co-creation between the stakeholders who design, develop, use, and make decisions using evidence from digital measures.

Summary

In September 2022, the second in a series of meetings hosted by the Swiss Federal Institute of Technology in Zürich, the Foundation for the National Institutes of Health Biomarkers Consortium, and sponsored by Wellcome Trust, entitled "Reverse Engineering of Digital Measures," was held in Zurich, Switzerland, with a broad range of stakeholders sharing their experience across four case studies to examine how patient centricity is essential in shaping development and validation of digital evidence generation tools.

Key Messages

In this paper, we discuss progress and the remaining barriers to widespread use of digital measures for evidence generation in clinical development and care delivery. We also present key discussion points and takeaways in order to continue discourse and provide a basis for dissemination and outreach to the wider community and other stakeholders. The work presented here shows us a blueprint for how and why the patient voice can be thoughtfully integrated into digital measure development and that continued multistakeholder engagement is critical for further progress.

Balance Impairments in People with Early-Stage Multiple Sclerosis: Boosting the Integration of Instrumented Assessment in Clinical Practice

The balance of people with multiple sclerosis (PwMS) is commonly assessed during neurological examinations through clinical Romberg and tandem gait tests that are often not sensitive enough to unravel subtle deficits in early-stage PwMS. Inertial sensors (IMUs) could overcome this drawback. Nevertheless, IMUs are not yet fully integrated into clinical practice due to issues including the difficulty to understand/interpret the big number of parameters provided and the lack of cut-off values to identify possible abnormalities. In an attempt to overcome these limitations, an instrumented modified Romberg test (ImRomberg: standing on foam with eyes closed while wearing an IMU on the trunk) was administered to 81 early-stage PwMS and 38 healthy subjects (HS). To facilitate clinical interpretation, 21 IMU-based parameters were computed and reduced through principal component analysis into two components, sway complexity and sway intensity, descriptive of independent aspects of balance, presenting a clear clinical meaning and significant correlations with at least one clinical scale. Compared to HS, early-stage PwMS showed a 228% reduction in sway complexity and a 63% increase in sway intensity, indicating, respectively, a less automatic (more conscious) balance control and larger and faster trunk movements during upright posture. Cut-off values were derived to identify the presence of balance abnormalities and if these abnormalities are clinically meaningful. By applying these thresholds and integrating the ImRomberg test with the clinical tandem gait test, balance impairments were identified in 58% of PwMS versus the 17% detected by traditional Romberg and tandem gait tests. The higher sensitivity of the proposed approach would allow for the direct identification of early-stage PwMS who could benefit from preventive rehabilitation interventions aimed at slowing MS-related functional decline during neurological examinations and with minimal modifications to the tests commonly performed.

Assessing the usability of wearable devices to measure gait and physical activity in chronic conditions: a systematic review

BACKGROUND

The World Health Organisation's global strategy for digital health emphasises the importance of patient involvement. Understanding the usability and acceptability of wearable devices is a core component of this. However, usability assessments to date have focused predominantly on healthy adults. There is a need to understand the patient perspective of wearable devices in participants with chronic health conditions.

METHODS

A systematic review was conducted to identify any study design that included a usability assessment of wearable devices to measure mobility, through gait and physical activity, within five cohorts with chronic conditions (Parkinson's disease [PD], multiple sclerosis [MS], congestive heart failure, [CHF], chronic obstructive pulmonary disorder [COPD], and proximal femoral fracture [PFF]).

RESULTS

Thirty-seven studies were identified. Substantial heterogeneity in the quality of reporting, the methods used to assess usability, the devices used, and the aims of the studies precluded any meaningful comparisons. Questionnaires were used in the majority of studies (70.3%; n = 26) with a reliance on intervention specific measures (n = 16; 61.5%). For those who used interviews (n = 17; 45.9%), no topic guides were provided, while methods of analysis were not reported in over a third of studies (n = 6; 35.3%).

CONCLUSION

Usability of wearable devices is a poorly measured and reported variable in chronic health conditions. Although the heterogeneity in how these devices are implemented implies acceptance, the patient voice should not be assumed. In the absence of being able to make specific usability conclusions, the results of this review instead recommends that future research needs to: (1) Conduct usability assessments as standard, irrespective of the cohort under investigation or the type of study undertaken. (2) Adhere to basic reporting standards (e.g. COREQ) including the basic details of the study. Full copies of any questionnaires and interview guides should be supplied through supplemental files. (3) Utilise mixed methods research to gather a more comprehensive understanding of usability than either qualitative or quantitative research alone will provide. (4) Use previously validated questionnaires alongside any intervention specific measures.

The Contribution of Machine Learning in the Validation of Commercial Wearable Sensors for Gait Monitoring in Patients: A Systematic Review

Gait, balance, and coordination are important in the development of chronic disease, but the ability to accurately assess these in the daily lives of patients may be limited by traditional biased assessment tools. Wearable sensors offer the possibility of minimizing the main limitations of traditional assessment tools by generating quantitative data on a regular basis, which can greatly improve the home monitoring of patients. However, these commercial sensors must be validated in this context with rigorous validation methods. This scoping review summarizes the state-of-the-art between 2010 and 2020 in terms of the use of commercial wearable devices for gait monitoring in patients. For this specific period, 10 databases were searched and 564 records were retrieved from the associated search. This scoping review included 70 studies investigating one or more wearable sensors used to automatically track patient gait in the field. The majority of studies (95%) utilized accelerometers either by itself (N = 17 of 70) or embedded into a device (N = 57 of 70) and/or gyroscopes (51%) to automatically monitor gait via wearable sensors. All of the studies (N = 70) used one or more validation methods in which “ground truth” data were reported. Regarding the validation of wearable sensors, studies using machine learning have become more numerous since 2010, at 17% of included studies. This scoping review highlights the current state of the ability of commercial sensors to enhance traditional methods of gait assessment by passively monitoring gait in daily life, over long periods of time, and with minimal user interaction. Considering our review of the last 10 years in this field, machine learning approaches are algorithms to be considered for the future. These are in fact data-based approaches which, as long as the data collected are numerous, annotated, and representative, allow for the training of an effective model. In this context, commercial wearable sensors allowing for increased data collection and good patient adherence through efforts of miniaturization, energy consumption, and comfort will contribute to its future success.