Using Smartphones to Reduce Research Burden in a Neurodegenerative Population and Assessing Participant Adherence: A Randomized Clinical Trial and Two Observational Studies

Tracking amyotrophic lateral sclerosis disease progression using passively collected smartphone sensor data

BACKGROUND

Passively collected smartphone sensor data provide an opportunity to study physical activity and mobility unobtrusively over long periods of time and may enable disease monitoring in people with amyotrophic lateral sclerosis (PALS).

METHODS

We enrolled 63 PALS who used Beiwe mobile application that collected their smartphone accelerometer and GPS data and administered the self-entry ALS Functional Rating Scale-Revised (ALSFRS-RSE) survey. We identified individual steps from accelerometer data and used the Activity Index to summarize activity at the minute level. Walking, Activity Index, and GPS outcomes were then aggregated into day-level measures. We used linear mixed effect models (LMMs) to estimate baseline and monthly change for ALSFRS-RSE scores (total score, subscores Q1-3, Q4-6, Q7-9, Q10-12) and smartphone sensor data measures, as well as the associations between them.

FINDINGS

The analytic sample (N = 45) was 64.4% male with a mean age of 60.1 years. The mean observation period was 292.3 days. The ALSFRS-RSE total score baseline mean was 35.8 and had a monthly rate of decline of -0.48 (p-value <0.001). We observed statistically significant change over time and association with ALSFRS-RSE total score for four smartphone sensor data-derived measures: walking cadence from top 1 min and log-transformed step count, step count from top 1 min, and Activity Index from top 1 min.

INTERPRETATION

Smartphone sensors can unobtrusively track physical changes in PALS, potentially aiding disease monitoring and future research.

Listener effort quantifies clinically meaningful progression of dysarthria in people living with amyotrophic lateral sclerosis

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative motor neuron disease that causes progressive muscle weakness. Progressive bulbar dysfunction causes dysarthria and thus social isolation, reducing quality of life. The Everything ALS Speech Study obtained longitudinal clinical information and speech recordings from 292 participants. In a subset of 120 participants, we measured speaking rate (SR) and listener effort (LE), a measure of dysarthria severity rated by speech pathologists from recordings. LE intra- and inter-rater reliability was very high (ICC 0.88 to 0.92). LE correlated with other measures of dysarthria at baseline. LE changed over time in participants with ALS (slope 0.77 pts/month; p<0.001) but not controls (slope 0.005 pts/month; p=0.807). The slope of LE progression was similar in all participants with ALS who had bulbar dysfunction at baseline, regardless of ALS site of onset. LE could be a remotely collected clinically meaningful clinical outcome assessment for ALS clinical trials.

Remote research burden of follow-up in longitudinal patient-reported outcomes (PROs) data collection: An exploratory sequential mixed-methods study (Preprint).. [DOI: 10.2196/preprints.51290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

BACKGROUND

Longitudinal patient-reported outcomes studies require questionnaire assessments to be administered remotely multiple times, burdening research staff.

OBJECTIVE

To define and quantify the burden that researcher may experience during patient follow-up.

METHODS

Data were collected via interviews and a questionnaire. This study is an exploratory sequential mixed-methods study. Traditional content analysis was used for the qualitative data. Quantitative data were analyzed using Spearman’s correlation, and significance was tested using the chi-square test. Learning curves of healthcare staff regarding follow-up calls were generated using cumulative summation analysis.

RESULTS

We constructed a three-dimension conceptual framework for staff burden: (a) time-related burden, (b) technical-related burden, and (c) emotional-related burden. The quantitative analysis found that follow-up time was significantly correlated with staff experience, workload, and learning curve periods. There was a significant difference between the lost-to-follow-up rate of staff with and without follow-up experience with this program. Staff working on a daily assessment schedule had a higher lost-to-follow-up rate than those on a twice-a-week schedule. Additionally, inexperienced follow-up staff needed 113 calls to achieve stable follow-up time and quality, while experienced staff needed only 55 calls.

CONCLUSIONS

Researchers in longitudinal PROs projects suffer from a multidimensional burden during remote follow-up. Our results may help establish a proper PROs follow-up protocol to reduce the burden on research staff without sacrificing data quality.

Feasibility and acceptability of remote smartphone cognitive testing in frontotemporal dementia research

Introduction

Remote smartphone assessments of cognition, speech/language, and motor functioning in frontotemporal dementia (FTD) could enable decentralized clinical trials and improve access to research. We studied the feasibility and acceptability of remote smartphone data collection in FTD research using the ALLFTD Mobile App (ALLFTD-mApp).

Methods

A diagnostically mixed sample of 214 participants with FTD or from familial FTD kindreds (asymptomatic: CDR®+NACC-FTLD = 0 [N = 101]; prodromal: 0.5 [N = 49]; symptomatic ≥1 [N = 51]; not measured [N = 13]) were asked to complete ALLFTD-mApp tests on their smartphone three times within 12 days. They completed smartphone familiarity and participation experience surveys.

Results

It was feasible for participants to complete the ALLFTD-mApp on their own smartphones. Participants reported high smartphone familiarity, completed ∼ 70% of tasks, and considered the time commitment acceptable (98% of respondents). Greater disease severity was associated with poorer performance across several tests.

Discussion

These findings suggest that the ALLFTD-mApp study protocol is feasible and acceptable for remote FTD research.

HIGHLIGHTS

The ALLFTD Mobile App is a smartphone-based platform for remote, self-administered data collection.The ALLFTD Mobile App consists of a comprehensive battery of surveys and tests of executive functioning, memory, speech and language, and motor abilities.Remote digital data collection using the ALLFTD Mobile App was feasible in a multicenter research consortium that studies FTD. Data was collected in healthy controls and participants with a range of diagnoses, particularly FTD spectrum disorders.Remote digital data collection was well accepted by participants with a variety of diagnoses.

Wearable device and smartphone data quantify ALS progression and may provide novel outcome measures

Amyotrophic lateral sclerosis (ALS) therapeutic development has largely relied on staff-administered functional rating scales to determine treatment efficacy. We sought to determine if mobile applications (apps) and wearable devices can be used to quantify ALS disease progression through active (surveys) and passive (sensors) data collection. Forty ambulatory adults with ALS were followed for 6-months. The Beiwe app was used to administer the self-entry ALS functional rating scale-revised (ALSFRS-RSE) and the Rasch Overall ALS Disability Scale (ROADS) surveys every 2-4 weeks. Each participant used a wrist-worn activity monitor (ActiGraph Insight Watch) or an ankle-worn activity monitor (Modus StepWatch) continuously. Wearable device wear and app survey compliance were adequate. ALSFRS-R highly correlated with ALSFRS-RSE. Several wearable data daily physical activity measures demonstrated statistically significant change over time and associations with ALSFRS-RSE and ROADS. Active and passive digital data collection hold promise for novel ALS trial outcome measure development.

Randomized trial of inosine for urate elevation in amyotrophic lateral sclerosis

INTRODUCTION/AIMS

Higher urate levels are associated with improved ALS survival in retrospective studies, however whether raising urate levels confers a survival advantage is unknown. In the Safety of Urate Elevation in Amyotrophic Lateral Sclerosis (SURE-ALS) trial, inosine raised serum urate and was safe and well-tolerated. The SURE-ALS2 trial was designed to assess longer term safety. Functional outcomes and a smartphone application were also explored.

METHODS

Participants were randomized 2:1 to inosine (n = 14) or placebo (n = 9) for 20 weeks, titrated to serum urate of 7-8 mg/dL. Primary outcomes were safety and tolerability. Functional outcomes were measured with the Amyotrophic Lateral Sclerosis Functional Rating Scale Revised (ALSFRS-R). Mobility and ALSFRS-R were also assessed by a smartphone application.

RESULTS

During inosine treatment, mean urate ranged 5.68-6.82 mg/dL. Treatment-emergent adverse event (TEAE) incidence was similar between groups (p > .10). Renal TEAEs occurred in three (21%) and hypertension in one (7%) of participants randomized to inosine. Inosine was tolerated in 71% of participants versus placebo 67%. Two participants (14%) in the inosine group experienced TEAEs deemed related to treatment (nephrolithiasis); one was a severe adverse event. Mean ALSFRS-R decline did not differ between groups (p = .69). Change in measured home time was similar between groups. Digital and in-clinic ALSFRS-R correlated well.

DISCUSSION

Inosine met pre-specified criteria for safety and tolerability. A functional benefit was not demonstrated in this trial designed for safety and tolerability. Findings suggested potential utility for a smartphone application in ALS clinical and research settings.

The feasibility of remotely monitoring physical, cognitive, and psychosocial function in individuals with stroke or chronic obstructive pulmonary disease

Objective

Clinical implementation of remote monitoring of human function requires an understanding of its feasibility. We evaluated adherence and the resources required to monitor physical, cognitive, and psychosocial function in individuals with either chronic obstructive pulmonary disease or stroke during a three-month period.

Methods

Seventy-three individuals agreed to wear a Fitbit to monitor physical function and to complete monthly online assessments of cognitive and psychosocial function. During a three-month period, we measured adherence to monitoring (1) physical function using average daily wear time, and (2) cognition and psychosocial function using the percentage of assessments completed. We measured the resources needed to promote adherence as (1) the number of participants requiring at least one reminder to synchronize their Fitbit, and (2) the number of reminders needed for each completed cognitive and psychosocial assessment.

Results

After accounting for withdrawals, the average daily wear time was 77.5 ± 19.9% of the day and did not differ significantly between months 1, 2, and 3 (p = 0.30). To achieve this level of adherence, 64.9% of participants required at least one reminder to synchronize their device. Participants completed 61.0% of the cognitive and psychosocial assessments; the portion of assessments completed each month didnot significantly differ (p = 0.44). Participants required 1.13 ± 0.57 reminders for each completed assessment. Results did not differ by disease diagnosis.

Conclusions

Remote monitoring of human function in individuals with either chronic obstructive pulmonary disease or stroke is feasible as demonstrated by high adherence. However, the number of reminders required indicates that careful consideration must be given to the resources available to obtain high adherence.

Remote digital assessment of amyotrophic lateral sclerosis functional rating scale - a multicenter observational study

Objective: Remote self-assessment of the revised amyotrophic lateral sclerosis functional rating scale (ALSFRS-R) using digital data capture was investigated for its feasibility as an add-on to ALSFRS-R assessments during multidisciplinary clinic visits. Methods: From August 2017 to December 2021, at 12 ALS centers in Germany, an observational study on remote assessment of the ALSFRS-R was performed. In addition to the assessment of ALSFRS-R during clinic visits, patients were offered a digital self-assessment of the ALSFRS-R - either on a computer or on a mobile application ("ALS-App"). Results: An estimated multicenter cohort of 4,670 ALS patients received care at participating ALS centers. Of these patients, 971 remotely submitted the ALSFRS-R, representing 21% of the multicenter cohort. Of those who opted for remote assessment, 53.7% (n = 521) completed a minimum of 4 ALSFRS-R per year with a mean number of 10.9 assessments per year. Different assessment frequencies were found for patients using a computer (7.9 per year, n = 857) and mobile app (14.6 per year, n = 234). Patients doing remote assessments were more likely to be male and less functionally impaired but many patients with severe disability managed to complete it themselves or with a caregiver (35% of remote ALSFRS-R cohort in King's Stage 4). Conclusions: In a dedicated ALS center setting remote digital self-assessment of ALSFRS-R can provide substantial data which is complementary and potentially an alternative to clinic assessments and could be used for research purposes and person-level patient management. Addressing barriers relating to patient uptake and adherence are key to its success.

Smartphones for musculoskeletal research - hype or hope? Lessons from a decennium of mHealth studies

BACKGROUND

Smartphones provide opportunities for musculoskeletal research: they are integrated in participants' daily lives and can be used to collect patient-reported outcomes as well as sensor data from large groups of people. As the field of research with smartphones and smartwatches matures, it has transpired that some of the advantages of this modern technology are in fact double-edged swords. BODY: In this narrative review, we illustrate the advantages of using smartphones for data collection with 18 studies from various musculoskeletal domains. We critically appraised existing literature, debunking some myths around the advantages of smartphones: the myth that smartphone studies automatically enable high engagement, that they reach more representative samples, that they cost little, and that sensor data is objective. We provide a nuanced view of evidence in these areas and discuss strategies to increase engagement, to reach representative samples, to reduce costs and to avoid potential sources of subjectivity in analysing sensor data.

CONCLUSION

If smartphone studies are designed without awareness of the challenges inherent to smartphone use, they may fail or may provide biased results. Keeping participants of smartphone studies engaged longitudinally is a major challenge. Based on prior research, we provide 6 actions by researchers to increase engagement. Smartphone studies often have participants that are younger, have higher incomes and high digital literacy. We provide advice for reaching more representative participant groups, and for ensuring that study conclusions are not plagued by bias resulting from unrepresentative sampling. Costs associated with app development and testing, data storage and analysis, and tech support are substantial, even if studies use a 'bring your own device'-policy. Exchange of information on costs, collective app development and usage of open-source tools would help the musculoskeletal community reduce costs of smartphone studies. In general, transparency and wider adoption of best practices would help bringing smartphone studies to the next level. Then, the community can focus on specific challenges of smartphones in musculoskeletal contexts, such as symptom-related barriers to using smartphones for research, validating algorithms in patient populations with reduced functional ability, digitising validated questionnaires, and methods to reliably quantify pain, quality of life and fatigue.