Reliability and validity of the Roche PD Mobile Application for remote monitoring of early Parkinson's disease

Implementing sensor-based digital health technologies in clinical trials: Key considerations from the eCOA Consortium

The increased use of sensor-based digital health technologies (DHTs) in clinical trials brought to light concerns about implementation practices that might introduce burden on trial participants, resulting in suboptimal compliance and become an additional complicating factor in clinical trial conduct. These concerns may contribute to the lower-than-anticipated uptake of DHT deployment and data use for regulatory decision-making, despite well-articulated benefits. The Electronic Clinical Outcome Assessment (eCOA) Consortium gathered collective experience on deploying sensor-based DHTs and supplemented this with relevant literature focusing on mechanisms that may enhance participant compliance. The process for DHT implementation starts with identifying a clinical concept of interest followed by a digital measure selection, defining active or passive data capture and their sources, the number of sensors with respective body location, plus the duration and frequency of use in the context of perceived participant burden. Roundtable discussions among patient groups, physicians, and technology providers prior to protocol development can be very impactful for optimizing trial design. While diversity and inclusion are essential for any clinical trial, patient populations should be considered carefully in the context of trial-specific aims, requirements, and anticipated patient burden. Minimizing site burden includes assessment of training, research engagement, and logistical burden which needs to be triaged differently for early and late-stage clinical trials. Additional considerations include sharing trial results with study participants and leveraging publicly available data for compliance modeling. To the best of our knowledge, this report provides holistic considerations for sensor-based DHT implementation that may optimize participant compliance.

Impacts on study design when implementing digital measures in Parkinson's disease-modifying therapy trials

Introduction

Parkinson's Disease affects over 8.5 million people and there are currently no medications approved to treat underlying disease. Clinical trials for disease modifying therapies (DMT) are hampered by a lack of sufficiently sensitive measures to detect treatment effect. Reliable digital assessments of motor function allow for frequent at-home measurements that may be able to sensitively detect disease progression.

Methods

Here, we estimate the test-retest reliability of a suite of at-home motor measures derived from raw triaxial accelerometry data collected from 44 participants (21 with confirmed PD) and use the estimates to simulate digital measures in DMT trials. We consider three schedules of assessments and fit linear mixed models to the simulated data to determine whether a treatment effect can be detected.

Results

We find at-home measures vary in reliability; many have ICCs as high as or higher than MDS-UPDRS part III total score. Compared with quarterly in-clinic assessments, frequent at-home measures reduce the sample size needed to detect a 30% reduction in disease progression from over 300 per study arm to 150 or less than 100 for bursts and evenly spaced at-home assessments, respectively. The results regarding superiority of at-home assessments for detecting change over time are robust to relaxing assumptions regarding the responsiveness to disease progression and variability in progression rates.

Discussion

Overall, at-home measures have a favorable reliability profile for sensitive detection of treatment effects in DMT trials. Future work is needed to better understand the causes of variability in PD progression and identify the most appropriate statistical methods for effect detection.

Disease-modifying therapies for Parkinson disease: lessons from multiple sclerosis

The development of disease-modifying therapies (DMTs) for neurological disorders is an important goal in modern neurology, and the associated challenges are similar in many chronic neurological conditions. Major advances have been made in the multiple sclerosis (MS) field, with a range of DMTs being approved for relapsing MS and the introduction of the first DMTs for progressive MS. By contrast, people with Parkinson disease (PD) still lack such treatment options, relying instead on decades-old therapeutic approaches that provide only symptomatic relief. To address this unmet need, an in-person symposium was held in Toronto, Canada, in November 2022 for international researchers and experts in MS and PD to discuss strategies for advancing DMT development. In this Roadmap article, we highlight discussions from the symposium, which focused on therapeutic targets and preclinical models, disease spectra and subclassifications, and clinical trial design and outcome measures. From these discussions, we propose areas for novel or deeper exploration in PD using lessons learned from therapeutic development in MS. In addition, we identify challenges common to the PD and MS fields that need to be addressed to further advance the discovery and development of effective DMTs.

Wearable Sensor-Based Assessments for Remotely Screening Early-Stage Parkinson's Disease

Prevalence estimates of Parkinson's disease (PD)-the fastest-growing neurodegenerative disease-are generally underestimated due to issues surrounding diagnostic accuracy, symptomatic undiagnosed cases, suboptimal prodromal monitoring, and limited screening access. Remotely monitored wearable devices and sensors provide precise, objective, and frequent measures of motor and non-motor symptoms. Here, we used consumer-grade wearable device and sensor data from the WATCH-PD study to develop a PD screening tool aimed at eliminating the gap between patient symptoms and diagnosis. Early-stage PD patients (n = 82) and age-matched comparison participants (n = 50) completed a multidomain assessment battery during a one-year longitudinal multicenter study. Using disease- and behavior-relevant feature engineering and multivariate machine learning modeling of early-stage PD status, we developed a highly accurate (92.3%), sensitive (90.0%), and specific (100%) random forest classification model (AUC = 0.92) that performed well across environmental and platform contexts. These findings provide robust support for further exploration of consumer-grade wearable devices and sensors for global population-wide PD screening and surveillance.

Assessing the clinical utility of inertial sensors for home monitoring in Parkinson's disease: a comprehensive review

This review screened 296 articles on wearable sensors for home monitoring of people with Parkinson's Disease within the PubMed Database, from January 2017 to May 2023. A three-level maturity framework was applied for classifying the aims of 59 studies included: demonstrating technical efficacy, diagnostic sensitivity, or clinical utility. As secondary analysis, user experience (usability and patient adherence) was evaluated. The evidences provided by the studies were categorized and stratified according to the level of maturity. Our results indicate that approximately 75% of articles investigated diagnostic sensitivity, i.e. correlation of sensor-data with clinical parameters. Evidence of clinical utility, defined as improvement on health outcomes or clinical decisions after the use of the wearables, was found only in nine papers. A third of the articles included reported evidence of user experience. Future research should focus more on clinical utility, to facilitate the translation of research results within the management of Parkinson's Disease.

Regulatory Pathways for Qualification and Acceptance of Digital Health Technology-Derived Clinical Trial Endpoints: Considerations for Sponsors

Despite widespread interest and substantial investment in the adoption of sensor-based digital health technologies (sDHTs) for remote data capture in drug development trials, no drug has been approved based on an sDHT-derived primary endpoint in the United States (US). One reason for this lack of advancement is the complexity of obtaining regulatory endorsement for those endpoints within current US regulatory pathways. The goal of our review is to describe the two choices currently available to pharmaceutical study Sponsors: (i) they may navigate the traditional route of compiling the evidence to support the sDHT-derived endpoint in their investigational new drug (IND) application, requiring specific expertise and substantial resources; or (ii) they may navigate the drug development tool (DDT) pathway with the goal of qualifying their sDHT-derived endpoint as a biomarker or clinical outcome assessment applicable to a broader context of use (COU), either alone or as part of a partnership or consortium. We describe the nuances of each pathway; the evidentiary requirements for supporting an sDHT-derived endpoint and the technology used to capture it; and the impact that an sDHT's regulatory status may have on a Sponsor's decision to use it for data capture. By systematically comparing the IND and DDT pathways, our over-arching goals are to support the increasing deployment of sDHTs within the clinical research setting and help advance regulatory science in the field of digital medicine.

Deep Learning for hand tracking in Parkinson's Disease video-based assessment: Current and future perspectives

BACKGROUND

Parkinson's Disease (PD) demands early diagnosis and frequent assessment of symptoms. In particular, analysing hand movements is pivotal to understand disease progression. Advancements in hand tracking using Deep Learning (DL) allow for the automatic and objective disease evaluation from video recordings of standardised motor tasks, which are the foundation of neurological examinations. In view of this scenario, this narrative review aims to describe the state of the art and the future perspective of DL frameworks for hand tracking in video-based PD assessment.

METHODS

A rigorous search of PubMed, Web of Science, IEEE Explorer, and Scopus until October 2023 using primary keywords such as parkinson, hand tracking, and deep learning was performed to select eligible by focusing on video-based PD assessment through DL-driven hand tracking frameworks RESULTS:: After accurate screening, 23 publications met the selection criteria. These studies used various solutions, from well-established pose estimation frameworks, like OpenPose and MediaPipe, to custom deep architectures designed to accurately track hand and finger movements and extract relevant disease features. Estimated hand tracking data were then used to differentiate PD patients from healthy individuals, characterise symptoms such as tremors and bradykinesia, or regress the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) by automatically assessing clinical tasks such as finger tapping, hand movements, and pronation-supination.

CONCLUSIONS

DL-driven hand tracking holds promise for PD assessment, offering precise, objective measurements for early diagnosis and monitoring, especially in a telemedicine scenario. However, to ensure clinical acceptance, standardisation and validation are crucial. Future research should prioritise large open datasets, rigorous validation on patients, and the investigation of new frontiers such as tracking hand-hand and hand-object interactions for daily-life tasks assessment.

Digital health technologies to strengthen patient-centred outcome assessment in clinical trials in inflammatory arthritis

Common to all inflammatory arthritides, namely rheumatoid arthritis, psoriatic arthritis, axial spondyloarthritis, and juvenile idiopathic arthritis, is a potential for reduced mobility that manifests through joint pain, swelling, stiffness, and ultimately joint damage. Across these conditions, consensus has been reached on the need to capture outcomes related to mobility, such as functional capacity and physical activity, as core domains in randomised controlled trials. Existing endpoints within these core domains rely wholly on self-reported questionnaires that capture patients' perceptions of their symptoms and activities. These questionnaires are subjective, inherently vulnerable to recall bias, and do not capture the granularity of fluctuations over time. Several early adopters have integrated sensor-based digital health technology (DHT)-derived endpoints to measure physical function and activity in randomised controlled trials for conditions including Parkinson's disease, Duchenne's muscular dystrophy, chronic obstructive pulmonary disease, and heart failure. Despite these applications, there have been no sensor-based DHT-derived endpoints in clinical trials recruiting patients with inflammatory arthritis. Borrowing from case studies across medicine, we outline the opportunities and challenges in developing novel sensor-based DHT-derived endpoints that capture the symptoms and disease manifestations most relevant to patients with inflammatory arthritis.

Digital biomarkers for non-motor symptoms in Parkinson's disease: the state of the art

Digital biomarkers that remotely monitor symptoms have the potential to revolutionize outcome assessments in future disease-modifying trials in Parkinson's disease (PD), by allowing objective and recurrent measurement of symptoms and signs collected in the participant's own living environment. This biomarker field is developing rapidly for assessing the motor features of PD, but the non-motor domain lags behind. Here, we systematically review and assess digital biomarkers under development for measuring non-motor symptoms of PD. We also consider relevant developments outside the PD field. We focus on technological readiness level and evaluate whether the identified digital non-motor biomarkers have potential for measuring disease progression, covering the spectrum from prodromal to advanced disease stages. Furthermore, we provide perspectives for future deployment of these biomarkers in trials. We found that various wearables show high promise for measuring autonomic function, constipation and sleep characteristics, including REM sleep behavior disorder. Biomarkers for neuropsychiatric symptoms are less well-developed, but show increasing accuracy in non-PD populations. Most biomarkers have not been validated for specific use in PD, and their sensitivity to capture disease progression remains untested for prodromal PD where the need for digital progression biomarkers is greatest. External validation in real-world environments and large longitudinal cohorts remains necessary for integrating non-motor biomarkers into research, and ultimately also into daily clinical practice.

Examining Associations Between Smartphone Use and Clinical Severity in Frontotemporal Dementia: Proof-of-Concept Study

BACKGROUND

Frontotemporal lobar degeneration (FTLD) is a leading cause of dementia in individuals aged <65 years. Several challenges to conducting in-person evaluations in FTLD illustrate an urgent need to develop remote, accessible, and low-burden assessment techniques. Studies of unobtrusive monitoring of at-home computer use in older adults with mild cognitive impairment show that declining function is reflected in reduced computer use; however, associations with smartphone use are unknown.

OBJECTIVE

This study aims to characterize daily trajectories in smartphone battery use, a proxy for smartphone use, and examine relationships with clinical indicators of severity in FTLD.

METHODS

Participants were 231 adults (mean age 52.5, SD 14.9 years; n=94, 40.7% men; n=223, 96.5% non-Hispanic White) enrolled in the Advancing Research and Treatment of Frontotemporal Lobar Degeneration (ARTFL study) and Longitudinal Evaluation of Familial Frontotemporal Dementia Subjects (LEFFTDS study) Longitudinal Frontotemporal Lobar Degeneration (ALLFTD) Mobile App study, including 49 (21.2%) with mild neurobehavioral changes and no functional impairment (ie, prodromal FTLD), 43 (18.6%) with neurobehavioral changes and functional impairment (ie, symptomatic FTLD), and 139 (60.2%) clinically normal adults, of whom 55 (39.6%) harbored heterozygous pathogenic or likely pathogenic variants in an autosomal dominant FTLD gene. Participants completed the Clinical Dementia Rating plus National Alzheimer's Coordinating Center Frontotemporal Lobar Degeneration Behavior and Language Domains (CDR+NACC FTLD) scale, a neuropsychological battery; the Neuropsychiatric Inventory; and brain magnetic resonance imaging. The ALLFTD Mobile App was installed on participants' smartphones for remote, passive, and continuous monitoring of smartphone use. Battery percentage was collected every 15 minutes over an average of 28 (SD 4.2; range 14-30) days. To determine whether temporal patterns of battery percentage varied as a function of disease severity, linear mixed effects models examined linear, quadratic, and cubic effects of the time of day and their interactions with each measure of disease severity on battery percentage. Models covaried for age, sex, smartphone type, and estimated smartphone age.

RESULTS

The CDR+NACC FTLD global score interacted with time on battery percentage such that participants with prodromal or symptomatic FTLD demonstrated less change in battery percentage throughout the day (a proxy for less smartphone use) than clinically normal participants (P<.001 in both cases). Additional models showed that worse performance in all cognitive domains assessed (ie, executive functioning, memory, language, and visuospatial skills), more neuropsychiatric symptoms, and smaller brain volumes also associated with less battery use throughout the day (P<.001 in all cases).

CONCLUSIONS

These findings support a proof of concept that passively collected data about smartphone use behaviors associate with clinical impairment in FTLD. This work underscores the need for future studies to develop and validate passive digital markers sensitive to longitudinal clinical decline across neurodegenerative diseases, with potential to enhance real-world monitoring of neurobehavioral change.

Using a smartwatch and smartphone to assess early Parkinson's disease in the WATCH-PD study over 12 months

Digital measures may provide objective, sensitive, real-world measures of disease progression in Parkinson's disease (PD). However, multicenter longitudinal assessments of such measures are few. We recently demonstrated that baseline assessments of gait, tremor, finger tapping, and speech from a commercially available smartwatch, smartphone, and research-grade wearable sensors differed significantly between 82 individuals with early, untreated PD and 50 age-matched controls. Here, we evaluated the longitudinal change in these assessments over 12 months in a multicenter observational study using a generalized additive model, which permitted flexible modeling of at-home data. All measurements were included until participants started medications for PD. Over one year, individuals with early PD experienced significant declines in several measures of gait, an increase in the proportion of day with tremor, modest changes in speech, and few changes in psychomotor function. As measured by the smartwatch, the average (SD) arm swing in-clinic decreased from 25.9 (15.3) degrees at baseline to 19.9 degrees (13.7) at month 12 (P = 0.004). The proportion of awake time an individual with early PD had tremor increased from 19.3% (18.0%) to 25.6% (21.4%; P < 0.001). Activity, as measured by the number of steps taken per day, decreased from 3052 (1306) steps per day to 2331 (2010; P = 0.16), but this analysis was restricted to 10 participants due to the exclusion of those that had started PD medications and lost the data. The change of these digital measures over 12 months was generally larger than the corresponding change in individual items on the Movement Disorder Society-Unified Parkinson's Disease Rating Scale but not greater than the change in the overall scale. Successful implementation of digital measures in future clinical trials will require improvements in study conduct, especially data capture. Nonetheless, gait and tremor measures derived from a commercially available smartwatch and smartphone hold promise for assessing the efficacy of therapeutics in early PD.

Digital outcome measures from smartwatch data relate to non-motor features of Parkinson's disease

Monitoring of Parkinson's disease (PD) has seen substantial improvement over recent years as digital sensors enable a passive and continuous collection of information in the home environment. However, the primary focus of this work has been motor symptoms, with little focus on the non-motor aspects of the disease. To address this, we combined longitudinal clinical non-motor assessment data and digital multi-sensor data from the Verily Study Watch for 149 participants from the Parkinson's Progression Monitoring Initiative (PPMI) cohort with a diagnosis of PD. We show that digitally collected physical activity and sleep measures significantly relate to clinical non-motor assessments of cognitive, autonomic, and daily living impairment. However, the poor predictive performance we observed, highlights the need for better targeted digital outcome measures to enable monitoring of non-motor symptoms.

Immunotherapy: An emerging treatment option for neurodegenerative diseases

Accumulation of misfolded proteins and protein aggregates leading to degeneration of neurons is a hallmark of several neurodegenerative diseases. Therapy mostly relies on symptomatic relief. Immunotherapy offers a promising approach for the development of disease-modifying routes. Such strategies have shown remarkable results in oncology, and this promise is increasingly being realized for neurodegenerative diseases in advanced preclinical and clinical studies. This review highlights cases of passive and active immunotherapies in Parkinson's and Alzheimer's diseases. The reasons for success and failure, wherever available, and strategies to cross the blood-brain barrier, are discussed. The need for conditional modulation of the immune response is also reflected on.

Improved measurement of disease progression in people living with early Parkinson's disease using digital health technologies

BACKGROUND

Digital health technologies show promise for improving the measurement of Parkinson's disease in clinical research and trials. However, it is not clear whether digital measures demonstrate enhanced sensitivity to disease progression compared to traditional measurement approaches.

METHODS

To this end, we develop a wearable sensor-based digital algorithm for deriving features of upper and lower-body bradykinesia and evaluate the sensitivity of digital measures to 1-year longitudinal progression using data from the WATCH-PD study, a multicenter, observational digital assessment study in participants with early, untreated Parkinson's disease. In total, 82 early, untreated Parkinson's disease participants and 50 age-matched controls were recruited and took part in a variety of motor tasks over the course of a 12-month period while wearing body-worn inertial sensors. We establish clinical validity of sensor-based digital measures by investigating convergent validity with appropriate clinical constructs, known groups validity by distinguishing patients from healthy volunteers, and test-retest reliability by comparing measurements between visits.

RESULTS

We demonstrate clinical validity of the digital measures, and importantly, superior sensitivity of digital measures for distinguishing 1-year longitudinal change in early-stage PD relative to corresponding clinical constructs.

CONCLUSIONS

Our results demonstrate the potential of digital health technologies to enhance sensitivity to disease progression relative to existing measurement standards and may constitute the basis for use as drug development tools in clinical research.

Smartphone applications for Movement Disorders: Towards collaboration and re-use

BACKGROUND

Numerous smartphone and tablet applications (apps) are available to monitor movement disorders, but an overview of their purpose and stage of development is missing.

OBJECTIVES

To systematically review published literature and classify smartphone and tablet apps with objective measurement capabilities for the diagnosis, monitoring, assessment, or treatment of movement disorders.

METHODS

We systematically searched for publications covering smartphone or tablet apps to monitor movement disorders until November 22nd, 2023. We reviewed the target population, measured domains, purpose, and technology readiness level (TRL) of the proposed app and checked their availability in common app stores.

RESULTS

We identified 113 apps. Most apps were developed for Parkinson's disease specifically (n = 82; 73%) or for movement disorders in general (n = 17; 15%). Apps were either designed to momentarily assess symptoms (n = 65; 58%), support treatment (n = 22; 19%), aid in diagnosis (n = 16; 14%), or passively track symptoms (n = 11; 10%). Commonly assessed domains across movement disorders included fine motor skills (n = 34; 30%), gait (n = 36; 32%), and tremor (n = 32; 28%) for the motor domain and cognition (n = 16; 14%) for the non-motor domain. Twenty-six (23%) apps were proof-of-concepts (TRL 1-3), while most apps were tested in a controlled setting (TRL 4-6; n = 63; 56%). Twenty-four apps were tested in their target setting (TRL 7-9) of which 10 were accessible in common app stores or as Android Package.

CONCLUSIONS

The development of apps strongly gravitates towards Parkinson's disease and a selection of motor symptoms. Collaboration, re-use and further development of existing apps is encouraged to avoid reinventions of the wheel.

Digital health technologies and machine learning augment patient reported outcomes to remotely characterise rheumatoid arthritis

Digital measures of health status captured during daily life could greatly augment current in-clinic assessments for rheumatoid arthritis (RA), to enable better assessment of disease progression and impact. This work presents results from weaRAble-PRO, a 14-day observational study, which aimed to investigate how digital health technologies (DHT), such as smartphones and wearables, could augment patient reported outcomes (PRO) to determine RA status and severity in a study of 30 moderate-to-severe RA patients, compared to 30 matched healthy controls (HC). Sensor-based measures of health status, mobility, dexterity, fatigue, and other RA specific symptoms were extracted from daily iPhone guided tests (GT), as well as actigraphy and heart rate sensor data, which was passively recorded from patients' Apple smartwatch continuously over the study duration. We subsequently developed a machine learning (ML) framework to distinguish RA status and to estimate RA severity. It was found that daily wearable sensor-outcomes robustly distinguished RA from HC participants (F1, 0.807). Furthermore, by day 7 of the study (half-way), a sufficient volume of data had been collected to reliably capture the characteristics of RA participants. In addition, we observed that the detection of RA severity levels could be improved by augmenting standard patient reported outcomes with sensor-based features (F1, 0.833) in comparison to using PRO assessments alone (F1, 0.759), and that the combination of modalities could reliability measure continuous RA severity, as determined by the clinician-assessed RAPID-3 score at baseline (r2, 0.692; RMSE, 1.33). The ability to measure the impact of the disease during daily life-through objective and remote digital outcomes-paves the way forward to enable the development of more patient-centric and personalised measurements for use in RA clinical trials.

Shifting From Active to Passive Monitoring of Alzheimer Disease: The State of the Research

Most research using digital technologies builds on existing methods for staff-administered evaluation, requiring a large investment of time, effort, and resources. Widespread use of personal mobile devices provides opportunities for continuous health monitoring without active participant engagement. Home-based sensors show promise in evaluating behavioral features in near real time. Digital technologies across these methodologies can detect precise measures of cognition, mood, sleep, gait, speech, motor activity, behavior patterns, and additional features relevant to health. As a neurodegenerative condition with insidious onset, Alzheimer disease and other dementias (AD/D) represent a key target for advances in monitoring disease symptoms. Studies to date evaluating the predictive power of digital measures use inconsistent approaches to characterize these measures. Comparison between different digital collection methods supports the use of passive collection methods in settings in which active participant engagement approaches are not feasible. Additional studies that analyze how digital measures across multiple data streams can together improve prediction of cognitive impairment and early-stage AD are needed. Given the long timeline of progression from normal to diagnosis, digital monitoring will more easily make extended longitudinal follow-up possible. Through the American Heart Association-funded Strategically Focused Research Network, the Boston University investigative team deployed a platform involving a wide range of technologies to address these gaps in research practice. Much more research is needed to thoroughly evaluate limitations of passive monitoring. Multidisciplinary collaborations are needed to establish legal and ethical frameworks for ensuring passive monitoring can be conducted at scale while protecting privacy and security, especially in vulnerable populations.

Upper limb intention tremor assessment: opportunities and challenges in wearable technology

BACKGROUND

Tremors are involuntary rhythmic movements commonly present in neurological diseases such as Parkinson's disease, essential tremor, and multiple sclerosis. Intention tremor is a subtype associated with lesions in the cerebellum and its connected pathways, and it is a common symptom in diseases associated with cerebellar pathology. While clinicians traditionally use tests to identify tremor type and severity, recent advancements in wearable technology have provided quantifiable ways to measure movement and tremor using motion capture systems, app-based tasks and tools, and physiology-based measurements. However, quantifying intention tremor remains challenging due to its changing nature.

METHODOLOGY & RESULTS

This review examines the current state of upper limb tremor assessment technology and discusses potential directions to further develop new and existing algorithms and sensors to better quantify tremor, specifically intention tremor. A comprehensive search using PubMed and Scopus was performed using keywords related to technologies for tremor assessment. Afterward, screened results were filtered for relevance and eligibility and further classified into technology type. A total of 243 publications were selected for this review and classified according to their type: body function level: movement-based, activity level: task and tool-based, and physiology-based. Furthermore, each publication's methods, purpose, and technology are summarized in the appendix table.

CONCLUSIONS

Our survey suggests a need for more targeted tasks to evaluate intention tremors, including digitized tasks related to intentional movements, neurological and physiological measurements targeting the cerebellum and its pathways, and signal processing techniques that differentiate voluntary from involuntary movement in motion capture systems.

Improving naturalistic neuroscience with patient engagement strategies

Introduction

The clinical implementation of chronic electrophysiology-driven adaptive deep brain stimulation (DBS) algorithms in movement disorders requires reliable representation of motor and non-motor symptoms in electrophysiological biomarkers, throughout normal life (naturalistic). To achieve this, there is the need for high-resolution and -quality chronic objective and subjective symptom monitoring in parallel to biomarker recordings. To realize these recordings, an active participation and engagement of the investigated patients is necessary. To date, there has been little research into patient engagement strategies for DBS patients or chronic electrophysiological recordings.

Concepts and results

We here present our concept and the first results of a patient engagement strategy for a chronic DBS study. After discussing the current state of literature, we present objectives, methodology and consequences of the patient engagement regarding study design, data acquisition, and study infrastructure. Nine patients with Parkinson's disease and their caregivers participated in the meeting, and their input led to changes to our study design. Especially, the patient input helped us designing study-set-up meetings and support structures.

Conclusion

We believe that patient engagement increases compliance and study motivation through scientific empowerment of patients. While considering patient opinion on sensors or questionnaire questions may lead to more precise and reliable data acquisition, there was also a high demand for study support and engagement structures. Hence, we recommend the implementation of patient engagement in planning of chronic studies with complex designs, long recording durations or high demand for individual active study participation.

Smartphone-Based Assessment of Mobility and Manual Dexterity in Adult People with Spinal Muscular Atrophy

Background

More responsive, reliable, and clinically valid endpoints of disability are essential to reduce size, duration, and burden of clinical trials in adult persons with spinal muscular atrophy (aPwSMA).

Objective

The aim is to investigate the feasibility of smartphone-based assessments in aPwSMA and provide evidence on the reliability and construct validity of sensor-derived measures (SDMs) of mobility and manual dexterity collected remotely in aPwSMA.

Methods

Data were collected from 59 aPwSMA (23 walkers, 20 sitters and 16 non-sitters) and 30 age-matched healthy controls (HC). SDMs were extracted from five smartphone-based tests capturing mobility and manual dexterity, which were administered in-clinic and remotely in daily life for four weeks. Reliability (Intraclass Correlation Coefficients, ICC) and construct validity (ability to discriminate between HC and aPwSMA and correlations with Revised Upper Limb Module, RULM and Hammersmith Functional Scale - Expanded HFMSE) were quantified for all SDMs.

Results

The smartphone-based assessments proved feasible, with 92.1% average adherence in aPwSMA. The SDMs allowed to reliably assess both mobility and dexterity (ICC > 0.75 for 14/22 SDMs). Twenty-one out of 22 SDMs significantly discriminated between HC and aPwSMA. The highest correlations with the RULM were observed for SDMs from the manual dexterity tests in both non-sitters (Typing, ρ= 0.78) and sitters (Pinching, ρ= 0.75). In walkers, the highest correlation was between mobility tests and HFMSE (5 U-Turns, ρ= 0.79).

Conclusions

This exploratory study provides preliminary evidence for the usability of smartphone-based assessments of mobility and manual dexterity in aPwSMA when deployed remotely in participants' daily life. Reliability and construct validity of SDMs remotely collected in real-life was demonstrated, which is a pre-requisite for their use in longitudinal trials. Additionally, three novel smartphone-based performance outcome assessments were successfully established for aPwSMA. Upon further validation of responsiveness to interventions, this technology holds potential to increase the efficiency of clinical trials in aPwSMA.

Development and implementation of the frog-in-maze game to study upper limb movement in people with Parkinson's disease

Upper-limb bradykinesia occurs early in Parkinson's disease (PD) and bradykinesia is required for diagnosis. Our goal was to develop, implement and validate a game "walking" a frog through a maze using bimanual, alternating finger-tapping movements to provide a salient, objective, and remotely monitorable method of tracking disease progression and response to therapy in PD. Twenty-five people with PD and 16 people without PD participated. Responses on 5 different mazes were quantified and compared to spatiotemporal gait parameters and standard disease metrics in these participants. Intertap interval (ITI) on maze 2 & 3, which included turns, was strongly inversely related to stride-length and stride-velocity and directly related to motor UPDRS scores. Levodopa decreased ITI, except in maze 4. PD participants with freezing of gait had longer ITI on all mazes. The responses quantified on maze 2 & 3 were related to disease severity and gait stride-length, were levodopa responsive, and were worse in people with freezing of gait, suggesting that these mazes could be used to quantify motor dysfunction in PD. Programming our frog-in-maze game onto a remotely distributable platform could provide a tool to monitor disease progression and therapeutic response in people with PD, including during clinical trials.

Patient-centric assessment of rheumatoid arthritis using a smartwatch and bespoke mobile app in a clinical setting

Rheumatoid arthritis (RA) is a fluctuating progressive disease requiring frequent symptom assessment for appropriate management. Continuous tracking using digital technologies may provide greater insights of a patient's experience. This prospective study assessed the feasibility, reliability, and clinical utility of using novel digital technologies to remotely monitor participants with RA. Participants with moderate to severe RA and non-RA controls were monitored continuously for 14 days using an iPhone with an integrated bespoke application and an Apple Watch. Participants completed patient-reported outcome measures and objective guided tests designed to assess disease-related impact on physical function. The study was completed by 28 participants with RA, 28 matched controls, and 2 unmatched controls. Completion rates for all assessments were > 97% and were reproducible over time. Several guided tests distinguished between RA and control cohorts (e.g., mean lie-to-stand time [seconds]: RA: 4.77, control: 3.25; P < 0.001). Participants with RA reporting greater stiffness, pain, and fatigue had worse guided test performances (e.g., wrist movement [P < 0.001] and sit-to-stand transition time [P = 0.009]) compared with those reporting lower stiffness, pain, and fatigue. This study demonstrates that digital technologies can be used in a well-controlled, remote clinical setting to assess the daily impact of RA.

Application of single wrist-wearable accelerometry for objective motor diary assessment in fluctuating Parkinson's disease

Advanced Parkinson's disease (PD) is characterized by motor fluctuations including unpredictable oscillations remarkably impairing quality of life. Effective management and development of novel therapies for these response fluctuations largely depend on clinical rating instruments such as the widely-used PD home diary, which are associated with biases and errors. Recent advancements in digital health technologies provide user-friendly wearables that can be tailored for continuous monitoring of motor fluctuations. Their criterion validity under real-world conditions using clinical examination as the gold standard remains to be determined. We prospectively examined this validity of a wearable accelerometer-based digital Parkinson's Motor Diary (adPMD) using the Parkinson's Kinetigraph (PKG®) in an alternative application by converting its continuous data into one of the three motor categories of the PD home diary (Off, On and Dyskinetic state). Sixty-three out of 91 eligible participants with fluctuating PD (46% men, average age 66) had predefined sufficient adPMD datasets (>70% of half-hour periods) from 2 consecutive days. 92% of per-protocol assessments were completed. adPMD monitoring of daily times in motor states showed moderate validity for Off and Dyskinetic state (ICC = 0.43-0.51), while inter-rating methods agreements on half-hour-level can be characterized as poor (median Cohen's κ = 0.13-0.21). Individualization of adPMD thresholds for transferring accelerometer data into diary categories improved temporal agreements up to moderate level for Dyskinetic state detection (median Cohen's κ = 0.25-0.41). Here we report that adPMD real-world-monitoring captures daily times in Off and Dyskinetic state in advanced PD with moderate validities, while temporal agreement of adPMD and clinical observer diary data is limited.

Detection and Characterization of Walking Bouts Using a Single Wrist-Worn Accelerometer in Free-living Conditions

Detection and characterization of abnormalities of movement are important to develop a method for detecting early signs of Parkinson's disease (PD). Most of the current research in detection of characteristic reduction of movements due to PD, known as parkinsonism, requires using a set of invasive sensors in a clinical or controlled environment. Actigraphy has been widely used in medical research as a non-invasive data acquisition method in free-living conditions for long periods of time. The proposed algorithm uses triaxial accelerometer data obtained through actigraphy to detect walking bouts at least 10 seconds long and characterize them using cadence and arm swing. Accurate detection of walking periods is the first step toward the characterization of movement based on gait abnormalities. The algorithm was based on a Walking Score (WS) derived using the value of the auto-correlation function (ACF) for the Resultant acceleration vector. The algorithm achieved a precision of 0.90, recall of 0.77, and F1 score of 0.83 compared to the expert scoring for walking bout detection. We additionally described a method to measure arm swing amplitude.

Digital technologies: Innovations that transform the face of drug development

Recently, digital health technologies (DHTs) and digital biomarkers have gained a lot of traction in clinical investigations, motivating sponsors, investigators, and regulators to discuss and implement integrated approaches for deploying DHTs. These new tools present new and unique challenges for optimal technology integration in clinical trial processes, including operational, ethical, and regulatory issues. In this paper, we gathered different perspectives to discuss challenges and perspectives from three different stakeholders: industry, US regulators, and a public-private partnership consortium. The complexities of DHT implementation, which include regulatory definitions, defining the scope of validation experiments, and the need for partnerships between BioPharma and the technology sectors, are highlighted. Most of these challenges are related to translation of DHT-derived measures into endpoints that are meaningful to clinicians and patients, participant safety, training, and retention and privacy of data. The example of the Wearable Assessments in the Clinic and Home in PD (WATCH-PD) study is discussed as an example that demonstrated the advantages of pre-competitive collaborations, which include early regulatory feedback, data sharing, and multistakeholder alignment. Future advances in DHTs are expected to spur device-agnostic measured development and incorporate patient reported outcomes in drug development. More efforts are needed to define validation experiments for a defined context of use, incentivize data sharing and development of data standards. Multistakeholder collaborations via precompetitive consortia will help facilitate broad acceptance of DHT-enabled measures in drug development.

Digital health technology derived measures: Biomarkers or clinical outcome assessments?

Digital health technologies (DHTs) present unique opportunities for clinical evidence generation but pose certain challenges. These challenges stem, in part, from existing definitions of drug development tools, which were not created with DHT-derived measures in mind. DHT-derived measures can be leveraged as either clinical outcome assessments (COAs) or as biomarkers since they share properties with both categories of drug development tools. Examples from the literature indicate a variety of applications for DHT-derived data, including capturing disease physiology, symptom tracking, or response to therapies. The distinction between the categorization of DHT-derived measures as COAs or as biomarkers can be very fine, with terminology variability among regulatory authorities. This has significant implications for integration of DHT-derived measures in clinical trials, leading to confusion regarding the evidence required to support these tools' use in drug development. There is a need to amend definitions and create clear evidentiary requirements to support broad adoption of these new and innovative tools. The biopharma industry, the technology sector, consulting businesses, academic researchers, and regulators need a dialogue via multi-stakeholder collaborations to clarify questions around DHT-derived measures, to unify definitions, and to create the foundations for evidentiary package requirements, providing a path forward to predictable results.

Mapping Relevance of Digital Measures to Meaningful Symptoms and Impacts in Early Parkinson's Disease

BACKGROUND

Adoption of new digital measures for clinical trials and practice has been hindered by lack of actionable qualitative data demonstrating relevance of these metrics to people with Parkinson's disease.

OBJECTIVE

This study evaluated of relevance of WATCH-PD digital measures to meaningful symptoms and impacts of early Parkinson's disease from the patient perspective.

METHODS

Participants with early Parkinson's disease (N = 40) completed surveys and 1:1 online-interviews. Interviews combined: 1) symptom mapping to delineate meaningful symptoms/impacts of disease, 2) cognitive interviewing to assess content validity of digital measures, and 3) mapping of digital measures back to personal symptoms to assess relevance from the patient perspective. Content analysis and descriptive techniques were used to analyze data.

RESULTS

Participants perceived mapping as deeply engaging, with 39/40 reporting improved ability to communicate important symptoms and relevance of measures. Most measures (9/10) were rated relevant by both cognitive interviewing (70-92.5%) and mapping (80-100%). Two measures related to actively bothersome symptoms for more than 80% of participants (Tremor, Shape rotation). Tasks were generally deemed relevant if they met three participant context criteria: 1) understanding what the task measured, 2) believing it targeted an important symptom of PD (past, present, or future), and 3) believing the task was a good test of that important symptom. Participants did not require that a task relate to active symptoms or "real" life to be relevant.

CONCLUSION

Digital measures of tremor and hand dexterity were rated most relevant in early PD. Use of mapping enabled precise quantification of qualitative data for more rigorous evaluation of new measures.

The convergence of traditional and digital biomarkers through AI-assisted biosensing: A new era in translational diagnostics?

Advances in consumer electronics, alongside the fields of microfluidics and nanotechnology have brought to the fore low-cost wearable/portable smart devices. Although numerous smart devices that track digital biomarkers have been successfully translated from bench-to-bedside, only a few follow the same fate when it comes to track traditional biomarkers. Current practices still involve laboratory-based tests, followed by blood collection, conducted in a clinical setting as they require trained personnel and specialized equipment. In fact, real-time, passive/active and robust sensing of physiological and behavioural data from patients that can feed artificial intelligence (AI)-based models can significantly improve decision-making, diagnosis and treatment at the point-of-procedure, by circumventing conventional methods of sampling, and in person investigation by expert pathologists, who are scarce in developing countries. This review brings together conventional and digital biomarker sensing through portable and autonomous miniaturized devices. We first summarise the technological advances in each field vs the current clinical practices and we conclude by merging the two worlds of traditional and digital biomarkers through AI/ML technologies to improve patient diagnosis and treatment. The fundamental role, limitations and prospects of AI in realizing this potential and enhancing the existing technologies to facilitate the development and clinical translation of "point-of-care" (POC) diagnostics is finally showcased.

Development of an Open-source and Lightweight Sensor Recording Software System for Conducting Biomedical Research: Technical Report

BACKGROUND

Digital sensing devices have become an increasingly important component of modern biomedical research, as they help provide objective insights into individuals' everyday behavior in terms of changes in motor and nonmotor symptoms. However, there are significant barriers to the adoption of sensor-enhanced biomedical solutions in terms of both technical expertise and associated costs. The currently available solutions neither allow easy integration of custom sensing devices nor offer a practicable methodology in cases of limited resources. This has become particularly relevant, given the need for real-time sensor data that could help lower health care costs by reducing the frequency of clinical assessments performed by specialists and improve access to health assessments (eg, for people living in remote areas or older adults living at home).

OBJECTIVE

The objective of this paper is to detail the end-to-end development of a novel sensor recording software system that supports the integration of heterogeneous sensor technologies, runs as an on-demand service on consumer-grade hardware to build sensor systems, and can be easily used to reliably record longitudinal sensor measurements in research settings.

METHODS

The proposed software system is based on a server-client architecture, consisting of multiple self-contained microservices that communicated with each other (eg, the web server transfers data to a database instance) and were implemented as Docker containers. The design of the software is based on state-of-the-art open-source technologies (eg, Node.js or MongoDB), which fulfill nonfunctional requirements and reduce associated costs. A series of programs to facilitate the use of the software were documented. To demonstrate performance, the software was tested in 3 studies (2 gait studies and 1 behavioral study assessing activities of daily living) that ran between 2 and 225 days, with a total of 114 participants. We used descriptive statistics to evaluate longitudinal measurements for reliability, error rates, throughput rates, latency, and usability (with the System Usability Scale [SUS] and the Post-Study System Usability Questionnaire [PSSUQ]).

RESULTS

Three qualitative features (event annotation program, sample delay analysis program, and monitoring dashboard) were elaborated and realized as integrated programs. Our quantitative findings demonstrate that the system operates reliably on consumer-grade hardware, even across multiple months (>420 days), providing high throughput (2000 requests per second) with a low latency and error rate (<0.002%). In addition, the results of the usability tests indicate that the system is effective, efficient, and satisfactory to use (mean usability ratings for the SUS and PSSUQ were 89.5 and 1.62, respectively).

CONCLUSIONS

Overall, this sensor recording software could be leveraged to test sensor devices, as well as to develop and validate algorithms that are able to extract digital measures (eg, gait parameters or actigraphy). The proposed software could help significantly reduce barriers related to sensor-enhanced biomedical research and allow researchers to focus on the research questions at hand rather than on developing recording technologies.

A Clinical Perspective on Bespoke Sensing Mechanisms for Remote Monitoring and Rehabilitation of Neurological Diseases: Scoping Review

Neurological diseases including stroke and neurodegenerative disorders cause a hefty burden on the healthcare system. Survivors experience significant impairment in mobility and daily activities, which requires extensive rehabilitative interventions to assist them to regain lost skills and restore independence. The advent of remote rehabilitation architecture and enabling technology mandates the elaboration of sensing mechanisms tailored to individual clinical needs. This study aims to review current trends in the application of sensing mechanisms in remote monitoring and rehabilitation in neurological diseases, and to provide clinical insights to develop bespoke sensing mechanisms. A systematic search was performed using the PubMED database to identify 16 papers published for the period between 2018 to 2022. Teleceptive sensors (56%) were utilized more often than wearable proximate sensors (50%). The most commonly used modality was infrared (38%) and acceleration force (38%), followed by RGB color, EMG, light and temperature, and radio signal. The strategy adopted to improve the sensing mechanism included a multimodal sensor, the application of multiple sensors, sensor fusion, and machine learning. Most of the stroke studies utilized biofeedback control systems (78%) while the majority of studies for neurodegenerative disorders used sensors for remote monitoring (57%). Functional assessment tools that the sensing mechanism may emulate to produce clinically valid information were proposed and factors affecting user adoption were described. Lastly, the limitations and directions for further development were discussed.

Smart Consumer Wearables as Digital Diagnostic Tools: A Review

The increasing usage of smart wearable devices has made an impact not only on the lifestyle of the users, but also on biological research and personalized healthcare services. These devices, which carry different types of sensors, have emerged as personalized digital diagnostic tools. Data from such devices have enabled the prediction and detection of various physiological as well as psychological conditions and diseases. In this review, we have focused on the diagnostic applications of wrist-worn wearables to detect multiple diseases such as cardiovascular diseases, neurological disorders, fatty liver diseases, and metabolic disorders, including diabetes, sleep quality, and psychological illnesses. The fruitful usage of wearables requires fast and insightful data analysis, which is feasible through machine learning. In this review, we have also discussed various machine-learning applications and outcomes for wearable data analyses. Finally, we have discussed the current challenges with wearable usage and data, and the future perspectives of wearable devices as diagnostic tools for research and personalized healthcare domains.