A Remote Digital Monitoring Platform to Assess Cognitive and Motor Symptoms in Huntington Disease: Cross-sectional Validation Study

Movement Disorders and Smart Wrist Devices: A Comprehensive Study

In the medical field, there are several very different movement disorders, such as tremors, Parkinson's disease, or Huntington's disease. A wide range of motor and non-motor symptoms characterizes them. It is evident that in the modern era, the use of smart wrist devices, such as smartwatches, wristbands, and smart bracelets is spreading among all categories of people. This diffusion is justified by the limited costs, ease of use, and less invasiveness (and consequently greater acceptability) than other types of sensors used for health status monitoring. This systematic review aims to synthesize research studies using smart wrist devices for a specific class of movement disorders. Following PRISMA-S guidelines, 130 studies were selected and analyzed. For each selected study, information is provided relating to the smartwatch/wristband/bracelet model used (whether it is commercial or not), the number of end-users involved in the experimentation stage, and finally the characteristics of the benchmark dataset possibly used for testing. Moreover, some articles also reported the type of raw data extracted from the smart wrist device, the implemented designed algorithmic pipeline, and the data classification methodology. It turned out that most of the studies have been published in the last ten years, showing a growing interest in the scientific community. The selected articles mainly investigate the relationship between smart wrist devices and Parkinson's disease. Epilepsy and seizure detection are also research topics of interest, while there are few papers analyzing gait disorders, Huntington's Disease, ataxia, or Tourette Syndrome. However, the results of this review highlight the difficulties still present in the use of the smartwatch/wristband/bracelet for the identified categories of movement disorders, despite the advantages these technologies could bring in the dissemination of low-cost solutions usable directly within living environments and without the need for caregivers or medical personnel.

Unlocking the full potential of digital endpoints for decision making: a novel modular evidence concept enabling re-use and advancing collaboration

INTRODUCTION

Over the last decade increasing examples indicate opportunities to measure patient functioning and its relevance for clinical and regulatory decision making via endpoints collected through digital health technologies. More recently, we have seen such measures support primary study endpoints and enable smaller trials. The field is advancing fast: validation requirements have been proposed in the literature and regulators are releasing new guidances to review these endpoints. Pharmaceutical companies are embracing collaborations to develop them and working with academia and patient organizations in their development. However, the road to validation and regulatory acceptance is lengthy. The full value of digital endpoints cannot be unlocked until better collaboration and modular evidence frameworks are developed enabling re-use of evidence and repurposing of digital endpoints.

AREAS COVERED

This paper proposes a solution by presenting a novel modular evidence framework -the Digital Evidence Ecosystem and Protocols (DEEP)- enabling repurposing of measurement solutions, re-use of evidence, application of standards and also facilitates collaboration with health technology assessment bodies.

EXPERT OPINION

The integration of digital endpoints in healthcare, essential for personalized and remote care, requires harmonization and transparency. The proposed novel stack model offers a modular approach, fostering collaboration and expediting the adoption in patient care.

Evaluation of the Parkinson's Remote Interactive Monitoring System in a Clinical Setting: Usability Study

BACKGROUND

The fastest-growing neurological disorder is Parkinson disease (PD), a progressive neurodegenerative disease that affects 10 million people worldwide. PD is typically treated with levodopa, an oral pill taken to increase dopamine levels, and other dopaminergic agonists. As the disease advances, the efficacy of the drug diminishes, necessitating adjustments in treatment dosage according to the patient's symptoms and disease progression. Therefore, remote monitoring systems that can provide more detailed and accurate information on a patient's condition regularly are a valuable tool for clinicians and patients to manage their medication. The Parkinson's Remote Interactive Monitoring System (PRIMS), developed by PragmaClin Research Inc, was designed on the premise that it will be an easy-to-use digital system that can accurately capture motor and nonmotor symptoms of PD remotely.

OBJECTIVE

We performed a usability evaluation in a simulated clinical environment to assess the ease of use of the PRIMS and determine whether the product offers suitable functionality for users in a clinical setting.

METHODS

Participants were recruited from a user sign-up web-based database owned by PragmaClin Research Inc. A total of 11 participants were included in the study based on the following criteria: (1) being diagnosed with PD and (2) not being diagnosed with dementia or any other comorbidities that would make it difficult to complete the PRIMS assessment safely and independently. Patient users completed a questionnaire that is based on the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale. Interviews and field notes were analyzed for underlying themes and topics.

RESULTS

In total, 11 people with PD participated in the study (female individuals: n=5, 45%; male individuals: n=6, 55%; age: mean 66.7, SD 7.77 years). Thematic analysis of the observer's notes revealed 6 central usability issues associated with the PRIMS. These were the following: (1) the automated voice prompts are confusing, (2) the small camera is problematic, (3) the motor test exhibits excessive sensitivity to the participant's orientation and position in relation to the cameras, (4) the system poses mobility challenges, (5) navigating the system is difficult, and (6) the motor test exhibits inconsistencies and technical issues. Thematic analysis of qualitative interview responses revealed four central themes associated with participants' perspectives and opinions on the PRIMS, which were (1) admiration of purpose, (2) excessive system sensitivity, (3) video instructions preferred, and (4) written instructions disliked. The average system usability score was calculated to be 69.2 (SD 4.92), which failed to meet the acceptable system usability score of 70.

CONCLUSIONS

Although multiple areas of improvement were identified, most of the participants showed an affinity for the overarching objective of the PRIMS. This feedback is being used to upgrade the current PRIMS so that it aligns more with patients' needs.

Accelerometer-based measures in Friedreich ataxia: a longitudinal study on real-life activity

Quantitative measurement of physical activity may complement neurological evaluation and provide valuable information on patients' daily life. We evaluated longitudinal changes of physical activity in patients with Friedreich ataxia (FRDA) using remote monitoring with wearable sensors. We performed an observational study in 26 adult patients with FRDA and 13 age-sex matched healthy controls (CTR). Participants were asked to wear two wearable sensors, at non-dominant wrist and at waist, for 7 days during waking hours. Evaluations were performed at baseline and at 1-year follow-up. We analysed the percentage of time spent in sedentary or physical activities, the Vector Magnitude on the 3 axes (VM3), and average number of steps/min. Study participants were also evaluated with ataxia clinical scales and functional tests for upper limbs dexterity and walking capability. Baseline data showed that patients had an overall reduced level of physical activity as compared to CTR. Accelerometer-based measures were highly correlated with clinical scales and disease duration in FRDA. Significantly changes from baseline to l-year follow-up were observed in patients for the following measures: (i) VM3; (ii) percentage of sedentary and light activity, and (iii) percentage of Moderate-Vigorous Physical Activity (MVPA). Reduction in physical activity corresponded to worsening in gait score of the Scale for Assessment and Rating of Ataxia. Real-life activity monitoring is feasible and well tolerated by patients. Accelerometer-based measures can quantify disease progression in FRDA over 1 year, providing objective information about patient's motor activities and supporting the usefulness of these data as complementary outcome measure in interventional trials.

Smartphone applications for Movement Disorders: Towards collaboration and re-use

BACKGROUND

Numerous smartphone and tablet applications (apps) are available to monitor movement disorders, but an overview of their purpose and stage of development is missing.

OBJECTIVES

To systematically review published literature and classify smartphone and tablet apps with objective measurement capabilities for the diagnosis, monitoring, assessment, or treatment of movement disorders.

METHODS

We systematically searched for publications covering smartphone or tablet apps to monitor movement disorders until November 22nd, 2023. We reviewed the target population, measured domains, purpose, and technology readiness level (TRL) of the proposed app and checked their availability in common app stores.

RESULTS

We identified 113 apps. Most apps were developed for Parkinson's disease specifically (n = 82; 73%) or for movement disorders in general (n = 17; 15%). Apps were either designed to momentarily assess symptoms (n = 65; 58%), support treatment (n = 22; 19%), aid in diagnosis (n = 16; 14%), or passively track symptoms (n = 11; 10%). Commonly assessed domains across movement disorders included fine motor skills (n = 34; 30%), gait (n = 36; 32%), and tremor (n = 32; 28%) for the motor domain and cognition (n = 16; 14%) for the non-motor domain. Twenty-six (23%) apps were proof-of-concepts (TRL 1-3), while most apps were tested in a controlled setting (TRL 4-6; n = 63; 56%). Twenty-four apps were tested in their target setting (TRL 7-9) of which 10 were accessible in common app stores or as Android Package.

CONCLUSIONS

The development of apps strongly gravitates towards Parkinson's disease and a selection of motor symptoms. Collaboration, re-use and further development of existing apps is encouraged to avoid reinventions of the wheel.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Digital health technologies and machine learning augment patient reported outcomes to remotely characterise rheumatoid arthritis

Digital measures of health status captured during daily life could greatly augment current in-clinic assessments for rheumatoid arthritis (RA), to enable better assessment of disease progression and impact. This work presents results from weaRAble-PRO, a 14-day observational study, which aimed to investigate how digital health technologies (DHT), such as smartphones and wearables, could augment patient reported outcomes (PRO) to determine RA status and severity in a study of 30 moderate-to-severe RA patients, compared to 30 matched healthy controls (HC). Sensor-based measures of health status, mobility, dexterity, fatigue, and other RA specific symptoms were extracted from daily iPhone guided tests (GT), as well as actigraphy and heart rate sensor data, which was passively recorded from patients' Apple smartwatch continuously over the study duration. We subsequently developed a machine learning (ML) framework to distinguish RA status and to estimate RA severity. It was found that daily wearable sensor-outcomes robustly distinguished RA from HC participants (F1, 0.807). Furthermore, by day 7 of the study (half-way), a sufficient volume of data had been collected to reliably capture the characteristics of RA participants. In addition, we observed that the detection of RA severity levels could be improved by augmenting standard patient reported outcomes with sensor-based features (F1, 0.833) in comparison to using PRO assessments alone (F1, 0.759), and that the combination of modalities could reliability measure continuous RA severity, as determined by the clinician-assessed RAPID-3 score at baseline (r2, 0.692; RMSE, 1.33). The ability to measure the impact of the disease during daily life-through objective and remote digital outcomes-paves the way forward to enable the development of more patient-centric and personalised measurements for use in RA clinical trials.

Digital assessment of speech in Huntington disease

Background

Speech changes are an early symptom of Huntington disease (HD) and may occur prior to other motor and cognitive symptoms. Assessment of HD commonly uses clinician-rated outcome measures, which can be limited by observer variability and episodic administration. Speech symptoms are well suited for evaluation by digital measures which can enable sensitive, frequent, passive, and remote administration.

Methods

We collected audio recordings using an external microphone of 36 (18 HD, 7 prodromal HD, and 11 control) participants completing passage reading, counting forward, and counting backwards speech tasks. Motor and cognitive assessments were also administered. Features including pausing, pitch, and accuracy were automatically extracted from recordings using the BioDigit Speech software and compared between the three groups. Speech features were also analyzed by the Unified Huntington Disease Rating Scale (UHDRS) dysarthria score. Random forest machine learning models were implemented to predict clinical status and clinical scores from speech features.

Results

Significant differences in pausing, intelligibility, and accuracy features were observed between HD, prodromal HD, and control groups for the passage reading task (e.g., p < 0.001 with Cohen'd = -2 between HD and control groups for pause ratio). A few parameters were significantly different between the HD and control groups for the counting forward and backwards speech tasks. A random forest classifier predicted clinical status from speech tasks with a balanced accuracy of 73% and an AUC of 0.92. Random forest regressors predicted clinical outcomes from speech features with mean absolute error ranging from 2.43-9.64 for UHDRS total functional capacity, motor and dysarthria scores, and explained variance ranging from 14 to 65%. Montreal Cognitive Assessment scores were predicted with mean absolute error of 2.3 and explained variance of 30%.

Conclusion

Speech data have the potential to be a valuable digital measure of HD progression, and can also enable remote, frequent disease assessment in prodromal HD and HD. Clinical status and disease severity were predicted from extracted speech features using random forest machine learning models. Speech measurements could be leveraged as sensitive marker of clinical onset and disease progression in future clinical trials.

Upper limb intention tremor assessment: opportunities and challenges in wearable technology

BACKGROUND

Tremors are involuntary rhythmic movements commonly present in neurological diseases such as Parkinson's disease, essential tremor, and multiple sclerosis. Intention tremor is a subtype associated with lesions in the cerebellum and its connected pathways, and it is a common symptom in diseases associated with cerebellar pathology. While clinicians traditionally use tests to identify tremor type and severity, recent advancements in wearable technology have provided quantifiable ways to measure movement and tremor using motion capture systems, app-based tasks and tools, and physiology-based measurements. However, quantifying intention tremor remains challenging due to its changing nature.

METHODOLOGY & RESULTS

This review examines the current state of upper limb tremor assessment technology and discusses potential directions to further develop new and existing algorithms and sensors to better quantify tremor, specifically intention tremor. A comprehensive search using PubMed and Scopus was performed using keywords related to technologies for tremor assessment. Afterward, screened results were filtered for relevance and eligibility and further classified into technology type. A total of 243 publications were selected for this review and classified according to their type: body function level: movement-based, activity level: task and tool-based, and physiology-based. Furthermore, each publication's methods, purpose, and technology are summarized in the appendix table.

CONCLUSIONS

Our survey suggests a need for more targeted tasks to evaluate intention tremors, including digitized tasks related to intentional movements, neurological and physiological measurements targeting the cerebellum and its pathways, and signal processing techniques that differentiate voluntary from involuntary movement in motion capture systems.

HD-DRUM, a Tablet-Based Drumming Training App Intervention for People With Huntington Disease: App Development Study

BACKGROUND

Huntington disease (HD) is a neurodegenerative condition that leads to progressive loss of cognitive-executive and motor functions, largely due to basal ganglia (BG) atrophy. Currently, there are no therapeutic interventions tailored to address executive and motor dysfunction in people with HD. Music-based interventions may aid executive abilities by compensating for impaired BG-reliant timing and rhythm generation using external rhythmic beats. Here, we applied an integrated knowledge translation (IKT) framework to co-design a tablet-based rhythmic drumming training app (HD-DRUM) to stimulate executive and motor abilities in people with HD.

OBJECTIVE

The primary aim was to develop the HD-DRUM app for at-home use that addressed the accessibility needs of people with HD and allowed for the quantification of performance improvements and adherence for controlled clinical evaluation.

METHODS

The IKT framework was applied to iteratively refine the design of HD-DRUM. This process involved 3 phases of knowledge user engagement and co-design: a web-based survey of people with HD (n=29) to inform about their accessibility needs, usability testing of tablet-based touch screens as hardware solutions, and usability testing of the design and build of HD-DRUM to meet the identified accessibility needs of people affected by HD and their clinicians (n=12).

RESULTS

The survey identified accessibility problems due to cognitive and motor control impairments such as difficulties in finding and navigating through information and using PC keyboards and mouses to interact with apps. Tablet-based touch screens were identified as feasible and accessible solutions for app delivery. Key elements to ensure that the app design and build met the needs of people with HD were identified and implemented. These included the facilitation of intuitive navigation through the app using large and visually distinctive buttons; the use of audio and visual cues as training guides; and gamification, positive feedback, and drumming to background music as a means to increase motivation and engagement. The co-design development process resulted in the proof-of-concept HD-DRUM app that is described here according to the Template for Intervention Description and Replication checklist. HD-DRUM can be used at home, allowing the quantification of performance improvements and adherence for clinical evaluation, matching of training difficulty to users' performance levels using gamification, and future scale-up to reach a wide range of interested users.

CONCLUSIONS

Applying an IKT-based co-design framework involving knowledge user engagement allowed for the iterative refinement of the design and build of the tablet-based HD-DRUM app intervention, with the aim of stimulating BG-reliant cognitive and motor functions. Mapping the intervention against the Template for Intervention Description and Replication framework to describe complex interventions allowed for the detailed description of the HD-DRUM intervention and identification of areas that required refinement before finalizing the intervention protocol.

The use of digital outcome measures in clinical trials in rare neurological diseases: a systematic literature review

Developing drugs for rare diseases is challenging, and the precision and objectivity of outcome measures is critical to this process. In recent years, a number of technologies have increasingly been used for remote monitoring of patient health. We report a systematic literature review that aims to summarize the current state of progress with regard to the use of digital outcome measures for real-life motor function assessment of patients with rare neurological diseases. Our search of published literature identified 3826 records, of which 139 were included across 27 different diseases. This review shows that use of digital outcome measures for motor function outside a clinical setting is feasible and employed in a broad range of diseases, although we found few outcome measures that have been robustly validated and adopted as endpoints in clinical trials. Future research should focus on validation of devices, variables, and algorithms to allow for regulatory qualification and widespread adoption.

Current Technology Developments Can Improve the Quality of Research and Level of Evidence for Rehabilitation Interventions: A Narrative Review

The current important limitations to the implementation of Evidence-Based Practice (EBP) in the rehabilitation field are related to the validation process of interventions. Indeed, most of the strict guidelines that have been developed for the validation of new drugs (i.e., double or triple blinded, strict control of the doses and intensity) cannot-or can only partially-be applied in rehabilitation. Well-powered, high-quality randomized controlled trials are more difficult to organize in rehabilitation (e.g., longer duration of the intervention in rehabilitation, more difficult to standardize the intervention compared to drug validation studies, limited funding since not sponsored by big pharma companies), which reduces the possibility of conducting systematic reviews and meta-analyses, as currently high levels of evidence are sparse. The current limitations of EBP in rehabilitation are presented in this narrative review, and innovative solutions are suggested, such as technology-supported rehabilitation systems, continuous assessment, pragmatic trials, rehabilitation treatment specification systems, and advanced statistical methods, to tackle the current limitations. The development and implementation of new technologies can increase the quality of research and the level of evidence supporting rehabilitation, provided some adaptations are made to our research methodology.