The Path Forward for Digital Measures: Suppressing the Desire to Compare Apples and Pineapples

Digital Phenotyping for Stress, Anxiety, and Mild Depression: Systematic Literature Review

BACKGROUND

Unaddressed early-stage mental health issues, including stress, anxiety, and mild depression, can become a burden for individuals in the long term. Digital phenotyping involves capturing continuous behavioral data via digital smartphone devices to monitor human behavior and can potentially identify milder symptoms before they become serious.

OBJECTIVE

This systematic literature review aimed to answer the following questions: (1) what is the evidence of the effectiveness of digital phenotyping using smartphones in identifying behavioral patterns related to stress, anxiety, and mild depression? and (2) in particular, which smartphone sensors are found to be effective, and what are the associated challenges?

METHODS

We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) process to identify 36 papers (reporting on 40 studies) to assess the key smartphone sensors related to stress, anxiety, and mild depression. We excluded studies conducted with nonadult participants (eg, teenagers and children) and clinical populations, as well as personality measurement and phobia studies. As we focused on the effectiveness of digital phenotyping using smartphones, results related to wearable devices were excluded.

RESULTS

We categorized the studies into 3 major groups based on the recruited participants: studies with students enrolled in universities, studies with adults who were unaffiliated to any particular organization, and studies with employees employed in an organization. The study length varied from 10 days to 3 years. A range of passive sensors were used in the studies, including GPS, Bluetooth, accelerometer, microphone, illuminance, gyroscope, and Wi-Fi. These were used to assess locations visited; mobility; speech patterns; phone use, such as screen checking; time spent in bed; physical activity; sleep; and aspects of social interactions, such as the number of interactions and response time. Of the 40 included studies, 31 (78%) used machine learning models for prediction; most others (n=8, 20%) used descriptive statistics. Students and adults who experienced stress, anxiety, or depression visited fewer locations, were more sedentary, had irregular sleep, and accrued increased phone use. In contrast to students and adults, less mobility was seen as positive for employees because less mobility in workplaces was associated with higher performance. Overall, travel, physical activity, sleep, social interaction, and phone use were related to stress, anxiety, and mild depression.

CONCLUSIONS

This study focused on understanding whether smartphone sensors can be effectively used to detect behavioral patterns associated with stress, anxiety, and mild depression in nonclinical participants. The reviewed studies provided evidence that smartphone sensors are effective in identifying behavioral patterns associated with stress, anxiety, and mild depression.

Statistical analysis of actigraphy data with generalised additive models

There is a growing interest in the use of physical activity data in clinical studies, particularly in diseases that limit mobility in patients. High-frequency data collected with digital sensors are typically summarised into actigraphy features aggregated at epoch level (e.g., by minute). The statistical analysis of such volume of data is not straightforward. The general trend is to derive metrics, capturing specific aspects of physical activity, that condense (say) a week worth of data into a single numerical value. Here we propose to analyse the entire time-series data using Generalised Additive Models (GAMs). GAMs are semi-parametric models that allow inclusion of both parametric and non-parametric terms in the linear predictor. The latter are smooth terms (e.g., splines) and, in the context of actigraphy minute-by-minute data analysis, they can be used to assess daily patterns of physical activity. This in turn can be used to better understand changes over time in longitudinal studies as well as to compare treatment groups. We illustrate the application of GAMs in two clinical studies where actigraphy data was collected: a non-drug, single-arm study in patients with amyotrophic lateral sclerosis, and a physical-activity sub-study included in a phase 2b clinical trial in patients with chronic obstructive pulmonary disease.

Digital Mobility Measures: A Window into Real-World Severity and Progression of Parkinson's Disease

BACKGROUND

Real-world monitoring using wearable sensors has enormous potential for assessing disease severity and symptoms among persons with Parkinson's disease (PD). Many distinct features can be extracted, reflecting multiple mobility domains. However, it is unclear which digital measures are related to PD severity and are sensitive to disease progression.

OBJECTIVES

The aim was to identify real-world mobility measures that reflect PD severity and show discriminant ability and sensitivity to disease progression, compared to the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) scale.

METHODS

Multicenter real-world continuous (24/7) digital mobility data from 587 persons with PD and 68 matched healthy controls were collected using an accelerometer adhered to the lower back. Machine learning feature selection and regression algorithms evaluated associations of the digital measures using the MDS-UPDRS (I-III). Binary logistic regression assessed discriminatory value using controls, and longitudinal observational data from a subgroup (n = 33) evaluated sensitivity to change over time.

RESULTS

Digital measures were only moderately correlated with the MDS-UPDRS (part II-r = 0.60 and parts I and III-r = 0.50). Most associated measures reflected activity quantity and distribution patterns. A model with 14 digital measures accurately distinguished recently diagnosed persons with PD from healthy controls (81.1%, area under the curve: 0.87); digital measures showed larger effect sizes (Cohen's d: [0.19-0.66]), for change over time than any of the MDS-UPDRS parts (Cohen's d: [0.04-0.12]).

CONCLUSIONS

Real-world mobility measures are moderately associated with clinical assessments, suggesting that they capture different aspects of motor capacity and function. Digital mobility measures are sensitive to early-stage disease and to disease progression, to a larger degree than conventional clinical assessments, demonstrating their utility, primarily for clinical trials but ultimately also for clinical care. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Validation of automated pipeline for the assessment of a motor speech disorder in amyotrophic lateral sclerosis (ALS)

Background and objective

Amyotrophic lateral sclerosis (ALS) frequently causes speech impairments, which can be valuable early indicators of decline. Automated acoustic assessment of speech in ALS is attractive, and there is a pressing need to validate such tools in line with best practices, including analytical and clinical validation. We hypothesized that data analysis using a novel speech assessment pipeline would correspond strongly to analyses performed using lab-standard practices and that acoustic features from the novel pipeline would correspond to clinical outcomes of interest in ALS.

Methods

We analyzed data from three standard speech assessment tasks (i.e., vowel phonation, passage reading, and diadochokinesis) in 122 ALS patients. Data were analyzed automatically using a pipeline developed by Winterlight Labs, which yielded 53 acoustic features. First, for analytical validation, data were analyzed using a lab-standard analysis pipeline for comparison. This was followed by univariate analysis (Spearman correlations between individual features in Winterlight and in-lab datasets) and multivariate analysis (sparse canonical correlation analysis (SCCA)). Subsequently, clinical validation was performed. This included univariate analysis (Spearman correlation between automated acoustic features and clinical measures) and multivariate analysis (interpretable autoencoder-based dimensionality reduction).

Results

Analytical validity was demonstrated by substantial univariate correlations (Spearman's ρ > 0.70) between corresponding pairs of features from automated and lab-based datasets, as well as interpretable SCCA feature groups. Clinical validity was supported by strong univariate correlations between automated features and clinical measures (Spearman's ρ > 0.70), as well as associations between multivariate outputs and clinical measures.

Conclusion

This novel, automated speech assessment feature set demonstrates substantial promise as a valid tool for analyzing impaired speech in ALS patients and for the further development of these technologies.

Measuring Health-Related Quality of Life With Multimodal Data: Viewpoint

The ability to objectively measure aspects of performance and behavior is a fundamental pillar of digital health, enabling digital wellness products, decentralized trial concepts, evidence generation, digital therapeutics, and more. Emerging multimodal technologies capable of measuring several modalities simultaneously and efforts to integrate inputs across several sources are further expanding the limits of what digital measures can assess. Experts from the field of digital health were convened as part of a multi-stakeholder workshop to examine the progress of multimodal digital measures in two key areas: detection of disease and the measurement of meaningful aspects of health relevant to the quality of life. Here we present a meeting report, summarizing key discussion points, relevant literature, and finally a vision for the immediate future, including how multimodal measures can provide value to stakeholders across drug development and care delivery, as well as three key areas where headway will need to be made if we are to continue to build on the encouraging progress so far: collaboration and data sharing, removal of barriers to data integration, and alignment around robust modular evaluation of new measurement capabilities.

Estimating the Burden of Influenza-like Illness on Daily Activity at the Population Scale Using Commercial Wearable Sensors

IMPORTANCE

The severity of viral infections can vary widely, from asymptomatic cases to complications leading to hospitalizations and death. Milder cases, despite being more prevalent, often go undocumented, and their public health burden is not accurately estimated.

OBJECTIVE

To estimate the true burden of influenza-like illness (ILI) in the US population using a surrogate measure of daily steps lost as measured by commercial wearable sensors.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study modeled data from 15 122 US adults who reported ILI symptoms during the 2018-2019 influenza season (before the COVID-19 pandemic) and who had a sufficient density of wearable sensor data at symptom onset. Participants' minute-level step data as measured by commercial wearable sensors were collected from October 1, 2018, through June 30, 2019. Minute-level activity time series were transformed into day-level time series per user, indicating the total number of steps daily.

MAIN OUTCOMES AND MEASURES

The primary end point was the number of steps lost during the period of 4 days before symptom onset (the latent phase) through 11 days after symptom onset (the symptomatic phase). The association between covariates and steps lost during this interval was also examined.

RESULTS

Of the 15 122 participants in this study, 13 108 (86.7%) were women, and the median age was 32 years (IQR, 27-38 years). For their ILI event, 2836 of 15 080 participants (18.8%) sought medical attention, and only 61 (0.4%) were hospitalized. Over the course of an ILI lasting 10 days, the mean cumulative loss was 4437 steps (95% CI, 4143-4731 steps). After weighting, there was an estimated overall nationwide reduction in mobility equivalent to 255.2 billion steps (95% CI, 232.9-277.6 billion steps) lost because of ILI symptoms during the study period. This finding reflects significant changes in routines, mobility, and employment and is equivalent to 15% of the active US population becoming completely immobilized for 1 day. Moreover, 60.6% of this reduction in steps (154.6 billion steps [95% CI, 138.1-171.2 billion steps]) occurred among persons who sought no medical care. Age and educational level were positively associated with steps lost.

CONCLUSIONS AND RELEVANCE

These findings suggest that most of the burden of ILI in this study would have been invisible to health care and public health reporting systems. This approach has applications for public health, health care, and clinical research, from estimating costs of lost productivity at population scale, to measuring effectiveness of anti-ILI treatments, to monitoring recovery after acute viral syndromes such as during long COVID-19.

Digital Biomarkers in Psychiatric Research: Data Protection Qualifications in a Complex Ecosystem

Psychiatric research traditionally relies on subjective observation, which is time-consuming and labor-intensive. The widespread use of digital devices, such as smartphones and wearables, enables the collection and use of vast amounts of user-generated data as "digital biomarkers." These tools may also support increased participation of psychiatric patients in research and, as a result, the production of research results that are meaningful to them. However, sharing mental health data and research results may expose patients to discrimination and stigma risks, thus discouraging participation. To earn and maintain participants' trust, the first essential requirement is to implement an appropriate data governance system with a clear and transparent allocation of data protection duties and responsibilities among the actors involved in the process. These include sponsors, investigators, operators of digital tools, as well as healthcare service providers and biobanks/databanks. While previous works have proposed practical solutions to this end, there is a lack of consideration of positive data protection law issues in the extant literature. To start filling this gap, this paper discusses the GDPR legal qualifications of controller, processor, and joint controllers in the complex ecosystem unfolded by the integration of digital biomarkers in psychiatric research, considering their implications and proposing some general practical recommendations.

Beyond the Therapist's Office: Merging Measurement-Based Care and Digital Medicine in the Real World

This viewpoint focuses on the ways in which digital medicine and measurement-based care can be utilized in tandem to promote better assessment, patient engagement, and an improved quality of psychiatric care. To date, there has been an underutilization of digital measurement in psychiatry, and there is little discussion of the feedback and patient engagement process in digital medicine. Measurement-based care is a recognized evidence-based strategy that engages patients in an understanding of their outcome data. When implemented as designed, providers review the scores and trends in outcome immediately and then provide feedback to their patients. However, the process is typically confined to office visits, which does not provide a complete picture of a patient's progress and functioning. The process is labor intensive, even with digital feedback systems, but the integration of passive metrics obtained through wearables and apps can supplement office-based observations. This enhanced measurement-based care process can provide a picture of real-world patient functioning through passive metrics (activity, sleep, etc.). This can potentially engage patients more in their health data and involve a critically needed therapeutic alliance component in digital medicine.

The Future of Digital Health: Meeting Report

At the end of 2020, Karger's Digital Biomarkers, together with Evidation Health, produced a special issue entitled "The Future of Digital Health." This brief meeting report provides an overview of the expert panel and workshop that were held in early 2021 to explore key topics raised in the special issue.

Evaluation, Acceptance, and Qualification of Digital Measures: From Proof of Concept to Endpoint

To support the successful adoption of digital measures into internal decision making and evidence generation for medical product development, we present a unified lexicon to aid communication throughout this process, and highlight key concepts including the critical role of participant engagement in development of digital measures. We detail the steps of bringing a successful proof of concept to scale, focusing on key decisions in the development of a new digital measure: asking the right question, optimized approaches to evaluating new measures, and whether and how to pursue qualification or acceptance. Building on the V3 framework for establishing verification and analytical and clinical validation, we discuss strategic and practical considerations for collecting this evidence, illustrated with concrete examples of trailblazing digital measures in the field.