Advancing the Use of Mobile Technologies in Clinical Trials: Recommendations from the Clinical Trials Transformation Initiative

Digital endpoints in clinical trials: emerging themes from a multi-stakeholder Knowledge Exchange event

BACKGROUND

Digital technologies, such as wearable devices and smartphone applications (apps), can enable the decentralisation of clinical trials by measuring endpoints in people's chosen locations rather than in traditional clinical settings. Digital endpoints can allow high-frequency and sensitive measurements of health outcomes compared to visit-based endpoints which provide an episodic snapshot of a person's health. However, there are underexplored challenges in this emerging space that require interdisciplinary and cross-sector collaboration. A multi-stakeholder Knowledge Exchange event was organised to facilitate conversations across silos within this research ecosystem.

METHODS

A survey was sent to an initial list of stakeholders to identify potential discussion topics. Additional stakeholders were identified through iterative discussions on perspectives that needed representation. Co-design meetings with attendees were held to discuss the scope, format and ethos of the event. The event itself featured a cross-disciplinary selection of talks, a panel discussion, small-group discussions facilitated via a rolling seating plan and audience participation via Slido. A transcript was generated from the day, which, together with the output from Slido, provided a record of the day's discussions. Finally, meetings were held following the event to identify the key challenges for digital endpoints which emerged and reflections and recommendations for dissemination.

RESULTS

Several challenges for digital endpoints were identified in the following areas: patient adherence and acceptability; algorithms and software for devices; design, analysis and conduct of clinical trials with digital endpoints; the environmental impact of digital endpoints; and the need for ongoing ethical support. Learnings taken for next generation events include the need to include additional stakeholder perspectives, such as those of funders and regulators, and the need for additional resources and facilitation to allow patient and public contributors to engage meaningfully during the event.

CONCLUSIONS

The event emphasised the importance of consortium building and highlighted the critical role that collaborative, multi-disciplinary, and cross-sector efforts play in driving innovation in research design and strategic partnership building moving forward. This necessitates enhanced recognition by funders to support multi-stakeholder projects with patient involvement, standardised terminology, and the utilisation of open-source software.

Unlocking the full potential of digital endpoints for decision making: a novel modular evidence concept enabling re-use and advancing collaboration

INTRODUCTION

Over the last decade increasing examples indicate opportunities to measure patient functioning and its relevance for clinical and regulatory decision making via endpoints collected through digital health technologies. More recently, we have seen such measures support primary study endpoints and enable smaller trials. The field is advancing fast: validation requirements have been proposed in the literature and regulators are releasing new guidances to review these endpoints. Pharmaceutical companies are embracing collaborations to develop them and working with academia and patient organizations in their development. However, the road to validation and regulatory acceptance is lengthy. The full value of digital endpoints cannot be unlocked until better collaboration and modular evidence frameworks are developed enabling re-use of evidence and repurposing of digital endpoints.

AREAS COVERED

This paper proposes a solution by presenting a novel modular evidence framework -the Digital Evidence Ecosystem and Protocols (DEEP)- enabling repurposing of measurement solutions, re-use of evidence, application of standards and also facilitates collaboration with health technology assessment bodies.

EXPERT OPINION

The integration of digital endpoints in healthcare, essential for personalized and remote care, requires harmonization and transparency. The proposed novel stack model offers a modular approach, fostering collaboration and expediting the adoption in patient care.

Development of a Speech-based Composite Score for Remotely Quantifying Language Changes in Frontotemporal Dementia

BACKGROUND

Changes to speech and language are common symptoms across different subtypes of frontotemporal dementia (FTD). These changes affect the ability to communicate, impacting everyday functions. Accurately assessing these changes may help clinicians to track disease progression and detect response to treatment.

OBJECTIVE

To determine which aspects of speech show significant change over time and to develop a novel composite score for tracking speech and language decline in individuals with FTD.

METHOD

We recruited individuals with FTD to complete remote digital speech assessments based on a picture description task. Speech samples were analyzed to derive acoustic and linguistic measures of speech and language, which were tested for longitudinal change over the course of the study and were used to compute a novel composite score.

RESULTS

Thirty-six (16 F, 20 M; M age = 61.3 years) individuals were enrolled in the study, with 27 completing a follow-up assessment 12 months later. We identified eight variables reflecting different aspects of language that showed longitudinal decline in the FTD clinical syndrome subtypes and developed a novel composite score based on these variables. The resulting composite score demonstrated a significant effect of change over time, high test-retest reliability, and a correlation with standard scores on various other speech tasks.

CONCLUSION

Remote digital speech assessments have the potential to characterize speech and language abilities in individuals with FTD, reducing the burden of clinical assessments while providing a novel measure of speech and language abilities that is sensitive to disease and relevant to everyday function.

Ecological validity of a deep learning algorithm to detect gait events from real-life walking bouts in mobility-limiting diseases

Introduction

The clinical assessment of mobility, and walking specifically, is still mainly based on functional tests that lack ecological validity. Thanks to inertial measurement units (IMUs), gait analysis is shifting to unsupervised monitoring in naturalistic and unconstrained settings. However, the extraction of clinically relevant gait parameters from IMU data often depends on heuristics-based algorithms that rely on empirically determined thresholds. These were mainly validated on small cohorts in supervised settings.

Methods

Here, a deep learning (DL) algorithm was developed and validated for gait event detection in a heterogeneous population of different mobility-limiting disease cohorts and a cohort of healthy adults. Participants wore pressure insoles and IMUs on both feet for 2.5 h in their habitual environment. The raw accelerometer and gyroscope data from both feet were used as input to a deep convolutional neural network, while reference timings for gait events were based on the combined IMU and pressure insoles data.

Results and discussion

The results showed a high-detection performance for initial contacts (ICs) (recall: 98%, precision: 96%) and final contacts (FCs) (recall: 99%, precision: 94%) and a maximum median time error of -0.02 s for ICs and 0.03 s for FCs. Subsequently derived temporal gait parameters were in good agreement with a pressure insoles-based reference with a maximum mean difference of 0.07, -0.07, and <0.01 s for stance, swing, and stride time, respectively. Thus, the DL algorithm is considered successful in detecting gait events in ecologically valid environments across different mobility-limiting diseases.

Applying Systems Thinking to Inform Decentralized Clinical Trial Planning and Deployment

Recently, there has been a growing interest in understanding how decentralized clinical trial (DCT) solutions can mitigate existing challenges in clinical development, particularly participant burden and access, and the collection, management, and quality of clinical data. This paper examines DCT deployments, emphasizing how they are integrated and how they may impact clinical trial oversight, management, and execution. We propose a conceptual framework that employs systems thinking to evaluate the impact on key stakeholders through a reiterative assessment of pain points. We conclude that decentralized solutions should be customized to meet patient needs and preferences and the unique requirements of each clinical trial. We discuss how DCT elements introduce new demands and pressures within the existing system and reflect on enablers that can overcome DCT implementation challenges. As stakeholders look for ways to make clinical research more relevant and accessible to a larger and more diverse patient population, further robust and granular research is needed to quantify the impact of DCTs empirically.

Diversity, Equity, and Inclusion in Clinical Research: A Path Toward Precision Health for Everyone

Healthcare disparities are a persistent societal problem. One of the contributing factors to this status quo is the lack of diversity and representativeness of research efforts, which result in nongeneralizable evidence that, in turn, provides suboptimal means to enable the best possible outcomes at the individual level. There are several strategies that research teams can adopt to improve the diversity, equity, and inclusion (DEI) of their efforts; these strategies span the totality of the research path, from initial design to the shepherding of clinical data through a potential regulatory process. These strategies include more intentionality and DEI-based goal-setting, more diverse research and leadership teams, better community engagement to set study goals and approaches, better tailored outreach interventions, decentralization of study procedures and incorporation of innovative technology for more flexible data collection, and self-surveillance to identify and prevent biases. Within their remit of overlooking research efforts, regulatory authorities, as stakeholders, also have the potential for a positive effect on the DEI of emerging clinical evidence. All these are implementable tools and mechanisms that can make study participation more approachable to diverse communities, and ultimately generate evidence that is more generalizable and a conduit for better outcomes. The research community has an imperative to make DEI principles key foundational aspects in study conduct in order to pursue better personalized medicine for diverse patient populations.

Decentralised clinical trials in multiple sclerosis research

Randomised controlled trials (RCTs) play an important role in multiple sclerosis (MS) research, ensuring that new interventions are safe and efficacious before their introduction into clinical practice. Trials have been evolving to improve the robustness of their designs and the efficiency of their conduct. Advances in digital and mobile technologies in recent years have facilitated this process and the first RCTs with decentralised elements became possible. Decentralised clinical trials (DCTs) are conducted remotely, enabling participation of a more heterogeneous population who can participate in research activities from different locations and at their convenience. DCTs also rely on digital and mobile technologies which allows for more flexible and frequent assessments. While hospitals quickly adapted to e-health and telehealth assessments during the COVID-19 pandemic, the conduct of conventional RCTs was profoundly disrupted. In this paper, we review the existing evidence and gaps in knowledge in the design and conduct of DCTs in MS.

Mobility recorded by wearable devices and gold standards: the Mobilise-D procedure for data standardization

Wearable devices are used in movement analysis and physical activity research to extract clinically relevant information about an individual's mobility. Still, heterogeneity in protocols, sensor characteristics, data formats, and gold standards represent a barrier for data sharing, reproducibility, and external validation. In this study, we aim at providing an example of how movement data (from the real-world and the laboratory) recorded from different wearables and gold standard technologies can be organized, integrated, and stored. We leveraged on our experience from a large multi-centric study (Mobilise-D) to provide guidelines that can prove useful to access, understand, and re-use the data that will be made available from the study. These guidelines highlight the encountered challenges and the adopted solutions with the final aim of supporting standardization and integration of data in other studies and, in turn, to increase and facilitate comparison of data recorded in the scientific community. We also provide samples of standardized data, so that both the structure of the data and the procedure can be easily understood and reproduced.

Predicting hospitalization from real-world measures in patients with chronic kidney disease: A proof-of-principle study

Objective

To investigate if in-clinic measures of physical function and real-world measures of physical behavior and mobility effort are associated with one another and to determine if they predict future hospitalization in participants with chronic kidney disease (CKD).

Methods

In this secondary analysis, novel real-world measures of physical behavior and mobility effort, including the best 6-minute step count (B6SC), were derived from passively collected data from a thigh worn actigraphy sensor and compared to traditional in-clinic measures of physical function (e.g. 6-minute walk test (6MWT). Hospitalization status during 2 years of follow-up was determined from electronic health records. Correlation analyses were used to compare measures and Cox Regression analysis was used to compare measures with hospitalization.

Results

One hundred and six participants were studied (69  ±  13 years, 43% women). Mean  ±  SD baseline measures for 6MWT was 386  ±  66 m and B6SC was 524  ±  125 steps. Forty-four hospitalization events over 224 years of total follow-up occurred. Good separation was achieved for tertiles of 6MWT, B6SC and steps/day for hospitalization events. This pattern persisted in models adjusted for demographics (6MWT: HR  =  0.63 95% CI 0.43-0.93, B6SC: HR  =  0.75, 95% CI 0.56-1.02 and steps/day: HR  =  0.75, 95% CI 0.50-1.13) and further adjusted for morbidities (6MWT: HR  =  0.54, 95% CI 0.35-0.84, B6SC: HR  =  0.70, 95% CI 0.49-1.00 and steps/day: HR  =  0.69, 95% CI 0.43-1.09).

Conclusion

Digital health technologies can be deployed remotely, passively, and continuously to collect real-world measures of physical behavior and mobility effort that differentiate risk of hospitalization in patients with CKD.

Regulatory Qualification of a Cross-Disease Digital Measure: Benefits and Challenges from the Perspective of IMI Consortium IDEA-FAST

Background

Innovative Medicines Initiative (IMI) consortium IDEA-FAST is developing novel digital measures of fatigue, sleep quality, and impact of sleep disturbances for neurodegenerative diseases and immune-mediated inflammatory diseases. In 2022, the consortium met with the European Medicines Agency (EMA) to receive advice on its plans for regulatory qualification of the measures. This viewpoint reviews the IDEA-FAST perspective on developing digital measures for multiple diseases and the advice provided by the EMA.

Summary

The EMA considered a cross-disease measure an interesting and arguably feasible concept. Developers should account for the need for a strong rationale that the clinical features to be measured are similar across diseases. In addition, they may expect increased complexity of study design, challenges when managing differences within and between disease populations, and the need for validation in both heterogeneous and homogeneous populations.

Key Messages

EMA highlighted the challenges teams may encounter when developing a cross-disease measure, though benefits potentially include reduced resources for the technology developer and health authority, faster access to innovation across different therapeutic fields, and feasibility of cross-disease comparisons. The insights included here can be used by project teams to guide them in the development of cross-disease digital measures intended for regulatory qualification.

Addressing Health Inequities in Digital Clinical Trials: A Review of Challenges and Solutions From the Field of HIV Research

Clinical trials are considered the gold standard for establishing efficacy of health interventions, thus determining which interventions are brought to scale in health care and public health programs. Digital clinical trials, broadly defined as trials that have partial to full integration of technology across implementation, interventions, and/or data collection, are valued for increased efficiencies as well as testing of digitally delivered interventions. Although recent reviews have described the advantages and disadvantages of and provided recommendations for improving scientific rigor in the conduct of digital clinical trials, few to none have investigated how digital clinical trials address the digital divide, whether they are equitably accessible, and if trial outcomes are potentially beneficial only to those with optimal and consistent access to technology. Human immunodeficiency virus (HIV), among other health conditions, disproportionately affects socially and economically marginalized populations, raising questions of whether interventions found to be efficacious in digital clinical trials and subsequently brought to scale will sufficiently and consistently reach and provide benefit to these populations. We reviewed examples from HIV research from across geographic settings to describe how digital clinical trials can either reproduce or mitigate health inequities via the design and implementation of the digital clinical trials and, ultimately, the programs that result. We discuss how digital clinical trials can be intentionally designed to prevent inequities, monitor ongoing access and utilization, and assess for differential impacts among subgroups with diverse technology access and use. These findings can be generalized to many other health fields and are practical considerations for donors, investigators, reviewers, and ethics committees engaged in digital clinical trials.

A cross-sectional survey on the early impact of COVID-19 on the uptake of decentralised trial methods in the conduct of clinical trials

BACKGROUND

The COVID-19 pandemic significantly impacted the conduct of clinical trials through delay, interruption or cancellation. Decentralised methods in clinical trials could help to continue trials during a pandemic. This paper presents the results of an exploratory study conducted early in the pandemic to gain insight into and describe the experiences of organisations involved in clinical trials, with regard to the impact of COVID-19 on the conduct of trials, and the adoption of decentralised methods prior to, and as mitigation for the impact, of COVID-19.

METHODS

A survey with 11 open-ended and four multiple choice questions was conducted in June 2020 among member organisations of the public-private "Trials@Home" consortium. The survey investigated (1) the impact and challenges of COVID-19 on the continuation of ongoing clinical trials, (2) the adoption of decentralised methods in clinical trials prior to and as a mitigation strategy for COVID-19, (3) the challenges of conducting clinical trials during COVID-19, (4) the expected permanency of COVID-19-driven changes to the adoption of decentralised methods in clinical trials, and (5) lessons learned from conducting clinical trials during the COVID-19 pandemic. A thematic, inductive analysis of open survey questions was performed, complemented with descriptive statistics (frequencies and distributions).

RESULTS

The survey had a response rate of 81%. All organisations included in the analysis (n = 18) implemented (some) decentralised methods in their clinical trials prior to COVID-19, and 15 (83%) implemented decentralised methods as mitigation for COVID-19. Decentralised methods for IMP supply, patient-health care provider interaction and communication, clinic visits and source document verification were used more often as mitigation strategies than they were used prior to COVID-19. Many respondents expect to maintain those decentralised methods they implemented during COVID-19 in ongoing trials, as well as implement them in future trials.

CONCLUSIONS

Decentralised methods are a widely implemented mitigation strategy for trial conduct in the face of the COVID-19 pandemic. The results of this survey show that there is an interest to continue the use of decentralised methods in future trials, but important points of attention have been identified that need solutions to help guide the transition from the traditional trial model to a more decentralised trial model.

Patient-led development of digital endpoints and the use of computer vision analysis in assessment of motor function in rare diseases

Digital health technologies are transforming the way health outcomes are captured and measured. Digital biomarkers may provide more objective measurements than traditional approaches as they encompass continuous and longitudinal data collection and use of automated analysis for data interpretation. In addition, the use of digital health technology allows for home-based disease assessments, which in addition to reducing patient burden from on-site hospital visits, provides a more holistic picture of how the patient feels and functions in the real world. Tools that can robustly capture drug efficacy based on disease-specific outcomes that are meaningful to patients, are going to be key to the successful development of new treatments. This is particularly important for people living with rare and chronic complex conditions, where therapeutic options are limited and need to be developed using a patient-focused approach to achieve the biggest impact. Working in partnership with patient Organisation Duchenne UK, we co-developed a video-based approach, delivered through a new mobile health platform (DMD Home), to assess motor function in patients with Duchenne muscular dystrophy (DMD), a genetic, rare, muscular disease characterized by the progressive loss of muscle function and strength. Motor function tasks were selected to reflect the “transfer stage” of the disease, when patients are no longer able to walk independently but can stand and weight-bear to transfer. This stage is important for patients and families as it represents a significant milestone in the progression of DMD but it is not routinely captured and/or scored by standard DMD clinical and physiotherapy assessments. A total of 62 videos were submitted by eight out of eleven participants who onboarded the app and were analysed with pose estimation software (OpenPose) that led to the extraction of objective, quantitative measures, including time, pattern of movement trajectory, and smoothness and symmetry of movement. Computer vision analysis of video tasks to identify voluntary or compensatory movements within the transfer stage merits further investigation. Longitudinal studies to validate DMD home as a new methodology to predict progression to the non-ambulant stage will be pursued.

Evaluating the Use of Digital Biomarkers to Test Treatment Effects on Cognition and Movement in Patients with Lewy Body Dementia

Background:

PRESENCE was a Phase 2 trial assessing mevidalen for symptomatic treatment of Lewy body dementia (LBD). Participants received daily doses (10, 30, or 75 mg) of mevidalen (LY3154207) or placebo for 12 weeks.

Objective:

To evaluate if frequent cognitive and motor tests using an iPad app and wrist-worn actigraphy to track activity and sleep could detect mevidalen treatment effects in LBD.

Methods:

Of 340 participants enrolled in PRESENCE, 238 wore actigraphy for three 2-week periods: pre-, during, and post-intervention. A subset of participants (n = 160) enrolled in a sub-study using an iPad trial app with 3 tests: digital symbol substitution (DSST), spatial working memory (SWM), and finger-tapping. Compliance was defined as daily test completion or watch-wearing ≥23 h/day. Change from baseline to week 12 (app) or week 8 (actigraphy) was used to assess treatment effects using Mixed Model Repeated Measures analysis. Pearson correlations between sensor-derived features and clinical endpoints were assessed.

Results:

Actigraphy and trial app compliance was > 90% and > 60%, respectively. At baseline, daytime sleep positively correlated with Epworth Sleepiness Scale score (p < 0.01). Physical activity correlated with improvement on Movement Disorder Society –Unified Parkinson Disease Rating Scale (MDS-UPDRS) part II (p < 0.001). Better scores of DSST and SWM correlated with lower Alzheimer Disease Assessment Scale –Cognitive 13-Item Scale (ADAS-Cog₁₃) (p < 0.001). Mevidalen treatment (30 mg) improved SWM (p < 0.01), while dose-dependent decreases in daytime sleep (10 mg: p < 0.01, 30 mg: p < 0.05, 75 mg: p < 0.001), and an increase in walking minutes (75 mg dose: p < 0.001) were observed, returning to baseline post-intervention.

Conclusion:

Devices used in the LBD population achieved adequate compliance and digital metrics detected statistically significant treatment effects.

Challenges of Incorporating Digital Health Technology Outcomes in a Clinical Trial: Experiences from PD STAT

Digital health technologies (DHTs) have great potential for use as clinical trial outcomes; however, practical issues need to be addressed in order to maximise their benefit. We describe our experience of incorporating two DHTs as secondary/exploratory outcome measures in PD STAT, a randomised clinical trial of simvastatin in people with Parkinson's disease. We found much higher rates of missing data in the DHTs than the traditional outcome measures, in particular due to technical and software difficulties. We discuss methods to address these obstacles in terms of protocol design, workforce training and data management.

Considerations for Conducting Bring Your Own “Device” (BYOD) Clinical Studies

Background

Digital health technologies are attracting attention as novel tools for data collection in clinical research. They present alternative methods compared to in-clinic data collection, which often yields snapshots of the participants' physiology, behavior, and function that may be prone to biases and artifacts, e.g., white coat hypertension, and not representative of the data in free-living conditions. Modern digital health technologies equipped with multi-modal sensors combine different data streams to derive comprehensive endpoints that are important to study participants and are clinically meaningful. Used for data collection in clinical trials, they can be deployed as provisioned products where technology is given at study start or in a bring your own “device” (BYOD) manner where participants use their technologies to generate study data.

Summary

The BYOD option has the potential to be more user-friendly, allowing participants to use technologies that they are familiar with, ensuring better participant compliance, and potentially reducing the bias that comes with introducing new technologies. However, this approach presents different technical, operational, regulatory, and ethical challenges to study teams. For example, BYOD data can be more heterogeneous, and recruiting historically underrepresented populations with limited access to technology and the internet can be challenging. Despite the rapid increase in digital health technologies for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving.

Key Messages

We offer considerations for academic researchers, drug developers, and patient advocacy organizations on the design and deployment of BYOD models in clinical research. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; (5) statistical considerations to meet regulatory requirements. We believe that this article acts as a primer, providing insights into study design and operational requirements to ensure the successful implementation of BYOD clinical studies.

Digital Health-Enabled Clinical Trials in Stroke: Ready for Prime Time?

As stroke continues to represent a major global health care problem, advancing our knowledge of new effective and safe stroke interventions represents a public health priority. The identification of these therapies requires the conduct of high-quality and well-powered randomized clinical trials. Despite its potential to inform clinical practice, traditional randomized clinical trial models have their drawbacks, including elevated costs, long completion times, failure to recruit the target sample sizes, lack of diversity, and complex operational procedures. Therefore, improving the participants' experience and trials' overall efficiency constitutes an important unmet need. Innovative models such as virtual and decentralized patient-centric trials have been proposed as a valuable strategy in this pursuit. In this narrative review, we discuss the limitations of traditional randomized clinical trial models and present the concept, advantages, and challenges of decentralized digitally enabled approaches to the conduct of stroke clinical trials.

Lessons learned in the Apple Heart Study and implications for the data management of future digital clinical trials

The digital clinical trial is fast emerging as a pragmatic trial that can improve a trial's design including recruitment and retention, data collection and analytics. To that end, digital platforms such as electronic health records or wearable technologies that enable passive data collection can be leveraged, alleviating burden from the participant and study coordinator. However, there are challenges. For example, many of these data sources not originally intended for research may be noisier than traditionally obtained measures. Further, the secure flow of passively collected data and their integration for analysis is non-trivial. The Apple Heart Study was a prospective, single-arm, site-less digital trial designed to evaluate the ability of an app to detect atrial fibrillation. The study was designed with pragmatic features, such as an app for enrollment, a wearable device (the Apple Watch) for data collection, and electronic surveys for participant-reported outcomes that enabled a high volume of patient enrollment and accompanying data. These elements led to challenges including identifying the number of unique participants, maintaining participant-level linkage of multiple complex data streams, and participant adherence and engagement. Novel solutions were derived that inform future designs with an emphasis on data management. We build upon the excellent framework of the Clinical Trials Transformation Initiative to provide a comprehensive set of guidelines for data management of the digital clinical trial that include an increased role of collaborative data scientists in the design and conduct of the modern digital trial.

Recommendations for Defining and Reporting Adherence Measured by Biometric Monitoring Technologies: Systematic Review

Background

Suboptimal adherence to data collection procedures or a study intervention is often the cause of a failed clinical trial. Data from connected sensors, including wearables, referred to here as biometric monitoring technologies (BioMeTs), are capable of capturing adherence to both digital therapeutics and digital data collection procedures, thereby providing the opportunity to identify the determinants of adherence and thereafter, methods to maximize adherence.

Objective

We aim to describe the methods and definitions by which adherence has been captured and reported using BioMeTs in recent years. Identifying key gaps allowed us to make recommendations regarding minimum reporting requirements and consistency of definitions for BioMeT-based adherence data.

Methods

We conducted a systematic review of studies published between 2014 and 2019, which deployed a BioMeT outside the clinical or laboratory setting for which a quantitative, nonsurrogate, sensor-based measurement of adherence was reported. After systematically screening the manuscripts for eligibility, we extracted details regarding study design, participants, the BioMeT or BioMeTs used, and the definition and units of adherence. The primary definitions of adherence were categorized as a continuous variable based on duration (highest resolution), a continuous variable based on the number of measurements completed, or a categorical variable (lowest resolution).

Results

Our PubMed search terms identified 940 manuscripts; 100 (10.6%) met our eligibility criteria and contained descriptions of 110 BioMeTs. During literature screening, we found that 30% (53/177) of the studies that used a BioMeT outside of the clinical or laboratory setting failed to report a sensor-based, nonsurrogate, quantitative measurement of adherence. We identified 37 unique definitions of adherence reported for the 110 BioMeTs and observed that uniformity of adherence definitions was associated with the resolution of the data reported. When adherence was reported as a continuous time-based variable, the same definition of adherence was adopted for 92% (46/50) of the tools. However, when adherence data were simplified to a categorical variable, we observed 25 unique definitions of adherence reported for 37 tools.

Conclusions

We recommend that quantitative, nonsurrogate, sensor-based adherence data be reported for all BioMeTs when feasible; a clear description of the sensor or sensors used to capture adherence data, the algorithm or algorithms that convert sample-level measurements to a metric of adherence, and the analytic validation data demonstrating that BioMeT-generated adherence is an accurate and reliable measurement of actual use be provided when available; and primary adherence data be reported as a continuous variable followed by categorical definitions if needed, and that the categories adopted are supported by clinical validation data and/or consistent with previous reports.

Data management in diabetes clinical trials: a qualitative study

Background

Clinical trials play an important role in expanding the knowledge of diabetes prevention, diagnosis, and treatment, and data management is one of the main issues in clinical trials. Lack of appropriate planning for data management in clinical trials may negatively influence achieving the desired results. The aim of this study was to explore data management processes in diabetes clinical trials in three research institutes in Iran.

Method

This was a qualitative study conducted in 2019. In this study, data were collected through in-depth semi-structured interviews with 16 researchers in three endocrinology and metabolism research institutes. To analyze data, the method of thematic analysis was used.

Results

The five themes that emerged from data analysis included (1) clinical trial data collection, (2) technologies used in data management, (3) data security and confidentiality management, (4) data quality management, and (5) data management standards. In general, the findings indicated that no clear and standard process was used for data management in diabetes clinical trials, and each research center executed its own methods and processes.

Conclusion

According to the results, the common methods of data management in diabetes clinical trials included a set of paper-based processes. It seems that using information technology can help facilitate data management processes in a variety of clinical trials, including diabetes clinical trials.

Digital Phenotyping in Clinical Neurology

Internet-connected devices, including personal computers, smartphones, smartwatches, and voice assistants, have evolved into powerful multisensor technologies that billions of people interact with daily to connect with friends and colleagues, access and share information, purchase goods, play games, and navigate their environment. Digital phenotyping taps into the data streams captured by these devices to characterize and understand health and disease. The purpose of this article is to summarize opportunities for digital phenotyping in neurology, review studies using everyday technologies to obtain motor and cognitive information, and provide a perspective on how neurologists can embrace and accelerate progress in this emerging field.

Digital Biomarkers in Psychiatric Research: Data Protection Qualifications in a Complex Ecosystem

Psychiatric research traditionally relies on subjective observation, which is time-consuming and labor-intensive. The widespread use of digital devices, such as smartphones and wearables, enables the collection and use of vast amounts of user-generated data as "digital biomarkers." These tools may also support increased participation of psychiatric patients in research and, as a result, the production of research results that are meaningful to them. However, sharing mental health data and research results may expose patients to discrimination and stigma risks, thus discouraging participation. To earn and maintain participants' trust, the first essential requirement is to implement an appropriate data governance system with a clear and transparent allocation of data protection duties and responsibilities among the actors involved in the process. These include sponsors, investigators, operators of digital tools, as well as healthcare service providers and biobanks/databanks. While previous works have proposed practical solutions to this end, there is a lack of consideration of positive data protection law issues in the extant literature. To start filling this gap, this paper discusses the GDPR legal qualifications of controller, processor, and joint controllers in the complex ecosystem unfolded by the integration of digital biomarkers in psychiatric research, considering their implications and proposing some general practical recommendations.

Technology-outcome measures in neuromuscular disorders: a systematic review

BACKGROUND

Portable and wearable devices can monitor a number of physical performances and have been lately applied to patients with neuromuscular disorders (NMD).

METHODS

We performed a systematic search of literature databases following PRISMA principles, including all studies reporting the use of technological devices for motor function assessment in NMDs from 2000 to 2021. We also summarized the evidence on measurement properties (validity, reliability, responsiveness) of the analyzed technological outcome measures.

RESULTS

One-hundred studies fulfilled the selection criteria, most of them published in the last ten years. We defined four categories that gathered similar technologies: gait analysis tools, for clinical assessment of pace and posture; continuous monitoring of physical activity with inertial sensors, that allow "unsupervised" activity assessment; upper limb evaluation tools, including Kinect-based outcome measures to assess the reachable workspace; and new muscle strength assessment tools, such as Myotools. Inertial sensors have the evident advantage of being applied in the "in-home" setting, which has become especially appealing with the Covid-19 pandemic, although poor evidence from psychometric property assessment and results of the analyzed studies may limit their research application. Both Kinect-based outcome measures and Myotools have been already validated in multicenter studies and different NMDs, showing excellent characteristics for application in clinical trials.

CONCLUSION

This overview is intended to raise awareness on the potential of the different TOMs in the neuromuscular field and be an informative source for the design of future clinical trials, particularly in the era of telemedicine.

A Systematic Review of Methods used to Conduct Decentralised Clinical Trials

Aims

To evaluate, using quantitative and qualitative approaches, published data on the design and conduct of decentralised clinical trials (DCTs).

Methods

We searched MEDLINE, EMBASE, CENTRAL, PsycINFO, ProQuest Dissertations and Theses, ClinicalTrials.gov, OpenGrey and Google Scholar for publications reporting, discussing, or evaluating decentralised clinical research methods. Reports of randomised clinical trials using decentralised methods were included in a focused quantitative analysis with a primary outcome of number of randomised participants. All publications discussing or evaluating DCTs were included in a wider qualitative analysis to identify advantages, disadvantages, facilitators, barriers and stakeholder opinions of decentralised clinical trials. Quantitative data were summarised using descriptive statistics, and qualitative data analysed using a thematic approach.

Results

Initial searches identified 19 704 articles. After removal of duplicates, 18 553 were screened, resulting in 237 eligible for full‐text assessment. Forty‐five trials were included in the quantitative analysis; 117 documents were included in the qualitative analysis. Trials were widely heterogeneous in design and reporting, precluding meta‐analysis of the effect of DCT methods on the primary recruitment outcome. Qualitative analysis formulated 4 broad themes: value, burden, safety and equity. Participant and stakeholder experiences of DCTs were incompletely represented.

Conclusion

DCTs are developing rapidly. However, there is insufficient evidence to confirm which methods are most effective in trial recruitment, retention, or overall cost. The identified advantages, disadvantages, facilitators and barriers should inform the development of DCT methods. We recommend further research on how DCTs are experienced and perceived by participants and stakeholders to maximise potential benefits.

Clinical validation of digital biomarkers for pediatric patients with asthma and cystic fibrosis - Potential for clinical trials and clinical care

BACKGROUND

Digital biomarkers are a promising novel method to capture clinical data in a home-setting. However, clinical validation prior to implementation is of vital importance. The aim of this study was to clinically validate physical activity, heart rate, sleep and FEV1 as digital biomarkers measured by a smartwatch and portable spirometer in children with asthma and cystic fibrosis (CF).

METHODS

This was a prospective cohort study including 60 children with asthma and 30 children with CF (age 6-16). Participants wore a smartwatch, performed daily spirometry at home and completed a daily symptom questionnaire for 28-days. Physical activity, heart rate, sleep and FEV1 were considered candidate digital endpoints. Data from 128 healthy children was used for comparison. Reported outcomes were compliance, difference between patients and controls, correlation with disease-activity and potential to detect clinical events. Analysis was performed with linear mixed effect models.

RESULTS

Median compliance was 88%. On average, patients exhibited lower physical activity and FEV1 compared to healthy children, whereas the heart rate of children with asthma was higher compared to healthy children. Days with a higher symptom score were associated with lower physical activity for children with uncontrolled asthma and CF. Furthermore, FEV1 was lower and (nocturnal) heart rate was higher for both patient groups on days with more symptoms. Candidate biomarkers and showed a distinct pattern before- and after a pulmonary exacerbation.

CONCLUSION

Portable spirometer- and smartwatch-derived digital biomarkers show promise as candidate endpoints for use in clinical trials or clinical care in pediatric lung disease.

Utilizing graph machine learning within drug discovery and development

Graph machine learning (GML) is receiving growing interest within the pharmaceutical and biotechnology industries for its ability to model biomolecular structures, the functional relationships between them, and integrate multi-omic datasets - amongst other data types. Herein, we present a multidisciplinary academic-industrial review of the topic within the context of drug discovery and development. After introducing key terms and modelling approaches, we move chronologically through the drug development pipeline to identify and summarize work incorporating: target identification, design of small molecules and biologics, and drug repurposing. Whilst the field is still emerging, key milestones including repurposed drugs entering in vivo studies, suggest GML will become a modelling framework of choice within biomedical machine learning.

Navigating the ethics of remote research data collection

COVID-19 has accelerated broad trends already in place toward remote research data collection and monitoring. This move implicates novel ethical and regulatory challenges which have not yet received due attention. Existing work is preliminary and does not seek to identify or grapple with the issues in a rigorous and sophisticated way. Here, we provide a framework for identifying and addressing challenges that we believe can help the research community realize the benefits of remote technologies while preserving ethical ideals and public trust. We organize issues into several distinct categories and provide points to consider in a table that can help facilitate ethical design and review of research studies using remote health instruments.

Estimating sleep stages using cardiorespiratory signals: validation of a novel algorithm across a wide range of sleep-disordered breathing severity

STUDY OBJECTIVES

We have developed the CardioRespiratory Sleep Staging (CReSS) algorithm for estimating sleep stages using heart rate variability and respiration, allowing for estimation of sleep staging during home sleep apnea tests. Our objective was to undertake an epoch-by-epoch validation of algorithm performance against the gold standard of manual polysomnography sleep staging.

METHODS

Using 296 polysomnographs, we created a limited montage of airflow and heart rate and deployed CReSS to identify each 30-second epoch as wake, light sleep (N1 + N2), deep sleep (N3), or rapid eye movement (REM) sleep. We calculated Cohen's kappa and the percentage of accurately identified epochs. We repeated our analyses after stratification by sleep-disordered breathing (SDB) severity, and after adding thoracic respiratory effort as a backup signal for periods of invalid airflow.

RESULTS

CReSS discriminated wake/light sleep/deep sleep/REM sleep with 78% accuracy; the kappa value was 0.643 (95% confidence interval, 0.641-0.645). Discrimination of wake/sleep demonstrated a kappa value of 0.711 and accuracy of 89%, non-REM sleep/REM sleep demonstrated a kappa of 0.790 and accuracy of 94%, and light sleep/deep sleep demonstrated a kappa of 0.469 and accuracy of 87%. Kappa values did not vary by more than 0.07 across subgroups of no SDB, mild SDB, moderate SDB, and severe SDB. Accuracy increased to 80%, with a kappa value of 0.680 (95% confidence interval, 0.678-0.682), when CReSS additionally utilized the thoracic respiratory effort signal.

CONCLUSIONS

We observed substantial agreement between CReSS and the gold-standard comparator of manual sleep staging of polysomnographic signals, which was consistent across the full range of SDB severity. Future research should focus on the extent to which CReSS reduces the discrepancy between the apnea-hypopnea index and the respiratory event index, and the ability of CReSS to identify REM sleep-related obstructive sleep apnea.

Integrating Real-World Evidence in the Regulatory Decision-Making Process: A Systematic Analysis of Experiences in the US, EU, and China Using a Logic Model

Real world evidence (RWE) and real-world data (RWD) are drawing ever-increasing attention in the pharmaceutical industry and drug regulatory authorities (DRAs) all over the world due to their paramount role in supporting drug development and regulatory decision making. However, there is little systematic documentary analysis about how RWE was integrated for the use by the DRAs in evaluating new treatment approaches and monitoring post-market safety. This study aimed to analyze and discuss the integration of RWE into regulatory decision-making process from the perspective of DRAs. Different development strategies to develop and adopt RWE by the DRAs in the US, Europe, and China were reviewed and compared, and the challenges encountered were discussed. It was found that different strategies on development of RWE were applied by FDA, EMA, and NMPA. The extent to which RWE was adopted in China was relatively limited compared to that in the US and EU, which was highly related to the national pharmaceutical environment and development stages. A better understanding of the overall goals, inputs, activities, outputs, and outcomes in developing RWE will help inform actions to harness RWD and leverage RWE for better health care decisions.

Postdischarge Recovery after Acute Pediatric Lung Disease Can Be Quantified with Digital Biomarkers

BACKGROUND

Pediatric patients admitted for acute lung disease are treated and monitored in the hospital, after which full recovery is achieved at home. Many studies report in-hospital recovery, but little is known regarding the time to full recovery after hospital discharge. Technological innovations have led to increased interest in home-monitoring and digital biomarkers. The aim of this study was to describe at-home recovery of 3 common pediatric respiratory diseases using a questionnaire and wearable device.

METHODS

In this study, patients admitted due to pneumonia (n = 30), preschool wheezing (n = 30), and asthma exacerbation (AE; n = 11) were included. Patients were monitored with a smartwatch and a questionnaire during admission, with a 14-day recovery period and a 10-day "healthy" period. Median compliance was calculated, and a mixed-effects model was fitted for physical activity and heart rate (HR) to describe the recovery period, and the physical activity recovery trajectory was correlated to respiratory symptom scores.

RESULTS

Median compliance was 47% (interquartile range [IQR] 33-81%) during the entire study period, 68% (IQR 54-91%) during the recovery period, and 28% (IQR 0-74%) during the healthy period. Patients with pneumonia reached normal physical activity 12 days postdischarge, while subjects with wheezing and AE reached this level after 5 and 6 days, respectively. Estimated mean physical activity was closely correlated with the estimated mean symptom score. HR measured by the smartwatch showed a similar recovery trajectory for subjects with wheezing and asthma, but not for subjects with pneumonia.

CONCLUSIONS

The digital biomarkers, physical activity, and HR obtained via smartwatch show promise for quantifying postdischarge recovery in a noninvasive manner, which can be useful in pediatric clinical trials and clinical care.

Medical Food Assessment Using a Smartphone App With Continuous Glucose Monitoring Sensors: Proof-of-Concept Study

Background

Novel wearable biosensors, ubiquitous smartphone ownership, and telemedicine are converging to enable new paradigms of clinical research. A new generation of continuous glucose monitoring (CGM) devices provides access to clinical-grade measurement of interstitial glucose levels. Adoption of these sensors has become widespread for the management of type 1 diabetes and is accelerating in type 2 diabetes. In parallel, individuals are adopting health-related smartphone-based apps to monitor and manage care.

Objective

We conducted a proof-of-concept study to investigate the potential of collecting robust, annotated, real-time clinical study measures of glucose levels without clinic visits.

Methods

Self-administered meal-tolerance tests were conducted to assess the impact of a proprietary synbiotic medical food on glucose control in a 6-week, double-blind, placebo-controlled, 2×2 cross-over pilot study (n=6). The primary endpoint was incremental glucose measured using Abbott Freestyle Libre CGM devices associated with a smartphone app that provided a visual diet log.

Results

All subjects completed the study and mastered CGM device usage. Over 40 days, 3000 data points on average per subject were collected across three sensors. No adverse events were recorded, and subjects reported general satisfaction with sensor management, the study product, and the smartphone app, with an average self-reported satisfaction score of 8.25/10. Despite a lack of sufficient power to achieve statistical significance, we demonstrated that we can detect meaningful changes in the postprandial glucose response in real-world settings, pointing to the merits of larger studies in the future.

Conclusions

We have shown that CGM devices can provide a comprehensive picture of glucose control without clinic visits. CGM device usage in conjunction with our custom smartphone app can lower the participation burden for subjects while reducing study costs, and allows for robust integration of multiple valuable data types with glucose levels remotely.

Trial Registration

ClinicalTrials.gov NCT04424888; http://clinicaltrials.gov/ct2/show/NCT04424888.

Development of Novel, Value-Based, Digital Endpoints for Clinical Trials: A Structured Approach Toward Fit-for-Purpose Validation

Novel digital endpoints gathered via wearables, small devices, or algorithms hold great promise for clinical trials. However, implementation has been slow because of a lack of guidelines regarding the validation process of these new measurements. In this paper, we propose a pragmatic approach toward selection and fit-for-purpose validation of digital endpoints. Measurements should be value-based, meaning the measurements should directly measure or be associated with meaningful outcomes for patients. Devices should be assessed regarding technological validity. Most importantly, a rigorous clinical validation process should appraise the tolerability, difference between patients and controls, repeatability, detection of clinical events, and correlation with traditional endpoints. When technically and clinically fit-for-purpose, case building in interventional clinical trials starts to generate evidence regarding the response to new or existing health-care interventions. This process may lead to the digital endpoint replacing traditional endpoints, such as clinical rating scales or questionnaires in clinical trials. We recommend initiating more data-sharing collaborations to prevent unnecessary duplication of research and integration of value-based measurements in clinical care to enhance acceptance by health-care professionals. Finally, we invite researchers and regulators to adopt this approach to ensure a timely implementation of digital measurements and value-based thinking in clinical trial design and health care. SIGNIFICANCE STATEMENT: Novel digital endpoints are often cited as promising for the clinical trial of the future. However, clear validation guidelines are lacking in the literature. This paper contains pragmatic criteria for the selection, technical validation, and clinical validation of novel digital endpoints and provides recommendations for future work and collaboration.

Wearable Devices: Current Status and Opportunities in Pain Assessment and Management

INTRODUCTION

We investigated the possibilities and opportunities for using wearable devices that measure physical activity and physiometric signals in conjunction with ecological momentary assessment (EMA) data to improve the assessment and treatment of pain.

METHODS

We considered studies with cross-sectional and longitudinal designs as well as interventional or observational studies correlating pain scores with measures derived from wearable devices. A search was also performed on studies that investigated physical activity and physiometric signals among patients with pain.

RESULTS

Few studies have assessed the possibility of incorporating wearable devices as objective tools for contextualizing pain and physical function in free-living environments. Of the studies that have been conducted, most focus solely on physical activity and functional outcomes as measured by a wearable accelerometer. Several studies report promising correlations between pain scores and signals derived from wearable devices, objectively measured physical activity, and physical function. In addition, there is a known association between physiologic signals that can be measured by wearable devices and pain, though studies using wearable devices to measure these signals and associate them with pain in free-living environments are limited.

CONCLUSION

There exists a great opportunity to study the complex interplay between physiometric signals, physical function, and pain in a real-time fashion in free-living environments. The literature supports the hypothesis that wearable devices can be used to develop reproducible biosignals that correlate with pain. The combination of wearable devices and EMA will likely lead to the development of clinically meaningful endpoints that will transform how we understand and treat pain patients.

A Roadmap to Inform Development, Validation and Approval of Digital Mobility Outcomes: The Mobilise-D Approach

Health care has had to adapt rapidly to COVID-19, and this in turn has highlighted a pressing need for tools to facilitate remote visits and monitoring. Digital health technology, including body-worn devices, offers a solution using digital outcomes to measure and monitor disease status and provide outcomes meaningful to both patients and health care professionals. Remote monitoring of physical mobility is a prime example, because mobility is among the most advanced modalities that can be assessed digitally and remotely. Loss of mobility is also an important feature of many health conditions, providing a read-out of health as well as a target for intervention. Real-world, continuous digital measures of mobility (digital mobility outcomes or DMOs) provide an opportunity for novel insights into health care conditions complementing existing mobility measures. Accepted and approved DMOs are not yet widely available. The need for large collaborative efforts to tackle the critical steps to adoption is widely recognised. Mobilise-D is an example. It is a multidisciplinary consortium of 34 institutions from academia and industry funded through the European Innovative Medicines Initiative 2 Joint Undertaking. Members of Mobilise-D are collaborating to address the critical steps for DMOs to be adopted in clinical trials and ultimately health care. To achieve this, the consortium has developed a roadmap to inform the development, validation and approval of DMOs in Parkinson's disease, multiple sclerosis, chronic obstructive pulmonary disease and recovery from proximal femoral fracture. Here we aim to describe the proposed approach and provide a high-level view of the ongoing and planned work of the Mobilise-D consortium. Ultimately, Mobilise-D aims to stimulate widespread adoption of DMOs through the provision of device agnostic software, standards and robust validation in order to bring digital outcomes from concept to use in clinical trials and health care.

Digital Health Applications for Pharmacogenetic Clinical Trials

Digital health (DH) is the use of digital technologies and data analytics to understand health-related behaviors and enhance personalized clinical care. DH is increasingly being used in clinical trials, and an important field that could potentially benefit from incorporating DH into trial design is pharmacogenetics. Prospective pharmacogenetic trials typically compare a standard care arm to a pharmacogenetic-guided therapeutic arm. These trials often require large sample sizes, are challenging to recruit into, lack patient diversity, and can have complicated workflows to deliver therapeutic interventions to both investigators and patients. Importantly, the use of DH technologies could mitigate these challenges and improve pharmacogenetic trial design and operation. Some DH use cases include (1) automatic electronic health record-based patient screening and recruitment; (2) interactive websites for participant engagement; (3) home- and tele-health visits for patient convenience (e.g., samples for lab tests, physical exams, medication administration); (4) healthcare apps to collect patient-reported outcomes, adverse events and concomitant medications, and to deliver therapeutic information to patients; and (5) wearable devices to collect vital signs, electrocardiograms, sleep quality, and other discrete clinical variables. Given that pharmacogenetic trials are inherently challenging to conduct, future pharmacogenetic utility studies should consider implementing DH technologies and trial methodologies into their design and operation.

Implementation of Mobile Health Technologies in Clinical Trials of Movement Disorders: Underutilized Potential

Mobile health technologies (mHealth) are patient-worn or portable devices aimed at increasing the granularity and relevance of clinical measurements. The implementation of mHealth has the potential to decrease sample size, duration, and cost of clinical trials. We performed a review of the ClinicalTrials.gov database using a standardized approach to identify adoption in and usefulness of mHealth in movement disorders interventional clinical trials. Trial phase, geographical area, availability of data captured, constructs of interest, and outcome priority were collected. Eligible trials underwent quality appraisal using an ad hoc 5-point checklist to assess mHealth feasibility, acceptability, correlation with patient-centered outcome measures, and clinical meaningfulness. A total of 29% (n = 54/184) registered trials were using mHealth, mainly in Parkinson's disease and essential tremor (59.3% and 27.8%). In most cases, mHealth were used in phase 2 trials (83.3%) as secondary outcome measures (59.3%). Only five phase 3 trials, representing 9.3% of the total, used mHealth (1 as primary outcome measure, 3 as secondary, and 1 as tertiary). Only 3.7% (n = 2/54) of all trials used mHealth for measuring both motor and non-motor symptoms, and 23.1% (n = 12/52) used mHealth for unsupervised, ecologic outcomes. Our findings suggest that mHealth remain underutilized and largely relegated to phase 2 trials for secondary or tertiary outcome measures. Efforts toward greater alignment of mHealth with patient-centered outcomes and development of a universal, common-language platform to synchronize data from one or more devices will assist future efforts toward the integration of mHealth into clinical trials.

Learning from patient and site perspectives to develop better digital health trials: Recommendations from the Clinical Trials Transformation Initiative

In order to harness the potential of digital health technologies to enhance the quality of clinical research, it is critical to first understand how to engage patients and research sites when planning and conducting digital health trials. To pave the way for the more effective use of digital health technologies in trials, the Clinical Trials Transformation Initiative has developed the first comprehensive, evidence-based set of recommendations for incorporating patient and site perspectives in digital health trials. While directed primarily at sponsors, these recommendations are expected to be valuable for all stakeholders including investigators.

Outcome measures based on digital health technology sensor data: data- and patient-centric approaches

Digital health technology tools (DHTT) are technologies such as apps, smartphones, and wearables that remotely acquire health-related information from individuals. They have the potential advantages of objectivity and sensitivity of measurement, richness of high-frequency sensor data, and opportunity for passive collection of health-related data. Thus, DHTTs promise to provide patient phenotyping at an order of granularity several times greater than is possible with traditional clinical research tools. While the conceptual development of novel DHTTs is keeping pace with technological and analytical advancements, an as yet unaddressed gap is how to develop robust and meaningful outcome measures based on sensor data. Here, we describe two roadmaps which were developed to generate outcome measures based on DHTT data: one using a data-centric approach and the second a patient-centric approach. The data-centric approach to develop digital outcome measures summarizes those sensor features maximally sensitive to the concept of interest, exemplified with the quantification of disease progression. The patient-centric approach summarizes those sensor features that are optimally relevant to patients' functioning in everyday life. Both roadmaps are exemplified for use in tracking disease progression in observational and clinical interventional studies, and with a DHTT designed to evaluate motor symptom severity and symptom experience in Parkinson's disease. Use cases other than disease progression (e.g., case-finding) are considered summarily. DHTT research requires methods to summarize sensor data into meaningful outcome measures. It is hoped that the concepts outlined here will encourage a scientific discourse and eventual consensus on the creation of novel digital outcome measures for both basic clinical research and clinical drug development.

Choosing a Mobile Sensor Technology for a Clinical Trial: Statistical Considerations, Developments and Learnings

The DIA Study Endpoints Community Working Group on Mobile Sensor Technology (MST) series addresses considerations that may be useful for selecting MST for use in a clinical trial. This article describes considerations regarding the selection of MST for clinical trials including expectations around technology specifications, verification (bench testing), regulatory clearance and certification status. We identify useful statistical methods needed to establish agreement of the MST with respect to a clinical 'gold' standard technology in terms of accuracy and precision, and to combine data across trials, data types or device versions. In addition to describing key considerations, this manuscript also serves as a central location citing those resources where additional detail can be found.