1
|
Leyens L, Batchelor J, De Beuckelaer E, Langel K, Hartog B. Unlocking the full potential of digital endpoints for decision making: a novel modular evidence concept enabling re-use and advancing collaboration. Expert Rev Pharmacoecon Outcomes Res 2024; 24:731-741. [PMID: 38747565 DOI: 10.1080/14737167.2024.2334347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 03/20/2024] [Indexed: 06/17/2024]
Abstract
INTRODUCTION Over the last decade increasing examples indicate opportunities to measure patient functioning and its relevance for clinical and regulatory decision making via endpoints collected through digital health technologies. More recently, we have seen such measures support primary study endpoints and enable smaller trials. The field is advancing fast: validation requirements have been proposed in the literature and regulators are releasing new guidances to review these endpoints. Pharmaceutical companies are embracing collaborations to develop them and working with academia and patient organizations in their development. However, the road to validation and regulatory acceptance is lengthy. The full value of digital endpoints cannot be unlocked until better collaboration and modular evidence frameworks are developed enabling re-use of evidence and repurposing of digital endpoints. AREAS COVERED This paper proposes a solution by presenting a novel modular evidence framework -the Digital Evidence Ecosystem and Protocols (DEEP)- enabling repurposing of measurement solutions, re-use of evidence, application of standards and also facilitates collaboration with health technology assessment bodies. EXPERT OPINION The integration of digital endpoints in healthcare, essential for personalized and remote care, requires harmonization and transparency. The proposed novel stack model offers a modular approach, fostering collaboration and expediting the adoption in patient care.
Collapse
Affiliation(s)
- Lada Leyens
- Regulatory Science, DEEP Measures Oy, Helsinki, Finland
- Product Development Regulatory, F. Hoffmann-La Roche Ltd, Basel, Switzerland
| | | | | | - Kai Langel
- Regulatory, Janssen Cilag S.A, Madrid, Spain
| | - Bert Hartog
- Clinical Operations and Innovation, Janssen-Cilag B.V, DS Breda, The Netherlands
| |
Collapse
|
2
|
Keyloun KR, Abel J, Garcia JK, Papadopoulos EJ, Carson RT, Gwaltney C, Slagle AF, Byrom B. Leveraging sensor-based functional outcomes to enhance understanding of the patient experience: challenges and opportunities. Expert Rev Pharmacoecon Outcomes Res 2024; 24:723-730. [PMID: 38828646 DOI: 10.1080/14737167.2024.2362291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Accepted: 05/28/2024] [Indexed: 06/05/2024]
Abstract
INTRODUCTION Sensor-based digital health technology (DHT) has emerged as a promising means to assess patient functioning within and outside clinical trials. Sensor-based functional outcomes (SBFOs) provide valuable insights that complement other measures of how a patient feels or functions to enhance understanding of the patient experience to inform medical product development. AREAS COVERED This perspective paper provides recommendations for defining SBFOs, discusses the core evidence required to support SBFOs to inform decision-making, and considers future directions for the field. EXPERT COMMENTARY The clinical outcome assessment (COA) development process provides an important starting point for developing patient-centered SBFOs; however, given the infancy of the field, SBFO development may benefit from a hybrid approach to evidence generation by merging exploratory data analysis with patient engagement in measure development. Effective SBFO development requires combining unique expertise in patient engagement, measurement and regulatory science, and digital health and analytics. Challenges specific to SBFO development include identifying concepts of interest, ensuring measurement of meaningful aspects of health, and identifying thresholds for meaningful change. SBFOs are complementary to other COAs and, as part of an integrated evidence strategy, offer great promise in fostering a holistic understanding of patient experience and treatment benefits, particularly in real-world settings.
Collapse
Affiliation(s)
| | - Jessica Abel
- Patient Centered Outcomes Research, AbbVie, CA, USA
| | | | | | | | | | | | - Bill Byrom
- eCOA Science, Signant Health, Nottingham, UK
| |
Collapse
|
3
|
Adams JL, Kangarloo T, Gong Y, Khachadourian V, Tracey B, Volfson D, Latzman RD, Cosman J, Edgerton J, Anderson D, Best A, Kostrzebski MA, Auinger P, Wilmot P, Pohlson Y, Jensen-Roberts S, Müller MLTM, Stephenson D, Dorsey ER. Using a smartwatch and smartphone to assess early Parkinson's disease in the WATCH-PD study over 12 months. NPJ Parkinsons Dis 2024; 10:112. [PMID: 38866793 PMCID: PMC11169239 DOI: 10.1038/s41531-024-00721-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 05/10/2024] [Indexed: 06/14/2024] Open
Abstract
Digital measures may provide objective, sensitive, real-world measures of disease progression in Parkinson's disease (PD). However, multicenter longitudinal assessments of such measures are few. We recently demonstrated that baseline assessments of gait, tremor, finger tapping, and speech from a commercially available smartwatch, smartphone, and research-grade wearable sensors differed significantly between 82 individuals with early, untreated PD and 50 age-matched controls. Here, we evaluated the longitudinal change in these assessments over 12 months in a multicenter observational study using a generalized additive model, which permitted flexible modeling of at-home data. All measurements were included until participants started medications for PD. Over one year, individuals with early PD experienced significant declines in several measures of gait, an increase in the proportion of day with tremor, modest changes in speech, and few changes in psychomotor function. As measured by the smartwatch, the average (SD) arm swing in-clinic decreased from 25.9 (15.3) degrees at baseline to 19.9 degrees (13.7) at month 12 (P = 0.004). The proportion of awake time an individual with early PD had tremor increased from 19.3% (18.0%) to 25.6% (21.4%; P < 0.001). Activity, as measured by the number of steps taken per day, decreased from 3052 (1306) steps per day to 2331 (2010; P = 0.16), but this analysis was restricted to 10 participants due to the exclusion of those that had started PD medications and lost the data. The change of these digital measures over 12 months was generally larger than the corresponding change in individual items on the Movement Disorder Society-Unified Parkinson's Disease Rating Scale but not greater than the change in the overall scale. Successful implementation of digital measures in future clinical trials will require improvements in study conduct, especially data capture. Nonetheless, gait and tremor measures derived from a commercially available smartwatch and smartphone hold promise for assessing the efficacy of therapeutics in early PD.
Collapse
Affiliation(s)
- Jamie L Adams
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA.
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA.
| | | | - Yishu Gong
- Takeda Pharmaceuticals, Cambridge, MA, USA
| | | | | | | | | | | | | | | | | | - Melissa A Kostrzebski
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - Peggy Auinger
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - Peter Wilmot
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | - Yvonne Pohlson
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | - Stella Jensen-Roberts
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
| | | | | | - E Ray Dorsey
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| |
Collapse
|
4
|
Mestre TA, Stebbins GT, Stephenson D, Dexter D, Lee KK, Xiao Y, Dam T, Kopil CM, Simuni T. Patient-centered development of clinical outcome assessments in early Parkinson disease: key priorities and advances. NPJ Parkinsons Dis 2024; 10:101. [PMID: 38744872 PMCID: PMC11094181 DOI: 10.1038/s41531-024-00716-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 04/25/2024] [Indexed: 05/16/2024] Open
Affiliation(s)
- Tiago A Mestre
- Ottawa Hospital Research Institute; University of Ottawa Brain and Mind Research Institute; Division of Neurology, Department of Medicine, University of Ottawa, The Ottawa Hospital Ottawa, Ottawa, ON, Canada.
| | - Glenn T Stebbins
- Department of Neurological Sciences, Rush University Medical Center, Chicago, IL, USA
| | | | | | | | - Yuge Xiao
- The Michael J. Fox Foundation for Parkinson's Research, New York, NY, USA
| | - Tien Dam
- Neumora Therapeutics, Cambridge, MA, USA
| | - Catherine M Kopil
- The Michael J. Fox Foundation for Parkinson's Research, New York, NY, USA
| | - Tanya Simuni
- Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
5
|
Mestre TA. Laquinimod, Huntington's disease, and disease modification. Lancet Neurol 2024; 23:220-221. [PMID: 38280390 DOI: 10.1016/s1474-4422(24)00001-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 01/03/2024] [Accepted: 01/03/2024] [Indexed: 01/29/2024]
Affiliation(s)
- Tiago A Mestre
- Ottawa Hospital Research Institute; University of Ottawa Brain and Mind Research Institute; Division of Neurology, Department of Medicine, University of Ottawa, The Ottawa Hospital Ottawa, Ottawa, ON K1Y 4E9, Canada.
| |
Collapse
|
6
|
Mirelman A, Volkov J, Salomon A, Gazit E, Nieuwboer A, Rochester L, Del Din S, Avanzino L, Pelosin E, Bloem BR, Della Croce U, Cereatti A, Thaler A, Roggen D, Mazza C, Shirvan J, Cedarbaum JM, Giladi N, Hausdorff JM. Digital Mobility Measures: A Window into Real-World Severity and Progression of Parkinson's Disease. Mov Disord 2024; 39:328-338. [PMID: 38151859 DOI: 10.1002/mds.29689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 11/20/2023] [Accepted: 11/27/2023] [Indexed: 12/29/2023] Open
Abstract
BACKGROUND Real-world monitoring using wearable sensors has enormous potential for assessing disease severity and symptoms among persons with Parkinson's disease (PD). Many distinct features can be extracted, reflecting multiple mobility domains. However, it is unclear which digital measures are related to PD severity and are sensitive to disease progression. OBJECTIVES The aim was to identify real-world mobility measures that reflect PD severity and show discriminant ability and sensitivity to disease progression, compared to the Movement Disorder Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) scale. METHODS Multicenter real-world continuous (24/7) digital mobility data from 587 persons with PD and 68 matched healthy controls were collected using an accelerometer adhered to the lower back. Machine learning feature selection and regression algorithms evaluated associations of the digital measures using the MDS-UPDRS (I-III). Binary logistic regression assessed discriminatory value using controls, and longitudinal observational data from a subgroup (n = 33) evaluated sensitivity to change over time. RESULTS Digital measures were only moderately correlated with the MDS-UPDRS (part II-r = 0.60 and parts I and III-r = 0.50). Most associated measures reflected activity quantity and distribution patterns. A model with 14 digital measures accurately distinguished recently diagnosed persons with PD from healthy controls (81.1%, area under the curve: 0.87); digital measures showed larger effect sizes (Cohen's d: [0.19-0.66]), for change over time than any of the MDS-UPDRS parts (Cohen's d: [0.04-0.12]). CONCLUSIONS Real-world mobility measures are moderately associated with clinical assessments, suggesting that they capture different aspects of motor capacity and function. Digital mobility measures are sensitive to early-stage disease and to disease progression, to a larger degree than conventional clinical assessments, demonstrating their utility, primarily for clinical trials but ultimately also for clinical care. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Collapse
Affiliation(s)
- Anat Mirelman
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
- Faculty of Medicine and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Jana Volkov
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
| | - Amit Salomon
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
| | - Eran Gazit
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
| | - Alice Nieuwboer
- Department of Rehabilitation Science, KU Leuven, Neuromotor Rehabilitation Research Group, Leuven, Belgium
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, United Kingdom
- National Institute for Health and Care Research (NIHR) Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Laura Avanzino
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health (DINOGMI), University of Genoa, Genoa, Italy
- Department of Experimental Medicine, Section of Human Physiology, University of Genoa, Genoa, Italy
| | - Elisa Pelosin
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health (DINOGMI), University of Genoa, Genoa, Italy
- IRCCS Policlinico San Martino Teaching Hospital, Genoa, Italy
| | - Bastiaan R Bloem
- Department of Neurology, Radboud University Medical Center, Donders Institute for Brain, Cognition and Behavior, Nijmegen, The Netherlands
| | - Ugo Della Croce
- Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - Andrea Cereatti
- Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Avner Thaler
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
- Faculty of Medicine and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | | | | | | | - Jesse M Cedarbaum
- Coeruleus Clinical Sciences, Woodbridge, Connecticut, USA
- Yale University School of Medicine, New Haven, Connecticut, USA
| | - Nir Giladi
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
- Faculty of Medicine and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Jeffrey M Hausdorff
- Laboratory for Early Markers of Neurodegeneration (LEMON), Center for the Study of Movement, Cognition and Mobility, Neurological Institute, Tel Aviv Medical Center, Tel Aviv, Israel
- Faculty of Medicine and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
- Department of Physical Therapy, Tel Aviv University, Tel Aviv, Israel
- Department of Orthopedic Surgery, Rush Alzheimer's Disease Center, Rush University Medical Center, Chicago, Illinois, USA
| |
Collapse
|