1
|
Zrubka Z, Champion A, Holtorf AP, Di Bidino R, Earla JR, Boltyenkov AT, Tabata-Kelly M, Asche C, Burrell A. The PICOTS-ComTeC Framework for Defining Digital Health Interventions: An ISPOR Special Interest Group Report. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2024; 27:383-396. [PMID: 38569772 DOI: 10.1016/j.jval.2024.01.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/18/2024] [Accepted: 01/21/2024] [Indexed: 04/05/2024]
Abstract
OBJECTIVES Digital health definitions are abundant, but often lack clarity and precision. We aimed to develop a minimum information framework to define patient-facing digital health interventions (DHIs) for outcomes research. METHODS Definitions of digital-health-related terms (DHTs) were systematically reviewed, followed by a content analysis using frameworks, including PICOTS (population, intervention, comparator, outcome, timing, and setting), Shannon-Weaver Model of Communication, Agency for Healthcare Research and Quality Measures, and the World Health Organization's Classification of Digital Health Interventions. Subsequently, we conducted an online Delphi study to establish a minimum information framework, which was pilot tested by 5 experts using hypothetical examples. RESULTS After screening 2610 records and 545 full-text articles, we identified 101 unique definitions of 67 secondary DHTs in 76 articles, resulting in 95 different patterns of concepts among the definitions. World Health Organization system (84.5%), message (75.7%), intervention (58.3%), and technology (52.4%) were the most frequently covered concepts. For the Delphi survey, we invited 47 members of the ISPOR Digital Health Special Interest Group, 18 of whom became the Delphi panel. The first, second, and third survey rounds were completed by 18, 11, and 10 respondents, respectively. After consolidating results, the PICOTS-ComTeC acronym emerged, involving 9 domains (population, intervention, comparator, outcome, timing, setting, communication, technology, and context) and 32 optional subcategories. CONCLUSIONS Patient-facing DHIs can be specified using PICOTS-ComTeC that facilitates identification of appropriate interventions and comparators for a given decision. PICOTS-ComTeC is a flexible and versatile tool, intended to assist authors in designing and reporting primary studies and evidence syntheses, yielding actionable results for clinicians and other decision makers.
Collapse
Affiliation(s)
- Zsombor Zrubka
- Health Economics Research Center, University Research and Innovation Center, Óbuda University, Budapest, Hungary.
| | | | | | - Rossella Di Bidino
- Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy; The Graduate School of Health Economics and Management (ALTEMS), Rome, Italy
| | | | | | - Masami Tabata-Kelly
- The Heller School for Social Policy and Management, Brandeis University, Waltham, MA, USA
| | - Carl Asche
- Pharmacotherapy Outcomes Research Center, Department of Pharmacotherapy, College of Pharmacy, University of Utah, Salt-Lake City, UT, USA
| | | |
Collapse
|
2
|
Ilg W, Milne S, Schmitz-Hübsch T, Alcock L, Beichert L, Bertini E, Mohamed Ibrahim N, Dawes H, Gomez CM, Hanagasi H, Kinnunen KM, Minnerop M, Németh AH, Newman J, Ng YS, Rentz C, Samanci B, Shah VV, Summa S, Vasco G, McNames J, Horak FB. Quantitative Gait and Balance Outcomes for Ataxia Trials: Consensus Recommendations by the Ataxia Global Initiative Working Group on Digital-Motor Biomarkers. CEREBELLUM (LONDON, ENGLAND) 2023:10.1007/s12311-023-01625-2. [PMID: 37955812 DOI: 10.1007/s12311-023-01625-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/20/2023] [Indexed: 11/14/2023]
Abstract
With disease-modifying drugs on the horizon for degenerative ataxias, ecologically valid, finely granulated, digital health measures are highly warranted to augment clinical and patient-reported outcome measures. Gait and balance disturbances most often present as the first signs of degenerative cerebellar ataxia and are the most reported disabling features in disease progression. Thus, digital gait and balance measures constitute promising and relevant performance outcomes for clinical trials.This narrative review with embedded consensus will describe evidence for the sensitivity of digital gait and balance measures for evaluating ataxia severity and progression, propose a consensus protocol for establishing gait and balance metrics in natural history studies and clinical trials, and discuss relevant issues for their use as performance outcomes.
Collapse
Affiliation(s)
- Winfried Ilg
- Section Computational Sensomotorics, Hertie Institute for Clinical Brain Research, Otfried-Müller-Straße 25, 72076, Tübingen, Germany.
- Centre for Integrative Neuroscience (CIN), Tübingen, Germany.
| | - Sarah Milne
- Bruce Lefroy Centre for Genetic Health Research, Murdoch Children's Research Institute, Parkville, VIC, Australia
- Department of Paediatrics, Melbourne University, Melbourne, VIC, Australia
- Physiotherapy Department, Monash Health, Clayton, VIC, Australia
- School of Primary and Allied Health Care, Monash University, Frankston, VIC, Australia
| | - Tanja Schmitz-Hübsch
- Experimental and Clinical Research Center, a cooperation of Max-Delbrueck Center for Molecular Medicine and Charité, Universitätsmedizin Berlin, Berlin, Germany
- Neuroscience Clinical Research Center, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, UK
- NIHR Newcastle Biomedical Research Centre, Newcastle University, Newcastle upon Tyne, UK
| | - Lukas Beichert
- Department of Neurodegenerative Diseases and Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Enrico Bertini
- Research Unit of Neuromuscular and Neurodegenerative Disorders, Bambino Gesu' Children's Research Hospital, IRCCS, Rome, Italy
| | | | - Helen Dawes
- NIHR Exeter BRC, College of Medicine and Health, University of Exeter, Exeter, UK
| | | | - Hasmet Hanagasi
- Behavioral Neurology and Movement Disorders Unit, Department of Neurology, Istanbul Faculty of Medicine, Istanbul University, Istanbul, Turkey
| | | | - Martina Minnerop
- Institute of Neuroscience and Medicine (INM-1)), Research Centre Juelich, Juelich, Germany
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- Department of Neurology, Center for Movement Disorders and Neuromodulation, Medical Faculty & University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Andrea H Németh
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK
| | - Jane Newman
- NIHR Newcastle Biomedical Research Centre, Newcastle University, Newcastle upon Tyne, UK
- Wellcome Centre for Mitochondrial Research, Newcastle University, Newcastle upon Tyne, UK
| | - Yi Shiau Ng
- Wellcome Centre for Mitochondrial Research, Newcastle University, Newcastle upon Tyne, UK
| | - Clara Rentz
- Institute of Neuroscience and Medicine (INM-1)), Research Centre Juelich, Juelich, Germany
| | - Bedia Samanci
- Behavioral Neurology and Movement Disorders Unit, Department of Neurology, Istanbul Faculty of Medicine, Istanbul University, Istanbul, Turkey
| | - Vrutangkumar V Shah
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
- APDM Precision Motion, Clario, Portland, OR, USA
| | - Susanna Summa
- Movement Analysis and Robotics Laboratory (MARLab), Neurorehabilitation Unit, Neurological Science and Neurorehabilitation Area, Bambino Gesù Children's Hospital, IRCCS, Rome, Italy
| | - Gessica Vasco
- Movement Analysis and Robotics Laboratory (MARLab), Neurorehabilitation Unit, Neurological Science and Neurorehabilitation Area, Bambino Gesù Children's Hospital, IRCCS, Rome, Italy
| | - James McNames
- APDM Precision Motion, Clario, Portland, OR, USA
- Department of Electrical and Computer Engineering, Portland State University, Portland, OR, USA
| | - Fay B Horak
- Department of Neurology, Oregon Health & Science University, Portland, OR, USA
- APDM Precision Motion, Clario, Portland, OR, USA
| |
Collapse
|
3
|
Gasteiger N, Dowding D, Norman G, McGarrigle L, Eost-Telling C, Jones D, Vercell A, Ali SM, O'Connor S. Conducting a systematic review and evaluation of commercially available mobile applications (apps) on a health-related topic: the TECH approach and a step-by-step methodological guide. BMJ Open 2023; 13:e073283. [PMID: 37308269 PMCID: PMC10277147 DOI: 10.1136/bmjopen-2023-073283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 05/25/2023] [Indexed: 06/14/2023] Open
Abstract
OBJECTIVES To provide an overview of the methodological considerations for conducting commercial smartphone health app reviews (mHealth reviews), with the aim of systematising the process and supporting high-quality evaluations of mHealth apps. DESIGN Synthesis of our research team's experiences of conducting and publishing various reviews of mHealth apps available on app stores and hand-searching the top medical informatics journals (eg, The Lancet Digital Health, npj Digital Medicine, Journal of Biomedical Informatics and the Journal of the American Medical Informatics Association) over the last five years (2018-2022) to identify other app reviews to contribute to the discussion of this method and supporting framework for developing a research (review) question and determining the eligibility criteria. RESULTS We present seven steps to support rigour in conducting reviews of health apps available on the app market: (1) writing a research question or aims, (2) conducting scoping searches and developing the protocol, (3) determining the eligibility criteria using the TECH framework, (4) conducting the final search and screening of health apps, (5) data extraction, (6) quality, functionality and other assessments and (7) analysis and synthesis of findings. We introduce the novel TECH approach to developing review questions and the eligibility criteria, which considers the Target user, Evaluation focus, Connectedness and the Health domain. Patient and public involvement and engagement opportunities are acknowledged, including co-developing the protocol and undertaking quality or usability assessments. CONCLUSION Commercial mHealth app reviews can provide important insights into the health app market, including the availability of apps and their quality and functionality. We have outlined seven key steps for conducting rigorous health app reviews in addition to the TECH acronym, which can support researchers in writing research questions and determining the eligibility criteria. Future work will include a collaborative effort to develop reporting guidelines and a quality appraisal tool to ensure transparency and quality in systematic app reviews.
Collapse
Affiliation(s)
- Norina Gasteiger
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
- Division of Informatics, Imaging and Data Sciences, The University of Manchester, Manchester, UK
| | - Dawn Dowding
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
| | - Gill Norman
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
| | - Lisa McGarrigle
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
- Manchester Academic Health Science Centre, Manchester, UK
| | - Charlotte Eost-Telling
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
| | - Debra Jones
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
| | - Amy Vercell
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
- The Christie NHS Foundation Trust, Manchester, UK
| | - Syed Mustafa Ali
- Division of Informatics, Imaging and Data Sciences, The University of Manchester, Manchester, UK
| | - Siobhan O'Connor
- Division of Nursing, Midwifery and Social Work, The University of Manchester, Manchester, UK
| |
Collapse
|
4
|
Silberman J, Wicks P, Patel S, Sarlati S, Park S, Korolev IO, Carl JR, Owusu JT, Mishra V, Kaur M, Willey VJ, Sucala ML, Campellone TR, Geoghegan C, Rodriguez-Chavez IR, Vandendriessche B, Goldsack JC. Rigorous and rapid evidence assessment in digital health with the evidence DEFINED framework. NPJ Digit Med 2023; 6:101. [PMID: 37258851 DOI: 10.1038/s41746-023-00836-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 05/05/2023] [Indexed: 06/02/2023] Open
Abstract
Dozens of frameworks have been proposed to assess evidence for digital health interventions (DHIs), but existing frameworks may not facilitate DHI evidence reviews that meet the needs of stakeholder organizations including payers, health systems, trade organizations, and others. These organizations may benefit from a DHI assessment framework that is both rigorous and rapid. Here we propose a framework to assess Evidence in Digital health for EFfectiveness of INterventions with Evaluative Depth (Evidence DEFINED). Designed for real-world use, the Evidence DEFINED Quick Start Guide may help streamline DHI assessment. A checklist is provided summarizing high-priority evidence considerations in digital health. Evidence-to-recommendation guidelines are proposed, specifying degrees of adoption that may be appropriate for a range of evidence quality levels. Evidence DEFINED differs from prior frameworks in its inclusion of unique elements designed for rigor and speed. Rigor is increased by addressing three gaps in prior frameworks. First, prior frameworks are not adapted adequately to address evidence considerations that are unique to digital health. Second, prior frameworks do not specify evidence quality criteria requiring increased vigilance for DHIs in the current regulatory context. Third, extant frameworks rarely leverage established, robust methodologies that were developed for non-digital interventions. Speed is achieved in the Evidence DEFINED Framework through screening optimization and deprioritization of steps that may have limited value. The primary goals of Evidence DEFINED are to a) facilitate standardized, rapid, rigorous DHI evidence assessment in organizations and b) guide digital health solutions providers who wish to generate evidence that drives DHI adoption.
Collapse
Affiliation(s)
- Jordan Silberman
- Office of Medical Policy and Technology Assessment, Elevance Health, Palo Alto, CA, USA.
| | | | - Smit Patel
- Digital Medicine Society, Boston, MA, USA
| | - Siavash Sarlati
- Office of Medical Policy and Technology Assessment, Elevance Health, Palo Alto, CA, USA
- Department of Emergency Medicine, School of Medicine, University of California, San Francisco, CA, USA
| | - Siyeon Park
- Geisinger Health System, Danville, PA, USA
- Pharmesol, Inc., Newton, MA, USA
| | | | | | | | - Vimal Mishra
- Department of Medicine and Health Administration, Virginia Commonwealth University, Richmond, VA, USA
- UC Davis Health, Sacramento, CA, USA
| | - Manpreet Kaur
- Office of Medical Policy and Technology Assessment, Elevance Health, Palo Alto, CA, USA
| | | | | | | | - Cindy Geoghegan
- Digital Medicine Society, Boston, MA, USA
- Patients and Partners, LLC, Madison, CT, USA
| | | | - Benjamin Vandendriessche
- Department of Electrical, Computer and Systems Engineering, Case Western Reserve University, Cleveland, OH, USA
- Byteflies, Antwerp, Belgium
| | | |
Collapse
|
5
|
Debelle H, Packer E, Beales E, Bailey HGB, Mc Ardle R, Brown P, Hunter H, Ciravegna F, Ireson N, Evers J, Niessen M, Shi JQ, Yarnall AJ, Rochester L, Alcock L, Del Din S. Feasibility and usability of a digital health technology system to monitor mobility and assess medication adherence in mild-to-moderate Parkinson's disease. Front Neurol 2023; 14:1111260. [PMID: 37006505 PMCID: PMC10050691 DOI: 10.3389/fneur.2023.1111260] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 02/20/2023] [Indexed: 03/17/2023] Open
Abstract
IntroductionParkinson's disease (PD) is a neurodegenerative disorder which requires complex medication regimens to mitigate motor symptoms. The use of digital health technology systems (DHTSs) to collect mobility and medication data provides an opportunity to objectively quantify the effect of medication on motor performance during day-to-day activities. This insight could inform clinical decision-making, personalise care, and aid self-management. This study investigates the feasibility and usability of a multi-component DHTS to remotely assess self-reported medication adherence and monitor mobility in people with Parkinson's (PwP).MethodsThirty participants with PD [Hoehn and Yahr stage I (n = 1) and II (n = 29)] were recruited for this cross-sectional study. Participants were required to wear, and where appropriate, interact with a DHTS (smartwatch, inertial measurement unit, and smartphone) for seven consecutive days to assess medication adherence and monitor digital mobility outcomes and contextual factors. Participants reported their daily motor complications [motor fluctuations and dyskinesias (i.e., involuntary movements)] in a diary. Following the monitoring period, participants completed a questionnaire to gauge the usability of the DHTS. Feasibility was assessed through the percentage of data collected, and usability through analysis of qualitative questionnaire feedback.ResultsAdherence to each device exceeded 70% and ranged from 73 to 97%. Overall, the DHTS was well tolerated with 17/30 participants giving a score > 75% [average score for these participants = 89%, from 0 (worst) to 100 (best)] for its usability. Usability of the DHTS was significantly associated with age (ρ = −0.560, BCa 95% CI [−0.791, −0.207]). This study identified means to improve usability of the DHTS by addressing technical and design issues of the smartwatch. Feasibility, usability and acceptability were identified as key themes from PwP qualitative feedback on the DHTS.ConclusionThis study highlighted the feasibility and usability of our integrated DHTS to remotely assess medication adherence and monitor mobility in people with mild-to-moderate Parkinson's disease. Further work is necessary to determine whether this DHTS can be implemented for clinical decision-making to optimise management of PwP.
Collapse
Affiliation(s)
- Héloïse Debelle
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Emma Packer
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Esther Beales
- Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Harry G. B. Bailey
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Ríona Mc Ardle
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR), Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Philip Brown
- The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Heather Hunter
- The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Fabio Ciravegna
- Department of Computer Science and INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, United Kingdom
- Dipartimento di Informatica, Università di Torino, Turin, Italy
| | - Neil Ireson
- Department of Computer Science and INSIGNEO Institute for in silico Medicine, The University of Sheffield, Sheffield, United Kingdom
| | | | | | - Jian Qing Shi
- Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen, China
| | - Alison J. Yarnall
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR), Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
- The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Lynn Rochester
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR), Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
- The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Lisa Alcock
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR), Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
| | - Silvia Del Din
- Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle upon Tyne, United Kingdom
- National Institute for Health and Care Research (NIHR), Newcastle Biomedical Research Centre (BRC), Newcastle University and The Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, United Kingdom
- *Correspondence: Silvia Del Din
| |
Collapse
|
6
|
Functional and Symptomatic Clinical Trial Endpoints: The HFC-ARC Scientific Expert Panel. JACC. HEART FAILURE 2022; 10:889-901. [PMID: 36456063 DOI: 10.1016/j.jchf.2022.09.012] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 09/09/2022] [Accepted: 09/18/2022] [Indexed: 11/11/2022]
Abstract
The Heart Failure Academic Research Consortium is a partnership between the Heart Failure Collaboratory (HFC) and the Academic Research Consortium (ARC) composed of patients, academic investigators from the United States and Europe, the U.S. Food and Drug Administration, the National Institutes of Health, payers, and industry. Members discussed the measure, remote capture, and clinical utility of functional and quality-of-life endpoints for use in clinical trials of heart failure and cardiovascular therapeutics, with the goal of improving the efficiency of heart failure and cardiovascular clinical research, evidence generation, and thereby patient quality of life, functional status, and survival. Assessments of patient-reported outcomes and maximal and submaximal exercise tolerance are standardized and validated, but actigraphy remains inconsistent as a potential endpoint. This paper details those discussions and consensus recommendations.
Collapse
|
7
|
Guo CC, Chiesa PA, de Moor C, Fazeli MS, Schofield T, Hofer K, Belachew S, Scotland A. Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review. J Med Internet Res 2022; 24:e37683. [DOI: 10.2196/37683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 07/18/2022] [Accepted: 10/11/2022] [Indexed: 11/22/2022] Open
Abstract
Background
With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.
Objective
We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.
Methods
A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.
Results
A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).
Conclusions
Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.
Collapse
|
8
|
Oesterle TS, Karpyak VM, Coombes BJ, Athreya AP, Breitinger SA, Correa da Costa S, Dana Gerberi DJ. Systematic review: Wearable remote monitoring to detect nonalcohol/nonnicotine-related substance use disorder symptoms. Am J Addict 2022; 31:535-545. [PMID: 36062888 DOI: 10.1111/ajad.13341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 08/15/2022] [Accepted: 08/22/2022] [Indexed: 01/31/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Substance use disorders (SUDs) are chronic relapsing diseases characterized by significant morbidity and mortality. Phenomenologically, patients with SUDs present with a repeating cycle of intoxication, withdrawal, and craving, significantly impacting their diagnosis and treatment. There is a need for better identification and monitoring of these disease states. Remote monitoring chronic illness with wearable devices offers a passive, unobtrusive, constant physiological data assessment. We evaluate the current evidence base for remote monitoring of nonalcohol, nonnicotine SUDs. METHODS We performed a systematic, comprehensive literature review and screened 1942 papers. RESULTS We found 15 studies that focused mainly on the intoxication stage of SUD. These studies used wearable sensors measuring several physiological parameters (ECG, HR, O2 , Accelerometer, EDA, temperature) and implemented study-specific algorithms to evaluate the data. DISCUSSION AND CONCLUSIONS Studies were extracted, organized, and analyzed based on the three SUD disease states. The sample sizes were relatively small, focused primarily on the intoxication stage, had low monitoring compliance, and required significant computational power preventing "real-time" results. Cardiovascular data was the most consistently valuable data in the predictive algorithms. This review demonstrates that there is currently insufficient evidence to support remote monitoring of SUDs through wearable devices. SCIENTIFIC SIGNIFICANCE This is the first systematic review to show the available data on wearable remote monitoring of SUD symptoms in each stage of the disease cycle. This clinically relevant approach demonstrates what we know and do not know about the remote monitoring of SUDs within disease states.
Collapse
Affiliation(s)
- Tyler S Oesterle
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, USA
| | - Victor M Karpyak
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, USA
| | - Brandon J Coombes
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA
| | - Arjun P Athreya
- Department of Molecular Pharmacology and Experimental Therapeutics, Mayo Clinic, Rochester, Minnesota, USA
| | - Scott A Breitinger
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota, USA
| | | | | |
Collapse
|
9
|
Obasa AJ, Akinradewo OF, Olanipekun AO. Impact of technologies towards addressing stress-related problems among practicing quantity surveyors in Lagos, Nigeria. INTERNATIONAL JOURNAL OF CONSTRUCTION MANAGEMENT 2022. [DOI: 10.1080/15623599.2022.2135943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Ayotomide James Obasa
- Department of Quantity Surveying, Federal University of Technology Akure, Akure, Nigeria
| | | | | |
Collapse
|
10
|
Ratitch B, Rodriguez-Chavez IR, Dabral A, Fontanari A, Vega J, Onorati F, Vandendriessche B, Morton S, Damestani Y. Considerations for Analyzing and Interpreting Data from Biometric Monitoring Technologies in Clinical Trials. Digit Biomark 2022; 6:83-97. [PMID: 36466953 PMCID: PMC9716191 DOI: 10.1159/000525897] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/31/2022] [Indexed: 01/05/2024] Open
Abstract
BACKGROUND The proliferation and increasing maturity of biometric monitoring technologies allow clinical investigators to measure the health status of trial participants in a more holistic manner, especially outside of traditional clinical settings. This includes capturing meaningful aspects of health in daily living and a more granular and objective manner compared to traditional tools in clinical settings. SUMMARY Within multidisciplinary teams, statisticians and data scientists are increasingly involved in clinical trials that incorporate digital clinical measures. They are called upon to provide input into trial planning, generation of evidence on the clinical validity of novel clinical measures, and evaluation of the adequacy of existing evidence. Analysis objectives related to demonstrating clinical validity of novel clinical measures differ from typical objectives related to demonstrating safety and efficacy of therapeutic interventions using established measures which statisticians are most familiar with. KEY MESSAGES This paper discusses key considerations for generating evidence for clinical validity through the lens of the type and intended use of a clinical measure. This paper also briefly discusses the regulatory pathways through which clinical validity evidence may be reviewed and highlights challenges that investigators may encounter while dealing with data from biometric monitoring technologies.
Collapse
Affiliation(s)
- Bohdana Ratitch
- Statistics and Data Insights, Bayer, Westmount, Québec, Canada
| | - Isaac R. Rodriguez-Chavez
- Strategy Center for Decentralized Clinical Trials and Digital Medicine, Drug Development Solutions, ICON plc, Blue Bell, Pennsylvania, USA
| | - Abhishek Dabral
- Global Development Operations, Amgen Inc., Thousand Oaks, California, USA
| | | | - Julio Vega
- Department of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Francesco Onorati
- Applied Data Science, Current Health, A Best Buy Health Company, Boston, Massachusetts, USA
| | - Benjamin Vandendriessche
- Byteflies, Antwerp, Belgium & Department of Electrical, Computer and Systems Engineering, Case Western Reserve University, Cleveland, Ohio, USA
| | - Stuart Morton
- Emerging Digital Medicines, Eli Lilly & Co., Indianapolis, Indiana, USA
| | - Yasaman Damestani
- Digital Medicine, Karyopharm Therapeutics, Newton, Massachusetts, USA
| |
Collapse
|
11
|
Demanuele C, Lokker C, Jhaveri K, Georgiev P, Sezgin E, Geoghegan C, Zou KH, Izmailova E, McCarthy M. Considerations for Conducting Bring Your Own “Device” (BYOD) Clinical Studies. Digit Biomark 2022; 6:47-60. [PMID: 35949223 PMCID: PMC9294934 DOI: 10.1159/000525080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 04/07/2022] [Indexed: 12/21/2022] Open
Abstract
Background Digital health technologies are attracting attention as novel tools for data collection in clinical research. They present alternative methods compared to in-clinic data collection, which often yields snapshots of the participants' physiology, behavior, and function that may be prone to biases and artifacts, e.g., white coat hypertension, and not representative of the data in free-living conditions. Modern digital health technologies equipped with multi-modal sensors combine different data streams to derive comprehensive endpoints that are important to study participants and are clinically meaningful. Used for data collection in clinical trials, they can be deployed as provisioned products where technology is given at study start or in a bring your own “device” (BYOD) manner where participants use their technologies to generate study data. Summary The BYOD option has the potential to be more user-friendly, allowing participants to use technologies that they are familiar with, ensuring better participant compliance, and potentially reducing the bias that comes with introducing new technologies. However, this approach presents different technical, operational, regulatory, and ethical challenges to study teams. For example, BYOD data can be more heterogeneous, and recruiting historically underrepresented populations with limited access to technology and the internet can be challenging. Despite the rapid increase in digital health technologies for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving. Key Messages We offer considerations for academic researchers, drug developers, and patient advocacy organizations on the design and deployment of BYOD models in clinical research. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; (5) statistical considerations to meet regulatory requirements. We believe that this article acts as a primer, providing insights into study design and operational requirements to ensure the successful implementation of BYOD clinical studies.
Collapse
Affiliation(s)
| | | | - Krishna Jhaveri
- Philips Sleep and Respiratory Care, Monroeville, Pennsylvania, USA
| | | | - Emre Sezgin
- The Abigail Wexner Research Institute, Nationwide Children's Hospital, Columbus, Ohio, USA
| | | | - Kelly H. Zou
- Global Medical Analytics and Real-World Evidence, Viatris Inc, Canonsburg, Pennsylvania, USA
| | | | | |
Collapse
|
12
|
Olaye IM, Belovsky MP, Bataille L, Cheng R, Ciger A, Fortuna KL, Izmailova ES, McCall D, Miller CJ, Muehlhausen W, Northcott CA, Rodriguez-Chavez IR, Pratap A, Vandendriessche B, Zisman-Ilani Y, Bakker JP. Recommendations for Defining and Reporting Adherence Measured by Biometric Monitoring Technologies: Systematic Review. J Med Internet Res 2022; 24:e33537. [PMID: 35436221 PMCID: PMC9052021 DOI: 10.2196/33537] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2021] [Revised: 11/03/2021] [Accepted: 01/14/2022] [Indexed: 11/13/2022] Open
Abstract
Background Suboptimal adherence to data collection procedures or a study intervention is often the cause of a failed clinical trial. Data from connected sensors, including wearables, referred to here as biometric monitoring technologies (BioMeTs), are capable of capturing adherence to both digital therapeutics and digital data collection procedures, thereby providing the opportunity to identify the determinants of adherence and thereafter, methods to maximize adherence. Objective We aim to describe the methods and definitions by which adherence has been captured and reported using BioMeTs in recent years. Identifying key gaps allowed us to make recommendations regarding minimum reporting requirements and consistency of definitions for BioMeT-based adherence data. Methods We conducted a systematic review of studies published between 2014 and 2019, which deployed a BioMeT outside the clinical or laboratory setting for which a quantitative, nonsurrogate, sensor-based measurement of adherence was reported. After systematically screening the manuscripts for eligibility, we extracted details regarding study design, participants, the BioMeT or BioMeTs used, and the definition and units of adherence. The primary definitions of adherence were categorized as a continuous variable based on duration (highest resolution), a continuous variable based on the number of measurements completed, or a categorical variable (lowest resolution). Results Our PubMed search terms identified 940 manuscripts; 100 (10.6%) met our eligibility criteria and contained descriptions of 110 BioMeTs. During literature screening, we found that 30% (53/177) of the studies that used a BioMeT outside of the clinical or laboratory setting failed to report a sensor-based, nonsurrogate, quantitative measurement of adherence. We identified 37 unique definitions of adherence reported for the 110 BioMeTs and observed that uniformity of adherence definitions was associated with the resolution of the data reported. When adherence was reported as a continuous time-based variable, the same definition of adherence was adopted for 92% (46/50) of the tools. However, when adherence data were simplified to a categorical variable, we observed 25 unique definitions of adherence reported for 37 tools. Conclusions We recommend that quantitative, nonsurrogate, sensor-based adherence data be reported for all BioMeTs when feasible; a clear description of the sensor or sensors used to capture adherence data, the algorithm or algorithms that convert sample-level measurements to a metric of adherence, and the analytic validation data demonstrating that BioMeT-generated adherence is an accurate and reliable measurement of actual use be provided when available; and primary adherence data be reported as a continuous variable followed by categorical definitions if needed, and that the categories adopted are supported by clinical validation data and/or consistent with previous reports.
Collapse
Affiliation(s)
- Iredia M Olaye
- Department of Medicine Division of Clinical Epidemiology and Evaluative Sciences Research, Weill Cornell Medical College Cornell University, New York, NY, United States
| | - Mia P Belovsky
- Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA, United States
| | - Lauren Bataille
- Novartis Pharmaceuticals Corporation, East Hanover, NJ, United States
| | - Royce Cheng
- Health Platforms, Verily Life Sciences, Cambridge, MA, United States
| | | | - Karen L Fortuna
- Giesel School of Medicine at Dartmouth College, Hanover, NH, United States
| | | | | | | | | | | | | | - Abhishek Pratap
- CAMH Krembil Center for Neuroinformatics, Toronto, ON, Canada
- Vector Institute, Toronto, ON, Canada
- Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States
- Institute of Psychiatry, Psychology, and Neuroscience, Kings College London, London, United Kingdom
| | - Benjamin Vandendriessche
- Byteflies, Antwerp, Belgium
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH, United States
| | - Yaara Zisman-Ilani
- Department of Social and Behavioral Sciences; College of Public Health, Temple University, Philadelphia, PA, United States
| | | |
Collapse
|
13
|
Garro F, Chiappalone M, Buccelli S, De Michieli L, Semprini M. Neuromechanical Biomarkers for Robotic Neurorehabilitation. Front Neurorobot 2021; 15:742163. [PMID: 34776920 PMCID: PMC8579108 DOI: 10.3389/fnbot.2021.742163] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 09/22/2021] [Indexed: 02/06/2023] Open
Abstract
One of the current challenges for translational rehabilitation research is to develop the strategies to deliver accurate evaluation, prediction, patient selection, and decision-making in the clinical practice. In this regard, the robot-assisted interventions have gained popularity as they can provide the objective and quantifiable assessment of the motor performance by taking the kinematics parameters into the account. Neurophysiological parameters have also been proposed for this purpose due to the novel advances in the non-invasive signal processing techniques. In addition, other parameters linked to the motor learning and brain plasticity occurring during the rehabilitation have been explored, looking for a more holistic rehabilitation approach. However, the majority of the research done in this area is still exploratory. These parameters have shown the capability to become the “biomarkers” that are defined as the quantifiable indicators of the physiological/pathological processes and the responses to the therapeutical interventions. In this view, they could be finally used for enhancing the robot-assisted treatments. While the research on the biomarkers has been growing in the last years, there is a current need for a better comprehension and quantification of the neuromechanical processes involved in the rehabilitation. In particular, there is a lack of operationalization of the potential neuromechanical biomarkers into the clinical algorithms. In this scenario, a new framework called the “Rehabilomics” has been proposed to account for the rehabilitation research that exploits the biomarkers in its design. This study provides an overview of the state-of-the-art of the biomarkers related to the robotic neurorehabilitation, focusing on the translational studies, and underlying the need to create the comprehensive approaches that have the potential to take the research on the biomarkers into the clinical practice. We then summarize some promising biomarkers that are being under investigation in the current literature and provide some examples of their current and/or potential applications in the neurorehabilitation. Finally, we outline the main challenges and future directions in the field, briefly discussing their potential evolution and prospective.
Collapse
Affiliation(s)
- Florencia Garro
- Rehab Technologies, Istituto Italiano di Tecnologia, Genoa, Italy.,Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Michela Chiappalone
- Rehab Technologies, Istituto Italiano di Tecnologia, Genoa, Italy.,Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Stefano Buccelli
- Rehab Technologies, Istituto Italiano di Tecnologia, Genoa, Italy
| | | | | |
Collapse
|
14
|
Multimodal biometric monitoring technologies drive the development of clinical assessments in the home environment. Maturitas 2021; 151:41-47. [PMID: 34446278 DOI: 10.1016/j.maturitas.2021.06.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2021] [Revised: 06/15/2021] [Accepted: 06/22/2021] [Indexed: 01/23/2023]
Abstract
Biometric monitoring technologies (BioMeTs) have attracted the attention of the health care community because of their user-friendly form factor and multi-sensor data-collection capabilities. The potential benefits of remote monitoring for collecting comprehensive, longitudinal, and contextual datasets span therapeutic areas, and both chronic and acute disease settings. Importantly, multimodal BioMeTs unlock the ability to generate rich contextual data to augment digital measures. Currently, the availability of devices is no longer the main factor limiting adoption but rather the ability to integrate fit-for-purpose BioMeTs reliably and safely into clinical care. We provide a critical review of the state of art for multimodal BioMeTs in clinical care and identify three unmet clinical needs: 1) expand the abilities of existing ambulatory unimodal BioMeTs; 2) adapt standardized clinical test protocols ("spot checks'') for use under free living conditions; and 3) develop novel applications to manage rehabilitation and chronic diseases. As the field is still in an early and quickly evolving state, we make practical recommendations: 1) to select appropriate BioMeTs; 2) to develop composite digital measures; and 3) to design interoperable software to ingest, process, delegate, and visualize the data when deploying novel clinical applications. Multimodal BioMeTs will drive the evolution from in-clinic assessments to at-home data collection with a focus on prevention, personalization, and long-term outcomes by empowering health care providers with knowledge, delivering convenience, and an improved standard of care to patients.
Collapse
|