1
|
Cohen A, Naslund J, Lane E, Bhan A, Rozatkar A, Mehta UM, Vaidyam A, Byun AJS, Barnett I, Torous J. Digital phenotyping data and anomaly detection methods to assess changes in mood and anxiety symptoms across a transdiagnostic clinical sample. Acta Psychiatr Scand 2024. [PMID: 38807465 DOI: 10.1111/acps.13712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 04/14/2024] [Accepted: 05/16/2024] [Indexed: 05/30/2024]
Abstract
INTRODUCTION Clinical assessment of mood and anxiety change often relies on clinical assessment or self-reported scales. Using smartphone digital phenotyping data and resulting markers of behavior (e.g., sleep) to augment clinical symptom scores offers a scalable and potentially more valid method to understand changes in patients' state. This paper explores the potential of using a combination of active and passive sensors in the context of smartphone-based digital phenotyping to assess mood and anxiety changes in two distinct cohorts of patients to assess the preliminary reliability and validity of this digital phenotyping method. METHODS Participants from two different cohorts, each n = 76, one with diagnoses of depression/anxiety and the other schizophrenia, utilized mindLAMP to collect active data (e.g., surveys on mood/anxiety), along with passive data consisting of smartphone digital phenotyping data (geolocation, accelerometer, and screen state) for at least 1 month. Using anomaly detection algorithms, we assessed if statistical anomalies in the combination of active and passive data could predict changes in mood/anxiety scores as measured via smartphone surveys. RESULTS The anomaly detection model was reliably able to predict symptom change of 4 points or greater for depression as measured by the PHQ-9 and anxiety as measured for the GAD-8 for both patient populations, with an area under the ROC curve of 0.65 and 0.80 for each respectively. For both PHQ-9 and GAD-7, these AUCs were maintained when predicting significant symptom change at least 7 days in advance. Active data alone predicted around 52% and 75% of the symptom variability for the depression/anxiety and schizophrenia populations respectively. CONCLUSION These results indicate the feasibility of anomaly detection for predicting symptom change in transdiagnostic cohorts. These results across different patient groups, different countries, and different sites (India and the US) suggest anomaly detection of smartphone digital phenotyping data may offer a reliable and valid approach to predicting symptom change. Future work should emphasize prospective application of these statistical methods.
Collapse
Affiliation(s)
- Asher Cohen
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - John Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Erlend Lane
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | | | - Abhijit Rozatkar
- Department of Psychiatry, AIIMS Bhopal, All India Institute of Medical Sciences Bhopal, Bhopal, India
| | - Urvakhsh Meherwan Mehta
- Department of Psychiatry, National Institute of Mental Health and Neurosciences, Bengaluru, India
- National Institute of Advanced Studies, Bangalore, India
| | - Aditya Vaidyam
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Andrew Jin Soo Byun
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| | - Ian Barnett
- Department of Biostatistics, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania, USA
| | - John Torous
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
2
|
Macias Alonso AK, Hirt J, Woelfle T, Janiaud P, Hemkens LG. Definitions of digital biomarkers: a systematic mapping of the biomedical literature. BMJ Health Care Inform 2024; 31:e100914. [PMID: 38589213 PMCID: PMC11015196 DOI: 10.1136/bmjhci-2023-100914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 03/06/2024] [Indexed: 04/10/2024] Open
Abstract
BACKGROUND Technological devices such as smartphones, wearables and virtual assistants enable health data collection, serving as digital alternatives to conventional biomarkers. We aimed to provide a systematic overview of emerging literature on 'digital biomarkers,' covering definitions, features and citations in biomedical research. METHODS We analysed all articles in PubMed that used 'digital biomarker(s)' in title or abstract, considering any study involving humans and any review, editorial, perspective or opinion-based articles up to 8 March 2023. We systematically extracted characteristics of publications and research studies, and any definitions and features of 'digital biomarkers' mentioned. We described the most influential literature on digital biomarkers and their definitions using thematic categorisations of definitions considering the Food and Drug Administration Biomarkers, EndpointS and other Tools framework (ie, data type, data collection method, purpose of biomarker), analysing structural similarity of definitions by performing text and citation analyses. RESULTS We identified 415 articles using 'digital biomarker' between 2014 and 2023 (median 2021). The majority (283 articles; 68%) were primary research. Notably, 287 articles (69%) did not provide a definition of digital biomarkers. Among the 128 articles with definitions, there were 127 different ones. Of these, 78 considered data collection, 56 data type, 50 purpose and 23 included all three components. Those 128 articles with a definition had a median of 6 citations, with the top 10 each presenting distinct definitions. CONCLUSIONS The definitions of digital biomarkers vary significantly, indicating a lack of consensus in this emerging field. Our overview highlights key defining characteristics, which could guide the development of a more harmonised accepted definition.
Collapse
Affiliation(s)
- Ana Karen Macias Alonso
- Department of Applied Natural Sciences, Technische Hochschule Lübeck, Lübeck, Germany
- Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
| | - Julian Hirt
- Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Health, Eastern Switzerland University of Applied Sciences, St.Gallen, Switzerland
| | - Tim Woelfle
- Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Neurology and MS Center, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Perrine Janiaud
- Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
| | - Lars G Hemkens
- Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel, Basel, Switzerland
- Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
- Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, USA
- Meta-Research Innovation Center Berlin (METRIC-B), Berlin Institute of Health, Berlin, Germany
| |
Collapse
|
3
|
Srimokla O, Pan-Ngum W, Khamsiriwatchara A, Padungtod C, Tipmontree R, Choosri N, Saralamba S. Early warning systems for malaria outbreaks in Thailand: an anomaly detection approach. Malar J 2024; 23:11. [PMID: 38191421 PMCID: PMC10775623 DOI: 10.1186/s12936-024-04837-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 01/03/2024] [Indexed: 01/10/2024] Open
Abstract
BACKGROUND Malaria continues to pose a significant health threat. Rapid identification of malaria infections and the deployment of active surveillance tools are crucial for achieving malaria elimination in regions where malaria is endemic, such as certain areas of Thailand. In this study, an anomaly detection system is introduced as an early warning mechanism for potential malaria outbreaks in countries like Thailand. METHODS Unsupervised clustering-based, and time series-based anomaly detection algorithms are developed and compared to identify abnormal malaria activity in Thailand. Additionally, a user interface tailored for anomaly detection is designed, enabling the Thai malaria surveillance team to utilize these algorithms and visualize regions exhibiting unusual malaria patterns. RESULTS Nine distinct anomaly detection algorithms we developed. Their efficacy in pinpointing verified outbreaks was assessed using malaria case data from Thailand spanning 2012 to 2022. The historical average threshold-based anomaly detection method triggered three times fewer alerts, while correctly identifying the same number of verified outbreaks when compared to the current method used in Thailand. A limitation of this analysis is the small number of verified outbreaks; further consultation with the Division of Vector Borne Disease could help identify more verified outbreaks. The developed dashboard, designed specifically for anomaly detection, allows disease surveillance professionals to easily identify and visualize unusual malaria activity at a provincial level across Thailand. CONCLUSION An enhanced early warning system is proposed to bolster malaria elimination efforts for countries with a similar malaria profile to Thailand. The developed anomaly detection algorithms, after thorough comparison, have been optimized for integration with the current malaria surveillance infrastructure. An anomaly detection dashboard for Thailand is built and supports early detection of abnormal malaria activity. In summary, the proposed early warning system enhances the identification process for provinces at risk of outbreaks and offers easy integration with Thailand's established malaria surveillance framework.
Collapse
Affiliation(s)
- Oraya Srimokla
- Nuffield Department of Medicine, University of Oxford, Broad St, Oxford, OX13AZ, UK
| | - Wirichada Pan-Ngum
- Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Ratchawithi Rd, Bangkok, 10400, Thailand
- Department of Tropical Hygiene, Faculty of Tropical Medicine, Mahidol University, Ratchawithi Rd, Bangkok, 10400, Thailand
| | - Amnat Khamsiriwatchara
- Center of Excellence for Biomedical and Public Health Informatics, Faculty of Tropical Medicine, Mahidol University, Ratchawithi Rd, Bangkok, 10400, Thailand
| | - Chantana Padungtod
- Division of Vector Borne Diseases, Department of Disease Control, Ministry of Public Health, Talat Kwan, Bangkok, Nonthaburi, 11000, Thailand
| | - Rungrawee Tipmontree
- Division of Vector Borne Diseases, Department of Disease Control, Ministry of Public Health, Talat Kwan, Bangkok, Nonthaburi, 11000, Thailand
| | - Noppon Choosri
- College of Arts, Media and Technology, Chiang Mai University, Sukhothai 5 Alley, Mueang Chiang Mai, Chiang Mai, 50200, Thailand
| | - Sompob Saralamba
- Mahidol Oxford Tropical Medicine Research Unit, Faculty of Tropical Medicine, Mahidol University, Ratchawithi Rd, Bangkok, 10400, Thailand.
| |
Collapse
|
4
|
Newby D, Orgeta V, Marshall CR, Lourida I, Albertyn CP, Tamburin S, Raymont V, Veldsman M, Koychev I, Bauermeister S, Weisman D, Foote IF, Bucholc M, Leist AK, Tang EYH, Tai XY, Llewellyn DJ, Ranson JM. Artificial intelligence for dementia prevention. Alzheimers Dement 2023; 19:5952-5969. [PMID: 37837420 PMCID: PMC10843720 DOI: 10.1002/alz.13463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 08/01/2023] [Accepted: 08/07/2023] [Indexed: 10/16/2023]
Abstract
INTRODUCTION A wide range of modifiable risk factors for dementia have been identified. Considerable debate remains about these risk factors, possible interactions between them or with genetic risk, and causality, and how they can help in clinical trial recruitment and drug development. Artificial intelligence (AI) and machine learning (ML) may refine understanding. METHODS ML approaches are being developed in dementia prevention. We discuss exemplar uses and evaluate the current applications and limitations in the dementia prevention field. RESULTS Risk-profiling tools may help identify high-risk populations for clinical trials; however, their performance needs improvement. New risk-profiling and trial-recruitment tools underpinned by ML models may be effective in reducing costs and improving future trials. ML can inform drug-repurposing efforts and prioritization of disease-modifying therapeutics. DISCUSSION ML is not yet widely used but has considerable potential to enhance precision in dementia prevention. HIGHLIGHTS Artificial intelligence (AI) is not widely used in the dementia prevention field. Risk-profiling tools are not used in clinical practice. Causal insights are needed to understand risk factors over the lifespan. AI will help personalize risk-management tools for dementia prevention. AI could target specific patient groups that will benefit most for clinical trials.
Collapse
Affiliation(s)
- Danielle Newby
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
| | - Vasiliki Orgeta
- Division of Psychiatry, University College London, London, W1T 7BN, UK
| | - Charles R Marshall
- Preventive Neurology Unit, Wolfson Institute of Population Health, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, E1 4NS, UK
- Department of Neurology, Royal London Hospital, London, E1 1BB, UK
| | - Ilianna Lourida
- Population Health Sciences Institute, Newcastle University, Newcastle, NE2 4AX, UK
- University of Exeter Medical School, Exeter, EX1 2HZ, UK
| | - Christopher P Albertyn
- Department of Old Age Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, SE5 8AF, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, 37129, Italy
| | - Vanessa Raymont
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
| | - Michele Veldsman
- Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, OX3 9DU, UK
- Department of Experimental Psychology, University of Oxford, Oxford, OX2 6GG, UK
| | - Ivan Koychev
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
| | - Sarah Bauermeister
- University of Oxford, Department of Psychiatry, Warneford Hospital, Oxford, OX3 7JX, UK
| | - David Weisman
- Abington Neurological Associates, Abington, PA 19001, USA
| | - Isabelle F Foote
- Preventive Neurology Unit, Wolfson Institute of Population Health, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, E1 4NS, UK
- Institute for Behavioral Genetics, University of Colorado Boulder, Boulder, CO 80309, USA
| | - Magda Bucholc
- Cognitive Analytics Research Lab, School of Computing, Engineering & Intelligent Systems, Ulster University, Derry, BT48 7JL, UK
| | - Anja K Leist
- Institute for Research on Socio-Economic Inequality (IRSEI), Department of Social Sciences, University of Luxembourg, L-4365, Luxembourg
| | - Eugene Y H Tang
- Population Health Sciences Institute, Newcastle University, Newcastle, NE2 4AX, UK
| | - Xin You Tai
- Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford, OX3 9DU, UK
- Division of Clinical Neurology, John Radcliffe Hospital, Oxford University Hospitals Trust, Oxford, OX3 9DU, UK
| | | | - David J. Llewellyn
- University of Exeter Medical School, Exeter, EX1 2HZ, UK
- The Alan Turing Institute, London, NW1 2DB, UK
| | | |
Collapse
|