1
|
Hirten RP, Tomalin L, Danieletto M, Golden E, Zweig M, Kaur S, Helmus D, Biello A, Pyzik R, Bottinger EP, Keefer L, Charney D, Nadkarni GN, Suarez-Farinas M, Fayad ZA. Evaluation of a machine learning approach utilizing wearable data for prediction of SARS-CoV-2 infection in healthcare workers. JAMIA Open 2022; 5:ooac041. [PMID: 35677186 PMCID: PMC9129173 DOI: 10.1093/jamiaopen/ooac041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 04/28/2022] [Accepted: 05/15/2022] [Indexed: 11/16/2022] Open
Abstract
Objective To determine whether a machine learning model can detect SARS-CoV-2 infection from physiological metrics collected from wearable devices. Materials and Methods Health care workers from 7 hospitals were enrolled and prospectively followed in a multicenter observational study. Subjects downloaded a custom smart phone app and wore Apple Watches for the duration of the study period. Daily surveys related to symptoms and the diagnosis of Coronavirus Disease 2019 were answered in the app. Results We enrolled 407 participants with 49 (12%) having a positive nasal SARS-CoV-2 polymerase chain reaction test during follow-up. We examined 5 machine-learning approaches and found that gradient-boosting machines (GBM) had the most favorable validation performance. Across all testing sets, our GBM model predicted SARS-CoV-2 infection with an average area under the receiver operating characteristic (auROC) = 86.4% (confidence interval [CI] 84-89%). The model was calibrated to value sensitivity over specificity, achieving an average sensitivity of 82% (CI ±∼4%) and specificity of 77% (CI ±∼1%). The most important predictors included parameters describing the circadian heart rate variability mean (MESOR) and peak-timing (acrophase), and age. Discussion We show that a tree-based ML algorithm applied to physiological metrics passively collected from a wearable device can identify and predict SARS-CoV-2 infection. Conclusion Applying machine learning models to the passively collected physiological metrics from wearable devices may improve SARS-CoV-2 screening methods and infection tracking.
Collapse
Affiliation(s)
- Robert P Hirten
- Department of Medicine, The Dr. Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
| | - Lewis Tomalin
- Department of Population Health Science and Policy, Center for Biostatistics, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Matteo Danieletto
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Eddye Golden
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Micol Zweig
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Sparshdeep Kaur
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
| | - Drew Helmus
- Department of Medicine, The Dr. Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Anthony Biello
- Department of Medicine, The Dr. Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Renata Pyzik
- The BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Erwin P Bottinger
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
| | - Laurie Keefer
- Department of Medicine, The Dr. Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Dennis Charney
- Office of the Dean, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Nash Family Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Girish N Nadkarni
- The Hasso Plattner Institute for Digital Health at the Mount Sinai, New York, New York, USA
- The Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Mayte Suarez-Farinas
- Department of Population Health Science and Policy, Center for Biostatistics, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Zahi A Fayad
- The BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|