A machine learning approach to determine resilience utilizing wearable device data: analysis of an observational cohort

Objective

To assess whether an individual's degree of psychological resilience can be determined from physiological metrics passively collected from a wearable device.

Materials and Methods

Data were analyzed in this secondary analysis of the Warrior Watch Study dataset, a prospective cohort of healthcare workers enrolled across 7 hospitals in New York City. Subjects wore an Apple Watch for the duration of their participation. Surveys were collected measuring resilience, optimism, and emotional support at baseline.

Results

We evaluated data from 329 subjects (mean age 37.4 years, 37.1% male). Across all testing sets, gradient-boosting machines (GBM) and extreme gradient-boosting models performed best for high- versus low-resilience prediction, stratified on a median Connor-Davidson Resilience Scale-2 score of 6 (interquartile range = 5-7), with an AUC of 0.60. When predicting resilience as a continuous variable, multivariate linear models had a correlation of 0.24 (P = .029) and RMSE of 1.37 in the testing data. A positive psychological construct, comprised of resilience, optimism, and emotional support was also evaluated. The oblique random forest method performed best in estimating high- versus low-composite scores stratified on a median of 32.5, with an AUC of 0.65, a sensitivity of 0.60, and a specificity of 0.70.

Discussion

In a post hoc analysis, machine learning models applied to physiological metrics collected from wearable devices had some predictive ability in identifying resilience states and a positive psychological construct.

Conclusions

These findings support the further assessment of psychological characteristics from passively collected wearable data in dedicated studies.

A Mixed-methods Assessment of the Impact of Insurance Issues on the Emotional and Physical Health of Patients With Inflammatory Bowel Disease

BACKGROUND

In patients with inflammatory bowel disease (IBD), failure to adhere to treatment regimens due to insurance issues can lead to disease complications. Our aim was to examine patients' perceptions of the impact of insurance issues on their health.

METHODS

Twenty-nine patients with IBD at a large US academic center and an insurance issue participated in a mixed-methods study. Retrospective chart review and an online questionnaire were completed to collect demographic information, IBD characteristics, and validated resilience scores. Semistructured interviews were completed for insurance experiences, which were coded independently by 2 coders for themes.

RESULTS

Twenty-nine patients completed the interview, and 24 completed the online survey. Sixteen had Crohn's disease, 13 had ulcerative colitis, and 66% were female. The most common insurance issue was lapsed insurance. Many experienced physical consequences, with 58% having flares, 14% undergoing surgery, and 14% developing antibodies. All emotional responses were negative, with the majority feeling stressed (38%). Providers were uninformed of insurance issues in 28% of cases. When asked about perceived resilience, 41% felt incapable of managing the situation, and 45% gave up trying to solve the problem. When asked how to improve going forward, 38% requested an easily accessible advocate to guide them.

CONCLUSIONS

A large proportion of our cohort chose not to inform their provider, felt incapable of managing on their own, and gave up on resolving their insurance issue. This highlights the need to consider restructuring the insurance system, to identify those at risk for insurance issues, and to make advocates available to avoid devastating consequences.

Resilience-based Integrated IBD Care Is Associated With Reductions in Health Care Use and Opioids

BACKGROUND & AIMS

Integrated inflammatory bowel disease (IBD) care is effective but not routinely implemented. Validated methods that simultaneously address mind and body targets such as resilience may improve access and outcomes. We describe the development and implementation of the GRITT method and its impact on resilience, health care utilization (HCU), and opioid use in IBD.

METHODS

Consecutive patients from an academic IBD center were evaluated for low resilience on the basis of provider referral. Low resilience patients were invited to participate in the GRITT program. Primary outcome was % reduction in HCU. Secondary outcomes were change in resilience and corticosteroid and opioid use. Patients were allocated into 2 groups for analysis: GRITT participants (GP) and non-participants (NP). Clinical data and HCU in the year before enrollment were collected at baseline and 12 months. One-way repeated measures multivariate analysis of covariance evaluated group × time interactions for the primary outcome. Effect size was calculated for changes in resilience over time.

RESULTS

Of 456 screened IBD patients 394 were eligible, 184 GP and 210 NP. GP had greater reduction in HCU than NP: 71% reduction in emergency department visits, 94% reduction in unplanned hospitalizations. There was 49% reduction in opioid use and 73% reduction in corticosteroid use in GP. Resilience increased by 27.3 points (59%), yielding a large effect size (d = 2.4).

CONCLUSIONS

Mind-body care that focuses on building resilience in the context of IBD care may be a novel approach to reduce unplanned HCU and opioid use, but large, multicenter, randomized controlled trials are needed.

Evaluation of a machine learning approach utilizing wearable data for prediction of SARS-CoV-2 infection in healthcare workers

Objective

To determine whether a machine learning model can detect SARS-CoV-2 infection from physiological metrics collected from wearable devices.

Materials and Methods

Health care workers from 7 hospitals were enrolled and prospectively followed in a multicenter observational study. Subjects downloaded a custom smart phone app and wore Apple Watches for the duration of the study period. Daily surveys related to symptoms and the diagnosis of Coronavirus Disease 2019 were answered in the app.

Results

We enrolled 407 participants with 49 (12%) having a positive nasal SARS-CoV-2 polymerase chain reaction test during follow-up. We examined 5 machine-learning approaches and found that gradient-boosting machines (GBM) had the most favorable validation performance. Across all testing sets, our GBM model predicted SARS-CoV-2 infection with an average area under the receiver operating characteristic (auROC) = 86.4% (confidence interval [CI] 84-89%). The model was calibrated to value sensitivity over specificity, achieving an average sensitivity of 82% (CI ±∼4%) and specificity of 77% (CI ±∼1%). The most important predictors included parameters describing the circadian heart rate variability mean (MESOR) and peak-timing (acrophase), and age.

Discussion

We show that a tree-based ML algorithm applied to physiological metrics passively collected from a wearable device can identify and predict SARS-CoV-2 infection.

Conclusion

Applying machine learning models to the passively collected physiological metrics from wearable devices may improve SARS-CoV-2 screening methods and infection tracking.

Factors Associated with Longitudinal Psychological and Physiological Stress in Health Care Workers During the COVID-19 Pandemic: Observational Study Using Apple Watch Data

Background

The COVID-19 pandemic has resulted in a high degree of psychological distress among health care workers (HCWs). There is a need to characterize which HCWs are at an increased risk of developing psychological effects from the pandemic. Given the differences in the response of individuals to stress, an analysis of both the perceived and physiological consequences of stressors can provide a comprehensive evaluation of its impact.

Objective

This study aimed to determine characteristics associated with longitudinal perceived stress in HCWs and to assess whether changes in heart rate variability (HRV), a marker of autonomic nervous system function, are associated with features protective against longitudinal stress.

Methods

HCWs across 7 hospitals in New York City, NY, were prospectively followed in an ongoing observational digital study using the custom Warrior Watch Study app. Participants wore an Apple Watch for the duration of the study to measure HRV throughout the follow-up period. Surveys measuring perceived stress, resilience, emotional support, quality of life, and optimism were collected at baseline and longitudinally.

Results

A total of 361 participants (mean age 36.8, SD 10.1 years; female: n=246, 69.3%) were enrolled. Multivariate analysis found New York City’s COVID-19 case count to be associated with increased longitudinal stress (P=.008). Baseline emotional support, quality of life, and resilience were associated with decreased longitudinal stress (P<.001). A significant reduction in stress during the 4-week period after COVID-19 diagnosis was observed in the highest tertial of emotional support (P=.03) and resilience (P=.006). Participants in the highest tertial of baseline emotional support and resilience had a significantly different circadian pattern of longitudinally collected HRV compared to subjects in the low or medium tertial.

Conclusions

High resilience, emotional support, and quality of life place HCWs at reduced risk of longitudinal perceived stress and have a distinct physiological stress profile. Our findings support the use of these characteristics to identify HCWs at risk of the psychological and physiological stress effects of the pandemic.

Use of Physiological Data From a Wearable Device to Identify SARS-CoV-2 Infection and Symptoms and Predict COVID-19 Diagnosis: Observational Study

BACKGROUND

Changes in autonomic nervous system function, characterized by heart rate variability (HRV), have been associated with infection and observed prior to its clinical identification.

OBJECTIVE

We performed an evaluation of HRV collected by a wearable device to identify and predict COVID-19 and its related symptoms.

METHODS

Health care workers in the Mount Sinai Health System were prospectively followed in an ongoing observational study using the custom Warrior Watch Study app, which was downloaded to their smartphones. Participants wore an Apple Watch for the duration of the study, measuring HRV throughout the follow-up period. Surveys assessing infection and symptom-related questions were obtained daily.

RESULTS

Using a mixed-effect cosinor model, the mean amplitude of the circadian pattern of the standard deviation of the interbeat interval of normal sinus beats (SDNN), an HRV metric, differed between subjects with and without COVID-19 (P=.006). The mean amplitude of this circadian pattern differed between individuals during the 7 days before and the 7 days after a COVID-19 diagnosis compared to this metric during uninfected time periods (P=.01). Significant changes in the mean and amplitude of the circadian pattern of the SDNN was observed between the first day of reporting a COVID-19-related symptom compared to all other symptom-free days (P=.01).

CONCLUSIONS

Longitudinally collected HRV metrics from a commonly worn commercial wearable device (Apple Watch) can predict the diagnosis of COVID-19 and identify COVID-19-related symptoms. Prior to the diagnosis of COVID-19 by nasal swab polymerase chain reaction testing, significant changes in HRV were observed, demonstrating the predictive ability of this metric to identify COVID-19 infection.