Can we trust the oxygen saturation measured by consumer smartwatches?

State of the science and recommendations for using wearable technology in sleep and circadian research

Wearable sleep-tracking technology is of growing use in the sleep and circadian fields, including for applications across other disciplines, inclusive of a variety of disease states. Patients increasingly present sleep data derived from their wearable devices to their providers and the ever-increasing availability of commercial devices and new-generation research/clinical tools has led to the wide adoption of wearables in research, which has become even more relevant given the discontinuation of the Philips Respironics Actiwatch. Standards for evaluating the performance of wearable sleep-tracking devices have been introduced and the available evidence suggests that consumer-grade devices exceed the performance of traditional actigraphy in assessing sleep as defined by polysomnogram. However, clear limitations exist, for example, the misclassification of wakefulness during the sleep period, problems with sleep tracking outside of the main sleep bout or nighttime period, artifacts, and unclear translation of performance to individuals with certain characteristics or comorbidities. This is of particular relevance when person-specific factors (like skin color or obesity) negatively impact sensor performance with the potential downstream impact of augmenting already existing healthcare disparities. However, wearable sleep-tracking technology holds great promise for our field, given features distinct from traditional actigraphy such as measurement of autonomic parameters, estimation of circadian features, and the potential to integrate other self-reported, objective, and passively recorded health indicators. Scientists face numerous decision points and barriers when incorporating traditional actigraphy, consumer-grade multi-sensor devices, or contemporary research/clinical-grade sleep trackers into their research. Considerations include wearable device capabilities and performance, target population and goals of the study, wearable device outputs and availability of raw and aggregate data, and data extraction, processing, and analysis. Given the difficulties in the implementation and utilization of wearable sleep-tracking technology in real-world research and clinical settings, the following State of the Science review requested by the Sleep Research Society aims to address the following questions. What data can wearable sleep-tracking devices provide? How accurate are these data? What should be taken into account when incorporating wearable sleep-tracking devices into research? These outstanding questions and surrounding considerations motivated this work, outlining practical recommendations for using wearable technology in sleep and circadian research.

The 2023 wearable photoplethysmography roadmap

Photoplethysmography is a key sensing technology which is used in wearable devices such as smartwatches and fitness trackers. Currently, photoplethysmography sensors are used to monitor physiological parameters including heart rate and heart rhythm, and to track activities like sleep and exercise. Yet, wearable photoplethysmography has potential to provide much more information on health and wellbeing, which could inform clinical decision making. This Roadmap outlines directions for research and development to realise the full potential of wearable photoplethysmography. Experts discuss key topics within the areas of sensor design, signal processing, clinical applications, and research directions. Their perspectives provide valuable guidance to researchers developing wearable photoplethysmography technology.

Digital Platform for Continuous Monitoring of Patients Using a Smartwatch: Longitudinal Prospective Cohort Study

BACKGROUND

Since the COVID-19 pandemic, there has been a boost in the digital transformation of the human society, where wearable devices such as a smartwatch can already measure vital signs in a continuous and naturalistic way; however, the security and privacy of personal data is a challenge to expanding the use of these data by health professionals in clinical follow-up for decision-making. Similar to the European General Data Protection Regulation, in Brazil, the Lei Geral de Proteção de Dados established rules and guidelines for the processing of personal data, including those used for patient care, such as those captured by smartwatches. Thus, in any telemonitoring scenario, there is a need to comply with rules and regulations, making this issue a challenge to overcome.

OBJECTIVE

This study aimed to build a digital solution model for capturing data from wearable devices and making them available in a safe and agile manner for clinical and research use, following current laws.

METHODS

A functional model was built following the Brazilian Lei Geral de Proteção de Dados (2018), where data captured by smartwatches can be transmitted anonymously over the Internet of Things and be identified later within the hospital. A total of 80 volunteers were selected for a 24-week follow-up clinical trial divided into 2 groups, one group with a previous diagnosis of COVID-19 and a control group without a previous diagnosis of COVID-19, to measure the synchronization rate of the platform with the devices and the accuracy and precision of the smartwatch in out-of-hospital conditions to simulate remote monitoring at home.

RESULTS

In a 35-week clinical trial, >11.2 million records were collected with no system downtime; 66% of continuous beats per minute were synchronized within 24 hours (79% within 2 days and 91% within a week). In the limit of agreement analysis, the mean differences in oxygen saturation, diastolic blood pressure, systolic blood pressure, and heart rate were -1.280% (SD 5.679%), -1.399 (SD 19.112) mm Hg, -1.536 (SD 24.244) mm Hg, and 0.566 (SD 3.114) beats per minute, respectively. Furthermore, there was no difference in the 2 study groups in terms of data analysis (neither using the smartwatch nor the gold-standard devices), but it is worth mentioning that all volunteers in the COVID-19 group were already cured of the infection and were highly functional in their daily work life.

CONCLUSIONS

On the basis of the results obtained, considering the validation conditions of accuracy and precision and simulating an extrahospital use environment, the functional model built in this study is capable of capturing data from the smartwatch and anonymously providing it to health care services, where they can be treated according to the legislation and be used to support clinical decisions during remote monitoring.

Evaluating the Potential of Machine Learning and Wearable Devices in End-of-Life Care in Predicting 7-Day Death Events Among Patients With Terminal Cancer: Cohort Study

BACKGROUND

An accurate prediction of mortality in end-of-life care is crucial but presents challenges. Existing prognostic tools demonstrate moderate performance in predicting survival across various time frames, primarily in in-hospital settings and single-time evaluations. However, these tools may fail to capture the individualized and diverse trajectories of patients. Limited evidence exists regarding the use of artificial intelligence (AI) and wearable devices, specifically among patients with cancer at the end of life.

OBJECTIVE

This study aimed to investigate the potential of using wearable devices and AI to predict death events among patients with cancer at the end of life. Our hypothesis was that continuous monitoring through smartwatches can offer valuable insights into the progression of patients at the end of life and enable the prediction of changes in their condition, which could ultimately enhance personalized care, particularly in outpatient or home care settings.

METHODS

This prospective study was conducted at the National Taiwan University Hospital. Patients diagnosed with cancer and receiving end-of-life care were invited to enroll in wards, outpatient clinics, and home-based care settings. Each participant was given a smartwatch to collect physiological data, including steps taken, heart rate, sleep time, and blood oxygen saturation. Clinical assessments were conducted weekly. The participants were followed until the end of life or up to 52 weeks. With these input features, we evaluated the prediction performance of several machine learning-based classifiers and a deep neural network in 7-day death events. We used area under the receiver operating characteristic curve (AUROC), F1-score, accuracy, and specificity as evaluation metrics. A Shapley additive explanations value analysis was performed to further explore the models with good performance.

RESULTS

From September 2021 to August 2022, overall, 1657 data points were collected from 40 patients with a median survival time of 34 days, with the detection of 28 death events. Among the proposed models, extreme gradient boost (XGBoost) yielded the best result, with an AUROC of 96%, F1-score of 78.5%, accuracy of 93%, and specificity of 97% on the testing set. The Shapley additive explanations value analysis identified the average heart rate as the most important feature. Other important features included steps taken, appetite, urination status, and clinical care phase.

CONCLUSIONS

We demonstrated the successful prediction of patient deaths within the next 7 days using a combination of wearable devices and AI. Our findings highlight the potential of integrating AI and wearable technology into clinical end-of-life care, offering valuable insights and supporting clinical decision-making for personalized patient care. It is important to acknowledge that our study was conducted in a relatively small cohort; thus, further research is needed to validate our approach and assess its impact on clinical care.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05054907; https://classic.clinicaltrials.gov/ct2/show/NCT05054907.

Consumer Wearable Health and Fitness Technology in Cardiovascular Medicine: JACC State-of-the-Art Review

The use of consumer wearable devices (CWDs) to track health and fitness has rapidly expanded over recent years because of advances in technology. The general population now has the capability to continuously track vital signs, exercise output, and advanced health metrics. Although understanding of basic health metrics may be intuitive (eg, peak heart rate), more complex metrics are derived from proprietary algorithms, differ among device manufacturers, and may not historically be common in clinical practice (eg, peak V˙O2, exercise recovery scores). With the massive expansion of data collected at an individual patient level, careful interpretation is imperative. In this review, we critically analyze common health metrics provided by CWDs, describe common pitfalls in CWD interpretation, provide recommendations for the interpretation of abnormal results, present the utility of CWDs in exercise prescription, examine health disparities and inequities in CWD use and development, and present future directions for research and development.

Home monitoring in interstitial lung diseases

The widespread use of smartphones and the internet has enabled self-monitoring and more hybrid-care models. The COVID-19 pandemic has further accelerated remote monitoring, including in the heterogenous and often vulnerable group of patients with interstitial lung diseases (ILDs). Home monitoring in ILD has the potential to improve access to specialist care, reduce the burden on health-care systems, improve quality of life for patients, identify acute and chronic disease worsening, guide treatment decisions, and simplify clinical trials. Home spirometry has been used in ILD for several years and studies with other devices (such as pulse oximeters, activity trackers, and cough monitors) have emerged. At the same time, challenges have surfaced, including technical, analytical, and implementational issues. In this Series paper, we provide an overview of experiences with home monitoring in ILD, address the challenges and limitations for both care and research, and provide future perspectives. VIDEO ABSTRACT.

Wearable activity trackers-advanced technology or advanced marketing?

Wearable devices represent one of the most popular trends in health and fitness. Rapid advances in wearable technology present a dizzying display of possible functions: from thermometers and barometers, magnetometers and accelerometers, to oximeters and calorimeters. Consumers and practitioners utilize wearable devices to track outcomes, such as energy expenditure, training load, step count, and heart rate. While some rely on these devices in tandem with more established tools, others lean on wearable technology for health-related outcomes, such as heart rhythm analysis, peripheral oxygen saturation, sleep quality, and caloric expenditure. Given the increasing popularity of wearable devices for both recreation and health initiatives, understanding the strengths and limitations of these technologies is increasingly relevant. Need exists for continued evaluation of the efficacy of wearable devices to accurately and reliably measure purported outcomes. The purposes of this review are (1) to assess the current state of wearable devices using recent research on validity and reliability, (2) to describe existing gaps between physiology and technology, and (3) to offer expert interpretation for the lay and professional audience on how best to approach wearable technology and employ it in the pursuit of health and fitness. Current literature demonstrates inconsistent validity and reliability for various metrics, with algorithms not publicly available or lacking high-quality validation studies. Advancements in wearable technology should consider standardizing validation metrics, providing transparency in used algorithms, and improving how technology can be tailored to individuals. Until then, it is prudent to exercise caution when interpreting metrics reported from consumer-wearable devices.