Accuracy of Samsung Smartphone Integrated Pulse Oximetry Meets Full FDA Clearance Standards for Clinical Use

Performance of a commercial smart watch compared to polysomnography reference for overnight continuous oximetry measurement and sleep apnea evaluation

STUDY OBJECTIVES

We evaluated the accuracy and precision of continuous overnight oxygen saturation (SpO2) measurement by a commercial wrist device (WD) incorporating high-grade sensors and investigated WD estimation of sleep-disordered breathing by quantifying overnight oxygen desaturation index compared to polysomnography (PSG) oxygen desaturation index and apnea-hypopnea index (AHI) with and without sleep questionnaire data to assess the WD's ability to detect obstructive sleep apnea and determine its severity.

METHODS

Participants completed sleep questionnaires, had a WD (Samsung Galaxy Watch 4) placed on their wrist, and underwent attended, in-laboratory overnight PSG (Nihon Kohden) with a pulse oximetry probe secured either to a finger or an ear lobe. PSG data were scored by a single experienced registered PSG technologist. Statistical analysis included demographic characteristics, continuous SpO2 measurement WD vs PSG root-mean-square error with Bland-Altman plot and linear regression associations. Predictive models for PSG oxygen desaturation index and AHI severity were built using logistic regression with probability cutoffs determined via receiver operating curve characteristics.

RESULTS

The 51 participants analyzed had a median age of 49 (range, 22-78) years; 66.7% were male, with median body mass index of 28.1 (range, 20.1-47.3) kg/m2 with a race/ethnicity distribution of 49.0% Caucasian, 25.5% Hispanic, 9.8% African American, 9.8% Asian, and 5.9% Middle Eastern. WD vs PSG continuous SpO2 measurement in percentage points demonstrated a bias of 0.91 (95% confidence interval, 0.38, 1.45), standard deviation of 2.37 (95% confidence interval, 2.36, 2.38), and root-mean-square error of 2.54 (95% confidence interval, 2.34, 2.73). WD area under the curve receiver operating curve characteristics for predicting PSG were 0.882 oxygen desaturation index > 15 events/h, 0.894 AHI > 30 events/h, 0.800 AHI > 15 events/h, and 0.803 AHI > 5 events/h. WD plus select sleep questionnaire areas under the curve for predicting PSG were 0.943 AHI > 30 events/h, 0.868 AHI > 15 events/h, and 0.863 AHI > 5 events/h.

CONCLUSIONS

The WD conducted reliable overnight continuous SpO2 monitoring with root-mean-square error < 3% vs PSG. Predictive models of PSG AHI based on WD measurements alone, or plus sleep questionnaires, demonstrated excellent to outstanding discrimination for obstructive sleep apnea identification and severity. Longitudinal WD use should be evaluated promptly based on the WD's potential to improve accessibility and accuracy of obstructive sleep apnea testing, as well as support treatment follow-up.

CITATION

Browne SH, Vaida F, Umlauf A, Kim J, DeYoung P, Owens RL. Performance of a commercial smart watch compared to polysomnography reference for overnight continuous oximetry measurement and sleep apnea evaluation. J Clin Sleep Med. 2024;20(9):1479-1488.

Evaluation of Leading Smartwatches for the Detection of Hypoxemia: Comparison to Reference Oximeter

Although smartwatches are not considered medical devices, experimental validation of their accuracy in detecting hypoxemia is necessary due to their potential use in monitoring conditions manifested by a prolonged decrease in peripheral blood oxygen saturation (SpO2), such as chronic obstructive pulmonary disease, sleep apnea syndrome, and COVID-19, or at high altitudes, e.g., during sport climbing, where the use of finger-sensor-based pulse oximeters may be limited. The aim of this study was to experimentally compare the accuracy of SpO2 measurement of popular smartwatches with a clinically used pulse oximeter according to the requirements of ISO 80601-2-61. Each of the 18 young and healthy participants underwent the experimental assessment three times in randomized order-wearing Apple Watch 8, Samsung Galaxy Watch 5, or Withings ScanWatch-resulting in 54 individual experimental assessments and complete datasets. The accuracy of the SpO2 measurements was compared to that of the Radical-7 (Masimo Corporation, Irvine, CA, USA) during short-term hypoxemia induced by consecutive inhalation of three prepared gas mixtures with reduced oxygen concentrations (14%, 12%, and 10%). All three smartwatch models met the maximum acceptable root-mean-square deviation (≤4%) from the reference measurement at both normal oxygen levels and induced desaturation with SpO2 less than 90%. Apple Watch 8 reached the highest reliability due to its lowest mean bias and root-mean-square deviation, highest Pearson correlation coefficient, and accuracy in detecting hypoxemia. Our findings support the use of smartwatches to reliably detect hypoxemia in situations where the use of standard finger pulse oximeters may be limited.

Hospital cybersecurity risks and gaps: Review (for the non-cyber professional)

Background

Healthcare is facing a growing threat of cyberattacks. Myriad data sources illustrate the same trends that healthcare is one of the industries with the highest risk of cyber infiltration and is seeing a surge in security incidents within just a few years. The circumstances thus begged the question: are US hospitals prepared for the risks that accompany clinical medicine in cyberspace?

Objective

The study aimed to identify the major topics and concerns present in today's hospital cybersecurity field, intended for non-cyber professionals working in hospital settings.

Methods

Via structured literature searches of the National Institutes of Health's PubMed and Tel Aviv University's DaTa databases, 35 journal articles were identified to form the core of the study. Databases were chosen for accessibility and academic rigor. Eighty-seven additional sources were examined to supplement the findings.

Results

The review revealed a basic landscape of hospital cybersecurity, including primary reasons hospitals are frequent targets, top attack methods, and consequences hospitals face following attacks. Cyber technologies common in healthcare and their risks were examined, including medical devices, telemedicine software, and electronic data. By infiltrating any of these components of clinical care, attackers can access mounds of information and manipulate, steal, ransom, or otherwise compromise the records, or can use the access to catapult themselves to deeper parts of a hospital's network. Issues that can increase healthcare cyber risks, like interoperability and constant accessibility, were also identified. Finally, strategies that hospitals tend to employ to combat these risks, including technical, financial, and regulatory, were explored and found to be weak. There exist serious vulnerabilities within hospitals' technologies that many hospitals presently fail to address. The COVID-19 pandemic was used to further illustrate this issue.

Conclusions

Comparison of the risks, strategies, and gaps revealed that many US hospitals are unprepared for cyberattacks. Efforts are largely misdirected, with external-often governmental-efforts negligible. Policy changes, e.g., training employees in cyber protocols, adding advanced technical protections, and collaborating with several experts, are necessary. Overall, hospitals must recognize that, in cyber incidents, the real victims are the patients. They are at risk physically and digitally when medical devices or treatments are compromised.

Clinical feasibility of an advanced neonatal epidermal multiparameter continuous monitoring technology in a large public maternity hospital in Nairobi, Kenya

Clinically feasible multiparameter continuous physiological monitoring technologies are needed for use in resource-constrained African healthcare facilities to allow for early detection of critical events and timely intervention for major morbidities in high-risk neonates. We conducted a prospective clinical feasibility study of a novel multiparameter continuous physiological monitoring technology in neonates at Pumwani Maternity Hospital in Nairobi, Kenya. To assess feasibility, we compared the performance of Sibel's Advanced Neonatal Epidermal (ANNE) technology to reference technologies, including Masimo's Rad-97 pulse CO-oximeter with capnography technology for heart rate (HR), respiratory rate (RR), and oxygen saturation (SpO₂) measurements and Spengler's Tempo Easy non-contact infrared thermometer for temperature measurements. We evaluated key performance criteria such as up-time, clinical event detection performance, and the agreement of measurements compared to those from the reference technologies in an uncontrolled, real-world setting. Between September 15 and December 15, 2020, we collected and analyzed 503 h of ANNE data from 109 enrolled neonates. ANNE's up-time was 42 (11%) h more for HR, 77 (25%) h more for RR, and 6 (2%) h less for SpO₂ compared to the Rad-97. However, ANNE's ratio of up-time to total attached time was less than Rad-97's for HR (0.79 vs 0.86), RR (0.68 vs. 0.79), and SpO₂ (0.69 vs 0.86). ANNE demonstrated adequate performance in identifying high and low HR and RR and high temperature events; however, showed relatively poor performance for low SpO₂ events. The normalized spread of limits of agreement were 8.4% for HR and 52.2% for RR and the normalized root-mean-square deviation was 4.4% for SpO₂. Temperature agreement showed a spread of limits of agreement of 2.8 °C. The a priori-identified optimal limits were met for HR and temperature but not for RR or SpO₂. ANNE was clinically feasible for HR and temperature but not RR and SpO₂ as demonstrated by the technology's up-time, clinical event detection performance, and the agreement of measurements compared to those from the reference technologies.

Remote patient monitoring in the management of chronic obstructive pulmonary disease

Remote patient monitoring allows monitoring high-risk patients through implementation of an expanding number of technologies in coordination with a healthcare team to augment care, with the potential to provide early detection of exacerbation, prompt access to therapy and clinical services, and ultimately improved patient outcomes and decreased healthcare utilization.In this review, we describe the application of remote patient monitoring in chronic obstructive pulmonary disease including the potential benefits and possible barriers to implementation both for the individual and the healthcare system.

Medical Apps and the Gray Zone in the COVID-19 Era: Between Evidence and New Needs for Cybersecurity Expansion

The study focuses on emerging problems caused by the spread of medical apps. Firstly, it reviews the current role of cybersecurity and identifies the potential need to widen the boundaries of cybersecurity in relation to these apps. Secondly, it focuses on the pivotal device behind the development of mHealth: the smartphone, and highlights its role and current potential for hosting wearable medical technology. Thirdly, it addresses emerging issues regarding these apps, which are in a gray zone. This is done through an analysis of the important positions of scholars, and by means of a survey report on the increased use of various categories of apps during the COVID-19 pandemic, highlighting an accentuation of the problem. The study ends by explaining the reflections and proposals that emerged after performing the analysis.