1
|
Mehmood A, Sarouji A, Rahman MMU, Al-Naffouri TY. Your smartphone could act as a pulse-oximeter and as a single-lead ECG. Sci Rep 2023; 13:19277. [PMID: 37935806 PMCID: PMC10630323 DOI: 10.1038/s41598-023-45933-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 10/25/2023] [Indexed: 11/09/2023] Open
Abstract
In the post-covid19 era, every new wave of the pandemic causes an increased concern/interest among the masses to learn more about their state of well-being. Therefore, it is the need of the hour to come up with ubiquitous, low-cost, non-invasive tools for rapid and continuous monitoring of body vitals that reflect the status of one's overall health. In this backdrop, this work proposes a deep learning approach to turn a smartphone-the popular hand-held personal gadget-into a diagnostic tool to measure/monitor the three most important body vitals, i.e., pulse rate (PR), blood oxygen saturation level (aka SpO2), and respiratory rate (RR). Furthermore, we propose another method that could extract a single-lead electrocardiograph (ECG) of the subject. The proposed methods include the following core steps: subject records a small video of his/her fingertip by placing his/her finger on the rear camera of the smartphone, and the recorded video is pre-processed to extract the filtered and/or detrended video-photoplethysmography (vPPG) signal, which is then fed to custom-built convolutional neural networks (CNN), which eventually spit-out the vitals (PR, SpO2, and RR) as well as a single-lead ECG of the subject. To be precise, the contribution of this paper is twofold: (1) estimation of the three body vitals (PR, SpO2, RR) from the vPPG data using custom-built CNNs, vision transformer, and most importantly by CLIP model (a popular image-caption-generator model); (2) a novel discrete cosine transform+feedforward neural network-based method that translates the recorded video-PPG signal to a single-lead ECG signal. The significance of this work is twofold: (i) it allows rapid self-testing of body vitals (e.g., self-monitoring for covid19 symptoms), (ii) it enables rapid self-acquisition of a single-lead ECG, and thus allows early detection of atrial fibrillation (abormal heart beat or arrhythmia), which in turn could enable early intervention in response to a range of cardiovascular diseases, and could help save many precious lives. Our work could help reduce the burden on healthcare facilities and could lead to reduction in health insurance costs.
Collapse
Affiliation(s)
- Ahsan Mehmood
- Department of Electrical Engineering, KAUST, Thuwal, Kingdom of Saudi Arabia
| | - Asma Sarouji
- Department of Electrical Engineering, KAUST, Thuwal, Kingdom of Saudi Arabia
| | - M Mahboob Ur Rahman
- Department of Electrical Engineering, KAUST, Thuwal, Kingdom of Saudi Arabia.
| | - Tareq Y Al-Naffouri
- Department of Electrical Engineering, KAUST, Thuwal, Kingdom of Saudi Arabia
| |
Collapse
|
2
|
Dang TH, Jang GY, Lee K, Oh TI. Motion Artifacts Reduction for Noninvasive Hemodynamic Monitoring of Conscious Patients Using Electrical Impedance Tomography: A Preliminary Study. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115308. [PMID: 37300035 DOI: 10.3390/s23115308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 05/19/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023]
Abstract
Electrical impedance tomography (EIT) can monitor the real-time hemodynamic state of a conscious and spontaneously breathing patient noninvasively. However, cardiac volume signal (CVS) extracted from EIT images has a small amplitude and is sensitive to motion artifacts (MAs). This study aimed to develop a new algorithm to reduce MAs from the CVS for more accurate heart rate (HR) and cardiac output (CO) monitoring in patients undergoing hemodialysis based on the source consistency between the electrocardiogram (ECG) and the CVS of heartbeats. Two signals were measured at different locations on the body through independent instruments and electrodes, but the frequency and phase were matched when no MAs occurred. A total of 36 measurements with 113 one-hour sub-datasets were collected from 14 patients. As the number of motions per hour (MI) increased over 30, the proposed algorithm had a correlation of 0.83 and a precision of 1.65 beats per minute (BPM) compared to the conventional statical algorithm of a correlation of 0.56 and a precision of 4.04 BPM. For CO monitoring, the precision and upper limit of the mean ∆CO were 3.41 and 2.82 L per minute (LPM), respectively, compared to 4.05 and 3.82 LPM for the statistical algorithm. The developed algorithm could reduce MAs and improve HR/CO monitoring accuracy and reliability by at least two times, particularly in high-motion environments.
Collapse
Affiliation(s)
- Thi Hang Dang
- Department of Medical Engineering, Graduate School, Kyung Hee University, Seoul 02453, Republic of Korea
| | - Geuk Young Jang
- Department of Thoracic and Cardiovascular Surgery, Seoul National University Bundang Hospital, Seongnam-si 13620, Republic of Korea
| | - Kyounghun Lee
- Medical Science Research Institute, Kyung Hee University Medical Center, Seoul 02447, Republic of Korea
| | - Tong In Oh
- Department of Medical Engineering, Graduate School, Kyung Hee University, Seoul 02453, Republic of Korea
- Department of Biomedical Engineering, School of Medicine, Kyung Hee University, Seoul 02453, Republic of Korea
| |
Collapse
|
3
|
Sato S, Hiratsuka T, Hasegawa K, Watanabe K, Obara Y, Kariya N, Shinba T, Matsui T. Screening for Major Depressive Disorder Using a Wearable Ultra-Short-Term HRV Monitor and Signal Quality Indices. SENSORS (BASEL, SWITZERLAND) 2023; 23:3867. [PMID: 37112208 PMCID: PMC10143236 DOI: 10.3390/s23083867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 04/06/2023] [Accepted: 04/07/2023] [Indexed: 06/19/2023]
Abstract
To encourage potential major depressive disorder (MDD) patients to attend diagnostic sessions, we developed a novel MDD screening system based on sleep-induced autonomic nervous responses. The proposed method only requires a wristwatch device to be worn for 24 h. We evaluated heart rate variability (HRV) via wrist photoplethysmography (PPG). However, previous studies have indicated that HRV measurements obtained using wearable devices are susceptible to motion artifacts. We propose a novel method to improve screening accuracy by removing unreliable HRV data (identified on the basis of signal quality indices (SQIs) obtained by PPG sensors). The proposed algorithm enables real-time calculation of signal quality indices in the frequency domain (SQI-FD). A clinical study conducted at Maynds Tower Mental Clinic enrolled 40 MDD patients (mean age, 37.5 ± 8.8 years) diagnosed on the basis of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, and 29 healthy volunteers (mean age, 31.9 ± 13.0 years). Acceleration data were used to identify sleep states, and a linear classification model was trained and tested using HRV and pulse rate data. Ten-fold cross-validation showed a sensitivity of 87.3% (80.3% without SQI-FD data) and specificity of 84.0% (73.3% without SQI-FD data). Thus, SQI-FD drastically improved sensitivity and specificity.
Collapse
Affiliation(s)
- Shohei Sato
- Department of Electrical Engineering and Computer Science, Faculty of Systems Design, Tokyo Metropolitan University, Tokyo 191-0065, Japan
| | - Takuma Hiratsuka
- Department of Electrical Engineering and Computer Science, Faculty of Systems Design, Tokyo Metropolitan University, Tokyo 191-0065, Japan
| | - Kenya Hasegawa
- Department of Electrical Engineering and Computer Science, Faculty of Systems Design, Tokyo Metropolitan University, Tokyo 191-0065, Japan
| | - Keisuke Watanabe
- Department of Electrical Engineering and Computer Science, Faculty of Systems Design, Tokyo Metropolitan University, Tokyo 191-0065, Japan
| | - Yusuke Obara
- Maynds Tower Mental Clinic, Tokyo 151-0053, Japan
| | | | - Toshikazu Shinba
- Department of Psychiatry, Shizuoka Saiseikai General Hospital, Shizuoka 422-8527, Japan
- Research Division, Saiseikai Research Institute of Health Care and Welfare, Tokyo 108-0073, Japan
| | - Takemi Matsui
- Department of Electrical Engineering and Computer Science, Graduate School of System Design, Tokyo Metropolitan University, Tokyo 191-0065, Japan
| |
Collapse
|
4
|
McLean MK, Weaver RG, Lane A, Smith MT, Parker H, Stone B, McAninch J, Matolak DW, Burkart S, Chandrashekhar MVS, Armstrong B. A Sliding Scale Signal Quality Metric of Photoplethysmography Applicable to Measuring Heart Rate across Clinical Contexts with Chest Mounting as a Case Study. SENSORS (BASEL, SWITZERLAND) 2023; 23:3429. [PMID: 37050488 PMCID: PMC10098585 DOI: 10.3390/s23073429] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 03/06/2023] [Accepted: 03/17/2023] [Indexed: 06/19/2023]
Abstract
UNLABELLED Photoplethysmography (PPG) signal quality as a proxy for accuracy in heart rate (HR) measurement is useful in various public health contexts, ranging from short-term clinical diagnostics to free-living health behavior surveillance studies that inform public health policy. Each context has a different tolerance for acceptable signal quality, and it is reductive to expect a single threshold to meet the needs across all contexts. In this study, we propose two different metrics as sliding scales of PPG signal quality and assess their association with accuracy of HR measures compared to a ground truth electrocardiogram (ECG) measurement. METHODS We used two publicly available PPG datasets (BUT PPG and Troika) to test if our signal quality metrics could identify poor signal quality compared to gold standard visual inspection. To aid interpretation of the sliding scale metrics, we used ROC curves and Kappa values to calculate guideline cut points and evaluate agreement, respectively. We then used the Troika dataset and an original dataset of PPG data collected from the chest to examine the association between continuous metrics of signal quality and HR accuracy. PPG-based HR estimates were compared with reference HR estimates using the mean absolute error (MAE) and the root-mean-square error (RMSE). Point biserial correlations were used to examine the association between binary signal quality and HR error metrics (MAE and RMSE). RESULTS ROC analysis from the BUT PPG data revealed that the AUC was 0.758 (95% CI 0.624 to 0.892) for signal quality metrics of STD-width and 0.741 (95% CI 0.589 to 0.883) for self-consistency. There was a significant correlation between criterion poor signal quality and signal quality metrics in both Troika and originally collected data. Signal quality was highly correlated with HR accuracy (MAE and RMSE, respectively) between PPG and ground truth ECG. CONCLUSION This proof-of-concept work demonstrates an effective approach for assessing signal quality and demonstrates the effect of poor signal quality on HR measurement. Our continuous signal quality metrics allow estimations of uncertainties in other emergent metrics, such as energy expenditure that relies on multiple independent biometrics. This open-source approach increases the availability and applicability of our work in public health settings.
Collapse
Affiliation(s)
- Marnie K. McLean
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | - R. Glenn Weaver
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | - Abbi Lane
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | - Michal T. Smith
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | - Hannah Parker
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | - Ben Stone
- College of Engineering and Computing, University of South Carolina, Columbia, SC 29208, USA
| | - Jonas McAninch
- College of Engineering and Computing, University of South Carolina, Columbia, SC 29208, USA
| | - David W. Matolak
- College of Engineering and Computing, University of South Carolina, Columbia, SC 29208, USA
| | - Sarah Burkart
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| | | | - Bridget Armstrong
- Department of Exercise Science, University of South Carolina, Columbia, SC 29208, USA
| |
Collapse
|
5
|
Channel Intensity and Edge-Based Estimation of Heart Rate via Smartphone Recordings. COMPUTERS 2023. [DOI: 10.3390/computers12020043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/22/2023]
Abstract
Smartphones, today, come equipped with a wide variety of sensors and high-speed processors that can capture, process, store, and communicate different types of data. Coupled with their ubiquity in recent years, these devices show potential as practical and portable healthcare monitors that are both cost-effective and accessible. To this end, this study focuses on examining the feasibility of smartphones in estimating the heart rate (HR), using video recordings of the users’ fingerprints. The proposed methodology involves two-stage processing that combines channel-intensity-based approaches (Channel-Intensity mode/Counter method) and a novel technique that relies on the spatial and temporal position of the recorded fingerprint edges (Edge-Detection mode). The dataset used here included 32 fingerprint video recordings taken from 6 subjects, using the rear camera of 2 smartphone models. Each video clip was first validated to determine whether it was suitable for Channel-Intensity mode or Edge-Detection mode, followed by further processing and heart rate estimation in the selected mode. The relative accuracy for recordings via the Edge-Detection mode was 93.04%, with a standard error of estimates (SEE) of 6.55 and Pearson’s correlation r > 0.91, while the Channel-Intensity mode showed a relative accuracy of 92.75%, with an SEE of 5.95 and a Pearson’s correlation r > 0.95. Further statistical analysis was also carried out using Pearson’s correlation test and the Bland–Altman method to verify the statistical significance of the results. The results thus show that the proposed methodology, through smartphones, is a potential alternative to existing technologies for monitoring a person’s heart rate.
Collapse
|
6
|
Georgieva-Tsaneva G. Interactive Cardio System for Healthcare Improvement. SENSORS (BASEL, SWITZERLAND) 2023; 23:1186. [PMID: 36772226 PMCID: PMC9921847 DOI: 10.3390/s23031186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 01/12/2023] [Accepted: 01/18/2023] [Indexed: 06/18/2023]
Abstract
The paper presents an interactive cardio system that can be used to improve healthcare. The proposed system receives, processes, and analyzes cardio data using an Internet-based software platform. The system enables the acquisition of biomedical data using various means of recording cardiac signals located in remote locations around the world. The recorded discretized cardio information is transmitted to the system for processing and mathematical analysis. At the same time, the recorded cardio data can also be stored online in established databases. The article presents the algorithms for the preprocessing and mathematical analysis of cardio data (heart rate variability). The results of studies conducted on the Holter recordings of healthy individuals and individuals with cardiovascular diseases are presented. The created system can be used for the remote monitoring of patients with chronic cardiovascular diseases or patients in remote settlements (where, for example, there may be no hospitals), control and assistance in the process of treatment, and monitoring the taking of prescribed drugs to help to improve people's quality of life. In addition, the issue of ensuring the security of cardio information and the confidentiality of the personal data of health users is considered.
Collapse
|
7
|
Comparison of Three Prototypes of PPG Sensors for Continual Real-Time Measurement in Weak Magnetic Field. SENSORS 2022; 22:s22103769. [PMID: 35632179 PMCID: PMC9144130 DOI: 10.3390/s22103769] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Revised: 05/11/2022] [Accepted: 05/14/2022] [Indexed: 12/04/2022]
Abstract
This paper is focused on investigation of three developed prototypes of sensors based on the photoplethysmography (PPG) principle for continual measurement of the PPG signal in the magnetic field environment with the inherent radiofrequency and electromagnetic disturbance. The tested prototypes differ in the used optical part of the PPG sensor and their working mode, control unit, power supply, and applied Bluetooth (BT) communication methods. The main aim of the current work was motivated by finding suitable and universal parameter settings for PPG signal real-time recording in different working mode conditions. Comparative measurements in laboratory conditions by certified commercial pulse oximeter and blood pressure monitor (BPM) devices show good stability and proper accuracy of finally determined heart rate values. The supplementary investigation certifies the necessity of the placement of the pressure cuff of the BPM device on the opposite arm than the tested PPG sensor. Measurement experiments inside the scanning area of the running weak field magnetic resonance scanner verify proper function and practical usability of sensed PPG signals for further processing and analysis in all three prototype cases. Additional testing shows that the BT transmission in the scanning area has no visible influence on the quality of the finally obtained scanner images.
Collapse
|
8
|
Cui H, Wang Z, Yu B, Jiang F, Geng N, Li Y, Xu L, Zheng D, Zhang B, Lu P, Greenwald SE. Statistical Analysis of the Consistency of HRV Analysis Using BCG or Pulse Wave Signals. SENSORS (BASEL, SWITZERLAND) 2022; 22:2423. [PMID: 35336592 PMCID: PMC8951337 DOI: 10.3390/s22062423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 02/22/2022] [Accepted: 02/28/2022] [Indexed: 05/06/2023]
Abstract
Ballistocardiography (BCG) is considered a good alternative to HRV analysis with its non-contact and unobtrusive acquisition characteristics. However, consensus about its validity has not yet been established. In this study, 50 healthy subjects (26.2 ± 5.5 years old, 22 females, 28 males) were invited. Comprehensive statistical analysis, including Coefficients of Variation (CV), Lin’s Concordance Correlation Coefficient (LCCC), and Bland-Altman analysis (BA ratio), were utilized to analyze the consistency of BCG and ECG signals in HRV analysis. If the methods gave different answers, the worst case was taken as the result. Measures of consistency such as Mean, SDNN, LF gave good agreement (the absolute value of CV difference < 2%, LCCC > 0.99, BA ratio < 0.1) between J-J (BCG) and R-R intervals (ECG). pNN50 showed moderate agreement (the absolute value of CV difference < 5%, LCCC > 0.95, BA ratio < 0.2), while RMSSD, HF, LF/HF indicated poor agreement (the absolute value of CV difference ≥ 5% or LCCC ≤ 0.95 or BA ratio ≥ 0.2). Additionally, the R-R intervals were compared with P-P intervals extracted from the pulse wave (PW). Except for pNN50, which exhibited poor agreement in this comparison, the performances of the HRV indices estimated from the PW and the BCG signals were similar.
Collapse
Affiliation(s)
- Huiying Cui
- College of Medicine and Biological and Information Engineering, Northeastern University, Shenyang 110167, China; (H.C.); (Z.W.); (F.J.)
| | - Zhongyi Wang
- College of Medicine and Biological and Information Engineering, Northeastern University, Shenyang 110167, China; (H.C.); (Z.W.); (F.J.)
| | - Bin Yu
- Philips Design, 5611 AZ Eindhoven, The Netherlands;
| | - Fangfang Jiang
- College of Medicine and Biological and Information Engineering, Northeastern University, Shenyang 110167, China; (H.C.); (Z.W.); (F.J.)
| | - Ning Geng
- Department of Cardiology, Shengjing Hospital of China Medical University, Shenyang 110819, China;
| | - Yongchun Li
- Shenyang Contain Electronic Technology Co., Ltd., Shenyang 110167, China;
| | - Lisheng Xu
- College of Medicine and Biological and Information Engineering, Northeastern University, Shenyang 110167, China; (H.C.); (Z.W.); (F.J.)
- Neusoft Research of Intelligent Healthcare Technology, Co., Ltd., Shenyang 110167, China
| | - Dingchang Zheng
- Research Centre for Intelligent Healthcare, Coventry University, Coventry CV1 5RW, UK;
| | - Biyong Zhang
- BOBO Technology, Hangzhou 310000, China;
- User System Interaction Group, Industrial Design, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands
| | - Peilin Lu
- Neuroscience Center, Department of Neurology, Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou 310000, China;
| | - Stephen E. Greenwald
- Blizard Institute, Barts & The London School of Medicine & Dentistry, Queen Mary University of London, London E1 4NS, UK
| |
Collapse
|