1
|
Henry B, Merz M, Hoang H, Abdulkarim G, Wosik J, Schoettker P. Cuffless Blood Pressure in clinical practice: challenges, opportunities and current limits. Blood Press 2024; 33:2304190. [PMID: 38245864 DOI: 10.1080/08037051.2024.2304190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 01/07/2024] [Indexed: 01/22/2024]
Abstract
Background: Cuffless blood pressure measurement technologies have attracted significant attention for their potential to transform cardiovascular monitoring.Methods: This updated narrative review thoroughly examines the challenges, opportunities, and limitations associated with the implementation of cuffless blood pressure monitoring systems.Results: Diverse technologies, including photoplethysmography, tonometry, and ECG analysis, enable cuffless blood pressure measurement and are integrated into devices like smartphones and smartwatches. Signal processing emerges as a critical aspect, dictating the accuracy and reliability of readings. Despite its potential, the integration of cuffless technologies into clinical practice faces obstacles, including the need to address concerns related to accuracy, calibration, and standardization across diverse devices and patient populations. The development of robust algorithms to mitigate artifacts and environmental disturbances is essential for extracting clear physiological signals. Based on extensive research, this review emphasizes the necessity for standardized protocols, validation studies, and regulatory frameworks to ensure the reliability and safety of cuffless blood pressure monitoring devices and their implementation in mainstream medical practice. Interdisciplinary collaborations between engineers, clinicians, and regulatory bodies are crucial to address technical, clinical, and regulatory complexities during implementation. In conclusion, while cuffless blood pressure monitoring holds immense potential to transform cardiovascular care. The resolution of existing challenges and the establishment of rigorous standards are imperative for its seamless incorporation into routine clinical practice.Conclusion: The emergence of these new technologies shifts the paradigm of cardiovascular health management, presenting a new possibility for non-invasive continuous and dynamic monitoring. The concept of cuffless blood pressure measurement is viable and more finely tuned devices are expected to enter the market, which could redefine our understanding of blood pressure and hypertension.
Collapse
Affiliation(s)
- Benoit Henry
- Service of Anesthesiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Maxime Merz
- Service of Anesthesiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Harry Hoang
- Service of Anesthesiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| | - Ghaith Abdulkarim
- Neuro-Informatics Laboratory, Mayo Clinic College of Medicine and Science, Rochester, MN, USA
- Department of Neurological Surgery, Mayo Clinic, Rochester, MN, USA
| | - Jedrek Wosik
- Department of Medicine, Duke University School of Medicine, Durham, North Carolina
| | - Patrick Schoettker
- Service of Anesthesiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
| |
Collapse
|
2
|
Kwon D, Mi Jung Y, Lee HC, Kyong Kim T, Kim K, Lee G, Kim D, Lee SB, Mi Lee S. Non-invasive prediction of massive transfusion during surgery using intraoperative hemodynamic monitoring data. J Biomed Inform 2024; 156:104680. [PMID: 38914411 DOI: 10.1016/j.jbi.2024.104680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/27/2024] [Accepted: 06/21/2024] [Indexed: 06/26/2024]
Abstract
OBJECTIVE Failure to receive prompt blood transfusion leads to severe complications if massive bleeding occurs during surgery. For the timely preparation of blood products, predicting the possibility of massive transfusion (MT) is essential to decrease morbidity and mortality. This study aimed to develop a model for predicting MT 10 min in advance using non-invasive bio-signal waveforms that change in real-time. METHODS In this retrospective study, we developed a deep learning-based algorithm (DLA) to predict intraoperative MT within 10 min. MT was defined as the transfusion of 3 or more units of red blood cells within an hour. The datasets consisted of 18,135 patients who underwent surgery at Seoul National University Hospital (SNUH) for model development and internal validation and 621 patients who underwent surgery at the Boramae Medical Center (BMC) for external validation. We constructed the DLA by using features extracted from plethysmography (collected at 500 Hz) and hematocrit measured during surgery. RESULTS Among 18,135 patients in SNUH and 621 patients in BMC, 265 patients (1.46%) and 14 patients (2.25%) received MT during surgery, respectively. The area under the receiver operating characteristic curve (AUROC) of DLA predicting intraoperative MT before 10 min was 0.962 (95% confidence interval [CI], 0.948-0.974) in internal validation and 0.922 (95% CI, 0.882-0.959) in external validation, respectively. CONCLUSION The DLA can successfully predict intraoperative MT using non-invasive bio-signal waveforms.
Collapse
Affiliation(s)
- Doyun Kwon
- Interdisciplinary Program of Medical Informatics, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Young Mi Jung
- Department of Obstetrics and Gynecology, Seoul National University College of Medicine, Seoul, Republic of Korea; Department of Obstetrics and Gynecology, Guro Hospital, Korea University College of Medicine, Seoul, Republic of Korea
| | - Hyung-Chul Lee
- Department of Anesthesiology and Pain Medicine, Seoul National University College of Medicine, Seoul National University Hospital, Seoul, Republic of Korea.
| | - Tae Kyong Kim
- Department of Anesthesiology and Pain Medicine, SMG-SNU Boramae Medical Center, Seoul National University College of Medicine, Seoul, Republic of Korea.
| | - Kwangsoo Kim
- Department of Transdisciplinary Medicine, Institute of Convergence Medicine with Innovative Technology, Seoul National University Hospital, Republic of Korea; Department of Medicine, College of Medicine, Seoul National University, Republic of Korea
| | - Garam Lee
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, Republic of Korea
| | - Dokyoon Kim
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, United States.
| | - Seung-Bo Lee
- Department of Medical Informatics, Keimyung University School of Medicine, Daegu, Republic of Korea.
| | - Seung Mi Lee
- Department of Obstetrics and Gynecology, Seoul National University College of Medicine, Seoul, Republic of Korea; Department of Obstetrics and Gynecology & Innovative Medical Technology Research Institute, Seoul National University Hospital, Republic of Korea; Medical Big Data Research Center & Institute of Reproductive Medicine and Population, Medical Research Center, Seoul National University, Republic of Korea.
| |
Collapse
|
3
|
Kamanditya B, Fuadah YN, Mahardika T NQ, Lim KM. Continuous blood pressure prediction system using Conv-LSTM network on hybrid latent features of photoplethysmogram (PPG) and electrocardiogram (ECG) signals. Sci Rep 2024; 14:16450. [PMID: 39014018 PMCID: PMC11252121 DOI: 10.1038/s41598-024-66514-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Accepted: 07/02/2024] [Indexed: 07/18/2024] Open
Abstract
Continuous blood pressure (BP) monitoring is essential for managing cardiovascular disease. However, existing devices often require expert handling, highlighting the need for alternative methods to simplify the process. Researchers have developed various methods using physiological signals to address this issue. Yet, many of these methods either fall short in accuracy according to the BHS, AAMI, and IEEE standards for BP measurement devices or suffer from low computational efficiency due to the complexity of their models. To solve this problem, we developed a BP prediction system that merges extracted features of PPG and ECG from two pulses of both signals using convolutional and LSTM layers, followed by incorporating the R-to-R interval durations as additional features for predicting systolic (SBP) and diastolic (DBP) blood pressure. Our findings indicate that the prediction accuracies for SBP and DBP were 5.306 ± 7.248 mmHg with a 0.877 correlation coefficient and 3.296 ± 4.764 mmHg with a 0.918 correlation coefficient, respectively. We found that our proposed model achieved a robust performance on the MIMIC III dataset with a minimum architectural design and high-level accuracy compared to existing methods. Thus, our method not only meets the passing category for BHS, AAMI, and IEEE guidelines but also stands out as the most rapidly accurate deep-learning-based BP measurement device currently available.
Collapse
Affiliation(s)
- Bharindra Kamanditya
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, 39177, Republic of Korea
| | - Yunendah Nur Fuadah
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, 39177, Republic of Korea
- Department of Electrical Engineering, Telkom University, Bandung, 40257, Indonesia
| | - Nurul Qashri Mahardika T
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, 39177, Republic of Korea
| | - Ki Moo Lim
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, 39177, Republic of Korea.
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi, 39253, Republic of Korea.
- Meta Heart Inc., Gumi, 39253, Republic of Korea.
| |
Collapse
|
4
|
Liu ZD, Li Y, Zhang YT, Zeng J, Chen ZX, Liu JK, Miao F. HGCTNet: Handcrafted Feature-Guided CNN and Transformer Network for Wearable Cuffless Blood Pressure Measurement. IEEE J Biomed Health Inform 2024; 28:3882-3894. [PMID: 38687656 DOI: 10.1109/jbhi.2024.3395445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Biosignals collected by wearable devices, such as electrocardiogram and photoplethysmogram, exhibit redundancy and global temporal dependencies, posing a challenge in extracting discriminative features for blood pressure (BP) estimation. To address this challenge, we propose HGCTNet, a handcrafted feature-guided CNN and transformer network for cuffless BP measurement based on wearable devices. By leveraging convolutional operations and self-attention mechanisms, we design a CNN-Transformer hybrid architecture to learn features from biosignals that capture both local information and global temporal dependencies. Then, we introduce a handcrafted feature-guided attention module that utilizes handcrafted features extracted from biosignals as query vectors to eliminate redundant information within the learned features. Finally, we design a feature fusion module that integrates the learned features, handcrafted features, and demographics to enhance model performance. We validate our approach using two large wearable BP datasets: the CAS-BP dataset and the Aurora-BP dataset. Experimental results demonstrate that HGCTNet achieves an estimation error of 0.9 ± 6.5 mmHg for diastolic BP (DBP) and 0.7 ± 8.3 mmHg for systolic BP (SBP) on the CAS-BP dataset. On the Aurora-BP dataset, the corresponding errors are -0.4 ± 7.0 mmHg for DBP and -0.4 ± 8.6 mmHg for SBP. Compared to the current state-of-the-art approaches, HGCTNet reduces the mean absolute error of SBP estimation by 10.68% on the CAS-BP dataset and 9.84% on the Aurora-BP dataset. These results highlight the potential of HGCTNet in improving the performance of wearable cuffless BP measurements.
Collapse
|
5
|
Slapničar G, Wang W, Luštrek M. Generalized channel separation algorithms for accurate camera-based multi-wavelength PTT and BP estimation. BIOMEDICAL OPTICS EXPRESS 2024; 15:3128-3146. [PMID: 38855660 PMCID: PMC11161386 DOI: 10.1364/boe.518562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 03/19/2024] [Accepted: 03/22/2024] [Indexed: 06/11/2024]
Abstract
Single-site multi-wavelength (MW) pulse transit time (PTT) measurement was recently proposed using contact sensors with sequential illumination. It leverages different penetration depths of light to measure the traversal of a cardiac pulse between skin layers. This enabled continuous single-site MW blood pressure (BP) monitoring, but faces challenges like subtle skin compression, which importantly influences the PPG morphology and subsequent PTT. We extended this idea to contact-free camera-based sensing and identified the major challenge of color channel overlap, which causes the signals obtained from a consumer RGB camera to be a mixture of responses in different wavelengths, thus not allowing for meaningful PTT measurement. To address this, we propose novel camera-independent data-driven channel separation algorithms based on constrained genetic algorithms. We systematically validated the algorithms on camera recordings of palms and corresponding ground-truth BP measurements of 13 subjects in two different scenarios, rest and activity. We compared the proposed algorithms against established blind source separation methods and against previous camera-specific physics-based method, showing good performance in both PTT reconstruction and BP estimation using a Random Forest regressor. The best-performing algorithm achieved mean absolute errors (MAEs) of 3.48 and 2.61 mmHg for systolic and diastolic BP in a leave-one-subject-out experiment with personalization, solidifying the proposed algorithms as enablers of novel contact-free MW PTT and BP estimation.
Collapse
Affiliation(s)
- Gašper Slapničar
- Department of Intelligent Systems, Jožef Stefan Institute, Jamova cesta 39, 1000 Ljubljana, Slovenia
- Jožef Stefan International Postgraduate School, Jamova cesta 39, 1000 Ljubljana, Slovenia
| | - Wenjin Wang
- Biomedical Engineering Department, Southern University of Science and Technology, 1088 Xueyuan Blvd, Nanshan, Shenzhen, Guangdong, China
| | - Mitja Luštrek
- Department of Intelligent Systems, Jožef Stefan Institute, Jamova cesta 39, 1000 Ljubljana, Slovenia
- Jožef Stefan International Postgraduate School, Jamova cesta 39, 1000 Ljubljana, Slovenia
| |
Collapse
|
6
|
Julkaew S, Wongsirichot T, Damkliang K, Sangthawan P. Improving accuracy of vascular access quality classification in hemodialysis patients using deep learning with K highest score feature selection. J Int Med Res 2024; 52:3000605241232519. [PMID: 38573764 PMCID: PMC10996358 DOI: 10.1177/03000605241232519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 01/26/2024] [Indexed: 04/05/2024] Open
Abstract
OBJECTIVE To develop and evaluate a novel feature selection technique, using photoplethysmography (PPG) sensors, for enhancing the performance of deep learning models in classifying vascular access quality in hemodialysis patients. METHODS This cross-sectional study involved creating a novel feature selection method based on SelectKBest principles, specifically designed to optimize deep learning models for PPG sensor data, in hemodialysis patients. The method effectiveness was assessed by comparing the performance of multiple deep learning models using the feature selection approach versus complete feature set. The model with the highest accuracy was then trained and tested using a 70:30 approach, respectively, with the full dataset and the SelectKBest dataset. Performance results were compared using Student's paired t-test. RESULTS Data from 398 hemodialysis patients were included. The 1-dimensional convolutional neural network (CNN1D) displayed the highest accuracy among different models. Implementation of the SelectKBest-based feature selection technique resulted in a statistically significant improvement in the CNN1D model's performance, achieving an accuracy of 92.05% (with feature selection) versus 90.79% (with full feature set). CONCLUSION These findings suggest that the newly developed feature selection approach might aid in accurately predicting vascular access quality in hemodialysis patients. This advancement may contribute to the development of reliable diagnostic tools for identifying vascular complications, such as stenosis, potentially improving patient outcomes and their quality of life.
Collapse
Affiliation(s)
- Sarayut Julkaew
- College of Digital Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Thakerng Wongsirichot
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Kasikrit Damkliang
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Pornpen Sangthawan
- Division of Nephrology, Department of Medicine, Faculty of Medicine, Prince of Songkhla University, Hat Yai, Songkhla, Thailand
| |
Collapse
|
7
|
Fang H, Xiong J, He L. Fair non-contact blood pressure estimation using imaging photoplethysmography. BIOMEDICAL OPTICS EXPRESS 2024; 15:2133-2151. [PMID: 38633076 PMCID: PMC11019696 DOI: 10.1364/boe.514241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 02/15/2024] [Accepted: 02/28/2024] [Indexed: 04/19/2024]
Abstract
Hypertension is typically manifested as a latent symptom that requires detection through specialized equipment. This poses an inconvenience for individuals who need to undergo long-term blood pressure monitoring in their daily lives. Therefore, there is a need for a portable, non-contact method for estimating blood pressure. However, current non-contact blood pressure estimation methods often rely on relatively narrow datasets, lacking a broad range of blood pressure distributions. Additionally, their applicability is confined to controlled experimental environments. This study proposes a non-contact blood pressure estimation method suitable for various life scenarios, encompassing multiple age groups, diverse ethnicities, and individuals with different skin tones. The aim is to enhance the practicality and accuracy of existing non-contact blood pressure estimation methods. The research extracts the imaging photoplethysmogram (IPPG) signal from facial videos and processes the signal through four layers of filtering operations to obtain an IPPG signal reflecting pulse wave variations. A CNN+BiLSTM+GRU network structure is constructed to improve the accuracy of current non-contact blood pressure estimation methods. In comparison to existing approaches, the mean absolute error (MAE) for systolic blood pressure (SBP) and diastolic blood pressure (DBP) is reduced by 13.6% and 16.4%, respectively.
Collapse
Affiliation(s)
- Hongli Fang
- College of Physics and Electronic Information Engineering, Zhejiang Normal University, Jinhua 321000, China
| | - Jiping Xiong
- College of Physics and Electronic Information Engineering, Zhejiang Normal University, Jinhua 321000, China
| | - Linying He
- College of Physics and Electronic Information Engineering, Zhejiang Normal University, Jinhua 321000, China
| |
Collapse
|
8
|
Slapničar G, Su J, Wang W. Fundamental and Practical Feasibility of Electrocardiogram Reconstruction from Photoplethysmogram. SENSORS (BASEL, SWITZERLAND) 2024; 24:2100. [PMID: 38610312 PMCID: PMC11014403 DOI: 10.3390/s24072100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 03/22/2024] [Accepted: 03/23/2024] [Indexed: 04/14/2024]
Abstract
Electrocardiogram (ECG) reconstruction from contact photoplethysmogram (PPG) would be transformative for cardiac monitoring. We investigated the fundamental and practical feasibility of such reconstruction by first replicating pioneering work in the field, with the aim of assessing the methods and evaluation metrics used. We then expanded existing research by investigating different cycle segmentation methods and different evaluation scenarios to robustly verify both fundamental feasibility, as well as practical potential. We found that reconstruction using the discrete cosine transform (DCT) and a linear ridge regression model shows good results when PPG and ECG cycles are semantically aligned-the ECG R peak and PPG systolic peak are aligned-before training the model. Such reconstruction can be useful from a morphological perspective, but loses important physiological information (precise R peak location) due to cycle alignment. We also found better performance when personalization was used in training, while a general model in a leave-one-subject-out evaluation performed poorly, showing that a general mapping between PPG and ECG is difficult to derive. While such reconstruction is valuable, as the ECG contains more fine-grained information about the cardiac activity as well as offers a different modality (electrical signal) compared to the PPG (optical signal), our findings show that the usefulness of such reconstruction depends on the application, with a trade-off between morphological quality of QRS complexes and precise temporal placement of the R peak. Finally, we highlight future directions that may resolve existing problems and allow for reliable and robust cross-modal physiological monitoring using just PPG.
Collapse
Affiliation(s)
- Gašper Slapničar
- Department of Intelligent Systems, Jožef Stefan Institute, Jamova cesta 39, 1000 Ljubljana, Slovenia
- Jožef Stefan International Postgraduate School, Jamova cesta 39, 1000 Ljubljana, Slovenia
| | - Jie Su
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (J.S.); (W.W.)
| | - Wenjin Wang
- Department of Electrical Engineering, Eindhoven University of Technology, 5612 AZ Eindhoven, The Netherlands; (J.S.); (W.W.)
- Biomedical Engineering Department, Southern University of Science and Technology, Shenzhen 518055, China
| |
Collapse
|
9
|
Park JS, Hong KS. Robust blood pressure measurement from facial videos in diverse environments. Heliyon 2024; 10:e26007. [PMID: 38434043 PMCID: PMC10906170 DOI: 10.1016/j.heliyon.2024.e26007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 02/02/2024] [Accepted: 02/06/2024] [Indexed: 03/05/2024] Open
Abstract
Blood pressure (BP) management is important worldwide, and BP monitoring is a crucial aspect of maintaining good health. Traditional BP meter measures BP independently in various situations, such as at home or work, using a cuff to maintain a stable condition. However, these devices can causes a foreign body sensation and discomfort, and are not always practical for periodic monitoring. As a result, studies have been conducted on the use of photoplethysmography (PPG) for measuring BP. However, PPG also has limitations similar to those of traditional BP meters, as it requires the placement of sensors on two regions of the body (fingers or toes). To address this issue, researchers have conducted studies on non-contact methods for measuring BP using face and hand videos. These studies have utilized two cameras to measure PTT and have focused on internal environments, resulting in low accuracy of BP measurement in external environments. We proposes a method for robust BP measurement using pulse wave velocity (PWV) and PTT calculated from facial videos. PTT is estimated by measuring the phase difference between two different regions of interest (ROIs) and PWV is calculated using PTT and the actual distance between two ROIs. In addition, our proposed method extracts the pulse wave from the ROI to measure BP. The actual distance between the ROIs and PTT are estimated using the two extracted pulse waves, and BP is then measured using PWV and PTT. To evaluate the BP measurement performance, the BP calculated from both BP meters and facial videos (in indoor, outdoor, driving car, and flying drone environments) are compared. Our results reveal that the proposed method can robustly measure BP in diverse environments.
Collapse
Affiliation(s)
- Jin-soo Park
- Department of Electrical and Computer Engineering, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon-si, 16419, Republic of Korea
| | - Kwang-seok Hong
- School of Electronic Electrical Engineering, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon-si, 16419, Republic of Korea
| |
Collapse
|
10
|
Julkaew S, Wongsirichot T, Damkliang K, Sangthawan P. DeepVAQ : an adaptive deep learning for prediction of vascular access quality in hemodialysis patients. BMC Med Inform Decis Mak 2024; 24:45. [PMID: 38347504 PMCID: PMC10860325 DOI: 10.1186/s12911-024-02441-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 01/26/2024] [Indexed: 02/15/2024] Open
Abstract
BACKGROUND Chronic kidney disease is a prevalent global health issue, particularly in advanced stages requiring dialysis. Vascular access (VA) quality is crucial for the well-being of hemodialysis (HD) patients, ensuring optimal blood transfer through a dialyzer machine. The ultrasound dilution technique (UDT) is used as the gold standard for assessing VA quality; however, its limited availability due to high costs impedes its widespread adoption. We aimed to develop a novel deep learning model specifically designed to predict VA quality from Photoplethysmography (PPG) sensors. METHODS Clinical data were retrospectively gathered from 398 HD patients, spanning from February 2021 to February 2022. The DeepVAQ model leverages a convolutional neural network (CNN) to process PPG sensor data, pinpointing specific frequencies and patterns that are indicative of VA quality. Meticulous training and fine-tuning were applied to ensure the model's accuracy and reliability. Validation of the DeepVAQ model was carried out against established diagnostic standards using key performance metrics, including accuracy, specificity, precision, F-score, and area under the receiver operating characteristic curve (AUC). RESULT DeepVAQ demonstrated superior performance, achieving an accuracy of 0.9213 and a specificity of 0.9614. Its precision and F-score stood at 0.8762 and 0.8364, respectively, with an AUC of 0.8605. In contrast, traditional models like Decision Tree, Naive Bayes, and kNN demonstrated significantly lower performance across these metrics. This comparison underscores DeepVAQ's enhanced capability in accurately predicting VA quality compared to existing methodologies. CONCLUSION Exemplifying the potential of artificial intelligence in healthcare, particularly in the realm of deep learning, DeepVAQ represents a significant advancement in non-invasive diagnostics. Its precise multi-class classification ability for VA quality in hemodialysis patients holds substantial promise for improving patient outcomes, potentially leading to a reduction in mortality rates.
Collapse
Affiliation(s)
- Sarayut Julkaew
- College of Digital Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Thakerng Wongsirichot
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand.
| | - Kasikrit Damkliang
- Division of Computational Science, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Pornpen Sangthawan
- Department of Medicine, Division of Nephrology, Faculty of Medicine, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| |
Collapse
|
11
|
Wu BF, Chiu LW, Wu YC, Lai CC, Cheng HM, Chu PH. Contactless Blood Pressure Measurement Via Remote Photoplethysmography With Synthetic Data Generation Using Generative Adversarial Networks. IEEE J Biomed Health Inform 2024; 28:621-632. [PMID: 37037253 DOI: 10.1109/jbhi.2023.3265857] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2023]
Abstract
Remote photoplethysmography (rPPG) has been used to measure vital signs such as heart rate, heart rate variability, blood pressure (BP), and blood oxygen. Recent studies adopt features developed with photoplethysmography (PPG) to achieve contactless BP measurement via rPPG. These features can be classified into two groups: time or phase differences from multiple signals, or waveform feature analysis from a single signal. Here we devise a solution to extract the time difference information from the rPPG signal captured at 30 FPS. We also propose a deep learning model architecture to estimate BP from the extracted features. To prevent overfitting and compensate for the lack of data, we leverage a multi-model design and generate synthetic data. We also use subject information related to BP to assist in model learning. For real-world usage, the subject information is replaced with values estimated from face images, with performance that is still better than the state-of-the-art. To our best knowledge, the improvements can be achieved because of: 1) the model selection with estimated subject information, 2) replacing the estimated subject information with the real one, 3) the InfoGAN assistance training (synthetic data generation), and 4) the time difference features as model input. To evaluate the performance of the proposed method, we conduct a series of experiments, including dynamic BP measurement for many single subjects and nighttime BP measurement with infrared lighting. Our approach reduces the MAE from 15.49 to 8.78 mmHg for systolic blood pressure (SBP) and 10.56 to 6.16 mmHg for diastolic blood pressure(DBP) on a self-constructed rPPG dataset. On the Taipei Veterans General Hospital(TVGH) dataset for nighttime applications, the MAE is reduced from 21.58 to 11.12 mmHg for SBP and 9.74 to 7.59 mmHg for DBP, with improvement ratios of 48.47% and 22.07% respectively.
Collapse
|
12
|
Liu Y, Yu J, Mou H. Photoplethysmography-based cuffless blood pressure estimation: an image encoding and fusion approach. Physiol Meas 2023; 44:125004. [PMID: 38099538 DOI: 10.1088/1361-6579/ad0426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 10/17/2023] [Indexed: 12/18/2023]
Abstract
Objective.Photoplethysmography (PPG) is a promising wearable technology that detects volumetric changes in microcirculation using a light source and a sensor on the skin's surface. PPG has been shown to be useful for non-invasive blood pressure (BP) measurement. Deep learning-based BP measurements are now gaining popularity. However, almost all methods focus on 1D PPG. We aimed to design an end-to-end approach for estimating BP using image encodings from a 2D perspective.Approach.In this paper, we present a BP estimation approach based on an image encoding and fusion (BP-IEF) technique. We convert the PPG into five image encodings and use them as input. The proposed BP-IEF consists of two parts: an encoder and a decoder. In addition, three kinds of well-known neural networks are taken as the fundamental architecture of the encoder. The decoder is a hybrid architecture that consists of convolutional and fully connected layers, which are used to fuse features from the encoder.Main results.The performance of the proposed BP-IEF is evaluated on the UCI database in both non-mixed and mixed manners. On the non-mixed dataset, the root mean square error and mean absolute error for systolic BP (SBP) are 13.031 mmHg and 9.187 mmHg respectively, while for diastolic BP (DBP) they are 5.049 mmHg and 3.810 mmHg. On the mixed dataset, the corresponding values for SBP are 4.623 mmHg and 3.058 mmHg, while for DBP the values are 2.350 mmHg and 1.608 mmHg. In addition, both SBP and DBP estimation on the mixed dataset achieved grade A compared to the British Hypertension Society standard. The DBP estimation on the non-mixed dataset also achieved grade A.Significance.The results indicate that the proposed approach has the potential to improve on the current mobile healthcare for cuffless BP measurement.
Collapse
Affiliation(s)
- Yinsong Liu
- Department of School of Electronic Engineering, Beijing University of Posts and Telecommunication, Beijing 100876, People's Republic of China
| | - Junsheng Yu
- Department of School of Electronic Engineering, Beijing University of Posts and Telecommunication, Beijing 100876, People's Republic of China
- School of Physics and Electronic Information, Anhui Normal University, Wuhu 241003, People's Republic of China
- School of Intelligence and Digital Engineering, Luoyang Vocational College of Science and Technology, Luoyang 471000, People's Republic of China
| | - Hanlin Mou
- Chinese Academy of Sciences Aerospace Information Research Institute, Beijing 100094, People's Republic of China
| |
Collapse
|
13
|
Jiang X, Zhang J, Mu W, Wang K, Li L, Zhang L. TRCCBP: Transformer Network for Radar-Based Contactless Continuous Blood Pressure Monitoring. SENSORS (BASEL, SWITZERLAND) 2023; 23:9680. [PMID: 38139525 PMCID: PMC10747831 DOI: 10.3390/s23249680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Revised: 11/10/2023] [Accepted: 11/28/2023] [Indexed: 12/24/2023]
Abstract
Contactless continuous blood pressure (BP) monitoring is of great significance for daily healthcare. Radar-based continuous monitoring methods typically extract time-domain features manually such as pulse transit time (PTT) to calculate the BP. However, breathing and slight body movements usually distort the features extracted from pulse-wave signals, especially in long-term continuous monitoring, and manually extracted features may have limited performance for BP estimation. This article proposes a Transformer network for Radar-based Contactless Continuous Blood Pressure monitoring (TRCCBP). A heartbeat signal-guided single-beat pulse wave extraction method is designed to obtain pure pulse-wave signals. A transformer network-based blood pressure estimation network is proposed to estimate BP, which utilizes convolutional layers with different scales, a gated recurrent unit (GRU) to capture time-dependence in continuous radar signal and multi-head attention modules to capture deep temporal domain characteristics. A radar signal dataset captured in an indoor environment containing 31 persons and a real medical situation containing five persons is set up to evaluate the performance of TRCCBP. Compared with the state-of-the-art method, the average accuracy of diastolic blood pressure (DBP) and systolic blood pressure (SBP) is 4.49 mmHg and 4.73 mmHg, improved by 12.36 mmHg and 8.80 mmHg, respectively. The proposed TRCCBP source codes and radar signal dataset have been made open-source online for further research.
Collapse
Affiliation(s)
- Xikang Jiang
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (X.J.)
| | - Jinhui Zhang
- Logistic Support Center, Chinese PLA General Hospital, Beijing 100853, China
| | - Wenyao Mu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (X.J.)
| | - Kun Wang
- Logistic Support Center, Chinese PLA General Hospital, Beijing 100853, China
| | - Lei Li
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (X.J.)
| | - Lin Zhang
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China; (X.J.)
| |
Collapse
|
14
|
Baker S, Yogavijayan T, Kandasamy Y. Towards Non-Invasive and Continuous Blood Pressure Monitoring in Neonatal Intensive Care Using Artificial Intelligence: A Narrative Review. Healthcare (Basel) 2023; 11:3107. [PMID: 38131997 PMCID: PMC10743031 DOI: 10.3390/healthcare11243107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/29/2023] [Accepted: 12/04/2023] [Indexed: 12/23/2023] Open
Abstract
Preterm birth is a live birth that occurs before 37 completed weeks of pregnancy. Approximately 11% of babies are born preterm annually worldwide. Blood pressure (BP) monitoring is essential for managing the haemodynamic stability of preterm infants and impacts outcomes. However, current methods have many limitations associated, including invasive measurement, inaccuracies, and infection risk. In this narrative review, we find that artificial intelligence (AI) is a promising tool for the continuous measurement of BP in a neonatal cohort, based on data obtained from non-invasive sensors. Our findings highlight key sensing technologies, AI techniques, and model assessment metrics for BP sensing in the neonatal cohort. Moreover, our findings show that non-invasive BP monitoring leveraging AI has shown promise in adult cohorts but has not been broadly explored for neonatal cohorts. We conclude that there is a significant research opportunity in developing an innovative approach to provide a non-invasive alternative to existing continuous BP monitoring methods, which has the potential to improve outcomes for premature babies.
Collapse
Affiliation(s)
- Stephanie Baker
- College of Science and Engineering, James Cook University, Cairns, QLD 4878, Australia
| | - Thiviya Yogavijayan
- College of Medicine and Dentistry, James Cook University, Townsville, QLD 4811, Australia;
| | - Yogavijayan Kandasamy
- Department of Neonatology, Townsville University Hospital, Townsville, QLD 4811, Australia;
| |
Collapse
|
15
|
Pankaj, Kumar A, Kumar M, Komaragiri R. Optimized deep neural network models for blood pressure classification using Fourier analysis-based time-frequency spectrogram of photoplethysmography signal. Biomed Eng Lett 2023; 13:739-750. [PMID: 37872982 PMCID: PMC10590347 DOI: 10.1007/s13534-023-00296-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 05/28/2023] [Accepted: 06/09/2023] [Indexed: 10/25/2023] Open
Abstract
Appropriate blood pressure (BP) management through continuous monitoring and rapid diagnosis helps to take preventive care against cardiovascular diseases (CVD). As hypertension is one of the leading causes of CVDs, keeping hypertension under control by a timely screening of subjects becomes lifesaving. This work proposes estimating BP from motion artifact-affected photoplethysmography signals (PPG) by applying signal processing techniques in realtime. This paper proposes a deep neural network-based methodology to accurately classify PPG signals using a Fourier theory-based time-frequency (TF) spectrogram. This work uses the Fourier decomposition method (FDM) to transform a PPG signal into a TF spectrogram. In the proposed work, the last three layers of the pre-trained deep neural network, namely, GoogleNet, DenseNet, and AlexNet, are modified and then used to classify the PPG signal into normotension, pre-hypertension, and hypertension. The proposed framework is trained and tested using the MIMIC-III and PPG-BP databases using five-fold training and testing. Out of the three deep neural networks, the proposed framework with the DenseNet-201 network performs best, with a test accuracy of 96.5%. The proposed work uses FDM to compute the TF spectrogram to accurately separate the motion artifacts and noise components from a noise-corrupted PPG signal. Capturing more frequency components that contain more information from PPG signals makes the deep neural networks extract better and more meaningful features. Thus, training a deep neural network model with clean PPG signal features improves the generalized capability of a BP classification model when tested in realtime.
Collapse
Affiliation(s)
- Pankaj
- Department of Electronics and Communication Engineering, Bennett University, Greater Noida, India
| | - Ashish Kumar
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu India
| | - Manjeet Kumar
- Department of Electronics and Communication Engineering, Delhi Technological University, Delhi, India
| | - Rama Komaragiri
- Department of Electronics and Communication Engineering, Bennett University, Greater Noida, India
| |
Collapse
|
16
|
Xing W, Shi Y, Wu C, Wang Y, Wang X. Predicting blood pressure from face videos using face diagnosis theory and deep neural networks technique. Comput Biol Med 2023; 164:107112. [PMID: 37481950 DOI: 10.1016/j.compbiomed.2023.107112] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/13/2023] [Accepted: 05/30/2023] [Indexed: 07/25/2023]
Abstract
Hypertension is a major cause of cardiovascular diseases. Accurate and convenient measurement of blood pressure are necessary for the detection, treatment, and control of hypertension. In recent years, face video based non-contact blood pressure prediction is a promising research topic. Interestingly, face diagnosis has been an important part of traditional Chinese medicine (TCM) for thousands of years. TCM practitioners observe some typical regions of the face to determine the health status of the Zang Fu organs (i.e., heart). However, the effectiveness of face diagnosis theory in conjunction with computer vision analysis techniques to predict blood pressure is unclear. We proposed an artificial intelligence framework for predicting blood pressure using deep convolutional neural networks in this study. First, we extracted pulse wave signals through 652 facial videos. Then, we trained and compared nine artificial neural networks and chose the best performed prediction model, with an overall true predict rate of 90%. We also investigated the impact of face reflex regions selection on blood pressure prediction model, and the five face regions outperformed. Our high effectiveness and stability framework may provide an objective and convenient computer-aided blood pressure prediction method for hypertension screening and disease prevention.
Collapse
Affiliation(s)
- Weiying Xing
- School of Traditional Chinese Medicine, Beijing University of Chinese Medicine, Beijing, 102488, China.
| | - Yinni Shi
- School of Information, North China University of Technology, Beijing, 100144, China.
| | - Chaoyong Wu
- School of Traditional Chinese Medicine, Beijing University of Chinese Medicine, Beijing, 102488, China.
| | - Yiqiao Wang
- School of Management, Beijing University of Chinese Medicine, Beijing, 102488, China.
| | - Xu Wang
- School of Life Science, Beijing University of Chinese Medicine, Beijing, 102488, China.
| |
Collapse
|
17
|
Sel K, Mohammadi A, Pettigrew RI, Jafari R. Physics-informed neural networks for modeling physiological time series for cuffless blood pressure estimation. NPJ Digit Med 2023; 6:110. [PMID: 37296218 DOI: 10.1038/s41746-023-00853-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 05/24/2023] [Indexed: 06/12/2023] Open
Abstract
The bold vision of AI-driven pervasive physiological monitoring, through the proliferation of off-the-shelf wearables that began a decade ago, has created immense opportunities to extract actionable information for precision medicine. These AI algorithms model input-output relationships of a system that, in many cases, exhibits complex nature and personalization requirements. A particular example is cuffless blood pressure estimation using wearable bioimpedance. However, these algorithms need training over significant amount of ground truth data. In the context of biomedical applications, collecting ground truth data, particularly at the personalized level is challenging, burdensome, and in some cases infeasible. Our objective is to establish physics-informed neural network (PINN) models for physiological time series data that would use minimal ground truth information to extract complex cardiovascular information. We achieve this by building Taylor's approximation for gradually changing known cardiovascular relationships between input and output (e.g., sensor measurements to blood pressure) and incorporating this approximation into our proposed neural network training. The effectiveness of the framework is demonstrated through a case study: continuous cuffless BP estimation from time series bioimpedance data. We show that by using PINNs over the state-of-the-art time series models tested on the same datasets, we retain high correlations (systolic: 0.90, diastolic: 0.89) and low error (systolic: 1.3 ± 7.6 mmHg, diastolic: 0.6 ± 6.4 mmHg) while reducing the amount of ground truth training data on average by a factor of 15. This could be helpful in developing future AI algorithms to help interpret pervasive physiologic data using minimal amount of training data.
Collapse
Affiliation(s)
- Kaan Sel
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA
| | - Amirmohammad Mohammadi
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA
| | | | - Roozbeh Jafari
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA.
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA.
- School of Engineering Medicine, Texas A&M University, Houston, TX, USA.
| |
Collapse
|
18
|
Zhao L, Liang C, Huang Y, Zhou G, Xiao Y, Ji N, Zhang YT, Zhao N. Emerging sensing and modeling technologies for wearable and cuffless blood pressure monitoring. NPJ Digit Med 2023; 6:93. [PMID: 37217650 DOI: 10.1038/s41746-023-00835-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 05/05/2023] [Indexed: 05/24/2023] Open
Abstract
Cardiovascular diseases (CVDs) are a leading cause of death worldwide. For early diagnosis, intervention and management of CVDs, it is highly desirable to frequently monitor blood pressure (BP), a vital sign closely related to CVDs, during people's daily life, including sleep time. Towards this end, wearable and cuffless BP extraction methods have been extensively researched in recent years as part of the mobile healthcare initiative. This review focuses on the enabling technologies for wearable and cuffless BP monitoring platforms, covering both the emerging flexible sensor designs and BP extraction algorithms. Based on the signal type, the sensing devices are classified into electrical, optical, and mechanical sensors, and the state-of-the-art material choices, fabrication methods, and performances of each type of sensor are briefly reviewed. In the model part of the review, contemporary algorithmic BP estimation methods for beat-to-beat BP measurements and continuous BP waveform extraction are introduced. Mainstream approaches, such as pulse transit time-based analytical models and machine learning methods, are compared in terms of their input modalities, features, implementation algorithms, and performances. The review sheds light on the interdisciplinary research opportunities to combine the latest innovations in the sensor and signal processing research fields to achieve a new generation of cuffless BP measurement devices with improved wearability, reliability, and accuracy.
Collapse
Affiliation(s)
- Lei Zhao
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Cunman Liang
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Yan Huang
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Guodong Zhou
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Yiqun Xiao
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Nan Ji
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Yuan-Ting Zhang
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China
| | - Ni Zhao
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China.
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering (COCHE), Hong Kong, China.
| |
Collapse
|
19
|
Qin C, Li Y, Liu C, Ma X. Cuff-Less Blood Pressure Prediction Based on Photoplethysmography and Modified ResNet. Bioengineering (Basel) 2023; 10:bioengineering10040400. [PMID: 37106587 PMCID: PMC10135940 DOI: 10.3390/bioengineering10040400] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2023] [Revised: 03/20/2023] [Accepted: 03/20/2023] [Indexed: 04/29/2023] Open
Abstract
Cardiovascular disease (CVD) has become a common health problem of mankind, and the prevalence and mortality of CVD are rising on a year-to-year basis. Blood pressure (BP) is an important physiological parameter of the human body and also an important physiological indicator for the prevention and treatment of CVD. Existing intermittent measurement methods do not fully indicate the real BP status of the human body and cannot get rid of the restraining feeling of a cuff. Accordingly, this study proposed a deep learning network based on the ResNet34 framework for continuous prediction of BP using only the promising PPG signal. The high-quality PPG signals were first passed through a multi-scale feature extraction module after a series of pre-processing to expand the perceptive field and enhance the perception ability on features. Subsequently, useful feature information was then extracted by stacking multiple residual modules with channel attention to increase the accuracy of the model. Lastly, in the training stage, the Huber loss function was adopted to stabilize the iterative process and obtain the optimal solution of the model. On a subset of the MIMIC dataset, the errors of both SBP and DBP predicted by the model met the AAMI standards, while the accuracy of DBP reached Grade A of the BHS standard, and the accuracy of SBP almost reached Grade A of the BHS standard. The proposed method verifies the potential and feasibility of PPG signals combined with deep neural networks in the field of continuous BP monitoring. Furthermore, the method is easy to deploy in portable devices, and it is more consistent with the future trend of wearable blood-pressure-monitoring devices (e.g., smartphones and smartwatches).
Collapse
Affiliation(s)
- Caijie Qin
- Institute of Information Engineering, Sanming University, Sanming 365004, China
- CBSR&NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing 100049, China
| | - Yong Li
- Institute of Information Engineering, Sanming University, Sanming 365004, China
| | - Chibiao Liu
- Institute of Information Engineering, Sanming University, Sanming 365004, China
| | - Xibo Ma
- CBSR&NLPR, Institute of Automation, Chinese Academy of Sciences, Beijing 100049, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
20
|
González S, Hsieh WT, Chen TPC. A benchmark for machine-learning based non-invasive blood pressure estimation using photoplethysmogram. Sci Data 2023; 10:149. [PMID: 36944668 PMCID: PMC10030661 DOI: 10.1038/s41597-023-02020-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 02/14/2023] [Indexed: 03/23/2023] Open
Abstract
Blood Pressure (BP) is an important cardiovascular health indicator. BP is usually monitored non-invasively with a cuff-based device, which can be bulky and inconvenient. Thus, continuous and portable BP monitoring devices, such as those based on a photoplethysmography (PPG) waveform, are desirable. In particular, Machine Learning (ML) based BP estimation approaches have gained considerable attention as they have the potential to estimate intermittent or continuous BP with only a single PPG measurement. Over the last few years, many ML-based BP estimation approaches have been proposed with no agreement on their modeling methodology. To ease the model comparison, we designed a benchmark with four open datasets with shared preprocessing, the right validation strategy avoiding information shift and leak, and standard evaluation metrics. We also adapted Mean Absolute Scaled Error (MASE) to improve the interpretability of model evaluation, especially across different BP datasets. The proposed benchmark comes with open datasets and codes. We showcase its effectiveness by comparing 11 ML-based approaches of three different categories.
Collapse
|
21
|
Chen Y, Zhuang J, Li B, Zhang Y, Zheng X. Remote Blood Pressure Estimation via the Spatiotemporal Mapping of Facial Videos. SENSORS (BASEL, SWITZERLAND) 2023; 23:2963. [PMID: 36991677 PMCID: PMC10055237 DOI: 10.3390/s23062963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 03/03/2023] [Accepted: 03/06/2023] [Indexed: 06/19/2023]
Abstract
Blood pressure (BP) monitoring is vital in daily healthcare, especially for cardiovascular diseases. However, BP values are mainly acquired through a contact-sensing method, which is inconvenient and unfriendly for BP monitoring. This paper proposes an efficient end-to-end network for estimating BP values from a facial video to achieve remote BP estimation in daily life. The network first derives a spatiotemporal map of a facial video. Then, it regresses the BP ranges with a designed blood pressure classifier and simultaneously calculates the specific value with a blood pressure calculator in each BP range based on the spatiotemporal map. In addition, an innovative oversampling training strategy was developed to handle the problem of unbalanced data distribution. Finally, we trained the proposed blood pressure estimation network on a private dataset, MPM-BP, and tested it on a popular public dataset, MMSE-HR. As a result, the proposed network achieved a mean absolute error (MAE) and root mean square error (RMSE) of 12.35 mmHg and 16.55 mmHg on systolic BP estimations, and those for diastolic BP were 9.54 mmHg and 12.22 mmHg, which were better than the values obtained in recent works. It can be concluded that the proposed method has excellent potential for camera-based BP monitoring in the indoor scenarios in the real world.
Collapse
Affiliation(s)
- Yuheng Chen
- Department of Automation, College of Electrical Engineering, Sichuan University, Chengdu 610065, China
- Key Laboratory of Information and Automation Technology of Sichuan Province, Chengdu 610065, China
| | - Jialiang Zhuang
- Department of Automation, College of Electrical Engineering, Sichuan University, Chengdu 610065, China
| | - Bin Li
- School of Computer Science, Northwest University, Xi’an 710069, China
| | - Yun Zhang
- School of Information Science and Technology, Xi’an Jiaotong University, Xi’an 710049, China
| | - Xiujuan Zheng
- Department of Automation, College of Electrical Engineering, Sichuan University, Chengdu 610065, China
- Key Laboratory of Information and Automation Technology of Sichuan Province, Chengdu 610065, China
| |
Collapse
|
22
|
Hamoud B, Kashevnik A, Othman W, Shilov N. Neural Network Model Combination for Video-Based Blood Pressure Estimation: New Approach and Evaluation. SENSORS (BASEL, SWITZERLAND) 2023; 23:1753. [PMID: 36850349 PMCID: PMC9959092 DOI: 10.3390/s23041753] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 01/23/2023] [Accepted: 02/02/2023] [Indexed: 06/18/2023]
Abstract
One of the most effective vital signs of health conditions is blood pressure. It has such an impact that changes your state from completely relaxed to extremely unpleasant, which makes the task of blood pressure monitoring a main procedure that almost everyone undergoes whenever there is something wrong or suspicious with his/her health condition. The most popular and accurate ways to measure blood pressure are cuff-based, inconvenient, and pricey, but on the bright side, many experimental studies prove that changes in the color intensities of the RGB channels represent variation in the blood that flows beneath the skin, which is strongly related to blood pressure; hence, we present a novel approach to blood pressure estimation based on the analysis of human face video using hybrid deep learning models. We deeply analyzed proposed approaches and methods to develop combinations of state-of-the-art models that were validated by their testing results on the Vision for Vitals (V4V) dataset compared to the performance of other available proposed models. Additionally, we came up with a new metric to evaluate the performance of our models using Pearson's correlation coefficient between the predicted blood pressure of the subjects and their respiratory rate at each minute, which is provided by our own dataset that includes 60 videos of operators working on personal computers for almost 20 min in each video. Our method provides a cuff-less, fast, and comfortable way to estimate blood pressure with no need for any equipment except the camera of your smartphone.
Collapse
Affiliation(s)
- Batol Hamoud
- Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia
| | - Alexey Kashevnik
- St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia
- Department of Applied Mathematics and Cybernetics, Institute of Mathematics and Information Technologies, Petrozavodsk State University (PetrSU), Petrozavodsk 185910, Russia
| | - Walaa Othman
- Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia
| | - Nikolay Shilov
- St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia
| |
Collapse
|
23
|
Qin K, Huang W, Zhang T, Tang S. Machine learning and deep learning for blood pressure prediction: a methodological review from multiple perspectives. Artif Intell Rev 2022. [DOI: 10.1007/s10462-022-10353-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
24
|
Khan Mamun MMR, Sherif A. Advancement in the Cuffless and Noninvasive Measurement of Blood Pressure: A Review of the Literature and Open Challenges. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 10:bioengineering10010027. [PMID: 36671599 PMCID: PMC9854981 DOI: 10.3390/bioengineering10010027] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 12/20/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022]
Abstract
Hypertension is a chronic condition that is one of the prominent reasons behind cardiovascular disease, brain stroke, and organ failure. Left unnoticed and untreated, the deterioration in a health condition could even result in mortality. If it can be detected early, with proper treatment, undesirable outcomes can be avoided. Until now, the gold standard is the invasive way of measuring blood pressure (BP) using a catheter. Additionally, the cuff-based and noninvasive methods are too cumbersome or inconvenient for frequent measurement of BP. With the advancement of sensor technology, signal processing techniques, and machine learning algorithms, researchers are trying to find the perfect relationships between biomedical signals and changes in BP. This paper is a literature review of the studies conducted on the cuffless noninvasive measurement of BP using biomedical signals. Relevant articles were selected using specific criteria, then traditional techniques for BP measurement were discussed along with a motivation for cuffless measurement use of biomedical signals and machine learning algorithms. The review focused on the progression of different noninvasive cuffless techniques rather than comparing performance among different studies. The literature survey concluded that the use of deep learning proved to be the most accurate among all the cuffless measurement techniques. On the other side, this accuracy has several disadvantages, such as lack of interpretability, computationally extensive, standard validation protocol, and lack of collaboration with health professionals. Additionally, the continuing work by researchers is progressing with a potential solution for these challenges. Finally, future research directions have been provided to encounter the challenges.
Collapse
Affiliation(s)
| | - Ahmed Sherif
- School of Computing Sciences and Computer Engineering, The University of Southern Mississippi, Hattiesburg, MS 39406, USA
| |
Collapse
|
25
|
Ku CJ, Wang Y, Chang CY, Wu MT, Dai ST, Liao LD. Noninvasive blood oxygen, heartbeat rate, and blood pressure parameter monitoring by photoplethysmography signals. Heliyon 2022; 8:e11698. [DOI: 10.1016/j.heliyon.2022.e11698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 08/02/2022] [Accepted: 11/10/2022] [Indexed: 11/19/2022] Open
|
26
|
Man PK, Cheung KL, Sangsiri N, Shek WJ, Wong KL, Chin JW, Chan TT, So RHY. Blood Pressure Measurement: From Cuff-Based to Contactless Monitoring. Healthcare (Basel) 2022; 10:healthcare10102113. [PMID: 36292560 PMCID: PMC9601911 DOI: 10.3390/healthcare10102113] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 09/26/2022] [Accepted: 10/02/2022] [Indexed: 11/04/2022] Open
Abstract
Blood pressure (BP) determines whether a person has hypertension and offers implications as to whether he or she could be affected by cardiovascular disease. Cuff-based sphygmomanometers have traditionally provided both accuracy and reliability, but they require bulky equipment and relevant skills to obtain precise measurements. BP measurement from photoplethysmography (PPG) signals has become a promising alternative for convenient and unobtrusive BP monitoring. Moreover, the recent developments in remote photoplethysmography (rPPG) algorithms have enabled new innovations for contactless BP measurement. This paper illustrates the evolution of BP measurement techniques from the biophysical theory, through the development of contact-based BP measurement from PPG signals, and to the modern innovations of contactless BP measurement from rPPG signals. We consolidate knowledge from a diverse background of academic research to highlight the importance of multi-feature analysis for improving measurement accuracy. We conclude with the ongoing challenges, opportunities, and possible future directions in this emerging field of research.
Collapse
Affiliation(s)
- Ping-Kwan Man
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Correspondence:
| | - Kit-Leong Cheung
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China
| | - Nawapon Sangsiri
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China
| | - Wilfred Jin Shek
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Biomedical Sciences, King’s College London, London WC2R 2LS, UK
| | - Kwan-Long Wong
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Jing-Wei Chin
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Tsz-Tai Chan
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Richard Hau-Yue So
- PanopticAI, Hong Kong Science and Technology Parks, New Territories, Hong Kong, China
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| |
Collapse
|
27
|
Advances in Cuffless Continuous Blood Pressure Monitoring Technology Based on PPG Signals. BIOMED RESEARCH INTERNATIONAL 2022; 2022:8094351. [PMID: 36217389 PMCID: PMC9547685 DOI: 10.1155/2022/8094351] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Accepted: 07/30/2022] [Indexed: 11/17/2022]
Abstract
Objective. To review the progress of research on photoplethysmography- (PPG-) based cuffless continuous blood pressure monitoring technologies and prospect the challenges that need to be addressed in the future. Methods. Using Web of Science and PubMed as search engines, the literature on cuffless continuous blood pressure studies using PPG signals in the recent five years were searched. Results. Based on the retrieved literature, this paper describes the available open datasets, commonly used signal preprocessing methods, and model evaluation criteria. Early researches employed multisite PPG signals to calculate pulse wave velocity or time and predicted blood pressure by a simple linear equation. Later, extensive researches were dedicated to mine the features of PPG signals related to blood pressure and regressed blood pressure by machine learning models. Most recently, many researches have emerged to experiment with complex deep learning models for blood pressure prediction with the raw PPG signal as input. Conclusion. This paper summarized the methods in the retrieved literature, provided insight into the artificial intelligence algorithms employed in the literature, and concluded with a discussion of the challenges and opportunities for the development of cuffless continuous blood pressure monitoring technologies.
Collapse
|
28
|
Fleischhauer V, Feldheiser A, Zaunseder S. Beat-to-Beat Blood Pressure Estimation by Photoplethysmography and Its Interpretation. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22187037. [PMID: 36146386 PMCID: PMC9506534 DOI: 10.3390/s22187037] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Revised: 08/29/2022] [Accepted: 09/13/2022] [Indexed: 05/28/2023]
Abstract
Blood pressure (BP) is among the most important vital signals. Estimation of absolute BP solely using photoplethysmography (PPG) has gained immense attention over the last years. Available works differ in terms of used features as well as classifiers and bear large differences in their results. This work aims to provide a machine learning method for absolute BP estimation, its interpretation using computational methods and its critical appraisal in face of the current literature. We used data from three different sources including 273 subjects and 259,986 single beats. We extracted multiple features from PPG signals and its derivatives. BP was estimated by xgboost regression. For interpretation we used Shapley additive values (SHAP). Absolute systolic BP estimation using a strict separation of subjects yielded a mean absolute error of 9.456mmHg and correlation of 0.730. The results markedly improve if data separation is changed (MAE: 6.366mmHg, r: 0.874). Interpretation by means of SHAP revealed four features from PPG, its derivation and its decomposition to be most relevant. The presented approach depicts a general way to interpret multivariate prediction algorithms and reveals certain features to be valuable for absolute BP estimation. Our work underlines the considerable impact of data selection and of training/testing separation, which must be considered in detail when algorithms are to be compared. In order to make our work traceable, we have made all methods available to the public.
Collapse
Affiliation(s)
- Vincent Fleischhauer
- Faculty of Information Technology, University of Applied Sciences and Arts Dortmund, 44139 Dortmund, Germany
- TU Dresden, Institute for Biomedical Engineering, 01069 Dresden, Germany
| | - Aarne Feldheiser
- Department of Anaesthesiology, Intensive Care Medicine and Pain Therapy, Evang. Kliniken Essen-Mitte, Huyssens-Stiftung/Knappschaft, 45136 Essen, Germany
- Department of Anaesthesiology and Operative Intensive Care Medicine (CCM, CVK), Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, 13353 Berlin, Germany
| | - Sebastian Zaunseder
- Faculty of Information Technology, University of Applied Sciences and Arts Dortmund, 44139 Dortmund, Germany
- TU Dresden, Institute for Biomedical Engineering, 01069 Dresden, Germany
| |
Collapse
|
29
|
Estimation of blood pressure waveform from facial video using a deep U-shaped network and the wavelet representation of imaging photoplethysmographic signals. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
30
|
Fine J, McShane MJ, Coté GL, Scully CG. A Computational Modeling and Simulation Workflow to Investigate the Impact of Patient-Specific and Device Factors on Hemodynamic Measurements from Non-Invasive Photoplethysmography. BIOSENSORS 2022; 12:bios12080598. [PMID: 36004994 PMCID: PMC9405581 DOI: 10.3390/bios12080598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 07/16/2022] [Accepted: 07/27/2022] [Indexed: 11/23/2022]
Abstract
Cardiovascular disease is the leading cause of death globally. To provide continuous monitoring of blood pressure (BP), a parameter which has shown to improve health outcomes when monitored closely, many groups are trying to measure blood pressure via noninvasive photoplethysmography (PPG). However, the PPG waveform is subject to variation as a function of patient-specific and device factors and thus a platform to enable the evaluation of these factors on the PPG waveform and subsequent hemodynamic parameter prediction would enable device development. Here, we present a computational workflow that combines Monte Carlo modeling (MC), gaussian combination, and additive noise to create synthetic dataset of volar fingertip PPG waveforms representative of a diverse cohort. First, MC is used to determine PPG amplitude across age, skin tone, and device wavelength. Then, gaussian combination generates accurate PPG waveforms, and signal processing enables data filtration and feature extraction. We improve the limitations of current synthetic PPG frameworks by enabling inclusion of physiological and anatomical effects from body site, skin tone, and age. We then show how the datasets can be used to examine effects of device characteristics such as wavelength, analog to digital converter specifications, filtering method, and feature extraction. Lastly, we demonstrate the use of this framework to show the insensitivity of a support vector machine predictive algorithm compared to a neural network and bagged trees algorithm.
Collapse
Affiliation(s)
- Jesse Fine
- Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Michael J. McShane
- Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
- Center for Remote Health Technologies and Systems, Texas A&M Engineering Experiment Station, Texas A&M University, College Station, TX 77843, USA
- Department of Materials Science and Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Gerard L. Coté
- Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
- Center for Remote Health Technologies and Systems, Texas A&M Engineering Experiment Station, Texas A&M University, College Station, TX 77843, USA
- Correspondence:
| | - Christopher G. Scully
- Office of Science and Engineering Laboratories, Division of Biomedical Physics, Center for Devices and Radiological Health, Food and Drug Administration, Silver Spring, MD 20993, USA
| |
Collapse
|
31
|
Markuleva M, Gerashchenko M, Gerashchenko S, Khizbullin R, Ivshin I. The Hemodynamic Parameters Values Prediction on the Non-Invasive Hydrocuff Technology Basis with a Neural Network Applying. SENSORS 2022; 22:s22114229. [PMID: 35684849 PMCID: PMC9185255 DOI: 10.3390/s22114229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 05/20/2022] [Accepted: 05/25/2022] [Indexed: 12/10/2022]
Abstract
The task to develop a mechanism for predicting the hemodynamic parameters values based on non-invasive hydrocuff technology of a pulse wave signal fixation is described in this study. The advantages and disadvantages of existing methods of recording the ripple curve are noted in the published materials. This study proposes a new hydrocuff method for hemodynamic parameters and blood pressure values measuring. A block diagram of the device being developed is presented. Algorithms for processing the pulse wave contour are presented. A neural network applying necessity for the multiparametric feature space formation is substantiated. The pulse wave contours obtained using hydrocuff technology of oscillation formation for various age groups are presented. According to preliminary estimates, by the moment of the dicrotic surge formation, it is possible to judge the ratio of the heart and blood vessels work, which makes it possible to form an expanded feature space of significant parameters based on neural network classifiers. This study presents the characteristics accounted for creating a database for training a neural network.
Collapse
Affiliation(s)
- Marina Markuleva
- Medical Cybernetics and Computer Science Department, Penza State University, 440026 Penza, Russia; marina-- (M.M.); (M.G.); (S.G.)
| | - Mikhail Gerashchenko
- Medical Cybernetics and Computer Science Department, Penza State University, 440026 Penza, Russia; marina-- (M.M.); (M.G.); (S.G.)
| | - Sergey Gerashchenko
- Medical Cybernetics and Computer Science Department, Penza State University, 440026 Penza, Russia; marina-- (M.M.); (M.G.); (S.G.)
| | - Robert Khizbullin
- Kazan State Power Engineering University, Krasnoselskaya, 51, 420066 Kazan, Russia;
- Correspondence:
| | - Igor Ivshin
- Kazan State Power Engineering University, Krasnoselskaya, 51, 420066 Kazan, Russia;
| |
Collapse
|
32
|
Molinaro N, Schena E, Silvestri S, Massaroni C. Multi-ROI Spectral Approach for the Continuous Remote Cardio-Respiratory Monitoring from Mobile Device Built-In Cameras. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22072539. [PMID: 35408151 PMCID: PMC9002464 DOI: 10.3390/s22072539] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 03/16/2022] [Accepted: 03/23/2022] [Indexed: 05/05/2023]
Abstract
Heart rate (HR) and respiratory rate (fR) can be estimated by processing videos framing the upper body and face regions without any physical contact with the subject. This paper proposed a technique for continuously monitoring HR and fR via a multi-ROI approach based on the spectral analysis of RGB video frames recorded with a mobile device (i.e., a smartphone's camera). The respiratory signal was estimated by the motion of the chest, whereas the cardiac signal was retrieved from the pulsatile activity at the level of right and left cheeks and forehead. Videos were recorded from 18 healthy volunteers in four sessions with different user-camera distances (i.e., 0.5 m and 1.0 m) and illumination conditions (i.e., natural and artificial light). For HR estimation, three approaches were investigated based on single or multi-ROI approaches. A commercially available multiparametric device was used to record reference respiratory signals and electrocardiogram (ECG). The results demonstrated that the multi-ROI approach outperforms the single-ROI approach providing temporal trends of both the vital parameters comparable to those provided by the reference, with a mean absolute error (MAE) consistently below 1 breaths·min-1 for fR in all the scenarios, and a MAE between 0.7 bpm and 6 bpm for HR estimation, whose values increase at higher distances.
Collapse
Affiliation(s)
- Nunzia Molinaro
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy
| | - Emiliano Schena
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy
| | - Sergio Silvestri
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy
| | - Carlo Massaroni
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy
| |
Collapse
|
33
|
Almarshad MA, Islam MS, Al-Ahmadi S, BaHammam AS. Diagnostic Features and Potential Applications of PPG Signal in Healthcare: A Systematic Review. Healthcare (Basel) 2022; 10:healthcare10030547. [PMID: 35327025 PMCID: PMC8950880 DOI: 10.3390/healthcare10030547] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 03/03/2022] [Accepted: 03/11/2022] [Indexed: 02/04/2023] Open
Abstract
Recent research indicates that Photoplethysmography (PPG) signals carry more information than oxygen saturation level (SpO2) and can be utilized for affordable, fast, and noninvasive healthcare applications. All these encourage the researchers to estimate its feasibility as an alternative to many expansive, time-wasting, and invasive methods. This systematic review discusses the current literature on diagnostic features of PPG signal and their applications that might present a potential venue to be adapted into many health and fitness aspects of human life. The research methodology is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines 2020. To this aim, papers from 1981 to date are reviewed and categorized in terms of the healthcare application domain. Along with consolidated research areas, recent topics that are growing in popularity are also discovered. We also highlight the potential impact of using PPG signals on an individual’s quality of life and public health. The state-of-the-art studies suggest that in the years to come PPG wearables will become pervasive in many fields of medical practices, and the main domains include cardiology, respiratory, neurology, and fitness. Main operation challenges, including performance and robustness obstacles, are identified.
Collapse
Affiliation(s)
- Malak Abdullah Almarshad
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia; (M.S.I.); (S.A.-A.)
- Computer Science Department, College of Computer and Information Sciences, Al-Imam Mohammad Ibn Saud Islamic University, Riyadh 11432, Saudi Arabia
- Correspondence:
| | - Md Saiful Islam
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia; (M.S.I.); (S.A.-A.)
| | - Saad Al-Ahmadi
- Computer Science Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia; (M.S.I.); (S.A.-A.)
| | - Ahmed S. BaHammam
- The University Sleep Disorders Center, Department of Medicine, College of Medicine, King Saud University, Riyadh 11324, Saudi Arabia;
| |
Collapse
|
34
|
Park J, Seok HS, Kim SS, Shin H. Photoplethysmogram Analysis and Applications: An Integrative Review. Front Physiol 2022; 12:808451. [PMID: 35300400 PMCID: PMC8920970 DOI: 10.3389/fphys.2021.808451] [Citation(s) in RCA: 49] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 12/21/2021] [Indexed: 12/03/2022] Open
Abstract
Beyond its use in a clinical environment, photoplethysmogram (PPG) is increasingly used for measuring the physiological state of an individual in daily life. This review aims to examine existing research on photoplethysmogram concerning its generation mechanisms, measurement principles, clinical applications, noise definition, pre-processing techniques, feature detection techniques, and post-processing techniques for photoplethysmogram processing, especially from an engineering point of view. We performed an extensive search with the PubMed, Google Scholar, Institute of Electrical and Electronics Engineers (IEEE), ScienceDirect, and Web of Science databases. Exclusion conditions did not include the year of publication, but articles not published in English were excluded. Based on 118 articles, we identified four main topics of enabling PPG: (A) PPG waveform, (B) PPG features and clinical applications including basic features based on the original PPG waveform, combined features of PPG, and derivative features of PPG, (C) PPG noise including motion artifact baseline wandering and hypoperfusion, and (D) PPG signal processing including PPG preprocessing, PPG peak detection, and signal quality index. The application field of photoplethysmogram has been extending from the clinical to the mobile environment. Although there is no standardized pre-processing pipeline for PPG signal processing, as PPG data are acquired and accumulated in various ways, the recently proposed machine learning-based method is expected to offer a promising solution.
Collapse
Affiliation(s)
- Junyung Park
- Department of Biomedical Engineering, Chonnam National University, Yeosu, South Korea
| | - Hyeon Seok Seok
- Department of Biomedical Engineering, Chonnam National University, Yeosu, South Korea
| | - Sang-Su Kim
- Department of Biomedical Engineering, Chonnam National University, Yeosu, South Korea
| | - Hangsik Shin
- Department of Convergence Medicine, University of Ulsan College of Medicine, Asan Medical Center, Seoul, South Korea
| |
Collapse
|
35
|
Molinaro N, Schena E, Silvestri S, Bonotti F, Aguzzi D, Viola E, Buccolini F, Massaroni C. Contactless Vital Signs Monitoring From Videos Recorded With Digital Cameras: An Overview. Front Physiol 2022; 13:801709. [PMID: 35250612 PMCID: PMC8895203 DOI: 10.3389/fphys.2022.801709] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 01/20/2022] [Indexed: 01/26/2023] Open
Abstract
The measurement of physiological parameters is fundamental to assess the health status of an individual. The contactless monitoring of vital signs may provide benefits in various fields of application, from healthcare and clinical setting to occupational and sports scenarios. Recent research has been focused on the potentiality of camera-based systems working in the visible range (380-750 nm) for estimating vital signs by capturing subtle color changes or motions caused by physiological activities but invisible to human eyes. These quantities are typically extracted from videos framing some exposed body areas (e.g., face, torso, and hands) with adequate post-processing algorithms. In this review, we provided an overview of the physiological and technical aspects behind the estimation of vital signs like respiratory rate, heart rate, blood oxygen saturation, and blood pressure from digital images as well as the potential fields of application of these technologies. Per each vital sign, we provided the rationale for the measurement, a classification of the different techniques implemented for post-processing the original videos, and the main results obtained during various applications or in validation studies. The available evidence supports the premise of digital cameras as an unobtrusive and easy-to-use technology for physiological signs monitoring. Further research is needed to promote the advancements of the technology, allowing its application in a wide range of population and everyday life, fostering a biometrical holistic of the human body (BHOHB) approach.
Collapse
Affiliation(s)
- Nunzia Molinaro
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Emiliano Schena
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Sergio Silvestri
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| | | | - Damiano Aguzzi
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Erika Viola
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Fabio Buccolini
- BHOHB – Biometrical Holistic of Human Body S.r.l., Rome, Italy
| | - Carlo Massaroni
- Unit of Measurements and Biomedical Instrumentation, Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy
| |
Collapse
|
36
|
Cuffless Blood Pressure Measurement Using Linear and Nonlinear Optimized Feature Selection. Diagnostics (Basel) 2022; 12:diagnostics12020408. [PMID: 35204499 PMCID: PMC8870879 DOI: 10.3390/diagnostics12020408] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 01/30/2022] [Accepted: 01/30/2022] [Indexed: 02/04/2023] Open
Abstract
The cuffless blood pressure (BP) measurement allows for frequent measurement without discomfort to the patient compared to the cuff inflation measurement. With the availability of a large dataset containing physiological waveforms, now it is possible to use them through different learning algorithms to produce a relationship with changes in BP. In this paper, a novel cuffless noninvasive blood pressure measurement technique has been proposed using optimized features from electrocardiogram and photoplethysmography based on multivariate symmetric uncertainty (MSU). The technique is an improvement over other contemporary methods due to the inclusion of feature optimization depending on both linear and nonlinear relationships with the change of blood pressure. MSU has been used as a selection criterion with algorithms such as the fast correlation and ReliefF algorithms followed by the penalty-based regression technique to make sure the features have maximum relevance as well as minimum redundancy. The result from the technique was compared with the performance of similar techniques using the MIMIC-II dataset. After training and testing, the root mean square error (RMSE) comes as 5.28 mmHg for systolic BP and 5.98 mmHg for diastolic BP. In addition, in terms of mean absolute error, the result improved to 4.27 mmHg for SBP and 5.01 for DBP compared to recent cuffless BP measurement techniques which have used substantially large datasets and feature optimization. According to the British Hypertension Society Standard (BHS), our proposed technique achieved at least grade B in all cumulative criteria for cuffless BP measurement.
Collapse
|
37
|
Detection of Unilateral Arm Paresis after Stroke by Wearable Accelerometers and Machine Learning. SENSORS 2021; 21:s21237784. [PMID: 34883800 PMCID: PMC8659933 DOI: 10.3390/s21237784] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 11/19/2021] [Accepted: 11/19/2021] [Indexed: 01/05/2023]
Abstract
Recent advances in stroke treatment have provided effective tools to successfully treat ischemic stroke, but still a majority of patients are not treated due to late arrival to hospital. With modern stroke treatment, earlier arrival would greatly improve the overall treatment results. This prospective study was performed to asses the capability of bilateral accelerometers worn in bracelets 24/7 to detect unilateral arm paralysis, a hallmark symptom of stroke, early enough to receive treatment. Classical machine learning algorithms as well as state-of-the-art deep neural networks were evaluated on detection times between 15 min and 120 min. Motion data were collected using triaxial accelerometer bracelets worn on both arms for 24 h. Eighty-four stroke patients with unilateral arm motor impairment and 101 healthy subjects participated in the study. Accelerometer data were divided into data windows of different lengths and analyzed using multiple machine learning algorithms. The results show that all algorithms performed well in separating the two groups early enough to be clinically relevant, based on wrist-worn accelerometers. The two evaluated deep learning models, fully convolutional network and InceptionTime, performed better than the classical machine learning models with an AUC score between 0.947-0.957 on 15 min data windows and up to 0.993-0.994 on 120 min data windows. Window lengths longer than 90 min only marginally improved performance. The difference in performance between the deep learning models and the classical models was statistically significant according to a non-parametric Friedman test followed by a post-hoc Nemenyi test. Introduction of wearable stroke detection devices may dramatically increase the portion of stroke patients eligible for revascularization and shorten the time to treatment. Since the treatment effect is highly time-dependent, early stroke detection may dramatically improve stroke outcomes.
Collapse
|