MLP-BP: A novel framework for cuffless blood pressure measurement with PPG and ECG signals based on MLP-Mixer neural networks

Attention-based convolutional neural network with multi-modal temporal information fusion for motor imagery EEG decoding

Convolutional neural network (CNN) has been widely applied in motor imagery (MI)-based brain computer interface (BCI) to decode electroencephalography (EEG) signals. However, due to the limited perceptual field of convolutional kernel, CNN only extracts features from local region without considering long-term dependencies for EEG decoding. Apart from long-term dependencies, multi-modal temporal information is equally important for EEG decoding because it can offer a more comprehensive understanding of the temporal dynamics of neural processes. In this paper, we propose a novel deep learning network that combines CNN with self-attention mechanism to encapsulate multi-modal temporal information and global dependencies. The network first extracts multi-modal temporal information from two distinct perspectives: average and variance. A shared self-attention module is then designed to capture global dependencies along these two feature dimensions. We further design a convolutional encoder to explore the relationship between average-pooled and variance-pooled features and fuse them into more discriminative features. Moreover, a data augmentation method called signal segmentation and recombination is proposed to improve the generalization capability of the proposed network. The experimental results on the BCI Competition IV-2a (BCIC-IV-2a) and BCI Competition IV-2b (BCIC-IV-2b) datasets show that our proposed method outperforms the state-of-the-art methods and achieves 4-class average accuracy of 85.03% on the BCIC-IV-2a dataset. The proposed method implies the effectiveness of multi-modal temporal information fusion in attention-based deep learning networks and provides a new perspective for MI-EEG decoding. The code is available at https://github.com/Ma-Xinzhi/EEG-TransNet.

Pulse2AI: An Adaptive Framework to Standardize and Process Pulsatile Wearable Sensor Data for Clinical Applications

Goal: To establish Pulse2AI as a reproducible data preprocessing framework for pulsatile signals that generate high-quality machine-learning-ready datasets from raw wearable recordings. Methods: We proposed an end-to-end data preprocessing framework that adapts multiple pulsatile signal modalities and generates machine-learning-ready datasets agnostic to downstream medical tasks. Results: a dataset preprocessed by Pulse2AI improved systolic blood pressure estimation by 29.58%, from 11.41 to 8.03 mmHg in root-mean-square-error (RMSE) and its diastolic counterpart by 26.01%, from 7.93 to 5.87 mmHg in RMSE. For respiration rate (RR) estimation, Pulse2AI boosted performance by 19.69%, from 1.47 to 1.18 breaths per minute (BrPM) in mean-absolute-error (MAE). Conclusion: Pulse2AI turns pulsatile signals into machine learning (ML) ready datasets for arbitrary remote health monitoring tasks. We tested Pulse2AI on multiple pulsatile modalities and demonstrated its efficacy in two medical applications. This work bridges valuable assets in remote sensing and internet of medical things to ML-ready datasets for medical modeling.

MEMS Fingertip Strain Plethysmography for Cuffless Estimation of Blood Pressure

OBJECTIVE

To develop a cuffless method for estimating blood pressure (BP) from fingertip strain plethysmography (SPG) recordings.

METHODS

A custom-built micro-electromechanical systems (MEMS) strain sensor is employed to record heartbeat-induced vibrations at the fingertip. An XGboost regressor is then trained to relate SPG recordings to beat-to-beat systolic BP (SBP), diastolic BP (DBP), mean arterial pressure (MAP) values. For this purpose, each SPG segment in this setup is represented by a feature vector consisting of cardiac time interval, amplitude features, statistical properties, and demographic information of the subjects. In addition, a novel concept, coined geometric features, are introduced and incorporated into the feature space to further encode the dynamics in SPG recordings. The performance of the regressor is assessed on 32 healthy subjects through 5-fold cross-validation (5-CV) and leave-subject-out cross validation (LSOCV).

RESULTS

Mean absolute errors (MAEs) of 3.88 mmHg and 5.45 mmHg were achieved for DBP and SBP estimations, respectively, in the 5-CV setting. LSOCV yielded MAEs of 8.16 mmHg for DBP and 16.81 mmHg for SBP. Through feature importance analysis, 3 geometric and 26 integral-related features introduced in this work were identified as primary contributors to BP estimation. The method exhibited robustness against variations in blood pressure level (normal to critical) and body mass index (underweight to obese), with MAE ranges of [1.28, 4.28] mmHg and [2.64, 7.52] mmHg, respectively.

CONCLUSION

The findings suggest high potential for SPG-based BP estimation at the fingertip.

SIGNIFICANCE

This study presents a fundamental step towards the augmentation of optical sensors that are susceptible to dark skin tones.

Automatic identification of hypertension and assessment of its secondary effects using artificial intelligence: A systematic review (2013-2023)

Artificial Intelligence (AI) techniques are increasingly used in computer-aided diagnostic tools in medicine. These techniques can also help to identify Hypertension (HTN) in its early stage, as it is a global health issue. Automated HTN detection uses socio-demographic, clinical data, and physiological signals. Additionally, signs of secondary HTN can also be identified using various imaging modalities. This systematic review examines related work on automated HTN detection. We identify datasets, techniques, and classifiers used to develop AI models from clinical data, physiological signals, and fused data (a combination of both). Image-based models for assessing secondary HTN are also reviewed. The majority of the studies have primarily utilized single-modality approaches, such as biological signals (e.g., electrocardiography, photoplethysmography), and medical imaging (e.g., magnetic resonance angiography, ultrasound). Surprisingly, only a small portion of the studies (22 out of 122) utilized a multi-modal fusion approach combining data from different sources. Even fewer investigated integrating clinical data, physiological signals, and medical imaging to understand the intricate relationships between these factors. Future research directions are discussed that could build better healthcare systems for early HTN detection through more integrated modeling of multi-modal data sources.

Challenges and prospects of visual contactless physiological monitoring in clinical study

The monitoring of physiological parameters is a crucial topic in promoting human health and an indispensable approach for assessing physiological status and diagnosing diseases. Particularly, it holds significant value for patients who require long-term monitoring or with underlying cardiovascular disease. To this end, Visual Contactless Physiological Monitoring (VCPM) is capable of using videos recorded by a consumer camera to monitor blood volume pulse (BVP) signal, heart rate (HR), respiratory rate (RR), oxygen saturation (SpO2) and blood pressure (BP). Recently, deep learning-based pipelines have attracted numerous scholars and achieved unprecedented development. Although VCPM is still an emerging digital medical technology and presents many challenges and opportunities, it has the potential to revolutionize clinical medicine, digital health, telemedicine as well as other areas. The VCPM technology presents a viable solution that can be integrated into these systems for measuring vital parameters during video consultation, owing to its merits of contactless measurement, cost-effectiveness, user-friendly passive monitoring and the sole requirement of an off-the-shelf camera. In fact, the studies of VCPM technologies have been rocketing recently, particularly AI-based approaches, but few are employed in clinical settings. Here we provide a comprehensive overview of the applications, challenges, and prospects of VCPM from the perspective of clinical settings and AI technologies for the first time. The thorough exploration and analysis of clinical scenarios will provide profound guidance for the research and development of VCPM technologies in clinical settings.

MLP-mmWP: High-Precision Millimeter Wave Positioning Based on MLP-Mixer Neural Networks

Millimeter wave (MMW) communication, noted for its merit of wide bandwidth and high-speed transmission, is also a competitive implementation of the Internet of Everything (IoE). In an always-connected world, mutual data transmission and localization are the primary issues, such as the application of MMW application in autonomous vehicles and intelligent robots. Recently, artificial intelligence technologies have been adopted for the issues in the MMW communication domain. In this paper, MLP-mmWP, a deep learning method, is proposed to localize the user with respect to MMW communication information. The proposed method employs seven sequences of beamformed fingerprints (BFFs) to estimate localization, which includes line-of-sight (LOS) and non-line-of-sight (NLOS) transmissions. As far as we know, MLP-mmWP is the first method to apply the MLP-Mixer neural network to the task of MMW positioning. Moreover, experimental results in a public dataset demonstrate that MLP-mmWP outperforms the existing state-of-the-art methods. Specifically, in a simulation area of 400 × 400 m2, the positioning mean absolute error is 1.78 m, and the 95th percentile prediction error is 3.96 m, representing improvements of 11.8% and 8.2%, respectively.

A benchmark for machine-learning based non-invasive blood pressure estimation using photoplethysmogram

Blood Pressure (BP) is an important cardiovascular health indicator. BP is usually monitored non-invasively with a cuff-based device, which can be bulky and inconvenient. Thus, continuous and portable BP monitoring devices, such as those based on a photoplethysmography (PPG) waveform, are desirable. In particular, Machine Learning (ML) based BP estimation approaches have gained considerable attention as they have the potential to estimate intermittent or continuous BP with only a single PPG measurement. Over the last few years, many ML-based BP estimation approaches have been proposed with no agreement on their modeling methodology. To ease the model comparison, we designed a benchmark with four open datasets with shared preprocessing, the right validation strategy avoiding information shift and leak, and standard evaluation metrics. We also adapted Mean Absolute Scaled Error (MASE) to improve the interpretability of model evaluation, especially across different BP datasets. The proposed benchmark comes with open datasets and codes. We showcase its effectiveness by comparing 11 ML-based approaches of three different categories.

PulseDB: A large, cleaned dataset based on MIMIC-III and VitalDB for benchmarking cuff-less blood pressure estimation methods

There has been a growing interest in developing cuff-less blood pressure (BP) estimation methods to enable continuous BP monitoring from electrocardiogram (ECG) and/or photoplethysmogram (PPG) signals. The majority of these methods have been evaluated using publicly-available datasets, however, there exist significant discrepancies across studies with respect to the size, the number of subjects, and the applied pre-processing steps for the data that is eventually used for training and testing the models. Such differences make conducting performance comparison across models largely unfair, and mask the generalization capability of various BP estimation methods. To fill this important gap, this paper presents "PulseDB," the largest cleaned dataset to date, for benchmarking BP estimation models that also fulfills the requirements of standardized testing protocols. PulseDB contains 1) 5,245,454 high-quality 10 -s segments of ECG, PPG, and arterial BP (ABP) waveforms from 5,361 subjects retrieved from the MIMIC-III waveform database matched subset and the VitalDB database; 2) subjects' identification and demographic information, that can be utilized as additional input features to improve the performance of BP estimation models, or to evaluate the generalizability of the models to data from unseen subjects; and 3) positions of the characteristic points of the ECG/PPG signals, making PulseDB directly usable for training deep learning models with minimal data pre-processing. Additionally, using this dataset, we conduct the first study to provide insights about the performance gap between calibration-based and calibration-free testing approaches for evaluating generalizability of the BP estimation models. We expect PulseDB, as a user-friendly, large, comprehensive and multi-functional dataset, to be used as a reliable source for the evaluation of cuff-less BP estimation methods.

Advancement in the Cuffless and Noninvasive Measurement of Blood Pressure: A Review of the Literature and Open Challenges

Hypertension is a chronic condition that is one of the prominent reasons behind cardiovascular disease, brain stroke, and organ failure. Left unnoticed and untreated, the deterioration in a health condition could even result in mortality. If it can be detected early, with proper treatment, undesirable outcomes can be avoided. Until now, the gold standard is the invasive way of measuring blood pressure (BP) using a catheter. Additionally, the cuff-based and noninvasive methods are too cumbersome or inconvenient for frequent measurement of BP. With the advancement of sensor technology, signal processing techniques, and machine learning algorithms, researchers are trying to find the perfect relationships between biomedical signals and changes in BP. This paper is a literature review of the studies conducted on the cuffless noninvasive measurement of BP using biomedical signals. Relevant articles were selected using specific criteria, then traditional techniques for BP measurement were discussed along with a motivation for cuffless measurement use of biomedical signals and machine learning algorithms. The review focused on the progression of different noninvasive cuffless techniques rather than comparing performance among different studies. The literature survey concluded that the use of deep learning proved to be the most accurate among all the cuffless measurement techniques. On the other side, this accuracy has several disadvantages, such as lack of interpretability, computationally extensive, standard validation protocol, and lack of collaboration with health professionals. Additionally, the continuing work by researchers is progressing with a potential solution for these challenges. Finally, future research directions have been provided to encounter the challenges.

Blood Pressure Measurement: From Cuff-Based to Contactless Monitoring

Blood pressure (BP) determines whether a person has hypertension and offers implications as to whether he or she could be affected by cardiovascular disease. Cuff-based sphygmomanometers have traditionally provided both accuracy and reliability, but they require bulky equipment and relevant skills to obtain precise measurements. BP measurement from photoplethysmography (PPG) signals has become a promising alternative for convenient and unobtrusive BP monitoring. Moreover, the recent developments in remote photoplethysmography (rPPG) algorithms have enabled new innovations for contactless BP measurement. This paper illustrates the evolution of BP measurement techniques from the biophysical theory, through the development of contact-based BP measurement from PPG signals, and to the modern innovations of contactless BP measurement from rPPG signals. We consolidate knowledge from a diverse background of academic research to highlight the importance of multi-feature analysis for improving measurement accuracy. We conclude with the ongoing challenges, opportunities, and possible future directions in this emerging field of research.

Novel Blood Pressure Waveform Reconstruction from Photoplethysmography using Cycle Generative Adversarial Networks

Continuous monitoring of blood pressure (BP) can help individuals manage their chronic diseases such as hypertension, requiring non-invasive measurement methods in free-living conditions. Recent approaches fuse Photoplethys-mograph (PPG) and electrocardiographic (ECG) signals using different machine and deep learning approaches to non-invasively estimate BP; however, they fail to reconstruct the complete signal, leading to less accurate models. In this paper, we propose a cycle generative adversarial network (CycleGAN) based approach to extract a BP signal known as ambulatory blood pressure (ABP) from a clean PPG signal. Our approach uses a cycle generative adversarial network that extends the GAN architecture for domain translation, and outperforms state-of-the-art approaches by up to 2× in BP estimation.

An Intelligent Site Selection Model for Hydrogen Refueling Stations Based on Fuzzy Comprehensive Evaluation and Artificial Neural Network—A Case Study of Shanghai

With the gradual popularization of hydrogen fuel cell vehicles (HFCVs), the construction and planning of hydrogen refueling stations (HRSs) are increasingly important. Taking operational HRSs in China’s coastal and major cities as examples, we consider the main factors affecting the site selection of HRSs in China from the three aspects of economy, technology and society to establish a site selection evaluation system for hydrogen refueling stations and determine the weight of each index through the analytic hierarchy process (AHP). Then, combined with fuzzy comprehensive evaluation (FCE) method and artificial neural network model (ANN), FCE method is used to evaluate HRS in operation in China’s coastal areas and major cities, and we used the resulting data obtained from the comprehensive evaluation as the training data to train the neural network. So, an intelligent site selection model for HRSs based on fuzzy comprehensive evaluation and artificial neural network model (FCE-ANN) is proposed. The planned HRSs in Shanghai are evaluated, and an optimal site selection of the HRS is obtained. The results show that the optimal HRSs site selected by the FCE-ANN model is consistent with the site selection obtained by the FCE method, and the accuracy of the FCE-ANN model is verified. The findings of this study may provide some guidelines for policy makers in planning the hydrogen refueling stations.