A new look at the essence of the imaging photoplethysmography

Remote photoplethysmography (rPPG) in the wild: Remote heart rate imaging via online webcams

Remote photoplethysmography (rPPG) is a low-cost technique to measure physiological parameters such as heart rate by analyzing videos of a person. There has been growing attention to this technique due to the increased possibilities and demand for running psychological experiments on online platforms. Technological advancements in commercially available cameras and video processing algorithms have led to significant progress in this field. However, despite these advancements, past research indicates that suboptimal video recording conditions can severely compromise the accuracy of rPPG. In this study, we aimed to develop an open-source rPPG methodology and test its performance on videos collected via an online platform, without control of the hardware of the participants and the contextual variables, such as illumination, distance, and motion. Across two experiments, we compared the results of the rPPG extraction methodology to a validated dataset used for rPPG testing. Furthermore, we then collected 231 online video recordings and compared the results of the rPPG extraction to finger pulse oximeter data acquired with a validated mobile heart rate application. Results indicated that the rPPG algorithm was highly accurate, showing a significant degree of convergence with both datasets thus providing an improved tool for recording and analyzing heart rate in online experiments.

Revisiting the Venoarteriolar Reflex-Further Insights from Upper Limb Dependency in Healthy Subjects

The venoarteriolar reflex (VAR) is described as a vasoconstriction occurring in response to an increase in venous transmural pressure. Its underlying mechanisms are still not clarified, particularly the neural pathway that supposedly evokes this reflex. In addition, recent studies have shown that the postural maneuvers that evoke VAR also produce a decrease in contralateral perfusion, which is also poorly understood. Our study aimed to explore the contralateral response to unilateral upper limb dependency and its underlying mechanisms. Fifteen young, healthy subjects (24.1 ± 5.8 y.o.) participated in this study after giving informed consent. While seated, subjects remained for 7 min with both arms at heart level (baseline), after which a random hand was placed 40 cm below the heart level for 5 min (dependency) before resuming the initial position for another 7 min (recovery). Skin perfusion was assessed bilaterally with photoplethysmography, and electrodermal activity (EDA) was assessed in the contralateral hand. During hand dependency, perfusion decreased significantly in both limbs, although it was more pronounced in the dependent limb, corroborating previous reports that unilateral limb dependency evokes a decrease in contralateral perfusion. Transient EDA peaks were detected in the first seconds of the dependency and recovery phases. These results support the participation of the sympathetic nervous system as a mechanism regulating contralateral perfusion during unilateral limb dependency. This sympathetic activation is probably attributed to the postural changes themselves and is likely not related to the VAR.

Understanding the physiological transmission mechanisms of photoplethysmography signals: a comprehensive review

Objective. The widespread adoption of Photoplethysmography (PPG) as a non-invasive method for detecting blood volume variations and deriving vital physiological parameters reflecting health status has surged, primarily due to its accessibility, cost-effectiveness, and non-intrusive nature. This has led to extensive research around this technique in both daily life and clinical applications. Interestingly, despite the existence of contradictory explanations of the underlying mechanism of PPG signals across various applications, a systematic investigation into this crucial matter has not been conducted thus far. This gap in understanding hinders the full exploitation of PPG technology and undermines its accuracy and reliability in numerous applications.Approach. Building upon a comprehensive review of the fundamental principles and technological advancements in PPG, this paper initially attributes the origin of PPG signals to a combination of physical and physiological transmission processes. Furthermore, three distinct models outlining the concerned physiological transmission processes are synthesized, with each model undergoing critical examination based on theoretical underpinnings, empirical evidence, and constraints.Significance. The ultimate objective is to form a fundamental framework for a better understanding of physiological transmission processes in PPG signal generation and to facilitate the development of more reliable technologies for detecting physiological signals.

Microscopic photoplethysmography-based evaluation of cardiotoxicity in whitefish larvae induced by acute exposure to cadmium and phenol

Toxic environmental pollutants pose a health risk for both humans and animals. Accumulation of industrial contaminants in freshwater fish may become a significant threat to biodiversity. Comprehensive monitoring of the impact of environmental stressors on fish functional systems is important and use of non-invasive tools that can detect the presence of these toxicants in vivo is desirable. The blood circulatory system, by virtue of its sensitivity to the external stimuli, could be an informative indicator of chemical exposure. In this study, microscopic photoplethysmography-based approach was used to investigate the cardiac activity in broad whitefish larvae (Coregonus nasus) under acute exposure to cadmium and phenol. We identified contamination-induced abnormalities in the rhythms of the ventricle and atrium. Our results allow introducing additional endpoints to evaluate the cardiac dysfunction in fish larvae and contribute to the non-invasive evaluation of the toxic effects of industrial pollutants on bioaccumulation and aquatic life.

Maternal interoceptive focus is associated with greater reported engagement in mother-infant stroking and rocking

Parental caregiving during infancy is primarily aimed at the regulation of infants' physiological and emotional states. Recent models of embodied cognition propose that interoception, i.e., the perception of internal bodily states, may influence the quality and quantity of parent-infant caregiving. Yet, empirical investigations into this relationship remain scarce. Across two online studies of mothers with 6- to 18-month-old infants during Covid-19 lockdowns, we examined whether mothers' self-reported engagement in stroking and rocking their infant was related to self-reported interoceptive abilities. Additional measures included retrospective accounts of pregnancy and postnatal body satisfaction, and mothers' reports of their infant's understanding of vocabulary relating to body parts. In Study 1 (N = 151) and Study 2 (N = 111), mothers reported their engagement in caregiving behaviours and their tendency to focus on and regulate bodily states. In a subsample from Study 2 (N = 49), we also obtained an objective measure of cardiac interoceptive accuracy using an online heartbeat counting task. Across both studies, the tendency to focus on and regulate interoceptive states was associated with greater mother-infant stroking and rocking. Conversely, we found no evidence for a relationship between objective interoceptive accuracy and caregiving. The findings suggest that interoception may play a role in parental engagement in stroking and rocking, however, in-person dyadic studies are warranted to further investigate this relationship.

Robust arterial compliance estimation with Katz's fractal dimension of photoplethysmography

Arterial compliance (AC) plays a crucial role in vascular aging and cardiovascular disease. The ability to continuously estimate aortic AC or its surrogate, pulse pressure (PP), through wearable devices is highly desirable, given its strong association with daily activities. While the single-site photoplethysmography (PPG)-derived arterial stiffness indices show reasonable correlations with AC, they are susceptible to noise interference, limiting their practical use. To overcome this challenge, our study introduces a noise-resistant indicator of AC: Katz's fractal dimension (KFD) of PPG signals. We showed that KFD integrated the signal complexity arising from compliance changes across a cardiac cycle and vascular structural complexity, thereby decreasing its dependence on individual characteristic points. To assess its capability in measuring AC, we conducted a comprehensive evaluation using both in silico studies with 4374 virtual human data and real-world measurements. In the virtual human studies, KFD demonstrated a strong correlation with AC (r = 0.75), which only experienced a slight decrease to 0.66 at a signal-to-noise ratio of 15dB, surpassing the best PPG-morphology-derived AC measure (r = 0.41) under the same noise condition. In addition, we observed that KFD's sensitivity to AC varied based on the individual's hemodynamic status, which may further enhance the accuracy of AC estimations. These in silico findings were supported by real-world measurements encompassing diverse health conditions. In conclusion, our study suggests that PPG-derived KFD has the potential to continuously and reliably monitor arterial compliance, enabling unobtrusive and wearable assessment of cardiovascular health.

Plethysmographic assessment of vasomotor response in patients with congestive heart failure before and after heart transplantation

Sympathetic vasomotor response is the most important part of the autonomic regulation of circulation, which determines the quality of life. It is disrupted in a number of diseases, particularly in patients with congestive heart failure (CHF). However, experimental evaluation of reflex vasoconstriction is still a non-trivial task due to the limited set of available technologies. The aim of this study is to assess the dynamics of vasomotor response of forearm vessels due to both the deactivation of cardiopulmonary baroreceptors and cold stress using a newly designed imaging plethysmograph (IPG) and compare its performance with classical air plethysmograph (APG). In both vasoconstriction tests, vasomotor response was assessed as a change in the blood flow rate due to venous occlusion compared to that at rest. Both tests were carried out in 45 CHF patients both before and after heart transplantation, as well as in 11 age-matched healthy volunteers. Prior to transplantation, both APG and IPG showed a significant decrease in vasomotor response in CHF patients due to both tests as compared to the control group. After heart transplantation, an increase in vasomotor reactivity was revealed in both vasoconstriction tests. We have found that both plethysmographic techniques provide correlated assessment of changes in the vasomotor response. In addition, we have found that IPG is more resistant to artifacts than APG. The new IPG method has the advantage of measuring blood flow in a contactless manner, making it very promising for experimental evaluation of vasomotor response in clinical conditions.

Red Blood Cells' Area Deformation as the Origin of the Photoplethysmography Signal

The origin of the photoplethysmography (PPG) signal is a debatable topic, despite plausible models being addressed. One concern revolves around the correlation between the mechanical waveform's pulsatile nature and the associated biomechanism. The interface between these domains requires a clear mathematical or physical model that can explain physiological behavior. Describing the correct origin of the recorded optical waveform not only benefits the development of the next generation of biosensors but also defines novel health markers. In this study, the assumption of a pulsatile nature is based on the mechanism of blood microcirculation. At this level, two interconnected phenomena occur: variation in blood flow velocity through the capillary network and red blood cell (RBC) shape deformation. The latter effect was qualitatively investigated in synthetic capillaries to assess the experimental data needed for PPG model development. Erythrocytes passed through 10 µm and 6 µm microchannel widths with imposed velocities between 50 µm/s and 2000 µm/s, according to real scenarios. As a result, the length and area deformation of RBCs followed a logarithmic law function of the achieved traveling speeds. Applying radiometric expertise on top, mechanical-optical insights are obtained regarding PPG's pulsatile nature. The mathematical equations derived from experimental data correlate microcirculation physiologic with waveform behavior at a high confidence level. The transfer function between the biomechanics and the optical signal is primarily influenced by the vasomotor state, capillary network orientation, concentration, and deformation performance of erythrocytes.

The 2023 wearable photoplethysmography roadmap

Photoplethysmography is a key sensing technology which is used in wearable devices such as smartwatches and fitness trackers. Currently, photoplethysmography sensors are used to monitor physiological parameters including heart rate and heart rhythm, and to track activities like sleep and exercise. Yet, wearable photoplethysmography has potential to provide much more information on health and wellbeing, which could inform clinical decision making. This Roadmap outlines directions for research and development to realise the full potential of wearable photoplethysmography. Experts discuss key topics within the areas of sensor design, signal processing, clinical applications, and research directions. Their perspectives provide valuable guidance to researchers developing wearable photoplethysmography technology.

Robust in-vehicle heartbeat detection using multimodal signal fusion

A medical check-up during driving enables the early detection of diseases. Heartbeat irregularities indicate possible cardiovascular diseases, which can be determined with continuous health monitoring. Therefore, we develop a redundant sensor system based on electrocardiography (ECG) and photoplethysmography (PPG) sensors attached to the steering wheel, a red, green, and blue (RGB) camera behind the steering wheel. For the video, we integrate the face recognition engine SeetaFace to detect landmarks of face segments continuously. Based on the green channel, we derive colour changes and, subsequently, the heartbeat. We record the ECG, PPG, video, and reference ECG with body electrodes of 19 volunteers during different driving scenarios, each lasting 15 min: city, highway, and countryside. We combine early, signal-based late, and sensor-based late fusion with a hybrid convolutional neural network (CNN) and integrated majority voting to deliver the final heartbeats that we compare to the reference ECG. Based on the measured and the reference heartbeat positions, the usable time was 51.75%, 58.62%, and 55.96% for the driving scenarios city, highway, and countryside, respectively, with the hybrid algorithm and combination of ECG and PPG. In conclusion, the findings suggest that approximately half the driving time can be utilised for in-vehicle heartbeat monitoring.

Spatial averaging method based on adaptive weight for imaging photoplethysmography

Significance

Imaging photoplethysmography (iPPG) is a non-contact measuring technology for several physiological parameters reflecting personal health status without a special sensor. However, the pulse signal obtained using the iPPG usually is contaminated by various noises, and the intensity of the interesting pulse signal is relatively weak compared to the noises, emphasizing the necessity of obtaining high-quality pulse signals to measure physiological parameters correctly.

Aim

Various regions of the face harbor distinct pulse information. We propose a spatial averaging method based on adaptive weights, which can obtain high-quality pulse signals by applying different weights to facial sub-regions of interest (sub-ROIs; sROIs).

Approach

First, the facial ROI is divided into seven sROIs and the coarse heart rate (HR) is calculated from them. Next, the signal-to-noise ratio (SNR) of the raw signal obtained from each sROI is calculated using the coarse HR, and then a high-quality pulse signal is obtained by assigning positive or negative weights to each sROI based on the SNRs.

Results

We compare our method with others through the quality analysis of the obtained pulse signals using the self-collected database and the public database PURE. The comparison results show that the proposed method can provide a better pulse signal compared to other methods under various resolutions and states.

Conclusions

This proposed method can obtain the pulse signal with better quality, which is helpful to accurately measure physiological parameters, such as HR and HR variability.

Duality in response of intracranial vessels to nitroglycerin revealed in rats by imaging photoplethysmography

Among numerous approaches to the study of migraine, the nitroglycerin (NTG) model occupies a prominent place, but there is relatively insufficient information about how NTG affects intracranial vessels. In this study we aim to assess the effects of NTG on blood-flow parameters in meningeal vessels measured by imaging photoplethysmography (iPPG) in animal experiments. An amplitude of the pulsatile component (APC) of iPPG waveform was assessed before and within 2.5 h after the NTG administration in saline (n = 13) or sumatriptan (n = 12) pretreatment anesthetized rats in conditions of a closed cranial window. In animals of both groups, NTG caused a steady decrease in blood pressure. In 7 rats of the saline group, NTG resulted in progressive increase in APC, whereas decrease in APC was observed in other 6 rats. In all animals in the sumatriptan group, NTG administration was accompanied exclusively by an increase in APC. Diametrically opposite changes in APC due to NTG indicate a dual effect of this drug on meningeal vasomotor activity. Sumatriptan acts as a synergist of the NTG vasodilating action. The results we obtained contribute to understanding the interaction of vasoactive drugs in the study of the headache pathophysiology and methods of its therapy.

Automated Multi-Wavelength Quality Assessment of Photoplethysmography Signals Using Modulation Spectrum Shape Features

Photoplethysmography (PPG) is used to measure blood volume changes in the microvascular bed of tissue. Information about these changes along time can be used for estimation of various physiological parameters, such as heart rate variability, arterial stiffness, and blood pressure, to name a few. As a result, PPG has become a popular biological modality and is widely used in wearable health devices. However, accurate measurement of various physiological parameters requires good-quality PPG signals. Therefore, various signal quality indexes (SQIs) for PPG signals have been proposed. These metrics have usually been based on statistical, frequency, and/or template analyses. The modulation spectrogram representation, however, captures the second-order periodicities of a signal and has been shown to provide useful quality cues for electrocardiograms and speech signals. In this work, we propose a new PPG quality metric based on properties of the modulation spectrum. The proposed metric is tested using data collected from subjects while they performed various activity tasks contaminating the PPG signals. Experiments on this multi-wavelength PPG dataset show the combination of proposed and benchmark measures significantly outperforming several benchmark SQIs with improvements of 21.3% BACC (balanced accuracy) for green, 21.6% BACC for red, and 19.0% BACC for infrared wavelengths, respectively, for PPG quality detection tasks. The proposed metrics also generalize for cross-wavelength PPG quality detection tasks.

Photoplethysmography upon cold stress-impact of measurement site and acquisition mode

Photoplethysmography (PPG) allows various statements about the physiological state. It supports multiple recording setups, i.e., application to various body sites and different acquisition modes, rendering the technique a versatile tool for various situations. Owing to anatomical, physiological and metrological factors, PPG signals differ with the actual setup. Research on such differences can deepen the understanding of prevailing physiological mechanisms and path the way towards improved or novel methods for PPG analysis. The presented work systematically investigates the impact of the cold pressor test (CPT), i.e., a painful stimulus, on the morphology of PPG signals considering different recording setups. Our investigation compares contact PPG recorded at the finger, contact PPG recorded at the earlobe and imaging PPG (iPPG), i.e., non-contact PPG, recorded at the face. The study bases on own experimental data from 39 healthy volunteers. We derived for each recording setup four common morphological PPG features from three intervals around CPT. For the same intervals, we derived blood pressure and heart rate as reference. To assess differences between the intervals, we used repeated measures ANOVA together with paired t-tests for each feature and we calculated Hedges' g to quantify effect sizes. Our analyses show a distinct impact of CPT. As expected, blood pressure shows a highly significant and persistent increase. Independently of the recording setup, all PPG features show significant changes upon CPT as well. However, there are marked differences between recording setups. Effect sizes generally differ with the finger PPG showing the strongest response. Moreover, one feature (pulse width at half amplitude) shows an inverse behavior in finger PPG and head PPG (earlobe PPG and iPPG). In addition, iPPG features behave partially different from contact PPG features as they tend to return to baseline values while contact PPG features remain altered. Our findings underline the importance of recording setup and physiological as well as metrological differences that relate to the setups. The actual setup must be considered in order to properly interpret features and use PPG. The existence of differences between recording setups and a deepened knowledge on such differences might open up novel diagnostic methods in the future.

Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review

Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis-polysomnography (PSG)-is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research.

Quantification of the Phenomena Affecting Reflective Arterial Photoplethysmography

Photoplethysmography (PPG) is a widely emerging method to assess vascular health in humans. The origins of the signal of reflective PPG on peripheral arteries have not been thoroughly investigated. We aimed to identify and quantify the optical and biomechanical processes that influence the reflective PPG signal. We developed a theoretical model to describe the dependence of reflected light on the pressure, flow rate, and the hemorheological properties of erythrocytes. To verify the theory, we designed a silicone model of a human radial artery, inserted it in a mock circulatory circuit filled with porcine blood, and imposed static and pulsatile flow conditions. We found a positive, linear relationship between the pressure and the PPG and a negative, non-linear relationship, of comparable magnitude, between the flow and the PPG. Additionally, we quantified the effects of the erythrocyte disorientation and aggregation. The theoretical model based on pressure and flow rate yielded more accurate predictions, compared to the model using pressure alone. Our results indicate that the PPG waveform is not a suitable surrogate for intraluminal pressure and that flow rate significantly affects PPG. Further validation of the proposed methodology in vivo could enable the non-invasive estimation of arterial pressure from PPG and increase the accuracy of health-monitoring devices.

Arterial pulsation modulates the optical attenuation coefficient of skin

Photoplethysmographic (PPG) signals arise from the modulation of light reflectivity on the skin due to changes of physiological origin. Imaging plethysmography (iPPG) is a video-based PPG method that can remotely monitor vital signs in a non-invasive manner. iPPG signals result from skin reflectivity modulation. The origin of such reflectivity modulation is still a subject of debate. Here, we have used optical coherence tomography (OCT) imaging to find whether iPPG signals may result from skin optical properties being directly or indirectly modulated by arterial transmural pressure propagation. The light intensity across the tissue was modeled through a simple exponential decay (Beer-Lambert law) to analyze in vivo the modulation of the optical attenuation coefficient of the skin by arterial pulsation. The OCT transversal images were acquired from a forearm of three subjects in a pilot study. The results show that the optical attenuation coefficient of skin changes at the same frequency as the arterial pulsation due to transmural pressure propagation (local ballistographic effect), but we cannot discard the contribution of global ballistographic effects.

Continuous intraoperative perfusion monitoring of free microvascular anastomosed fasciocutaneous flaps using remote photoplethysmography

Flap loss through limited perfusion remains a major complication in reconstructive surgery. Continuous monitoring of perfusion will facilitate early detection of insufficient perfusion. Remote or imaging photoplethysmography (rPPG/iPPG) as a non-contact, non-ionizing, and non-invasive monitoring technique provides objective and reproducible information on physiological parameters. The aim of this study is to establish rPPG for intra- and postoperative monitoring of flap perfusion in patients undergoing reconstruction with free fasciocutaneous flaps (FFCF). We developed a monitoring algorithm for flap perfusion, which was evaluated in 15 patients. For 14 patients, ischemia of the FFCF in the forearm and successful reperfusion of the implanted FFCF was quantified based on the local signal. One FFCF showed no perfusion after reperfusion and devitalized in the course. Intraoperative monitoring of perfusion with rPPG provides objective and reproducible results. Therefore, rPPG is a promising technology for standard flap perfusion monitoring on low costs without the need for additional monitoring devices.

Photoplethysmographic Imaging of Hemodynamics and Two-Dimensional Oximetry

The review of recent papers devoted to actively developing methods of photoplethysmographic imaging (the PPGI) of blood volume pulsations in vessels and non-contact two-dimensional oximetry on the surface of a human body has been carried out. The physical fundamentals and technical aspects of the PPGI and oximetry have been considered. The manifold of the physiological parameters available for the analysis by the PPGI method has been shown. The prospects of the PPGI technology have been discussed. The possibilities of non-contact determination of blood oxygen saturation SpO2 (pulse saturation O2) have been described. The relevance of remote determination of the level of oxygenation in connection with the spread of a new coronavirus infection SARS-CoV-2 (COVID-19) has been emphasized. Most of the works under consideration cover the period 2010-2021.

Photoplethysmographic imaging and analysis of pulsatile pressure wave in palmar artery at 10 wavelengths

SIGNIFICANCE

As a noncontact method, imaging photoplethysmography (iPPG) may provide a powerful tool to measure pulsatile pressure wave (PPW) in superficial arteries and extract biomarkers for monitoring of artery wall stiffness.

AIM

We intend to develop a approach for extraction of the very weak cardiac component from iPPG data by identifying locations of strong PPW signals with optimized illumination wavelength and determining pulse wave velocity (PWV).

APPROACH

Monochromatic in vivo iPPG datasets have been acquired from left hands to investigate various algorithms for retrieval of PPW signals, distribution maps and waveforms, and their dependence on arterial location and wavelength.

RESULTS

A robust algorithm of pixelated independent component analysis (pICA) has been developed and combined with spatiotemporal filtering to retrieve PPW signals. Spatial distributions of PPW signals have been mapped in 10 wavelength bands from 445 to 940 nm and waveforms were analyzed at multiple locations near the palmar artery tree. At the wavelength of 850 nm selected for timing analysis, we determined PWV values from 12 healthy volunteers in a range of 0.5 to 5.8 m/s across the hand region from wrist to midpalm and fingertip.

CONCLUSIONS

These results demonstrate the potentials of the iPPG method based on pICA algorithm for translation into a monitoring tool to characterize wall stiffness of superficial artery by rapid and noncontact measurement of PWV and other biomarkers within 10 s.

Noninvasive Non-Contact SpO2 Monitoring Using an Integrated Polarization-Sensing CMOS Imaging Sensor

BACKGROUND

In the diagnosis and primary health care of an individual, estimation of the pulse rate and blood oxygen saturation (SpO2) is critical. The pulse rate and SpO2 are determined by methods including photoplethysmography (iPPG), light spectroscopy, and pulse oximetry. These devices need to be compact, non-contact, and noninvasive for real-time health monitoring. Reflection-based iPPG is becoming popular as it allows non-contact estimation of the heart rate and SpO2. Most iPPG methods capture temporal data and form complex computations, and thus real-time measurements and spatial visualization are difficult.

METHOD

In this research work, reflective mode polarized imaging-based iPPG is proposed. For polarization imaging, a custom image sensor with wire grid polarizers on each pixel is designed. Each pixel has a wire grid of varying transmission axes, allowing phase detection of the incoming light. The phase information of the backscattered light from the fingertips of 12 healthy volunteers was recorded in both the resting as well as the excited states. These data were then processed using MATLAB 2021b software.

RESULTS

The phase information provides quantitative information on the reflection from the superficial and deep layers of skin. The ratio of deep to superficial layer backscattered phase information is shown to be directly correlated and linearly increasing with an increase in the SpO2 and heart rate.

CONCLUSIONS

The phase-based measurements help to monitor the changes in the resting and excited state heart rate and SpO2 in real time. Furthermore, the use of the ratio of phase information helps to make the measurements independent of the individual skin traits and thus increases the accuracy of the measurements. The proposed iPPG works in ambient light, relaxing the instrumentation requirement and helping the system to be compact and portable.

Performance analysis of remote photoplethysmography deep filtering using long short-term memory neural network

Background

Remote photoplethysmography (rPPG) is a technique developed to estimate heart rate using standard video cameras and ambient light. Due to the multiple sources of noise that deteriorate the quality of the signal, conventional filters such as the bandpass and wavelet-based filters are commonly used. However, after using conventional filters, some alterations remain, but interestingly an experienced eye can easily identify them.

Results

We studied a long short-term memory (LSTM) network in the rPPG filtering task to identify these alterations using many-to-one and many-to-many approaches. We used three public databases in intra-dataset and cross-dataset scenarios, along with different protocols to analyze the performance of the method. We demonstrate how the network can be easily trained with a set of 90 signals totaling around 45 min. On the other hand, we show the stability of the LSTM performance with six state-of-the-art rPPG methods.

Conclusions

This study demonstrates the superiority of the LSTM-based filter experimentally compared with conventional filters in an intra-dataset scenario. For example, we obtain on the VIPL database an MAE of 3.9 bpm, whereas conventional filtering improves performance on the same dataset from 10.3 bpm to 7.7 bpm. The cross-dataset approach presents a dependence in the network related to the average signal-to-noise ratio on the rPPG signals, where the closest signal-to-noise ratio values in the training and testing set the better. Moreover, it was demonstrated that a relatively small amount of data are sufficient to successfully train the network and outperform the results obtained by classical filters. More precisely, we have shown that about 45 min of rPPG signal could be sufficient to train an effective LSTM deep-filter.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12938-022-01037-z.

Novel Method to Assess Endothelial Function via Monitoring of Perfusion Response to Local Heating by Imaging Photoplethysmography

Endothelial dysfunction is one of the most important markers of the risk of cardiovascular complications. This study is aimed to demonstrate the feasibility of imaging photoplethysmography to assess microcirculation response to local heating in order to develop a novel technology for assessing endothelial function. As a measure of vasodilation, we used the relative dynamics of the pulsatile component of the photoplethysmographic waveform, which was assessed in a large area of the outer surface of the middle third of the subject's forearm. The perfusion response was evaluated in six healthy volunteers during a test with local skin heating up to 40-42 °C and subsequent relaxation. The proposed method is featured by accurate control of the parameters affecting the microcirculation during the prolonged study. It was found that in response to local hyperthermia, a multiple increase in the pulsation component, which has a biphasic character, was observed. The amplitude of the first phase of the perfusion reaction depends on both the initial skin temperature and the difference between the basal and heating temperatures. The proposed method allows the assessment of a reproducible perfusion increase in response to hyperthermia developed due to humoral factors associated with the endothelium, thus allowing detection of its dysfunction.

Intraoperative visualization and quantitative assessment of tissue perfusion by imaging photoplethysmography: comparison with ICG fluorescence angiography

Intraoperative monitoring of tissue perfusion is of great importance for optimizing surgery and reducing postoperative complications. To date, there is no standard procedure for assessing blood circulation in routine clinical practice. Over the past decade, indocyanine green (ICG) fluorescence angiography is most commonly used for intraoperative perfusion evaluation. Imaging photoplethysmography (iPPG) potentially enables contactless assessment of the blood supply to organs. However, no strong evidence of this potential has been provided so far. Here we report results of a comparative assessment of tissue perfusion obtained using custom-made iPPG and commercial ICG-fluorescence systems during eight different gastrointestinal surgeries. Both systems allow mapping the blood-supply distribution over organs. It was demonstrated for the first time that the quantitative assessment of blood perfusion by iPPG is in good agreement with that obtained by ICG-fluorescence imaging in all surgical cases under study. iPPG can become an objective quantitative monitoring system for tissue perfusion in the operating room due to its simplicity, low cost and no need for any agent injections.

Pulsatile flow in venous perforators of the lower limb

Teaching traditionally asserts that the arterial pressure pulse is dampened across the capillary bed to the extent that pulsatility is non-existent in the venous circulation of the lower limbs. Herein, we present evidence of transmission of arterial pulsations across the capillary network into perforator veins in the lower limbs of healthy, heat-stressed humans. Perforator veins are connections from the superficial veins that drain into the deep veins. When assessed using ultrasound at rest, they infrequently demonstrate flow and a pulsatile flow waveform is not described. We investigated perforator vein pulsatility in ten young, healthy volunteers who underwent passive heating by +2 ºC deep body temperature via a hot-water-perfused suit, and five who also underwent active heating by +2 ºC via low-intensity cycling while wearing the hot-water-perfused suit. At +0.5 ºC increments in temperature, blood velocity in an ankle perforator vein was measured using duplex ultrasound. In all perforators with heating, sustained flow was demonstrated, with a pulsatile waveform that was synchronous with the cardiac cycle. The maximum velocity was 29 ± 14 cm/s with passive heating and approximately half with active heating (P=0.04). The small veins of the skin at the ankle also demonstrated increased perfusion with pulsatility, seen with low-velocity microvascular imaging technology. We consider explanations for this pulsatility and conclude that it is propagated from the arterial inflow through the skin microcirculation as a result of increased dilatation and flow volume, and that this a normal response to increased skin blood flow.

A new principle of pulse detection based on terahertz wave plethysmography

This study presents findings in the terahertz (THz) frequency spectrum for non-contact cardiac sensing applications. Cardiac pulse information is simultaneously extracted using THz waves based on the established principles in electronics and optics. The first fundamental principle is micro-Doppler motion effect. This motion based method, primarily using coherent phase information from the radar receiver, has been widely exploited in microwave frequency bands and has recently found popularity in millimeter waves (mmWave) for breathe rate and heart rate detection. The second fundamental principle is reflectance based optical measurement using infrared or visible light. The variation in the light reflection is proportional to the volumetric change of the heart, often referred as photoplethysmography (PPG). Herein, we introduce the concept of terahertz-wave-plethysmography (TPG), which detects blood volume changes in the upper dermis tissue layer by measuring the reflectance of THz waves, similar to the existing remote PPG (rPPG) principle. The TPG principle is justified by scientific deduction, electromagnetic wave simulations and carefully designed experimental demonstrations. Additionally, pulse measurements from various peripheral body parts of interest (BOI), palm, inner elbow, temple, fingertip and forehead, are demonstrated using a wideband THz sensing system developed by the Terahertz Electronics Lab at Arizona State University, Tempe. Among the BOIs under test, it is found that the measurements from forehead BOI gives the best accuracy with mean heart rate (HR) estimation error 1.51 beats per minute (BPM) and standard deviation 1.08 BPM. The results validate the feasibility of TPG for direct pulse monitoring. A comparative study on pulse sensitivity is conducted between TPG and rPPG. The results indicate that the TPG contains more pulsatile information from the forehead BOI than that in the rPPG signals in regular office lighting condition and thus generate better heart rate estimation statistic in the form of empirical cumulative distribution function of HR estimation error. Last but not least, TPG penetrability test for covered skin is demonstrated using two types of garment materials commonly used in daily life.

On the spatial phase distribution of cutaneous low-frequency perfusion oscillations

Distributed cutaneous tissue blood volume oscillations contain information on autonomic nervous system (ANS) regulation of cardiorespiratory activity as well as dominating thermoregulation. ANS associated with low-frequency oscillations can be quantified in terms of frequencies, amplitudes, and phase shifts. The relative order between these faculties may be disturbed by conditions colloquially termed ‘stress’. Photoplethysmography imaging, an optical non-invasive diagnostic technique provides information on cutaneous tissue perfusion in the temporal and spatial domains. Using the cold pressure test (CPT) in thirteen healthy volunteers as a well-studied experimental intervention, we present a method for evaluating phase shifts in low- and intermediate frequency bands in forehead cutaneous perfusion mapping. Phase shift changes were analysed in low- and intermediate frequency ranges from 0.05 Hz to 0.18 Hz. We observed that time waveforms increasingly desynchronised in various areas of the scanned area throughout measurements. An increase of IM band phase desynchronization observed throughout measurements was comparable in experimental and control group, suggesting a time effect possibly due to overshooting the optimal relaxation duration. CPT triggered an increase in the number of points phase-shifted to the reference that was specific to the low frequency range for phase-shift thresholds defined as π/4, 3π/8, and π/2 rad, respectively. Phase shifts in forehead blood oscillations may infer changes of vascular tone due to activity of various neural systems. We present an innovative method for the phase shift analysis of cutaneous tissue perfusion that appears promising to assess ANS change processes related to physical or psychological stress. More comprehensive studies are needed to further investigate the reliability and physiological significance of findings.

Towards Development of Specular Reflection Vascular Imaging

Specular reflection from tissue is typically considered as undesirable, and managed through device design. However, we believe that specular reflection is an untapped light-tissue interaction, which can be used for imaging subcutaneous blood flow. To illustrate the concept of subcutaneous blood flow visualization using specular reflection from the skin, we have developed a ray tracing for the neck and identified conditions under which useful data can be collected. Based on our model, we have developed a prototype Specular Reflection Vascular Imaging (SRVI) device and demonstrated its feasibility by imaging major neck vessels in a case study. The system consists of a video camera that captures a video from a target area illuminated by a rectangular LED source. We extracted the SRVI signal from 5 × 5 pixels areas (local SRVI signal). The correlations of local SRVIs to the SRVI extracted from all pixels in the target area do not appear to be randomly distributed, but rather form cohesive sub-regions with distinct boundaries. The obtained waveforms were compared with the ECG signal. Based on the time delays with respect to the ECG signal, as well as the waveforms themselves, the sub-regions can be attributed to the jugular vein and carotid artery. The proposed method, SRVI, has the potential to contribute to extraction of the diagnostic information that the jugular venous pulse can provide.

Rational selection of RGB channels for disease classification based on IPPG technology

The green channel is usually selected as the optimal channel for vital signs monitoring in image photoplethysmography (IPPG) technology. However, some controversies arising from the different penetrability of skin tissue in visible light remain unresolved, i.e., making the optical and physiological information carried by the IPPG signals of the RGB channels inconsistent. This study clarifies that the optimal channels for different diseases are different when IPPG technology is used for disease classification. We further verified this conclusion in the classification model of heart disease and diabetes mellitus based on the random forest classification algorithm. The experimental results indicate that the green channel has a considerably excellent performance in classifying heart disease patients and the healthy with an average Accuracy value of 88.43% and an average F1score value of 93.72%. The optimal channel for classifying diabetes mellitus patients and the healthy is the red channel with an average Accuracy value of 82.12% and the average F1score value of 89.31%. Due to the limited penetration depth of the blue channel into the skin tissue, the blue channel is not as effective as the green and red channels as a disease classification channel. This investigation is of great significance to the development of IPPG technology and its application in disease classification.

Scattering-driven PPG signal model

This article discusses the origin of PPG signals. Two plausible hypotheses are analyzed: the volumetric hypothesis and a model wherein the PPG is driven by the RBC aggregation process. To verify the model predictions, the PPG signals at the fingertip were measured. External pressure was applied to the fingertip, presumably reducing the blood flow. The results expressed in terms of gamma, used in pulse-oximetry, agree with the aggregation model. In addition, the oscillometric signal and the PPG signal amplitude were simultaneously measured in the fingertip. All of the experimental results favor the proposed aggregation mechanism as responsible the PPG signal.

Wrist pulse signal acquisition and analysis for disease diagnosis: A review

Pulse diagnosis (PD) plays an indispensable role in healthcare in China, India, Korea, and other Orient countries. It requires considerable training and experience to master. The results of pulse diagnosis rely heavily on the practitioner's subjective analysis, which means that the results from different physicians may be inconsistent. To overcome these drawbacks, computational pulse diagnosis (CPD) is used with advanced sensing techniques and analytical methods. Focusing on the main processes of CPD, this paper provides a systematic review of the latest advances in pulse signal acquisition, signal preprocessing, feature extraction, and signal recognition. The most relevant principles and applications are presented along with current progress. Extensive comparisons and analyses are conducted to evaluate the merits of different methods employed in CPD. While much progress has been made, a lack of datasets and benchmarks has limited the development of CPD. To address this gap and facilitate further research, we present a benchmark to evaluate different methods. We conclude with observations of the status and prospects of CPD.

Diagnostic Features and Potential Applications of PPG Signal in Healthcare: A Systematic Review

Recent research indicates that Photoplethysmography (PPG) signals carry more information than oxygen saturation level (SpO2) and can be utilized for affordable, fast, and noninvasive healthcare applications. All these encourage the researchers to estimate its feasibility as an alternative to many expansive, time-wasting, and invasive methods. This systematic review discusses the current literature on diagnostic features of PPG signal and their applications that might present a potential venue to be adapted into many health and fitness aspects of human life. The research methodology is based on the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines 2020. To this aim, papers from 1981 to date are reviewed and categorized in terms of the healthcare application domain. Along with consolidated research areas, recent topics that are growing in popularity are also discovered. We also highlight the potential impact of using PPG signals on an individual's quality of life and public health. The state-of-the-art studies suggest that in the years to come PPG wearables will become pervasive in many fields of medical practices, and the main domains include cardiology, respiratory, neurology, and fitness. Main operation challenges, including performance and robustness obstacles, are identified.

Pulse Oximetry: The Working Principle, Signal Formation, and Applications

Pulse oximeters are routinely used in various medical-grade and consumer-grade applications. They can be used to estimate, for example, blood oxygen saturation, autonomic nervous system activity and cardiac function, blood pressure, sleep quality, and recovery through the recording of photoplethysmography signal. Medical-grade devices often record red and infra-red light-based photoplethysmography signals while smartwatches and other consumer-grade devices usually rely on a green light. At its simplest, a pulse oximeter can consist of one or two photodiodes and a photodetector attached, for example, a fingertip or earlobe. These sensors are used to record light absorption in a medium as a function of time. This time-varying absorption information is used to form a photoplethysmography signal. In this chapter, we discuss the working principles of pulse oximeters and the formation of the photoplethysmography signal. We will further discuss the advantages and disadvantages of pulse oximeters, which kind of applications exist in the medical field, and how pulse oximeters are utilized in daily health monitoring.

Fundamentals of Camera-PPG based Magnetic Resonance Imaging

In Magnetic Resonance Imaging (MRI), cardiac triggering that synchronizes data acquisition with cardiac contractions is an essential technique for acquiring high-quality images. Triggering is typically based on the Electrocardiogram (ECG) signal (e.g. R-peak). Since ECG acquisition involves extra workflow steps like electrode placement and ECG signals are usually disturbed by magnetic fields in high Magnetic Resonance (MR) systems, we explored camera-based photoplethysmography (PPG) as an alternative. We used the in-bore camera of a clinical MR system to investigate the feasibility and challenges of camera-based cardiac triggering. Data from ECG, finger oximeter and camera were synchronously collected. We found that that camera-PPG provides a higher availability of signal (and trigger) measurement, and the PPG signals measured from the forehead show considerably less delay w.r.t. the coupled ECG R-peak than the finger PPG signals in terms of trigger detection. The insights obtained in this study provide a basis for an envisioned system design phase.

A Tactile-Pattern-Integrated Sensing Window for More Consistent Photoplethysmography (PPG) Measurements

We have demonstrated a tactile-pattern-integrated sensing window for more consistent photoplethysmogram (PPG) measurements. The pattern is composed of two tiny bumps that measure 500μm in diameter and 300μm in height and allow users to position their finger pulps more consistently on the sensing window over different measurement occasions, simply by following their tactile sensation. We experimentally compared the tactile pattern window to a flat window (without any bumps) for 5 test subjects and found that the sensing window with the tactile pattern significantly helped users obtain more consistent PPG signals than the flat window (p < 0.01).The use of PPG sensors in mobile phones and wearable watches have been limited to the measurements of heart rates and blood oxygen saturation in spite of widely-spread efforts to expand their applications. This is due to the fluctuations observed between measurements which largely originate from inconsistent placement of fingers on the sensing windows. The integrated tactile pattern could provide consistent and accurate measurements and lead to more successful commercialization of diverse PPG-based mobile healthcare services.

Modified Camera Setups for Day-and-Night Pulse-rate Monitoring

Camera systems have been studied as a means for ubiquitous remote photoplethysmography. It was first considered for daytime applications using ambient light. However, main applications for continuous monitoring are in dark or low-light conditions (e.g. sleep monitoring) and, more recently, suitable light sources and simple camera adaptations have been considered for infrared-based solutions. This paper explores suitable camera configurations for pulse-rate monitoring during both day and night (24/7). Various configurations differing in the recorded spectral range are defined, i.e. straight-forward adaptations of a standard RGB camera by choosing proper optical filters. These systems have been studied in a benchmark involving day and night monitoring with various degrees of motion disturbances. The results indicate that, for the 24/7 monitoring, it is best to deploy the full spectral band of an RGB camera, and this can be done without compromising the monitoring performance at night.

Fusion Method to Estimate Heart Rate from Facial Videos Based on RPPG and RBCG

Remote sensing of vital signs has been developed to improve the measurement environment by using a camera without a skin-contact sensor. The camera-based method is based on two concepts, namely color and motion. The color-based method, remote photoplethysmography (RPPG), measures the color variation of the face generated by reflectance of blood, whereas the motion-based method, remote ballistocardiography (RBCG), measures the subtle motion of the head generated by heartbeat. The main challenge of remote sensing is overcoming the noise of illumination variance and motion artifacts. The studies on remote sensing have focused on the blind source separation (BSS) method for RGB colors or motions of multiple facial points to overcome the noise. However, they have still been limited in their real-world applications. This study hypothesized that BSS-based combining of colors and the motions can improve the accuracy and feasibility of remote sensing in daily life. Thus, this study proposed a fusion method to estimate heart rate based on RPPG and RBCG by the BSS methods such as ensemble averaging (EA), principal component analysis (PCA), and independent component analysis (ICA). The proposed method was verified by comparing it with previous RPPG and RBCG from three datasets according to illumination variance and motion artifacts. The three main contributions of this study are as follows: (1) the proposed method based on RPPG and RBCG improved the remote sensing with the benefits of each measurement; (2) the proposed method was demonstrated by comparing it with previous methods; and (3) the proposed method was tested in various measurement conditions for more practical applications.

Recent Academic Research on Clinically Relevant Digital Measures: Systematic Review

Background

Digital clinical measures collected via various digital sensing technologies such as smartphones, smartwatches, wearables, ingestibles, and implantables are increasingly used by individuals and clinicians to capture health outcomes or behavioral and physiological characteristics of individuals. Although academia is taking an active role in evaluating digital sensing products, academic contributions to advancing the safe, effective, ethical, and equitable use of digital clinical measures are poorly characterized.

Objective

We performed a systematic review to characterize the nature of academic research on digital clinical measures and to compare and contrast the types of sensors used and the sources of funding support for specific subareas of this research.

Methods

We conducted a PubMed search using a range of search terms to retrieve peer-reviewed articles reporting US-led academic research on digital clinical measures between January 2019 and February 2021. We screened each publication against specific inclusion and exclusion criteria. We then identified and categorized research studies based on the types of academic research, sensors used, and funding sources. Finally, we compared and contrasted the funding support for these specific subareas of research and sensor types.

Results

The search retrieved 4240 articles of interest. Following the screening, 295 articles remained for data extraction and categorization. The top five research subareas included operations research (research analysis; n=225, 76%), analytical validation (n=173, 59%), usability and utility (data visualization; n=123, 42%), verification (n=93, 32%), and clinical validation (n=83, 28%). The three most underrepresented areas of research into digital clinical measures were ethics (n=0, 0%), security (n=1, 0.5%), and data rights and governance (n=1, 0.5%). Movement and activity trackers were the most commonly studied sensor type, and physiological (mechanical) sensors were the least frequently studied. We found that government agencies are providing the most funding for research on digital clinical measures (n=192, 65%), followed by independent foundations (n=109, 37%) and industries (n=56, 19%), with the remaining 12% (n=36) of these studies completely unfunded.

Conclusions

Specific subareas of academic research related to digital clinical measures are not keeping pace with the rapid expansion and adoption of digital sensing products. An integrated and coordinated effort is required across academia, academic partners, and academic funders to establish the field of digital clinical measures as an evidence-based field worthy of our trust.

Assessment of Non-Invasive Blood Pressure Prediction from PPG and rPPG Signals Using Deep Learning

Exploiting photoplethysmography signals (PPG) for non-invasive blood pressure (BP) measurement is interesting for various reasons. First, PPG can easily be measured using fingerclip sensors. Second, camera based approaches allow to derive remote PPG (rPPG) signals similar to PPG and therefore provide the opportunity for non-invasive measurements of BP. Various methods relying on machine learning techniques have recently been published. Performances are often reported as the mean average error (MAE) on the data which is problematic. This work aims to analyze the PPG- and rPPG based BP prediction error with respect to the underlying data distribution. First, we train established neural network (NN) architectures and derive an appropriate parameterization of input segments drawn from continuous PPG signals. Second, we use this parameterization to train NNs with a larger PPG dataset and carry out a systematic evaluation of the predicted blood pressure. The analysis revealed a strong systematic increase of the prediction error towards less frequent BP values across NN architectures. Moreover, we tested different train/test set split configurations which underpin the importance of a careful subject-aware dataset assignment to prevent overly optimistic results. Third, we use transfer learning to train the NNs for rPPG based BP prediction. The resulting performances are similar to the PPG-only case. Finally, we apply different personalization techniques and retrain our NNs with subject-specific data for both the PPG-only and rPPG case. Whilst the particular technique is less important, personalization reduces the prediction errors significantly.

Effectiveness of consumer-grade contactless vital signs monitors: a systematic review and meta-analysis

The objective of this systematic review and meta-analysis was to analyze the effectiveness of contactless vital sign monitors that utilize a consumer-friendly camera versus medical grade instruments. A multiple database search was conducted from inception to September 2020. Inclusion criteria were as follows: studies that used a consumer-grade camera (smartphone/webcam) to examine contactless vital signs in adults; evaluated the non-contact device against a reference medical device; and used the participants’ face for measurement. Twenty-six studies were included in the review of which 16 were included in Pearson’s correlation and 14 studies were included in the Bland–Altman meta-analysis. Twenty-two studies measured heart rate (HR) (92%), three measured blood pressure (BP) (12%), and respiratory rate (RR) (12%). No study examined blood oxygen saturation (SpO₂). Most studies had a small sample size (≤ 30 participants) and were performed in a laboratory setting. Our meta-analysis found that consumer-grade contactless vital sign monitors were accurate in comparison to a medical device in measuring HR. Current contactless monitors have limitations such as motion, poor lighting, and lack of automatic face tracking. Currently available consumer-friendly contactless monitors measure HR accurately compared to standard medical devices. More studies are needed to assess the accuracy of contactless BP and RR monitors. Implementation of contactless vital sign monitors for clinical use will require validation in a larger population, in a clinical setting, and expanded to encompass other vital signs including BP, RR, and SpO₂.

Imagining How Lines Were Drawn: The Appreciation of Calligraphy and the Facilitative Factor Based on the Viewer's Rating and Heart Rate

For this study, we examined how recognizing the writing process of calligraphy influences the cognitive and affective processes related to appreciating it, with the aim of contributing to both graphonomics and the psychology of aesthetics. To this end, we conducted two Web-based experiments in which some participants were instructed to view calligraphy by tracing it with their eyes (the tracing method), while others were told to feel free to think and imagine whatever they wanted. Study 1 (N = 103) revealed that the tracing method elicits stronger admiration, inspiration, and empathy in viewers. Study 2 (N = 87) showed that the tracing method decreases the average heart rate of those who do not frequently engage in calligraphy appreciation as they gaze at calligraphy for a minute-and-a-half (during the second half of the stimulus duration); this suggests that the tracing method could keep viewers from becoming bored while looking at calligraphy. In sum, the tracing method has positive effects on viewing calligraphy. From a broader perspective, the results imply that how in detail viewers recognize the process of creating an artwork will be a key determinant of art appreciation. In addition, our findings demonstrate how we can measure cardiac activities using the emerging technology of the photoplethysmogram (PPG).

Recent Advances in Atherosclerotic Disease Screening Using Pervasive Healthcare

Atherosclerosis screening helps the medical model transform from therapeutic medicine to preventive medicine by assessing degree of atherosclerosis prior to the occurrence of fatal vascular events. Pervasive screening emphasizes atherosclerotic monitoring with easy access, quick process, and advanced computing. In this work, we introduced five cutting-edge pervasive technologies including imaging photoplethysmography (iPPG), laser Doppler, radio frequency (RF), thermal imaging (TI), optical fiber sensing and piezoelectric sensor. IPPG measures physiological parameters by using video images that record the subtle skin color changes consistent with cardiac-synchronous blood volume changes in subcutaneous arteries and capillaries. Laser Doppler obtained the information on blood flow by analyzing the spectral components of backscattered light from the illuminated tissues surface. RF is based on Doppler shift caused by the periodic movement of the chest wall induced by respiration and heartbeat. TI measures vital signs by detecting electromagnetic radiation emitted by blood flow. The working principle of optical fiber sensor is to detect the change of light properties caused by the interaction between the measured physiological parameter and the entering light. Piezoelectric sensors are based on the piezoelectric effect of dielectrics. All these pervasive technologies are noninvasive, mobile, and can detect physiological parameters related to atherosclerosis screening.

Optical incoherent technique for noninvasive assessment of blood flow in tissues: Theoretical model and experimental study

Laser noninvasive methods for assessment of a tissue blood flow (BF), for example, the Laser Doppler Flowmetry (LDF), are well-known today. However, in such methods, low-frequency fluctuations (LFFs) in the registered optical signal caused by blood volume changes inside a tissue have not been studied in details until now. The aim of this study is to investigate the LFFs formation and to justify the LFFs-based diagnostic technique for cutaneous BF assessment. LFFs are theoretically described and experimentally shown in the input LDF signal inside the frequency range 0 to 10 Hz. They are substantiated as the basis of the new diagnostic method, in which BF is defined as the magnitude of blood volume changes in a tissue per unit time. The hand-made prototype of the promising diagnostic tool with light emitted diodes is used to validate the technique in experiments in vivo on 16 healthy volunteers in comparison with the LDF method. Experimental results show a good similarity of the recorded BF for both coherent and incoherent method. The proposed technique makes it possible the creation of inexpensive diagnostic equipment for assessment of cutaneous BF without using lasers and coherent light, completely and functionally comparable to LDF devices.

Validation of a non-invasive imaging photoplethysmography device to assess plantar skin perfusion, a comparison with laser speckle contrast analysis

Assessing skin perfusion is an established and reliable method to study impaired lower limb blood flow. Laser Speckle Contrast Analysis (LASCA) has been identified as the current gold standard to measure skin perfusion. Imaging photoplethysmography (iPPG) is a new low-cost imaging technique to assess perfusion. However, it is unclear how results obtained from this technique compare against that of LASCA at plantar skin. Therefore, the aim of this study was to investigate the association between the skin perfusion at the plantar surface of the foot using iPPG and LASCA. Perfusion at six plantar locations (Hallux, 1st 3rd 5th metatarsal heads, midfoot, heel) was simultaneously measured using LASCA and iPPG in 20 healthy participants. Skin thickness and skin temperature were also collected at the same plantar locations. Spearman's rank tests showed significant associations with medium strength between the perfusion values measured with LASCA and iPPG for most tested sites. No improvement in the relationship between iPPG and LASCA data was observed when controlling for either skin thickness or skin temperature. Skin perfusion values obtained using iPPG were found to be significantly associated with the corresponding values obtained using the gold standard LASCA device. Additionally, the measurement of perfusion using iPPG is shown to be robust.

A measurement of illumination variation-resistant noncontact heart rate based on the combination of singular spectrum analysis and sub-band method

BACKGROUND AND OBJECTIVE

The imaging photoplethysmography method is a non-contact and non-invasive measurement method that usually uses surrounding illumination as an illuminant, which can be easily influenced by the surrounding illumination variations. Thus, it has a practical value to develop an efficient method of heart rate measurement that can remove the interference of illumination variations robustly.

METHOD

We propose a novel framework of heart rate measurement that is robust to illumination variations by combining singular spectrum analysis and sub-band method. At first, we extract the blood volume pulse signal by applying the modified sub-band method to the raw facial RGB trace signals. Then the spectra for the interference of illumination variations are extracted from the raw signal obtained from facial regions of interest by using singular spectrum analysis. Finally, we estimate the more robust heart rate through comparison analysis between the spectra of the extracted blood volume pulse signal and the illumination variations.

RESULTS

We compared our method with several state-of-the-art methods through the analysis using the self-collected data and the UBFC-RPPG database. Bland-Altman plots and Pearson correlation coefficients pointed out that the proposed method could measure the heart rate more accurately than the state-of-the-art methods. For the self-collected data and the UBFC-RPPG database, Bland-Altman plots showed that proposed method caused better agreement with 95% limits from -4 bpm to 10 bpm and from -2 bpm to 4 bpm respectively than the other state-of-the-art methods. It also revealed that the highly linear relation was held between the estimated heart rate and ground truth with the correlation coefficients of 0.89 and 0.99, respectively.

CONCLUSION

By extracting illumination variation directly from the facial region of interest rather than from the background region of interest, the proposed method demonstrates that it can overcome the drawbacks of the previous methods due to the illumination variation difference between the background and facial regions of interest. It can be found that the proposed method has a relatively good robustness regardless of whether illumination variation exists or not.

Remote Photoplethysmography for Evaluation of Cutaneous Sensory Nerve Fiber Function

About 2% of the world’s population suffers from small nerve fiber dysfunction, neuropathy, which can result in severe pain. This condition is caused by damage to the small nerve fibers and its assessment is challenging, due to the lack of simple and objective diagnostic techniques. The present study aimed to develop a contactless photoplethysmography system using simple instrumentation, for objective and non-invasive assessment of small cutaneous sensory nerve fiber function. The approach is based on the use of contactless photoplethysmography for the characterization of skin flowmotions and topical heating evoked vasomotor responses. The feasibility of the technique was evaluated on volunteers (n = 14) using skin topical anesthesia, which is able to produce temporary alterations of cutaneous nerve fibers function. In the treated skin region in comparison to intact skin: neurogenic and endothelial component of flowmotions decreased by ~61% and 41%, the local heating evoked flare area decreased by ~44%, vasomotor response trend peak and nadir were substantially reduced. The results indicate for the potential of the remote photoplethysmography in the assessment of the cutaneous nerve fiber function. It is believed that in the future this technique could be used in the clinics as an affordable alternative to laser Doppler imaging technique.

Comparison of Visible and Infrared Video Plethysmography Captured from Different Regions of the Human Face

Recently, video plethysmography (VPG) - a heart rate estimation technique using a video camera - has gained significant attention. Most studies of VPG have used a visible RGB camera; only a limited number of studies investigating near-infrared light (wavelength 750-2500 nm), which can be used even in a dark environment, have been performed. The purpose of this study was to investigate the differences between VPG data collected using visible light (VPG_VIS) or near-infrared light (VPG_NIR) from four facial areas (forehead, right cheek, left cheek, and nose). An experiment was conducted to obtain both VPG_VIS and VPG_NIR simultaneously by alternately irradiating the face with NIR and VIS lights. Experimental results showed that the root mean squared error of heart rate estimated using VPG_NIR was 1 bpm higher than that of VPG_VIS. However, contrary to our expectations, the power of the heartbeat-related component included in VPG_NIR was not reduced despite the absorbance of hemoglobin in the NIR light range being 1/100 of that in the VIS light range. This result supports the hypothesis that a main factor in the generation of VPG waves was change in the optical properties caused by blood vessels compressing the subcutaneous tissue and the venous bed. Additionally, the accuracy of the heart rate estimation using VPG tended to be high when the nose was set as the ROI. This result was likely associated with the anatomical structure of the nose.

Association of remote imaging photoplethysmography and cutaneous perfusion in volunteers

Remote imaging photoplethysmography (iPPG) senses the cardiac pulse in outer skin layers and is responsive to mean arterial pressure and pulse pressure in critically ill patients. Whether iPPG is sufficiently sensitive to monitor cutaneous perfusion is not known. This study aimed at determining the response of iPPG to changes in cutaneous perfusion measured by  Laser speckle imaging (LSI). Thirty-seven volunteers were engaged in a cognitive test known to evoke autonomic nervous activity and a Heat test. Simultaneous measurements of iPPG and LSI were taken at baseline and during cutaneous perfusion challenges. A perfusion index (PI) was calculated to assess iPPG signal strength. The response of iPPG to the challenges and its relation to LSI were determined. PI of iPPG significantly increased in response to autonomic nervous stimuli and to the Heat test by 5.8% (p = 0.005) and 11.1% (p < 0.001), respectively. PI was associated with LSI measures of cutaneous perfusion throughout experiments (p < 0.001). iPPG responses to study task correlated with those of LSI (r = 0.62, p < 0.001) and were comparable among subjects. iPPG is sensitive to autonomic nervous activity in volunteers and is closely associated with cutaneous perfusion.

Intraoperative Imaging of Cortical Blood Flow by Camera-Based Photoplethysmography at Green Light

Intraoperative evaluation of blood perfusion in the brain cortex is an important but hitherto unresolved problem. Our aim was to demonstrate the feasibility of cerebral microcirculation assessment during open brain surgery by using camera-based photoplethysmography (cbPPG) synchronized with an electrocardiograph. Cortical blood flow was monitored in five patients with different diagnoses. Two cases (tumor resection and extra-intracranial bypass grafting) are presented in detail. Blood-flow parameters were visualized after processing cortex images recorded under green-light illumination before and after surgical intervention. In all cases, blood flow was successfully visualized in >95% of open brain. Distributions of blood pulsation amplitude, a parameter related to cortical blood perfusion; pulse arrival time; and blood-pressure-pulse shape were calculated with high spatial resolution (in every pixel). Changes in cerebral blood supply caused by surgical intervention were clearly revealed. We have shown that the temporal spread of pulse arrival time and the spatiotemporal variability of pulse shape are very sensitive markers of brain circulatory disturbances. The green-light cbPPG system offers a new approach to objective assessment of blood-flow changes in the brain during surgical intervention. The proposed system allows for contactless monitoring of cortex blood flow in real time with high resolution, thus providing useful information for surgery optimization and minimization of brain tissue damage.