Stress levels estimation from facial video based on non-contact measurement of pulse wave

Contactless face video based vital signs detection framework for continuous health monitoring using feature optimization and hybrid neural network

Continuous monitoring of vital signs such as respiration and heart rate is essential to detect and predict conditions that may affect the patient's well-being. To detect these vital signs most medical systems use contact sensors. They are not feasible for long term monitoring and are not repeatable. Vital signs using facial video-noncontact monitoring are becoming increasingly important. Researchers in the last few years although considerable progress has been made, challenging datasets absence timing of assessment process and the technology still has some limitations such as time consuming nature and lack of computer portability. To solve those problems, we propose a contactless video based vital signs detection framework for continuous health monitoring using feature optimization and hybrid neural network. In the proposed technique, modified war strategy optimization algorithm is proposed to segment the face portion from the input video frames. Then, we utilize the known data acquisition models to extract vital signs from the segmented face portions are heart rate, blood pressure, respiratory rate and oxygen saturation. An improved neural network structure (Lifting Net) is further used to achieve the adaptive extraction of deep hidden features for specific signs, for realizing the high precision of human health monitoring. The Hughes effect or dimensionality issue affects detection accuracy in sign classification when there are fewer training instances relative to the number of spectral features. The problem can be overcome through feature optimization here Northern goshawk optimization algorithm is used to select optimal best features which reduces the data dimensionality issue. Furthermore, hybrid deep ensemble reinforcement learning classifier is proposed for the human vital sign detection and classification which ensures the early detection of patient abnormality. Finally, we validate our framework using benchmark video datasets such as TokyoTechrPPG, PURE and COHFACE. To proves the effectiveness of proposed technique using simulation results and comparative analysis.

Blood pressure estimation by spatial pulse-wave dynamics in a facial video

We propose a remote method to estimate continuous blood pressure (BP) based on spatial information of a pulse-wave as a function of time. By setting regions of interest to cover a face in a mutually exclusive and collectively exhaustive manner, RGB facial video is converted into a spatial pulse-wave signal. The spatial pulse-wave signal is converted into spatial signals of contours of each segmented pulse beat and relationships of each segmented pulse beat. The spatial signal is represented as a time-continuous value based on a representation of a pulse contour in a time axis and a phase axis and an interpolation along with the time axis. A relationship between the spatial signals and BP is modeled by a convolutional neural network. A dataset was built to demonstrate the effectiveness of the proposed method. The dataset consists of continuous BP and facial RGB videos of ten healthy volunteers. The results show an adequate estimation of the performance of the proposed method when compared to the ground truth in mean BP, in both the correlation coefficient (0.85) and mean absolute error (5.4 mmHg). For comparison, the dataset was processed using conventional pulse features, and the estimation error produced by our method was significantly lower. To visualize the root source of the BP signals used by our method, we have visualized spatial-wise and channel-wise contributions to the estimation by the deep learning model. The result suggests the spatial-wise contribution pattern depends on the blood pressure, while the pattern of pulse contour-wise contribution pattern reflects the relationship between percussion wave and dicrotic wave.