Noncontact measurement of emotional and physiological changes in heart rate from a webcam

Where is emotional feeling felt in the body? An integrative review

Contemporary research on "embodied emotion" emphasizes the role of the body in emotional feeling. The evidence base on interoception, arguably the most prominent strand of embodied emotion research, places emphasis on the cardiac, respiratory and gastrointestinal systems. In turn, interoception has evidence-based links with improved emotion regulation. Despite the focus on separate bodily systems, it is unclear whether particular interoceptive locations play a greater role in emotional feeling and emotion regulation. Further, according to Gross' "process model", the sooner that regulation of an emotion occurs, the better; hence, it is additionally important to identify the first body areas to activate. These issues are investigated in a two-stage integrative review. The first stage was preliminary, giving an overview of the evidence base to highlight the distribution of measured body areas. This indicated that 86% of publications (n = 88) measured cardiac activity, 26% measured the respiratory system, and six percent the gastrointestinal system. Given the emphasis placed on all three systems in interoception theory and research on emotion, this suggests a dearth of comprehensive findings pertaining to feeling locations. The second stage investigated the core issues of where emotional feelings are felt in the body and time-related implications for regulation. This was based on ten texts, which together suggested that the head, throat and chest are the most consistently detected locations across and within numerous emotional contexts. Caution is required, however, since-among other reasons discussed-measurement was not time-restricted in these latter publications, and direct physiological measurement was found in only a minority of cases.

Automated video-based heart rate tracking for the anesthetized and behaving monkey

Heart rate (HR) is extremely valuable in the study of complex behaviours and their physiological correlates in non-human primates. However, collecting this information is often challenging, involving either invasive implants or tedious behavioural training. In the present study, we implement a Eulerian video magnification (EVM) heart tracking method in the macaque monkey combined with wavelet transform. This is based on a measure of image to image fluctuations in skin reflectance due to changes in blood influx. We show a strong temporal coherence and amplitude match between EVM-based heart tracking and ground truth ECG, from both color (RGB) and infrared (IR) videos, in anesthetized macaques, to a level comparable to what can be achieved in humans. We further show that this method allows to identify consistent HR changes following the presentation of conspecific emotional voices or faces. EVM is used to extract HR in humans but has never been applied to non-human primates. Video photoplethysmography allows to extract awake macaques HR from RGB videos. In contrast, our method allows to extract awake macaques HR from both RGB and IR videos and is particularly resilient to the head motion that can be observed in awake behaving monkeys. Overall, we believe that this method can be generalized as a tool to track HR of the awake behaving monkey, for ethological, behavioural, neuroscience or welfare purposes.

Remote Monitoring of Vital Signs in Diverse Non-Clinical and Clinical Scenarios Using Computer Vision Systems: A Review

Techniques for noncontact measurement of vital signs using camera imaging technologies have been attracting increasing attention. For noncontact physiological assessments, computer vision-based methods appear to be an advantageous approach that could be robust, hygienic, reliable, safe, cost effective and suitable for long distance and long-term monitoring. In addition, video techniques allow measurements from multiple individuals opportunistically and simultaneously in groups. This paper aims to explore the progress of the technology from controlled clinical scenarios with fixed monitoring installations and controlled lighting, towards uncontrolled environments, crowds and moving sensor platforms. We focus on the diversity of applications and scenarios being studied in this topic. From this review it emerges that automatic multiple regions of interest (ROIs) selection, removal of noise artefacts caused by both illumination variations and motion artefacts, simultaneous multiple person monitoring, long distance detection, multi-camera fusion and accepted publicly available datasets are topics that still require research to enable the technology to mature into many real-world applications.

A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving

As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures' unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists' cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems.