Facial functional networks during resting state revealed by thermal infrared imaging

In recent decades, an increasing number of studies on psychophysiology and, in general, on clinical medicine has employed the technique of facial thermal infrared imaging (IRI), which allows to obtain information about the emotional and physical states of the subjects in a completely non-invasive and contactless fashion. Several regions of interest (ROIs) have been reported in literature as salient areas for the psychophysiological characterization of a subject (i.e. nose tip and glabella ROIs). There is however a lack of studies focusing on the functional correlation among these ROIs and about the physiological basis of the relation existing between thermal IRI and vital signals, such as the electrodermal activity, i.e. the galvanic skin response (GSR). The present study offers a new methodology able to assess the functional connection between salient seed ROIs of thermal IRI and all the pixel of the face. The same approach was also applied considering as seed signal the GSR and its phasic and tonic components. Seed correlation analysis on 63 healthy volunteers demonstrated the presence of a common pathway regulating the facial thermal functionality and the electrodermal activity. The procedure was also tested on a pathological case study, finding a completely different pattern compared to the healthy cases. The method represents a promising tool in neurology, physiology and applied neurosciences.

Intraoperative thermal infrared imaging in neurosurgery: machine learning approaches for advanced segmentation of tumors

Surgical resection is one of the most relevant practices in neurosurgery. Finding the correct surgical extent of the tumor is a key question and so far several techniques have been employed to assist the neurosurgeon in preserving the maximum amount of healthy tissue. Some of these methods are invasive for patients, not always allowing high precision in the detection of the tumor area. The aim of this study is to overcome these limitations, developing machine learning based models, relying on features obtained from a contactless and non-invasive technique, the thermal infrared (IR) imaging. The thermal IR videos of thirteen patients with heterogeneous tumors were recorded in the intraoperative context. Time (TD)- and frequency (FD)-domain features were extracted and fed different machine learning models. Models relying on FD features have proven to be the best solutions for the optimal detection of the tumor area (Average Accuracy = 90.45%; Average Sensitivity = 84.64%; Average Specificity = 93,74%). The obtained results highlight the possibility to accurately detect the tumor lesion boundary with a completely non-invasive, contactless, and portable technology, revealing thermal IR imaging as a very promising tool for the neurosurgeon.

Facial thermal and blood perfusion patterns of human emotions: Proof-of-Concept

In this work, a preliminary study of proof-of-concept was conducted to evaluate the performance of the thermographic and blood perfusion data when emotions of positive and negative valence are applied, where the blood perfusion data are obtained from the thermographic data. The images were obtained for baseline, positive, and negative valence according to the protocol of the Geneva Affective Picture Database. Absolute and percentage differences of average values of the data between the valences and the baseline were calculated for different regions of interest (forehead, periorbital eyes, cheeks, nose and upper lips). For negative valence, a decrease in temperature and blood perfusion was observed in the regions of interest, and the effect was greater on the left side than on the right side. In positive valence, the temperature and blood perfusion increased in some cases, showing a complex pattern. The temperature and perfusion of the nose was reduced for both valences, which is indicative of the arousal dimension. The blood perfusion images were found to be greater contrast; the percentage differences in the blood perfusion images are greater than those obtained in thermographic images. Moreover, the blood perfusion images, and vasomotor answer are consistent, therefore, they can be a better biomarker than thermographic analysis in identifying emotions.

Thermal infrared imaging based facial temperature in comparison to ear temperature during a real-driving scenario

Motion Sickness is associated with a variety of symptoms, which differ in occurrence rate and intensity between individuals. In order to research the cause of car sickness and develop countermeasures, it is important to determine symptoms and their severity objectively. A tool for this purpose could be the assessment of physiological reactions due to motion sickness. This paper describes and discusses a methodology to identify changes in facial skin temperatures in a real-driving study. Common techniques had to be adjusted in order to meet the requirements given by the challenges of in-car-recording. The examined data was generated in a previous study, which was designed to research motion sickness in a driving environment. A pre-processing technique had to be developed to magnify features on the face and subsequently improve the tracking in thermal imagery. After the pre-processing, regions of interest (ROI) were manually marked and tracked in thermal images. The thereby assessed facial skin temperatures were compared to tympanic temperatures. Derived temperatures from the forehead as well as from the 20 hottest pixels within the face indicated a better tracking, while the nose tip was more affected by detection errors. The correlation of the three features with the tympanic temperature showed remarkable differences between a baseline measurement and the actual driving. Less than 10% of the data derived during the driving and up to 30% of the data during the baseline measurement correlated highly. It is concluded that detecting changes in facial skin temperature using thermal infrared imaging in a moving car is challenging and results are hardly comparable to tympanic temperatures. Future research should aim at the different influencing factors of skin and tympanic temperature, while enhancing tracking or detection of ROI could be achieved by reducing the passengers' movements or choosing the target area more carefully.

Phenotyping viral infection in sweetpotato using a high-throughput chlorophyll fluorescence and thermal imaging platform

BACKGROUND

Virus diseases caused by co-infection with Sweet potato feathery mottle virus (SPFMV) and Sweetpotato chlorotic stunt virus (SPCSV) are a severe problem in the production of sweetpotato (Ipomoea batatas L.). Traditional molecular virus detection methods include nucleic acid-based and serological tests. In this study, we aimed to validate the use of a non-destructive imaging-based plant phenotype platform to study plant-virus synergism in sweetpotato by comparing four virus treatments with two healthy controls.

RESULTS

By monitoring physiological and morphological effects of viral infection in sweetpotato over 29 days, we quantified photosynthetic performance from chlorophyll fluorescence (ChlF) imaging and leaf thermography from thermal infrared (TIR) imaging among sweetpotatoes. Moreover, the differences among different treatments observed from ChlF and TIR imaging were related to virus accumulation and distribution in sweetpotato. These findings were further validated at the molecular level by related gene expression in both photosynthesis and carbon fixation pathways.

CONCLUSION

Our study validated for the first time the use of ChlF- and TIR-based imaging systems to distinguish the severity of virus diseases related to SPFMV and SPCSV in sweetpotato. In addition, we demonstrated that the operating efficiency of PSII and photochemical quenching were the most sensitive parameters for the quantification of virus effects compared with maximum quantum efficiency, non-photochemical quenching, and leaf temperature.

Children with facial paralysis due to Moebius syndrome exhibit reduced autonomic modulation during emotion processing

BACKGROUND

Facial mimicry is crucial in the recognition of others' emotional state. Thus, the observation of others' facial expressions activates the same neural representation of that affective state in the observer, along with related autonomic and somatic responses. What happens, therefore, when someone cannot mimic others' facial expressions?

METHODS

We investigated whether psychophysiological emotional responses to others' facial expressions were impaired in 13 children (9 years) with Moebius syndrome (MBS), an extremely rare neurological disorder (1/250,000 live births) characterized by congenital facial paralysis. We inspected autonomic responses and vagal regulation through facial cutaneous thermal variations and by the computation of respiratory sinus arrhythmia (RSA). These parameters provide measures of emotional arousal and show the autonomic adaptation to others' social cues. Physiological responses in children with MBS were recorded during dynamic facial expression observation and were compared to those of a control group (16 non-affected children, 9 years).

RESULTS

There were significant group effects on thermal patterns and RSA, with lower values in children with MBS. We also observed a mild deficit in emotion recognition in these patients.

CONCLUSION

Results support "embodied" theory, whereby the congenital inability to produce facial expressions induces alterations in the processing of facial expression of emotions. Such alterations may constitute a risk for emotion dysregulation.

"The face of ostracism": The impact of the social categorization on the thermal facial responses of the target and the observer

Ostracism has been shown to elicit pain in both the target and the observers. Two experiments investigated the autonomic thermal signature associated with an ostracism experience and assessed whether and how social categorization impacts the autonomic arousal of both the target and the observer. Autonomic response was assessed using thermal infrared imaging, recording facial temperature variation during an online game of ball toss (i.e., Cyberball). Social categorization was manipulated using a minimal group paradigm. The results show a more intense autonomic response during ostracism (vs. inclusion), marked by an increase in facial temperature in the nose and the perioral area. This autonomic response is stronger when individuals are ostracized by ingroup (vs. outgroup) members. Similar pattern of temperature variations emerge when individuals observe an ostracism episode involving ingroup members. Our findings advance the understanding of psycho-physiological mechanisms underlying the ostracism experience and emphasize the impact of social categorization in such mechanisms.

Thermal infrared imaging in psychophysiology: potentialities and limits

Functional infrared thermal imaging (fITI) is considered an upcoming, promising methodology in the emotional arena. Driven by sympathetic nerves, observations of affective nature derive from muscular activity subcutaneous blood flow as well as perspiration patterns in specific body parts. A review of 23 experimental procedures that employed fITI for investigations of affective nature is provided, along with the adopted experimental protocol and the thermal changes that took place on selected regions of interest in human and nonhuman subjects. Discussion is provided regarding the selection of an appropriate baseline, the autonomic nature of the thermal print, the experimental setup, methodological issues, limitations, and considerations, as well as future directions.