Does stereopsis improve face identification? A study using a virtual reality display with integrated eye-tracking and pupillometry

CAS(ME)3: A Third Generation Facial Spontaneous Micro-Expression Database With Depth Information and High Ecological Validity

Micro-expression (ME) is a significant non-verbal communication clue that reveals one person's genuine emotional state. The development of micro-expression analysis (MEA) has just gained attention in the last decade. However, the small sample size problem constrains the use of deep learning on MEA. Besides, ME samples distribute in six different databases, leading to database bias. Moreover, the ME database development is complicated. In this article, we introduce a large-scale spontaneous ME database: CAS(ME) 3. The contribution of this article is summarized as follows: (1) CAS(ME) 3 offers around 80 hours of videos with over 8,000,000 frames, including manually labeled 1,109 MEs and 3,490 macro-expressions. Such a large sample size allows effective MEA method validation while avoiding database bias. (2) Inspired by psychological experiments, CAS(ME) 3 provides the depth information as an additional modality unprecedentedly, contributing to multi-modal MEA. (3) For the first time, CAS(ME) 3 elicits ME with high ecological validity using the mock crime paradigm, along with physiological and voice signals, contributing to practical MEA. (4) Besides, CAS(ME) 3 provides 1,508 unlabeled videos with more than 4,000,000 frames, i.e., a data platform for unsupervised MEA methods. (5) Finally, we demonstrate the effectiveness of depth information by the proposed depth flow algorithm and RGB-D information.

The lateralized flash-lag illusion: A psychophysical and pupillometry study

The flash-lag illusion (FLI) is a visual phenomenon where a flashed object, either co-localized or in physical alignment with another continuously moving object, is perceived to lag behind the path of the moving object. In the present study, we reveal an anisotropy of the FLI between the lateral visual fields that was expressed psychophysically as different points of subjective equality, depending on the hemifield in which the stimuli appeared. Specifically, the study confirmed that, as seen in two previous studies, the FLI was significantly larger in the left visual field (LVF) than in the right (RVF). In addition, pupil dilations were larger in the RVF than in the LVF as well as returning to baseline levels more rapidly in the LVF. We interpret these findings as converging on revealing more efficient spatial and attentional processing and, in turn, extrapolation of motion in the LVF/right hemisphere than in the RVF/left hemisphere.

Pupil psychosensory reflex in response to own and standardised silhouettes in patients with anorexia nervosa

OBJECTIVE

This study aimed to assess the physiological response of patients with anorexia nervosa (AN) to different types of silhouettes using pupillometry.

METHODS

We measured the pupil psychosensory reflex (PSR) of 42 patients with AN and 35 healthy controls in response to standardised body silhouettes and to pictures of their own silhouettes digitally modified to represent different body mass indices (BMI). Perceptual distortion and body dissatisfaction were assessed using Anamorphic Micro Software©. Twenty-three of the recruited patients were tested up to four times during an inpatient treatment programme to assess the impact of weight gain.

RESULTS

PSR correlated with the subjective rating of emotional arousal in controls but not in patients. Own silhouettes and standardised silhouettes triggered a different pupil response both in patients with AN and in controls. With pictures of their own silhouettes, pupil response to underweight stimuli differed from pupil response to normal weight or overweight stimuli in both groups. Weight gain was associated with an increase in PSR, an improvement of ideal BMI and a decrease of body dissatisfaction, but no change in perceptual distortion.

CONCLUSION

Our findings support the idea that pupillometry could be a useful tool to assess the physiological state of patients with AN.