Detecting and categorizing fleeting emotions in faces

Expressions of emotion are often brief, providing only fleeting images from which to base important social judgments. We sought to characterize the sensitivity and mechanisms of emotion detection and expression categorization when exposure to faces is very brief, and to determine whether these processes dissociate. Observers viewed 2 backward-masked facial expressions in quick succession, 1 neutral and the other emotional (happy, fearful, or angry), in a 2-interval forced-choice task. On each trial, observers attempted to detect the emotional expression (emotion detection) and to classify the expression (expression categorization). Above-chance emotion detection was possible with extremely brief exposures of 10 ms and was most accurate for happy expressions. We compared categorization among expressions using a d' analysis, and found that categorization was usually above chance for angry versus happy and fearful versus happy, but consistently poor for fearful versus angry expressions. Fearful versus angry categorization was poor even when only negative emotions (fearful, angry, or disgusted) were used, suggesting that this categorization is poor independent of decision context. Inverting faces impaired angry versus happy categorization, but not emotion detection, suggesting that information from facial features is used differently for emotion detection and expression categorizations. Emotion detection often occurred without expression categorization, and expression categorization sometimes occurred without emotion detection. These results are consistent with the notion that emotion detection and expression categorization involve separate mechanisms.

Face-sensitive P1 and N170 components are related to the perception of two-dimensional and three-dimensional objects

Studies investigating event-related potentials have reported on face-sensitive P1 and N170 components, as well as object-related N170 components. Face-sensitive N170 is also sensitive to face inversion, which has been defined as the face-inversion effect. This study aimed to directly compare the relationship between face-sensitive N170 during face perception (upright and inverted faces) and object-related N170 during object perception (two-dimensional and three-dimensional objects). More specifically, the purpose was to clarify whether face-sensitive P1 and N170 components are related to the perception of two-dimensional and three-dimensional objects. Electroencephalography was performed in participants who were shown one of the four types of stimuli: upright faces, inverted faces, two-dimensional objects, or three-dimensional objects. The results revealed that the latency of P1 for three-dimensional objects was significantly longer than that for two-dimensional objects, the latency of N170 for three-dimensional objects was significantly longer than that for two-dimensional objects, and the latency of N170 for inverted faces was significantly longer than that for upright faces. These findings suggest that face-sensitive P1 and N170 components are related to the perception of two-dimensional and three-dimensional objects. Moreover, the results suggest that, similar to the face-inversion effect of face-sensitive N170 affected by mental rotation of the face, the object-related N170 of three-dimensional objects was affected by the mental rotation of two-dimensional objects. This suggests the novel possibility that face-sensitive P1 and N170 components can be used as an index for the perception of two-dimensional and three-dimensional objects.

Theta- and Gamma-Band Activity Discriminates Face, Body and Object Perception

Face and body perception is mediated by configural mechanisms, which allow the perception of these stimuli as a whole, rather than the sum of individual parts. Indirect measures of configural processing in visual cognition are the face and body inversion effects (FIE and BIE), which refer to the drop in performance when these stimuli are perceived upside-down. Albeit FIE and BIE have been well characterized at the behavioral level, much still needs to be understood in terms of the neurophysiological correlates of these effects. Thus, in the current study, the brain’s electrical activity has been recorded by a 128 channel electroencephalogram (EEG) in 24 healthy participants while perceiving (upright and inverted) faces, bodies and houses. EEG data were analyzed in both the time domain (i.e., event-related potentials—ERPs) and the frequency domain [i.e., induced theta (5–7 Hz) and gamma (28–45 Hz) oscillations]. ERPs amplitude results showed increased N170 amplitude for inverted faces and bodies (compared to the same stimuli presented in canonical position) but not for houses. ERPs latency results showed delayed N170 components for inverted (vs. upright) faces, houses, but not bodies. Spectral analysis of induced oscillations indicated physiological FIE and BIE; that is decreased gamma-band synchronization over right occipito-temporal electrodes for inverted (vs. upright) faces, and increased bilateral frontoparietal theta-band synchronization for inverted (vs. upright) faces. Furthermore, increased left occipito-temporal and right frontal theta-band synchronization for upright (vs. inverted) bodies was found. Our findings, thus, demonstrate clear differences in the neurophysiological correlates of face and body perception. The neurophysiological FIE suggests disruption of feature binding processes (decrease in occipital gamma oscillations for inverted faces), together with enhanced feature-based attention (increase in frontoparietal theta oscillations for inverted faces). In contrast, the BIE may suggest that structural encoding for bodies is mediated by the first stages of configural processing (decrease in occipital theta oscillations for inverted bodies).

Inversion Impairs Expert Budgerigar Identity Recognition: A Face-Like Effect for a Nonface Object of Expertise

The face-inversion effect is the finding that picture-plane inversion disproportionately impairs face recognition compared to object recognition and is now attributed to greater orientation-sensitivity of holistic processing for faces but not common objects. Yet, expert dog judges have showed similar recognition deficits for inverted dogs and inverted faces, suggesting that holistic processing is not specific to faces but to the expert recognition of perceptually similar objects. Although processing changes in expert object recognition have since been extensively documented, no other studies have observed the distinct recognition deficits for inverted objects-of-expertise that people as face experts show for faces. However, few studies have examined experts who recognize individual objects similar to how people recognize individual faces. Here we tested experts who recognize individual budgerigar birds. The effect of inversion on viewpoint-invariant budgerigar and face recognition was compared for experts and novices. Consistent with the face-inversion effect, novices showed recognition deficits for inverted faces but not for inverted budgerigars. By contrast, experts showed equal recognition deficits for inverted faces and budgerigars. The results are consistent with the hypothesis that processes underlying the face-inversion effect are specific to the expert individuation of perceptually similar objects.

Explaining Sad People's Memory Advantage for Faces

Sad people recognize faces more accurately than happy people (Hills et al., 2011). We devised four hypotheses for this finding that are tested between in the current study. The four hypotheses are: (1) sad people engage in more expert processing associated with face processing; (2) sad people are motivated to be more accurate than happy people in an attempt to repair their mood; (3) sad people have a defocused attentional strategy that allows more information about a face to be encoded; and (4) sad people scan more of the face than happy people leading to more facial features to be encoded. In Experiment 1, we found that dysphoria (sad mood often associated with depression) was not correlated with the face-inversion effect (a measure of expert processing) nor with response times but was correlated with defocused attention and recognition accuracy. Experiment 2 established that dysphoric participants detected changes made to more facial features than happy participants. In Experiment 3, using eye-tracking we found that sad-induced participants sampled more of the face whilst avoiding the eyes. Experiment 4 showed that sad-induced people demonstrated a smaller own-ethnicity bias. These results indicate that sad people show different attentional allocation to faces than happy and neutral people.

Face-Inversion Effect on Disgust Evoked by a Cluster of Dots

A cluster of dots such as lotus seed pods evokes extremely strong disgust when it is placed on human and animal skins. However, few empirical studies have examined the role of the background image, such as skin, in the generation of disgust. In this study, we investigated whether the orientation of background faces influences the disgust evoked by the dot pattern. The participants were asked to evaluate disgust to an upright, inverted, or phase-scrambled face image with or without a cluster of dots on it and then complete a questionnaire measuring trypophobia proneness (Trypophobia Questionnaire). The results suggested that disgust was intensified by the background faces, especially by the upright faces. The intensification of disgust in the upright face was correlated positively with the Trypophobia Questionnaire scores. The results indicated a face-inversion effect on the disgust to the dot pattern, suggesting a significant role of the background image.

The Bandwidth of Diagnostic Horizontal Structure for Face Identification

Horizontally oriented spatial frequency components are a diagnostic source of face identity information, and sensitivity to this information predicts upright identification accuracy and the magnitude of the face-inversion effect. However, the bandwidth at which this information is conveyed, and the extent to which human tuning matches this distribution of information, has yet to be characterized. We designed a 10-alternative forced choice face identification task in which upright or inverted faces were filtered to retain horizontal or vertical structure. We systematically varied the bandwidth of these filters in 10° steps and replaced the orientation components that were removed from the target face with components from the average of all possible faces. This manipulation created patterns that looked like faces but contained diagnostic information in orientation bands unknown to the observer on any given trial. Further, we quantified human performance relative to the actual information content of our face stimuli using an ideal observer with perfect knowledge of the diagnostic band. We found that the most diagnostic information for face identification is conveyed by a narrow band of orientations along the horizontal meridian, whereas human observers use information from a wide range of orientations.