Face perception: A brief journey through recent discoveries and current directions

A longitudinal study on the impact of high-altitude hypoxia on perceptual processes

This study aimed to explore the neural mechanisms underlying high-altitude (HA) adaptation and deadaptation in perceptual processes in lowlanders. Eighteen healthy lowlanders were administered a facial S1-S2 matching task that included incomplete face (S1) and complete face (S2) photographs combined with ERP technology. Participants were tested at four time points: shortly before they departed the HA (Test 1), twenty-five days after entering the HA (Test 2), and one week (Test 3) and one month (Test 4) after returning to the lowlands. Compared with those at sea level (SL), shorter reaction times (RTs), shorter latencies of P1 and N170, and larger amplitudes of complete face N170 were found in HAs. After returning to SL, compared with that of HA, the amplitude of the incomplete face P1 was smaller after one week, and the complete face was smaller after one month. The right hemisphere N170 amplitude was greater after entering HA and one week after returning to SL than at baseline, but it returned to baseline after one month. Taken together, the current findings suggest that HA adaptation increases visual cortex excitation to accelerate perceptual processing. More mental resources are recruited during the configural encoding stage of complete faces after HA exposure. The perceptual processes affected by HA exposure are reversible after returning to SL, but the low-level processing stage differs between incomplete and complete faces due to neural compensation mechanisms. The configural encoding stage in the right hemisphere is affected by HA exposure and requires more than one week but less than one month to recover to baseline.

The effect of processing partial information in dynamic face perception

Face perception is a major topic in vision research. Most previous research has concentrated on (holistic) spatial representations of faces, often with static faces as stimuli. However, faces are highly dynamic stimuli containing important temporal information. How sensitive humans are regarding temporal information in dynamic faces is not well understood. Studies investigating temporal information in dynamic faces usually focus on the processing of emotional expressions. However, faces also contain relevant temporal information without any strong emotional expression. To investigate cues that modulate human sensitivity to temporal order, we utilized muted dynamic neutral face videos in two experiments. We varied the orientation of the faces (upright and inverted) and the presence/absence of eye blinks as partial dynamic cues. Participants viewed short, muted, monochromic videos of models vocalizing a widely known text (National Anthem). Videos were played either forward (in the correct temporal order) or backward. Participants were asked to determine the direction of the temporal order for each video, and (at the end of the experiment) whether they had understood the speech. We found that face orientation, and the presence/absence of an eye blink affected sensitivity, criterion (bias) and reaction time: Overall, sensitivity was higher for upright compared to inverted faces, and in the condition where an eye blink was present compared to the condition without an eye blink. Reaction times were mostly faster in the conditions with higher sensitivity. A bias to report inverted faces as 'backward' observed in Experiment I, where upright and inverted faces were presented randomly interleaved within each block, was absent when presenting upright and inverted faces in different blocks in Experiment II. Language comprehension results revealed that there was higher sensitivity when understanding the speech compared to not understanding the speech in both experiments. Taken together, our results showed higher sensitivity with upright compared to inverted faces, suggesting that the perception of dynamic, task-relevant information was superior with the canonical orientation of the faces. Furthermore, partial information coming from eye blinks, in addition to mouth movements, seemed to play a significant role in dynamic face perception, both when faces were presented upright and inverted. We suggest that studying the perception of facial dynamics beyond emotional expressions will help us to better understand the mechanisms underlying the temporal integration of facial information from different -partial and holistic- sources, and that our results show how different strategies, depending on the available information, are employed by human observers when judging the temporal order of faces.

Faces do not guide attention in an object-based facilitation manner

Numerous studies on face processing have revealed their special ability to affect attention, but relatively little research has been done on how faces guide spatial attention allocation. To enrich this field, this study resorted to the object-based attention (OBA) effect in a modified double-rectangle paradigm where the rectangles were replaced with human faces and mosaic patterns (non-face objects). Experiment 1 replicated the typical OBA effect in the non-face objects, but this effect was absent in Asian and Caucasian faces. Experiment 2 removed the eye region from Asian faces, but still found no object-based facilitation in the faces without eyes. In Experiment 3, the OBA effect was also observed for faces when the faces disappear a short period before the responses. Overall, these results revealed that when two faces are presented together, they do not exert object-based facilitation regardless of their facial features such as race and the presence of eyes. We argue that the lack of a typical OBA effect is due to the filtering cost induced by the entire face content. This cost slows down the response when attention shifts within a face and results in the absence of object-based facilitation.

An Exploratory Analysis of the Neural Correlates of Human-Robot Interactions With Functional Near Infrared Spectroscopy

Functional near infrared spectroscopy (fNIRS) has been gaining increasing interest as a practical mobile functional brain imaging technology for understanding the neural correlates of social cognition and emotional processing in the human prefrontal cortex (PFC). Considering the cognitive complexity of human-robot interactions, the aim of this study was to explore the neural correlates of emotional processing of congruent and incongruent pairs of human and robot audio-visual stimuli in the human PFC with fNIRS methodology. Hemodynamic responses from the PFC region of 29 subjects were recorded with fNIRS during an experimental paradigm which consisted of auditory and visual presentation of human and robot stimuli. Distinct neural responses to human and robot stimuli were detected at the dorsolateral prefrontal cortex (DLPFC) and orbitofrontal cortex (OFC) regions. Presentation of robot voice elicited significantly less hemodynamic response than presentation of human voice in a left OFC channel. Meanwhile, processing of human faces elicited significantly higher hemodynamic activity when compared to processing of robot faces in two left DLPFC channels and a left OFC channel. Significant correlation between the hemodynamic and behavioral responses for the face-voice mismatch effect was found in the left OFC. Our results highlight the potential of fNIRS for unraveling the neural processing of human and robot audio-visual stimuli, which might enable optimization of social robot designs and contribute to elucidation of the neural processing of human and robot stimuli in the PFC in naturalistic conditions.

More Than the Face: Representations of Bodies in the Inferior Temporal Cortex

Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Drinking and smoking polygenic risk is associated with childhood and early-adulthood psychiatric and behavioral traits independently of substance use and psychiatric genetic risk

Alcohol drinking and tobacco smoking are hazardous behaviors associated with a wide range of adverse health outcomes. In this study, we explored the association of polygenic risk scores (PRS) related to drinks per week, age of smoking initiation, smoking initiation, cigarettes per day, and smoking cessation with 433 psychiatric and behavioral traits in 4498 children and young adults (aged 8-21) of European ancestry from the Philadelphia neurodevelopmental cohort. After applying a false discovery rate multiple testing correction accounting for the number of PRS and traits tested, we identified 36 associations related to psychotic symptoms, emotion and age recognition social competencies, verbal reasoning, anxiety-related traits, parents' education, and substance use. These associations were independent of the genetic correlations among the alcohol-drinking and tobacco-smoking traits and those with cognitive performance, educational attainment, risk-taking behaviors, and psychopathology. The removal of participants endorsing substance use did not affect the associations of each PRS with psychiatric and behavioral traits identified as significant in the discovery analyses. Gene-ontology enrichment analyses identified several neurobiological processes underlying mechanisms of the PRS associations we report. In conclusion, we provide novel insights into the genetic overlap of smoking and drinking behaviors in children and young adults, highlighting their independence from psychopathology and substance use.

Automatic gaze to the nose region cannot be inhibited during observation of facial expression in Eastern observers

Humans can extract a great deal of information about others very quickly. This is partly because the face automatically captures observers' attention. Specifically, the eyes can attract overt attention. Although it has been reported that not only the eyes but also the nose can capture initial oculomotor movement in Eastern observers, its generalizability remains unknown. In this study, we applied the "don't look" paradigm wherein participants are asked not to fixate on a specific facial region (i.e., eyes, nose, and mouth) during an emotion recognition task with upright (Experiment 1) and inverted (Experiment 2) faces. In both experiments, we found that participants were less able to inhibit the initial part of their fixations to the nose, which can be interpreted as the nose automatically capturing attention. Along with previous studies, our overt attention tends to be attracted by a part of the face, which is the nose region in Easterner observers.

Size Effects in the Recognition of Blurry Faces

Spatial frequencies critical for recognition of faces are scale-dependent. Progressively coarser features of the face are utilized at smaller sizes, despite the availability of finer features. Blur removes fine details in an image, disrupting the finer features utilized for recognition at large sizes. At smaller sizes, observers utilize coarser features, and thus, recognition may be less impacted by blur. This coupling between size and critical spatial frequencies allows us to predict a regime in which observers tolerate blur better with decreasing image sizes within a range of moderate face sizes. We tested recognition of famous faces in four conditions: large-intact, small-intact, large-blurry, and small-blurry. Observers showed high recognition performance in both intact conditions. Blur significantly disrupted recognition, yet accuracy was significantly and consistently higher in the small-blurry compared to the large-blurry condition. These results are suggestive of an inherent scale-dependent mechanism that, at certain sizes, negatively impacts recognition of blurry images.