Eye gaze is not unique: The reversed congruency effect on gaze and tongue targets

In the spatial Stroop task, an arrow target produces a spatial Stroop effect, whereas a gaze target elicits a reversed congruency effect. The reversed congruency effect has been explained by the unique attentional mechanisms of eye gaze. However, recent studies have shown that not only gaze but arrow targets produced a reversed congruency effect when embedded in a complex background. The present study investigated whether non-gaze targets produce a reversed congruency effect. In Experiments 1 and 2, we used the tongue, which is not commonly used to indicate spatial directions in daily life, as a target in the spatial Stroop task, in addition to the conventional gaze and arrows. In Experiment 3, we used arrow stimuli embedded in a complex background as a target. Participants judged the left/right direction of the target presented in the left or right visual field. Although arrow and gaze targets replicated previous findings (spatial Stroop and reversed congruency effect, respectively), the tongue target produced a reversed congruency effect (Experiments 1 and 2). The spatial Stroop effect of arrow targets disappeared when they were in a complex background (Experiment 3). These results are inconsistent with previous accounts emphasising the unique status of eye gaze. We propose that temporal decay of the location code and response inhibition are responsible for the reversal of spatial interference.

Facial trustworthiness dampens own-gender bias in emotion recognition

Previous research suggests that emotion recognition is influenced by social categories derived by invariant facial features such as gender and inferences of trustworthiness from facial appearance. The current study sought to replicate and extend these findings by examining the intersection of these social categories on recognition of emotional facial expressions. We used a dynamic emotion recognition task to assess accuracy and response times in the happiness and anger categorization displayed by female and male faces that differed in the degree of facial trustworthiness (i.e., trustworthy- vs. untrustworthy-looking faces). We found that facial trustworthiness was able to modulate the own-gender bias on emotion recognition, as responses to untrustworthy-looking faces revealed a bias towards ingroup members. Conversely, when faces look trustworthy, no differences on emotion recognition between female and male faces were found. In addition, positive inferences of trustworthiness lead to faster recognition of happiness in females and anger in males, showing that facial appearance was able to influence also the intersection between social categories and specific emotional expressions. Together, these results suggest that facial appearance, probably due to the activation of approach or avoidance motivational systems, is able to modulate the own-gender bias on emotion recognition.

Facial first impressions are not mandatory: A priming investigation

A common assertion is that, based around prominent character traits, first impressions are spontaneously extracted from faces. Specifically, mere exposure to a person is sufficient to trigger the involuntary extraction of core personality characteristics (e.g., trustworthiness, dominance, competence), an outcome that supports a range of significant judgments (e.g., hiring, investing, electing). But is this in fact the case? Noting ambiguities in the extant literature, here we used a repetition priming procedure to probe the extent to which impressions of dominance are extracted from faces absent the instruction to evaluate the stimuli in this way. Across five experiments in which either the character trait of interest was made increasingly obvious to participants (Expts. 1-3) or attention was explicitly directed toward the faces to generate low-level/high-level judgments (Expts. 4 & 5), no evidence for the spontaneous extraction of first impressions was observed. Instead, priming only emerged when judgments of dominance were an explicit requirement of the task at hand. Thus, at least using a priming methodology, the current findings contest the notion that first impressions are a mandatory product of person perception.

Fading boundaries between the physical and the social world: Insights and novel techniques from the intersection of these two fields

This review focuses on the subtle interactions between sensory input and social cognition in visual perception. We suggest that body indices, such as gait and posture, can mediate such interactions. Recent trends in cognitive research are trying to overcome approaches that define perception as stimulus-centered and are pointing toward a more embodied agent-dependent perspective. According to this view, perception is a constructive process in which sensory inputs and motivational systems contribute to building an image of the external world. A key notion emerging from new theories on perception is that the body plays a critical role in shaping our perception. Depending on our arm's length, height and capacity of movement, we create our own image of the world based on a continuous compromise between sensory inputs and expected behavior. We use our bodies as natural "rulers" to measure both the physical and the social world around us. We point out the necessity of an integrative approach in cognitive research that takes into account the interplay between social and perceptual dimensions. To this end, we review long-established and novel techniques aimed at measuring bodily states and movements, and their perception, with the assumption that only by combining the study of visual perception and social cognition can we deepen our understanding of both fields.

The relationship between ensemble representations of facial information

People accurately evaluate various types of facial information (gaze direction, facial expression, facial identity, and gender) of multiple faces. Considering such varieties, summarizing abilities of facial information might vary depending on its type because it is either changeable (e.g., gaze direction and expression) or invariant (e.g., identity and gender). The current study investigated the relationship between the averaging abilities of facial information using an individual difference approach and a dual-task paradigm to understand the effect of facial information type on the ensemble coding of facial information. We conducted two online experiments on the relationship between the averaging abilities of facial expressions and gaze direction (Experiment 1) and those of facial expressions and gender (Experiment 2). Participants were asked to estimate the average of each piece of facial information in the first and second blocks (single task), respectively, and both sequentially in the third and fourth blocks (dual task). We found that most of the error autocorrelations of facial information were high, indicating high measurement reliability. Participants' abilities to average facial expressions were correlated with those to average gaze directions, but not with those to average gender information. That is, the ensemble processing of facial expressions is related to gaze directions, but not genders. These results suggest that ensemble representations of facial information regarding changeable properties differ from those of invariant ones.

Perceptions of persons who wear face coverings are modulated by the perceivers' attitude

We examined if the effect of facial coverings on person perception is influenced by the perceiver's attitudes. We used two online experiments in which participants saw the same human target persons repeatedly appearing with and without a specific piece of clothing and had to judge the target persons' character. In Experiment 1 (N = 101), we investigated how the wearing of a facial mask influences a person's perception depending on the perceiver's attitude toward measures against the COVID-19 pandemic. In Experiment 2 (N = 114), we examined the effect of wearing a head cover associated with Arabic culture on a person's perception depending on the perceiver's attitude toward Islam. Both studies were preregistered; both found evidence that a person's perception is a process shaped by the personal attitudes of the perceiver as well as merely the target person's outward appearance. Integrating previous findings, we demonstrate that facial covers, as well as head covers, operate as cues which are used by the perceivers to infer the target persons' underlying attitudes. The judgment of the target person is shaped by the perceived attitude toward what the facial covering stereotypically symbolizes.

Olfaction in the Multisensory Processing of Faces: A Narrative Review of the Influence of Human Body Odors

A recent body of research has emerged regarding the interactions between olfaction and other sensory channels to process social information. The current review examines the influence of body odors on face perception, a core component of human social cognition. First, we review studies reporting how body odors interact with the perception of invariant facial information (i.e., identity, sex, attractiveness, trustworthiness, and dominance). Although we mainly focus on the influence of body odors based on axillary odor, we also review findings about specific steroids present in axillary sweat (i.e., androstenone, androstenol, androstadienone, and estratetraenol). We next survey the literature showing body odor influences on the perception of transient face properties, notably in discussing the role of body odors in facilitating or hindering the perception of emotional facial expression, in relation to competing frameworks of emotions. Finally, we discuss the developmental origins of these olfaction-to-vision influences, as an emerging literature indicates that odor cues strongly influence face perception in infants. Body odors with a high social relevance such as the odor emanating from the mother have a widespread influence on various aspects of face perception in infancy, including categorization of faces among other objects, face scanning behavior, or facial expression perception. We conclude by suggesting that the weight of olfaction might be especially strong in infancy, shaping social perception, especially in slow-maturing senses such as vision, and that this early tutoring function of olfaction spans all developmental stages to disambiguate a complex social environment by conveying key information for social interactions until adulthood.

Social categorization and joint attention: Interacting effects of age, sex, and social status

In the present study, we examine how person categorization conveyed by the combination of multiple cues modulates joint attention. In three experiments, we tested the combinatory effect of age, sex, and social status on gaze-following behaviour and pro-social attitudes. In Experiments 1 and 2, young adults were required to perform an instructed saccade towards left or right targets while viewing a to-be-ignored distracting face (female or male) gazing left or right, that could belong to a young, middle-aged, or elderly adult of high or low social status. Social status was manipulated by semantic knowledge (Experiment 1) or through visual appearance (Experiment 2). Results showed a clear combinatory effect of person perception cues on joint attention (JA). Specifically, our results showed that age and sex cues interacted with social status information depending on the modality through which it was conveyed. In Experiment 3, we further investigated our results by testing whether the identities used in Experiments 1 and 2 triggered different pro-social behaviour. The results of Experiment 3 showed that the identities resulting as more distracting in Experiments 1 and 2 were also perceived as more in need and prompt helping behaviour. Taken together, our evidence shows a combinatorial effect of age, sex, and social status in modulating the gaze following behaviour, highlighting a complex and dynamic interplay between person categorization and joint attention.

Why do you attract me but not others? Retrieval of person knowledge and its generalization bring diverse judgments of facial attractiveness

Judgments of facial attractiveness play an important role in social interactions. However, it still remains unclear why these judgments are malleable. The present study aimed to understand whether the retrieval of person knowledge leads to different judgments of attractiveness of the same face. Event-related potentials and learning-recognition tasks were used to investigate the effects of person knowledge on facial attractiveness. The results showed that compared with familiar faces that were matched with negative person knowledge, those matched with positive person knowledge were evaluated as more attractive and evoked a larger early posterior negativity (EPN) and late positive complex (LPC). Additionally, positive similar faces had the same behavioral results and evoked large LPC, while unfamiliar faces did not have any significant effects. These results indicate that the effect of person knowledge on facial attractiveness occurs from early to late stage of facial attractiveness processing, and this effect could be generalized based on the similarity of the face structure, which occurred at the late stage. This mechanism may explain why individuals form different judgments of facial attractiveness.

The Effects of Facial Attractiveness and Familiarity on Facial Expression Recognition

The classic theory of face perception holds that the invariant (e.g., identity and race) and variant (e.g., expression) dimensions of face information are independent of one another. Two separate neural systems are involved in face processing. However, the dynamic theory of face perception indicates that these two neural systems interact bidirectionally. Accordingly, by using the emotion categorization task and morph movies task, we investigated the influence of facial attractiveness on facial expression recognition and provided further evidence supporting the dynamic theory of face perception in both the static and dynamic contexts. In addition, this research used familiar celebrities (including actors, television personalities, politicians, and comedians) and explored the role of familiarity in face perception. In two experiments, the participants were asked to assess the expressions of faces with different levels of attractiveness and different levels of familiarity. We found that regardless of being in a static or dynamic face situation, happy expressions on attractive faces can be recognized more quickly, highlighting the advantage of happy expression recognition. Moreover, in static and dynamic familiar face situations, familiarity has a greater impact on expression recognition, and the influence of attraction on expression recognition may be weakened or even unaffected. Our results show that facial attractiveness influences the recognition of facial expressions in both static and dynamic contexts and highlight the importance of familiarity in face perception.

Emotional Oddball: A Review on Variants, Results, and Mechanisms

It is of the utmost importance for an organism to rapidly detect and react to changes in its environment. The oddball paradigm has repeatedly been used to explore the underlying cognitive and neurophysiological components of change detection. It is also used to investigate the special role of emotional content in perception and attention (emotional oddball paradigm; EOP). In this article, the EOP is systematically reviewed. The EOP is, for instance, used as a tool to address questions as to what degree emotional deviant stimuli trigger orientation reactions, which role the emotional context plays in the processing of deviant information, and how the processing of emotional deviant information differs interindividually (including clinical populations). Two main variants with regard to the emotionality of standards and deviants are defined. Most of the identified EOP studies report EEG data but an overview of behavioral data is also provided in this review. We integrate evidence from 99 EOP experiments and shape the EOP's theoretical background under the consideration of other paradigms’ mechanisms and theories.

Facial race and sex cues have a comparable influence on emotion recognition in Chinese and Australian participants

The magnitude of the happy categorisation advantage, the faster recognition of happiness than negative expressions, is influenced by facial race and sex cues. Previous studies have investigated these relationships using racial outgroups stereotypically associated with physical threat in predominantly Caucasian samples. To determine whether these influences generalise to stimuli representing other ethnic groups and to participants of different ethnicities, Caucasian Australian (Experiments 1 and 2) and Chinese participants (Experiment 2) categorised happy and angry expressions displayed on own-race male faces presented with emotional other-race male, own-race female, and other-race female faces in separate tasks. The influence of social category cues on the happy categorisation advantage was similar in the Australian and Chinese samples. In both samples, the happy categorisation advantage was present for own-race male faces when they were encountered with other-race male faces but reduced when own-race male faces were categorised along with female faces. The happy categorisation advantage was present for own-race and other-race female faces when they were encountered with own-race male faces in both samples. Results suggest similarity in the influence of social category cues on emotion categorisation.

The Things You Do: Internal Models of Others' Expected Behaviour Guide Action Observation

Predictions allow humans to manage uncertainties within social interactions. Here, we investigate how explicit and implicit person models-how different people behave in different situations-shape these predictions. In a novel action identification task, participants judged whether actors interacted with or withdrew from objects. In two experiments, we manipulated, unbeknownst to participants, the two actors action likelihoods across situations, such that one actor typically interacted with one object and withdrew from the other, while the other actor showed the opposite behaviour. In Experiment 2, participants additionally received explicit information about the two individuals that either matched or mismatched their actual behaviours. The data revealed direct but dissociable effects of both kinds of person information on action identification. Implicit action likelihoods affected response times, speeding up the identification of typical relative to atypical actions, irrespective of the explicit knowledge about the individual's behaviour. Explicit person knowledge, in contrast, affected error rates, causing participants to respond according to expectations instead of observed behaviour, even when they were aware that the explicit information might not be valid. Together, the data show that internal models of others' behaviour are routinely re-activated during action observation. They provide first evidence of a person-specific social anticipation system, which predicts forthcoming actions from both explicit information and an individuals' prior behaviour in a situation. These data link action observation to recent models of predictive coding in the non-social domain where similar dissociations between implicit effects on stimulus identification and explicit behavioural wagers have been reported.

Investigating the early stages of person perception: the asymmetry of social categorization by sex vs. age

Early perceptual operations are central components of the dynamics of social categorization. The wealth of information provided by facial cues presents challenges to our understanding of these early stages of person perception. The current study aimed to uncover the dynamics of processing multiply categorizable faces, notably as a function of their gender and age. Using a modified four-choice version of a mouse-tracking paradigm (which assesses the relative dominance of two categorical dimensions), the relative influence that sex and age have on each other during categorization of infant, younger adult, and older adult faces was investigated. Results of these experiments demonstrate that when sex and age dimensions are simultaneously categorized, only for infant faces does age influence sex categorization. In contrast, the sex of both young and older adults was shown to influence age categorization. The functional implications of these findings are discussed in light of previous person perception research.

Perceptual and gaze biases during face processing: related or not?

Previous studies have demonstrated a left perceptual bias while looking at faces, due to the fact that observers mainly use information from the left side of a face (from the observer's point of view) to perform a judgment task. Such a bias is consistent with the right hemisphere dominance for face processing and has sometimes been linked to a left gaze bias, i.e. more and/or longer fixations on the left side of the face. Here, we recorded eye-movements, in two different experiments during a gender judgment task, using normal and chimeric faces which were presented above, below, right or left to the central fixation point or on it (central position). Participants performed the judgment task by remaining fixated on the fixation point or after executing several saccades (up to three). A left perceptual bias was not systematically found as it depended on the number of allowed saccades and face position. Moreover, the gaze bias clearly depended on the face position as the initial fixation was guided by face position and landed on the closest half-face, toward the center of gravity of the face. The analysis of the subsequent fixations revealed that observers move their eyes from one side to the other. More importantly, no apparent link between gaze and perceptual biases was found here. This implies that we do not look necessarily toward the side of the face that we use to make a gender judgment task. Despite the fact that these results may be limited by the absence of perceptual and gaze biases in some conditions, we emphasized the inter-individual differences observed in terms of perceptual bias, hinting at the importance of performing individual analysis and drawing attention to the influence of the method used to study this bias.

Noise as a mechanism of anomalous face processing among persons with Schizophrenia

There is substantial evidence that people with Schizophrenia (SCZ) have altered visual perception and cognition, including impaired face processing. However, the mechanism(s) underlying this observation are not yet known. Eye movement studies have found that people with SCZ do not direct their gaze to the most informative regions of the face (e.g., the eyes). This suggests that SCZ patients may be less able to extract the most relevant face information and therefore have decreased calculation efficiency. In addition, research with non-face stimuli indicates that SCZ is associated with increased levels of internal noise. Importantly, both calculation efficiency and internal noise have been shown to underpin face perception among healthy observers. Therefore, the current study applies noise masking to upright and inverted faces to determine if face processing deficits among those with SCZ are the result of changes in calculation efficiency, internal noise, or both. Consistent with previous results, SCZ participants exhibited higher contrast thresholds in order to identify masked target faces. However, higher thresholds were associated with increases in internal noise but unrelated to changes in calculation efficiency. These results suggest that SCZ-related face processing deficits are the result of a decreased noise-to-signal ratio. The source of increased processing noise among these patients is unclear, but may emanate from abnormal neural dynamics.

The Gender Typicality of Faces and Its Impact on Visual Processing and on Hiring Decisions

Past research has shown that the gender typicality of applicants’ faces affects leadership selection irrespective of a candidate’s gender: A masculine facial appearance is congruent with masculine-typed leadership roles, thus masculine-looking applicants are hired more certainly than feminine-looking ones. In the present study, we extended this line of research by investigating hiring decisions for both masculine- and feminine-typed professional roles. Furthermore, we used eye tracking to examine the visual exploration of applicants’ portraits. Our results indicate that masculine-looking applicants were favored for the masculine-typed role (leader) and feminine-looking applicants for the feminine-typed role (team member). Eye movement patterns showed that information about gender category and facial appearance was integrated during first fixations of the portraits. Hiring decisions, however, were not based on this initial analysis, but occurred at a second stage, when the portrait was viewed in the context of considering the applicant for a specific job.