The first 100 milliseconds of a face: on the microgenesis of early face processing

Reading Emotions in Faces With and Without Masks Is Relatively Independent of Extended Exposure and Individual Difference Variables

The ability to read emotions in faces helps humans efficiently assess social situations. We tested how this ability is affected by aspects of familiarization with face masks and personality, with a focus on emotional intelligence (measured with an ability test, the MSCEIT, and a self-report scale, the SREIS). To address aspects of the current pandemic situation, we used photos of not only faces per se but also of faces that were partially covered with face masks. The sample (N = 49), the size of which was determined by an a priori power test, was recruited in Germany and consisted of healthy individuals of different ages [M = 24.8 (18-64) years]. Participants assessed the emotional expressions displayed by six different faces determined by a 2 (sex) × 3 (age group: young, medium, and old) design. Each person was presented with six different emotional displays (angry, disgusted, fearful, happy, neutral, and sad) with or without a face mask. Accuracy and confidence were lower with masks-in particular for the emotion disgust (very often misinterpreted as anger) but also for happiness, anger, and sadness. When comparing the present data collected in July 2021 with data from a different sample collected in May 2020, when people first started to familiarize themselves with face masks in Western countries during the first wave of the COVID-19 pandemic, we did not detect an improvement in performance. There were no effects of participants' emotional intelligence, sex, or age regarding their accuracy in assessing emotional states in faces for unmasked or masked faces.

The Episodic Prototypes Model (EPM): On the nature and genesis of facial representations

Faces undergo massive changes over time and life events. We need a mental representation which is flexible enough to cope with the existing visual varieties, but which is also stable enough to be the basis for valid recognition. Two main theoretical frameworks exist to describe facial representations: prototype models assuming one central item comprising all visual experiences of a face, and exemplar models assuming single representations of each visual experience of a face. We introduce a much more ecological valid model dealing with episodic prototypes (the Episodic Prototypes Model—EPM), where faces are represented by a low number of prototypes that refer to specific Episodes of Life (EoL, e.g., early adulthood, mature age) during which the facial appearance shows only moderate variation. Such an episodic view of mental representation allows for efficient storage, as the number of needed prototypes is relatively low, and it allows for the needed variation within a prototype that keeps the everyday and steadily ongoing changes across a certain period of time. Studies 1–3 provide evidence that facial representations are highly dependent on temporal aspects which is in accord with EoL, and that individual learning history generates the structure and content of respective prototypes. In Study 4, we used implicit measures (RT) in a face verification task to investigate the postulated power of the EPM. We could demonstrate that episodic prototypes clearly outperformed visual depictions of exhaustive prototypes, supporting the general idea of our approach.

Cultural Differences in the Time Course of Configural and Featural Processing for Own-race Faces

Previous research suggests that East Asians pay more attention than Caucasian Westerners to configural information in faces, while the latter group pays more attention to featural information. However, it is unclear whether this cultural variation in attention produces a different time course of the processing bias for configural and featural information. This was examined using event-related potentials in a spatial attention paradigm. Chinese and Westerners were instructed to attend to the locations of two face images or houses. Although the race-related difference was absent in behavioral performance and N170 component, Chinese participants exhibited a configural processing bias on P1 component in the case of both own- and other-race faces and a featural processing bias on P2 component for own-race faces. In contrast, Westerners exhibited a featural processing bias for own-race faces and a configural processing bias for other-race faces on P1 component, whereas a configural processing bias was observed on P2 component for both own- and other-race faces. These results demonstrate that there are important differences between East Asians and Westerners in their relative preferences for configural versus featural processing of own-race faces, but not other-race faces. The relative roles of configural and featural information processing for faces are thus dependent on both who is looking (the culture or race of the observer) and what they are looking at (the race of the face): Easterners enjoy an early global/configural processing bias and a late local/featural processing bias for own-race faces, while Westerners benefit from an early local/featural processing bias and a late global/configural processing bias for own-race faces; both of the groups have an early and late global/configural processing bias for other-race faces.

Wearing Face Masks Strongly Confuses Counterparts in Reading Emotions

Wearing face masks is one of the essential means to prevent the transmission of certain respiratory diseases such as coronavirus disease 2019 (COVID-19). Although acceptance of such masks is increasing in the Western hemisphere, many people feel that social interaction is affected by wearing a mask. In the present experiment, we tested the impact of face masks on the readability of emotions. The participants (N = 41, calculated by an a priori power test; random sample; healthy persons of different ages, 18–87 years) assessed the emotional expressions displayed by 12 different faces. Each face was randomly presented with six different expressions (angry, disgusted, fearful, happy, neutral, and sad) while being fully visible or partly covered by a face mask. Lower accuracy and lower confidence in one’s own assessment of the displayed emotions indicate that emotional reading was strongly irritated by the presence of a mask. We further detected specific confusion patterns, mostly pronounced in the case of misinterpreting disgusted faces as being angry plus assessing many other emotions (e.g., happy, sad, and angry) as neutral. We discuss compensatory actions that can keep social interaction effective (e.g., body language, gesture, and verbal communication), even when relevant visual information is crucially reduced.

How Do We Perceive “Aliens”? About the Implicit Processes Underlying the Perception of People With Alien Paraphernalia

People often draw trait assessments of unfamiliar persons on the basis of minimal visual information like facial features. Most studies focus on explicit person evaluations, even though automatic processes of perception are the underlying basis. Furthermore, previous experiments on automatic processes only address very general levels of association. We conducted two experiments employing the multidimensional IAT (md-IAT) to examine automatic processes of perception in a more differentiated way, testing essential variables that are often used to characterize aliens. Results show that personality trait associations of people perceived and categorized as aliens (acquired solely through usage of paraphernalia) are not consistently negative in comparison to more familiar-looking people but might point to the core variables of xenophobic stereotypes (e.g., being aggressive, threatening, and untrustworthy). Proceeding in revealing such variables and testing them might help to understand the main cognito-emotive pattern behind xenophobia and help challenging and tackling stereotypes against aliens.

First gender, then attractiveness: Indications of gender-specific attractiveness processing via ERP onsets

We followed an ERP-based approach to gain knowledge on the dependence and temporal order of two essential processes of face perception: attractiveness and gender. By combining a dual-choice task with a go/nogo-paradigm focusing on the LRP and N200-effect, we could estimate the processing times and onsets of both types of face processing. The analyses of the LRP revealed that gender aspects were processed much earlier than attractiveness. Whereas gender was already analysed 243.9 ms post-stimulus onset, attractiveness came into play 58.6 ms later, i.e. after a post-stimulus onset delay of 302.5 ms. This resulting pattern was mirrored by the analyses of the N200-effect, an effect available mainly frontally which is supposed to correlate with the inhibition of inappropriate responses. Taking the onset of the N200 effect as an estimator for the moment at which information has been processed sufficiently for task decision, we could trace the N200 effect at 152.0 ms for go/nogo-decision on gender, while not as early as 206.7 ms on attractiveness. In sum, processing of facial attractiveness seems to be based on gender-specific aesthetic pre-processing, for instance via activating gender-specific attractiveness prototypes which show focused processing of certain facial aspects.

The Power of Shape: How Shape of Node-Link Diagrams Impacts Aesthetic Appreciation and Triggers Interest

Positive effects of aesthetically appreciated designs have long been studied and confirmed since the 19th century: such designs are more enjoyable, they are more forgivable for glitches and can increase users' performance. In the field of information visualization, studies of aesthetics are still a niche approach. In the current study, we aim to specifically understand which parameters in a visualization of node-link diagrams make them aesthetically pleasing-an important extension to already existing research on usability and readability aspects. We investigated how the shape of the outline of such diagrams influences the aesthetic judgments on two of the most important dimensions of aesthetic appeal: beauty and interest. We employed different outlines to node-link diagrams and compared them with uniformly filled shapes, varying two important variables typically impacting aesthetics: complexity and curvature. This was done for a short (100 ms) and ad libitum presentation time. Diagrams with curvier outlines were perceived as more beautiful, while diagrams with more complex outlines were considered to be more interesting. These dependencies already exist for presaccadic perception (100 ms) and are slightly stronger for unlimited presentation time. We also found that curvature is a predictor for beauty only for unlimited presentation time. Aesthetic appeal was very similar for diagrams and pure shapes, so many results from fundamental research on aesthetics can potentially be transferred to the community of network visualization, assisting to improve visualizations also in aesthetic regards.

Understanding human perception by human-made illusions

IT MAY BE FUN TO PERCEIVE ILLUSIONS, BUT THE UNDERSTANDING OF HOW THEY WORK IS EVEN MORE STIMULATING AND SUSTAINABLE: They can tell us where the limits and capacity of our perceptual apparatus are found-they can specify how the constraints of perception are set. Furthermore, they let us analyze the cognitive sub-processes underlying our perception. Illusions in a scientific context are not mainly created to reveal the failures of our perception or the dysfunctions of our apparatus, but instead point to the specific power of human perception. The main task of human perception is to amplify and strengthen sensory inputs to be able to perceive, orientate and act very quickly, specifically and efficiently. The present paper strengthens this line of argument, strongly put forth by perceptual pioneer Richard L. Gregory (e.g., Gregory, 2009), by discussing specific visual illusions and how they can help us to understand the magic of perception.

Local feature suppression effect in face and non-face stimuli

There is evidence that the cognitive system processes human faces faster and more precisely than other stimuli. Also, faces summon visual attention in an automatic manner, as evidenced by efficient, 'pop-out' search for face targets amongst homogeneous non-face distractors. Pop-out for faces implies that faces are processed as a basic visual 'feature' by specialized face-tuned detectors, similar to the coding of other features (e.g., color, orientation, motion, etc.). However, it is unclear whether such face detectors encode only the global face configuration or both global and local face features. If the former were correct, the face detectors should be unable to support search for a local face feature, rendering search slower relative to non-face stimuli; that is, there would be local feature suppression (LFS) for faces. If the latter was the case, there should be no difference in the processing of local and, respectively, global face features. In two experiments, participants discerned the presence (vs. absence) of a local target defined as a part of either a normal or a scrambled (schematic or realistic) face or of a non-face (Kanizsa diamond or realistic house) configuration. The results consistently showed a robust LFS effect in both reaction times and error rates for face stimuli, and either no difference or even a local feature enhancement effect for the control stimuli. Taken together, these findings indicate that faces are encoded as a basic visual feature by means of globally tuned face detectors.

Creating a framework for experimentally testing early visual processing: a response to Nurmoja, et al. (2012) on trait perception from pixelized faces

Nurmoja, Eamets, Härma, and Bachmann (2012) revealed that strongly pixelated pictures of faces still provide relevant cues for reliably assessing the apparent (i.e., subjectively perceived) traits of the portrayed. The present article responds to the paper by developing the outline of a framework for future research to reveal certain steps in processing complex visual stimuli. This framework combines the approach of degradation of the stimuli with the so-called microgenetic approach of percepts based on presentation time limitations. The proposed combination of a particular kind of stimulus manipulation and a specific experimental procedure allows testing targeted assumptions concerning visual processing, not only in the domain of face perception, but in all domains involving complex visual stimuli, for example, art perception.

Processing of featural and configural aspects of faces is lateralized in dorsolateral prefrontal cortex: a TMS study

Facial recognition relies on distinct and parallel types of processing: featural processing focuses on the individual components of a face (e.g., the shape or the size of the eyes), whereas configural (or "relational") processing considers the spatial interrelationships among the single facial components (e.g., distance of the mouth from the nose). Previous neuroimaging evidence has suggested that featural and configural processes may rely on different brain circuits. By using rTMS, here we show for the first time a double dissociation in dorsolateral prefrontal cortex for different aspects of face processing: in particular, TMS over the left middle frontal gyrus (BA8) selectively disrupted featural processing, whereas TMS over the right inferior frontal gyrus (BA44) selectively interfered with configural processing of faces. By establishing a causal link between activation in left and right prefrontal areas and different modes of face processing, our data extend previous neuroimaging evidence and may have important implications in the study of face-processing deficits, such as those manifested in prosopagnosia and autistic spectrum disorders.

Strabismic amblyopia affects relational but not featural and Gestalt processing of faces

The ability to identify faces is of critical importance for normal social interactions. Previous evidence suggests that early visual deprivation may impair certain aspects of face recognition. The effects of strabismic amblyopia on face processing have not been investigated previously. In this study, a group of individuals with amblyopia were administered two tasks known to selectively measure face detection based on a Gestalt representation of a face (Mooney faces task) and featural and relational processing of faces (Jane faces task). Our data show that--when relying on their amblyopic eye only - strabismic amblyopes perform as well as normally sighted individuals in face detection and recognition on the basis of their single features. However, they are significantly impaired in discriminating among different faces on the basis of the spacing of their single features (i.e., configural processing of relational information). Our findings are the first to demonstrate that strabismic amblyopia may cause specific deficits in face recognition, and add to previous reports characterizing visual perceptual deficits associated in amblyopia as high-level and not only as low-level processing.

Dependence of the appearance-based perception of criminality, suggestibility, and trustworthiness on the level of pixelation of facial images

While the dependence of face identification on the level of pixelation-transform of the images of faces has been well studied, similar research on face-based trait perception is underdeveloped. Because depiction formats used for hiding individual identity in visual media and evidential material recorded by surveillance cameras often consist of pixelized images, knowing the effects of pixelation on person perception has practical relevance. Here, the results of two experiments are presented showing the effect of facial image pixelation on the perception of criminality, trustworthiness, and suggestibility. It appears that individuals (N = 46, M age = 21.5 yr., SD = 3.1 for criminality ratings; N = 94, M age = 27.4 yr., SD = 10.1 for other ratings) have the ability to discriminate between facial cues ndicative of these perceived traits from the coarse level of image pixelation (10-12 pixels per face horizontally) and that the discriminability increases with a decrease in the coarseness of pixelation. Perceived criminality and trustworthiness appear to be better carried by the pixelized images than perceived suggestibility.