Are you always on my mind? A review of how face perception and attention interact

Face and emotion expression processing and the serotonin transporter polymorphism 5-HTTLPR/rs22531

Face cognition, including face identity and facial expression processing, is a crucial component of socio-emotional abilities, characterizing humans as highest developed social beings. However, for these trait domains molecular genetic studies investigating gene-behavior associations based on well-founded phenotype definitions are still rare. We examined the relationship between 5-HTTLPR/rs25531 polymorphisms - related to serotonin-reuptake - and the ability to perceive and recognize faces and emotional expressions in human faces. For this aim we conducted structural equation modeling on data from 230 young adults, obtained by using a comprehensive, multivariate task battery with maximal effort tasks. By additionally modeling fluid intelligence and immediate and delayed memory factors, we aimed to address the discriminant relationships of the 5-HTTLPR/rs25531 polymorphisms with socio-emotional abilities. We found a robust association between the 5-HTTLPR/rs25531 polymorphism and facial emotion perception. Carriers of two long (L) alleles outperformed carriers of one or two S alleles. Weaker associations were present for face identity perception and memory for emotional facial expressions. There was no association between the 5-HTTLPR/rs25531 polymorphism and non-social abilities, demonstrating discriminant validity of the relationships. We discuss the implications and possible neural mechanisms underlying these novel findings.

Does Target Object Processing Affect Reaction Times in Simple Detection Spatial Cueing Tasks?

The current study tested the effect of varying target type and target set size during simple detection versions of Posner's exogenous spatial cueing task. The four target conditions consisted of a single letter, a single number, one of four possible letters, or one of four possible numbers. Responses were faster for numbers than for letters, but only when the cue-target lag was short, the target set included more than one potential number, and the cue and target appeared in different locations. These findings suggest that even during detection tasks, responses are influenced by the object features of the target. Methodological implications for spatial cueing studies and other types of visual perception research were discussed.

Dysfunctional Patterns of Gamma-Band Activity in Response to Human Faces Compared to Non-Facial Stimuli in Patients with Schizophrenia

OBJECTIVE

Healthy individuals show stronger gamma-band activities (GBAs) for socially relevant stimuli (human faces) than for non-relevant ones. This study aimed to examine whether this gamma-band preference occurs in patients with schizophrenia.

METHODS

EEG was recorded for 24 patients with schizophrenia and 23 healthy controls while they viewed pictures of human faces, chairs, and nature scenes. The spectral powers of high-beta (20-30 Hz) and gamma (30-80 Hz) frequencies were analyzed along 3 midline cortical regions, and phase synchronization was calculated.

RESULTS

Compared to the response to non-facial stimuli, higher event related deactivation to facial stimuli was observed for the high-beta frequency across groups. For the gamma frequency, early-stage GBA was increased and late-stage GBA was decreased for all 3 stimuli in patients with schizophrenia compared to healthy controls. Preferential GBA patterns (100-200 and 200-300 ms) were found in healthy controls, but not in patients with schizophrenia. Significant correlation existed between negative symptoms and GBA in the frontal region for chair and scene stimuli. There was no significant intergroup difference in phase synchronization pattern.

CONCLUSION

Our results suggest that patients with schizophrenia have deficits in the preferential pattern of GBA for human faces and the deficits in the preferential pattern were mainly influenced by over-response to socially non-relevant stimuli.

Dynamic emotion perception and prior expectancy

Social interactions require the ability to rapidly perceive emotion from various incoming dynamic, multisensory cues. Prior expectations reduce incoming emotional information and direct attention to cues that are aligned with what is expected. Studies to date have investigated the prior expectancy effect using static emotional images, despite the fact that dynamic stimuli would represent greater ecological validity. The objective of the study was to create a novel functional magnetic resonance imaging (fMRI) paradigm to examine the influence of prior expectations on naturalistic emotion perception. For this purpose, we developed a dynamic emotion perception task, which consisted of audio-visual videos that carry emotional information congruent or incongruent with prior expectations. The results show that emotional congruency was associated with activity in prefrontal regions, amygdala, and putamen, whereas emotional incongruency was associated with activity in temporoparietal junction and mid-cingulate gyrus. Supported by the behavioural results, our findings suggest that prior expectations are reinforced after repeated experience and learning, whereas unexpected emotions may rely on fast change detection processes. The results from the current study are compatible with the notion that the ability to automatically detect unexpected changes in complex dynamic environments allows for adaptive behaviours in potentially advantageous or threatening situations.

Automatic Change Detection to Facial Expressions in Adolescents: Evidence from Visual Mismatch Negativity Responses

Adolescence is a critical period for the neurodevelopment of social-emotional processing, wherein the automatic detection of changes in facial expressions is crucial for the development of interpersonal communication. Two groups of participants (an adolescent group and an adult group) were recruited to complete an emotional oddball task featuring on happy and one fearful condition. The measurement of event-related potential was carried out via electroencephalography and electrooculography recording, to detect visual mismatch negativity (vMMN) with regard to the automatic detection of changes in facial expressions between the two age groups. The current findings demonstrated that the adolescent group featured more negative vMMN amplitudes than the adult group in the fronto-central region during the 120–200 ms interval. During the time window of 370–450 ms, only the adult group showed better automatic processing on fearful faces than happy faces. The present study indicated that adolescent’s posses stronger automatic detection of changes in emotional expression relative to adults, and sheds light on the neurodevelopment of automatic processes concerning social-emotional information.

Emotional face recognition in adolescent suicide attempters and adolescents engaging in non-suicidal self-injury

Little is known about the bio-behavioral mechanisms underlying and differentiating suicide attempts from non-suicidal self-injury (NSSI) in adolescents. Adolescents who attempt suicide or engage in NSSI often report significant interpersonal and social difficulties. Emotional face recognition ability is a fundamental skill required for successful social interactions, and deficits in this ability may provide insight into the unique brain-behavior interactions underlying suicide attempts versus NSSI in adolescents. Therefore, we examined emotional face recognition ability among three mutually exclusive groups: (1) inpatient adolescents who attempted suicide (SA, n = 30); (2) inpatient adolescents engaged in NSSI (NSSI, n = 30); and (3) typically developing controls (TDC, n = 30) without psychiatric illness. Participants included adolescents aged 13-17 years, matched on age, gender and full-scale IQ. Emotional face recognition was evaluated using the diagnostic assessment of nonverbal accuracy (DANVA-2). Compared to TDC youth, adolescents with NSSI made more errors on child fearful and adult sad face recognition while controlling for psychopathology and medication status (ps < 0.05). No differences were found on emotional face recognition between NSSI and SA groups. Secondary analyses showed that compared to inpatients without major depression, those with major depression made fewer errors on adult sad face recognition even when controlling for group status (p < 0.05). Further, compared to inpatients without generalized anxiety, those with generalized anxiety made fewer recognition errors on adult happy faces even when controlling for group status (p < 0.05). Adolescent inpatients engaged in NSSI showed greater deficits in emotional face recognition than TDC, but not inpatient adolescents who attempted suicide. Further results suggest the importance of psychopathology in emotional face recognition. Replication of these preliminary results and examination of the role of context-dependent emotional processing are needed moving forward.

Intact perception but abnormal orientation towards face-like objects in young children with ASD

There is ample behavioral evidence of diminished orientation towards faces as well as the presence of face perception impairments in autism spectrum disorder (ASD), but the underlying mechanisms of these deficits are still unclear. We used face-like object stimuli that have been shown to evoke pareidolia in typically developing (TD) individuals to test the effect of a global face-like configuration on orientation and perceptual processes in young children with ASD and age-matched TD controls. We show that TD children were more likely to look first towards upright face-like objects than children with ASD, showing that a global face-like configuration elicit a stronger orientation bias in TD children as compared to children with ASD. However, once they were looking at the stimuli, both groups spent more time exploring the upright face-like object, suggesting that they both perceived it as a face. Our results are in agreement with abnormal social orienting in ASD, possibly due to an abnormal tuning of the subcortical pathway, leading to poor orienting and attention towards faces. Our results also indicate that young children with ASD can perceive a generic face holistically, such as face-like objects, further demonstrating holistic processing of faces in ASD.

Interactive effects between gaze direction and facial expression on attentional resources deployment: the task instruction and context matter

In three experiments, we tested whether the amount of attentional resources needed to process a face displaying neutral/angry/fearful facial expressions with direct or averted gaze depends on task instructions, and face presentation. To this end, we used a Rapid Serial Visual Presentation paradigm in which participants in Experiment 1 were first explicitly asked to discriminate whether the expression of a target face (T1) with direct or averted gaze was angry or neutral, and then to judge the orientation of a landscape (T2). Experiment 2 was identical to Experiment 1 except that participants had to discriminate the gender of the face of T1 and fearful faces were also presented randomly inter-mixed within each block of trials. Experiment 3 differed from Experiment 2 only because angry and fearful faces were never presented within the same block. The findings indicated that the presence of the attentional blink (AB) for face stimuli depends on specific combinations of gaze direction and emotional facial expressions and crucially revealed that the contextual factors (e.g., explicit instruction to process the facial expression and the presence of other emotional faces) can modify and even reverse the AB, suggesting a flexible and more contextualized deployment of attentional resources in face processing.

Visual Search of Mooney Faces

Faces spontaneously capture attention. However, which special attributes of a face underlie this effect is unclear. To address this question, we investigate how gist information, specific visual properties and differing amounts of experience with faces affect the time required to detect a face. Three visual search experiments were conducted investigating the rapidness of human observers to detect Mooney face images. Mooney images are two-toned, ambiguous images. They were used in order to have stimuli that maintain gist information but limit low-level image properties. Results from the experiments show: (1) Although upright Mooney faces were searched inefficiently, they were detected more rapidly than inverted Mooney face targets, demonstrating the important role of gist information in guiding attention toward a face. (2) Several specific Mooney face identities were searched efficiently while others were not, suggesting the involvement of specific visual properties in face detection. (3) By providing participants with unambiguous gray-scale versions of the Mooney face targets prior to the visual search task, the targets were detected significantly more efficiently, suggesting that prior experience with Mooney faces improves the ability to extract gist information for rapid face detection. However, a week of training with Mooney face categorization did not lead to even more efficient visual search of Mooney face targets. In summary, these results reveal that specific local image properties cannot account for how faces capture attention. On the other hand, gist information alone cannot account for how faces capture attention either. Prior experience facilitates the effect of gist on visual search of faces; making faces a special object category for guiding attention.

When do fearful faces override inhibition of return?

Inhibition of return (IOR) occurs when more than about 300 ms elapses between the cue and the target in atypical peripheral cueing task: reaction times (RTs) become longer when the cue and target locations are the same versus different. IOR could serve the adaptive role of optimizing visual search by discouraging the re-inspection of previously attended locations. As such, IOR should not reduce our chances of noticing relevant event information and emotional stimuli, in particular. However, previous studies have led to inconsistent results. The present study offers a systematic investigation of the conditions under which target fearful faces can modulate either the magnitude or the time course of the IOR effect. Notably, we manipulated the depth of facial processing required to perform the task and/or the task relevance of the facial expressions. When participants localized target faces (Experiment 1) or discriminated them from non-face stimuli (Experiment 2), their emotional expression had no impact on IOR whatsoever. However, IOR occurred later for fearful versus neutral faces when the participants performed emotion (Experiment 3) or gender (Experiment 4) discrimination tasks. These findings are discussed with regard to the mechanisms responsible for IOR and to the processing of emotional facial expressions.

Orienting Toward Face-Like Stimuli in Early Childhood

Newborn infants orient preferentially toward face-like or "protoface" stimuli and recent studies suggest similar reflexive orienting responses in adults. Little is known, however, about the operation of this mechanism in childhood. An attentional-cueing procedure was therefore developed to investigate protoface orienting in early childhood. Consistent with the extant literature, 5- to 6-year-old children (n = 25) exhibited orienting toward face-like stimuli; they responded faster when target location was cued by the appearance of a protoface stimulus than when location was cued by matched control patterns. The potential of this procedure to investigate the development of typical and atypical social perception is discussed.

Eye gaze and head orientation modulate the inhibition of return for faces

The present study used an inhibition of return (IOR) spatial cueing paradigm to examine how gaze direction and head orientation modulate attention capture for human faces. Target response time (RT) was measured after the presentation of a peripheral cue, which was either a face (with front-facing or averted gaze, in either frontal head view or averted head view) or a house (control). Participants fixated on a centered cross at all times and responded via button press to a peripheral target after a variable stimulus onset asynchrony (SOA) from the stimulus cue. At the shortest SOA (150 ms), RTs were shorter for faces than houses, independent of an IOR response, suggesting a cue-based RT advantage elicited by faces. At the longest SOA (2,400 ms), a larger IOR magnitude was found for faces compared to houses. Both the cue-based RT advantage and later IOR responses were modulated by gaze-head congruency; these effects were strongest for frontal gaze faces in frontal head view, and for averted gaze faces in averted head view. Importantly, participants were not given any specific information regarding the stimuli, nor were they told the true purpose of the study. These findings indicate that the congruent combination of head and gaze direction influence the exogenous attention capture of faces during inhibition of return.

Visual short-term memory load modulates the early attention and perception of task-irrelevant emotional faces

The ability to focus on task-relevant information, while suppressing distraction, is critical for human cognition and behavior. Using a delayed-match-to-sample (DMS) task, we investigated the effects of emotional face distractors (positive, negative, and neutral faces) on early and late phases of visual short-term memory (VSTM) maintenance intervals, using low and high VSTM loads. Behavioral results showed decreased accuracy and delayed reaction times (RTs) for high vs. low VSTM load. Event-related potentials (ERPs) showed enhanced frontal N1 and occipital P1 amplitudes for negative faces vs. neutral or positive faces, implying rapid attentional alerting effects and early perceptual processing of negative distractors. However, high VSTM load appeared to inhibit face processing in general, showing decreased N1 amplitudes and delayed P1 latencies. An inverse correlation between the N1 activation difference (high-load minus low-load) and RT costs (high-load minus low-load) was found at left frontal areas when viewing negative distractors, suggesting that the greater the inhibition the lower the RT cost for negative faces. Emotional interference effect was not found in the late VSTM-related parietal P300, frontal positive slow wave (PSW) and occipital negative slow wave (NSW) components. In general, our findings suggest that the VSTM load modulates the early attention and perception of emotional distractors.

A voxel-based morphometry study of gray matter correlates of facial emotion recognition in bipolar disorder

Facial emotion recognition (FER) is one of the many cognitive deficits reported in bipolar disorder (BD) patients. The aim of this study was to investigate neuroanatomical correlates of FER impairments in BD type I (BD-I). Participants comprised 21 euthymic BD-I patients without Axis I DSM IV-TR comorbidities and 21 healthy controls who were assessed using magnetic resonance imaging and the Penn Emotion Recognition Test (ER40). Preprocessing of images used DARTEL (diffeomorphic anatomical registration through exponentiated Lie algebra) for optimized voxel-based morphometry in SPM8. Compared with healthy subjects, BD-I patients performed poorly in on the ER40 and had reduced gray matter volume (GMV) in the left orbitofrontal cortex, superior portion of the temporal pole and insula. In the BD-I group, the statistical maps indicated a direct correlation between FER on the ER40 and right middle cingulate gyrus GMV. Our findings are consistent with the previous studies regarding the overlap of multiple brain networks of social cognition and BD neurobiology, particularly components of the anterior-limbic neural network.

Fixation to features and neural processing of facial expressions in a gender discrimination task

Early face encoding, as reflected by the N170 ERP component, is sensitive to fixation to the eyes. Whether this sensitivity varies with facial expressions of emotion and can also be seen on other ERP components such as P1 and EPN, was investigated. Using eye-tracking to manipulate fixation on facial features, we found the N170 to be the only eye-sensitive component and this was true for fearful, happy and neutral faces. A different effect of fixation to features was seen for the earlier P1 that likely reflected general sensitivity to face position. An early effect of emotion (∼120 ms) for happy faces was seen at occipital sites and was sustained until ∼350 ms post-stimulus. For fearful faces, an early effect was seen around 80 ms followed by a later effect appearing at ∼150 ms until ∼300 ms at lateral posterior sites. Results suggests that in this emotion-irrelevant gender discrimination task, processing of fearful and happy expressions occurred early and largely independently of the eye-sensitivity indexed by the N170. Processing of the two emotions involved different underlying brain networks active at different times.

Efficient human face detection in infancy

Adults detect conspecific faces more efficiently than heterospecific faces; however, the development of this own-species bias (OSB) remains unexplored. We tested whether 6- and 11-month-olds exhibit OSB in their attention to human and animal faces in complex visual displays with high perceptual load (25 images competing for attention). Infants (n = 48) and adults (n = 43) passively viewed arrays containing a face among 24 non-face distractors while we measured their gaze with remote eye tracking. While OSB is typically not observed until about 9 months, we found that, already by 6 months, human faces were more likely to be detected, were detected more quickly (attention capture), and received longer looks (attention holding) than animal faces. These data suggest that 6-month-olds already exhibit OSB in face detection efficiency, consistent with perceptual attunement. This specialization may reflect the biological importance of detecting conspecific faces, a foundational ability for early social interactions.

What is special about expertise? Visual expertise reveals the interactive nature of real-world object recognition

Ever since Diamond and Carey (1986. J. Exp. Psychol.: Gen., vol. 115, pp. 107-117) seminal work, the main model for studying expertise in visual object recognition ("visual expertise") has been face perception. The underlying assumption was that since faces may be considered the ultimate domain of visual expertise, any face-processing signature might actually be a general characteristic of visual expertise. However, while humans are clearly experts in face recognition, visual expertise is not restricted to faces and can be observed in a variety of domains. This raises the question of whether face recognition is in fact the right model to study visual expertise, and if not, what are the common cognitive and neural characteristics of visual expertise. The current perspective article addresses this question by revisiting past and recent neuroimaging and behavioural works on visual expertise. The view of visual expertise that emerges from these works is that expertise is a unique phenomenon, with distinctive neural and cognitive characteristics. Specifically, visual expertise is a controlled, interactive process that develops from the reciprocal interactions between the visual system and multiple top-down factors, including semantic knowledge, top-down attentional control, and task relevance. These interactions enable the ability to flexibly access domain-specific information at multiple scales and levels guided by multiple recognition goals. Extensive visual experience with a given object category culminates in the recruitment of these multiple systems, and is reflected in widespread neural activity, extending well beyond visual cortex, to include higher-level cortical areas.

The Distinct Role of the Amygdala, Superior Colliculus and Pulvinar in Processing of Central and Peripheral Snakes

Introduction

Visual processing of ecologically relevant stimuli involves a central bias for stimuli demanding detailed processing (e.g., faces), whereas peripheral object processing is based on coarse identification. Fast detection of animal shapes holding a significant phylogenetic value, such as snakes, may benefit from peripheral vision. The amygdala together with the pulvinar and the superior colliculus are implicated in an ongoing debate regarding their role in automatic and deliberate spatial processing of threat signals.

Methods

Here we tested twenty healthy participants in an fMRI task, and investigated the role of spatial demands (the main effect of central vs. peripheral vision) in the processing of fear-relevant ecological features. We controlled for stimulus dependence using true or false snakes; snake shapes or snake faces and for task constraints (implicit or explicit). The main idea justifying this double task is that amygdala and superior colliculus are involved in both automatic and controlled processes. Moreover the explicit/implicit instruction in the task with respect to emotion is not necessarily equivalent to explicit vs. implicit in the sense of endogenous vs. exogenous attention, or controlled vs. automatic processes.

Results

We found that stimulus-driven processing led to increased amygdala responses specifically to true snake shapes presented in the centre or in the peripheral left hemifield (right hemisphere). Importantly, the superior colliculus showed significantly biased and explicit central responses to snake-related stimuli. Moreover, the pulvinar, which also contains foveal representations, also showed strong central responses, extending the results of a recent single cell pulvinar study in monkeys. Similar hemispheric specialization was found across structures: increased amygdala responses occurred to true snake shapes presented to the right hemisphere, with this pattern being closely followed by the superior colliculus and the pulvinar.

Conclusion

These results show that subcortical structures containing foveal representations such as the amygdala, pulvinar and superior colliculus play distinct roles in the central and peripheral processing of snake shapes. Our findings suggest multiple phylogenetic fingerprints in the responses of subcortical structures to fear-relevant stimuli.

Computerized spatial delayed recognition span task: a specific tool to assess visuospatial working memory

A new tablet device version (IOS platform) of the Spatial Delayed Recognition Span Task (SDRST) was developed with the aim of investigating visuospatial Working Memory (WM) abilities based on touchscreen technology. This new WM testing application will be available to download for free in Apple Store app (“SDRST app”). In order to verify the feasibility of this computer-based task, we conducted three experiments with different manipulations and groups of participants. We were interested in investigating if (1) the SDRST is sensitive enough to tap into cognitive differences brought by aging and dementia; (2) different experimental manipulations work successfully; (3) cortical brain activations seen in other WM tasks are also demonstrated here; and (4) non-human primates are able to answer the task. Performance (scores and response time) was better for young than older adults and higher for the latter when compared to Alzheimer’s disease (AD) patients. All groups performed better with facial stimuli than with images of scenes and with emotional than with neutral stimuli. Electrophysiology data showed activation on prefrontal and frontal areas of scalp, theta band activity on the midline area, and gamma activity in left temporal area. There are all scalp regions known to be related to attention and WM. Besides those data, our sample of adult captive capuchin monkeys (Sapajus libidinosus) answered the task above chance level. Taken together, these results corroborate the reliability of this new computer-based SDRST as a measure of visuospatial WM in clinical and non-clinical populations as well as in non-human primates. Its tablet app allows the task to be administered in a wide range of settings, including hospitals, homes, schools, laboratories, universities, and research institutions.

Face recognition in schizophrenia disorder: A comprehensive review of behavioral, neuroimaging and neurophysiological studies

Facial emotion processing has been extensively studied in schizophrenia patients while general face processing has received less attention. The already published reviews do not address the current scientific literature in a complete manner. Therefore, here we tried to answer some questions that remain to be clarified, particularly: are the non-emotional aspects of facial processing in fact impaired in schizophrenia patients? At the behavioral level, our key conclusions are that visual perception deficit in schizophrenia patients: are not specific to faces; are most often present when the cognitive (e.g. attention) and perceptual demands of the tasks are important; and seems to worsen with the illness chronification. Although, currently evidence suggests impaired second order configural processing, more studies are necessary to determine whether or not holistic processing is impaired in schizophrenia patients. Neural and neurophysiological evidence suggests impaired earlier levels of visual processing, which might involve the deficits in interaction of the magnocellular and parvocellular pathways impacting on further processing. These deficits seem to be present even before the disorder out-set. Although evidence suggests that this deficit may be not specific to faces, further evidence on this question is necessary, in particularly more ecological studies including context and body processing.

Differences Among Deviations, Genders, and Observers in the Perception of Eye and Nose Asymmetry

PURPOSE

This study investigated the degree and range of recognition of canting of the interpupillary line and deviation of the nose, which were regarded as "normal," "acceptable," and "needing surgical correction," according to different observer groups.

MATERIALS AND METHODS

Four different groups (40 each for laypeople, dental students, general dentists, and orthodontists) rated 11 simulated asymmetric images with canted eyes and a deviated nose separately. The raters categorized each image as normal, socially "acceptable" and not requiring correction, or abnormal and would benefit from correction. Survival analysis was used to evaluate the scope of perception.

RESULTS

The degree of recognition for eye-canting and nose deviation was 2.31 and 2.92, respectively. Eye-canting and nose deviation had lower degrees of recognition in the clockwise direction (2.13°) and on the left side (2.65°), respectively. Women showed a lower degree of the "upper limit of the acceptable range" for canted eyes, and men showed a lower "degree of recognition" and "upper limit of the acceptable range" for a deviated nose. Orthodontists showed a larger upper limit of the acceptable range for eye-canting (P < .001).

CONCLUSIONS

The perceptions of asymmetry of canted eyes and deviated nose were affected by gender, direction of asymmetry, and observer groups.

Emotionally anesthetized: media violence induces neural changes during emotional face processing

Media violence exposure causes increased aggression and decreased prosocial behavior, suggesting that media violence desensitizes people to the emotional experience of others. Alterations in emotional face processing following exposure to media violence may result in desensitization to others' emotional states. This study used scalp electroencephalography methods to examine the link between exposure to violence and neural changes associated with emotional face processing. Twenty-five participants were shown a violent or nonviolent film clip and then completed a gender discrimination stop-signal task using emotional faces. Media violence did not affect the early visual P100 component; however, decreased amplitude was observed in the N170 and P200 event-related potentials following the violent film, indicating that exposure to film violence leads to suppression of holistic face processing and implicit emotional processing. Participants who had just seen a violent film showed increased frontal N200/P300 amplitude. These results suggest that media violence exposure may desensitize people to emotional stimuli and thereby require fewer cognitive resources to inhibit behavior.

The development of sex category representation in infancy: matching of faces and bodies

Sex is a significant social category, and adults derive information about it from both faces and bodies. Research indicates that young infants process sex category information in faces. However, no prior study has examined whether infants derive sex categories from bodies and match faces and bodies in terms of sex. In the current study, 5-month-olds exhibited a preference between sex congruent (face and body of the same sex) versus sex-incongruent (face and body belonging to different genders) images. In contrast, 3.5-month-olds failed to exhibit a preference. Thus, 5-month-olds process sex information from bodies and match it to facial information. However, younger infants' failure to match suggests that there is a developmental change between 3.5 and 5 months of age in the processing of sex categories. These results indicate that rapid developmental changes lead to fairly sophisticated social information processing quite early in life.

Asymmetric engagement of amygdala and its gamma connectivity in early emotional face processing

The amygdala has been regarded as a key substrate for emotion processing. However, the engagement of the left and right amygdala during the early perceptual processing of different emotional faces remains unclear. We investigated the temporal profiles of oscillatory gamma activity in the amygdala and effective connectivity of the amygdala with the thalamus and cortical areas during implicit emotion-perceptual tasks using event-related magnetoencephalography (MEG). We found that within 100 ms after stimulus onset the right amygdala habituated to emotional faces rapidly (with duration around 20–30 ms), whereas activity in the left amygdala (with duration around 50–60 ms) sustained longer than that in the right. Our data suggest that the right amygdala could be linked to autonomic arousal generated by facial emotions and the left amygdala might be involved in decoding or evaluating expressive faces in the early perceptual emotion processing. The results of effective connectivity provide evidence that only negative emotional processing engages both cortical and subcortical pathways connected to the right amygdala, representing its evolutional significance (survival). These findings demonstrate the asymmetric engagement of bilateral amygdala in emotional face processing as well as the capability of MEG for assessing thalamo-cortico-limbic circuitry.

Object-based attentional selection modulates anticipatory alpha oscillations

Visual cortical alpha oscillations are involved in attentional gating of incoming visual information. It has been shown that spatial and feature-based attentional selection result in increased alpha oscillations over the cortical regions representing sensory input originating from the unattended visual field and task-irrelevant visual features, respectively. However, whether attentional gating in the case of object based selection is also associated with alpha oscillations has not been investigated before. Here we measured anticipatory electroencephalography (EEG) alpha oscillations while participants were cued to attend to foveal face or word stimuli, the processing of which is known to have right and left hemispheric lateralization, respectively. The results revealed that in the case of simultaneously displayed, overlapping face and word stimuli, attending to the words led to increased power of parieto-occipital alpha oscillations over the right hemisphere as compared to when faces were attended. This object category-specific modulation of the hemispheric lateralization of anticipatory alpha oscillations was maintained during sustained attentional selection of sequentially presented face and word stimuli. These results imply that in the case of object-based attentional selection—similarly to spatial and feature-based attention—gating of visual information processing might involve visual cortical alpha oscillations.

Cortical response of the ventral attention network to unattended angry facial expressions: an EEG source analysis study

Introduction: We used an affective prime task composed of emotional (happy, angry, and neutral) prime faces and target words with either positive or negative valence. By asking subjects to attend to either the faces’ emotional expression or to the glasses’ shape, we assessed whether angry facial expressions were processed when they were unattended and task-irrelevant.

Methods: We conducted a distributed source analysis on the corresponding event-related potentials focused on the early activity of face processing and attention networks’ related areas. We also evaluated the magnitude of the affective priming effect.

Results: We observed a reduction of occipitotemporal areas’ (BA37) activation to unattended compared to attended faces and a modulation of primary visual areas’ activity lateralization. The latter was more right lateralized for attended than for unattended faces, and emotional faces were more right lateralized than neutral ones only in the former condition. Affective priming disappeared when emotional expressions of prime faces were ignored. Moreover, an increased activation in the right temporo–parietal junction (TPJ), but not in the intraparietal sulcus, was observed only for unattended angry facial expressions at ∼170 ms after face presentation.

Conclusion: We suggest that attentional resources affect the early processing in visual and occipito-temporal areas, irrespective of the faces’ threatening content. The disappearance of the affective priming effect suggests that when subjects were asked to focus on glasses’ shape, attentional resources were not available to process the facial emotional expression, even though emotion-relevant and emotion-irrelevant features of the face were presented in the same position. On the other hand, unattended angry faces evoked a pre-attentive TPJ activity, which most likely represents a bottom–up trigger that signals their high behavioral relevance, although it is unrelated to task demands.

Unemotional traits predict early processing deficit for fearful expressions in young violent offenders: an investigation using continuous flash suppression

BACKGROUND

Research evidence suggests that cognitive and neural mechanisms involved in social information processing may underlie the key aspects associated with the emergence of aggression and psychopathy. Despite extensive research in this field, it is unclear whether this deficit relates to general attentional problems or affects early stages of information processing. Therefore, the aim was to explore the link between aggression, psychopathic traits, and the early processing deficits in young antisocial violent offenders (YAVOs) and healthy controls (CTLs).

METHOD

Participants were presented with rapidly changing Mondrian-like images in one eye, while a neutral or emotional (happy, angry, fearful, disgusted, surprised, sad) face was slowly introduced to the other eye. Participants indicated the location in which the face had appeared on the screen, reflecting the time when they became aware of the stimulus. The relative processing advantage was obtained by subtracting mean reaction times for emotional from neutral faces.

RESULTS

The results indicated that individuals with higher levels of unemotional traits tended to exhibit an extensive early processing disadvantage for fearful facial expressions; this relationship was only evident in the YAVO as opposed to the CTL sample.

CONCLUSIONS

These findings indicate that an emotion processing deficit in antisocial individuals is present even at the most basic levels of processing and closely related to certain psychopathic traits. Furthermore, this early processing deficit appears to be highly specific to fearful expressions, which is consistent with predictions made by influential models of psychopathy. The clinical significance and potential implications of the results are discussed.

Social cognition in schizophrenia and healthy aging: differences and similarities

Social cognition is impaired in schizophrenia but it is not clear whether this is specific for the illness and whether emotion perception is selectively affected. To study this we examined the perception of emotional and non-emotional clues in facial expressions, a key social cognitive skill, in schizophrenia patients and old healthy individuals using young healthy individuals as reference. Tests of object recognition, visual orientation, psychomotor speed, and working memory were included to allow multivariate analysis taking into account other cognitive functions

RESULTS

Schizophrenia patients showed impairments in recognition of identity and emotional facial clues compared to young and old healthy groups. Severity was similar to that for object recognition and visuospatial processing. Older and younger healthy groups did not differ from each other on these tests. Schizophrenia patients and old healthy individuals were similarly impaired in the ability to automatically learn new faces during the testing procedure (measured by the CSTFAC index) compared to young healthy individuals.

CONCLUSIONS

Social cognition is distinctly impaired in schizophrenia compared to healthy aging. Further study is needed to identify the mechanisms of automatic social cognitive learning impairment in schizophrenia patients and healthy aging individuals and determine whether similar neural systems are affected.

Physical Aggression and Facial Expression Identification

Social information processing theories suggest that aggressive individuals may exhibit hostile perceptual biases when interpreting other’s behaviour. This hypothesis was tested in the present study which investigated the effects of physical aggression on facial expression identification in a sample of healthy participants. Participants were asked to judge the expressions of faces presented to them and to complete a self-report measure of aggression. Relative to low physically aggressive participants, high physically aggressive participants were more likely to mistake non-angry facial expressions as being angry facial expressions (misattribution errors), supporting the idea of a hostile predisposition. These differences were not explained by gender, or response times. There were no differences in identifying angry expressions in general between aggression groups (misperceived errors). These findings add support to the idea that aggressive individuals exhibit hostile perceptual biases when interpreting facial expressions.

I can't take my eyes off of you: attentional allocation to infant, child, adolescent and adult faces in mothers and non-mothers

It has been reported previously that infant faces elicit enhanced attentional allocation compared to adult faces in adult women, particularly when these faces are emotional and when the participants are mothers, as compared to non-mothers [1]. However, it remains unclear whether this increased salience of infant faces as compared to adult faces extends to children older than infant age, or whether infant faces have a unique capacity to elicit preferential attentional allocation compared to juvenile or adult faces. Therefore, this study investigated attentional allocation to a variety of different aged faces (infants, pre-adolescent children, adolescents, and adults) in 84 adult women, 39 of whom were mothers. Consistent with previous findings, infant faces were found to elicit greater attentional engagement compared to pre-adolescent, adolescent, or adult faces, particularly when the infants displayed distress; again, this effect was more pronounced in mothers compared to non-mothers. Pre-adolescent child faces were also found to elicit greater attentional engagement compared to adolescent and adult faces, but only when they displayed distress. No preferential attentional allocation was observed for adolescent compared to adult faces. These findings indicate that cues potentially signalling vulnerability, specifically age and sad affect, interact to engage attention. They point to a potentially important mechanism, which helps facilitate caregiving behaviour.

The influence of emotional faces on the spatial allocation of attention

OBJECTIVES

Studies suggest that the right hemisphere is dominant for emotional facial recognition. In addition, whereas some studies suggest the right hemisphere mediates the processing of all emotions (dominance hypothesis), other studies suggest that the left hemisphere mediates positive emotions the right mediates negative emotions (valence hypothesis). Since each hemisphere primarily attends to contralateral space, the goals of this study was to learn if emotional faces would induce a leftward deviation of attention and if the valence of facial emotional stimuli can influence the normal viewer's spatial direction of attention.

METHODS

Seventeen normal right handed participants were asked to bisect horizontal lines that had all combinations of sad, happy or neutral faces at ends of these lines. During this task the subjects were never requested to look at these faces and there were no task demands that depended on viewing these faces.

RESULTS

Presentation of emotional faces induced a greater leftward deviation compared to neutral faces, independent of where (spatial position) these faces were presented. However, faces portraying negative emotions tended to induce a greater leftward bias than positive emotions.

CONCLUSIONS

Independent of location, the presence of emotional faces influenced the spatial allocation of attention, such that normal subjects shift the direction of their attention toward left hemispace and this attentional shift appears to be greater for negative (sad) than positive faces (happy).

Love is in the gaze: an eye-tracking study of love and sexual desire

Reading other people's eyes is a valuable skill during interpersonal interaction. Although a number of studies have investigated visual patterns in relation to the perceiver's interest, intentions, and goals, little is known about eye gaze when it comes to differentiating intentions to love from intentions to lust (sexual desire). To address this question, we conducted two experiments: one testing whether the visual pattern related to the perception of love differs from that related to lust and one testing whether the visual pattern related to the expression of love differs from that related to lust. Our results show that a person's eye gaze shifts as a function of his or her goal (love vs. lust) when looking at a visual stimulus. Such identification of distinct visual patterns for love and lust could have theoretical and clinical importance in couples therapy when these two phenomena are difficult to disentangle from one another on the basis of patients' self-reports.

Selective attention modulates high-frequency activity in the face-processing network

Face processing depends on the orchestrated activity of a large-scale neuronal network. Its activity can be modulated by attention as a function of task demands. However, it remains largely unknown whether voluntary, endogenous attention and reflexive, exogenous attention to facial expressions equally affect all regions of the face-processing network, and whether such effects primarily modify the strength of the neuronal response, the latency, the duration, or the spectral characteristics. We exploited the good temporal and spatial resolution of intracranial electroencephalography (iEEG) and recorded from depth electrodes to uncover the fast dynamics of emotional face processing. We investigated frequency-specific responses and event-related potentials (ERP) in the ventral occipito-temporal cortex (VOTC), ventral temporal cortex (VTC), anterior insula, orbitofrontal cortex (OFC), and amygdala when facial expressions were task-relevant or task-irrelevant. All investigated regions of interest (ROI) were clearly modulated by task demands and exhibited stronger changes in stimulus-induced gamma band activity (50-150 Hz) when facial expressions were task-relevant. Observed latencies demonstrate that the activation is temporally coordinated across the network, rather than serially proceeding along a processing hierarchy. Early and sustained responses to task-relevant faces in VOTC and VTC corroborate their role for the core system of face processing, but they also occurred in the anterior insula. Strong attentional modulation in the OFC and amygdala (300 msec) suggests that the extended system of the face-processing network is only recruited if the task demands active face processing. Contrary to our expectation, we rarely observed differences between fearful and neutral faces. Our results demonstrate that activity in the face-processing network is susceptible to the deployment of selective attention. Moreover, we show that endogenous attention operates along the whole face-processing network, and that these effects are reflected in frequency-specific changes in the gamma band.

Attractive faces temporally modulate visual attention

Facial attractiveness is an important biological and social signal on social interaction. Recent research has demonstrated that an attractive face captures greater spatial attention than an unattractive face does. Little is known, however, about the temporal characteristics of visual attention for facial attractiveness. In this study, we investigated the temporal modulation of visual attention induced by facial attractiveness by using a rapid serial visual presentation. Fourteen male faces and two female faces were successively presented for 160 ms, respectively, and participants were asked to identify two female faces embedded among a series of multiple male distractor faces. Identification of a second female target (T2) was impaired when a first target (T1) was attractive compared to neutral or unattractive faces, at 320 ms stimulus onset asynchrony (SOA); identification was improved when T1 was attractive compared to unattractive faces at 640 ms SOA. These findings suggest that the spontaneous appraisal of facial attractiveness modulates temporal attention.

Face-specific capacity limits under perceptual load do not depend on holistic processing

Previous observations that face recognition may proceed automatically, without drawing on attentional resources, have been challenged by recent demonstrations that only a few faces can be processed at one time. However, a question remains about the nature of the stimulus properties that underlie face-specific capacity limits. Two experiments showed that speeded categorization of a famous face (such as a politician or pop star) is facilitated when it is congruent with a peripheral distractor face. This congruency effect is eliminated if the visual search is loaded with more than one face, unlike previous demonstrations of speeded classification using semantic information. Importantly, congruency effects are also eliminated when the search task is loaded with nontarget faces that are shown in an inverted orientation. These results indicate that face-specific capacity limits are not determined by the configural ("holistic") properties of face recognition.