Amygdala responses to averted vs direct gaze fear vary as a function of presentation speed

A double-blind trial of decoded neurofeedback intervention for specific phobias

AIM

A new closed-loop functional magnetic resonance imaging method called multivoxel neuroreinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

METHODS

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (one target, one control) animal subtype-specific phobias were randomly assigned (1:1:1) to receive one, three, or five sessions of multivoxel neuroreinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pretreatment to posttreatment differences were analyzed with a two-way repeated-measures anova.

RESULTS

A total of 23 participants (69.6% female) were randomized to receive one (n = 8), three (n = 7), or five (n = 7) sessions of multivoxel neuroreinforcement. Eighteen (n = 6 each group) participants were analyzed for our primary outcome. After neuroreinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

CONCLUSION

Results suggest that multivoxel neuroreinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a nondistressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

CLINICAL TRIAL REGISTRATION

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

Emotion-gaze interaction affects time-to-collision estimates, but not preferred interpersonal distance towards looming faces

Estimating the time until impending collision (time-to-collision, TTC) of approaching or looming individuals and maintaining a comfortable distance from others (interpersonal distance, IPD) are commonly required in daily life and contribute to survival and social goals. Despite accumulating evidence that facial expressions and gaze direction interactively influence face processing, it remains unclear how these facial features affect the spatiotemporal processing of looming faces. We examined whether facial expressions (fearful vs. neutral) and gaze direction (direct vs. averted) interact on the judgments of TTC and IPD for looming faces, based on the shared signal hypothesis that fear signals the existence of threats in the environment when coupled with averted gaze. Experiment 1 demonstrated that TTC estimates were reduced for fearful faces compared to neutral ones only when the concomitant gaze was averted. In Experiment 2, the emotion-gaze interaction was not observed in the IPD regulation, which is arguably sensitive to affective responses to faces. The results suggest that fearful-averted faces modulate the cognitive extrapolation process of looming motion by communicating environmental threats rather than by altering subjective fear or perceived emotional intensity of faces. The TTC-specific effect may reflect an enhanced defensive response to unseen threats implied by looming fearful-averted faces. Our findings provide insight into how the visual system processes facial features to ensure bodily safety and comfortable interpersonal communication in dynamic environments.

A double-blind trial of decoded neurofeedback intervention for specific phobias

Aim

A new closed-loop fMRI method called multi-voxel neuro-reinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

Methods

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (1 target, 1 control) animal subtype specific phobias were randomly assigned (1:1:1) to receive 1, 3, or 5 sessions of multi-voxel neuro-reinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pre-treatment to post-treatment differences were analyzed with a 2-way repeated-measures ANOVA.

Results

A total of 23 participants (69.6% female) were randomized to receive 1 (n=8), 3 (n=7), or 5 (n=7) sessions of multi-voxel neuro-reinforcement. Eighteen (n=6 each group) participants were analyzed for our primary outcome. After neuro-reinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

Conclusion

Results suggest multi-voxel neuro-reinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a non-distressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

Clinical Trial Registration

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

'Le regard des autres': the experience of walking in social environments as a person with Parkinson's disease

OBJECTIVE

To examine the experience of people with Parkinson's disease when walking in different social situations, and improve understanding of how this affects participation in meaningful activity.

METHODS

A convenience sample of fourteen people with Parkinson's disease and a history of gait dysfunction was recruited. In-depth interviews and direct observations were conducted in the participants' home environments. Specific examples from community mobility were reviewed using first person interviewing techniques with the support of video footage. Interview transcripts were analyzed using an interpretive phenomenological approach to derive key themes.

RESULTS

The feeling of 'being looked at' (le regard des autres) was the central theme in participant discourse. This sentiment was inextricably linked to the given norms of the social setting, and the relationships between participants and others within that environment. Participants sought to manage how they were perceived by others through modification of posture/gait patterns; disclosure of their neurological disease; and avoidance/withdrawal from social situations.

CONCLUSION

Further to the functional aspects of mobility, gait is important for maintaining self-image in people with Parkinson's disease. Affective gaze interactions have significant consequences upon participation restriction. These findings underscore the interest of activities which strengthen self-image and validate movement diversity in PD rehabilitation.

Effects of fearful face presentation time and observer's eye movement on the gaze cue effect

BACKGROUND

There are many conflicting findings on the gaze cueing effect (GCE) of emotional facial expressions. This study aimed to investigate whether an averted gaze, accompanied by a fearful expression of different durations, could enhance attentional orientation, as measured by a participant's eye movements.

METHODS

Twelve participants (3 females) completed the gaze cue task, reacting to a target location after observing changes in the gaze and expression of a face illustrated on a computer screen. Meanwhile, participants' eye movements were monitored by electrooculography. The GCE was calculated by reaction time as an indicator of attention shift.

RESULTS

The analysis of the overall data did not find a significant effect of fearful facial expressions on the GCE. However, analysis of trial data that excluded a participant's eye movement data showed that brief (0, 100 ms) presentation of the fearful facial expression enhanced the GCE compared to that during a neutral facial expression, although when the presentation time of the fearful expression was increased to 200 or 400 ms, the GCE of the fearful expression was at the same level as when model showed a neutral expression.

CONCLUSIONS

The results suggest that the attention-enhancing effect of gaze cues induced by rapidly presented fearful expressions occurs only when the effect of eye movement trials is excluded. This effect may be mediated by reflexively neural circuits in the amygdala that process threatening stimuli. However, as the expression duration increased, the fearful expression's attention-enhancing effect decreased. We suggest that future studies on the emotion modulation of GCE should consider the negative effects of participants' saccades and blinks on the experimental results.

The shared signal hypothesis: Facial and bodily expressions of emotion mutually inform one another

Decades of research show that contextual information from the body, visual scene, and voices can facilitate judgments of facial expressions of emotion. To date, most research suggests that bodily expressions of emotion offer context for interpreting facial expressions, but not vice versa. The present research aimed to investigate the conditions under which mutual processing of facial and bodily displays of emotion facilitate and/or interfere with emotion recognition. In the current two studies, we examined whether body and face emotion recognition are enhanced through integration of shared emotion cues, and/or hindered through mixed signals (i.e., interference). We tested whether faces and bodies facilitate or interfere with emotion processing by pairing briefly presented (33 ms), backward-masked presentations of faces with supraliminally presented bodies (Experiment 1) and vice versa (Experiment 2). Both studies revealed strong support for integration effects, but not interference. Integration effects are most pronounced for low-emotional clarity facial and bodily expressions, suggesting that when more information is needed in one channel, the other channel is recruited to disentangle any ambiguity. That this occurs for briefly presented, backward-masked presentations reveals low-level visual integration of shared emotional signal value.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

The rapid and automatic categorization of facial expression changes in highly variable natural images

Emotional expressions are quickly and automatically read from human faces under natural viewing conditions. Yet, categorization of facial expressions is typically measured in experimental contexts with homogenous sets of face stimuli. Here we evaluated how the 6 basic facial emotions (Fear, Disgust, Happiness, Anger, Surprise or Sadness) can be rapidly and automatically categorized with faces varying in head orientation, lighting condition, identity, gender, age, ethnic origin and background context. High-density electroencephalography was recorded in 17 participants viewing 50 s sequences with natural variable images of neutral-expression faces alternating at a 6 Hz rate. Every five stimuli (1.2 Hz), variable natural images of one of the six basic expressions were presented. Despite the wide physical variability across images, a significant F/5 = 1.2 Hz response and its harmonics (e.g., 2F/5 = 2.4 Hz, etc.) was observed for all expression changes at the group-level and in every individual participant. Facial categorization responses were found mainly over occipito-temporal sites, with distinct hemispheric lateralization and cortical topographies according to the different expressions. Specifically, a stronger response was found to Sadness categorization, especially over the left hemisphere, as compared to Fear and Happiness, together with a right hemispheric dominance for categorization of Fearful faces. Importantly, these differences were specific to upright faces, ruling out the contribution of low-level visual cues. Overall, these observations point to robust rapid and automatic facial expression categorization processes in the human brain.

Turning Heads: The Effects of Face View and Eye Gaze Direction on the Perceived Attractiveness of Expressive Faces

We investigated whether the perceived attractiveness of expressive faces was influenced by head turn and eye gaze towards or away from the observer. In all experiments, happy faces were consistently rated as more attractive than angry faces. A head turn towards the observer, whereby a full-face view was shown, was associated with relatively higher attractiveness ratings when gaze direction was aligned with face view (Experiment 1). However, preference for full-face views of happy faces was not affected by gaze shifts towards or away from the observer (Experiment 2a). In Experiment 3, the relative duration of each face view (front-facing or averted at 15°) during a head turn away or towards the observer was manipulated. There was benefit on attractiveness ratings for happy faces shown for a longer duration from the front view, regardless of the direction of head turn. Our findings support previous studies indicating a preference for positive expressions on attractiveness judgements, which is further enhanced by the front views of faces, whether presented during a head turn or shown statically. In sum, our findings imply a complex interaction between cues of social attention, indicated by the view of the face shown, and reward on attractiveness judgements of unfamiliar faces.

Fast saccadic and manual responses to faces presented to the koniocellular visual pathway

The parallel pathways of the human visual system differ in their tuning to luminance, color, and spatial frequency. These attunements recently have been shown to propagate to differential processing of higher-order stimuli, facial threat cues, in the magnocellular (M) and parvocellular (P) pathways, with greater sensitivity to clear and ambiguous threat, respectively. The role of the third, koniocellular (K) pathway in facial threat processing, however, remains unknown. To address this gap in knowledge, we briefly presented peripheral face stimuli psychophysically biased towards M, P, or K pathways. Observers were instructed to report via a key-press whether the face was angry or neutral while their eye movements and manual responses were recorded. We found that short-latency saccades were made more frequently to faces presented in the K channel than to P or M channels. Saccade latencies were not significantly modulated by expressive and identity cues. In contrast, manual response latencies and accuracy were modulated by both pathway biasing and by interactions of facial expression with facial masculinity, such that angry male faces elicited the fastest, and angry female faces, the least accurate, responses. We conclude that face stimuli can evoke fast saccadic and manual responses when projected to the K pathway.

Magnocellular and parvocellular pathway contributions to facial threat cue processing

Human faces evolved to signal emotions, with their meaning contextualized by eye gaze. For instance, a fearful expression paired with averted gaze clearly signals both presence of threat and its probable location. Conversely, direct gaze paired with facial fear leaves the source of the fear-evoking threat ambiguous. Given that visual perception occurs in parallel streams with different processing emphases, our goal was to test a recently developed hypothesis that clear and ambiguous threat cues would differentially engage the magnocellular (M) and parvocellular (P) pathways, respectively. We employed two-tone face images to characterize the neurodynamics evoked by stimuli that were biased toward M or P pathways. Human observers (N = 57) had to identify the expression of fearful or neutral faces with direct or averted gaze while their magnetoencephalogram was recorded. Phase locking between the amygdaloid complex, orbitofrontal cortex (OFC) and fusiform gyrus increased early (0–300 ms) for M-biased clear threat cues (averted-gaze fear) in the β-band (13–30 Hz) while P-biased ambiguous threat cues (direct-gaze fear) evoked increased θ (4–8 Hz) phase locking in connections with OFC of the right hemisphere. We show that M and P pathways are relatively more sensitive toward clear and ambiguous threat processing, respectively, and characterize the neurodynamics underlying emotional face processing in the M and P pathways.

No influence of eye gaze on emotional face processing in the absence of conscious awareness

The human brain has evolved specialised mechanisms to enable the rapid detection of threat cues, including emotional face expressions (e.g., fear and anger). However, contextual cues - such as gaze direction - influence the ability to recognise emotional expressions. For instance, anger paired with direct gaze, and fear paired with averted gaze are more accurately recognised compared to alternate conjunctions of these features. It is argued that this is because gaze direction conveys the relevance and locus of the threat to the observer. Here, we used continuous flash suppression (CFS) to assess whether the modulatory effect of gaze direction on emotional face processing occurs outside of conscious awareness. Previous research using CFS has demonstrated that fearful facial expressions are prioritised by the visual system and gain privileged access to awareness over other expressed emotions. We hypothesised that if the modulatory effects of gaze on emotional face processing occur also at this level, then the gaze-emotion conjunctions signalling self-relevant threat will reach awareness faster than those that do not. We report that fearful faces gain privileged access to awareness over angry faces, but that gaze direction does not modulate this effect. Thus, our findings suggest that previously reported effects of gaze direction on emotional face processing are likely to occur once the face is detected, where the self-relevance and locus of the threat can be consciously appraised.

Amygdala responds to direct gaze in real but not in computer-generated faces

Computer-generated (CG) faces are an important visual interface for human-computer interaction in social contexts. Here we investigated whether the human brain processes emotion and gaze similarly in real and carefully matched CG faces. Real faces evoked greater responses in the fusiform face area than CG faces, particularly for fearful expressions. Emotional (angry and fearful) facial expressions evoked similar activations in the amygdala in real and CG faces. Direct as compared with averted gaze elicited greater fMRI responses in the amygdala regardless of facial expression but only for real and not for CG faces. We observed an interaction effect between gaze and emotion (i.e., the shared signal effect) in the right posterior temporal sulcus and other regions, but not in the amygdala, and we found no evidence for different shared signal effects in real and CG faces. Taken together, the present findings highlight similarities (emotional processing in the amygdala) and differences (overall processing in the fusiform face area, gaze processing in the amygdala) in the neural processing of real and CG faces.

Differential magnocellular versus parvocellular pathway contributions to the combinatorial processing of facial threat

Recently, speed of presentation of facially expressive stimuli was found to influence the processing of compound threat cues (e.g., anger/fear/gaze). For instance, greater amygdala responses were found to clear (e.g., direct gaze anger/averted gaze fear) versus ambiguous (averted gaze anger/direct gaze fear) combinations of threat cues when rapidly presented (33 and 300ms), but greater to ambiguous versus clear threat cues when presented for more sustained durations (1, 1.5, and 2s). A working hypothesis was put forth (Adams et al., 2012) that these effects were due to differential magnocellular versus parvocellular pathways contributions to the rapid versus sustained processing of threat, respectively. To test this possibility directly here, we restricted visual stream processing in the fMRI environment using facially expressive stimuli specifically designed to bias visual input exclusively to the magnocellular versus parvocellular pathways. We found that for magnocellular-biased stimuli, activations were predominantly greater to clear versus ambiguous threat-gaze pairs (on par with that previously found for rapid presentations of threat cues), whereas activations to ambiguous versus clear threat-gaze pairs were greater for parvocellular-biased stimuli (on par with that previously found for sustained presentations). We couch these findings in an adaptive dual process account of threat perception and highlight implications for other dual process models within psychology.

The ventromedial prefrontal cortex is particularly responsive to social evaluations requiring the use of person-knowledge

Humans can rely on diverse sources of information to evaluate others, including knowledge (e.g., occupation, likes and dislikes, education, etc.) and perceptual cues (e.g., attractiveness, race, etc.). Previous research has identified brain regions supporting person evaluations, but are evaluations based on perceptual cues versus person-knowledge processed differently? Moreover, are neural responses consistent when person-knowledge is available but unnecessary for the evaluation? This fMRI study examined how the use and availability of person-knowledge shapes the neural underpinnings of social evaluations. Participants evaluated well-known actors based on attractiveness or body of work (i.e., person-knowledge) and unknown models based on attractiveness only. Analyses focused on the VMPFC, following research implicating this region in positive evaluations based on person-knowledge. The VMPFC was sensitive to the (1) availability of person-knowledge, showing greater responses as ratings became more positive for actors (but not models) regardless of rating dimension and (2) use of available person-knowledge, showing greater activity as ratings for likability based on body of work became more positive for actors versus models rated on attractiveness. These findings indicate that although brain regions supporting person evaluation are sensitive to the availability to person-knowledge, they are even more responsive when judgments require the use of available person-knowledge.

Affective Eye Contact: An Integrative Review

In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.

Sex-related differences in behavioral and amygdalar responses to compound facial threat cues

During face perception, we integrate facial expression and eye gaze to take advantage of their shared signals. For example, fear with averted gaze provides a congruent avoidance cue, signaling both threat presence and its location, whereas fear with direct gaze sends an incongruent cue, leaving threat location ambiguous. It has been proposed that the processing of different combinations of threat cues is mediated by dual processing routes: reflexive processing via magnocellular (M) pathway and reflective processing via parvocellular (P) pathway. Because growing evidence has identified a variety of sex differences in emotional perception, here we also investigated how M and P processing of fear and eye gaze might be modulated by observer's sex, focusing on the amygdala, a structure important to threat perception and affective appraisal. We adjusted luminance and color of face stimuli to selectively engage M or P processing and asked observers to identify emotion of the face. Female observers showed more accurate behavioral responses to faces with averted gaze and greater left amygdala reactivity both to fearful and neutral faces. Conversely, males showed greater right amygdala activation only for M-biased averted-gaze fear faces. In addition to functional reactivity differences, females had proportionately greater bilateral amygdala volumes, which positively correlated with behavioral accuracy for M-biased fear. Conversely, in males only the right amygdala volume was positively correlated with accuracy for M-biased fear faces. Our findings suggest that M and P processing of facial threat cues is modulated by functional and structural differences in the amygdalae associated with observer's sex.

Neurodynamics and connectivity during facial fear perception: The role of threat exposure and signal congruity

Fearful faces convey threat cues whose meaning is contextualized by eye gaze: While averted gaze is congruent with facial fear (both signal avoidance), direct gaze (an approach signal) is incongruent with it. We have previously shown using fMRI that the amygdala is engaged more strongly by fear with averted gaze during brief exposures. However, the amygdala also responds more to fear with direct gaze during longer exposures. Here we examined previously unexplored brain oscillatory responses to characterize the neurodynamics and connectivity during brief (~250 ms) and longer (~883 ms) exposures of fearful faces with direct or averted eye gaze. We performed two experiments: one replicating the exposure time by gaze direction interaction in fMRI (N = 23), and another where we confirmed greater early phase locking to averted-gaze fear (congruent threat signal) with MEG (N = 60) in a network of face processing regions, regardless of exposure duration. Phase locking to direct-gaze fear (incongruent threat signal) then increased significantly for brief exposures at ~350 ms, and at ~700 ms for longer exposures. Our results characterize the stages of congruent and incongruent facial threat signal processing and show that stimulus exposure strongly affects the onset and duration of these stages.

Observer's anxiety facilitates magnocellular processing of clear facial threat cues, but impairs parvocellular processing of ambiguous facial threat cues

Facial expression and eye gaze provide a shared signal about threats. While a fear expression with averted gaze clearly points to the source of threat, direct-gaze fear renders the source of threat ambiguous. Separable routes have been proposed to mediate these processes, with preferential attunement of the magnocellular (M) pathway to clear threat, and of the parvocellular (P) pathway to threat ambiguity. Here we investigated how observers’ trait anxiety modulates M- and P-pathway processing of clear and ambiguous threat cues. We scanned subjects (N = 108) widely ranging in trait anxiety while they viewed fearful or neutral faces with averted or directed gaze, with the luminance and color of face stimuli calibrated to selectively engage M- or P-pathways. Higher anxiety facilitated processing of clear threat projected to M-pathway, but impaired perception of ambiguous threat projected to P-pathway. Increased right amygdala reactivity was associated with higher anxiety for M-biased averted-gaze fear, while increased left amygdala reactivity was associated with higher anxiety for P-biased, direct-gaze fear. This lateralization was more pronounced with higher anxiety. Our findings suggest that trait anxiety differentially affects perception of clear (averted-gaze fear) and ambiguous (direct-gaze fear) facial threat cues via selective engagement of M and P pathways and lateralized amygdala reactivity.

Social Vision: Applying a Social-Functional Approach to Face and Expression Perception

A social-functional approach to face processing comes with a number of assumptions. First, given that humans possess limited cognitive resources, it assumes that we naturally allocate attention to processing and integrating the most adaptively relevant social cues. Second, from these cues, we make behavioral forecasts about others in order to respond in an efficient and adaptive manner. This assumption aligns with broader ecological accounts of vision that highlight a direct action-perception link, even for nonsocial vision. Third, humans are naturally predisposed to process faces in this functionally adaptive manner. This latter contention is implied by our attraction to dynamic aspects of the face, including looking behavior and facial expressions, from which we tend to overgeneralize inferences, even when forming impressions of stable traits. The functional approach helps to address how and why observers are able to integrate functionally related compound social cues in a manner that is ecologically relevant and thus adaptive.

Shared mechanism for emotion processing in adolescents with and without autism

Although, the quest to understand emotional processing in individuals with Autism Spectrum Disorders (ASD) has led to an impressive number of studies, the picture that emerges from this research remains inconsistent. Some studies find that Typically Developing (TD) individuals outperform those with ASD in emotion recognition tasks, others find no such difference. In this paper, we move beyond focusing on potential group differences in behaviour to answer what we believe is a more pressing question: do individuals with ASD use the same mechanisms to process emotional cues? To this end, we rely on model-based analyses of participants’ accuracy during an emotion categorisation task in which displays of anger and fear are paired with direct vs. averted gaze. Behavioural data of 20 ASD and 20 TD adolescents revealed that the ASD group displayed lower overall performance. Yet, gaze direction had a similar impact on emotion categorisation in both groups, i.e. improved accuracy for salient combinations (anger-direct, fear-averted). Critically, computational modelling of participants’ behaviour reveals that the same mechanism, i.e. increased perceptual sensitivity, underlies the contextual impact of gaze in both groups. We discuss the specific experimental conditions that may favour emotion processing and the automatic integration of contextual information in ASD.

Qualitative Analysis of Emotions: Fear and Thrill

People can speak, and this provides opportunities to analyze human emotions using perceived experiences communicated via language, as well as through measurement and imaging techniques that are also applicable to other higher animal species. Here I compare four qualitative methodological approaches to test if, and how, thrill depends on fear. I use eight high-risk, high-skill, real-life outdoor adventure recreation activities to provide the test circumstances. I present data from: >4000 person-days of participant observation; interviews with 40 expert practitioners; retrospective autoethnography of 50 critical incidents over 4 decades; and experimental autoethnography of 60 events. Results from different methods are congruent, but different approaches yield different insights. The principal findings are as follows. Individuals differ in their fear and thrill responses. The same individual may have different responses on different occasions. Fear boosts performance, but panic causes paralysis. Anxiety or apprehension prior to a risky action or event differs from fear experienced during the event itself. The intensity of pre-event fear generally increases with the immediacy of risk to life, and time to contemplate that risk. Fear must be faced, assessed and overcome in order to act. Thrill can occur either during or after a high-risk event. Thrill can occur without fear, and fear without thrill. Below a lower threshold of perceived risk, thrill can occur without fear. Between a lower and upper threshold, thrill increases with fear. Beyond the upper threshold, thrill vanishes but fear remains. This there is a sawtooth relation between fear and thrill. Perceived danger generates intense focus and awareness. Fear and other emotions can disappear during intense concentration and focus. Under high risk, the usual emotional sequence is fear before the action or event, then focus during the action or event, then thrill, relief, or triumph afterward. The emotionless state persists only during the most intense concentration. For events long enough to differentiate time within the events, fear and thrill can arise and fade in different fine-scale sequences.

Early changes of brain connectivity in primary open angle glaucoma

Our aim was to assess in primary open angle glaucoma (POAG), a major cause of irreversible blindness worldwide, whether diffuse brain changes recently shown in advanced stage can be detected since the early stage. We used multimodal magnetic resonance imaging (MRI) in 57 patients with the three POAG stages and in 29 age-matched normal controls (NC). Voxelwise statistics was performed with nonparametric permutation testing. Compared with NC, disrupted anatomical connectivity (AC) was found in the whole POAG group along the visual pathway and in nonvisual white matter tracts (P < 0.001). Moreover, POAG patients showed decreased functional connectivity (FC) in the visual (P = 0.004) and working memory (P < 0.001) networks whereas an increase occurred in the default mode (P = 0.002) and subcortical (P < 0.001) networks. Altered AC and FC were already present in early POAG (n = 14) in both visual and nonvisual systems (P ≤ 0.01). Only severe POAG (n = 30) showed gray matter atrophy and this mapped on visual cortex (P < 0.001) and hippocampus (P < 0.001). Increasing POAG stage was associated with worsening AC in both visual and nonvisual pathway (P < 0.001), progressive atrophy in the hippocampus and frontal cortex (P < 0.003). Most of the structural and functional alterations within and outside the visual system showed correlation (P < 0.001 to 0.02) with computerized visual field and retinal nerve fiber layer thickness. In conclusion, the complex pathogenesis of POAG includes widespread damage of AC and altered FC within and beyond the visual system since the early disease stage. The association of brain MRI changes with measures of visual severity emphasizes the clinical relevance of our findings. Hum Brain Mapp 37:4581-4596, 2016. © 2016 Wiley Periodicals, Inc.

Atypical Amygdala Response to Fear Conditioning in Autism Spectrum Disorder

BACKGROUND

Anxiety is the most common comorbid psychiatric concern in individuals diagnosed with autism spectrum disorder (ASD) and can cause significant functional impairment. Fear conditioning tasks offer a useful neurodevelopmental model for anxiety, yet there are no published neuroimaging studies of fear conditioning using ASD samples.

METHODS

Twenty adults diagnosed with ASD and 19 healthy adult control subjects completed a standard fear conditioning and extinction paradigm while undergoing functional magnetic resonance imaging scanning. A burst of air on the base of the neck was the unconditioned stimulus. Participants returned 1 day later for scanning during an extinction recall phase. A priori regions of interest were analyzed with a familywise error correction rate < 0.05.

RESULTS

All regions of interest demonstrated significantly greater response to threat than safe conditions during initial fear acquisition. Compared with age-matched control subjects, the ASD group showed a significantly decreased differential response to threat versus safe cues in right amygdala during the initial fear acquisition phase and decreased response in left amygdala during the first run of extinction recall on the second day of scanning.

CONCLUSIONS

Symptoms of severe anxiety in ASD may arise from atypical neural mechanisms especially related to the differentiation of threat versus safe cues. An inability to effectively identify safety contexts may underlie chronically increased levels of anxiety in many individuals diagnosed with ASD.

Anxiety dissociates the adaptive functions of sensory and motor response enhancements to social threats

Efficient detection and reaction to negative signals in the environment is essential for survival. In social situations, these signals are often ambiguous and can imply different levels of threat for the observer, thereby making their recognition susceptible to contextual cues – such as gaze direction when judging facial displays of emotion. However, the mechanisms underlying such contextual effects remain poorly understood. By computational modeling of human behavior and electrical brain activity, we demonstrate that gaze direction enhances the perceptual sensitivity to threat-signaling emotions – anger paired with direct gaze, and fear paired with averted gaze. This effect arises simultaneously in ventral face-selective and dorsal motor cortices at 200 ms following face presentation, dissociates across individuals as a function of anxiety, and does not reflect increased attention to threat-signaling emotions. These findings reveal that threat tunes neural processing in fast, selective, yet attention-independent fashion in sensory and motor systems, for different adaptive purposes.

DOI:http://dx.doi.org/10.7554/eLife.10274.001

Facial expressions can communicate important social signals, and understanding these signals can be essential for surviving threatening situations. Past studies have identified changes to brain activity and behavior in response to particular social threats, but it is not clear how the brain processes information from the facial expressions of others to identify these threats. Here, El Zein, Wyart and Grèzes aimed to identify how signals of threat are represented in the human brain.

The experiment used a technique called electroencephalography to record brain activity in healthy human volunteers as they examined angry and fearful facial expressions. El Zein, Wyart and Grèzes found that emotions that signaled a threat to the observer are better represented in particular regions of the brain – including those that control action – within a fraction of a second after the facial expression was shown to the volunteer. Moreover, the response of the brain regions that control action was greater in volunteers with higher levels of anxiety, which highlights the role of anxiety in reacting rapidly to social threats in the environment.

El Zein, Wyart and Grèzes’ findings show that social threats can alter brain activity very rapidly, and in a more selective manner than previously believed. A future challenge is to find out whether other aspects in threatening environments can stimulate similar increases in brain activity.

DOI:http://dx.doi.org/10.7554/eLife.10274.002

Social Vision: Functional Forecasting and the Integration of Compound Social Cues

For decades the study of social perception was largely compartmentalized by type of social cue: race, gender, emotion, eye gaze, body language, facial expression etc. This was partly due to good scientific practice (e.g., controlling for extraneous variability), and partly due to assumptions that each type of social cue was functionally distinct from others. Herein, we present a functional forecast approach to understanding compound social cue processing that emphasizes the importance of shared social affordances across various cues (see too Adams, Franklin, Nelson, & Stevenson, 2010; Adams & Nelson, 2011; Weisbuch & Adams, 2012). We review the traditional theories of emotion and face processing that argued for dissociable and noninteracting pathways (e.g., for specific emotional expressions, gaze, identity cues), as well as more recent evidence for combinatorial processing of social cues. We argue here that early, and presumably reflexive, visual integration of such cues is necessary for adaptive behavioral responding to others. In support of this claim, we review contemporary work that reveals a flexible visual system, one that readily incorporates meaningful contextual influences in even nonsocial visual processing, thereby establishing the functional and neuroanatomical bases necessary for compound social cue integration. Finally, we explicate three likely mechanisms driving such integration. Together, this work implicates a role for cognitive penetrability in visual perceptual abilities that have often been (and in some cases still are) ascribed to direct encapsulated perceptual processes.

Selective attention effects on early integration of social signals: same timing, modulated neural sources

Humans combine co-emitted social signals to predict other's immediate intentions and prepare an adapted response. However, little is known about whether attending to only one of co-emitted social signals impacts on its combination with other signals. Here, using electroencephalography, we address selective attention effects on early combination of social signals. We manipulated three visual cues: gaze direction, emotional expression, and pointing gesture, while participants performed either emotion or gaze direction judgments. Results showed that a temporal marker of social cues integration emerges 170ms after the stimulus onset, even if the integration of the three visual cues was not required to perform the task, as only one feature at a time was task relevant. Yet in addition to common temporal regions, the relative contribution of specific neural sources of this integration changed as a function of the attended feature: integration during emotion judgments was mainly implemented in classic limbic areas but in the dorsal pathway during gaze direction judgments. Together, these findings demonstrate that co-emitted social cues are integrated as long as they are relevant to the observer, even when they are irrelevant to the ongoing task.

Structural and functional brain changes beyond visual system in patients with advanced glaucoma

In order to test the hypothesis that in primary open angle glaucoma (POAG), an important cause of irreversible blindness, a spreading of neurodegeneration occurs through the brain, we performed multimodal MRI and subsequent whole-brain explorative voxelwise analyses in 13 advanced POAG patients and 12 age-matched normal controls (NC). Altered integrity (decreased fractional anisotropy or increased diffusivities) of white matter (WM) tracts was found not only along the visual pathway of POAG but also in nonvisual WM tracts (superior longitudinal fascicle, anterior thalamic radiation, corticospinal tract, middle cerebellar peduncle). POAG patients also showed brain atrophy in both visual cortex and other distant grey matter (GM) regions (frontoparietal cortex, hippocampi and cerebellar cortex), decreased functional connectivity (FC) in visual, working memory and dorsal attention networks and increased FC in visual and executive networks. In POAG, abnormalities in structure and FC within and outside visual system correlated with visual field parameters in the poorer performing eyes, thus emphasizing their clinical relevance. Altogether, this represents evidence that a vision disorder such as POAG can be considered a widespread neurodegenerative condition.

The developmental disruptions of serotonin signaling may involved in autism during early brain development

Autism is a developmental disorder defined by the presence of a triad of communication, social and stereo typical behavioral characteristics with onset before 3years of age. In spite of the fact that there are potential environmental factors for autistic behavior, the dysfunction of serotonin during early development of the brain could be playing a role in this prevalence rise. Serotonin can modulate a number of developmental events, including cell division, neuronal migration, cell differentiation and synaptogenesis. Hyperserotonemia during fetal development results in the loss of serotonin terminals through negative feedback. The increased serotonin causes a decrease of oxytocin in the paraventricular nucleus of the hypothalamus and an increase in calcitonin gene-related peptide (CGRP) in the central nucleus of the amygdale, which are associated with social interactions and vital in autism. However, hyposerotonemia may be also relevant to the development of sensory as well as motor and cognitive faculties. And the paucity of placenta-derived serotonin should have potential importance when the pathogenesis of autism is considered. This review briefly summarized the developmental disruptions of serotonin signaling involved in the pathogenesis of autism during early development of the brain.

If it bleeds, it leads: separating threat from mere negativity

Most theories of emotion hold that negative stimuli are threatening and aversive. Yet in everyday experiences some negative sights (e.g. car wrecks) attract curiosity, whereas others repel (e.g. a weapon pointed in our face). To examine the diversity in negative stimuli, we employed four classes of visual images (Direct Threat, Indirect Threat, Merely Negative and Neutral) in a set of behavioral and functional magnetic resonance imaging studies. Participants reliably discriminated between the images, evaluating Direct Threat stimuli most quickly, and Merely Negative images most slowly. Threat images evoked greater and earlier blood oxygen level-dependent (BOLD) activations in the amygdala and periaqueductal gray, structures implicated in representing and responding to the motivational salience of stimuli. Conversely, the Merely Negative images evoked larger BOLD signal in the parahippocampal, retrosplenial, and medial prefrontal cortices, regions which have been implicated in contextual association processing. Ventrolateral as well as medial and lateral orbitofrontal cortices were activated by both threatening and Merely Negative images. In conclusion, negative visual stimuli can repel or attract scrutiny depending on their current threat potential, which is assessed by dynamic shifts in large-scale brain network activity.

Perception of social cues of danger in autism spectrum disorders

Intuitive grasping of the meaning of subtle social cues is particularly affected in autism spectrum disorders (ASD). Despite their relevance in social communication, the effect of averted gaze in fearful faces in conveying a signal of environmental threat has not been investigated using real face stimuli in adults with ASD. Here, using functional MRI, we show that briefly presented fearful faces with averted gaze, previously shown to be a strong communicative signal of environmental danger, produce different patterns of brain activation than fearful faces with direct gaze in a group of 26 normally intelligent adults with ASD compared with 26 matched controls. While implicit cue of threat produces brain activation in attention, emotion processing and mental state attribution networks in controls, this effect is absent in individuals with ASD. Instead, individuals with ASD show activation in the subcortical face-processing system in response to direct eye contact. An effect of differences in looking behavior was excluded in a separate eye tracking experiment. Our data suggest that individuals with ASD are more sensitive to direct eye contact than to social signals of danger conveyed by averted fearful gaze.

MEG evidence for dynamic amygdala modulations by gaze and facial emotions

BACKGROUND

Amygdala is a key brain region for face perception. While the role of amygdala in the perception of facial emotion and gaze has been extensively highlighted with fMRI, the unfolding in time of amydgala responses to emotional versus neutral faces with different gaze directions is scarcely known.

METHODOLOGY/PRINCIPAL FINDINGS

Here we addressed this question in healthy subjects using MEG combined with an original source imaging method based on individual amygdala volume segmentation and the localization of sources in the amygdala volume. We found an early peak of amygdala activity that was enhanced for fearful relative to neutral faces between 130 and 170 ms. The effect of emotion was again significant in a later time range (310-350 ms). Moreover, the amygdala response was greater for direct relative averted gaze between 190 and 350 ms, and this effect was selective of fearful faces in the right amygdala.

CONCLUSION

Altogether, our results show that the amygdala is involved in the processing and integration of emotion and gaze cues from faces in different time ranges, thus underlining its role in multiple stages of face perception.

Amygdala activation for eye contact despite complete cortical blindness

Cortical blindness refers to the loss of vision that occurs after destruction of the primary visual cortex. Although there is no sensory cortex and hence no conscious vision, some cortically blind patients show amygdala activation in response to facial or bodily expressions of emotion. Here we investigated whether direction of gaze could also be processed in the absence of any functional visual cortex. A well-known patient with bilateral destruction of his visual cortex and subsequent cortical blindness was investigated in an fMRI paradigm during which blocks of faces were presented either with their gaze directed toward or away from the viewer. Increased right amygdala activation was found in response to directed compared with averted gaze. Activity in this region was further found to be functionally connected to a larger network associated with face and gaze processing. The present study demonstrates that, in human subjects, the amygdala response to eye contact does not require an intact primary visual cortex.

Effects of gaze direction, head orientation and valence of facial expression on amygdala activity

There is increasing evidence for a role of the amygdala in processing gaze direction and emotional relevance of faces. In this event-related functional magnetic resonance study we investigated amygdala responses while we orthogonally manipulated head direction, gaze direction and facial expression (angry, happy and neutral). This allowed us to investigate effects of stimulus ambiguity, low-level factors and non-emotional factors on amygdala activation. Averted vs direct gaze induced increased activation in the right dorsal amygdala regardless of facial expression and head orientation. Furthermore, valence effects were found in the ventral amygdala and strongly dependent on head orientation. We observed enhanced activation to angry and neutral vs happy faces for observer-directed faces in the left ventral amygdala while the averted head condition reversed this pattern resulting in increased activation to happy as compared to angry and neutral faces. These results suggest that gaze direction drives specifically dorsal amygdala activation regardless of facial expression, low-level perceptual factors or stimulus ambiguity. The role of the amygdala is thus not restricted to the detection of potential threat, but has a more general role in attention processes. Furthermore, valence effects are associated with activation of the ventral amygdala and strongly influenced by non-emotional factors.

Why don't men understand women? Altered neural networks for reading the language of male and female eyes

Men are traditionally thought to have more problems in understanding women compared to understanding other men, though evidence supporting this assumption remains sparse. Recently, it has been shown, however, that meńs problems in recognizing women’s emotions could be linked to difficulties in extracting the relevant information from the eye region, which remain one of the richest sources of social information for the attribution of mental states to others. To determine possible differences in the neural correlates underlying emotion recognition from female, as compared to male eyes, a modified version of the Reading the Mind in the Eyes Test in combination with functional magnetic resonance imaging (fMRI) was applied to a sample of 22 participants. We found that men actually had twice as many problems in recognizing emotions from female as compared to male eyes, and that these problems were particularly associated with a lack of activation in limbic regions of the brain (including the hippocampus and the rostral anterior cingulate cortex). Moreover, men revealed heightened activation of the right amygdala to male stimuli regardless of condition (sex vs. emotion recognition). Thus, our findings highlight the function of the amygdala in the affective component of theory of mind (ToM) and in empathy, and provide further evidence that men are substantially less able to infer mental states expressed by women, which may be accompanied by sex-specific differences in amygdala activity.

Faces in context: a review and systematization of contextual influences on affective face processing

Facial expressions are of eminent importance for social interaction as they convey information about other individuals’ emotions and social intentions. According to the predominant “basic emotion” approach, the perception of emotion in faces is based on the rapid, automatic categorization of prototypical, universal expressions. Consequently, the perception of facial expressions has typically been investigated using isolated, de-contextualized, static pictures of facial expressions that maximize the distinction between categories. However, in everyday life, an individual’s face is not perceived in isolation, but almost always appears within a situational context, which may arise from other people, the physical environment surrounding the face, as well as multichannel information from the sender. Furthermore, situational context may be provided by the perceiver, including already present social information gained from affective learning and implicit processing biases such as race bias. Thus, the perception of facial expressions is presumably always influenced by contextual variables. In this comprehensive review, we aim at (1) systematizing the contextual variables that may influence the perception of facial expressions and (2) summarizing experimental paradigms and findings that have been used to investigate these influences. The studies reviewed here demonstrate that perception and neural processing of facial expressions are substantially modified by contextual information, including verbal, visual, and auditory information presented together with the face as well as knowledge or processing biases already present in the observer. These findings further challenge the assumption of automatic, hardwired categorical emotion extraction mechanisms predicted by basic emotion theories. Taking into account a recent model on face processing, we discuss where and when these different contextual influences may take place, thus outlining potential avenues in future research.

The social-sensory interface: category interactions in person perception

Research is increasingly challenging the claim that distinct sources of social information-such as sex, race, and emotion-are processed in discrete fashion. Instead, there appear to be functionally relevant interactions that occur. In the present article, we describe research examining how cues conveyed by the human face, voice, and body interact to form the unified representations that guide our perceptions of and responses to other people. We explain how these information sources are often thrown into interaction through bottom-up forces (e.g., phenotypic cues) as well as top-down forces (e.g., stereotypes and prior knowledge). Such interactions point to a person perception process that is driven by an intimate interface between bottom-up perceptual and top-down social processes. Incorporating data from neuroimaging, event-related potentials (ERP), computational modeling, computer mouse-tracking, and other behavioral measures, we discuss the structure of this interface, and we consider its implications and adaptive purposes. We argue that an increased understanding of person perception will likely require a synthesis of insights and techniques, from social psychology to the cognitive, neural, and vision sciences.

Effect of direct eye contact in PTSD related to interpersonal trauma: an fMRI study of activation of an innate alarm system

In healthy individuals, direct eye contact initially leads to activation of a fast subcortical pathway, which then modulates a cortical route eliciting social cognitive processes. The aim of this study was to gain insight into the neurobiological effects of direct eye-to-eye contact using a virtual reality paradigm in individuals with posttraumatic stress disorder (PTSD) related to prolonged childhood abuse. We examined 16 healthy comparison subjects and 16 patients with a primary diagnosis of PTSD using a virtual reality functional magnetic resonance imaging paradigm involving direct vs averted gaze (happy, sad, neutral) as developed by Schrammel et al. in 2009. Irrespective of the displayed emotion, controls exhibited an increased blood oxygenation level-dependent response during direct vs averted gaze within the dorsomedial prefrontal cortex, left temporoparietal junction and right temporal pole. Under the same conditions, individuals with PTSD showed increased activation within the superior colliculus (SC)/periaqueductal gray (PAG) and locus coeruleus. Our findings suggest that healthy controls react to the exposure of direct gaze with an activation of a cortical route that enhances evaluative 'top-down' processes underlying social interactions. In individuals with PTSD, however, direct gaze leads to sustained activation of a subcortical route of eye-contact processing, an innate alarm system involving the SC and the underlying circuits of the PAG.

Selectivity and persistent firing responses to social vocalizations in the basolateral amygdala

This study examined responsiveness to acoustic stimuli among neurons of the basolateral amygdala. While recording from single neurons in awake mustached bats (Pteronotus parnellii), we presented a wide range of acoustic stimuli including tonal, noise, and vocal signals. While many neurons displayed phasic or sustained responses locked to effective auditory stimuli, the majority of neurons (n=58) displayed a persistent excitatory discharge that lasted well beyond stimulus duration and filled the interval between successive stimuli. Persistent firing usually began seconds (median value, 5.4 s) after the initiation of a train of repeated stimuli and lasted, in the majority of neurons, for at least 2 min after the end of the stimulus train. Auditory-responsive amygdalar neurons were generally excited by one stimulus or very few stimuli. Most neurons did not respond well to synthetic stimuli including tones, noise bursts or frequency-modulated sweeps, but instead responded only to vocal stimuli (82 of 87 neurons). Furthermore, most neurons were highly selective among vocal stimuli. On average, neurons responded to 1.7 of 15 different syllables or syllable sequences. The largest percentage of neurons responded to a hiss-like rectangular broadband noise burst (rBNB) call associated with aggressive interactions. Responsiveness to effective vocal stimuli was reduced or eliminated when the spectrotemporal features of the stimuli were altered in a subset of neurons. Chemical activation of the medial geniculate body (MG) increased both background and evoked firing. Among 39 histologically localized recording sites, we saw no evidence of topographic organization in terms of temporal response pattern, habituation, or the affect of calls to which neurons responded. Overall, these studies demonstrate that amygdalar neurons in the mustached bat show high selectivity to vocal stimuli, and suggest that persistent firing may be an important feature of amygdalar responses to social vocalizations.

Eye contact with neutral and smiling faces: effects on autonomic responses and frontal EEG asymmetry

In our previous studies we have shown that seeing another person “live” with a direct vs. averted gaze results in enhanced skin conductance responses (SCRs) indicating autonomic arousal and in greater relative left-sided frontal activity in the electroencephalography (asymmetry in the alpha-band power), associated with approach motivation. In our studies, however, the stimulus persons had a neutral expression. In real-life social interaction, eye contact is often associated with a smile, which is another signal of the sender's approach-related motivation. A smile could, therefore, enhance the affective-motivational responses to eye contact. In the present study, we investigated whether the facial expression (neutral vs. social smile) would modulate autonomic arousal and frontal EEG alpha-band asymmetry to seeing a direct vs. an averted gaze in faces presented “live” through a liquid crystal (LC) shutter. The results showed that the SCRs were greater for the direct than the averted gaze and that the effect of gaze direction was more pronounced for a smiling than a neutral face. However, in this study, gaze direction and facial expression did not affect the frontal EEG asymmetry, although, for gaze direction, we found a marginally significant correlation between the degree of an overall bias for asymmetric frontal activity and the degree to which direct gaze elicited stronger left-sided frontal activity than did averted gaze.

Neurocognitive mechanisms of gaze-expression interactions in face processing and social attention

The face conveys a rich source of non-verbal information used during social communication. While research has revealed how specific facial channels such as emotional expression are processed, little is known about the prioritization and integration of multiple cues in the face during dyadic exchanges. Classic models of face perception have emphasized the segregation of dynamic vs. static facial features along independent information processing pathways. Here we review recent behavioral and neuroscientific evidence suggesting that within the dynamic stream, concurrent changes in eye gaze and emotional expression can yield early independent effects on face judgments and covert shifts of visuospatial attention. These effects are partially segregated within initial visual afferent processing volleys, but are subsequently integrated in limbic regions such as the amygdala or via reentrant visual processing volleys. This spatiotemporal pattern may help to resolve otherwise perplexing discrepancies across behavioral studies of emotional influences on gaze-directed attentional cueing. Theoretical explanations of gaze-expression interactions are discussed, with special consideration of speed-of-processing (discriminability) and contextual (ambiguity) accounts. Future research in this area promises to reveal the mental chronometry of face processing and interpersonal attention, with implications for understanding how social referencing develops in infancy and is impaired in autism and other disorders of social cognition.

A 7 tesla FMRI study of amygdala responses to fearful faces

The amygdalae are involved in the perception of emotions such as happiness, anger and fear. Because of their proximity to the sinuses, the image signal intensity in T2* weighted fMRI data is often affected by signal loss due to through-slice dephasing, especially at high field strength. In this study, the feasibility of fMRI in the amygdalae at 7 Tesla was investigated. A paradigm based on the presentation of fearful faces was used for stimulation. Previously, opposite effects have been found for presentation of averted and direct gaze fearful faces. Here, we show that (1) sufficiently high temporal SNR values are reached in the amygdalae for detection of small BOLD signal changes and (2) that the BOLD signal in the amygdalae for presentation of a direct or averted gaze in a fearful face depends on stimulus duration.