Processing social aspects of human gaze: A combined fMRI-DTI study

Inhibitory TMS over Visual Area V5/MT Disrupts Visual Speech Recognition

During face-to-face communication, the perception and recognition of facial movements can facilitate individuals' understanding of what is said. Facial movements are a form of complex biological motion. Separate neural pathways are thought to processing (1) simple, nonbiological motion with an obligatory waypoint in the motion-sensitive visual middle temporal area (V5/MT); and (2) complex biological motion. Here, we present findings that challenge this dichotomy. Neuronavigated offline transcranial magnetic stimulation (TMS) over V5/MT on 24 participants (17 females and 7 males) led to increased response times in the recognition of simple, nonbiological motion as well as visual speech recognition compared with TMS over the vertex, an active control region. TMS of area V5/MT also reduced practice effects on response times, that are typically observed in both visual speech and motion recognition tasks over time. Our findings provide the first indication that area V5/MT causally influences the recognition of visual speech.SIGNIFICANCE STATEMENT In everyday face-to-face communication, speech comprehension is often facilitated by viewing a speaker's facial movements. Several brain areas contribute to the recognition of visual speech. One area of interest is the motion-sensitive visual medial temporal area (V5/MT), which has been associated with the perception of simple, nonbiological motion such as moving dots, as well as more complex, biological motion such as visual speech. Here, we demonstrate using noninvasive brain stimulation that area V5/MT is causally relevant in recognizing visual speech. This finding provides new insights into the neural mechanisms that support the perception of human communication signals, which will help guide future research in typically developed individuals and populations with communication difficulties.

Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli

Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.

Two-in-one system and behavior-specific brain synchrony during goal-free cooperative creation: an analytical approach combining automated behavioral classification and the event-related generalized linear model

SIGNIFICANCE

In hyperscanning studies of natural social interactions, behavioral coding is usually necessary to extract brain synchronizations specific to a particular behavior. The more natural the task is, the heavier the coding effort is. We propose an analytical approach to resolve this dilemma, providing insights and avenues for future work in interactive social neuroscience.

AIM

The objective is to solve the laborious coding problem for naturalistic hyperscanning by proposing a convenient analytical approach and to uncover brain synchronization mechanisms related to human cooperative behavior when the ultimate goal is highly free and creative.

APPROACH

This functional near-infrared spectroscopy hyperscanning study challenged a cooperative goal-free creative game in which dyads can communicate freely without time constraints and developed an analytical approach that combines automated behavior classification (computer vision) with a generalized linear model (GLM) in an event-related manner. Thirty-nine dyads participated in this study.

RESULTS

Conventional wavelet-transformed coherence (WTC) analysis showed that joint play induced robust between-brain synchronization (BBS) among the hub-like superior and middle temporal regions and the frontopolar and dorsomedial/dorsolateral prefrontal cortex (PFC) in the right hemisphere, in contrast to sparse within-brain synchronization (WBS). Contrarily, similar regions within a single brain showed strong WBS with similar connection patterns during independent play. These findings indicate a two-in-one system for performing creative problem-solving tasks. Further, WTC-GLM analysis combined with computer vision successfully extracted BBS, which was specific to the events when one of the participants raised his/her face to the other. This brain-to-brain synchrony between the right dorsolateral PFC and the right temporo-parietal junction suggests joint functioning of these areas when mentalization is necessary under situations with restricted social signals.

CONCLUSIONS

Our proposed analytical approach combining computer vision and WTC-GLM can be applied to extract inter-brain synchrony associated with social behaviors of interest.

Differences in the neural networks of thermal sensation with and without evaluation process

Several neuroimaging studies have analyzed the neural networks involved in thermal sensation. In some of these studies, participants were instructed to evaluate and report the thermal sensation using a point scale, visual analog scale, or other psychophysical rating tool while the imaging data were obtained. Therefore, the imaging data may reflect signals involved in the processes of both sensation and evaluation. The present study aimed to discriminate the neural networks involved in identifying different temperature stimuli and the two different processes by using functional magnetic resonance imaging (fMRI). We applied four different thermal stimuli (“hot,” 40C; “warm,” 36 °C, “cool,” 27 °C; and “cold,” 22 °C) to the left forearm using Peltier apparatus. During the stimuli, participants were instructed to either evaluate (evaluation task) or not evaluate (no-evaluation task) and report the thermal sensation. We found brain activation in the medial prefrontal cortex/anterior cingulate gyrus, inferior frontal gyrus, bilateral insula, and posterior parietal cortex during the four thermal stimuli both with and without the evaluation task. Additionally, the stimuli with the evaluation task induced stronger and broader activation, including the right fronto-parietal and anterior insula regions. These results indicate that thermal stimulation activates the common neural networks, independent of the thermal conditions and evaluation process. Moreover, the evaluation process may increase the attention to the thermal stimuli, resulting in the activation of the right lateralized ventral attentional network.

•

Neural networks involved in thermal sensation were assessed by functional MRI.

•

Warm or cold stimulation was applied to the left forearm.

•

The stimulation was conducted with or without the evaluation of the sensation.

•

Greater activation of a right-lateralized attention network was induced by the evaluation process.

•

A common neural network was found, which was activated by both warm and cold stimuli.

Neural Basis of Impaired Emotion Recognition in Adult Attention-Deficit/Hyperactivity Disorder

BACKGROUND

Deficits in emotion recognition have been repeatedly documented in patients diagnosed with attention-deficit/hyperactivity disorder (ADHD), but their neural basis is unknown so far.

METHODS

In the current study, adult patients with ADHD (n = 44) and healthy control subjects (n = 43) underwent functional magnetic resonance imaging during explicit emotion recognition of stimuli expressing affective information in face, voice, or face-voice combinations. The employed experimental paradigm allowed us to delineate areas for processing audiovisual information based on their functional activation profile, including the bilateral posterior superior temporal gyrus/middle temporal gyrus, amygdala, medial prefrontal cortex, and precuneus, as well as the right posterior thalamus.

RESULTS

As expected, unbiased hit rates for correct classification of the expressed emotions were lower in patients with ADHD than in healthy control subjects irrespective of the presented sensory modality. This deficit at a behavioral level was accompanied by lower activation in patients with ADHD versus healthy control subjects in the cortex adjacent to the right superior temporal gyrus/middle temporal gyrus and the right posterior thalamus, which represent key areas for processing socially relevant signals and their integration across modalities. A cortical region adjacent to the right posterior superior temporal gyrus was the only brain region that showed a significant correlation between brain activation and emotion identification performance.

CONCLUSIONS

Altogether, these results provide the first evidence for a potential neural substrate of the observed impairments in emotion recognition in adults with ADHD.

Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects

Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.

A methodological scoping review of the integration of fMRI to guide dMRI tractography. What has been done and what can be improved: A 20-year perspective

Combining MRI modalities is a growing trend in neurosciences. It provides opportunities to investigate the brain architecture supporting cognitive functions. Integrating fMRI activation to guide dMRI tractography offers potential advantages over standard tractography methods. A quick glimpse of the literature on this topic reveals that this technique is challenging, and no consensus or "best practices" currently exist, at least not within a single document. We present the first attempt to systematically analyze and summarize the literature of 80 studies that integrated task-based fMRI results to guide tractography, over the last two decades. We report 19 findings that cover challenges related to sample size, microstructure modelling, seeding methods, multimodal space registration, false negatives/positives, specificity/validity, gray/white matter interface and more. These findings will help the scientific community (1) understand the strengths and limitations of the approaches, (2) design studies using this integrative framework, and (3) motivate researchers to fill the gaps identified. We provide references toward best practices, in order to improve the overall result's replicability, sensitivity, specificity, and validity.

Fear-specific leftward bias in gaze direction judgment

Previous studies have shown that humans have a left spatial attention bias in cognition and behaviour. However, whether there exists a leftward perception bias of gaze direction has not been investigated. To address this gap, we conducted three behavioural experiments using a forced-choice gaze direction judgment task. The point of subjective equality (PSE) was employed to measure whether there was a leftward perception bias of gaze direction, and if there was, whether this bias was modulated by face emotion. The results of experiment 1 showed that the PSE of fearful faces was significantly positive as compared to zero and this effect was not found in angry, happy, and neutral faces, indicating that participants were more likely to judge the gaze direction of fearful faces as directed to their left-side space, namely a leftward perception bias. With the response keys counterbalanced between participants, experiment 2a replicated the findings in experiment 1. To further investigate whether the gaze direction perception variation was contributed by emotional or low-level features of faces, experiment 2b and 3 used inverted faces and inverted eyes, respectively. The results revealed similar leftward perception biases of gaze direction in all types of faces, indicating that gaze direction perception was biased by emotional information in faces rather than low-level facial features. Overall, our study demonstrates that there a fear-specific leftward perception bias in processing gaze direction. These findings shed new light on the cerebral lateralization in humans.

Visual Information Routes in the Posterior Dorsal and Ventral Face Network Studied with Intracranial Neurophysiology and White Matter Tract Endpoints

Occipitotemporal regions within the face network process perceptual and socioemotional information, but the dynamics and information flow between different nodes of this network are still debated. Here, we analyzed intracerebral EEG from 11 epileptic patients viewing a stimulus sequence beginning with a neutral face with direct gaze. The gaze could avert or remain direct, while the emotion changed to fearful or happy. N200 field potential peak latencies indicated that face processing begins in inferior occipital cortex and proceeds anteroventrally to fusiform and inferior temporal cortices, in parallel. The superior temporal sulcus responded preferentially to gaze changes with augmented field potential amplitudes for averted versus direct gaze, and large effect sizes relative to other network regions. An overlap analysis of posterior white matter tractography endpoints (from 1066 healthy brains) relative to active intracerebral electrodes in the 11 patients showed likely involvement of both dorsal and ventral posterior white matter pathways. Overall, our data provide new insight into the timing of face and social cue processing in the occipitotemporal brain and anchor the superior temporal cortex in dynamic gaze processing.

Perceptual difficulty modulates the direction of information flow in familiar face recognition

Humans are fast and accurate when they recognize familiar faces. Previous neurophysiological studies have shown enhanced representations for the dichotomy of familiar vs. unfamiliar faces. As familiarity is a spectrum, however, any neural correlate should reflect graded representations for more vs. less familiar faces along the spectrum. By systematically varying familiarity across stimuli, we show a neural familiarity spectrum using electroencephalography. We then evaluated the spatiotemporal dynamics of familiar face recognition across the brain. Specifically, we developed a novel informational connectivity method to test whether peri-frontal brain areas contribute to familiar face recognition. Results showed that feed-forward flow dominates for the most familiar faces and top-down flow was only dominant when sensory evidence was insufficient to support face recognition. These results demonstrate that perceptual difficulty and the level of familiarity influence the neural representation of familiar faces and the degree to which peri-frontal neural networks contribute to familiar face recognition.

Nature and nurture shape structural connectivity in the face processing brain network

Face processing is a key ability facilitating social cognition. Only a few studies explored how nature and nurture shape face processing ontogeny at the behavioral and neural level. Also, very little is known about the contributions of nature and nurture to the establishment of white matter fibers supporting this specific human ability. The main purpose of this study was to assess genetic and environmental influences on white matter bundles connecting atlas-defined and functionally-defined face-responsive areas in the brain. Diffusion weighted images from 408 twins (monozygotic = 264, dizygotic = 144) were obtained from the WU-Minn Human Connectome Project. Fractional anisotropy - a widely used measure of fiber quality - of seven white matter tracts in the face network and ten global white matter tracts was analyzed by means of Structural Equation Modeling for twin data. Results revealed small and moderate genetic effects on face network fiber quality in addition to their shared variance with global brain white matter integrity. Furthermore, a theoretically expected common latent factor accounted for limited genetic and larger environmental variance in multiple face network fibers. The findings suggest that both genetic and environmental factors explain individual differences in fiber quality within the face network, as compared with much larger genetic effects on global brain white matter quality. In addition to heritability, individual-specific environmental influences on the face processing brain network are large, a finding that suggests to connect nature and nurture views on this remarkably specific human ability.

Examining the effect of online advertisement cues on human responses using eye-tracking, EEG, and MRI

This study sought to emphasize how disciplines such as neuroscience and marketing can be applied in advertising and consumer behavior. The application of neuroscience methods in analyzing and understanding human behavior related to the Elaboration Likelihood Model (ELM) and brain activity has recently garnered attention. This study examines brain processes while participants attempted to elicit preferences for a product, and demonstrates factors that influence consumer behavior using eye-tracking, electroencephalography (EEG), and magnetic resonance imaging (MRI) from a neuroscience approach. We planned two conditions of online advertising, namely, peripheral cues without argument and central cues with argument strength. Thirty respondents participated in the experiment, consisting of eye-tracking, EEG, and MRI instruments to explore brain activity in central cue conditions. We investigated whether diffusion tensor imaging (DTI) analysis could detect regional brain changes. Using eye-tracking, we found that the responses were mainly in the mean fixation duration, number of fixations, mean saccade duration, and number of saccade durations for the central cue condition. Moreover, the findings show that the fusiform gyrus and frontal cortex are significantly associated with building a relationship by inferring central cues in the EEG assay. The MRI images show that the fusiform gyrus and frontal cortex are significantly active in the central cue condition. DTI analysis indicates that the corpus callosum has changed in the central cue condition. We used eye-tracking, EEG, MRI, and DTI to understand that these connections may apprehend responses when viewing advertisements, especially in the fusiform gyrus, frontal cortex, and corpus callosum.

Brain mechanisms of eye contact during verbal communication predict autistic traits in neurotypical individuals

Atypical eye contact in communication is a common characteristic in autism spectrum disorders. Autistic traits vary along a continuum extending into the neurotypical population. The relation between autistic traits and brain mechanisms underlying spontaneous eye contact during verbal communication remains unexplored. Here, we used simultaneous functional magnetic resonance imaging and eye tracking to investigate this relation in neurotypical people within a naturalistic verbal context. Using multiple regression analyses, we found that brain response in the posterior superior temporal sulcus (pSTS) and its connectivity with the fusiform face area (FFA) during eye contact with a speaker predicted the level of autistic traits measured by Autism-spectrum Quotient (AQ). Further analyses for different AQ subclusters revealed that these two predictors were negatively associated with attention to detail. The relation between FFA–pSTS connectivity and the attention to detail ability was mediated by individuals’ looking preferences for speaker’s eyes. This study identified the role of an individual eye contact pattern in the relation between brain mechanisms underlying natural eye contact during verbal communication and autistic traits in neurotypical people. The findings may help to increase our understanding of the mechanisms of atypical eye contact behavior during natural communication.

Functional Connectivity within and beyond the Face Network Is Related to Reduced Discrimination of Degraded Faces in Young and Older Adults

Degrading face stimuli reduces face discrimination in both young and older adults, but the brain correlates of this decline in performance are not fully understood. We used functional magnetic resonance imaging to examine the effects of degraded face stimuli on face and nonface brain networks and tested whether these changes would predict the linear declines seen in performance. We found decreased activity in the face network (FN) and a decrease in the similarity of functional connectivity (FC) in the FN across conditions as degradation increased but no effect of age. FC in whole-brain networks also changed with increasing degradation, including increasing FC between the visual network and cognitive control networks. Older adults showed reduced modulation of this whole-brain FC pattern. The strongest predictors of within-participant decline in accuracy were changes in whole-brain network FC and FC similarity of the FN. There was no influence of age on these brain-behavior relations. These results suggest that a systems-level approach beyond the FN is required to understand the brain correlates of performance decline when faces are obscured with noise. In addition, the association between brain and behavior changes was maintained into older age, despite the dampened FC response to face degradation seen in older adults.

Brain Networks Processing Temporal Information in Dynamic Facial Expressions

This fMRI study examines the role of local and global motion information in facial movements during exposure to novel dynamic face stimuli. We found that synchronous expressions distinctively engaged medial prefrontal areas in the rostral and caudal sectors of anterior cingulate cortex (r/cACC) extending to inferior supplementary motor areas, as well as motor cortex and bilateral superior frontal gyrus (global temporal-spatial processing). Asynchronous expressions in which one part of the face unfolded before the other activated more the right superior temporal sulcus (STS) and inferior frontal gyrus (local temporal-spatial processing). These differences in temporal dynamics had no effect on visual face-responsive areas. Dynamic causal modeling analysis further showed that processing of asynchronous expression features was associated with a differential information flow, centered on STS, which received direct input from occipital cortex and projected to the amygdala. Moreover, STS and amygdala displayed selective interactions with cACC where the integration of both local and global motion cues could take place. These results provide new evidence for a role of local and global temporal dynamics in emotional expressions, extracted in partly separate brain pathways. Importantly, we show that dynamic expressions with synchronous movement cues may distinctively engage brain areas responsible for motor execution of expressions.

Role of the right anterior insular cortex in joint attention-related identification with a partner

Understanding others as intentional agents is critical in social interactions. We perceive others' intentions through identification, a categorical judgment that others should work like oneself. The most primitive form of understanding others' intentions is joint attention (JA). During JA, an initiator selects a shared object through gaze (initiative joint attention, IJA), and the responder follows the direction of the initiator's gaze (reactive joint attention, RJA). Therefore, both participants share the intention of object selection. However, the neural underpinning of shared intention through JA remains unknown. In this study, we hypothesized that JA is represented by inter-individual neural synchronization of the intention-related activity. Additionally, JA requires eye contact that activates the limbic mirror system; therefore, we hypothesized that this system is involved in shared attention through JA. To test these hypotheses, participants underwent hyperscanning fMRI while performing JA tasks. We found that IJA-related activation of the right anterior insular cortex of participants was positively correlated with RJA-related activation of homologous regions in their partners. This area was activated by volitional selection of the target during IJA. Therefore, identification with others by JA is likely accomplished by the shared intentionality of target selection represented by inter-individual synchronization of the right anterior insular cortex.

Neural basis of interindividual variability in social perception in typically developing children and adolescents using diffusion tensor imaging

Humans show great interindividual variability in the degree they engage in social relationship. The neural basis of this variability is still poorly understood, particularly in children. In this study, we aimed to investigate the neural basis of interindividual variability in the first step of social behavior, that is social perception, in typically developing children. For that purpose, we first used eye-tracking to objectively measure eye-gaze processing during passive visualization of social movie clips in 24 children and adolescents (10.5 ± 2.9 y). Secondly, we correlated eye-tracking data with measures of fractional anisotropy, an index of white matter microstructure, obtained using diffusion tensor imaging MRI. The results showed a large interindividual variability in the number of fixations to the eyes of characters during visualization of social scenes. In addition, whole-brain analysis showed a significant positive correlation between FA and number of fixations to the eyes,mainly in the temporal part of the superior longitudinal fasciculi bilaterally, adjacent to the posterior superior temporal cortex. Our results indicate the existence of a neural signature associated with the interindividual variability in social perception in children, contributing for better understanding the neural basis of typical and atypical development of a broader social expertise.

Dorsal-movement and ventral-form regions are functionally connected during visual-speech recognition

Faces convey social information such as emotion and speech. Facial emotion processing is supported via interactions between dorsal-movement and ventral-form visual cortex regions. Here, we explored, for the first time, whether similar dorsal-ventral interactions (assessed via functional connectivity), might also exist for visual-speech processing. We then examined whether altered dorsal-ventral connectivity is observed in adults with high-functioning autism spectrum disorder (ASD), a disorder associated with impaired visual-speech recognition. We acquired functional magnetic resonance imaging (fMRI) data with concurrent eye tracking in pairwise matched control and ASD participants. In both groups, dorsal-movement regions in the visual motion area 5 (V5/MT) and the temporal visual speech area (TVSA) were functionally connected to ventral-form regions (i.e., the occipital face area [OFA] and the fusiform face area [FFA]) during the recognition of visual speech, in contrast to the recognition of face identity. Notably, parts of this functional connectivity were decreased in the ASD group compared to the controls (i.e., right V5/MT-right OFA, left TVSA-left FFA). The results confirmed our hypothesis that functional connectivity between dorsal-movement and ventral-form regions exists during visual-speech processing. Its partial dysfunction in ASD might contribute to difficulties in the recognition of dynamic face information relevant for successful face-to-face communication.

Looking beyond the face area: lesion network mapping of prosopagnosia

Damage to the right fusiform face area can disrupt the ability to recognize faces, a classic example of how damage to a specialized brain region can disrupt a specialized brain function. However, similar symptoms can arise from damage to other brain regions, and face recognition is now thought to depend on a distributed brain network. The extent of this network and which regions are critical for facial recognition remains unclear. Here, we derive this network empirically based on lesion locations causing clinically significant impairments in facial recognition. Cases of acquired prosopagnosia were identified through a systematic literature search and lesion locations were mapped to a common brain atlas. The network of brain regions connected to each lesion location was identified using resting state functional connectivity from healthy participants (n = 1000), a technique termed lesion network mapping. Lesion networks were overlapped to identify connections common to lesions causing prosopagnosia. Reproducibility was assessed using split-half replication. Specificity was assessed through comparison with non-specific control lesions (n = 135) and with control lesions associated with symptoms other than prosopagnosia (n = 155). Finally, we tested whether our facial recognition network derived from clinically evident cases of prosopagnosia could predict subclinical facial agnosia in an independent lesion cohort (n = 31). Our systematic literature search identified 44 lesions causing prosopagnosia, only 29 of which intersected the right fusiform face area. However, all 44 lesion locations fell within a single brain network defined by connectivity to the right fusiform face area. Less consistent connectivity was found to other face-selective regions. Surprisingly, all 44 lesion locations were also functionally connected, through negative correlation, with regions in the left frontal cortex. This connectivity pattern was highly reproducible and specific to lesions causing prosopagnosia. Positive connectivity to the right fusiform face area and negative connectivity to left frontal regions were independent predictors of prosopagnosia and predicted subclinical facial agnosia in an independent lesion cohort. We conclude that lesions causing prosopagnosia localize to a single functionally connected brain network defined by connectivity to the right fusiform face area and to left frontal regions. Implications of these findings for models of facial recognition deficits are discussed.

Are you laughing at me? Neural correlates of social intent attribution to auditory and visual laughter

Laughter is a multifaceted signal, which can convey social acceptance facilitating social bonding as well as social rejection inflicting social pain. In the current study, we addressed the neural correlates of social intent attribution to auditory or visual laughter within an fMRI study to identify brain areas showing linear increases of activation with social intent ratings. Negative social intent attributions were associated with activation increases within the medial prefrontal cortex/anterior cingulate cortex (mPFC/ACC). Interestingly, negative social intent attributions of auditory laughter were represented more rostral than visual laughter within this area. Our findings corroborate the role of the mPFC/ACC as key node for processing “social pain” with distinct modality‐specific subregions. Other brain areas that showed an increase of activation included bilateral inferior frontal gyrus and right superior/middle temporal gyrus (STG/MTG) for visually presented laughter and bilateral STG for auditory presented laughter with no overlap across modalities. Similarly, positive social intent attributions were linked to hemodynamic responses within the right inferior parietal lobe and right middle frontal gyrus, but there was no overlap of activity for visual and auditory laughter. Our findings demonstrate that social intent attribution to auditory and visual laughter is located in neighboring, but spatially distinct neural structures.

Properties of face localizer activations and their application in functional magnetic resonance imaging (fMRI) fingerprinting

Functional localizers are particularly prevalent in functional magnetic resonance imaging (fMRI) studies concerning face processing. In this study, we extend the knowledge on face localizers regarding four important aspects: First, activation differences in occipital and fusiform face areas (OFA/FFA) and amygdala are characterized by increased activation while precuneus and medial prefrontal cortex show decreased deactivation to faces versus control stimuli. The face-selective posterior superior temporal sulcus is a hybrid area exhibiting increased activation within its inferior and decreased deactivation within its superior part. Second, the employed control stimuli can impact on whether a region is classified in group analyses as face-selective or not. We specifically investigated this for recently described cytoarchitectonic subregions of the fusiform cortex (FG-2/FG-4). Averaged activity across voxels in FG-4 was stronger for faces than objects, houses, or landscapes. In FG-2, averaged activity was only significantly stronger in comparison with landscapes, but small peaks within this area were detected for comparison versus objects and houses. Third, reproducibility of individual peak activations is excellent for right FFA and quite good for right OFA, whereas within all other areas it was too low to provide valid information on time-invariant individual peaks. Finally, the fine-grained spatial activation patterns in right OFA and FFA are both time-invariant within each individual and sufficiently different between individuals to enable identification of individual participants with near-perfect precision (fMRI fingerprinting).

Attention to the face is characterised by a difficult to inhibit first fixation to the eyes

The eyes are preferentially attended over other facial features and recent evidence suggests this bias is difficult to suppress. To further examine the automatic and volitional nature of this bias for eye information, we used a novel prompting face recognition paradigm in 41 adults and measured the location of their first fixations, overall dwell time and behavioural responses. First, patterns of eye gaze were measured during a free-viewing forced choice face recognition paradigm. Second, the task was repeated but with prompts to look to either the eyes or the mouth. Participants showed significantly more first fixations to the eyes than mouth, both when prompted to look at the eyes and when prompted to look at the mouth. The pattern of looking to the eyes when prompted was indistinguishable from the unprompted condition in which participants were free to look where they chose. Notably, the dwell time data demonstrated that the eye bias did not persist over the entire presentation period. Our results suggest a difficult-to-inhibit bias to initially orient to the eyes, which is superseded by volitional, top-down control of eye gaze. Further, the amount of looking to the eyes is at a maximum level spontaneously and cannot be enhanced by explicit instructions.

Linking structural and effective brain connectivity: structurally informed Parametric Empirical Bayes (si-PEB)

Despite the potential for better understanding functional neuroanatomy, the complex relationship between neuroimaging measures of brain structure and function has confounded integrative, multimodal analyses of brain connectivity. This is particularly true for task-related effective connectivity, which describes the causal influences between neuronal populations. Here, we assess whether measures of structural connectivity may usefully inform estimates of effective connectivity in larger scale brain networks. To this end, we introduce an integrative approach, capitalising on two recent statistical advances: Parametric Empirical Bayes, which provides group-level estimates of effective connectivity, and Bayesian model reduction, which enables rapid comparison of competing models. Crucially, we show that structural priors derived from high angular resolution diffusion imaging on a dynamic causal model of a 12-region network-based on functional MRI data from the same subjects-substantially improve model evidence (posterior probability 1.00). This provides definitive evidence that structural and effective connectivity depend upon each other in mediating distributed, large-scale interactions in the brain. Furthermore, this work offers novel perspectives for understanding normal brain architecture and its disintegration in clinical conditions.

Structural and effective brain connectivity underlying biological motion detection

The perception of actions underwrites a wide range of socio-cognitive functions. Previous neuroimaging and lesion studies identified several components of the brain network for visual biological motion (BM) processing, but interactions among these components and their relationship to behavior remain little understood. Here, using a recently developed integrative analysis of structural and effective connectivity derived from high angular resolution diffusion imaging (HARDI) and functional magnetic resonance imaging (fMRI), we assess the cerebro-cerebellar network for processing of camouflaged point-light BM. Dynamic causal modeling (DCM) informed by probabilistic tractography indicates that the right superior temporal sulcus (STS) serves as an integrator within the temporal module. However, the STS does not appear to be a "gatekeeper" in the functional integration of the occipito-temporal and frontal regions: The fusiform gyrus (FFG) and middle temporal cortex (MTC) are also connected to the right inferior frontal gyrus (IFG) and insula, indicating multiple parallel pathways. BM-specific loops of effective connectivity are seen between the left lateral cerebellar lobule Crus I and right STS, as well as between the left Crus I and right insula. The prevalence of a structural pathway between the FFG and STS is associated with better BM detection. Moreover, a canonical variate analysis shows that the visual sensitivity to BM is best predicted by BM-specific effective connectivity from the FFG to STS and from the IFG, insula, and STS to the early visual cortex. Overall, the study characterizes the architecture of the cerebro-cerebellar network for BM processing and offers prospects for assessing the social brain.

Functional organization of face processing in the human superior temporal sulcus: a 7T high-resolution fMRI study

The superior temporal sulcus (STS) is a major component of the human face perception network, implicated in processing dynamic changeable aspects of faces. However, it remains unknown whether STS holds functionally segregated subdivisions for different categories of facial movements. We used high-resolution functional magnetic resonance imaging (fMRI) at 7T in 16 volunteers to compare STS activation with faces displaying angry or happy expressions, eye-gaze shifts and lip-speech movements. Combining univariate and multivariate analyses, we show a systematic topological organization within STS, with gaze-related activity predominating in the most posterior and superior sector, speech-related activity in the anterior sector and emotional expressions represented in the intermediate middle STS. Right STS appeared to hold a finer functional segregation between all four types of facial movements, and best discriminative abilities within the face-selective posterior STS (pSTS). Conversely, left STS showed greater overlap between conditions, with a lack of distinction between mouth movements associated to speech or happy expression and better discriminative abilities (for gaze and speech vs emotion conditions) outside pSTS. Differential sensitivity to upper (eye) or lower (mouth) facial features may contribute to, but does not appear to fully account for, these response patterns.

A Review on the Use of Wearable Functional Near-Infrared Spectroscopy in Naturalistic Environments. JAPANESE PSYCHOLOGICAL RESEARCH 2018;60:347-373. [PMID: 30643322 PMCID: PMC6329605 DOI: 10.1111/jpr.12206]

The development of novel miniaturized wireless and wearable functional Near-Infrared Spectroscopy (fNIRS) devices have paved the way to new functional brain imaging that can revolutionize the cognitive research fields. Over the past few decades, several studies have been conducted with conventional fNIRS systems that have demonstrated the suitability of this technology for a wide variety of populations and applications, to investigate both the healthy brain and the diseased brain. However, what makes wearable fNIRS even more appealing is its capability to allow measurements in everyday life scenarios that are not possible with other gold-standard neuroimaging modalities, such as functional Magnetic Resonance Imaging. This can have a huge impact on the way we explore the neural bases and mechanisms underpinning human brain functioning. The aim of this review is to provide an overview of studies conducted with wearable fNIRS in naturalistic settings in the field of cognitive neuroscience. In addition, we present the challenges associated with the use of wearable fNIRS in unrestrained contexts, discussing solutions that will allow accurate inference of functional brain activity. Finally, we provide an overview of the future perspectives in cognitive neuroscience that we believe would benefit the most by using wearable fNIRS.

Recognizing visual speech: Reduced responses in visual-movement regions, but not other speech regions in autism

Speech information inherent in face movements is important for understanding what is said in face-to-face communication. Individuals with autism spectrum disorders (ASD) have difficulties in extracting speech information from face movements, a process called visual-speech recognition. Currently, it is unknown what dysfunctional brain regions or networks underlie the visual-speech recognition deficit in ASD. We conducted a functional magnetic resonance imaging (fMRI) study with concurrent eye tracking to investigate visual-speech recognition in adults diagnosed with high-functioning autism and pairwise matched typically developed controls. Compared to the control group (n = 17), the ASD group (n = 17) showed decreased Blood Oxygenation Level Dependent (BOLD) response during visual-speech recognition in the right visual area 5 (V5/MT) and left temporal visual speech area (TVSA) - brain regions implicated in visual-movement perception. The right V5/MT showed positive correlation with visual-speech task performance in the ASD group, but not in the control group. Psychophysiological interaction analysis (PPI) revealed that functional connectivity between the left TVSA and the bilateral V5/MT and between the right V5/MT and the left IFG was lower in the ASD than in the control group. In contrast, responses in other speech-motor regions and their connectivity were on the neurotypical level. Reduced responses and network connectivity of the visual-movement regions in conjunction with intact speech-related mechanisms indicate that perceptual mechanisms might be at the core of the visual-speech recognition deficit in ASD. Communication deficits in ASD might at least partly stem from atypical sensory processing and not higher-order cognitive processing of socially relevant information.

Affective Eye Contact: An Integrative Review

In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.

Aberrant patterns of neural activity when perceiving emotion from biological motion in schizophrenia

Social perceptual deficits in schizophrenia are well established. Recent work suggests that the ability to extract social information from bodily cues is reduced in patients. However, little is known about the neurobiological mechanisms underlying this deficit. In the current study, 20 schizophrenia patients and 16 controls completed two tasks using point-light animations during fMRI: a basic biological motion task and an emotion in biological motion task. The basic biological motion task was used to localize activity in posterior superior temporal sulcus (pSTS), a critical region for biological motion perception. During the emotion in biological motion task, participants viewed brief videos depicting happiness, fear, anger, or neutral emotions and were asked to decide which emotion was portrayed. Activity in pSTS and amygdala was interrogated during this task. Results indicated that patients showed overall reduced activation compared to controls in pSTS and at a trend level in amygdala across emotions, despite similar task performance. Further, a functional connectivity analysis revealed that controls, but not patients, showed significant positive connectivity between pSTS and left frontal regions as well as bilateral angular gyrus during the emotion in biological motion task. These findings indicate that schizophrenia patients show aberrant neural activity and functional connectivity when extracting complex social information from simple motion stimuli, which may contribute to social perception deficits in this disorder.

•

Perception of social information from bodily cues is impaired in schizophrenia.

•

We examined neural correlates of perception of emotion from biological motion.

•

Activity in amygdala and posterior superior temporal sulcus was reduced in patients.

•

pSTS functional connectivity with frontal and parietal regions was reduced in patients.

•

Aberrant neural responses may contribute to social perceptual deficits in schizophrenia.

White matter pathways and social cognition

There is a growing consensus that social cognition and behavior emerge from interactions across distributed regions of the "social brain". Researchers have traditionally focused their attention on functional response properties of these gray matter networks and neglected the vital role of white matter connections in establishing such networks and their functions. In this article, we conduct a comprehensive review of prior research on structural connectivity in social neuroscience and highlight the importance of this literature in clarifying brain mechanisms of social cognition. We pay particular attention to three key social processes: face processing, embodied cognition, and theory of mind, and their respective underlying neural networks. To fully identify and characterize the anatomical architecture of these networks, we further implement probabilistic tractography on a large sample of diffusion-weighted imaging data. The combination of an in-depth literature review and the empirical investigation gives us an unprecedented, well-defined landscape of white matter pathways underlying major social brain networks. Finally, we discuss current problems in the field, outline suggestions for best practice in diffusion-imaging data collection and analysis, and offer new directions for future research.

The Original Social Network: White Matter and Social Cognition

Social neuroscience has traditionally focused on the functionality of gray matter regions, ignoring the critical role played by axonal fiber pathways in supporting complex social processes. In this paper, we argue that research on white matter is essential for understanding a range of topics in social neuroscience, such as face processing, theory of mind, empathy, and imitation, as well as clinical disorders defined by aberrant social behavior, such as prosopagnosia, autism, and schizophrenia. We provide practical advice on how best to carry out these studies, which ultimately will substantially deepen our understanding of the neurobiological basis of social behavior.

Revealing the neural time-course of direct gaze processing via spatial frequency manipulation of faces

Direct gaze is a powerful social cue signalling the attention of another person toward oneself. Here we investigated the relevance of low spatial frequency (LSF) and high spatial frequency (HSF) in facial cues for direct gaze processing. We identified two distinct peaks in the ERP response, the N170 and N240 components. These two components were related to different stimulus conditions and influenced by different spatial frequencies. In particular, larger N170 and N240 amplitudes were observed for direct gaze than for averted gaze, but only in the N240 component was this effect modulated by spatial frequency, where it was reliant in LSF information. By contrast, larger N170 and N240 components were observed for faces than for non-facial stimuli, but this effect was only modulated by spatial frequency in the N170 component, where it relied on HSF information. The present study highlights the existence of two functionally distinct components related to direct gaze processing.

Investigating the Influences of Language Delay and/or Familial Risk for Dyslexia on Brain Structure in 5-Year-Olds

Early language delay has often been associated with atypical language/literacy development. Neuroimaging studies further indicate functional disruptions during language and print processing in school-age children with a retrospective report of early language delay. Behavioral data of 114 5-year-olds with a retrospective report of early language delay in infancy (N = 34) and those without (N = 80) and with a familial risk for dyslexia and those without are presented. Behaviorally, children with a retrospective report of early language delay exhibited reduced performance in language/reading-related measures. A voxel-based morphometry analysis in a subset (N = 46) demonstrated an association between reduced gray matter volume and early language delay in left-hemispheric middle temporal, occipital, and frontal regions. Alterations in middle temporal cortex in children with a retrospective report of early language delay were observed regardless of familial risk for dyslexia. Additionally, while children with isolated familial risk for dyslexia showed gray matter reductions in temporoparietal and occipitotemporal regions, these effects were most profound in children with both risk factors. An interaction effect of early language delay and familial risk was revealed in temporoparietal, occipital, and frontal cortex. Our findings support a cumulative effect of early behavioral and genetic risk factors on brain development and may ultimately inform diagnosis/treatment.

Taking two to tango: fMRI analysis of improvised joint action with physical contact

Many forms of joint action involve physical coupling between the participants, such as when moving a sofa together or dancing a tango. We report the results of a novel two-person functional MRI study in which trained couple dancers engaged in bimanual contact with an experimenter standing next to the bore of the magnet, and in which the two alternated between being the leader and the follower of joint improvised movements. Leading showed a general pattern of self-orientation, being associated with brain areas involved in motor planning, navigation, sequencing, action monitoring, and error correction. In contrast, following showed a far more sensory, externally-oriented pattern, revealing areas involved in somatosensation, proprioception, motion tracking, social cognition, and outcome monitoring. We also had participants perform a "mutual" condition in which the movement patterns were pre-learned and the roles were symmetric, thereby minimizing any tendency toward either leading or following. The mutual condition showed greater activity in brain areas involved in mentalizing and social reward than did leading or following. Finally, the analysis of improvisation revealed the dual importance of motor-planning and working-memory areas. We discuss these results in terms of theories of both joint action and improvisation.

Association between Neuroticism and Emotional Face Processing

Neuroticism is one of the “Big Five” personality factors and is characterized by a tendency to experience negative affect. We aimed to investigate how neuroticism influences the neural correlates for processing of emotional facial expressions. 68 healthy participants were presented with emotional dynamic facial stimuli, i.e. happy, neutral or angry, during functional MRI. Brain activations for the contrasts emotional vs. neutral, happy vs. neutral and angry vs. neutral were correlated with individuals’ neuroticism scores as obtained by the NEO Five Factor Inventory questionnaire and additionally investigated for gender differences. The bilateral medial temporal gyrus (MTG) was identified as key region in the processing of emotional faces and activations within this region correlated with individual neuroticism scores. Although female participants showed significantly stronger activation differences between emotional and neutral facial expressions in the left MTG, the correlation between activation and neuroticism scores did not show any significant gender differences. Our results offer for the first time a biological correlate within the face processing network for enhanced reactivity of neurotic individuals to emotional facial expressions which occurs similarly for both male and female participants.

The neural network for face recognition: Insights from an fMRI study on developmental prosopagnosia

Face recognition is supported by collaborative work of multiple face-responsive regions in the brain. Based on findings from individuals with normal face recognition ability, a neural model has been proposed with the occipital face area (OFA), fusiform face area (FFA), and face-selective posterior superior temporal sulcus (pSTS) as the core face network (CFN) and the rest of the face-responsive regions as the extended face network (EFN). However, little is known about how these regions work collaboratively for face recognition in our daily life. Here we focused on individuals suffering developmental prosopagnosia (DP), a neurodevelopmental disorder specifically impairing face recognition, to shed light on the infrastructure of the neural model of face recognition. Specifically, we used a variant of global brain connectivity method to comprehensively explore resting-state functional connectivity (FC) among face-responsive regions in a large sample of DPs (N = 64). We found that both the FCs within the CFN and those between the CFN and EFN were largely reduced in DP. Importantly, the right OFA and FFA served as the dysconnectivity hubs within the CFN, i.e., FCs concerning these two regions within the CFN were largely disrupted. In addition, DPs' right FFA also showed reduced FCs with the EFN. Moreover, these disrupted FCs were related to DP's behavioral deficit in face recognition, with the FCs from the FFA to the anterior temporal lobe (ATL) and pSTS the most predictive. Based on these findings, we proposed a revised neural model of face recognition demonstrating the relatedness of interactions among face-responsive regions to face recognition.

Neural mechanisms of eye contact when listening to another person talking

Eye contact occurs frequently and voluntarily during face-to-face verbal communication. However, the neural mechanisms underlying eye contact when it is accompanied by spoken language remain unexplored to date. Here we used a novel approach, fixation-based event-related functional magnetic resonance imaging (fMRI), to simulate the listener making eye contact with a speaker during verbal communication. Participants’ eye movements and fMRI data were recorded simultaneously while they were freely viewing a pre-recorded speaker talking. The eye tracking data were then used to define events for the fMRI analyses. The results showed that eye contact in contrast to mouth fixation involved visual cortical areas (cuneus, calcarine sulcus), brain regions related to theory of mind/intentionality processing (temporoparietal junction, posterior superior temporal sulcus, medial prefrontal cortex) and the dorsolateral prefrontal cortex. In addition, increased effective connectivity was found between these regions for eye contact in contrast to mouth fixations. The results provide first evidence for neural mechanisms underlying eye contact when watching and listening to another person talking. The network we found might be well suited for processing the intentions of communication partners during eye contact in verbal communication.

Frontal temporal and parietal systems synchronize within and across brains during live eye-to-eye contact

Human eye-to-eye contact is a primary source of social cues and communication. In spite of the biological significance of this interpersonal interaction, the underlying neural processes are not well-understood. This knowledge gap, in part, reflects limitations of conventional neuroimaging methods, including solitary confinement in the bore of a scanner and minimal tolerance of head movement that constrain investigations of natural, two-person interactions. However, these limitations are substantially resolved by recent technical developments in functional near-infrared spectroscopy (fNIRS), a non-invasive spectral absorbance technique that detects changes in blood oxygen levels in the brain by using surface-mounted optical sensors. Functional NIRS is tolerant of limited head motion and enables simultaneous acquisitions of neural signals from two interacting partners in natural conditions. We employ fNIRS to advance a data-driven theoretical framework for two-person neuroscience motivated by the Interactive Brain Hypothesis which proposes that interpersonal interaction between individuals evokes neural mechanisms not engaged during solo, non-interactive, behaviors. Within this context, two specific hypotheses related to eye-to-eye contact, functional specificity and functional synchrony, were tested. The functional specificity hypothesis proposes that eye-to-eye contact engages specialized, within-brain, neural systems; and the functional synchrony hypothesis proposes that eye-to-eye contact engages specialized, across-brain, neural processors that are synchronized between dyads. Signals acquired during eye-to-eye contact between partners (interactive condition) were compared to signals acquired during mutual gaze at the eyes of a picture-face (non-interactive condition). In accordance with the specificity hypothesis, responses during eye-to-eye contact were greater than eye-to-picture gaze for a left frontal cluster that included pars opercularis (associated with canonical language production functions known as Broca's region), pre- and supplementary motor cortices (associated with articulatory systems), as well as the subcentral area. This frontal cluster was also functionally connected to a cluster located in the left superior temporal gyrus (associated with canonical language receptive functions known as Wernicke's region), primary somatosensory cortex, and the subcentral area. In accordance with the functional synchrony hypothesis, cross-brain coherence during eye-to-eye contact relative to eye-to-picture gaze increased for signals originating within left superior temporal, middle temporal, and supramarginal gyri as well as the pre- and supplementary motor cortices of both interacting brains. These synchronous cross-brain regions are also associated with known language functions, and were partner-specific (i.e., disappeared with randomly assigned partners). Together, both within and across-brain neural correlates of eye-to-eye contact included components of previously established productive and receptive language systems. These findings reveal a left frontal, temporal, and parietal long-range network that mediates neural responses during eye-to-eye contact between dyads, and advance insight into elemental mechanisms of social and interpersonal interactions.

You talkin' to me? Communicative talker gaze activates left-lateralized superior temporal cortex during perception of degraded speech

Neuroimaging studies of speech perception have consistently indicated a left-hemisphere dominance in the temporal lobes’ responses to intelligible auditory speech signals (McGettigan and Scott, 2012). However, there are important communicative cues that cannot be extracted from auditory signals alone, including the direction of the talker's gaze. Previous work has implicated the superior temporal cortices in processing gaze direction, with evidence for predominantly right-lateralized responses (Carlin & Calder, 2013). The aim of the current study was to investigate whether the lateralization of responses to talker gaze differs in an auditory communicative context. Participants in a functional MRI experiment watched and listened to videos of spoken sentences in which the auditory intelligibility and talker gaze direction were manipulated factorially. We observed a left-dominant temporal lobe sensitivity to the talker's gaze direction, in which the left anterior superior temporal sulcus/gyrus and temporal pole showed an enhanced response to direct gaze – further investigation revealed that this pattern of lateralization was modulated by auditory intelligibility. Our results suggest flexibility in the distribution of neural responses to social cues in the face within the context of a challenging speech perception task.

•

Talker gaze is an important social cue during speech comprehension.

•

Neural responses to gaze were measured during perception of degraded sentences.

•

Gaze direction modulated activation in left-lateralized superior temporal cortex.

•

Left lateralization became stronger when speech was less intelligible.

•

Results suggest task-dependent flexibility in cortical responses to gaze.

Gaze-cueing requires intact face processing - Insights from acquired prosopagnosia

Gaze-cueing is the automatic spatial orienting of attention in the direction of perceived gaze. Participants respond faster to targets located at positions congruent with the direction of gaze, compared to incongruent ones (gaze cueing effect, GCE). However, it still remains unclear whether its occurrence depends on intact integration of information from the entire eye region or face, rather than simply the presence of the eyes per se. To address this question, we investigated the GCE in PS, an extensively studied case of pure acquired prosopagnosia. In our gaze-cueing paradigm, we manipulated the duration at which cues were presented (70ms vs. 400ms) and the availability of facial information (full-face vs. eyes-only). For 70ms cue duration, we found a context-dependent dissociation between PS and controls: PS showed a GCE for eyes-only stimuli, whereas controls showed a GCE only for full-face stimuli. For 400ms cue duration, PS showed gaze-cueing independently of stimulus context, whereas in healthy controls a GCE again emerged only for full-face stimuli. Our findings suggest that attentional deployment based on the gaze direction of briefly presented faces requires intact processing of facial information, which affords salience to the eye region.

How emotion context modulates unconscious goal activation during motor force exertion

Priming participants with emotional or action-related concepts influences goal formation and motor force output during effort exertion tasks, even without awareness of priming information. However, little is known about neural processes underpinning how emotional cues interact with action (or inaction) goals to motivate (or demotivate) motor behaviour. In a novel functional neuroimaging paradigm, visible emotional images followed by subliminal action or inaction word primes were presented before participants performed a maximal force exertion. In neutral emotional contexts, maximum force was lower following inaction than action primes. However, arousing emotional images had interactive motivational effects on the motor system: Unpleasant images prior to inaction primes increased force output (enhanced effort exertion) relative to control primes, and engaged a motivation-related network involving ventral striatum, extended amygdala, as well as right inferior frontal cortex. Conversely, pleasant images presented before action (versus control) primes decreased force and activated regions of the default-mode network, including inferior parietal lobule and medial prefrontal cortex. These findings show that emotional context can determine how unconscious goal representations influence motivational processes and are transformed into actual motor output, without direct rewarding contingencies. Furthermore, they provide insight into altered motor behaviour in psychopathological disorders with dysfunctional motivational processes.

Gazing at me: the importance of social meaning in understanding direct-gaze cues

Direct gaze is an engaging and important social cue, but the meaning of direct gaze depends heavily on the surrounding context. This paper reviews some recent studies of direct gaze, to understand more about what neural and cognitive systems are engaged by this social cue and why. The data show that gaze can act as an arousal cue and can modulate actions, and can activate brain regions linked to theory of mind and self-related processing. However, all these results are strongly modulated by the social meaning of a gaze cue and by whether participants believe that another person is really watching them. The implications of these contextual effects and audience effects for our theories of gaze are considered.

Tuning Eye-Gaze Perception by Transitory STS Inhibition

Processing eye-gaze information is a key step to human social interaction. Neuroimaging studies have shown that superior temporal sulcus (STS) is highly implicated in eye-gaze perception. In autism, a lack of preference for the eyes, as well as anatomo-functional abnormalities within the STS, has been described. To date, there are no experimental data in humans showing whether it is possible to interfere with eye-gaze processing by modulating STS neural activity. Here, we measured eye-gaze perception before and after inhibitory transcranial magnetic stimulation (TMS) applied over the posterior STS (pSTS) in young healthy volunteers. Eye-gaze processing, namely overt orienting toward the eyes, was measured using eye tracking during passive visualization of social movies. Inhibition of the right pSTS led participants to look less to the eyes of characters during visualization of social movies. Such effect was specific for the eyes and was not observed after inhibition of the left pSTS nor after placebo TMS. These results indicate for the first time that interfering with the right pSTS neural activity transitorily disrupts the behavior of orienting toward the eyes and thus indirectly gaze perception, a fundamental process for human social cognition. These results could open up new perspectives in therapeutic interventions in autism.

Beta- and gamma-band activity reflect predictive coding in the processing of causal events

In daily life, complex events are perceived in a causal manner, suggesting that the brain relies on predictive processes to model them. Within predictive coding theory, oscillatory beta-band activity has been linked to top-down predictive signals and gamma-band activity to bottom-up prediction errors. However, neurocognitive evidence for predictive coding outside lower-level sensory areas is scarce. We used magnetoencephalography to investigate neural activity during probability-dependent action perception in three areas pivotal for causal inference, superior temporal sulcus, temporoparietal junction and medial prefrontal cortex, using bowling action animations. Within this network, Granger-causal connectivity in the beta-band was found to be strongest for backward top-down connections and gamma for feed-forward bottom-up connections. Moreover, beta-band power in TPJ increased parametrically with the predictability of the action kinematics-outcome sequences. Conversely, gamma-band power in TPJ and MPFC increased with prediction error. These findings suggest that the brain utilizes predictive-coding-like computations for higher-order cognition such as perception of causal events.

Gaze Direction Modulates the Relation between Neural Responses to Faces and Visual Awareness

Gaze direction and especially direct gaze is a powerful nonverbal cue that plays an important role in social interactions. Here we studied the neural mechanisms underlying the privileged access of direct gaze to visual awareness. We performed functional magnetic resonance imaging in healthy human volunteers who were exposed to faces with direct or averted gaze under continuous flash suppression, thereby manipulating their awareness of the faces. A gaze processing network comprising fusiform face area (FFA), superior temporal sulcus, amygdala, and intraparietal sulcus showed overall reduced neural responses when participants reported to be unaware of the faces. Interestingly, direct gaze elicited greater responses than averted gaze when participants were aware of the faces, but smaller responses when they were unaware. Additional between-subject correlation and single-trial analyses indicated that this pattern of results was due to a modulation of the relationship between neural responses and awareness by gaze direction: with increasing neural activation in the FFA, direct-gaze faces entered awareness more readily than averted-gaze faces. These findings suggest that for direct gaze, lower levels of neural activity are sufficient to give rise to awareness than for averted gaze, thus providing a neural basis for privileged access of direct gaze to awareness. Significance statement: Another person's eye gaze directed at oneself is a powerful social signal acting as a catalyst for further communication. Here, we studied the neural mechanisms underlying the prioritized access of direct gaze to visual awareness in healthy human volunteers and show that with increasing neural activation, direct-gaze faces enter awareness more readily than averted-gaze faces. This suggests that for a socially highly relevant cue like direct gaze, lower levels of neural activity are sufficient to give rise to awareness compared with averted gaze, possibly because the human brain is attuned to the efficient neural processing of direct gaze due to the biological importance of eye contact for social interactions.

A Revised Neural Framework for Face Processing

Face perception relies on computations carried out in face-selective cortical areas. These areas have been intensively investigated for two decades, and this work has been guided by an influential neural model suggested by Haxby and colleagues in 2000. Here, we review new findings about face-selective areas that suggest the need for modifications and additions to the Haxby model. We suggest a revised framework based on (a) evidence for multiple routes from early visual areas into the face-processing system, (b) information about the temporal characteristics of these areas, (c) indications that the fusiform face area contributes to the perception of changeable aspects of faces, (d) the greatly elevated responses to dynamic compared with static faces in dorsal face-selective brain areas, and (e) the identification of three new anterior face-selective areas. Together, these findings lead us to suggest that face perception depends on two separate pathways: a ventral stream that represents form information and a dorsal stream driven by motion and form information.