The inferior occipital gyrus is a major cortical source of the face-evoked N170: Evidence from simultaneous scalp and intracerebral human recordings

Fast saccades to faces during the feedforward sweep

Saccadic choice tasks use eye movements as a response method, typically in a task where observers are asked to saccade as quickly as possible to an image of a prespecified target category. Using this approach, face-selective saccades have been observed within 100 ms poststimulus. When taking into account oculomotor processing, this suggests that faces can be detected in as little as 70 to 80 ms. It has therefore been suggested that face detection must occur during the initial feedforward sweep, since this latency leaves little time for feedback processing. In the current experiment, we tested this hypothesis using backward masking-a technique shown to primarily disrupt feedback processing while leaving feedforward activation relatively intact. Based on minimum saccadic reaction time, we found that face detection benefited from ultra-fast, accurate saccades within 110 to 160 ms and that these eye movements are obtainable even under extreme masking conditions that limit perceptual awareness. However, masking did significantly increase the median SRT for faces. In the manual responses, we found remarkable detection accuracy for faces and houses, even when participants indicated having no visual experience of the test images. These results provide evidence for the view that the saccadic bias to faces is initiated by coarse information used to categorize faces in the feedforward sweep but that, in most cases, additional processing is required to quickly reach the threshold for saccade initiation.

Neural correlates of impaired learning and recognition of novel faces in mild cognitive impairment

OBJECTIVE

Face memory impairment significantly affects social interactions and daily functioning in individuals with mild cognitive impairment (MCI). While deficits in recognizing familiar faces among individuals with MCI have been reported, their ability to learn and recognize unfamiliar faces remains unclear. This study examined the behavioral performance and event-related potentials (ERPs) of unfamiliar face memorization and recognition in MCI.

METHODS

Fifteen individuals with MCI and 15 healthy controls learned and recognized 90 unfamiliar neutral faces. Their performance accuracy and cortical ERPs were compared between the two groups across the learning and recognition phases.

RESULTS

Individuals with MCI had lower accuracy in identifying newly learned faces than healthy controls. Moreover, individuals with MCI had reduced occipitotemporal N170 and central vertex positive potential responses during both the learning and recognition phases, suggesting impaired initial face processing and attentional resources allocation. Also, individuals with MCI had reduced central N200 and frontal P300 responses during the recognition phase, suggesting impaired later-stage face recognition and attention engagement.

CONCLUSION

These findings provide neurobehavioral evidence for impaired learning and recognition of unfamiliar faces in individuals with MCI.

SIGNIFICANCE

Individuals with MCI may have face memory deficits in both early-stage face processing and later-stage recognition .

Brain Networks and Intelligence: A Graph Neural Network Based Approach to Resting State fMRI Data

Resting-state functional magnetic resonance imaging (rsfMRI) is a powerful tool for investigating the relationship between brain function and cognitive processes as it allows for the functional organization of the brain to be captured without relying on a specific task or stimuli. In this paper, we present a novel modeling architecture called BrainRGIN for predicting intelligence (fluid, crystallized and total intelligence) using graph neural networks on rsfMRI derived static functional network connectivity matrices. Extending from the existing graph convolution networks, our approach incorporates a clustering-based embedding and graph isomorphism network in the graph convolutional layer to reflect the nature of the brain sub-network organization and efficient network expression, in combination with TopK pooling and attention-based readout functions. We evaluated our proposed architecture on a large dataset, specifically the Adolescent Brain Cognitive Development Dataset, and demonstrated its effectiveness in predicting individual differences in intelligence. Our model achieved lower mean squared errors, and higher correlation scores than existing relevant graph architectures and other traditional machine learning models for all of the intelligence prediction tasks. The middle frontal gyrus exhibited a significant contribution to both fluid and crystallized intelligence, suggesting their pivotal role in these cognitive processes. Total composite scores identified a diverse set of brain regions to be relevant which underscores the complex nature of total intelligence.

Combining electrodermal activity analysis and dynamic causal modeling to investigate the visual-odor multimodal integration during face perception

Objective. This study presents a novel methodological approach for incorporating information related to the peripheral sympathetic response into the investigation of neural dynamics. Particularly, we explore how hedonic contextual olfactory stimuli influence the processing of neutral faces in terms of sympathetic response, event-related potentials and effective connectivity analysis. The objective is to investigate how the emotional valence of odors influences the cortical connectivity underlying face processing and the role of face-induced sympathetic arousal in this visual-olfactory multimodal integration.Approach. To this aim, we combine electrodermal activity (EDA) analysis and dynamic causal modeling to examine changes in cortico-cortical interactions.Results. The results reveal that stimuli arising sympathetic EDA responses are associated with a more negative N170 amplitude, which may be a marker of heightened arousal in response to faces. Hedonic odors, on the other hand, lead to a more negative N1 component and a reduced the vertex positive potential when they are unpleasant or pleasant. Concerning connectivity, unpleasant odors strengthen the forward connection from the inferior temporal gyrus (ITG) to the middle temporal gyrus, which is involved in processing changeable facial features. Conversely, the occurrence of sympathetic responses after a stimulus is correlated with an inhibition of this same connection and an enhancement of the backward connection from ITG to the fusiform face gyrus.Significance. These findings suggest that unpleasant odors may enhance the interpretation of emotional expressions and mental states, while faces capable of eliciting sympathetic arousal prioritize identity processing.

Mass-univariate analysis of scalp ERPs reveals large effects of gaze fixation location during face processing that only weakly interact with face emotional expression

Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content.

A new paradigm for investigating real-world social behavior and its neural underpinnings

Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.

Conflict and control in cortical responses to inconsistent emotional signals in a face-word Stroop

Social communication is fraught with ambiguity. Negotiating the social world requires interpreting the affective signals we receive and often selecting between channels of conflicting affective information. The affective face-word Stroop (AFWS) provides an experimental paradigm which may identify cognitive-affective control mechanisms underpinning essential social-affective skills. Initial functional magnetic resonance imaging (fMRI) study of the AFWS identified right amygdala as driving this affective conflict and left rostral anterior cingulate cortex (rACC) as the locus of conflict control. We employed electroencephalogram (EEG) and eLORETA source localization to investigate the timing, location, and sequence of control processes when responding to affective conflict generated during the AFWS. However we designated affective word as the response target and affective face as the distractor to maximize conflict and control effects. Reaction times showed slowed responses in high vs. low control conditions, corresponding to a Rabbitt type control effect rather than the previously observed Grattan effect. Control related activation occurred in right rACC 96-118 ms post-stimulus, corresponding to the resolution of the P1 peak in the Visual Evoked Potential (VEP). Face distractors elicit right hemisphere control, while word distractors elicit left hemisphere control. Low control trials require rapid "booting up" control resources observable through VEPs. Incongruent trial activity in right fusiform face area is suppressed 118-156 ms post stimulus corresponding to onset and development of the N170 VEP component. Results are consistent with a predicted sequence of rapid early amygdala activation by affective conflict, then rACC inhibition of amygdala decreasing facilitation of affective face processing (however, amygdala activity is not observable with EEG).

Illusory object recognition is either perceptual or cognitive in origin depending on decision confidence

We occasionally misinterpret ambiguous sensory input or report a stimulus when none is presented. It is unknown whether such errors have a sensory origin and reflect true perceptual illusions, or whether they have a more cognitive origin (e.g., are due to guessing), or both. When participants performed an error-prone and challenging face/house discrimination task, multivariate electroencephalography (EEG) analyses revealed that during decision errors (e.g., mistaking a face for a house), sensory stages of visual information processing initially represent the presented stimulus category. Crucially however, when participants were confident in their erroneous decision, so when the illusion was strongest, this neural representation flipped later in time and reflected the incorrectly reported percept. This flip in neural pattern was absent for decisions that were made with low confidence. This work demonstrates that decision confidence arbitrates between perceptual decision errors, which reflect true illusions of perception, and cognitive decision errors, which do not.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

Electrophysiological Studies of Reception of Facial Communication in Autism Spectrum Disorder and Schizophrenia

Autism spectrum disorder (ASD) and schizophrenia spectrum disorders (SZ) are characterized by difficulty with social cognition and atypical reception of facial communication - a key area in the Research Domain Criteria framework. To identify areas of overlap and dissociation between ASD and SZ, we review studies of event-related potentials (ERP) to faces across ASD and SZ populations, focusing on ERPs implicated in social perception: P100, N170, N250, and P300. There were many inconsistent findings across studies; however, replication was strongest for delayed N170 latency in ASD and attenuated N170 amplitude in SZ. These results highlight the challenges of replicating research findings in heterogeneous clinical populations and the need for transdiagnostic research that continuously quantifies behavior and neural activity across neurodevelopmental disorders.

Event-related brain potential markers of visual and auditory perception: A useful tool for brain computer interface systems

OBJECTIVE

A majority of BCI systems, enabling communication with patients with locked-in syndrome, are based on electroencephalogram (EEG) frequency analysis (e.g., linked to motor imagery) or P300 detection. Only recently, the use of event-related brain potentials (ERPs) has received much attention, especially for face or music recognition, but neuro-engineering research into this new approach has not been carried out yet. The aim of this study was to provide a variety of reliable ERP markers of visual and auditory perception for the development of new and more complex mind-reading systems for reconstructing the mental content from brain activity.

METHODS

A total of 30 participants were shown 280 color pictures (adult, infant, and animal faces; human bodies; written words; checkerboards; and objects) and 120 auditory files (speech, music, and affective vocalizations). This paradigm did not involve target selection to avoid artifactual waves linked to decision-making and response preparation (e.g., P300 and motor potentials), masking the neural signature of semantic representation. Overall, 12,000 ERP waveforms × 126 electrode channels (1 million 512,000 ERP waveforms) were processed and artifact-rejected.

RESULTS

Clear and distinct category-dependent markers of perceptual and cognitive processing were identified through statistical analyses, some of which were novel to the literature. Results are discussed from the view of current knowledge of ERP functional properties and with respect to machine learning classification methods previously applied to similar data.

CONCLUSION

The data showed a high level of accuracy (p ≤ 0.01) in the discriminating the perceptual categories eliciting the various electrical potentials by statistical analyses. Therefore, the ERP markers identified in this study could be significant tools for optimizing BCI systems [pattern recognition or artificial intelligence (AI) algorithms] applied to EEG/ERP signals.

Relations between physical activity and hippocampal functional connectivity: Modulating role of mind wandering

Physical activity is critical for maintaining cognitive and brain health. Previous studies have indicated that the effect of physical activity on cognitive and brain function varies between individuals. The present study aimed to examine whether mind wandering modulated the relations between physical activity and resting-state hippocampal functional connectivity. A total of 99 healthy adults participated in neuroimaging data collection as well as reported their physical activity in the past week and their propensity to mind wandering during typical activities. The results indicated that mind wandering was negatively related to the resting-state functional connectivity between hippocampus and right inferior occipital gyrus. Additionally, for participants with higher level of mind wandering, physical activity was negatively related to hippocampal connectivity at left precuneus and right precentral gyrus. In contrast, such relations were positive at right medial frontal gyrus and bilateral precentral gyrus for participants with lower level of mind wandering. Altogether, these findings indicated that the relations between physical activity and hippocampal functional connectivity vary as a function of mind wandering level, suggesting that individual differences are important to consider when we aim to maintain or improve cognitive and brain health through increasing physical activity.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Deep Convolutional Neural Network-Based Visual Stimuli Classification Using Electroencephalography Signals of Healthy and Alzheimer’s Disease Subjects

Visual perception is an important part of human life. In the context of facial recognition, it allows us to distinguish between emotions and important facial features that distinguish one person from another. However, subjects suffering from memory loss face significant facial processing problems. If the perception of facial features is affected by memory impairment, then it is possible to classify visual stimuli using brain activity data from the visual processing regions of the brain. This study differentiates the aspects of familiarity and emotion by the inversion effect of the face and uses convolutional neural network (CNN) models (EEGNet, EEGNet SSVEP (steady-state visual evoked potentials), and DeepConvNet) to learn discriminative features from raw electroencephalography (EEG) signals. Due to the limited number of available EEG data samples, Generative Adversarial Networks (GAN) and Variational Autoencoders (VAE) are introduced to generate synthetic EEG signals. The generated data are used to pretrain the models, and the learned weights are initialized to train them on the real EEG data. We investigate minor facial characteristics in brain signals and the ability of deep CNN models to learn them. The effect of face inversion was studied, and it was observed that the N170 component has a considerable and sustained delay. As a result, emotional and familiarity stimuli were divided into two categories based on the posture of the face. The categories of upright and inverted stimuli have the smallest incidences of confusion. The model’s ability to learn the face-inversion effect is demonstrated once more.

Influence of scene-based expectation on facial expression perception: the moderating effect of cognitive load

Prior expectations play an important role in the process of perception. In real life, facial expressions always appear within a scene, which enables individuals to generate predictions that affect facial expression judgments. In the present study, using event-related potentials, we investigated the influence of scene-based expectation on facial expression processing. In addition, we used a cognitive task to manipulate cognitive load to interfere with scene-based expectation. Results showed that under the condition of sufficient cognitive resources, faces elicited more negative N170 amplitudes and more positive N400 amplitudes when the emotional valence of the scenes and faces was congruent. However, in the condition of cognitive load, no such difference was observed. The findings suggested that the effect of expectation on facial expression recognition emerges during both the early and late stages of facial expression processing, and the effect is weakened when cognitive resources are occupied by unrelated tasks.

Face-selective responses in combined EEG/MEG recordings with fast periodic visual stimulation (FPVS)

Fast periodic visual stimulation (FPVS) allows the recording of objective brain responses of human face categorization (i.e., generalizable face-selective responses) with high signal-to-noise ratio. This approach has been successfully employed in a number of scalp electroencephalography (EEG) studies but has not been used with magnetoencephalography (MEG) yet, let alone with combined MEG/EEG recordings and distributed source estimation. Here, we presented various natural images of faces periodically (1.2 Hz) among natural images of objects (base frequency 6 Hz) whilst recording simultaneous EEG and MEG in 15 participants. Both measurement modalities showed face-selective responses at 1.2 Hz and harmonics across participants, with high and comparable signal-to-noise ratio (SNR) in about 3 min of stimulation. The correlation of face categorization responses between EEG and two MEG sensor types was lower than between the two MEG sensor types, indicating that the two sensor modalities provide independent information about the sources of face-selective responses. Face-selective EEG responses were right-lateralized as reported previously, and were numerically but non-significantly right-lateralized in MEG data. Distributed source estimation based on combined EEG/MEG signals confirmed a more bilateral face-selective response in visual brain regions located anteriorly to the common response to all stimuli at 6 Hz and harmonics. Conventional sensor and source space analyses of evoked responses in the time domain further corroborated this result. Our results demonstrate that FPVS in combination with simultaneously recorded EEG and MEG may serve as an efficient localizer paradigm for human face categorization.

Aberrant modulation of brain activity underlies impaired working memory following traumatic brain injury

Impaired working memory is a common and disabling consequence of traumatic brain injury (TBI) that is caused by aberrant brain processing. However, little is known about the extent to which deficits are perpetuated by specific working memory subprocesses. Using a combined functional magnetic resonance imaging (fMRI) and working memory paradigm, we tested the hypothesis that the pattern of brain activation subserving working memory following TBI would interact with both task demands and specific working memory subcomponents: encoding, maintenance, and retrieval. Forty-three patients with moderate-severe TBI, of whom 25 were in the acute phase of recovery (M = 2.16 months, SD = 1.48 months, range = 0.69 - 6.64 months) and 18 in the chronic phase of recovery (M = 23.44 months, SD = 6.76 months, range = 13.35 - 34.82 months), were compared with 38 demographically similar healthy controls. Behaviourally, we found that working memory deficits were confined to the high cognitive load trials in both acute (P = 0.006) and chronic (P = 0.024) cohorts. Furthermore, results for a subset of the sample (18 chronic TBI and 17 healthy controls) who underwent fMRI revealed that the TBI group showed reduced brain activation when simply averaged across all task trials (regardless of cognitive load or subcomponent). However, interrogation of the subcomponents of working memory revealed a more nuanced pattern of activation. When examined more closely, patterns of brain activity following TBI were found to interact with both task demands and the working memory subcomponent: increased activation was observed during encoding in the left inferior occipital gyrus whereas decreased activation was apparent during maintenance in the bilateral cerebellum and left calcarine sulcus. Taken together, findings indicate an inability to appropriately modulate brain activity according to task demand that is specific to working memory encoding and maintenance.

Data-point-wise spatiotemporal mapping of human ventral visual areas: Use of spatial frequency/luminance-modulated chromatic faces

Visual information involving facial identity and expression is crucial for social communication. Although the influence of facial features such as spatial frequency (SF) and luminance on face processing in visual areas has been studied extensively using grayscale stimuli, the combined effects of other features in this process have not been characterized. To determine the combined effects of different SFs and color, we created chromatic stimuli with low, high or no SF components, which bring distinct SF and color information into the ventral stream simultaneously. To obtain neural activity data with high spatiotemporal resolution we recorded face-selective responses (M170) using magnetoencephalography. We used a permutation test procedure with threshold-free cluster enhancement to assess statistical significance while resolving problems related to multiple comparisons and arbitrariness found in traditional statistical methods. We found that time windows with statistically significant threshold levels were distributed differently among the stimulus conditions. Face stimuli containing any SF components evoked M170 in the fusiform gyrus (FG), whereas a significant emotional effect on M170 was only observed with the original images. Low SF faces elicited larger activation of the FG and the inferior occipital gyrus than the original images, suggesting an interaction between low and high SF information processing. Interestingly, chromatic face stimuli without SF first activated color-selective regions and then the FG, indicating that facial color was processed according to a hierarchy in the ventral stream. These findings suggest complex effects of SFs in the presence of color information, reflected in M170, and unveil the detailed spatiotemporal dynamics of face processing in the human brain.

Intracerebral electrical stimulation to understand the neural basis of human face identity recognition

Recognizing people's identity by their faces is a key function in the human species, supported by regions of the ventral occipito-temporal cortex (VOTC). In the last decade, there have been several reports of perceptual face distortion during direct electrical stimulation (DES) with subdural electrodes positioned over a well-known face-selective VOTC region of the right lateral middle fusiform gyrus (LatMidFG; i.e., the "Fusiform Face Area", FFA). However, transient impairments of face identity recognition (FIR) have been extremely rare and only behaviorally quantified during DES with intracerebral (i.e., depth) electrodes in stereo-electroencephalography (SEEG). The three detailed cases reported so far, summarized here, were specifically impaired at FIR during DES inside different anatomical VOTC regions of the right hemisphere: the inferior occipital gyrus (IOG) and the LatMidFG, as well as a region that lies at the heart of a large magnetic susceptibility artifact in functional magnetic resonance imaging (fMRI): the anterior fusiform gyrus (AntFG). In the first two regions, the eloquent electrode contacts were systematically associated with the highest face-selective and (unfamiliar) face individuation responses as measured with intracerebral electrophysiology. Stimulation in the right AntFG did not lead to perceptual changes but also caused an inability to remember having been presented face pictures, as if the episode was never recorded in memory. These observations support the view of an extensive network of face-selective VOTC regions subtending human FIR, with at least three critical nodes in the right hemisphere associated with differential intrinsic and extrinsic patterns of reentrant connectivity.

Sexual Dimorphism in Hemispheric Processing of Faces in Humans: A Meta-Analysis of 817 Cases

A well-established neuroimaging literature predicts a right-sided asymmetry in the activation of face-devoted areas such as the fusiform gyrus (FG) and its resulting M/N170 response during face processing. However, the face-related response sometimes appears to be bihemispheric. A few studies have argued that bilaterality depended on the sex composition of the sample. To shed light on this matter, two meta-analyses were conducted starting from a large initial database of 250 ERP (Event-related potentials)/MEG (Magnetoencephalography) peer-reviewed scientific articles. Paper coverage was from 1985 to 2020. Thirty-four articles met the inclusion criteria of a sufficiently large and balanced sample size with strictly right-handed and healthy participants aged 18–35 years and N170 measurements in response to neutral front view faces at left and right occipito/temporal sites. The data of 817 male (n = 414) and female (n = 403) healthy adults were subjected to repeated-measures analyses of variance. The results of statistical analyses from the data of 17 independent studies (from Asia, Europe and America) seem to robustly indicate the presence of a sex difference in the way the two cerebral hemispheres process facial information in humans, with a marked right-sided asymmetry of the bioelectrical activity in males and a bilateral or left-sided activity in females.

Gender differences in subliminal affective face priming: A high-density ERP study

INTRODUCTION

Subliminal affective priming effects (SAPEs) refer to the phenomenon by which the presentation of an affective prime stimulus influences the subsequent affective evaluation of a target stimulus. Previous studies have reported that unconsciously processed stimuli affect behavioral performance more than consciously processed stimuli. However, the impact of SAPEs on the face-specific N170 component is unclear. We studied how SAPEs for fearful faces affected the N170 for subsequent supraliminal target faces using event-related potentials (ERPs).

METHODS

Japanese adults (n = 44, 20 females) participated in this study. Subliminal prime faces (neutral or fearful) were presented for 17 ms, followed by a backward mask for 283 ms and 800 ms target faces (neutral, emotionally ambiguous, or fearful). 128-channel ERPs were recorded while participants judged the expression of target faces as neutral or fearful. Response rates and response times were also measured for assessing behavioral alterations.

RESULTS

Although the behavioral results revealed no evidence of SAPEs, we found gender-related SAPEs in right N170 amplitude. Specifically, female participants exhibited enhanced right N170 amplitude for emotionally neutral faces primed by fearful faces, while male participants exhibited decreased N170 amplitude in fearful prime trials with fearful target faces. Male participants exhibited significant correlations between N170 amplitude and behavioral response time in the fearful prime-neutral target condition.

CONCLUSIONS

Our ERP results suggest the existence of a gender difference in target-face processing preceded by subliminally presented face stimuli in the right occipito-temporal region.

The N170 event-related potential reflects delayed neural response to faces when visual attention is directed to the eyes in youths with ASD

Atypical neural response to faces is thought to contribute to social deficits in autism spectrum disorder (ASD). Compared to typically developing (TD) controls, individuals with ASD exhibit delayed brain responses to upright faces at a face-sensitive event-related potential (ERP), the N170. Given observed differences in patterns of visual attention to faces, it is not known whether slowed neural processing may simply reflect atypical looking to faces. The present study manipulated visual attention to facial features to examine whether directed attention to the eyes normalizes N170 latency in ASD. ERPs were recorded in 30 children and adolescents with ASD as well as 26 TD children and adolescents. Results replicated prior findings of shorter N170 latency to the eye region of the face in TD individuals. In contrast, those with ASD did not demonstrate modulation of N170 latency by point of regard to the face. Group differences in latency were most pronounced when attention was directed to the eyes. Results suggest that well-replicated findings of N170 delays in ASD do not simply reflect atypical patterns of visual engagement with experimental stimuli. These findings add to a body of evidence indicating that N170 delays are a promising marker of atypical neural response to social information in ASD. LAY SUMMARY: This study looks at how children's and adolescents' brains respond when looking at different parts of a face. Typically developing children and adolescents processed eyes faster than other parts of the face, whereas this pattern was not seen in ASD. Children and adolescents with ASD processed eyes more slowly than typically developing children. These findings suggest that observed inefficiencies in face processing in ASD are not simply reflective of failure to attend to the eyes.

Event-related network changes unfold the dynamics of cortical integration during face processing

Face perception arises from a collective activation of brain regions in the occipital, parietal and temporal cortices. Despite the wide acknowledgment that these regions act in an intertwined network, the network behavior itself is poorly understood. Here we present a study in which time-varying connectivity estimated from EEG activity elicited by facial expressions presentation was characterized using graph-theoretical measures of node centrality and global network topology. Results revealed that face perception results from a dynamic reshaping of the network architecture, characterized by the emergence of hubs located in the occipital and temporal regions of the scalp. The importance of these nodes can be observed from the early stages of visual processing and reaches a climax in the same time-window in which the face-sensitive N170 is observed. Furthermore, using Granger causality, we found that the time-evolving centrality of these nodes is associated with ERP amplitude, providing a direct link between the network state and local neural response. Additionally, investigating global network topology by means of small-worldness and modularity, we found that face processing requires a functional network with a strong small-world organization that maximizes integration, at the cost of segregated subdivisions. Interestingly, we found that this architecture is not static, but instead, it is implemented by the network from stimulus onset to ~200 ms. Altogether, this study reveals the event-related changes underlying face processing at the network level, suggesting that a distributed processing mechanism operates through dynamically weighting the contribution of the cortical regions involved.

Fast periodic visual stimulation to highlight the relationship between human intracerebral recordings and scalp electroencephalography

Despite being of primary importance for fundamental research and clinical studies, the relationship between local neural population activity and scalp electroencephalography (EEG) in humans remains largely unknown. Here we report simultaneous scalp and intracerebral EEG responses to face stimuli in a unique epileptic patient implanted with 27 intracerebral recording contacts in the right occipitotemporal cortex. The patient was shown images of faces appearing at a frequency of 6 Hz, which elicits neural responses at this exact frequency. Response quantification at this frequency allowed to objectively relate the neural activity measured inside and outside the brain. The patient exhibited typical 6 Hz responses on the scalp at the right occipitotemporal sites. Moreover, there was a clear spatial correspondence between these scalp responses and intracerebral signals in the right lateral inferior occipital gyrus, both in amplitude and in phase. Nevertheless, the signal measured on the scalp and inside the brain at nearby locations showed a 10-fold difference in amplitude due to electrical insulation from the head. To further quantify the relationship between the scalp and intracerebral recordings, we used an approach correlating time-varying signals at the stimulation frequency across scalp and intracerebral channels. This analysis revealed a focused and right-lateralized correspondence between the scalp and intracerebral recordings that were specific to the face stimulation is more broadly distributed in various control situations. These results demonstrate the interest of a frequency tagging approach in characterizing the electrical propagation from brain sources to scalp EEG sensors and in identifying the cortical sources of brain functions from these recordings.

Age-related hearing loss influences functional connectivity of auditory cortex for the McGurk illusion

Age-related hearing loss affects hearing at high frequencies and is associated with difficulties in understanding speech. Increased audio-visual integration has recently been found in age-related hearing impairment, the brain mechanisms that contribute to this effect are however unclear. We used functional magnetic resonance imaging in elderly subjects with normal hearing and mild to moderate uncompensated hearing loss. Audio-visual integration was studied using the McGurk task. In this task, an illusionary fused percept can occur if incongruent auditory and visual syllables are presented. The paradigm included unisensory stimuli (auditory only, visual only), congruent audio-visual and incongruent (McGurk) audio-visual stimuli. An illusionary precept was reported in over 60% of incongruent trials. These McGurk illusion rates were equal in both groups of elderly subjects and correlated positively with speech-in-noise perception and daily listening effort. Normal-hearing participants showed an increased neural response in left pre- and postcentral gyri and right middle frontal gyrus for incongruent stimuli (McGurk) compared to congruent audio-visual stimuli. Activation patterns were however not different between groups. Task-modulated functional connectivity differed between groups showing increased connectivity from auditory cortex to visual, parietal and frontal areas in hard of hearing participants as compared to normal-hearing participants when comparing incongruent stimuli (McGurk) with congruent audio-visual stimuli. These results suggest that changes in functional connectivity of auditory cortex rather than activation strength during processing of audio-visual McGurk stimuli accompany age-related hearing loss.

Short-range and long-range neuronal oscillatory coupling in multiple frequency bands during face perception

Neuronal oscillatory activity has been considered to play a key role in face processing through its functional effect on information flow and exchange in human brain. Specifically, most neuronal oscillatory activity is measured in different rhythm based on the electrophysiological signal at single channel level. Although, the neuronal oscillatory coupling between neuronal assembles is associated with the information flow and exchange between brain regions, few studies focus on this type of neuronal oscillatory activity in face processing. In this study, the neuronal oscillatory coupling was investigated based on electroencephalographic (EEG) data of 20 participants, which were recorded when the participants were in a face/non-face perceptual task. The phase lag index (PLI) was used to assess the neuronal oscillatory coupling between brain regions in typical frequency bands. Enhanced short-range coupling was observed in theta (4-8 Hz) and alpha (8-12 Hz) band over the frontal region, in gamma1 (30-49 Hz) band over the left posterior and occipito-temporal regions, and in gamma2 (51-75 Hz) over the right temporal region during face perception compared with non-face perception. Long-range coupling was increased in theta and gamma band over the right hemisphere during face perception. Moreover, increased long-range coupling was observed in alpha band over the left and right hemisphere respectively during face perception. The results suggested that frequency-specific neuronal oscillatory coupling within and between regions of frontal cortex and the ventral visual pathway played an important role in face perception, which might reflect underlying neural mechanism of face perception.

Becoming sexy: Contrapposto pose increases attractiveness ratings and modulates observers' brain activity

Previous neurophysiological studies have revealed the neural correlates of human body form perception, as well as those related to the perception of attractive body sizes. In the current study we aimed to extend the neurophysiological studies regarding body perception by investigating the perception of human body posture to provide insights into the cognitive mechanisms responsive to bodily form, and the processing of its attractiveness. To achieve these aims, we used the contrapposto posture which creates an exaggeration of low waist to hip ratio (WHR), an indicator of women's attractiveness. Electroencephalogram (EEG) signals were recorded while participants completed both (i) an oddball task presenting female body forms differing in pose (contrapposto vs. standing) and viewing angle (anterior vs. posterior), and (ii) a subsequent active attractiveness judgement task. Behavioral results showed that a contrapposto pose is considered more attractive than a neutral standing pose. Results at the neural level showed that body posture modulates the visual information processing in early ERP components, indicating attentional variations depending on human body posture; as well as in late components, indicating further differences in attention and attractiveness judgement of stimuli varying in body pose. Furthermore, the LORETA results identified the middle temporal gyrus as well as angular gyrus as the key brain regions activated in association with the perception and attractiveness judgment of females' bodies with different body poses. Overall, the current paper suggests the evolutionary adaptive preference for lower WHRs as in the contrapposto pose activating brain regions associated with visual perception and attractiveness judgement.

Impaired face-like object recognition in premanifest Huntington's disease

Progressive striatal atrophy has long been considered the pathological hallmark of Huntington's disease (HD), but is it now recognized that malfunction and degeneration of posterior-cortical territories are also prominent characteristics of the disease. The limited knowledge about the functional impact of these posterior-cortical changes could be partially attributed to the lack of sensitive measures to capture them. We hypothesized that early malfunction of specific territories of the ventral visual pathway in premanifest HD would lead to difficulties in the recognition of complex stimuli and to differences in their neurophysiological correlates. To test this idea, we used an object, face and face-like object recognition task to be conducted during an electroencephalographic recording. Compared to healthy-matched controls, premanifest participants showed a significantly increased number of recognition errors in the face-like object condition. Moreover, premanifest participants showed a dramatic decrease in the N170 component elicited for the face-like objects. This N170 decrease was significantly associated with the number of recognition errors and with severity of apathy and global cognitive performance. The lack of differences in other clinical and cognitive measures supports a selective deficit in recognition of face-like objects and their neurophysiological correlates in premanifest HD. These deficits occurred in participants up to 15 years before the estimated time to disease onset and correlated strongly with cognitive and behavioral measures known to be sensitive to HD progression. This finding highlights the existence of selective visuoperceptive deficits years before motor-based onset of HD and emphasizes the need to develop sensitive measures to capture early visual system changes in this population. Assessing the integrity of the visual cortex and its related functions in HD could help to identify early markers of disease progression.

Dual-Task Interference on Early and Late Stages of Facial Emotion Detection Is Revealed by Human Electrophysiology

Rapid and accurate processing of potential social threats is paramount to social thriving, and provides a clear evolutionary advantage. Though automatic processing of facial expressions has been assumed for some time, some researchers now question the extent to which this is the case. Here, we provide electrophysiological data from a psychological refractory period (PRP) dual-task paradigm in which participants had to decide whether a target face exhibited a neutral or fearful expression, as overlap with a concurrent auditory tone categorization task was experimentally manipulated. Specifically, we focused on four event-related potentials (ERP) linked to emotional face processing, covering distinct processing stages and topography: the early posterior negativity (EPN), early frontal positivity (EFP), late positive potential (LPP), and also the face-sensitive N170. As expected, there was an emotion modulation of each ERP. Most importantly, there was a significant attenuation of this emotional response proportional to the degree of task overlap for each component, except the N170. In fact, when the central overlap was greatest, this emotion-specific amplitude was statistically null for the EFP and LPP, and only marginally different from zero for the EPN. N170 emotion modulation was, on the other hand, unaffected by central overlap. Thus, our results show that emotion-specific ERPs for three out of four processing stages—i.e., perceptual encoding (EPN), emotion detection (EFP), or content evaluation (LPP)—are attenuated and even eliminated by central resource scarcity. Models assuming automatic processing should be revised to account for these results.

A robust implicit measure of facial attractiveness discrimination

Decisions of attractiveness from the human face are made instantly and spontaneously, but robust implicit neural measures of facial attractiveness discrimination are currently lacking. Here we applied fast periodic visual stimulation coupled with electroencephalography (EEG) to objectively measure the neural coding of facial attractiveness. We presented different pictures of faces at 6 Hz, i.e. six faces/second, for a minute while participants attended to a central fixation cross and indicated whether the cross shortly changed color. Every other face in the stimulation was attractive and was replaced by a relatively less attractive face. This resulted in alternating more/less attractive faces at a 3 Hz rate, eliciting a significant increase in occipito-temporal EEG amplitude at 3 Hz both at the group and the individual participant level. This response was absent in two control conditions where either only attractive or only less attractive faces were presented. These observations support the view that face-sensitive visual areas discriminate attractiveness implicitly and rapidly from the human face.

Rapid stream stimulation can enhance the stimulus selectivity of early evoked responses to written characters but not faces

The recognition potential (RP) is an early visually evoked response (~250 ms) whose magnitude is sensitive to object recognizability and related factors. The RP is often measured when objects are embedded in a rapid stream of masking stimuli (the RSS paradigm), especially in reading research. The idea is that RSS provides greater stimulus-dependent variations in RP, compared to the corresponding variations without RSS. However, this idea has never been subject to systematic evaluation. We directly test whether RSS can enhance 2 types of RP stimulus selectivity, by measuring the RP in conditions that only differ in the presence or absence of a masking stream and in the type of stimulus shown. We measure the effect of image inversion on RP for Chinese characters (experiment 1); the effect of orthographical correctness on RP for Chinese characters (experiment 3); and as a control study, the effect of image inversion on the N170 response to faces (experiment 2). To ensure a fair comparison, the earliest negative deflections (RP/N170) measured with and without RSS should at least have similar channel ranges, and topographical distributions of both amplitude and selectivity. Our first set of results clearly supports this. Our main results clearly show an increase in stimulus-selectivity for RSS over non-RSS in both of the RP (Chinese character) experiments, but no such enhancement in the N170 (face) experiment. This provides incentive for investigations into the underlying mechanisms of selectivity enhancement. Our findings may also help to explain contradictory findings between RP/N170 studies that differ only in the use of noise masks, which is sometimes treated as trivial detail in papers that do not reference the RP/RSS literature.

The inferior occipital gyrus is a major cortical source of the face-evoked N170: Evidence from simultaneous scalp and intracerebral human recordings

The sudden onset of a face image leads to a prominent face-selective response in human scalp electroencephalographic (EEG) recordings, peaking 170 ms after stimulus onset at occipito-temporal (OT) scalp sites: the N170 (or M170 in magnetoencephalography). According to a widely held view, the main cortical source of the N170 lies in the fusiform gyrus (FG), whereas the posteriorly located inferior occipital gyrus (IOG) would rather generate earlier face-selective responses. Here, we report neural responses to upright and inverted faces recorded in a unique patient using multicontact intracerebral electrodes implanted in the right IOG and in the OT sulcus above the right lateral FG (LFG). Simultaneous EEG recordings on the scalp identified the N170 over the right OT scalp region. The latency and amplitude of this scalp N170 were correlated at the single-trial level with the N170 recorded in the lateral IOG, close to the scalp lateral occipital surface. In addition, a positive component maximal around the latency of the N170 (a P170) was prominent above the internal LFG, whereas this region typically generates an N170 (or "N200") over its external/ventral surface. This suggests that electrophysiological responses in the LFG manifest as an equivalent dipole oriented mostly along the vertical axis with likely minimal projection to the lateral OT scalp region. Altogether, these observations provide evidence that the IOG is a major cortical generator of the face-selective scalp N170, qualifying the potential contribution of the FG and questioning a strict serial spatiotemporal organization of the human cortical face network.