The role of spatial frequency information for ERP components sensitive to faces and emotional facial expression

Reduced spatial frequency differentiation and sex-related specificities in fearful face detection in autism: Insights from EEG and the predictive brain model

Face processing relies on predictive processes driven by low spatial frequencies (LSF) that convey coarse information prior to fine information conveyed by high spatial frequencies. However, autistic individuals might have atypical predictive processes, contributing to facial processing difficulties. This may be more normalized in autistic females, who often exhibit better socio-communicational abilities than males. We hypothesized that autistic females would display a more typical coarse-to-fine processing for socio-emotional stimuli compared to autistic males. To test this hypothesis, we asked adult participants (44 autistic, 51 non-autistic) to detect fearful faces among neutral faces, filtered in two orders: from coarse-to-fine (CtF) and from fine-to-coarse (FtC). Results show lower d' values and longer reaction times for fearful detection in autism compared to non-autistic (NA) individuals, regardless of the filtering order. Both groups presented shorter P100 latency after CtF compared to FtC, and larger amplitude for N170 after FtC compared to CtF. However, autistic participants presented a reduced difference in source activity between CtF and FtC in the fusiform. There was also a more spatially spread activation pattern in autistic females compared to NA females. Finally, females had faster P100 and N170 latencies, as well as larger occipital activation for FtC sequences than males, irrespective of the group. Overall, the results do not suggest impaired predictive processes from LSF in autism despite behavioral differences in fear detection. However, they do indicate reduced brain modulation by spatial frequency in autism. In addition, the findings highlight sex differences that warrant consideration in understanding autistic females.

Measurement of the N170 during facial neuromuscular electrical stimulation (fNMES)

BACKGROUND

Studies on facial feedback effects typically employ props or posed facial expressions, which often lack temporal precision and muscle specificity.

NEW METHOD

Facial Neuromuscular Electrical Stimulation (fNMES) allows for a controlled influence of contractions of facial muscles, and may be used to advance our understanding of facial feedback effects, especially when combined with Electroencephalography (EEG). However, electrical stimulation introduces significant interference that can mask underlying brain dynamics. Whether established signal processing methods can allow for a reduction of said interference whilst retaining effects of interest, remains unexplored.

RESULTS

We addressed these questions focusing on the classic N170 visual evoked potential, a face-sensitive brain component: 20 participants viewed images of houses, and of sad, happy, and neutral faces. On half of the trials, fNMES was delivered to bilateral lower-face muscles during the presentation of visual stimuli. A larger N170 amplitude was found for faces relative to houses. Interestingly, this was the case both without and during fNMES, regardless of whether the fNMES artefact was removed or not. Moreover, sad facial expressions elicited a larger N170 amplitude relative to neutral facial expressions, both with and without fNMES.

COMPARISON WITH EXISTING METHODS

fNMES offers a more precise way of manipulating proprioceptive feedback from facial muscles, which affords greater diversity in experimental design for studies on facial feedback effects.

CONCLUSIONS

We show that the combining of fNMES and EEG can be achieved and may serve as a powerful means of exploring the impact of controlled proprioceptive inputs on various types of cognitive processing.

The Dot-Probe Attention Bias Task as a Method to Assess Psychological Well-Being after Anesthesia: A Study with Adult Female Long-Tailed Macaques (Macaca fascicularis)

Understanding the impact routine research and laboratory procedures have on animals is crucial to improving their well-being and to the success and reproducibility of the research they are involved in. Cognitive measures of welfare offer insight into animals' internal psychological state, but require validation. Attention bias - the tendency to attend to one type of information over another - is a cognitive phenomenon documented in humans and animals that is known to be modulated by affective state (i.e., emotions). Hence, changes in attention bias may offer researchers a deeper perspective of their animals' psychological well-being. The dot-probe task is an established method for quantifying attention bias in humans (by measuring reaction time to a dot-probe replacing pairs of stimuli), but has yet to be validated in animals. We developed a dot-probe task for long-tailed macaques (Macaca fascicularis) to determine if the task can detect changes in attention bias following anesthesia, a context known to modulate attention and trigger physiological arousal in macaques. Our task included the following features: stimulus pairs of threatening and neutral facial expressions of conspecifics and their scrambled counterparts, two stimuli durations (100 and 1,000 ms), and counterbalancing of the dot-probe's position on the touchscreen (left and right) and location relative to the threatening stimulus. We tested 8 group-housed adult females on different days relative to being anesthetized (baseline and 1-, 3-, 7-, and 14-days after). At baseline, monkeys were vigilant to threatening content when stimulus pairs were presented for 100 ms, but not 1,000 ms. On the day immediately following anesthesia, we found evidence that attention bias changed to an avoidance of threatening content. Attention bias returned to threat vigilance by the third day postanesthesia and remained so up to the last day of testing (14-days after anesthesia). We also found that attention bias was independent of the type of stimuli pair (i.e., whole face vs. scrambled counterparts), suggesting that the scrambled stimuli retained aspects of the original stimuli. Nevertheless, whole faces were more salient to the monkeys as responses to these trials were generally slower than to scrambled stimulus pairs. Overall, our study suggests it is feasible to detect changes in attention bias following anesthesia using the dot-probe task in nonhuman primates. Our results also reveal important aspects of stimulus preparation and experimental design.

The Time Sequence of Face Spatial Frequency Differs During Working Memory Encoding and Retrieval Stages

Previous studies have found that P1 and P2 components were more sensitive to configural and featural face processing, respectively, when attentional resources were sufficient, suggesting that face processing follows a coarse-to-fine sequence. However, the role of working memory (WM) load in the time course of configural and featural face processing is poorly understood, especially whether it differs during encoding and retrieval stages. This study employed a delayed recognition task with varying WM load and face spatial frequency (SF). Our behavioral and ERP results showed that WM load modulated face SF processing. Specifically, for the encoding stage, P1 and P2 were more sensitive to broadband SF (BSF) faces, while N170 was more sensitive to low SF (LSF) and BSF faces. For the retrieval stage, P1 on the right hemisphere was more sensitive to BSF faces relative to HSF faces, N170 was more sensitive to LSF faces than HSF faces, especially under the load 1 condition, while P2 was more sensitive to high SF (HSF) faces than HSF faces, especially under load 3 condition. These results indicate that faces are perceived less finely during the encoding stage, whereas face perception follows a coarse-to-fine sequence during the retrieval stage, which is influenced by WM load. The coarse and fine information were processed especially under the low and high load conditions, respectively.

Differences in cortical processing of facial emotions in broader autism phenotype

Autism Spectrum Disorder (ASD) is a heterogeneous condition that affects face perception. Evidence shows that there are differences in face perception associated with the processing of low spatial frequency (LSF) and high spatial frequency (HSF) of visual stimuli between non-symptomatic relatives of individuals with autism (broader autism phenotype, BAP) and typically developing individuals. However, the neural mechanisms involved in these differences are not fully understood. Here we tested whether face-sensitive event related potentials could serve as neuronal markers of differential spatial frequency processing, and whether these potentials could differentiate non-symptomatic parents of children with autism (pASD) from parents of typically developing children (pTD). To this end, we performed electroencephalographic recordings of both groups of parents while they had to recognize emotions of face pictures composed of the same or different emotions (happiness or anger) presented in different spatial frequencies. We found no significant differences in the accuracy between groups but lower amplitude modulation in the Late Positive Potential activity in pASD. Source analysis showed a difference in the right posterior part of the superior temporal region that correlated with ASD symptomatology of the child. These results reveal differences in brain processing of recognition of facial emotion in BAP that could be a precursor of ASD.

High spatial frequency filtered primes hastens happy faces categorization in autistic adults

Coarse information of a visual stimulus is conveyed by Low Spatial Frequencies (LSF) and is thought to be rapidly extracted to generate predictions. This may guide fast recognition with the subsequent integration of fine information, conveyed by High Spatial Frequencies (HSF). In autism, emotional face recognition is challenging, and might be related to alterations in LSF predictive processes. We analyzed the data of 27 autistic and 34 non autistic (NA) adults on an emotional Stroop task (i.e., emotional face with congruent or incongruent emotional word) with spatially filtered primes (HSF vs.LSF). We hypothesized that LSF primes would generate predictions leading to faster categorization of the target face compared to HSF primes, in the NA group but not in autism. Surprisingly, HSF primes led to faster categorization than LSF primes in both groups. Moreover, the advantage of HSF vs.LSF primes was stronger for angry than happy faces in NA, but was stronger for happy than angry faces in autistic participants. Drift diffusion modelling confirmed HSF advantage and showed a longer non-decision time (e.g., encoding) in autism. Despite LSF predictive impairments in autism was not corroborated, our analyses suggest low level processing specificities in autism.

Processing of facial expressions of same-race and other-race faces: distinct and shared neural underpinnings

People understand others’ emotions quickly from their facial expressions. However, facial expressions of ingroup and outgroup members may signal different social information and thus be mediated by distinct neural activities. We investigated whether there are distinct neuronal responses to fearful and happy expressions of same-race (SR) and other-race (OR) faces. We recorded electroencephalogram from Chinese adults when viewing an adaptor face (with fearful/neutral expressions in Experiment 1 but happy/neutral expressions in Experiment 2) and a target face (with fearful expressions in Experiment 1 but happy expressions in Experiment 2) presented in rapid succession. We found that both fearful and happy (vs neutral) adaptor faces increased the amplitude of a frontocentral positivity (P2). However, a fearful but not happy (vs neutral) adaptor face decreased the P2 amplitudes to target faces, and this repetition suppression (RS) effect occurred when adaptor and target faces were of the same race but not when of different races. RS was observed on two late parietal/central positive activities to fearful/happy target faces, which, however, occurred regardless of whether adaptor and target faces were of the same or different races. Our findings suggest that early affective processing of fearful expressions may engage distinct neural activities for SR and OR faces.

APOE ε4 and cognitive reserve effects on the functional network in the Alzheimer's disease spectrum

The apolipoprotein E (APOE) ε4 allele is a genetic risk factor for Alzheimer's disease, whereas educational attainments have protective effects against cognitive decline in aging and patients with Alzheimer's disease. We examined the possible effects of years of education and APOE genotype on the topological properties of the functional network in normal aging, mild cognitive impairment and Alzheimer's disease. The years of education showed a significant, negative association with the local efficiency, clustering coefficient and small-worldness of functional networks in APOE ε4 noncarriers but not in ε4 carriers. These associations were mainly observed in normal aging and were reduced in mild cognitive impairment and Alzheimer's disease. Moreover, regions of the inferior frontal gyrus, temporal pole, and cuneus also showed correlations between education and nodal degree. Our findings demonstrated that the protective effects of education persist in APOE ε4 noncarriers but diminish in ε4 carriers. In addition, the protective effects of education were attenuated or reduced in the progression of Alzheimer's disease.

Learning dynamics of electrophysiological brain signals during human fear conditioning

Electrophysiological studies in rodents allow recording neural activity during threats with high temporal and spatial precision. Although fMRI has helped translate insights about the anatomy of underlying brain circuits to humans, the temporal dynamics of neural fear processes remain opaque and require EEG. To date, studies on electrophysiological brain signals in humans have helped to elucidate underlying perceptual and attentional processes, but have widely ignored how fear memory traces evolve over time. The low signal-to-noise ratio of EEG demands aggregations across high numbers of trials, which will wash out transient neurobiological processes that are induced by learning and prone to habituation. Here, our goal was to unravel the plasticity and temporal emergence of EEG responses during fear conditioning. To this end, we developed a new sequential-set fear conditioning paradigm that comprises three successive acquisition and extinction phases, each with a novel CS+/CS- set. Each set consists of two different neutral faces on different background colors which serve as CS+ and CS-, respectively. Thereby, this design provides sufficient trials for EEG analyses while tripling the relative amount of trials that tap into more transient neurobiological processes. Consistent with prior studies on ERP components, data-driven topographic EEG analyses revealed that ERP amplitudes were potentiated during time periods from 33-60 ms, 108-200 ms, and 468-820 ms indicating that fear conditioning prioritizes early sensory processing in the brain, but also facilitates neural responding during later attentional and evaluative stages. Importantly, averaging across the three CS+/CS- sets allowed us to probe the temporal evolution of neural processes: Responses during each of the three time windows gradually increased from early to late fear conditioning, while long-latency (460-730 ms) electrocortical responses diminished throughout fear extinction. Our novel paradigm demonstrates how short-, mid-, and long-latency EEG responses change during fear conditioning and extinction, findings that enlighten the learning curve of neurophysiological responses to threat in humans.

Suppression durations for facial expressions under breaking continuous flash suppression: effects of faces' low-level image properties

Perceptual biases for fearful facial expressions are observed across many studies. According to the low-level, visual-based account of these biases, fear expressions are advantaged in some way due to their image properties, such as low spatial frequency content. However, there is a degree of empirical disagreement regarding the range of spatial frequency information responsible for perceptual biases. Breaking continuous flash suppression (b. CFS) has explored these effects, showing similar biases for detecting fearful facial expressions. Recent findings from a b. CFS study highlight the role of high, rather than low spatial frequency content in determining faces' visibility. The present study contributes to ongoing discussions regarding the efficacy of b. CFS, and shows that the visibility of facial expressions vary according to how they are normalised for physical contrast and spatially filtered. Findings show that physical contrast normalisation facilitates fear's detectability under b. CFS more than when normalised for apparent contrast, and that this effect is most pronounced when faces are high frequency filtered. Moreover, normalising faces' perceived contrast does not guarantee equality between expressions' visibility under b. CFS. Findings have important implications for the use of contrast normalisation, particularly regarding the extent to which contrast normalisation facilitates fear bias effects.

Effects of Spatial Frequency Filtering Choices on the Perception of Filtered Images

The early visual system is composed of spatial frequency-tuned channels that break an image into its individual frequency components. Therefore, researchers commonly filter images for spatial frequencies to arrive at conclusions about the differential importance of high versus and low spatial frequency image content. Here, we show how simple decisions about the filtering of the images, and how they are displayed on the screen, can result in drastically different behavioral outcomes. We show that jointly normalizing the contrast of the stimuli is critical in order to draw accurate conclusions about the influence of the different spatial frequencies, as images of the real world naturally have higher contrast energy at low than high spatial frequencies. Furthermore, the specific choice of filter shape can result in contradictory results about whether high or low spatial frequencies are more useful for understanding image content. Finally, we show that the manner in which the high spatial frequency content is displayed on the screen influences how recognizable an image is. Previous findings that make claims about the visual system's use of certain spatial frequency bands should be revisited, especially if their methods sections do not make clear what filtering choices were made.

Testing the magnocellular-pathway advantage in facial expressions processing for consistency over time

The ability to identify facial expressions rapidly and accurately is central to human evolution. Previous studies have demonstrated that this ability relies to a large extent on the magnocellular, rather than parvocellular, visual pathway, which is biased toward processing low spatial frequencies. Despite the generally consistent finding, no study to date has investigated the reliability of this effect over time. In the present study, 40 participants completed a facial emotion identification task (fearful, happy, or neutral faces) using facial images presented at three different spatial frequencies (low, high, or broad spatial frequency), at two time points separated by one year. Bayesian statistics revealed an advantage for the magnocellular pathway in processing facial expressions; however, no effect for time was found. Furthermore, participants' RT patterns of results were highly stable over time. Our replication, together with the consistency of our measurements within subjects, underscores the robustness of this effect. This capacity, therefore, may be considered in a trait-like manner, suggesting that individuals may possess various ability levels for processing facial expressions that can be captured in behavioral measurements.

Filtered beauty in Oslo and Tokyo: A spatial frequency analysis of facial attractiveness

Images of European female and male faces were digitally processed to generate spatial frequency (SF) filtered images containing only a narrow band of visual information within the Fourier spectrum. The original unfiltered images and four SF filtered images (low, medium-low, medium-high and high) were then paired in trials that kept constant SF band and face gender and participants made a forced-choice decision about the more attractive among the two faces. In this way, we aimed at identifying those specific SF bands where forced-choice preferences corresponded best to forced-choice judgements made when viewing the natural, broadband, facial images. We found that aesthetic preferences dissociated across SFs and face gender, but similarly for participants from Asia (Japan) and Europe (Norway). Specifically, preferences when viewing SF filtered images were best related to the preference with the broadband face images when viewing the highest filtering band for the female faces (about 48-77 cycles per face). In contrast, for the male faces, the medium-low SF band (about 11-19 cpf) related best to choices made with the natural facial images. Eye tracking provided converging evidence for the above, gender-related, SF dissociations. We suggest greater aesthetic relevance of the mobile and communicative parts for the female face and, conversely, of the rigid, structural, parts for the male face for facial aesthetics.

Towards a Dynamic Exploration of Vision, Cognition and Emotion in Alcohol-Use Disorders

Abstract: Visuoperceptive impairments are among the most frequently reported deficits in alcohol-use disorders, but only very few studies have investigated their origin and interactions with other categories of dysfunctions. Besides, these deficits have generally been interpreted in a linear bottom-up perspective, which appears very restrictive with respect to the new models of vision developed in healthy populations. Indeed, new theories highlight the predictive nature of the visual system and demonstrate that it interacts with higher-level cognitive functions to generate top-down predictions. These models nota-bly posit that a fast but coarse visual analysis involving magnocellular pathways helps to compute heuristic guesses regard-ing the identity and affective value of inputs, which are used to facilitate conscious visual recognition. Building on these new proposals, the present review stresses the need to reconsider visual deficits in alcohol-use disorders as they might have cru-cial significance for core features of the pathology, such as attentional bias, loss of inhibitory control and emotion decoding impairments. Centrally, we suggest that individuals with severe alcohol-use disorders could present with magnocellular dam-age and we defend a dynamic explanation of the deficits. Rather than being restricted to high-level processes, deficits could start at early visual stages and then extend and potentially intensify during following steps due to reduced cerebral connec-tivity and dysfunctional cognitive/emotional regions. A new research agenda is specifically provided to test these hypotheses.

The Role of Low-Spatial Frequency Components in the Processing of Deceptive Faces: A Study Using Artificial Face Models

Interpreting another's true emotion is important for social communication, even in the face of deceptive facial cues. Because spatial frequency components provide important clues for recognizing facial expressions, we investigated how we use spatial frequency information from deceptive faces to interpret true emotion. We conducted two different tasks: a face-generating experiment in which participants were asked to generate deceptive and genuine faces by tuning the intensity of happy and angry expressions (Experiment 1) and a face-classification task in which participants had to classify presented faces as either deceptive or genuine (Experiment 2). Low- and high-spatial frequency (LSF and HSF) components were varied independently. The results showed that deceptive happiness (i.e., anger is the hidden expression) involved different intensities for LSF and HSF. These results suggest that we can identify hidden anger by perceiving unbalanced intensities of emotional expression between LSF and HSF information contained in deceptive faces.

Influence of EEG References on N170 Component in Human Facial Recognition

The choice of the reference electrode scheme is an important step in event-related potential (ERP) analysis. In order to explore the optimal electroencephalogram reference electrode scheme for the ERP signal related to facial recognition, we investigated the influence of average reference (AR), mean mastoid reference (MM), and Reference Electrode Standardization Technique (REST) on the N170 component via statistical analysis, statistical parametric scalp mappings (SPSM) and source analysis. The statistical results showed that the choice of reference electrode scheme has little effect on N170 latency (p > 0.05), but has an significant impact on N170 amplitude (p < 0.05). ANOVA results show that, for the three references scheme, there was statistically significant difference between N170 latency and amplitude induced by the unfamiliar face and that induced by the scrambled face (p < 0.05). Specifically, the SPSM results show an anterior and a temporo-occipital distribution for AR and REST, whereas just anterior distribution shown for MM. However, the circumstantial evidence provided by source analysis is more consistent with SPSM of AR and REST, compared with that of MM. These results indicate that the experimental results under the AR and REST references are more objective and appropriate. Thus, it is more appropriate to use AR and REST reference scheme settings in future facial recognition experiments.

Time course of spatial frequency integration in face perception: An ERP study

Face perception is based on the processing and integration of multiple spatial frequency (SF) ranges. However, the temporal dynamics of SF integration to form an early face representation in the human brain is still a matter of debate. To address this issue, we recorded event-related potentials (ERPs) during the presentation of spatial frequency-manipulated facial images. Twenty-six participants performed a gender discrimination task on non-filtered, low-, high-, and band-pass filtered face images, corresponding, respectively, to the full range, spatial frequencies up to 8 cycles/image, above 32 cycles/image, and from 8 to 16 cycles/image. Behaviorally, the task related-performance was more accurate and faster for non-filtered (NF) and mid-range SF (MSF) than for low SF (LSF) and high SF (HSF) stimuli. At both behavioral and electrophysiological levels, response to MSF contained in faces did not differ from the responses to full spectrum non-filtered (NF) facial images. In ERPs, LSF facial images evoked the largest P1 amplitude while HSF facial images evoked the largest N170 amplitude compared with the other three conditions. Since LSFs and HSFs would transmit global and local information respectively, our observations lend further support to the "coarse-to-fine" processing theory of faces. Furthermore, they offer original evidence of the effectiveness and adequacy of the mid-range spatial frequency in face perception. Possible theoretical interpretations of our findings are discussed.

Pattern matters: Snakes exhibiting triangular and diamond-shaped skin patterns modulate electrophysiological activity in human visual cortex

The neural and perceptual mechanisms that support the efficient visual detection of snakes in humans are still not fully understood. According to the Snake Detection Theory, selection pressures posed by snakes on early primates have shaped the development of the visual system. Previous studies in humans have investigated early visual electrophysiological activity in response to snake images vs. various alternative dangerous or non-dangerous stimuli. These studies have shown that the Early Posterior Negativity (EPN) component is selectively elicited by snake or snake-like images. Recent findings yielded the complementary/alternative hypothesis that early humans (and possibly other primates) evolved an aversion especially for potentially harmful triangular shapes, such as teeth, claws or spikes. In the present study we investigated the effect of triangular and diamond-shaped patterns in snake skins on the ERP correlates of visual processing in humans. In the first experiment, we employed pictures of snakes displaying either triangular/diamond-shaped patterns or no particular pattern on their skins, and pictures of frogs as control. Participants observed a random visual presentation of these pictures. Consistent with previous studies, snakes elicited an enhanced negativity between 225 and 300 ms (EPN) compared to frogs. However, snakes featuring triangular/diamond-shaped patterns on their skin produced an enhanced EPN compared to the snakes that did not display such patterns. In a second experiment we used pictures displaying only skin patterns of snakes and frogs. Results from the second experiment confirmed the results of the first experiment, suggesting that triangular snake-skin patterns modulate the activity in human visual cortex. Taken together, our results constitute an important contribution to the snake detection theory.

Impairments of emotional face processing in schizophrenia patients: Evidence from P100, N170 and P300 ERP components in a sample of auditory hallucinators

Patients with schizophrenia show impaired face and emotional expression processing that may be due to early perceptual deficits or late impairments in higher-order emotional facial recognition. This study examined event-related potentials (ERPs) in 23 patients with schizophrenia who experience auditory hallucinations and 19 healthy controls. EEG activity was recorded from 32 scalp sites positioned according to the 10-10 placement system. Linked left and right electrodes at the mastoids served as the reference. The P100, N170 and P300 were measured during an emotional facial identification task, which included neutral, joyful, sad, angry and fearful facial expressions and non-face stimuli (chairs). P100 was measured at O_1/2 and P_7/8. N170 was measured at P_7/8. P300 was measured at P_z. Patients with schizophrenia were slower at identifying all facial expressions, including neutral ones. They also showed less positive P100 amplitude to sad, angry and fearful facial expressions. N170 amplitudes were smaller in patients in response to neutral, joyful, sad, angry, and fearful facial expression. Patients showed less positive P300 mean amplitudes to all facial expressions, including neutral ones. Within-group comparisons showed that patients exhibited a different pattern of ERP modulation across facial expressions than controls for P100 and N170, but not for P300. Our findings are compatible with the idea that behavioural and electrophysiological face-processing deficits in schizophrenia arise from early-stage deficits in visual processing.

Differential Effects of Intranasal Vasopressin on the Processing of Adult and Infant Cues: An ERP Study

Arginine vasopressin (AVP) is a powerful regulator of various social behaviors across many species. However, seemingly contradictory effects of AVP have been found in both animal and human studies, e.g., promoting aggression on one hand and facilitating social bonding on the other hand. Therefore, we hypothesize that the role of AVP in social behaviors is context-dependent. To this end, we examined the modulatory effect of AVP on male’s behavioral and neural responses to infant and adult cues. After intranasal and double-blind treatment of AVP or placebo, male participants were asked to rate their subjective approaching willingness to infant and adult faces in specific contexts informed by cue words while EEG recording. Our results showed that AVP treatment increased approaching ratings to neutral and positive other-gender adult faces compared to emotional matched same-gender adult faces, and to negative girl faces compared to negative boy faces. Furthermore, compared to placebo treatment, AVP treatment induced larger N1 amplitudes to neutral cues associated with both adults and infants, whereas AVP treatment only sustained pronounced late positive potential amplitudes to neutral cues of infants but not adults. Those findings implicate differential roles of AVP in the processing of adult- and infant-related cues and thus lend support to the context-dependent account.

Effects of Repeated Concussions and Sex on Early Processing of Emotional Facial Expressions as Revealed by Electrophysiology

OBJECTIVES

Concussions affect the processing of emotional stimuli. This study aimed to investigate how sex interacts with concussion effects on early event-related brain potentials (ERP) measures (P1, N1) of emotional facial expressions (EFE) processing in asymptomatic, multi-concussion athletes during an EFE identification task.

METHODS

Forty control athletes (20 females and 20 males) and 43 multi-concussed athletes (22 females and 21 males), recruited more than 3 months after their last concussion, were tested. Participants completed the Beck Depression Inventory II, the Beck Anxiety Inventory, the Post-Concussion Symptom Scale, and an Emotional Facial Expression Identification Task. Pictures of male and female faces expressing neutral, angry, and happy emotions were randomly presented and the emotion depicted had to be identified as fast as possible during EEG acquisition.

RESULTS

Relative to controls, concussed athletes of both sex exhibited a significant suppression of P1 amplitude recorded from the dominant right hemisphere while performing the emotional face expression identification task. The present study also highlighted a sex-specific suppression of the N1 component amplitude after concussion which affected male athletes.

CONCLUSIONS

These findings suggest that repeated concussions alter the typical pattern of right-hemisphere response dominance to EFE in early stages of EFE processing and that the neurophysiological mechanisms underlying the processing of emotional stimuli are distinctively affected across sex. (JINS, 2018, 24, 673-683).

Revealing the neural time-course of direct gaze processing via spatial frequency manipulation of faces

Direct gaze is a powerful social cue signalling the attention of another person toward oneself. Here we investigated the relevance of low spatial frequency (LSF) and high spatial frequency (HSF) in facial cues for direct gaze processing. We identified two distinct peaks in the ERP response, the N170 and N240 components. These two components were related to different stimulus conditions and influenced by different spatial frequencies. In particular, larger N170 and N240 amplitudes were observed for direct gaze than for averted gaze, but only in the N240 component was this effect modulated by spatial frequency, where it was reliant in LSF information. By contrast, larger N170 and N240 components were observed for faces than for non-facial stimuli, but this effect was only modulated by spatial frequency in the N170 component, where it relied on HSF information. The present study highlights the existence of two functionally distinct components related to direct gaze processing.

The influence of spatial frequency content on facial expression processing: An ERP study using rapid serial visual presentation

Spatial frequency (SF) contents have been shown to play an important role in emotion perception. This study employed event-related potentials (ERPs) to explore the time course of neural dynamics involved in the processing of facial expression conveying specific SF information. Participants completed a dual-target rapid serial visual presentation (RSVP) task, in which SF-filtered happy, fearful, and neutral faces were presented. The face-sensitive N170 component distinguished emotional (happy and fearful) faces from neutral faces in a low spatial frequency (LSF) condition, while only happy faces were distinguished from neutral faces in a high spatial frequency (HSF) condition. The later P3 component differentiated between the three types of emotional faces in both LSF and HSF conditions. Furthermore, LSF information elicited larger P1 amplitudes than did HSF information, while HSF information elicited larger N170 and P3 amplitudes than did LSF information. Taken together, these results suggest that emotion perception is selectively tuned to distinctive SF contents at different temporal processing stages.

Positive Classification Advantage: Tracing the Time Course Based on Brain Oscillation

The present study aimed to explore the modulation of frequency bands (alpha, beta, theta) underlying the positive facial expressions classification advantage within different post-stimulus time intervals (100–200 ms, 200–300 ms, 300–400 ms). For this purpose, we recorded electroencephalogram (EEG) activity during an emotion discrimination task for happy, sad and neutral faces. The correlation between the non-phase-locked power of frequency bands and reaction times (RTs) was assessed. The results revealed that beta played a major role in positive classification advantage (PCA) within the 100–200 and 300–400 ms intervals, whereas theta was important within the 200–300 ms interval. We propose that the beta band modulated the neutral and emotional face classification process, and that the theta band modulated for happy and sad face classification.

N170 Reveals the Categorical Perception Effect of Emotional Valence

As an important attribute of facial expression, emotional valence has been well explored, but its processing mechanisms remain ambiguous. Investigating the categorical perception (CP) of emotional valence might help uncover the objective basis of the subjective dichotomy of emotional valence and identify the stage at which this processing of valence information might occur. A judgment task was used in the current study with stimuli from the within- or between-category condition, in which participants were required to decide whether two presented faces showed the same emotion. The results of the behavioral experiment revealed a significant CP effect of emotional valence, with faster RTs and greater accuracy for the between- than for the within-category stimuli. In the ERP experiment, the N170 (peaking at approximately 150-170 ms) was found to reflect the CP effect of emotional valence, with a larger amplitude for the within- than for the between-category condition. In contrast, the P1 component (peaking at approximately 100-130 ms) was insensitive to the CP effect of emotional valence. These results reveal the existence of the CP of emotional valence and indicate that the N170 is its earliest electrophysiological index. Therefore, the categorization of emotional valence not only has an objective neural basis but occurs at a relatively early stage of processing.

Insensitivity to Fearful Emotion for Early ERP Components in High Autistic Tendency Is Associated with Lower Magnocellular Efficiency

Low spatial frequency (LSF) visual information is extracted rapidly from fearful faces, suggesting magnocellular involvement. Autistic phenotypes demonstrate altered magnocellular processing, which we propose contributes to a decreased P100 evoked response to LSF fearful faces. Here, we investigated whether rapid processing of fearful facial expressions differs for groups of neurotypical adults with low and high scores on the Autistic Spectrum Quotient (AQ). We created hybrid face stimuli with low and high spatial frequency filtered, fearful, and neutral expressions. Fearful faces produced higher amplitude P100 responses than neutral faces in the low AQ group, particularly when the hybrid face contained a LSF fearful expression. By contrast, there was no effect of fearful expression on P100 amplitude in the high AQ group. Consistent with evidence linking magnocellular differences with autistic personality traits, our non-linear VEP results showed that the high AQ group had higher amplitude K2.1 responses than the low AQ group, which is indicative of less efficient magnocellular recovery. Our results suggest that magnocellular LSF processing of a human face may be the initial visual cue used to rapidly and automatically detect fear, but that this cue functions atypically in those with high autistic tendency.

Emotion Processing by ERP Combined with Development and Plasticity

Emotions important for survival and social interaction have received wide and deep investigations. The application of the fMRI technique into emotion processing has obtained overwhelming achievements with respect to the localization of emotion processes. The ERP method, which possesses highly temporal resolution compared to fMRI, can be employed to investigate the time course of emotion processing. The emotional modulation of the ERP component has been verified across numerous researches. Emotions, described as dynamically developing along with the growing age, have the possibility to be enhanced through learning (or training) or to be damaged due to disturbances in growth, which is underlain by the neural plasticity of emotion-relevant nervous systems. And mood disorders with typical symptoms of emotion discordance probably have been caused by the dysfunctional neural plasticity.

The role of spatial frequency in emotional face classification

Previous studies with emotional face stimuli have revealed that our ability to identify different emotional states is dependent on the faces' spatial frequency content. However, these studies typically only tested a limited number of emotional states. In the present study, we measured the consistency with which 24 different emotional states are classified when the faces are unfiltered, high-, or low-pass filtered, using a novel rating method that simultaneously measures perceived arousal (high to low) and valence (pleasant to unpleasant). The data reveal that consistent ratings are made for every emotional state independent of spatial frequency content. We conclude that emotional faces possess both high- and low-frequency information that can be relied on to facilitate classification.

Bidirectional electric communication between the inferior occipital gyrus and the amygdala during face processing

Faces contain multifaceted information that is important for human communication. Neuroimaging studies have revealed face-specific activation in multiple brain regions, including the inferior occipital gyrus (IOG) and amygdala; it is often assumed that these regions constitute the neural network responsible for the processing of faces. However, it remains unknown whether and how these brain regions transmit information during face processing. This study investigated these questions by applying dynamic causal modeling of induced responses to human intracranial electroencephalography data recorded from the IOG and amygdala during the observation of faces, mosaics, and houses in upright and inverted orientations. Model comparisons assessing the experimental effects of upright faces versus upright houses and upright faces versus upright mosaics consistently indicated that the model having face-specific bidirectional modulatory effects between the IOG and amygdala was the most probable. The experimental effect between upright versus inverted faces also favored the model with bidirectional modulatory effects between the IOG and amygdala. The spectral profiles of modulatory effects revealed both same-frequency (e.g., gamma-gamma) and cross-frequency (e.g., theta-gamma) couplings. These results suggest that the IOG and amygdala communicate rapidly with each other using various types of oscillations for the efficient processing of faces. Hum Brain Mapp 38:4511-4524, 2017. © 2017 Wiley Periodicals, Inc.

An Explanation for the Role of the Amygdala in Aesthetic Judgments

It has been proposed that the top-down guidance of feature-based attention is the basis for the involvement of the amygdala in various tasks requiring emotional decision-making (Jacobs et al., 2012a). Aesthetic judgments are correlated with particular visual features and can be considered emotional in nature (Jacobs et al., 2016). Moreover, we have previously shown that various aesthetic judgments result in observers preferentially attending to different visual features (Jacobs et al., 2010). Here, we argue that—together—this explains why the amygdalae become active during aesthetic judgments of visual materials. We discuss potential implications and predictions of this theory that can be tested experimentally.

The N170 component is sensitive to face-like stimuli: a study of Chinese Peking opera makeup

The N170 component is considered a neural marker of face-sensitive processing. In the present study, the face-sensitive N170 component of event-related potentials (ERPs) was investigated with a modified oddball paradigm using a natural face (the standard stimulus), human- and animal-like makeup stimuli, scrambled control images that mixed human- and animal-like makeup pieces, and a grey control image. Nineteen participants were instructed to respond within 1000 ms by pressing the 'F' or 'J' key in response to the standard or deviant stimuli, respectively. We simultaneously recorded ERPs, response accuracy, and reaction times. The behavioral results showed that the main effect of stimulus type was significant for reaction time, whereas there were no significant differences in response accuracies among stimulus types. In relation to the ERPs, N170 amplitudes elicited by human-like makeup stimuli, animal-like makeup stimuli, scrambled control images, and a grey control image progressively decreased. A right hemisphere advantage was observed in the N170 amplitudes for human-like makeup stimuli, animal-like makeup stimuli, and scrambled control images but not for grey control image. These results indicate that the N170 component is sensitive to face-like stimuli and reflect configural processing in face recognition.

Aesthetics by Numbers: Links between Perceived Texture Qualities and Computed Visual Texture Properties

Our world is filled with texture. For the human visual system, this is an important source of information for assessing environmental and material properties. Indeed-and presumably for this reason-the human visual system has regions dedicated to processing textures. Despite their abundance and apparent relevance, only recently the relationships between texture features and high-level judgments have captured the interest of mainstream science, despite long-standing indications for such relationships. In this study, we explore such relationships, as these might be used to predict perceived texture qualities. This is relevant, not only from a psychological/neuroscience perspective, but also for more applied fields such as design, architecture, and the visual arts. In two separate experiments, observers judged various qualities of visual textures such as beauty, roughness, naturalness, elegance, and complexity. Based on factor analysis, we find that in both experiments, ~75% of the variability in the judgments could be explained by a two-dimensional space, with axes that are closely aligned to the beauty and roughness judgments. That a two-dimensional judgment space suffices to capture most of the variability in the perceived texture qualities suggests that observers use a relatively limited set of internal scales on which to base various judgments, including aesthetic ones. Finally, for both of these judgments, we determined the relationship with a large number of texture features computed for each of the texture stimuli. We find that the presence of lower spatial frequencies, oblique orientations, higher intensity variation, higher saturation, and redness correlates with higher beauty ratings. Features that captured image intensity and uniformity correlated with roughness ratings. Therefore, a number of computational texture features are predictive of these judgments. This suggests that perceived texture qualities-including the aesthetic appreciation-are sufficiently universal to be predicted-with reasonable accuracy-based on the computed feature content of the textures.

Influence of spatial frequency and emotion expression on face processing in patients with panic disorder

BACKGROUND

Deficits in facial emotion processing is a major characteristic of patients with panic disorder. It is known that visual stimuli with different spatial frequencies take distinct neural pathways. This study investigated facial emotion processing involving stimuli presented at broad, high, and low spatial frequencies in patients with panic disorder.

METHODS

Eighteen patients with panic disorder and 19 healthy controls were recruited. Seven event-related potential (ERP) components: (P100, N170, early posterior negativity (EPN); vertex positive potential (VPP), N250, P300; and late positive potential (LPP)) were evaluated while the participants looked at fearful and neutral facial stimuli presented at three spatial frequencies.

RESULTS

When a fearful face was presented, panic disorder patients showed a significantly increased P100 amplitude in response to low spatial frequency compared to high spatial frequency; whereas healthy controls demonstrated significant broad spatial frequency dependent processing in P100 amplitude. Vertex positive potential amplitude was significantly increased in high and broad spatial frequency, compared to low spatial frequency in panic disorder. Early posterior negativity amplitude was significantly different between HSF and BSF, and between LSF and BSF processing in both groups, regardless of facial expression.

LIMITATION

The possibly confounding effects of medication could not be controlled.

CONCLUSIONS

During early visual processing, patients with panic disorder prefer global to detailed information. However, in later processing, panic disorder patients overuse detailed information for the perception of facial expressions. These findings suggest that unique spatial frequency-dependent facial processing could shed light on the neural pathology associated with panic disorder.

Cerebral Correlates of Emotional and Action Appraisals During Visual Processing of Emotional Scenes Depending on Spatial Frequency: A Pilot Study

Visual processing of emotional stimuli critically depends on the type of cognitive appraisal involved. The present fMRI pilot study aimed to investigate the cerebral correlates involved in the visual processing of emotional scenes in two tasks, one emotional, based on the appraisal of personal emotional experience, and the other motivational, based on the appraisal of the tendency to action. Given that the use of spatial frequency information is relatively flexible during the visual processing of emotional stimuli depending on the task’s demands, we also explored the effect of the type of spatial frequency in visual stimuli in each task by using emotional scenes filtered in low spatial frequency (LSF) and high spatial frequencies (HSF). Activation was observed in the visual areas of the fusiform gyrus for all emotional scenes in both tasks, and in the amygdala for unpleasant scenes only. The motivational task induced additional activation in frontal motor-related areas (e.g. premotor cortex, SMA) and parietal regions (e.g. superior and inferior parietal lobules). Parietal regions were recruited particularly during the motivational appraisal of approach in response to pleasant scenes. These frontal and parietal activations, respectively, suggest that motor and navigation processes play a specific role in the identification of the tendency to action in the motivational task. Furthermore, activity observed in the motivational task, in response to both pleasant and unpleasant scenes, was significantly greater for HSF than for LSF scenes, suggesting that the tendency to action is driven mainly by the detailed information contained in scenes. Results for the emotional task suggest that spatial frequencies play only a small role in the evaluation of unpleasant and pleasant emotions. Our preliminary study revealed a partial distinction between visual processing of emotional scenes during identification of the tendency to action, and during identification of personal emotional experiences. It also illustrates flexible use of the spatial frequencies contained in scenes depending on their emotional valence and on task demands.

Early visual processing for low spatial frequency fearful face is correlated with cortical volume in patients with schizophrenia

Patients with schizophrenia present with dysfunction of the magnocellular pathway, which might impair their early visual processing. We explored the relationship between functional abnormality of early visual processing and brain volumetric changes in schizophrenia. Eighteen patients and 16 healthy controls underwent electroencephalographic recordings and high-resolution magnetic resonance imaging. During electroencephalographic recordings, participants passively viewed neutral or fearful faces with broad, high, or low spatial frequency characteristics. Voxel-based morphometry was performed to investigate brain volume correlates of visual processing deficits. Event related potential analysis suggested that patients with schizophrenia had relatively impaired P100 processing of low spatial frequency fearful face stimuli compared with healthy controls; patients' gray-matter volumes in the dorsolateral and medial prefrontal cortices positively correlated with this amplitude. In addition, patients' gray-matter volume in the right cuneus positively correlated with the P100 amplitude in the left hemisphere for the high spatial frequency neutral face condition and that in the left dorsolateral prefrontal cortex negatively correlated with the negative score of the Positive and Negative Syndrome Scale. No significant correlations were observed in healthy controls. This study suggests that the cuneus and prefrontal cortex are significantly involved with the early visual processing of magnocellular input in patients with schizophrenia.

Spatial Frequency Components of Images Modulate Neuronal Activity in Monkey Amygdala

Processing the spatial frequency components of an image is a crucial feature for visual perception, especially in recognition of faces. Here, we study the correlation between spatial frequency components of images of faces and neuronal activity in monkey amygdala while performing a visual recognition task. The frequency components of the images were analyzed using a fast Fourier transform for 40 spatial frequency ranges. We recorded 65 neurons showing statistically significant responses to at least one of the images used as a stimulus. A total of 37 of these neurons (n = 37) showed significant responses to at least three images, and in eight of them (8/37, 22%), we found a statistically significant correlation between neuron response and the modulus amplitude of at least one frequency range present in the images. Our results indicate that high spatial frequency and low spatial frequency components of images influence the activity of amygdala neurons.

The cerebral correlates of subliminal emotions: an eleoencephalographic study with emotional hybrid faces

In a high-resolution electroencephalographic study, participants evaluated the friendliness level of upright and inverted 'hybrid faces', i.e. facial photos containing a subliminal emotional core in the low spatial frequencies (< 6 cycles/image), superimposed on a neutral expression in the rest of the spatial frequencies. Upright happy and angry faces were judged as more friendly or less friendly than neutral faces, respectively. We observed the time course of cerebral correlates of these stimuli with event-related potentials (ERPs), confirming that hybrid faces elicited the posterior emotion-related and face-related components (P1, N170 and P2), previously shown to be engaged by non-subliminal emotional stimuli. In addition, these components were stronger in the right hemisphere and were both enhanced and delayed by face inversion. A frontal positivity (210-300 ms) was stronger for emotional than for neutral faces, and for upright than for inverted faces. Hence, hybrid faces represent an original approach in the study of subliminal emotions, which appears promising for investigating their electrophysiological correlates.

Neural correlates of cognitive aging during the perception of facial age: the role of relatively distant and local texture information

Previous event-related potential (ERP) research revealed that older relative to younger adults show reduced inversion effects in the N170 (with more negative amplitudes for inverted than upright faces), suggestive of impairments in face perception. However, as these studies used young to middle-aged faces only, this finding may reflect preferential processing of own- relative to other-age faces rather than age-related decline. We conducted an ERP study in which young and older participants categorized young and old upright or inverted faces by age. Stimuli were presented either unfiltered or low-pass filtered at 30, 20, or 10 cycles per image (CPI). Response times revealed larger inversion effects, with slower responses for inverted faces, for young faces in young participants. Older participants did not show a corresponding effect. ERPs yielded a trend toward reduced N170 inversion effects in older relative to younger adults independent of face age. Moreover, larger inversion effects for young relative to old faces were detected, and filtering resulted in smaller N170 amplitudes. The reduced N170 inversion effect in older adults may reflect age-related changes in neural correlates of face perception. A smaller N170 inversion effect for old faces may indicate that facial changes with age hamper early face perception stages.

On the use of spatial frequency to isolate contributions from the magnocellular and parvocellular systems and the dorsal and ventral cortical streams

Many authors have claimed that suprathreshold achromatic stimuli of low and high spatial frequency can be used to separate responses from different entities in the visual system. Most prominently, it has been proposed that such stimuli can differentiate responses from the magnocellular and parvocellular systems. As is reviewed here, investigators who have examined stimulus specificity of neurons in these systems have found little difference between magno- and parvocellular cells. It has also been proposed that spatial frequency can be used to selectively activate the "magnocellular-dorsal stream". The present review indicates that cells in Area MT of the dorsal stream do prefer very low spatial frequencies. However, the review also shows that cells in Area V4 of the ventral stream respond, not only to relatively high spatial frequencies, but also to low frequency stimuli. Thus, low spatial frequencies cannot be relied upon to selectively activate the dorsal stream.

Attentional bias to affective faces and complex IAPS images in early visual cortex follows emotional cue extraction

Emotionally arousing stimuli are known to rapidly draw the brain's processing resources, even when they are task-irrelevant. The steady-state visual evoked potential (SSVEP) response, a neural response to a flickering stimulus which effectively allows measurement of the processing resources devoted to that stimulus, has been used to examine this process of attentional shifting. Previous studies have used a task in which participants detected periods of coherent motion in flickering random dot kinematograms (RDKs) which generate an SSVEP, and found that task-irrelevant emotional stimuli withdraw more attentional resources from the task-relevant RDKs than task-irrelevant neutral stimuli. However, it is not clear whether the emotion-related differences in the SSVEP response are conditional on higher-level extraction of emotional cues as indexed by well-known event-related potential (ERPs) components (N170, early posterior negativity, EPN), or if affective bias in competition for visual attention resources is a consequence of a time-invariant shifting process. In the present study, we used two different types of emotional distractors - IAPS pictures and facial expressions - for which emotional cue extraction occurs at different speeds, being typically earlier for faces (at ~170ms, as indexed by the N170) than for IAPS images (~220-280ms, EPN). We found that emotional modulation of attentional resources as measured by the SSVEP occurred earlier for faces (around 180ms) than for IAPS pictures (around 550ms), after the extraction of emotional cues as indexed by visual ERP components. This is consistent with emotion related re-allocation of attentional resources occurring after emotional cue extraction rather than being linked to a time-fixed shifting process.

Exploring facial emotion perception in schizophrenia using transcranial magnetic stimulation and spatial filtering

Schizophrenia patients have difficulty extracting emotional information from facial expressions. Perception of facial emotion can be examined by systematically altering the spatial frequency of stimuli and suppressing visual processing with temporal precision using transcranial magnetic stimulation (TMS). In the present study, we compared 25 schizophrenia patients and 27 healthy controls using a facial emotion identification task. Spatial processing was examined by presenting facial photographs that contained either high (HSF), low (LSF), or broadband/unfiltered (BSF) spatial frequencies. Temporal processing was manipulated using a single-pulse TMS delivered to the visual cortex either before (forward masking) or after (backward masking) photograph presentation. Consistent with previous studies, schizophrenia patients performed significantly below controls across all three spatial frequencies. A spatial frequency by forward/backward masking interaction effect demonstrated reduced performance in the forward masking component in the BSF condition and a reversed performance pattern in the HSF condition, with no significant differences between forward and backward masking in the LSF condition. However, the group by spatial frequency interaction was not significant. These findings indicate that manipulating visual suppression of emotional information at the level of the primary visual cortex results in comparable effects on both groups. This suggests that patients' deficits in facial emotion identification are not explained by low-level processes in the retino-geniculo-striate projection, but may rather depend on deficits of affect perception occurring at later integrative processing stages.

Neural correlates of attention to emotional facial expressions in dysphoria

The present study investigated whether dysphoric individuals have a difficulty in disengaging attention from negative stimuli and/or reduced attention to positive information. Sad, neutral and happy facial stimuli were presented in an attention-shifting task to 18 dysphoric and 18 control participants. Reaction times to neutral shapes (squares and diamonds) and the event-related potentials to emotional faces were recorded. Dysphoric individuals did not show impaired attentional disengagement from sad faces or facilitated disengagement from happy faces. Right occipital lateralisation of P100 was absent in dysphoric individuals, possibly indicating reduced attention-related sensory facilitation for faces. Frontal P200 was largest for sad faces among dysphoric individuals, whereas controls showed larger amplitude to both sad and happy as compared with neutral expressions, suggesting that dysphoric individuals deployed early attention to sad, but not happy, expressions. Importantly, the results were obtained controlling for the participants' trait anxiety. We conclude that at least under some circumstances the presence of depressive symptoms can modulate early, automatic stages of emotional processing.

The male advantage in child facial resemblance detection: behavioral and ERP evidence

Males have been suggested to have advantages over females in reactions to child facial resemblance, which reflects the evolutionary pressure on males to solve the adaptive paternal uncertainty problem and to identify biological offspring. However, previous studies showed inconsistent results and the male advantage in child facial resemblance perception, as a kin detection mechanism, is still unclear. Here, we investigated the behavioral and brain mechanisms underlying the self-resembling faces processing and how it interacts with sex and age using event-related potential (ERP) technique. The results showed a stable male advantage in self-resembling child faces processing, such that males have higher detectability to self-resembling child faces than females. For ERP results, males showed smaller N2 and larger late positive component (LPC) amplitudes for self-resembling child faces, which may reflect face-matching and self-referential processing in kin detection, respectively. Further source analysis showed that the N2 component and LPC were originated from the anterior cingulate cortex and medial frontal gyrus, respectively. Our results support the male advantage in self-resembling child detection and further indicate that such distinctions can be found in both early and late processing stages in the brain at different regions.

Event-related potentials to unattended changes in facial expressions: detection of regularity violations or encoding of emotions?

Visual mismatch negativity (vMMN), a component in event-related potentials (ERPs), can be elicited when rarely presented “deviant” facial expressions violate regularity formed by repeated “standard” faces. vMMN is observed as differential ERPs elicited between the deviant and standard faces. It is not clear, however, whether differential ERPs to rare emotional faces interspersed with repeated neutral ones reflect true vMMN (i.e., detection of regularity violation) or merely encoding of the emotional content in the faces. Furthermore, a face-sensitive N170 response, which reflects structural encoding of facial features, can be modulated by emotional expressions. Owing to its similar latency and scalp topography with vMMN, these two components are difficult to separate. We recorded ERPs to neutral, fearful, and happy faces in two different stimulus presentation conditions in adult humans. For the oddball condition group, frequently presented neutral expressions (p = 0.8) were rarely replaced by happy or fearful expressions (p = 0.1), whereas for the equiprobable condition group, fearful, happy, and neutral expressions were presented with equal probability (p = 0.33). Independent component analysis (ICA) revealed two prominent components in both stimulus conditions in the relevant latency range and scalp location. A component peaking at 130 ms post stimulus showed a difference in scalp topography between the oddball (bilateral) and the equiprobable (right-dominant) conditions. The other component, peaking at 170 ms post stimulus, showed no difference between the conditions. The bilateral component at the 130-ms latency in the oddball condition conforms to vMMN. Moreover, it was distinct from N170 which was modulated by the emotional expression only. The present results suggest that future studies on vMMN to facial expressions should take into account possible confounding effects caused by the differential processing of the emotional expressions as such.