Fluid Intelligence and Automatic Neural Processes in Facial Expression Perception: An Event-Related Potential Study

The role of attention control in visual mismatch negativity (vMMN) studies

The detection of unattended visual changes is investigated by the visual mismatch negativity (vMMN) component of event-related potentials (ERPs). The vMMN is measured as the difference between the ERPs to infrequent (deviant) and frequent (standard) stimuli irrelevant to the ongoing task. In the present study, we used human faces expressing different emotions as deviants and standards. In such studies, participants perform various tasks, so their attention is diverted from the vMMN-related stimuli. If such tasks vary in their attentional demand, they might influence the outcome of vMMN studies. In this study, we compared four kinds of frequently used tasks: (1) a tracking task that demanded continuous performance, (2) a detection task where the target stimuli appeared at any time, (3) a detection task where target stimuli appeared only in the inter-stimulus intervals, and (4) a task where target stimuli were members of the stimulus sequence. This fourth task elicited robust vMMN, while in the other three tasks, deviant stimuli elicited moderate posterior negativity (vMMN). We concluded that the ongoing task had a marked influence on vMMN; thus, it is important to consider this effect in vMMN studies.

Intelligence and Visual Mismatch Negativity: Is Pre-Attentive Visual Discrimination Related to General Cognitive Ability?

EEG has been used for decades to identify neurocognitive processes related to intelligence. Evidence is accumulating for associations with neural markers of higher-order cognitive processes (e.g., working memory); however, whether associations are specific to complex processes or also relate to earlier processing stages remains unclear. Addressing these issues has implications for improving our understanding of intelligence and its neural correlates. The MMN is an ERP that is elicited when, within a series of frequent standard stimuli, rare deviant stimuli are presented. As stimuli are typically presented outside the focus of attention, the MMN is suggested to capture automatic pre-attentive discrimination processes. However, the MMN and its relation to intelligence has largely only been studied in the auditory domain, thus preventing conclusions about the involvement of automatic discrimination processes in humans' dominant sensory modality-vision. EEG was recorded from 50 healthy participants during a passive visual oddball task that presented simple sequence violations and deviations within a more complex hidden pattern. Signed area amplitudes and fractional area latencies of the visual MMN were calculated with and without Laplacian transformation. Correlations between visual MMN and intelligence (Raven's Advanced Progressive Matrices) were of negligible to small effect sizes, differed critically between measurement approaches, and Bayes Factors provided anecdotal to substantial evidence for the absence of an association. We discuss differences between the auditory and visual MMN, the implications of different measurement approaches, and offer recommendations for further research in this evolving field.

Emotional expression visual mismatch negativity in children

Detection of changes in facial emotions is crucial to communicate and to rapidly process threats in the environment. This function develops throughout childhood via modulations of the earliest brain responses, such as the P100 and the N170 recorded using electroencephalography. Automatic brain signatures can be measured through expression-related visual mismatch negativity (vMMN), which reflects the processing of unattended changes. While increasing research has investigated vMMN processing in adults, few studies have been conducted on children. Here, a controlled paradigm previously validated was used to disentangle specific responses to emotional deviants (angry face) from that of neutral deviants. Latencies and amplitudes of P100 and N170 both decrease with age, confirming that sensory and face-specific activity is not yet mature in school-aged children. Automatic change detection-related activity is present in children, with a similar vMMN pattern in response to both emotional and neutral deviant stimuli to what previously observed in adults. However, vMMN processing is delayed in children compared to adults and no emotion-specific response is yet observed, suggesting nonmature automatic detection of salient emotional cues. To our knowledge, this is the first study investigating expression-related vMMN in school-aged children, and further investigations are needed to confirm these results.

Belief in biological origin of race (racial essentialism) increases sensitivities to cultural category changes measured by ERP mismatch negativity (MMN)

The dynamic multicultural view explains culture-specific effects on cognition that cultural knowledge is organized in multiple knowledge systems which are specific to each culture and differentially activated when exposed to related objects or scenes. This view predicts automatic categorizations of environmental information according to the culture-specific knowledge systems. This study investigated whether cultural information could be spontaneously categorized, and the modulation of this process by the belief in the biological origin of race (i.e., racial essentialism) with an event-related brain potential, the visual Mismatch Negativity (vMMN). Deviant pictures of Eastern (Western) culture were randomly presented in a stream of standard Western (Eastern) pictures while participants were playing a video game. Participants who endorse racial essentialism (high group) showed vMMNs to the deviants with high relevance to the Eastern or Western culture and the deviant with low Eastern relevance; while participants with low racial essentialism showed vMMN to the deviant with high Eastern relevance only. These results revealed spontaneous cultural categorization with vMMN and the top-down modulation of spontaneous categorization by personal belief. In addition, this is the first demonstration of MMNs to cultural deviance and the potentials in applying MMNs to study psychological essentialism and social categorization.

Sad expressions during encoding attenuate recognition of facial identity in visual working memory: behavioural and electrophysiological evidence

The current study investigated how sad expressions during encoding affected recognition of facial identity in visual working memory (WM) and its electrophysiological correlates. Event-related potentials were obtained from 36 individuals during a delayed face discrimination task. The hit (correctly recognising studied faces) rates, correct rejection (CR: correctly rejecting unstudied faces) rates, sensitivity d' (discrimination power of face identity recognition), and N170 (150-200 ms), the vertex positive potential (VPP; 150-200 ms), N250 (250-300 ms), P3b (350-450 ms), and late positive potential (LPP; 550-800 ms) amplitudes elicited by the neutral probe faces (previously encoded with sad and happy expressions) during hits and CR conditions were analysed. The participants showed lower hits and CRs and therefore had a lower discrimination power for facial identity preceded by sad expressions compared to happy expressions. For hits, neutral probe faces previously encoded with sad expressions exhibited increased N170, VPP, N250, P3b and LPP amplitudes compared to amplitudes following encoding with happy expressions. For correct rejections, the ERP effect of sad/happy expressions was absent. These results indicate that sad expressions during encoding attenuated the recognition of facial identity in visual WM. The reduced facial identity recognition for previously encoded sad expressions may be associated with increased early structural encoding, more late attention and perceptual resource engagement.

Facial Expression Related vMMN: Disentangling Emotional from Neutral Change Detection

Detection of changes in facial emotional expressions is crucial to communicate and to rapidly and automatically process possible threats in the environment. Recent studies suggest that expression-related visual mismatch negativity (vMMN) reflects automatic processing of emotional changes. In the present study we used a controlled paradigm to investigate the specificity of emotional change-detection. In order to disentangle specific responses to emotional deviants from that of neutral deviants, we presented neutral expression as standard stimulus (p = 0.80) and both angry and neutral expressions as deviants (p = 0.10, each). In addition to an oddball sequence, an equiprobable sequence was presented, to control for refractoriness and low-level differences. Our results showed that in an early time window (100–200 ms), the controlled vMMN was greater than the oddball vMMN only for the angry deviant, suggesting the importance of controlling for refractoriness and stimulus physical features in emotion related studies. Within the controlled vMMN, angry and neutral deviants both elicited early and late peaks occurring at 140 and 310 ms, respectively, but only the emotional vMMN presented sustained amplitude after each peak. By directly comparing responses to emotional and neutral deviants, our study provides evidence of specific activity reflecting the automatic detection of emotional change. This differs from broader “visual” change processing, and suggests the involvement of two partially-distinct pre-attentional systems in the detection of changes in facial expressions.