Background Odors Modulate N170 ERP Component and Perception of Emotional Facial Stimuli

Combining electrodermal activity analysis and dynamic causal modeling to investigate the visual-odor multimodal integration during face perception

Objective. This study presents a novel methodological approach for incorporating information related to the peripheral sympathetic response into the investigation of neural dynamics. Particularly, we explore how hedonic contextual olfactory stimuli influence the processing of neutral faces in terms of sympathetic response, event-related potentials and effective connectivity analysis. The objective is to investigate how the emotional valence of odors influences the cortical connectivity underlying face processing and the role of face-induced sympathetic arousal in this visual-olfactory multimodal integration.Approach. To this aim, we combine electrodermal activity (EDA) analysis and dynamic causal modeling to examine changes in cortico-cortical interactions.Results. The results reveal that stimuli arising sympathetic EDA responses are associated with a more negative N170 amplitude, which may be a marker of heightened arousal in response to faces. Hedonic odors, on the other hand, lead to a more negative N1 component and a reduced the vertex positive potential when they are unpleasant or pleasant. Concerning connectivity, unpleasant odors strengthen the forward connection from the inferior temporal gyrus (ITG) to the middle temporal gyrus, which is involved in processing changeable facial features. Conversely, the occurrence of sympathetic responses after a stimulus is correlated with an inhibition of this same connection and an enhancement of the backward connection from ITG to the fusiform face gyrus.Significance. These findings suggest that unpleasant odors may enhance the interpretation of emotional expressions and mental states, while faces capable of eliciting sympathetic arousal prioritize identity processing.

Body odor disgust sensitivity (BODS) is related to extreme odor valence perception

Odors are important disease cues, and disgust sensitivity to body odors reflects individual differences in disease avoidance. The body odor disgust sensitivity (BODS) scale provides a rapid and valid assessment of individual differences. Nevertheless, little is known about how individual differences in BODS might correlate with overall odor perception or how it is related to other differences in emotional reactivity (e.g., affect intensity). We investigated how BODS relates to perceptual ratings of pleasant and unpleasant odors. We aggregated data from 4 experiments (total N = 190) that were conducted in our laboratory, and where valence and intensity ratings were collected. Unpleasant odors were body-like (e.g., sweat-like valeric acid), which may provide disease cues. The pleasant odors were, in contrast, often found in soap and cleaning products (e.g., lilac, lemon). Across experiments, we show that individuals with higher BODS levels perceived smells as more highly valenced overall: unpleasant smells were rated as more unpleasant, and pleasant smells were rated as more pleasant. These results suggest that body odor disgust sensitivity is associated with a broader pattern of affect intensity which causes stronger emotional responses to both negative and positive odors. In contrast, BODS levels were not associated with odor intensity perception. Furthermore, disgust sensitivity to odors coming from external sources (e.g., someone else's sweat) was the best predictor of odor valence ratings. The effects were modest in size. The results validate the BODS scale as it is explicitly associated with experimental ratings of odor valence.

Smell what you hardly see: Odors assist visual categorization in the human brain

Visual categorization is the brain ability to rapidly and automatically respond to a certain category of inputs. Whether category-selective neural responses are purely visual or can be influenced by other sensory modalities remains unclear. Here, we test whether odors modulate visual categorization, expecting that odors facilitate the neural categorization of congruent visual objects, especially when the visual category is ambiguous. Scalp electroencephalogram (EEG) was recorded while natural images depicting various objects were displayed in rapid 12-Hz streams (i.e., 12 images / second) and variable exemplars of a target category (either human faces, cars, or facelike objects in dedicated sequences) were interleaved every 9^th stimulus to tag category-selective responses at 12/9 = 1.33 Hz in the EEG frequency spectrum. During visual stimulation, participants (N = 26) were implicitly exposed to odor contexts (either body, gasoline or baseline odors) and performed an orthogonal cross-detection task. We identify clear category-selective responses to every category over the occipito-temporal cortex, with the largest response for human faces and the lowest for facelike objects. Critically, body odor boosts the response to the ambiguous facelike objects (i.e., either perceived as nonface objects or faces) over the right hemisphere, especially for participants reporting their presence post-stimulation. By contrast, odors do not significantly modulate other category-selective responses, nor the general visual response recorded at 12 Hz, revealing a specific influence on the categorization of congruent ambiguous stimuli. Overall, these findings support the view that the brain actively uses cues from the different senses to readily categorize visual inputs, and that olfaction, which has long been considered as poorly functional in humans, is well placed to disambiguate visual information.

The processing characteristics of bodily expressions under the odor context: An ERP study

The recognition of facial expressions has been shown to be influenced by contextual odors. The aims of this study were (1) to investigate whether odor has a similar effect on the recognition of bodily expressions, and (2) to analyze the time-course of such effects. Sixty-nine adults were randomized into three groups to identify bodily expressions (happy, fearful, and neutral) in three odor environments (pleasant odor, unpleasant odor, and no odor). Event-related potentials (ERPs) induced by the viewing bodily expressions were analyzed. Behaviorally, the unpleasant odor context promoted the recognition of bodily expressions. The ERP results showed odor influences on bodily expression recognition in two phases. In a middle stage phase (150-200 ms post-stimulus onset), VPP amplitudes induced by bodily expressions were greater in an unpleasant odor context than in a pleasant odor context. In a mid-late stage phase (beyond 200 ms), an interaction between contextual odor and bodily expression type was observed. When exposed to an unpleasant contextual odor, N2 and LPP amplitudes related to fearful bodily expressions were smaller than when exposed to other odor contexts, showing the promoting effect of mood coherence effect. Behavioral and ERP evidence confirmed that contextual odor can modulate the visual processing of bodily expressions, with an overall promoting effect of an unpleasant odor on bodily expression processing (phase one) and a specific modulating influence of odors on affectively congruent/incongruent bodily expressions (phase two).

Recognition Characteristics of Facial and Bodily Expressions: Evidence From ERPs

In the natural environment, facial and bodily expressions influence each other. Previous research has shown that bodily expressions significantly influence the perception of facial expressions. However, little is known about the cognitive processing of facial and bodily emotional expressions and its temporal characteristics. Therefore, this study presented facial and bodily expressions, both separately and together, to examine the electrophysiological mechanism of emotional recognition using event-related potential (ERP). Participants assessed the emotions of facial and bodily expressions that varied by valence (positive/negative) and consistency (matching/non-matching emotions). The results showed that bodily expressions induced a more positive P1 component and a shortened latency, whereas facial expressions triggered a more negative N170 and prolonged latency. Among N2 and P3, N2 was more sensitive to inconsistent emotional information and P3 was more sensitive to consistent emotional information. The cognitive processing of facial and bodily expressions had distinctive integrating features, with the interaction occurring in the early stage (N170). The results of the study highlight the importance of facial and bodily expressions in the cognitive processing of emotion recognition.

Comparison of Scalp ERP to Faces in Macaques and Humans

Face recognition is an essential activity of social living, common to many primate species. Underlying processes in the brain have been investigated using various techniques and compared between species. Functional imaging studies have shown face-selective cortical regions and their degree of correspondence across species. However, the temporal dynamics of face processing, particularly processing speed, are likely different between them. Across sensory modalities activation of primary sensory cortices in macaque monkeys occurs at about 3/5 the latency of corresponding activation in humans, though this human simian difference may diminish or disappear in higher cortical regions. We recorded scalp event-related potentials (ERPs) to presentation of faces in macaques and estimated the peak latency of ERP components. Comparisons of latencies between macaques (112 ms) and humans (192 ms) suggested that the 3:5 ratio could be preserved in higher cognitive regions of face processing between those species.

A Review of the Effects of Valenced Odors on Face Perception and Evaluation

How do valenced odors affect the perception and evaluation of facial expressions? We reviewed 25 studies published from 1989 to 2020 on cross-modal behavioral effects of odors on the perception of faces. The results indicate that odors may influence facial evaluations and classifications in several ways. Faces are rated as more arousing during simultaneous odor exposure, and the rated valence of faces is affected in the direction of the odor valence. For facial classification tasks, in general, valenced odors, whether pleasant or unpleasant, decrease facial emotion classification speed. The evidence for valence congruency effects was inconsistent. Some studies found that exposure to a valenced odor facilitates the processing of a similarly valenced facial expression. The results for facial evaluation were mirrored in classical conditioning studies, as faces conditioned with valenced odors were rated in the direction of the odor valence. However, the evidence of odor effects was inconsistent when the task was to classify faces. Furthermore, using a z-curve analysis, we found clear evidence for publication bias. Our recommendations for future research include greater consideration of individual differences in sensation and cognition, individual differences (e.g., differences in odor sensitivity related to age, gender, or culture), establishing standardized experimental assessments and stimuli, larger study samples, and embracing open research practices.

Odor-evoked hedonic contexts influence the discrimination of facial expressions in the human brain

The influence of odor valence on expressive-face perception remains unclear. Here, three "valenced" odor contexts (pleasant, unpleasant, control) were diffused while scalp electroencephalogram (EEG) was recorded in 18 participants presented with expressive faces alternating at a 6-Hz rate. One facial expression (happiness, disgust or neutrality) repeatedly arose every 6 face pictures to isolate its discrimination from other expressions at 1 Hz and harmonics in the EEG spectrum. The amplitude of the brain response to neutrality was larger in the pleasant vs. control odor context, and fewer electrodes responded in the unpleasant odor context. The number of responding electrodes was reduced for disgust in both odor contexts. The response to happiness was unchanged between odor conditions. Overall, these observations suggest that valenced odors influence the neural discrimination of facial expressions depending on both face and odor hedonic valence, especially for the emotionally ambiguous neutral expression.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

Olfaction Modulates Inter-Subject Correlation of Neural Responses

Odors can be powerful stimulants. It is well-established that odors provide strong cues for recall of locations, people and events. The effects of specific scents on other cognitive functions are less well-established. We hypothesized that scents with different odor qualities will have a different effect on attention. To assess attention, we used Inter-Subject Correlation of the EEG because this metric is strongly modulated by attentional engagement with natural audiovisual stimuli. We predicted that scents known to be "energizing" would increase Inter-Subject Correlation during watching of videos as compared to "calming" scents. In a first experiment, we confirmed this for eucalyptol and linalool while participants watched animated autobiographical narratives. The result was replicated in a second experiment, but did not generalize to limonene, also considered an "energizing" odorant. In a third, double-blind experiment, we tested a battery of scents including single molecules, as well as mixtures, as participants watched various short video clips. We found a varying effect of odor on Inter-Subject Correlation across the various scents. This study provides a basis for reliably and reproducibly assessing effects of odors on brain activity. Future research is needed to further explore the effect of scent-based up-modulation in engagement on learning and memory performance. Educators, product developers and fragrance brands might also benefit from such objective neurophysiological measures.

Unpleasant Food Odors Modulate the Processing of Facial Expressions: An Event-Related Potential Study

In real-life situations, emotional information is often expressed through multiple sensory channels, with cross-talk between channels. Previous research has established that odor environments regulate the recognition of facial expressions. Therefore, this study combined event-related potentials (ERPs) with a facial emotion recognition task to investigate the effect of food odor context on the recognition of facial expressions and its time course. Fifty-four participants were asked to identify happy, fearful, and neutral faces in an odor context (pleasant, unpleasant or neutral). Electroencephalography (EEG) was performed to extract event-related potentials (ERPs). Behaviorally, unpleasant food odors triggered faster recognition of facial expressions, especially fearful ones. ERP results found that in the early stage, unpleasant food odors within 80–110 ms evoked a larger P100 amplitude than pleasant food odors and no odors, which showed that the unpleasant odor environment promoted the rapid processing of facial expressions. Next, the interaction between odor environment and facial expressions occurred during the middle stage, and the fearful expression evoked a smaller VPP (vertex positive potential) amplitude than the happy and neutral expressions when exposed to the unpleasant food odor environment. This result indicates that unpleasant odor environment consumed fewer cognitive resources when judging fearful expression, showing the promoting effect of mood coherence effect. These findings provided evidence for how people chose odor environments to facilitate the recognition of facial expressions, and highlighted the advantages of unpleasant food odors in communicating emotional information across the olfactory and visual pathways.

Background odors affect behavior in a dot-probe task with emotionally expressive faces

Odors affect perception of social cues in visual environments. Although often underestimated, people use their sense of smell to guide approach or avoidance behavior in social contexts. However, underlying psychological mechanisms are not well known. Prior work suggested olfactory effects are due to increased attention or arousal, or depend on the congruency between olfactory and visual cues. Our aim was to assess how odors influence attentional processes using a dot-probe task with odor-congruent and odor-incongruent facial expressions (happy, disgusted and neutral expressions paired with pleasant odor, unpleasant odor and no-odor). In a preregistered analysis plan, we hypothesized either faster reaction times attributed to arousal from odors in general, or to faces that were emotionally congruent with the odors. We also hypothesized time-on-task effects specific to the odor compared to the control condition. Using Bayesian linear models, we found strong evidence that the faces were rated as more arousing and emotional in odor contexts. However, the dot-probe task did in fact not provide an effective cue to selective visual attention, and odors did not modulate overall attention to the faces. However, we found a time-on-task effect such that in the unpleasant odor condition, response times decreased over time, whereas in the no-odor and pleasant condition there was a slight increase in response times. We conclude that time-on-task effects is an interesting venue for odor-visual interaction research, and such effects might explain inconsistent findings in the prior research literature.