Stop looking angry and smile, please: start and stop of the very same facial expression differentially activate threat- and reward-related brain networks

Looming Angry Faces: Preliminary Evidence of Differential Electrophysiological Dynamics for Filtered Stimuli via Low and High Spatial Frequencies

Looming motion interacts with threatening emotional cues in the initial stages of visual processing. However, the underlying neural networks are unclear. The current study investigated if the interactive effect of threat elicited by angry and looming faces is favoured by rapid, magnocellular neural pathways and if exogenous or endogenous attention influences such processing. Here, EEG/ERP techniques were used to explore the early ERP responses to moving emotional faces filtered for high spatial frequencies (HSF) and low spatial frequencies (LSF). Experiment 1 applied a passive-viewing paradigm, presenting filtered angry and neutral faces in static, approaching, or receding motions on a depth-cued background. In the second experiment, broadband faces (BSF) were included, and endogenous attention was directed to the expression of faces. Our main results showed that regardless of attentional control, P1 was enhanced by BSF angry faces, but neither HSF nor LSF faces drove the effect of facial expressions. Such findings indicate that looming motion and threatening expressions are integrated rapidly at the P1 level but that this processing relies neither on LSF nor on HSF information in isolation. The N170 was enhanced for BSF angry faces regardless of attention but was enhanced for LSF angry faces during passive viewing. These results suggest the involvement of a neural pathway reliant on LSF information at the N170 level. Taken together with previous reports from the literature, this may indicate the involvement of multiple parallel neural pathways during early visual processing of approaching emotional faces.

Etiopathogenesis in the Development of Borderline Personality Characteristics in Children and Adolescents

The validity and clinical significance of the characteristics of borderline personality disorder (BPD) in adolescents are increasingly being recognized. The persistence of BPD characteristics in adolescence is high and is associated with negative interpersonal, academic, professional, and financial outcomes. In the literature, BPD characteristics observed in children and adolescents are explained with psychodynamic theories, developmental models, and evolutionary approaches. Emotional dysregulation, interpersonal dysfunction, impulsivity, and self-harming behavior, negative life events, temperament characteristics, neuropsychological dysfunctions, neuroanatomical, genetic, hormonal, and immunological factors may play a role in BPD etiopathogenesis. This review aims to address different approaches and relevant factors for the development of BPD. The articles published between 1968-2021 in the PubMed database were reviewed, and prominent studies were selected for evaluation. The importance of invalidating environment, epistemic freezing and hypermentalization, complex or attachment trauma is emphasized in psychodynamic and developmental literature. In the evolutionary approach, on the other hand, romantic relationships and the onset of reproduction are emphasized as the reason for the emergence of symptoms during adolescence, and it is argued that BPD is related to the rapid life history strategy. It is stated that a decrease in volume in the orbitofrontal cortex and anterior cingulate cortex, which are involved in top-down emotional processing, and an increase in the activity of thalamus and hippocampus regions, which are involved in bottom-up emotional processing are observed in adolescents with BPD characteristics when compared to healthy controls. It is thought that the increase in activation in the superior temporal gyrus and precuneus observed in adolescents with BPD features is a neural indicator of hypermentalization, and the increase in activation in the insula is a neural indicator of social pain. It has been reported that the decrease in resting heart rate and the increase in heart rate variability observed in adolescents with BPD symptoms are associated with the activation of the parasympathetic system. BPD in adolescents is a disorder that challenges clinicians in terms of diagnosis, differential diagnosis, and treatment. It is crucial to evaluate the factors related to etiopathogenesis in BPD in a multifaceted and detailed manner. Keywords: Borderline Personality Disorder, Difficulty in Emotion Regulation, Mentalization, Trauma, Self-harming Behavior, Temperamental Characteristics.

VR for Studying the Neuroscience of Emotional Responses

Emotions are frequently considered as the driving force of behavior, and psychopathology is often characterized by aberrant emotional responding. Emotional states are reflected on a cognitive-verbal, physiological-humoral, and motor-behavioral level but to date, human research lacks an experimental protocol for a comprehensive and ecologically valid characterization of such emotional states. Virtual reality (VR) might help to overcome this situation by allowing researchers to study mental processes and behavior in highly controlled but reality-like laboratory settings. In this chapter, we first elucidate the role of presence and immersion as requirements for eliciting emotional states in a virtual environment and discuss different VR methods for emotion induction. We then consider the organization of emotional states on a valence continuum (i.e., from negative to positive) and on this basis discuss the use of VR to study threat processing and avoidance as well as reward processing and approach behavior. Although the potential of VR has not been fully realized in laboratory and clinical settings yet, this technological tool can open up new avenues to better understand the neurobiological mechanisms of emotional responding in healthy and pathological conditions.

Up close and emotional: Electrophysiological dynamics of approaching angry faces

Recent evidence suggests that looming emotional faces are processed rapidly by the neural system, and that this apparent approach further interacts with emotion, causing an enhanced neural response for angry expressions. However, previous research has not demonstrated unequivocally if these effects are due to low-level visual features, or if they are indeed due to the emotional content of the stimuli. To address this question, the current study presented upright and inverted angry and neutral faces, which either expanded or contracted in size on a constant depth-cued background, such that they appeared to approach or retreat from the viewer. EEG/ERP measures were used to identify the time course of brain activity for these stimuli. The results showed that when faces were upright, both the P1 and N170 were enhanced for angry expressions, with the P1 being further increased with looming angry faces. The inversion of the faces caused an increase in both the P1 and N170 amplitudes, but no modulation was found for emotions. These findings show an early modulation of brain activity for upright looming angry faces and rule out the influence of low-level visual features as a contributing factor.

Differences in the recognition of sadness, anger, and fear in facial expressions: the role of the observer and model gender

This study investigated gender differences in the accuracy and speed of recognition of facial expressions of sadness, anger, and fear in male and female models showing these emotions. According to the fitness threat hypothesis, females should be faster and more accurate in recognising emotional facial expressions of fear and sadness, whereas males should be faster and more accurate in recognising anger. According to the evolutionary opponent's emotion recognition, male observers should be more efficient in recognising emotions presented by male models, and female observers in recognising emotions presented by female models. The facial expression recognition task included 210 colour images from the Karolinska Directed Emotional Faces (KDEF) database. The sample consisted of university students (29 male and 29 female). Testing was conducted individually, and efficiency measured with accuracy and speed of recognition (reaction time). The results showed that females were faster than males in recognizing all three facial expressions. They were also more accurate in recognizing fear, whereas there were no gender differences in accurate recognition of sadness and anger. No significant interactions were found between model and observer gender on either measure (accuracy and speed of recognition). However, all three emotional expressions were recognised more accurately, but not faster, when the model was female. The gender-specific pattern in facial expression recognition found in this study does not completely corroborate the fitness threat hypothesis.

Enhanced early ERP responses to looming angry faces

Although the brain is known to process threatening emotional stimuli and looming motion rapidly, little is known about how the emotion and motion interact. To address this question, two experiments were carried out which presented angry and neutral emotional faces on a depth-cued background that induced the perception of distance, or a non-cued background. Furthermore, faces either expanded or contracted in size such that they appeared to approach or recede from the viewer. EEG/ERP measures were used to identify the time course of brain activity for these looming and receding, angry and neutral emotional faces. The results of both experiments revealed that the P1 was enhanced by looming angry faces on the depth-cued background, compared to neutral approaching faces, as well as all receding faces, indicating an early interaction of emotion and motion within 100 ms of presentation. Angry expressions were also found to enhance the N170 regardless of movement. These findings suggest that processing of threat and looming motion interact at the very early stages of visual processing. Furthermore, as the modulating effect of looming motion on angry expressions only arose on the depth-cued background, the findings highlight the importance of approaching movements rather than sole increases in the retinal size of the stimuli.

Retrospective Evaluation of Sequential Events and the Influence of Preference-Dependent Working Memory: A Computational Examination

Humans organize sequences of events into a single overall experience, and evaluate the aggregated experience as a whole, such as a generally pleasant dinner, movie, or trip. However, such evaluations are potentially computationally taxing, and so our brains must employ heuristics (i.e., approximations). For example, the peak-end rule hypothesis suggests that we average the peaks and end of a sequential event vs. integrating every moment. However, there is no general model to test viable hypotheses quantitatively. Here, we propose a general model and test among multiple specific ones, while also examining the role of working memory. The models were tested with a novel picture-rating task. We first compared averaging across entire sequences vs. the peak-end heuristic. Correlation tests indicated that averaging prevailed, with peak and end both still having significant prediction power. Given this, we developed generalized order-dependent and relative-preference-dependent models to subsume averaging, peak and end. The combined model improved the prediction power. However, based on limitations of relative-preference-including imposing a potentially arbitrary ranking among preferences-we introduced an absolute-preference-dependent model, which successfully explained the remembered utilities. Yet, because using all experiences in a sequence requires too much memory as real-world settings scale, we then tested "windowed" models, i.e., evaluation within a specified window. The windowed (absolute) preference-dependent (WP) model explained the empirical data with long sequences better than without windowing. However, because fixed-windowed models harbor their own limitations-including an inability to capture peak-event influences beyond a fixed window-we then developed discounting models. With (absolute) preference-dependence added to the discounting rate, the results showed that the discounting model reflected the actual working memory of the participants, and that the preference-dependent discounting (PD) model described different features from the WP model. Taken together, we propose a combined WP-PD model as a means by which people evaluate experiences, suggesting preference-dependent working-memory as a significant factor underlying our evaluations.

How the visual brain detects emotional changes in facial expressions: Evidence from driven and intrinsic brain oscillations

The processing of facial expressions is often studied using static pictorial cues. Recent work, however, suggests that viewing changing expressions more robustly evokes physiological responses. Here, we examined the sensitivity of steady-state visual evoked potentials and intrinsic oscillatory brain activity to transient emotional changes in facial expressions. Twenty-two participants viewed sequences of grayscale faces periodically turned on and off at a rate of 17.5 Hz, to evoke flicker steady-state visual evoked potentials (ssVEPs) in visual cortex. Each sequence began with a neutral face (flickering for 2290 msec), immediately followed by a face from the same actor (also flickering for 2290 msec) with one of four expressions (happy, angry, fearful, or another neutral expression), followed by the initially presented neutral face (flickering for 1140 msec). The amplitude of the ssVEP and the power of intrinsic brain oscillations were analyzed, comparing the four expression-change conditions. We found a transient perturbation (reduction) of the ssVEP that was more pronounced after the neutral-to-angry change compared to the other conditions, at right posterior sensors. Induced alpha-band (8-13 Hz) power was reduced compared to baseline after each change. This reduction showed a central-occipital topography and was strongest in the subtlest and rarest neutral-to-neutral condition. Thus, the ssVEP indexed involvement of face-sensitive cortical areas in decoding affective expressions, whereas mid-occipital alpha power reduction reflected condition frequency rather than expression-specific processing, consistent with the role of alpha power changes in selective attention.

Heightened Salience of Anger and Aggression in Female Adolescents With Borderline Personality Disorder-A Script-Based fMRI Study

Background: Anger and aggression belong to the core symptoms of borderline personality disorder. Although an early and specific treatment of BPD is highly relevant to prevent chronification, still little is known about anger and aggression and their neural underpinnings in adolescents with BPD.

Method: Twenty female adolescents with BPD (age 15–17 years) and 20 female healthy adolescents (age 15–17 years) took part in this functional magnetic resonance imaging (fMRI) study. A script-driven imagery paradigm was used to induce rejection-based feelings of anger, which was followed by descriptions of self-directed and other-directed aggressive reactions. To investigate the specificity of the neural activation patterns for adolescent patients, results were compared with data from 34 female adults with BPD (age 18–50 years) and 32 female healthy adults (age 18–50 years).

Results: Adolescents with BPD showed increased activations in the left posterior insula and left dorsal striatum as well as in the left inferior frontal cortex and parts of the mentalizing network during the rejection-based anger induction and the imagination of aggressive reactions compared to healthy adolescents. For the other-directed aggression phase, a significant diagnosis by age interaction confirmed that these results were specific for adolescents.

Discussion: The results of this very first fMRI study on anger and aggression in adolescents with BPD suggest an enhanced emotional reactivity to and higher effort in controlling anger and aggression evoked by social rejection at an early developmental stage of the disorder. Since emotion dysregulation is a known mediator for aggression in BPD, the results point to the need of appropriate early interventions for adolescents with BPD.

Neural Correlates of Facial Mimicry: Simultaneous Measurements of EMG and BOLD Responses during Perception of Dynamic Compared to Static Facial Expressions

Facial mimicry (FM) is an automatic response to imitate the facial expressions of others. However, neural correlates of the phenomenon are as yet not well established. We investigated this issue using simultaneously recorded EMG and BOLD signals during perception of dynamic and static emotional facial expressions of happiness and anger. During display presentations, BOLD signals and zygomaticus major (ZM), corrugator supercilii (CS) and orbicularis oculi (OO) EMG responses were recorded simultaneously from 46 healthy individuals. Subjects reacted spontaneously to happy facial expressions with increased EMG activity in ZM and OO muscles and decreased CS activity, which was interpreted as FM. Facial muscle responses correlated with BOLD activity in regions associated with motor simulation of facial expressions [i.e., inferior frontal gyrus, a classical Mirror Neuron System (MNS)]. Further, we also found correlations for regions associated with emotional processing (i.e., insula, part of the extended MNS). It is concluded that FM involves both motor and emotional brain structures, especially during perception of natural emotional expressions.

Graph theory reveals amygdala modules consistent with its anatomical subdivisions

Similarities on the cellular and neurochemical composition of the amygdaloid subnuclei suggests their clustering into subunits that exhibit unique functional organization. The topological principle of community structure has been used to identify functional subnetworks in neuroimaging data that reflect the brain effective organization. Here we used modularity to investigate the organization of the amygdala using resting state functional magnetic resonance imaging (rsfMRI) data. Our goal was to determine whether such topological organization would reliably reflect the known neurobiology of individual amygdaloid nuclei, allowing for human imaging studies to accurately reflect the underlying neurobiology. Modularity analysis identified amygdaloid elements consistent with the main anatomical subdivisions of the amygdala that embody distinct functional and structural properties. Additionally, functional connectivity pathways of these subunits and their correlation with task-induced amygdala activation revealed distinct functional profiles consistent with the neurobiology of the amygdala nuclei. These modularity findings corroborate the structure–function relationship between amygdala anatomical substructures, supporting the use of network analysis techniques to generate biologically meaningful partitions of brain structures.

Exploring the Neural Basis of Avatar Identification in Pathological Internet Gamers and of Self-Reflection in Pathological Social Network Users

Background and aims Internet gaming addiction appears to be related to self-concept deficits and increased angular gyrus (AG)-related identification with one's avatar. For increased social network use, a few existing studies suggest striatal-related positive social feedback as an underlying factor. However, whether an impaired self-concept and its reward-based compensation through the online presentation of an idealized version of the self are related to pathological social network use has not been investigated yet. We aimed to compare different stages of pathological Internet game and social network use to explore the neural basis of avatar and self-identification in addictive use. Methods About 19 pathological Internet gamers, 19 pathological social network users, and 19 healthy controls underwent functional magnetic resonance imaging while completing a self-retrieval paradigm, asking participants to rate the degree to which various self-concept-related characteristics described their self, ideal, and avatar. Self-concept-related characteristics were also psychometrically assessed. Results Psychometric testing indicated that pathological Internet gamers exhibited higher self-concept deficits generally, whereas pathological social network users exhibit deficits in emotion regulation only. We observed left AG hyperactivations in Internet gamers during avatar reflection and a correlation with symptom severity. Striatal hypoactivations during self-reflection (vs. ideal reflection) were observed in social network users and were correlated with symptom severity. Discussion and conclusion Internet gaming addiction appears to be linked to increased identification with one's avatar, evidenced by high left AG activations in pathological Internet gamers. Addiction to social networks seems to be characterized by emotion regulation deficits, reflected by reduced striatal activation during self-reflection compared to during ideal reflection.

The effects of facial expressions and tears on the speed of sex recognition

The goal of this research was to examine the effects of facial expressions on the speed of sex recognition. Prior research revealed that sex recognition of female angry faces was slower compared with male angry faces and that female happy faces are recognized faster than male happy faces. We aimed to replicate and extend the previous research by using different set of facial stimuli, different methodological approach and also by examining the effects of some other previously unexplored expressions (such as crying) on the speed of sex recognition. In the first experiment, we presented facial stimuli of men and women displaying anger, fear, happiness, sadness, crying and three control conditions expressing no emotion. Results showed that sex recognition of angry females was significantly slower compared with sex recognition in any other condition, while sad, crying, happy, frightened and neutral expressions did not impact the speed of sex recognition. In the second experiment, we presented angry, neutral and crying expressions in blocks and again only sex recognition of female angry expressions was slower compared with all other expressions. The results are discussed in a context of perceptive features of male and female facial configuration, evolutionary theory and social learning context.

Facial mimicry in its social setting

In interpersonal encounters, individuals often exhibit changes in their own facial expressions in response to emotional expressions of another person. Such changes are often called facial mimicry. While this tendency first appeared to be an automatic tendency of the perceiver to show the same emotional expression as the sender, evidence is now accumulating that situation, person, and relationship jointly determine whether and for which emotions such congruent facial behavior is shown. We review the evidence regarding the moderating influence of such factors on facial mimicry with a focus on understanding the meaning of facial responses to emotional expressions in a particular constellation. From this, we derive recommendations for a research agenda with a stronger focus on the most common forms of encounters, actual interactions with known others, and on assessing potential mediators of facial mimicry. We conclude that facial mimicry is modulated by many factors: attention deployment and sensitivity, detection of valence, emotional feelings, and social motivations. We posit that these are the more proximal causes of changes in facial mimicry due to changes in its social setting.

Spatiotemporal neural network dynamics for the processing of dynamic facial expressions

The dynamic facial expressions of emotion automatically elicit multifaceted psychological activities; however, the temporal profiles and dynamic interaction patterns of brain activities remain unknown. We investigated these issues using magnetoencephalography. Participants passively observed dynamic facial expressions of fear and happiness, or dynamic mosaics. Source-reconstruction analyses utilizing functional magnetic-resonance imaging data revealed higher activation in broad regions of the bilateral occipital and temporal cortices in response to dynamic facial expressions than in response to dynamic mosaics at 150–200 ms and some later time points. The right inferior frontal gyrus exhibited higher activity for dynamic faces versus mosaics at 300–350 ms. Dynamic causal-modeling analyses revealed that dynamic faces activated the dual visual routes and visual–motor route. Superior influences of feedforward and feedback connections were identified before and after 200 ms, respectively. These results indicate that hierarchical, bidirectional neural network dynamics within a few hundred milliseconds implement the processing of dynamic facial expressions.

Metacognition in Early Phase Psychosis: Toward Understanding Neural Substrates

Individuals in the early phases of psychotic illness have disturbed metacognitive capacity, which has been linked to a number of poor outcomes. Little is known, however, about the neural systems associated with metacognition in this population. The purpose of this study was to elucidate the neuroanatomical correlates of metacognition. We anticipated that higher levels of metacognition may be dependent upon gray matter density (GMD) of regions within the prefrontal cortex. Examining whole-brain structure in 25 individuals with early phase psychosis, we found positive correlations between increased medial prefrontal cortex and ventral striatum GMD and higher metacognition. These findings represent an important step in understanding the path through which the biological correlates of psychotic illness may culminate into poor metacognition and, ultimately, disrupted functioning. Such a path will serve to validate and promote metacognition as a viable treatment target in early phase psychosis.

Basal ganglia circuit loops, dopamine and motivation: A review and enquiry

Dopamine neurons located in the midbrain play a role in motivation that regulates approach behavior (approach motivation). In addition, activation and inactivation of dopamine neurons regulate mood and induce reward and aversion, respectively. Accumulating evidence suggests that such motivational role of dopamine neurons is not limited to those located in the ventral tegmental area, but also in the substantia nigra. The present paper reviews previous rodent work concerning dopamine's role in approach motivation and the connectivity of dopamine neurons, and proposes two working models: One concerns the relationship between extracellular dopamine concentration and approach motivation. High, moderate and low concentrations of extracellular dopamine induce euphoric, seeking and aversive states, respectively. The other concerns circuit loops involving the cerebral cortex, basal ganglia, thalamus, epithalamus, and midbrain through which dopaminergic activity alters approach motivation. These models should help to generate hypothesis-driven research and provide insights for understanding altered states associated with drugs of abuse and affective disorders.

The fate of the inner nose: odor imagery in patients with olfactory loss

Cerebral activations during olfactory mental imagery are fairly well investigated in healthy participants but little attention has been given to olfactory imagery in patients with olfactory loss. To explore whether olfactory loss leads to deficits in olfactory imagery, neural responses using functional magnetic resonance imaging (fMRI) and self-report measures were investigated in 16 participants with acquired olfactory loss and 19 control participants. Participants imagined both pleasant and unpleasant odors and their visual representations. Patients reported less vivid olfactory but not visual images than controls. Results from neuroimaging revealed that activation patterns differed between patients and controls. While the control group showed stronger activation in olfactory brain regions for unpleasant compared to pleasant odors, the patient group did not. Also, activation in critical areas for olfactory imagery was correlated with the duration of olfactory dysfunction, indicating that the longer the duration of dysfunction, the more the attentional resources were employed. This indicates that participants with olfactory loss have difficulties to perform olfactory imagery in the conventional way. Regular exposure to olfactory information may be necessary to maintain an olfactory imagery capacity.

Cognition, emotion, and attention

Deficits of attention, emotion, and cognition occur in individuals with alcohol abuse and addiction. This review elucidates the concepts of attention, emotion, and cognition and references research on the underlying neural networks and their compromise in alcohol use disorder. Neuroimaging research on adolescents with family history of alcoholism contributes to the understanding of pre-existing brain structural conditions and characterization of cognition and attention processes in high-risk individuals. Attention and cognition interact with other brain functions, including perceptual selection, salience, emotion, reward, and memory, through interconnected neural networks. Recent research reports compromised microstructural and functional network connectivity in alcoholism, which can have an effect on the dynamic tuning between brain systems, e.g., the frontally based executive control system, the limbic emotion system, and the midbrain-striatal reward system, thereby impeding cognitive flexibility and behavioral adaptation to changing environments. Finally, we introduce concepts of functional compensation, the capacity to generate attentional resources for performance enhancement, and brain structure recovery with abstinence. An understanding of the neural mechanisms of attention, emotion, and cognition will likely provide the basis for better treatment strategies for developing skills that enhance alcoholism therapy adherence and quality of life, and reduce the propensity for relapse.

Beyond face value: does involuntary emotional anticipation shape the perception of dynamic facial expressions?

Emotional facial expressions are immediate indicators of the affective dispositions of others. Recently it has been shown that early stages of social perception can already be influenced by (implicit) attributions made by the observer about the agent's mental state and intentions. In the current study possible mechanisms underpinning distortions in the perception of dynamic, ecologically-valid, facial expressions were explored. In four experiments we examined to what extent basic perceptual processes such as contrast/context effects, adaptation and representational momentum underpinned the perceptual distortions, and to what extent 'emotional anticipation', i.e. the involuntary anticipation of the other's emotional state of mind on the basis of the immediate perceptual history, might have played a role. Neutral facial expressions displayed at the end of short video-clips, in which an initial facial expression of joy or anger gradually morphed into a neutral expression, were misjudged as being slightly angry or slightly happy, respectively (Experiment 1). This response bias disappeared when the actor's identity changed in the final neutral expression (Experiment 2). Videos depicting neutral-to-joy-to-neutral and neutral-to-anger-to-neutral sequences again produced biases but in opposite direction (Experiment 3). The bias survived insertion of a 400 ms blank (Experiment 4). These results suggested that the perceptual distortions were not caused by any of the low-level perceptual mechanisms (adaptation, representational momentum and contrast effects). We speculate that especially when presented with dynamic, facial expressions, perceptual distortions occur that reflect 'emotional anticipation' (a low-level mindreading mechanism), which overrules low-level visual mechanisms. Underpinning neural mechanisms are discussed in relation to the current debate on action and emotion understanding.

Faces in context: a review and systematization of contextual influences on affective face processing

Facial expressions are of eminent importance for social interaction as they convey information about other individuals’ emotions and social intentions. According to the predominant “basic emotion” approach, the perception of emotion in faces is based on the rapid, automatic categorization of prototypical, universal expressions. Consequently, the perception of facial expressions has typically been investigated using isolated, de-contextualized, static pictures of facial expressions that maximize the distinction between categories. However, in everyday life, an individual’s face is not perceived in isolation, but almost always appears within a situational context, which may arise from other people, the physical environment surrounding the face, as well as multichannel information from the sender. Furthermore, situational context may be provided by the perceiver, including already present social information gained from affective learning and implicit processing biases such as race bias. Thus, the perception of facial expressions is presumably always influenced by contextual variables. In this comprehensive review, we aim at (1) systematizing the contextual variables that may influence the perception of facial expressions and (2) summarizing experimental paradigms and findings that have been used to investigate these influences. The studies reviewed here demonstrate that perception and neural processing of facial expressions are substantially modified by contextual information, including verbal, visual, and auditory information presented together with the face as well as knowledge or processing biases already present in the observer. These findings further challenge the assumption of automatic, hardwired categorical emotion extraction mechanisms predicted by basic emotion theories. Taking into account a recent model on face processing, we discuss where and when these different contextual influences may take place, thus outlining potential avenues in future research.

Facial mimicry and the mirror neuron system: simultaneous acquisition of facial electromyography and functional magnetic resonance imaging

Numerous studies have shown that humans automatically react with congruent facial reactions, i.e., facial mimicry, when seeing a vis-á-vis' facial expressions. The current experiment is the first investigating the neuronal structures responsible for differences in the occurrence of such facial mimicry reactions by simultaneously measuring BOLD and facial EMG in an MRI scanner. Therefore, 20 female students viewed emotional facial expressions (happy, sad, and angry) of male and female avatar characters. During picture presentation, the BOLD signal as well as M. zygomaticus major and M. corrugator supercilii activity were recorded simultaneously. Results show prototypical patterns of facial mimicry after correction for MR-related artifacts: enhanced M. zygomaticus major activity in response to happy and enhanced M. corrugator supercilii activity in response to sad and angry expressions. Regression analyses show that these congruent facial reactions correlate significantly with activations in the IFG, SMA, and cerebellum. Stronger zygomaticus reactions to happy faces were further associated to increased activities in the caudate, MTG, and PCC. Corrugator reactions to angry expressions were further correlated with the hippocampus, insula, and STS. Results are discussed in relation to core and extended models of the mirror neuron system (MNS).

Neural mechanisms underlying the effects of face-based affective signals on memory for faces: a tentative model

In our daily lives, we form some impressions of other people. Although those impressions are affected by many factors, face-based affective signals such as facial expression, facial attractiveness, or trustworthiness are important. Previous psychological studies have demonstrated the impact of facial impressions on remembering other people, but little is known about the neural mechanisms underlying this psychological process. The purpose of this article is to review recent functional MRI (fMRI) studies to investigate the effects of face-based affective signals including facial expression, facial attractiveness, and trustworthiness on memory for faces, and to propose a tentative concept for understanding this affective-cognitive interaction. On the basis of the aforementioned research, three brain regions are potentially involved in the processing of face-based affective signals. The first candidate is the amygdala, where activity is generally modulated by both affectively positive and negative signals from faces. Activity in the orbitofrontal cortex (OFC), as the second candidate, increases as a function of perceived positive signals from faces; whereas activity in the insular cortex, as the third candidate, reflects a function of face-based negative signals. In addition, neuroscientific studies have reported that the three regions are functionally connected to the memory-related hippocampal regions. These findings suggest that the effects of face-based affective signals on memory for faces could be modulated by interactions between the regions associated with the processing of face-based affective signals and the hippocampus as a memory-related region.

Why are you looking like that? How the context influences evaluation and processing of human faces

Perception and evaluation of facial expressions are known to be heavily modulated by emotional features of contextual information. Such contextual effects, however, might also be driven by non-emotional aspects of contextual information, an interaction of emotional and non-emotional factors, and by the observers' inherent traits. Therefore, we sought to assess whether contextual information about self-reference in addition to information about valence influences the evaluation and neural processing of neutral faces. Furthermore, we investigated whether social anxiety moderates these effects. In the present functional magnetic resonance imaging (fMRI) study, participants viewed neutral facial expressions preceded by a contextual sentence conveying either positive or negative evaluations about the participant or about somebody else. Contextual influences were reflected in rating and fMRI measures, with strong effects of self-reference on brain activity in the medial prefrontal cortex and right fusiform gyrus. Additionally, social anxiety strongly affected the response to faces conveying negative, self-related evaluations as revealed by the participants' rating patterns and brain activity in cortical midline structures and regions of interest in the left and right middle frontal gyrus. These results suggest that face perception and processing are highly individual processes influenced by emotional and non-emotional aspects of contextual information and further modulated by individual personality traits.

Effects of aversive stimuli on prospective memory. An event-related fMRI study

Prospective memory (PM) describes the ability to execute a previously planned action at the appropriate point in time. Although behavioral studies clearly showed that prospective memory performance is affected by the emotional significance attributed to the intended action, no study so far investigated the brain mechanisms subserving the modulatory effect of emotional salience on PM performance. The general aim of the present study was to explore brain regions involved in prospective memory processes when PM cues are associated with emotional stimuli. In particular, based on the hypothesised critical role of the prefrontal cortex in prospective memory in the presence of emotionally salient stimuli, we expected a stronger involvement of aPFC when the retrieval and execution of the intended action is cued by an aversive stimulus. To this aim BOLD responses of PM trials cued by aversive facial expressions were compared to PM trials cued by neutral facial expressions. Whole brain analysis showed that PM task cued by aversive stimuli is differentially associated with activity in the right lateral prefrontal area (BA 10) and in the left caudate nucleus. Moreover a temporal shift between the response of the caudate nucleus that preceded that of aPFC was observed. These findings suggest that the caudate nucleus might provide an early analysis of the affective properties of the stimuli, whereas the anterior lateral prefrontal cortex (BA10) would be involved in a slower and more deliberative analysis to guide goal-directed behaviour.

Differential effects of dopaminergic therapies on dorsal and ventral striatum in Parkinson's disease: implications for cognitive function

Cognitive abnormalities are a feature of Parkinson's disease (PD). Unlike motor symptoms that are clearly improved by dopaminergic therapy, the effect of dopamine replacement on cognition seems paradoxical. Some cognitive functions are improved whereas others are unaltered or even hindered. Our aim was to understand the effect of dopamine replacement therapy on various aspects of cognition. Whereas dorsal striatum receives dopamine input from the substantia nigra (SN), ventral striatum is innervated by dopamine-producing cells in the ventral tegmental area (VTA). In PD, degeneration of SN is substantially greater than cell loss in VTA and hence dopamine-deficiency is significantly greater in dorsal compared to ventral striatum. We suggest that dopamine supplementation improves functions mediated by dorsal striatum and impairs, or heightens to a pathological degree, operations ascribed to ventral striatum. We consider the extant literature in light of this principle. We also survey the effect of dopamine replacement on functional neuroimaging in PD relating the findings to this framework. This paper highlights the fact that currently, titration of therapy in PD is geared to optimizing dorsal striatum-mediated motor symptoms, at the expense of ventral striatum operations. Increased awareness of contrasting effects of dopamine replacement on dorsal versus ventral striatum functions will lead clinicians to survey a broader range of symptoms in determining optimal therapy, taking into account both those aspects of cognition that will be helped versus those that will be hindered by dopaminergic treatment.