Explicit and incidental facial expression processing: an fMRI study

Review of EEG Affective Recognition with a Neuroscience Perspective

Emotions are a series of subconscious, fleeting, and sometimes elusive manifestations of the human innate system. They play crucial roles in everyday life-influencing the way we evaluate ourselves, our surroundings, and how we interact with our world. To date, there has been an abundance of research on the domains of neuroscience and affective computing, with experimental evidence and neural network models, respectively, to elucidate the neural circuitry involved in and neural correlates for emotion recognition. Recent advances in affective computing neural network models often relate closely to evidence and perspectives gathered from neuroscience to explain the models. Specifically, there has been growing interest in the area of EEG-based emotion recognition to adopt models based on the neural underpinnings of the processing, generation, and subsequent collection of EEG data. In this respect, our review focuses on providing neuroscientific evidence and perspectives to discuss how emotions potentially come forth as the product of neural activities occurring at the level of subcortical structures within the brain's emotional circuitry and the association with current affective computing models in recognizing emotions. Furthermore, we discuss whether such biologically inspired modeling is the solution to advance the field in EEG-based emotion recognition and beyond.

TMS disruption of the lateral prefrontal cortex increases neural activity in the default mode network when naming facial expressions

Recognizing facial expressions is dependent on multiple brain networks specialized for different cognitive functions. In the current study, participants (N = 20) were scanned using functional magnetic resonance imaging (fMRI), while they performed a covert facial expression naming task. Immediately prior to scanning thetaburst transcranial magnetic stimulation (TMS) was delivered over the right lateral prefrontal cortex (PFC), or the vertex control site. A group whole-brain analysis revealed that TMS induced opposite effects in the neural responses across different brain networks. Stimulation of the right PFC (compared to stimulation of the vertex) decreased neural activity in the left lateral PFC but increased neural activity in three nodes of the default mode network (DMN): the right superior frontal gyrus, right angular gyrus and the bilateral middle cingulate gyrus. A region of interest analysis showed that TMS delivered over the right PFC reduced neural activity across all functionally localised face areas (including in the PFC) compared to TMS delivered over the vertex. These results suggest that visually recognizing facial expressions is dependent on the dynamic interaction of the face-processing network and the DMN. Our study also demonstrates the utility of combined TMS/fMRI studies for revealing the dynamic interactions between different functional brain networks.

The prefrontal cortex is differentially involved in implicit and explicit facial emotion processing: An fNIRS study

Despite extensive research, the differential roles of the prefrontal cortex (PFC) in implicit and explicit facial emotion processing remain elusive. Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique that can measure changes in both oxyhemoglobin (HbO) and deoxyhemoglobin (HbR) concentrations. Currently, how HbO and HbR change during facial emotion processing remains unclear. Here, fNIRS was used to examine and compare PFC activation during implicit and explicit facial emotion processing. Forty young adults performed a facial-matching task that required either emotion discrimination (explicit task) or age discrimination (implicit task), and the activation of their PFCs was measured by fNIRS. Participants attempted the task on two occasions to determine whether their activation patterns were maintained over time. The PFC displayed increases in HbO and/or decreases in HbR during the implicit and explicit facial emotion tasks. Importantly, there were significantly greater changes in PFC HbO during the explicit task, whereas no significant difference in HbR changes between conditions was found. Between sessions, HbO changes were reduced across tasks, but the difference in HbO changes between the implicit and explicit tasks remained unchanged. The test-retest reliability of the behavioral measures was excellent, whereas that of fNIRS measures was mostly poor to fair. Thus, the PFC plays a specific role in recognizing facial expressions, and its differential involvement in implicit and explicit facial emotion processing can be consistently captured at the group level by changes in HbO. This study demonstrates the potential of fNIRS for elucidating the neural mechanisms underlying facial emotion recognition.

The Influence of Emotional Experience on Semantic Processing of Concrete Concepts

Introduction

Parallel distributed processing theory (PDP theory) holds that all brain regions involved in conceptual representation perform a series of activities at the same time. However, the role of emotional experience information in concrete conceptual representation is still unknown. This study further explores whether the emotional experience will also affect the semantic processing of concrete concept representations.

Methods

This study used the emotion priming paradigm and semantic judgment task to explore whether emotion priming impacts the processing of animal concepts with different emotional experiences through two experiments. In Experiments 1a and 1b, pleasant or disgusted faces were used as emotional priming stimuli to explore whether the explicit processing of emotions would affect the semantic processing of animal concepts. Experiments 2a and 2b used positive or negative scenery pictures as emotional priming stimuli to explore whether the implicit processing of emotions would affect the semantic processing of animal concepts.

Results

The Experiment 1 results showed that the perception of faces promotes the processing of animal words, showing the "word-emotion congruence effect". Experiment 2a did not show the expected results, while Experiment 2b showed that the general negative perception of scenery pictures could significantly promote the processing of disgusted animal words. The results further proved the "word-emotion congruence effect" shown in the results of Experiment 1 from the perspective of implicit emotion processing. Combining the results of two experiments, it can be proven that emotional experience affects the semantic processing process of concrete concepts.

Discussion

Both Experiment 1 and Experiment 2b of this study show the "word-emotion congruence effect". PDP theory believes that conceptual representation is represented by the activity patterns of billions of neurons distributed in many areas of the brain, and related semantic processing and sensory processing will occur simultaneously. The results of this experiment well support PDP theory.

Common and distinct neurofunctional representations of core and social disgust in the brain: Coordinate-based and network meta-analyses

Disgust represents a multifaceted defensive-avoidance response. On the behavioral level, the response includes withdrawal and a disgust-specific facial expression. While both serve the avoidance of pathogens, the latter additionally transmits social-communicative information. Given that common and distinct brain representation of the primary defensive-avoidance response (core disgust) and encoding of the social-communicative signal (social disgust) remain debated, we employed neuroimaging meta-analyses to (1) determine brain systems generally engaged in disgust processing, and (2) segregate common and distinct brain systems for core and social disgust. Disgust processing, in general, engaged a bilateral network encompassing the insula, amygdala, occipital and prefrontal regions. Core disgust evoked stronger reactivity in left-lateralized threat detection and defensive response network including amygdala, occipital and frontal regions, while social disgust engaged a right-lateralized superior temporal-frontal network engaged in social cognition. Anterior insula, inferior frontal and fusiform regions were commonly engaged during core and social disgust, suggesting a shared neurofunctional basis. We demonstrate a common and distinct neural basis of primary disgust responses and encoding of associated social-communicative signals.

Facial expression is retained in deep networks trained for face identification

Facial expressions distort visual cues for identification in two-dimensional images. Face processing systems in the brain must decouple image-based information from multiple sources to operate in the social world. Deep convolutional neural networks (DCNN) trained for face identification retain identity-irrelevant, image-based information (e.g., viewpoint). We asked whether a DCNN trained for identity also retains expression information that generalizes over viewpoint change. DCNN representations were generated for a controlled dataset containing images of 70 actors posing 7 facial expressions (happy, sad, angry, surprised, fearful, disgusted, neutral), from 5 viewpoints (frontal, 90° and 45° left and right profiles). Two-dimensional visualizations of the DCNN representations revealed hierarchical groupings by identity, followed by viewpoint, and then by facial expression. Linear discriminant analysis of full-dimensional representations predicted expressions accurately, mean 76.8% correct for happiness, followed by surprise, disgust, anger, neutral, sad, and fearful at 42.0%; chance ≈14.3%. Expression classification was stable across viewpoints. Representational similarity heatmaps indicated that image similarities within identities varied more by viewpoint than by expression. We conclude that an identity-trained, deep network retains shape-deformable information about expression and viewpoint, along with identity, in a unified form—consistent with a recent hypothesis for ventral visual stream processing.

Emotional sensitivity predicts internship performance of medical students enrolled under different admission screening protocols

BACKGROUND AND PURPOSE

People with heightened emotional sensitivity can perceive better how others feel. Students admitted to medical school by interviews for assessing pre-set personal qualities, such as emotional sensitivity, may be more likely to meet patients' satisfaction in the future. We tested whether a student enrolled by passing the interview would have more emotional sensitivity than those by taking an exam. We also investigated what impact the enrolment protocols might have on students' internship performance.

METHODS

Participants were first- and second-year medical students and assigned into the interviewed group or examined group according to the entrance protocols. Two emotion-related tasks and one control task were adopted. Subsequently, the performance evaluation of clinical work from students' advisors about these two groups of participants were collected after they finished the internship training at the hospital.

CONCLUSIONS

Students selected through the pre-programmed interview which is based on personal qualities showed greater emotional sensitivity than those selected by the exam. Those students with better emotional sensitivity also performed better when they were in the internship training. Emotional sensitivity is a valid index to predict students' future performance and could be used in the selection protocol for medical students.

Using a second-person approach to identify disease-specific profiles of social behavior in frontotemporal dementia and Alzheimer's disease

Changes in social behavior are recognized as potential symptoms of behavioral-variant frontotemporal dementia (bvFTD) and semantic dementia (SD), yet objective ways to assess these behaviors in natural social situations are lacking. This study takes a truly social (or second-person) approach and examines changes in real-world social behavior in different dementia syndromes, by analyzing non-scripted social interactions in bvFTD patients (n = 20) and SD patients (n = 20), compared to patients with Alzheimer's disease (AD) (n = 20). Video recordings of 10-min conversations between patients and behavioral neurologists were analyzed for the presence of socially engaging (e.g., nodding, smiling, gesturing) and disengaging behavior (e.g., avoiding eye contact, self-grooming, interrupting). Results demonstrated disease-specific profiles, with bvFTD patients showing less nodding and more looking away than AD, and SD patients showing more gesturing than AD. A principal components analysis revealed the presence of four unobserved components, showing atypical disengaging patterns of behavior. Whole-brain voxel-based morphometry analyses revealed distinct neurobiological bases for each of these components, with the brain regions identified previously associated with behavior selection, abstract mentalization and processing of multi-sensory and socially-relevant information, in mediating socially engaging and disengaging behavior. This study demonstrates the utility of systematic behavioral observation of social interactions in the differential diagnosis of dementia.

Damage to Orbitofrontal Areas 12 and 13, but Not Area 14, Results in Blunted Attention and Arousal to Socioemotional Stimuli in Rhesus Macaques

An earlier study in monkeys indicated that lesions to the mid-portion of the ventral orbitofrontal cortex (OFC), including Walker’s areas 11 and 13 (OFC11/13), altered the spontaneous scanning of still pictures of primate faces (neutral and emotional) and the modulation of arousal. Yet, these conclusions were limited by several shortcomings, including the lesion approach, use of static rather than dynamic stimuli, and manual data analyses. To confirm and extend these earlier findings, we compared attention and arousal to social and nonsocial scenes in three groups of rhesus macaques with restricted lesions to one of three OFC areas (OFC12, OFC13, or OFC14) and a sham-operated control group using eye-tracking to capture scanning patterns, focal attention and pupil size. Animals with damage to the lateral OFC areas (OFC12 and OFC13) showed decreased attention specifically to the eyes of negative (threatening) social stimuli and increased arousal (increased pupil diameter) to positive social scenes. In contrast, animals with damage to the ventromedial OFC area (OFC14) displayed no differences in attention or arousal in the presence of social stimuli compared to controls. These findings support the notion that areas of the lateral OFC are critical for directing attention and modulating arousal to emotional social cues. Together with the existence of face-selective neurons in these lateral OFC areas, the data suggest that the lateral OFC may set the stage for multidimensional information processing related to faces and emotion and may be involved in social judgments.

Comparison Between Facilitating and Suppressing Facial Emotional Expressions Using Frontal EEG Asymmetry

The prefrontal cortex plays a key role in emotional state. Electroencephalography (EEG) studies have reported relationships between frontal asymmetry in the alpha band, emotional state, and emotion-related motivation. The current study investigated whether the positive or negative valence of emotional stimulation or the behavioral intention to either facilitate or suppress one’s facial expression in response to these stimuli is reflected in relevant changes in frontal EEG asymmetry. EEG was recorded while participants either produced a facial expression that was in accord with positive or negative feelings corresponding to image stimuli, or suppressed their facial expressions. The laterality index of frontal alpha power indicated greater relative right frontal activity while participants suppressed facial expression compared with facilitating facial expression during emotional stimulation. However, there was no difference in frontal asymmetry between the presentation of image stimuli showing facial expressions corresponding to positive vs. negative emotions. These results suggested that frontal asymmetry was related to the control of facial emotional expressions rather than the perception of positive vs. negative emotions. Moreover, microstate analysis revealed that the appearance rate of microstate class B with polarity in the left frontal area increased during the suppression of facial expressions. The present results suggested that frontal asymmetry reflects the control of facial emotional expressions, which supports the motivational direction model.

Gaze behaviour to lateral face stimuli in infants who do and do not gain an ASD diagnosis

Cerebral lateralisation of function is common characteristic across vertebrate species and is positively associated with fitness of the organism, in humans we hypothesise that it is associated with cognitive fitness. This investigation evaluated the early development of lateralised gaze behaviour for face stimuli in infants at high and low risk for autism from the British Autism Sibling Infant Study (BASIS). The BASIS cohort includes a low risk group and three high-risk groups who at age 3 were developing (i) typically, (ii) atypically or (iii) had received a diagnosis for ASD. Using eye-tracking data derived from a face pop-out task at 6 and 14 months of age, all non-ASD groups showed a bias for stimuli on the left at both timepoints. At 6 months the ASD group demonstrated a preference for stimuli on the right and were slower than their neurotypical counterparts to look at faces on the left. However, by 14 months these differences disappear. Longitudinal associations between lateral looking behaviour at 6 months and language and motor ability at 14 months were also found. Results suggest that infants who go on to be diagnosed with autism exhibit early differences in gaze behaviour that may be associated with subsequent cognitive outcomes.

Neural Correlates of Facial Expression Recognition in Earthquake Witnesses

Major adverse events, like an earthquake, trigger different kinds of emotional dysfunctions or psychiatric disorders in the exposed subjects. Recent literature has also shown that exposure to natural disasters can increase threat detection. In particular, we previously found a selective enhancement in the ability to read emotional facial expressions in L’Aquila earthquake witnesses, suggesting hypervigilance to stimuli signaling a threat. In light of previous neuroimaging data showing that trauma exposure is related to derangement of resting-state brain activity, in the present study we investigated the neurofunctional changes related to the recognition of emotional faces in L’Aquila earthquake witnesses. Specifically, we tested the relationships between accuracy in recognizing facial expressions and activity of the visual network (VN) and of the default-mode network (DMN). Resting-state functional connectivity (FC) with the main hub of the VN (primary, ventral, right-dorsal, and left-dorsal visual cortices) and DMN (posterior cingulate/precuneus, medial prefrontal, and right and left inferior parietal cortices) was investigated through a seed-based functional magnetic resonance imaging (fMRI) analysis in both earthquake-exposed subjects and non-exposed persons who did not live in an earthquake-affected area. The results showed that, in earthquake-exposed subjects, there is a significant reduction in the correlation between accuracy in recognizing facial expressions and the FC of the dorsal seed of the VN with the right inferior occipito-temporal cortex and the left lateral temporal cortex, and of two parietal seeds of DMN, i.e., lower parietal and medial prefrontal cortex, with the precuneus bilaterally. These findings suggest that a functional modification of brain systems involved in detecting and interpreting emotional faces may represent the neurophysiological basis of the specific “emotional expertise” observed in the earthquake witnesses.

Behavioral and Neural Dysregulation to Social Rewards and Links to Internalizing Symptoms in Adolescents

Adolescence is a time of unique sensitivity to socially salient stimuli such as social rewards. This period overlaps with the onset of psychopathology such as internalizing and externalizing symptoms. In the current studies, we examined behavioral and neural patterns of dysregulation to social rewards and threats, and links to internalizing and externalizing symptoms in youths. In study 1, we used a social Go/NoGo cognitive control task using peer faces to test for age-related behavioral differences in inhibitory failures in adolescents (N = 53, Mage = 13.37 years), and adults (N = 51, Mage = 43.71 years). In study 2, an independent adolescent sample (N = 51, Mage = 13.98 years) completed a similar social Go/NoGo cognitive control task during fMRI. Results show that adolescents had greater inhibitory failures - as measured by false alarm rate - to both social reward and threat cues than adults, and more so to social reward than threat cues. Greater inhibitory failures to social reward than threat cues were associated with greater internalizing symptoms, but were not significantly related to externalizing symptoms. At the neural level, greater inhibitory failures to social reward than threat cues as well as greater internalizing symptoms were both associated with heightened amygdala-ventral striatum connectivity. Our findings indicate that subcortico-subcortical connectivity, which is deemed to occur chronologically earlier and thus necessary for subcortico-cortical circuits, may serve as an early biomarker for emotion dysregulation and a risk factor for internalizing symptoms.

Positive emotions have a unique capacity to capture attention

Most of the previous research in the area of cognitive psychology or cognitive neuroscience focused on studying negative emotions and argued that the negative emotional stimuli capture attention involuntarily as compared to neutral stimuli. However, in the last decades, researchers started paying attention in studying positive emotions also as positive emotions have evolutionary significance and are essential for many aspects of our life. The theme of this chapter is to present an overview of research in the area of positive emotions, and make a case that positively-valenced stimulus is prioritized over others. Primarily, when attentional resources are not constrained, many studies have shown that similar to negative stimuli, positive stimuli also capture attention automatically irrespective of whether they are relevant or irrelevant to the primary task. It suggests a fundamental prioritization of these stimuli by the cognitive/motivational system. However, when attentional resources are constrained, only positive or high rewarding stimuli win the competition for attentional resources compared to negative or stimuli associated with high punishment. Positive or high rewarding stimuli also receive priority in temporal selection, when attention is constrained. Theoretical implications of these results have been discussed. Possible cognitive and neural mechanisms have been proposed underlying these effects.

Aberrant attentive and inattentive brain activity to auditory negative words, and its relation to persecutory delusion in patients with schizophrenia

BACKGROUND AND PURPOSE

Previous research has suggested that deficits in emotion recognition are involved in the pathogenesis of persecutory delusion in schizophrenia. Although disruption in auditory and language processing is crucial in the pathophysiology of schizophrenia, the neural basis for the deficits in emotion recognition of auditorily presented language stimuli and its relation to persecutory delusion have not yet been clarified.

PATIENTS AND METHODS

The current functional magnetic resonance imaging study used a dichotic listening task for 15 patients with schizophrenia and 23 healthy controls matched for age, sex, parental socioeconomic background, handedness, dexterous ear, and intelligence quotient. The participants completed a word recognition task on the attended side in which a word with emotionally valenced content (negative/neutral) was presented to one ear and a different neutral word was presented to the other ear. Participants selectively attended to either ear.

RESULTS

The whole brain analysis detected the aberrant neural activity in the right inferior frontal gyrus in the patients with schizophrenia compared to that in the controls (P<0.05, false discovery rate-corrected). Brain activity in the right pars triangularis of the inferior frontal gyrus was significantly reduced when negatively valenced words were presented to the right ear, whereas the activity of the same region was significantly enhanced when these words were presented to the left ear, irrespective of the attended ear, in the participants with schizophrenia compared to the controls. Furthermore, this diminished brain response to auditorily presented negatively valenced words significantly correlated with severe positive symptoms (r=-0.67, P=0.006) and delusional behavior (r=-0.62, P=0.014) in the patients with schizophrenia.

CONCLUSION

The present results indicate that the significantly impaired brain activity in response to auditorily presented negatively valenced words in the right pars triangularis of the inferior frontal gyrus is associated with the pathogenesis of positive symptoms such as persecutory delusion.

Brain pathways of pain empathy activated by pained facial expressions: a meta-analysis of fMRI using the activation likelihood estimation method

OBJECTIVE:

The objective of this study is to summarize and analyze the brain signal patterns of empathy for pain caused by facial expressions of pain utilizing activation likelihood estimation, a meta-analysis method.

DATA SOURCES:

Studies concerning the brain mechanism were searched from the Science Citation Index, Science Direct, PubMed, DeepDyve, Cochrane Library, SinoMed, Wanfang, VIP, China National Knowledge Infrastructure, and other databases, such as SpringerLink, AMA, Science Online, Wiley Online, were collected. A time limitation of up to 13 December 2016 was applied to this study.

DATA SELECTION:

Studies presenting with all of the following criteria were considered for study inclusion: Use of functional magnetic resonance imaging, neutral and pained facial expression stimuli, involvement of adult healthy human participants over 18 years of age, whose empathy ability showed no difference from the healthy adult, a painless basic state, results presented in Talairach or Montreal Neurological Institute coordinates, multiple studies by the same team as long as they used different raw data.

OUTCOME MEASURES:

Activation likelihood estimation was used to calculate the combined main activated brain regions under the stimulation of pained facial expression.

RESULTS:

Eight studies were included, containing 178 subjects. Meta-analysis results suggested that the anterior cingulate cortex (BA32), anterior central gyrus (BA44), fusiform gyrus, and insula (BA13) were activated positively as major brain areas under the stimulation of pained facial expression.

CONCLUSION:

Our study shows that pained facial expression alone, without viewing of painful stimuli, activated brain regions related to pain empathy, further contributing to revealing the brain’s mechanisms of pain empathy.

Hierarchical Brain Network for Face and Voice Integration of Emotion Expression

The brain has separate specialized computational units to process faces and voices located in occipital and temporal cortices. However, humans seamlessly integrate signals from the faces and voices of others for optimal social interaction. How are emotional expressions, when delivered by different sensory modalities (faces and voices), integrated in the brain? In this study, we characterized the brains’ response to faces, voices, and combined face–voice information (congruent, incongruent), which varied in expression (neutral, fearful). Using a whole-brain approach, we found that only the right posterior superior temporal sulcus (rpSTS) responded more to bimodal stimuli than to face or voice alone but only when the stimuli contained emotional expression. Face- and voice-selective regions of interest, extracted from independent functional localizers, similarly revealed multisensory integration in the face-selective rpSTS only; further, this was the only face-selective region that also responded significantly to voices. Dynamic causal modeling revealed that the rpSTS receives unidirectional information from the face-selective fusiform face area, and voice-selective temporal voice area, with emotional expression affecting the connection strength. Our study promotes a hierarchical model of face and voice integration, with convergence in the rpSTS, and that such integration depends on the (emotional) salience of the stimuli.

Are Moral and Socio-conventional Knowledge Impaired in Severe Traumatic Brain Injury?

Objective

The aim of this study was to investigate explicit moral and socio-conventional knowledge in Traumatic Brain Injury (TBI) patients.

Method

A group of 28 TBI patients was tested on a new set of moral and socio-conventional items. Responses of TBI patients were compared with those of 28 matched controls. Participants had to report how hard would be to perform specific moral or socio-conventional transgressions, using a 10-point Likert scale. We analyzed our data through mixed-effects models, to jointly assess by-participants and by-items variance. The factors considered were Type of Item (Moral vs. Socio-conventional) and Group (TBI vs. Controls).

Results

Results revealed a significant interaction between Type of Item and Group (χ2[1] = 25.5, p < .001). Simple-effects analyses showed that TBI, as Controls, were able to differentiate moral and socio-conventional transgressions (χ2[1] = 72.3, p < .001), as they deemed the former as more difficult to enact. TBI patients, however, evaluated moral transgressions as easier to fulfill (χ2[1] = 12.2, p = .001).

Conclusions

TBI patients can clearly differentiate moral and socio-conventional transgressions, suggesting that the explicit knowledge of these two dimensions is spared. TBI patients, however, considered moral transgressions as easier to fulfill with respect to Controls. This finding may suggest a tendency in TBI patients to underestimate the weight of moral transgressions.

Blunted amygdala activity is associated with depression severity in treatment-resistant depression

Up to 50% of individuals with major depressive disorder (MDD) do not recover after two antidepressant medication trials, and therefore meet the criteria for treatment-resistant depression (TRD). Mindfulness-based cognitive therapy (MBCT) is one promising treatment; however, the extent to which MBCT influences clinical outcomes relative to baseline neural activation remains unknown. In the present study we investigated baseline differences in amygdala activation between TRD patients and healthy controls (HCs), related amygdala activation to depression symptoms, and examined the impacts of MBCT and amygdala activation on longitudinal depression outcomes. At baseline, TRD patients (n = 80) and HCs (n = 37) participated in a functional magnetic resonance imaging task in which they identified either the emotion (affect labeling) or the gender (gender labeling) of faces, or passively viewed faces (observing). The TRD participants then completed eight weeks of MBCT or a health enhancement program (HEP). Relative to HCs, the TRD patients demonstrated less amygdala activation during affect labeling, and marginally less during gender labeling. Blunted amygdala activation in TRD patients during affect labeling was associated with greater depression severity. MBCT was associated with greater depression reductions than was HEP directly following treatment; however, at 52 weeks the treatment effect was not significant, and baseline amygdala activation across the task conditions predicted depression severity in both groups. TRD patients have blunted amygdala responses during affect labeling that are associated with greater concurrent depression. Furthermore, although MBCT produced greater short-term improvements in depression than did HEP, overall baseline amygdala reactivity was predictive of long-term clinical outcomes in both groups.

Sleep-amount differentially affects fear-processing neural circuitry in pediatric anxiety: A preliminary fMRI investigation

Insufficient sleep, as well as the incidence of anxiety disorders, both peak during adolescence. While both conditions present perturbations in fear-processing-related neurocircuitry, it is unknown whether these neurofunctional alterations directly link anxiety and compromised sleep in adolescents. Fourteen anxious adolescents (AAs) and 19 healthy adolescents (HAs) were compared on a measure of sleep amount and neural responses to negatively valenced faces during fMRI. Group differences in neural response to negative faces emerged in the dorsal anterior cingulate cortex (dACC) and the hippocampus. In both regions, correlation of sleep amount with BOLD activation was positive in AAs, but negative in HAs. Follow-up psychophysiological interaction (PPI) analyses indicated positive connectivity between dACC and dorsomedial prefrontal cortex, and between hippocampus and insula. This connectivity was correlated negatively with sleep amount in AAs, but positively in HAs. In conclusion, the presence of clinical anxiety modulated the effects of sleep-amount on neural reactivity to negative faces differently among this group of adolescents, which may contribute to different clinical significance and outcomes of sleep disturbances in healthy adolescents and patients with anxiety disorders.

Linguistic processing and Script-Driven Imagery for trauma exposure: A proof of concept pilot trial

While several empirically supported treatments for posttraumatic stress disorder (PTSD) have been developed, these treatments are neither widely available nor universally efficacious. This pilot, proof of concept study evaluated a computerized imaginal exposure Script-Driven Imagery Training (SDI-T) for individuals with elevated trauma reactivity. The training was supplemented with two forms of linguistic processing, affect labeling (SDI-T + AL) and distraction (SDI-T + D), to determine whether linguistic inhibitory regulation augmented the effects of SDI-T.

METHODS

Participants (n = 64) with trauma-related distress were randomized to SDI-T, SDI-T + AL, or SDI-T + D. Physiology and self-reported trauma distress were measured at pre- and post-training.

RESULTS

The training was acceptable to participants and effective at reducing self-reported distress (d = -0.41), and physiological activation from pre- to post-training (d = -0.49, ps < .01), with some evidence that linguistic processing (SDI-T + AL and SDIT-T + D) conferred a benefit over SDI-T. The linguistic processing groups had significantly steeper reduction in physiology relative to the non-linguistic processing group (p < .05, d = 0.59). There was no benefit of SDI-T + AL over SDI-T + D.

CONCLUSIONS

This pilot study provides initial support for the acceptability and efficacy of computerized imaginal exposure training for PTSD. Clinical implications and future directions are discussed.

Can threat detection be enhanced using processing strategies by police trainees and officers?

The ability to detect threatening stimuli is an important skill for police officers. No research has yet examined whether implementing different information processing strategies can improve threat detection in police officers and police trainees. The first aim of our study was to compare the effect of strategies accentuating the processing of the emotional or the semantic dimension of stimuli on attention towards threatening and neutral information. The second aim was to consider the impact of PTSD symptoms on threat detection, as a function of processing strategies, in police officers and trainees. In a cueing paradigm, participants had to respond to a target that was presented following a threatening or neutral cue. Participants then answered a question, known beforehand, concerning the cue. The question was used to induce a more emotional or semantic processing strategy. Results showed that when the processing strategy was emotional, police trainees and officers were faster to detect the target when it followed a threatening cue, compared to a neutral cue, independently of its spatial location. This was not the case when the processing strategy was semantic. This study shows that induced processing strategies can influence attentional mechanisms related to threat detection in police trainees and police officers.

Impaired Recognition of Emotional Faces after Stroke Involving Right Amygdala or Insula

Despite its basic and translational importance, the neural circuitry supporting the perception of emotional faces remains incompletely understood. Functional imaging studies and chronic lesion studies indicate distinct roles of the amygdala and insula in recognition of fear and disgust in facial expressions, whereas intracranial encephalography studies, which are not encumbered by variations in human anatomy, indicate a somewhat different role of these structures. In this article, we leveraged lesion-mapping techniques in individuals with acute right hemisphere stroke to investigate lesions associated with impaired recognition of prototypic emotional faces before significant neural reorganization can occur during recovery from stroke. Right hemisphere stroke patients were significantly less accurate than controls on a test of emotional facial recognition for both positive and negative emotions. Patients with right amygdala or anterior insula lesions had significantly lower scores than other right hemisphere stroke patients on recognition of angry and happy faces. Lesion volume within several regions, including the right amygdala and anterior insula, each independently contributed to the error rate in recognition of individual emotions. Results provide additional support for a necessary role of the right amygdala and anterior insula within a network of regions underlying recognition of facial expressions, particularly those that have biological importance or motivational relevance and have implications for clinical practice.

Neural Correlates of Explicit Versus Implicit Facial Emotion Processing in ASD

The underlying neural mechanisms of implicit and explicit facial emotion recognition (FER) were studied in children and adolescents with autism spectrum disorder (ASD) compared to matched typically developing controls (TDC). EEG was obtained from N = 21 ASD and N = 16 TDC. Task performance, visual (P100, N170) and cognitive (late positive potential) event-related-potentials, as well as coherence were compared across groups. TDC showed a task-dependent increase and a stronger lateralization of P100 amplitude during the explicit task and task-dependent modulation of intra-hemispheric coherence in the beta band. In contrast, the ASD group showed no task dependent modulation. Results indicate disruptions in early visual processing and top-down attentional processes as contributing factors to FER deficits in ASD.

Increased heart rate after exercise facilitates the processing of fearful but not disgusted faces

Embodied theories of emotion assume that emotional processing is grounded in bodily and affective processes. Accordingly, the perception of an emotion re-enacts congruent sensory and affective states; and conversely, bodily states congruent with a specific emotion facilitate emotional processing. This study tests whether the ability to process facial expressions (faces having a neutral expression, expressing fear, or disgust) can be influenced by making the participants’ body state congruent with the expressed emotion (e.g., high heart rate in the case of faces expressing fear). We designed a task requiring participants to categorize pictures of male and female faces that either had a neutral expression (neutral), or expressed emotions whose linkage with high heart rate is strong (fear) or significantly weaker or absent (disgust). Critically, participants were tested in two conditions: with experimentally induced high heart rate (Exercise) and with normal heart rate (Normal). Participants processed fearful faces (but not disgusted or neutral faces) faster when they were in the Exercise condition than in the Normal condition. These results support the idea that an emotionally congruent body state facilitates the automatic processing of emotionally-charged stimuli and this effect is emotion-specific rather than due to generic factors such as arousal.

The role of the cerebellum in explicit and incidental processing of facial emotional expressions: A study with transcranial magnetic stimulation

Growing evidence suggests that the cerebellum plays a critical role in non-motor functions, contributing to cognitive and affective processing. In particular, the cerebellum might represent an important node of the "limbic" network, underlying not only emotion regulation but also emotion perception and recognition. Here, we used transcranial magnetic stimulation (TMS) to shed further light on the role of the cerebellum in emotional perception by specifically testing cerebellar contribution to explicit and incidental emotional processing. In particular, in three different experiments, we found that TMS over the (left) cerebellum impaired participants' ability to categorize facial emotional expressions (explicit task) and to classify the gender of emotional faces (incidental emotional processing task), but not the gender of neutral faces. Overall, our results indicate that the cerebellum is involved in perceiving the emotional content of facial stimuli, even when this is task irrelevant.

Neural correlates of preferred activities: development of an interest-specific go/nogo task

The activities we choose to spend our leisure time with are intrinsically motivating and vary across individuals. Yet it is unknown how impulse control or neural activity changes when processing a preferred stimulus related to a hobby or interest. Developing a task that assesses the response to preferred interests is of importance as it would be relevant to a range of psychiatric disorders that have hyper- or hypo-arousal to such cues. During functional Magnetic Resonance Imaging (fMRI), 39 healthy adults completed a novel task to test approach behavior and cognitive control to cues that were personalized to the participants' interests compared to stimuli the participants identified as being of non-interest and colored shapes. fMRI results showed that cues of one's interest elicited activation in the anterior insula compared to colored shapes. Interests did not change inhibition compared to non-interests and colored shapes and all stimuli equally engaged a frontostriatal circuit. Together the results suggest that adults were sensitive to their interests but were effective at regulating their impulses towards these cues, a skill that is critical for navigating the temptations and distractions in our daily environment.

Altered spontaneous brain activity in adolescent boys with pure conduct disorder revealed by regional homogeneity analysis

Functional magnetic resonance imaging (fMRI) studies have revealed abnormal neural activity in several brain regions of adolescents with conduct disorder (CD) performing various tasks. However, little is known about the spontaneous neural activity in people with CD in a resting state. The aims of this study were to investigate CD-associated regional activity abnormalities and to explore the relationship between behavioral impulsivity and regional activity abnormalities. Resting-state fMRI (rs-fMRI) scans were administered to 28 adolescents with CD and 28 age-, gender-, and IQ-matched healthy controls (HCs). The rs-fMRI data were subjected to regional homogeneity (ReHo) analysis. ReHo can demonstrate the temporal synchrony of regional blood oxygen level-dependent signals and reflect the coordination of local neuronal activity facilitating similar goals or representations. Compared to HCs, the CD group showed increased ReHo bilaterally in the insula as well as decreased ReHo in the right inferior parietal lobule, right middle temporal gyrus and right fusiform gyrus, left anterior cerebellum anterior, and right posterior cerebellum. In the CD group, mean ReHo values in the left and the right insula correlated positively with Barratt Impulsivity Scale (BIS) total scores. The results suggest that CD is associated with abnormal intrinsic brain activity, mainly in the cerebellum and temporal-parietal-limbic cortices, regions that are related to emotional and cognitive processing. BIS scores in adolescents with CD may reflect severity of abnormal neuronal synchronization in the insula.

An Exploratory TMS Study on Prefrontal Lateralization in Valence Categorization of Facial Expressions

Abstract. Converging neuroimaging and patient data suggest that the dorsolateral prefrontal cortex (DLPFC) is involved in emotional processing. However, it is still not clear whether the DLPFC in the left and right hemisphere is differentially involved in emotion recognition depending on the emotion considered. Here we used transcranial magnetic stimulation (TMS) to shed light on the possible causal role of the left and right DLPFC in encoding valence of positive and negative emotional facial expressions. Participants were required to indicate whether a series of faces displayed a positive or negative expression, while TMS was delivered over the right DLPFC, the left DLPFC, and a control site (vertex). Interfering with activity in both the left and right DLPFC delayed valence categorization (compared to control stimulation) to a similar extent irrespective of emotion type. Overall, we failed to demonstrate any valence-related lateralization in the DLPFC by using TMS. Possible methodological limitations are discussed.

How task demands shape brain responses to visual food cues

Several previous imaging studies have aimed at identifying the neural basis of visual food cue processing in humans. However, there is little consistency of the functional magnetic resonance imaging (fMRI) results across studies. Here, we tested the hypothesis that this variability across studies might - at least in part - be caused by the different tasks employed. In particular, we assessed directly the influence of task set on brain responses to food stimuli with fMRI using two tasks (colour vs. edibility judgement, between-subjects design). When participants judged colour, the left insula, the left inferior parietal lobule, occipital areas, the left orbitofrontal cortex and other frontal areas expressed enhanced fMRI responses to food relative to non-food pictures. However, when judging edibility, enhanced fMRI responses to food pictures were observed in the superior and middle frontal gyrus and in medial frontal areas including the pregenual anterior cingulate cortex and ventromedial prefrontal cortex. This pattern of results indicates that task sets can significantly alter the neural underpinnings of food cue processing. We propose that judging low-level visual stimulus characteristics - such as colour - triggers stimulus-related representations in the visual and even in gustatory cortex (insula), whereas discriminating abstract stimulus categories activates higher order representations in both the anterior cingulate and prefrontal cortex. Hum Brain Mapp 38:2897-2912, 2017. © 2017 Wiley Periodicals, Inc.

How white and black bodies are perceived depends on what emotion is expressed

Body language is a powerful indicator of others’ emotions in social interactions, with positive signals triggering approach and negative ones retreat and defensiveness. Intergroup and interracial factors can influence these interactions, sometimes leading to aggressive or even violent behaviour. Despite its obvious social relevance however, the interaction between body expression and race remains unexplored, with explanations of the impact of race being almost exclusively based on the role of race in face recognition. In the current fMRI study we scanned white European participants while they viewed affective (angry and happy) body postures of both same race (white) and other race (black) individuals. To assess the difference between implicit and explicit recognition participants performed either an explicit emotion categorisation task, or an irrelevant shape judgement task. Brain activity was modulated by race in a number of brain regions across both tasks. Race-related activity appeared to be task- as well as emotion- specific. Overall, the other-race effects appeared to be driven by positive emotions, while same-race effects were observed for negative emotions. A race specific effect was also observed in right amygdala reflecting increased activation for explicit recognition of angry white body expressions. Overall, these results provide the first clear evidence that race influences affective body perception.

The Neural Bases of Disgust for Cheese: An fMRI Study

The study of food aversion in humans by the induction of illness is ethically unthinkable, and it is difficult to propose a type of food that is disgusting for everybody. However, although cheese is considered edible by most people, it can also be perceived as particularly disgusting to some individuals. As such, the perception of cheese constitutes a good model to study the cerebral processes of food disgust and aversion. In this study, we show that a higher percentage of people are disgusted by cheese than by other types of food. Functional magnetic resonance imaging then reveals that the internal and external globus pallidus and the substantia nigra belonging to the basal ganglia are more activated in participants who dislike or diswant to eat cheese (Anti) than in other participants who like to eat cheese, as revealed following stimulation with cheese odors and pictures. We suggest that the aforementioned basal ganglia structures commonly involved in reward are also involved in the aversive motivated behaviors. Our results further show that the ventral pallidum, a core structure of the reward circuit, is deactivated in Anti subjects stimulated by cheese in the wanting task, highlighting the suppression of motivation-related activation in subjects disgusted by cheese.

The impact of emotion awareness and regulation on social functioning in individuals at clinical high risk for psychosis

BACKGROUND

Social functioning (SF) difficulties are ubiquitous among individuals at clinical high risk for psychosis (CHR), but it is not yet clear why. One possibility is suggested by the observation that effective SF requires adaptive emotion awareness and regulation. Previous reports have documented deficits in emotion awareness and regulation in individuals with schizophrenia, and have shown that such deficits predicted SF. However, it is unknown whether these deficits are present prior to the onset of psychosis or whether they are linked to SF in CHR individuals.

METHOD

We conducted a cross-sectional comparison of emotion awareness and regulation in 54 individuals at CHR, 87 with schizophrenia and 50 healthy controls (HC). Then, within the CHR group, we examined links between emotion awareness, emotion regulation and SF as indexed by the Global Functioning Scale: Social (Cornblatt et al. 2007).

RESULTS

Group comparisons indicated significant differences between HC and the two clinical groups in their ability to identify and describe feelings, as well as the use of suppression and reappraisal emotion-regulation strategies. Specifically, the CHR and schizophrenia groups displayed comparable deficits in all domains of emotion awareness and emotion regulation. A hierarchical multiple regression analysis indicated that difficulties describing feelings accounted for 23.2% of the SF variance.

CONCLUSIONS

The results indicate that CHR individuals display substantial emotion awareness and emotion-regulation deficits, at severity comparable with those observed in individuals with schizophrenia. Such deficits, in particular difficulties describing feelings, predate the onset of psychosis and contribute significantly to poor SF in this population.

Degraded Impairment of Emotion Recognition in Parkinson's Disease Extends from Negative to Positive Emotions

Because of dopaminergic neurodegeneration, patients with Parkinson's disease (PD) show impairment in the recognition of negative facial expressions. In the present study, we aimed to determine whether PD patients with more advanced motor problems would show a much greater deficit in recognition of emotional facial expressions than a control group and whether impairment of emotion recognition would extend to positive emotions. Twenty-nine PD patients and 29 age-matched healthy controls were recruited. Participants were asked to discriminate emotions in Experiment  1 and identify gender in Experiment  2. In Experiment  1, PD patients demonstrated a recognition deficit for negative (sadness and anger) and positive faces. Further analysis showed that only PD patients with high motor dysfunction performed poorly in recognition of happy faces. In Experiment  2, PD patients showed an intact ability for gender identification, and the results eliminated possible abilities in the functions measured in Experiment  2 as alternative explanations for the results of Experiment  1. We concluded that patients' ability to recognize emotions deteriorated as the disease progressed. Recognition of negative emotions was impaired first, and then the impairment extended to positive emotions.

Social Cognition and the Prefrontal Cortex

Social cognitive neuroscience is a rapidly emerging field that utilizes cognitive neuroscientific techniques (e.g., lesion studies, neuroimaging) to address concepts traditionally in the social psychological realm (e.g., attitudes, stereotypes). The purpose of this article is to review published neuroscientific and neuropsychological research into social cognition. The author focuses on the role of the prefrontal cortex in social behavior and presents a framework that provides cohesion of this research. The article proposes that this framework will be useful in guiding future social cognitive neuroscientific research.

When do fearful faces override inhibition of return?

Inhibition of return (IOR) occurs when more than about 300 ms elapses between the cue and the target in atypical peripheral cueing task: reaction times (RTs) become longer when the cue and target locations are the same versus different. IOR could serve the adaptive role of optimizing visual search by discouraging the re-inspection of previously attended locations. As such, IOR should not reduce our chances of noticing relevant event information and emotional stimuli, in particular. However, previous studies have led to inconsistent results. The present study offers a systematic investigation of the conditions under which target fearful faces can modulate either the magnitude or the time course of the IOR effect. Notably, we manipulated the depth of facial processing required to perform the task and/or the task relevance of the facial expressions. When participants localized target faces (Experiment 1) or discriminated them from non-face stimuli (Experiment 2), their emotional expression had no impact on IOR whatsoever. However, IOR occurred later for fearful versus neutral faces when the participants performed emotion (Experiment 3) or gender (Experiment 4) discrimination tasks. These findings are discussed with regard to the mechanisms responsible for IOR and to the processing of emotional facial expressions.

Self perception and facial emotion perception of others in anorexia nervosa

Background: Whether individuals with anorexia nervosa (AN) are able to accurately perceive emotions from faces of others is unclear. Furthermore, whether individuals with AN process images of their own face differently to healthy individuals has thus far not been investigated. Therefore, the aim of this study was to investigate facial affect processing and the processing of one’s own face through measures of emotion identification, functional magnetic resonance imaging (fMRI) and eyetracking.

Methods: Twenty-four females with AN and 25 matched healthy control participants were presented with an implicit emotion processing task during fMRI and eyetracking, followed by an explicit emotion identification task.

Results: The AN group were found to ‘hyperscan’ stimuli and avoided visually attending to salient features of their own face images. Results of the fMRI revealed increased activity to own face stimuli in AN in the right inferior and middle temporal gyri, and right lingual gyrus. AN participants were not found to display emotion identification deficits to the standard emotional face stimuli.

Discussion: The findings are discussed in terms of increased anxiety to disorder-relevant stimuli in AN. Potential clinical implications are discussed in relation to the use of eyetracking techniques to improve the perception of self in AN.

Affective mapping: An activation likelihood estimation (ALE) meta-analysis

Functional neuroimaging has the spatial resolution to explain the neural basis of emotions. Activation likelihood estimation (ALE), as opposed to traditional qualitative meta-analysis, quantifies convergence of activation across studies within affective categories. Others have used ALE to investigate a broad range of emotions, but without the convenience of the BrainMap database. We used the BrainMap database and analysis resources to run separate meta-analyses on coordinates reported for anger, anxiety, disgust, fear, happiness, humor, and sadness. Resultant ALE maps were compared to determine areas of convergence between emotions, as well as to identify affect-specific networks. Five out of the seven emotions demonstrated consistent activation within the amygdala, whereas all emotions consistently activated the right inferior frontal gyrus, which has been implicated as an integration hub for affective and cognitive processes. These data provide the framework for models of affect-specific networks, as well as emotional processing hubs, which can be used for future studies of functional or effective connectivity.

Anodal tDCS targeting the right orbitofrontal cortex enhances facial expression recognition

The orbitofrontal cortex (OFC) has been implicated in the capacity to accurately recognise facial expressions. The aim of the current study was to determine if anodal transcranial direct current stimulation (tDCS) targeting the right OFC in healthy adults would enhance facial expression recognition, compared with a sham condition. Across two counterbalanced sessions of tDCS (i.e. anodal and sham), 20 undergraduate participants (18 female) completed a facial expression labelling task comprising angry, disgusted, fearful, happy, sad and neutral expressions, and a control (social judgement) task comprising the same expressions. Responses on the labelling task were scored for accuracy, median reaction time and overall efficiency (i.e. combined accuracy and reaction time). Anodal tDCS targeting the right OFC enhanced facial expression recognition, reflected in greater efficiency and speed of recognition across emotions, relative to the sham condition. In contrast, there was no effect of tDCS to responses on the control task. This is the first study to demonstrate that anodal tDCS targeting the right OFC boosts facial expression recognition. This finding provides a solid foundation for future research to examine the efficacy of this technique as a means to treat facial expression recognition deficits, particularly in individuals with OFC damage or dysfunction.

Affect labeling enhances exposure effectiveness for public speaking anxiety

Exposure is an effective treatment for anxiety but many patients do not respond fully. Affect labeling (labeling emotional experience) attenuates emotional responding. The current project examined whether affect labeling enhances exposure effectiveness in participants with public speaking anxiety. Participants were randomized to exposure with or without affect labeling. Physiological arousal and self-reported fear were assessed before and after exposure and compared between groups. Consistent with hypotheses, participants assigned to Affect Labeling, especially those who used more labels during exposure, showed greater reduction in physiological activation than Control participants. No effect was found for self-report measures. Also, greater emotion regulation deficits at baseline predicted more benefit in physiological arousal from exposure combined with affect labeling than exposure alone. The current research provides evidence that behavioral strategies that target prefrontal-amygdala circuitry can improve treatment effectiveness for anxiety and these effects are particularly pronounced for patients with the greatest deficits in emotion regulation.

Writing content predicts benefit from written expressive disclosure: Evidence for repeated exposure and self-affirmation

Expressive disclosure regarding a stressful event improves psychological and physical health, yet predictors of these effects are not well established. The current study assessed exposure, narrative structure, affect word use, self-affirmation and discovery of meaning as predictors of anxiety, depressive and physical symptoms following expressive writing. Participants (N = 50) wrote on four occasions about a stressful event and completed self-report measures before writing and three months later. Essays were coded for stressor exposure (level of detail and whether participants remained on topic), narrative structure, self-affirmation and discovery of meaning. Linguistic Inquiry and Word Count software was used to quantify positive and negative affect word use. Controlling for baseline anxiety, more self-affirmation and detail about the event predicted lower anxiety symptoms, and more negative affect words (very high use) and more discovery of meaning predicted higher anxiety symptoms three months after writing. Findings highlight the importance of self-affirmation and exposure as predictors of benefit from expressive writing.