Rapid amygdala gamma oscillations in response to fearful facial expressions

Review of EEG Affective Recognition with a Neuroscience Perspective

Emotions are a series of subconscious, fleeting, and sometimes elusive manifestations of the human innate system. They play crucial roles in everyday life-influencing the way we evaluate ourselves, our surroundings, and how we interact with our world. To date, there has been an abundance of research on the domains of neuroscience and affective computing, with experimental evidence and neural network models, respectively, to elucidate the neural circuitry involved in and neural correlates for emotion recognition. Recent advances in affective computing neural network models often relate closely to evidence and perspectives gathered from neuroscience to explain the models. Specifically, there has been growing interest in the area of EEG-based emotion recognition to adopt models based on the neural underpinnings of the processing, generation, and subsequent collection of EEG data. In this respect, our review focuses on providing neuroscientific evidence and perspectives to discuss how emotions potentially come forth as the product of neural activities occurring at the level of subcortical structures within the brain's emotional circuitry and the association with current affective computing models in recognizing emotions. Furthermore, we discuss whether such biologically inspired modeling is the solution to advance the field in EEG-based emotion recognition and beyond.

Decoding emotion with phase-amplitude fusion features of EEG functional connectivity network

Decoding emotional neural representations from the electroencephalographic (EEG)-based functional connectivity network (FCN) is of great scientific importance for uncovering emotional cognition mechanisms and developing harmonious human-computer interactions. However, existing methods mainly rely on phase-based FCN measures (e.g., phase locking value [PLV]) to capture dynamic interactions between brain oscillations in emotional states, which fail to reflect the energy fluctuation of cortical oscillations over time. In this study, we initially examined the efficacy of amplitude-based functional networks (e.g., amplitude envelope correlation [AEC]) in representing emotional states. Subsequently, we proposed an efficient phase-amplitude fusion framework (PAF) to fuse PLV and AEC and used common spatial pattern (CSP) to extract fused spatial topological features from PAF for multi-class emotion recognition. We conducted extensive experiments on the DEAP and MAHNOB-HCI datasets. The results showed that: (1) AEC-derived discriminative spatial network topological features possess the ability to characterize emotional states, and the differential network patterns of AEC reflect dynamic interactions in brain regions associated with emotional cognition. (2) The proposed fusion features outperformed other state-of-the-art methods in terms of classification accuracy for both datasets. Moreover, the spatial filter learned from PAF is separable and interpretable, enabling a description of affective activation patterns from both phase and amplitude perspectives.

Impairment of unconscious emotional processing after unilateral medial temporal structure resection

The role of the amygdala in unconscious emotional processing remains a topic of debate. Past lesion studies have indicated that amygdala damage leads to impaired electrodermal activity in response to subliminally presented emotional stimuli. However, electrodermal activity can reflect both emotional and nonemotional processes. To provide behavioral evidence highlighting the critical role of the amygdala in unconscious emotional processing, we examined patients (n = 16) who had undergone unilateral resection of medial temporal lobe structures, including the amygdala. We utilized the subliminal affective priming paradigm in conjunction with unilateral visual presentation. Fearful or happy dynamic facial expressions were presented in unilateral visual fields for 30 ms, serving as negative or positive primes. Subsequently, neutral target faces were displayed, and participants were tasked with rating the valence of these targets. Positive primes, compared to negative ones, enhanced valence ratings of the target to a greater extent when they stimulated the intact hemisphere (i.e., were presented in the contralateral visual field of the intact hemisphere) than when they stimulated the resected hemisphere (i.e., were presented in the contralateral visual field of the resected hemisphere). These results suggest that the amygdala is causally involved in unconscious emotional processing.

Inhibition of fatty acid binding protein-5 in the basolateral amygdala induces anxiolytic effects and accelerates fear memory extinction

RATIONALE

The endocannabinoid (eCB) system critically controls anxiety and fear-related behaviours. Anandamide (AEA), a prominent eCB ligand, is a hydrophobic lipid that requires chaperone proteins such as Fatty Acid Binding Proteins (FABPs) for intracellular transport. Intracellular AEA transport is necessary for degradation, so blocking FABP activity increases AEA neurotransmission.

OBJECTIVE

To investigate the effects of a novel FABP5 inhibitor (SBFI-103) in the basolateral amygdala (BLA) on anxiety and fear memory.

METHODS

We infused SBFI-103 (0.5 μg-5 μg) to the BLA of adult male Sprague Dawley rats and ran various anxiety and fear memory behavioural assays, neurophysiological recordings, and localized molecular signaling analyses. We also co-infused SBFI-103 with the AEA inhibitor, LEI-401 (3 μg and 10 μg) to investigate the potential role of AEA in these phenomena.

RESULTS

Acute intra-BLA administration of SBFI-103 produced strong anxiolytic effects across multiple behavioural tests. Furthermore, animals exhibited acute and long-term accelerated associative fear memory extinction following intra-BLA FABP5 inhibition. In addition, BLA FABP5 inhibition induced strong modulatory effects on putative PFC pyramidal neurons along with significantly increased gamma oscillation power. Finally, we observed local BLA changes in the phosphorylation activity of various anxiety- and fear memory-related molecular biomarkers in the PI3K/Akt and MAPK/Erk signaling pathways. At all three levels of analyses, we found the functional effects of SBFI-103 depend on availability of the AEA ligand.

CONCLUSIONS

These findings demonstrate a novel intra-BLA FABP5 signaling mechanism regulating anxiety and fear memory behaviours, neuronal activity states, local anxiety-related molecular pathways, and functional AEA modulation.

Influence of stimulus manipulation on conscious awareness of emotional facial expressions in the match-to-sample paradigm

The conscious perception of emotional facial expressions plays an indispensable role in social interaction. However, previous psychological studies have reported inconsistent findings regarding whether conscious awareness is greater for emotional expressions than for neutral expressions. Furthermore, whether this phenomenon is attributable to emotional or visual factors remains unknown. To investigate these issues, we conducted five psychological experiments to test the conscious perception of emotional and neutral facial expressions using the match-to-sample paradigm. Facial stimuli were momentarily presented in the peripheral visual fields while participants read simultaneously presented letters in the central visual fields. The participants selected a perceived face from nine samples. The results of all experiments demonstrated that emotional expressions were more accurately identified than neutral expressions. Furthermore, Experiment 4 showed that angry expressions were identified more accurately than anti-angry expressions, which expressed neutral emotions with comparable physical changes to angry expressions. Experiment 5, testing the interaction between emotional expression and face direction, showed that angry expressions looking toward participants were more accurately identified than those looking away from participants, even though they were physically identical. These results suggest that the conscious awareness of emotional facial expressions is enhanced by their emotional significance.

Dose-Dependent Atrophy in Bilateral Amygdalae and Nuclei After Brain Radiation Therapy and Its Association With Mood and Memory Outcomes on a Longitudinal Clinical Trial

PURPOSE

Amygdalae are bilateral, almond-shaped structures located anterior to the hippocampi, critical to limbic system functions of emotional processing and memory consolidation. The amygdalae are heterogeneous, composed of multiple nuclei with distinct structural and functional properties. We prospectively assessed associations between longitudinal changes in amygdala morphometry, including component nuclei, and functional outcomes in patients with primary brain tumors receiving radiation therapy (RT).

METHODS AND MATERIALS

On a prospective longitudinal trial, 63 patients underwent high-resolution volumetric brain magnetic resonance imaging and testing for mood (Beck Depression Inventory and Beck Anxiety Inventory), memory (Brief Visuospatial Memory Test-Revised [BVMT] Total Recall and Delayed Recall; Hopkins Verbal Learning Test-Revised [HVLT] Total Recall and Delayed Recall), and health-related quality-of-life outcomes (Functional Assessment of Cancer Therapy-Brain Social/Family Well-Being and Emotional Well-Being) at baseline and 3, 6, and 12 months after RT. Amygdalae, including 8 nuclei, were autosegmented bilaterally using validated techniques. Linear mixed-effects models assessed longitudinal change in amygdalae and nuclei volumes and associations with dose and outcomes. Wilcoxon rank sum tests compared amygdala volume change between patient groups with worse and more stable outcomes at each time point.

RESULTS

Atrophy was found in the right amygdala at 6 months (P = .001) and the left amygdala at 12 months (P = .046). A higher dose was associated with atrophy of the left amygdala (P = .013) at 12 months. The right amygdala showed dose-dependent atrophy at 6 months (P = .016) and 12 months (P = .001). Worse BVMT-Total, HVLT-Total, and HVLT-Delayed performance was associated with smaller left lateral (P = .014, P = .004, and P = .007, respectively) and left basal (P = .034, P = .016, and P = .026, respectively) nuclei volumes. Increased anxiety at 6 months was associated with greater combined (P = .031) and right (P = .007) amygdala atrophy. Greater left amygdala atrophy (P = .038) was noted in patients with decreased emotional well-being at 12 months.

CONCLUSIONS

Bilateral amygdalae and nuclei undergo time- and dose-dependent atrophy after brain RT. Atrophy in amygdalae and specific nuclei was associated with poorer memory, mood, and emotional well-being. Amygdalae-sparing treatment planning may preserve neurocognitive and neuropsychiatric outcomes in this population.

Non-angry aggressive arousal and angriffsberietschaft: A narrative review of the phenomenology and physiology of proactive/offensive aggression motivation and escalation in people and other animals

Human aggression typologies largely correspond with those for other animals. While there may be no non-human equivalent of angry reactive aggression, we propose that human proactive aggression is similar to offense in other animals' dominance contests for territory or social status. Like predation/hunting, but unlike defense, offense and proactive aggression are positively reinforcing, involving dopamine release in accumbens. The drive these motivational states provide must suffice to overcome fear associated with initiating risky fights. We term the neural activity motivating proactive aggression "non-angry aggressive arousal", but use "angriffsberietschaft" for offense motivation in other animals to acknowledge possible differences. Temporal variation in angriffsberietschaft partitions fights into bouts; engendering reduced anti-predator vigilance, redirected aggression and motivational over-ride. Increased aggressive arousal drives threat-to-attack transitions, as in verbal-to-physical escalation and beyond that, into hyper-aggression. Proactive aggression and offense involve related neural activity states. Cingulate, insular and prefrontal cortices energize/modulate aggression through a subcortical core containing subnuclei for each aggression type. These proposals will deepen understanding of aggression across taxa, guiding prevention/intervention for human violence.

Rapid Processing of Invisible Fearful Faces in the Human Amygdala

Rapid detection of a threat or its symbol (e.g., fearful face), whether visible or invisible, is critical for human survival. This function is suggested to be enabled by a subcortical pathway to the amygdala independent of the cortex. However, conclusive electrophysiological evidence in humans is scarce. Here, we explored whether the amygdala can rapidly encode invisible fearful faces. We recorded intracranial electroencephalogram (iEEG) responses in the human (both sexes) amygdala to faces with fearful, happy, and neutral emotions rendered invisible by backward masking. We found that a short-latency intracranial event-related potential (iERP) in the amygdala, beginning 88 ms poststimulus onset, was preferentially evoked by invisible fearful faces relative to invisible happy or neutral faces. The rapid iERP exhibited selectivity to the low spatial frequency (LSF) component of the fearful faces. Time-frequency iEEG analyses further identified a rapid amygdala response preferentially for LSF fearful faces at the low gamma frequency band, beginning 45 ms poststimulus onset. In contrast, these rapid responses to invisible fearful faces were absent in cortical regions, including early visual areas, the fusiform gyrus, and the parahippocampal gyrus. These findings provide direct evidence for the existence of a subcortical pathway specific for rapid fear detection in the amygdala and demonstrate that the subcortical pathway can function without conscious awareness and under minimal influence from cortical areas.SIGNIFICANCE STATEMENT Automatic detection of biologically relevant stimuli, such as threats or dangers, has remarkable survival value. Here, we provide direct intracranial electrophysiological evidence that the human amygdala preferentially responds to fearful faces at a rapid speed, despite the faces being invisible. This rapid, fear-selective response is restricted to faces containing low spatial frequency information transmitted by magnocellular neurons and does not appear in cortical regions. These results support the existence of a rapid subcortical pathway independent of cortical pathways to the human amygdala.

Prestimulus amygdala spectral activity is associated with visual face awareness

Alpha cortical oscillations have been proposed to suppress sensory processing in the visual, auditory, and tactile domains, influencing conscious stimulus perception. However, it is unknown whether oscillatory neural activity in the amygdala, a subcortical structure involved in salience detection, has a similar impact on stimulus awareness. Recording intracranial electroencephalography (EEG) from 9 human amygdalae during face detection in a continuous flash suppression task, we found increased spectral prestimulus power and phase coherence, with most consistent effects in the alpha band, when faces were undetected relative to detected, similarly as previously observed in cortex with this task using scalp-EEG. Moreover, selective decreases in the alpha and gamma bands preceded face detection, with individual prestimulus alpha power correlating negatively with detection rate in patients. These findings reveal for the first time that prestimulus subcortical oscillations localized in human amygdala may contribute to perceptual gating mechanisms governing subsequent face detection and offer promising insights on the role of this structure in visual awareness.

How are emotional facial expressions detected rapidly and accurately? A diffusion model analysis

Previous psychological studies have shown that people detect emotional facial expressions more rapidly and accurately than neutral facial expressions. However, the cognitive mechanisms underlying the efficient detection of emotional facial expressions remain unclear. To investigate this issue, we used diffusion model analyses to estimate the cognitive parameters of a visual search task in which participants detected faces with normal expressions of anger and happiness and their anti-expressions within a crowd of neutral faces. The anti-expressions were artificially created to control the visual changes of facial features but were usually recognized as emotionally neutral. We tested the hypothesis that the emotional significance of the target's facial expressions modulated the non-decisional time and the drift rate. We also conducted an exploratory investigation of the effect of facial expressions on threshold separation. The results showed that the non-decisional time was shorter, and the drift rate was larger for targets with normal expressions than with anti-expressions. Subjective emotional arousal ratings of facial targets were negatively related to the non-decisional time and positively associated with the drift rate. In addition, the threshold separation was larger for normal expressions than for anti-expressions and positively associated with arousal ratings for facial targets. These results suggest that the efficient detection of emotional facial expressions is accomplished via the faster and more cautious accumulation of emotional information of facial expressions which is initiated more rapidly by enhanced attentional allocation.

Localized task-invariant emotional valence encoding revealed by intracranial recordings

The ability to distinguish between negative, positive and neutral valence is a key part of emotion perception. Emotional valence has conceptual meaning that supersedes any particular type of stimulus, although it is typically captured experimentally in association with particular tasks. We sought to identify neural encoding for task-invariant emotional valence. We evaluated whether high-gamma responses (HGRs) to visually displayed words conveying emotions could be used to decode emotional valence from HGRs to facial expressions. Intracranial electroencephalography was recorded from 14 individuals while they participated in two tasks, one involving reading words with positive, negative, and neutral valence, and the other involving viewing faces with positive, negative, and neutral facial expressions. Quadratic discriminant analysis was used to identify information in the HGR that differentiates the three emotion conditions. A classifier was trained on the emotional valence labels from one task and was cross-validated on data from the same task (within-task classifier) as well as the other task (between-task classifier). Emotional valence could be decoded in the left medial orbitofrontal cortex and middle temporal gyrus, both using within-task classifiers and between-task classifiers. These observations suggest the presence of task-independent emotional valence information in the signals from these regions.

Are there consistent abnormalities in event-related EEG oscillations in patients with Alzheimer's disease compared to other diseases belonging to dementia?

Cerebrospinal and structural-molecular neuroimaging in-vivo biomarkers are recommended for diagnostic purposes in Alzheimer's disease (AD) and other dementias; however, they do not explain the effects of AD neuropathology on neurophysiological mechanisms underpinning cognitive processes. Here, an Expert Panel from the Electrophysiology Professional Interest Area of the Alzheimer's Association reviewed the field literature and reached consensus on the event-related electroencephalographic oscillations (EROs) that show consistent abnormalities in patients with significant cognitive deficits due to Alzheimer's, Parkinson's (PD), Lewy body (LBD), and cerebrovascular diseases. Converging evidence from oddball paradigms showed that, as compared to cognitively unimpaired (CU) older adults, AD patients had lower amplitude in widespread delta (>4 Hz) and theta (4-7 Hz) phase-locked EROs as a function of disease severity. Similar effects were also observed in PD, LBD, and/or cerebrovascular cognitive impairment patients. Non-phase-locked alpha (8-12 Hz) and beta (13-30 Hz) oscillations were abnormally reduced (event-related desynchronization, ERD) in AD patients relative to CU. However, studies on patients with other dementias remain lacking. Delta and theta phase-locked EROs during oddball tasks may be useful neurophysiological biomarkers of cognitive systems at work in heuristic and intervention clinical trials performed in AD patients, but more research is needed regarding their potential role for other dementias.

Modulation of Emotion Perception via Amygdala Stimulation in Humans

Background

Multiple lines of evidence show that the human amygdala is part of a neural network important for perception of emotion from environmental stimuli, including for processing of intrinsic attractiveness/“goodness” or averseness/“badness,” i.e., affective valence.

Objective/Hypothesis

With this in mind, we investigated the effect of electrical brain stimulation of the human amygdala on perception of affective valence of images taken from the International Affective Picture Set (IAPS).

Methods

Using intracranial electrodes in patients with epilepsy, we first obtained event-related potentials (ERPs) in eight patients as they viewed IAPS images of varying affective valence. Next, in a further cohort of 10 patients (five female and five male), we measured the effect of 50 Hz electrical stimulation of the left amygdala on perception of affective valence from IAPS images.

Results

We recorded distinct ERPs from the left amygdala and found significant differences in the responses between positively and negatively valenced stimuli (p = 0.002), and between neutral and negatively valenced stimuli (p = 0.017) 300–500 ms after stimulus onset. Next, we found that amygdala stimulation did not significantly affect how patients perceived valence for neutral images (p = 0.58), whereas stimulation induced patients to report both positively (p = 0.05) and negatively (< 0.01) valenced images as more neutral.

Conclusion

These results render further evidence that the left amygdala participates in a neural network for perception of emotion from environmental stimuli. These findings support the idea that electrical stimulation disrupts this network and leads to partial disruption of perception of emotion. Harnessing this effect may have clinical implications in treatment of certain neuropsychiatric disorders using deep brain stimulation (DBS) and neuromodulation.

Functional neuronal networks reveal emotional processing differences in children with ADHD

Attention Deficit Hyperactivity Disorder (ADHD) is a common neurodevelopmental disorder that, in addition to inattention, excessive activity, or impulsivity, makes it difficult for children to process facial emotions and thus to interact with their peers. Here we analyze neuronal networks of children with this disorder by means of the phase-locking value (PLV) method. In particular, we determine the level of phase synchronization between 62 EEG channels of 22 healthy boys and 22 boys with ADHD, recorder whilst observing facial emotions of anger, happiness, neutrality, and sadness. We construct neuronal networks based on the gamma sub-band, which according to previous studies, shows the highest response to emotional stimuli. We find that the functional connectivity of the frontal and occipital lobes in the ADHD group is significantly (P-value < 0.01) higher than in the healthy group. More functional connectivity in these lobes shows more phase synchronization between the neurons of these brain regions, representing some problems in the brain emotional processing center in the ADHD group. The shortest path lengths in these lobes are also significantly (P-value < 0.01) higher in the ADHD group than in the healthy group. This result indicates less efficiency of information transmission and segregation in occipital and frontal lobes of ADHD neuronal networks, responsible for visual and emotional processing in the brain, respectively. We hope that our approach will help obtain further insights into ADHD with methods of network science.

Insular Dichotomy in the Implicit Detection of Emotions in Human Faces

The functional roles of the insula diverge between its posterior portion (PI), mainly connected with somato-sensory and motor areas, and its anterior section (AI) connected with the frontal, limbic, and cingulate regions. We report intracranial recordings of local field evoked potentials from PI, AI, and the visual fusiform gyrus to a full array of emotional faces including pain while the individuals' attention was diverted from emotions. The fusiform gyrus and PI responded equally to all types of faces, including neutrals. Conversely, the AI responded only to emotional faces, maximally to pain and fear, while remaining insensitive to neutrals. The two insular sectors reacted with almost identical latency suggesting their parallel initial activation via distinct functional routes. The consistent responses to all emotions, together with the absence of response to neutral faces, suggest that early responses in the AI reflect the immediate arousal value and behavioral relevance of emotional stimuli, which may be subserved by "fast track" routes conveying coarse-spatial-frequency information via the superior colliculus and dorsal pulvinar. Such responses precede the conscious detection of the stimulus' precise signification and valence, which need network interaction and information exchange with other brain areas, for which the AI is an essentialhub.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

LeGUI: A Fast and Accurate Graphical User Interface for Automated Detection and Anatomical Localization of Intracranial Electrodes

Accurate anatomical localization of intracranial electrodes is important for identifying the seizure foci in patients with epilepsy and for interpreting effects from cognitive studies employing intracranial electroencephalography. Localization is typically performed by coregistering postimplant computed tomography (CT) with preoperative magnetic resonance imaging (MRI). Electrodes are then detected in the CT, and the corresponding brain region is identified using the MRI. Many existing software packages for electrode localization chain together separate preexisting programs or rely on command line instructions to perform the various localization steps, making them difficult to install and operate for a typical user. Further, many packages provide solutions for some, but not all, of the steps needed for confident localization. We have developed software, Locate electrodes Graphical User Interface (LeGUI), that consists of a single interface to perform all steps needed to localize both surface and depth/penetrating intracranial electrodes, including coregistration of the CT to MRI, normalization of the MRI to the Montreal Neurological Institute template, automated electrode detection for multiple types of electrodes, electrode spacing correction and projection to the brain surface, electrode labeling, and anatomical targeting. The software is written in MATLAB, core image processing is performed using the Statistical Parametric Mapping toolbox, and standalone executable binaries are available for Windows, Mac, and Linux platforms. LeGUI was tested and validated on 51 datasets from two universities. The total user and computational time required to process a single dataset was approximately 1 h. Automatic electrode detection correctly identified 4362 of 4695 surface and depth electrodes with only 71 false positives. Anatomical targeting was verified by comparing electrode locations from LeGUI to locations that were assigned by an experienced neuroanatomist. LeGUI showed a 94% match with the 482 neuroanatomist-assigned locations. LeGUI combines all the features needed for fast and accurate anatomical localization of intracranial electrodes into a single interface, making it a valuable tool for intracranial electrophysiology research.

Attenuated alpha-gamma coupling in emotional dual pathways with right-Amygdala predicting ineffective antidepressant response

Aims

The diversity of treatment outcomes for major depressive disorder (MDD) remains uncertain in neuropathology. The current study aimed at exploring electrophysiological biomarkers associated with treatment response.

Methods

The present study recruited 130 subjects including 100 MDD patients and 30 healthy controls. All subjects participated in a sad expression recognition task while their magnetoencephalography data were recorded. Patients who had a reduction of at least 50% in disorder severity at endpoint (>2 weeks) were considered as responders. Within‐frequency power and phase‐amplitude coupling were measured for the brain regions involved in the emotional visual information processing pathways.

Results

The significant alpha–gamma decoupling from the right thalamus to the right amygdala in unconscious processing and from right orbital frontal cortices to the right amygdala in conscious processing was found in non‐responders relative to responders and healthy controls. These kinds of dysregulation could also predict the potential treatment response.

Conclusion

The attenuated alpha–gamma coupling in dual pathways indicated increased sensitivity to the negative emotional information and reduced moderated effect of the amygdala, which might cause insensitivity to antidepressant treatment and could be regarded as potential neural mechanisms for treatment response prediction.

Alpha-to-beta- and gamma-band activity reflect predictive coding in affective visual processing

Processing of negative affective pictures typically leads to desynchronization of alpha-to-beta frequencies (ERD) and synchronization of gamma frequencies (ERS). Given that in predictive coding higher frequencies have been associated with prediction errors, while lower frequencies have been linked to expectations, we tested the hypothesis that alpha-to-beta ERD and gamma ERS induced by aversive pictures are associated with expectations and prediction errors, respectively. We recorded EEG while volunteers were involved in a probabilistically cued affective picture task using three different negative valences to produce expectations and prediction errors. Our data show that alpha-to-beta band activity after stimulus presentation was related to the expected valence of the stimulus as predicted by a cue. The absolute mismatch of the expected and actual valence, which denotes an absolute prediction error was related to increases in alpha, beta and gamma band activity. This demonstrates that top-down predictions and bottom-up prediction errors are represented in typical spectral patterns associated with affective picture processing. This study provides direct experimental evidence that negative affective picture processing can be described by neuronal predictive coding computations.

Identifying the neurophysiological effects of memory-enhancing amygdala stimulation using interpretable machine learning

BACKGROUND

Direct electrical stimulation of the amygdala can enhance declarative memory for specific events. An unanswered question is what underlying neurophysiological changes are induced by amygdala stimulation.

OBJECTIVE

To leverage interpretable machine learning to identify the neurophysiological processes underlying amygdala-mediated memory, and to develop more efficient neuromodulation technologies.

METHOD

Patients with treatment-resistant epilepsy and depth electrodes placed in the hippocampus and amygdala performed a recognition memory task for neutral images of objects. During the encoding phase, 160 images were shown to patients. Half of the images were followed by brief low-amplitude amygdala stimulation. For local field potentials (LFPs) recorded from key medial temporal lobe structures, feature vectors were calculated by taking the average spectral power in canonical frequency bands, before and after stimulation, to train a logistic regression classification model with elastic net regularization to differentiate brain states.

RESULTS

Classifying the neural states at the time of encoding based on images subsequently remembered versus not-remembered showed that theta and slow-gamma power in the hippocampus were the most important features predicting subsequent memory performance. Classifying the post-image neural states at the time of encoding based on stimulated versus unstimulated trials showed that amygdala stimulation led to increased gamma power in the hippocampus.

CONCLUSION

Amygdala stimulation induced pro-memory states in the hippocampus to enhance subsequent memory performance. Interpretable machine learning provides an effective tool for investigating the neurophysiological effects of brain stimulation.

Impairment of emotional expression detection after unilateral medial temporal structure resection

Detecting emotional facial expressions is an initial and indispensable component of face-to-face communication. Neuropsychological studies on the neural substrates of this process have shown that bilateral amygdala lesions impaired the detection of emotional facial expressions. However, the findings were inconsistent, possibly due to the limited number of patients examined. Furthermore, whether this processing is based on emotional or visual factors of facial expressions remains unknown. To investigate this issue, we tested a group of patients (n = 23) with unilateral resection of medial temporal lobe structures, including the amygdala, and compared their performance under resected- and intact-hemisphere stimulation conditions. The participants were asked to detect normal facial expressions of anger and happiness, and artificially created anti-expressions, among a crowd with neutral expressions. Reaction times for the detection of normal expressions versus anti-expressions were shorter when the target faces were presented to the visual field contralateral to the intact hemisphere (i.e., stimulation of the intact hemisphere; e.g., right visual field for patients with right hemispheric resection) compared with the visual field contralateral to the resected hemisphere (i.e., stimulation of the resected hemisphere). Our findings imply that the medial temporal lobe structures, including the amygdala, play an essential role in the detection of emotional facial expressions, according to the emotional significance of the expressions.

Atypical development of emotional face processing networks in autism spectrum disorder from childhood through to adulthood

•

MEG connectivity to emotional faces in ASD and typical controls 6–39 years of age was investigated.

•

Distinct age-related changes in connectivity were observed in the groups to happy and angry faces.

•

Age-related between-group differences in functional connectivity were found in gamma band.

•

Emotion-specific age-related between-group differences were seen in beta.

•

Findings highlight specific neurodevelopmental trajectories to emotional faces in ASD vs. TD.

Impairments in social functioning are hallmarks of autism spectrum disorder (ASD) and atypical functional connectivity may underlie these difficulties. Emotion processing networks typically undergo protracted maturational changes, however, those with ASD show either hyper- or hypo-connectivity with little consensus on the functional connectivity underpinning emotion processing. Magnetoencephalography was used to investigate age-related changes in whole-brain functional connectivity of eight regions of interest during happy and angry face processing in 190 children, adolescents and adults (6–39 years) with and without ASD. Findings revealed age-related changes from child- through to mid-adulthood in functional connectivity in controls and in ASD in theta, as well as age-related between-group differences across emotions, with connectivity decreasing in ASD, but increasing for controls, in gamma. Greater connectivity to angry faces was observed across groups in gamma. Emotion-specific age-related between-group differences in beta were also found, that showed opposite trends with age for happy and angry in ASD. Our results establish altered, frequency-specific developmental trajectories of functional connectivity in ASD, across distributed networks and a broad age range, which may finally help explain the heterogeneity in the literature.

Comparing Neural Correlates of Human Emotions across Multiple Stimulus Presentation Paradigms

Most electroencephalography (EEG)-based emotion recognition systems rely on a single stimulus to evoke emotions. These systems make use of videos, sounds, and images as stimuli. Few studies have been found for self-induced emotions. The question "if different stimulus presentation paradigms for same emotion, produce any subject and stimulus independent neural correlates" remains unanswered. Furthermore, we found that there are publicly available datasets that are used in a large number of studies targeting EEG-based human emotional state recognition. Since one of the major concerns and contributions of this work is towards classifying emotions while subjects experience different stimulus-presentation paradigms, we need to perform new experiments. This paper presents a novel experimental study that recorded EEG data for three different human emotional states evoked with four different stimuli presentation paradigms. Fear, neutral, and joy have been considered as three emotional states. In this work, features were extracted with common spatial pattern (CSP) from recorded EEG data and classified through linear discriminant analysis (LDA). The considered emotion-evoking paradigms included emotional imagery, pictures, sounds, and audio-video movie clips. Experiments were conducted with twenty-five participants. Classification performance in different paradigms was evaluated, considering different spectral bands. With a few exceptions, all paradigms showed the best emotion recognition for higher frequency spectral ranges. Interestingly, joy emotions were classified more strongly as compared to fear. The average neural patterns for fear vs. joy emotional states are presented with topographical maps based on spatial filters obtained with CSP for averaged band power changes for all four paradigms. With respect to the spectral bands, beta and alpha oscillation responses produced the highest number of significant results for the paradigms under consideration. With respect to brain region, the frontal lobe produced the most significant results irrespective of paradigms and spectral bands. The temporal site also played an effective role in generating statistically significant findings. To the best of our knowledge, no study has been conducted for EEG emotion recognition while considering four different stimuli paradigms. This work provides a good contribution towards designing EEG-based system for human emotion recognition that could work effectively in different real-time scenarios.

Neural Oscillatory Abnormalities During Gaze Processing in Schizophrenia: Evidence of Reduced Theta Phase Consistency and Inter-areal Theta-Gamma Coupling

BACKGROUND

Abnormal gaze discrimination in schizophrenia (SZ) is associated with impairment in social functioning, but the neural mechanisms remain unclear. Evidence suggests that local neural oscillations and inter-areal communication through neural synchronization are critical physiological mechanisms supporting basic and complex cognitive processes. The roles of these mechanisms in abnormal gaze processing in SZ have not been investigated. The present study examined local neural oscillations and connectivity between anterior and bilateral posterior brain areas during gaze processing.

METHODS

During electroencephalography recording, 28 participants with SZ and 34 healthy control participants completed a gaze discrimination task. Time-frequency decomposition of electroencephalography data was used to examine neural oscillatory power and intertrial phase consistency at bilateral posterior and midline anterior scalp sites. In addition, connectivity between these anterior and posterior sites, in terms of cross-frequency coupling between theta phase and gamma amplitude, was examined using the Kullback-Leibler Modulation Index.

RESULTS

Participants with SZ showed reduced total power of theta-band activity relative to healthy control participants at all sites examined. This group difference could be accounted for by reduced intertrial phase consistency of theta activity in SZ participants, which was related to reduced gaze discrimination accuracy in SZ. In addition, SZ participants exhibited reduced Kullback-Leibler indexing, both feedforward and feedback connectivity, between the posterior and anterior sites.

CONCLUSIONS

These findings suggest that abnormal theta phase consistency and dysconnection between posterior face processing and anterior areas may underlie gaze processing deficits in SZ.

Oscillatory EEG Signatures of Affective Processes during Interaction with Adaptive Computer Systems

Affect monitoring is being discussed as a novel strategy to make adaptive systems more user-oriented. Basic knowledge about oscillatory processes and functional connectivity underlying affect during naturalistic human-computer interactions (HCI) is, however, scarce. This study assessed local oscillatory power entrainment and distributed functional connectivity in a close-to-naturalistic HCI-paradigm. Sixteen participants interacted with a simulated assistance system which deliberately evoked positive (supporting goal-achievement) and negative (impeding goal-achievement) affective reactions. Electroencephalography (EEG) was used to examine the reactivity of the cortical system during the interaction by studying both event-related (de-)synchronization (ERD/ERS) and event-related functional coupling of cortical networks towards system-initiated assistance. Significantly higher α-band and β-band ERD in centro-parietal and parieto-occipital regions and β-band ERD in bi-lateral fronto-central regions were observed during impeding system behavior. Supportive system behavior activated significantly higher γ-band ERS in bi-hemispheric parietal-occipital regions. This was accompanied by functional coupling of remote β-band and γ-band activity in the medial frontal, left fronto-central and parietal regions, respectively. Our findings identify oscillatory signatures of positive and negative affective processes as reactions to system-initiated assistance. The findings contribute to the development of EEG-based neuroadaptive assistance loops by suggesting a non-obtrusive method for monitoring affect in HCI.

Early developmental changes in visual social engagement in infant rhesus monkeys

Impairments in social interaction in Autism Spectrum Disorder (ASD) differ greatly across individuals and vary throughout an individual’s lifetime. Yet, an important marker of ASD in infancy is deviations in social-visual engagement, such as the reliably detectable early deviations in attention to the eyes or to biological movement (Klin et al., 2015). Given the critical nature of these early developmental periods, understanding its neurobehavioral underpinnings by means of a nonhuman primate model will be instrumental to understanding the pathophysiology of ASD. Like humans, rhesus macaques 1) develop in rich and complex social behaviors, 2) progressively develop social skills throughout infancy, and 3) have high similarities with humans in brain anatomy and cognitive functions (Machado and Bachevalier, 2003). In this study, male infant rhesus macaques living with their mothers in complex social groups were eye-tracked longitudinally from birth to 6 months while viewing full-faced videos of unfamiliar rhesus monkeys differing in age and sex. The results indicated a critical period for the refinement of social skills around 4–8 weeks of age in rhesus macaques. Specifically, infant monkeys’ fixation to the eyes shows an inflection in developmental trajectory, increasing from birth to 8 weeks, decreasing slowly to a trough between 14–18 weeks, before increasing again. These results parallel the developmental trajectory of social visual engagement published in human infants (Jones & Klin, 2013) and suggest the presence of a switch in the critical networks supporting these early developing social skills that is highly conserved between rhesus macaque and human infant development.

Neurocognitive Mechanisms Underlying Social Atypicalities in Autism: Weak Amygdala's Emotional Modulation Hypothesis

Autism spectrum disorder (ASD) is a neurodevelopmental condition associated with atypicalities in social interaction. Although psychological and neuroimaging studies have revealed divergent impairments in psychological processes (e.g., emotion and perception) and neural activity (e.g., amygdala, superior temporal sulcus, and inferior frontal gyrus) related to the processing of social stimuli, it remains difficult to integrate these findings. In an effort to resolve this issue, we review our psychological and functional magnetic resonance imaging (fMRI) findings and present a hypothetical neurocognitive model. Our psychological study showed that emotional modulation of reflexive joint attention is impaired in individuals with ASD. Our fMRI study showed that modulation from the amygdala to the neocortex during observation of dynamic facial expressions is reduced in the ASD group. Based on these findings and other evidence, we hypothesize that weak modulation from the amygdala to the neocortex-through which emotion rapidly modulates various types of perceptual, cognitive, and motor processing functions-underlies the social atypicalities in individuals with ASD.

Atypical Amygdala-Neocortex Interaction During Dynamic Facial Expression Processing in Autism Spectrum Disorder

Atypical reciprocal social interactions involving emotional facial expressions are a core clinical feature of autism spectrum disorder (ASD). Previous functional magnetic resonance imaging (fMRI) studies have demonstrated that some social brain regions, including subcortical (e.g., amygdala) and neocortical regions (e.g., fusiform gyrus, FG) are less activated during the processing of facial expression stimuli in individuals with ASD. However, the functional networking patterns between the subcortical and cortical regions in processing emotional facial expressions remain unclear. We investigated this issue in ASD (n = 31) and typically developing (TD; n = 31) individuals using fMRI. Participants viewed dynamic facial expressions of anger and happiness and their corresponding mosaic images. Regional brain activity analysis revealed reduced activation of several social brain regions, including the amygdala, in the ASD group compared with the TD group in response to dynamic facial expressions vs. dynamic mosaics (p < 0.05, ηp2 = 0.19). Dynamic causal modeling (DCM) analyses were then used to compare models with forward, backward, and bi-directional effective connectivity between the amygdala and neocortical networks. The results revealed that: (1) the model with effective connectivity from the amygdala to the neocortex best fit the data of both groups; and (2) the same model best accounted for group differences. Coupling parameter (i.e., effective connectivity) analyses showed that the modulatory effects of dynamic facial processing were substantially weaker in the ASD group than in the TD group. These findings suggest that atypical modulation from the amygdala to the neocortex underlies impairment in social interaction involving dynamic facial expressions in individuals with ASD.

Impairment in recognition of emotional facial expressions in Alzheimer's disease is represented by EEG theta and alpha responses

Behavioral studies have shown that the recognition of facial expressions may be impaired in patients with Alzheimer's disease (AD). The identification and recognition of a facial expression might be represented by event-related brain oscillations. The present study aims to analyze EEG event-related oscillations and determine the electrophysiological indicators of impaired facial expression recognition in AD patients. EEGs of 30 healthy controls and 30 AD patients were recorded during their perception of three different facial expressions (angry, happy, neutral). Event-related power spectrum and phase locking were analyzed in the theta (4-7) and alpha (8-13 Hz) frequency bands with the EEGLAB open toolbox. There was a significant facial Expression × Group interaction (p < 0.05) for the theta power spectrum; the healthy control group had higher theta power than the AD group during the perception of angry facial expressions (p < 0.05). There was a significant hemisphere difference between the two groups (p < 0.05). There was a right hemisphere alpha power dominance in healthy subjects. However, AD patients did not have this alpha power asymmetry. The present study, for the first time in the literature, presents the electrophysiological indicators of impaired recognition of facial expression in AD patients. The current study could be a basis for future studies that will analyze emotional processing in different kinds of dementia patients, and this study may have provided indicators of electrophysiological correlates of behavioral problems observed in clinical practice.

Dose-dependent atrophy of the amygdala after radiotherapy

BACKGROUND AND PURPOSE

The amygdalae are deep brain nuclei critical to emotional processing and the creation and storage of memory. It is not known whether the amygdalae are affected by brain radiotherapy (RT). We sought to quantify dose-dependent amygdala change one year after brain RT.

MATERIALS AND METHODS

52 patients with primary brain tumors were retrospectively identified. Study patients underwent high-resolution, volumetric magnetic resonance imaging before RT and 1 year afterward. Images were processed using FDA-cleared software for automated segmentation of amygdala volume. Tumor, surgical changes, and segmentation errors were manually censored. Mean amygdala RT dose was tested for correlation with amygdala volume change 1 year after RT via the Pearson correlation coefficient. A linear mixed-effects model was constructed to evaluate potential predictors of amygdala volume change, including age, tumor hemisphere, sex, seizure history, and bevacizumab treatment during the study period. As 51 of 52 patients received chemotherapy, possible chemotherapy effects could not be studied. A two-tailed p-value <0.05 was considered statistically significant.

RESULTS

Mean amygdala RT dose (r = -0.28, p = 0.01) was significantly correlated with volume loss. On multivariable analysis, the only significant predictor of amygdala atrophy was radiation dose. The final linear mixed-effects model estimated amygdala volume loss of 0.17% for every 1 Gy increase in mean amygdala RT dose (p = 0.008).

CONCLUSIONS

The amygdala demonstrates dose-dependent atrophy one year after radiotherapy for brain tumors. Amygdala atrophy may mediate neuropsychological effects seen after brain RT.

Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings

The amygdala is crucially implicated in processing emotional information from various sensory modalities. However, there is dearth of knowledge concerning the integration and relative time-course of its responses across different channels, i.e., for auditory, visual, and audiovisual input. Functional neuroimaging data in humans point to a possible role of this region in the multimodal integration of emotional signals, but direct evidence for anatomical and temporal overlap of unisensory and multisensory-evoked responses in amygdala is still lacking. We recorded event-related potentials (ERPs) and oscillatory activity from 9 amygdalae using intracranial electroencephalography (iEEG) in patients prior to epilepsy surgery, and compared electrophysiological responses to fearful, happy, or neutral stimuli presented either in voices alone, faces alone, or voices and faces simultaneously delivered. Results showed differential amygdala responses to fearful stimuli, in comparison to neutral, reaching significance 100-200 ms post-onset for auditory, visual and audiovisual stimuli. At later latencies, ∼400 ms post-onset, amygdala response to audiovisual information was also amplified in comparison to auditory or visual stimuli alone. Importantly, however, we found no evidence for either super- or subadditivity effects in any of the bimodal responses. These results suggest, first, that emotion processing in amygdala occurs at globally similar early stages of perceptual processing for auditory, visual, and audiovisual inputs; second, that overall larger responses to multisensory information occur at later stages only; and third, that the underlying mechanisms of this multisensory gain may reflect a purely additive response to concomitant visual and auditory inputs. Our findings provide novel insights on emotion processing across the sensory pathways, and their convergence within the limbic system.

Amygdala activation during unconscious visual processing of food

Hedonic or emotional responses to food have important positive and negative effects on human life. Behavioral studies have shown that hedonic responses to food images are elicited rapidly, even in the absence of conscious awareness of food. Although a number of previous neuroimaging studies investigated neural activity during conscious processing of food images, the neural mechanisms underlying unconscious food processing remain unknown. To investigate this issue, we measured neural activity using functional magnetic resonance imaging while participants viewed food and mosaic images presented subliminally and supraliminally. Conjunction analyses revealed that the bilateral amygdala was more strongly activated in response to food images than to mosaic images under both subliminal and supraliminal conditions. Interaction analyses revealed that the broad bilateral posterior regions, peaking at the posterior fusiform gyrus, were particularly active when participants viewed food versus mosaic images under the supraliminal compared with the subliminal condition. Dynamic causal modeling analyses supported the model in which the subcortical visual pathway from the pulvinar to the amygdala was modulated by food under the subliminal condition; in contrast, the model in which both subcortical and cortical (connecting the primary visual cortex, fusiform gyrus, and the amygdala) visual pathways were modulated by food received the most support under the supraliminal condition. These results suggest the possibility that unconscious hedonic responses to food may exert an effect through amygdala activation via the subcortical visual pathway.

Specificity of Primate Amygdalar Pathways to Hippocampus

The amygdala projects to hippocampus in pathways through which affective or social stimuli may influence learning and memory. We investigated the still unknown amygdalar termination patterns and their postsynaptic targets in hippocampus from system to synapse in rhesus monkeys of both sexes. The amygdala robustly innervated the stratum lacunosum-moleculare layer of cornu ammonis fields and uncus anteriorly. Sparser terminations in posterior hippocampus innervated the radiatum and pyramidal layers at the prosubicular/CA1 juncture. The terminations, which were larger than other afferents in the surrounding neuropil, position the amygdala to influence hippocampal input anteriorly, and its output posteriorly. Most amygdalar boutons (76-80%) innervated spines of excitatory hippocampal neurons, and most of the remaining innervated presumed inhibitory neurons, identified by morphology and label with parvalbumin or calretinin, which distinguished nonoverlapping neurochemical classes of hippocampal inhibitory neurons. In CA1, amygdalar axons innervated some calretinin neurons, which disinhibit pyramidal neurons. By contrast, in CA3 the amygdala innervated both calretinin and parvalbumin neurons; the latter strongly inhibit nearby excitatory neurons. In CA3, amygdalar pathways also made closely spaced dual synapses on excitatory neurons. The strong excitatory synapses in CA3 may facilitate affective context representations and trigger sharp-wave ripples associated with memory consolidation. When the amygdala is excessively activated during traumatic events, the specialized innervation of excitatory neurons and the powerful parvalbumin inhibitory neurons in CA3 may allow the suppression of activity of nearby neurons that receive weaker nonamygdalar input, leading to biased passage of highly charged affective stimuli and generalized fear.SIGNIFICANCE STATEMENT Strong pathways from the amygdala targeted the anterior hippocampus, and more weakly its posterior sectors, positioned to influence a variety of emotional and cognitive functions. In hippocampal field CA1, the amygdala innervated some calretinin neurons, which disinhibit excitatory neurons. By contrast, in CA3 the amygdala innervated calretinin as well as some of the powerful parvalbumin inhibitory neurons and may help balance the activity of neural ensembles to allow social interactions, learning, and memory. These results suggest that when the amygdala is hyperactive during emotional upheaval, it strongly activates excitatory hippocampal neurons and parvalbumin inhibitory neurons in CA3, which can suppress nearby neurons that receive weaker input from other sources, biasing the passage of stimuli with high emotional import and leading to generalized fear.

Veterans with PTSD demonstrate amygdala hyperactivity while viewing threatening faces: A MEG study

Posttraumatic stress disorder (PTSD) is a major psychiatric disorder that is prevalent in combat veterans. Previous neuroimaging studies have found elevated amygdala activity in PTSD in response to threatening stimuli, but previous work has lacked the temporal specificity to study fast bottom-up fear responses involving the amygdala. Forty-four combat veterans, 28 with PTSD and 16 without, completed psychological testing and then a face-processing task during magnetoencephalography (MEG). The resulting MEG data were pre-processed, transformed into the time-frequency domain, and then imaged using a beamforming approach. We found that veterans with PTSD exhibited significantly stronger oscillatory activity from 50 to 450 ms in the left amygdala compared to veterans without PTSD while processing threatening faces. This group difference was not present while viewing neutral faces. The current study shows that amygdala hyperactivity in response to threatening cues begins quickly in PTSD, which makes theoretical sense as an adaptive bottom-up fear response.

Character drawing style in cartoons on empathy induction: an eye-tracking and EEG study

In its most basic form, empathy refers to the ability to understand another person’s feelings and emotions, representing an essential component of human social interaction. Owing to an increase in the use of mass media, which is used to distribute high levels of empathy-inducing content, media plays a key role in individual and social empathy induction. We investigated empathy induction in cartoons using eye movement, EEG and behavioral measures to explore whether empathy factors correlate with character drawing styles. Two different types of empathy-inducing cartoons that consisted of three stages and had the same story plot were used. One had an iconic style, while the other was realistic style. Fifty participants were divided into two groups corresponding to the individual cartoon drawing styles and were presented with only one type of drawing style. We found that there were no significant differences of empathy factors between iconic and realistic style. However, the Induced Empathy Score (IES) had a close relationship with subsequent attentional processing (total fixation length for gaze duration). Furthermore, iconic style suppressed the fronto-central area more than realistic style in the gamma power band. These results suggest that iconic cartoons have the advantage of abstraction during empathy induction, because the iconic cartoons induced the same level of empathy as realistic cartoons while using the same story plot (top-down process), even though lesser time and effort were required by the cartoon artist to draw them. This also means that the top-down process (story plot) is more important than the bottom-up process (drawing style) in empathy induction when viewing cartoons

Discrimination of emotional states from scalp- and intracranial EEG using multiscale Rényi entropy

A data-adaptive, multiscale version of Rényi's quadratic entropy (RQE) is introduced for emotional state discrimination from EEG recordings. The algorithm is applied to scalp EEG recordings of 30 participants watching 4 emotionally-charged video clips taken from a validated public database. Krippendorff's inter-rater statistic reveals that multiscale RQE of the mid-frontal scalp electrodes best discriminates between five emotional states. Multiscale RQE is also applied to joint scalp EEG, amygdala- and occipital pole intracranial recordings of an implanted patient watching a neutral and an emotionally charged video clip. Unlike for the neutral video clip, the RQEs of the mid-frontal scalp electrodes and the amygdala-implanted electrodes are observed to coincide in the time range where the crux of the emotionally-charged video clip is revealed. In addition, also during this time range, phase synchrony between the amygdala and mid-frontal recordings is maximal, as well as our 30 participants' inter-rater agreement on the same video clip. A source reconstruction exercise using intracranial recordings supports our assertion that amygdala could contribute to mid-frontal scalp EEG. On the contrary, no such contribution was observed for the occipital pole's intracranial recordings. Our results suggest that emotional states discriminated from mid-frontal scalp EEG are likely to be mirrored by differences in amygdala activations in particular when recorded in response to emotionally-charged scenes.

Gamma oscillations in the superior colliculus and pulvinar in response to faces support discrimination performance in monkeys

The subcortical visual pathway including the superior colliculus (SC), pulvinar, and amygdala has been implicated in unconscious visual processing of faces, eyes, and gaze direction in blindsight. Our previous studies reported that monkey SC and pulvinar neurons responded preferentially to images of faces while performing a delayed non-matching to sample (DNMS) task to discriminate different visual stimuli (Nguyen et al., 2013, 2014). However, the contribution of SC and pulvinar neurons to the discrimination of the facial images and subsequent behavioral performance remains unknown. Since gamma oscillations have been implicated in sensory and cognitive processes as well as behavioral execution, we hypothesized that gamma oscillations during neuronal responses might contribute to achieving the appropriate behavioral performance (i.e., a correct response). In the present study, we re-analyzed those neuronal responses in the monkey SC and pulvinar to investigate possible relationships between gamma oscillations in these neurons and behavioral performance (correct response ratios) during the DNMS task. Gamma oscillations of SC and pulvinar neuronal activity were analyzed in three phases around the stimulus onset [inter-trial interval (ITI): 1000ms before trial onset; Early: 0-200ms after stimulus onset; and Late: 300-500ms after stimulus onset]. We found that human facial images elicited stronger gamma oscillations in the early phase than the ITI and late phase in both the SC and pulvinar neurons. Furthermore, there was a significant correlation between strengths of gamma oscillations in the early phase and behavioral performance in both the SC and pulvinar. The results suggest that gamma oscillatory activity in the SC and pulvinar contributes to successful behavioral performance during unconscious perceptual and behavioral processes.

Analysis of functional brain connections for positive-negative emotions using phase locking value

In this study, we investigate the brain networks during positive and negative emotions for different types of stimulus (audio only, video only and audio + video) in [Formula: see text], and [Formula: see text] bands in terms of phase locking value, a nonlinear method to study functional connectivity. Results show notable hemispheric lateralization as phase synchronization values between channels are significant and high in right hemisphere for all emotions. Left frontal electrodes are also found to have control over emotion in terms of functional connectivity. Besides significant inter-hemisphere phase locking values are observed between left and right frontal regions, specifically between left anterior frontal and right mid-frontal, inferior-frontal and anterior frontal regions; and also between left and right mid frontal regions. ANOVA analysis for stimulus types show that stimulus types are not separable for emotions having high valence. PLV values are significantly different only for negative emotions or neutral emotions between audio only/video only and audio only/audio + video stimuli. Finding no significant difference between video only and audio + video stimuli is interesting and might be interpreted as that video content is the most effective part of a stimulus.

Direction of Amygdala-Neocortex Interaction During Dynamic Facial Expression Processing

Dynamic facial expressions of emotion strongly elicit multifaceted emotional, perceptual, cognitive, and motor responses. Neuroimaging studies revealed that some subcortical (e.g., amygdala) and neocortical (e.g., superior temporal sulcus and inferior frontal gyrus) brain regions and their functional interaction were involved in processing dynamic facial expressions. However, the direction of the functional interaction between the amygdala and the neocortex remains unknown. To investigate this issue, we re-analyzed functional magnetic resonance imaging (fMRI) data from 2 studies and magnetoencephalography (MEG) data from 1 study. First, a psychophysiological interaction analysis of the fMRI data confirmed the functional interaction between the amygdala and neocortical regions. Then, dynamic causal modeling analysis was used to compare models with forward, backward, or bidirectional effective connectivity between the amygdala and neocortical networks in the fMRI and MEG data. The results consistently supported the model of effective connectivity from the amygdala to the neocortex. Further increasing time-window analysis of the MEG demonstrated that this model was valid after 200 ms from the stimulus onset. These data suggest that emotional processing in the amygdala rapidly modulates some neocortical processing, such as perception, recognition, and motor mimicry, when observing dynamic facial expressions of emotion.

Disconnection from others in autism is more than just a feeling: whole-brain neural synchrony in adults during implicit processing of emotional faces

Background

Socio-emotional difficulties in autism spectrum disorder (ASD) are thought to reflect impaired functional connectivity within the “social brain”. Nonetheless, a whole-brain characterization of the fast responses in functional connectivity during implicit processing of emotional faces in adults with ASD is lacking.

Methods

The present study used magnetoencephalography to investigate early responses in functional connectivity, as measured by interregional phase synchronization, during implicit processing of angry, neutral and happy faces. The sample (n = 44) consisted of 22 young adults with ASD and 22 age- and sex-matched typically developed (TD) controls.

Results

Reduced phase-synchrony in the beta band around 300 ms emerged during processing of angry faces in the ASD compared to TD group, involving key areas of the social brain. In the same time window, de-synchronization in the beta band in the amygdala was reduced in the ASD group across conditions.

Conclusions

This is the first demonstration of atypical global and local synchrony patterns in the social brain in adults with ASD during implicit processing of emotional faces. The present results replicate and substantially extend previous findings on adolescents, highlighting that atypical brain synchrony during processing of socio-emotional stimuli is a hallmark of clinical sequelae in autism.

Electronic supplementary material

The online version of this article (doi:10.1186/s13229-017-0123-2) contains supplementary material, which is available to authorized users.

Amygdala Response to Emotional Stimuli without Awareness: Facts and Interpretations

Over the past two decades, evidence has accumulated that the human amygdala exerts some of its functions also when the observer is not aware of the content, or even presence, of the triggering emotional stimulus. Nevertheless, there is as of yet no consensus on the limits and conditions that affect the extent of amygdala’s response without focused attention or awareness. Here we review past and recent studies on this subject, examining neuroimaging literature on healthy participants as well as brain-damaged patients, and we comment on their strengths and limits. We propose a theoretical distinction between processes involved in attentional unawareness, wherein the stimulus is potentially accessible to enter visual awareness but fails to do so because attention is diverted, and in sensory unawareness, wherein the stimulus fails to enter awareness because its normal processing in the visual cortex is suppressed. We argue this distinction, along with data sampling amygdala responses with high temporal resolution, helps to appreciate the multiplicity of functional and anatomical mechanisms centered on the amygdala and supporting its role in non-conscious emotion processing. Separate, but interacting, networks relay visual information to the amygdala exploiting different computational properties of subcortical and cortical routes, thereby supporting amygdala functions at different stages of emotion processing. This view reconciles some apparent contradictions in the literature, as well as seemingly contrasting proposals, such as the dual stage and the dual route model. We conclude that evidence in favor of the amygdala response without awareness is solid, albeit this response originates from different functional mechanisms and is driven by more complex neural networks than commonly assumed. Acknowledging the complexity of such mechanisms can foster new insights on the varieties of amygdala functions without awareness and their impact on human behavior.

The Functional Role of Neural Oscillations in Non-Verbal Emotional Communication

Effective interpersonal communication depends on the ability to perceive and interpret nonverbal emotional expressions from multiple sensory modalities. Current theoretical models propose that visual and auditory emotion perception involves a network of brain regions including the primary sensory cortices, the superior temporal sulcus (STS), and orbitofrontal cortex (OFC). However, relatively little is known about how the dynamic interplay between these regions gives rise to the perception of emotions. In recent years, there has been increasing recognition of the importance of neural oscillations in mediating neural communication within and between functional neural networks. Here we review studies investigating changes in oscillatory activity during the perception of visual, auditory, and audiovisual emotional expressions, and aim to characterize the functional role of neural oscillations in nonverbal emotion perception. Findings from the reviewed literature suggest that theta band oscillations most consistently differentiate between emotional and neutral expressions. While early theta synchronization appears to reflect the initial encoding of emotionally salient sensory information, later fronto-central theta synchronization may reflect the further integration of sensory information with internal representations. Additionally, gamma synchronization reflects facilitated sensory binding of emotional expressions within regions such as the OFC, STS, and, potentially, the amygdala. However, the evidence is more ambiguous when it comes to the role of oscillations within the alpha and beta frequencies, which vary as a function of modality (or modalities), presence or absence of predictive information, and attentional or task demands. Thus, the synchronization of neural oscillations within specific frequency bands mediates the rapid detection, integration, and evaluation of emotional expressions. Moreover, the functional coupling of oscillatory activity across multiples frequency bands supports a predictive coding model of multisensory emotion perception in which emotional facial and body expressions facilitate the processing of emotional vocalizations.

A multi-pathway hypothesis for human visual fear signaling

A hypothesis is proposed for five visual fear signaling pathways in humans, based on an analysis of anatomical connectivity from primate studies and human functional connectvity and tractography from brain imaging studies. Earlier work has identified possible subcortical and cortical fear pathways known as the "low road" and "high road," which arrive at the amygdala independently. In addition to a subcortical pathway, we propose four cortical signaling pathways in humans along the visual ventral stream. All four of these traverse through the LGN to the visual cortex (VC) and branching off at the inferior temporal area, with one projection directly to the amygdala; another traversing the orbitofrontal cortex; and two others passing through the parietal and then prefrontal cortex, one excitatory pathway via the ventral-medial area and one regulatory pathway via the ventral-lateral area. These pathways have progressively longer propagation latencies and may have progressively evolved with brain development to take advantage of higher-level processing. Using the anatomical path lengths and latency estimates for each of these five pathways, predictions are made for the relative processing times at selective ROIs and arrival at the amygdala, based on the presentation of a fear-relevant visual stimulus. Partial verification of the temporal dynamics of this hypothesis might be accomplished using experimental MEG analysis. Possible experimental protocols are suggested.

Fixation to features and neural processing of facial expressions in a gender discrimination task

Early face encoding, as reflected by the N170 ERP component, is sensitive to fixation to the eyes. Whether this sensitivity varies with facial expressions of emotion and can also be seen on other ERP components such as P1 and EPN, was investigated. Using eye-tracking to manipulate fixation on facial features, we found the N170 to be the only eye-sensitive component and this was true for fearful, happy and neutral faces. A different effect of fixation to features was seen for the earlier P1 that likely reflected general sensitivity to face position. An early effect of emotion (∼120 ms) for happy faces was seen at occipital sites and was sustained until ∼350 ms post-stimulus. For fearful faces, an early effect was seen around 80 ms followed by a later effect appearing at ∼150 ms until ∼300 ms at lateral posterior sites. Results suggests that in this emotion-irrelevant gender discrimination task, processing of fearful and happy expressions occurred early and largely independently of the eye-sensitivity indexed by the N170. Processing of the two emotions involved different underlying brain networks active at different times.

The primate amygdala in social perception - insights from electrophysiological recordings and stimulation

The role of the amygdala in emotion and social perception has been intensively investigated primarily through studies using functional magnetic resonance imaging (fMRI). Recently, this topic has been examined using single-unit recordings in both humans and monkeys, with a focus on face processing. The findings provide novel insights, including several surprises: amygdala neurons have very long response latencies, show highly nonlinear responses to whole faces, and can be exquisitely selective for very specific parts of faces such as the eyes. In humans, the responses of amygdala neurons correlate with internal states evoked by faces, rather than with their objective features. Current and future studies extend the investigations to psychiatric illnesses such as autism, in which atypical face processing is a hallmark of social dysfunction.