Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings

Macaque claustrum, pulvinar and putative dorsolateral amygdala support the cross-modal association of social audio-visual stimuli based on meaning

Social communication draws on several cognitive functions such as perception, emotion recognition and attention. The association of audio-visual information is essential to the processing of species-specific communication signals. In this study, we use functional magnetic resonance imaging in order to identify the subcortical areas involved in the cross-modal association of visual and auditory information based on their common social meaning. We identified three subcortical regions involved in audio-visual processing of species-specific communicative signals: the dorsolateral amygdala, the claustrum and the pulvinar. These regions responded to visual, auditory congruent and audio-visual stimulations. However, none of them was significantly activated when the auditory stimuli were semantically incongruent with the visual context, thus showing an influence of visual context on auditory processing. For example, positive vocalization (coos) activated the three subcortical regions when presented in the context of positive facial expression (lipsmacks) but not when presented in the context of negative facial expression (aggressive faces). In addition, the medial pulvinar and the amygdala presented multisensory integration such that audiovisual stimuli resulted in activations that were significantly higher than those observed for the highest unimodal response. Last, the pulvinar responded in a task-dependent manner, along a specific spatial sensory gradient. We propose that the dorsolateral amygdala, the claustrum and the pulvinar belong to a multisensory network that modulates the perception of visual socioemotional information and vocalizations as a function of the relevance of the stimuli in the social context. SIGNIFICANCE STATEMENT: Understanding and correctly associating socioemotional information across sensory modalities, such that happy faces predict laughter and escape scenes predict screams, is essential when living in complex social groups. With the use of functional magnetic imaging in the awake macaque, we identify three subcortical structures-dorsolateral amygdala, claustrum and pulvinar-that only respond to auditory information that matches the ongoing visual socioemotional context, such as hearing positively valenced coo calls and seeing positively valenced mutual grooming monkeys. We additionally describe task-dependent activations in the pulvinar, organizing along a specific spatial sensory gradient, supporting its role as a network regulator.

An active inference perspective for the amygdala complex

The amygdala is a heterogeneous network of subcortical nuclei with central importance in cognitive and clinical neuroscience. Various experimental designs in human psychology and animal model research have mapped multiple conceptual frameworks (e.g., valence/salience and decision making) to ever more refined amygdala circuitry. However, these predominantly bottom up-driven accounts often rely on interpretations tailored to a specific phenomenon, thus preventing comprehensive and integrative theories. We argue here that an active inference model of amygdala function could unify these fractionated approaches into an overarching framework for clearer empirical predictions and mechanistic interpretations. This framework embeds top-down predictive models, informed by prior knowledge and belief updating, within a dynamical system distributed across amygdala circuits in which self-regulation is implemented by continuously tracking environmental and homeostatic demands.

Hemodynamic and electrophysiological responses of the human amygdala during face imitation-a study using functional MRI and intracranial EEG

The involvement of the human amygdala in facial mimicry remains a matter of debate. We investigated neural activity in the human amygdala during a task in which an imitation task was separated in time from an observation task involving facial expressions. Neural activity in the amygdala was measured using functional magnetic resonance imaging in 18 healthy individuals and using intracranial electroencephalogram in six medically refractory patients with epilepsy. The results of functional magnetic resonance imaging experiment showed that mimicry of negative and positive expressions activated the amygdala more than mimicry of non-emotional facial movements. In intracranial electroencephalogram experiment and time-frequency analysis, emotion-related activity of the amygdala during mimicry was observed as a significant neural oscillation in the high gamma band range. Furthermore, spectral event analysis of individual trial intracranial electroencephalogram data revealed that sustained oscillation of gamma band activity originated from an increased number and longer duration of neural events in the amygdala. Based on these findings, we conclude that during facial mimicry, visual information of expressions and feedback from facial movements are combined in the amygdalar nuclei. Considering the time difference of information approaching the amygdala, responses to facial movements are likely to modulate rather than initiate affective processing in human participants.

Prestimulus amygdala spectral activity is associated with visual face awareness

Alpha cortical oscillations have been proposed to suppress sensory processing in the visual, auditory, and tactile domains, influencing conscious stimulus perception. However, it is unknown whether oscillatory neural activity in the amygdala, a subcortical structure involved in salience detection, has a similar impact on stimulus awareness. Recording intracranial electroencephalography (EEG) from 9 human amygdalae during face detection in a continuous flash suppression task, we found increased spectral prestimulus power and phase coherence, with most consistent effects in the alpha band, when faces were undetected relative to detected, similarly as previously observed in cortex with this task using scalp-EEG. Moreover, selective decreases in the alpha and gamma bands preceded face detection, with individual prestimulus alpha power correlating negatively with detection rate in patients. These findings reveal for the first time that prestimulus subcortical oscillations localized in human amygdala may contribute to perceptual gating mechanisms governing subsequent face detection and offer promising insights on the role of this structure in visual awareness.

Frequency dependent emotion differentiation and directional coupling in amygdala, orbitofrontal and medial prefrontal cortex network with intracranial recordings

The amygdala, orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) form a crucial part of the emotion circuit, yet their emotion induced responses and interactions have been poorly investigated with direct intracranial recordings. Such high-fidelity signals can uncover precise spectral dynamics and frequency differences in valence processing allowing novel insights on neuromodulation. Here, leveraging the unique spatio-temporal advantages of intracranial electroencephalography (iEEG) from a cohort of 35 patients with intractable epilepsy (with 71 contacts in amygdala, 31 in OFC and 43 in mPFC), we assessed the spectral dynamics and interactions between the amygdala, OFC and mPFC during an emotional picture viewing task. Task induced activity showed greater broadband gamma activity in the negative condition compared to positive condition in all the three regions. Similarly, beta activity was increased in the negative condition in the amygdala and OFC while decreased in mPFC. Furthermore, beta activity of amygdala showed significant negative association with valence ratings. Critically, model-based computational analyses revealed unidirectional connectivity from mPFC to the amygdala and bidirectional communication between OFC-amygdala and OFC-mPFC. Our findings provide direct neurophysiological evidence for a much-posited model of top-down influence of mPFC over amygdala and a bidirectional influence between OFC and the amygdala. Altogether, in a relatively large sample size with human intracranial neuronal recordings, we highlight valence-dependent spectral dynamics and dyadic coupling within the amygdala-mPFC-OFC network with implications for potential targeted neuromodulation in emotion processing.

Integrative interaction of emotional speech in audio-visual modality

Emotional clues are always expressed in many ways in our daily life, and the emotional information we receive is often represented by multiple modalities. Successful social interactions require a combination of multisensory cues to accurately determine the emotion of others. The integration mechanism of multimodal emotional information has been widely investigated. Different brain activity measurement methods were used to determine the location of brain regions involved in the audio-visual integration of emotional information, mainly in the bilateral superior temporal regions. However, the methods adopted in these studies are relatively simple, and the materials of the study rarely contain speech information. The integration mechanism of emotional speech in the human brain still needs further examinations. In this paper, a functional magnetic resonance imaging (fMRI) study was conducted using event-related design to explore the audio-visual integration mechanism of emotional speech in the human brain by using dynamic facial expressions and emotional speech to express emotions of different valences. Representational similarity analysis (RSA) based on regions of interest (ROIs), whole brain searchlight analysis, modality conjunction analysis and supra-additive analysis were used to analyze and verify the role of relevant brain regions. Meanwhile, a weighted RSA method was used to evaluate the contributions of each candidate model in the best fitted model of ROIs. The results showed that only the left insula was detected by all methods, suggesting that the left insula played an important role in the audio-visual integration of emotional speech. Whole brain searchlight analysis, modality conjunction analysis and supra-additive analysis together revealed that the bilateral middle temporal gyrus (MTG), right inferior parietal lobule and bilateral precuneus might be involved in the audio-visual integration of emotional speech from other aspects.

Localized task-invariant emotional valence encoding revealed by intracranial recordings

The ability to distinguish between negative, positive and neutral valence is a key part of emotion perception. Emotional valence has conceptual meaning that supersedes any particular type of stimulus, although it is typically captured experimentally in association with particular tasks. We sought to identify neural encoding for task-invariant emotional valence. We evaluated whether high-gamma responses (HGRs) to visually displayed words conveying emotions could be used to decode emotional valence from HGRs to facial expressions. Intracranial electroencephalography was recorded from 14 individuals while they participated in two tasks, one involving reading words with positive, negative, and neutral valence, and the other involving viewing faces with positive, negative, and neutral facial expressions. Quadratic discriminant analysis was used to identify information in the HGR that differentiates the three emotion conditions. A classifier was trained on the emotional valence labels from one task and was cross-validated on data from the same task (within-task classifier) as well as the other task (between-task classifier). Emotional valence could be decoded in the left medial orbitofrontal cortex and middle temporal gyrus, both using within-task classifiers and between-task classifiers. These observations suggest the presence of task-independent emotional valence information in the signals from these regions.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

Auditory roughness elicits defense reactions

Auditory roughness elicits aversion, and higher activation in cerebral areas involved in threat processing, but its link with defensive behavior is unknown. Defensive behaviors are triggered by intrusions into the space immediately surrounding the body, called peripersonal space (PPS). Integrating multisensory information in PPS is crucial to assure the protection of the body. Here, we assessed the behavioral effects of roughness on auditory-tactile integration, which reflects the monitoring of this multisensory region of space. Healthy human participants had to detect as fast as possible a tactile stimulation delivered on their hand while an irrelevant sound was approaching them from the rear hemifield. The sound was either a simple harmonic sound or a rough sound, processed through binaural rendering so that the virtual sound source was looming towards participants. The rough sound speeded tactile reaction times at a farther distance from the body than the non-rough sound. This indicates that PPS, as estimated here via auditory-tactile integration, is sensitive to auditory roughness. Auditory roughness modifies the behavioral relevance of simple auditory events in relation to the body. Even without emotional or social contextual information, auditory roughness constitutes an innate threat cue that elicits defensive responses.