Dynamic emotion perception and prior expectancy

Effects of age and gender on neural correlates of emotion imagery

Mental imagery is part of people's own internal processing and plays an important role in everyday life, cognition and pathology. The neural network supporting mental imagery is bottom‐up modulated by the imagery content. Here, we examined the complex associations of gender and age with the neural mechanisms underlying emotion imagery. We assessed the brain circuits involved in emotion mental imagery (vs. action imagery), controlled by a letter detection task on the same stimuli, chosen to ensure attention to the stimuli and to discourage imagery, in 91 men and women aged 14–65 years using fMRI. In women, compared with men, emotion imagery significantly increased activation within the right putamen, which is involved in emotional processing. Increasing age, significantly decreased mental imagery‐related activation in the left insula and cingulate cortex, areas involved in awareness of ones' internal states, and it significantly decreased emotion verbs‐related activation in the left putamen, which is part of the limbic system. This finding suggests a top‐down mechanism by which gender and age, in interaction with bottom‐up effect of type of stimulus, or directly, can modulate the brain mechanisms underlying mental imagery.

Temporal dynamics of affect in the brain: Evidence from human imaging and animal models

Emotions are time-varying internal states that promote survival in the face of dynamic environments and shifting homeostatic needs. Research in non-human organisms has recently afforded specific insights into the neural mechanisms that support the emergence, persistence, and decay of affective states. Concurrently, a separate affective neuroscience literature has begun to dissect the neural bases of affective dynamics in humans. However, the circuit-level mechanisms identified in animals lack a clear mapping to the human neuroscience literature. As a result, critical questions pertaining to the neural bases of affective dynamics in humans remain unanswered. To address these shortcomings, the present review integrates findings from humans and non-human organisms to highlight the neural mechanisms that govern the temporal features of emotional states. Using the theory of affective chronometry as an organizing framework, we describe the specific neural mechanisms and modulatory factors that arbitrate the rise-time, intensity, and duration of emotional states.

Stria terminalis, amygdala, and temporoparietal junction networks facilitate efficient emotion processing under expectations

Rapid emotion processing is an ecologically essential ability for survival in social environments in which threatening or advantageous encounters dynamically and rapidly occur. Efficient emotion recognition is subserved by different processes, depending on one's expectations; however, the underlying functional and structural circuitry is still poorly understood. In this study, we delineate brain networks that subserve fast recognition of emotion in situations either congruent or incongruent with prior expectations. For this purpose, we used multimodal neuroimaging and investigated performance on a dynamic emotion perception task. We show that the extended amygdala structural and functional networks relate to speed of emotion processing under threatening conditions. Specifically, increased microstructure of the right stria terminalis, an amygdala white-matter pathway, was related to faster detection of emotion during actual presentation of anger or after cueing anger. Moreover, functional connectivity of right amygdala with limbic regions was related to faster detection of anger congruent with cue, suggesting selective attention to threat. On the contrary, we found that faster detection of anger incongruent with cue engaged the ventral attention "reorienting" network. Faster detection of happiness, in either expectancy context, engaged a widespread frontotemporal-subcortical functional network. These findings shed light on the functional and structural circuitries that facilitate speed of emotion recognition and, for the first time, elucidate a role for the stria terminalis in human emotion processing.

Negative expectations influence behavioral and ERP responses in the subsequent recognition of expectancy-incongruent neutral events

Previous studies have shown that expectancy incongruence in emotional stimuli influences the encoding (i.e., the first stage of memory processing) of the stimuli. However, it is unknown about whether expectancy incongruence influences later stages of memory processing, such as recognition. To this end, expectancy cues were presented prior to emotional pictures. Most often, the cues accurately indicated the emotional consequences of the pictures, but in some cases the consequence was incongruent with the expectations, and a picture from another emotional category was presented. Afterward, participants completed an unexpected recognition task in which old and novel pictures were not preceded by expectancy cues. The results showed that, in the encoding phase, expectancy incongruence reduced response accuracy when categorizing pictorial emotions, and the effect was smaller for neutral pictures than for negative pictures. ERP results showed stronger and weaker responses to expectancy incongruent pictures compared to congruent pictures in time ranges related to the encoding-related early and middle late positive potential (LPP), respectively. In the subsequent recognition phase, d' scores were higher for incongruent neutral pictures than for congruent ones. Expectancy incongruence enlarged the P2 response but reduced the recognition-related early LPP response for neutral pictures. However, effects of expectancy incongruence were not seen for negative pictures. Therefore, the findings in the present study indicate that negative expectations influence the later recognition of expectancy incongruent neutral events, whereas negative events are more resistant to the effects of expectation incongruence.

Hierarchical deficits in auditory information processing in schizophrenia

Deficits in auditory processing contribute significantly to impaired functional outcome in schizophrenia (SZ), but mediating factors remain under investigation. Here we evaluated two hierarchical components of early auditory processing: pitch-change detection (i.e. identifying if 2 tones have "same" or "different" pitch), which is preferentially associated with early auditory cortex, and serial pitch-pattern detection (i.e. identifying if 3 tones have "same" or "different" pitch, and, if "different", which one differed from the others), which depends also on auditory association regions. Deficits in pitch-change detection deficits in SZ have been widely reported and correlated with higher auditory disturbances such as Auditory Emotion Recognition (AER). Deficits in serial pitch-pattern discrimination have been less studied. Here, we investigated both pitch perception components, along with integrity of AER in SZ patients vs. controls using behavioral paradigms. We hypothesized that the deficits could be viewed as hierarchically organized in SZ, with deficits in low-level function propagating sequentially through subsequent levels of processing. Participants included 27 SZ and 40 controls. The magnitude of the deficits in SZ participants was large in both the pitch-change (d = 1.15) and serial pitch-pattern tasks (d = 1.21) with no significant differential task effect. The effect size of the AER deficits was extremely large (d = 2.82). In the SZ group, performance in both pitch tasks correlated significantly with impaired AER performance. However, a mediation analysis showed that serial pitch-pattern detection mediated the relationship between simpler pitch-change detection and AER in patients. Findings are consistent with hierarchical models of cognitive dysfunction in SZ with deficits in early information processing contributing to higher level impairments. Furthermore, findings are consistent with recent neurophysiological results suggesting similar level impairments for processing of simple vs. more complex tonal dysfunction in SZ.

Neural correlates of dynamic emotion perception in schizophrenia and the influence of prior expectations

Impaired emotion perception is a well-established and stable deficit in schizophrenia; however, there is limited knowledge about the underlying aberrant cognitive and brain processes that result in emotion perception deficits. Recent influential work has shown that perceptual deficits in schizophrenia may result from aberrant precision in prior expectations, associated with disrupted activity in frontal regions. In the present study, we investigated the perception of dynamic, multisensory emotion, the influence of prior expectations and the underlying aberrant brain processes in schizophrenia. During a functional Magnetic Resonance Imaging scan, participants completed the Dynamic Emotion Perception task, which induces prior expectations with emotion instruction cues. We delineated neural responses and functional connectivity in whole-brain large-scale networks underlying emotion perception. Compared to healthy individuals, schizophrenia patients had lower accuracy specifically for emotions that were congruent with prior expectations. At the neural level, schizophrenia patients had less engagement of right inferior frontal and parietal regions, as well as right amygdala dysconnectivity during discrimination of emotions congruent with prior expectations. The results indicate that individuals with schizophrenia may have aberrant prior expectations about emotional expressions, associated with under-activity in inferior frontoparietal regions and right amygdala dysconnectivity, which results in impaired perception of emotion.

Association between schizophrenia polygenic risk and neural correlates of emotion perception

The neural correlates of emotion perception have been shown to be significantly altered in schizophrenia (SCZ) patients as well as their healthy relatives, possibly reflecting genetic susceptibility to the disease. The aim of the study was to investigate the association between SCZ polygenic risk and brain activity whilst testing perception of multisensory, dynamic emotional stimuli. We created SCZ polygenic risk scores (PRS) for a sample of twenty-eight healthy individuals. The PRS was based on data from the Psychiatric Genomics Consortium and was used as a regressor score in the neuroimaging analysis. The results of a multivariate brain-behaviour analysis show that higher SCZ PRS are related to increased activity in brain regions critical for emotion during the perception of threatening (angry) emotions. These results suggest that individuals with higher SCZ PRS over-activate the neural correlates underlying emotion during perception of threat, perhaps due to an increased experience of fear or neural inefficiency in emotion-regulation areas. Moreover, over-recruitment of emotion regulation regions might function as a compensation to maintain normal emotion regulation during threat perception. If replicated in larger studies, these findings may have important implications for understanding the neurophysiological biomarkers relevant in SCZ.

Emotional prediction: An ALE meta-analysis and MACM analysis

The prediction of emotion has been explored in a variety of functional brain imaging and neurophysiological studies. However, an overall picture of the areas involved this process remains unexploited. Here, we quantitatively summarized the published literature on emotional prediction using activation likelihood estimation (ALE) in functional magnetic resonance imaging (fMRI). Furthermore, the current study employed a meta-analytic connectivity modeling (MACM) to map the meta-analytic coactivation maps of regions of interest (ROIs). Our ALE analysis revealed significant convergent activations in some vital brain areas involved in emotional prediction, including the dorsolateral prefrontal cortex (DLPFC), ventrolateral prefrontal cortex (VLPFC), orbitofrontal cortex (OFC) and medial prefrontal cortex (MPFC). For the MACM analysis, we identified that the DLPFC, VLPFC and OFC were the core areas in the coactivation network of emotional prediction. Overall, the results of ALE and MACM indicated that prefrontal brain areas play critical roles in emotional prediction.

Auditory conflict and congruence in frontotemporal dementia

Impaired analysis of signal conflict and congruence may contribute to diverse socio-emotional symptoms in frontotemporal dementias, however the underlying mechanisms have not been defined. Here we addressed this issue in patients with behavioural variant frontotemporal dementia (bvFTD; n = 19) and semantic dementia (SD; n = 10) relative to healthy older individuals (n = 20). We created auditory scenes in which semantic and emotional congruity of constituent sounds were independently probed; associated tasks controlled for auditory perceptual similarity, scene parsing and semantic competence. Neuroanatomical correlates of auditory congruity processing were assessed using voxel-based morphometry. Relative to healthy controls, both the bvFTD and SD groups had impaired semantic and emotional congruity processing (after taking auditory control task performance into account) and reduced affective integration of sounds into scenes. Grey matter correlates of auditory semantic congruity processing were identified in distributed regions encompassing prefrontal, parieto-temporal and insular areas and correlates of auditory emotional congruity in partly overlapping temporal, insular and striatal regions. Our findings suggest that decoding of auditory signal relatedness may probe a generic cognitive mechanism and neural architecture underpinning frontotemporal dementia syndromes.