Connectome-based modeling reveals a resting-state functional network that mediates the relationship between social rejection and rumination

Background

Rumination impedes problem solving and is one of the most important factors in the onset and maintenance of multiple psychiatric disorders. The current study aims to investigate the impact of social rejection on rumination and explore the underlying neural mechanisms involved in this process.

Methods

We utilized psychological questionnaire and resting-state brain imaging data from a sample of 560 individuals. The predictive model for rumination scores was constructed using resting-state functional connectivity data through connectome-based predictive modeling. Additionally, a mediation analysis was conducted to investigate the mediating role of the prediction network in the relationship between social rejection and rumination.

Results

A positive correlation between social rejection and rumination was found. We obtained the prediction model of rumination and found that the strongest contributions came from the intra- and internetwork connectivity within the default mode network (DMN), dorsal attention network (DAN), frontoparietal control network (FPCN), and sensorimotor networks (SMN). Analysis of node strength revealed the significance of the supramarginal gyrus (SMG) and angular gyrus (AG) as key nodes in the prediction model. In addition, mediation analysis showed that the strength of the prediction network mediated the relationship between social rejection and rumination.

Conclusion

The findings highlight the crucial role of functional connections among the DMN, DAN, FPCN, and SMN in linking social rejection and rumination, particular in brain regions implicated in social cognition and emotion, namely the SMG and AG regions. These results enhance our understanding of the consequences of social rejection and provide insights for novel intervention strategies targeting rumination.

Reinvestigating the Neural Bases Involved in Speech Production of Stutterers: An ALE Meta-Analysis

Background: Stuttering is characterized by dysfluency and difficulty in speech production. Previous research has found abnormalities in the neural function of various brain areas during speech production tasks. However, the cognitive neural mechanism of stuttering has still not been fully determined. Method: Activation likelihood estimation analysis was performed to provide neural imaging evidence on neural bases by reanalyzing published studies. Results: Our analysis revealed overactivation in the bilateral posterior superior temporal gyrus, inferior frontal gyrus, medial frontal gyrus, precentral gyrus, postcentral gyrus, basal ganglia, and cerebellum, and deactivation in the anterior superior temporal gyrus and middle temporal gyrus among the stutterers. The overactivated regions might indicate a greater demand in feedforward planning in speech production, while the deactivated regions might indicate dysfunction in the auditory feedback system among stutterers. Conclusions: Our findings provide updated and direct evidence on the multi-level impairment (feedforward and feedback systems) of stutterers during speech production and show that the corresponding neural bases were differentiated.

A cognitive model of response omissions in distraction paradigms

The effects of distraction on responses manifest in three ways: prolonged reaction times, and increased error and response omission rates. However, the latter effect is often ignored or assumed to be due to a separate cognitive process. We investigated omissions occurring in two paradigms that manipulated distraction. One required simple stimulus detection of younger participants, the second required choice responses and was completed by both younger and older participants. We fit data from these paradigms with a model that identifies three causes of omissions: two are related to the process of accumulating the evidence on which a response is based: intrinsic omissions (due to between-trial variation in accumulation rates making it impossible to ever reach the evidence threshold) and design omissions (due to response windows that cause slow responses not to be recorded; a third, contaminant omissions, allows for a cause unrelated to the response process. In both data sets systematic differences in omission rates across conditions were accounted for by task-related omissions. Intrinsic omissions played a lesser role than design omissions, even though the presence of design omissions was not evident in descriptive analyses of the data. The model provided an accurate account of all aspects of the detection data and the choice-response data, but slightly underestimated overall omissions in the choice paradigm, particularly in older participants, suggesting that further investigation of contaminant omission effects is needed.

Contextual Modulation of Binary Decisions in Dyadic Social Interactions

The present experimental design allowed binary decisions (i.e., to choose between proactive approaching or withdrawing behavior). These decisions were made on complex social interaction scenarios displayed on videos. The videos were taken from a first-person perspective. They were preceded by one sentence each that provided additional information about the context of the displayed scenario. The sentence preceding the video and the video jointly provided a context of emotional valence. That context varied from trial to trial. We observed that provocative and threatening videos produced predominantly fear and anger responses. Fear was associated with withdrawal decisions, while anger led to approach decisions. Negative contextual information increased the probability of approach decisions in aggressive provocative videos; positive contextual information enhanced the chance of approach decisions in socially positive videos. In neutral situations, displayed in videos, the probability of the approach behavior was reduced in case of negative contextual information. Yet, the probability for approach behavior was increased if positive contextual information preceded neutral videos. Our experimental setup provided a paradigm that can be adapted and accommodated for the examination of future research questions on social decisions in multidimensional, complex social situations.

Symptoms of Posttraumatic Stress Disorder are Associated with Exaggerated Neural Response to Surprising Errors

Posttraumatic stress disorder (PTSD) is characterized by exaggerated salience of previously innocuous cues and associated with hyperactivity of salience-related brain regions. Recently, computational models have been deployed to operationalize salience more precisely regarding surprise-driven learning, leading to findings that such learning is altered in anxiety-related disorders. In the present study, a sample of 20 combat veterans completed a probabilistic learning task during fMRI scanning. We applied a computational model to generate a trial-by-trial surprise signal (i.e., unsigned prediction error or difference between the expected probability of an outcome and the actual observed outcome), which allowed us to examine the neural response to surprising events. We did not observe an association between PTSD symptoms and behavioral indices of learning in the task. Surprising errors were associated with increased activity in the left precuneus/inferior parietal lobule and right inferior parietal lobule, two parietal regions that are linked to salience processing. Additionally, PTSD symptom severity was positively associated with precuneus/inferior parietal lobule activation to surprising errors, r = .63, p = .004. Taken together, this pattern of results suggests that PTSD symptoms are specifically associated with an exaggerated response to surprising errors in salience-related regions of the brain. This altered pattern of neural activity could represent a target for intervention to improve PTSD symptoms.

Unravelling the effects of methylphenidate on the dopaminergic and noradrenergic functional circuits

Functional magnetic resonance imaging (fMRI) can be combined with drugs to investigate the system-level functional responses in the brain to such challenges. However, most psychoactive agents act on multiple neurotransmitters, limiting the ability of fMRI to identify functional effects related to actions on discrete pharmacological targets. We recently introduced a multimodal approach, REACT (Receptor-Enriched Analysis of functional Connectivity by Targets), which offers the opportunity to disentangle effects of drugs on different neurotransmitters and clarify the biological mechanisms driving clinical efficacy and side effects of a compound. Here, we focus on methylphenidate (MPH), which binds to the dopamine transporter (DAT) and the norepinephrine transporter (NET), to unravel its effects on dopaminergic and noradrenergic functional circuits in the healthy brain at rest. We then explored the relationship between these target-enriched resting state functional connectivity (FC) maps and inter-individual variability in behavioural responses to a reinforcement-learning task encompassing a novelty manipulation to disentangle the molecular systems underlying specific cognitive/behavioural effects. Our main analysis showed a significant MPH-induced FC increase in sensorimotor areas in the functional circuit associated with DAT. In our exploratory analysis, we found that MPH-induced regional variations in the DAT and NET-enriched FC maps were significantly correlated with some of the inter-individual differences on key behavioural responses associated with the reinforcement-learning task. Our findings show that main MPH-related FC changes at rest can be understood through the distribution of DAT in the brain. Furthermore, they suggest that when compounds have mixed pharmacological profiles, REACT may be able to capture regional functional effects that are underpinned by the same cognitive mechanism but are related to engagement of distinct molecular targets.

Altered whole-brain gray matter volume in primary angle closure glaucoma patients: a voxel-based morphometry study

The study aimed to compare the whole-brain gray matter volume (GMV) and white matter volume (WMV) difference between primary angle closure glaucoma (PACG) patients and health controls (HCs) using a voxel-based morphometry method. A total of 27 patients with PACG (17 males and 10 females) and 27 HCs (17 males and 10 females), closely matched for age and education, were enrolled in the study. All subjects underwent magnetic resonance imaging (MRI) scans. The MRI data were processed using SPM8 software in voxel-based morphometry 8 toolbox. The relationship between the mean GMV values of brain regions and the clinical features including psychological testing and mean retinal nerve fiber layer (RNFL) thickness in PACG groups were analyzed by using Pearson correlation. Compared with HCs, PACG patients showed significantly decreased GMV values in the left cerebellum posterior lobe (CPL), right extra-nuclear, and right superior temporal gyrus. In contrast, PACG patients showed significantly increased GMV values in the left CPL, right CPL, right superior temporal gyrus, right thalamus and right insula (P<0.01). Moreover, in the PACG group, the left mean RNFL showed a positive correlation with the mean GMV values of the left CPL (r=0.719; P<0.001) and the right mean RNFL showed a positive correlation with the mean GMV values of the left CPL (r=0.721; P<0.001). The Hamilton depression score showed a positive correlation with the mean GMV values of right insula (r=0.897; P<0.001). Our results demonstrated that PACG patients showed altered brain structure in various regions related to visuomotor function, thalamocortical pathway, and emotion function, which might provide a useful informations to understanding the anatomy neural mechanisms of deficit in vision loss and depression in PACG.

Distraction and facilitation: The impact of emotional sounds in an emoji oddball task

Emotional stimuli are argued to capture attention and consume attentional resources differently depending on their emotional content. The present study investigates the impact of the automatic detection of unexpected and to-be-ignored emotional stimuli on human behavioral responses, and aims to unravel the differences in distraction between two negative emotional stimuli: sadness and anger. Forty participants (M_age = 25.5 years) performed a visual categorization task where angry and sad emoji faces were presented after either a standard neutral tone (in 80% of trials) or a deviant emotional sound (tone changing in pitch; sad or angry sound in 10% of trials each) that was to be ignored. Deviant trials were either congruent (e.g., sad sound-sad face) or incongruent (e.g., angry sound-sad face). Although the stimuli presented to the participants were brief and to-be-ignored, results indicate that participants were significantly more distracted by sad compared to angry stimuli (seen as prolonged response times). Findings are discussed with reference to the nature of the two negative emotions.

Stimulus complexity matters when you hear your own voice: Attention effects on self-generated voice processing

The ability to discriminate self- and non-self voice cues is a fundamental aspect of self-awareness and subserves self-monitoring during verbal communication. Nonetheless, the neurofunctional underpinnings of self-voice perception and recognition are still poorly understood. Moreover, how attention and stimulus complexity influence the processing and recognition of one's own voice remains to be clarified. Using an oddball task, the current study investigated how self-relevance and stimulus type interact during selective attention to voices, and how they affect the representation of regularity during voice perception. Event-related potentials (ERPs) were recorded from 18 right-handed males. Pre-recorded self-generated (SGV) and non-self (NSV) voices, consisting of a nonverbal vocalization (vocalization condition) or disyllabic word (word condition), were presented as either standard or target stimuli in different experimental blocks. The results showed increased N2 amplitude to SGV relative to NSV stimuli. Stimulus type modulated later processing stages only: P3 amplitude was increased for SGV relative to NSV words, whereas no differences between SGV and NSV were observed in the case of vocalizations. Moreover, SGV standards elicited reduced N1 and P2 amplitude relative to NSV standards. These findings revealed that the self-voice grabs more attention when listeners are exposed to words but not vocalizations. Further, they indicate that detection of regularity in an auditory stream is facilitated for one's own voice at early processing stages. Together, they demonstrate that self-relevance affects attention to voices differently as a function of stimulus type.

A Quantitative Tractography Study Into the Connectivity, Segmentation and Laterality of the Human Inferior Longitudinal Fasciculus

The human inferior longitudinal fasciculus (ILF) is a ventral, temporo-occipital association tract. Though described in early neuroanatomical works, its existence was later questioned. Application of in vivo tractography to the neuroanatomical study of the ILF has generally confirmed its existence, however, consensus is lacking regarding its subdivision, laterality and connectivity. Further, there is a paucity of detailed neuroanatomic data pertaining to the exact anatomy of the ILF. Generalized Q-Sampling imaging (GQI) is a non-tensor tractographic modality permitting high resolution imaging of white-matter structures. As it is a non-tensor modality, it permits visualization of crossing fibers and accurate delineation of close-proximity fiber-systems. We applied deterministic GQI tractography to data from 30 healthy subjects and a large-volume, averaged diffusion atlas, to delineate ILF anatomy. Post-mortem white matter dissection was also carried out in three cadaveric specimens for further validation. The ILF was found in all 60 hemispheres. At its occipital extremity, ILF fascicles demonstrated a bifurcated, ventral-dorsal morphological termination pattern, which we used to further subdivide the bundle for detailed analysis. These divisions were consistent across the subject set and within the atlas. We applied quantitative techniques to study connectivity strength of the ILF at its anterior and posterior extremities. Overall, both morphological divisions, and the un-separated ILF, demonstrated strong leftward-lateralized connectivity patterns. Leftward-lateralization was also found for ILF volumes across the subject set. Due to connective and volumetric leftward-dominance and ventral location, we postulate the ILFs role in the semantic system. Further, our results are in agreement with functional and lesion-based postulations pertaining to the ILFs role in facial recognition.

The Role of Motivation in Cognitive Reappraisal for Depressed Patients

Background: People engage in emotion regulation in service of motive goals (typically, to approach a desired emotional goal or avoid an undesired emotional goal). However, how motives (goals) in emotion regulation operate to shape the regulation of emotion is rarely known. Furthermore, the modulatory role of motivation in the impaired reappraisal capacity and neural abnormalities typical of depressed patients is not clear. Our hypothesis was that (1) approach and avoidance motivation may modulate emotion regulation and the underlying neural substrates; (2) approach/avoidance motivation may modulate emotion regulation neural abnormalities in depressed patients. Methods: Twelve drug-free depressed patients and fifteen matched healthy controls reappraised emotional pictures with approach/avoidant strategies and self-rated their emotional intensities during fMRI scans. Approach/avoidance motivation was measured using Behavioral Inhibition System and Behavioral Activation System (BIS/BAS) Scale. We conducted whole-brain analyses and correlation analyses of regions of interest to identify alterations in regulatory prefrontal-amygdala circuits which were modulated by motivation. Results: Depressed patients had a higher level of BIS and lower levels of BAS-reward responsiveness and BAS-drive. BIS scores were positively correlated with depressive severity. We found the main effect of motivation as well as the interactive effect of motivation and group on the neural correlates of emotion regulation. Specifically, hypoactivation of IFG underlying the group differences in the motivation-related neural correlates during reappraisal may be partially explained by the interaction between group and reappraisal. Consistent with our prediction, dlPFC and vmPFC was differentially between groups which were modulated by motivation. Specifically, the avoidance motivation of depressed patients could predict the right dlPFC activation during decreasing positive emotion, while the approach motivation of normal individuals could predict the right vmPFC activation during decreasing negative emotion. Notably, striatal regions were observed when examining the neural substrates underlying the main effect of motivation (lentiform nucleus) and the interactive effect between motivation and group (midbrain). Conclusions: Our findings highlight the modulatory role of approach and avoidance motivation in cognitive reappraisal, which is dysfunctional in depressed patients. The results could enlighten the CBT directed at modifying the motivation deficits in cognitive regulation of emotion.

COMT and DRD2/ANKK-1 gene-gene interaction account for resetting of gamma neural oscillations to auditory stimulus-driven attention

Attention capture by potentially relevant environmental stimuli is critical for human survival, yet it varies considerably among individuals. A large series of studies has suggested that attention capture may depend on the cognitive balance between maintenance and manipulation of mental representations and the flexible switch between goal-directed representations and potentially relevant stimuli outside the focus of attention; a balance that seems modulated by a prefrontostriatal dopamine pathway. Here, we examined inter-individual differences in the cognitive control of attention through studying the effects of two single nucleotide polymorphisms regulating dopamine at the prefrontal cortex and the striatum (i.e., COMTMet108/158Val and ANKK1/DRD2TaqIA) on stimulus-driven attention capture. Healthy adult participants (N = 40) were assigned to different groups according to the combination of the polymorphisms COMTMet108/158Val and ANKK1/DRD2TaqIA, and were instructed to perform on a well-established distraction protocol. Performance in individuals with a balance between prefrontal dopamine display and striatal receptor density was slowed down by the occurrence of unexpected distracting events, while those with a rather unbalanced dopamine activity were able maintain task performance with no time delay, yet at the expense of a slightly lower accuracy. This advantage, associated to their distinct genetic profiles, was paralleled by an electrophysiological mechanism of phase-resetting of gamma neural oscillation to the novel, distracting events. Taken together, the current results suggest that the epistatic interaction between COMTVal108/158Met and ANKK1/DRD2 TaqIa genetic polymorphisms lies at the basis of stimulus-driven attention capture.

Comparison of spontaneous brain activity revealed by regional homogeneity in AQP4-IgG neuromyelitis optica-optic neuritis versus MOG-IgG optic neuritis patients: a resting-state functional MRI study

OBJECTIVE

Many previous studies have demonstrated that neuromyelitis optica (NMO) patients have abnormalities of brain anatomy and function. However, differences in spontaneous brain activity between myelin oligodendrocyte glycoprotein (MOG)-IgG ON and aquaporin 4(AQP4)-neuromyelitis optica-optic neuritis (ON) remain unknown. In the current study, we investigated the brain neural homogeneity in MOG-IgG ON versus AQP4-IgG NMO-ON subjects by regional homogeneity (ReHo) method using magnetic resonance imaging (MRI).

PATIENTS AND METHODS

A total of 32 NMO-ON and ON subjects (21 with AQP4-IgG+NMO-ON and 11 with MOG-IgG+ON) and 34 healthy controls (HCs) closely matched for age were recruited, and scans were performed for all subjects. A one-way analysis of variance (ANOVA) was performed to determine the regions in which the ReHo was different across the three groups. NMO-ON and ON subjects were distinguished from HCs by a receiver operating characteristic (ROC) curve. The relationship between the mean ReHo in many brain regions and clinical features in NMO subjects was calculated by Pearson correlation analysis.

RESULTS

Compared with HCs, MOG-IgG+ON subjects had significantly decreased ReHo values in the posterior lobe of the left cerebellum and increased ReHo values in the left inferior frontal gyrus, right prefrontal gyrus, and left precentral/postcentral gyrus. AQP4-IgG+NMO-ON subjects showed higher ReHo values in the left inferior frontal gyrus and right middle temporal/occipital gyrus. Compared with MOG-IgG+ON subjects, AQP4-IgG+NMO-ON subjects had lower ReHo values in the posterior lobe of the right cerebellum. AQP4-Ig+NMO-ON subjects showed higher ReHo values in the left precentral/postcentral gyrus and right superior temporal gyrus.

CONCLUSION

AQP4-IgG+NMO-ON and MOG-IgG+ON subjects showed abnormal synchronized neuronal activity in many brain regions, which is consistent with deficits in visual, motor, and cognitive function. Furthermore, different patterns of synchronized neuronal activity occurred in the AQP4-IgG+NMO-ON and MOG-IgG+ON.

Fear Spreading Across Senses: Visual Emotional Events Alter Cortical Responses to Touch, Audition, and Vision

Attention and perception are potentiated for emotionally significant stimuli, promoting efficient reactivity and survival. But does such enhancement extend to stimuli simultaneously presented across different sensory modalities? We used functional magnetic resonance imaging in humans to examine the effects of visual emotional signals on concomitant sensory inputs in auditory, somatosensory, and visual modalities. First, we identified sensory areas responsive to task-irrelevant tones, touches, or flickers, presented bilaterally while participants attended to either a neutral or a fearful face. Then, we measured whether these responses were modulated by the emotional content of the face. Sensory responses in primary cortices were enhanced for auditory and tactile stimuli when these appeared with fearful faces, compared with neutral, but striate cortex responses to the visual stimuli were reduced in the left hemisphere, plausibly as a consequence of sensory competition. Finally, conjunction and functional connectivity analyses identified 2 distinct networks presumably responsible for these emotional modulatory processes, involving cingulate, insular, and orbitofrontal cortices for the increased sensory responses, and ventrolateral prefrontal cortex for the decreased sensory responses. These results suggest that emotion tunes the excitability of sensory systems across multiple modalities simultaneously, allowing the individual to adaptively process incoming inputs in a potentially threatening environment.

Happiness increases distraction by auditory deviant stimuli

Rare and unexpected changes (deviants) in an otherwise repeated stream of task-irrelevant auditory distractors (standards) capture attention and impair behavioural performance in an ongoing visual task. Recent evidence indicates that this effect is increased by sadness in a task involving neutral stimuli. We tested the hypothesis that such effect may not be limited to negative emotions but reflect a general depletion of attentional resources by examining whether a positive emotion (happiness) would increase deviance distraction too. Prior to performing an auditory-visual oddball task, happiness or a neutral mood was induced in participants by means of the exposure to music and the recollection of an autobiographical event. Results from the oddball task showed significantly larger deviance distraction following the induction of happiness. Interestingly, the small amount of distraction typically observed on the standard trial following a deviant trial (post-deviance distraction) was not increased by happiness. We speculate that happiness might interfere with the disengagement of attention from the deviant sound back towards the target stimulus (through the depletion of cognitive resources and/or mind wandering) but help subsequent cognitive control to recover from distraction.

Dehydroepiandrosterone (DHEA) and dehydroepiandrosterone-sulfate (DHEAS) and emotional processing - A behavioral and electrophysiological approach

Dehydroepiandrosterone (DHEA) and dehydroepiandrosterone-sulfate (DHEAS) may have mood enhancement effects: higher DHEAS concentrations and DHEA/cortisol ratio have been related to lower depression scores and controlled trials of DHEA administration have reported significant antidepressant effects. The balance between DHEAS and DHEA has been suggested to influence brain functioning. We explored DHEAS, DHEA, cortisol, DHEA/cortisol and DHEAS/DHEA ratios relations to the processing of negative emotional stimuli at behavioral and brain levels by recording the electroencephalogram of 21 young women while performing a visual task with implicit neutral or negative emotional content in an audio-visual oddball paradigm. For each condition, salivary DHEA, DHEAS and cortisol were measured before performing the task and at 30 and 60min intervals. DHEA increased after task performance, independent of the implicit emotional content. With implicit negative emotion, higher DHEAS/DHEA and DHEA/cortisol ratios before task performance were related to shorter visual P300 latencies suggesting faster brain processing under a negative emotional context. In addition, higher DHEAS/DHEA ratios were related to reduced visual P300 amplitudes, indicating less processing of the negative emotional stimuli. With this study, we could show that at the electrophysiological level, higher DHEAS/DHEA and DHEA/cortisol ratios were related to shorter stimulus evaluation times suggesting less interference of the implicit negative content of the stimuli with the task. Furthermore, higher DHEAS/DHEA ratios were related to reduced processing of negative emotional stimuli which may eventually constitute a protective mechanism against negative information overload.

Emotional valence and spatial congruency differentially modulate crossmodal processing: an fMRI study

Salient exogenous stimuli modulate attentional processes and lead to attention shifts-even across modalities and at a pre-attentive level. Stimulus properties such as hemispheric laterality and emotional valence influence processing, but their specific interaction in audio-visual attention paradigms remains ambiguous. We conducted an fMRI experiment to investigate the interaction of supramodal spatial congruency, emotional salience, and stimulus presentation side on neural processes of attention modulation. Emotionally neutral auditory deviants were presented in a dichotic listening oddball design. Simultaneously, visual target stimuli (schematic faces) were presented, which displayed either a negative or a positive emotion. These targets were presented in the left or in the right visual field and were either spatially congruent (valid) or incongruent (invalid) with the concurrent deviant auditory stimuli. According to our expectation we observed that deviant stimuli serve as attention-directing cues for visual target stimuli. Region-of-interest (ROI) analyses suggested differential effects of stimulus valence and spatial presentation on the hemodynamic response in bilateral auditory cortices. These results underline the importance of valence and presentation side for attention guidance by deviant sound events and may hint at a hemispheric specialization for valence and attention processing.

Neither state or trait anxiety alter the response to distracting emotionally neutral sounds

Attentional control theory suggests that heightened anxiety, whether due to trait or state factors, causes an increased vulnerability to distraction even when the distracters are emotionally neutral. Recent passive oddball studies appear to support this theory in relation to the distraction caused by emotionally neutral sounds. However such studies have manipulated emotional state via the content of task stimuli, thus potentially confounding changes in emotion with differences in task demands. To identify the effect of anxiety on the distraction caused by emotionally neutral sounds, 50 participants completed a passive oddball task requiring emotionally neutral sounds to be ignored. Crucially, state anxiety was manipulated independent of the task stimuli (via unrelated audiovisual stimuli) thus removing confounds relating to task demands. Neither state or trait anxiety was found to influence the susceptibility to distraction by emotionally neutral sounds. These findings contribute to the ongoing debate concerning the impact of emotion on attention.

Emotional sounds modulate early neural processing of emotional pictures

In our natural environment, emotional information is conveyed by converging visual and auditory information; multimodal integration is of utmost importance. In the laboratory, however, emotion researchers have mostly focused on the examination of unimodal stimuli. Few existing studies on multimodal emotion processing have focused on human communication such as the integration of facial and vocal expressions. Extending the concept of multimodality, the current study examines how the neural processing of emotional pictures is influenced by simultaneously presented sounds. Twenty pleasant, unpleasant, and neutral pictures of complex scenes were presented to 22 healthy participants. On the critical trials these pictures were paired with pleasant, unpleasant, and neutral sounds. Sound presentation started 500 ms before picture onset and each stimulus presentation lasted for 2 s. EEG was recorded from 64 channels and ERP analyses focused on the picture onset. In addition, valence and arousal ratings were obtained. Previous findings for the neural processing of emotional pictures were replicated. Specifically, unpleasant compared to neutral pictures were associated with an increased parietal P200 and a more pronounced centroparietal late positive potential (LPP), independent of the accompanying sound valence. For audiovisual stimulation, increased parietal P100 and P200 were found in response to all pictures which were accompanied by unpleasant or pleasant sounds compared to pictures with neutral sounds. Most importantly, incongruent audiovisual pairs of unpleasant pictures and pleasant sounds enhanced parietal P100 and P200 compared to pairings with congruent sounds. Taken together, the present findings indicate that emotional sounds modulate early stages of visual processing and, therefore, provide an avenue by which multimodal experience may enhance perception.

Phasic boosting of auditory perception by visual emotion

Emotionally negative stimuli boost perceptual processes. There is little known, however, about the timing of this modulation. The present study aims at elucidating the phasic effects of, emotional processing on auditory processing within subsequent time-windows of visual emotional, processing in humans. We recorded the electroencephalogram (EEG) while participants responded to a, discrimination task of faces with neutral or fearful expressions. A brief complex tone, which subjects, were instructed to ignore, was displayed concomitantly, but with different asynchronies respective to, the image onset. Analyses of the N1 auditory event-related potential (ERP) revealed enhanced brain, responses in presence of fearful faces. Importantly, this effect occurred at picture-tone asynchronies of, 100 and 150ms, but not when these were displayed simultaneously, or at 50ms or 200ms asynchrony. These results confirm the existence of a fast-operating crossmodal effect of visual emotion on auditory, processing, suggesting a phasic variation according to the time-course of emotional processing.

Acute neural effects of selective serotonin reuptake inhibitors versus noradrenaline reuptake inhibitors on emotion processing: Implications for differential treatment efficacy

Clinical research has demonstrated differential efficacy of selective serotonin reuptake inhibitors (SSRIs) and norepinephrine reuptake inhibitors (NRIs), which may relate to differential acute effects these medications have on emotional brain processes. Here we present findings from a Multi-Level Kernel Density Analysis meta-analysis that integrates and contrasts activations from disparate fMRI studies in order to examine whether single dose SSRIs and NRIs have different effects on emotion processing tasks in healthy participants. Seven SSRI and four NRI studies were eligible for inclusion. SSRIs decreased amygdala responses, suggesting reduced emotional reactivity to emotional stimuli, whereas NRIs increased frontal and medial activation, suggesting increased emotion regulation. As hypothesised, an interaction of antidepressant and task type was found, such that SSRIs modulated amygdaloid-hippocampal, medial and frontal activity during both the presentation of faces and pictures, whereas NRIs only modulated the activation in medial and frontal regions during the presentation of pictures. Findings are interpreted within a novel model of the differential effects of SSRIs and NRIs on emotion processing.

A computational model of auditory attention for use in soundscape research

Urban soundscape design involves creating outdoor spaces that are pleasing to the ear. One way to achieve this goal is to add or accentuate sounds that are considered to be desired by most users of the space, such that the desired sounds mask undesired sounds, or at least distract attention away from undesired sounds. In view of removing the need for a listening panel to assess the effectiveness of such soundscape measures, the interest for new models and techniques is growing. In this paper, a model of auditory attention to environmental sound is presented, which balances computational complexity and biological plausibility. Once the model is trained for a particular location, it classifies the sounds that are present in the soundscape and simulates how a typical listener would switch attention over time between different sounds. The model provides an acoustic summary, giving the soundscape designer a quick overview of the typical sounds at a particular location, and allows assessment of the perceptual effect of introducing additional sounds.

The perception of dynamic and static facial expressions of happiness and disgust investigated by ERPs and fMRI constrained source analysis

A recent functional magnetic resonance imaging (fMRI) study by our group demonstrated that dynamic emotional faces are more accurately recognized and evoked more widespread patterns of hemodynamic brain responses than static emotional faces. Based on this experimental design, the present study aimed at investigating the spatio-temporal processing of static and dynamic emotional facial expressions in 19 healthy women by means of multi-channel electroencephalography (EEG), event-related potentials (ERP) and fMRI-constrained regional source analyses. ERP analysis showed an increased amplitude of the LPP (late posterior positivity) over centro-parietal regions for static facial expressions of disgust compared to neutral faces. In addition, the LPP was more widespread and temporally prolonged for dynamic compared to static faces of disgust and happiness. fMRI constrained source analysis on static emotional face stimuli indicated the spatio-temporal modulation of predominantly posterior regional brain activation related to the visual processing stream for both emotional valences when compared to the neutral condition in the fusiform gyrus. The spatio-temporal processing of dynamic stimuli yielded enhanced source activity for emotional compared to neutral conditions in temporal (e.g., fusiform gyrus), and frontal regions (e.g., ventromedial prefrontal cortex, medial and inferior frontal cortex) in early and again in later time windows. The present data support the view that dynamic facial displays trigger more information reflected in complex neural networks, in particular because of their changing features potentially triggering sustained activation related to a continuing evaluation of those faces. A combined fMRI and EEG approach thus provides an advanced insight to the spatio-temporal characteristics of emotional face processing, by also revealing additional neural generators, not identifiable by the only use of an fMRI approach.

Mood modulates auditory laterality of hemodynamic mismatch responses during dichotic listening

Hemodynamic mismatch responses can be elicited by deviant stimuli in a sequence of standard stimuli even during cognitive demanding tasks. Emotional context is known to modulate lateralized processing. Right-hemispheric negative emotion processing may bias attention to the right and enhance processing of right-ear stimuli. The present study examined the influence of induced mood on lateralized pre-attentive auditory processing of dichotic stimuli using functional magnetic resonance imaging (fMRI). Faces expressing emotions (sad/happy/neutral) were presented in a blocked design while a dichotic oddball sequence with consonant-vowel (CV) syllables in an event-related design was simultaneously administered. Twenty healthy participants were instructed to feel the emotion perceived on the images and to ignore the syllables. Deviant sounds reliably activated bilateral auditory cortices and confirmed attention effects by modulation of visual activity. Sad mood induction activated visual, limbic and right prefrontal areas. A lateralization effect of emotion-attention interaction was reflected in a stronger response to right-ear deviants in the right auditory cortex during sad mood. This imbalance of resources may be a neurophysiological correlate of laterality in sad mood and depression. Conceivably, the compensatory right-hemispheric enhancement of resources elicits increased ipsilateral processing.

Phase re-setting of gamma neural oscillations during novelty processing in an appetitive context

Based on the previous study where phase-synchronization (PS) of gamma-band responses (GBRs) proved a reliable cerebral correlate of involuntary attention and its enhancement under threat, we measured gamma-PS elicited by novel sounds from human electroencephalogram (EEG) scalp-recordings when participants responded to visual stimuli displaying either highly motivational or neutral sceneries. We then tested the modulatory effect of the emotional conditions on auditory responses. Novel distractor sounds did not affect behavioural accuracy on subjects' visual task performance in neutral context but markedly decreased hit rate in the appetitive one. Similarly, gamma-PS to novel sounds remained intact in neutral context, whereas it showed an increase, within the 35-Hz sub-range, in the appetitive context. These results suggest that a context of processing positive emotional stimuli results into an enhanced processing of task-irrelevant novel auditory events, and, furthermore, that gamma-PS is tuned under conditions that could promote long-term survival.

Emotional perception: meta-analyses of face and natural scene processing

Functional imaging studies of emotional processing typically contain neutral control conditions that serve to remove simple effects of visual perception, thus revealing the additional emotional process. Here we seek to identify similarities and differences across 100 studies of emotional face processing and 57 studies of emotional scene processing, using a coordinate-based meta-analysis technique. The overlay of significant meta-analyses resulted in extensive overlap in clusters, coupled with offset and unique clusters of reliable activity. The area of greatest overlap is the amygdala, followed by regions of medial prefrontal cortex, inferior frontal/orbitofrontal cortex, inferior temporal cortex, and extrastriate occipital cortex. Emotional face-specific clusters were identified in regions known to be involved in face processing, including anterior fusiform gyrus and middle temporal gyrus, and emotional scene studies were uniquely associated with lateral occipital cortex, as well as pulvinar and the medial dorsal nucleus of the thalamus. One global result of the meta-analysis reveals that a class of visual stimuli (faces vs. scenes) has a considerable impact on the resulting emotion effects, even after removing the basic visual perception effects through subtractive contrasts. Pure effects of emotion may thus be difficult to remove for the particular class of stimuli employed in an experimental paradigm. Whether a researcher chooses to tightly control the various elements of the emotional stimuli, as with posed face photographs, or allow variety and environmental realism into their evocative stimuli, as with natural scenes, will depend on the desired generalizability of their results.