Spatial frequencies or emotional effects?

The Socio-Moral Image Database (SMID): A novel stimulus set for the study of social, moral and affective processes

A major obstacle for the design of rigorous, reproducible studies in moral psychology is the lack of suitable stimulus sets. Here, we present the Socio-Moral Image Database (SMID), the largest standardized moral stimulus set assembled to date, containing 2,941 freely available photographic images, representing a wide range of morally (and affectively) positive, negative and neutral content. The SMID was validated with over 820,525 individual judgments from 2,716 participants, with normative ratings currently available for all images on affective valence and arousal, moral wrongness, and relevance to each of the five moral values posited by Moral Foundations Theory. We present a thorough analysis of the SMID regarding (1) inter-rater consensus, (2) rating precision, and (3) breadth and variability of moral content. Additionally, we provide recommendations for use aimed at efficient study design and reproducibility, and outline planned extensions to the database. We anticipate that the SMID will serve as a useful resource for psychological, neuroscientific and computational (e.g., natural language processing or computer vision) investigations of social, moral and affective processes. The SMID images, along with associated normative data and additional resources are available at https://osf.io/2rqad/.

A cluster-based approach to selecting representative stimuli from the International Affective Picture System (IAPS) database

The International Affective Picture System (IAPS; Lang, Bradley, & Cuthbert, 2008) is a stimulus database that is frequently used to investigate various aspects of emotional processing. Despite its extensive use, selecting IAPS stimuli for a research project is not usually done according to an established strategy, but rather is tailored to individual studies. Here we propose a standard, replicable method for stimulus selection based on cluster analysis, which re-creates the group structure that is most likely to have produced the valence arousal, and dominance norms associated with the IAPS images. Our method includes screening the database for outliers, identifying a suitable clustering solution, and then extracting the desired number of stimuli on the basis of their level of certainty of belonging to the cluster they were assigned to. Our method preserves statistical power in studies by maximizing the likelihood that the stimuli belong to the cluster structure fitted to them, and by filtering stimuli according to their certainty of cluster membership. In addition, although our cluster-based method is illustrated using the IAPS, it can be extended to other stimulus databases.

Affective blindsight relies on low spatial frequencies

The human brain can process facial expressions of emotions rapidly and without awareness. Several studies in patients with damage to their primary visual cortices have shown that they may be able to guess the emotional expression on a face despite their cortical blindness. This non-conscious processing, called affective blindsight, may arise through an intact subcortical visual route that leads from the superior colliculus to the pulvinar, and thence to the amygdala. This pathway is thought to process the crude visual information conveyed by the low spatial frequencies of the stimuli. In order to investigate whether this is the case, we studied a patient (TN) with bilateral cortical blindness and affective blindsight. An fMRI paradigm was performed in which fearful and neutral expressions were presented using faces that were either unfiltered, or filtered to remove high or low spatial frequencies. Unfiltered fearful faces produced right amygdala activation although the patient was unaware of the presence of the stimuli. More importantly, the low spatial frequency components of fearful faces continued to produce right amygdala activity while the high spatial frequency components did not. Our findings thus confirm that the visual information present in the low spatial frequencies is sufficient to produce affective blindsight, further suggesting that its existence could rely on the subcortical colliculo-pulvino-amygdalar pathway.

Magnocellular Bias in Exogenous Attention to Biologically Salient Stimuli as Revealed by Manipulating Their Luminosity and Color

Exogenous attention is a set of mechanisms that allow us to detect and reorient toward salient events—such as appetitive or aversive—that appear out of the current focus of attention. The nature of these mechanisms, particularly the involvement of the parvocellular and magnocellular visual processing systems, was explored. Thirty-four participants performed a demanding digit categorization task while salient (spiders or S) and neutral (wheels or W) stimuli were presented as distractors under two figure–ground formats: heterochromatic/isoluminant (exclusively processed by the parvocellular system, Par trials) and isochromatic/heteroluminant (preferentially processed by the magnocellular system, Mag trials). This resulted in four conditions: SPar, SMag, WPar, and WMag. Behavioral (RTs and error rates in the task) and electrophysiological (ERPs) indices of exogenous attention were analyzed. Behavior showed greater attentional capture by SMag than by SPar distractors and enhanced modulation of SMag capture as fear of spiders reported by participants increased. ERPs reflected a sequence from magnocellular dominant (P1p, ≃120 msec) to both magnocellular and parvocellular processing (N2p and P2a, ≃200 msec). Importantly, amplitudes in one N2p subcomponent were greater to SMag than to SPar and WMag distractors, indicating greater magnocellular sensitivity to saliency. Taking together, results support a magnocellular bias in exogenous attention toward distractors of any nature during initial processing, a bias that remains in later stages when biologically salient distractors are present.

Emotion Processing by ERP Combined with Development and Plasticity

Emotions important for survival and social interaction have received wide and deep investigations. The application of the fMRI technique into emotion processing has obtained overwhelming achievements with respect to the localization of emotion processes. The ERP method, which possesses highly temporal resolution compared to fMRI, can be employed to investigate the time course of emotion processing. The emotional modulation of the ERP component has been verified across numerous researches. Emotions, described as dynamically developing along with the growing age, have the possibility to be enhanced through learning (or training) or to be damaged due to disturbances in growth, which is underlain by the neural plasticity of emotion-relevant nervous systems. And mood disorders with typical symptoms of emotion discordance probably have been caused by the dysfunctional neural plasticity.

Emotional Contexts Exert a Distracting Effect on Attention and Inhibitory Control in Female and Male Adolescents

Adolescents exhibit difficulties in behavioral regulation that become more evident when emotional contexts are involved, since these may hinder the development of socially-adaptive behaviors. The objectives of the present study were: to examine the influence of emotional contexts on adolescents’ ability to inhibit a prepotent response, evaluated by ERPs, and to determine whether sex differences in response inhibition are observed in adolescents in those contexts. Participants performed a prepotent response inhibition task (Go-NoGo) under 3 background context conditions: neutral, pleasant, and unpleasant. While no differences in accuracy were observed, the presence of emotional contexts did prolong reaction times compared to the neutral context. Also, the unpleasant context caused an enhancement of N2 amplitudes compared to the neutral and pleasant contexts. Also, N2 and P3 latencies were longer in emotional contexts than in the neutral condition during both correct responses and correct inhibitions. No sex differences were found in amplitude, but females showed longer N2 and P3 latencies than males. These results confirm the idea that, in adolescents, unpleasant pictures receive preferential attention over neutral images and so generate greater difficulty in response inhibition. Finally, results demonstrate that sex differences in inhibition control in adolescence were observed only in relation to time-processing.

Vocal emotion decoding in the subthalamic nucleus: An intracranial ERP study in Parkinson's disease

Using intracranial local field potential (LFP) recordings in patients with Parkinson's disease (PD) undergoing deep brain stimulation (DBS), we explored the electrophysiological activity of the subthalamic nucleus (STN) in response to emotional stimuli in the auditory modality. Previous studies focused on the influence of visual stimuli. To this end, we recorded LFPs within the STN in response to angry, happy, and neutral prosodies in 13 patients with PD who had just undergone implantation of DBS electrodes. We observed specific modulation of the right STN in response to anger and happiness, as opposed to neutral prosody, occurring at around 200-300ms post-onset, and later at around 850-950ms post-onset for anger and at around 3250-3350ms post-onset for happiness. Taken together with previous reports of modulated STN activity in response to emotional visual stimuli, the present results appear to confirm that the STN is involved in emotion processing irrespective of stimulus valence and sensory modality.

Motivated attention and family risk for depression: Neuronal generator patterns at scalp elicited by lateralized aversive pictures reveal blunted emotional responsivity

Behavioral and electrophysiologic evidence suggests that major depression (MDD) involves right parietotemporal dysfunction, a region activated by arousing affective stimuli. Building on prior event-related potential (ERP) findings (Kayser et al. 2016 NeuroImage 142:337–350), this study examined whether these abnormalities also characterize individuals at clinical high risk for MDD. We systematically explored the impact of family risk status and personal history of depression and anxiety on three distinct stages of emotional processing comprising the late positive potential (LPP). ERPs (72 channels) were recorded from 74 high and 53 low risk individuals (age 13–59 years, 58 male) during a visual half-field paradigm using highly-controlled pictures of cosmetic surgery patients showing disordered (negative) or healed (neutral) facial areas before or after treatment. Reference-free current source density (CSD) transformations of ERP waveforms were quantified by temporal principal components analysis (tPCA). Component scores of prominent CSD-tPCA factors sensitive to emotional content were analyzed via permutation tests and repeated measures ANOVA for mixed factorial designs with unstructured covariance matrix, including gender, age and clinical covariates. Factor-based distributed inverse solutions provided descriptive estimates of emotional brain activations at group level corresponding to hierarchical activations along ventral visual processing stream. Risk status affected emotional responsivity (increased positivity to negative-than-neutral stimuli) overlapping early N2 sink (peak latency 212 ms), P3 source (385 ms), and a late centroparietal source (630 ms). High risk individuals had reduced right-greater-than-left emotional lateralization involving occipitotemporal cortex (N2 sink) and bilaterally reduced emotional effects involving posterior cingulate (P3 source) and inferior temporal cortex (630 ms) when compared to those at low risk. While the early emotional effects were enhanced for left hemifield (right hemisphere) presentations, hemifield modulations did not differ between risk groups, suggesting top-down rather than bottom-up effects of risk. Groups did not differ in their stimulus valence or arousal ratings. Similar effects were seen for individuals with a lifetime history of depression or anxiety disorder in comparison to those without. However, there was no evidence that risk status and history of MDD or anxiety disorder interacted in their impact on emotional responsivity, suggesting largely independent attenuation of attentional resource allocation to enhance perceptual processing of motivationally salient stimuli. These findings further suggest that a deficit in motivated attention preceding conscious awareness may be a marker of risk for depression.

•

Emotional hemifield ERP task with 127 individuals at high and low family risk for MDD

•

CSD-PCA methods summarized affective modulation of late positive potential (LPP).

•

High risk and prior diagnosis of MDD or anxiety disorder independently reduced LPP.

•

Suggested hypoarousal (top-down) of right temporoparietal and other emotional regions

•

Left hemifield (bottom-up) modulations of early emotional asymmetries were preserved.

An Explanation for the Role of the Amygdala in Aesthetic Judgments

It has been proposed that the top-down guidance of feature-based attention is the basis for the involvement of the amygdala in various tasks requiring emotional decision-making (Jacobs et al., 2012a). Aesthetic judgments are correlated with particular visual features and can be considered emotional in nature (Jacobs et al., 2016). Moreover, we have previously shown that various aesthetic judgments result in observers preferentially attending to different visual features (Jacobs et al., 2010). Here, we argue that—together—this explains why the amygdalae become active during aesthetic judgments of visual materials. We discuss potential implications and predictions of this theory that can be tested experimentally.

Competition for attentional resources between low spatial frequency content of emotional images and a foreground task in early visual cortex

Low spatial frequency (LSF) image content has been proposed to play a superior functional role in emotional content extraction via the magnocellular pathway biasing attentional resources toward emotional content in visual cortex. We investigated whether emotionally unpleasant complex images that were presented either unfiltered or with LSF content only in the background while subjects performed a foreground task will withdraw more attentional resources from the task compared to unemotional, neutral images (distraction paradigm). We measured steady-state visual evoked potentials (SSVEPs) driven by flickering stimuli of a foreground task. Unfiltered unpleasant images resulted in a significant reduction of SSVEP amplitude compared to neutral images. No statistically significant differences were found with LSF background images. In a behavioral control experiment, we found no significant differences for complexity ratings between unfiltered and LSF pictures. Content identification was possible for unfiltered and LSF picture (correct responses > 74%). An additional EEG study examined typical emotion-related components for complex images presented either as unfiltered, LSF, or high spatial frequency (HSF, as an additional control) filtered, unpleasant, and neutral images. We found a significant main effect of emotional valence in the early posterior negativity. Late positive potential differences were only found for unfiltered and HSF images. Results suggest that, while LSF content is sufficient to allow for content and emotional cue extraction when images were presented alone, LSF content is not salient enough to serve as emotional distractor that withdraws attentional resources from a foreground task in early visual cortex.

Perceived time slows during fleeting fun or fear

Previous psychophysical studies at durations greater than 1000 ms have confirmed the anecdotal reports of an increase in the perceived duration of both positively and negatively valenced emotive stimuli; however, the results of studies at durations less than 1000 ms have been inconsistent. This study further investigated the effect of valence on the perception of durations less than 1000 ms. We used both positively and negatively valenced stimuli in order to compare their effects on the distortion of duration, and we tested multiple data points within the sub-one-second range. We found an increase in the perceived duration of both positively and negatively valenced emotional stimuli at all data points. This is consistent with studies at durations longer than 1000 ms and also with models of temporal processing. We also confirmed that Weber fractions, within the range tested, followed the generalized form of Weber's law.

Early Left Parietal Activity Elicited by Direct Gaze: A High-Density EEG Study

Gaze is one of the most important cues for human communication and social interaction. In particular, gaze contact is the most primary form of social contact and it is thought to capture attention. A very early-differentiated brain response to direct versus averted gaze has been hypothesized. Here, we used high-density electroencephalography to test this hypothesis. Topographical analysis allowed us to uncover a very early topographic modulation (40-80 ms) of event-related responses to faces with direct as compared to averted gaze. This modulation was obtained only in the condition where intact broadband faces-as opposed to high-pass or low-pas filtered faces-were presented. Source estimation indicated that this early modulation involved the posterior parietal region, encompassing the left precuneus and inferior parietal lobule. This supports the idea that it reflected an early orienting response to direct versus averted gaze. Accordingly, in a follow-up behavioural experiment, we found faster response times to the direct gaze than to the averted gaze broadband faces. In addition, classical evoked potential analysis showed that the N170 peak amplitude was larger for averted gaze than for direct gaze. Taken together, these results suggest that direct gaze may be detected at a very early processing stage, involving a parallel route to the ventral occipito-temporal route of face perceptual analysis.

The modulation of delta responses in the interaction of brightness and emotion

The modulation of delta oscillations (0.5-3.5Hz) by emotional stimuli is reported. Physical attributes such as color, brightness and spatial frequency of emotional visual stimuli have crucial effect on the perception of complex scene. Brightness is intimately related with emotional valence. Here we explored the effect of brightness on delta oscillatory responses upon presentation of pleasant, unpleasant and neutral pictures. We found that bright unpleasant pictures elicited lower amplitude of delta response than original unpleasant pictures. The electrophysiological finding of the study was in accordance with behavioral data. These results denoted the importance of delta responses on the examination of the association between perceptual and conceptual processes while in the question of brightness and emotion.

How emotion context modulates unconscious goal activation during motor force exertion

Priming participants with emotional or action-related concepts influences goal formation and motor force output during effort exertion tasks, even without awareness of priming information. However, little is known about neural processes underpinning how emotional cues interact with action (or inaction) goals to motivate (or demotivate) motor behaviour. In a novel functional neuroimaging paradigm, visible emotional images followed by subliminal action or inaction word primes were presented before participants performed a maximal force exertion. In neutral emotional contexts, maximum force was lower following inaction than action primes. However, arousing emotional images had interactive motivational effects on the motor system: Unpleasant images prior to inaction primes increased force output (enhanced effort exertion) relative to control primes, and engaged a motivation-related network involving ventral striatum, extended amygdala, as well as right inferior frontal cortex. Conversely, pleasant images presented before action (versus control) primes decreased force and activated regions of the default-mode network, including inferior parietal lobule and medial prefrontal cortex. These findings show that emotional context can determine how unconscious goal representations influence motivational processes and are transformed into actual motor output, without direct rewarding contingencies. Furthermore, they provide insight into altered motor behaviour in psychopathological disorders with dysfunctional motivational processes.

Emotion effects within frontal alpha oscillation in a picture oddball paradigm

In the current study we measured frontal alpha band oscillation in an oddball paradigm with emotional pictures as target stimuli. Within these emotional target pictures we varied valence and arousal separately. Irrespective of this emotional connotation, participants were asked to respond to the occurrence of any picture that deviates from the standard picture (a checkerboard). All stimuli were presented briefly and target stimuli were easily distinguishable from the standard stimulus based on mere perceptive features. Thus, the procedure reduces the probability that participants intentionally process or evaluate the emotional content of the pictures. With these incidental procedural conditions we yet observed a relative shift of alpha power to the right frontal site with increasing pleasantness of the pictures. Furthermore, frontal alpha band oscillation decreased with increasing picture arousal. These patterns were also evident when we controlled for valence and arousal of the pictures at the individual level. The results suggest that changes in frontal alpha band oscillation reflect reliable emotion correlates of incidental picture processing in the oddball paradigm.

Aesthetics by Numbers: Links between Perceived Texture Qualities and Computed Visual Texture Properties

Our world is filled with texture. For the human visual system, this is an important source of information for assessing environmental and material properties. Indeed-and presumably for this reason-the human visual system has regions dedicated to processing textures. Despite their abundance and apparent relevance, only recently the relationships between texture features and high-level judgments have captured the interest of mainstream science, despite long-standing indications for such relationships. In this study, we explore such relationships, as these might be used to predict perceived texture qualities. This is relevant, not only from a psychological/neuroscience perspective, but also for more applied fields such as design, architecture, and the visual arts. In two separate experiments, observers judged various qualities of visual textures such as beauty, roughness, naturalness, elegance, and complexity. Based on factor analysis, we find that in both experiments, ~75% of the variability in the judgments could be explained by a two-dimensional space, with axes that are closely aligned to the beauty and roughness judgments. That a two-dimensional judgment space suffices to capture most of the variability in the perceived texture qualities suggests that observers use a relatively limited set of internal scales on which to base various judgments, including aesthetic ones. Finally, for both of these judgments, we determined the relationship with a large number of texture features computed for each of the texture stimuli. We find that the presence of lower spatial frequencies, oblique orientations, higher intensity variation, higher saturation, and redness correlates with higher beauty ratings. Features that captured image intensity and uniformity correlated with roughness ratings. Therefore, a number of computational texture features are predictive of these judgments. This suggests that perceived texture qualities-including the aesthetic appreciation-are sufficiently universal to be predicted-with reasonable accuracy-based on the computed feature content of the textures.

Disturbances in Response Inhibition and Emotional Processing as Potential Pathways to Violence in Schizophrenia: A High-Density Event-Related Potential Study

OBJECTIVE

Increased susceptibility to emotional triggers and poor response inhibition are important in the etiology of violence in schizophrenia. Our goal was to evaluate abnormalities in neurophysiological mechanisms underlying response inhibition and emotional processing in violent patients with schizophrenia (VS) and 3 different comparison groups: nonviolent patients (NV), healthy controls (HC) and nonpsychotic violent subjects (NPV).

METHODS

We recorded high-density Event-Related Potentials (ERPs) and behavioral responses during an Emotional Go/NoGo Task in 35 VS, 24 NV, 28 HC and 31 NPV subjects. We also evaluated psychiatric symptoms and impulsivity.

RESULTS

The neural and behavioral deficits in violent patients were most pronounced when they were presented with negative emotional stimuli: They responded more quickly than NV when they made commission errors (ie, failure of inhibition), and evidenced N2 increases and P3 decreases. In contrast, NVs showed little change in reaction time or ERP amplitude with emotional stimuli. These N2 and P3 amplitude changes in VSs showed a strong association with greater impulsivity. Besides these group specific changes, VSs shared deficits with NV, mostly N2 reduction, and with violent nonpsychotic subjects, particularly P3 reduction.

CONCLUSION

Negative affective triggers have a strong impact on violent patients with schizophrenia which may have both behavioral and neural manifestations. The resulting activation could interfere with response inhibition. The affective disruption of response inhibition, identified in this study, may index an important pathway to violence in schizophrenia and suggest new modes of treatment.

Opposing effects of perceptual versus working memory load on emotional distraction

Throughout our day-to-day activities, we are subjected to numerous stimuli that compete for our attention; consequently, we must prioritize stimuli for further processing and influence over behaviour. Previous research has demonstrated that the extent to which task-irrelevant distractors are processed is mediated by the nature of the cognitive task, and the level of processing load. Importantly though, the interaction between cognitive task, processing load, and emotional distractor processing remains unclear. This is a particularly important question given the unique ways that emotion interacts with attention, and the fact that some other forms of processing load have been shown to reduce emotional distractor encoding. In the present study, participants were presented with emotional distractors during a perceptual and working memory task, under varying levels of load. In Experiment 1, we showed that the impact of emotional distractors on behaviour was reduced under conditions of high relative to low perceptual load. However, in sharp contrast, high working memory load was associated with increased emotional distraction. Importantly, these results were replicated in Experiment 2. Overall, the impact of processing load on emotional distraction varies according to the cognitive function being performed. These results raise the intriguing possibility that working memory operations deplete some of the cognitive resources needed to control the impact of emotion on behaviour. The findings, therefore, may have important implications for clinical populations featuring cognitive dysfunction and emotional dysregulation.

Attachment Representation Moderates the Influence of Emotional Context on Information Processing

The induction of emotional states has repeatedly been shown to affect cognitive processing capacities. At a neurophysiological level, P3 amplitude responses that are associated with attention allocation have been found to be reduced to task-relevant stimuli during emotional conditions as compared to neutral conditions suggesting a draining impact of emotion on cognitive resources. Attachment theory claims that how individuals regulate their emotions is guided by an internal working model (IWM) of attachment that has formed early in life. While securely attached individuals are capable of freely evaluating their emotions insecurely attached ones tend to either suppress or heighten the emotional experience in a regulatory effort. To explore how attachment quality moderates the impact of emotional contexts on information processing event-related potentials (ERPs) in 41 individuals were assessed. Subjects were instructed to detect neutral target letters within an oddball paradigm. Various images taken from the International Affective Picture System (IAPS) served as background pictures and represented negative, positive and neutral task-irrelevant contexts. Attachment representation was assessed using the Adult Attachment Interview (AAI) and individuals were assigned to one of three categories (secure, insecure-dismissing, insecure-preoccupied). At a behavioral level, the study revealed that negative emotionally conditions were associated with the detection of less target stimuli in insecure-dismissing subjects. Accordingly, ERPs yielded reduced P3 amplitudes in insecure-dismissing subjects when given a negative emotional context. We interpret these findings in terms of less sufficient emotion regulation strategies in insecure-dismissing subjects at the cost of accurate behavioral performance. The study suggests that attachment representation differentially moderates the relationship between emotional contexts and information processing most evident in insecure-dismissing subjects.

Neuronal generator patterns at scalp elicited by lateralized aversive pictures reveal consecutive stages of motivated attention

Event-related potential (ERP) studies have provided evidence for an allocation of attentional resources to enhance perceptual processing of motivationally salient stimuli. Emotional modulation affects several consecutive components associated with stages of affective-cognitive processing, beginning as early as 100-200ms after stimulus onset. In agreement with the notion that the right parietotemporal region is critically involved during the perception of arousing affective stimuli, some ERP studies have reported asymmetric emotional ERP effects. However, it is difficult to separate emotional from non-emotional effects because differences in stimulus content unrelated to affective salience or task demands may also be associated with lateralized function or promote cognitive processing. Other concerns pertain to the operational definition and statistical independence of ERP component measures, their dependence on an EEG reference, and spatial smearing due to volume conduction, all of which impede the identification of distinct scalp activation patterns associated with affective processing. Building on prior research using a visual half-field paradigm with highly controlled emotional stimuli (pictures of cosmetic surgery patients showing disordered [negative] or healed [neutral] facial areas before or after treatment), 72-channel ERPs recorded from 152 individuals (ages 13-68years; 81 female) were transformed into reference-free current source density (CSD) waveforms and submitted to temporal principal components analysis (PCA) to identify their underlying neuronal generator patterns. Using both nonparametric randomization tests and repeated measures ANOVA, robust effects of emotional content were found over parietooccipital regions for CSD factors corresponding to N2 sink (212ms peak latency), P3 source (385ms) and a late centroparietal source (630ms), all indicative of greater positivity for negative than neutral stimuli. For the N2 sink, emotional effects were right-lateralized and modulated by hemifield, with larger amplitude and asymmetry for left hemifield (right hemisphere) presentations. For all three factors, more positive amplitudes at parietooccipital sites were associated with increased ratings of negative valence and greater arousal. Distributed inverse solutions of the CSD-PCA-based emotional effects implicated a sequence of maximal activations in right occipitotemporal cortex, bilateral posterior cingulate cortex, and bilateral inferior temporal cortex. These findings are consistent with hierarchical activations of the ventral visual pathway reflecting subsequent processing stages in response to motivationally salient stimuli.

Mechanisms of mindfulness: The dynamics of affective adaptation during open monitoring

Mindfulness - the nonjudgmental awareness of the present experience - is thought to facilitate affective adaptation through increased exposure to emotions and faster extinction of habitual responses. To test this framework, the amplification of the Late Positive Potential (LPP) by negative relative to neutral images was analyzed across stimulus repetitions while 37 novices performed an open monitoring mindfulness exercise. Compared to two active control conditions where attention was either diverted to a distracting task or the stimuli were attended without mindfulness instructions, open monitoring enhanced the initial LPP response to negative stimuli, indicating increased emotional exposure. Across successive repetitions, mindfulness reduced and ultimately removed the affective LPP amplification, suggesting extinction of habitual emotional reactions. This effect arose from reduced negative as well enlarged neutral LPPs. Unlike stimuli from control conditions, the images previously viewed with mindfulness instructions did not elicit affective LPP amplification during subsequent re-exposure, suggesting reconsolidation of stimulus meaning.

What's the meaning of this? A behavioral and neurophysiological investigation into the principles behind the classification of visual emotional stimuli

Two experiments were performed to investigate the principles by which emotional stimuli are classified on the dimensions of valence and arousal. In Experiment 1, a large sample of healthy participants rated emotional stimuli according to both broad dimensions. Hierarchical cluster analyses performed on these ratings revealed that stimuli were clustered according to their semantic content at the beginning of the agglomerative process. Example semantic themes include food, violence, nudes, death, and objects. Importantly, this pattern occurred in a parallel fashion for ratings on both dimensions. In Experiment 2, we investigated if the same semantic clusters were differentiated at the neurophysiological level. Intracerebral EEG was recorded from 18 patients with intractable epilepsy who viewed the same set of stimuli. Not only did electrocortical responses differentiate between these data-defined semantic clusters, they converged with the behavioral measurements to highlight the importance of categories associated with survival and reproduction. These findings provide strong evidence that the semantic content of affective material influences their classification along the broad dimensions of valence and arousal, and this principle of categorization exerts an effect on the evoked emotional response. Future studies should consider data-driven techniques rather than normative ratings to identify more specific, semantically related emotional images.

Involvement of Sensory Regions in Affective Experience: A Meta-Analysis

A growing body of work suggests that sensory processes may also contribute to affective experience. In this study, we performed a meta-analysis of affective experiences driven through visual, auditory, olfactory, gustatory, and somatosensory stimulus modalities including study contrasts that compared affective stimuli to matched neutral control stimuli. We found, first, that limbic and paralimbic regions, including the amygdala, anterior insula, pre-supplementary motor area, and portions of orbitofrontal cortex were consistently engaged across two or more modalities. Second, early sensory input regions in occipital, temporal, piriform, mid-insular, and primary sensory cortex were frequently engaged during affective experiences driven by visual, auditory, olfactory, gustatory, and somatosensory inputs. A classification analysis demonstrated that the pattern of neural activity across a contrast map diagnosed the stimulus modality driving the affective experience. These findings suggest that affective experiences are constructed from activity that is distributed across limbic and paralimbic brain regions and also activity in sensory cortical regions.

Emotional facial expressions evoke faster orienting responses, but weaker emotional responses at neural and behavioural levels compared to scenes: A simultaneous EEG and facial EMG study

In the current study, electroencephalography (EEG) was recorded simultaneously with facial electromyography (fEMG) to determine whether emotional faces and emotional scenes are processed differently at the neural level. In addition, it was investigated whether these differences can be observed at the behavioural level via spontaneous facial muscle activity. Emotional content of the stimuli did not affect early P1 activity. Emotional faces elicited enhanced amplitudes of the face-sensitive N170 component, while its counterpart, the scene-related N100, was not sensitive to emotional content of scenes. At 220-280ms, the early posterior negativity (EPN) was enhanced only slightly for fearful as compared to neutral or happy faces. However, its amplitudes were significantly enhanced during processing of scenes with positive content, particularly over the right hemisphere. Scenes of positive content also elicited enhanced spontaneous zygomatic activity from 500-750ms onwards, while happy faces elicited no such changes. Contrastingly, both fearful faces and negative scenes elicited enhanced spontaneous corrugator activity at 500-750ms after stimulus onset. However, relative to baseline EMG changes occurred earlier for faces (250ms) than for scenes (500ms) whereas for scenes activity changes were more pronounced over the whole viewing period. Taking into account all effects, the data suggests that emotional facial expressions evoke faster attentional orienting, but weaker affective neural activity and emotional behavioural responses compared to emotional scenes.

Parallel processing of general and specific threat during early stages of perception

Differential processing of threat can consummate as early as 100 ms post-stimulus. Moreover, early perception not only differentiates threat from non-threat stimuli but also distinguishes among discrete threat subtypes (e.g. fear, disgust and anger). Combining spatial-frequency-filtered images of fear, disgust and neutral scenes with high-density event-related potentials and intracranial source estimation, we investigated the neural underpinnings of general and specific threat processing in early stages of perception. Conveyed in low spatial frequencies, fear and disgust images evoked convergent visual responses with similarly enhanced N1 potentials and dorsal visual (middle temporal gyrus) cortical activity (relative to neutral cues; peaking at 156 ms). Nevertheless, conveyed in high spatial frequencies, fear and disgust elicited divergent visual responses, with fear enhancing and disgust suppressing P1 potentials and ventral visual (occipital fusiform) cortical activity (peaking at 121 ms). Therefore, general and specific threat processing operates in parallel in early perception, with the ventral visual pathway engaged in specific processing of discrete threats and the dorsal visual pathway in general threat processing. Furthermore, selectively tuned to distinctive spatial-frequency channels and visual pathways, these parallel processes underpin dimensional and categorical threat characterization, promoting efficient threat response. These findings thus lend support to hybrid models of emotion.

Interpretative bias in spider phobia: Perception and information processing of ambiguous schematic stimuli

This study investigates the interpretative bias in spider phobia with respect to rapid visuomotor processing. We compared perception, evaluation, and visuomotor processing of ambiguous schematic stimuli between spider-fearful and control participants. Stimuli were produced by gradually morphing schematic flowers into spiders. Participants rated these stimuli related to their perceptual appearance and to their feelings of valence, disgust, and arousal. Also, they responded to the same stimuli within a response priming paradigm that measures rapid motor activation. Spider-fearful individuals showed an interpretative bias (i.e., ambiguous stimuli were perceived as more similar to spiders) and rated spider-like stimuli as more unpleasant, disgusting, and arousing. However, we observed no differences between spider-fearful and control participants in priming effects for ambiguous stimuli. For non-ambiguous stimuli, we observed a similar enhancement for phobic pictures as has been reported previously for natural images. We discuss our findings with respect to the visual representation of morphed stimuli and to perceptual learning processes.

Event-related potential signatures of perceived and imagined emotional and food real-life photos

Although food and affective pictures share similar emotional and motivational characteristics, the relationship between the neuronal responses to these stimuli is unclear. Particularly, it is not known whether perceiving and imagining food and affective stimuli elicit similar event-related potential (ERP) patterns. In this study, two ERP correlates, the early posterior negativity (EPN) and the late positive potential (LPP) for perceived and imagined emotional and food photographs were investigated. Thirteen healthy volunteers were exposed to a set of food photos, as well as unpleasant, pleasant, and neutral photos from the International Affective Picture System. In each trial, participants were first asked to view a photo (perception condition), and then to create a visual mental image of it and to rate its vividness (imagery condition). The results showed that during perception, brain regions corresponding to sensorimotor and parietal motivational (defensive and appetitive) systems were activated to different extents, producing a graded pattern of EPN and LPP responses specific to the photo content - more prominent for unpleasant than pleasant and food content. Also, an EPN signature occurred in both conditions for unpleasant content, suggesting that, compared to food or pleasant content, unpleasant content may be attended to more intensely during perception and may be represented more distinctly during imagery. Finally, compared to LLP activation during perception, as well as imagery and perception of all other content, LPP activation was significantly reduced during imagery of unpleasant photos, suggesting inhibition of unwanted memories. Results are framed within a neurocognitive working model of embodied emotions.

The color red attracts attention in an emotional context. An ERP study

The color red is known to influence psychological functioning, having both negative (e.g., blood, fire, danger), and positive (e.g., sex, food) connotations. The aim of our study was to assess the attentional capture by red-colored images, and to explore the modulatory role of the emotional valence in this process, as postulated by Elliot and Maier (2012) color-in-context theory. Participants completed a dot-probe task with each cue comprising two images of equal valence and arousal, one containing a prominent red object and the other an object of different coloration. Reaction times were measured, as well as the event-related lateralizations of the EEG. Modulation of the lateralized components revealed that the color red captured and later held the attention in both positive and negative conditions, but not in a neutral condition. An overt motor response to the target stimulus was affected mainly by attention lingering over the visual field where the red cue had been flashed. However, a weak influence of the valence could still be detected in reaction times. Therefore, red seems to guide attention, specifically in emotionally-valenced circumstances, indicating that an emotional context can alter color’s impact both on attention and motor behavior.

The influence of image valence on visual attention and perception of risk in drivers

Currently there is little research into the relationship between emotion and driving in the context of advertising and distraction. Research that has looked into this also has methodological limitations that could be affecting the results rather than emotional processing (Trick et al., 2012). The current study investigated the relationship between image valence and risk perception, eye movements and physiological reactions. Participants watched hazard perception clips which had emotional images from the international affective picture system overlaid onto them. They rated how hazardous or safe they felt, whilst eye movements, galvanic skin response and heart rate were recorded. Results suggested that participants were more aware of potential hazards when a neutral image had been shown, in comparison to positive and negative valenced images; that is, participants showed higher subjective ratings of risk, larger physiological responses and marginally longer fixation durations when viewing a hazard after a neutral image, but this effect was attenuated after emotional images. It appears that emotional images reduce sensitivity to potential hazards, and we suggest that future studies could apply these findings to higher fidelity paradigms such as driving simulators.

Biases in facial and vocal emotion recognition in chronic schizophrenia

There has been extensive research on impaired emotion recognition in schizophrenia in the facial and vocal modalities. The literature points to biases toward non-relevant emotions for emotional faces but few studies have examined biases in emotional recognition across different modalities (facial and vocal). In order to test emotion recognition biases, we exposed 23 patients with stabilized chronic schizophrenia and 23 healthy controls (HCs) to emotional facial and vocal tasks asking them to rate emotional intensity on visual analog scales. We showed that patients with schizophrenia provided higher intensity ratings on the non-target scales (e.g., surprise scale for fear stimuli) than HCs for the both tasks. Furthermore, with the exception of neutral vocal stimuli, they provided the same intensity ratings on the target scales as the HCs. These findings suggest that patients with chronic schizophrenia have emotional biases when judging emotional stimuli in the visual and vocal modalities. These biases may stem from a basic sensorial deficit, a high-order cognitive dysfunction, or both. The respective roles of prefrontal-subcortical circuitry and the basal ganglia are discussed.

Food-pics: an image database for experimental research on eating and appetite

Our current environment is characterized by the omnipresence of food cues. The sight and smell of real foods, but also graphically depictions of appetizing foods, can guide our eating behavior, for example, by eliciting food craving and influencing food choice. The relevance of visual food cues on human information processing has been demonstrated by a growing body of studies employing food images across the disciplines of psychology, medicine, and neuroscience. However, currently used food image sets vary considerably across laboratories and image characteristics (contrast, brightness, etc.) and food composition (calories, macronutrients, etc.) are often unspecified. These factors might have contributed to some of the inconsistencies of this research. To remedy this, we developed food-pics, a picture database comprising 568 food images and 315 non-food images along with detailed meta-data. A total of N = 1988 individuals with large variance in age and weight from German speaking countries and North America provided normative ratings of valence, arousal, palatability, desire to eat, recognizability and visual complexity. Furthermore, data on macronutrients (g), energy density (kcal), and physical image characteristics (color composition, contrast, brightness, size, complexity) are provided. The food-pics image database is freely available under the creative commons license with the hope that the set will facilitate standardization and comparability across studies and advance experimental research on the determinants of eating behavior.

How arousal modulates the visual contrast sensitivity function

Recent evidence indicates that emotion enhances contrast thresholds in subsequent visual perception (Phelps, Ling, & Carrasco, 2006) and perceptual sensitivity for low-spatial frequency but not high-spatial frequency targets (Bocanegra & Zeelenberg, 2009b). However, these studies just report responses to various frequencies at a fixed contrast level or responses to various contrasts at a fixed frequency. In the current study, we measured the full contrast sensitivity function as a function of emotional arousal in order to investigate potential interactions between spatial frequency and contrast. We used a Bayesian adaptive inference with a trial-to-trial information gain strategy (Lesmes, Lu, Baek, & Albright, 2010) and a fear-conditioned stimulus to manipulate arousal level. The spatial frequency at which people showed peak contrast sensitivity shifted to lower spatial frequencies in the arousing condition compared with the nonarousing condition and people had greater contrast sensitivity function bandwidth in the arousing than in the nonarousing condition.

Posterior P1 and early frontal negativity reflect developmental changes in attentional distraction during adolescence

Previous studies in adults have revealed that attentional distraction modulates the late positive potential (LPP) during emotion regulation. To determine whether early visual components reflect developmental changes in attentional distraction during adolescence, we collected event-related potentials from 20 young adolescents, 18 older adolescents, and 18 young adults as they performed a distraction task (counting) while viewing affective images. Consistent with previous findings obtained in distraction studies, the distraction task (counting) reduced emotional modulation of the LPP. At an early stage of processing, counting reduced emotional modulation of P1 and increased the negativity bias of early frontal negativity (eFN) for negatively valenced pictures compared to simple viewing with no distraction. sLORETA analyses further revealed eFN indexing of rostral prefrontal cortical activation, a cortical area that has been shown in recent fMRI studies to be activated by distraction. Moreover, P1 amplitudes in young and older adolescents did not differ but were both larger than the P1s in young adults. In addition, eFN amplitudes significantly decreased with age. The dissociable distraction patterns between the posterior P1 and eFN provide evidence not only for the timing hypothesis of emotion regulation but also for different developmental trajectories of visual processing areas and the prefrontal cortex during affective processing in adolescence.

Oscillatory subthalamic nucleus activity is modulated by dopamine during emotional processing in Parkinson's disease

Dopaminergic denervation in Parkinson's disease (PD) leads to motor deficits but also depression, lack of motivation and apathy. These symptoms can be reversed by dopaminergic treatment, which may even lead to an increased hedonic tone in some patients with PD. Here, we tested the effects of dopamine on emotional processing as indexed by changes in local field potential (LFP) activity of the subthalamic nucleus (STN) in 28 PD patients undergoing deep brain stimulation. LFP activity from the STN was recorded after the administration of levodopa (ON group) or after overnight withdrawal of medication (OFF group) during presentation of an emotional picture-viewing task. Neutral and emotionally arousing pleasant and unpleasant stimuli were chosen from the International Affective Picture System. We found a double dissociation of the alpha band response depending on dopamine state and stimulus valence: dopamine enhanced the processing of pleasant stimuli, while activation during unpleasant stimuli was reduced, as indexed by the degree of desynchronization in the alpha frequency band. This pattern was reversed in the OFF state and more pronounced in the subgroup of non-depressed PD patients. Further, we found an early gamma band increase with unpleasant stimuli that occurred when ON but not OFF medication and was correlated with stimulus arousal. The late STN alpha band decrease is thought to represent active processing of sensory information. Our findings support the idea that dopamine enhances approach-related processes during late stimulus evaluation in PD. The early gamma band response may represent local encoding of increased attention, which varies as a function of stimulus arousal.

A new standardized stimulus set for studying need-of-help recognition (NeoHelp)

This article presents the NeoHelp visual stimulus set created to facilitate investigation of need-of-help recognition with clinical and normative populations of different ages, including children. Need-of-help recognition is one aspect of socioemotional development and a necessary precondition for active helping. The NeoHelp consists of picture pairs showing everyday situations: The first item in a pair depicts a child needing help to achieve a goal; the second one shows the child achieving the goal. Pictures of birds in analogue situations are also included. These control stimuli enable implementation of a human-animal categorization task which serves to separate behavioral correlates specific to need-of-help recognition from general differentiation processes. It is a concern in experimental research to ensure that results do not relate to systematic perceptual differences when comparing responses to categories of different content. Therefore, we not only derived the NeoHelp-pictures within a pair from one another by altering as little as possible, but also assessed their perceptual similarity empirically. We show that NeoHelp-picture pairs are very similar regarding low-level perceptual properties across content categories. We obtained data from 60 children in a broad age range (4 to 13 years) for three different paradigms, in order to assess whether the intended categorization and differentiation could be observed reliably in a normative population. Our results demonstrate that children can differentiate the pictures' content regarding both need-of-help category as well as species as intended in spite of the high perceptual similarities. We provide standard response characteristics (hit rates and response times) that are useful for future selection of stimuli and comparison of results across studies. We show that task requirements coherently determine which aspects of the pictures influence response characteristics. Thus, we present NeoHelp, the first open-access standardized visual stimuli set for investigation of need-of-help recognition and invite researchers to use and extend it.

Unintentionality of affective attention across visual processing stages

Affective attention involves bottom-up perceptual selection that prioritizes motivationally significant stimuli. To clarify the extent to which this process is automatic, we investigated the dependence of affective attention on the intention to process emotional meaning. Affective attention was manipulated by presenting affective images with variable arousal and intentionality by requiring participants to make affective and non-affective evaluations. Polytomous rather than binary decisions were required from the participants in order to elicit relatively deep emotional processing. The temporal dynamics of prioritized processing were assessed using early posterior negativity (EPN, 175–300 ms) as well as P3-like (P3, 300–500 ms) and slow wave (SW, 500–1500 ms) portions of the late positive potential. All analyzed components were differentially sensitive to stimulus categories suggesting that they indeed reflect distinct stages of motivational significance encoding. The intention to perceive emotional meaning had no effect on EPN, an additive effect on P3, and an interactive effect on SW. We concluded that affective attention went from completely unintentional during the EPN to partially unintentional during P3 and SW where top-down signals, respectively, complemented and modulated bottom-up differences in stimulus prioritization. The findings were interpreted in light of two-stage models of visual perception by associating the EPN with large-capacity initial relevance detection and the P3 as well as SW with capacity-limited consolidation and elaboration of affective stimuli.

Processing of emotional information in the human subthalamic nucleus

BACKGROUND

The subthalamic nucleus (STN) is an efficient target for treating patients with Parkinson's disease as well as patients with obsessive-compulsive disorder (OCD) using high frequency stimulation (HFS). In both Parkinson's disease and OCD patients, STN-HFS can trigger abnormal behaviours, such as hypomania and impulsivity.

METHODS

To investigate if this structure processes emotional information, and whether it depends on motor demands, we recorded subthalamic local field potentials in 16 patients with Parkinson's disease using deep brain stimulation electrodes. Recordings were made with and without dopaminergic treatment while patients performed an emotional categorisation paradigm in which the response varied according to stimulus valence (pleasant, unpleasant and neutral) and to the instruction given (motor, non-motor and passive).

RESULTS

Pleasant, unpleasant and neutral stimuli evoked an event related potential (ERP). Without dopamine medication, ERP amplitudes were significantly larger for unpleasant compared with neutral pictures, whatever the response triggered by the stimuli; and the magnitude of this effect was maximal in the ventral part of the STN. No significant difference in ERP amplitude was observed for pleasant pictures. With dopamine medication, ERP amplitudes were significantly increased for pleasant compared with neutral pictures whatever the response triggered by the stimuli, while ERP amplitudes to unpleasant pictures were not modified.

CONCLUSIONS

These results demonstrate that the ventral part of the STN processes the emotional valence of stimuli independently of the motor context and that dopamine enhances processing of pleasant information. These findings confirm the specific involvement of the STN in emotional processes in human, which may underlie the behavioural changes observed in patients with deep brain stimulation.