Early modulation of visual perception by emotional arousal: evidence from steady-state visual evoked brain potentials

Moving toward reality: Electrocortical reactivity to naturalistic multimodal emotional videos

While previous research has investigated the effects of emotional videos on peripheral physiological measures and conscious experience, this study extends the research to include electrocortical measures, specifically the steady-state visual-evoked potential (ssVEP). A carefully curated set of 45 videos, designed to represent a wide range of emotional and neutral content, were presented with a flickering border. The videos featured a continuous single-shot perspective, natural soundtrack, and excluded elements associated with professional films, to enhance realism. The results demonstrate a consistent reduction in ssVEP amplitude during emotional videos which strongly correlates with the rated emotional intensity of the clips. This suggests that narrative audiovisual stimuli have the potential to track dynamic emotional processing in the cortex, providing new avenues for research in affective neuroscience. The findings highlight the potential of using realistic video stimuli to investigate how the human brain processes emotional events in a paradigm that increases ecological validity. Future studies can further develop this paradigm by expanding the video set, targeting specific cortical networks, and manipulating narrative predictability. Overall, this study establishes a foundation for investigating emotional perception using realistic video stimuli and has the potential to expand our understanding of real-world emotional processing in the human brain.

Decoding Emotion From High-frequency Steady State Visual Evoked Potential (SSVEP)

BACKGROUND

Steady-state visual evoked potential (SSVEP) by flickering sensory stimuli has been widely applied in the brain-machine interface (BMI). Yet, it remains largely unexplored whether affective information could be decoded from the signal of SSVEP, especially from the frequencies higher than the critical flicker frequency (an upper-frequency limit one can see the flicker).

NEW METHOD

Participants fixated on visual stimuli presented at 60Hz above the critical flicker frequency. The stimuli were pictures with different affective valance (positive, neutral, negative) in distinctive semantic categories (human, animal, scene). SSVEP entrainment in the brain evoked by the flickering stimuli at 60Hz was used to decode the affective and semantic information.

RESULTS

During the presentation of stimuli (1s), the affective valance could be decoded from the SSVEP signals at 60Hz, while the semantic categories could not. In contrast, neither the affective nor the semantic information could be decoded from the brain signal 1second before the onset of stimuli.

COMPARISON WITH EXISTING METHOD(S)

Previous studies focused mainly on EEG activity tagged at frequencies lower than the critical flickering frequency and investigated whether the affective valence of stimuli drew participants' attention. The current study was the first to use SSVEP signals from high-frequency (60Hz) above the critical flickering frequency to decode affective information from stimuli. The high-frequency flickering was invisible and thus substantially reduced the fatigue of participants.

CONCLUSIONS

We found that affective information could be decoded from high-frequency SSVEP and the current finding could be added to designing affective BMI in the future.

The effect of inherently threatening contexts on visuocortical engagement to conditioned threat

Fear and anxiety are crucial for adaptive responding in life-threatening situations. Whereas fear is a phasic response to an acute threat accompanied by selective attention, anxiety is characterized by a sustained feeling of apprehension and hypervigilance during situations of potential threat. In the current literature, fear and anxiety are usually considered mutually exclusive, with partially separated neural underpinnings. However, there is accumulating evidence that challenges this distinction between fear and anxiety, and simultaneous activation of fear and anxiety networks has been reported. Therefore, the current study experimentally tested potential interactions between fear and anxiety. Fifty-two healthy participants completed a differential fear conditioning paradigm followed by a test phase in which the conditioned stimuli were presented in front of threatening or neutral contextual images. To capture defense system activation, we recorded subjective (threat, US-expectancy), physiological (skin conductance, heart rate) and visuocortical (steady-state visual evoked potentials) responses to the conditioned stimuli as a function of contextual threat. Results demonstrated successful fear conditioning in all measures. In addition, threat and US-expectancy ratings, cardiac deceleration, and visuocortical activity were enhanced for fear cues presented in threatening compared with neutral contexts. These results are in line with an additive or interactive rather than an exclusive model of fear and anxiety, indicating facilitated defensive behavior to imminent danger in situations of potential threat.

Neuroelectric Correlates of Human Sexuality: A Review and Meta-Analysis

Many reviews on sexual arousal in humans focus on different brain imaging methods and behavioral observations. Although neurotransmission in the brain is mainly performed through electrochemical signals, there are no systematic reviews of the electrophysiological correlates of sexual arousal. We performed a systematic search on this subject and reviewed 255 studies including various electrophysiological methods. Our results show how neuroelectric signals have been used to investigate genital somatotopy as well as basic genital physiology during sexual arousal and how cortical electric signals have been recorded during orgasm. Moreover, experiments on the interactions of cognition and sexual arousal in healthy subjects and in individuals with abnormal sexual preferences were analyzed as well as case studies on sexual disturbances associated with diseases of the nervous system. In addition, 25 studies focusing on brain potentials during the interaction of cognition and sexual arousal were eligible for meta-analysis. The results showed significant effect sizes for specific brain potentials during sexual stimulation (P3: Cohen's d = 1.82, N = 300, LPP: Cohen's d = 2.30, N = 510) with high heterogeneity between the combined studies. Taken together, our review shows how neuroelectric methods can consistently differentiate sexual arousal from other emotional states.

Layer-specific, retinotopically-diffuse modulation in human visual cortex in response to viewing emotionally expressive faces

Viewing faces that are perceived as emotionally expressive evokes enhanced neural responses in multiple brain regions, a phenomenon thought to depend critically on the amygdala. This emotion-related modulation is evident even in primary visual cortex (V1), providing a potential neural substrate by which emotionally salient stimuli can affect perception. How does emotional valence information, computed in the amygdala, reach V1? Here we use high-resolution functional MRI to investigate the layer profile and retinotopic distribution of neural activity specific to emotional facial expressions. Across three experiments, human participants viewed centrally presented face stimuli varying in emotional expression and performed a gender judgment task. We found that facial valence sensitivity was evident only in superficial cortical layers and was not restricted to the retinotopic location of the stimuli, consistent with diffuse feedback-like projections from the amygdala. Together, our results provide a feedback mechanism by which the amygdala directly modulates activity at the earliest stage of visual processing.

Abnormal Visual Evoked Responses to Emotional Cues Correspond to Diagnosis and Disease Severity in Fibromyalgia

Background

Chronic pain disorders are often associated with cognitive-emotional dysregulation. However, the relations between such dysregulation, underlying brain processes, and clinical symptom constellations, remain unclear. Here, we aimed to characterize the abnormalities in cognitive-emotional processing involved in fibromyalgia syndrome (FMS) and their relation to disease severity.

Methods

Fifty-eight participants, 39 FMS patients (35F), and 19 healthy control subjects (16F) performed an EEG-based paradigm assessing attention allocation by extracting steady-state visually evoked potentials (ssVEP) in response to affective distractors presented during a cognitive task. Patients were also evaluated for pain severity, sleep quality, depression, and anxiety.

Results

EEG ssVEP measurement indicated that, compared to healthy controls, FMS patients displayed impaired affective discrimination, and sustained attention to negative distractors. Moreover, patients displayed decreased task-related fronto-occipital EEG connectivity. Lack of adaptive attentional discrimination, measured via EEG, was predictive of pain severity, while impairments in fronto-occipital connectivity were predictive of impaired sleep.

Conclusions

FMS patients display maladaptive affective attention modulation, which predicts disease symptoms. These findings support the centrality of cognitive-emotional dysregulation in the pathophysiology of chronic pain.

Steady-state visual evoked potentials differentiate between internally and externally directed attention

While attention to external visual stimuli has been extensively studied, attention directed internally towards mental contents (e.g., thoughts, memories) or bodily signals (e.g., breathing, heartbeat) has only recently become a subject of increased interest, due to its relation to interoception, contemplative practices and mental health. The present study aimed at expanding the methodological toolbox for studying internal attention, by examining for the first time whether the steady-state visual evoked potential (ssVEP), a well-established measure of attention, can differentiate between internally and externally directed attention. To this end, we designed a task in which flickering dots were used to generate ssVEPs, and instructed participants to count visual targets (external attention condition) or their heartbeats (internal attention condition). We compared the ssVEP responses between conditions, along with alpha-band activity and the heartbeat evoked potential (HEP) - two electrophysiological measures associated with internally directed attention. Consistent with our hypotheses, we found that both the magnitude and the phase synchronization of the ssVEP decreased when attention was directed internally, suggesting that ssVEP measures are able to differentiate between internal and external attention. Additionally, and in line with previous findings, we found larger suppression of parieto-occipital alpha-band activity and an increase of the HEP amplitude in the internal attention condition. Furthermore, we found a trade-off between changes in ssVEP response and changes in HEP and alpha-band activity: when shifting from internal to external attention, increase in ssVEP response was related to a decrease in parieto-occipital alpha-band activity and HEP amplitudes. These findings suggest that shifting between external and internal directed attention prompts a re-allocation of limited processing resources that are shared between external sensory and interoceptive processing.

Estimation of Emotional Arousal Changes of a Group of Individuals During Movie Screening Using Steady-State Visual-Evoked Potential

Neurocinematics is an emerging discipline in neuroscience, which aims to provide new filmmaking techniques by analyzing the brain activities of a group of audiences. Several neurocinematics studies attempted to track temporal changes in mental states during movie screening; however, it is still needed to develop efficient and robust electroencephalography (EEG) features for tracking brain states precisely over a long period. This study proposes a novel method for estimating emotional arousal changes in a group of individuals during movie screening by employing steady-state visual evoked potential (SSVEP), which is a widely used EEG response elicited by the presentation of periodic visual stimuli. Previous studies have reported that the emotional arousal of each individual modulates the strength of SSVEP responses. Based on this phenomenon, movie clips were superimposed on a background, eliciting an SSVEP response with a specific frequency. Two emotionally arousing movie clips were presented to six healthy male participants, while EEG signals were recorded from the occipital channels. We then investigated whether the movie scenes that elicited higher SSVEP responses coincided well with those rated as the most impressive scenes by 37 viewers in a separate experimental session. Our results showed that the SSVEP response averaged across six participants could accurately predict the overall impressiveness of each movie, evaluated with a much larger group of individuals.

Emotion-Attention Interaction in the Right Hemisphere

Hemispheric asymmetries in affective and cognitive functions have been extensively studied. While both cerebral hemispheres contribute to most affective and cognitive processes, neuroscientific literature and neuropsychological evidence support an overall right hemispheric dominance for emotion, attention and arousal. Emotional stimuli, especially those with survival value such as threat, tend to be prioritized in attentional resource competition. Arousing unpleasant emotional stimuli have prioritized access, especially to right-lateralized attention networks. Interference of task performance may be observed when limited resources are exhausted by task- and emotion-related processing. Tasks that rely on right hemisphere-dependent processing, like attending to the left visual hemifield or global-level visual features, are especially vulnerable to interference due to attention capture by unpleasant emotional stimuli. The aim of this review is to present literature regarding the special role of the right hemisphere in affective and attentional brain processes and their interaction. Furthermore, clinical and technological implications of this interaction will be presented. Initially, the effects of focal right hemisphere lesion or atrophy on emotional functions will be introduced. Neurological right hemisphere syndromes including aprosodia, anosognosia and neglect, which further point to the predominance of the intact right hemisphere in emotion, attention and arousal will be presented. Then there will be a brief review of electrophysiological evidence, as well as evidence from patients with neglect that support attention capture by emotional stimuli in the right hemisphere. Subsequently, experimental work on the interaction of emotion, attention and cognition in the right hemispheres of healthy subjects will be presented. Finally, clinical implications for better understanding and assessment of alterations in emotion-attention interaction due to brain disorder or treatment, such as neuromodulation, that impact affective brain functions will be discussed. It will be suggested that measuring right hemispheric emotion-attention interactions may provide basis for novel biomarkers of brain health. Such biomarkers allow for improved diagnostics in brain damage and disorders and optimized treatments. To conclude, future technological applications will be outlined regarding brain physiology-based measures that reflect engagement of the right hemisphere in affective and attentional processes.

Emotional content overrides spatial attention

Spatial attention is our capacity to attend to or ignore particular regions of our spatial environment. However, some classes of stimuli may be able to override our efforts to ignore them. Here we assessed the relationship between involuntary attentional capture with emotional images and spatial attention at early stages of perceptual processing. Multiple scenes of unpleasant and neutral content were displayed in rapid serial visual presentation (RSVP) streams that elicited the steady-state visual evoked potential (SSVEP), a neural marker of selective attention at early visual areas. In a spatial cueing task, participants were cued to covertly attend to RSVP streams presented at 4 and 6 Hz presentation rates in the left and right visual hemifields. The task was to detect square targets occasionally displayed within the image streams, responding only to those appearing on the cued side. The RSVP streams were always neutral pictures in one visual hemifield but would unpredictably switch from neutral to aversive content in the other visual hemifield. We found that SSVEP amplitude was consistently modulated by a change in emotional valence of image streams, regardless of whether the change in content occurred in the attended or unattended spatial location, reflecting an automatic sensory amplification for affective stimuli. The present data provide further evidence in support that emotional images can attract visual processing resources independently of spatial attention allocation, and are consistent with sustained sensory facilitation of early visual areas through re-entrant feedback projections from higher-order cortical areas involved in the extraction of affective information.

Threat imminence modulates neural gain in attention and motor relevant brain circuits in humans

Different levels of threat imminence elicit distinct computational strategies reflecting how the organism interacts with its environment in order to guarantee survival. Thereby, parasympathetically driven orienting and inhibition of on-going behavior in post-encounter situations and defense reactions in circa-strike conditions associated with sympathetically driven action preparation are typically observed across species. Here, we show that healthy humans are characterized by markedly variable individual orienting or defense response tendencies as indexed by differential heart rate (HR) changes during the passive viewing of unpleasant pictures. Critically, these HR response tendencies predict neural gain modulations in cortical attention and preparatory motor circuits as measured by neuromagnetic steady-state visual evoked fields (ssVEFs) and induced beta-band (19-30 Hz) desynchronization, respectively. Decelerative HR orienting responses were associated with increased ssVEF power in the parietal cortex and reduced beta-band desynchronization in pre-motor and motor areas. However, accelerative HR defense response tendencies covaried with reduced ssVEF power in the parietal cortex and lower beta-band desynchronization in cortical motor circuits. These results show that neural gain in attention- and motor-relevant brain areas is modulated by HR indexed threat imminence during the passive viewing of unpleasant pictures. The observed mutual ssVEF and beta-band power modulations in attention and motor brain circuits support the idea of two prevalent response tendencies characterized by orienting and motor inhibition or reduced stimulus processing and action initiation tendencies at different perceived threat imminence levels.

Nontarget emotional stimuli must be highly conspicuous to modulate the attentional blink

The attentional blink (AB) is often considered a top-down phenomenon because it is triggered by matching an initial target (T1) in a rapid serial visual presentation (RSVP) stream to a search template. However, the AB is modulated when targets are emotional, and is evoked when a task-irrelevant, emotional critical distractor (CDI) replaces T1. Neither manipulation fully captures the interplay between bottom-up and top-down attention in the AB: Valenced targets intrinsically conflate top-down and bottom-up attention. The CDI approach cannot manipulate second target (T2) valence, which is critical because valenced T2s can "break through" the AB (in the target-manipulation approach). The present research resolves this methodological challenge by indirectly measuring whether a purely bottom-up CDI can modulate report of a subsequent T2. This novel approach adds a valenced CDI to the "classic," two-target AB. Participants viewed RSVP streams containing a T1-CDI pair preceding a variable lag to T2. If the CDI's valence is sufficient to survive the AB, it should modulate T2 performance, indirectly signaling bottom-up capture by an emotional stimulus. Contrary to this prediction, CDI valence only affected the AB when CDIs were also extremely visually conspicuous. Thus, emotional valence alone is insufficient to modulate the AB.

SSVEP phase synchronies and propagation during repetitive visual stimulation at high frequencies

Steady-state visual evoked potentials (SSVEPs), the brain response to visual flicker stimulation, have proven beneficial in both research and clinical applications. Despite the practical advantages of stimulation at high frequencies in terms of visual comfort and safety, high frequency-SSVEPs have not received enough attention and little is known about the mechanisms behind their generation and propagation in time and space. In this study, we investigated the origin and propagation of SSVEPs in the gamma frequency band (40-60 Hz) by studying the dynamic properties of EEG in 32 subjects. Using low-resolution brain electromagnetic tomography (sLORETA) we identified the cortical sources involved in SSVEP generation in that frequency range to be in the primary visual cortex, Brodmann areas 17, 18 and 19 with minor contribution from sources in central and frontal sites. We investigated the SSVEP propagation as measured on the scalp in the framework of the existing theories regarding the neurophysiological mechanism through which the SSVEP spreads through the cortex. We found a progressive phase shift from posterior parieto-occipital sites over the cortex with a phase velocity of approx. 8-14 m/s and wavelength of about 21 and 24 cm. The SSVEP spatial properties appear sensitive to input frequency with higher stimulation frequencies showing a faster propagation speed.

Neural Mechanism of Affective Perception: Evidence from Phase and Causality Analysis in the Cerebral Cortex

Emotion plays an important role in people's lives. However, the neural mechanism of affective perception is still unclear. In this study, steady-state visual evoked potentials (SSVEPs) were used to explore information processing speed and interactions among cortical structures involved in affective perception. Pleasant, unpleasant, and neutral pictures selected from the International Affective Picture System were presented either in intact or phase-scrambled form at a fixed frequency, where the induced SSVEPs could be used as a frequency marker of brain activity with high temporal resolution and signal-to-noise ratio. Source estimation methods were used to reconstruct the cortical signals. The information processing of affective images was studied by phase and causal connection analysis in the cortical space to investigate the information processing speed of the local brain region and the dynamic interactions across brain regions. Experimental results showed that affective and semantic perception was accompanied by the acceleration of information processing speed in the ventral pathway. Unpleasant emotions had the fastest information processing speed in the ventral stream compared with pleasant and neutral emotions, including the middle occipital gyrus and the middle temporal gyrus, with a right hemisphere bias. In addition, unpleasant emotions were stronger than pleasant emotions in long-term causal connections in the bilateral middle temporal gyrus, and the direction was from the right hemisphere to the left hemisphere. These results provide unique insights into the cortical activities for affective perception and support the view that unpleasant emotions have priority in information perception in the middle temporal gyrus compared with pleasant and neutral emotions, with a right hemisphere bias.

Decoding Neural Representations of Affective Scenes in Retinotopic Visual Cortex

The perception of opportunities and threats in complex visual scenes represents one of the main functions of the human visual system. The underlying neurophysiology is often studied by having observers view pictures varying in affective content. It has been shown that viewing emotionally engaging, compared with neutral, pictures (1) heightens blood flow in limbic, frontoparietal, and anterior visual structures and (2) enhances the late positive event-related potential (LPP). The role of retinotopic visual cortex in this process has, however, been contentious, with competing theories predicting the presence versus absence of emotion-specific signals in retinotopic visual areas. Recording simultaneous electroencephalography-functional magnetic resonance imaging while observers viewed pleasant, unpleasant, and neutral affective pictures, and applying multivariate pattern analysis, we found that (1) unpleasant versus neutral and pleasant versus neutral decoding accuracy were well above chance level in retinotopic visual areas, (2) decoding accuracy in ventral visual cortex (VVC), but not in early or dorsal visual cortex, was correlated with LPP, and (3) effective connectivity from amygdala to VVC predicted unpleasant versus neutral decoding accuracy, whereas effective connectivity from ventral frontal cortex to VVC predicted pleasant versus neutral decoding accuracy. These results suggest that affective scenes evoke valence-specific neural representations in retinotopic visual cortex and that these representations are influenced by reentry signals from anterior brain regions.

Oscillations in the central brain of Drosophila are phase locked to attended visual features

Object-based attention describes the brain's capacity to prioritize one set of stimuli while ignoring others. Human research suggests that the binding of diverse stimuli into one attended percept requires phase-locked oscillatory activity in the brain. Even insects display oscillatory brain activity during visual attention tasks, but it is unclear if neural oscillations in insects are selectively correlated to different features of attended objects. We addressed this question by recording local field potentials in the Drosophila central complex, a brain structure involved in visual navigation and decision making. We found that attention selectively increased the neural gain of visual features associated with attended objects and that attention could be redirected to unattended objects by activation of a reward circuit. Attention was associated with increased beta (20- to 30-Hz) oscillations that selectively locked onto temporal features of the attended visual objects. Our results suggest a conserved function for the beta frequency range in regulating selective attention to salient visual features.

The SSVEP tracks attention, not consciousness, during perceptual filling-in

Research on the neural basis of conscious perception has almost exclusively shown that becoming aware of a stimulus leads to increased neural responses. By designing a novel form of perceptual filling-in (PFI) overlaid with a dynamic texture display, we frequency-tagged multiple disappearing targets as well as their surroundings. We show that in a PFI paradigm, the disappearance of a stimulus and subjective invisibility is associated with increases in neural activity, as measured with steady-state visually evoked potentials (SSVEPs), in electroencephalography (EEG). We also find that this increase correlates with alpha-band activity, a well-established neural measure of attention. These findings cast doubt on the direct relationship previously reported between the strength of neural activity and conscious perception, at least when measured with current tools, such as the SSVEP. Instead, we conclude that SSVEP strength more closely measures changes in attention.

Social aversive generalization learning sharpens the tuning of visuocortical neurons to facial identity cues

Defensive system activation promotes heightened perception of threat signals, and excessive attention to threat signals has been discussed as a contributory factor in the etiology of anxiety disorders. However, a mechanistic account of attentional modulation during fear-relevant processes, especially during fear generalization remains elusive. To test the hypothesis that social fear generalization prompts sharpened tuning in the visuocortical representation of social threat cues, 67 healthy participants underwent differential fear conditioning, followed by a generalization test in which participants viewed faces varying in similarity with the threat-associated face. We found that generalization of social threat sharpens visuocortical tuning of social threat cues, whereas ratings of fearfulness showed generalization, linearly decreasing with decreasing similarity to the threat-associated face. Moreover, individuals who reported greater anxiety in social situations also showed heightened sharpened tuning of visuocortical neurons to facial identity cues, indicating the behavioral relevance of visuocortical tuning during generalization learning.

Rapid processing of neutral and angry expressions within ongoing facial stimulus streams: Is it all about isolated facial features?

Our visual system extracts the emotional meaning of human facial expressions rapidly and automatically. Novel paradigms using fast periodic stimulations have provided insights into the electrophysiological processes underlying emotional content extraction: the regular occurrence of specific identities and/or emotional expressions alone can drive diagnostic brain responses. Consistent with a processing advantage for social cues of threat, we expected angry facial expressions to drive larger responses than neutral expressions. In a series of four EEG experiments, we studied the potential boundary conditions of such an effect: (i) we piloted emotional cue extraction using 9 facial identities and a fast presentation rate of 15 Hz (N = 16); (ii) we reduced the facial identities from 9 to 2, to assess whether (low or high) variability across emotional expressions would modulate brain responses (N = 16); (iii) we slowed the presentation rate from 15 Hz to 6 Hz (N = 31), the optimal presentation rate for facial feature extraction; (iv) we tested whether passive viewing instead of a concurrent task at fixation would play a role (N = 30). We consistently observed neural responses reflecting the rate of regularly presented emotional expressions (5 Hz and 2 Hz at presentation rates of 15 Hz and 6 Hz, respectively). Intriguingly, neutral expressions consistently produced stronger responses than angry expressions, contrary to the predicted processing advantage for threat-related stimuli. Our findings highlight the influence of physical differences across facial identities and emotional expressions.

Visuocortical tuning to a threat-related feature persists after extinction and consolidation of conditioned fear

Neurons in the visual cortex sharpen their orientation tuning as humans learn aversive contingencies. A stimulus orientation (CS+) that reliably predicts an aversive noise (unconditioned stimulus: US) is selectively enhanced in lower-tier visual cortex, while similar unpaired orientations (CS-) are inhibited. Here, we examine in male volunteers how sharpened visual processing is affected by fear extinction learning (where no US is presented), and how fear and extinction memory undergo consolidation one day after the original learning episode. Using steady-state visually evoked potentials from electroencephalography in a fear generalization task, we found that extinction learning prompted rapid changes in orientation tuning: Both conditioned visuocortical and skin conductance responses to the CS+ were strongly reduced. Next-day re-testing (delayed recall) revealed a brief but precise return-of-tuning to the CS+ in visual cortex accompanied by a brief, more generalized return-of-fear in skin conductance. Explorative analyses also showed persistent tuning to the threat cue in higher visual areas, 24 h after successful extinction, outlasting peripheral responding. Together, experience-based changes in the sensitivity of visual neurons show response patterns consistent with memory consolidation and spontaneous recovery, the hallmarks of long-term neural plasticity.

Combined frequency-tagging EEG and eye tracking reveal reduced social bias in boys with autism spectrum disorder

Developmental accounts of autism spectrum disorder (ASD) state that infants and children with ASD are spontaneously less attracted by and less proficient in processing social stimuli such as faces. This is hypothesized to partly underlie social communication difficulties in ASD. While in some studies a reduced preference for social stimuli has been shown in individuals with ASD, effect sizes are moderate and vary across studies, stimuli, and designs. Eye tracking, often the methodology of choice to study social preference, conveys information about overt orienting processes but conceals covert attention, possibly resulting in an underestimation of the effects. In this study, we recorded eye tracking and electroencephalography (EEG) during fast periodic visual stimulation to address this issue. We tested 21 boys with ASD (8-12 years old) and 21 typically developing (TD) control boys, matched for age and IQ. Streams of variable images of faces were presented at 6 Hz alongside images of houses presented at 7.5 Hz or vice versa, while children were engaged in an orthogonal task. While frequency-tagged neural responses were larger in response to faces than simultaneously presented houses in both groups, this effect was much larger in TD boys than in boys with ASD. This group difference in saliency of social versus non-social processing is significant after 5 sec of stimulus presentation and holds throughout the entire trial. Although there was no interaction between group and stimulus category for simultaneously recorded eye-tracking data, eye tracking and EEG measures were strongly correlated. We conclude that frequency-tagging EEG, allowing monitoring of both overt and covert processes, provides a fast, objective and reliable measure of decreased preference for social information in ASD.

No intermodal interference effects of threatening information during concurrent audiovisual stimulation

Changes in attention can result in sensory processing trade-off effects, in which sensory cortical responses to attended stimuli are heightened and responses to competing distractors are attenuated. However, it is unclear if competition or facilitation effects will be observed at the level of sensory cortex when attending to competing stimuli in two modalities. The present study used electroencephalogram (EEG) and frequency-tagging to quantitatively assess auditory-visual interactions during sustained multimodal sensory stimulation. The emotional content of a 6.66 Hz rapid serial visual presentation (RSVP) was manipulated to elicit well-established emotional attention effects, while a constant 63 dB tone with a 40.8 Hz modulation served as a concurrent auditory stimulus in two experiments. As a directed attention manipulation, participants were instructed to detect transient sound level events in the auditory stream in Experiment 1. To manipulate attention through threat anticipation, participants were instructed to expect an aversive noise burst after a higher 40.8 Hz modulated tone in Experiment 2. Each stimulus evoked reliable steady-state sensory cortical responses in all participants (n = 30) in both experiments. The visual cortical responses were modulated by the auditory detection task, but not by threat anticipation: Visual responses were smaller during auditory streams with a transient target as compared to uninterrupted auditory streams. Conversely, visual stimulus condition had no significant effects on auditory sensory cortical responses in either experiment. These results indicate that there is neither a competition nor facilitation effect of visual content on concurrent auditory sensory cortical processing. They further indicate that competition effects of auditory stream content on sustained visuocortical responses are limited to auditory target processing.

Expectation Gates Neural Facilitation of Emotional Words in Early Visual Areas

The current study examined whether emotional expectations gate attention to emotional words in early visual cortex. Color cues informed about word valence and onset latency. We observed a stimulus-preceding negativity prior to the onset of cued words that was larger for negative than for neutral words. This indicates that in anticipation of emotional words more attention was allocated to them than to neutral words before target onset. During stimulus presentation the steady-state visual evoked potential (SSVEP), elicited by flickering words, was attenuated for cued compared to uncued words, indicating sharpened sensory activity, i.e., expectation suppression. Most importantly, the SSVEP was more enhanced for negative than neutral words when these were cued. Uncued conditions did not differ in SSVEP amplitudes, paralleling previous studies reporting lexico-semantic but not early visual effects of emotional words. We suggest that cueing mediates re-entrant engagement of visual resources by providing an early “affective gist” of an upcoming word. Consequently, visual single-word studies may have underestimated attentional effects of emotional words and their anticipation during reading.

Rapid sensory gain with emotional distracters precedes attentional deployment from a foreground task

The steady-state visual evoked potential (SSVEP), an electrophysiological marker of attentional resource allocation, has recently been demonstrated to serve as a neural signature of emotional content extraction from a rapid serial visual presentation (RSVP). SSVEP amplitude was reduced for streams of emotional relative to neutral scenes passively viewed at 6 Hz (~167 ms per image), but it was enhanced for emotional relative to neutral scenes when viewed as 4 Hz RSVP (250 ms per image). Here, we investigated whether these seemingly contradictory observations may be related to different dynamics in the allocation of attentional resources as a consequence of stimulation frequency. To this end, we advanced our distraction paradigm by presenting a visual foreground task consisting of randomly moving squares flickering at 15 Hz superimposed on task-irrelevant RSVP streams shown at 6 or 4 Hz, which could unpredictably switch from neutral to unpleasant content during the trial or remained neutral. Critically, our findings demonstrate that affective distractors captured attentional resources more strongly than their neutral counterparts, irrespective of whether they were presented at 6 or 4 Hz rate. Moreover, the emotion-dependent attentional deployment from the foreground task was temporally preceded by sustained sensory facilitation in response to emotional background images. Together, present findings provide evidence for rapid sustained visual facilitation but a rather slow attentional bias in favor of emotional distractors in early visual areas.

The effect of trait anxiety on attentional mechanisms in combined context and cue conditioning and extinction learning

Sensory processing and attention allocation are shaped by threat, but the role of trait-anxiety in sensory processing as a function of threat predictability remains incompletely understood. Therefore, we measured steady-state visual evoked potentials (ssVEPs) as an index of sensory processing of predictable and unpredictable threat cues in 29 low (LA) and 29 high (HA) trait-anxious participants during a modified NPU-paradigm followed by an extinction phase. Three different contextual cues indicated safety (N), predictable (P) or unpredictable threat (U), while foreground cues signalled shocks in the P-condition only. All participants allocated increased attentional resources to the central P-threat cue, replicating previous findings. Importantly, LA individuals exhibited larger ssVEP amplitudes to contextual threat (U and P) than to contextual safety cues, while HA individuals did not differentiate among contextual cues in general. Further, HA exhibited higher aversive ratings of all contexts compared to LA. These results suggest that high trait-anxious individuals might be worse at discriminating contextual threat stimuli and accordingly overestimate the probability and aversiveness of unpredictable threat. These findings support the notion of aberrant sensory processing of unpredictable threat in anxiety disorders, as this processing pattern is already evident in individuals at risk of these disorders.

Functional Source Separation for EEG-fMRI Fusion: Application to Steady-State Visual Evoked Potentials

Neurorobotics is one of the most ambitious fields in robotics, driving integration of interdisciplinary data and knowledge. One of the most productive areas of interdisciplinary research in this area has been the implementation of biologically-inspired mechanisms in the development of autonomous systems. Specifically, enabling such systems to display adaptive behavior such as learning from good and bad outcomes, has been achieved by quantifying and understanding the neural mechanisms of the brain networks mediating adaptive behaviors in humans and animals. For example, associative learning from aversive or dangerous outcomes is crucial for an autonomous system, to avoid dangerous situations in the future. A body of neuroscience research has suggested that the neurocomputations in the human brain during associative learning involve re-shaping of sensory responses. The nature of these adaptive changes in sensory processing during learning however are not yet well enough understood to be readily implemented into on-board algorithms for robotics application. Toward this overall goal, we record the simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), characterizing one candidate mechanism, i.e., large-scale brain oscillations. The present report examines the use of Functional Source Separation (FSS) as an optimization step in EEG-fMRI fusion that harnesses timing information to constrain the solutions that satisfy physiological assumptions. We applied this approach to the voxel-wise correlation of steady-state visual evoked potential (ssVEP) amplitude and blood oxygen level-dependent imaging (BOLD), across both time series. The results showed the benefit of FSS for the extraction of robust ssVEP signals during simultaneous EEG-fMRI recordings. Applied to data from a 3-phase aversive conditioning paradigm, the correlation maps across the three phases (habituation, acquisition, extinction) show converging results, notably major overlapping areas in both primary and extended visual cortical regions, including calcarine sulcus, lingual cortex, and cuneus. In addition, during the acquisition phase when aversive learning occurs, we observed additional correlations between ssVEP and BOLD in the anterior cingulate cortex (ACC) as well as the precuneus and superior temporal gyrus.

Rapid Extraction of Emotion Regularities from Complex Scenes in the Human Brain

Adaptive behavior requires the rapid extraction of behaviorally relevant information in the environment, with particular emphasis on emotional cues. However, the speed of emotional feature extraction from complex visual environments is largely undetermined. Here we use objective electrophysiological recordings in combination with frequency tagging to demonstrate that the extraction of emotional information from neutral, pleasant, or unpleasant naturalistic scenes can be completed at a presentation speed of 167 ms (i.e., 6 Hz) under high perceptual load. Emotional compared to neutral pictures evoked enhanced electrophysiological responses with distinct topographical activation patterns originating from different neural sources. Cortical facilitation in early visual cortex was also more pronounced for scenes with pleasant compared to unpleasant or neutral content, suggesting a positivity offset mechanism dominating under conditions of rapid scene processing. These results significantly advance our knowledge of complex scene processing in demonstrating rapid integrative content identification, particularly for emotional cues relevant for adaptive behavior in complex environments.

Visual cues of threat elicit greater steady-state electroencephalographic responses than visual reminders of death

Terror management theory (TMT) suggests that reminders of death activate an exclusive anxiety mechanism different from the one activated by other types of symbolic threats. This notion is supported by evidence showing how experimental participants verbally reflecting on their own death are then influenced in their opinions and behaviours. A previous study showed that magnitude of electroencephalography (EEG) activity is greater when images depicting death-related content are coupled with painful thermal stimuli compared to threat-related content. Here we expand on previous research by testing whether similar effects may be brought about by passive observation of generic visual reminders of death. More precisely, we hypothesised that fast periodic presentation of death-related vs. more generic threat-related images determine a preferential modulation of brain activity measured by means of EEG. In two experiments, we found that images depicting death content elicit lower frequency-tagged EEG response compared to more generic threat images. Visual evoked potentials revealed that a brief change of the scene from neutral to threat content elicits greater amplitude at the late latencies (compatible with a P300 potential), particularly at the parieto-occipital sites. Altogether, our findings suggest that, in a context where no reflection on death cues is allowed and no threatening stimuli in other modality occur, visual death cues trigger lower neural synchronisation than that elicited by similarly negative and arousing cues with divergent threatening meaning.

Testing the Possibility of Model-based Pavlovian Control of Attention to Threat

Signals for reward or punishment attract attention preferentially, a principle termed value-modulated attention capture (VMAC). The mechanisms that govern the allocation of attention can be described with a terminology that is more often applied to the control of overt behaviors, namely, the distinction between instrumental and Pavlovian control, and between model-free and model-based control. Although instrumental control of VMAC can be either model-free or model-based, it is not known whether Pavlovian control of VMAC can be model-based. To decide whether this is possible, we measured steady-state visual evoked potentials (SSVEPs) while 20 healthy adults took part in a novel task. During the learning stage, participants underwent aversive threat conditioning with two conditioned stimuli (CSs): one that predicted pain (CS+) and one that predicted safety (CS-). Instructions given before the test stage allowed participants to infer whether novel, ambiguous CSs (new_CS+/new_CS-) were threatening or safe. Correct inference required combining stored internal representations and new propositional information, the hallmark of model-based control. SSVEP amplitudes quantified the amount of attention allocated to novel CSs on their very first presentation, before they were ever reinforced. We found that SSVEPs were higher for new_CS+ than new_CS-. This result is potentially indicative of model-based Pavlovian control of VMAC, but additional controls are necessary to verify this conclusively. This result underlines the potential transformative role of information and inference in emotion regulation.

Complex sparse spatial filter for decoding mixed frequency and phase coded steady-state visually evoked potentials

BACKGROUND

Mixed frequency and phase coding (FPC) can achieve the significant increase of the number of commands in steady-state visual evoked potential-based brain-computer interface (SSVEP-BCI). However, the inconsistent phases of the SSVEP over channels in a trial and the existence of non-contributing channels due to noise effects can decrease accurate detection of stimulus frequency.

NEW METHOD

We propose a novel command detection method based on a complex sparse spatial filter (CSSF) by solving ℓ₁- and ℓ_2,1-regularization problems for a mixed-coded SSVEP-BCI. In particular, ℓ_2,1-regularization (aka group sparsification) can lead to the rejection of electrodes that are not contributing to the SSVEP detection.

RESULTS

A calibration data based canonical correlation analysis (CCA) and CSSF with ℓ₁- and ℓ_2,1-regularization cases were demonstrated for a 16-target stimuli with eleven subjects. The results of statistical test suggest that the proposed method with ℓ₁- and ℓ_2,1-regularization significantly achieved the highest ITR.

COMPARISON WITH EXISTING METHODS

The proposed approaches do not need any reference signals, automatically select prominent channels, and reduce the computational cost compared to the other mixed frequency-phase coding (FPC)-based BCIs.

CONCLUSIONS

The experimental results suggested that the proposed method can be usable implementing BCI effectively with reduce visual fatigue.

Assessing the relationship between pupil diameter and visuocortical activity

Visuocortical activity and pupil diameter both increase in tasks involving memory, attention, and physiological arousal. Thus, the question arises whether pupil dilation prompts a subsequent increase in visuocortical activity. In this study, we investigated the extent to which changes in visuocortical activity relate to changes in pupil diameter. The amplitude of the sustained visuocortical response to a flickering stimulus (i.e., steady-state visually evoked potential [ssVEP] power) was examined in 39 participants while pupil diameter was measured. To generalize across stimulus conditions, Gabor stimuli varied in brightness and ssVEP driving frequency. As expected, brighter stimuli prompted pupil constriction and larger ssVEP power. To determine whether momentary fluctuations in pupil size contribute to the ssVEP amplitude under conditions of constant luminance and frequency, the single-trial means from each measure were correlated and the shape of the pupil-diameter waveform related to the ssVEP amplitude time course, both within and between participants. Under constant conditions, changes in pupil diameter were not related to changes in ssVEP amplitude, at any luminance level or driving frequency. Findings suggest that pupil dilation does not systematically prompt subsequent changes in visuocortical activity, and thus is not a sufficient cause of visuocortical modulation in cognitive or affective tasks.

Hypervigilance during anxiety and selective attention during fear: Using steady-state visual evoked potentials (ssVEPs) to disentangle attention mechanisms during predictable and unpredictable threat

Anxiety is induced by unpredictable threat, and presumably characterized by enhanced vigilance. In contrast, fear is elicited by imminent threat, and leads to phasic responses with selective attention. In order to investigate attention mechanisms and defensive responding during fear and anxiety, we employed an adaptation of the NPU-threat test and measured cortical (steady-state visual evoked potentials, ssVEPs), physiological (heart rate, HR), and subjective responses (ratings) to predictable (fear-related) and unpredictable (anxiety-related) threat in 42 healthy participants. An aversive unconditioned stimulus (US, loud noise) was 100% predicted by a cue (predictable P-cue) in one context (predictable P-context), but appeared unpredictably within a different context (unpredictable U-context, U-cue), while it was never delivered in a neutral safe context (N-cue, N- context). In response to predictable threat (P-cue), increased ssVEP amplitudes and accelerated HR were found. Both predictable and unpredictable contexts yielded increased ssVEP amplitudes compared to the safe context. Interestingly, in the unpredictable context participants showed longer-lasting visuocortical activation than in the predictable context, supporting the notion of heightened vigilance during anxiety. In parallel, HR decelerated to both threat contexts indicating fear bradycardia to these threatening contexts as compared to the safe context. These results support the idea of hypervigilance in anxiety-like situations reflected in a long-lasting facilitated processing of sensory information, in contrast to increased selective attention to specific imminent threat during fear. Thus, this study further supports the defense-cascade model with vigilance and orienting in the post-encounter phase of threat (anxiety), while selective attention and defensive mobilization in the circa-strike phase of threat (fear).

Face Perception in Social Anxiety: Visuocortical Dynamics Reveal Propensities for Hypervigilance or Avoidance

BACKGROUND

Theories of aberrant attentional processing in social anxiety, and anxiety disorders more broadly, have postulated an initial hypervigilance or facilitation to clinically relevant threats and consequent defensive avoidance. However, existing objective measurements utilized to explore this phenomenon lack the resolution to elucidate attentional dynamics, particularly covert influences.

METHODS

We utilized a continuous measure of visuocortical engagement, the steady-state visual evoked potential in response to naturalistic angry, fearful, happy, and neutral facial expressions. Participants were treatment-seeking patients with principal diagnoses of social anxiety circumscribed to performance situations (n = 21) or generalized across interaction contexts (n = 42), treatment-seeking patients with panic disorder with agoraphobia (n = 25), and 17 healthy participants.

RESULTS

At the principal disorder level, only circumscribed social anxiety patients showed sustained visuocortical facilitation to aversive facial expressions. Control participants as well as patients with panic disorder with agoraphobia and generalized social anxiety showed no bias. More finely stratifying the sample according to clinical judgment of social anxiety severity and interference revealed a linear increase in visuocortical bias to aversive expressions for all but the most severely impaired patients. This group showed an opposing sustained attentional disengagement.

CONCLUSIONS

Rather than shifts between covert vigilance and avoidance of aversive facial expressions, social anxiety appears to confer a sustained bias for one or the other. While vigilant attention reliably increases with social anxiety severity for the majority of patients, the most impaired patients show an opposing avoidance. These distinct patterns of attentional allocation could provide a powerful means of personalizing neuroscience-based interventions to modify attention bias and related impairment.

Effects of Scene Properties and Emotional Valence on Brain Activations: A Fixation-Related fMRI Study

Temporal and spatial characteristics of fixations are affected by image properties, including high-level scene characteristics, such as object-background composition, and low-level physical characteristics, such as image clarity. The influence of these factors is modulated by the emotional content of an image. Here, we aimed to establish whether brain correlates of fixations reflect these modulatory effects. To this end, we simultaneously scanned participants and measured their eye movements, while presenting negative and neutral images in various image clarity conditions, with controlled object-background composition. The fMRI data were analyzed using a novel fixation-based event-related (FIBER) method, which allows the tracking of brain activity linked to individual fixations. The results revealed that fixating an emotional object was linked to greater deactivation in the right lingual gyrus than fixating the background of an emotional image, while no difference between object and background was found for neutral images. We suggest that deactivation in the lingual gyrus might be linked to inhibition of saccade execution. This was supported by fixation duration results, which showed that in the negative condition, fixations falling on the object were longer than those falling on the background. Furthermore, increase in the image clarity was correlated with fixation-related activity within the lateral occipital complex, the structure linked to object recognition. This correlation was significantly stronger for negative images, presumably due to greater deployment of attention towards emotional objects. Our eye-tracking results are in line with these observations, showing that the chance of fixating an object rose faster for negative images over neutral ones as the level of noise decreased. Overall, our study demonstrated that emotional value of an image changes the way that low and high-level scene properties affect the characteristics of fixations. The fixation-related brain activity is affected by the low-level scene properties and this impact differs between negative and neutral images. The high-level scene properties also affect brain correlates of fixations, but only in the case of the negative images.

Visual cortex responses reflect temporal structure of continuous quasi-rhythmic sensory stimulation

Neural processing of dynamic continuous visual input, and cognitive influences thereon, are frequently studied in paradigms employing strictly rhythmic stimulation. However, the temporal structure of natural stimuli is hardly ever fully rhythmic but possesses certain spectral bandwidths (e.g. lip movements in speech, gestures). Examining periodic brain responses elicited by strictly rhythmic stimulation might thus represent ideal, yet isolated cases. Here, we tested how the visual system reflects quasi-rhythmic stimulation with frequencies continuously varying within ranges of classical theta (4–7 Hz), alpha (8–13 Hz) and beta bands (14–20 Hz) using EEG. Our findings substantiate a systematic and sustained neural phase-locking to stimulation in all three frequency ranges. Further, we found that allocation of spatial attention enhances EEG-stimulus locking to theta- and alpha-band stimulation. Our results bridge recent findings regarding phase locking (“entrainment”) to quasi-rhythmic visual input and “frequency-tagging” experiments employing strictly rhythmic stimulation. We propose that sustained EEG-stimulus locking can be considered as a continuous neural signature of processing dynamic sensory input in early visual cortices. Accordingly, EEG-stimulus locking serves to trace the temporal evolution of rhythmic as well as quasi-rhythmic visual input and is subject to attentional bias.

•

Dynamic visual stimuli constitute large parts of our perceptual experience.

•

Strictly rhythmic dynamics condense in EEG-recorded mass-neural activity.

•

We tested how stimuli with fluctuating rhythms reflect in the EEG.

•

We found that the EEG allows tracing two quasi-rhythmic stimuli in parallel.

•

Dynamics of attended stimuli may be tracked with greater temporal precision.

Steady-state visual evoked potentials as a research tool in social affective neuroscience

Like many other primates, humans place a high premium on social information transmission and processing. One important aspect of this information concerns the emotional state of other individuals, conveyed by distinct visual cues such as facial expressions, overt actions, or by cues extracted from the situational context. A rich body of theoretical and empirical work has demonstrated that these socioemotional cues are processed by the human visual system in a prioritized fashion, in the service of optimizing social behavior. Furthermore, socioemotional perception is highly dependent on situational contexts and previous experience. Here, we review current issues in this area of research and discuss the utility of the steady-state visual evoked potential (ssVEP) technique for addressing key empirical questions. Methodological advantages and caveats are discussed with particular regard to quantifying time-varying competition among multiple perceptual objects, trial-by-trial analysis of visual cortical activation, functional connectivity, and the control of low-level stimulus features. Studies on facial expression and emotional scene processing are summarized, with an emphasis on viewing faces and other social cues in emotional contexts, or when competing with each other. Further, because the ssVEP technique can be readily accommodated to studying the viewing of complex scenes with multiple elements, it enables researchers to advance theoretical models of socioemotional perception, based on complex, quasinaturalistic viewing situations.

Steady-state visually evoked potential correlates of human body perception

In cognitive neuroscience, interest in the neuronal basis underlying the processing of human bodies is steadily increasing. Based on functional magnetic resonance imaging studies, it is assumed that the processing of pictures of human bodies is anchored in a network of specialized brain areas comprising the extrastriate and the fusiform body area (EBA, FBA). An alternative to examine the dynamics within these networks is electroencephalography, more specifically so-called steady-state visually evoked potentials (SSVEPs). In SSVEP tasks, a visual stimulus is presented repetitively at a predefined flickering rate and typically elicits a continuous oscillatory brain response at this frequency. This brain response is characterized by an excellent signal-to-noise ratio-a major advantage for source reconstructions. The main goal of present study was to demonstrate the feasibility of this method to study human body perception. To that end, we presented pictures of bodies and contrasted the resulting SSVEPs to two control conditions, i.e., non-objects and pictures of everyday objects (chairs). We found specific SSVEPs amplitude differences between bodies and both control conditions. Source reconstructions localized the SSVEP generators to a network of temporal, occipital and parietal areas. Interestingly, only body perception resulted in activity differences in middle temporal and lateral occipitotemporal areas, most likely reflecting the EBA/FBA.

Extent and time-course of competition in visual cortex between emotionally arousing distractors and a concurrent task

Emotionally arousing cues automatically attract attentional resources, which may be at the cost of processing task-related information. Of central importance is how the visual system resolves competition for processing resources among stimuli differing in motivational salience. Here, we assessed the extent and time-course of competition between emotionally arousing distractors and task-related stimuli in a frequency-tagging paradigm. Steady-state visual evoked potentials (ssVEPs) were evoked using random-dot kinematograms that consisted of rapidly flickering (8.57 Hz) dots, superimposed upon emotional or neutral distractor pictures flickering at 12 Hz. The time-varying amplitude of the ssVEP evoked by the motion detection task showed a significant reduction to the task-relevant stream while emotionally arousing pictures were presented as distractors. Competition between emotionally arousing pictures and moving dots began 450 ms after picture onset and persisted for an additional 2600 ms. Competitive effects of the overlapping task and picture stream revealed cost effects for the motion detection task when unpleasant pictures were presented as distractors between 450 and 1650 ms after picture onset, where an increase in ssVEP amplitude to the flickering picture stimulus was at the cost of ssVEP amplitude to the flickering dot stimulus. Cost effects were generalized to all emotionally arousing contents between 1850 and 3050 ms after picture onset, where the greatest amount of competition was evident for conditions in which emotionally arousing pictures, compared to neutral, served as distractors. In sum, the processing capacity of the visual system as measured by ssVEPs is limited, resulting in prioritized processing of emotionally relevant cues.

Losing Neutrality: The Neural Basis of Impaired Emotional Control without Sleep

Sleep deprivation has been shown recently to alter emotional processing possibly associated with reduced frontal regulation. Such impairments can ultimately fail adaptive attempts to regulate emotional processing (also known as cognitive control of emotion), although this hypothesis has not been examined directly. Therefore, we explored the influence of sleep deprivation on the human brain using two different cognitive-emotional tasks, recorded using fMRI and EEG. Both tasks involved irrelevant emotional and neutral distractors presented during a competing cognitive challenge, thus creating a continuous demand for regulating emotional processing. Results reveal that, although participants showed enhanced limbic and electrophysiological reactions to emotional distractors regardless of their sleep state, they were specifically unable to ignore neutral distracting information after sleep deprivation. As a consequence, sleep deprivation resulted in similar processing of neutral and negative distractors, thus disabling accurate emotional discrimination. As expected, these findings were further associated with a decrease in prefrontal connectivity patterns in both EEG and fMRI signals, reflecting a profound decline in cognitive control of emotion. Notably, such a decline was associated with lower REM sleep amounts, supporting a role for REM sleep in overnight emotional processing. Altogether, our findings suggest that losing sleep alters emotional reactivity by lowering the threshold for emotional activation, leading to a maladaptive loss of emotional neutrality. Significance statement: Sleep loss is known as a robust modulator of emotional reactivity, leading to increased anxiety and stress elicited by seemingly minor triggers. In this work, we aimed to portray the neural basis of these emotional impairments and their possible association with frontal regulation of emotional processing, also known as cognitive control of emotion. Using specifically suited EEG and fMRI tasks, we were able to show that sleep deprivation alters emotional reactivity by triggering enhanced processing of stimuli regarded previously as neutral. These changes were further accompanied by diminished frontal connectivity, reduced REM sleep, and poorer performance. Therefore, we suggest that sleep loss alters emotional reactivity by lowering the threshold for emotional activation, leading to a maladaptive loss of emotional neutrality.

Attentional enhancement for positive and negative tones at an early stage of auditory processing

We report an event-related potential (ERP) study based on the hypothesis that valenced (i.e., positive and/or negative) tones are prioritized over neutral ones at an early, perceptual stage of auditory processing. In order to avoid perceptual confounds, we induced valence experimentally during a learning phase by assigning positive, negative, and neutral valences to tone-frequencies in a balanced design. In a subsequent test phase, EEG was recorded while these tones were entirely task-irrelevant. The amplitude of the auditory N1 was increased for valenced compared with neutral tones, indicating enhanced attention. While behavioral results of the learning phase, and both implicit and explicit measures of tone evaluation indicated differentiation between positive and negative valence, there was no such differentiation on the N1 amplitude. Our results suggest that it is the general relevance of the valenced tones that governs early attentional processes.

Aroused with heart: Modulation of heartbeat evoked potential by arousal induction and its oscillatory correlates

Recent studies showed that the visceral information is constantly processed by the brain, thereby potentially influencing cognition. One index of such process is the heartbeat evoked potential (HEP), an ERP component related to the cortical processing of the heartbeat. The HEP is sensitive to a number of factors such as motivation, attention, pain, which are associated with higher levels of arousal. However, the role of arousal and its associated brain oscillations on the HEP has not been characterized, yet it could underlie the previous findings. Here we analysed the effects of high- (HA) and low-arousal (LA) induction on the HEP. Further, we investigated the brain oscillations and their role in the HEP in response to HA and LA inductions. As compared to LA, HA was associated with a higher HEP and lower alpha oscillations. Interestingly, individual differences in the HEP modulation by arousal induction were correlated with alpha oscillations. In particular, participants with higher alpha power during the arousal inductions showed a larger HEP in response to HA compared to LA. In summary, we demonstrated that arousal induction affects the cortical processing of heartbeats; and that the alpha oscillations may modulate this effect.

Promoting the translation of intentions into action by implementation intentions: behavioral effects and physiological correlates

The present review addresses the physiological correlates of planning effects on behavior. Although intentions to act qualify as predictors of behavior, accumulated evidence indicates that there is a substantial gap between even strong intentions and subsequent action. One effective strategy to reduce this intention–behavior gap is the formation of implementation intentions that specify when, where, and how to act on a given goal in an if-then format (“If I encounter situation Y, then I will initiate action Z!”). It has been proposed that implementation intentions render the mental representation of the situation highly accessible and establish a strong associative link between the mental representations of the situation and the action. These process assumptions have been examined in behavioral research, and in physiological research, a field that has begun to investigate the temporal dynamics of and brain areas involved in implementation intention effects. In the present review, we first summarize studies on the cognitive processes that are central to the strategic automation of action control by implementation intentions. We then examine studies involving critical samples with impaired self-regulation. Lastly, we review studies that have applied physiological measures such as heart rate, cortisol level, and eye movement, as well as electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) studies on the neural correlates of implementation intention effects. In support of the assumed processes, implementation intentions increased goal attainment in studies on cognitive processes and in critical samples, modulated brain waves related to perceptual and decision processes, and generated less activity in brain areas associated with effortful action control. In our discussion, we reflect on the status quo of physiological research on implementation intentions, methodological and conceptual issues, related research, and propose future directions.

Emotional arousal modulation of right temporoparietal cortex in depression depends on parental depression status in women: first evidence

BACKGROUND

Structural and Electroencephalography (EEG) abnormalities in right temporoparietal cortex have been associated with family history of depression (FH). Here we investigate if functional abnormalities in this area, indexed by attenuated responses to emotionally arousing stimuli, are also family-history-dependent.

METHODS

Neuromagnetic activity for emotional and neutral complex scenes was recorded by Magnetoencephalography (MEG) in 20 depressed patients without, 8 depressed patients with FH, and 15 healthy controls. Emotion-sensitive neuronal steady state responses were cortical source localized and tested for group-by-emotion interactions.

RESULTS

The group-by-emotion interaction (F(4, 80)=4.4, p=0.004) was explained by a significant modulation of right temporoparietal cortex activity by emotional arousal in controls and patients without FH. This effect was reduced in FH positive patients. The difference between patient groups remained when clinical variables such as symptom severity were accounted for.

LIMITATIONS

All patients were medicated, but differences between patient groups remained after accounting for medication dosage. Further, the sample size was limited, but data-driven resampling statistics showed the robustness of our effects. Finally, the sample consists of female patients only and we cannot generalize our results to male samples.

CONCLUSIONS

Patients with FH show impaired recruitment of attention-relevant cortical circuitry by emotional stimuli. The neuroanatomical locus of this effect accords with previous reports on structural abnormalities and electrophysiological deficits at rest in individuals with FH. Our results speak to the relevance of right temporoparietal dysfunction in emotional information processing as a potential endophenotype for depression with FH.

Affective facilitation of early visual cortex during rapid picture presentation at 6 and 15 Hz

The steady-state visual evoked potential (SSVEP), a neurophysiological marker of attentional resource allocation with its generators in early visual cortex, exhibits enhanced amplitude for emotional compared to neutral complex pictures. Emotional cue extraction for complex images is linked to the N1-EPN complex with a peak latency of ∼140-160 ms. We tested whether neural facilitation in early visual cortex with affective pictures requires emotional cue extraction of individual images, even when a stream of images of the same valence category is presented. Images were shown at either 6 Hz (167 ms, allowing for extraction) or 15 Hz (67 ms per image, causing disruption of processing by the following image). Results showed SSVEP amplitude enhancement for emotional compared to neutral images at a presentation rate of 6 Hz but no differences at 15 Hz. This was not due to featural differences between the two valence categories. Results strongly suggest that individual images need to be displayed for sufficient time allowing for emotional cue extraction to drive affective neural modulation in early visual cortex.

Does it matter how you ask? Self-reported emotions to depictions of need-of-help and social context

BACKGROUND

When humans observe other people's emotions they not only can relate but also experience similar affective states. This capability is seen as a precondition for helping and other prosocial behaviors. Our study aims to quantify the influence of help-related picture content on subjectively experienced affect. It also assesses the impact of different scales on the way people rate their emotional state.

METHODS

The participants (N=242) of this study were shown stimuli with help-related content. In the first subset, half the drawings depicted a child or a bird needing help to reach a simple goal. The other drawings depicted situations where the goal was achieved. The second subset showed adults either actively helping a child or as passive bystanders. We created control conditions by including pictures of the adults on their own. Participants were asked to report their affective responses to the stimuli using two types of 9-point scales. For one half of the pictures, scales of arousal (calm to excited) and of bipolar valence (unhappy to happy) were employed; for the other half, unipolar scales of pleasantness and unpleasantness (strong to absent) were used.

RESULTS

Even non-dramatic depictions of simple need-of-help situations were rated systematically lower in valence, higher in arousal, less pleasant and more unpleasant than corresponding pictures with the child or bird not needing help. The presence of a child and adult together increased pleasantness ratings compared to pictures in which they were depicted alone. Arousal was lower for pictures showing only an adult than for those including a child. Depictions of active helping were rated similarly to pictures showing a passive adult bystander, when the need-of-help was resolved. Aggregated unipolar pleasantness and unpleasantness ratings accounted well for arousal and even better for bipolar valence ratings and for content effects on them.

CONCLUSION

This is the first study to report upon the meaningful impact of harmless need-of-help content on self-reported emotional experience. It provides the basis for further investigating the links between subjective emotional experience and active prosocial behavior. It also builds upon recent findings on the correspondence between emotional ratings on bipolar and unipolar scales.

Sustained attention in context conditioning: Evidence from steady-state VEPs

In classical fear conditioning an aversive event is paired repeatedly with a predictive stimulus, which later elicits fear. Repeated presentation of an aversive event in the absence of a predictive cue however may induce anxiety, and the context may gain a threatening value. As such conditioned anxiety can be considered a sustained reaction compared to phasic fear, it would be interesting to track continuous cortical responses during context conditioning. The present study realized a differential context conditioning paradigm and assessed sustained cortical activations to the threatening and the safe context and how neutral cues are processed within both contexts. Two pictures of different office rooms presented for 20s served as contexts. One room became associated with an unpleasant noise that was presented unpredictably (CTX+) while the other office (CTX-) was never associated with this unpleasant noise. After acquisition, a social agent or an object was presented as a distractor in both contexts. Cortical activations in response to contexts and distractors were assessed separately by steady-state visually evoked potentials (ssVEPs) using frequency tagging. Results revealed enhanced ssVEP-amplitudes for CTX+ compared to CTX- in a lateral occipital cluster during acquisition. Similarly, CTX+ elicited higher ssVEP-amplitudes during the test phase, and these context conditioning effects were not reduced by the simultaneous presentation of novel distractors. These results indicate that context conditioning was successfully implemented and that the anxiety context received facilitated cortical processing across the whole viewing time. We conclude that threatening contexts capture attention over a longer period of time, and are immune to distraction by new objects.