Temporal trade-off effects in sustained attention: dynamics in visual cortex predict the target detection performance during distraction

How fear conditioning affects the visuocortical processing of context cues in humans. Evidence from steady state visual evoked responses

Previous research has focused on how different environments modulate fear learning and the accompanying prioritization of acquired threat cues in sensory cortices. Here, we focus on the other side of the coin and show how the acquisition of threat relevance influences the sensory processing of the environment and an associated context cue. Thereby, we observed that spatial suppression surrounding the focus of threat relevant cues extended by threat learning. By recording frequency-tagged steady-state visual evoked fields (ssVEFs) from 35 healthy participants using Magnetoencephalography (MEG), we replicate earlier findings that centrally presented acquired threat-relevant cues (CS+) evoke greater ssVEF responses, whereas visuocortical engagement during the processing of threat-irrelevant cues (CS-) is inhibited. Critically, as predicted by early computational models of threat learning such as the Rescorla-Wagner model, ssVEF responses to an inter-trial peripheral background flicker (context cue), when no CS was shown, increased linearly during learning. In contrast, visuocortical engagement in the early-tier visual cortex during the processing of the background flicker was strongly reduced during CS presentation in the last learning block. This effect was observed during maximal CS+ and CS- discrimination. However, in more anterior ventral visual cortex, the inhibition of oscillatory responses of the context cue occurred only during CS + trials, whereas during CS- trials, background ssVEF responses were increased. These results are in line with the notion that attentional resources are reallocated flexibly between cues of different threat relevance and that the spatial extension of center surround neuronal competition can be modulated by threat learning.

Quantifying population-level neural tuning functions using Ricker wavelets and the Bayesian bootstrap

BACKGROUND

Experience changes visuo-cortical tuning. In humans, re-tuning has been studied during aversive generalization learning, in which the similarity of generalization stimuli (GSs) with a conditioned threat cue (CS+) is used to quantify tuning functions. Previous work utilized pre-defined tuning shapes (generalization and sharpening patterns). This approach may constrain the ways in which re-tuning can be characterized since the tuning patterns may not match the prototypical functions.

NEW METHOD

The present study proposes a flexible and data-driven method for precisely quantifying changes in tuning based on the Ricker wavelet function and the Bayesian bootstrap. This method was applied to EEG and psychophysics data from an aversive generalization learning paradigm.

RESULTS

The Ricker wavelet model fitted the steady-state visual event potentials (ssVEP), alpha-band power, and detection accuracy data well. A Morlet wavelet function was used for comparison and fit the data better in some situations, but was more challenging to interpret. The pattern of re-tuning in the EEG data, predicted by the Ricker model, resembled the shapes of the best fitting a-priori patterns.

COMPARISON WITH EXISTING METHODS

Although the re-tuning shape modeled by the Ricker function resembled the pre-defined shapes, the Ricker approach led to greater Bayes factors and more interpretable results compared to a-priori models. The Ricker approach was more easily fit and led to more interpretable results than a Morlet wavelet model.

CONCLUSION

This work highlights the promise of the current method for capturing the precise nature of visuo-cortical tuning, unconstrained by the implementation of a-priori models.

Quantifying Population-level Neural Tuning Functions Using Ricker Wavelets and the Bayesian Bootstrap

Experience changes the tuning of sensory neurons, including neurons in retinotopic visual cortex, as evident from work in humans and non-human animals. In human observers, visuo-cortical re-tuning has been studied during aversive generalization learning paradigms, in which the similarity of generalization stimuli (GSs) with a conditioned threat cue (CS+) is used to quantify tuning functions. This work utilized pre-defined tuning shapes reflecting prototypical generalization (Gaussian) and sharpening (Difference-of-Gaussians) patterns. This approach may constrain the ways in which re-tuning can be characterized, for example if tuning patterns do not match the prototypical functions or represent a mixture of functions. The present study proposes a flexible and data-driven method for precisely quantifying changes in neural tuning based on the Ricker wavelet function and the Bayesian bootstrap. The method is illustrated using data from a study in which university students (n = 31) performed an aversive generalization learning task. Oriented gray-scale gratings served as CS+ and GSs and a white noise served as the unconditioned stimulus (US). Acquisition and extinction of the aversive contingencies were examined, while steady-state visual event potentials (ssVEP) and alpha-band (8-13 Hz) power were measured from scalp EEG. Results showed that the Ricker wavelet model fitted the ssVEP and alpha-band data well. The pattern of re-tuning in ssVEP amplitude across the stimulus gradient resembled a generalization (Gaussian) shape in acquisition and a sharpening (Difference-of-Gaussian) shape in an extinction phase. As expected, the pattern of re-tuning in alpha-power took the form of a generalization shape in both phases. The Ricker-based approach led to greater Bayes factors and more interpretable results compared to prototypical tuning models. The results highlight the promise of the current method for capturing the precise nature of visuo-cortical tuning functions, unconstrained by the exact implementation of prototypical a-priori models.

No Evidence That Working Memory Modulates the Plasticity of the Nociceptive System, as Measured by Secondary Mechanical Hypersensitivity

The effect of cognition on the plasticity of the nociceptive system remains controversial. In this study, we examined whether working memory can buffer against the development of secondary hypersensitivity. Thirty-five healthy women participated in 3 experimental conditions. In each condition, they underwent electrical stimulation of the skin for 2 minutes (middle-frequency electrical stimulation [MFS]), which induces secondary hypersensitivity. During MFS, participants executed either an individually tailored and rewarded n-back task (working memory condition), a rewarded reaction-time task (non-working memory condition), or no task at all (control condition). Before and after MFS, participants rated the self-reported intensity and unpleasantness of mechanical pinprick stimuli. Fear of MFS was also assessed. Heart rate variability was measured to examine potential differences between the 3 conditions and steady-state evoked potentials to the electrical stimulation were recorded to investigate differences in cortical responses. We report no significant difference in hypersensitivity between the 3 conditions. Moreover, engaging in the cognitive tasks did not affect the heart rate variability or the steady-state evoked potentials. Interestingly, higher fear of MFS predicted greater hypersensitivity. In conclusion, we found no evidence that working memory affects the plasticity of the nociceptive system, yet pain-related fear plays a role. PERSPECTIVE: This study shows that the execution of a cognitive task, irrespective of cognitive load or working memory, does not significantly modulate the development of secondary hypersensitivity, heart rate variability, or steady-state evoked potentials. However, higher pain-related fear seems to contribute to greater hypersensitivity.

The FreqTag toolbox: A principled approach to analyzing electrophysiological time series in frequency tagging paradigms

Steady-state visual evoked potential (ssVEP) frequency tagging is an increasingly used method in electrophysiological studies of visual attention and perception. Frequency tagging is suitable for studies examining a wide range of populations, including infants and children. Frequency tagging involves the presentation of different elements of a visual array at different temporal rates, thus using stimulus timing to “tag” the brain response to a given element by means of a unique time signature. Leveraging the strength of the ssVEP frequency tagging method to isolate brain responses to concurrently presented and spatially overlapping visual objects requires specific signal processing methods. Here, we introduce the FreqTag suite of functions, an open source MATLAB toolbox. The purpose of the FreqTag toolbox is three-fold. First, it will equip users with a set of transparent and reproducible analytical tools for the analysis of ssVEP data. Second, the toolbox is designed to illustrate fundamental features of frequency domain and time-frequency domain approaches. Finally, decision criteria for the application of different functions and analyses are described. To promote reproducibility, raw algorithms are provided in a modular fashion, without additional hidden functions or transformations. This approach is intended to facilitate a fundamental understanding of the transformations and algorithmic steps in FreqTag, and to allow users to visualize and test each step in the toolbox.

Effects of Experience on Spatial Frequency Tuning in the Visual System: Behavioral, Visuocortical, and Alpha-band Responses

Using electrophysiology and a classic fear conditioning paradigm, this work examined adaptive visuocortical changes in spatial frequency tuning in a sample of 50 undergraduate students. High-density EEG was recorded while participants viewed 400 total trials of individually presented Gabor patches of 10 different spatial frequencies. Patches were flickered to produce sweep steady-state visual evoked potentials (ssVEPs) at a temporal frequency of 13.33 Hz, with stimulus contrast ramping up from 0% to 41% Michelson over the course of each 2800-msec trial. During the final 200 trials, a selected range of Gabor stimuli (either the lowest or highest spatial frequencies, manipulated between participants) were paired with an aversive 90-dB white noise auditory stimulus. Changes in spatial frequency tuning from before to after conditioning for paired and unpaired gratings were evaluated at the behavioral and electrophysiological level. Specifically, ssVEP amplitude changes were evaluated for lateral inhibition and generalization trends, whereas change in alpha band (8-12 Hz) activity was tested for a generalization trend across spatial frequencies, using permutation-controlled F contrasts. Overall time courses of the sweep ssVEP amplitude envelope and alpha-band power were orthogonal, and ssVEPs proved insensitive to spatial frequency conditioning. Alpha reduction (blocking) was most pronounced when viewing fear-conditioned spatial frequencies, with blocking decreasing along the gradient of spatial frequencies preceding conditioned frequencies, indicating generalization across spatial frequencies. Results suggest that alpha power reduction-conceptually linked to engagement of attention and alertness/arousal mechanisms-to fear-conditioned stimuli operates independently of low-level spatial frequency processing (indexed by ssVEPs) in primary visual cortex.

Functional Source Separation for EEG-fMRI Fusion: Application to Steady-State Visual Evoked Potentials

Neurorobotics is one of the most ambitious fields in robotics, driving integration of interdisciplinary data and knowledge. One of the most productive areas of interdisciplinary research in this area has been the implementation of biologically-inspired mechanisms in the development of autonomous systems. Specifically, enabling such systems to display adaptive behavior such as learning from good and bad outcomes, has been achieved by quantifying and understanding the neural mechanisms of the brain networks mediating adaptive behaviors in humans and animals. For example, associative learning from aversive or dangerous outcomes is crucial for an autonomous system, to avoid dangerous situations in the future. A body of neuroscience research has suggested that the neurocomputations in the human brain during associative learning involve re-shaping of sensory responses. The nature of these adaptive changes in sensory processing during learning however are not yet well enough understood to be readily implemented into on-board algorithms for robotics application. Toward this overall goal, we record the simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), characterizing one candidate mechanism, i.e., large-scale brain oscillations. The present report examines the use of Functional Source Separation (FSS) as an optimization step in EEG-fMRI fusion that harnesses timing information to constrain the solutions that satisfy physiological assumptions. We applied this approach to the voxel-wise correlation of steady-state visual evoked potential (ssVEP) amplitude and blood oxygen level-dependent imaging (BOLD), across both time series. The results showed the benefit of FSS for the extraction of robust ssVEP signals during simultaneous EEG-fMRI recordings. Applied to data from a 3-phase aversive conditioning paradigm, the correlation maps across the three phases (habituation, acquisition, extinction) show converging results, notably major overlapping areas in both primary and extended visual cortical regions, including calcarine sulcus, lingual cortex, and cuneus. In addition, during the acquisition phase when aversive learning occurs, we observed additional correlations between ssVEP and BOLD in the anterior cingulate cortex (ACC) as well as the precuneus and superior temporal gyrus.

Pre-target alpha power predicts the speed of cued target discrimination

The human visual system selects information from dense and complex streams of spatiotemporal input. This selection process is aided by prior knowledge of the features, location, and temporal proximity of an upcoming stimulus. In the laboratory, this knowledge is often conveyed by cues, preceding a task-relevant target stimulus. Response speed in cued selection tasks varies within and across participants and is often thought to index efficient selection of a cued feature, location, or moment in time. The present study used a reverse correlation approach to identify neural predictors of efficient target discrimination: Participants identified the orientation of a sinusoidal grating, which was presented in one hemifield following the presentation of bilateral visual cues that carried temporal but not spatial information about the target. Across different analytic approaches, faster target responses were predicted by larger alpha power preceding the target. These results suggest that heightened pre-target alpha power during a cue period may index a state that is beneficial for subsequent target processing. Our findings are broadly consistent with models that emphasize capacity sharing across time, as well as models that link alpha oscillations to temporal predictions regarding upcoming events.

Affectively Biased Competition: Sustained Attention is Tuned to Rewarding Expressions and is Not Modulated by Norepinephrine Receptor Gene Variant

It is well established that emotionally salient stimuli evoke greater visual cortex activation than neutral ones, and can distract attention from competing tasks. Yet less is known about underlying neurobiological processes. As a proxy of population level biased competition, EEG steady-state visual evoked potentials are sensitive to competition effects from salient stimuli. Here we wished to examine whether individual differences in norepinephrine activity play a role in emotionally-biased competition.

Our previous research has found robust effects of a common variation in the ADRA2B gene, coding for alpha2B norepinephrine (NE) receptors, on emotional modulation of attention and memory. In the present study, EEG was collected while 87 carriers of the ADRA2B deletion variant and 95 non-carriers (final sample) performed a change detection task in which target gratings (gabor patches) were superimposed directly over angry, happy, and neutral faces. Participants indicated the number of phase changes (0–3) in the target. Overlapping targets and distractors were flickered at a distinct driving frequencies. Relative EEG power for faces vs. targets at the driving frequency served as an index of cortical resources allocated to each of the competing stimuli. Deletion carriers and non-carriers were randomly assigned to Discovery and Replication samples and reliability of results across samples was assessed before the groups were combined for greater power.

Overall happy faces evoked higher competition than angry or neutral faces; however, we observed no hypothesized effects of ADRA2B. Increased competition from happy faces was not due to the effect of low-level visual features or individuals low in social anxiety. Our results indicate that emotionally biased competition during sustained attention, while reliably observed in young adults, is not influenced by commonly observed individual differences linked to NE receptor function. They further indicate an overall pattern of affectively-biased competition for happy faces, which we interpret in relation to previously observed boundary conditions.

Attention flexibly trades off across points in time

Sensory signals continuously enter the brain, raising the question of how perceptual systems handle this constant flow of input. Attention to an anticipated point in time can prioritize visual information at that time. However, how we voluntarily attend across time when there are successive task-relevant stimuli has been barely investigated. We developed a novel experimental protocol that allowed us to assess, for the first time, both the benefits and costs of voluntary temporal attention when perceiving a short sequence of two or three visual targets with predictable timing. We found that when humans directed attention to a cued point in time, their ability to perceive orientation was better at that time but also worse earlier and later. These perceptual tradeoffs across time are analogous to those found across space for spatial attention. We concluded that voluntary attention is limited, and selective, across time.

Hypervigilance during anxiety and selective attention during fear: Using steady-state visual evoked potentials (ssVEPs) to disentangle attention mechanisms during predictable and unpredictable threat

Anxiety is induced by unpredictable threat, and presumably characterized by enhanced vigilance. In contrast, fear is elicited by imminent threat, and leads to phasic responses with selective attention. In order to investigate attention mechanisms and defensive responding during fear and anxiety, we employed an adaptation of the NPU-threat test and measured cortical (steady-state visual evoked potentials, ssVEPs), physiological (heart rate, HR), and subjective responses (ratings) to predictable (fear-related) and unpredictable (anxiety-related) threat in 42 healthy participants. An aversive unconditioned stimulus (US, loud noise) was 100% predicted by a cue (predictable P-cue) in one context (predictable P-context), but appeared unpredictably within a different context (unpredictable U-context, U-cue), while it was never delivered in a neutral safe context (N-cue, N- context). In response to predictable threat (P-cue), increased ssVEP amplitudes and accelerated HR were found. Both predictable and unpredictable contexts yielded increased ssVEP amplitudes compared to the safe context. Interestingly, in the unpredictable context participants showed longer-lasting visuocortical activation than in the predictable context, supporting the notion of heightened vigilance during anxiety. In parallel, HR decelerated to both threat contexts indicating fear bradycardia to these threatening contexts as compared to the safe context. These results support the idea of hypervigilance in anxiety-like situations reflected in a long-lasting facilitated processing of sensory information, in contrast to increased selective attention to specific imminent threat during fear. Thus, this study further supports the defense-cascade model with vigilance and orienting in the post-encounter phase of threat (anxiety), while selective attention and defensive mobilization in the circa-strike phase of threat (fear).

What does the dot-probe task measure? A reverse correlation analysis of electrocortical activity

The dot-probe task is considered a gold standard for assessing the intrinsic attentive selection of one of two lateralized visual cues, measured by the response time to a subsequent, lateralized response probe. However, this task has recently been associated with poor reliability and conflicting results. To resolve these discrepancies, we tested the underlying assumption of the dot-probe task-that fast probe responses index heightened cue selection-using an electrophysiological measure of selective attention. Specifically, we used a reverse correlation approach in combination with frequency-tagged steady-state visual potentials (ssVEPs). Twenty-one participants completed a modified dot-probe task in which each member of a pair of lateralized face cues, varying in emotional expression (angry-angry, neutral-angry, neutral-neutral), flickered at one of two frequencies (15 or 20 Hz), to evoke ssVEPs. One cue was then replaced by a response probe, and participants indicated the probe orientation (0° or 90°). We analyzed the ssVEP evoked by the cues as a function of response speed to the subsequent probe (i.e., a reverse correlation analysis). Electrophysiological measures of cue processing varied with probe hemifield location: Faster responses to left probes were associated with weak amplification of the preceding left cue, apparent only in a median split analysis. By contrast, faster responses to right probes were systematically and parametrically predicted by diminished visuocortical selection of the preceding right cue. Together, these findings highlight the poor validity of the dot-probe task, in terms of quantifying intrinsic, nondirected attentive selection irrespective of probe/cue location.

Steady-state visual evoked potentials as a research tool in social affective neuroscience

Like many other primates, humans place a high premium on social information transmission and processing. One important aspect of this information concerns the emotional state of other individuals, conveyed by distinct visual cues such as facial expressions, overt actions, or by cues extracted from the situational context. A rich body of theoretical and empirical work has demonstrated that these socioemotional cues are processed by the human visual system in a prioritized fashion, in the service of optimizing social behavior. Furthermore, socioemotional perception is highly dependent on situational contexts and previous experience. Here, we review current issues in this area of research and discuss the utility of the steady-state visual evoked potential (ssVEP) technique for addressing key empirical questions. Methodological advantages and caveats are discussed with particular regard to quantifying time-varying competition among multiple perceptual objects, trial-by-trial analysis of visual cortical activation, functional connectivity, and the control of low-level stimulus features. Studies on facial expression and emotional scene processing are summarized, with an emphasis on viewing faces and other social cues in emotional contexts, or when competing with each other. Further, because the ssVEP technique can be readily accommodated to studying the viewing of complex scenes with multiple elements, it enables researchers to advance theoretical models of socioemotional perception, based on complex, quasinaturalistic viewing situations.

State dependency of inhibitory control performance: an electrical neuroimaging study

Behavioral and brain responses to stimuli not only depend on their physical features but also on the individuals' neurocognitive states before stimuli onsets. While the influence of pre-stimulus fluctuations in brain activity on low-level perceptive processes is well established, the state dependency of high-order executive processes remains unclear. Using a classical inhibitory control Go/NoGo task, we examined whether and how fluctuations in the brain activity during the period preceding the stimuli triggering inhibition influenced inhibitory control performance. Seventeen participants completed the Go/NoGo task while 64-channel electroencephalogram was recorded. We compared the event-related potentials preceding the onset of the NoGo stimuli associated with inhibition failures false alarms (FA) vs. successful inhibition correct rejections (CR) with data-driven statistical analyses of global measures of the topography and strength of the scalp electric field. Distributed electrical source estimations were used to localize the origin of the event-related potentials modulations. We observed differences in the global field power of the event-related potentials (FA > CR) without concomitant topographic modulations over the 40 ms period immediately preceding NoGo stimuli. This result indicates that the same brain networks were engaged in the two conditions, but more strongly before FA than CR. Source estimations revealed that this effect followed from a higher activity before FA than CR within bilateral inferior frontal gyri and the right inferior parietal lobule. These findings suggest that uncontrolled quantitative variations in pre-stimulus activity within attentional and control brain networks influence inhibition performance. The present data thereby demonstrate the state dependency of cognitive processes of up to high-order executive levels.

Pre-target oscillatory brain activity and the attentional blink

Reporting the second of two targets within a stream of distracting words during rapid serial visual presentation (RSVP) is impaired when the targets are separated by a single distractor word, a deficit in temporal attention that has been referred to as the attentional blink (AB). Recent conceptual and empirical work has pointed to pre-target brain states as potential mediators of the AB effect. The current study examined differences in pre-target electrophysiology between correctly and incorrectly reported trials, considering amplitude and phase measures of alpha oscillations as well as the steady-state visual evoked potential (ssVEP) evoked by the RSVP stream. For incorrectly reported trials, relatively lower alpha-band power and greater ssVEP inter-trial phase locking were observed during extended time periods preceding presentation of the first target. These results suggest that facilitated processing of the pre-target distracter stream indexed by reduced alpha and heightened phase locking characterizes a dynamic brain state that predicts lower accuracy in terms of reporting the second target under strict temporal constraints. Findings align with hypotheses in which the AB effect is attributed to neurocognitive factors such as fluctuations in pre-target attention or to cognitive strategies applied at the trial level.

Aversive learning shapes neuronal orientation tuning in human visual cortex

The responses of sensory cortical neurons are shaped by experience. As a result perceptual biases evolve, selectively facilitating the detection and identification of sensory events that are relevant for adaptive behaviour. Here we examine the involvement of human visual cortex in the formation of learned perceptual biases. We use classical aversive conditioning to associate one out of a series of oriented gratings with a noxious sound stimulus. After as few as two grating-sound pairings, visual cortical responses to the sound-paired grating show selective amplification. Furthermore, as learning progresses, responses to the orientations with greatest similarity to the sound-paired grating are increasingly suppressed, suggesting inhibitory interactions between orientation-selective neuronal populations. Changes in cortical connectivity between occipital and fronto-temporal regions mirror the changes in visuo-cortical response amplitudes. These findings suggest that short-term behaviourally driven retuning of human visual cortical neurons involves distal top–down projections as well as local inhibitory interactions.

Sensory cortical tuning is shaped by experience to facilitate coding of features that are predictive of behaviourally relevant outcomes. Here the authors demonstrate that rapid behaviourally driven retuning of human visual cortex involves top–down projections as well as local inhibitory interactions.

Sustained attention in context conditioning: Evidence from steady-state VEPs

In classical fear conditioning an aversive event is paired repeatedly with a predictive stimulus, which later elicits fear. Repeated presentation of an aversive event in the absence of a predictive cue however may induce anxiety, and the context may gain a threatening value. As such conditioned anxiety can be considered a sustained reaction compared to phasic fear, it would be interesting to track continuous cortical responses during context conditioning. The present study realized a differential context conditioning paradigm and assessed sustained cortical activations to the threatening and the safe context and how neutral cues are processed within both contexts. Two pictures of different office rooms presented for 20s served as contexts. One room became associated with an unpleasant noise that was presented unpredictably (CTX+) while the other office (CTX-) was never associated with this unpleasant noise. After acquisition, a social agent or an object was presented as a distractor in both contexts. Cortical activations in response to contexts and distractors were assessed separately by steady-state visually evoked potentials (ssVEPs) using frequency tagging. Results revealed enhanced ssVEP-amplitudes for CTX+ compared to CTX- in a lateral occipital cluster during acquisition. Similarly, CTX+ elicited higher ssVEP-amplitudes during the test phase, and these context conditioning effects were not reduced by the simultaneous presentation of novel distractors. These results indicate that context conditioning was successfully implemented and that the anxiety context received facilitated cortical processing across the whole viewing time. We conclude that threatening contexts capture attention over a longer period of time, and are immune to distraction by new objects.

Electrocortical amplification for emotionally arousing natural scenes: the contribution of luminance and chromatic visual channels

Emotionally arousing scenes readily capture visual attention, prompting amplified neural activity in sensory regions of the brain. The physical stimulus features and related information channels in the human visual system that contribute to this modulation, however, are not known. Here, we manipulated low-level physical parameters of complex scenes varying in hedonic valence and emotional arousal in order to target the relative contributions of luminance based versus chromatic visual channels to emotional perception. Stimulus-evoked brain electrical activity was measured during picture viewing and used to quantify neural responses sensitive to lower-tier visual cortical involvement (steady-state visual evoked potentials) as well as the late positive potential, reflecting a more distributed cortical event. Results showed that the enhancement for emotional content was stimulus-selective when examining the steady-state segments of the evoked visual potentials. Response amplification was present only for low spatial frequency, grayscale stimuli, and not for high spatial frequency, red/green stimuli. In contrast, the late positive potential was modulated by emotion regardless of the scene's physical properties. Our findings are discussed in relation to neurophysiologically plausible constraints operating at distinct stages of the cortical processing stream.

The steady-state visual evoked potential in vision research: A review

Periodic visual stimulation and analysis of the resulting steady-state visual evoked potentials were first introduced over 80 years ago as a means to study visual sensation and perception. From the first single-channel recording of responses to modulated light to the present use of sophisticated digital displays composed of complex visual stimuli and high-density recording arrays, steady-state methods have been applied in a broad range of scientific and applied settings.The purpose of this article is to describe the fundamental stimulation paradigms for steady-state visual evoked potentials and to illustrate these principles through research findings across a range of applications in vision science.

Raised middle-finger: electrocortical correlates of social conditioning with nonverbal affective gestures

Humans form impressions of others by associating persons (faces) with negative or positive social outcomes. This learning process has been referred to as social conditioning. In everyday life, affective nonverbal gestures may constitute important social signals cueing threat or safety, which therefore may support aforementioned learning processes. In conventional aversive conditioning, studies using electroencephalography to investigate visuocortical processing of visual stimuli paired with danger cues such as aversive noise have demonstrated facilitated processing and enhanced sensory gain in visual cortex. The present study aimed at extending this line of research to the field of social conditioning by pairing neutral face stimuli with affective nonverbal gestures. To this end, electro-cortical processing of faces serving as different conditioned stimuli was investigated in a differential social conditioning paradigm. Behavioral ratings and visually evoked steady-state potentials (ssVEP) were recorded in twenty healthy human participants, who underwent a differential conditioning procedure in which three neutral faces were paired with pictures of negative (raised middle finger), neutral (pointing), or positive (thumbs-up) gestures. As expected, faces associated with the aversive hand gesture (raised middle finger) elicited larger ssVEP amplitudes during conditioning. Moreover, theses faces were rated as to be more arousing and unpleasant. These results suggest that cortical engagement in response to faces aversively conditioned with nonverbal gestures is facilitated in order to establish persistent vigilance for social threat-related cues. This form of social conditioning allows to establish a predictive relationship between social stimuli and motivationally relevant outcomes.

Intrinsic fluctuations in sustained attention and distractor processing

Although sustaining a moderate level of attention is critical in daily life, evidence suggests that attention is not deployed consistently, but rather fluctuates from moment to moment between optimal and suboptimal states. To better characterize these states in humans, the present study uses a gradual-onset continuous performance task with irrelevant background distractors to explore the relationship among behavioral fluctuations, brain activity, and, in particular, the processing of visual distractors. Using fMRI, we found that reaction time variability, a continuous measure of attentional instability, was positively correlated with activity in task-positive networks and negatively correlated with activity in the task-negative default mode network. We also observed greater processing of distractor images during more stable and less error prone "in the zone" epochs compared with suboptimal "out of the zone" epochs of the task. Overall, the data suggest that optimal states of attention are accomplished with more efficient and potentially less effortful recruitment of task-relevant resources, freeing remaining resources to process task irrelevant features of the environment.

Escape from harm: linking affective vision and motor responses during active avoidance

When organisms confront unpleasant objects in their natural environments, they engage in behaviors that allow them to avoid aversive outcomes. Here, we linked visual processing of threat to its behavioral consequences by including a motor response that terminated exposure to an aversive event. Dense-array steady-state visual evoked potentials were recorded in response to conditioned threat and safety signals viewed in active or passive behavioral contexts. The amplitude of neuronal responses in visual cortex increased additively, as a function of emotional value and action relevance. The gain in local cortical population activity for threat relative to safety cues persisted when aversive reinforcement was behaviorally terminated, suggesting a lingering emotionally based response amplification within the visual system. Distinct patterns of long-range neural synchrony emerged between the visual cortex and extravisual regions. Increased coupling between visual and higher-order structures was observed specifically during active perception of threat, consistent with a reorganization of neuronal populations involved in linking sensory processing to action preparation.

Fearful faces heighten the cortical representation of contextual threat

Perception of facial expressions is typically investigated by presenting isolated face stimuli. In everyday life, however, faces are rarely seen without a surrounding visual context that affects perception and interpretation of the facial expression. Conversely, fearful faces may act as a cue, heightening the sensitivity of the visual system to effectively detect potential threat in the environment. In the present study, we used steady-state visually evoked potentials (ssVEPs) to examine the mutual effects of facial expressions (fearful, neutral, happy) and affective visual context (pleasant, neutral, threat). By assigning two different flicker frequencies (12 vs. 15Hz) to the face and the visual context scene, cortical activity to the concurrent stimuli was separated, which represents a novel approach to independently tracking the cortical processes associated with the face and the context. Twenty healthy students viewed flickering faces overlaid on flickering visual scenes, while performing a simple change-detection task at fixation, and high-density EEG was recorded. Arousing background scenes generally drove larger ssVEP amplitudes than neutral scenes. Importantly, background and expression interacted: When viewing fearful facial expressions, the ssVEP in response to threat context was amplified compared to other backgrounds. Together, these findings suggest that fearful faces elicit vigilance for potential threat in the visual periphery.

Luminance, but not chromatic visual pathways, mediate amplification of conditioned danger signals in human visual cortex

Complex organisms rely on experience to optimize the function of perceptual and motor systems in situations relevant to survival. It is well established that visual cues reliably paired with danger are processed more efficiently than neutral cues, and that such facilitated sensory processing extends to low levels of the visual system. The neurophysiological mechanisms mediating biased sensory processing, however, are not well understood. Here we used grating stimuli specifically designed to engage luminance or chromatic pathways of the human visual system in a differential classical conditioning paradigm. Behavioral ratings and visual electroencephalographic steady-state potentials were recorded in healthy human participants. Our findings indicate that the visuocortical response to high-spatial-frequency isoluminant (red-green) grating stimuli was not modulated by fear conditioning, but low-contrast, low-spatial-frequency reversal of grayscale gratings resulted in pronounced conditioning effects. We conclude that sensory input conducted via the chromatic pathways into retinotopic visual cortex has limited access to the bi-directional connectivity with brain networks mediating the acquisition and expression of fear, such as the amygdaloid complex. Conversely, luminance information is necessary to establish amplification of learned danger signals in hierarchically early regions of the visual system.

Face-evoked steady-state visual potentials: effects of presentation rate and face inversion

Face processing can be explored using electrophysiological methods. Research with event-related potentials has demonstrated the so-called face inversion effect, in which the N170 component is enhanced in amplitude and latency to inverted, compared to upright, faces. The present study explored the extent to which repetitive lower-level visual cortical engagement, reflected in flicker steady-state visual evoked potentials (ssVEPs), shows similar amplitude enhancement to face inversion. We also asked if inversion-related ssVEP modulation would be dependent on the stimulation rate at which upright and inverted faces were flickered. To this end, multiple tagging frequencies were used (5, 10, 15, and 20 Hz) across two studies (n = 21, n = 18). Results showed that amplitude enhancement of the ssVEP for inverted faces was found solely at higher stimulation frequencies (15 and 20 Hz). By contrast, lower frequency ssVEPs did not show this inversion effect. These findings suggest that stimulation frequency affects the sensitivity of ssVEPs to face inversion.

Orienting and emotional perception: facilitation, attenuation, and interference

Human emotions are considered here to be founded on motivational circuits in the brain that evolved to protect (defensive) and sustain (appetitive) the life of individuals and species. These circuits are phylogenetically old, shared among mammals, and involve the activation of both subcortical and cortical structures that mediate attention, perception, and action. Circuit activation begins with a feature-match between a cue and an existing representation in memory that has motivational significance. Subsequent processes include rapid cue-directed orienting, information gathering, and action selection - What is it? Where is it? What to do? In our studies of emotional perception, we have found that measures that index orienting to emotional cues generally show enhanced circuit activation and response facilitation, relative to orienting indicators occasioned by affectively neutral cues, whether presented concurrently or independently. Here, we discuss these findings, considering both physiological reflex and brain measures as they are modulated during orienting and emotional perception.

Acquired fears reflected in cortical sensory processing: a review of electrophysiological studies of human classical conditioning

The capacity to associate neutral stimuli with affective value is an important survival strategy that can be accomplished by cell assemblies obeying Hebbian learning principles. In the neuroscience laboratory, classical fear conditioning has been extensively used as a model to study learning-related changes in neural structure and function. Here, we review the effects of classical fear conditioning on electromagnetic brain activity in humans, focusing on how sensory systems adapt to changing fear-related contingencies. By considering spatiotemporal patterns of mass neuronal activity, we illustrate a range of cortical changes related to a retuning of neuronal sensitivity to amplify signals consistent with fear-associated stimuli at the cost of other sensory information. Putative mechanisms that may underlie fear-associated plasticity at the level of the sensory cortices are briefly considered, and several avenues for future work are outlined.

Competition effects of threatening faces in social anxiety

Threatening faces involuntarily grab attention in socially anxious individuals. It is unclear, however, whether attention capture is at the expense of concurrent visual processing. The current study examined the perceptual cost effects of viewing fear-relevant stimuli (threatening faces) relative to a concurrent change-detection task. Steady-state visual evoked potentials (ssVEPs) were used to separate the neural response to 2 fully overlapping types of stimuli flickering at different frequencies: Task-irrelevant facial expressions (angry, neutral, happy) were overlaid with a task-relevant Gabor patch stream, which required a response to rare phase reversals. Groups of 17 high and 17 low socially anxious observers were recruited through online prescreening of 849 students. A prominent competition effect of threatening faces was observed solely in elevated social anxiety: When an angry face, relative to a neutral or happy face, served as a distractor, heightened ssVEP amplitudes were seen at the tagging frequency of that facial expression. Simultaneously, the ssVEP evoked by the task-relevant Gabor grating was reliably diminished compared with conditions with neutral or happy distractor faces. Thus, threatening faces capture and hold low-level perceptual resources in viewers symptomatic for social anxiety at the cost of a concurrent primary task. It is important to note that this competition in lower tier visual cortex was maintained throughout the viewing period and was unaccompanied by competition effects on behavioral performance.

Phase re-setting of gamma neural oscillations during novelty processing in an appetitive context

Based on the previous study where phase-synchronization (PS) of gamma-band responses (GBRs) proved a reliable cerebral correlate of involuntary attention and its enhancement under threat, we measured gamma-PS elicited by novel sounds from human electroencephalogram (EEG) scalp-recordings when participants responded to visual stimuli displaying either highly motivational or neutral sceneries. We then tested the modulatory effect of the emotional conditions on auditory responses. Novel distractor sounds did not affect behavioural accuracy on subjects' visual task performance in neutral context but markedly decreased hit rate in the appetitive one. Similarly, gamma-PS to novel sounds remained intact in neutral context, whereas it showed an increase, within the 35-Hz sub-range, in the appetitive context. These results suggest that a context of processing positive emotional stimuli results into an enhanced processing of task-irrelevant novel auditory events, and, furthermore, that gamma-PS is tuned under conditions that could promote long-term survival.