Integrating electrophysiology and neuroimaging of spatial selective attention to simple isolated visual stimuli

Crossmodal visual predictions elicit spatially specific early visual cortex activity but later than real visual stimuli

Previous studies have indicated that crossmodal visual predictions are instrumental in controlling early visual cortex activity. The exact time course and spatial precision of such crossmodal top-down influences on the visual cortex have been unknown. In the present study, participants were exposed to audiovisual combinations comprising one of two sounds and a Gabor patch either in the top left or in the bottom right visual field. Event-related potentials (ERPs) were recorded to these frequent crossmodal combinations (standards) as well as to trials in which the visual stimulus was omitted (omissions) or the visual and auditory stimuli were recombined (deviants). Standards and deviants elicited an ERP between 50 and 100 ms of opposite polarity known as the C1 effect commonly associated with retinotopic processing in early visual cortex. By contrast, a C1 effect was not observed in omission trials. Spatially specific omission and mismatch effects (deviants minus standards) started only later with a latency of 230 ms and 170 ms, respectively. These results suggest that crossmodal visual predictions control visual cortex activity in a spatially specific manner. However, visual predictions do not modulate visual cortex activity with the same timing as visual stimulation activates these areas but rather seem to involve distinct neural mechanisms. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Attention modulates topology and dynamics of auditory sensory gating

This work challenges the widely accepted model of sensory gating as a preattention inhibitory process by investigating whether attention directed at the second tone (S2) within a paired-click paradigm could affect gating at the cortical level. We utilized magnetoencephalography, magnetic resonance imaging and spatio-temporal source localization to compare the cortical dynamics underlying gating responses across two conditions (passive and attention) in 19 healthy subjects. Source localization results reaffirmed the existence of a fast processing pathway between the prefrontal cortex (PFC) and bilateral superior temporal gyri (STG) that underlies the auditory gating process. STG source dynamics comprised two gating sub-components, Mb1 and Mb2, both of which showed significant gating suppression (>51%). The attention directed to the S2 tone changed the gating network topology by switching the prefrontal generator from a dorsolateral location, which was active in the passive condition (18/19), to a medial location, active in the attention condition (19/19). Enhanced responses to the attended stimulus caused a significant reduction in gating suppression in both STG gating components (>50%). Our results demonstrate that attention not only modulates sensory gating dynamics, but also exerts topological rerouting of information processing within the PFC. The present data, suggesting that the cortical levels of early sensory processing are subject to top-down influences, change the current view of gating as a purely automatic bottom-up process.

Automatic Conflict Monitoring by Event-Related Potentials Could be used to Estimate Visual Acuity Levels

Numerous studies have explored the physical attribute features or face perceptions in conflict processing, while complicate gradient conflicts were rarely discussed. The aim of the study was to discuss the relationship between the event-related potential (ERP) component features and different visual acuity levels by using the modified S1-S2 task under non-attention status. Three visual acuity levels were applied, each with four orientations of "E" optotype stimuli randomly presented in the center of the visual field while participants were required to concentrate on listening to stories. The results showed that the amplitudes of P1 and P3 as well as difference P3 were larger in supra-threshold condition. In threshold condition, larger amplitudes for both N2 and difference N2 exhibited in frontal and central areas. In sub-threshold condition, there was no endogenous component elicited by mismatch stimuli except smaller anterior N1. Meanwhile, the specific distributions of N1 and N2 were presented and compared with previous face processing. The findings showed that visual conflict processing took place not only at an early stage but also at the late period, which might be as the consequences of interaction between conflict strength and involuntary attention. We concluded that automatic conflict detecting of visual icons by the serial ERP components could distinguish different visual acuity levels. The involvement of endogenous components could reveal the specific mechanism of more precise and fine conflict identification of complex physical attributes under non-attention status, furthermore could be used as valid markers to estimate the magnitude of visual acuity objectively.

Detailed spatiotemporal brain mapping of chromatic vision combining high-resolution VEP with fMRI and retinotopy

Neuroimaging studies have identified so far, several color-sensitive visual areas in the human brain, and the temporal dynamics of these activities have been separately investigated using the visual-evoked potentials (VEPs). In the present study, we combined electrophysiological and neuroimaging methods to determine a detailed spatiotemporal profile of chromatic VEP and to localize its neural generators. The accuracy of the present co-registration study was obtained by combining standard fMRI data with retinotopic and motion mapping data at the individual level. We found a sequence of occipito activities more complex than that typically reported for chromatic VEPs, including feed-forward and reentrant feedback. Results showed that chromatic human perception arises by the combined activity of at the least five parieto-occipital areas including V1, LOC, V8/VO, and the motion-sensitive dorsal region MT+. However, the contribution of V1 and V8/VO seems dominant because the re-entrant activity in these areas was present more than once (twice in V8/VO and thrice in V1). This feedforward and feedback chromatic processing appears delayed compared with the luminance processing. Associating VEPs and neuroimaging measures, we showed for the first time a complex spatiotemporal pattern of activity, confirming that chromatic stimuli produce intricate interactions of many different brain dorsal and ventral areas.

Does spatial attention modulate the earliest component of the visual evoked potential?

Whether visual spatial attention can modulate feedforward input to human primary visual cortex (V1) is debated. A prominent and long-standing hypothesis is that visual spatial attention can influence processing in V1, but only at delayed latencies suggesting a feedback-mediated mechanism and a lack of modulation during the initial afferent volley. The most promising challenge to this hypothesis comes from an event-related potential (ERP) study that showed an amplitude enhancement of the earliest visual ERP component, called the 'C1', in response to spatially attended relative to spatially unattended stimuli. In the Kelly et al. study, several important experimental design modifications were introduced, including tailoring the stimulus locations and recording electrodes to each individual subject. In the current study, we employed the same methodological procedures and tested for attentional enhancements of the C1 component in each quadrant of the visual field. Using the same analysis strategies as Kelly et al., we found no evidence for an attention-based modulation of the C1 (measured from 50-80 ms). Attention-based amplitude enhancements were clear and robust for the subsequent P1 component (90-140 ms). Thus, despite using methods specifically designed to reveal C1 attention effects, the current study provided no confirmatory evidence for such effects.

Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges

We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.

Spatial attention and reading ability: ERP correlates of flanker and cue-size effects in good and poor adult phonological decoders

To investigate facilitatory and inhibitory processes during selective attention among adults with good (n=17) and poor (n=14) phonological decoding skills, a go/nogo flanker task was completed while EEG was recorded. Participants responded to a middle target letter flanked by compatible or incompatible flankers. The target was surrounded by a small or large circular cue which was presented simultaneously or 500ms prior. Poor decoders showed a greater RT cost for incompatible stimuli preceded by large cues and less RT benefit for compatible stimuli. Poor decoders also showed reduced modulation of ERPs by cue-size at left hemisphere posterior sites (N1) and by flanker compatibility at right hemisphere posterior sites (N1) and frontal sites (N2), consistent with processing differences in fronto-parietal attention networks. These findings have potential implications for understanding the relationship between spatial attention and phonological decoding in dyslexia.

Chronic cannabis use and ERP correlates of visual selective attention during the performance of a flanker go/nogo task

The aim of the study was to investigate the relationship between chronic cannabis use and visual selective attention by examining event-related potentials (ERPs) during the performance of a flanker go/nogo task. Male participants were 15 chronic cannabis users (minimum two years use, at least once per week) and 15 drug naive controls. Cannabis users showed longer reaction times compared to controls with equivalent accuracy. Cannabis users also showed a reduction in the N2 'nogo effect' at frontal sites, particularly for incongruent stimuli, and particularly in the right hemisphere. This suggests differences between chronic cannabis users and controls in terms of inhibitory processing within the executive control network, and may implicate the right inferior frontal cortex. There was also preliminary evidence for differences in early selective attention, with controls but not cannabis users showing modulation of N1 amplitude by flanker congruency. Further investigation is required to examine the potential reversibility of these residual effects after long-term abstinence and to examine the role of early selective attention mechanisms in more detail.

Earliest stages of visual cortical processing are not modified by attentional load

This study investigated the effects of attentional load on neural responses to attended and irrelevant visual stimuli by recording high-density event-related potentials (ERPs) from the scalp in normal adult subjects. Peripheral (upper and lower visual field) and central stimuli were presented in random order at a rapid rate while subjects responded to targets among the central stimuli. Color detection and color-orientation conjunction search tasks were used as the low- and high-load tasks, respectively. Behavioral results showed significant load effects on both accuracy and reaction time for target detections. ERP results revealed no significant load effect on the initial C1 component (60-100 ms) evoked by either central-relevant or peripheral-irrelevant stimuli. Source analysis with dipole modeling confirmed previous reports that the C1 includes the initial evoked response in primary visual cortex. Source analyses indicated that high attentional load enhanced the early (70-140 ms) neural response to central-relevant stimuli in ventral-lateral extrastriate cortex, whereas load effects on peripheral-irrelevant stimulus processing started at 110 ms and were localized to more dorsal and anterior extrastriate cortical areas. These results provide evidence that the earliest stages of visual cortical processing are not modified by attentional load and show that attentional load affects the processing of task relevant and irrelevant stimuli in different ways.

Specific fear modulates attentional selectivity during visual search: electrophysiological insights from the N2pc

In the present study, we used high-density EEG during a visual search task to investigate the dynamics of spatial attention to fear-relevant targets and background stimuli in small animal phobia during a visual search task. Twenty-five spider fearful (22 females) and 25 healthy nonfearful participants (19 females) were measured, while searching for discrepant objects in visual arrays. Compared to nonfearful participants, spider fearful individuals showed a more enhanced posterior N2pc to spider (vs. butterfly) targets in an array of flowers. Furthermore, spider fearful participants showed enhanced hypervigilance for all presented stimuli compared to controls as reflected by enhanced N1 amplitudes (160-200 ms). Our findings provide neural evidence for early, enhanced selective spatial attention for fear-relevant stimuli.

Spatio-temporal brain mapping of motion-onset VEPs combined with fMRI and retinotopic maps

Neuroimaging studies have identified several motion-sensitive visual areas in the human brain, but the time course of their activation cannot be measured with these techniques. In the present study, we combined electrophysiological and neuroimaging methods (including retinotopic brain mapping) to determine the spatio-temporal profile of motion-onset visual evoked potentials for slow and fast motion stimuli and to localize its neural generators. We found that cortical activity initiates in the primary visual area (V1) for slow stimuli, peaking 100 ms after the onset of motion. Subsequently, activity in the mid-temporal motion-sensitive areas, MT+, peaked at 120 ms, followed by peaks in activity in the more dorsal area, V3A, at 160 ms and the lateral occipital complex at 180 ms. Approximately 250 ms after stimulus onset, activity fast motion stimuli was predominant in area V6 along the parieto-occipital sulcus. Finally, at 350 ms (100 ms after the motion offset) brain activity was visible again in area V1. For fast motion stimuli, the spatio-temporal brain pattern was similar, except that the first activity was detected at 70 ms in area MT+. Comparing functional magnetic resonance data for slow vs. fast motion, we found signs of slow-fast motion stimulus topography along the posterior brain in at least three cortical regions (MT+, V3A and LOR).

Attentional modulation of neuromagnetic evoked responses in early human visual cortex and parietal lobe following a rank-order rule

Top-down voluntary attention modulates the amplitude of magnetic evoked fields in the human visual cortex. Whether such modulation is flexible enough to adapt to the demands of complex tasks in which abstract rules must be applied to select a target in the presence of distracters remains unclear. We recorded brain neuromagnetic activity using whole-head magnetoencephalography in 14 human subjects during a rule-guided target selection task, and applied event-related Synthetic Aperture Magnetometry to image instantaneous changes in neuromagnetic source activity throughout the brain. During the task subjects selected one of two stimuli (the target) and ignored the other (the distracter) based on a color-rank rule (color 1 > color 2 > color 3). Our results revealed that in early visual color-sensitive areas and the parietal cortex visual stimuli evoke activity that scaled following the rank-order rule. This effect was stronger and occurred later in the parietal lobe (~200 ms after target/distracter onset) relative to early visual areas (~180 ms). Moreover, we found that transient changes in the target's motion direction evoked stronger responses relative to similar changes in the distracter at ~180 ms from change onset in contralateral areas hMT+/V5. These results suggest that during target selection and allocation of attention to a stimulus, top-down signals adjust their intensity following complex selection rules according to the organism's priorities, thereby differentially modulating neuromagnetic activity across visual cortical areas.

Is that a belt or a snake? Object attentional selection affects the early stages of visual sensory processing

Background

There is at present crescent empirical evidence deriving from different lines of ERPs research that, unlike previously observed, the earliest sensory visual response, known as C1 component or P/N80, generated within the striate cortex, might be modulated by selective attention to visual stimulus features. Up to now, evidence of this modulation has been related to space location, and simple features such as spatial frequency, luminance, and texture. Additionally, neurophysiological conditions, such as emotion, vigilance, the reflexive or voluntary nature of input attentional selection, and workload have also been related to C1 modulations, although at least the workload status has received controversial indications. No information is instead available, at present, for objects attentional selection.

Methods

In this study object- and space-based attention mechanisms were conjointly investigated by presenting complex, familiar shapes of artefacts and animals, intermixed with distracters, in different tasks requiring the selection of a relevant target-category within a relevant spatial location, while ignoring the other shape categories within this location, and, overall, all the categories at an irrelevant location. EEG was recorded from 30 scalp electrode sites in 21 right-handed participants.

Results and Conclusions

ERP findings showed that visual processing was modulated by both shape- and location-relevance per se, beginning separately at the latency of the early phase of a precocious negativity (60-80 ms) at mesial scalp sites consistent with the C1 component, and a positivity at more lateral sites. The data also showed that the attentional modulation progressed conjointly at the latency of the subsequent P1 (100-120 ms) and N1 (120-180 ms), as well as later-latency components. These findings support the views that (1) V1 may be precociously modulated by direct top-down influences, and participates to object, besides simple features, attentional selection; (2) object spatial and non-spatial features selection might begin with an early, parallel detection of a target object in the visual field, followed by the progressive focusing of spatial attention onto the location of an actual target for its identification, somehow in line with neural mechanisms reported in the literature as "object-based space selection", or with those proposed for visual search.

Biasing perception by spatial long-term memory

Human perception is highly flexible and adaptive. Selective processing is tuned dynamically according to current task goals and expectations to optimize behavior. Arguably, the major source of our expectations about events yet to unfold is our past experience; however, the ability of long-term memories to bias early perceptual analysis has remained untested. We used a noninvasive method with high temporal resolution to record neural activity while human participants detected visual targets that appeared at remembered versus novel locations within naturalistic visual scenes. Upon viewing a familiar scene, spatial memories changed oscillatory brain activity in anticipation of the target location. Memory also enhanced neural activity during early stages of visual analysis of the target and improved behavioral performance. Both measures correlated with subsequent target-detection performance. We therefore demonstrated that memory can directly enhance perceptual functions in the human brain.

Evoked traveling alpha waves predict visual-semantic categorization-speed

In the present study we have tested the hypothesis that evoked traveling alpha waves are behaviorally significant. The results of a visual-semantic categorization task show that three early ERP components including the P1-N1 complex had a dominant frequency characteristic in the alpha range and behaved like traveling waves do. They exhibited a traveling direction from midline occipital to right lateral parietal sites. Phase analyses revealed that this traveling behavior of ERP components could be explained by phase-delays in the alpha but not theta and beta frequency range. Most importantly, we found that the speed of the traveling alpha wave was significantly and negatively correlated with reaction time indicating that slow traveling speed was associated with fast picture-categorization. We conclude that evoked alpha oscillations are functionally associated with early access to visual-semantic information and generate--or at least modulate--the early waveforms of the visual ERP.

Evoked alpha and early access to the knowledge system: the P1 inhibition timing hypothesis

In this article, a theory is presented which assumes that the visual P1 reflects the same cognitive and physiological functionality as alpha (with a frequency of about 10 Hz).Whereas alpha is an ongoing process, the P1 is the manifestation of an event-related process. It is suggested that alpha and the P1 reflect inhibition that is effective during early access to a complex knowledge system (KS). Most importantly, inhibition operates in two different ways. In potentially competing and task irrelevant networks, inhibition is used to block information processing. In task relevant neural networks, however, inhibition is used to increase the signal to noise ratio (SNR) by enabling precisely timed activity in neurons with a high level of excitation but silencing neurons with a comparatively low level of excitation. Inhibition is increased to modulate the SNR when processing complexity and network excitation increases and when certain types of attentional demands - such as top-down control, expectancy or reflexive attention - increase. A variety of findings are reviewed to demonstrate that they can well be interpreted on the basis of the suggested theory. One interesting aspect thereby is that attentional benefits (reflected e.g., by a larger P1 for attended as compared to unattended items at contralateral sites) and costs (reflected e.g., by a larger P1 at ipsilateral sites) can both be interpreted in terms of inhibition. In the former case an increased P1 is associated with a more effective processing of the presented item (due to an inhibition modulated increase in SNR), in the latter case, however, with a suppression of item processing (due to inhibition that blocks information processing).

Spatiotemporal brain mapping of spatial attention effects on pattern-reversal ERPs

Recordings of event-related potentials (ERPs) were combined with structural and functional magnetic resonance imaging (fMRI) to investigate the timing and localization of stimulus selection processes during visual-spatial attention to pattern-reversing gratings. Pattern reversals were presented in random order to the left and right visual fields at a rapid rate, while subjects attended to the reversals in one field at a time. On separate runs, stimuli were presented in the upper and lower visual quadrants. The earliest ERP component (C1, peaking at around 80 ms), which inverted in polarity for upper versus lower field stimuli and was localized in or near visual area V1, was not modulated by attention. In the latency range 80-250 ms, multiple components were elicited that were increased in amplitude by attention and were colocalized with fMRI activations in specific visual cortical areas. The principal anatomical sources of these attention-sensitive components were localized by fMRI-seeded dipole modeling as follows: P1 (ca. 100 ms-source in motion-sensitive area MT+), C2 (ca. 130 ms-same source as C1), N1a (ca. 145 ms-source in horizontal intraparietal sulcus), N1b (ca. 165 ms-source in fusiform gyrus, area V4/V8), N1c (ca. 180 ms-source in posterior intraparietal sulcus, area V3A), and P2 (ca. 220 ms-multiple sources, including parieto-occipital sulcus, area V6). These results support the hypothesis that spatial attention acts to amplify both feed-forward and feedback signals in multiple visual areas of both the dorsal and ventral streams of processing.

Dynamics of within-, inter-, and cross-modal attentional modulation

Numerous studies have demonstrated effects of spatial attention within single sensory modalities (within-modal spatial attention) and the effect of directing attention to one sense compared with the other senses (intermodal attention) on cortical neuronal activity. Furthermore, recent studies have been revealing that the effects of spatial attention directed to a certain location in a certain sense spread to the other senses at the same location in space (cross-modal spatial attention). The present study used magnetoencephalography to examine the temporal dynamics of the effects of within-modal and cross-modal spatial and intermodal attention on cortical processes responsive to visual stimuli. Visual or tactile stimuli were randomly presented on the left or right side at a random interstimulus interval and subjects directed attention to the left or right when vision or touch was a task-relevant modality. Sensor-space analysis showed that a response around the occipitotemporal region at around 150 ms after visual stimulation was significantly enhanced by within-modal, cross-modal spatial, and intermodal attention. A later response over the right frontal region at around 200 ms was enhanced by within-modal spatial and intermodal attention, but not by cross-modal spatial attention. These effects were estimated to originate from the occipitotemporal and lateral frontal areas, respectively. Thus the results suggest different spatiotemporal dynamics of neural representations of cross-modal attention and intermodal or within-modal attention.

Interactions between working memory, attention and eye movements

This paper reviews the recent findings on working memory, attention and eye movements. We discuss the research that shows that many phenomena related to visual attention taking place when selecting relevant information from the environment are similar to processes needed to keep information active in working memory. We discuss new data that show that when retrieving information from working memory, people may allocate visual spatial attention to the empty location in space that used to contain the information that has to be retrieved. Moreover, we show that maintaining a location in working memory not only may involve attention rehearsal, but might also recruit the oculomotor system. Recent findings seem to suggest that remembering a location may involve attention-based rehearsal in higher brain areas, while at the same time there is inhibition of specific motor programs at lower brain areas. We discuss the possibility that working memory functions do not reside at a special area in the brain, but emerge from the selective recruitment of brain areas that are typically involved in spatial attention and motor control.

When are attention and saccade preparation dissociated?

To understand the mechanisms of visual attention, it is crucial to know the relationship between attention and saccades. Some theories propose a close relationship, whereas others view the attention and saccade systems as completely independent. One possible way to resolve this controversy is to distinguish between the maintenance and shifting of attention. The present study used a novel paradigm that allowed simultaneous measurement of attentional allocation and saccade preparation. Saccades toward the location where attention was maintained were either facilitated or suppressed depending on the probability of making a saccade to that location and the match between the attended location and the saccade location on the previous trial. Shifting attention to another location was always associated with saccade facilitation. The findings provide a new view, demonstrating that the maintenance of attention and shifting of attention differ in their relationship to the oculomotor system.

Perceptual load interacts with involuntary attention at early processing stages: event-related potential studies

Perceptual load is known to influence the locus of attentional selection in the brain but through an unknown underlying mechanism. We used event-related potentials (ERPs) to investigate how perceptual load interacts with cue-driven involuntary attention. Perceptual load was manipulated in a line orientation discrimination task in which target location was cued involuntarily by means of peripheral cues. Attentional modulation was observed for P1m (the posterior midline P1 component with peak latency between 108 and 140 ms) with invalid trials eliciting larger P1m than valid trials. This attentional effect on P1m increased as a function of perceptual load, suggesting an early temporal locus for the interaction of perceptual load and involuntary attention. Attentional modulation for the C1 component (peak latency at approximately 80 ms) was also observed, but only for high-load stimuli that were presented intermixed with low-load stimuli. Results suggest that (a) perceptual load affects attentional selection at early processing stages; (b) perceptual load interacts with involuntary attention earlier and with different brain mechanisms relative to voluntary attention; and (c) attentional modulation in the C1 time range is possible under optimal experimental conditions.

Differentiating spatial and object-based effects on attention: an event-related brain potential study with peripheral cueing

Do spatial attention and object attention modulate visual processing in similar ways? Previously we have found a dissociation between these two forms of attention on ERP measures of sensory processing under conditions of peripheral cueing, with spatial attention effects associated with changes over anterior scalp regions and object attention effects associated with changes over posterior regions (He, X., Fan, S., Zhou, K., Chen, L., 2004. Cue validity and object-based attention. J. Cogn. Neurosci. 16, 1085-1097). However, under conditions of central cueing recent data suggest that spatial and object attention have similar effects over posterior cortical areas (e.g., Martínez, A., Teder-Sälejärvi, W., Hillyard, S.A., 2007. Spatial attention facilitates selection of illusory objects: evidence from event-related brain potentials. Brain Res. 1139, 143-152). In the present study we present further evidence for dissociation between spatial and object-based attention under conditions in which spatial attention effects were enhanced by increasing the cue validity and the task load. The data replicated our previous results, with the effects of spatial attention found in an enhanced anterior N1, while the effects of object-based attention emerged in an enhanced posterior N1. Analyses of attention effect maps and current source density maps confirmed the distinct scalp distributions. These results support the proposal that, under peripheral cueing, spatial attention and object attention are associated with activity respectively in anterior and posterior brain structures, and further suggest a distinction between how attention modulates processing under conditions of central cueing and peripheral cueing.

Attention modulates earliest responses in the primary auditory and visual cortices

A fundamental question about the neural correlates of attention concerns the earliest sensory processing stage that it can affect. We addressed this issue by recording magnetoencephalography (MEG) signals while subjects performed detection tasks, which required employment of spatial or nonspatial attention, in auditory or visual modality. Using distributed source analysis of MEG signals, we found that, contrary to previous studies that used equivalent current dipole (ECD) analysis, spatial attention enhanced the initial feedforward response in the primary visual cortex (V1) at 55-90 ms. We also found attentional modulation of the putative primary auditory cortex (A1) activity at 30-50 ms. Furthermore, we reproduced our findings using ECD modeling guided by the results of distributed source analysis and suggest a reason why earlier studies using ECD analysis failed to identify the modulation of earliest V1 activity.

Electrophysiological correlates of spatial orienting towards angry faces: a source localization study

The goal of this study was to examine behavioral and electrophysiological correlates of involuntary orienting toward rapidly presented angry faces in non-anxious, healthy adults using a dot-probe task in conjunction with high-density event-related potentials and a distributed source localization technique. Consistent with previous studies, participants showed hypervigilance toward angry faces, as indexed by facilitated response time for validly cued probes following angry faces and an enhanced P1 component. An opposite pattern was found for happy faces suggesting that attention was directed toward the relatively more threatening stimuli within the visual field (neutral faces). Source localization of the P1 effect for angry faces indicated increased activity within the anterior cingulate cortex, possibly reflecting conflict experienced during invalidly cued trials. No modulation of the early C1 component was found for affect or spatial attention. Furthermore, the face-sensitive N170 was not modulated by emotional expression. Results suggest that the earliest modulation of spatial attention by face stimuli is manifested in the P1 component, and provide insights about mechanisms underlying attentional orienting toward cues of threat and social disapproval.

Location and features of instructive spatial cues do not influence the time course of covert shifts of visual spatial attention

The time course of shifting visual spatial attention to flickering stimuli in the left and right visual hemifield was investigated. The goal was to test whether an instructive peripheral salient cue located close to the newly to-be-attended location triggers faster shifts per se compared to a central cue. Besides behavioural data an objective electrophysiological measure, the steady-state visual evoked potential (SSVEP) was used to measure the time course of visual pathway facilitation in the human brain for centrally and peripherally cued shifts of spatial attention. Results revealed that both spatial cues resulted in identical time courses of shifts of covert spatial attention. This was true with respect to behavioural data and SSVEP amplitude. Results support the notion that a salient peripheral spatial cue does not automatically produce faster shifts of spatial attention to the to-be-attended location when this cue is informative and embedded in an ongoing stimulation.

When and where perceptual load interacts with voluntary visuospatial attention: an event-related potential and dipole modeling study

Perceptual load is recognized to affect visual selective attention, but at an unknown spatiotemporal locus in the brain. To examine this issue, event-related potentials (ERPs) were recorded while participants performed an orientation discrimination task, under conditions of low or high perceptual load. Participants were required to respond to targets (10% of trials) presented in the attended visual field while ignoring all stimuli in the unattended visual field. The interaction between voluntary attention and perceptual load was significant for the posterior N1 component (190 ms) but not for the earlier C1 (84 ms) or P1 (100 ms) components. This load by attention interaction for N1 was localized to the temporoparietal-occipital (TPO) gyrus by dipole modeling analysis. Dipole modeling also showed that a reversed attentional effect in the C1 time range was due to ERP overlap from the subsequent attention-sensitive P1 component. Results suggest that perceptual load affects voluntary visuospatial attention at an early (but not the earliest) processing stage and that the TPO gyrus mediates target selection at the discrimination stage.

Spatiotemporal analysis of the cortical sources of the steady-state visual evoked potential

This study aimed to characterize the neural generators of the steady-state visual evoked potential (SSVEP) to repetitive, 6 Hz pattern-reversal stimulation. Multichannel scalp recordings of SSVEPs and dipole modeling techniques were combined with functional magnetic resonance imaging (fMRI) and retinotopic mapping in order to estimate the locations of the cortical sources giving rise to the SSVEP elicited by pattern reversal. The time-varying SSVEP scalp topography indicated contributions from two major cortical sources, which were localized in the medial occipital and mid-temporal regions of the contralateral hemisphere. Colocalization of dipole locations with fMRI activation sites indicated that these two major sources of the SSVEP were located in primary visual cortex (V1) and in the motion sensitive (MT/V5) areas, respectively. Minor contributions from mid-occipital (V3A) and ventral occipital (V4/V8) areas were also considered. Comparison of SSVEP phase information with timing information collected in a previous transient VEP study (Di Russo et al. [2005] Neuroimage 24:874-886) suggested that the sequence of cortical activation is similar for steady-state and transient stimulation. These results provide a detailed spatiotemporal profile of the cortical origins of the SSVEP, which should enhance its use as an efficient clinical tool for evaluating visual-cortical dysfunction as well as an investigative probe of the cortical mechanisms of visual-perceptual processing.

Spatio-temporal Analysis of Feature-Based Attention

The cortical mechanisms of feature-selective attention to color and motion cues were studied in humans using combined electrophysiological, magnetoencephalographic, and hemodynamic (functional magnetic resonance imaging) measures of brain activity. Subjects viewed a display of random dots that periodically either changed color or moved coherently. When attention was directed to the color change it elicited enhanced neural activity in visual area V4v, previously shown to be specialized for processing color information. In contrast, when dot movement was attended it produced enhanced activity in the motion-specialized area human MT. Parallel recordings of event-related electrophysiological and magnetoencephalographic responses indicated that the attention-related facilitation of neural activity in these specialized cortical areas occurred rapidly, beginning as early as 90-120 ms after stimulus onset. We conclude that selection of an entire feature dimension (motion or color) boosts neural activity in its specialized cortical module much more rapidly than does selection of one feature value from another (e.g., one color from another), as reported in previous electrophysiological studies. By combining methods with high spatial and temporal resolution it is possible to analyze the precise time course of feature-selective processing in specialized cortical areas.

ERP and fMRI correlates of endogenous and exogenous focusing of visual-spatial attention

The aim of this study was to investigate the neural correlates of the functional distinction underlying attentional mechanisms of endogenous-sustained and exogenous-transient spatial selection. We recorded event related potentials (ERPs) and used functional magnetic resonance imaging (fMRI) in separate experiments while subjects performed a simple reaction time (RT) to the same visual stimulus displayed to one of several field locations. Endogenous-sustained or exogenous-transient focusing of attention onto target location were obtained by presenting the stimulus in blocks of same-point vs. randomised-point trials, respectively. Same-point stimuli yielded overall faster RT than randomised stimuli, indicating a facilitating effect of endogenous-sustained spatial attention on the perceptual processing of the impending stimulus. Moreover, same-point vs. randomised presentations revealed significant increases in the fMRI signal in the bilateral lingual and fusiform gyri as well as in the right calcarine sulcus, in conjunction with a larger amplitude of the posterior P1 component of ERPs, but no modulation of the amplitude of the N1 component. Rather, a larger amplitude of N1 was found in the reverse contrast, randomised minus same-point trials, which revealed increases in the fMRI signal along the posterior left superior frontal sulcus and bilaterally in the superior precuneus. These findings indicate that N1 indexes exogenous orienting of attention and is likely to represent the activity of frontal and parietal components of the attention network involved in eliciting attention changes. In contrast, the effects of those changes, resulting in a modulation of activation in visual occipital areas, are indexed by P1.

Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas

We investigated the effects of spatial-selective attention on oscillatory neuronal dynamics in a tactile delayed-match-to-sample task. Whole-head magnetoencephalography was recorded in healthy subjects while dot patterns were presented to their index fingers using Braille stimulators. The subjects' task was to report the reoccurrence of an initially presented sample pattern in a series of up to eight test stimuli that were presented unpredictably to their right or left index finger. Attention was cued to one side (finger) at the beginning of each trial, and subjects performed the task at the attended side, ignoring the unattended side. After stimulation, high-frequency gamma-band activity (60-95 Hz) in presumed primary somatosensory cortex (S1) was enhanced, whereas alpha- and beta-band activity were suppressed in somatosensory and occipital areas and then rebounded. Interestingly, despite the absence of any visual stimulation, we also found time-locked activation of medial occipital, presumably visual, cortex. Most relevant, spatial tactile attention enhanced stimulus-induced gamma-band activity in brain regions consistent with contralateral S1 and deepened and prolonged the stimulus induced suppression of beta- and alpha-band activity, maximal in parieto-occipital cortex. Additionally, the beta rebound over contralateral sensorimotor areas was suppressed. We hypothesize that spatial-selective attention enhances the saliency of sensory representations by synchronizing neuronal responses in early somatosensory cortex and thereby enhancing their impact on downstream areas and facilitating interareal processing. Furthermore, processing of tactile patterns also seems to recruit visual cortex and this even more so for attended compared with unattended stimuli.

Event-related potentials, cognition, and behavior: A biological approach

The prevailing cognitive-psychological accounts of event-related brain potentials (ERPs) assume that ERP components manifest information processing operations leading from stimulus to response. Since this view encounters numerous difficulties already analyzed in previous studies, an alternative view is presented here that regards cortical control of behavior as a repetitive sensorimotor cycle consisting of two phases: (i) feedforward anticipation and (ii) feedback cortical performance. This view allows us to interpret in an integrative manner numerous data obtained from very different domains of ERP studies: from biophysics of ERP waves to their relationship to the processing of language, in which verbal behavior is viewed as likewise controlled by the same two basic control processes: feedforward (hypothesis building) and feedback (hypothesis checking). The proposed approach is intentionally simplified, explaining numerous effects on the basis of few assumptions and relating several levels of analysis: neurophysiology, macroelectrical processes (i.e. ERPs), cognition and behavior. It can, therefore, be regarded as a first approximation to a general theory of ERPs.

Effect of fixation tasks on multifocal visual evoked potentials

PURPOSE

This study investigated the effects of cognitive influence on the multifocal visual evoked potential (mVEP) at different levels of eccentricity. Three different foveal fixation conditions were utilized involving varying levels of task complexity. A more complex visual fixation task has been known to suppress peripheral signals in subjective testing.

METHODS

Twenty normal subjects had monocular mVEPs recorded using the AccuMap objective perimeter. This allowed simultaneous stimulation of 58 segments of the visual field to an eccentricity of 24 degrees. The mVEP was recorded using three different fixation conditions in random order. During task 1 the subject passively viewed the central fixation area. For task 2 alternating numbers were displayed within the fixation area; the subject on viewing the number '3' in the central fixation area indicated recognition by pressing a button. Throughout task 3, numbers were displayed as in task 2. The subject had the cognitive task of summating all the numbers.

RESULTS

Analysis revealed that the increased attention and concentration demanded by tasks 2 and 3 in comparison with task 1 resulted in significantly enhanced central amplitudes of 9.41% (Mann-Whitney P = 0.0002) and 13.45% (P = 0.0002), respectively. These amplitudes became reduced in the periphery and approached those of task 1, resulting in no significant difference between the three tasks. Latencies demonstrated no significant difference between each task nor at any eccentricity (P > 0.05). As the complexity of each task increased the amount of alpha rhythm was significantly reduced.

CONCLUSIONS

Our findings indicate that task 1 required a minimal demand of cognition and was associated with the greatest amount of alpha rhythm. It was also the most difficult to perform because of loss of interest. The other two tasks required a greater demand of higher order cognitive skills resulting in significantly enhanced amplitudes centrally and the attenuation of alpha rhythm. Therefore, amplitudes are increased around the area of attention.

Effects of attention and arousal on early responses in striate cortex

Humans employ attention to facilitate perception of relevant stimuli. Visual attention can bias the selection of a location in the visual field, a whole visual object or any visual feature of an object. Attention draws on both current behavioral goals and/or the saliency of physical attributes of a stimulus, and it influences activity of different brain regions at different latencies. Attentional effect in the striate and extrastriate cortices has been the subject of intense research interest in many recent studies. The consensus emerging from them places the first attentional effects in extrastriate areas, which in turn modulate activity of V1 at later latencies. In this view attention influences activity in striate cortex some 150 ms after stimulus onset. Here we use magnetoencephalography to compare brain responses to foveally presented identical stimuli under the conditions of passive viewing, when the stimuli are irrelevant to the subject and under an active GO/NOGO task, when the stimuli are cues instructing the subject to make or inhibit movement of his/her left or right index finger. The earliest striate activity was identified 40-45 ms after stimulus onset, and it was identical in passive and active conditions. Later striate response starting at about 70 ms and reaching a peak at about 100 ms showed a strong attentional modulation. Even before the striate cortex, activity of the right inferior parietal lobule was modulated by attention, suggesting this region as a candidate for mediating attentional signals to the striate cortex.

Brain mechanisms of involuntary visuospatial attention: an event-related potential study

The brain mechanisms mediating visuospatial attention were investigated by recording event-related potentials (ERPs) during a line-orientation discrimination task. Nonpredictive peripheral cues were used to direct participant's attention involuntarily to a spatial location. The earliest attentional modulation was observed in the P1 component (peak latency about 130 ms), with the valid trials eliciting larger P1 than invalid trials. Moreover, the attentional modulations on both the amplitude and latency of the P1 and N1 components had a different pattern as compared to previous studies with voluntary attention tasks. In contrast, the earliest visual ERP component, C1 (peak latency about 80 ms), was not modulated by attention. Low-resolution brain electromagnetic tomography (LORETA) showed that the earliest attentional modulation occurred in extrastriate cortex (middle occipital gyrus, BA 19) but not in the primary visual cortex. Later attention-related reactivations in the primary visual cortex were found at about 110 ms after stimulus onset. The results suggest that involuntary as well as voluntary attention modulates visual processing at the level of extrastriate cortex; however, at least some different processes are involved by involuntary attention compared to voluntary attention. In addition, the possible feedback from higher visual cortex to the primary visual cortex is faster and occurs earlier in involuntary relative to voluntary attention task.

Visual search in temporally segregated displays: Converging operations in the study of the preview benefit

Preview benefit is an attentional phenomenon that enables observers to selectively search through new information in the visual field. In a preview search task, objects are presented in two sets, separated by a time interval (preview interval), and with the second set (new objects) containing the target. Event-related brain potentials (ERPs) were used to investigate whether preview benefit occurs via maintenance of inhibition of the old objects during the preview interval. ERPs time-locked to a color probe indicated that the old objects were actively attended rather than inhibited during the preview interval. Follow-up behavioral experiments produced converging results. The results suggest that, although participants might be using inhibition at later stages of the preview interval, they are not maintaining inhibition on the old objects throughout most of the preview interval.

Identification of the neural sources of the pattern-reversal VEP

This study aimed to characterize the neural generators of the early components of the visual-evoked potential (VEP) to pattern-reversal gratings. Multichannel scalp recordings of VEPs and dipole modeling techniques were combined with functional magnetic resonance imaging (fMRI) and retinotopic mapping in order to estimate the locations of the cortical sources giving rise to VEP components in the first 200 ms poststimulus. Dipole locations were seeded to visual cortical areas in which fMRI activations were elicited by the same stimuli. The results provide strong evidence that the first major component of the VEP elicited by a pattern-reversal stimulus (N75/P85) arises from surface-negative activity in the primary visual cortex (area V1). Subsequent waveform components could be accounted for by dipoles that were in close proximity to fMRI activations in the following cortical areas: P95 (area MT/V5), P125/N135 (area V1), N150 (transverse parietal sulcus, TPS), N160 (ventral occipital areas VP, V4v, and V4/V8), and N180 (dorsal occipital areas V3A/V7). These results provide a detailed spatiotemporal profile of the cortical origins of the pattern-reversal VEP, which should enhance its utility in both clinical and basic studies of visual-perceptual processing.

Neuronal synchronization and selective color processing in the human brain

In the present study, subjects selectively attended to the color of checkerboards in a feature-based attention paradigm. Induced gamma band responses (GBRs), the induced alpha band, and the event-related potential (ERP) were analyzed to uncover neuronal dynamics during selective feature processing. Replicating previous ERP findings, the selection negativity (SN) with a latency of about 160 msec was extracted. Furthermore, and similarly to previous EEG studies, a gamma band peak in a time window between 290 and 380 msec was found. This peak had its major energy in the 55- to 70-Hz range and was significantly larger for the attended color. Contrary to previous human induced gamma band studies, a much earlier 40- to 50-Hz peak in a time window between 160 and 220 msec after stimulus onset and, thus, concurrently to the SN was prominent with significantly more energy for attended as opposed to unattended color. The induced alpha band (9.8-11.7 Hz), on the other hand, exhibited a marked suppression for attended color in a time window between 450 and 600 msec after stimulus onset. A comparison of the time course of the 40- to 50-Hz and 55- to 70-Hz induced GBR, the induced alpha band, and the ERP revealed temporal coincidences for changes in the morphology of these brain responses. Despite these similarities in the time domain, the cortical source configuration was found to discriminate between induced GBRs and the SN. Our results suggest that large-scale synchronous high-frequency brain activity as measured in the human GBR play a specific role in attentive processing of stimulus features.

Perception of static eye gaze direction facilitates subsequent early visual processing

OBJECTIVE

Using event-related potentials (ERPs), it has been recently shown that a reflexive shift of attention following the observation of a dynamic eye gaze cue enhances and speeds up early visual processing of a target presented at the gazed-at location. Here we investigate whether similar early sensory modulations are also elicited by static gaze cues, or if previously described attentional effects were caused mainly by visual motion cues and not by eye gaze direction per se. Furthermore, we explore if these possible attentional orienting effects reflect facilitation of the processing of cued stimuli, inhibition of the unattended stimuli, or both.

METHODS

Subjects were presented with a face looking to the right or left visual field (VF), or straight away, before the occurrence of a lateralized target to detect. There were 3 conditions in this nonpredictive cueing task: (1) target presented in the VF indicated by the eye gaze direction (congruent); (2) opposite to the eye gaze direction (incongruent); or (3) preceded by a straight gazing face (neutral).

RESULTS

Subjects were faster at detecting congruently than incongruently and neutrally cued targets. Facilitation effects were observed on early ERP components: the occipital P1 and occipito-temporal N1 components were speeded up as early as approximately 100 ms following stimulus onset (P1), and enhanced (P1 and N1) in response to congruent trials, particularly in the right hemisphere.

CONCLUSIONS

Spatial attention triggered by static eye gaze direction produces response facilitations - predominantly lateralized to the right hemisphere - from the early sensory stages of visual processing.

SIGNIFICANCE

This study provides the first evidence of a speeding up and amplification of early visual processing following attention triggered by static eye gaze perception.

Sequence of pattern onset responses in the human visual areas: an fMRI constrained VEP source analysis

We measured the timing of activity in distinct functional areas of the human visual cortex after onset of a visual pattern. This is not possible with visual evoked potentials (VEPs) or magnetic fields alone, and direct combination of functional magnetic resonance imaging (fMRI) with electromagnetic data has turned out to be difficult. We tested a relatively new approach, where both position and orientation of the active cortex was given to the VEP source model. Subjects saw the same visual patterns flashed ON and OFF, both when recording VEPs and fMRI responses. We identified the positions and orientations of the activated cortex in four retinotopic areas in each individual, and the corresponding dipoles were seeded to model the individual evoked potential data. Unexplained variance, comprising signals from other areas, was inversely modeled. Despite the partially a priori fixed model and optimized signal-to-noise ratio of VEP data, full separation of retinotopic areas was only seldom possible due to crosstalk between the adjacent sources, but separation was usually possible between areas V1 and V3/V3a. Whereas the latencies generally followed the hierarchical organization of cortical areas (V1-V2-V3), with around 25 ms between the strongest responses, an early activation emerged 10-20 ms after V1, close to the temporo-occipital junction (LO/V5) and with an additional 20-ms latency in the corresponding region of the opposite hemisphere. Our approach shows that it is feasible to directly seed information from fMRI to electromagnetic source models and to identify the components and dynamics of VEPs in different retinotopic areas of a human individual.

Attending to a location in three-dimensional space modulates early ERPs

It has been reported that attending to a particular location can modulate incoming sensory signals, as reflected by the stimulus-evoked P1 and N1 components of the visual event-related potential (ERPs) in a two-dimensional (2D) display [Attention, Space, and Action: Studies in Cognitive Neuroscience, Oxford University Press, New York, 1999, p. 31]. In contrast, in this study we examined the effect of attention in 3D space using a stereoscopic display. Stimuli were presented randomly, one at a time, in an orthogonal combination of two depths (near, far) and two 2D locations (left, right) relative to the fixation point. The task was to attend selectively to one of these four positions and to respond to a target stimulus defined by shape in the attended 3D location. The effect of 2D location selection on the P1 amplitude was greater for stimuli in the near than the far depth plane, and the amplitude of N1 increased in response to stimuli in the attended combination of 2D location and depth. These results suggest that the effect of early spatial selection on the visual ERP is not simply based on retinotopic organization of the visual field, but also on intermediate stages that construct a 3D spatial representation of the external world.

The spatial distribution of selective attention assessed using the multifocal visual evoked potential

To determine the manner in which attention is distributed among numerous locations in the visual space, we used a multifocal recording technique that allowed simultaneous recordings of evoked cortical activity from 12 visual field areas out to 23.6 degrees. We found that multifocal visual evoked potential (mfVEP) amplitude was larger when a region of visual space was attended than when it was not attended. The magnitude of this effect was inversely related to visual field eccentricity and there was no attention-related modulation of VEP amplitude for the most eccentric region. In addition, we found that mfVEP amplitudes in the regions contiguous to the attended region could also be larger, depending upon their spatial relationship to the attended region. Specifically, amplitudes in more central regions on the 'meridian of attention' were larger when the subject attended anywhere along that meridian.