Quantitative analysis of attention and detection signals during visual search

The dynamical balance of the brain at rest

The authors review evidence that spontaneous, that is, not stimulus or task driven, activity in the brain at the level of large-scale neural systems is not noise, but orderly and organized in a series of functional networks that maintain, at all times, a high level of coherence. These networks of spontaneous activity correlation or resting state networks (RSN) are closely related to the underlying anatomical connectivity, but their topography is also gated by the history of prior task activation. Network coherence does not depend on covert cognitive activity, but its strength and integrity relates to behavioral performance. Some RSN are functionally organized as dynamically competing systems both at rest and during tasks. Computational studies show that one of such dynamics, the anticorrelation between networks, depends on noise-driven transitions between different multistable cluster synchronization states. These multistable states emerge because of transmission delays between regions that are modeled as coupled oscillators systems. Large-scale systems dynamics are useful for keeping different functional subnetworks in a state of heightened competition, which can be stabilized and fired by even small modulations of either sensory or internal signals.

Neurocognitive systems related to real-world prospective memory

Background

Prospective memory (PM) denotes the ability to remember to perform actions in the future. It has been argued that standard laboratory paradigms fail to capture core aspects of PM.

Methodology/Principal Findings

We combined functional MRI, virtual reality, eye-tracking and verbal reports to explore the dynamic allocation of neurocognitive processes during a naturalistic PM task where individuals performed errands in a realistic model of their residential town. Based on eye movement data and verbal reports, we modeled PM as an iterative loop of five sustained and transient phases: intention maintenance before target detection (TD), TD, intention maintenance after TD, action, and switching, the latter representing the activation of a new intention in mind. The fMRI analyses revealed continuous engagement of a top-down fronto-parietal network throughout the entire task, likely subserving goal maintenance in mind. In addition, a shift was observed from a perceptual (occipital) system while searching for places to go, to a mnemonic (temporo-parietal, fronto-hippocampal) system for remembering what actions to perform after TD. Updating of the top-down fronto-parietal network occurred at both TD and switching, the latter likely also being characterized by frontopolar activity.

Conclusion/Significance

Taken together, these findings show how brain systems complementary interact during real-world PM, and support a more complete model of PM that can be applied to naturalistic PM tasks and that we named PROspective MEmory DYnamic (PROMEDY) model because of its dynamics on both multi-phase iteration and the interactions of distinct neurocognitive networks.

Differential effects of exogenous and endogenous cueing in multi-stream RSVP: implications for theories of attentional blink

The attentional blink (AB) refers to the finding that performance on the second of two targets (T1 and T2) in a rapid serial visual presentation (RSVP) stream is impaired when the targets are presented within 200-500 ms. To explore the possible interaction between spatial attentional orienting and temporary attentional deficits, this study used central (endogenous) and peripheral (exogenous) cues in a multi-stream RSVP task and compared the endogenous and exogenous cueing effects inside and outside of the AB period. While the endogenous cueing effect was constant in magnitude over time, the exogenous cueing effect was significantly larger inside than outside of the AB period. Theoretical implications of these findings for the interaction between attention mechanisms in spatial and temporal domains are discussed.

Hemispheric asymmetries of motor versus nonmotor processes during (visuo)motor control

Language and certain aspects of motor control are typically served by the left hemisphere, whereas visuospatial and attentional control are lateralized to the right. Here a (visuo)motor tracing task was used to identify hemispheric lateralization beyond the general, contralateral organization of the motor system. Functional magnetic resonance imaging (fMRI) was applied in 40 male right-handers (19-30 yrs) during line tracing with dominant and nondominant hand, with and without visual guidance. Results revealed a network of areas activating more in the right than left hemisphere, irrespective of the effector. Inferior portions of frontal gyrus and parietal lobe overlapped largely with a previously described ventral attention network responding to unexpected or behaviourally relevant stimuli. This demonstrates a hitherto unreported functionality of this circuit that also seems to activate when spatial information is continuously exploited to adapt motor behaviour. Second, activation of left dorsal premotor and postcentral regions during tracing with the nondominant left hand was more pronounced than that in their right hemisphere homologues during tracing with the dominant right hand. These activation asymmetries of motor areas ipsilateral to the moving hand could not be explained by asymmetries in skill performance, the degree of handedness, or interhemispheric interactions. The latter was measured by a double-pulse transcranial magnetic stimulation paradigm, whereby a conditioning stimulus was applied over one hemisphere and a test stimulus over the other. We propose that the left premotor areas contain action representations strongly related to movement implementation which are also accessed during movements performed with the left body side.

Deficits in visual search for conjunctions of motion and form after parietal damage but with spared hMT+/V5

It has been argued that area hMT+/V5 in humans acts as a motion filter, enabling targets defined by a conjunction of motion and form to be efficiently selected. We present data indicating that (a) damage to parietal cortex leads to a selective problem in processing motion-form conjunctions, and (b) that the presence of a structurally and functional intact hMT+/V5 is not sufficient for efficient search for motion-form conjunctions. We suggest that, in addition to motion-processing areas (e.g., hMT+/V5), the posterior parietal cortex is necessary for efficient search with motion-form conjunctions, so that damage to either brain region may bring about deficits in search. We discuss the results in terms of the involvement of the posterior parietal cortex in the top-down guidance of search or in the binding of motion and form information.

Attention to memory and the environment: functional specialization and dynamic competition in human posterior parietal cortex

Posterior parietal cortex has been traditionally associated with perceptual attention and sensory-motor processing, but recent studies also indicate a potential role in episodic memory retrieval. Here, we developed a new paradigm to isolate top-down attention-related activity directed to either memory or perceptual information. We demonstrated a robust topographic separation in human posterior parietal cortex associated with searching for task-relevant information in episodic memory or in the environment. Control analyses confirmed that this difference was not dependent on differences in sensory stimulation or eye movements across tasks. Notably, we observed in memory- and perception-related regions a mechanism of reciprocal dynamic competition that was related to behavioral performance. These results provide the first evidence for a double dissociation between parietal networks involved in top-down attention to memory and the environment and support the idea of neural competition between perception and memory.

Evidence for intact memory-guided attention in school-aged children

Visual scenes contain many statistical regularities such as the likely identity and location of objects that are present; with experience, such regularities can be encoded and can ultimately facilitate the deployment of spatial attention to important locations. Memory-guided attention has been extensively examined in adults with the 'contextual cueing' paradigm and has been linked to specific neural substrates - a medial temporal lobe (MTL)-frontoparietal network. However, it currently remains unknown when this ability comes 'online' during development. Thus, we examined the performance of school-aged children on an age-appropriate version of the contextual cueing paradigm. Children searched for a target fish among distractor fish in new displays and in 'old' displays on a touchscreen computer. Old displays repeated across blocks of trials and thus provided an opportunity for prior experience with the invariant configuration of the stimuli to guide attentional deployment. We found that over time children searched old displays significantly faster than new displays, thus revealing intact memory-guided attention and presumed function of an MTL-frontoparietal network in 5- to 9-year-olds. More generally, our findings suggest that children are remarkably sensitive to the inherent structure of their visual environment and this enables attentional deployment to become more efficient with experience.

The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas

This article explores the notion that Freudian constructs may have neurobiological substrates. Specifically, we propose that Freud's descriptions of the primary and secondary processes are consistent with self-organized activity in hierarchical cortical systems and that his descriptions of the ego are consistent with the functions of the default-mode and its reciprocal exchanges with subordinate brain systems. This neurobiological account rests on a view of the brain as a hierarchical inference or Helmholtz machine. In this view, large-scale intrinsic networks occupy supraordinate levels of hierarchical brain systems that try to optimize their representation of the sensorium. This optimization has been formulated as minimizing a free-energy; a process that is formally similar to the treatment of energy in Freudian formulations. We substantiate this synthesis by showing that Freud's descriptions of the primary process are consistent with the phenomenology and neurophysiology of rapid eye movement sleep, the early and acute psychotic state, the aura of temporal lobe epilepsy and hallucinogenic drug states.

Dynamic coding of events within the inferior frontal gyrus in a probabilistic selective attention task

Besides the fact that RTs in cognitive tasks are affected by the specific demands of a trial, the context in which this trial occurs codetermines the speed of the response. For instance, invalid spatial cues generally prolong RTs to targets in the location-cueing paradigm, whereas the magnitude of these RT costs additionally varies as a function of the preceding trial types so that RTs for invalid trials may be increased when preceded by valid rather than invalid trials. In the present fMRI study, we investigated trial sequence effects in a combined oddball and location-cueing paradigm. In particular, we tested whether RTs and neural activity to infrequent invalid or deviant targets varied as a function of the number of preceding valid standard trials. As expected, RTs in invalid and deviant trials were significantly slower when more valid standard trials had been presented beforehand. This behavioral effect was reflected in the neural activity of the right inferior/middle frontal gyrus where the amplitude of the hemodynamic response in invalid and deviant trials was positively related to the number of preceding valid standard trials. In contrast, decreased activity (i.e., a negative parametric modulation effect) was observed when more valid standard trials were successively presented. Further positive parametric effects for the number of preceding valid standard trials were observed in the left caudate nucleus and lingual gyrus. The data suggest that inferior frontal cortex extracts both event regularities and irregularities in event streams.

Specialization in the default mode: Task-induced brain deactivations dissociate between visual working memory and attention

The idea of an organized mode of brain function that is present as default state and suspended during goal-directed behaviors has recently gained much interest in the study of human brain function. The default mode hypothesis is based on the repeated observation that certain brain areas show task-induced deactivations across a wide range of cognitive tasks. In this event-related functional resonance imaging study we tested the default mode hypothesis by comparing common and selective patterns of BOLD deactivation in response to the demands on visual attention and working memory (WM) that were independently modulated within one task. The results revealed task-induced deactivations within regions of the default mode network (DMN) with a segregation of areas that were additively deactivated by an increase in the demands on both attention and WM, and areas that were selectively deactivated by either high attentional demand or WM load. Attention-selective deactivations appeared in the left ventrolateral and medial prefrontal cortex and the left lateral temporal cortex. Conversely, WM-selective deactivations were found predominantly in the right hemisphere including the medial-parietal, the lateral temporo-parietal, and the medial prefrontal cortex. Moreover, during WM encoding deactivated regions showed task-specific functional connectivity. These findings demonstrate that task-induced deactivations within parts of the DMN depend on the specific characteristics of the attention and WM components of the task. The DMN can thus be subdivided into a set of brain regions that deactivate indiscriminately in response to cognitive demand ("the core DMN") and a part whose deactivation depends on the specific task.

When less is more: TPJ and default network deactivation during encoding predicts working memory performance

Previous work has shown that temporo-parietal junction (TPJ), part of a ventral attention network for stimulus-driven reorienting, deactivates during effortful cognitive engagement, along with the default mode network (DMN). TPJ deactivation has been reported both during working memory (WM) and rapid visual search, ostensibly to prevent reorienting to irrelevant objects. We tested whether the magnitude of this deactivation during WM encoding is predictive of subsequent WM performance. Using slow event-related fMRI and a delayed WM task in which distracter stimuli were presented during the maintenance phase, we found that greater TPJ and DMN deactivation during the encoding phase predicted better WM performance. TPJ and DMN, however, also showed several functional dissociations: (1) TPJ exhibited a different task-evoked pattern than DMN, responding to distracters sharing task-relevant features, but not to other types of distracters; and (2) TPJ showed strong functional connectivity with the DMN at encoding but not during distracter presentation. These results provide further evidence for the functional importance of TPJ suppression and indicate that TPJ and DMN deactivation is especially critical during WM trace formation. In addition, the functional connectivity results suggest that TPJ, while not part of the DMN during the resting state, may flexibly "couple" with this network depending on task demands.

The limits of top-down control of visual attention

The extent to which spatial selection is driven by the goals of the observer and by the properties of the environment is one of the major issues in the field of visual attention. Here we review recent experimental evidence from behavioral and eye movement studies suggesting that top-down control has temporal and spatial limits. More specifically, we argue that the first feedforward sweep of information is bottom-up, and that top-down control can influence selection only after the sweep is completed. In addition, top-down control can limit spatial selection through adjusting the size of attentional window, an area of visual space which receives priority in information sampling. Finally, we discuss the evidence found using brain imaging techniques for top-down control in an attempt to reconcile it with behavioral findings. We conclude by discussing theoretical implications of these results for the current models of visual selection.

FMRI correlates of visuo-spatial reorienting investigated with an attention shifting double-cue paradigm

The control of visuo-spatial attention entails the joint contribution of goal-directed (endogenous) and stimulus-driven (exogenous) factors. However, little is known about the neural bases of the interplay between these two mechanisms. To address this issue, we presented endogenous (spatially informative) and exogenous (noninformative) visual cues sequentially within the same trial (double-cue paradigm) during fMRI, crossing factorially the validity of the two cues. We found that both endogenous and exogenous cues affected behavioral performance, speeding-up or slowing-down target discrimination when valid and invalid, respectively. Despite the double-cue paradigm maximizes the interplay between endogenous and exogenous factors, the two types of cue affected responses in an independent manner without any significant effect of congruence. The imaging data revealed increased activation in separate cortical areas following invalid endogenous and invalid exogenous cues. A fronto-parietal system was activated during invalid endogenous trials, whereas a region at the temporo-occipital junction was activated during invalid exogenous trials. Within both circuits, activity was unaffected by the validity of the other cue. These results indicate the existence of separate, noninteracting neural circuits for endogenous and exogenous reorienting of visuo-spatial attention.

Domain general mechanisms of perceptual decision making in human cortex

To successfully interact with objects in the environment, sensory evidence must be continuously acquired, interpreted, and used to guide appropriate motor responses. For example, when driving, a red light should motivate a motor command to depress the brake pedal. Single-unit recording studies have established that simple sensorimotor transformations are mediated by the same neurons that ultimately guide the behavioral response. However, it is also possible that these sensorimotor regions are the recipients of a modality-independent decision signal that is computed elsewhere. Here, we used functional magnetic resonance imaging and human observers to show that the time course of activation in a subregion of the right insula is consistent with a role in accumulating sensory evidence independently from the required motor response modality (saccade vs manual). Furthermore, a combination of computational modeling and simulations of the blood oxygenation level-dependent response suggests that this region is not simply recruited by general arousal or by the tonic maintenance of attention during the decision process. Our data thus raise the possibility that a modality-independent representation of sensory evidence may guide activity in effector-specific cortical areas before the initiation of a behavioral response.

Hemispheric differences in frontal and parietal influences on human occipital cortex: direct confirmation with concurrent TMS-fMRI

We used concurrent TMS-fMRI to test directly for hemispheric differences in causal influences of the right or left fronto-parietal cortex on activity (BOLD signal) in the human occipital cortex. Clinical data and some behavioral TMS studies have been taken to suggest right-hemisphere specialization for top-down modulation of vision in humans, based on deficits such as spatial neglect or extinction in lesioned patients, or findings that TMS to right (vs. left) fronto-parietal structures can elicit stronger effects on visual performance. But prior to the recent advent of concurrent TMS and neuroimaging, it was not possible to directly examine the causal impact of one (stimulated) brain region upon others in humans. Here we stimulated the frontal or intraparietal cortex in the left or right hemisphere with TMS, inside an MR scanner, while measuring with fMRI any resulting BOLD signal changes in visual areas V1-V4 and V5/MT+. For both frontal and parietal stimulation, we found clear differences between effects of right- versus left-hemisphere TMS on activity in the visual cortex, with all differences significant in direct statistical comparisons. Frontal TMS over either hemisphere elicited similar BOLD decreases for central visual field representations in V1-V4, but only right frontal TMS led to BOLD increases for peripheral field representations in these regions. Hemispheric differences for effects of parietal TMS were even more marked: Right parietal TMS led to strong BOLD changes in V1-V4 and V5/MT+, but left parietal TMS did not. These data directly confirm that the human frontal and parietal cortex show right-hemisphere specialization for causal influences on the visual cortex.

The role of early visual cortex in visual short-term memory and visual attention

We measured cortical activity with functional magnetic resonance imaging to probe the involvement of early visual cortex in visual short-term memory and visual attention. In four experimental tasks, human subjects viewed two visual stimuli separated by a variable delay period. The tasks placed differential demands on short-term memory and attention, but the stimuli were visually identical until after the delay period. Early visual cortex exhibited sustained responses throughout the delay when subjects performed attention-demanding tasks, but delay-period activity was not distinguishable from zero when subjects performed a task that required short-term memory. This dissociation reveals different computational mechanisms underlying the two processes.

Posterior parietal cortex and episodic retrieval: convergent and divergent effects of attention and memory

Functional neuroimaging studies of humans engaged in retrieval from episodic memory have revealed a surprisingly consistent pattern of retrieval-related activity in lateral posterior parietal cortex (PPC). Given the well-established role of lateral PPC in subserving goal-directed and reflexive attention, it has been hypothesized that PPC activation during retrieval reflects the recruitment of parietal attention mechanisms during remembering. Here, we evaluate this hypothesis by considering the anatomical overlap of retrieval and attention effects in lateral PPC. We begin by briefly reviewing the literature implicating dorsal PPC in goal-directed attention and ventral PPC in reflexive attention. We then discuss the pattern of dorsal and ventral PPC activation during episodic retrieval, and conclude with consideration of the degree of anatomical convergence across the two domains. This assessment revealed that predominantly divergent subregions of lateral PPC are engaged during acts of episodic retrieval and during goal-directed and reflexive attention, suggesting that PPC retrieval effects reflect functionally distinct mechanisms from these forms of attention. Although attention must play a role in aspects of retrieval, the data reviewed here suggest that further investigation into the relationship between processes of attention and memory, as well as alternative accounts of PPC contributions to retrieval, is warranted.

Functional heterogeneity of inferior parietal cortex during mathematical cognition assessed with cytoarchitectonic probability maps

Although the inferior parietal cortex (IPC) has been consistently implicated in mathematical cognition, the functional roles of its subdivisions are poorly understood. We address this problem using probabilistic cytoarchitectonic maps of IPC subdivisions intraparietal sulcus (IPS), angular gyrus (AG), and supramarginal gyrus. We quantified IPC responses relative to task difficulty and individual differences in task proficiency during mental arithmetic (MA) tasks performed with Arabic (MA-A) and Roman (MA-R) numerals. The 2 tasks showed similar levels of activation in 3 distinct IPS areas, hIP1, hIP2, and hIP3, suggesting their obligatory role in MA. Both AG areas, PGa and PGp, were strongly deactivated in both tasks, with stronger deactivations in posterior area PGp. Compared with the more difficult MA-R task, the MA-A task showed greater responses in both AG areas, but this effect was driven by less deactivation in the MA-A task. AG deactivations showed prominent overlap with lateral parietal nodes of the default mode network, suggesting a nonspecific role in MA. In both tasks, greater bilateral AG deactivation was associated with poorer performance. Our findings suggest a close link between IPC structure and function and they provide new evidence for behaviorally salient functional heterogeneity within the IPC during mathematical cognition.

Temporal order judgments activate temporal parietal junction

Perceptual temporal order judgments require an individual to determine the relative timing of two spatially separate events. Here we reveal the brain regions involved with this task. We had participants observe perceptually identical visual stimuli while conducting two different tasks: discriminating temporal order or discriminating spatial properties. By contrasting the functional magnetic resonance imaging signals during these tasks, we were able to isolate regions specifically engaged by each task. Participants observed two briefly presented rectangles. In one task, participants were instructed to report which appeared first, and, in the other, they were requested to report which rectangle was squarer. A potential confound of this study is that the temporal order judgment (TOJ) task required processing of brief events (onsets), whereas the shape task did not require temporal selectivity. To address this, we conducted a second study in which both tasks required discriminating brief events concurrent with the object onsets. The stimuli were similar to the first experiment, except a gray line was briefly superimposed on each rectangle at onset. Participants reported either which rectangle appeared first (TOJ) or which rectangle had a slightly wider gray line (shape). The first study found that the TOJ task resulted in greater bilateral activation of the temporal parietal junction (TPJ). The second revealed TOJ activation in the TPJ of the left hemisphere. This suggests that TPJ activation increases when we need to temporally sequence information. This finding supports the notion that the TPJ may be a crucial component of the "when" pathway.

Auditory attention activates peripheral visual cortex

Background

Recent neuroimaging studies have revealed that putatively unimodal regions of visual cortex can be activated during auditory tasks in sighted as well as in blind subjects. However, the task determinants and functional significance of auditory occipital activations (AOAs) remains unclear.

Methodology/Principal Findings

We examined AOAs in an intermodal selective attention task to distinguish whether they were stimulus-bound or recruited by higher-level cognitive operations associated with auditory attention. Cortical surface mapping showed that auditory occipital activations were localized to retinotopic visual cortex subserving the far peripheral visual field. AOAs depended strictly on the sustained engagement of auditory attention and were enhanced in more difficult listening conditions. In contrast, unattended sounds produced no AOAs regardless of their intensity, spatial location, or frequency.

Conclusions/Significance

Auditory attention, but not passive exposure to sounds, routinely activated peripheral regions of visual cortex when subjects attended to sound sources outside the visual field. Functional connections between auditory cortex and visual cortex subserving the peripheral visual field appear to underlie the generation of AOAs, which may reflect the priming of visual regions to process soon-to-appear objects associated with unseen sound sources.

Evidence for a frontoparietal control system revealed by intrinsic functional connectivity

Two functionally distinct, and potentially competing, brain networks have been recently identified that can be broadly distinguished by their contrasting roles in attention to the external world versus internally directed mentation involving long-term memory. At the core of these two networks are the dorsal attention system and the hippocampal-cortical memory system, a component of the brain's default network. Here spontaneous blood-oxygenation-level-dependent (BOLD) signal correlations were used in three separate functional magnetic resonance imaging data sets (n = 105) to define a third system, the frontoparietal control system, which is spatially interposed between these two previously defined systems. The frontoparietal control system includes many regions identified as supporting cognitive control and decision-making processes including lateral prefrontal cortex, anterior cingulate cortex, and inferior parietal lobule. Detailed analysis of frontal and parietal cortex, including use of high-resolution data, revealed clear evidence for contiguous but distinct regions: in general, the regions associated with the frontoparietal control system are situated between components of the dorsal attention and hippocampal-cortical memory systems. The frontoparietal control system is therefore anatomically positioned to integrate information from these two opposing brain systems.

Functional brain organization for visual search in ASD

Although previous studies have shown that individuals with autism spectrum disorder (ASD) excel at visual search, underlying neural mechanisms remain unknown. This study investigated the neurofunctional correlates of visual search in children with ASD and matched typically developing (TD) children, using an event-related functional magnetic resonance imaging design. We used a visual search paradigm, manipulating search difficulty by varying set size (6, 12, or 24 items), distractor composition (heterogeneous or homogeneous) and target presence to identify brain regions associated with efficient and inefficient search. While the ASD group did not evidence accelerated response time (RT) compared with the TD group, they did demonstrate increased search efficiency, as measured by RT by set size slopes. Activation patterns also showed differences between ASD group, which recruited a network including frontal, parietal, and occipital cortices, and the TD group, which showed less extensive activation mostly limited to occipito-temporal regions. Direct comparisons (for both homogeneous and heterogeneous search conditions) revealed greater activation in occipital and frontoparietal regions in ASD than in TD participants. These results suggest that search efficiency in ASD may be related to enhanced discrimination (reflected in occipital activation) and increased top-down modulation of visual attention (associated with frontoparietal activation).

Large-scale brain networks account for sustained and transient activity during target detection

Target detection paradigms have been widely applied in the study of human cognitive functions, particularly those associated with arousal, attention, stimulus processing and memory. In EEG recordings, the detection of task-relevant stimuli elicits the P300 component, a transient response with latency around 300 ms. The P300 response has been shown to be affected by the amount of mental effort and learning, as well as habituation. Furthermore, trial-by-trial variability of the P300 component has been associated with inter-stimulus interval, target-to-target interval or target probability; however, understanding the mechanisms underlying this variability is still an open question. In order to investigate whether it could be related to the distinct cortical networks in which coherent intrinsic activity is organized, and to understand the contribution of those networks to target detection processes, we carried out a simultaneous EEG-fMRI study, collecting data from 13 healthy subjects during a visual oddball task. We identified five large-scale networks, that largely overlap with the dorsal attention, the ventral attention, the core, the visual and the sensory-motor networks. Since the P300 component has been consistently associated with target detection, we concentrated on the first two brain networks, the time-course of which showed a modulation with the P300 response as detected in simultaneous EEG recordings. A trial-by-trial EEG-fMRI correlation approach revealed that they are involved in target detection with different functional roles: the ventral attention network, dedicated to revealing salient stimuli, was transiently activated by the occurrence of targets; the dorsal attention network, usually engaged during voluntary orienting, reflected sustained activity, possibly related to search for targets.

The reorienting system of the human brain: from environment to theory of mind

Survival can depend on the ability to change a current course of action to respond to potentially advantageous or threatening stimuli. This "reorienting" response involves the coordinated action of a right hemisphere dominant ventral frontoparietal network that interrupts and resets ongoing activity and a dorsal frontoparietal network specialized for selecting and linking stimuli and responses. At rest, each network is distinct and internally correlated, but when attention is focused, the ventral network is suppressed to prevent reorienting to distracting events. These different patterns of recruitment may reflect inputs to the ventral attention network from the locus coeruleus/norepinephrine system. While originally conceptualized as a system for redirecting attention from one object to another, recent evidence suggests a more general role in switching between networks, which may explain recent evidence of its involvement in functions such as social cognition.

Top-down and bottom-up attention to memory: a hypothesis (AtoM) on the role of the posterior parietal cortex in memory retrieval

Recent neuroimaging studies have implicated the posterior parietal cortex in episodic memory retrieval, but there is uncertainty about its specific role. Research in the attentional domain has shown that superior parietal lobe (SPL) regions along the intraparietal sulcus are implicated in the voluntary orienting of attention to relevant aspects of the environment, whereas inferior parietal lobe (IPL) regions at the temporo-parietal junction mediate the automatic allocation of attention to task-relevant information. Here we propose that the SPL and the IPL play conceptually similar roles in episodic memory retrieval. We hypothesize that the SPL allocates top-down attention to memory retrieval, whereas the IPL mediates the automatic, bottom-up attentional capture by retrieved memory contents. By reviewing the existing fMRI literature, we show that the posterior intraparietal sulcus of SPL is consistently active when the need for top-down assistance to memory retrieval is supposedly maximal, e.g., for memories retrieved with low vs. high confidence, for familiar vs. recollected memories, for recognition of high vs. low frequency words. On the other hand, the supramarginal gyrus of IPL is consistently active when the attentional capture by memory contents is supposedly maximal, i.e., for strong vs. weak memories, for vividly recollected vs. familiar memories, for memories retrieved with high vs. low confidence. We introduce a model of episodic memory retrieval that characterizes contributions of posterior parietal cortex.

Cortical network for vibrotactile attention: a fMRI study

We used fMRI to identify brain areas activated during tactile attention tasks. Participants detected the interval containing target stimulation of higher vibrotactile frequency or longer duration. Attributes were selectively or neutrally cued. A control backwards-counting task included concurrent, but irrelevant corresponding vibrotactile stimulation. Group analyses of average F-statistic maps, participant conjunction maps, and estimated time courses utilized data mapped to a standard average surface atlas (PALS B12). Repeated-measures, random-effects MANOVA examined blood oxygenation level-dependent (BOLD) signal modulation differences amongst tasks in defined regions, where significant responses occurred in at least 50% of the group. Greater than 0.1% increase in BOLD responses were found during at least one of the tactile attention tasks in contralateral parietal opercular OP1, BA 4 finger region, frontal eye field, dorsal premotor, anterior and posterior BA 7, and bilaterally in superior temporal sulcal cortex (BA 22), ventral premotor, supplementary motor area, and frontal operculum/insula. The same tasks suppressed activity in ipsilateral OP4. The BA 22 ROI showed larger responses during neutral cuing. The control task suppressed BOLD in ipsilateral OP1 and OP4 and bilaterally in BA 40, but significantly enhanced responses in dorsal parietal-frontal regions compared with tactile attention tasks. No regional differences were found between selectively cued frequency and duration tasks. Tactile attention effects were most prominent in OP1. Posterior parietal responses possibly reflected the visual attention required for backwards-counting, whereas the frontal regions potentially related to goal-directed behavior when identifying target stimulation.

Linking Visual Attention and Number Processing in the Brain: The Role of the Temporo-parietal Junction in Small and Large Symbolic and Nonsymbolic Number Comparison

There exists a long-standing debate regarding whether small and large numerosities engage different networks of processing. The ability to rapidly enumerate small (1–4) numerosities is referred to as “subitizing” and is thought to be qualitatively different from large numerosity processing. Functional neuro-imaging studies have attempted to dissociate neural correlates of small and large number processing by contrasting subitizing with counting of numerosities just outside the subitizing range. In the present study, we used functional magnetic resonance imaging (fMRI) to contrast the processing of numerosities in the “subitizing range” with numerosities requiring estimation. Participants compared sequentially presented slides of either dots or Arabic numerals for their relative magnitude. We show that comparison of nonsymbolic numerosities in the subitizing range led to activation of the right temporo-parietal junction, while at the same time this region was found to be suppressed during large numerosity processing. Furthermore, relative suppression of this region was strongly associated with faster response times. In previous studies, this region has been implicated in stimulus-driven attention.We therefore contend that activation of the temporo-parietal junction during small number processing and the suppression thereof during large numerosity comparisons reflects differential reliance on stimulus-driven versus goal-directed attentional networks in the brain.

A frontoparietal network for spatial attention reorienting in the auditory domain: a human fMRI/MEG study of functional and temporal dynamics

Several studies have identified a supramodal network critical to the reorienting of attention toward stimuli at novel locations and which involves the right temporoparietal junction and the inferior frontal areas. The present functional magnetic resonance imaging (fMRI)\magnetoencephalography (MEG) study investigates: 1) the cerebral circuit underlying attentional reorienting to spatially varying sound locations; 2) the circuit related to the regular change of sound location in the same hemifield, the change of sound location across hemifields, or sounds presented randomly at different locations on the azimuth plane; 3) functional temporal dynamics of the observed cortical areas exploiting the complementary characteristics of the fMRI and MEG paradigms. fMRI results suggest 3 distinct roles: the supratemporal plane appears modulated by variations of sound location; the inferior parietal lobule is modulated by the cross-meridian effect; and the inferior frontal cortex is engaged by the inhibition of a motor response. MEG data help to elucidate the temporal dynamics of this network by providing high-resolution time series with which to measure latency of neural activation manipulated by the reorienting of attention.

Neural Dynamics of Event Segmentation in Music: Converging Evidence for Dissociable Ventral and Dorsal Networks

The real world presents our sensory systems with a continuous stream of undifferentiated information. Segmentation of this stream at event boundaries is necessary for object identification and feature extraction. Here, we investigate the neural dynamics of event segmentation in entire musical symphonies under natural listening conditions. We isolated time-dependent sequences of brain responses in a 10 s window surrounding transitions between movements of symphonic works. A strikingly right-lateralized network of brain regions showed peak response during the movement transitions when, paradoxically, there was no physical stimulus. Model-dependent and model-free analysis techniques provided converging evidence for activity in two distinct functional networks at the movement transition: a ventral fronto-temporal network associated with detecting salient events, followed in time by a dorsal fronto-parietal network associated with maintaining attention and updating working memory. Our study provides direct experimental evidence for dissociable and causally linked ventral and dorsal networks during event segmentation of ecologically valid auditory stimuli.

Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS-fMRI

It has often been proposed that regions of the human parietal and/or frontal lobe may modulate activity in visual cortex, for example, during selective attention or saccade preparation. However, direct evidence for such causal claims is largely missing in human studies, and it remains unclear to what degree the putative roles of parietal and frontal regions in modulating visual cortex may differ. Here we used transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) concurrently, to show that stimulating right human intraparietal sulcus (IPS, at a site previously implicated in attention) elicits a pattern of activity changes in visual cortex that strongly depends on current visual context. Increased intensity of IPS TMS affected the blood oxygen level-dependent (BOLD) signal in V5/MT+ only when moving stimuli were present to drive this visual region, whereas TMS-elicited BOLD signal changes were observed in areas V1-V4 only during the absence of visual input. These influences of IPS TMS upon remote visual cortex differed significantly from corresponding effects of frontal (eye field) TMS, in terms of how they related to current visual input and their spatial topography for retinotopic areas V1-V4. Our results show directly that parietal and frontal regions can indeed have distinct patterns of causal influence upon functional activity in human visual cortex.

Activity in Right Temporo-Parietal Junction is Not Selective for Theory-of-Mind

Recent researchers have suggested that a region of right temporo-parietal junction (RTPJ) selectively subserves the attribution of beliefs to other people (Saxe R, Kanwisher N. 2003. People thinking about thinking people: fMRI investigations of theory of mind. NeuroImage. 19:1835-1842; Saxe R, Powell LJ. 2006. It's the thought that counts: specific brain regions for one component of theory of mind. Psychol Sci. 17:692-699; Saxe R, Wexler A. 2005. Making sense of another mind: the role of the right temporo-parietal junction. Neuropsychologia. 43:1391-1399). At the same time, a similar RTPJ region has been observed repeatedly in a variety of nonsocial tasks that require participants to redirect attention to task-relevant stimuli (e.g., Corbetta M, Shulman GL. 2002. Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci. 3:201-215; Serences JT, Shomstein S, Leber AB, Golay X, Egeth HE, Yantis S. 2005. Coordination of voluntary and stimulus-driven attentional control in human cortex. Psychol Sci. 16:114-122). However, because these 2 sets of tasks have never been compared within the same participants, it remains unclear whether these observations refer to the exact same region of RTPJ or may instead involve neighboring regions with distinct functional profiles. To test the claim that there is a region of RTPJ selective for belief attribution, the current study used functional neuroimaging to examine the extent to which cortical loci identified by a "theory-of-mind localizer" also distinguish between trials on a target detection task that varied demands to reorient attention (i.e., a version of the "Posner cueing task"). Results were incompatible with claims of RTPJ selectivity for mental state attribution. Regardless of whether regions were defined from group analyses or were individually tailored for each participant, RTPJ activity was also modulated by the nonsocial attentional task. The overlap between theory-of-mind and attentional reorienting suggests the need for new accounts of RTPJ function that integrate across these disparate task comparisons.

Right TPJ Deactivation during Visual Search: Functional Significance and Support for a Filter Hypothesis

Behavioral performance depends on attending to important objects in the environment rather than irrelevant objects. Regions in the right temporal-parietal junction (TPJ) are thought to be involved in redirecting attention to new objects that are behaviorally relevant. When subjects monitor a stream of distracter objects for a target, TPJ deactivates until the target is detected. We have proposed that the deactivation reflects the filtering of irrelevant inputs from TPJ, preventing unimportant objects from being attended. This hypothesis predicts that the mean deactivation to distracters should be larger when the subsequent target is detected than missed, reflecting more efficient filtering. An analysis of the blood oxygenation level-dependent (BOLD) task-evoked signals from 20 subjects during 2 monitoring tasks confirmed this prediction for regions in right supramarginal gyrus (SMG). Because the deactivation preceded the target, this mean BOLD-detection relationship did not reflect feedback from target detection or postdetection processes. The SMG regions showing this relationship overlapped or neighbored some regions associated with a "default" mode of brain function, suggesting the functional significance of deactivations in some default regions during task performance.

Eye Movement and Visual Search: Are There Elementary Abnormalities in Autism?

Although atypical eye gaze is commonly observed in autism, little is known about underlying oculomotor abnormalities. Our review of visual search and oculomotor systems in the healthy brain suggests that relevant networks may be partially impaired in autism, given regional abnormalities known from neuroimaging. However, direct oculomotor evidence for autism remains limited. This gap is critical since oculomotor abnormalities might play a causal role in functions known to be impaired in autism, such as imitation and joint attention. We integrate our oculomotor review into a developmental approach to language impairment related to nonverbal prerequisites. Oculomotor abnormalities may play a role as a sensorimotor defect at the root of impairments in later developing functional systems, ultimately resulting in sociocommunicative deficits.

Dissociation of stimulus relevance and saliency factors during shifts of visuospatial attention

The control of visuospatial attention entails multiple processes, including both voluntary (endogenous) factors and stimulus-driven (exogenous) factors. Exogenous processes can be triggered by visual targets presented at a previously unattended location, thus capturing attention in a stimulus-driven manner. However, little is known about the relative role of stimulus salience and behavioral relevance for this type of spatial reorienting. Here, we directly assessed how salience and relevance affect activation of the frontoparietal attentional system, using either low-salience but task-relevant target stimuli or salient but task-irrelevant flickering checkerboards. We compared event-related functional magnetic resonance imaging responses for stimuli presented at the unattended versus attended side (invalid minus valid trials), separately for the 2 categories of visual stimuli. We found that task-relevant invalid targets activated the frontoparietal attentional network, demonstrating that this system engages when target stimuli are presented at an unattended location, even when these have a low perceptual salience. Conversely, the presentation of high-salience checkerboards in one hemifield while endogenous attention was engaged elsewhere did not activate the attentional network. These findings indicate that task relevance is critical for stimulus-driven engagement of the attentional network when attentional resources are endogenously allocated somewhere else.

Attentional preparation for a lateralized visual distractor: behavioral and fMRI evidence

Attending to the location of an expected visual target can lead to anticipatory activations in spatiotopic occipital cortex, emerging before target onset. But less is known about how the brain may prepare for a distractor at a known location remote from the target. In a psychophysical experiment, we found that trial-to-trial advance knowledge about the presence of a distractor in the target-opposite hemifield significantly reduced its behavioral cost. In a subsequent functional magnetic resonance imaging experiment with similar task and stimuli, we found anticipatory activations in the occipital cortex contralateral to the expected distractor, but no additional target modulation, when participants were given advance information about a distractor's subsequent presence and location. Several attention-related control structures (frontal eye fields and superior parietal cortex) were active during attentional preparation for all trials, whereas the left superior prefrontal and right angular gyri were additionally activated when a distractor was anticipated. The right temporoparietal junction showed stronger functional coupling with occipital regions during preparation for trials with an isolated target than for trials with a distractor expected. These results show that anticipation of a visual distractor at a known location, remote from the target, can lead to (1) a reduction in the behavioral cost of that distractor, (2) preparatory modulation of the occipital cortex contralateral to the location of the expected distractor, and (3) anticipatory activation of distinct parietal and frontal brain structures. These findings indicate that specific components of preparatory visual attention may be devoted to minimizing the impact of distractors, not just to enhancements of target processing.

Separate modulations of human V1 associated with spatial attention and task structure

Functional magnetic resonance imaging (fMRI) was used while normal human volunteers engaged in simple detection and discrimination tasks, revealing separable modulations of early visual cortex associated with spatial attention and task structure. Both modulations occur even when there is no change in sensory stimulation. The modulation due to spatial attention is present throughout the early visual areas V1, V2, V3, and VP, and varies with the attended location. The task structure activations are strongest in V1 and are greater in regions that represent more peripheral parts of the visual field. Control experiments demonstrate that the task structure activations cannot be attributed to visual, auditory, or somatosensory processing, the motor response for the detection/discrimination judgment, or oculomotor responses such as blinks or saccades. These findings demonstrate that early visual areas are modulated by at least two types of endogenous signals, each with distinct cortical distributions.

An fMRI study of the neural correlates of graded visual perception

The neural correlates of clearly perceived visual stimuli have been reported previously in contrast to unperceived stimuli, but it is uncertain whether intermediate or graded perceptual experiences correlate with different patterns of neural activity. In this study, the subjective appearance of briefly presented visual stimuli was rated individually by subjects with respect to perceptual clarity: clear, vague or no experience of a stimulus. Reports of clear experiences correlated with activation in a widespread network of brain areas, including parietal cortex, prefrontal cortex, premotor cortex, supplementary motor areas, insula and thalamus. The reports of graded perceptual clarity were reflected in graded neural activity in a network comprising the precentral gyrus, intraparietal sulcus, basal ganglia and the insula. In addition, the reports of vague experiences demonstrated unique patterns of activation. Different degrees of perceptual clarity were reflected both in the degree to which activation was found within parts of the network serving a clear conscious percept, and additional unique activation patterns for different degrees of perceptual clarity. Our findings support theories proposing the involvement of a widespread network of brain areas during conscious perception.

Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems

On the basis of task-related imaging studies in normal human subjects, it has been suggested that two attention systems exist in the human brain: a bilateral dorsal attention system involved in top-down orienting of attention and a right-lateralized ventral attention system involved in reorienting attention in response to salient sensory stimuli. An important question is whether this functional organization emerges only in response to external attentional demands or is represented more fundamentally in the internal dynamics of brain activity. To address this question, we examine correlations in spontaneous fluctuations of the functional MRI blood oxygen level-dependent signal in the absence of task, stimuli, or explicit attentional demands. We identify a bilateral dorsal attention system and a right-lateralized ventral attention system solely on the basis of spontaneous activity. Further, we observe regions in the prefrontal cortex correlated with both systems, a potential mechanism for mediating the functional interaction between systems. These findings demonstrate that the neuroanatomical substrates of human attention persist in the absence of external events, reflected in the correlation structure of spontaneous activity.

An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention

Attention can be voluntarily directed to a location or automatically summoned to a location by a salient stimulus. We compared the effects of voluntary and stimulus-driven shifts of spatial attention on the blood oxygenation level-dependent signal in humans, using a method that separated preparatory activity related to the initial shift of attention from the subsequent activity caused by target presentation. Voluntary shifts produced greater preparatory activity than stimulus-driven shifts in the frontal eye field (FEF) and intraparietal sulcus, core regions of the dorsal frontoparietal attention network, demonstrating their special role in the voluntary control of attention. Stimulus-driven attentional shifts to salient color singletons recruited occipitotemporal regions, sensitive to color information and part of the dorsal network, including the FEF, suggesting a partly overlapping circuit for endogenous and exogenous orienting. The right temporoparietal junction (TPJ), a core region of the ventral frontoparietal attention network, was strongly modulated by stimulus-driven attentional shifts to behaviorally relevant stimuli, such as targets at unattended locations. However, the TPJ did not respond to salient, task-irrelevant color singletons, indicating that behavioral relevance is critical for TPJ modulation during stimulus-driven orienting. Finally, both ventral and dorsal regions were modulated during reorienting but significantly only by reorienting after voluntary shifts, suggesting the importance of a mismatch between expectation and sensory input.

Spatially Selective Representations of Voluntary and Stimulus-Driven Attentional Priority in Human Occipital, Parietal, and Frontal Cortex

When multiple objects are present in a visual scene, they compete for cortical processing in the visual system; selective attention biases this competition so that representations of behaviorally relevant objects enter awareness and irrelevant objects do not. Deployments of selective attention can be voluntary (e.g., shift or attention to a target's expected spatial location) or stimulus driven (e.g., capture of attention by a target-defining feature such as color). Here we use functional magnetic resonance imaging to show that both of these factors induce spatially selective attentional modulations within regions of human occipital, parietal, and frontal cortex. In addition, the voluntary attentional modulations are temporally sustained, indicating that activity in these regions dynamically tracks the locus of attention. These data show that a convolution of factors, including prior knowledge of location and target-defining features, determines the relative competitive advantage of visual stimuli within multiple stages of the visual system.

TMS in the parietal cortex: updating representations for attention and action

Transcranial magnetic stimulation (TMS) is one of the most recent techniques to have been used in investigations of the parietal cortex but already a number of studies have employed it as a tool in investigations of attentional and sensorimotor processes in the human parietal cortices. The high temporal resolution of TMS has proved to be a particular strength of the technique and the experiments have led to hypotheses about when circumscribed regions of parietal cortex are critical for specific attentional and sensorimotor processes. A consistent theme that runs through many reports is that of a critical contribution of parietal areas when attention or movements are re-directed and representations for attention or action must be updated.

Visual Short-Term Memory Load Suppresses Temporo-Parietal Junction Activity and Induces Inattentional Blindness

The right temporo-parietal junction (TPJ) is critical for stimulus-driven attention and visual awareness. Here we show that as the visual short-term memory (VSTM) load of a task increases, activity in this region is increasingly suppressed. Correspondingly, increasing VSTM load impairs the ability of subjects to consciously detect the presence of a novel, unexpected object in the visual field. These results not only demonstrate that VSTM load suppresses TPJ activity and induces inattentional blindness, but also offer a plausible neural mechanism for this perceptual deficit: suppression of the stimulus-driven attentional network.

The functional organization of the intraparietal sulcus in humans and monkeys

In macaque monkeys, the posterior parietal cortex (PPC) is concerned with the integration of multimodal information for constructing a spatial representation of the external world (in relation to the macaque's body or parts thereof), and planning and executing object-centred movements. The areas within the intraparietal sulcus (IPS), in particular, serve as interfaces between the perceptive and motor systems for controlling arm and eye movements in space. We review here the latest evidence for the existence of the IPS areas AIP (anterior intraparietal area), VIP (ventral intraparietal area), MIP (medial intraparietal area), LIP (lateral intraparietal area) and CIP (caudal intraparietal area) in macaques, and discuss putative human equivalents as assessed with functional magnetic resonance imaging. The data suggest that anterior parts of the IPS comprising areas AIP and VIP are relatively well preserved across species. By contrast, posterior areas such as area LIP and CIP have been found more medially in humans, possibly reflecting differences in the evolution of the dorsal visual stream and the inferior parietal lobule. Despite interspecies differences in the precise functional anatomy of the IPS areas, the functional relevance of this sulcus for visuomotor tasks comprising target selections for arm and eye movements, object manipulation and visuospatial attention is similar in humans and macaques, as is also suggested by studies of neurological deficits (apraxia, neglect, Bálint's syndrome) resulting from lesions to this region.

Cortical regions involved in eye movements, shifts of attention, and gaze perception

Human vision is an active process that involves shifting attention across the visual scene, with or without moving the eyes. Such shifts of attention can be generated at will (endogenously) or be triggered automatically, i.e., generated in response to exogenous stimuli including socially relevant cues such as someone else's gaze. What are the common and distinct brain mechanisms involved in these processes? To address this question, we carried out a quantitative effect-location meta-analysis of 59 brain-imaging experiments whose results were published using standardized coordinates. For each condition of interest, namely voluntary and visually triggered eye movements, voluntary and visually triggered (covert) shifts of attention, and perception of someone else's gaze, we computed activation likelihood estimation (ALE) maps. Those maps represent at each voxel of the brain the probability of reporting a signal change related to the condition of interest. For eye movements, this analysis confirmed the spatial location of the frontal eye fields, supplementary eye fields, and parietal saccade-related regions. The map of covert shifts of attention demonstrated highest similarity with the map of saccadic eye movements. Gaze perception showed common activation likelihood with the other conditions in the right intraparietal sulcus and in the lateral precentral gyrus. It demonstrated more similarity with the reflexive than with the voluntary saccades and shifts of attention. We propose that a core network of frontoparietal and temporal brain regions is recruited when we shift the focus of our attention with or without eye movements in response to the appearance of a visual target, as well as when we see someone else shift his or her gaze.

Localizing P300 generators in visual target and distractor processing: a combined event-related potential and functional magnetic resonance imaging study

Constraints from functional magnetic resonance imaging (fMRI) were used to identify the sources of the visual P300 event-related potential (ERP). Healthy subjects performed a visual three-stimulus oddball paradigm with a difficult discrimination task while fMRI and high-density ERP data were acquired in separate sessions. This paradigm allowed us to differentiate the P3b component of the P300, which has been implicated in the detection of rare events in general (target and distractor), from the P3a component, which is mainly evoked by distractor events. The fMRI-constrained source model explained >99% of the variance of the scalp ERP for both components. The P3b was mainly produced by parietal and inferior temporal areas, whereas frontal areas and the insula contributed mainly to the P3a. This source model reveals that both higher visual and supramodal association areas contribute to the visual P3b and that the P3a has a strong frontal contribution, which is compatible with its more anterior distribution on the scalp. The results point to the involvement of distinct attentional subsystems in target and distractor processing.