Spatio-temporal Analysis of Feature-Based Attention

Strength of predicted information content in the brain biases decision behavior

Prediction-for-perception theories suggest that the brain predicts incoming stimuli to facilitate their categorization.1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17 However, it remains unknown what the information contents of these predictions are, which hinders mechanistic explanations. This is because typical approaches cast predictions as an underconstrained contrast between two categories18,19,20,21,22,23,24-e.g., faces versus cars, which could lead to predictions of features specific to faces or cars, or features from both categories. Here, to pinpoint the information contents of predictions and thus their mechanistic processing in the brain, we identified the features that enable two different categorical perceptions of the same stimuli. We then trained multivariate classifiers to discern, from dynamic MEG brain responses, the features tied to each perception. With an auditory cueing design, we reveal where, when, and how the brain reactivates visual category features (versus the typical category contrast) before the stimulus is shown. We demonstrate that the predictions of category features have a more direct influence (bias) on subsequent decision behavior in participants than the typical category contrast. Specifically, these predictions are more precisely localized in the brain (lateralized), are more specifically driven by the auditory cues, and their reactivation strength before a stimulus presentation exerts a greater bias on how the individual participant later categorizes this stimulus. By characterizing the specific information contents that the brain predicts and then processes, our findings provide new insights into the brain's mechanisms of prediction for perception.

Sustained selective attention to chromatic information enhances visuocortical gain at the population level

Prior work in selective attention research has shown that colour-selective attention enhances neural activity in visuocortical areas sensitive to the attended colour while suppressing activity in areas sensitive to ignored colours. However, it is currently unclear whether this effect is limited to attending to specific colour hues or extends to chromatic information more broadly. To investigate this question, we used steady-state visual evoked potentials (ssVEPs) frequency tagging to quantify participants' visuocortical responses to specific elements embedded in arrays of flickering, randomly moving mid-complex patterns. Participants were instructed to attend to either coloured or greyscale patterns while ignoring the others. We found that attending to either coloured or greyscale patterns produced robust increases in ssVEP amplitudes both compared to ignored stimuli and to baseline. There was however no evidence of suppressed responses to ignored patterns. These findings demonstrate that attentional selection based on the presence or absence of chromatic information prompts selectively enhanced visuocortical processing but this selective amplification is not accompanied by suppression of unattended stimuli. Findings are consistent with theoretical notions that predict strong competition between specific exemplars within a given feature dimension, such as red or green, but weak competition between broadly defined stimulus categories, such as chromatic versus non-chromatic.

How musical rhythm training improves short-term memory for faces

Playing a musical instrument engages numerous cognitive abilities, including sensory perception, selective attention, and short-term memory. Mounting evidence indicates that engaging these cognitive functions during musical training will improve performance of these same functions. Yet, it remains unclear the extent these benefits may extend to nonmusical tasks, and what neural mechanisms may enable such transfer. Here, we conducted a preregistered randomized clinical trial where nonmusicians underwent 8 wk of either digital musical rhythm training or word search as control. Only musical rhythm training placed demands on short-term memory, as well as demands on visual perception and selective attention, which are known to facilitate short-term memory. As hypothesized, only the rhythm training group exhibited improved short-term memory on a face recognition task, thereby providing important evidence that musical rhythm training can benefit performance on a nonmusical task. Analysis of electroencephalography data showed that neural activity associated with sensory processing and selective attention were unchanged by training. Rather, rhythm training facilitated neural activity associated with short-term memory encoding, as indexed by an increased P3 of the event-related potential to face stimuli. Moreover, short-term memory maintenance was enhanced, as evidenced by increased two-class (face/scene) decoding accuracy. Activity from both the encoding and maintenance periods each highlight the right superior parietal lobule (SPL) as a source for training-related changes. Together, these results suggest musical rhythm training may improve memory for faces by facilitating activity within the SPL to promote how memories are encoded and maintained, which can be used in a domain-general manner to enhance performance on a nonmusical task.

Top-down modulation of visual cortical processing after transient congenital blindness

Early visual experience has been shown to be critical for the development of visual and multisensory functions; however, its impact on functional brain organization remains largely unexplored. Here, we therefore investigated the effect of early visual deprivation on top-down attentional modulation of visual cortical processing within the occipito-temporal cortex. Furthermore, we explored whether early visual deprivation may affect the extent to which typically visual, motion-selective area hMT responds to moving visual stimuli. Using functional magnetic resonance imaging, we compared cortical responses in area hMT and in the fusiform face area (FFA) to moving face stimuli - which were either task relevant or task irrelevant - relative to stationary face stimuli between cataract-reversal participants and normally sighted controls. Although both groups exhibited significantly stronger visual cortical responses in area hMT to moving stimuli than during the stationary baseline, the magnitude of this effect was significantly lower in the cataract-reversal group. In contrast, both groups exhibited significantly enhanced visual cortical responses in area hMT and in the FFA when moving face stimuli were task relevant compared to when they were task irrelevant, with no significant differences between groups in the magnitude of these effects. These results indicate that top-down attentional modulation of visual cortical processing in area hMT and FFA does not depend on early visual experience. Furthermore, the present results suggest that the functional specialization of area hMT for visual motion processing may be partially disrupted by early visual deprivation.

Emotion and attention in face processing: Complementary evidence from surface event-related potentials and intracranial amygdala recordings

Face processing is biased by emotional and voluntarily directed attention, both of which modulate processing in distributed cortical areas. The amygdala is assumed to contribute to an attentional bias for emotional faces, although its interaction with directed attention awaits further clarification. Here, we studied the interaction of emotion and attention during face processing via scalp EEG potentials of healthy participants and intracranial EEG (iEEG) recordings of the right amygdala in one patient. Three randomized blocks consisting of angry, neutral, and happy facial expressions were presented, and one expression was denoted as the target category in each block. Happy targets were detected fastest and most accurately both in the group study and by the iEEG patient. Occipital scalp potentials revealed emotion differentiation for happy faces in the early posterior negativity (EPN) around 300 ms after stimulus onset regardless of the target condition. A similar response to happy faces occurred in the amygdala only for happy targets. On the scalp, a late positive potential (LPP, around 600 ms) enhancement for targets occurred for all target conditions alike. A simultaneous late signal in the amygdala was largest for emotional targets. No late signal enhancements were found for neutral targets in the amygdala. Cortical modulations, by contrast, showed both attention-independent effects of emotion and emotion-independent effects of attention. These results demonstrate an attention-dependence of amygdala activity during the processing of facial expressions and partly independent cortical mechanisms.

Visual Motion Coherence Responses in Human Visual Cortex

Random dot kinematograms (RDKs) have recently been used to train subjects with cortical scotomas to perform direction of motion discrimination, partially restoring visual motion perception. To study the recovery of visual perception, it is important to understand how visual areas in normal subjects and subjects with cortical scotomas respond to RDK stimuli. Studies in normal subjects have shown that blood oxygen level-dependent (BOLD) responses in human area hV5/MT+ increase monotonically with coherence, in general agreement with electrophysiology studies in primates. However, RDK responses in prior studies were obtained while the subject was performing fixation, not a motion discrimination condition. Furthermore, BOLD responses were gauged against a baseline condition of uniform illumination or static dots, potentially decreasing the specificity of responses for the spatial integration of local motion signals (motion coherence). Here, we revisit this question starting from a baseline RDK condition of no coherence, thereby isolating the component of BOLD response due specifically to the spatial integration of local motion signals. In agreement with prior studies, we found that responses in the area hV5/MT+ of healthy subjects were monotonically increasing when subjects fixated without performing a motion discrimination task. In contrast, when subjects were performing an RDK direction of motion discrimination task, responses in the area hV5/MT+ remained flat, changing minimally, if at all, as a function of motion coherence. A similar pattern of responses was seen in the area hV5/MT+ of subjects with dense cortical scotomas performing direction of motion discrimination for RDKs presented inside the scotoma. Passive RDK presentation within the scotoma elicited no significant hV5/MT+ responses. These observations shed further light on how visual cortex responses behave as a function of motion coherence, helping to prepare the ground for future studies using these methods to study visual system recovery after injury.

Selective attention involves a feature-specific sequential release from inhibitory gating

Selective attention is a fundamental cognitive mechanism that allows our brain to preferentially process relevant sensory information, while filtering out distracting information. Attention is thought to flexibly gate the communication of irrelevant information through top-down alpha-rhythmic (8-12 Hz) functional connections, which influence early visual processing. However, the dynamic effects of top-down influence on downstream visual processing remain unknown. Here, we used electroencephalography to investigate local and network effects of selective attention while subjects attended to distinct features of identical stimuli. We found that attention-related changes in the functional brain network organization emerge shortly after stimulus onset, accompanied by an overall decrease of functional connectivity. Signatures of attentional selection were evident from a sequential release from alpha-band parietal gating in feature-selective areas. The directed connectivity paths and temporal evolution of this release from gating were consistent with the sensory effect of each feature, providing a neural basis for how visual processing quickly prioritizes relevant information in functionally specialized areas.

Neural responses to natural visual motion are spatially selective across the visual field, with selectivity differing across brain areas and task

It is well established that neural responses to visual stimuli are enhanced at select locations in the visual field. Although spatial selectivity and the effects of spatial attention are well understood for discrete tasks (e.g. visual cueing), little is known for naturalistic experience that involves continuous dynamic visual stimuli (e.g. driving). Here, we assess the strength of neural responses across the visual space during a kart‐race game. Given the varying relevance of visual location in this task, we hypothesized that the strength of neural responses to movement will vary across the visual field, and it would differ between active play and passive viewing. To test this, we measure the correlation strength of scalp‐evoked potentials with optical flow magnitude at individual locations on the screen. We find that neural responses are strongly correlated at task‐relevant locations in visual space, extending beyond the focus of overt attention. Although the driver's gaze is directed upon the heading direction at the centre of the screen, neural responses were robust at the peripheral areas (e.g. roads and surrounding buildings). Importantly, neural responses to visual movement are broadly distributed across the scalp, with visual spatial selectivity differing across electrode locations. Moreover, during active gameplay, neural responses are enhanced at select locations in the visual space. Conventionally, spatial selectivity of neural response has been interpreted as an attentional gain mechanism. In the present study, the data suggest that different brain areas focus attention on different portions of the visual field that are task‐relevant, beyond the focus of overt attention.

What processes are disrupted during the attentional blink? An integrative review of event-related potential research

Reporting the second of two targets is impaired when these appear in close succession, a phenomenon known as the attentional blink (AB). Despite decades of research, what factors limit our ability to process multiple sequentially presented events remains unclear. Specifically, two central issues remain open: does failure to report the second target (T2) reflect a structural limitation in working memory (WM) encoding or a disruption to attentional processes? And is perceptual processing of the stimulus that we fail to report impaired, or only processes that occur after this stimulus is identified? We address these questions by reviewing event-related potential (ERP) studies of the AB, after providing a brief overview of the theoretical landscape relevant to these debates and clarifying key concepts essential for interpreting ERP studies. We show that failure to report the second target is most often associated with disrupted attentional engagement (associated with a smaller and delayed N2pc component). This disruption occurs after early processing of T2 (associated with an intact P1 component), weakens its semantic processing (typically associated with a smaller N400 component), and prevents its encoding into WM (associated with absent P3b). However, failure to encode T2 in WM can occur despite intact attentional engagement and semantic processing. We conclude that the AB phenomenon, which reflects our limited ability to process sequential events, emerges from the disruption of both attentional engagement and WM encoding.

Attention control: The missing link between sensory discrimination and intelligence

Intelligence is correlated with the ability to make fine sensory discriminations. Although this relationship has been known since the beginning of intelligence testing, the mechanisms underlying this relationship are still unknown. In two large-scale structural equation-modelling studies, we investigated whether individual differences in attention control abilities can explain the relationship between sensory discrimination and intelligence. Across these two studies, we replicated the finding that attention control fully mediated the relationships of intelligence/working-memory capacity to sensory discrimination. Our findings show that attention control plays a prominent role in relating sensory discrimination to higher-order cognitive abilities.

Nested oscillations and brain connectivity during sequential stages of feature-based attention

Brain mechanisms of visual selective attention involve both local and network-level activity changes at specific oscillatory rhythms, but their interplay remains poorly explored. Here, we investigate anticipatory and reactive effects of feature-based attention using separate fMRI and EEG recordings, while participants attended to one of two spatially overlapping visual features (motion and orientation). We focused on EEG source analysis of local neuronal rhythms and nested oscillations and on graph analysis of connectivity changes in a network of fMRI-defined regions of interest, and characterized a cascade of attentional effects at multiple spatial scales. We discuss how the results may reconcile several theories of selective attention, by showing how β rhythms support anticipatory information routing through increased network efficiency, while reactive α-band desynchronization patterns and increased α-γ coupling in task-specific sensory areas mediate stimulus-evoked processing of task-relevant signals.

Temporal attention boosts perceptual effects of spatial attention and feature-based attention

Temporal attention, that is, the process of anticipating the occurrence of a stimulus at a given time point, has been shown to improve perceptual processing of visual stimuli. In the present study, we investigated whether and how temporal attention interacts with spatial attention and feature-based attention in visual selection. To monitor the influence of the three different attention dimensions on perceptual processing, we measured event-related potentials (ERPs). Our participants performed a visual search task, in which a colored singleton was presented amongst homogenous distractors. We manipulated spatial and feature-based attention by requiring participants to respond only to target singletons in a particular color and at a to-be-attended spatial location. We manipulated temporal attention by means of an explicit temporal cue that announced either validly or invalidly the occurrence of the search display. We obtained early ERP effects of spatial attention and feature-based attention at the validly cued but not at the invalidly cued time point. Taken together, our results suggest that temporal attention boosts early effects of spatial and feature-based attention.

In search of exogenous feature-based attention

Visual attention prioritizes the processing of sensory information at specific spatial locations (spatial attention; SA) or with specific feature values (feature-based attention; FBA). SA is well characterized in terms of behavior, brain activity, and temporal dynamics-for both top-down (endogenous) and bottom-up (exogenous) spatial orienting. FBA has been thoroughly studied in terms of top-down endogenous orienting, but much less is known about the potential of bottom-up exogenous influences of FBA. Here, in four experiments, we adapted a procedure used in two previous studies that reported exogenous FBA effects, with the goal of replicating and expanding on these findings, especially regarding its temporal dynamics. Unlike the two previous studies, we did not find significant effects of exogenous FBA. This was true (1) whether accuracy or RT was prioritized as the main measure, (2) with precues presented peripherally or centrally, (3) with cue-to-stimulus ISIs of varying durations, (4) with four or eight possible target locations, (5) at different meridians, (6) with either brief or long stimulus presentations, (7) and with either fixation contingent or noncontingent stimulus displays. In the last experiment, a postexperiment participant questionnaire indicated that only a small subset of participants, who mistakenly believed the irrelevant color of the precue indicated which stimulus was the target, exhibited benefits for valid exogenous FBA precues. Overall, we conclude that with the protocol used in the studies reporting exogenous FBA, the exogenous stimulus-driven influence of FBA is elusive at best, and that FBA is primarily a top-down, goal-driven process.

Left-Hemispheric Asymmetry for Object-Based Attention: an ERP Study

It has been shown that selective attention enhances the activity in visual regions associated with stimulus processing. The left hemisphere seems to have a prominent role when non-spatial attention is directed towards specific stimulus features (e.g., color, spatial frequency). The present electrophysiological study investigated the time course and neural correlates of object-based attention, under the assumption of left-hemispheric asymmetry. Twenty-nine right-handed participants were presented with 3D graphic images representing the shapes of different object categories (wooden dummies, chairs, structures of cubes) which lacked detail. They were instructed to press a button in response to a target stimulus indicated at the beginning of each run. The perception of non-target stimuli elicited a larger anterior N2 component, which was likely associated with motor inhibition. Conversely, target selection resulted in an enhanced selection negativity (SN) response lateralized over the left occipito-temporal regions, followed by a larger centro-parietal P300 response. These potentials were interpreted as indexing attentional selection and categorization processes, respectively. The standardized weighted low-resolution electromagnetic tomography (swLORETA) source reconstruction showed the engagement of a fronto-temporo-limbic network underlying object-based visual attention. Overall, the SN scalp distribution and relative neural generators hinted at a left-hemispheric advantage for non-spatial object-based visual attention.

Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention

Spatial attention changes the sampling of visual space. Behavioral studies suggest that feature-based attention modulates this resampling to optimize the attended feature's sampling. We investigate this hypothesis by estimating spatial sampling in visual cortex while independently varying both feature-based and spatial attention. Our results show that spatial and feature-based attention interacted: resampling of visual space depended on both the attended location and feature (color vs. temporal frequency). This interaction occurred similarly throughout visual cortex, regardless of an area's overall feature preference. However, the interaction did depend on spatial sampling properties of voxels that prefer the attended feature. These findings are parsimoniously explained by variations in the precision of an attentional gain field. Our results demonstrate that the deployment of spatial attention is tailored to the spatial sampling properties of units that are sensitive to the attended feature.

Frontal Eye Field Involvement in Color and Motion Feature-Based Attention: Single-Pulse Transcranial Magnetic Stimulation

An object can have multiple attributes, and visual feature-based attention (FBA) is the process of focusing on a specific one of them. During visual FBA, the frontal eye field (FEF) is considered to be an important brain area related to the choice of attribute. However, the study of the FEF in FBA remains inadequate. We applied single-pulse transcranial magnetic stimulation (TMS) to the right FEF (rFEF), and designed two independent experimental FBA tasks that each involved two attributes (color and motion), to explore the action time of FEF and the spatial transmission of the FEF signal, respectively. The results of the first experiment showed that when TMS was applied to the rFEF at 100 ms after the target image stimulus began, the subjects’ response time increased significantly compared with the response time in the control trials (in which TMS was applied to the vertex). This indicated that inhibiting the rFEF influenced the progress of visual FBA. The results confirm that the FEF is involved in the early stage of visual attention (at ~100 ms). In the second experiment, TMS was applied at 100 ms after the target image stimulus began. We analyzed the electroencephalogram (EEG) signal after TMS, and found that the electrode signal amplitudes for FC4 (which corresponded to the rFEF) were significantly correlated with the electrode signal amplitudes in the posterior regions. In addition, the amplitude rise of the posterior electrode signal lagged ~50 ms behind that of the FC4. Furthermore, for color and motion, different areas in the posterior brain region were involved in signal transmission. In this study, the application of single-pulse TMS was shown to provide a direct and effective method for research on the FEF, and the combination of TMS and EEG recordings allows a high degree of time resolution, which can provide powerful evidence for research on neural signal transmission.

The role of inferior frontal junction in controlling the spatially global effect of feature-based attention in human visual areas

Feature-based attention has a spatially global effect, i.e., responses to stimuli that share features with an attended stimulus are enhanced not only at the attended location but throughout the visual field. However, how feature-based attention modulates cortical neural responses at unattended locations remains unclear. Here we used functional magnetic resonance imaging (fMRI) to examine this issue as human participants performed motion- (Experiment 1) and color- (Experiment 2) based attention tasks. Results indicated that, in both experiments, the respective visual processing areas (middle temporal area [MT+] for motion and V4 for color) as well as early visual, parietal, and prefrontal areas all showed the classic feature-based attention effect, with neural responses to the unattended stimulus significantly elevated when it shared the same feature with the attended stimulus. Effective connectivity analysis using dynamic causal modeling (DCM) showed that this spatially global effect in the respective visual processing areas (MT+ for motion and V4 for color), intraparietal sulcus (IPS), frontal eye field (FEF), medial frontal gyrus (mFG), and primary visual cortex (V1) was derived by feedback from the inferior frontal junction (IFJ). Complementary effective connectivity analysis using Granger causality modeling (GCM) confirmed that, in both experiments, the node with the highest outflow and netflow degree was IFJ, which was thus considered to be the source of the network. These results indicate a source for the spatially global effect of feature-based attention in the human prefrontal cortex.

Attentional selection is the mechanism by which relevant sensory information is processed preferentially. Feature-based attention plays a key role in identifying an attentional target in a complex scene, because we often know the features of the target but not its exact location. The ability to quickly select the target is mainly attributed to enhancement of responses to stimuli that share features with an attended stimulus, not only at the attended location but throughout the whole visual field. However, little is known regarding how feature-based attention modulates brain responses at unattended locations. Here we used fMRI and advanced connectivity analyses to examine human subjects as they performed either motion- or color-based attention tasks. Our results indicated that the visual processing areas for motion and color showed the feature-based attention effect. Effective connectivity analysis showed that this feature-based attention effect was derived by feedback from the inferior frontal junction, an area of the posterior lateral prefrontal cortex involved in many different cognitive processes, including spatial attention and working memory. Further modeling confirmed that the inferior frontal junction showed connectivity features supporting its role as the source of the network. Our results support the hypothesis that the inferior frontal junction plays a key role in the spatially global effect of feature-based attention.

Oscillatory Mechanisms of Response Conflict Elicited by Color and Motion Direction: An Individual Differences Approach

Goal-directed behavior requires control over automatic behavior, for example, when goal-irrelevant information from the environment captures an inappropriate response and conflicts with the correct, goal-relevant action. Neural oscillations in the theta band (∼6 Hz) measured at midfrontal electrodes are thought to form an important substrate of the detection and subsequent resolution of response conflict. Here, we examined the extent to which response conflict and associated theta-band activity depend on the visual stimulus feature dimension that triggers the conflict. We used a feature-based Simon task to manipulate conflict by motion direction and stimulus color. Analyses were focused on individual differences in behavioral response conflict elicited across different stimulus dimensions and their relationship to conflict-related midfrontal theta. We first confirmed the presence of response conflict elicited by task-irrelevant motion and stimulus color, demonstrating the usefulness of our modified version of the Simon task to assess different sensory origins of response conflict. Despite titrating overall task performance, we observed large individual differences in the behavioral manifestations of response conflict elicited by the different visual dimensions. These behavioral conflict effects were mirrored in a dimension-specific relationship with conflict-related midfrontal theta power, such that, for each dimension, individual midfrontal theta power was generally higher when experienced response conflict was high. Finally, exploratory analyses of interregional functional connectivity suggested a role for phase synchronization between frontal and parietal scalp sites in modulating experienced conflict when color was the task-relevant visual dimension. Highlighting the importance of an individual differences approach in cognitive neuroscience, these results reveal large individual differences in experienced response conflict depending on the source of visual interference, which are predicted by conflict-related midfrontal theta power.

The effect of feature-based attention on flanker interference processing: An fMRI-constrained source analysis

The present study examined whether feature-based cueing affects early or late stages of flanker conflict processing using EEG and fMRI. Feature cues either directed participants' attention to the upcoming colour of the target or were neutral. Validity-specific modulations during interference processing were investigated using the N200 event-related potential (ERP) component and BOLD signal differences. Additionally, both data sets were integrated using an fMRI-constrained source analysis. Finally, the results were compared with a previous study in which spatial instead of feature-based cueing was applied to an otherwise identical flanker task. Feature-based and spatial attention recruited a common fronto-parietal network during conflict processing. Irrespective of attention type (feature-based; spatial), this network responded to focussed attention (valid cueing) as well as context updating (invalid cueing), hinting at domain-general mechanisms. However, spatially and non-spatially directed attention also demonstrated domain-specific activation patterns for conflict processing that were observable in distinct EEG and fMRI data patterns as well as in the respective source analyses. Conflict-specific activity in visual brain regions was comparable between both attention types. We assume that the distinction between spatially and non-spatially directed attention types primarily applies to temporal differences (domain-specific dynamics) between signals originating in the same brain regions (domain-general localization).

Feature-based attention potentiates recovery of fine direction discrimination in cortically blind patients

Training chronic, cortically-blind (CB) patients on a coarse [left-right] direction discrimination and integration (CDDI) task recovers performance on this task at trained, blind field locations. However, fine direction difference (FDD) thresholds remain elevated at these locations, limiting the usefulness of recovered vision in daily life. Here, we asked if this FDD impairment can be overcome by training CB subjects with endogenous, feature-based attention (FBA) cues. Ten CB subjects were recruited and trained on CDDI and FDD with an FBA cue or FDD with a neutral cue. After completion of each training protocol, FDD thresholds were re-measured with both neutral and FBA cues at trained, blind-field locations and at corresponding, intact-field locations. In intact portions of the visual field, FDD thresholds were lower when tested with FBA than neutral cues. Training subjects in the blind field on the CDDI task improved FDD performance to the point that a threshold could be measured, but these locations remained impaired relative to the intact field. FDD training with neutral cues resulted in better blind field FDD thresholds than CDDI training, but thresholds remained impaired relative to intact field levels, regardless of testing cue condition. Importantly, training FDD in the blind field with FBA lowered FDD thresholds relative to CDDI training, and allowed the blind field to reach thresholds similar to the intact field, even when FBA trained subjects were tested with a neutral rather than FBA cue. Finally, FDD training appeared to also recover normal integration thresholds at trained, blind-field locations, providing an interesting double dissociation with respect to CDDI training. In summary, mechanisms governing FBA appear to function normally in both intact and impaired regions of the visual field following V1 damage. Our results mark the first time that FDD thresholds in CB fields have been seen to reach intact field levels of performance. Moreover, FBA can be leveraged during visual training to recover normal, fine direction discrimination and integration performance at trained, blind-field locations, potentiating visual recovery of more complex and precise aspects of motion perception in cortically-blinded fields.

Selecting multiple features delays perception, but only when targets are horizontally arranged

Based on the finding that perception is lagged by attention split on multiple features (Lo et al., 2012), this study investigated how the feature-based lag effect interacts with the target spatial arrangement. Participants were presented with gratings the spatial frequencies of which constantly changed. The task was to monitor two gratings of the same or different colors and report their spatial frequencies right before the stimulus offset. The results showed a perceptual lag wherein the reported value was closer to the physical value some time prior to the stimulus offset. This lag effect was larger when the two gratings were of different colors than when they were the same color. Furthermore, the feature-based lag effect was statistically significant when the two gratings were horizontally arranged but not when they were vertically or diagonally arranged. A model is proposed to explain the effect of target arrangement: When targets are horizontally arranged, selecting an additional feature delays perception. When targets are vertically or diagonally arranged, target selection for the lower field is prioritized. This prioritization on the lower target might prompt observers to only select the lower target and ignore the upper one, and this causes more perceptual errors without delaying perception.

The effect of category learning on attentional modulation of visual cortex

Learning about visual object categories causes changes in the way we perceive those objects. One likely mechanism by which this occurs is the application of attention to potentially relevant objects. Here we test the hypothesis that category membership influences the allocation of attention, allowing attention to be applied not only to object features, but to entire categories. Participants briefly learned to categorize a set of novel cartoon animals after which EEG was recorded while participants distinguished between a target and non-target category. A second identical EEG session was conducted after two sessions of categorization practice. The category structure and task design allowed parametric manipulation of number of target features while holding feature frequency and category membership constant. We found no evidence that category membership influenced attentional selection: a postero-lateral negative component, labeled the selection negativity/N250, increased over time and was sensitive to number of target features, not target categories. In contrast, the right hemisphere N170 was not sensitive to target features. The P300 appeared sensitive to category in the first session, but showed a graded sensitivity to number of target features in the second session, possibly suggesting a transition from rule-based to similarity based categorization.

Assessing the internal consistency of the event-related potential: An example analysis

ERPs are widely and increasingly used to address questions in psychophysiological research. As discussed in this special issue, a renewed focus on questions of reliability and stability marks the need for intuitive, quantitative descriptors that allow researchers to communicate the robustness of ERP measures used in a given study. This report argues that well-established indices of internal consistency and effect size meet this need and can be easily extracted from most ERP datasets, as demonstrated with example analyses using a representative dataset from a feature-based visual selective attention task. We demonstrate how to measure the internal consistency of three aspects commonly considered in ERP studies: voltage measurements for specific time ranges at selected sensors, voltage dynamics across all time points of the ERP waveform, and the distribution of voltages across the scalp. We illustrate methods for quantifying the robustness of experimental condition differences, by calculating effect size for different indices derived from the ERP. The number of trials contributing to the ERP waveform was manipulated to examine the relationship between signal-to-noise ratio (SNR), internal consistency, and effect size. In the present example dataset, satisfactory consistency (Cronbach's alpha > 0.7) of individual voltage measurements was reached at lower trial counts than were required to reach satisfactory effect sizes for differences between experimental conditions. Comparing different metrics of robustness, we conclude that the internal consistency and effect size of ERP findings greatly depend on the quantification strategy, the comparisons and analyses performed, and the SNR.

Somatosensory Misrepresentation Associated with Chronic Pain: Spatiotemporal Correlates of Sensory Perception in a Patient following a Complex Regional Pain Syndrome Spread

Chronic pain is suggested to be linked to reorganization processes in the sensorimotor cortex. In the current study, the somatosensory representation of the extremities was investigated in a patient with a complex regional pain syndrome (CRPS) that initially occurred in the right hand and arm and spread later into the left hand and right leg. After the spread, magnetoencephalographic recordings in conjunction with somatosensory stimulation revealed that the clinical symptoms were associated with major changes in the primary somatosensory representation. Tactile stimulation of body parts triggering CRPS-related pain elicited activity located in the left primary somatosensory region corresponding to the right hand representation, where the CRPS initially appeared. Solely the unaffected left foot was observed to have a regular S1 representation. The pain distribution pattern was matching the cortical somatosensory misrepresentation suggesting that cortical reorganization processes might contribute and possibly underlie the development and spread of the CRPS.

Spatio-temporal dynamics of attentional selection stages during multiple object tracking

Subjects can visually track several moving items simultaneously, a fact that is difficult to explain by classical attention models. Previous work revealed that building a global shape based on the spatial position of the tracked items improves performance. Here we investigated the involved neural processes and the role of attention. A task-irrelevant probe stimulus was presented during multiple objects tracking at a fixed spatial location. Depending on the tracked item's trajectories the probe appeared either outside, inside, or on the edge of aforementioned global shape. Event-related potentials to the probe stimulus revealed two subsequent stages of attentional selection during multiple object tracking. After 100ms attention was deployed on the edge/boundary of the figure formed by the tracked items. In the following 80ms, attention spread from the outline to the full figure. These findings clarify the eminent contribution of attentional mechanisms in multiple objects tracking.

Different Cortical Mechanisms for Spatial vs. Feature-Based Attentional Selection in Visual Working Memory

The limited capacity of visual working memory (VWM) necessitates attentional mechanisms that selectively update and maintain only the most task-relevant content. Psychophysical experiments have shown that the retroactive selection of memory content can be based on visual properties such as location or shape, but the neural basis for such differential selection is unknown. For example, it is not known if there are different cortical modules specialized for spatial vs. feature-based mnemonic attention, in the same way that has been demonstrated for attention to perceptual input. Here, we used transcranial magnetic stimulation (TMS) to identify areas in human parietal and occipital cortex involved in the selection of objects from memory based on cues to their location (spatial information) or their shape (featural information). We found that TMS over the supramarginal gyrus (SMG) selectively facilitated spatial selection, whereas TMS over the lateral occipital cortex (LO) selectively enhanced feature-based selection for remembered objects in the contralateral visual field. Thus, different cortical regions are responsible for spatial vs. feature-based selection of working memory representations. Since the same regions are involved in terms of attention to external events, these new findings indicate overlapping mechanisms for attentional control over perceptual input and mnemonic representations.

Reward-associated features capture attention in the absence of awareness: Evidence from object-substitution masking

Reward-associated visual features have been shown to capture visual attention, evidenced in faster and more accurate behavioral performance, as well as in neural responses reflecting lateralized shifts of visual attention to those features. Specifically, the contralateral N2pc event-related-potential (ERP) component that reflects attentional shifting exhibits increased amplitude in response to task-relevant targets containing a reward-associated feature. In the present study, we examined the automaticity of such reward-association effects using object-substitution masking (OSM) in conjunction with MEG measures of visual attentional shifts. In OSM, a visual-search array is presented, with the target item to be detected indicated by a surrounding mask (here, four surrounding squares). Delaying the offset of the target-surrounding four-dot mask relative to the offset of the rest of the target/distracter array disrupts the viewer's awareness of the target (masked condition), whereas simultaneous offsets do not (unmasked condition). Here we manipulated whether the color of the OSM target was or was not of a previously reward-associated color. By tracking reward-associated enhancements of behavior and the N2pc in response to masked targets containing a previously rewarded or unrewarded feature, the automaticity of attentional capture by reward could be probed. We found an enhanced N2pc response to targets containing a previously reward-associated color feature. Moreover, this enhancement of the N2pc by reward did not differ between masking conditions, nor did it differ as a function of the apparent visibility of the target within the masked condition. Overall, these results underscore the automaticity of attentional capture by reward-associated features, and demonstrate the ability of feature-based reward associations to shape attentional capture and allocation outside of perceptual awareness.

Attention Determines Contextual Enhancement versus Suppression in Human Primary Visual Cortex

Neural responses in primary visual cortex (V1) depend on stimulus context in seemingly complex ways. For example, responses to an oriented stimulus can be suppressed when it is flanked by iso-oriented versus orthogonally oriented stimuli but can also be enhanced when attention is directed to iso-oriented versus orthogonal flanking stimuli. Thus the exact same contextual stimulus arrangement can have completely opposite effects on neural responses-in some cases leading to orientation-tuned suppression and in other cases leading to orientation-tuned enhancement. Here we show that stimulus-based suppression and enhancement of fMRI responses in humans depends on small changes in the focus of attention and can be explained by a model that combines feature-based attention with response normalization.

SIGNIFICANCE STATEMENT

Neurons in the primary visual cortex (V1) respond to stimuli within a restricted portion of the visual field, termed their "receptive field." However, neuronal responses can also be influenced by stimuli that surround a receptive field, although the nature of these contextual interactions and underlying neural mechanisms are debated. Here we show that the response in V1 to a stimulus in the same context can either be suppressed or enhanced depending on the focus of attention. We are able to explain the results using a simple computational model that combines two well established properties of visual cortical responses: response normalization and feature-based enhancement.

Colour expectations during object perception are associated with early and late modulations of electrophysiological activity

It is well known that visual expectation and attention modulate object perception. Yet, the mechanisms underlying these top-down influences are not completely understood. Event-related potentials (ERPs) indicate late contributions of expectations to object processing around the P2 or N2. This is true independent of whether people expect objects (vs. no objects) or specific shapes, hence when expectations pertain to complex visual features. However, object perception can also benefit from expecting colour information, which can facilitate figure/ground segregation. Studies on attention to colour show attention-sensitive modulations of the P1, but are limited to simple transient detection paradigms. The aim of the current study was to examine whether expecting simple features (colour information) during challenging object perception tasks produce early or late ERP modulations. We told participants to expect an object defined by predominantly black or white lines that were embedded in random arrays of distractor lines and then asked them to report the object's shape. Performance was better when colour expectations were met. ERPs revealed early and late phases of modulation. An early modulation at the P1/N1 transition arguably reflected earlier stages of object processing. Later modulations, at the P3, could be consistent with decisional processes. These results provide novel insights into feature-specific contributions of visual expectations to object perception.

Multivariate cross-classification: applying machine learning techniques to characterize abstraction in neural representations

Here we highlight an emerging trend in the use of machine learning classifiers to test for abstraction across patterns of neural activity. When a classifier algorithm is trained on data from one cognitive context, and tested on data from another, conclusions can be drawn about the role of a given brain region in representing information that abstracts across those cognitive contexts. We call this kind of analysis Multivariate Cross-Classification (MVCC), and review several domains where it has recently made an impact. MVCC has been important in establishing correspondences among neural patterns across cognitive domains, including motor-perception matching and cross-sensory matching. It has been used to test for similarity between neural patterns evoked by perception and those generated from memory. Other work has used MVCC to investigate the similarity of representations for semantic categories across different kinds of stimulus presentation, and in the presence of different cognitive demands. We use these examples to demonstrate the power of MVCC as a tool for investigating neural abstraction and discuss some important methodological issues related to its application.

The role of eye movement driven attention in functional strabismic amblyopia

Strabismic amblyopia “blunt vision” is a developmental anomaly that affects binocular vision and results in lowered visual acuity. Strabismus is a term for a misalignment of the visual axes and is usually characterized by impaired ability of the strabismic eye to take up fixation. Such impaired fixation is usually a function of the temporally and spatially impaired binocular eye movements that normally underlie binocular shifts in visual attention. In this review, we discuss how abnormal eye movement function in children with misaligned eyes influences the development of normal binocular visual attention and results in deficits in visual function such as depth perception. We also discuss how eye movement function deficits in adult amblyopia patients can also lead to other abnormalities in visual perception. Finally, we examine how the nonamblyopic eye of an amblyope is also affected in strabismic amblyopia.

Feature-based attention modulates surround suppression

Stimuli appearing in the surround of the classical receptive field (CRF) can reduce neuronal firing and perceived contrast of a preferred stimulus in the CRF, a phenomenon referred to as surround suppression. Suppression is greatest when the surrounding stimulus has the same orientation and spatial frequency (SF) as the central target. Although spatial attention has been shown to influence surround suppression, the effects of feature-based attention have yet to be characterized. Using behavioral contrast adaptation in humans, we examined center-surround interactions between SF and orientation, and asked whether attending to one feature dimension versus the other influenced suppression. A center-surround triplet comprised of a central target Gabor and two flanking Gabors were used for adaptation. The flankers could have the same SF and orientation as the target, or differ in one or both of the feature dimensions. Contrast thresholds were measured for the target before and after adapting to center-surround triplets, and postadaptation thresholds were taken as an indirect measure of surround suppression. Both feature dimensions contributed to surround suppression and did not summate. Moreover, when center and surround had the same feature value in one dimension (e.g., same orientation) but had different values in the other dimension (e.g., different SF), there was more suppression when attention was directed to the feature dimension that matched between center and surround than when attention was directed to the feature dimension that differed. These results demonstrate that feature-based attention can influence center-surround interactions by enhancing the effects of the attended dimension.

Neural correlates of visual motion processing without awareness in patients with striate cortex and pulvinar lesions

Patients with striate cortex lesions experience visual perception loss in the contralateral visual field. In few patients, however, stimuli within the blind field can lead to unconscious (blindsight) or even conscious perception when the stimuli are moving (Riddoch syndrome). Using functional magnetic resonance imaging (fMRI), we investigated the neural responses elicited by motion stimulation in the sighted and blind visual fields of eight patients with lesions of the striate cortex. Importantly, repeated testing ensured that none of the patients exhibited blindsight or a Riddoch syndrome. Three patients had additional lesions in the ipsilesional pulvinar. For blind visual field stimulation, great care was given that the moving stimulus was precisely presented within the borders of the scotoma. In six of eight patients, the stimulation within the scotoma elicited hemodynamic activity in area human middle temporal (hMT) while no activity was observed within the ipsilateral lesioned area of the striate cortex. One of the two patients in whom no ipsilesional activity was observed had an extensive lesion including massive subcortical damage. The other patient had an additional focal lesion within the lateral inferior pulvinar. Fiber-tracking based on anatomical and functional markers (hMT and Pulvinar) on individual diffusion tensor imaging (DTI) data from each patient revealed the structural integrity of subcortical pathways in all but the patient with the extensive subcortical lesion. These results provide clear evidence for the robustness of direct subcortical pathways from the pulvinar to area hMT in patients with striate cortex lesions and demonstrate that ipsilesional activity in area hMT is completely independent of conscious perception.

The temporal dynamics of visual working memory guidance of selective attention

The biased competition model proposes that there is top-down directing of attention to a stimulus matching the contents of working memory (WM), even when the maintenance of a WM representation is detrimental to target relevant performance. Despite many studies elucidating that spatial WM guidance can be present early in the visual processing system, whether visual WM guidance also influences perceptual selection remains poorly understood. Here, we investigated the electrophysiological correlates of early guidance of attention by WM in humans. Participants were required to perform a visual search task while concurrently maintaining object representations in their visual WM. Behavioral results showed that response times (RTs) were longer when the distractor in the visual search task was held in WM. The earliest WM guidance effect was observed in the P1 component (90–130 ms), with match trials eliciting larger P1 amplitude than mismatch trials. A similar result was also found in the N1 component (160–200 ms). These P1 and N1 effects could not be attributed to bottom-up perceptual priming from the presentation of a memory cue, because there was no significant difference in early event-related potential (ERP) component when the cue was merely perceptually identified but not actively held in WM. Standardized Low Resolution Electrical Tomography Analysis (sLORETA) showed that the early WM guidance occurred in the occipital lobe and the N1-related activation occurred in the parietal gyrus. Time-frequency data suggested that alpha-band event-related spectral perturbation (ERSP) magnitudes increased under the match condition compared with the mismatch condition only when the cue was held in WM. In conclusion, the present study suggests that the reappearance of a stimulus held in WM enhanced activity in the occipital area. Subsequently, this initial capture of attention by WM could be inhibited by competing visual inputs through attention re-orientation, reflecting by the alpha-band rhythm.

Earliest stages of visual cortical processing are not modified by attentional load

This study investigated the effects of attentional load on neural responses to attended and irrelevant visual stimuli by recording high-density event-related potentials (ERPs) from the scalp in normal adult subjects. Peripheral (upper and lower visual field) and central stimuli were presented in random order at a rapid rate while subjects responded to targets among the central stimuli. Color detection and color-orientation conjunction search tasks were used as the low- and high-load tasks, respectively. Behavioral results showed significant load effects on both accuracy and reaction time for target detections. ERP results revealed no significant load effect on the initial C1 component (60-100 ms) evoked by either central-relevant or peripheral-irrelevant stimuli. Source analysis with dipole modeling confirmed previous reports that the C1 includes the initial evoked response in primary visual cortex. Source analyses indicated that high attentional load enhanced the early (70-140 ms) neural response to central-relevant stimuli in ventral-lateral extrastriate cortex, whereas load effects on peripheral-irrelevant stimulus processing started at 110 ms and were localized to more dorsal and anterior extrastriate cortical areas. These results provide evidence that the earliest stages of visual cortical processing are not modified by attentional load and show that attentional load affects the processing of task relevant and irrelevant stimuli in different ways.

Spatio-temporal Patterns of Brain Activity Distinguish Strategies of Multiple-object Tracking

Human observers can readily track up to four independently moving items simultaneously, even in the presence of moving distractors. Here we combined EEG and magnetoencephalography recordings to investigate the neural processes underlying this remarkable capability. Participants were instructed to track four of eight independently moving items for 3 sec. When the movement ceased a probe stimulus consisting of four items with a higher luminance was presented. The location of the probe items could correspond fully, partly, or not at all with the tracked items. Participants reported whether the probe items fully matched the tracked items or not. About half of the participants showed slower RTs and higher error rates with increasing correspondence between tracked items and the probe. The other half, however, showed faster RTs and lower error rates when the probe fully matched the tracked items. This latter behavioral pattern was associated with enhanced probe-evoked neural activity that was localized to the lateral occipital cortex in the time range 170–210 msec. This enhanced response in the object-selective lateral occipital cortex suggested that these participants performed the tracking task by visualizing the overall shape configuration defined by the vertices of the tracked items, thereby producing a behavioral advantage on full-match trials. In a later time range (270–310 msec) probe-evoked neural activity increased monotonically as a function of decreasing target–probe correspondence in all participants. This later modulation, localized to superior parietal cortex, was proposed to reflect the degree of mismatch between the probe and the automatically formed visual STM representation of the tracked items.

Age-related changes in expectation-based modulation of motion detectability

Expecting motion in some particular direction biases sensitivity to that direction, which speeds detection of motion. However, the neural processes underlying this effect remain underexplored, especially in the context of normal aging. To address this, we examined younger and older adults' performance in a motion detection task. In separate conditions, the probability was either 50% or 100% that a field of dots would move coherently in the direction a participant expected (either vertically or horizontally). Expectation and aging effects were assessed via response times (RT) to detect motion and electroencephalography (EEG). In both age groups, RTs were fastest when motion was similar to the expected direction of motion. RT tuning curves exhibited a characteristic U-shape such that detection time increased with an increasing deviation from the participant's expected direction. Strikingly, EEG results showed an analogous, hyperbolic curve for N1 amplitude, reflecting neural biasing. Though the form of behavioral and EEG curves did not vary with age, older adults displayed a clear decline in the speed of detection and a corresponding reduction in EEG N1 amplitude when horizontal (but not vertical) motion was expected. Our results suggest that expectation-based detection ability varies with age and, for older adults, also with axis of motion.

Top-down suppression of incompatible motor activations during response selection under conflict

Top-down control is critical to select goal-directed actions in changeable environments, particularly when several options compete for selection. This control system is thought to involve a mechanism that suppresses activation of unwanted response representations. We tested this hypothesis, in humans, by measuring motor-evoked potentials (MEPs) elicited by transcranial magnetic stimulation (TMS) in a left finger muscle during motor preparation in an adapted Eriksen flanker task. Subjects reported, by a left or right button-press, the orientation of a left- or right-facing central arrow, flanked by two distractor arrows on each side. Central and peripheral arrows either pointed in the same (congruent trial) or in the opposite direction (incongruent trial). Top-down control was manipulated by changing the probability of congruent and incongruent trials in a given block. In the "mostly incongruent" (MI) blocks, 80% of trials were incongruent, producing a context in which subjects strongly anticipated that they would have to face conflict. In the "mostly congruent" (MC) blocks, 80% of trials were congruent and thus subjects barely anticipated conflict in that context. Thus, we assume that top-down control was stronger in the MI than in the MC condition. Accordingly, subjects displayed a lower error rate and shorter reaction times for the incongruent trials in the MI context than for similar trials in the MC context. More interestingly, we found that top-down control specifically reduced activation of the incompatible motor representation during response selection under high conflict. That is, when the central arrow specified a right hand response, left (non-selected) MEPs became smaller in the MI than in the MC condition, but only for incongruent trials, and this measure was positively correlated with performance. In contrast, MEPs elicited in the non-selected hand during congruent trials, or during all trials in which the left hand was selected, tended to increase more after the imperative signal in the MI than the MC condition. Another important observation was that, overall, MEPs were already strongly suppressed at the onset of the imperative signal and that this effect was particularly pronounced in the MI context. Hence, suppression of motor excitability seems to be a key component of conflict resolution.

Anticipatory alpha phase influences visual working memory performance

Alpha band (8-12 Hz) phase dynamics in the visual cortex are thought to reflect fluctuations in cortical excitability that influences perceptual processing. As such, visual stimuli are better detected when their onset is concurrent with specific phases of the alpha cycle. However, it is unclear whether alpha phase differentially influences cognitive performance at specific times relative to stimulus onset (i.e., is the influence of phase maximal before, at, or after stimulus onset?). To address this, participants performed a delayed-recognition, working memory (WM) task for visual motion direction during two separate visits. The first visit utilized functional magnetic resonance (fMRI) imaging to identify neural regions associated with task performance. Replicating previous studies, fMRI data showed engagement of visual cortical area V5, as well as a prefrontal cortical region, the inferior frontal junction (IFJ). During the second visit, transcranial magnetic stimulation (TMS) was applied separately to both the right IFJ and right V5 (with the vertex as a control region) while electroencephalography (EEG) was simultaneously recorded. During each trial, a single pulse of TMS (spTMS) was applied at one of six time points (-200, -100, -50, 0, 80, 160 ms) relative to the encoded stimulus onset. Results demonstrated a relationship between the phase of the posterior alpha signal prior to stimulus encoding and subsequent response times to the memory probe two seconds later. Specifically, spTMS to V5, and not the IFJ or vertex, yielded faster response times, indicating improved WM performance, when delivered during the peak, compared to the trough, of the alpha cycle, but only when spTMS was applied 100 ms prior to stimulus onset. These faster responses to the probe correlated with decreased early event related potential (ERP) amplitudes (i.e., P1) to the probe stimuli. Moreover, participants that were least affected by spTMS exhibited greater functional connectivity between V5 and fronto-parietal regions. These results suggest that posterior alpha phase indexes a critical time period for motion processing in the context of WM encoding goals, which occurs in anticipation of stimulus onset.

The spread of attention across features of a surface

Contrasting theories of visual attention have emphasized selection by spatial location, individual features, and whole objects. We used functional magnetic resonance imaging to ask whether and how attention to one feature of an object spreads to other features of the same object. Subjects viewed two spatially superimposed surfaces of random dots that were segregated by distinct color-motion conjunctions. The color and direction of motion of each surface changed smoothly and in a cyclical fashion. Subjects were required to track one feature (e.g., color) of one of the two surfaces and detect brief moments when the attended feature diverged from its smooth trajectory. To tease apart the effect of attention to individual features on the hemodynamic response, we used a frequency-tagging scheme. In this scheme, the stimulus features (color and direction of motion) are modulated periodically at distinct frequencies so that the contribution of each feature to the hemodynamics can be inferred from the harmonic response at the corresponding frequency. We found that attention to one feature (e.g., color) of one surface increased the response modulation not only to the attended feature but also to the other feature (e.g., motion) of the same surface. This attentional modulation was evident in multiple visual areas and was present as early as V1. The spread of attention to the behaviorally irrelevant features of a surface suggests that attention may automatically select all features of a single object. Thus object-based attention may be supported by an enhancement of feature-specific sensory signals in the visual cortex.

Functional specialization and generalization for grouping of stimuli based on colour and motion

This study was undertaken to learn whether the principle of functional specialization that is evident at the level of the prestriate visual cortex extends to areas that are involved in grouping visual stimuli according to attribute, and specifically according to colour and motion. Subjects viewed, in an fMRI scanner, visual stimuli composed of moving dots, which could be either coloured or achromatic; in some stimuli the moving coloured dots were randomly distributed or moved in random directions; in others, some of the moving dots were grouped together according to colour or to direction of motion, with the number of groupings varying from 1 to 3. Increased activation was observed in area V4 in response to colour grouping and in V5 in response to motion grouping while both groupings led to activity in separate though contiguous compartments within the intraparietal cortex. The activity in all the above areas was parametrically related to the number of groupings, as was the prominent activity in Crus I of the cerebellum where the activity resulting from the two types of grouping overlapped. This suggests (a) that, the specialized visual areas of the prestriate cortex have functions beyond the processing of visual signals according to attribute, namely that of grouping signals according to colour (V4) or motion (V5); (b) that the functional separation evident in visual cortical areas devoted to motion and colour, respectively, is maintained at the level of parietal cortex, at least as far as grouping according to attribute is concerned; and (c) that, by contrast, this grouping-related functional segregation is not maintained at the level of the cerebellum.