Representation of the visual field in the lateral intraparietal area of macaque monkeys: a quantitative receptive field analysis

Intention and attention: different functional roles for LIPd and LIPv

Establishing the circuitry underlying attentional and oculomotor control is a long-standing goal of systems neuroscience. The macaque lateral intraparietal area (LIP) has been implicated in both processes, but numerous studies have produced contradictory findings. Anatomically, LIP consists of a dorsal and ventral subdivision, but the functional importance of this division remains unclear. We injected muscimol, a GABA(A) agonist, and manganese, a magnetic resonance imaging lucent paramagnetic ion, into different portions of LIP, examined the effects of the resulting reversible inactivation on saccade planning and attention, and visualized each injection using anatomical magnetic resonance imaging. We found that dorsal LIP (LIPd) is primarily involved in oculomotor planning, whereas ventral LIP (LIPv) contributes to both attentional and oculomotor processes. Additional testing revealed that the two functions were dissociable, even in LIPv. Using our technique, we found a clear structure-function relationship that distinguishes LIPv from LIPd and found dissociable circuits for attention and eye movements in the posterior parietal cortex.

Topographic organization of macaque area LIP

Despite several attempts to define retinotopic maps in the macaque lateral intraparietal area (LIP) using histological, electrophysiological, and neuroimaging methods, the degree to which this area is topographically organized remains controversial. We recorded blood oxygenation level-dependent signals with functional MRI from two macaques performing a difficult visual search task on stimuli presented at the fovea or in the periphery of the visual field. The results revealed the presence of a single topographic representation of the contralateral hemifield in the ventral subdivision of the LIP (LIPv) in both hemispheres of both monkeys. Also, a foveal representation was localized in rostral LIPv rather than in dorsal LIP (LIPd) as previous experiments had suggested. Finally, both LIPd and LIPv responded only to contralateral stimuli. In contrast, human studies have reported multiple topographic maps in intraparietal cortex and robust responses to ipsilateral stimuli. These blood oxygenation level-dependent functional MRI results provide clear evidence for the topographic organization of macaque LIP that complements the results of previous electrophysiology studies, and also reveal some unexpected characteristics of this organization that have eluded these previous studies. The results also delineate organizational differences between LIPv and LIPd, providing support for these two histologically defined areas may subserve different visuospatial functions. Finally, these findings point to potential evolutionary differences in functional organization with human posterior parietal cortex.

The place code of saccade metrics in the lateral bank of the intraparietal sulcus

The lateral intraparietal area (LIP) of monkeys is known to participate in the guidance of rapid eye movements (saccades), but the means it uses to specify movement variables are poorly understood. To determine whether area LIP devotes neural space to encode saccade metrics spatially, we used the quantitative [(14)C]deoxyglucose method to obtain images of the distribution of metabolic activity in the intraparietal sulcus (IPs) of rhesus monkeys trained to repeatedly execute saccades of the same amplitude and direction for the duration of the experiment. Different monkeys were trained to perform saccades of different sizes and in different directions. A clear topography of saccade metrics was found in the cytoarchitectonically identified area LIP ventral (LIPv) contralateral to the direction of the eye movements. We demonstrate that the representation of the vertical meridian runs parallel to the fundus of the IPs and that it is not orthogonal to the representation of the horizontal meridian. Instead, the latter runs through the middle of LIPv parallel to its border with area LIP dorsal (LIPd). The upper part of oculomotor space is represented rostrally and dorsally relative to the horizontal meridian toward the LIPv-LIPd border, whereas the lower part of oculomotor space is represented caudally and ventrally toward the caudal edge of the IPs. Saccade amplitude is also represented in an orderly manner.

Relationship between neural responses and visual grouping in the monkey parietal cortex

Visual grouping through the binding of multiple discrete elements is an important component of object perception, and neurological studies have shown that the posterior parietal cortex plays a vital role in that process. To study the neural mechanisms underlying visual grouping, we recorded neuronal activity from the lateral bank of the intraparietal sulcus (L-IPS) of monkeys while they performed a task that required them to discriminate among rapidly presented visual patterns composed of five black or white dots arranged in a cross. The monkeys had to detect the patterns in which dots with the same contrast were arranged either horizontally or vertically (target). Visual grouping was necessary for detection of the target, and we surmised that if L-IPS neurons are involved in visual grouping, they may selectively respond to the grouped objects. In addition, we manipulated the monkeys' attention to the grouping of the elements. We found that many L-IPS neurons showed selectivity for the orientation of the target stimuli, and that selectivity was enhanced by the top-down attention. Moreover, the selectivity correlated with behavioral performance. These results provide the first physiological evidence that L-IPS neurons make a crucial contribution to visual grouping by combining visual and attentional signals so as to bind discrete visual elements together.

Functional Asymmetries Revealed in Visually Guided Saccades: An fMRI Study

Because eye movements are a fundamental tool for spatial exploration, we hypothesized that the neural bases of these movements in humans should be under right cerebral dominance, as already described for spatial attention. We used functional magnetic resonance imaging in 27 right-handed participants who alternated central fixation with either large or small visually guided saccades (VGS), equally performed in both directions. Hemispheric functional asymmetry was analyzed to identify whether brain regions showing VGS activation elicited hemispheric asymmetries. Hemispheric anatomical asymmetry was also estimated to assess its influence on the VGS functional lateralization. Right asymmetrical activations of a saccadic/attentional system were observed in the lateral frontal eye fields (FEF), the anterior part of the intraparietal sulcus (aIPS), the posterior third of the superior temporal sulcus (STS), the occipitotemporal junction (MT/V5 area), the middle occipital gyrus, and medially along the calcarine fissure (V1). The present rightward functional asymmetries were not related to differences in gray matter (GM) density/sulci positions between right and left hemispheres in the precentral, intraparietal, superior temporal, and extrastriate regions. Only V1 asymmetries were explained for almost 20% of the variance by a difference in the position of the right and left calcarine fissures. Left asymmetrical activations of a saccadic motor system were observed in the medial FEF and in the motor strip eye field along the Rolando sulcus. They were not explained by GM asymmetries. We suggest that the leftward saccadic motor asymmetry is part of a general dominance of the left motor cortex in right-handers, which must include an effect of sighting dominance. Our results demonstrate that, although bilateral by nature, the brain network involved in the execution of VGSs, irrespective of their direction, presented specific right and left asymmetries that were not related to anatomical differences in sulci positions.

Psychophysical Evidence for Spatiotopic Processing in Area MT in a Short-Term Memory for Motion Task

The middle temporal (MT) area has long been established as a cortical area involved in the encoding of motion information and has been thought to do so in retinotopic coordinates. It was previously shown that memory for motion has a spatial component by demonstrating that subjects do significantly worse on a match-to-sample task when the stimuli to be compared were spatially separated. The distance at which performance deteriorated (the critical spatial separation) increased at increasing eccentricities, suggesting that area MT was involved in the process. In this study, we asked whether optimal performance occurred when the stimuli were in the same retinotopic or spatiotopic coordinates. We found that the performance was best when the stimuli appeared in the same location in space rather than the same retinal location, after an eye movement. We also found that the relationship between retinal eccentricity and the critical spatial separation approximated that of area MT, as found previously. We conclude that area MT plays an important role in the memory for motion process and that this is carried out in spatiotopic coordinates. This conclusion supports the hypothesis that MT processing may have a spatiotopic component.

Orienting of spatial attention and the interplay between the senses

Many everyday situations require combining complex sensory signals about the external world with ongoing goals and expectations. Here I examine the role of attention in this process and consider the underlying neural substrates. First, mechanisms of spatial attention in the visual modality are reviewed, emphasising the involvement of fronto-parietal cortex. Spatial attention takes into account endogenous factors, e.g., information about behavioural relevance, as well as signals arising from the external world (stimulus-driven control). Stimulus-driven control is thought to take place automatically and independently from endogenous factors. However, recent findings demonstrate that endogenous and stimulus-driven mechanisms co-operate, jointly contributing for the selection of the relevant spatial location. Next, I will turn to studies of multisensory spatial attention. These have shown that attention control in fronto-parietal cortex operates supramodally. Supramodal control exerts top-down influences onto sensory-specific areas, enhancing the processing of stimuli at the attended location irrespective of modality. Unlike unimodal visual attention, but in line with traditional views of multisensory integration, multisensory attention can operate in a fully automatic manner regardless of relevance and task-set. I discuss these findings in relation to functional/anatomical pathways that may mediate multisensory attention control, highlighting possible links between spatial attention and multisensory integration of space.

Cortical connections of the visuomotor parietooccipital area V6Ad of the macaque monkey

Area V6A, a functionally defined region in the anterior bank of the parietooccipital sulcus, has been subdivided into dorsal and ventral cytoarchitectonic fields (V6Ad and V6Av). The aim of this study was to define the cortical connections of the cytoarchitectonic field V6Ad. Retrograde and bidirectional neuronal tracers were injected into the dorsal part of the anterior bank of parietooccipital sulcus of seven macaque monkeys (Macaca fascicularis). The limits of injection sites were compared with those of cytoarchitectonic fields. The major connections of V6Ad were with areas of the superior parietal lobule. The densest labeling was observed in the medial intraparietal area (MIP). Areas PEc, PGm, and V6Av were also strongly connected. Labeled cells were found in medial parietal area 31; in cingulate area 23; in the anterior (AIP), ventral (VIP), and lateral (LIP) intraparietal areas; in the inferior parietal lobule (fields Opt and PG); and in the medial superior temporal area (MST). In the frontal lobe, the main projection originated from F2, although labeled cells were also found in F7 and area 46. Preliminary results obtained from injections in nearby areas PEc and V6Av revealed connections different from those of V6Ad. In agreement with functional data, the strong connections with areas where arm-reaching activity is represented suggest that V6Ad is part of a parietofrontal circuit involved in the control of prehension, and connections with AIP specifically support an involvement in the control of grasping. Connections with areas LIP and Opt are likely related to the oculomotor activities observed in V6Ad.

Parietal regions processing visual 3D shape extracted from disparity

Three-dimensional (3D) shape is important for the visual control of grasping and manipulation. We used fMRI to study the processing of 3D shape extracted from disparity in human parietal cortex. Subjects stereoscopically viewed random-line stimuli portraying a 3D structure, a 2D structure in multiple depth planes or a 2D structure in the fixation plane. Subtracting the second from the first condition yields depth-structure sensitive regions and subtracting the third from the second position-in-depth sensitive regions. Two anterior intraparietal sulcus (IPS) regions, the dorsal IPS medial (DIPSM) and the dorsal IPS anterior (DIPSA) regions, were sensitive to depth structure and not to position in depth, while a posterior IPS region, the ventral IPS (VIPS) region, had a mixed sensitivity. All three IPS regions were also sensitive to 2D shape, indicating that they carry full 3D shape information. Finally DIPSM, but not DIPSA was sensitive to a saccade-related task. These results underscore the importance of anterior IPS regions in the processing of 3D shape, in agreement with their proximity to grasping-related regions. Moreover, comparison with the results of Durand, J.B., Nelissen, K., Joly, O., Wardak, C., Todd, J.T., Norman, J.F., Janssen, P., Vanduffel, W., Orban, G.A., 2007. Anterior Regions of Monkey Parietal Cortex Process Visual 3D Shape. Neuron 55, 493-505 obtained in the monkey indicates that DIPSA and DIPSM may represent human homologues for the posterior part of AIP and the adjoining part of LIP respectively.

Bayesian models of eye movement selection with retinotopic maps

Among the various possible criteria guiding eye movement selection, we investigate the role of position uncertainty in the peripheral visual field. In particular, we suggest that, in everyday life situations of object tracking, eye movement selection probably includes a principle of reduction of uncertainty. To evaluate this hypothesis, we confront the movement predictions of computational models with human results from a psychophysical task. This task is a freely moving eye version of the multiple object tracking task, where the eye movements may be used to compensate for low peripheral resolution. We design several Bayesian models of eye movement selection with increasing complexity, whose layered structures are inspired by the neurobiology of the brain areas implied in this process. Finally, we compare the relative performances of these models with regard to the prediction of the recorded human movements, and show the advantage of taking explicitly into account uncertainty for the prediction of eye movements.

Parietal control of attentional guidance: the significance of sensory, motivational and motor factors

The lateral intraparietal area (LIP), a portion of monkey posterior parietal cortex, has been implicated in spatial attention. We review recent evidence showing that LIP encodes a priority map of the external environment that specifies the momentary locus of attention and is activated in a variety of behavioral tasks. The priority map in LIP is shaped by task-specific motor, cognitive and motivational variables, the functional significance of which is not entirely understood. We suggest that these modulations represent teaching signals by which the brain learns to identify attentional priority of various stimuli based on the task-specific associations between these stimuli, the required action and expected outcome.

Direction selectivity of neurons in the macaque lateral intraparietal area

The lateral intraparietal area (LIP) of the macaque is believed to play a role in the allocation of attention and the plan to make saccadic eye movements. Many studies have shown that LIP neurons generally encode the static spatial location demarked by the receptive field (RF). LIP neurons might also provide information about the features of visual stimuli within the RF. For example, LIP receives input from cortical areas in the dorsal visual pathway that contain many direction-selective neurons. Here we examine direction selectivity of LIP neurons. Animals were only required to fixate while motion stimuli appeared in the RF. To avoid spatial confounds, the motion stimuli were patches of randomly arrayed dots that moved with 100% coherence in eight different directions. We found that the majority (61%) of LIP neurons were direction selective. The direction tuning was fairly broad, with a median direction-tuning bandwidth of 136 degrees. The average strength of direction selectivity was weaker in LIP than that of other areas of the dorsal visual stream but that difference may be because of the fact that LIP neurons showed a tonic offset in firing whenever a visual stimulus was in the RF, independent of direction. Direction-selective neurons do not seem to constitute a functionally distinct subdivision within LIP, because those neurons had robust, sustained delay-period activity during a memory delayed saccade task. The direction selectivity could also not be explained by asymmetries in the spatial RF, in the hypothetical case that the animals attended to slightly different locations depending on the direction of motion in the RF. Our results show that direction selectivity is a distinct attribute of LIP neurons in addition to spatial encoding.

Gamma-band activity in human posterior parietal cortex encodes the motor goal during delayed prosaccades and antisaccades

Although it is well established that parietal cortex is important in processing sensorimotor transformations, less is known about the neuronal dynamics of this process in humans. Using magnetoencephalography, we investigated the dynamics of parietal oscillatory activity during saccade planning in terms of sensory and motor goal processing. In the experiments, a peripheral stimulus was flashed in either the left or right hemifield, followed by a 1.5 s delay period, after which the subject executed a saccade toward (prosaccade) or away from (antisaccade) the stimulus. In response to stimulus presentation, we observed an initial increase in gamma-band power (40-120 Hz) in a region in the posterior parietal cortex contralateral to the direction of the stimulus. This lateralized power enhancement, which was sustained in a more narrow frequency band (85-105 Hz) during the delay period of prosaccades, mapped to the hemisphere contralateral to the direction of the saccade goal during the delay period of antisaccades. These results suggest that neuronal gamma-band synchronization in parietal cortex represents the planned direction of the saccade, not the memorized stimulus location. In the lower-frequency bands, we observed sustained contralateral alpha (7-13 Hz) power suppression after stimulus presentation in parieto-occipital regions. The dynamics of the alpha band was strongly related to the processing of the stimulus and showed only modest selectivity for the goal of the saccade. We conclude that parietal gamma-band synchronization reflects a mechanism to encode the motor goals in the visuomotor processing for saccades.

Representation of eye movements and stimulus motion in topographically organized areas of human posterior parietal cortex

Recent imaging studies have shown that the human posterior parietal cortex (PPC) contains four topographically organized areas along the intraparietal sulcus (IPS1-IPS4). Using a memory-guided saccade paradigm, we confirmed the locations and retinotopic organization of IPS1-IPS4 and identified two additional areas, IPS5 and superior parietal lobule 1 (SPL1). IPS5 is located at the intersection of the intraparietal and postcentral sulcus; SPL1 branches off the IPS and extends into the superior parietal lobule. Both areas, as well as IPS1-IPS4, each contain a representation of the contralateral visual hemifield. We then probed core functions of the dorsal pathway in these areas, that is, the representation of eye movements and visual motion, to compare the functional characteristics of human PPC to physiologically and anatomically defined areas in monkey PPC. First, as in monkey PPC, a gradient representation of eye movements was found along the IPS with decreasing responses for saccades and increasing responses for smooth pursuit eye movements from posterior/medial to anterior/lateral. The greatest preference for saccades was found in SPL1 and for smooth pursuit in IPS5. Second, and again similar to monkey PPC, all topographically organized PPC areas responded to different types of motion including planar, circular, and radial optic flow, as assessed using adaptation paradigms. Areas in posterior IPS preferred radial optic flow over planar motion, whereas areas in anterior PPC did not show preference for a particular motion type. Together, our results indicate strikingly similar characteristics in the general functional organization of human and monkey PPC, but also reveal some notable differences.

Number Forms in the Brain

Mental images of number lines, Galton's “number forms” (NF), are a useful way of investigating the relation between number and space. Here we report the first neuroimaging study of number-form synesthesia, investigating 10 synesthetes with NFs going from left to right compared with matched controls. Neuroimaging with functional magnetic resonance imaging revealed no difference in brain activation during a task focused on number magnitude but, in a comparable task on number order, synesthetes showed additional activations in the left and right posterior intraparietal sulci, suggesting that NFs are essentially ordinal in nature. Our results suggest that there are separate but partially overlapping neural circuits for the processing of ordinal and cardinal numbers, irrespective of the presence of an NF, but a core region in the anterior intraparietal sulcus representing (cardinal) number meaning appears to be activated autonomously, irrespective of task. This article provides an important extension beyond previous studies that have focused on word-color or grapheme-color synesthesia.

Neuronal correlates of the set-size effect in monkey lateral intraparietal area

It has long been known that the brain is limited in the amount of sensory information that it can process at any given time. A well-known form of capacity limitation in vision is the set-size effect, whereby the time needed to find a target increases in the presence of distractors. The set-size effect implies that inputs from multiple objects interfere with each other, but the loci and mechanisms of this interference are unknown. Here we show that the set-size effect has a neural correlate in competitive visuo-visual interactions in the lateral intraparietal area, an area related to spatial attention and eye movements. Monkeys performed a covert visual search task in which they discriminated the orientation of a visual target surrounded by distractors. Neurons encoded target location, but responses associated with both target and distractors declined as a function of distractor number (set size). Firing rates associated with the target in the receptive field correlated with reaction time both within and across set sizes. The findings suggest that competitive visuo-visual interactions in areas related to spatial attention contribute to capacity limitations in visual searches.

Coding of shape and position in macaque lateral intraparietal area

The analysis of object shape is critical for both object recognition and grasping. Areas in the intraparietal sulcus of the rhesus monkey are important for the visuomotor transformations underlying actions directed toward objects. The lateral intraparietal (LIP) area has strong anatomical connections with the anterior intraparietal area, which is known to control the shaping of the hand during grasping, and LIP neurons can respond selectively to simple two-dimensional shapes. Here we investigate the shape representation in area LIP of awake rhesus monkeys. Specifically, we determined to what extent LIP neurons are tuned to shape dimensions known to be relevant for grasping and assessed the invariance of their shape preferences with regard to changes in stimulus size and position in the receptive field. Most LIP neurons proved to be significantly tuned to multiple shape dimensions. The population of LIP neurons that were tested showed barely significant size invariance. Position invariance was present in a minority of the neurons tested. Many LIP neurons displayed spurious shape selectivity arising from accidental interactions between the stimulus and the receptive field. We observed pronounced differences in the receptive field profiles determined by presenting two different shapes. Almost all LIP neurons showed spatially selective saccadic activity, but the receptive field for saccades did not always correspond to the receptive field as determined using shapes. Our results demonstrate that a subpopulation of LIP neurons encodes stimulus shape. Furthermore, the shape representation in the dorsal visual stream appears to differ radically from the known representation of shape in the ventral visual stream.

Attention and active vision

Visual perception results from the interaction of incoming sensory signals and top down cognitive and motor signals. Here we focus on the representation of attended locations in parietal cortex and in earlier visual cortical areas. We review evidence that these spatial representations are modulated not only by selective attention but also by the intention to move the eyes. We describe recent experiments in monkey and human that elucidate the mechanisms and circuitry involved in updating, or remapping, the representations of salient stimuli. Two central ideas emerge. First, selective attention and remapping are closely intertwined, and together contribute to the percept of spatial stability. Second, remapping is accomplished not by a single area but by the participation of parietal, frontal and extrastriate cortex as well as subcortical structures. This neural circuitry is distinguished by significant redundancy and plasticity, suggesting that the updating of salient stimuli is fundamental for spatial stability and visuospatial behavior. We conclude that multiple processes and pathways contribute to active vision in the primate brain.

Transforming bottom-up topographic representations with top-down signals in the brain

There has been considerable success in allocating function to the different parts of the brain. We also know much about brain organisation in different regions of the brain and how different brain regions connect to one another. One of the most important next steps for modern neuroscience is to work out how different areas of the brain interact with one another. In particular we need to know how sensory regions communicate with association areas and vice versa. This article explores how top-down signals originating from association areas may be used to process and transform bottom-up representations originating from sensory areas of the brain. Simple models of networks containing topographically organised ensembles of neurons used to integrate and process information are described. The different models can be used to process information in a variety of different ways that could be used as the starting point for a variety of cognitive operations, in particular the extraction of abstract information from sensory representations.

Delay Activity and Sensory-Motor Translation During Planned Eye or Hand Movements to Visual or Tactile Targets

To perform eye or hand movements toward a relevant location, the brain must translate sensory input into motor output. Recent studies revealed segregation between circuits for translating visual information into saccadic or manual movements, but less is known about translation of tactile information into such movements. Using human functional magnetic resonance imaging (fMRI) in a delay paradigm, we factorially crossed sensory modality (vision or touch) and motor effector (eyes or hands) for lateralized movements (gaze shifts to left or right or pressing a left or right button with the corresponding left or right hand located there). We investigated activity in the delay-period between stimulation and response, asking whether the currently relevant side (left or right) during the delay was encoded according to sensory modality, upcoming motor response, or some interactive combination of these. Delay activity mainly reflected the motor response subsequently required. Irrespective of visual or tactile input, we found sustained activity in posterior partial cortex, frontal-eye field, and contralateral visual cortex when subjects would later make an eye movement. For delays prior to manual button-press response, activity increased in contralateral precentral regions, again regardless of stimulated modality. Posterior superior temporal sulcus showed sustained delay activity, irrespective of sensory modality, side, and response type. We conclude that the delay activations reflect translation of sensory signals into effector-specific motor circuits in parietal and frontal cortex (plus an impact on contralateral visual cortex for planned saccades), regardless of cue modality, whereas posterior STS provides a representation that generalizes across both sensory modality and motor effector.

The representation of spatial attention in human parietal cortex dynamically modulates with performance

The control and allocation of attention is an essential, ubiquitous neural process that gates our awareness of objects and events in the environment. Neural representations of the locus of spatial attention have been previously demonstrated in parietal cortex. However, the behavioral relevance of these neural representations is not known. While undergoing functional magnetic resonance imaging, subjects performed a covert spatial attention task that yielded a wide range of performance values. Voxels in parietal cortex selective for attended target location also dynamically modulated, becoming more or less responsive as performance levels changed. Surprisingly, this relationship was not linear. Responses peaked at intermediate performance levels and dropped both when performance was very high and when it was very low. Such dynamic modulation may represent a mechanism for organizing neural control signals according to behavioral task demands.

Cortical activity time locked to the shift and maintenance of spatial attention

Attention increases the gain of visual neurons, which improves visual performance. How attention is controlled, however, remains unknown. Clear correlations between attention and saccade planning indicate that the control of attention is mediated through mechanisms housed in the oculomotor network. Here, we used event-related functional magnetic resonance imaging to compare overt and covert attention shifts. Subjects covertly or overtly shifted attention based on an endogenous cue and maintained attention throughout a long and variable delay. To insure continued attention, subjects counted when the attended target dimmed at near-threshold contrast levels. Overt and covert tasks used identical stimuli and required identical motor responses. Additionally, a staircase procedure that adjusted the target-dimming contrast separately for covert and overt trials equated the difficulty between conditions and across subjects. We found that the same regions along the precentral and intraparietal sulci were active during shifts of covert and overt attention. We also found sustained activation in the hemisphere contralateral to the attended visual field. We conclude that maps of prioritized locations are represented in areas classically associated with oculomotor control. The readout of these spatial maps by posterior visual areas directs spatial attention just as the readout by downstream saccade generators directs saccades.

Anterior regions of monkey parietal cortex process visual 3D shape

The intraparietal cortex is involved in the control of visually guided actions, like reach-to-grasp movements, which require extracting the 3D shape and position of objects from 2D retinal images. Using fMRI in behaving monkeys, we investigated the role of the intraparietal cortex in processing stereoscopic information for recovering the depth structure and the position in depth of objects. We found that while several areas (CIP, LIP, and AIP on the lateral bank; PIP and MIP on the medial bank) are activated by stereoscopic stimuli, AIP and an adjoining portion of LIP are sensitive only to depth structure. Furthermore, only these two regions are sensitive to both the depth structure and the 2D shape of small objects. These results indicate that extracting 3D spatial information from stereo involves several intraparietal areas, among which AIP and anterior LIP are more specifically engaged in extracting the 3D shape of objects.

Persistent neural activity during the maintenance of spatial position in working memory

The mechanism for the short-term maintenance of information involves persistent neural activity during the retention interval, which forms a bridge between the cued memoranda and its later contingent response. Here, we used event-related functional magnetic resonance imaging to identify cortical areas with activity that persists throughout working memory delays with the goal of testing if such activity represents visuospatial attention or prospective saccade goals. We did so by comparing two spatial working memory tasks. During a memory-guided saccade (MGS) task, a location was maintained during a delay after which a saccade was generated to the remembered location. During a spatial item recognition (SIR) task identical to MGS until after the delay, a button press indicated whether a newly cued location matched the remembered location. Activity in frontal and parietal areas persisted above baseline and was greater in the hemisphere contralateral to the cued visual field. However, delay-period activity did not differ between the tasks. Notably, in the putative frontal eye field (FEF), delay period activity did not differ despite that the precise metrics of the memory-guided saccade were known during the MGS delay and saccades were never made in SIR. Persistent FEF activity may therefore represent a prioritized attentional map of space, rather than the metrics for saccades.

Feature-based attentional modulations in the absence of direct visual stimulation

When faced with a crowded visual scene, observers must selectively attend to behaviorally relevant objects to avoid sensory overload. Often this selection process is guided by prior knowledge of a target-defining feature (e.g., the color red when looking for an apple), which enhances the firing rate of visual neurons that are selective for the attended feature. Here, we used functional magnetic resonance imaging and a pattern classification algorithm to predict the attentional state of human observers as they monitored a visual feature (one of two directions of motion). We find that feature-specific attention effects spread across the visual field-even to regions of the scene that do not contain a stimulus. This spread of feature-based attention to empty regions of space may facilitate the perception of behaviorally relevant stimuli by increasing sensitivity to attended features at all locations in the visual field.

Saccade-related remapping of target representations between topographic maps: a neural network study

The goal of this study was to explore how a neural network could solve the updating task associated with the double-saccade paradigm, where two targets are flashed in succession and the subject must make saccades to the remembered locations of both targets. Because of the eye rotation of the saccade to the first target, the remembered retinal position of the second target must be updated if an accurate saccade to that target is to be made. We trained a three-layer, feed-forward neural network to solve this updating task using back-propagation. The network's inputs were the initial retinal position of the second target represented by a hill of activation in a 2D topographic array of units, as well as the initial eye orientation and the motor error of the saccade to the first target, each represented as 3D vectors in brainstem coordinates. The output of the network was the updated retinal position of the second target, also represented in a 2D topographic array of units. The network was trained to perform this updating using the full 3D geometry of eye rotations, and was able to produce the updated second-target position to within a 1 degrees RMS accuracy for a set of test points that included saccades of up to 70 degrees . Emergent properties in the network's hidden layer included sigmoidal receptive fields whose orientations formed distinct clusters, and predictive remapping similar to that seen in brain areas associated with saccade generation. Networks with the larger numbers of hidden-layer units developed two distinct types of units with different transformation properties: units that preferentially performed the linear remapping of vector subtraction, and units that performed the nonlinear elements of remapping that arise from initial eye orientation.

Different cortical activations during visuospatial attention and the intention to perform a saccade

Everyday life often necessitates dissociation between our directed attention and the intention to direct our gaze. Accordingly, the differential role of visual and motor related areas in the one or the other process is an issue of an ongoing debate. Here we used functional magnetic resonance imaging to elaborate a differentiation between visuospatial attention and the intention for a horizontal saccade in these cortical areas. Subjects fixated a central target, while they directed their attention to a colored cue in the left or right visual field. Regardless of its location, the color of the cue instructed the direction of the upcoming saccade (intention). The attention to the peripheral cue and the intention to perform the saccade were thus either directed to the same side or to opposite sides. A random effects analysis of the imaging data showed that activation of the early visual cortex and the motion sensitive complex was biased by attention to the contralateral cue, whereas activity of the color sensitive complex was modulated by the stimulus instructing a contraversive saccade. The posterior parietal cortex and the proper supplementary eye field (SEF) were most strongly activated in case of spatially congruent attention and intention. In contrast, activity of the pre-SEF and the frontal eye field was enhanced by spatially divergent attention and intention. The results presented here advance our understanding of how the human brain processes spatial information. Noteworthy, the visuomotor related areas show a subtle cortical separation for visual related attention and saccade related intention.

Frames of reference for gaze saccades evoked during stimulation of lateral intraparietal cortex

Previous studies suggest that stimulation of lateral intraparietal cortex (LIP) evokes saccadic eye movements toward eye- or head-fixed goals, whereas most single-unit studies suggest that LIP uses an eye-fixed frame with eye-position modulations. The goal of our study was to determine the reference frame for gaze shifts evoked during LIP stimulation in head-unrestrained monkeys. Two macaques (M1 and M2) were implanted with recording chambers over the right intraparietal sulcus and with search coils for recording three-dimensional eye and head movements. The LIP region was microstimulated using pulse trains of 300 Hz, 100-150 microA, and 200 ms. Eighty-five putative LIP sites in M1 and 194 putative sites in M2 were used in our quantitative analysis throughout this study. Average amplitude of the stimulation-evoked gaze shifts was 8.67 degrees for M1 and 7.97 degrees for M2 with very small head movements. When these gaze-shift trajectories were rotated into three coordinate frames (eye, head, and body), gaze endpoint distribution for all sites was most convergent to a common point when plotted in eye coordinates. Across all sites, the eye-centered model provided a significantly better fit compared with the head, body, or fixed-vector models (where the latter model signifies no modulation of the gaze trajectory as a function of initial gaze position). Moreover, the probability of evoking a gaze shift from any one particular position was modulated by the current gaze direction (independent of saccade direction). These results provide causal evidence that the motor commands from LIP encode gaze command in eye-fixed coordinates but are also subtly modulated by initial gaze position.

Visual topography of human intraparietal sulcus

Human parietal cortex is implicated in a wide variety of sensory and cognitive functions, yet its precise organization remains unclear. Visual field maps provide a potential structural basis for descriptions of functional organization. Here, we detail the topography of a series of five maps of the contralateral visual hemifield within human posterior parietal cortex. These maps are located along the medial bank of the intraparietal sulcus (IPS) and are revealed by direct visual stimulation during functional magnetic resonance imaging, allowing these parietal regions to be routinely and reliably identified simultaneously with occipital visual areas. Two of these maps (IPS3 and IPS4) are novel, whereas two others (IPS1 and IPS2) have previously been revealed only by higher-order cognitive tasks. Area V7, a previously identified visual map, is observed to lie within posterior IPS and to share a foveal representation with IPS1. These parietal maps are reliably observed across scan sessions; however, their precise topography varies between individuals. The multimodal organization of posterior IPS mirrors this variability in visual topography, with complementary tactile activations found immediately adjacent to the visual maps both medially and laterally. These visual maps may provide a practical framework in which to characterize the functional organization of human IPS.

Changing human visual field organization from early visual to extra-occipital cortex

BACKGROUND

The early visual areas have a clear topographic organization, such that adjacent parts of the cortical surface represent distinct yet adjacent parts of the contralateral visual field. We examined whether cortical regions outside occipital cortex show a similar organization.

METHODOLOGY/PRINCIPAL FINDINGS

The BOLD responses to discrete visual field locations that varied in both polar angle and eccentricity were measured using two different tasks. As described previously, numerous occipital regions are both selective for the contralateral visual field and show topographic organization within that field. Extra-occipital regions are also selective for the contralateral visual field, but possess little (or no) topographic organization. A regional analysis demonstrates that this weak topography is not due to increased receptive field size in extra-occipital areas.

CONCLUSIONS/SIGNIFICANCE

A number of extra-occipital areas are identified that are sensitive to visual field location. Neurons in these areas corresponding to different locations in the contralateral visual field do not demonstrate any regular or robust topographic organization, but appear instead to be intermixed on the cortical surface. This suggests a shift from processing that is predominately local in visual space, in occipital areas, to global, in extra-occipital areas. Global processing fits with a role for these extra-occipital areas in selecting a spatial locus for attention and/or eye-movements.

Multisensory integration in the ventral intraparietal area of the macaque monkey

The goal of this study was to characterize multisensory interaction patterns in cortical ventral intraparietal area (VIP). We recorded single-unit activity in two alert monkeys during the presentation of visual (drifting gratings) and tactile (low-pressure air puffs) stimuli. One stimulus was always positioned inside the receptive field of the neuron. The other stimulus was defined so as to manipulate the spatial and temporal disparity between the two stimuli. More than 70% of VIP cells showed a significant modulation of their response by bimodal stimulations. These cells included both bimodal cells, i.e., cells responsive to both tested modalities, and seemingly unimodal cells, i.e., cells responding to only one of the two tested modalities. This latter observation suggests that postsynaptic latent mechanisms are involved in multisensory integration. In both cell categories, neuronal responses are either enhanced or depressed and reflect nonlinear sub-, super-, or additive mechanisms. The occurrence of these observations is maximum when stimuli are in temporal synchrony and spatially congruent. Interestingly, introducing spatial or temporal disparities between stimuli does not affect the sign or the magnitude of interactions but rather their occurrence. Multisensory stimulation also affects the neuronal response latencies of bimodal stimuli. For a given neuron, these are on average intermediate between the two unimodal response latencies, again suggesting latent postsynaptic mechanisms. In summary, we show that the majority of VIP neurons perform multisensory integration, following general rules (e.g., spatial congruency and temporal synchrony) that are closely similar to those described in other cortical and subcortical regions.

Oscillatory activity in human parietal and occipital cortex shows hemispheric lateralization and memory effects in a delayed double-step saccade task

We applied magnetoencephalography (MEG) to record oscillatory brain activity from human subjects engaged in planning a double-step saccade. In the experiments, subjects (n = 8) remembered the locations of 2 sequentially flashed targets (each followed by a 2-s delay), presented in either the left or right visual hemifield, and then made saccades to the 2 locations in sequence. We examined changes in spectral power in relation to target location (left or right) and memory load (one or two targets), excluding error trials based on concurrent eye tracking. During the delay period following the first target, power in the alpha (8-12 Hz) and beta (13-25 Hz) bands was significantly suppressed in the hemisphere contralateral to the target. When the second target was presented, there was a further suppression in the alpha- and beta-band power over both hemispheres. In this period, the same sensors also showed contralateral power enhancements in the gamma band (60-90 Hz), most significantly prior to the initiation of the saccades. Adaptive spatial filtering techniques localized the neural sources of the directionally selective power changes in parieto-occipital areas. These results provide further support for a topographic organization for delayed saccades in human parietal and occipital cortex.

Attentional modulation of receptive field structure in area 7a of the behaving monkey

Spatial attention modulates the activity of inferior parietal neurons. A statistically rigorous approach to classical retinotopic mapping was used to quantify the receptive fields of area 7a neurons under 2 attentional conditions. Measurements were made with retinal stimulation held constant and the locus of attention manipulated covertly. Both tasks required central fixation but differed in the locus of covert attention (either on the center fixation point or on a peripheral square target in one of 25 locations). The neuron's identity over the recording session was confirmed using chaos theory to characterize unique temporal patterns. Sixty-six percent of the neurons changed prestimulus activity based on task state. Retinotopic mapping showed no evidence for foveal sparing. Attentional factors influenced visual responses for approximately 30% of the neurons. Two types of modulation were equally observed. One group of cells had a multiplicative scaling of response, with equal instances of enhancement and suppression. A second group of cells had a complex interaction of visual and attentional signals, such that spatial tuning was subject to a nonlinear modulation across the visual field based on attentional constraints. These 2 cell groups may have different roles in the shift of attention preceding motor behaviors and may underlie shifts in parietal retinotopic maps observed with intrinsic optical imaging.

A nonparametric quantification of neural response field structures

The response fields of higher cortical neurons are usually approximated with smooth mathematical functions for the purpose of population parameterization or theoretical modeling. We used instead two nonparametric methods (principal component analysis and independent component analysis), which provided a basis for the response field clustering. Although both methods performed satisfactorily, the principal component analysis space is more straightforward to calculate. It also gave a clear preference toward the smallest number of functional response field classes. Clustering was performed with both K-means and superparamagnetic clustering algorithms with similar results. We also show that the shapes of the eigenvectors remain consistent regardless of the response field data sets size. This finding reflects the fact that the response fields were generated by the same neural network and encode the same underlying process.

Functional imaging of the intraparietal cortex during saccades to visual and memorized targets

The representation of perceived space and intended actions in the primate parietal cortex has been the subject of considerable debate. To address this issue, we used the quantitative 14C-deoxyglucose method to obtain maps of the activity pattern in the intraparietal cortex of rhesus monkeys executing saccades to visual and memorized targets. The principal effect induced by memory-guided saccades was found more caudally in the deepest part of the middle third of the lateral bank (within area LIPv) whereas that induced by visually guided saccades extended more rostrally and superficially in the anterior third of the bank (within area LIPd). The memory-saccade-related and the visual-saccade-related regions of activation overlapped only within area LIPv. Besides saccade execution, maximal activity in area LIPd required a visual stimulus. The region activated by visual fixation was located at the border of LIPv and LIPd, extending mainly within area LIPd, and occupying about one third of the neural space of the region activated for visual-saccades. We suggest that the lateral intraparietal cortex represents visual and motor space in segregated, albeit partially overlapping, regions.

Receptive-field structure of optic flow responsive Purkinje cells in the vestibulocerebellum of pigeons

Neurons sensitive to optic flow patterns have been recorded in the the olivo-vestibulocerebellar pathway and extrastriate visual cortical areas in vertebrates, and in the visual neuropile of invertebrates. The complex spike activity (CSA) of Purkinje cells in the vestibulocerebellum (VbC) responds best to patterns of optic flow that result from either self-rotation or self-translation. Previous studies have suggested that these neurons have a receptive-field (RF) structure that “approximates” the preferred optic flowfield with a “bipartite” organization. Contrasting this, studies in invertebrate species indicate that optic flow sensitive neurons are precisely tuned to their preferred flowfield, such that the local motion sensitivities and local preferred directions within their RFs precisely match the local motion in that region of the preferred flowfield. In this study, CSA in the VbC of pigeons was recorded in response to a set of complex computer-generated optic flow stimuli, similar to those used in previous studies of optic flow neurons in primate extrastriate visual cortex, to test whether the receptive field was of a precise or bipartite organization. We found that these RFs were not precisely tuned to optic flow patterns. Rather, we conclude that these neurons have a bipartite RF structure that approximates the preferred optic flowfield by pooling motion subunits of only a few different direction preferences.

Spatially Selective Representations of Voluntary and Stimulus-Driven Attentional Priority in Human Occipital, Parietal, and Frontal Cortex

When multiple objects are present in a visual scene, they compete for cortical processing in the visual system; selective attention biases this competition so that representations of behaviorally relevant objects enter awareness and irrelevant objects do not. Deployments of selective attention can be voluntary (e.g., shift or attention to a target's expected spatial location) or stimulus driven (e.g., capture of attention by a target-defining feature such as color). Here we use functional magnetic resonance imaging to show that both of these factors induce spatially selective attentional modulations within regions of human occipital, parietal, and frontal cortex. In addition, the voluntary attentional modulations are temporally sustained, indicating that activity in these regions dynamically tracks the locus of attention. These data show that a convolution of factors, including prior knowledge of location and target-defining features, determines the relative competitive advantage of visual stimuli within multiple stages of the visual system.

Parametric modulation of cortical activation during smooth pursuit with and without target blanking. An fMRI study

Smooth pursuit eye movements (SPEM) are performed to track slowly moving visual targets and are accompanied by saccades whenever foveal representation is lost. In the present study, we correlated the cerebral activation as assessed by functional magnetic resonance imaging with parameters of eye movement performance in order to determine the cortical areas involved in the retinal and extraretinal processing of maintaining smooth pursuit velocity (SPV) and generating saccades in 16 healthy males. The stimulus consisted of a target moving at a constant velocity of 10 degrees/s with and without target blanking. During constant target presentation, SPV was positively correlated with the BOLD signal in the right V5 complex and negatively correlated with the BOLD response in the left dorsolateral prefrontal cortex (DLPFC). In the condition with target blanking, additional negative correlations with SPV were found in the left frontal eye field (FEF), the left parietoinsular vestibular cortex (PIVC) and the left angular gyrus. Saccadic frequency was negatively correlated with activations of the right mesial intraparietal sulcus (IPS) during both conditions and the right premotor area during continuous target presentation. We conclude that V5 is directly related to the maintenance of an optimal smooth pursuit velocity during visual feedback, whereas the FEF, PFC, angular gyrus and PIVC are involved in reconstitution and prediction whenever SPV decreases, especially during maintenance of smooth pursuit in the absence of a visual target. Furthermore, we suggest that parietal areas are related to the suppression of saccades during smooth pursuit.

A stimulus-dependent dissociation between the cerebral hemispheres under free-viewing conditions

Under free-viewing conditions, the leftward stimulus features are frequently overestimated (pseudoneglect). This asymmetry could reflect the operation of: (a) spatial attention mechanisms in the right hemisphere (RH) or, (b) stimulus-specific activation. To test these propositions, we attempted to induce a stimulus-specific dissociation between the hemispheres under free-viewing conditions. In two experiments (n=23, n=22) dextrals carried out two tasks. The 'grayscales' task required luminance judgments between two mirror-reversed luminance gradients. The flicker task required temporal frequency judgments between two mirror-reversed temporal gradients. The grayscales and flicker tasks suited the processing styles of the right and left hemispheres, respectively. For both experiments, a strong leftward bias was observed for the grayscales task, which could be the result of both of the mechanisms outlined above. In Experiment 1, there was a rightward bias for the flicker task-but only for participants with longer reaction times. In Experiment 2, where all responses were delayed, a rightward bias was found for the flicker task for shorter stimuli. The data demonstrate that stimulus-specific dissociations can be induced under free-viewing conditions. However, the fact that the rightward bias was: (a) weaker than the leftward bias and, (b) reduced by increases in length, demonstrates that RH spatial attention mechanisms are also important.

The Effect of Body and Environment-Centred Coordinates on Free-Viewing Perceptual Asymmetries for Vertical and Horizontal Stimuli

Leftward and upward perceptual biases are commonly reported for horizontal and vertical stimuli, respectively. It is unclear, however, whether these biases are based upon body or environment-centred coordinates. Two experiments examined the contribution of these coordinate systems to free-viewing vertical and horizontal perceptual biases. In Experiment 1, normal participants (n = 35) made forced-choice luminance judgments on two mirror-reversed luminance gradients (the 'greyscales' task) presented in vertical and horizontal orientations. Body and environment-based coordinates were dissociated by tilting participants' heads to the left or right. A leftward and upward bias, which was observed in the horizontal and vertical conditions (respectively) when the head was upright, was extinguished when the head was tilted. Results indicated a dual reliance on body and environmental coordinates with some suggestion that the upward bias was more dependent on environmental coordinates. In Experiment 2 the same stimuli were presented as participants (n = 24) adopted an upright or supine pose. Once again, leftward and upward biases were observed in the upright condition. The leftward bias persisted in the supine condition whereas the upward bias was eliminated. Results demonstrate that the leftward bias is based predominantly on body coordinates whereas the upward bias is reliant on environmental/gravitational coordinates. The possibility that the neural basis for the biases lies in the inter-modal centres of the intraparietal region of the right hemisphere is discussed.

Selective visual attention and perceptual coherence

Conscious perception of the visual world depends on neural activity at all levels of the visual system from the retina to regions of parietal and frontal cortex. Neurons in early visual areas have small spatial receptive fields (RFs) and code basic image features; neurons in later areas have large RFs and code abstract features such as behavioral relevance. This hierarchical organization presents challenges to perception: objects compete when they are presented in a single RF, and component object features are coded by anatomically distributed neuronal activity. Recent research has shown that selective attention coordinates the activity of neurons to resolve competition and link distributed object representations. We refer to this ensemble activity as a "coherence field", and propose that voluntary shifts of attention are initiated by a transient control signal that "nudges" the visual system from one coherent state to another.

Mapping the parietal cortex of human and non-human primates

The present essay reviews a series of functional magnetic resonance imaging (fMRI) studies conducted in parallel in humans and awake monkeys, concentrating on the intraparietal sulcus (IPS). MR responses to a range of visual stimuli indicate that the human IPS contains more functional regions along its anterior-posterior extent than are known in the monkey. Human IPS includes four motion sensitive regions, ventral IPS (VIPS), parieto-occipital IPS (POIPS), dorsal IPS medial (DIPSM) and dorsal IPS anterior (DIPSA), which are also sensitive to three-dimensional structure from motion (3D SFM). On the other hand, the monkey IPS contains only one motion sensitive area (VIP), which is not particularly sensitive to 3D SFM. The human IPS includes four regions sensitive to two-dimensional shape and three representations of central vision, while monkey IPS appears to contain only two shape sensitive regions and one central representation. These data support the hypothesis that monkey LIP corresponds to the region of human IPS between DIPSM and POIPS and that a portion of the anterior part of human IPS is evolutionarily new. This additional cortical tissue may provide the capacity for an enhanced visual analysis of moving images necessary for sophisticated control of manipulation and tool handling.

Spatial updating in area LIP is independent of saccade direction

We explore the world around us by making rapid eye movements to objects of interest. Remarkably, these eye movements go unnoticed, and we perceive the world as stable. Spatial updating is one of the neural mechanisms that contributes to this perception of spatial constancy. Previous studies in macaque lateral intraparietal cortex (area LIP) have shown that individual neurons update, or "remap," the locations of salient visual stimuli at the time of an eye movement. The existence of remapping implies that neurons have access to visual information from regions far beyond the classically defined receptive field. We hypothesized that neurons have access to information located anywhere in the visual field. We tested this by recording the activity of LIP neurons while systematically varying the direction in which a stimulus location must be updated. Our primary finding is that individual neurons remap stimulus traces in multiple directions, indicating that LIP neurons have access to information throughout the visual field. At the population level, stimulus traces are updated in conjunction with all saccade directions, even when we consider direction as a function of receptive field location. These results show that spatial updating in LIP is effectively independent of saccade direction. Our findings support the hypothesis that the activity of LIP neurons contributes to the maintenance of spatial constancy throughout the visual field.

Topographic maps of visual spatial attention in human parietal cortex

Functional magnetic resonance imaging (fMRI) was used to measure activity in human parietal cortex during performance of a visual detection task in which the focus of attention systematically traversed the visual field. Critically, the stimuli were identical on all trials (except for slight contrast changes in a fully randomized selection of the target locations) whereas only the cued location varied. Traveling waves of activity were observed in posterior parietal cortex consistent with shifts in covert attention in the absence of eye movements. The temporal phase of the fMRI signal in each voxel indicated the corresponding visual field location. Visualization of the distribution of temporal phases on a flattened representation of parietal cortex revealed at least two distinct topographically organized cortical areas within the intraparietal sulcus (IPS), each representing the contralateral visual field. Two cortical areas were proposed based on this topographic organization, which we refer to as IPS1 and IPS2 to indicate their locations within the IPS. This nomenclature is neutral with respect to possible homologies with well-established cortical areas in the monkey brain. The two proposed cortical areas exhibited relatively little response to passive visual stimulation in comparison with early visual areas. These results provide evidence for multiple topographic maps in human parietal cortex.

Interactions between number and space in parietal cortex

Since the time of Pythagoras, numerical and spatial representations have been inextricably linked. We suggest that the relationship between the two is deeply rooted in the brain's organization for these capacities. Many behavioural and patient studies have shown that numerical-spatial interactions run far deeper than simply cultural constructions, and, instead, influence behaviour at several levels. By combining two previously independent lines of research, neuroimaging studies of numerical cognition in humans, and physiological studies of spatial cognition in monkeys, we propose that these numerical-spatial interactions arise from common parietal circuits for attention to external space and internal representations of numbers.

Reference frames for representing visual and tactile locations in parietal cortex

The ventral intraparietal area (VIP) receives converging inputs from visual, somatosensory, auditory and vestibular systems that use diverse reference frames to encode sensory information. A key issue is how VIP combines those inputs together. We mapped the visual and tactile receptive fields of multimodal VIP neurons in macaque monkeys trained to gaze at three different stationary targets. Tactile receptive fields were found to be encoded into a single somatotopic, or head-centered, reference frame, whereas visual receptive fields were widely distributed between eye- to head-centered coordinates. These findings are inconsistent with a remapping of all sensory modalities in a common frame of reference. Instead, they support an alternative model of multisensory integration based on multidirectional sensory predictions (such as predicting the location of a visual stimulus given where it is felt on the skin and vice versa). This approach can also explain related findings in other multimodal areas.