Visual perception of motion and 3-D structure from motion: an fMRI study

Processing 3D form and 3D motion: respective contributions of attention-based and stimulus-driven activity

This study aims at segregating the neural substrate for the 3D-form and 3D-motion attributes in structure-from-motion perception, and at disentangling the stimulus-driven and endogenous-attention-driven processing of these attributes. Attention and stimulus were manipulated independently: participants had to detect the transitions of one attribute--form, 3D motion or colour--while the visual stimulus underwent successive transitions of all attributes. We compared the BOLD activity related to form and 3D motion in three conditions: stimulus-driven processing (unattended transitions), endogenous attentional selection (task) or both stimulus-driven processing and attentional selection (attended transitions). In all conditions, the form versus 3D-motion contrasts revealed a clear dorsal/ventral segregation. However, while the form-related activity is consistent with previously described shape-selective areas, the activity related to 3D motion does not encompass the usual "visual motion" areas, but rather corresponds to a high-level motion system, including IPL and STS areas. Second, we found a dissociation between the neural processing of unattended attributes and that involved in endogenous attentional selection. Areas selective for 3D-motion and form showed either increased activity at transitions of these respective attributes or decreased activity when subjects' attention was directed to a competing attribute. We propose that both facilitatory and suppressive mechanisms of attribute selection are involved depending on the conditions driving this selection. Therefore, attentional selection is not limited to an increased activity in areas processing stimulus properties, and may unveil different functional localization from stimulus modulation.

The posterior cingulate cortex and planum temporale/parietal operculum are activated by coherent visual motion

The posterior cingulate cortex (PCC) is involved in higher order sensory and sensory-motor integration while the planum temporale/parietal operculum (PT/PO) junction takes part in auditory motion and vestibular processing. Both regions are activated during different types of visual stimulation. Here, we describe the response characteristics of the PCC and PT/PO to basic types of visual motion stimuli of different complexity (complex and simple coherent as well as incoherent motion). Functional magnetic resonance imaging (fMRI) was performed in 10 healthy subjects at 3 Tesla, whereby different moving dot stimuli (vertical, horizontal, rotational, radial, and random) were contrasted against a static dot pattern. All motion stimuli activated a distributed cortical network, including previously described motion-sensitive striate and extrastriate visual areas. Bilateral activations in the dorsal region of the PCC (dPCC) were evoked using coherent motion stimuli, irrespective of motion direction (vertical, horizontal, rotational, radial) with increasing activity and with higher complexity of the stimulus. In contrast, the PT/PO responded equally well to all of the different coherent motion types. Incoherent (random) motion yielded significantly less activation both in the dPCC and in the PT/PO area. These results suggest that the dPCC and the PT/PO take part in the processing of basic types of visual motion. However, in dPCC a possible effect of attentional modulation resulting in the higher activity evoked by the complex stimuli should also be considered. Further studies are warranted to incorporate these regions into the current model of the cortical motion processing network.

Mapping the connectivity with structural equation modeling in an fMRI study of shape-from-motion task

In this fMRI study, we explore the connectivity among brain regions in a shape-from-motion task using the causal mapping analysis of structural equation modeling (SEM). An important distinction of our approach is that we have adapted SEM from its traditional role in confirmatory analysis to provide utility as an exploratory mapping technique. Our current approaches include (I) detecting brain regions that fit well in a hypothesized neural network model, and (II) identifying the best connectivity model at each brain region. We demonstrate that SEM effectively detects the dorsal and ventral visual pathways from the covariance structure in fMRI data, confirming previous neuroscience results. Further, our SEM mapping methodology found that the two pathways interact through specific cortical areas such as the superior lateral occipital cortex in the perception of shape from motion.

Development of cortical responses to optic flow

Humans discriminate approaching objects from receding ones shortly after birth, and optic flow associated with self-motion may activate distinctive brain networks, including the human MT+ complex. We sought evidence for evoked brain activity that distinguished radial motion from other optic flow patterns, such as translation or rotation by recording steady-state visual evoked potentials (ssVEPs), in both adults and 4–6 month-old infants to direction-reversing optic flow patterns. In adults, radial flow evoked distinctive brain responses in both the time and frequency domains. Differences between expansion/contraction and both translation and rotation were especially strong in lateral channels (PO7 and PO8), and there was an asymmetry between responses to expansion and contraction. In contrast, infants' evoked response waveforms to all flow types were equivalent, and showed no evidence of the expansion/contraction asymmetry. Infants' responses were largest and most reliable for the translation patterns in which all dots moved in the same direction. This pattern of response is consistent with an account in which motion processing systems detecting locally uniform motion develop earlier than do systems specializing in complex, globally non-uniform patterns of motion, and with evidence suggesting that motion processing undergoes prolonged postnatal development.

Perception of structured optic flow and random visual motion in infants and adults: a high-density EEG study

Electroencephalogram (EEG) was used in 8-month-old infants and adults to study brain electrical activity as a function of perception of structured optic flow and random visual motion. A combination of visual evoked potential (VEP) analyses and analyses of temporal spectral evolution (TSE, time-dependent spectral power) was carried out. Significant differences were found for the N2 component of VEP for optic flow versus random visual motion within and between groups. Both adults and infants showed shorter latencies for structured optic flow than random visual motion, and infants showed longer latencies, particularly for random visual motion, and larger amplitudes than adults. Both groups also showed significant differences in induced activity when TSE of the two motion stimuli (optic flow and random visual motion) was compared with TSE of a static dot pattern. Infants showed an induced decrease in the amplitudes in theta-band frequency, while adults showed an induced increase in beta-band frequency. Differences in induced activity for the two motion stimuli could, however, not be observed. Brain activity related to motion stimuli is different for infants and adults and the differences are observed both in VEPs and in induced activity of the EEG. To investigate how changes in locomotor development are related to accompanying changes in brain activity associated with visual motion perception, more data of infants with different experiences in self-produced locomotion are required.

Neural correlates of visually induced self-motion illusion in depth

Optic-flow fields can induce the conscious illusion of self-motion in a stationary observer. Here we used functional magnetic resonance imaging to reveal the differential processing of self- and object-motion in the human brain. Subjects were presented a constantly expanding optic-flow stimulus, composed of disparate red-blue dots, viewed through red-blue glasses to generate a vivid percept of three-dimensional motion. We compared the activity obtained during periods of illusory self-motion with periods of object-motion percept. We found that the right MT+, precuneus, as well as areas located bilaterally along the dorsal part of the intraparietal sulcus and along the left posterior intraparietal sulcus were more active during self-motion perception than during object-motion. Additional signal increases were located in the depth of the left superior frontal sulcus, over the ventral part of the left anterior cingulate, in the depth of the right central sulcus and in the caudate nucleus/putamen. We found no significant deactivations associated with self-motion perception. Our results suggest that the illusory percept of self-motion is correlated with the activation of a network of areas, ranging from motion-specific areas to regions involved in visuo-vestibular integration, visual imagery, decision making, and introspection.

Dorsal stream development in motion and structure-from-motion perception

Little is known about the neural development underlying high order visual perception. For example, in detection of structures by coherently moving dots, motion information must interact with shape-based information to enable object recognition. Tasks involving these different motion-based discriminations are known to activate distinct specialized brain areas in adults. Here, we investigate neural development of normally developing children using functional magnetic resonance imaging (fMRI) during perception of randomly moving point-light dots (RM), coherently moving dots that formed a 3D rotating object (SFM) and static dots. Perception of RM enhanced neural activity as compared with static dots in motion processing-related visual areas, including visual area 3a (V3a), and middle temporal area (hMT+) in 10 adults (age 20-30 years). Children (age 5-6 years) showed less pronounced activity in area V3a than adults. Perception of SFM induced enhanced neural activity as compared to RM in adults in the left parietal shape area (PSA), whereas children increased neural activity within dorsal (V3a) and ventral brain areas (lingual gyrus) of the occipital cortex. These findings provide evidence of neural development within the dorsal pathway. First, maturation was associated with enhanced activity in specialized areas within the dorsal pathway during RM perception (V3a) and SFM perception (PSA). Secondly, high order visual perception-related neural development was associated with a shift in neural activity from low level shape and motion specialized areas in children, including partially immature area V3a, to high order areas in the parietal lobule (PSA) in adults.

Cerebral processing of spontaneous reversals of the rotating Necker cube

The cerebral processing of spontaneous perceptive reversals of the rotating Necker cube was studied in humans by combined functional MRI and electroencephalography. These reversals prefer certain positions of the Necker cube and can be studied without external reference of the perception. Functional MRI revealed six bilaterally active regions in the visual, parietal, and premotor cortex. A new method determined phase-locked electroencephalography-activations in the regions of interest and showed a significant stimulus-locked activity that started in the left Brodmann area 18. This activity started 38 ms after passing the symmetric position of the Necker cube and spread along the dorsal stream. We suggest that a further portion of the event-related potential signal reflects additional top-down processing, dependent on the position of the Necker cube.

Neural correlates of monocular and binocular depth cues based on natural images: A LORETA analysis

Functional imaging studies investigating perception of depth rely solely on one type of depth cue based on non-natural stimulus material. To overcome these limitations and to provide a more realistic and complete set of depth cues natural stereoscopic images were used in this study. Using slow cortical potentials and source localization we aimed to identify the neural correlates of monocular and binocular depth cues. This study confirms and extends functional imaging studies, showing that natural images provide a good, reliable, and more realistic alternative to artificial stimuli, and demonstrates the possibility to separate the processing of different depth cues.

Modulation of V1 Activity by Shape: Image-Statistics or Shape-Based Perception?

It is current dogma that neurons in primary visual cortex extract local edges from the scene from which later visual areas reconstruct more meaningful shapes. Recent neuroimaging studies, however, have shown V1 modulations by the degree of structure in the image (shape). These V1 modulations due to the level of shape coherence have been explained in one of two possible ways: due to changes in image statistics or shape-based perceptual influences from higher visual areas. Here we compare both hypotheses using stimuli composed of Gabor arrays constructed to form circular shapes that can be successively degraded by manipulating the orientations of individual Gabors while maintaining local and global statistics. In a first experiment, we confirm that V1 responses are inversely correlated with the degree of structure in the image. In a second experiment, stimulus predictions are compared based on the degree of circular shape or change in the image statistic varied (orientation variance) in the image. We find that these V1 modulations to shape change are correlated with low-level changes in orientation contrast rather than shape perception per se.

Abnormal brain activation during movement observation in patients with conversion paralysis

Dissociative paralysis in conversion disorders has variably been attributed to a lack of movement initiation or an inhibition of movement. While psychodynamic theory suggests altered movement conceptualization, brain activation associated with observation and replication of movements has so far not been assessed neurobiologically. Here, we measured brain activation by functional magnetic resonance imaging during observation and subsequent imitative execution of movements in four patients with dissociative hand paralysis. Compared to healthy controls conversion disorder patients showed decreased activation of cortical hand areas during movement observation. This effect was specific to the side of their dissociative paralysis. No brain activation compatible with movement inhibition was observed. These findings indicate that in dissociative paralysis, there is not only derangement of movement initiation but already of movement conceptualization. This raises the possibility that strategies targeted at reestablishing appropriate movement conceptualization may contribute to the therapy of dissociative paralysis.

Auditory motion perception activates visual motion areas in early blind subjects

We have previously shown that some visual motion areas can be specifically recruited by auditory motion processing in blindfolded sighted subjects [Poirier, C., Collignon, O., De Volder, A.G., Renier, L., Vanlierde, A., Tranduy, D., Scheiber, C., 2005. Specific activation of V5 brain area by auditory motion processing: an fMRI study. Brain Res. Cogn. Brain Res. 25, 650-658]. The present fMRI study investigated whether auditory motion processing may recruit the same brain areas in early blind subjects. The task consisted of simultaneously determining both the nature of a sound stimulus (pure tone or complex sound) and the presence or absence of its movement. When a movement was present, blind subjects had to identify its direction. Auditory motion processing, as compared to static sound processing, activated the brain network of auditory and visual motion processing classically observed in sighted subjects. Accordingly, brain areas previously considered as specific to visual motion processing could be specifically recruited in blind people by motion stimuli presented through the auditory modality. This indicates that the occipital cortex of blind people could be organized in a modular way, as in sighted people. The similarity of these results with those we previously observed in sighted subjects suggests that occipital recruitment in blind people could be mediated by the same anatomical connections as in sighted subjects.

Mapping the parietal cortex of human and non-human primates

The present essay reviews a series of functional magnetic resonance imaging (fMRI) studies conducted in parallel in humans and awake monkeys, concentrating on the intraparietal sulcus (IPS). MR responses to a range of visual stimuli indicate that the human IPS contains more functional regions along its anterior-posterior extent than are known in the monkey. Human IPS includes four motion sensitive regions, ventral IPS (VIPS), parieto-occipital IPS (POIPS), dorsal IPS medial (DIPSM) and dorsal IPS anterior (DIPSA), which are also sensitive to three-dimensional structure from motion (3D SFM). On the other hand, the monkey IPS contains only one motion sensitive area (VIP), which is not particularly sensitive to 3D SFM. The human IPS includes four regions sensitive to two-dimensional shape and three representations of central vision, while monkey IPS appears to contain only two shape sensitive regions and one central representation. These data support the hypothesis that monkey LIP corresponds to the region of human IPS between DIPSM and POIPS and that a portion of the anterior part of human IPS is evolutionarily new. This additional cortical tissue may provide the capacity for an enhanced visual analysis of moving images necessary for sophisticated control of manipulation and tool handling.

Specific activation of the V5 brain area by auditory motion processing: an fMRI study

Previous neuroimaging studies devoted to auditory motion processing have shown the involvement of a cerebral network encompassing the temporoparietal and premotor areas. Most of these studies were based on a comparison between moving stimuli and static stimuli placed at a single location. However, moving stimuli vary in spatial location, and therefore motion detection can include both spatial localisation and motion processing. In this study, we used fMRI to compare neural processing of moving sounds and static sounds in various spatial locations in blindfolded sighted subjects. The task consisted of simultaneously determining both the nature of a sound stimulus (pure tone or complex sound) and the presence or absence of its movement. When movement was present, subjects had to identify its direction. This comparison of how moving and static stimuli are processed showed the involvement of the parietal lobules, the dorsal and ventral premotor cortex and the planum temporale during auditory motion processing. It also showed the specific recruitment of V5, the visual motion area. These results suggest that the previously proposed network of auditory motion processing is distinct from the network of auditory localisation. In addition, they suggest that the occipital cortex can process non-visual stimuli and that V5 is not restricted to visual processing.

Processing of global form and motion in migraineurs

Previous studies have identified anomalies of cortical visual processing in migraineurs that appear to extend beyond V1. Migraineurs respond differently than controls to transcranial magnetic stimulation of V5, and can demonstrate impairments of global motion processing. This study was designed to assess the integrity of intermediate stages of both motion and form processing in people with migraine. We measured the ability to integrate local orientation information into a global form percept, and to integrate local motion information into a global motion percept. Control subjects performed significantly better than migraineurs on both tasks, suggesting a diffuse visual cortical processing anomaly in migraine.

Visual field map clusters in human cortex

We describe the location and general properties of nine human visual field maps. The cortical location of each map, as well as many examples of the eccentricity and angular representations within these maps, are shown in a series of images that summarize a large set of functional MRI data. The organization and properties of these maps are compared and contrasted with descriptions by other investigators. We hypothesize that the human visual field maps are arranged in several clusters, each comprising a group of maps that share a common foveal representation and semicircular eccentricity map. The spatial organization of these clusters suggests that the perceptual processing within each cluster serves related functions.

3D shape perception from combined depth cues in human visual cortex

Our perception of the world's three-dimensional (3D) structure is critical for object recognition, navigation and planning actions. To accomplish this, the brain combines different types of visual information about depth structure, but at present, the neural architecture mediating this combination remains largely unknown. Here, we report neuroimaging correlates of human 3D shape perception from the combination of two depth cues. We measured fMRI responses while observers judged the 3D structure of two sequentially presented images of slanted planes defined by binocular disparity and perspective. We compared the behavioral and fMRI responses evoked by changes in one or both of the depth cues. fMRI responses in extrastriate areas (hMT+/V5 and lateral occipital complex), rather than responses in early retinotopic areas, reflected differences in perceived 3D shape, suggesting 'combined-cue' representations in higher visual areas. These findings provide insight into the neural circuits engaged when the human brain combines different information sources for unified 3D visual perception.

Does egocentric mental rotation elicit sex differences?

Mental rotation tests traditionally show a male performance advantage. Some neuroimaging studies have reported sex-specific cortical activation patterns during mental rotation. However, these experiments used abstract stimuli and some studies did not systematically exclude performance as a confounding variable. The mental rotation of hands and hand-related objects, compared to abstract objects, is known to evoke an egocentric motor strategy. In this study, we used fMRI to explore potential gender-specific cortical activation patterns for the mental rotation of hands and tools in a sample with an adequate and equal performance for men and women. We found a common neural substrate for men and women comprising superior parietal lobe, dorsolateral premotor cortex, and extrastriate occipital areas, compatible with an egocentric motor strategy for the mental rotation of hands and tools. Sex differences were modest and limited to the mental rotation of hands. Women recruited more left ventral premotor cortex, which could imply that women rely more on imitation or use more perceptual comparisons. Men, on the other hand, drafted more the lingual gyrus, possibly referring to more extensive semantic or early visual processing. We conclude that men and women use a very similar motor strategy during egocentric mental rotation with a potential gender-specific accent.

Neuromagnetic evoked responses to complex motions are greatest for expansion

We analysed evoked magnetic responses to moving random dot stimuli, initially using a 19-channel magnetoencephalography (MEG) system, and subsequently using a 151-channel MEG system. Random dot displays were used to construct complex motion sequences, which we refer to as expansion, contraction, deformation, and rotation. We also investigated lateral translation and a condition in which the directions of the dots were randomised. In all stimulus conditions, the dots were first stationary, then traveled for a brief period (317 s or 542 ms), and were then stationary again. In all conditions, evoked magnetic responses were observed with a widespread bilateral distribution over the observers' heads. Initial recordings revealed a substantially larger evoked magnetic response to the expansion condition than the other conditions. In a revised study, we used a 151-channel MEG system and two stimulus diameters (9.3 and 48 deg), the smaller comparable with the first experiment. The responses were analysed using a nonparametric approach and confirmed our initial observations. In a third study, speed gradients were removed and a new design permitted direct comparisons between motion conditions. The results from all three experiments are consistent with the greater ecological validity of the expansion stimulus.

Sensitivity to linear-speed-gradient of radial expansion flow in infancy

A radial expansion flow having a linear-speed-gradient (linear-grad) creates robust perception of a rigid object moving-in-depth [Perception 19 (1990) 21]. It has been reported that sensitivity to a linear-grad of radial expansion emerges at 2 months of age [Infant Behavior and Development 17 (1994) 165]. In the present study, we examined the development of sensitivity to the linear-grad of radial expansion after 2 months of age with three experiments. A total of 197 2- to 5-month-old infants participated. The results showed that sensitivity to the linear-grad improves between 2 and 3 months of age (Experiment 1), and that the infants may discriminate between an expansion having linear-grad and that having zero-grad based on their perception of motion-in-depth (Experiments 2 and 3).

Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays

We used fMRI to directly compare the neural substrates of three-dimensional (3-D) shape and motion processing for realistic textured objects rotating in depth. Subjects made judgments about several different attributes of these objects, including 3-D shape, the 3-D motion, and the scale of surface texture. For all of these tasks, we equated visual input, motor output, and task difficulty, and we controlled for differences in spatial attention. Judgments about 3-D shape from motion involve both parietal and occipito-temporal regions. The processing of 3-D shape is associated with the analysis of 3-D motion in parietal regions and the analysis of surface texture in occipito-temporal regions, which is consistent with the different behavioral roles that are typically attributed to the dorsal and ventral processing streams.

First- and second-order stimulus length selectivity in New World monkey striate cortex

Motion is a powerful cue for figure-ground segregation, allowing the recognition of shapes even if the luminance and texture characteristics of the stimulus and background are matched. In order to investigate the neural processes underlying early stages of the cue-invariant processing of form, we compared the responses of neurons in the striate cortex (V1) of anaesthetized marmosets to two types of moving stimuli: bars defined by differences in luminance, and bars defined solely by the coherent motion of random patterns that matched the texture and temporal modulation of the background. A population of form-cue-invariant (FCI) neurons was identified, which demonstrated similar tuning to the length of contours defined by first- and second-order cues. FCI neurons were relatively common in the supragranular layers (where they corresponded to 28% of the recorded units), but were absent from layer 4. Most had complex receptive fields, which were significantly larger than those of other V1 neurons. The majority of FCI neurons demonstrated end-inhibition in response to long first- and second-order bars, and were strongly direction selective. Thus, even at the level of V1 there are cells whose variations in response level appear to be determined by the shape and motion of the entire second-order object, rather than by its parts (i.e. the individual textural components). These results are compatible with the existence of an output channel from V1 to the ventral stream of extrastriate areas, which already encodes the basic building blocks of the image in an invariant manner.

Visual processing of coherent rotation in the central visual field: an fMRI study

Functional magnetic resonance imaging was used to determine the brain areas that process coherent motion. To reduce the activity related to eye-movement planning and self-motion perception, rotation was used as coherent motion and the stimulus was restricted to the central visual field. Coherent rotation relative to incoherent random-dot motion resulted in consistent activation in the superior parietal lobule (SPL), in the lateral occipital gyrus (presumptive kinetic occipital region, KO), and in the fusiform gyrus (FG). The main novel finding in present study is the bilateral SPL activation, which has not been found in any previous study contrasting coherent and incoherent motion. It is suggested that the SPL activation is related to form-from-motion processing. The stimulus modification that prevented abrupt appearances of dots at the borders of the stimulus field increased the strength of rolling disk-like percept of the coherent stimulus. This perception of form may also be at least partly responsible for the activation in KO and FG. With this explanation, our three consistent activation areas are in line with previous findings. Furthermore, these results demonstrate that even delicate changes in some stimulus aspects can lead to significant changes in the activation of the brain.

Neuronal representation of occluded objects in the human brain

Occluding surfaces frequently obstruct the object of interest yet are easily dealt with by the visual system. Here, we test whether neural areas known to participate in motion perception and eye movements are regions that also process occluded motion. Functional magnetic resonance imaging (fMRI) was used to assess brain activation while subjects watched a moving ball become occluded. Areas activated during occluded motion included the intraparietal sulcus (IPS) as well as middle temporal (MT) regions analogous to monkey MT/MST. A second experiment showed that these results were not due to motor activity. These findings suggest that human cortical regions involved in perceiving occluded motion are similar to regions that process real motion and regions responsible for eye movements. The intraparietal sulcus may be involved in predicting the location of an unseen target for future hand or eye movements.

A multitrial analysis for revealing significant corticocortical networks in magnetoencephalography and electroencephalography

We present an MEG/EEG framework to reveal statistically significant brain areas engaged in the same cognitive process across trials without resort to averaging procedures. The variability of neuronal responses is assumed to take place only in the reconstructed time series of cortical sources and not in their positions. This hypothesis allows the use of the surrogate data method to detect recurrently active brain areas across trials adjusted with any cortically constrained focal MEEG inverse solution. Results obtained from synthetic data show that considering several trials enhances the accuracy of the source localisation. We apply this approach on MEG data recorded during a simple visual stimulation. The considered stimulus is frequency tagged in order to reveal the neural network correlated to its perception using phase synchronisation analysis. The results show consistent patterns of distributed synchronous networks centred on occipital areas.

Neuronal mechanisms for the perception of ambiguous stimuli

Ambiguous figures that may take on the appearance of two or more distinct forms have fascinated philosophers and psychologists for generations. Recently, several laboratories have studied the neuronal basis of perceptual appearance at the level of single neurons in the cerebral cortex. Experiments that integrate neuronal recording with analyses based on sensory detection theory reveal a remarkable degree of specificity in these neuronal responses. The new challenges are to understand how cognitive processes, such as attention and memory, interact with perception to generate these neuronal signals.

Human cortical object recognition from a visual motion flowfield

Moving dots can evoke a percept of the spatial structure of a three-dimensional object in the absence of other visual cues. This phenomenon, called structure from motion (SFM), suggests that the motion flowfield represented in the dorsal stream can form the basis of object recognition performed in the ventral stream. SFM processing is likely to contribute to object perception whenever there is relative motion between the observer and the object viewed. Here we investigate the motion flowfield component of object recognition with functional magnetic resonance imaging. Our SFM stimuli encoded face surfaces and random three-dimensional control shapes with matched curvature properties. We used two different types of an SFM stimulus with the dots either fixed to the surface of the object or moving on it. Despite the radically different encoding of surface structure in the two types of SFM, both elicited strong surface percepts and involved the same network of cortical regions. From early visual areas, this network extends dorsally into the human motion complex and parietal regions and ventrally into object-related cortex. The SFM stimuli elicited a face-selective response in the fusiform face area. The human motion complex appears to have a central role in SFM object recognition, not merely representing the motion flowfield but also the surface structure of the motion-defined object. The motion complex and a region in the intraparietal sulcus reflected the motion state of the SFM-implicit object, responding more strongly when the implicit object was in motion than when it was stationary.

Shape perception reduces activity in human primary visual cortex

Visual perception involves the grouping of individual elements into coherent patterns that reduce the descriptive complexity of a visual scene. The physiological basis of this perceptual simplification remains poorly understood. We used functional MRI to measure activity in a higher object processing area, the lateral occipital complex, and in primary visual cortex in response to visual elements that were either grouped into objects or randomly arranged. We observed significant activity increases in the lateral occipital complex and concurrent reductions of activity in primary visual cortex when elements formed coherent shapes, suggesting that activity in early visual areas is reduced as a result of grouping processes performed in higher areas. These findings are consistent with predictive coding models of vision that postulate that inferences of high-level areas are subtracted from incoming sensory information in lower areas through cortical feedback.

Behavioral assessment of motion parallax and stereopsis as depth cues in rhesus monkeys

Although human psychophysical results show that motion parallax and stereopsis are both effective depth cues, it is not clear whether the same is true for non-human primates. As an initial step, we assessed the extent to which rhesus monkeys are capable of processing depth information based solely on motion parallax as compared with stereopsis. We constructed a unique display that enabled us to provide depth cues by either stereopsis or motion parallax or both. Our results show that monkeys can process depth information conveyed both by motion parallax and stereopsis. As in humans, motion parallax was somewhat less effective for depth discrimination than was stereopsis. These findings prepare efforts for assessing how motion parallax and stereopsis are co-processed in the visual system.

Three-dimensional shape representation in monkey cortex

Using fMRI in anesthetized monkeys, this study investigates how the primate visual system constructs representations of three-dimensional (3D) shape from a variety of cues. Computer-generated 3D objects defined by shading, random dots, texture elements, or silhouettes were presented either statically or dynamically (rotating). Results suggest that 3D shape representations are highly localized, although widely distributed, in occipital, temporal, parietal, and frontal cortices and may involve common brain regions regardless of shape cue. This distributed network of areas cuts across both "what" and "where" processing streams, reflecting multiple uses for 3D shape representation in perception, recognition, and action.

Object-selective responses in the human motion area MT/MST

The perception of moving objects and our successful interaction with them entail that the visual system integrates shape and motion information about objects. However, neuroimaging studies have implicated different human brain regions in the analysis of visual motion (medial temporal cortex; MT/MST) and shape (lateral occipital complex; LOC), consistent with traditional approaches in visual processing that attribute shape and motion processing to anatomically and functionally separable neural mechanisms. Here we demonstrate object-selective fMRI responses (higher responses for intact than for scrambled images of objects) in MT/MST, and especially in a ventral subregion of MT/MST, suggesting that human brain regions involved mainly in the processing of visual motion are also engaged in the analysis of object shape.

Functional magnetic resonance imaging of the visual system

Functional magnetic resonance imaging (fMRI), which is a technique useful for non-invasive mapping of brain function, is well suited for studying the visual system. This review highlights current clinical applications and research studies involving patients with visual deficits. Relevant reports regarding the investigation of the brain's role in visual processing and some newer fMRI techniques are also reviewed. Functional magnetic resonance imaging has been used for presurgical mapping of visual cortex in patients with brain lesions and for studying patients with amblyopia, optic neuritis, and residual vision in homonymous hemianopia. Retinotopic borders, motion processing, and visual attention have been the topics of several fMRI studies. These reports suggest that fMRI can be useful in clinical and research studies in patients with visual deficits.

The lateral occipital complex and its role in object recognition

Here we review recent findings that reveal the functional properties of extra-striate regions in the human visual cortex that are involved in the representation and perception of objects. We characterize both the invariant and non-invariant properties of these regions and we discuss the correlation between activation of these regions and recognition. Overall, these results indicate that the lateral occipital complex plays an important role in human object recognition.

Visual motion and the human brain: what has neuroimaging told us?

Recently, neuroimaging techniques have been applied to the study of human motion perception, complementing established techniques such as psychophysics, neurophysiology and neuropsychology. Because vision, particularly motion perception, has been studied relatively extensively, it provides an interesting case study to examine the contributions and limitations of neuroimaging to cognitive neuroscience. We suggest that in the domain of motion perception neuroimaging has: (1) revealed an extensive network of motion areas throughout the human brain, in addition to the well-studied motion complex (MT+); (2) verified and extended findings from other techniques; (3) suggested extensive top-down influences on motion perception; and (4) allowed experimenters to examine the neural correlates of awareness. We discuss these contributions, along with limitations and future directions for the neuroimaging of motion.

Imaging image processing in the human brain

Functional imaging in humans reveals the interplay of the many components of the human visual system: how they process the various types of information contained in the image to recover characteristics of the three-dimensional world surrounding us, but also how, in the course of this process, the retinal image is gradually integrated with non-retinal signals to provide information about the outside world in a format useful to other non-visual brain regions.