Extracting 3D from motion: differences in human and monkey intraparietal cortex

The posterior cingulate cortex and planum temporale/parietal operculum are activated by coherent visual motion

The posterior cingulate cortex (PCC) is involved in higher order sensory and sensory-motor integration while the planum temporale/parietal operculum (PT/PO) junction takes part in auditory motion and vestibular processing. Both regions are activated during different types of visual stimulation. Here, we describe the response characteristics of the PCC and PT/PO to basic types of visual motion stimuli of different complexity (complex and simple coherent as well as incoherent motion). Functional magnetic resonance imaging (fMRI) was performed in 10 healthy subjects at 3 Tesla, whereby different moving dot stimuli (vertical, horizontal, rotational, radial, and random) were contrasted against a static dot pattern. All motion stimuli activated a distributed cortical network, including previously described motion-sensitive striate and extrastriate visual areas. Bilateral activations in the dorsal region of the PCC (dPCC) were evoked using coherent motion stimuli, irrespective of motion direction (vertical, horizontal, rotational, radial) with increasing activity and with higher complexity of the stimulus. In contrast, the PT/PO responded equally well to all of the different coherent motion types. Incoherent (random) motion yielded significantly less activation both in the dPCC and in the PT/PO area. These results suggest that the dPCC and the PT/PO take part in the processing of basic types of visual motion. However, in dPCC a possible effect of attentional modulation resulting in the higher activity evoked by the complex stimuli should also be considered. Further studies are warranted to incorporate these regions into the current model of the cortical motion processing network.

The effect of overall stimulus velocity on motion parallax

This study examined the effectiveness with which motion parallax information can be utilized by rhesus monkeys for depth perception. A visual display comprised of random-dots that mimicked a rigid, three-dimensional object rocking back and forth was used. Differential depth was produced by presenting sub-regions of the dots moving at different velocities from the rest of dots in the display. The tasks for the monkeys were to detect or discriminate a target region that was protruding the furthest from the background plane. To understand the role of stimulus movement, we examined the accuracy and the rapidity of the saccadic responses as a function of rocking velocity of the entire three-dimensional object. The results showed that performance accuracy improved and reaction times decreased with increasing rocking velocities. The monkeys can process the motion parallax information with remarkable rapidity such that the average reaction time ranged between 212 and 246 milliseconds. The data collected suggest that the successive activation of just two sets of cones is sufficient to perform the task.

Responses to direction and transparent motion stimuli in area FST of the macaque

Motion transparency occurs when multiple object velocities are present within a local region of retinotopic space. Transparent signals can carry information useful in the segmentation of moving objects and in the extraction of three-dimensional structure from relative motion cues. However, the physiological substrate underlying the detection of motion transparency is poorly understood. Direction tuned neurons in area MT are suppressed by transparent stimuli, suggesting that other motion sensitive areas may be needed to represent this signal robustly. Recent neuroimaging evidence implicated two such areas in the macaque superior temporal sulcus. We studied one of these, FST, with electrophysiological methods and found that a large fraction of the neurons responded well to two opposite directions of motion and to transparent stimuli containing those same directions. A linear combination of MT-like responses qualitatively reproduces this behavior and predicts that FST neurons can be tuned for transparent motion containing specific direction and depth components. We suggest that FST plays a role in motion segmentation based on transparent signals.

Binding 3-D object perception in the human visual cortex

How do visual luminance, shape, motion, and depth bind together in the brain to represent the coherent percept of a 3-D object within hundreds of milliseconds (msec)? We provide evidence from simultaneous magnetoencephalographic (MEG) and electroencephalographic (EEG) data that perception of 3-D objects defined by luminance or motion elicits sequential activity in human visual cortices within 500 msec. Following activation of the primary visual cortex around 100 msec, 3-D objects elicited sequential activity with only little overlap (dynamic 3-D shapes: MT-LO-Temp; stationary 3-D shapes: LO-Temp). A delay of 80 msec, both in MEG/EEG responses and in reaction times (RTs), was found when additional motion information was processed. We also found significant positive correlations between RT, and MEG and EEG responses in the right temporal location. After about 400 msec, long-lasting activity was observed in the parietal cortex and concurrently in previously activated regions. Novel time-frequency analyses indicate that the activity in the lateral occipital (LO) complex is associated with an increase of induced power in the gamma band, a hallmark of binding. The close correspondence of an induced gamma response with concurrent sources located in the LO in both experimental conditions at different points in time ( approximately 200 msec for luminance and approximately 300 msec for dynamic cues) strongly suggests that the LO is the key region for the assembly of object features. The assembly is fed forward to achieve coherent perception of a 3-D object within 500 msec.

The temporal pattern of motion in depth perception derived from ERPs in humans

Former studies have demonstrated the cortical regions being involved in visual motion processing. The strength of neuronal activation was found to depend on the direction of motion. In particular the detection of optic flow towards the observer seems of particular importance due to its obvious biological relevance. We used event related potentials (ERPs) to add data of the temporal dynamics of this neuronal processing. Using current density reconstruction, source maxima of differential activation in motion in depth versus planar motion in the time range from 50 to 400 ms after stimulus onset were localized, and the time courses of activation were elaborated. Source reconstruction revealed six regions contributing significant source activity related to the perception of motion in depth: occipital pole, bilateral fusiform gyrus, right lateral superior occipital cortex and bilateral superior parietal cortex. Our data provide evidence for an early involvement of visual occipital cortex in the perception of motion in depth stimuli, followed by activation within parietal cortex, presumably associated with attention information processing. Sub-dividing the effects of the direction of the stimuli in motion in depth perception, optic flow directed towards the observer-induced stronger activation, but this differential activation excluded the parietal cortex. Thus the temporal deconvolution of the electrophysiological data suggests that the differential processing of approaching stimuli is initiated at an early stage of visual perception within the visual association area.

Organizational principles of human visual cortex revealed by receptor mapping

This receptorarchitectonic study of the human visual cortex investigated interareal differences in mean receptor concentrations and laminar distribution patterns of 16 neurotransmitter receptors in the dorsal and ventral parts of areas V1, V2, V3 as well as in adjoining areas V4 (ventrally) and V3A (dorsally). Both the functional hierarchy of these areas and a distinction between dorsal and ventral visual cortices were reflected by significant receptorarchitectonic differences. The observation that dorso-ventral differences existed in all extrastriate areas (including V2) is particularly important for the discussion about the relationship between dorsal and ventral V3 as it indicates that a receptorarchitectonic distinction between the ventral and dorsal visual cortices is present in but not specific to V3. This molecular specificity is mirrored by previously reported differences in retinal microstructure and functional differences as revealed in behavioral experiments demonstrating differential advantages for stimulus processing in the upper and lower visual fields. We argue that these anatomical and functional differences may be regarded as the result of an evolutionary optimization adapting to the processing of the most relevant stimuli occurring in the upper and lower visual fields.

Higher order visual processing in macaque extrastriate cortex

The extrastriate cortex of primates encompasses a substantial portion of the cerebral cortex and is devoted to the higher order processing of visual signals and their dispatch to other parts of the brain. A first step towards the understanding of the function of this cortical tissue is a description of the selectivities of the various neuronal populations for higher order aspects of the image. These selectivities present in the various extrastriate areas support many diverse representations of the scene before the subject. The list of the known selectivities includes that for pattern direction and speed gradients in middle temporal/V5 area; for heading in medial superior temporal visual area, dorsal part; for orientation of nonluminance contours in V2 and V4; for curved boundary fragments in V4 and shape parts in infero-temporal area (IT); and for curvature and orientation in depth from disparity in IT and CIP. The most common putative mechanism for generating such emergent selectivity is the pattern of excitatory and inhibitory linear inputs from the afferent area combined with nonlinear mechanisms in the afferent and receiving area.

The extraction of 3D shape from texture and shading in the human brain

We used functional magnetic resonance imaging to investigate the human cortical areas involved in processing 3-dimensional (3D) shape from texture (SfT) and shading. The stimuli included monocular images of randomly shaped 3D surfaces and a wide variety of 2-dimensional (2D) controls. The results of both passive and active experiments reveal that the extraction of 3D SfT involves the bilateral caudal inferior temporal gyrus (caudal ITG), lateral occipital sulcus (LOS) and several bilateral sites along the intraparietal sulcus. These areas are largely consistent with those involved in the processing of 3D shape from motion and stereo. The experiments also demonstrate, however, that the analysis of 3D shape from shading is primarily restricted to the caudal ITG areas. Additional results from psychophysical experiments reveal that this difference in neuronal substrate cannot be explained by a difference in strength between the 2 cues. These results underscore the importance of the posterior part of the lateral occipital complex for the extraction of visual 3D shape information from all depth cues, and they suggest strongly that the importance of shading is diminished relative to other cues for the analysis of 3D shape in parietal regions.

A stable topography of selectivity for unfamiliar shape classes in monkey inferior temporal cortex

The inferior temporal (IT) cortex in monkeys plays a central role in visual object recognition and learning. Previous studies have observed patches in IT cortex with strong selectivity for highly familiar object classes (e.g., faces), but the principles behind this functional organization are largely unknown due to the many properties that distinguish different object classes. To unconfound shape from meaning and memory, we scanned monkeys with functional magnetic resonance imaging while they viewed classes of initially novel objects. Our data revealed a topography of selectivity for these novel object classes across IT cortex. We found that this selectivity topography was highly reproducible and remarkably stable across a 3-month interval during which monkeys were extensively trained to discriminate among exemplars within one of the object classes. Furthermore, this selectivity topography was largely unaffected by changes in behavioral task and object retinal position, both of which preserve shape. In contrast, it was strongly influenced by changes in object shape. The topography was partially related to, but not explained by, the previously described pattern of face selectivity. Together, these results suggest that IT cortex contains a large-scale map of shape that is largely independent of meaning, familiarity, and behavioral task.

In praise of tedious anatomy

Functional neuroimaging is fundamentally a tool for mapping function to structure, and its success consequently requires neuroanatomical precision and accuracy. Here we review the various means by which functional activation can be localised to neuroanatomy and suggest that the gold standard should be localisation to the individual's or group's own anatomy through the use of neuroanatomical knowledge and atlases of neuroanatomy. While automated means of localisation may be useful, they cannot provide the necessary accuracy, given variability between individuals. We also suggest that the field of functional neuroimaging needs to converge on a common set of methods for reporting functional localisation including a common "standard" space and criteria for what constitutes sufficient evidence to report activation in terms of Brodmann's areas.

Anterior regions of monkey parietal cortex process visual 3D shape

The intraparietal cortex is involved in the control of visually guided actions, like reach-to-grasp movements, which require extracting the 3D shape and position of objects from 2D retinal images. Using fMRI in behaving monkeys, we investigated the role of the intraparietal cortex in processing stereoscopic information for recovering the depth structure and the position in depth of objects. We found that while several areas (CIP, LIP, and AIP on the lateral bank; PIP and MIP on the medial bank) are activated by stereoscopic stimuli, AIP and an adjoining portion of LIP are sensitive only to depth structure. Furthermore, only these two regions are sensitive to both the depth structure and the 2D shape of small objects. These results indicate that extracting 3D spatial information from stereo involves several intraparietal areas, among which AIP and anterior LIP are more specifically engaged in extracting the 3D shape of objects.

High-resolution maps of real and illusory tactile activation in primary somatosensory cortex in individual monkeys with functional magnetic resonance imaging and optical imaging

Although blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) has been widely used to explore human brain function, questions remain regarding the ultimate spatial resolution of positive BOLD fMRI, and indeed the extent to which functional maps revealed by positive BOLD correlate spatially with maps obtained with other high-spatial-resolution mapping techniques commonly used in animals, such as optical imaging of intrinsic signal (OIS) and single-unit electrophysiology. Here, we demonstrate that the positive BOLD signal at 9.4T can reveal the fine topography of individual fingerpads in single-condition activation maps in nonhuman primates. These digit maps are similar to maps obtained from the same animal using intrinsic optical imaging. Furthermore, BOLD fMRI reliably resolved submillimeter spatial shifts in activation in area 3b previously identified with OIS (Chen et al., 2003) as neural correlates of the "funneling illusion." These data demonstrate that at high field, high-spatial-resolution topographic maps can be achieved using the positive BOLD signal, weakening previous notions regarding the spatial specificity of the positive BOLD signal.

The Science of Sex Differences in Science and Mathematics

Amid ongoing public speculation about the reasons for sex differences in careers in science and mathematics, we present a consensus statement that is based on the best available scientific evidence. Sex differences in science and math achievement and ability are smaller for the mid-range of the abilities distribution than they are for those with the highest levels of achievement and ability. Males are more variable on most measures of quantitative and visuospatial ability, which necessarily results in more males at both high- and low-ability extremes; the reasons why males are often more variable remain elusive. Successful careers in math and science require many types of cognitive abilities. Females tend to excel in verbal abilities, with large differences between females and males found when assessments include writing samples. High-level achievement in science and math requires the ability to communicate effectively and comprehend abstract ideas, so the female advantage in writing should be helpful in all academic domains. Males outperform females on most measures of visuospatial abilities, which have been implicated as contributing to sex differences on standardized exams in mathematics and science. An evolutionary account of sex differences in mathematics and science supports the conclusion that, although sex differences in math and science performance have not directly evolved, they could be indirectly related to differences in interests and specific brain and cognitive systems. We review the brain basis for sex differences in science and mathematics, describe consistent effects, and identify numerous possible correlates. Experience alters brain structures and functioning, so causal statements about brain differences and success in math and science are circular. A wide range of sociocultural forces contribute to sex differences in mathematics and science achievement and ability-including the effects of family, neighborhood, peer, and school influences; training and experience; and cultural practices. We conclude that early experience, biological factors, educational policy, and cultural context affect the number of women and men who pursue advanced study in science and math and that these effects add and interact in complex ways. There are no single or simple answers to the complex questions about sex differences in science and mathematics.

fMRI bold signal analysis using a novel nonparametric statistical method

We present in this article a novel analytical method that enables the application of nonparametric rank-order statistics to fMRI data analysis, since it takes the omnipresent serial correlations (temporal autocorrelations) properly into account. Comparative simulations, using the common General Linear Model and the permutation test, confirm the validity and usefulness of our approach. Our simulations, which are performed with both synthetic and real fMRI data, show that our method requires significantly less computation time than permutation-based methods, while offering the same order of robustness and returning more information about the evoked response when combined with/compared to the results obtained with the common General Lineal Model approach.

Exploring the neural basis of cognition: multi-modal links between human fMRI and macaque neurophysiology

Although functional magnetic resonance imaging (fMRI) with sophisticated behavioral paradigms has enabled the investigation of increasingly higher-level cognitive functions in humans, these studies seem to lose touch with neurophysiological studies in macaque monkeys. The application of fMRI and other MRI-based techniques to macaque brains allows studies in the two species to be linked. fMRI in human and macaque subjects using equivalent cognitive tasks enables direct comparisons of the functional brain architecture, even for high-level cognitive functions. Combinations of functional or structural MRI and microelectrode techniques provide ways to explore functional brain networks at multiple spatiotemporal scales. These approaches would illuminate the neurophysiological underpinnings of human cognitive functions by integrating human functional neuroimaging with macaque single-unit recordings.

Contour discontinuities subserve two types of form analysis that underlie motion processing

Form analysis subserves motion processing in at least two ways: first, in terms of figural segmentation dedicated to solving the problem of figure-to-figure matching over time, and second, in terms of defining trackable features whose unambiguous motion signals can be generalized to ambiguously moving portions of an object. The former is a primarily ventral process involving the lateral occipital complex and also retinotopic areas such as V2 and V4, and the latter is a dorsal process involving V3A. Contour discontinuities, such as corners, deep concavities, maxima of positive curvature, junctions, and terminators, play a central role in both types of form analysis. Transformational apparent motion will be discussed in the context of figural segmentation and matching, and rotational motion in the context of trackable features. In both cases the analysis of form must proceed in parallel with the analysis of motion, in order to constrain the ongoing analysis of motion.

An evolutionary perspective on learning disability in mathematics

A distinction between potentially evolved, or biologically-primary forms of cognition, and the culturally-specific, or biologically-secondary forms of cognition that are built from primary systems is used to explore mathematical learning disability (MLD). Using this model, MLD could result from deficits in the brain and cognitive systems that support biologically-primary mathematical competencies, or from the brain and cognitive systems that support the modification of primary systems for the creation of secondary knowledge and secondary cognitive competencies. The former include visuospatial long-term and working memory and the intraparietal sulcus, whereas the latter include the central executive component of working memory and the anterior cingulate cortex and lateral prefrontal cortex. Different forms of MLD are discussed as related to each of the cognitive and brain systems.

Neural correlates of disparity-defined shape discrimination in the human brain

Binocular disparity, the slight differences between the images registered by our two eyes, provides an important cue when estimating the three-dimensional (3D) structure of the complex environment we inhabit. Sensitivity to binocular disparity is evident at multiple levels of the visual hierarchy in the primate brain, from early visual cortex to parietal and temporal areas. However, the relationship between activity in these areas and key perceptual functions that exploit disparity information for 3D shape perception remains an important open question. Here we investigate the link between human cortical activity and the perception of disparity-defined shape, measuring fMRI responses concurrently with psychophysical shape judgments. We parametrically degraded the coherence of shapes by shuffling the spatial position of dots whose disparity defined the 3D structure and investigated the effect of this stimulus manipulation on both cortical activity and shape discrimination. We report significant relationships between shape coherence and fMRI response in both dorsal (V3, hMT+/V5) and ventral (LOC) visual areas that correspond to the observers' discrimination performance. In contrast to previous suggestions of a dichotomy of disparity-related processes in the ventral and dorsal streams, these findings are consistent with proposed interactions between these pathways that may mediate a continuum of processes important in perceiving 3D shape from coarse contour segmentation to fine curvature estimation.

B(0) homogeneity throughout the monkey brain is strongly improved in the sphinx position as compared to the supine position

PURPOSE

To map B(0) distortions throughout the monkey brain in the two positions commonly used for NMR studies (the prone sphinx position and the supine position) in order to test the hypothesis that B(0) homogeneity in the sphinx position is significantly improved as compared to the supine position.

MATERIALS AND METHODS

Three macaque monkeys were installed in the two positions in a 3T whole-body MR system without shim correction. B(0) maps were acquired using a 3D gradient double-echo sequence, and field dispersion throughout the brain was quantified. In addition, field maps and localized (1)H spectra were acquired after first-order shimming was performed.

RESULTS

The field maps collected in the three animals were highly reproducible. B(0) dispersion throughout the brain was typically two to three times greater in the supine position than in the sphinx position. Although first-order shimming proved relatively more efficient in the supine position, B(0) dispersion still remained greater in the supine than in the sphinx position. These findings can be explained by the thickness of outer brain tissues.

CONCLUSION

This work demonstrates that the sphinx position is highly favorable in terms of B(0) homogeneity. It should prove useful for NMR exploration of the monkey brain, particularly at high fields where B(0) inhomogeneity associated with susceptibility artifacts is increased.

Extracting 3D structure from disparity

The neural mechanisms of stereoscopic 3D shape perception have only recently been investigated. Here we review the two cortical regions in which these mechanisms have been studied so far in macaques: a small subpart of inferotemporal cortex called TEs, and the caudal intraparietal (CIP) region. Neurons in TEs respond selectively to the orientation and curvature in depth of stereoscopic surfaces and this region provides a detailed 3D shape description of surface boundaries and surface content. This description is evoked only by binocular stimuli in which subjects see depth and it does not vary if depth is specified by different cues. Neurons in CIP are a selective for orientation in depth of surfaces and elongated objects, and their responses are also unaffected by changes in depth cues. Thus, stereoscopic 3D shape is processed in both the dorsal, occipito-parietal and the ventral, occipito-temporal streams.

V3A processes contour curvature as a trackable feature for the perception of rotational motion

Contour curvature (CC) is a vital cue for the analysis of both form and motion. Using functional magnetic resonance imaging, we localized the neural correlates of CC for the processing and perception of rotational motion. We found that the blood oxygen level-dependent signal in retinotopic area V3A and possibly also lateral occipital cortex (LOC) varied parametrically with the degree of CC. Control experiments ruled out the possibility that these modulations resulted from either changes in the area of the stimuli, the velocity with which contour elements were actually translating, or perceived angular velocity. We conclude that neurons within V3A and perhaps also LOC process continuously moving CC as a trackable feature. These data are consistent with the hypothesis that V3A contains neural populations that process trackable form features such as CC, not to solve the "ventral problem" of determining object shape but in order to solve the "dorsal problem" of what is going where.

Temporal pattern of source activities evoked by different types of motion onset stimuli

The aim of this study was to compare the time course of motion-related source activities evoked by the onset of different kinds of visual motion stimuli in human subjects. Event-related potentials (ERP) were recorded from 64 scalp electrodes in ten healthy subjects while they were viewing four different types of motion stimuli (translation, rotation, expansion and contraction). Following a new approach combining a current density reconstruction with clustering algorithms, source maxima in the time range from 50 to 400 ms after the onset of the visual stimulus were localized and the time courses of activation were elaborated. Six regions contributed significantly to source activity, half originating in the occipital lobe and half in the right parietal and right temporal cortex. The comparison of their time courses led to the following conclusions: (i) the different kinds of motion stimuli activated about the same areas of the brain but with different temporal patterns. (ii) Mainly parietal and extrastriate areas, but not V1/V2, were significantly involved in the differentiation of different kinds of motion. (iii) Contrasting the different kinds of motion onsets, responses from parietal areas were found mainly before those from lateral occipital areas. (iv) The classically defined N2 and P2 components were significantly different among the four motion conditions, but not P1. The N2 motion-related component was elicited not only by lateral occipital areas and middle temporal areas but also by right parietal areas. (v) The rotation condition evoked a novel component P180, concomitant with an increased activity in the left middle temporal gyrus.

Charting the lower superior temporal region, a new motion-sensitive region in monkey superior temporal sulcus

Although the role of the middle temporal (MT/V5) area and its medial superior temporal (MST) satellites in motion processing has been well explored, relatively little is known about motion regions located more rostrally in the superior temporal sulcus (STS), such as the fundus of the superior temporal (FST) area, the superior temporal polysensory (STP) region, or beyond. To fill this void, we used contrast-enhanced functional magnetic resonance imaging in awake macaques and a five-step testing procedure that allowed us to identify six motion-sensitive regions within the STS. Direction adaptation tests confirmed the motion sensitivity of these six regions. Five of them [MT/V5, its three satellites, and the middle part of the STP (STPm) region in the upper bank of the STS] have been documented by previous single-cell studies. A sixth, previously unknown motion-responsive region, which we termed the lower superior temporal (LST) region, was observed on the lower bank and fundus of the STS, 6-8 mm anterior to the FST area. In contrast to the MST areas, the LST region responds to slow as well as fast speeds and is responsive to static and moving images of objects, to patterns defined by opponent motion, and to actions. These results, obtained in both group and single-subject analyses, suggest that motion information in the STS might follow a second path, in addition to the MT/V5-MST path. This ventral path including the LST region, FST area, and STPm region is likely involved in the visual analysis of actions and biological motion.

Separate processing of different global-motion structures in visual cortex is revealed by FMRI

The visual system has the remarkable ability to extract several types of meaningful global-motion signals, such as radial motion, translation motion, and rotation, for different visual functions and actions. In the monkey brain, different groups of cells in MST respond best to different types of global motion [1, 2] whereas in lower cortical areas including MT, no such differential responses have been found. Here, we show that an area (or areas) lower than MST in the human brain [3] responds to different types of global motion. A series of human functional magnetic resonance imaging (fMRI) experiments, in which attention was controlled for, indicated that the center of radial motion activates the corresponding location in the V3A representation, whereas translation motion activates mainly in a more peripheral representation of V3A. These results suggest that in the human brain, V3A is an area that differentially responds according to the type of global motion.

Knowledge of visual attributes in the right hemisphere

Neurobiological theories of knowledge processing are biased toward the language-dominant (usually the left) hemisphere. Does the right hemisphere critically contribute to knowledge processing? J.A. is a left-hemisphere language-dominant individual who suffered a lesion confined to the right mid- and anterior fusiform gyrus. Although her language abilities are intact, she showed a partial loss of knowledge of the visual attributes of biological and nonbiological entities. This was observed regardless of the task performed: object discrimination, oral feature generation, forced-choice naming-to-definition or free-hand drawing. Functional-associative and nonvisual sensory attributes were spared. The same region that was lesioned in J.A. was activated in a functional magnetic resonance imaging study in 27 volunteers who retrieved semantic associations between concepts, but only if the concepts were represented as pictures and not as words. Therefore, right fusiform gyrus critically contributes to the conscious recollection of visual attributes of familiar entities.

fMRI in alert, behaving monkeys: an adaptation of the human infant familiarization novelty preference procedure

Functional magnetic resonance imaging (fMRI) is increasingly used in non-human primate research. In the present study, we adapt the familiarization-novelty preference (FNP) procedure used in human infant research to examine visual behavior in alert, unanaesthetized rhesus monkeys that were acclimated to the fMRI environment, but did not undergo behavioral training. In keeping with the typical FNP paradigm, we recorded eye movements (looking time and number of fixations) while monkeys viewed a series of four identical pictures (familiarization phase) followed by two different pictures (novelty phase). Number of fixations and looking time both increased during the novelty phase, thereby demonstrating visual discrimination of the new from the old picture. Importantly, discrimination did not occur on catch trials in which six identical pictures were presented. Moreover, brain activation in the amygdala was more strongly associated with the novelty phase than with the familiarization phase. In addition, magnitude of brain activation in the amygdala was correlated with the behavioral effect of visual discrimination. These findings demonstrate the feasibility of using eye movements as an index of visual discrimination in untrained monkeys during fMRI scanning. This methodological approach helps to extend the repertoire of research tools for fMRI in non-human primates.

Active heading control in simulated flight based on vertically extended contours

In two experiments, we manipulated the properties of 3-D objects and terrain texture in order to investigate their effects on active heading control during simulated flight. Simulated crosswinds were used to introduce a rotational component into the retinal flow field that presumably provided the visual cues used for heading control An active control task was used so that the results could be generalized to real-world applications such as flight simulation. In Experiment 1, we examined the effects of three types of terrain, each of which was presented with and without 3-D objects (trees), and found that the presence of 3-D objects was more important than terrain texture for precise heading control In Experiment 2, we investigated the effects of varying the height and density of 3-D objects and found that increasing 3-D object density improved heading control, but that 3-D object height had only a small effect. On the basis of these results, we conclude that the vertical contours improved active heading control by enhancing the motion parallax information contained in the retinal flow.

Using functional magnetic resonance imaging to assess adaptation and size invariance of shape processing by humans and monkeys

Functional magnetic resonance imaging in awake monkeys and humans was used to compare object adaptation in shape-sensitive regions of these two species under identical and different size conditions. Object adaptation was similar in humans and monkeys under both conditions. Neither species showed complete size invariance, in agreement with single-cell studies. Both the macaque inferotemporal (IT) complex and human lateral occipital complex (LOC) displayed an anteroposterior gradient in object adaptation and size invariance, with the more anterior regions being more adaptable and size invariant. The results provide additional evidence for the homology between the macaque IT cortex and human LOC but also add to the growing list of differences between human and monkey intraparietal sulcus regions.

Specific retinotopically based magnocellular impairment in a patient with medial visual dorsal stream damage

We report here retinotopically based magnocellular deficits in a patient with a unilateral parieto-occipital lesion. We applied convergent methodologies to study his dorsal stream processing, using psychophysics as well as structural and functional imaging. Using standard perimetry we found deficits involving the periphery of the left inferior quadrant abutting the horizontal meridian, suggesting damage of dorsal retinotopic representations beyond V1. Retinotopic damage was much more extensive when probed with frequency-doubling based contrast sensitivity measurements, which isolate processing within the magnocellular pathway: sensitivity losses now encroached on the visual central representation and did not respect the horizontal meridian, suggesting further damage to dorsal stream retinotopic areas that contain full hemi-field representations, such as human V3A or V6. Functional imaging revealed normal responses of human MT+ to motion contrast. Taken together, these findings are consistent with a recent proposal of two distinct magnocellular dorsal stream pathways: a latero-dorsal pathway passing to MT+ and concerned with the processing of coherent motion, and a medio-dorsal pathway that routes information from V3A to the human homologue of V6. Anatomical evidence was consistent with sparing of the latero-dorsal pathway in our patient, and was corroborated by his normal performance in speed, direction discrimination and motion coherence tasks with 2D and 3D objects. His pattern of dysfunction suggests damage only to the medio-dorsal pathway, an inference that is consistent with structural imaging data, which revealed a lesion encompassing the right parieto-occipital sulcus.

Mapping the parietal cortex of human and non-human primates

The present essay reviews a series of functional magnetic resonance imaging (fMRI) studies conducted in parallel in humans and awake monkeys, concentrating on the intraparietal sulcus (IPS). MR responses to a range of visual stimuli indicate that the human IPS contains more functional regions along its anterior-posterior extent than are known in the monkey. Human IPS includes four motion sensitive regions, ventral IPS (VIPS), parieto-occipital IPS (POIPS), dorsal IPS medial (DIPSM) and dorsal IPS anterior (DIPSA), which are also sensitive to three-dimensional structure from motion (3D SFM). On the other hand, the monkey IPS contains only one motion sensitive area (VIP), which is not particularly sensitive to 3D SFM. The human IPS includes four regions sensitive to two-dimensional shape and three representations of central vision, while monkey IPS appears to contain only two shape sensitive regions and one central representation. These data support the hypothesis that monkey LIP corresponds to the region of human IPS between DIPSM and POIPS and that a portion of the anterior part of human IPS is evolutionarily new. This additional cortical tissue may provide the capacity for an enhanced visual analysis of moving images necessary for sophisticated control of manipulation and tool handling.

The functional organization of the intraparietal sulcus in humans and monkeys

In macaque monkeys, the posterior parietal cortex (PPC) is concerned with the integration of multimodal information for constructing a spatial representation of the external world (in relation to the macaque's body or parts thereof), and planning and executing object-centred movements. The areas within the intraparietal sulcus (IPS), in particular, serve as interfaces between the perceptive and motor systems for controlling arm and eye movements in space. We review here the latest evidence for the existence of the IPS areas AIP (anterior intraparietal area), VIP (ventral intraparietal area), MIP (medial intraparietal area), LIP (lateral intraparietal area) and CIP (caudal intraparietal area) in macaques, and discuss putative human equivalents as assessed with functional magnetic resonance imaging. The data suggest that anterior parts of the IPS comprising areas AIP and VIP are relatively well preserved across species. By contrast, posterior areas such as area LIP and CIP have been found more medially in humans, possibly reflecting differences in the evolution of the dorsal visual stream and the inferior parietal lobule. Despite interspecies differences in the precise functional anatomy of the IPS areas, the functional relevance of this sulcus for visuomotor tasks comprising target selections for arm and eye movements, object manipulation and visuospatial attention is similar in humans and macaques, as is also suggested by studies of neurological deficits (apraxia, neglect, Bálint's syndrome) resulting from lesions to this region.

Neuronal mechanisms for illusory brightness perception in humans

Biological visual systems are extraordinarily capable of recovering the shape and brightness of objects from sparse and fragmentary information. Using functional magnetic imaging, we show that two associative areas of the dorsal pathway--in the caudal region of the intrapariatal sulcus and in the lateral occipital sulcus--respond specifically to the Craik-O'Brien-Cornsweet illusion generated by high-pass filtered edges. Other visual areas, including primary visual cortex, also respond strongly to the retinotopic location of the edge, but these areas respond equally well to a line of matched contrast and detectability, rather than specifically to the brightness illusion. The reconstruction of surface and/or its brightness seems to be achieved by associative areas from the information about visual features provided by the primary visual cortices, even where there is no physical difference in luminance.

Visual magnocellular and structure from motion perceptual deficits in a neurodevelopmental model of dorsal stream function

Williams syndrome (WS) is a neurodevelopmental disorder of genetic origin that has been used as a model to understand visual cognition. We have investigated early deficits in the afferent magnocellular pathway and their relation to abnormal visual dorsal processing in WS. A spatiotemporal contrast sensitivity task that is known to selectively activate that pathway was used in six WS subjects. Additionally, we have compared visual performance in 2D and 3D motion integration tasks. A novel 3D motion coherence task (using spheres with unpredictable axis of rotation) was used in order to investigate possible impairment of occipitoparietal areas that are known to be involved in 3D structure from motion (SFM) perception. We have found a significant involvement of low-level magnocellular maps in WS as assessed by the contrast sensitivity task. On the contrary, no significant differences were observed between WS and the control groups in the 2D motion integration tasks. However, all WS subjects were significantly impaired in the 3D SFM task. Our findings suggest that magnocellular damage may occur in addition to dorsal stream deficits in these patients. They are also consistent with recently described genetic and neuroanatomic abnormalities in retinotopic visual areas. Finally, selective SFM coherence deficits support the proposal that there is a specific pathway in the dorsal stream that is involved in motion processing of 3D surfaces, which seems to be impaired in this disorder.

Specificity of regions processing biological motion

Using functional magnetic resonance imaging and point light displays portraying six different human actions, we were able to show that several visual cortical regions, including human MT/V5 complex, posterior inferior temporal gyrus and superior temporal sulcus, are differentially active in the subtraction comparing biological motion to scrambled motion. Comparison of biological motion to three-dimensional rotation (of a human figure), articulated motion and translation suggests that human superior temporal sulcus activity reflects the action portrayed in the biological motion stimuli, whereas posterior inferior temporal gyrus responds to the figure and hMT/V5+ to the complex motion pattern present in biological motion stimuli. These results were confirmed with implied action stimuli.

Interactions between number and space in parietal cortex

Since the time of Pythagoras, numerical and spatial representations have been inextricably linked. We suggest that the relationship between the two is deeply rooted in the brain's organization for these capacities. Many behavioural and patient studies have shown that numerical-spatial interactions run far deeper than simply cultural constructions, and, instead, influence behaviour at several levels. By combining two previously independent lines of research, neuroimaging studies of numerical cognition in humans, and physiological studies of spatial cognition in monkeys, we propose that these numerical-spatial interactions arise from common parietal circuits for attention to external space and internal representations of numbers.

Distribution of Activity Across the Monkey Cerebral Cortical Surface, Thalamus and Midbrain during Rapid, Visually Guided Saccades

To examine the distribution of visual and oculomotor activity across the macaque brain, we performed functional magnetic resonance imaging (fMRI) on awake, behaving monkeys trained to perform visually guided saccades. Two subjects alternated between periods of making saccades and central fixations while blood oxygen level dependent (BOLD) images were collected [3 T, (1.5 mm)3 spatial resolution]. BOLD activations from each of four cerebral hemispheres were projected onto the subjects' cortical surfaces and aligned to a surface-based atlas for comparison across hemispheres and subjects. This surface-based analysis revealed patterns of visuo-oculomotor activity across much of the cerebral cortex, including activations in the posterior parietal cortex, superior temporal cortex and frontal lobe. For each cortical domain, we show the anatomical position and extent of visuo-oculomotor activity, including evidence that the dorsolateral frontal activation, which includes the frontal eye field (on the anterior bank of the arcuate sulcus), extends anteriorly into posterior principal sulcus (area 46) and posteriorly into part of dorsal premotor cortex (area 6). Our results also suggest that subcortical BOLD activity in the pulvinar thalamus may be lateralized during voluntary eye movements. These findings provide new neuroanatomical information as to the complex neural substrates that underlie even simple goal-directed behaviors.

Functional-anatomic correlates of memory retrieval that suggest nontraditional processing roles for multiple distinct regions within posterior parietal cortex

Current theories of posterior parietal cortex (PPC) function emphasize space-based attention and motor intention. Imaging studies of long-term memory have demonstrated PPC activation during successful memory retrieval. Here, we explored the relationship between memory processes and classical notions of PPC function. Study 1 investigated old-new recognition using picture and sound stimuli to test whether PPC memory effects were dependent on visuospatial attention. A region lateral to the intraparietal sulcus [inferior parietal lobule complex (IPLC)] and two regions in the medial PPC [precuneus complex (PCC) and posterior cingulate/retrosplenial cortex (pC/Rsp)] showed strong retrieval success effects for both picture and sound stimuli. Study 2 explored a recognition task with varied response contingencies to investigate whether these retrieval success effects are dependent on motor intentions. In one condition, subjects responded to both old and new items. In two other conditions, subjects responded only to old or only to new items. IPLC, PCC, and pC/Rsp continued to show retrieval success effects with similar magnitudes for all response contingencies, including a condition in which no responses were made to old items. In a third study, IPLC and PCC activity was modulated at retrieval based on levels of processing at study, suggesting sensitivity to memory demands. These studies demonstrate that retrieval success effects in lateral and medial PPC regions are not affected by manipulations predicted by classical theories of PPC function but can be modulated by memory-related manipulations. PPC regions thus have prominent response properties associated with memory, which may arise through interactions with medial temporal cortex.

Evolution of somatosensory and motor cortex in primates

Inferences about how the complex somatosensory systems of anthropoid primates evolved are based on comparative studies of such systems in extant mammals. Experimental studies of members of the major clades of extant mammals suggest that somatosensory cortex of early mammals consisted of only a few areas, including a primary area, S1, bordered by strip-like rostral and caudal somatosensory fields, SR and SC. In addition, the second somatosensory area, S2, and the parietal ventral area, PV, were probably present. S1, S2, and PV were activated independently via parallel projections from the ventroposterior nucleus, VP. Little posterior parietal cortex existed, and it was unlikely that a separate primary motor area, M1, existed until placental mammals evolved. Early primates retained this basic organization and also had a larger posterior parietal region that mediated sensorimotor functions via connections with motor and premotor areas. The frontal cortex included M1, dorsal and ventral premotor areas, supplementary motor area, and cingulate motor fields. Ventroposterior superior and ventroposterior inferior nuclei were distinct from the ventroposterior nucleus in the thalamus. In early anthropoid primates, areas S1, SR, and SC had differentiated into the fields now recognized as areas 3b, 3a, and 1. Areas 3b and 1 contained parallel mirror-image representations of cutaneous receptors and a parallel representation in area 2 was probable. Serial processing became dominant, so that neurons in areas 1, S2, and PV became dependent on area 3b for activation. Posterior parietal cortex expanded into more areas that related to frontal cortex. Less is known about changes that might have occurred with the emergence of apes and humans, but their brains were larger and posed scaling problems most likely solved by increasing the number of cortical areas and reducing the proportion of long connections.

Visual activation in prefrontal cortex is stronger in monkeys than in humans

The prefrontal cortex supports many cognitive abilities, which humans share to some degree with monkeys. The specialized functions of the prefrontal cortex depend both on the nature of its inputs from other brain regions and on distinctive aspects of local processing. We used functional MRI to compare prefrontal activity between monkey and human subjects when they viewed identical images of objects, either intact or scrambled. Visual object-related activation of the lateral prefrontal cortex was observed in both species, but was stronger in monkeys than in humans, both in magnitude (factors 2-3) and in spatial extent (fivefold or more as a percentage of prefrontal volume). This difference was observed for two different stimulus sets, at two field strengths, and over a range of tasks. These results suggest that there may be more volitional control over visual processing in humans than in monkeys.

Three-dimensional structure-from-motion selectivity in the anterior superior temporal polysensory area, STPa, of the behaving monkey

Human and non-human primates are able to perceive three-dimensional structure from motion displays. Three-dimensional structure-from-motion (object-motion) displays were used to test the hypothesis that neurons in the anterior division of the superior temporal polysensory area (STPa) of monkeys can selectively respond to three-dimensional structure-from-motion. Monkeys performed a reaction time task that required the detection of a change in the fraction of structure in three-dimensional transparent sphere displays. Neurons were able to distinguish structured and unstructured three-dimensional optic flow. These cells could differentiate the change in structure-from-motion at stimulus presentation and when the animal was detecting the amount of structure in the display. Some of these neurons were also tuned for characteristics of the sphere stimuli. Cells were also tested with navigational motion and many were found to respond both to three-dimensional structure-from-motion and navigational motion. These results suggest that STPa neurons represent specific aspects of three-dimensional surface structure and that neurons within STPa contribute to the perception of three-dimensional structure-from-motion.

Comparative mapping of higher visual areas in monkeys and humans

The advent of functional magnetic resonance imaging (fMRI) in non-human primates has facilitated comparison of the neurobiology of cognitive functions in humans and macaque monkeys, the most intensively studied animal model for higher brain functions. Most of these comparative studies have been performed in the visual system. The early visual areas V1, V2 and V3, as well as the motion area MT are conserved in humans. Beyond these areas, differences between human and monkey functional organization are increasingly evident. At the regional level, the monkey inferotemporal and intraparietal complexes appear to be conserved in humans, but there are profound functional differences in the intraparietal cortex suggesting that not all its constituent areas are homologous. In the long term, fMRI offers opportunities to compare the functional anatomy of a variety of cognitive functions in the two species.

Activation in the MT-complex during visual perception of apparent motion and temporal succession

Previous studies have shown that MT (i.e., the MT-complex) is activated during visual perception of apparent motion. To further explore the function of MT, we measured activation in MT by positron emission tomography (PET) using a broad range of stroboscopic stimulus events in which (a) the frame rate was so fast that observers perceived stimulus frames as simultaneous, (b) the frame rate was slower and generated compelling impressions of apparent motion, or (c) the frame rate was so slow that observers perceived temporal succession (successive views of the same objects at different locations) instead of motion. As expected, the simultaneity condition showed no activation (reliable increase in regional cerebral blood flow, rCBF) in MT whereas the motion condition showed activation in both left and right MT. However, the succession condition showed even stronger activation in left and right MT than did the motion condition. MT seems implicated in perception of retinal stimuli as successive views of the same object at different locations whether or not the views are connected by apparent motion.

Neurochemical organization of chimpanzee inferior pulvinar complex

The pulvinar of primates, which connects with all visual areas, has been implicated in visual attention and in control of eye movements. Recently, five separate neurochemical subdivisions of a region termed the inferior pulvinar complex have been identified in monkeys (Gray et al. [1999] J Comp Neurol 409:452-468; Gutierrez et al. [1995] J Comp Neurol 363:545-562), and comparable subdivisions have been mapped in humans (Cola et al. [1999] NeuroReport 10:3733-3738). In the present study, we investigated the inferior pulvinar of the chimpanzee (Pan troglodytes), the closest evolutionary relative of humans, using cytochrome oxidase (CO) and acetylcholinesterase (AChE) histochemistry, and immunocytochemistry for calbindin. Each staining method demarcated five histochemical zones corresponding, from medial to lateral, to the posterior (PI(P)), medial (PI(M)), central PI(C)), lateral (PI(L)), and the lateral-shell (PI(L-S)) divisions in monkeys. The PI(P) division stained darkly for calbindin and lightly for CO and AChE. The PI(M) division was characterized by less neuropil staining for calbindin, and by distinct, intensely stained patches of CO and AChE. PI(C) appeared lighter than adjacent divisions with CO and AChE histochemistry and was moderately stained with calbindin. PI(L) was moderately to darkly stained with each method and was adjoined by a lighter staining shell, PI(L-S). Thus, in the aspects of organization we examined, the inferior pulvinar of chimpanzees closely resembles that of humans and monkeys. This investigation provides a foundation for more detailed studies of the thalamic relationships of extrastriate cortex in apes and humans.

The primary visual cortex fills in color

One of the most important goals of visual processing is to reconstruct adequate representations of surfaces in a scene. It is thought that surface representation is produced mainly in the midlevel vision and that area V1 (the primary visual cortex) activity is solely due to feedback from the midlevel stage. Here, we measured functional MRI signals corresponding to "neon color spreading": an illusory transparent surface with long-range color filling-in, one of the important mediums in reconstructing a surface. The experiment was conducted with careful controls of attention, which can send feedback signals from higher visual areas. Activity for filling-in was observed only in V1, whereas activity for illusory contours was observed in multiple visual areas. These results indicate that surface representation is produced by multiple rather than single processing.

Methods for functional magnetic resonance imaging in normal and lesioned behaving monkeys

Methods for performing functional magnetic resonance imaging (fMRI) studies in behaving and lesioned monkeys using a human MR scanner are reported. Materials for head implant surgery were selected based on tests for magnetic susceptibility. A primate chair with a rigid head fixation system and a mock scanner environment for training were developed. To perform controlled visual studies, monkeys were trained to maintain fixation for several minutes using a novel training technique that utilized continuous juice rewards. A surface coil was used to acquire anatomical and functional images in four monkeys, one with a partial lesion of striate cortex. High-resolution anatomical images were used after non-uniform intensity correction to create cortical surface reconstructions of both lesioned and normal hemispheres. Our methods were confirmed in two visual experiments, in which functional activations were obtained during both free viewing and fixation conditions. In one experiment, face-selective activity was found in the fundus and banks of the superior temporal sulcus and the middle temporal gyrus in monkeys viewing pictures of faces and objects while maintaining fixation. In a second experiment, regions in occipital, parietal, and frontal cortex were activated in lesioned and normal animals viewing a cartoon movie. Importantly, in the animal with the striate lesion, fMRI signals were obtained in the immediate vicinity of the lesion. Our results extend those previously reported by providing a detailed account of the technique and by demonstrating the feasibility of fMRI in monkeys with lesions.

Applications of ultrasmall superparamagnetic iron oxide contrast agents in the MR study of animal models

Ultrasmall superparamagnetic iron oxide nanoparticles have been widely used during the past decade as MR intravascular contrast agents in the study of animal models. Such agents enhance both T1 and T2/T2* relaxation, although for animal studies it is the later type of enhancement that is most commonly exploited. Their strong microscopic intravascular susceptibility effect enables the local blood volume distribution to be mapped in various organs. High spatial resolution and sensitivity can be achieved, because the long half-life of these agents in blood, combined with anesthetization, permits steady-state measurements over extended periods. This capability has been utilized to study the cerebrovascular blood volume distributions and their changes in normal, activated, pathologic and pharmacologically or genetically modified states, particularly in rodent animal models. It has also been applied to study blood volume changes in other tissues, such as the myocardium. The relaxation rate shifts Delta R2 and Delta R2* induced by iron oxide agents may differ depending on certain morphological characteristics of the microvascular network, and sensitive Delta R2 and Delta R2* mapping can potentially provide, in addition to blood volume, measurement of other important microvascular parameters such as blood vessel density and size. This work aims to review the applications of ultrasmall superparamagnetic iron oxide contrast agents in MR animal studies, with an emphasis on the investigation of microvascular parameters.

Processing X-ray images to eliminate irrelevant structures that mask important features

In a plane radiographic image, there generally is an important area of interest (AOI). Too often, the AOI is partially masked by images of other overlapping and underlying structures that may be in front of or behind the AOI. An important adjunct to radiological diagnosis would be the capability of eliminating images of such masking structures to isolate the AOI for more detailed examination. We described a computerized method that utilizes a stereo pair of plane X-ray images to enable radiologists to interact with these images for first identifying for the computer the AOI and then directing the computer to eliminate all structures in front of and behind the AOI. The result is a plane X-ray image or a stereo X-ray image pair that includes only the AOI, but not any overlapping or underlying structures. The method uses a stereo pair of X-rays and the 3D perception of radiologists. 3D perception involves eye convergence and lens focus as well as cues, such as parallax and relative sizes. Convergence of the eyes is by far the strongest factor in 3D visualization. The horizontal separation or disparity between points in the left and right eye images on a screen or X-ray film produces convergence which determines an object's perceived depth in visual 3D space. All points in a given perceived depth plane have the same disparity on the screen. In theory, a given depth plane can be eliminated from the 3D image by shifting one image and then the other image of a stereo pair horizontally by the distance of the disparity of the depth plane, and subtracting. A new stereo image pair is thereby produced in which points only of the depth plane do not appear. However, in practical situations, certain artifacts arise that must be considered. The method has the potential for important applications in many areas of medical imaging processing.

Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays

We used fMRI to directly compare the neural substrates of three-dimensional (3-D) shape and motion processing for realistic textured objects rotating in depth. Subjects made judgments about several different attributes of these objects, including 3-D shape, the 3-D motion, and the scale of surface texture. For all of these tasks, we equated visual input, motor output, and task difficulty, and we controlled for differences in spatial attention. Judgments about 3-D shape from motion involve both parietal and occipito-temporal regions. The processing of 3-D shape is associated with the analysis of 3-D motion in parietal regions and the analysis of surface texture in occipito-temporal regions, which is consistent with the different behavioral roles that are typically attributed to the dorsal and ventral processing streams.