Color signals in human motion-selective cortex

The perception of motion in chromatic stimuli

The issue of whether there is a motion mechanism sensitive to purely chromatic stimuli has been pertinent for the past 30 or more years. The aim of this review is to examine why such different conclusions have been drawn in the literature and to reach some reconciliation. The review critically examines the behavioral evidence and concludes that there is a purely chromatic motion mechanism but that it is limited to the fovea. Examination of motion performance for chromatic and luminance stimuli provides convincing evidence that there are at least two different mechanisms for the two kinds of stimuli. The authors further argue that the chromatic mechanism may be at a particular disadvantage when the integration of multiple local motion signals is required. Finally, the authors present a descriptive model that may go some way toward explaining the reasons for the differences in collected data outlined in this article.

Bipolar cell pathways for color and luminance vision in a dichromatic mammalian retina

The mammalian retina is fundamentally dichromatic, with trichromacy only recently emerging in some primates. In dichromats, an array of short wavelength-sensitive (S, blue) and middle wavelength-sensitive (M, green) cones is sampled by approximately ten bipolar cell types, and the sampling pattern determines how retinal ganglion cells and ultimately higher visual centers encode color and luminance. By recording from cone-bipolar cell pairs in the retina of the ground squirrel, we show that the bipolar cell types sample cone signals in three ways: one type receives input exclusively from S-cones, two types receive mixed S/M-cone input and the remaining types receive an almost pure M-cone signal. Bipolar cells that carry S- or M-cone signals can have a role in color discrimination and may contact color-opponent ganglion cells. Bipolar cells that sum signals from S- and M-cones may signal to ganglion cells that encode luminance.

Specializations for chromatic and temporal signals in human visual cortex

Neurological case studies and qualitative measurements suggest that regions within human extrastriate cortex are specialized for different perceptual functions, including color. However, there are few quantitative measurements of human extrastriate color specializations. We studied the chromatic and temporal responses in several different clusters of human visual field maps using functional magnetic resonance imaging. Contrast response functions were measured for luminance [(L + M)-cone], red-green [(L - M)-cone] and blue-yellow (S-cone) modulations at various temporal frequencies. In primary visual cortex (V1), temporal responsivities to luminance and red-green modulations are approximately constant up to 10 Hz, but responsivities to blue-yellow modulations decrease significantly. In ventral occipital cortex (VO), all colors elicit strong responses, and, for each color, low temporal frequency modulations are more effective than high temporal frequency modulations. Hence, VO represents the full range of color information but does not respond well to rapid modulations. Conversely, in human motion-selective cortex (MT+) and V3A, blue-yellow modulations elicit very weak responses, whereas luminance and red-green high temporal frequency modulations are equally or more effective than low temporal frequency modulations. Hence, these dorsal occipital regions respond well to rapid modulations, but not all color information is represented. Similar to human motion perception, MT+ and V3A respond powerfully to all temporal frequencies but only to some colors. Similar to human color perception, VO responds powerfully to all colors but only to relatively low temporal frequencies.

Dorsal stream associations with orthographic and phonological processing

Several studies have indicated a key role for dorsal stream processing in lexical decoding. To examine this relationship further, performance on orthographic and phonological reading tests was compared with both steady-state visual evoked potentials and a putative behavioral measure of dorsal stream processing, coherent motion detection. Frequency analysis of the visual evoked potential data showed power at the second harmonic to be largely confined to dorsal stream regions, and significantly correlated with motion detection thresholds. Regression analyses showed that orthographic processing was significantly associated with the second harmonic power. Although consistent with previous reports, there remains a question as to why the orthographic visual evoked potential power relationship did not extend to include the coherent motion detection measures.

The Ferrier Lecture 1995 behind the seen: the functional specialization of the brain in space and time

The visual brain consists of many different visual areas, which are functionally specialized to process and perceive different attributes of the visual scene. However, the time taken to process different attributes varies; consequently, we see some attributes before others. It follows that there is a perceptual asynchrony and hierarchy in visual perception. Because perceiving an attribute is tantamount to becoming conscious of it, it follows that we become conscious of different attributes at different times. Visual consciousness is therefore distributed in time. Given that we become conscious of different visual attributes because of activity at different, functionally specialized, areas of the visual brain, it follows that visual consciousness is also distributed in space. Therefore, visual consciousness is not a single unified entity, but consists of many microconsciousnesses.

Perception of chromatic motion requires luminance interaction

There is an ongoing debate related to whether chromatic motion perception arises as a consequence of a chromatic signal only (eg Wandell et al 1999 Neuron 24 901-909) or a signal that is essentially based on luminance processes (luminance artifacts) (Mullen et al 2003 Vision Research 43 1235-1247). These two views conform to the idea that colour and luminance processes are physiologically independent (Livingstone and Hubel 1988 Science 240 740-749), but according to other reports many primary cortical 'V1' cells respond to both colour and luminance contrast (eg Vidyasagar et al 2002 European Journal of Neuroscience 16 945-956). A psychophysical task was designed to test whether possible interaction between luminance and chromatic contrast could account for perception of chromatic motion. It is shown that subjects respond in a manner that reflects involvement of both processes.

Chromatic sensitivity of neurones in area MT of the anaesthetised macaque monkey compared to human motion perception

We recorded activity from neurones in cortical motion-processing areas, middle temporal area (MT) and middle posterior superior temporal sulcus (MST), of anaesthetised and paralysed macaque monkeys in response to moving sinewave gratings modulated in luminance and chrominance. The activity of MT and MST neurones was highly dependent on luminance contrast. In three of four animals isoluminant chromatic modulations failed to activate MT/MST neurones significantly. At low luminance contrast a systematic dependence on chromaticity was revealed, attributable mostly to residual activity of the magnocellular pathway. Additionally, we found indications for a weak S-cone input, but rod intrusion could also have made a contribution. In contrast to the activity of MT and MST neurones, speed judgments and onset amplitude of evoked optokinetic eye movements in human subjects confronted with equivalent visual stimuli were largely independent of luminance modulation. Motion of every grating (including isoluminant) was readily visible for all but one observer. Similarity with the activity of MT/MST cells was found only for motion-nulling equivalent luminance contrast judgments at isoluminance. Our results suggest that areas MT and MST may not be involved in the processing of chromatic motion, but effects of central anaesthesia and/or the existence of intra- and inter-species differences must also be considered.

The cone inputs to the unique-hue mechanisms

Our aim was to characterise the chromatic mechanisms that yield the four unique hues: red, green, yellow and blue. We measured the null planes for all four unique hues and report the following two main results. (1) We confirm that three chromatic mechanisms are required to account for the four unique hues. These three chromatic mechanisms do not coincide with the chromatic tuning found in parvocellular LGN neurones, i.e., neurones tuned to L-M and S-(L+M); these subcortical chromatic mechanisms are hence not the neural substrate of the perceptual unique hues and further higher-order colour mechanisms need to be postulated. Our results are consistent with the idea that the two higher-order colour mechanisms that yield unique red and unique green respectively combine the incremental and decremental responses of the subcortical chromatic mechanisms with different weights. In contrast, unique yellow and unique blue can be explained by postulating a single higher-order chromatic mechanism that combines the incremental and decremental subcortical chromatic responses with similar weights. (2) The variability between observers is small when expressed in terms of perceptual errors, which is consistent with the hypothesis that the colour vision system in adult humans is able to recalibrate itself based on prior visual experience.

Channeling of red and green cone inputs to the zebrafish optomotor response

Visual systems break scenes down into individual features, processed in distinct channels, and then selectively recombine those features according to the demands of particular behavioral tasks. In primates, for example, there are distinct pathways for motion and form processing. While form vision utilizes color information, motion pathways receive input from only a subset of cone photoreceptors and are generally colorblind. To explore the link between early channeling of visual information and behavioral output across vertebrate species, we measured the chromatic inputs to the optomotor response of larval zebrafish. Using cone-isolating gratings, we found that there is a strong input from both red and green cones but not short-wavelength cones, which nevertheless do contribute to another behavior, phototaxis. Using a motion-nulling method, we measured precisely the input strength of gratings that stimulated cones in combination. The fish do not respond to gratings that stimulate different cone types out of phase, but have an enhanced response when the cones are stimulated together. This shows that red and green cone signals are pooled at a stage before motion detection. Since the two cone inputs are combined into a single ‘luminance’ channel, the response to sinusoidal gratings is colorblind. However, we also find that the relative contributions of the two cones at isoluminance varies with spatial frequency. Therefore, natural stimuli, which contain a mixture of spatial frequencies, are likely to be visible regardless of their chromatic composition.

Adaptation of oriented and unoriented color-selective neurons in human visual areas

Primary visual cortex contains at least two distinct populations of color-selective cells: neurons in one have circularly symmetric receptive fields and respond best to reddish and greenish light, while neurons in another have oriented receptive fields and a variety of color preferences. The relative prevalence and perceptual roles of the two kinds of neurons remain controversial, however. We used fMRI and a selective adaptation technique to measure responses attributable to these two populations. The technique revealed evidence of adaptation in both populations and indicated that they each produced strong signals in V1 and other human visual areas. The activity of both sets of neurons was also reflected in color appearance measurements made with the same stimuli. Thus, both oriented and unoriented color-selective cells in V1 are important components of the neural pathways that underlie perception of color.

A higher order motion region in human inferior parietal lobule: evidence from fMRI

The proposal that motion is processed by multiple mechanisms in the human brain has received little anatomical support so far. Here, we compared higher- and lower-level motion processing in the human brain using functional magnetic resonance imaging. We observed activation of an inferior parietal lobule (IPL) motion region by isoluminant red-green gratings when saliency of one color was increased and by long-range apparent motion at 7 Hz but not 2 Hz. This higher order motion region represents the entire visual field, while traditional motion regions predominantly process contralateral motion. Our results suggest that there are two motion-processing systems in the human brain: a contralateral lower-level luminance-based system, extending from hMT/V5+ into dorsal IPS and STS, and a bilateral higher-level saliency-based system in IPL.

The chromatic input to global motion perception

For over 30 years there has been a controversy over whether color-defined motion can be perceived by the human visual system. Some results suggest that there is no chromatic motion mechanism at all, whereas others do find evidence for a purely chromatic motion mechanism. Here we examine the chromatic input to global motion processing for a range of color directions in the photopic luminance range. We measure contrast thresholds for global motion identification and simple detection using sparse random-dot kinematograms. The results show a discrepancy between the two chromatic axes: whereas it is possible for observers to perform the global motion task for stimuli modulated along the red–green axis, we could not assess the contrast threshold required for stimuli modulated along the yellowish-violet axis. The contrast required for detection for both axes, however, are well below the contrasts required for global motion identification. We conclude that there is a significant red–green input to global motion processing providing further evidence for the involvement of the parvocellular pathway. The lack of S-cone input to global motion processing suggests that the koniocellular pathway mediates the detection but not the processing of complex motion for our parameter range.

Color vision

Color vision starts with the absorption of light in the retinal cone photoreceptors, which transduce electromagnetic energy into electrical voltages. These voltages are transformed into action potentials by a complicated network of cells in the retina. The information is sent to the visual cortex via the lateral geniculate nucleus (LGN) in three separate color-opponent channels that have been characterized psychophysically, physiologically, and computationally. The properties of cells in the retina and LGN account for a surprisingly large body of psychophysical literature. This suggests that several fundamental computations involved in color perception occur at early levels of processing. In the cortex, information from the three retino-geniculate channels is combined to enable perception of a large variety of different hues. Furthermore, recent evidence suggests that color analysis and coding cannot be separated from the analysis and coding of other visual attributes such as form and motion. Though there are some brain areas that are more sensitive to color than others, color vision emerges through the combined activity of neurons in many different areas.

Functional dissociation among components of remembering: control, perceived oldness, and content

Remembering is the ability to bring back to mind episodes from one's past and is presumably accomplished by multiple, interdependent processes. In the present functional magnetic resonance imaging study, neural correlates of three hypothesized components of remembering were explored, including those associated with control, perceived oldness, and retrieved content. Levels of each component were separately manipulated by varying study procedures and sorting trials by subject response. Results suggest that specific regions in the left prefrontal cortex, including anterior-ventral Brodmann's Area (BA) 45/47 and more dorsal BA 44, increase activity when high levels of control are required but do not necessarily modulate on the basis of perceived oldness. Parietal and frontal regions, particularly the left parietal cortex near BA 40/39, associate with the perception that information is old and generalize across levels of control and retrieved content. Activity in the parietal cortex correlated with perceived oldness even when judgments were in error. The inferior temporal cortex near BA 19/37 associated differentially with retrieval of visual object content. Within the ventral visual processing stream, content-based modulation was specific to late object-responsive regions, suggesting an efficient retrieval process that spares areas that process more primitive retinotopically mapped visual features. Taken collectively, the results identify neural correlates of distinct components of remembering and provide evidence for a functional dissociation. Frontal regions may contribute to control processes that interact with different posterior regions that contribute a signal that information is old and support the contents of retrieval.

Functional imaging of the visual pathways

Functional neuroimaging has provided a new view of activity in human visual cortex. There have been a series of interesting developments in understanding the relationship between the functional signals, particularly functional MRI, and basic measurements of action potentials and local field potentials. The new human neuro-imaging measurements have clarified some of the similarities and differences between the general organization of visual areas in human and macaque visual cortex, and there have been some interesting new results concerning cortical visual plasticity and dysfunction. The new fMRI focus on measurements of the human brain will drive new relationships between neurology and visual neuroscience that should help us learn much more about the neural basis of perception.

The influence of color on the perception of luminance motion

We examined the role of color in the processing of motion of a luminance-varying pattern by alternating the color of a moving pattern and measuring the luminance contrast required for accurate discrimination of the motion direction. We report that the contrast threshold for perceiving the direction of motion of luminance-varying patterns is greatly elevated when the mean chromaticity of the moving luminance pattern alternates between two hues. Thus, color plays a critical role in the discrimination of luminance motion direction. The magnitude of the threshold elevation is directly related to the magnitude of the LM opponent color contrast produced by the color alternation. S-cone contrast produces little or no effect. The interference produced by color alternation was greatly reduced in the retinal periphery. Our results indicate that first-order luminance motion mechanisms are sensitive to the color of moving objects as coded by a differencing of the outputs of L and M cones. Contrary to the widely accepted notion that luminance-defined motion is processed primarily in the spectrally broadband magnocellular (M) pathway, our results suggest that the hue-selective parvocellular (P) mechanisms provide input to first-order motion detectors.

Inner S-cone bipolar cells provide all of the central elements for S cones in macaque retina

Synaptic terminals of cones (pedicles) are presynaptic to numerous processes that arise from the dendrites of many types of bipolar cell. One kind of process, a central element, reaches deeply into invaginations of the cone pedicle just below an active zone associated with a synaptic ribbon. By reconstruction from serial electron micrographs, we show that L- and M-cone pedicles in macaque fovea are presynaptic to approximately 20 central elements that arise from two types of inner (invaginating) bipolar cell, midget and diffuse. In contrast, S-cone pedicles, with more synaptic ribbons, active zones/ribbon, and central elements/active zone, are presynaptic to approximately 33 central elements. Moreover, all of these arise from one type of bipolar cell, previously described by others, here termed an inner S-cone bipolar cell. Each provides approximately 16 central elements. Thirty-three is twice 16; correspondingly, these bipolar cells are twice as numerous as S cones. (Specifically, each S cone is presynaptic to four inner S-cone bipolar cells; in turn, each bipolar cell provides central elements to two S cones.) These bipolar cells are presynaptic to an equal number of small-field bistratified ganglion cells, giving cell numbers in 2G:2B:1S ratios. Each ganglion cell receives input from two or more inner S-cone bipolar cells and thereby collects signals from three or more S cones. This convergence, along with chromatic aberration of short-wavelength light, suggests that S-cone contributions to this ganglion cell's coextensive blue-ON/yellow-OFF receptive field are larger than opponent L/M-cone contributions via outer diffuse bipolar cells and that opponent L/M-cone signals are conveyed mainly by inner S-cone bipolar cells.

Color vision: how the cortex represents color

Our understanding of how we see color has benefited from the long tradition of visual psychophysics. More recently, models and methods from psychophysics are guiding modern neuroimaging experiments on color vision. Combining the two techniques can lead to discoveries that neither can make alone.

Efficient acquisition of human retinotopic maps

A bifield stimulation method for rapidly obtaining retinotopic maps in human occipital cortex using functional MRI was compared to conventional unifield stimulation. While maintaining central fixation, each participant viewed the conventional display, consisting of a single rotating checkerboard wedge and, in a separate run, the bifield display, consisting of two symmetrically placed rotating checkerboard wedges (a "propeller" configuration). Both stimulus configurations used wedges with 30 degree polar angle width, 6.8 degrees visual angle extension from fixation, and 8.3 Hz contrast polarity reversal rate. Retinotopic maps in each condition were projected onto a distortion corrected computationally flattened cortical surface representation obtained from a high-resolution structural MRI. An automated procedure to localize borders between early visual areas revealed, as expected, that map precision increased with duration of data acquisition for both conditions. Bifield stimulation required 40% less time to yield maps with similar precision to those obtained using conventional unifield stimulation.

Chromatic light adaptation measured using functional magnetic resonance imaging

Sensitivity changes, beginning at the first stages of visual transduction, permit neurons with modest dynamic range to respond to contrast variations across an enormous range of mean illumination. We have used functional magnetic resonance imaging (fMRI) to investigate how these sensitivity changes are controlled within the visual pathways. We measured responses in human visual area V1 to a constant-amplitude, contrast-reversing probe presented on a range of mean backgrounds. We found that signals from probes initiated in the L and M cones were affected by backgrounds that changed the mean absorption rates in the L and M cones, but not by background changes seen only by the S cones. Similarly, signals from S cone-initiated probes were altered by background changes in the S cones, but not by background changes in the L and M cones. Performance in psychophysical tests under similar conditions closely mirrored the changes in V1 fMRI signals. We compare our data with simulations of the visual pathway from photon catch rates to cortical blood-oxygen level-dependent signals and show that the quantitative fMRI signals are consistent with a simple model of mean-field adaptation based on Naka-Rushton (Naka and Rushton, 1966) adaptation mechanisms within cone photoreceptor classes.

S cone contributions to the magnocellular visual pathway in macaque monkey

The magnocellular visual pathway is believed to receive input from long (L) and middle (M), but not short (S), wavelength-sensitive cones. Recording from neurons in magnocellular layers of lateral geniculate nucleus (LGN) in macaque monkeys, we found that magnocellular neurons were unequivocally responsive to S cone-isolating stimuli. A quantitative analysis suggests that S cones provided about 10% of the input to these cells, on average, while L:M ratios were far more variable. S cone signals influenced responses with the same sign as L and M cone inputs (i.e., no color opponency). Magnocellular afferent recordings following inactivation of primary visual cortex demonstrated that S cone signals were feedforward in nature and did not arise from cortical feedback to LGN

The perceived speed of drifting chromatic gratings is mechanism-dependent

The perceived speed of chromatic motion was investigated for gratings that stimulate each chromatic mechanism [L-M and S-(L+M)] in isolation and for gratings that stimulate both chromatic systems. The observers' task consisted of adjusting the speed of a drifting achromatic grating to match the perceived speed of an isoluminant chromatic grating, drifting at 8 deg/s (temporal frequency of 4 Hz). Every observer reported a substantial decrease in perceived speed for chromatic gratings modulated along the S-(L+M) (blue-yellow) cardinal axis compared to other directions in color space. One observer even reported motion standstill for gratings modulated along this axis. Further testing demonstrates that the perceived speed of an isoluminant chromatic grating depends solely on the extent to which it stimulates the L-M (red-green) mechanism. Thus, under the conditions that were tested, the S-(L+M) postreceptoral mechanism does not appear to contribute significantly to determining the perceived speed of chromatic motion.

The influence of stimulus chromaticity on the isoluminant motion-onset VEP

Motion-onset visual evoked potentials (VEPs) were elicited by low spatial frequency chromatic isoluminant gratings presented in a central 7 degrees circular field. The chromatic composition of the stimuli was varied so as to modulate along different axes in colour space. For slow speeds (<5 degrees/s) changing the chromatic axis induced large response differences between the S- and L/M-cone VEPs. At faster speeds (5-12 degrees/s) the effects were not as marked. A dichotomy between the slow and fast responses was also shown to exist in terms of their contrast dependencies, the former exhibiting a stronger dependency on contrast than the latter. These findings suggest that neural substrates with chromatic sensitivity are involved in the generation of S- and L/M-cone mediated motion-onset VEPs at low velocities. At higher velocities, responses are generated by different mechanisms that possess little or no chromatic sensitivity.

Cellular basis for the response to second-order motion cues in Y retinal ganglion cells

We perceive motion when presented with spatiotemporal changes in contrast (second-order cue). This requires linear signals to be rectified and then summed in temporal order to compute direction. Although both operations have been attributed to cortex, rectification might occur in retina, prior to the ganglion cell. Here we show that the Y ganglion cell does indeed respond to spatiotemporal contrast modulations of a second-order motion stimulus. Responses in an OFF ganglion cell are caused by an EPSP/IPSP sequence evoked from within the dendritic field; in ON cells inhibition is indirect. Inhibitory effects, which are blocked by tetrodotoxin, clamp the response near resting potential thus preventing saturation. Apparently the computation for second-order motion can be initiated by Y cells and completed by cortical cells that sum outputs of multiple Y cells in a directionally selective manner.

Human cortical activity correlates with stereoscopic depth perception

Stereoscopic depth perception is based on binocular disparities. Although neurons in primary visual cortex (V1) are selective for binocular disparity, their responses do not explicitly code perceived depth. The stereoscopic pathway must therefore include additional processing beyond V1. We used functional magnetic resonance imaging (fMRI) to examine stereo processing in V1 and other areas of visual cortex. We created stereoscopic stimuli that portrayed two planes of dots in depth, placed symmetrically about the plane of fixation, or else asymmetrically with both planes either nearer or farther than fixation. The interplane disparity was varied parametrically to determine the stereoacuity threshold (the smallest detectable disparity) and the upper depth limit (largest detectable disparity). fMRI was then used to quantify cortical activity across the entire range of detectable interplane disparities. Measured cortical activity covaried with psychophysical measures of stereoscopic depth perception. Activity increased as the interplane disparity increased above the stereoacuity threshold and dropped as interplane disparity approached the upper depth limit. From the fMRI data and an assumption that V1 encodes absolute retinal disparity, we predicted that the mean response of V1 neurons should be a bimodal function of disparity. A post hoc analysis of electrophysiological recordings of single neurons in macaques revealed that, although the average firing rate was a bimodal function of disparity (as predicted), the precise shape of the function cannot fully explain the fMRI data. Although there was widespread activity within the extrastriate cortex (consistent with electrophysiological recordings of single neurons), area V3A showed remarkable sensitivity to stereoscopic stimuli, suggesting that neurons in V3A may play a special role in the stereo pathway.

Visual evoked potentials elicited by chromatic motion onset

Visually Evoked Potentials (VEPs) were recorded in response to the onset of chromatic and luminance motion gratings of 1 cpd and luminance 40 cd m(-2) subtending a 7 degrees field. At slow speeds (< or =2 cycles s(-1)) the motion onset response exhibits a clear amplitude minimum at isoluminance. Over the Michelson contrast range tested (0.05-0.75) the chromatic response at 2 cycles s(-1) possesses a linear response function compared to the saturating function of the luminance response and the contrast dependency of the former is a factor of 5-6 times greater than for the latter. These differences are suggestive of different neural substrates for the chromatic and luminance motion VEPs at slow speeds. At 10 cycles s(-1) the chromatic motion onset VEP exhibits no amplitude minimum at isoluminance and becomes more like its luminance counterpart in terms of its saturating contrast response function. Furthermore, the contrast dependency of the chromatic and luminance responses differs by only a factor of 1.6 at this faster rate. These findings are consistent with the idea of separate motion mechanisms that operate at fast and slow speeds, the latter having separate channels for colour and luminance motion.

Visual areas and spatial summation in human visual cortex

Functional MRI measurements can securely partition the human posterior occipital lobe into retinotopically organized visual areas (V1, V2 and V3) with experiments that last only 30 min. Methods for identifying functional areas in the dorsal and ventral aspect of the human occipital cortex, however, have not achieved this level of precision; in fact, different laboratories have produced inconsistent reports concerning the visual areas in dorsal and ventral occipital lobe. We report four findings concerning the visual representation in dorsal regions of occipital cortex. First, cortex near area V3A contains a central field representation that is distinct from the foveal representation at the confluence of areas V1, V2 and V3. Second, adjacent to V3A there is a second visual area, V3B, which represents both the upper and lower quadrants. The central representation in V3B appears to merge with that of V3A, much as the central representations of V1/2/3 come together on the lateral margin of the posterior pole. Third, there is yet another dorsal representation of the central visual field. This representation falls in area V7, which includes a representation of both the upper and lower quadrants of the visual field. Fourth, based on visual field and spatial summation measurements, it appears that the receptive field properties of neurons in area V7 differ from those in areas V3A and V3B.

Seeing with S cones

The S cone is highly conserved across mammalian species, sampling the retinal image with less spatial frequency than other cone photoreceptors. In human and monkey retina, the S cone represents typically 5-10% of the cone mosaic and distributes in a quasi-regular fashion over most of the retina. In the fovea, the S cone mosaic recedes from a central "S-free" zone whose size depends on the optics of the eye for a particular primate species: the smaller the eye, the less extreme the blurring of short wavelengths, and the smaller the zone. In the human retina, the density of the S mosaic predicts well the spatial acuity for S-isolating targets across the retina. This acuity is likely supported by a bistratified retinal ganglion cell whose spatial density is about that of the S cone. The dendrites of this cell collect a depolarizing signal from S cones that opposes a summed signal from M and L cones. The source of this depolarizing signal is a specialized circuit that begins with expression of the L-AP4 or mGluR6 glutamate receptor at the S cone-->bipolar cell synapse. The pre-synaptic circuitry of this bistratified ganglion cell is consistent with its S-ON/(M+L)-OFF physiological receptive field and with a role for the ganglion cell in blue/yellow color discrimination. The S cone also provides synapses to other types of retinal circuit that may underlie a contribution to the cortical areas involved with motion discrimination.

Visual motion and the human brain: what has neuroimaging told us?

Recently, neuroimaging techniques have been applied to the study of human motion perception, complementing established techniques such as psychophysics, neurophysiology and neuropsychology. Because vision, particularly motion perception, has been studied relatively extensively, it provides an interesting case study to examine the contributions and limitations of neuroimaging to cognitive neuroscience. We suggest that in the domain of motion perception neuroimaging has: (1) revealed an extensive network of motion areas throughout the human brain, in addition to the well-studied motion complex (MT+); (2) verified and extended findings from other techniques; (3) suggested extensive top-down influences on motion perception; and (4) allowed experimenters to examine the neural correlates of awareness. We discuss these contributions, along with limitations and future directions for the neuroimaging of motion.

Can neuroimaging really tell us what the human brain is doing? The relevance of indirect measures of population activity

Neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) give an indication towards the localization of mental representations and processes in the human brain. It is not clear to what extent such global measures of neuronal activity, pooling across large populations of neurons, can reveal how certain computations are implemented by the neurons in such population ('computational neuroimaging'). Population activity is related tightly to single-cell activity when all neurons in the population have similar response properties. We describe some evidence from single-cell recordings in monkeys that indicates that neurons with similar response properties are not scattered randomly throughout the visual cortex. Notwithstanding this clustering, populations of nearby neurons are still rather heterogeneous, requiring some prudence in deriving single-cell response properties from population activity. The following review of recent neuroimaging studies of the visual system describes to what degree inferences about computations and representations can be drawn from these studies.

Imaging image processing in the human brain

Functional imaging in humans reveals the interplay of the many components of the human visual system: how they process the various types of information contained in the image to recover characteristics of the three-dimensional world surrounding us, but also how, in the course of this process, the retinal image is gradually integrated with non-retinal signals to provide information about the outside world in a format useful to other non-visual brain regions.

Activity in primary visual cortex predicts performance in a visual detection task

Visual attention can affect both neural activity and behavior in humans. To quantify possible links between the two, we measured activity in early visual cortex (V1, V2 and V3) during a challenging pattern-detection task. Activity was dominated by a large response that was independent of the presence or absence of the stimulus pattern. The measured activity quantitatively predicted the subject's pattern-detection performance: when activity was greater, the subject was more likely to correctly discern the presence or absence of the pattern. This stimulus-independent activity had several characteristics of visual attention, suggesting that attentional mechanisms modulate activity in early visual cortex, and that this attention-related activity strongly influences performance.

Motion perception at scotopic light levels

Although the spatial and temporal properties of rod-mediated vision have been extensively characterized, little is known about scotopic motion perception. To provide such information, we determined thresholds for the detection and identification of the direction of motion of sinusoidal grating patches moving at speeds from 1 to 32 deg/s, under scotopic light levels, in four different types of observers: three normals, a rod monochromat (who lacks all cone vision), an S-cone monochromat (who lacks M- and L-cone vision), and four deuteranopes (who lack M-cone vision). The deuteranopes, whose motion perception does not differ from that of normals, allowed us to measure rod and L-cone thresholds under silent substitution conditions and to compare directly the perceived velocity for moving stimuli detected by either rod or cone vision at the same light level. We find, for rod as for cone vision, that the direction of motion can be reliably identified very near to detection threshold. In contrast, the perceived velocity of rod-mediated stimuli is reduced by approximately 20% relative to cone-mediated stimuli at temporal frequencies below 4 Hz and at all intensity levels investigated (0.92 to -1.12 log cd m(-2)). Most likely, the difference in velocity perception is distal in origin because rod and cone signals converge in the retina and further processing of their combined signals in the visual cortex is presumably identical. To account for the difference, we propose a model of velocity, in which the greater temporal averaging of rod signals in the retina leads to an attenuation of the motion signal in the detectors tuned to high velocities.

Vision: can colour contribute to motion?

Whether colour patterns that have no luminance variation can evoke the perception of visual motion has long been a controversial issue. Recent studies using new and old techniques have now provided compelling evidence that colour can indeed contribute to motion perception.

Perceived speed of colored stimuli

The influence of contrast and color on perceived motion was measured using a speed-matching task. Observers adjusted the speed of an L cone contrast pattern to match that of a variety of colored test patterns. The dependence of speed on test contrast was the same for all test colors measured, differing only by a sensitivity factor. This result suggests that the reduced apparent speed of low contrast targets and certain colored targets is caused by a common cortical mechanism. The cone contrast levels that equate perceived speed differ substantially from those that equate visibility. This result suggests that the neural mechanisms governing speed perception and visibility differ. Perceived speed differences caused by variations in color can be explained by color responses that are characteristic of motion-selective cortex.

Color signals in area MT of the macaque monkey

The relationship between the neural processing of color and motion information has been a contentious issue in visual neuroscience. We examined this relationship directly by measuring neural responses to isoluminant S cone signals in extrastriate area MT of the macaque monkey. S cone stimuli produced robust, direction-selective responses at most recording sites, indicating that color signals are present in MT. While these responses were unequivocal, S cone contrast sensitivity was, on average, 1.0-1.3 log units lower than luminance contrast sensitivity. The presence of S cone responses and the relative sensitivity of MT neurons to S cone and luminance signals agree with functional magnetic resonance imaging (fMRI) measurements in human MT+. The results are consistent with the hypothesis that color signals in MT influence behavior in speed judgment tasks.