Architecture of binocular disparity processing in monkey inferior temporal cortex

Decision-related activity in sensory neurons may depend on the columnar architecture of cerebral cortex

Many studies have reported correlations between the activity of sensory neurons and animals' judgments in discrimination tasks. Here, we suggest that such neuron-behavior correlations may require a cortical map for the task relevant features. This would explain why studies using discrimination tasks based on disparity in area V1 have not found these correlations: V1 contains no map for disparity. This scheme predicts that activity of V1 neurons correlates with decisions in an orientation-discrimination task. To test this prediction, we trained two macaque monkeys in a coarse orientation discrimination task using band-pass-filtered dynamic noise. The two orientations were always 90° apart and task difficulty was controlled by varying the orientation bandwidth of the filter. While the trained animals performed this task, we recorded from orientation-selective V1 neurons (n = 82, n = 31 for Monkey 1, n = 51 for Monkey 2). For both monkeys, we observed significant correlation (quantified as "choice probabilities") of the V1 activity with the monkeys' perceptual judgments (mean choice probability 0.54, p = 10(-5)). In one of these animals, we had previously measured choice probabilities in a disparity discrimination task in V1, which had been at chance (0.49, not significantly different from 0.5). The choice probabilities in this monkey for the orientation discrimination task were significantly larger than those for the disparity discrimination task (p = 0.032). These results are predicted by our suggestion that choice probabilities are only observed for cortical sensory neurons that are organized in maps for the task-relevant feature.

An investigation of surface reconstruction from binocular disparity based on standard regularization theory: comparison between "membrane" and "thin-plate" potential energy models

Visible surfaces of three-dimensional objects are reconstructed from two-dimensional retinal images in the early stages of human visual processing. In the computational model of surface reconstruction based on the standard regularization theory, an energy function is minimized. Two types of model have been proposed, called "membrane" and "thin-plate" after their function formulas, in which the first or the second derivative of depth information is used. In this study, the threshold of surface reconstruction from binocular disparity was investigated using a sparse random dot stereogram, and the predictive accuracy of these models was evaluated. It was found that the thin-plate model reconstructed surfaces more accurately than the membrane model and showed good agreement with experimental results. The likelihood that these models imitate human processing of visual information is discussed in terms of the size of receptive fields in the visual pathways of the human cortex.

Organization of color-selective neurons in macaque visual area V4

Cortical area V4 in monkeys contains neurons that respond selectively to particular colors. It has been controversial how these color-selective neurons are spatially organized in V4. One view asserts that color-selective neurons are organized in columns with different colors orderly mapped across the cortex, whereas other studies have found no evidence for columnar organization or any other clustered structure. In the present study, we reexamined the functional organization of color-selective neurons in area V4 by quantitatively evaluating and comparing the color selectivity of nearby neurons as well as those encountered along electrode penetrations. Using a multiple single-unit recording technique, we recorded extracellular activities simultaneously from groups of nearby V4 neurons. Color discrimination and color preferences exhibited a moderate correlation between nearby neurons, consistent with neurons in a local region of V4 sharing similar responses to stimulus color. However, the degree of clustering was variable across recording sites. Some regions contained neurons with similar color preferences, whereas others contained neurons with diverse color preferences. Neurons in penetrations normal to the cortical surface responded to an overlapping range of colors and maintained a moderate correlation. Neurons in penetrations tangential to the cortical surface differed dramatically in their preferred color and exhibited a negative correlation. We conclude that neurons in area V4 are moderately clustered according to their color selectivity and that this weak clustering is columnar in structure.

Quantitative analysis of functional clustering of neurons in the macaque inferior temporal cortex

Neurons with similar preferences for two-dimensional shapes of intermediate complexity cluster in area TE of the monkey inferior temporal cortex. To further characterize the functional structure of area TE, we quantitatively analyzed various aspects of the visual responses of closely located neurons by applying multiple single-unit recording techniques in anesthetized monkeys. Examination of the visual responses elicited with a large, predetermined set of visual stimuli confirmed previous findings that nearby neurons, on average, exhibited positively correlated preferences for a set of visual stimuli. Nearby neurons also tended to be similar in their receptive-field organization and contrast-polarity preference. In contrast, no correlation was found in the size tuning of neighboring neurons. Pooling or subtraction of activities between a pair of nearby neurons was shown to improve stimulus discriminability, if the neuron pair had positively or negatively correlated stimulus preferences, respectively. These results indicate that nearby TE neurons share some aspects of stimulus preference, but their response selectivity differ in other aspects. Both pooling and subtraction between nearby neurons can reduce across-trial response variability, if these decoding strategies are applied to appropriate neuronal pools.