Contribution of linear mechanisms to the specification of local motion by simple cells in areas 17 and 18 of the cat

Synaptic and intrinsic mechanisms underlying development of cortical direction selectivity

Modifications of synaptic inputs and cell-intrinsic properties both contribute to neuronal plasticity and development. To better understand these mechanisms, we undertook an intracellular analysis of the development of direction selectivity in the ferret visual cortex, which occurs rapidly over a few days after eye opening. We found strong evidence of developmental changes in linear spatiotemporal receptive fields of simple cells, implying alterations in circuit inputs. Further, this receptive field plasticity was accompanied by increases in near-spike-threshold excitability and input-output gain that resulted in dramatically increased spiking responses in the experienced state. Increases in subthreshold membrane responses induced by the receptive field plasticity and the increased input-output spiking gain were both necessary to explain the elevated firing rates in experienced ferrets. These results demonstrate that cortical direction selectivity develops through a combination of plasticity in inputs and in cell-intrinsic properties.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Gaze and Arrows: The Effect of Element Orientation on Apparent Motion is Modulated by Attention

In two experiments we investigated whether stimuli that elicit automatic orienting of attention (i.e., arrow or averted gaze) could drive apparent motion perception in one of two possible directions, modulating the effect of a low-level property (the orientation of elements along the motion direction). To this end, the competing motion paradigm was used, in which at time 1, a stimulus appears in the center of the display, and at time 2, two other stimuli appear in different spatial locations. Three kinds of stimuli with eight possible orientations were used in separate blocks; (1) a line; (2) an arrow; and, (3) an averted gaze. First, since the three stimuli present in the display at time 2 should be perceived to be located at the same distance (i.e., equidistant), the threshold for perceived equidistance was calculated for each participant and then used as the customized inter-stimulus distance. Participants were asked to press the button corresponding to the direction of the perceived motion. Results show a preference for collinear motion (motions between elements oriented along the motion direction), with a higher percentage of responses for gaze and arrow stimuli. In Experiment 1, a difference between gaze- and arrow-stimuli was observed. Apparent motion was seen towards the collinear position more often for gaze than for arrow when the stimulus was pointing to the vertical directions, while the opposite was true when the stimulus was pointing to the horizontal directions. In Experiment 2, where the lightness contrast between the gaze and the background was reduced, no difference between gaze- and arrow-stimuli emerged. We interpret our results as due to the social and biological value of gaze, which solved a possible ambiguity between gaze direction and the directions conveyed by the figural properties of the contrasted background in Experiment 1. These findings are consistent with the idea that stimuli known to automatically orient visual attention modulate motion perception.

Principles underlying sensory map topography in primary visual cortex

The primary visual cortex contains a detailed map of the visual scene, which is represented according to multiple stimulus dimensions including spatial location, ocular dominance and orientation. The maps for spatial location and ocular dominance originate from the spatial arrangement of thalamic axons in cortex. However, the origin of the other maps remains unclear. Here we demonstrate that the cortical maps for orientation, direction and retinal disparity are all strongly related to the organization for spatial location of light (ON) and dark (OFF) stimuli, an organization that we show is OFF-dominated, OFF-centric and runs orthogonal to ocular dominance columns. Because this ON/OFF organization originates from the clustering of ON and OFF thalamic afferents in visual cortex, we conclude that all main features of cortical topography, including orientation, direction and retinal disparity, follow a common organizing principle that arranges thalamic axons with similar retinotopy and ON/OFF polarity in neighboring cortical regions.

Functional characterization of spikelet activity in the primary visual cortex

KEY POINTS

In vivo whole-cell patch-clamp recordings in cat visual cortex revealed small deflections in the membrane potential of neurons, termed spikelets. Spikelet statistics and functional properties suggest these deflections originate from a single, nearby cell. Spikelets shared a number sensory selectivities with the principal neuron including orientation selectivity, receptive field location and eye preference. Principal neurons and spikelets did not, however, generally share preferences for depth (binocular disparity). Cross-correlation of spikelet activity and membrane potential revealed direct effects on the membrane potential of some principal neurons, suggesting that these cells were synaptically coupled or received common input from the cortical network. Other spikelet-neuron pairs revealed indirect effects, likely to be the result of correlated network events.

ABSTRACT

Intracellular recordings in the neocortex reveal not only the membrane potential of neurons, but small unipolar or bipolar deflections that are termed spikelets. Spikelets have been proposed to originate from various sources, including active dendritic mechanisms, gap junctions and extracellular signals. Here we examined the functional characteristics of spikelets measured in neurons from cat primary visual cortex in vivo. Spiking statistics and our functional characterization of spikelet activity indicate that spikelets originate from a separate, nearby cell. Spikelet kinetics and lack of a direct effect on spikelet activity from hyperpolarizing current injection suggest they do not arise from electrical coupling to the principal neuron being recorded. Spikelets exhibited matched orientation tuning preference and ocular dominance to the principal neuron. In contrast, binocular disparity preferences of spikelets and the principal neuron were unrelated. Finally, we examined the impact of spikelets on the principal neuron's membrane potential; we did observe some records for which spikelets were correlated with the membrane potential of the principal neuron, suggesting that these neurons were synaptically coupled or received common input from the cortical network.

Spatiotemporal characteristics of surround suppression in primary visual cortex and lateral geniculate nucleus of the cat

In the primary visual cortex (V1), a neuronal response to stimulation of the classical receptive field (CRF) is predominantly suppressed by a stimulus presented outside the CRF (extraclassical receptive field, ECRF), a phenomenon referred to as ECRF suppression. To elucidate the neuronal mechanisms and origin of ECRF suppression in V1 of anesthetized cats, we examined the temporal properties of the spatial extent and orientation specificity of ECRF suppression in V1 and the lateral geniculate nucleus (LGN), using stationary-flashed sinusoidal grating. In V1, we found three components of ECRF suppression: 1) local and fast, 2) global and fast, and 3) global and late. The local and fast component, which resulted from within 2° of the boundary of the CRF, started no more than 10 ms after the onset of the CRF response and exhibited low specificity for the orientation of the ECRF stimulus. These spatiotemporal properties corresponded to those of geniculate ECRF suppression, suggesting that the local and fast component of V1 is inherited from the LGN. In contrast, the two global components showed rather large spatial extents ∼5° from the CRF boundary and high specificity for orientation, suggesting that their possible origin is the cortex, not the LGN. Correspondingly, the local component was observed in all neurons of the thalamocortical recipient layer, while the global component was biased toward other layers. Therefore, we conclude that both subcortical and cortical mechanisms with different spatiotemporal properties are involved in ECRF suppression.

Emerging feed-forward inhibition allows the robust formation of direction selectivity in the developing ferret visual cortex

The computation of direction selectivity requires that a cell respond to joint spatial and temporal characteristics of the stimulus that cannot be separated into independent components. Direction selectivity in ferret visual cortex is not present at the time of eye opening but instead develops in the days and weeks following eye opening in a process that requires visual experience with moving stimuli. Classic Hebbian or spike timing-dependent modification of excitatory feed-forward synaptic inputs is unable to produce direction-selective cells from unselective or weakly directionally biased initial conditions because inputs eventually grow so strong that they can independently drive cortical neurons, violating the joint spatial-temporal activation requirement. Furthermore, without some form of synaptic competition, cells cannot develop direction selectivity in response to training with bidirectional stimulation, as cells in ferret visual cortex do. We show that imposing a maximum lateral geniculate nucleus (LGN)-to-cortex synaptic weight allows neurons to develop direction-selective responses that maintain the requirement for joint spatial and temporal activation. We demonstrate that a novel form of inhibitory plasticity, postsynaptic activity-dependent long-term potentiation of inhibition (POSD-LTPi), which operates in the developing cortex at the time of eye opening, can provide synaptic competition and enables robust development of direction-selective receptive fields with unidirectional or bidirectional stimulation. We propose a general model of the development of spatiotemporal receptive fields that consists of two phases: an experience-independent establishment of initial biases, followed by an experience-dependent amplification or modification of these biases via correlation-based plasticity of excitatory inputs that compete against gradually increasing feed-forward inhibition.

Diverse visual features encoded in mouse lateral geniculate nucleus

The thalamus is crucial in determining the sensory information conveyed to cortex. In the visual system, the thalamic lateral geniculate nucleus (LGN) is generally thought to encode simple center-surround receptive fields, which are combined into more sophisticated features in cortex, such as orientation and direction selectivity. However, recent evidence suggests that a more diverse set of retinal ganglion cells projects to the LGN. We therefore used multisite extracellular recordings to define the repertoire of visual features represented in the LGN of mouse, an emerging model for visual processing. In addition to center-surround cells, we discovered a substantial population with more selective coding properties, including direction and orientation selectivity, as well as neurons that signal absence of contrast in a visual scene. The direction and orientation selective neurons were enriched in regions that match the termination zones of direction selective ganglion cells from the retina, suggesting a source for their tuning. Together, these data demonstrate that the mouse LGN contains a far more elaborate representation of the visual scene than current models posit. These findings should therefore have a significant impact on our understanding of the computations performed in mouse visual cortex.

Mechanisms of direction selectivity in cat primary visual cortex as revealed by visual adaptation

In contrast to neurons of the lateral geniculate nucleus (LGN), neurons in the primary visual cortex (V1) are selective for the direction of visual motion. Cortical direction selectivity could emerge from the spatiotemporal configuration of inputs from thalamic cells, from intracortical inhibitory interactions, or from a combination of thalamic and intracortical interactions. To distinguish between these possibilities, we studied the effect of adaptation (prolonged visual stimulation) on the direction selectivity of intracellularly recorded cortical neurons. It is known that adaptation selectively reduces the responses of cortical neurons, while largely sparing the afferent LGN input. Adaptation can therefore be used as a tool to dissect the relative contribution of afferent and intracortical interactions to the generation of direction selectivity. In both simple and complex cells, adaptation caused a hyperpolarization of the resting membrane potential (-2.5 mV, simple cells, -0.95 mV complex cells). In simple cells, adaptation in either direction only slightly reduced the visually evoked depolarization; this reduction was similar for preferred and null directions. In complex cells, adaptation strongly reduced visual responses in a direction-dependent manner: the reduction was largest when the stimulus direction matched that of the adapting motion. As a result, adaptation caused changes in the direction selectivity of complex cells: direction selectivity was reduced after preferred direction adaptation and increased after null direction adaptation. Because adaptation in the null direction enhanced direction selectivity rather than reduced it, it seems unlikely that inhibition from the null direction is the primary mechanism for creating direction selectivity.

Spatial and temporal features of synaptic to discharge receptive field transformation in cat area 17

The aim of the present study was to characterize the spatial and temporal features of synaptic and discharge receptive fields (RFs), and to quantify their relationships, in cat area 17. For this purpose, neurons were recorded intracellularly while high-frequency flashing bars were used to generate RFs maps for synaptic and spiking responses. Comparison of the maps shows that some features of the discharge RFs depended strongly on those of the synaptic RFs, whereas others were less dependent. Spiking RF duration depended poorly and spiking RF amplitude depended moderately on those of the underlying synaptic RFs. At the other extreme, the optimal spatial frequency and phase of the discharge RFs in simple cells were almost entirely inherited from those of the synaptic RFs. Subfield width, in both simple and complex cells, was less for spiking responses compared with synaptic responses, but synaptic to discharge width ratio was relatively variable from cell to cell. When considering the whole RF of simple cells, additional variability in width ratio resulted from the presence of additional synaptic subfields that remained subthreshold. Due to these additional, subthreshold subfields, spatial frequency tuning predicted from synaptic RFs appears sharper than that predicted from spiking RFs. Excitatory subfield overlap in spiking RFs was well predicted by subfield overlap at the synaptic level. When examined in different regions of the RF, latencies appeared to be quite variable, but this variability showed negligible dependence on distance from the RF center. Nevertheless, spiking response latency faithfully reflected synaptic response latency.

Spatiotemporal organization of simple-cell receptive fields in area 18 of cat's cortex

Spatiotemporal structures of receptive-fields (RF) have been studied for simple cells in area 18 of eat by measuring the temporal transfer function (TTF) over different locations (subregions) within the RF. The temporal characteristics of different subregions differed from each other in the absolute phase shift (APS) to visual stimuli. Two types of relationships can be seen: (i)The APS varied continuously from one subregion to the next: (ii) A 180 degrees -phase jump was seen as the stimulus position changed somewhere within the receptive field. Spatiotemporal receptive field profiles have been determined by applying reverse Fourier analysis to responses in the frequency domain. For the continuous type, spatial and temporal characteristics cannot be dissociated (space time inseparable) and the spatiotemporal structure is oriented. On the contrary, the spatial and temporal characteristics for the jumping type can be dissociated (space-time separable) and the structure is not oriented in the space-time plane. Based on the APSs measured at different subregions, the optimal direction of motion and optimal spatial frequency of neurons can be predicted.

Lack of orientation and direction selectivity in a subgroup of fast-spiking inhibitory interneurons: cellular and synaptic mechanisms and comparison with other electrophysiological cell types

Neurons in cat area 17 can be grouped in 4 different electrophysiological cell classes (regular spiking, intrinsically bursting, chattering, and fast spiking [FS]). However, little is known of the functional properties of these different cell classes. Here we compared orientation and direction selectivity between these cell classes in cat area 17 and found that a subset of FS inhibitory neurons, usually with complex receptive fields, exhibited little selectivity in comparison with other cell types. Differences in occurrence and amplitude of gamma-range membrane fluctuations, as well as in numbers of action potentials in response to optimal visual stimuli, did not parallel differences observed for orientation and direction selectivity. Instead, differences in selectivity resulted mostly from differences in tuning of the membrane potential responses, although variations in spike threshold also contributed: weakly selective FS neurons exhibited both a lower spike threshold and more broadly tuned membrane potential responses in comparison with the other cell classes. Our results are consistent with the hypothesis that a subgroup of FS neurons receives connections and possesses intrinsic properties allowing the generation of weakly selective responses. The existence of weakly selective inhibitory neurons is consistent with orientation selectivity models that rely on broadly tuned inhibition.

A dynamic nonlinearity and spatial phase specificity in macaque V1 neurons

While studying the visual response dynamics of neurons in the macaque primary visual cortex (V1), we found a nonlinearity of temporal response that influences the visual functions of V1 neurons. Simple cells were recorded in all layers of V1; the nonlinearity was strongest in neurons located in layer 2/3. We recorded the spike responses to optimal sinusoidal gratings that were displayed for 100 ms, a temporal step response. The step responses were measured at many spatial phases of the grating stimulus. To judge whether simple cell behavior was consistent with linear temporal integration, the decay of the 100 ms step response at the preferred spatial phase was used to predict the step response at the opposite spatial phase. Responses in layers 4B and 4C were mostly consistent with a linear-plus-static-nonlinearity cascade model. However, this was not true in layer 2/3 where most cells had little or no step responses at the opposite spatial phase. Many layer 2/3 cells had transient preferred-phase responses but did not respond at the offset of the opposite-phase stimuli, indicating a dynamic nonlinearity. A different stimulus sequence, rapidly presented random sinusoids, also produced the same effect, with layer 2/3 simple cells exhibiting elevated spike rates in response to stimuli at one spatial phase but not 180 degrees away. The presence of a dynamic nonlinearity in the responses of V1 simple cells indicates that first-order analyses often capture only a fraction of neuronal behavior. The visual implication of our results is that simple cells in layer 2/3 are spatial phase-sensitive detectors that respond to contrast boundaries of one sign but not the opposite.

Contrast affects speed tuning, space-time slant, and receptive-field organization of simple cells in macaque V1

We measured speed tuning of V1 cells in alert macaques to high- and low-contrast stimuli. Most V1 cells tested, both simple and complex and directional as well as nondirectional, shifted their speed tuning to slower speeds for lower contrast stimuli. We found that the space-time slant of the receptive field of directional simple cells differed for high- and low-contrast stimuli, with the space-time slant predicting higher optimum speeds for the higher-contrast stimuli; i.e., there was a larger spatial shift of the receptive-field organization per unit time. Not only did the space-time maps of directional simple cells show different slants between high- and low-contrast stimuli, but they also showed a different organization, because for high-contrast stimuli, the maps tended to show a complete inversion of the receptive-field spatial organization at long delays after stimulus onset, with initial excitation followed by suppression and initial suppression followed by excitation, but for low-contrast stimuli the receptive-field organization showed only a quadrature shift over time. We show that a simple modification of earlier models for the generation of direction-selective simple cells can account for these observations.

Direction selectivity of simple cells in the primary visual cortex: comparison of two alternative mathematical models. II: Velocity tuning and response to moving bars

The two models of direction selectivity, presented in a previous paper, are used to investigate the response of simple cells to moving bars with different length, luminance and orientation. Most results agree with experimental data reported in the literature. However, a striking difference between the models is observable after a reduction in bar length. The antiphase model predicts that the optimal direction of movement for a short bar is equal to the optimal direction for a long bar, whereas the in-phase model predicts that the two optimal directions are orthogonal. This difference may allow experimental discrimination between the two models.

Direction selectivity of simple cells in the primary visual cortex: comparison of two alternative mathematical models. I: response to drifting gratings

Two models of a single hypercolumn in the primary visual cortex are presented, and used for the analysis of direction selectivity in simple cells. The two models differ as to the arrangement of inhibitory connections: in the first ("antiphase model") inhibition is in phase opposition with excitation, but with a similar orientation tuning; in the second ("in-phase model"), inhibition is in phase with excitation, but with broader orientation tuning. Simulation results, performed by using drifting gratings with different orientations, and different spatial and temporal frequencies, show that both models are able to explain the origin of direction preference of simple cells.

Direction selectivity of neurons in the striate cortex increases as stimulus contrast is decreased

Various properties of external scenes are integrated during the transmission of information along central visual pathways. One basic property concerns the sensitivity to direction of a moving stimulus. This direction selectivity (DS) is a fundamental response characteristic of neurons in the visual cortex. We have conducted a neurophysiological study of cells in the visual cortex to determine how DS is affected by changes in stimulus contrast. Previous work shows that a neuron integration time is increased at low contrasts, causing temporal changes of response properties. This leads to the prediction that DS should change with stimulus contrast. However, the change could be in a counterintuitive direction, i.e., DS could increase with reduced contrast. This possibility is of intrinsic interest but it is also of potential relevance to recent behavioral work in which human subjects exhibit increased DS as contrast is reduced. Our neurophysiological results are consistent with this finding, i.e., the degree of DS of cortical neurons is inversely related to stimulus contrast. Temporal phase differences of inputs to cortical cells may account for this result.

Temporal Properties of Inputs to Direction-Selective Neurons in Monkey V1

Motion in the visual scene is processed by direction-selective neurons in primary visual cortex. These cells receive inputs that differ in space and time. What are these inputs? A previous single-unit recording study in anesthetized monkey V1 proposed that the two major streams arising in the primate retina, the M and P pathways, differed in space and time as required to create direction selectivity. We confirmed that cortical cells driven by P inputs tend to have sustained responses. The M pathway, however, as assessed by recordings in layer 4Cα and from cells with high contrast sensitivity, is not purely transient. The diversity of timing in the M stream suggests that combinations of M inputs, as well as of M and P inputs, create direction selectivity.

Opponent-motion mechanisms are self-normalizing

In the ultimate stage of the Adelson-Bergen motion energy model [Adelson, E. H., & Bergen, J. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America, 2, 284-299], motion is derived from the difference between directionally opponent energies E(L) and E(R). However, Georgeson and Scott-Samuel [Georgeson, M. A., & Scott-Samuel, N. E. (1999). Motion contrast: A new metric for direction discrimination. Vision Research, 39, 4393-4402] demonstrated that motion contrast-a metric that normalizes opponent motion energy (E(L)-E(R)) by flicker energy (E(L)+E(R))-is a better descriptor of human direction discrimination. In a previous study [Rainville, S. J. M., Makous, W. L., & Scott-Samuel, N. E. (2002). The spatial properties of opponent-motion normalization. Vision Research, 42, 1727-1738], we used a lateral masking paradigm to show that opponent-motion normalization is selective for flicker position, orientation, and spatial-frequency. In the present study, we used a superposition masking paradigm and compared results to lateral masking data, as the two masking types activate local and remote normalization mechanisms differentially. Although selectivity for flicker orientation and spatial frequency varied across observers, bandwidths were similar across lateral and superimposed masking conditions. Additional experiments demonstrated that normalization signals are pooled over a spatial region whose aspect ratio and size are consistent with those of local motion detectors. Together, results show no evidence of remote normalization signals predicted by broadband inhibitory models [(e.g.) Heeger, D. J. (1992). Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9, 181-197; Foley, J. M. (1994). Human luminance pattern-vision mechanisms: Masking experiments require a new model. Journal of the Optical Society of America A-Optics and Image Science, 11, 1710-1719] but support a local normalization process whose spatial properties are inherited from low-level motion detectors.

Direction selectivity of excitation and inhibition in simple cells of the cat primary visual cortex

Direction selectivity in simple cells of primary visual cortex, defined from their spike responses, cannot be predicted using linear models. It has been suggested that the shunting inhibition evoked by visual stimulation is responsible for the nonlinear component of direction selectivity. Cortical inhibition would suppress a neuron's firing when stimuli move in the nonpreferred direction, but would allow responses to stimuli in the preferred direction. Models of direction selectivity based solely on input from the lateral geniculate nucleus, however, propose that the nonlinear response is caused by spike threshold. By extracting excitatory and inhibitory components of synaptic inputs from intracellular records obtained in vivo, we demonstrate that excitation and inhibition are tuned for the same direction, but differ in relative timing. Further, membrane potential responses combine in a linear fashion. Spike threshold, however, quantitatively accounts for the nonlinear component of direction selectivity, amplifying the direction selectivity of spike output relative to that of synaptic inputs.

A nonlinear model of the behavior of simple cells in visual cortex

Despite their structured receptive fields (RFs) and the strong linear components in their responses, most simple cells in mammalian visual cortex exhibit nonlinear behaviors. Besides the contrast-response function, nonlinearities are evident in various types of failure at superposition tasks, in the disagreement between direction indices computed from drifting and counterphase flickering gratings, in various forms of response suppression (including end- and side-stopping, spatial-frequency-specific inhibition and cross-orientation inhibition), in the advance of phase with increasing contrast, and in phase-insensitive and frequency-doubled responses to counterphase flickering gratings. These behaviors suggest that nonlinearities are involved in the operation of simple cells, but current models fail to explain them. A quantitative model is presented here that purports to describe basic and common principles of operation for all visual cortical cells. Simple cells are described as receiving afferents from multiple subunits that differ in their individual RFs and temporal impulse responses (TIRs). Subunits are independent and perform a spatial integration across their RFs followed by halfwave rectification and temporal convolution with their TIRs. This parallel operation yields a set of temporal functions representing each subunit's contribution to the membrane potential of the host cell, whose final form is given by the weighted sum of all subunits' contributions. By varying the number of subunits and their particular characteristics, different instances of the model are obtained each of which displays a different set of behaviors. Extensive simulation results are presented that illustrate how all of the reported nonlinear behaviors of simple cells arise from these multi-subunit organizations.

The derivation of direction selectivity in the striate cortex

In the central visual pathway of binocular animals, the property of directional selectivity (DS) is first exhibited in striate cortex. In this study, we sought to determine the neural circuitry underlying the transformation from non-DS neurons to DS cortical cells. In a well established model, DS receptive fields (RFs) are derived from the sum of two non-DS inputs with 90 degrees (quadrature) spatiotemporal phase differences. We explored possible input sources for this model, which include non-DS simple cells and lateral geniculate nucleus (LGN) neurons, by examination of spatiotemporal RFs of single cells and of pairs of cells. We find that distributions of non-DS simple RFs do not match the temporal predictions of the quadrature model because of a lack of long-latency responses. The long-latency inputs could potentially arise from lagged LGN afferents. However, analysis of cell pairs indicates that DS cells receive cortical input from non-DS simple cells for both short- and long-latency components, with temporal phase differences typically <90 degrees. Furthermore, the distribution of minimum phase differences needed to generate DS cells overlaps that exhibited by non-DS simple cells. Considered together, these results are consistent with a linear model whereby DS simple cells are formed from simple-cell inputs, with temporal phase differences often less than quadrature.

Visual cortex neurons of monkeys and cats: temporal dynamics of the spatial frequency response function

We measured the responses of striate cortex neurons as a function of spatial frequency on a fine time scale, over the course of an interval that is comparable to the duration of a single fixation (200 ms). Stationary gratings were flashed on for 200 ms and then off for 300 ms; the responses were analyzed at sequential 1-ms intervals. We found that 1) the preferred spatial frequency shifts through time from low frequencies to high frequencies, 2) the latency of the response increases as a function of spatial frequency, and 3) the poststimulus time histograms (PSTHs) are relatively shape-invariant across spatial frequency. The dynamic shifts in preferred spatial frequency appear to be a simple consequence of the latency shifts and the transient nature of the PSTH. The effects of these dynamic shifts on the coding of spatial frequency information are examined within the context of several different temporal integration strategies, and pattern-detection performance is determined as a function of the interval of integration, following response onset. The findings are considered within the context of related investigations as well as a number of functional issues: motion selectivity in depth, "coarse-to-fine" processing, direction selectivity, latency as a code for stimulus attributes, and behavioral response latency. Finally, we demonstrate that the results are qualitatively consistent with a simple feedforward model, similar to the one originally proposed in 1962 by Hubel and Wiesel, that incorporates measured differences in the response latencies and the receptive field sizes of different lateral geniculate nucleus inputs.

Sampling efficiency and internal noise for motion detection, discrimination, and summation

By comparing real observers to an ideal observer, previous studies have found that the detection of static patterns is limited by internal noise and by imperfect sampling efficiency. We developed and applied ideal observer models for the detection, discrimination, and summation of oppositely drifting gratings in Gaussian white noise. The three tasks share a common source of internal noise. The sampling efficiencies were on the order of 1-2% except for much lower efficiency in direction discrimination for faster moving gratings. The efficiency of direction discrimination relative to detection systematically declines as the speed is increased from 1 to 6 Hz. These results suggest that observers use mismatched filters tuned to slow speeds regardless of the signal speed. Human visual motion sensing appears to use distorted representations of the incoming signals, and this distortion is a major limitation to visual performance.

Space-time maps and two-bar interactions of different classes of direction-selective cells in macaque V-1

We used one-dimensional sparse noise stimuli to generate first-order spatiotemporal maps and second-order two-bar interaction maps for 65 simple and 124 complex direction-selective cells in alert macaque V1. Spatial and temporal phase differences between light and dark space-time maps clearly distinguished simple and complex cell populations. Complex cells usually showed similar direction preferences to light and dark bars, but many of the directional simple cells were much more direction selective to one sign of contrast than the reverse. We show that this is predicted by a simple energy model. Some of the direction-selective simple cells showed multiple space-time-slanted subregions, but others (previously described as S1 cells) had space-time maps that looked like just one subregion of an ordinary simple cell. Both simple and complex cells showed directional interactions (nonlinearities) to pairs of flashed bars (a 2-bar apparent-motion stimulus). The space-time slant of the simple cells correlated with the optimum dX/dT (velocity) of the paired-bar interactions. Some complex cells also showed a space-time slant; the direction of the slant usually correlated with the preferred direction of motion, but the degree of slant correlated with the inferred velocity tuning only when measured by a weighted-centroid calculation. Principal components analysis of the simple-cell space-time maps yielded one fast temporally biphasic component and a slower temporally monophasic component. We saw no consistent pattern for the spatial phase of the components, unlike previous reports; however, we show that principal components analysis may not distinguish between spatial offsets and phase offsets.

Computational subunits of visual cortical neurons revealed by artificial neural networks

A crucial step toward understanding visual processing is to obtain a comprehensive description of the relationship between visual stimuli and neuronal responses. Many neurons in the visual cortex exhibit nonlinear responses, making it difficult to characterize their stimulus-response relationships. Here, we recorded the responses of primary visual cortical neurons of the cat to spatiotemporal random-bar stimuli and trained artificial neural networks to predict the response of each neuron. The random initial connections in the networks consistently converged to regular patterns. Analyses of these connection patterns showed that the response of each complex cell to the random-bar stimuli could be well approximated by the sum of a small number of subunits resembling simple cells. The direction selectivity of each complex cell measured with drifting gratings was also well predicted by the combination of these subunits, indicating the generality of the model. These results are consistent with a simple functional model for complex cells and demonstrate the usefulness of the neural network method for revealing the stimulus-response transformations of nonlinear neurons.

The spatial properties of opponent-motion normalization

The final stage of the Adelson-Bergen model [J. Opt. Soc. Am. A 2 (1985) 284] computes net motion as the difference between directionally opposite energies E(L) and E(R). However, Georgeson and Scott-Samuel [Vis. Res. 39 (1999) 4393] found that human direction discrimination is better described by motion contrast (C(m))--a metric where opponent energy (E(L)-E(R)) is divided by flicker energy (E(L)+E(R)). In the present paper, we used a lateral masking paradigm to investigate the spatial properties of flicker energy involved in the normalization of opponent energy. Observers discriminated between left and right motion while viewing a checkerboard in which half of the checks contained a drifting sinusoid and the other half contained flicker (i.e. a counterphasing sinusoid). The relative luminance contrasts of flicker and motion checks determined the checkerboard's overall motion contrast C(m). We obtained selectivity functions for opponent-motion normalization by measuring C(m) thresholds whilst varying the orientation, spatial frequency, or size of flicker checks. In all conditions, performance (percent correct) decayed lawfully as we decreased motion contrast, validating the C(m) metric for our stimuli. Thresholds decreased with check size and also improved as we increased either the orientation or spatial-frequency difference between motion and flicker checks. Our data are inconsistent with Heeger-type normalization models [Vis. Neurosci. 9 (1992) 181] in which excitatory inputs are normalized by a non-selective pooling of inhibitory inputs, but data are consistent with the implicit assumption in Georgeson and Scott-Samuel's model that flicker normalization is localized in orientation, scale, and space. However, our lateral masking paradigm leaves open the possibility that the spatial properties of flicker normalization would be different if opponent and flicker energies spatially overlapped. Further characterization of motion contrast will require models of the spatial, temporal, and joint space-time properties of mechanisms mediating opponent-motion and flicker normalization.

Development of response timing and direction selectivity in cat visual thalamus and cortex

Single-unit recordings were made in the dorsal lateral geniculate nucleus (LGN) and visual cortex of kittens that were 4-13 weeks of age. Responses to visual stimuli were analyzed to determine the relationship between two related facets of the behaviors of the cells: direction selectivity (DS) and timing. DS depends on timing differences within the receptive field. Cortical DS was present at all ages, but its temporal frequency tuning changed. In kittens, DS was more common at high (approximately 4 Hz) than low ( approximately 1 Hz) temporal frequencies. This is in contrast to adults, in which DS is tuned to low frequencies, more common at 1 Hz than at 4 Hz (Saul and Humphrey, 1992a). In adult cats, the LGN provides the cortex with a wide range of timings that are also observable in cortical receptive fields (Saul and Humphrey, 1990, 1992b; Alonso et al., 2001). In kittens, LGN and cortical timing were immature. Most cells showed long-latency sustained responses. At low temporal frequencies, the variance in timing was small, but at higher frequencies, all timings were well represented. The timing data thus matched the temporal frequency tuning of DS. Kittens show DS at high temporal frequencies because of the abundance of inputs with different timing at high frequencies. As cells in the LGN mature, more low-frequency timing differences become available to the cortex, allowing DS at low frequencies to become possible for more cortical cells.

RAP: a new framework for visual categorization

Cognitive science might almost be defined as several disciplines communicating their different perspectives on the mind, the common object of study. However, domain-specific concepts and techniques can prevent, rather than foster, a communication of viewpoints. In this article, we develop a new framework for visual categorization in which the interaction between Represented (R) information and Available (A) information determine the Potent (P) information (symbolically, R ? A approximately P). We argue and illustrate that this framework helps to establish a common language to articulate issues common to low-, mid-, and high-level vision. More importantly, we present new techniques with which to visualize the so-far elusive constructs of representation and potent information.

Processing of second-order stimuli in the visual cortex

Naturally occurring visual stimuli are rich in examples of objects delineated from their backgrounds simply by differences in luminance, so-called first-order stimuli, as well as those defined by differences of contrast or texture, referred to as second-order stimuli. Here we provide a brief overview of visual cortical processing of second-order stimuli, as well as some comparative background on first-order processing, concentrating on single-unit neurophysiology, but also discussing relationships to human psychophysics and to neuroimaging. The selectivity of visual cortical neurons to orientation, spatial frequency, and direction of movement of first-order, luminance-defined stimuli is conventionally understood in terms of simple linear filter models, albeit with some minor nonlinearities such as thresholding and gain control. However, these kinds of models fail entirely to account for responses of neurons to second-order stimuli such as contrast envelopes, illusory contours, or texture borders. Second-order stimuli constructed from sinusoidal components have been used to analyze the neurophysiological mechanisms of such responses; these experiments demonstrate that the same neuron can exhibit three distinct kinds of tuning to spatial frequency, and also to orientation. These results can be understood in terms of a type of nonlinear 'filter-->rectify-->filter' model, which has been widely used in human psychophysics. Finally, several general issues will be discussed, including potential artifacts in experiments with second-order stimuli, and strategies for avoiding or controlling for them; caveats about definitions of first- vs. second-order mechanisms and stimuli; the concept of form-cue invariance; and the functional significance of second-order processing.

Response correlation maps of neurons in the mammalian olfactory bulb

To define the relationship between glomerular activation patterns and neuronal olfactory responses in the main olfactory bulb, intracellular recordings were combined with optical imaging of intrinsic signals. Response correlation maps (RCMs) were constructed by correlating the fluctuations in membrane potential and firing rate during odorant presentations with patterns of glomerular activation. The RCMs indicated that mitral/tufted cells were excited by activation of a focal region surrounding their principal glomerulus and generally inhibited by activation of more distant regions. However, the structure of the RCMs and the relative contribution of excitatory and inhibitory glomerular input evolved and even changed sign during and after odorant application. These data suggest a dynamic center-surround organization of mitral/tufted cell receptive fields.

Neural dynamics of motion integration and segmentation within and across apertures

A neural model is developed of how motion integration and segmentation processes, both within and across apertures, compute global motion percepts. Figure-ground properties, such as occlusion, influence which motion signals determine the percept. For visible apertures, a line's terminators do not specify true line motion. For invisible apertures, a line's intrinsic terminators create veridical feature-tracking signals. Sparse feature-tracking signals can be amplified before they propagate across position and are integrated with ambiguous motion signals within line interiors. This integration process determines the global percept. It is the result of several processing stages: directional transient cells respond to image transients and input to a directional short-range filter that selectively boosts feature-tracking signals with the help of competitive signals. Then, a long-range filter inputs to directional cells that pool signals over multiple orientations, opposite contrast polarities, and depths. This all happens no later than cortical area MT. The directional cells activate a directional grouping network, proposed to occur within cortical area MST, within which directions compete to determine a local winner. Enhanced feature-tracking signals typically win over ambiguous motion signals. Model MST cells that encode the winning direction feed back to model MT cells, where they boost directionally consistent cell activities and suppress inconsistent activities over the spatial region to which they project. This feedback accomplishes directional and depthful motion capture within that region. Model simulations include the barberpole illusion, motion capture, the spotted barberpole, the triple barberpole, the occluded translating square illusion, motion transparency and the chopsticks illusion. Qualitative explanations of illusory contours from translating terminators and plaid adaptation are also given.

Auditory space-time receptive field dynamics revealed by spherical white-noise analysis

Numerous studies have investigated the spatial sensitivity of cat auditory cortical neurons, but possible dynamic properties of the spatial receptive fields have been largely ignored. Given the considerable amount of evidence that implicates the primary auditory field in the neural pathways responsible for the perception of sound source location, a logical extension to earlier observations of spectrotemporal receptive fields, which characterize the dynamics of frequency tuning, is a description that uses sound source direction, rather than sound frequency, to examine the evolution of spatial tuning over time. The object of this study was to describe auditory space-time receptive field dynamics using a new method based on cross-correlational techniques and white-noise analysis in spherical auditory space. This resulted in a characterization of auditory receptive fields in two spherical dimensions of space (azimuth and elevation) plus a third dimension of time. Further analysis has revealed that spatial receptive fields of neurons in auditory cortex, like those in the visual system, are not static but can exhibit marked temporal dynamics. This might result, for example, in a neuron becoming selective for the direction and speed of moving auditory sound sources. Our results show that approximately 14% of AI neurons evidence significant space-time interaction (inseparability).

Matched filtering in motion detection and discrimination

When humans detect and discriminate visual motion, some neural mechanism extracts the motion information that is embedded in the noisy spatio-temporal stimulus. We show that an ideal mechanism in a motion discrimination experiment cross-correlates the received waveform with the signals to be discriminated. If the human visual system uses such a cross-correlator mechanism, discrimination performance should depend on the cross-correlation between the two signals. Manipulations of the signals' cross-correlation using differences in the speed and phase of moving gratings produced the predicted changes in the performance of human observers. The cross-correlator's motion performance improves linearly as contrast increases and human performance is similar. The ideal cross-correlator can be implemented by passing the stimulus through linear spatio-temporal filters matched to the signals. We propose that directionally selective simple cells in the striate cortex serve as matched filters during motion detection and discrimination.

Spatial and temporal receptive fields of geniculate and cortical cells and directional selectivity

The spatio-temporal receptive fields (RFs) of cells in the macaque monkey lateral geniculate nucleus (LGN) and striate cortex (V1) have been examined and two distinct sub-populations of non-directional V1 cells have been found: those with a slow largely monophasic temporal RF, and those with a fast very biphasic temporal response. These two sub-populations are in temporal quadrature, the fast biphasic cells crossing over from one response phase to the reverse just as the slow monophasic cells reach their peak response. The two sub-populations also differ in the spatial phases of their RFs. A principal components analysis of the spatio-temporal RFs of directional V1 cells shows that their RFs could be constructed by a linear combination of two components, one of which has the temporal and spatial characteristics of a fast biphasic cell, and the other the temporal and spatial characteristics of a slow monophasic cell. Magnocellular LGN cells are fast and biphasic and lead the fast-biphasic V1 subpopulation by 7 ms; parvocellular LGN cells are slow and largely monophasic and lead the slow monophasic V1 sub-population by 12 ms. We suggest that directional V1 cells get inputs in the approximate temporal and spatial quadrature required for motion detection by combining signals from the two non-directional cortical sub-populations which have been identified, and that these sub-populations have their origins in magno and parvo LGN cells, respectively.

Feedback connections act on the early part of the responses in monkey visual cortex

We previously showed that feedback connections from MT play a role in figure/ground segmentation. Figure/ground coding has been described at the V1 level in the late part of the neuronal responses to visual stimuli, and it has been suggested that these late modulations depend on feedback connections. In the present work we tested whether it actually takes time for this information to be fed back to lower order areas. We analyzed the extracellular responses of 169 V1, V2, and V3 neurons that we recorded in two anesthetized macaque monkeys. MT was inactivated by cooling. We studied the time course of the responses of the neurons that were significantly affected by the inactivation of MT to see whether the effects were delayed relative to the onset of the response. We first measured the time course of the feedback influences from MT on V1, V2, and V3 neurons tested with moving stimuli. For the large majority of the 51 neurons for which the response decreased, the effect was present from the beginning of the response. In the responses averaged after normalization, the decrease of response was significant in the first 10-ms bin of response. A similar result was found for six neurons for which the response significantly increased when MT was inactivated. We then looked at the time course of the responses to flashed stimuli (95 neurons). We observed 15 significant decreases of response and 14 significant increases. In both populations, the effects were significant within the first 10 ms of response. For some neurons with increased responses we even observed a shorter latency when MT was inactivated. We measured the latency of the response to the flashed stimuli. We found that even the earliest responding neurons were affected early by the feedback from MT. This was true for the response to flashed and to moving stimuli. These results show that feedback connections are recruited very early for the treatment of visual information. It further indicates that the presence or absence of feedback effects cannot be deduced from the time course of the response modulations.

Computational modeling of orientation tuning dynamics in monkey primary visual cortex

In the primate visual pathway, orientation tuning of neurons is first observed in the primary visual cortex. The LGN cells that comprise the thalamic input to V1 are not orientation tuned, but some V1 neurons are quite selective. Two main classes of theoretical models have been offered to explain orientation selectivity: feedforward models, in which inputs from spatially aligned LGN cells are summed together by one cortical neuron; and feedback models, in which an initial weak orientation bias due to convergent LGN input is sharpened and amplified by intracortical feedback. Recent data on the dynamics of orientation tuning, obtained by a cross-correlation technique, may help to distinguish between these classes of models. To test this possibility, we simulated the measurement of orientation tuning dynamics on various receptive field models, including a simple Hubel-Wiesel type feedforward model: a linear spatiotemporal filter followed by an integrate-and-fire spike generator. The computational study reveals that simple feedforward models may account for some aspects of the experimental data but fail to explain many salient features of orientation tuning dynamics in V1 cells. A simple feedback model of interacting cells is also considered. This model is successful in explaining the appearance of Mexican-hat orientation profiles, but other features of the data continue to be unexplained.

Membrane potential and firing rate in cat primary visual cortex

We have investigated the relationship between membrane potential and firing rate in cat visual cortex and found that the spike threshold contributes substantially to the sharpness of orientation tuning. The half-width at half-height of the tuning of the spike responses was 23 +/- 8 degrees, compared with 38 +/- 15 degrees for the membrane potential responses. Direction selectivity was also greater in spike responses (direction index, 0.61 +/- 0.35) than in membrane potential responses (0.28 +/- 0.21). Threshold also increased the distinction between simple and complex cells, which is commonly based on the linearity of the spike responses to drifting sinusoidal gratings. In many simple cells, such stimuli evoked substantial elevations in the mean potential, which are nonlinear. Being subthreshold, these elevations would be hard to detect in the firing rate responses. Moreover, just as simple cells displayed various degrees of nonlinearity, complex cells displayed various degrees of linearity. We fitted the firing rates with a classic rectification model in which firing rate is zero at potentials below a threshold and grows linearly with the potential above threshold. When the model was applied to a low-pass-filtered version of the membrane potential (with spikes removed), the estimated values of threshold (-54.4 +/- 1.4 mV) and linear gain (7.2 +/- 0.6 spikes. sec(-1). mV(-1)) were similar across the population. The predicted firing rates matched the observed firing rates well and accounted for the sharpening of orientation tuning of the spike responses relative to that of the membrane potential. As it was for stimulus orientation, threshold was also independent of stimulus contrast. The rectification model accounted for the dependence of spike responses on contrast and, because of a stimulus-induced tonic hyperpolarization, for the response adaptation induced by prolonged stimulation. Because gain and threshold are unaffected by visual stimulation and by adaptation, we suggest that they are constant under all conditions.

Motion contrast: a new metric for direction discrimination

The Adelson-Bergen energy model (Adelson, E. H., & Bergen, J. R. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A, 2, 284-299) is a standard framework for understanding first-order motion processing. The opponent energy for a given input is calculated by subtracting one directional energy measure (EL) from its opposite (ER), and its sign indicates the direction of motion of the input. Our observers viewed a dynamic sequence of gratings (1 c/deg) equivalent to the sum of two gratings moving in opposite directions with different contrasts. The ratio of contrasts was varied across trials. We found that opponent energy was a very poor predictor of direction discrimination performance. Heeger (1992). Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9, 181-197) has suggested that divisive inhibition amongst striate cells requires a contrast gain control in the energy model. A new metric can be formulated in the spirit of Heeger's model by normalising the opponent energy (EL - ER) with flicker energy, the sum of the directional motion energies (EL + ER). This new measure, motion contrast (EL - ER)/(EL + ER), was found to be a good predictor of direction discrimination performance over a wide range of contrast levels, but opponent energy was not. Discrimination thresholds expressed as motion contrast were around 0.5 +/- 0.1 for the sampled drifting gratings used in our experiments. We show that the dependence on motion contrast, and the threshold of about 0.5, can be predicted by a modified opponent energy model based on current knowledge of the response functions and response variance of cortical cells.

Direction selectivity and spatiotemporal separability in simple cortical cells

Simple cells in mammalian visual cortex are quasi-linear mechanisms whose behavior departs from true linearity in a very consistent manner. Empirical research on direction selectivity (DS) clearly illustrates these characteristics. A linear DS cell will be DS for all stimuli, whereas a linear non-DS cell will not be DS for any stimuli. However, many simple cells have opposite preferred directions for stimuli of reversed polarity, and some cells are DS for some stimuli (e.g., moving bars) but not for others (e.g., drifting gratings). Also, linear non-DS cells must have separable spatiotemporal receptive fields (RFs), and linear DS cells must have inseparable RFs. Yet many actual DS cells have separable RFs. Here we present a nonlinear model of simple-cell behavior that reproduces all of these empirical behaviors. The model is a variant of the current linear model, amended to include an interleaved nonlinearity (half-wave rectification) that allows it to mimic the (im)balance of push-pull mechanisms. We present simulation results showing that balanced push-pull mechanisms result in linear behavior, while imbalanced push-pull arrangements produce all of the incongruent DS-related behaviors that have been reported for simple cells.

Functional micro-organization of primary visual cortex: receptive field analysis of nearby neurons

It is well established that multiple stimulus dimensions (e.g., orientation and spatial frequency) are mapped onto the surface of striate cortex. However, the detailed organization of neurons within a local region of striate cortex remains unclear. Within a vertical column, do all neurons have the same response selectivities? And if not, how do they most commonly differ and why? To address these questions, we recorded from nearby pairs of simple cells and made detailed spatiotemporal maps of their receptive fields. From these maps, we extracted and analyzed a variety of response metrics. Our results provide new insights into the local organization of striate cortex. First, we show that nearby neurons seldom have very similar receptive fields, when these fields are characterized in space and time. Thus, there may be less redundancy within a column than previously thought. Moreover, we show that correlated discharge increases with receptive field similarity; thus, the local dissimilarity between neurons may allow for noise reduction by response pooling. Second, we show that several response variables are clustered within striate cortex, including some that have not received much attention such as response latency and temporal frequency. We also demonstrate that other parameters are not clustered, including the spatial phase (or symmetry) of the receptive field. Third, we show that spatial phase is the single parameter that accounts for most of the difference between receptive fields of nearby neurons. We consider the implications of this local diversity of spatial phase for population coding and construction of higher-order receptive fields.

Inhibitory contributions to spatiotemporal receptive-field structure and direction selectivity in simple cells of cat area 17

Intracortical inhibition contributes to direction selectivity in primary visual cortex, but how it acts has been unclear. We investigated this problem in simple cells of cat area 17 by taking advantage of the link between spatiotemporal (S-T) receptive-field structure and direction selectivity. Most cells in layer 4 have S-T-oriented receptive fields in which gradients of response timing across the field confer a preferred direction of motion. Linear summation of responses across the receptive field, followed by a static nonlinear amplification, has been shown previously to account for directional tuning in layer 4. We tested the hypotheses that inhibition acts by altering S-T structure or the static nonlinearity or both. Drifting and counterphasing sine wave gratings were used to measure direction selectivity and S-T structure, respectively, in 17 layer 4 simple cells before and during iontophoresis of bicuculline methiodide (BMI), a GABAA antagonist. S-T orientation was quantified from fits to response temporal phase versus stimulus spatial phase data. Bicuculline reduced direction selectivity and S-T orientation in nearly all cells, and reductions in the two measures were well correlated (r = 0.81) and reversible. Using conventional linear predictions based on response phase and amplitude, we found that BMI-induced changes in S-T structure also accounted well for absolute changes in the amplitude and phase of responses to gratings drifting in the preferred and nonpreferred direction. For each cell we also calculated an exponent used to estimate the static nonlinearity. Bicuculline reduced the exponent in most cells, but the changes were not correlated with reductions in direction selectivity. We conclude that GABAA-mediated inhibition influences directional tuning in layer 4 primarily by sculpting S-T receptive-field structure. The source of the inhibition is likely to be other simple cells with certain spatiotemporal relationships to their target. Despite reductions in the two measures, most receptive fields maintained some directional tuning and S-T orientation during BMI. This suggests that their excitatory inputs, arising from the lateral geniculate nucleus and within area 17, are sufficient to create some S-T orientation and that inhibition accentuates it. Finally, BMI also reduced direction selectivity in 8 of 10 simple cells tested in layer 6, but the reductions were not accompanied by systematic changes in S-T structure. This reflects the fact that S-T orientation, as revealed by our first-order measures of the receptive field, is weak there normally. Inhibition likely affects layer 6 cells via more complex, nonlinear interactions.

Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4

We examined how attention affected the orientation tuning of 262 isolated neurons in extrastriate area V4 and 135 neurons in area V1 of two rhesus monkeys. The animals were trained to perform a delayed match-to-sample task in which oriented stimuli were presented in the receptive field of the neuron being recorded. On some trials the animals were instructed to pay attention to those stimuli, and on other trials they were instructed to pay attention to other stimuli outside the receptive field. In this way, orientation-tuning curves could be constructed from neuronal responses collected in two behavioral states: one in which those stimuli were attended by the animal and one in which those stimuli were ignored by the animal. We fit Gaussians to the neuronal responses to twelve different orientations for each behavioral state. Although attention enhanced the responses of V4 neurons (median 26% increase) and V1 neurons (median 8% increase), selectivity, as measured by the width of its orientation-tuning curve, was not systematically altered by attention. The effects of attention were consistent with a multiplicative scaling of the driven response to all orientations. We also found that attention did not cause systematic changes in the undriven activity of the neurons.

Strobe rearing prevents the convergence of inputs with different response timings onto area 17 simple cells

Strobe rearing prevents the convergence of inputs with different response timings onto area 17 simple cells. J. Neurophysiol. 80: 3005-3020, 1998. The preceding paper showed that the loss of direction selectivity in simple cells induced by strobe rearing reflects the elimination of spatially ordered response timing differences across the receptive field that underlie spatiotemporal (S-T) inseparability. Here we addressed whether these changes reflected an elimination of certain timings or an alteration in how timings were associated in single cells. Timing in receptive fields was measured using stationary bars undergoing sinusoidal luminance modulation at different temporal frequencies (0.5-6 Hz). For each bar position, response phase versus temporal frequency data were fit by a line to obtain two measures: absolute phase and latency. In normal cats, many individual simple cells display a wide range of timings; in layer 4, the mean range for absolute phase and latency was 0.21 cycles and 39 ms, respectively. Strobe rearing compressed the mean timing ranges in single cells, to 0.08 cycles and 31 ms, respectively, and this compression accounted for the loss of inseparability. A similar compression was measured in layer 6 cells. In contrast, the range of timing values across the simple-cell population was relatively normal. Single cells merely sampled narrower than normal regions of the timing space. We sought to understand these cortical changes in terms of how inputs from the lateral geniculate nucleus (LGN) may have been affected by strobe rearing. In normal cats, a wide range of absolute phase and latency values exists among lagged and nonlagged LGN cells, and these thalamic timings account for most of the cortical timings. Also, S-T inseparability in many simple cells can be attributed to the convergence of lagged and/or nonlagged inputs. Strobe rearing did not change the sampling of lagged and nonlagged cells, and the geniculate timings continued to account for most of the cortical timings. However, strobe rearing virtually eliminated cortical receptive fields with mixed lagged and nonlagged timing, and it compressed the timing range in cells dominated by one or the other geniculate type. Thus strobe rearing did not eliminate certain timings in LGN or cortex, but prevented the convergence of different timings on single cells. To account for these results, we propose a developmental model in which strobe stimulation alters the correlational structure of inputs based on their response timing. Only inputs with similar timing become associated on single cortical cells, and this produces S-T separable receptive fields that lack the ability to confer a preferred direction of motion.

Strobe rearing reduces direction selectivity in area 17 by altering spatiotemporal receptive-field structure

Strobe rearing reduces direction selectivity in area 17 by altering spatiotemporal receptive-field structure. J. Neurophysiol. 80: 2991-3004, 1998. Direction selectivity in simple cells of cat area 17 is linked to spatiotemporal (S-T) receptive-field structure. S-T inseparable receptive fields display gradients of response timing across the receptive field that confer a preferred direction of motion. Receptive fields that are not direction selective lack gradients; they are S-T separable, displaying uniform timing across the field. Here we further examine this link using a developmental paradigm that disrupts direction selectivity. Cats were reared from birth to 8 mo of age in 8-Hz stroboscopic illumination. Direction selectivity in simple cells was then measured using gratings drifting at different temporal frequencies (0.25-16 Hz). S-T structure was assessed using stationary bars presented at different receptive-field positions, with bar luminance being modulated sinusoidally at different temporal frequencies. For each cell, plots of response phase versus bar position were fit by lines to characterize S-T inseparability at each temporal frequency. Strobe rearing produced a profound loss of direction selectivity at all temporal frequencies; only 10% of cells were selective compared with 80% in normal cats. The few remaining directional cells were selective over a narrower than normal range of temporal frequencies and exhibited weaker than normal direction selectivity. Importantly, the directional loss was accompanied by a virtual elimination of S-T inseparability. Nearly all cells were S-T separable, like nondirectional cells in normal cats. The loss was clearest in layer 4. Normally, inseparability is greatest there, and it correlates well (r = 0.77) with direction selectivity; strobe rearing reduced inseparability and direction selectivity to very low values. The few remaining directional cells were inseparable. In layer 6 of normal cats, most direction-selective cells are only weakly inseparable, and there is no consistent relationship between the two measures. However, after strobe rearing, even the weak inseparability was eliminated along with direction selectivity. The correlated changes in S-T structure and direction selectivity were confirmed using conventional linear predictions of directional tuning based on responses to counterphasing bars and white noise stimuli. The developmental changes were permanent, being observed up to 12 yr after strobe rearing. The deficits were remarkably specific; strobe rearing did not affect spatial receptive-field structure, orientation selectivity, spatial or temporal frequency tuning, or general responsiveness to visual stimuli. These results provide further support for a critical role of S-T structure in determining direction selectivity in simple cells. Strobe rearing eliminates directional tuning by altering the timing of responses within the receptive field.