Visual cortex neurons of monkeys and cats: temporal dynamics of the spatial frequency response function

Backward masking reveals coarse-to-fine dynamics in human V1

Natural images exhibit luminance variations aligned across a broad spectrum of spatial frequencies (SFs). It has been proposed that, at early stages of processing, the coarse signals carried by the low SF (LSF) of the visual input are sent rapidly from primary visual cortex (V1) to ventral, dorsal and frontal regions to form a coarse representation of the input, which is later sent back to V1 to guide the processing of fine-grained high SFs (i.e., HSF). We used functional resonance imaging (fMRI) to investigate the role of human V1 in the coarse-to-fine integration of visual input. We disrupted the processing of the coarse and fine content of full-spectrum human face stimuli via backward masking of selective SF ranges (LSFs: <1.75cpd and HSFs: >1.75cpd) at specific times (50, 83, 100 or 150ms). In line with coarse-to-fine proposals, we found that (1) the selective masking of stimulus LSF disrupted V1 activity in the earliest time window, and progressively decreased in influence, while (2) an opposite trend was observed for the masking of stimulus' HSF. This pattern of activity was found in V1, as well as in ventral (i.e. the Fusiform Face area, FFA), dorsal and orbitofrontal regions. We additionally presented subjects with contrast negated stimuli. While contrast negation significantly reduced response amplitudes in the FFA, as well as coupling between FFA and V1, coarse-to-fine dynamics were not affected by this manipulation. The fact that V1 response dynamics to strictly identical stimulus sets differed depending on the masked scale adds to growing evidence that V1 role goes beyond the early and quasi-passive transmission of visual information to the rest of the brain. It instead indicates that V1 may yield a 'spatially registered common forum' or 'blackboard' that integrates top-down inferences with incoming visual signals through its recurrent interaction with high-level regions located in the inferotemporal, dorsal and frontal regions.

The fractal brain: scale-invariance in structure and dynamics

The past 40 years have witnessed extensive research on fractal structure and scale-free dynamics in the brain. Although considerable progress has been made, a comprehensive picture has yet to emerge, and needs further linking to a mechanistic account of brain function. Here, we review these concepts, connecting observations across different levels of organization, from both a structural and functional perspective. We argue that, paradoxically, the level of cortical circuits is the least understood from a structural point of view and perhaps the best studied from a dynamical one. We further link observations about scale-freeness and fractality with evidence that the environment provides constraints that may explain the usefulness of fractal structure and scale-free dynamics in the brain. Moreover, we discuss evidence that behavior exhibits scale-free properties, likely emerging from similarly organized brain dynamics, enabling an organism to thrive in an environment that shares the same organizational principles. Finally, we review the sparse evidence for and try to speculate on the functional consequences of fractality and scale-freeness for brain computation. These properties may endow the brain with computational capabilities that transcend current models of neural computation and could hold the key to unraveling how the brain constructs percepts and generates behavior.

Perceptual consequences of interocular differences in the duration of temporal integration

Temporal differences in visual information processing between the eyes can cause dramatic misperceptions of motion and depth. Processing delays between the eyes cause the Pulfrich effect: oscillating targets in the frontal plane are misperceived as moving along near-elliptical motion trajectories in depth (Pulfrich, 1922). Here, we explain a previously reported but poorly understood variant: the anomalous Pulfrich effect. When this variant is perceived, the illusory motion trajectory appears oriented left- or right-side back in depth, rather than aligned with the true direction of motion. Our data indicate that this perceived misalignment is due to interocular differences in neural temporal integration periods, as opposed to interocular differences in delay. For oscillating motion, differences in the duration of temporal integration dampen the effective motion amplitude in one eye relative to the other. In a dynamic analog of the Geometric effect in stereo-surface-orientation perception (Ogle, 1950), the different motion amplitudes cause the perceived misorientation of the motion trajectories. Forced-choice psychophysical experiments, conducted with both different spatial frequencies and different onscreen motion damping in the two eyes show that the perceived misorientation in depth is associated with the eye having greater motion damping. A target-tracking experiment provided more direct evidence that the anomalous Pulfrich effect is caused by interocular differences in temporal integration and delay. These findings highlight the computational hurdles posed to the visual system by temporal differences in sensory processing. Future work will explore how the visual system overcomes these challenges to achieve accurate perception.

Horizontal connectivity in V1: Prediction of coherence in contour and motion integration

This study demonstrates the functional importance of the Surround context relayed laterally in V1 by the horizontal connectivity, in controlling the latency and the gain of the cortical response to the feedforward visual drive. We report here four main findings: 1) a centripetal apparent motion sequence results in a shortening of the spiking latency of V1 cells, when the orientation of the local inducer and the global motion axis are both co-aligned with the RF orientation preference; 2) this contextual effects grows with visual flow speed, peaking at 150–250°/s when it matches the propagation speed of horizontal connectivity (0.15–0.25 mm/ms); 3) For this speed range, the axial sensitivity of V1 cells is tilted by 90° to become co-aligned with the orientation preference axis; 4) the strength of modulation by the surround context correlates with the spatiotemporal coherence of the apparent motion flow. Our results suggest an internally-generated binding process, linking local (orientation /position) and global (motion/direction) features as early as V1. This long-range diffusion process constitutes a plausible substrate in V1 of the human psychophysical bias in speed estimation for collinear motion. Since it is demonstrated in the anesthetized cat, this novel form of contextual control of the cortical gain and phase is a built-in property in V1, whose expression does not require behavioral attention and top-down control from higher cortical areas. We propose that horizontal connectivity participates in the propagation of an internal “prediction” wave, shaped by visual experience, which links contour co-alignment and global axial motion at an apparent speed in the range of saccade-like eye movements.

Coarse-to-fine processing drives the efficient coding of natural scenes in mouse visual cortex

The visual system processes sensory inputs sequentially, perceiving coarse information before fine details. Here we study the neural basis of coarse-to-fine processing and its computational benefits in natural vision. We find that primary visual cortical neurons in awake mice respond to natural scenes in a coarse-to-fine manner, primarily driven by individual neurons rapidly shifting their spatial frequency preference from low to high over a brief response period. This shift transforms the population response in a way that counteracts the statistical regularities of natural scenes, thereby reducing redundancy and generating a more efficient neural representation. The increase in representational efficiency does not occur in either dark-reared or anesthetized mice, which show significantly attenuated coarse-to-fine spatial processing. Collectively, these results illustrate that coarse-to-fine processing is state dependent, develops postnatally via visual experience, and provides a computational advantage by generating more efficient representations of the complex spatial statistics of ethologically relevant natural scenes.

Skyberg et al. show that the visual cortex of mice processes natural scenes in a coarse-to-fine manner, driven by individual neuron’s temporal dynamics. These response dynamics, which require visual experience to develop, reduce redundancy in the neural code and lead to more efficient representations of complex visual stimuli.

Short-term monocular deprivation induces an interocular delay

Short term monocular deprivation modulates ocular dominance, such that the previously deprived eye's contribution to the binocular percept increases, supposedly as a result of changes in contrast-gain. Therefore, the processing time of the previously patched eye would be expected to speed up as a result of an increase in contrast gain. In order to test this hypothesis, this study examines the effects of short-term monocular deprivation on interocular synchronicity. The present study uses a paradigm based on the Pulfrich phenomenon. The stimulus used for testing consists of elements defining a cylinder rotating in depth, that allows measurement of any interocular delay. The interocular delay was measured at baseline before patching and at outcome, after one hour of monocular deprivation with an opaque or translucent patch. Contrary to expectations, short-term monocular deprivation induces an interocular delay, albeit not always significant, in the previously patched eye. The amplitude of this effect is larger with opaque patching compared to translucent patching. These results are the first report of a non-beneficial effect - i.e. a slowing down in the processing time of the previously patched-eye. They indicate that the plasticity effects of monocular deprivation are not exclusively mediated by contrast gain mechanisms and that light adaptation mechanisms might also be involved in the plasticity resulting from short-term monocular deprivation.

Local organization of spatial frequency tuning dynamics in the cat visual areas 17 and 18

Spatial frequency (SF) is a prominent feature to which most neurons in cat areas 17 and 18 (area 17/18) exhibit tuning selectivity. Previous studies have shown that neurons with similar SF tunings are locally clustered into SF preference domains. However, the functional organization of SF tuning remains not fully understood. Neurons in these areas show a variety of SF tuning dynamics; however, it is unknown how neurons with diverse dynamics are locally organized to form the population dynamics of the domains. The laminar organization of SF dynamics is also unknown, knowledge of which may be useful for determining how SF tuning dynamics of cat area 17/18 neurons arise in cortical circuits. To address these issues, we recorded the activities of multiple neurons in the cat area 17/18 using microelectrode arrays and characterized the time courses of the SF tunings of these neurons by a subspace reverse correlation. A wide range of SF dynamics was already present in the input layer, suggesting that intracortical mechanisms contribute to generating SF dynamics inside this layer but do not further shape it outside this layer. Local neuronal pools with similar SF tunings contained diverse SF dynamics. The average preferred SF of a pool similarly increased with response time. Moreover, the range of single-neuron preferred SFs in a pool tended to increase with time. Our results suggest that, in the presence of organized tuning diversity within an SF domain, the cortical SF organization remains stable during response time in cat area 17/18.NEW & NOTEWORTHY In cat area 17/18, we found that a local pool of neurons with similar spatial frequency (SF) tunings shows diverse but organized dynamics. Our results suggest that, in the presence of organized tuning diversity within an SF domain, the cortical SF organization remains stable over response time in these areas. Laminar analysis suggests that intracortical mechanisms contribute to generating SF dynamics inside the input layer but do not further shape it outside this layer.

Timing of response onset and offset in macaque V4: stimulus and task dependence

In the primate visual cortex, both the magnitude of the neuronal response and its timing can carry important information about the visual world, but studies typically focus only on response magnitude. Here, we examine the onset and offset latency of the responses of neurons in area V4 of awake, behaving macaques across several experiments in the context of a variety of stimuli and task paradigms. Our results highlight distinct contributions of stimuli and tasks to V4 response latency. We found that response onset latencies are shorter than typically cited (median = 75.5 ms), supporting a role for V4 neurons in rapid object and scene recognition functions. Moreover, onset latencies are longer for smaller stimuli and stimulus outlines, consistent with the hypothesis that longer latencies are associated with higher spatial frequency content. Strikingly, we found that onset latencies showed no significant dependence on stimulus occlusion, unlike in inferotemporal cortex, nor on task demands. Across the V4 population, onset latencies had a broad distribution, reflecting the diversity of feedforward, recurrent, and feedback connections that inform the responses of individual neurons. Response offset latencies, on the other hand, displayed the opposite tendency in their relationship to stimulus and task attributes: they are less influenced by stimulus appearance but are shorter in guided saccade tasks compared with fixation tasks. The observation that response latency is influenced by stimulus- and task-associated factors emphasizes a need to examine response timing alongside firing rate in determining the functional role of area V4.NEW & NOTEWORTHY Onset and offset timing of neuronal responses can provide information about visual environment and neuron's role in visual processing and its anatomical connectivity. In the first comprehensive examination of onset and offset latencies in the intermediate visual cortical area V4, we find neurons respond faster than previously reported, making them ideally suited to contribute to rapid object and scene recognition. While response onset reflects stimulus characteristics, timing of response offset is influenced more by behavioral task.

Interocular Differences in Spatial Frequency Influence the Pulfrich Effect

The Pulfrich effect is a stereo-motion phenomenon. When the two eyes are presented with visual targets moving in fronto-parallel motion at different luminances or contrasts, the perception is of a target moving-in-depth. It is thought that this percept of motion-in-depth occurs because lower luminance or contrast delays the speed of visual processing. Spatial properties of an image such as spatial frequency and size have also been shown to influence the speed of visual processing. In this study, we use a paradigm to measure interocular delay based on the Pulfrich effect where a structure-from-motion defined cylinder, composed of Gabor elements displayed at different interocular phases, rotates in depth. This allows us to measure any relative interocular processing delay while independently manipulating the spatial frequency and size of the micro elements (i.e., Gabor patches). We show that interocular spatial frequency differences, but not interocular size differences of image features, produce interocular processing delays.

Towards a Dynamic Exploration of Vision, Cognition and Emotion in Alcohol-Use Disorders

Abstract: Visuoperceptive impairments are among the most frequently reported deficits in alcohol-use disorders, but only very few studies have investigated their origin and interactions with other categories of dysfunctions. Besides, these deficits have generally been interpreted in a linear bottom-up perspective, which appears very restrictive with respect to the new models of vision developed in healthy populations. Indeed, new theories highlight the predictive nature of the visual system and demonstrate that it interacts with higher-level cognitive functions to generate top-down predictions. These models nota-bly posit that a fast but coarse visual analysis involving magnocellular pathways helps to compute heuristic guesses regard-ing the identity and affective value of inputs, which are used to facilitate conscious visual recognition. Building on these new proposals, the present review stresses the need to reconsider visual deficits in alcohol-use disorders as they might have cru-cial significance for core features of the pathology, such as attentional bias, loss of inhibitory control and emotion decoding impairments. Centrally, we suggest that individuals with severe alcohol-use disorders could present with magnocellular dam-age and we defend a dynamic explanation of the deficits. Rather than being restricted to high-level processes, deficits could start at early visual stages and then extend and potentially intensify during following steps due to reduced cerebral connec-tivity and dysfunctional cognitive/emotional regions. A new research agenda is specifically provided to test these hypotheses.

Spatial frequency sensitivity in macaque midbrain

Visual brain areas exhibit tuning characteristics well suited for image statistics present in our natural environment. However, visual sensation is an active process, and if there are any brain areas that ought to be particularly in tune with natural scene statistics, it would be sensory-motor areas critical for guiding behavior. Here we found that the rhesus macaque superior colliculus, a structure instrumental for rapid visual exploration with saccades, detects low spatial frequencies, which are the most prevalent in natural scenes, much more rapidly than high spatial frequencies. Importantly, this accelerated detection happens independently of whether a neuron is more or less sensitive to low spatial frequencies to begin with. At the population level, the superior colliculus additionally over-represents low spatial frequencies in neural response sensitivity, even at near-foveal eccentricities. Thus, the superior colliculus possesses both temporal and response gain mechanisms for efficient gaze realignment in low-spatial-frequency-dominated natural environments.

Revealing Detail along the Visual Hierarchy: Neural Clustering Preserves Acuity from V1 to V4

How primates perceive objects along with their detailed features remains a mystery. This ability to make fine visual discriminations depends upon a high-acuity analysis of spatial frequency (SF) along the visual hierarchy from V1 to inferotemporal cortex. By studying the transformation of SF across macaque parafoveal V1, V2, and V4, we discovered SF-selective functional domains in V4 encoding higher SFs up to 12 cycles/°. These intermittent higher-SF-selective domains, surrounded by domains encoding lower SFs, violate the inverse relationship between SF preference and retinal eccentricity. The neural activities of higher- and lower-SF domains correspond to local and global features, respectively, of the same stimuli. Neural response latencies in high-SF domains are around 10 ms later than in low-SF domains, consistent with the coarse-to-fine nature of perception. Thus, our finding of preserved resolution from V1 into V4, separated both spatially and temporally, may serve as a connecting link for detailed object representation.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Activity of primate V1 neurons during the gap saccade task

When a saccadic eye movement is made toward a visual stimulus, the variability in accompanying primary visual cortex (V1) activity is related to saccade latency in both humans and simians. To understand the nature of this relationship, we examined the functional link between V1 activity and the initiation of visually guided saccades during the gap saccade task, in which a brief temporal gap is inserted between the turning off of a fixation stimulus and the appearance of a saccadic target. The insertion of such a gap robustly reduces saccade latency and facilitates the occurrence of extremely short-latency (express) saccades. Here we recorded single-cell activity from macaque V1 while monkeys performed the gap saccade task. In parallel with the gap effect on saccade latency the neural latency (time of first spike) of V1 response elicited by the saccade target became shorter, and the firing rate increased as the gap duration increased. Similarly, neural latency was shorter and firing rate was higher before express saccades relative to regular-latency saccades. In addition to these posttarget changes, the level of spontaneous spike activity during the pretarget period was negatively correlated with both neural and saccade latencies. These results demonstrate that V1 activity correlates with the gap effect and indicate that trial-to-trial variability in the state of V1 accompanies the variability of neural and behavioral latencies.NEW & NOTEWORTHY The link between neural activity in monkey primary visual cortex (V1) and visually guided behavioral response is confirmed with the gap saccade paradigm. Results indicated that the variability in neural latency of V1 spike activity correlates with the gap effect on saccade latency and that the trial-to-trial variability in the state of V1 before the onset of saccade target correlates with the variability in neural and behavioral latencies.

Contrast response functions in the visual wulst of the alert burrowing owl: a single-unit study

The neuronal representation of luminance contrast has not been thoroughly studied in birds. Here we present a detailed quantitative analysis of the contrast response of 120 individual neurons recorded from the visual wulst of awake burrowing owls (Athene cunicularia). Stimuli were sine-wave gratings presented within the cell classical receptive field and optimized in terms of eye preference, direction of drift, and spatiotemporal frequency. As contrast intensity was increased from zero to near 100%, most cells exhibited a monotonic response profile with a compressive, at times saturating, nonlinearity at higher contrasts. However, contrast response functions were found to have a highly variable shape across cells. With the view to capture a systematic trend in the data, we assessed the performance of four plausible models (linear, power, logarithmic, and hyperbolic ratio) using classical goodness-of-fit measures and more rigorous statistical tools for multimodel inferences based on the Akaike information criterion. From this analysis, we conclude that a high degree of model uncertainty is present in our data, meaning that no single descriptor is able on its own to capture the heterogeneous nature of single-unit contrast responses in the wulst. We further show that the generalizability of the hyperbolic ratio model established, for example, in the primary visual cortex of cats and monkeys is not tenable in the owl wulst mainly because most neurons in this area have a much wider dynamic range that starts at low contrast. The challenge for future research will be to understand the functional implications of these findings.

Spatiotemporal profiles of receptive fields of neurons in the lateral posterior nucleus of the cat LP-pulvinar complex

The pulvinar is the largest extrageniculate thalamic visual nucleus in mammals. It establishes reciprocal connections with virtually all visual cortexes and likely plays a role in transthalamic cortico-cortical communication. In cats, the lateral posterior nucleus (LP) of the LP-pulvinar complex can be subdivided in two subregions, the lateral (LPl) and medial (LPm) parts, which receive a predominant input from the striate cortex and the superior colliculus, respectively. Here, we revisit the receptive field structure of LPl and LPm cells in anesthetized cats by determining their first-order spatiotemporal profiles through reverse correlation analysis following sparse noise stimulation. Our data reveal the existence of previously unidentified receptive field profiles in the LP nucleus both in space and time domains. While some cells responded to only one stimulus polarity, the majority of neurons had receptive fields comprised of bright and dark responsive subfields. For these neurons, dark subfields' size was larger than that of bright subfields. A variety of receptive field spatial organization types were identified, ranging from totally overlapped to segregated bright and dark subfields. In the time domain, a large spectrum of activity overlap was found, from cells with temporally coinciding subfield activity to neurons with distinct, time-dissociated subfield peak activity windows. We also found LP neurons with space-time inseparable receptive fields and neurons with multiple activity periods. Finally, a substantial degree of homology was found between LPl and LPm first-order receptive field spatiotemporal profiles, suggesting a high integration of cortical and subcortical inputs within the LP-pulvinar complex.

The neural basis of image segmentation in the primate brain

Image segmentation is a fundamental aspect of vision and a critical part of scene understanding. Our visual system rapidly and effortlessly segments scenes into component objects but the underlying neural basis is unknown. We studied single neurons in area V4 while monkeys discriminated partially occluded shapes. We found that many neurons tuned to boundary curvature maintained their shape selectivity over a large range of occlusion levels as compared to neurons that are not tuned to boundary curvature. This lends support to the hypothesis that segmentation in the face of occlusion may be solved by contour grouping.

Transcranial Magnetic Stimulation Changes Response Selectivity of Neurons in the Visual Cortex

BACKGROUND

Transcranial magnetic stimulation (TMS) is used to selectively alter neuronal activity of specific regions in the cerebral cortex. TMS is reported to induce either transient disruption or enhancement of different neural functions. However, its effects on tuning properties of sensory neurons have not been studied quantitatively.

OBJECTIVE/HYPOTHESIS

Here, we use specific TMS application parameters to determine how they may alter tuning characteristics (orientation, spatial frequency, and contrast sensitivity) of single neurons in the cat's visual cortex.

METHODS

Single unit spikes were recorded with tungsten microelectrodes from the visual cortex of anesthetized and paralyzed cats (12 males). Repetitive TMS (4 Hz, 4 s) was delivered with a 70 mm figure-8 coil. We quantified basic tuning parameters of individual neurons for each pre- and post-TMS condition. The statistical significance of changes for each tuning parameter between the two conditions was evaluated with a Wilcoxon signed-rank test.

RESULTS

We generally find long-lasting suppression which persists well beyond the stimulation period. Pre- and post-TMS orientation tuning curves show constant peak values. However, strong suppression at non-preferred orientations tends to narrow the widths of tuning curves. Spatial frequency tuning exhibits an asymmetric change in overall shape, which results in an emphasis on higher frequencies. Contrast tuning curves show nonlinear changes consistent with a gain control mechanism.

CONCLUSIONS

These findings suggest that TMS causes extended interruption of the balance between sub-cortical and intra-cortical inputs.

Neural mechanisms of coarse-to-fine discrimination in the visual cortex

Vision is a dynamic process that refines the spatial scale of analysis over time, as evidenced by a progressive improvement in the ability to detect and discriminate finer details. To understand coarse-to-fine discrimination, we studied the dynamics of spatial frequency (SF) response using reverse correlation in the primary visual cortex (V1) of the primate. In a majority of V1 cells studied, preferred SF either increased monotonically with time (group 1) or changed nonmonotonically, with an initial increase followed by a decrease (group 2). Monotonic shift in preferred SF occurred with or without an early suppression at low SFs. Late suppression at high SFs always accompanied nonmonotonic SF dynamics. Bayesian analysis showed that SF discrimination performance and best discriminable SF frequencies changed with time in different ways in the two groups of neurons. In group 1 neurons, SF discrimination performance peaked on both left and right flanks of the SF tuning curve at about the same time. In group 2 neurons, peak discrimination occurred on the right flank (high SFs) later than on the left flank (low SFs). Group 2 neurons were also better discriminators of high SFs. We examined the relationship between the time at which SF discrimination performance peaked on either flank of the SF tuning curve and the corresponding best discriminable SFs in both neuronal groups. This analysis showed that the population best discriminable SF increased with time in V1. These results suggest neural mechanisms for coarse-to-fine discrimination behavior and that this process originates in V1 or earlier.

The role of visual area V4 in the discrimination of partially occluded shapes

The primate brain successfully recognizes objects, even when they are partially occluded. To begin to elucidate the neural substrates of this perceptual capacity, we measured the responses of shape-selective neurons in visual area V4 while monkeys discriminated pairs of shapes under varying degrees of occlusion. We found that neuronal shape selectivity always decreased with increasing occlusion level, with some neurons being notably more robust to occlusion than others. The responses of neurons that maintained their selectivity across a wider range of occlusion levels were often sufficiently sensitive to support behavioral performance. Many of these same neurons were distinctively selective for the curvature of local boundary features and their shape tuning was well fit by a model of boundary curvature (curvature-tuned neurons). A significant subset of V4 neurons also signaled the animal's upcoming behavioral choices; these decision signals had short onset latencies that emerged progressively later for higher occlusion levels. The time course of the decision signals in V4 paralleled that of shape selectivity in curvature-tuned neurons: shape selectivity in curvature-tuned neurons, but not others, emerged earlier than the decision signals. These findings provide evidence for the involvement of contour-based mechanisms in the segmentation and recognition of partially occluded objects, consistent with psychophysical theory. Furthermore, they suggest that area V4 participates in the representation of the relevant sensory signals and the generation of decision signals underlying discrimination.

Selective stimulation of neurons in visual cortex enables segregation of slow and fast connections

Organization of the central visual pathway is generally studied from a perspective of feedforward processes. However, there are horizontal connections and also strong feedback from extra striate to visual cortex. Here, we use visual stimuli designed to maximize relative differential involvements of these three main types of connections. The approach relies on differences between stimulation within the classical receptive field (CRF) and that of the surround region. Although previous studies have used similar approaches, they were limited primarily to spatial segregation of neural connections. Our experimental design provides clear segregation of fast and slow components of surround modulation. We assume these are mediated by feedback and horizontal connections, respectively, but other factors may be involved. Our results imply that both horizontal and feedback connections contribute to integration of visual information outside the CRF and provide suppressive or facilitative modulation. For a given cell, modulation may change in strength and sign from suppression to facilitation or the reverse depending on surround parameters. Sub-threshold input from the CRF surround increases local field potential (LFP) power in distinct frequency ranges which differ for suppression and facilitation. Horizontal connections have delayed CRF-surround modulation and are sensitive to position changes in the surround. Therefore, surround information beyond the CRF is initially processed by fast connections which we consider to be feedback, whereas spatially tuned mechanisms are relatively slow and presumably mediated by horizontal connections. Overall, results suggest that convergent fast (feedforward) inputs determine size and structure of the CRFs of recipient cells in visual cortex. And fast connections from extra striate regions (feedback) plus slow-tuned connections (horizontal) within visual cortex contribute to spatial influences of CRF surround activation.

Strabismus disrupts binocular synaptic integration in primary visual cortex

Visual disruption early in development dramatically changes how primary visual cortex neurons integrate binocular inputs. The disruption is paradigmatic for investigating the synaptic basis of long-term changes in cortical function, because the primary visual cortex is the site of binocular convergence. The underlying alterations in circuitry by visual disruption remain poorly understood. Here we compare membrane potential responses, observed via whole-cell recordings in vivo, of primary visual cortex neurons in normal adult cats with those of cats in which strabismus was induced before the developmental critical period. In strabismic cats, we observed a dramatic shift in the ocular dominance distribution of simple cells, the first stage of visual cortical processing, toward responding to one eye instead of both, but not in complex cells, which receive inputs from simple cells. Both simple and complex cells no longer conveyed the binocular information needed for depth perception based on binocular cues. There was concomitant binocular suppression such that responses were weaker with binocular than with monocular stimulation. Our estimates of the excitatory and inhibitory input to single neurons indicate binocular suppression that was not evident in synaptic excitation, but arose de novo because of synaptic inhibition. Further constraints on circuit models of plasticity result from indications that the ratio of excitation to inhibition evoked by monocular stimulation decreased mainly for nonpreferred eye stimulation. Although we documented changes in synaptic input throughout primary visual cortex, a circuit model with plasticity at only thalamocortical synapses is sufficient to account for our observations.

Temporally advanced dynamic change of receptive field of lateral geniculate neurons during brief visual stimulation: Effects of brainstem peribrachial stimulation

Processing of visual information in the brain seems to proceed from initial fast but coarse to subsequent detailed processing. Such coarse-to-fine changes appear also in the response of single neurons in the visual pathway. In the dorsal lateral geniculate nucleus (dLGN), there is a dynamic change in the receptive field (RF) properties of neurons during visual stimulation. During a stimulus flash centered on the RF, the width of the RF-center, presumably related to spatial resolution, changes rapidly from large to small in an initial transient response component. In a subsequent sustained component, the RF-center width is rather stable apart from an initial slight widening. Several brainstem nuclei modulate the geniculocortical transmission in a state-dependent manner. Thus, modulatory input from cholinergic neurons in the peribrachial brainstem region (PBR) enhances the geniculocortical transmission during arousal. We studied whether such input also influences the dynamic RF-changes during visual stimulation. We compared dynamic changes of RF-center width of dLGN neurons during brief stimulus presentation in a control condition, with changes during combined presentation of the visual stimulus and electrical PBR-stimulation. The major finding was that PBR-stimulation gave an advancement of the dynamic change of the RF-center width such that the different response components occurred earlier. Consistent with previous studies, we also found that PBR-stimulation increased the gain of firing rate during the sustained response component. However, this increase of gain was particularly strong in the transition from the transient to the sustained component at the time when the center width was minimal. The results suggest that increased modulatory PBR-input not only increase the gain of the geniculocortical transmission, but also contributes to faster dynamics of transmission. We discuss implications for possible effects on visual spatial resolution.

Similarity relations in visual search predict rapid visual categorization

How do we perform rapid visual categorization?It is widely thought that categorization involves evaluating the similarity of an object to other category items, but the underlying features and similarity relations remain unknown. Here, we hypothesized that categorization performance is based on perceived similarity relations between items within and outside the category. To this end, we measured the categorization performance of human subjects on three diverse visual categories (animals, vehicles, and tools) and across three hierarchical levels (superordinate, basic, and subordinate levels among animals). For the same subjects, we measured their perceived pair-wise similarities between objects using a visual search task. Regardless of category and hierarchical level, we found that the time taken to categorize an object could be predicted using its similarity to members within and outside its category. We were able to account for several classic categorization phenomena, such as (a) the longer times required to reject category membership; (b) the longer times to categorize atypical objects; and (c) differences in performance across tasks and across hierarchical levels. These categorization times were also accounted for by a model that extracts coarse structure from an image. The striking agreement observed between categorization and visual search suggests that these two disparate tasks depend on a shared coarse object representation.

Dynamics of spatial frequency tuning in mouse visual cortex

Neuronal spatial frequency tuning in primary visual cortex (V1) substantially changes over time. In both primates and cats, a shift of the neuron's preferred spatial frequency has been observed from low frequencies early in the response to higher frequencies later in the response. In most cases, this shift is accompanied by a decreased tuning bandwidth. Recently, the mouse has gained attention as a suitable animal model to study the basic mechanisms of visual information processing, demonstrating similarities in basic neuronal response properties between rodents and highly visual mammals. Here we report the results of extracellular single-unit recordings in the anesthetized mouse where we analyzed the dynamics of spatial frequency tuning in V1 and the lateromedial area LM within the lateral extrastriate area V2L. We used a reverse-correlation technique to demonstrate that, as in monkeys and cats, the preferred spatial frequency of mouse V1 neurons shifted from low to higher frequencies later in the response. However, this was not correlated with a clear selectivity increase or enhanced suppression of responses to low spatial frequencies. These results suggest that the neuronal connections responsible for the temporal shift in spatial frequency tuning may considerably differ between mice and monkeys.

Short-time scale dynamics in the responses to multiple stimuli in visual cortex

Many previous studies have used the presentation of multiple stimuli in the receptive fields (RFs) of visual cortical neurons to explore how neurons might operate on multiple inputs. Most of these experiments have used two fixed stimulus locations within the RF of each neuron. Here the effects of using different positions within the RF of a neuron were explored. The stimuli were presented singly at one of six locations, and also at 15 pair-wise combinations, for 24 V2 cortical neurons in two macaque monkeys. There was considerable variability in how pairs of stimuli interacted within the receptive field of any given neuron: changing the position of the stimuli could result in enhancement, winner-take-all, or suppression relative to the strongest response to a stimulus presented by itself. Across the population of neurons there was no correlation between response strength and response latency. However, for many stimulus pairs the response latency was tightly locked to the shortest response latency of any single stimulus presented by itself independent of changes in response magnitude. In other words, a stimulus that by itself elicited a relatively long latency response, would often affect the magnitude of the response to a pair of stimuli, but not change the latency. These results may provide constraints on the development of models of cortical information processing.

Relative Brightness in Natural Images Can Be Accounted for by Removing Blurry Content

One critical question regarding visual cognition concerns how the physical properties of the visual world are represented in early vision and then relayed to high-level vision. Here, we posit a simple theory: Processes that encode object appearance reduce their response to spatial content that is coarser than the size of the attended object. We show that a filtering procedure based on this theory can account for the relative brightness levels of test patches placed in images of natural scenes and for many hard-to-explain brightness illusions. The implication is that the perception of brightness differences in most brightness illusions actually corresponds to physical differences present in the images. Portions of the visual system may encode these physical differences by means of neural processes that adaptively reduce their response to low-spatial-frequency content.

Rapid dynamics of contrast responses in the cat primary visual cortex

The visual information we receive during natural vision changes rapidly and continuously. The visual system must adapt to the spatiotemporal contents of the environment in order to efficiently process the dynamic signals. However, neuronal responses to luminance contrast are usually measured using drifting or stationary gratings presented for a prolonged duration. Since motion in our visual field is continuous, the signals received by the visual system contain an abundance of transient components in the contrast domain. Here using a modified reverse correlation method, we studied the properties of responses of neurons in the cat primary visual cortex to different contrasts of grating stimuli presented statically and transiently for 40 ms, and showed that neurons can effectively discriminate the rapidly changing contrasts. The change in the contrast response function (CRF) over time mainly consisted of an increment in contrast gain (CRF shifts to left) in the developing phase of temporal responses and a decrement in response gain (CRF shifts downward) in the decay phase. When the distribution range of stimulus contrasts was increased, neurons demonstrated decrement in contrast gain and response gain. Our results suggest that contrast gain control (contrast adaptation) and response gain control mechanisms are well established during the first tens of milliseconds after stimulus onset and may cooperatively mediate the rapid dynamic responses of visual cortical neurons to the continuously changing contrast. This fast contrast adaptation may play a role in detecting contrast contours in the context of visual scenes that are varying rapidly.

Phase sensitivities, excitatory summation fields, and silent suppressive receptive fields of single neurons in the parastriate cortex of the cat

We have recorded single-neuron activity from cytoarchitectonic area 18 of anesthetized (0.4–0.7% isoflurane in 65% N2O-35% O2 gaseous mixture) domestic cats. Neurons were identified as simple or complex on the basis of the ratios between the phase-variant (F1) component and the mean firing rate (F0) of spike responses to optimized (orientation, direction, spatial and temporal frequencies, size) high-contrast, luminance-modulated, sine-wave drifting gratings (simple: F1/F0 spike-response ratios > 1; complex: F1/F0 spike-response ratios < 1). The predominance (∼80%) of simple cells among the neurons recorded from the principal thalamorecipient layers supports the idea that most simple cells in area 18 might constitute a putative early stage in the visual information processing. Apart from the “spike-generating” regions (the classical receptive fields, CRFs), the receptive fields of three-quarters of area 18 neurons contain silent, extraclassical suppressive regions (ECRFs). The spatial extent of summation areas of excitatory responses was negatively correlated with the strength of the ECRF-induced suppression of spike responses. Lowering the stimulus contrast resulted in an expansion of the summation areas of excitatory responses accompanied by a reduction in the strength of the ECRF-induced suppression. The spatial and temporal frequency and orientation tunings of the ECRFs were much broader than those of the CRFs. Hence, the ECRFs of area 18 neurons appear to be largely “inherited” from their dorsal thalamic inputs. In most area 18 cells, costimulation of CRFs and ECRFs resulted in significant increases in F1/F0 spike-response ratios, and thus there was a contextually modulated functional continuum between the simple and complex cells.

Coarse-to-fine changes of receptive fields in lateral geniculate nucleus have a transient and a sustained component that depend on distinct mechanisms

Visual processing in the brain seems to provide fast but coarse information before information about fine details. Such dynamics occur also in single neurons at several levels of the visual system. In the dorsal lateral geniculate nucleus (LGN), neurons have a receptive field (RF) with antagonistic center-surround organization, and temporal changes in center-surround organization are generally assumed to be due to a time-lag of the surround activity relative to center activity. Spatial resolution may be measured as the inverse of center size, and in LGN neurons RF-center width changes during static stimulation with durations in the range of normal fixation periods (250-500 ms) between saccadic eye-movements. The RF-center is initially large, but rapidly shrinks during the first ~100 ms to a rather sustained size. We studied such dynamics in anesthetized cats during presentation (250 ms) of static spots centered on the RF with main focus on the transition from the first transient and highly dynamic component to the second more sustained component. The results suggest that the two components depend on different neuronal mechanisms that operate in parallel and with partial temporal overlap rather than on a continuously changing center-surround balance. Results from mathematical modeling further supported this conclusion. We found that existing models for the spatiotemporal RF of LGN neurons failed to account for our experimental results. The modeling demonstrated that a new model, in which the response is given by a sum of an early transient component and a partially overlapping sustained component, adequately accounts for our experimental data.

Visual exploration and object recognition by lattice deformation

Mechanisms of explicit object recognition are often difficult to investigate and require stimuli with controlled features whose expression can be manipulated in a precise quantitative fashion. Here, we developed a novel method (called "Dots"), for generating visual stimuli, which is based on the progressive deformation of a regular lattice of dots, driven by local contour information from images of objects. By applying progressively larger deformation to the lattice, the latter conveys progressively more information about the target object. Stimuli generated with the presented method enable a precise control of object-related information content while preserving low-level image statistics, globally, and affecting them only little, locally. We show that such stimuli are useful for investigating object recognition under a naturalistic setting--free visual exploration--enabling a clear dissociation between object detection and explicit recognition. Using the introduced stimuli, we show that top-down modulation induced by previous exposure to target objects can greatly influence perceptual decisions, lowering perceptual thresholds not only for object recognition but also for object detection (visual hysteresis). Visual hysteresis is target-specific, its expression and magnitude depending on the identity of individual objects. Relying on the particular features of dot stimuli and on eye-tracking measurements, we further demonstrate that top-down processes guide visual exploration, controlling how visual information is integrated by successive fixations. Prior knowledge about objects can guide saccades/fixations to sample locations that are supposed to be highly informative, even when the actual information is missing from those locations in the stimulus. The duration of individual fixations is modulated by the novelty and difficulty of the stimulus, likely reflecting cognitive demand.

Contributions of indirect pathways to visual response properties in macaque middle temporal area MT

The primate visual cortex exhibits a remarkable degree of interconnectivity. Each visual area receives an average of 10 to 15 inputs, many of them from cortical areas with overlapping, but not identical, functional properties. In this study, we assessed the functional significance of this anatomical parallelism to the middle temporal area (MT) of the macaque visual cortex. MT receives major feedforward inputs from areas V1, V2, and V3, but little is known about the properties of each of these pathways. We previously demonstrated that reversible inactivation of V2 and V3 causes a disproportionate degradation of tuning for binocular disparity of MT neurons, relative to direction tuning (Ponce et al., 2008). Here we show that MT neurons continued to encode speed and size information during V2/3 inactivation; however, many became significantly less responsive to fast speeds and others showed a modest decrease in surround suppression. These changes resemble previously reported effects of reducing stimulus contrast (Pack et al., 2005; Krekelberg et al., 2006), but we show here that they differ in their temporal dynamics. We find no evidence that the indirect pathways selectively target different functional regions within MT. Overall, our findings suggest that the indirect pathways to MT primarily convey modality-specific information on binocular disparity, but that they also contribute to the processing of stimuli moving at fast speeds.

From coarse to fine? Spatial and temporal dynamics of cortical face processing

Primary vision segregates information along 2 main dimensions: orientation and spatial frequency (SF). An important question is how this primary visual information is integrated to support high-level representations. It is generally assumed that the information carried by different SF is combined following a coarse-to-fine sequence. We directly addressed this assumption by investigating how the network of face-preferring cortical regions processes distinct SF over time. Face stimuli were flashed during 75, 150, or 300 ms and masked. They were filtered to preserve low SF (LSF), middle SF (MSF), or high SF (HSF). Most face-preferring regions robustly responded to coarse LSF, face information in early stages of visual processing (i.e., until 75 ms of exposure duration). LSF processing decayed as a function of exposure duration (mostly until 150 ms). In contrast, the processing of fine HSF, face information became more robust over time in the bilateral fusiform face regions and in the right occipital face area. The present evidence suggests the coarse-to-fine strategy as a plausible modus operandi in high-level visual cortex.

Spatiotemporal frequency tuning dynamics of neurons in the owl visual wulst

The transformation of spatial (SF) and temporal frequency (TF) tuning functions from broad-band/low-pass to narrow band-pass profiles is one of the key emergent properties of neurons in the mammalian primary visual cortex (V1). The mechanisms underlying such transformation are still a matter of ongoing debate. With the aim of providing comparative insights into the issue, we analyzed various aspects of the spatiotemporal tuning dynamics of neurons in the visual wulst of four awake owls. The wulst is the avian telencephalic target of the retinothalamofugal pathway and, in owls, bears striking functional analogy with V1. Most neurons in our sample exhibited fast and large-magnitude adaptation to the visual stimuli with response latencies very similar to those reported for V1. Moreover, latency increased as a function of stimulus SF but not TF, which suggests that parvo- and magno-like geniculate inputs could be converging onto single wulst neurons. No net shifts in preferred SF or TF were observed along the initial second of stimulation, but bandwidth decreased roughly during the first 200 ms after response latency for both stimulus dimensions. For SF, this occurred exclusively as a consequence of low-frequency suppression, whereas suppression was observed both at the low- and high-frequency limbs of TF tuning curves. Overall these results indicate that SF and TF tuning curves in the wulst are shaped by both feedforward and intratelencephalic suppressive mechanisms, similarly to what seems to be the case in the mammalian striate cortex.

Visual perception: larger is faster

A recent study has shown that neurons in the inferior temporal cortex of the macaque monkey brain show earlier selectivity to global and large shapes than to local and small ones, which may underlie the faster behavioral responses to global aspects of a scene.

The response dynamics of primate visual cortical neurons to simulated optical blur

Neurons in visual cortical area V1 typically respond well to lines or edges of specific orientations. There have been many studies investigating how the responses of these neurons to an oriented edge are affected by changes in luminance contrast. However, in natural images, edges vary not only in contrast but also in the degree of blur, both because of changes in focus and also because shadows are not sharp. The effect of blur on the response dynamics of visual cortical neurons has not been explored. We presented luminance-defined single edges in the receptive fields of parafoveal (1-6 deg eccentric) V1 neurons of two macaque monkeys trained to fixate a spot of light. We varied the width of the blurred region of the edge stimuli up to 0.36 deg of visual angle. Even though the neurons responded robustly to stimuli that only contained high spatial frequencies and 0.36 deg is much larger than the limits of acuity at this eccentricity, changing the degree of blur had minimal effect on the responses of these neurons to the edge. Primates need to measure blur at the fovea to evaluate image quality and control accommodation, but this might only involve a specialist subpopulation of neurons. If visual cortical neurons in general responded differently to sharp and blurred stimuli, then this could provide a cue for form perception, for example, by helping to disambiguate the luminance edges created by real objects from those created by shadows. On the other hand, it might be important to avoid the distraction of changing blur as objects move in and out of the plane of fixation. Our results support the latter hypothesis: the responses of parafoveal V1 neurons are largely unaffected by changes in blur over a wide range.

Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI

Are visual and auditory stimuli processed by similar mechanisms in the human cerebral cortex? Images can be thought of as light energy modulations over two spatial dimensions, and low-level visual areas analyze images by decomposition into spatial frequencies. Similarly, sounds are energy modulations over time and frequency, and they can be identified and discriminated by the content of such modulations. An obvious question is therefore whether human auditory areas, in direct analogy to visual areas, represent the spectro-temporal modulation content of acoustic stimuli. To answer this question, we measured spectro-temporal modulation transfer functions of single voxels in the human auditory cortex with functional magnetic resonance imaging. We presented dynamic ripples, complex broadband stimuli with a drifting sinusoidal spectral envelope. Dynamic ripples are the auditory equivalent of the gratings often used in studies of the visual system. We demonstrate selective tuning to combined spectro-temporal modulations in the primary and secondary auditory cortex. We describe several types of modulation transfer functions, extracting different spectro-temporal features, with a high degree of interaction between spectral and temporal parameters. The overall low-pass modulation rate preference of the cortex matches the modulation content of natural sounds. These results demonstrate that combined spectro-temporal modulations are represented in the human auditory cortex, and suggest that complex signals are decomposed and processed according to their modulation content, the same transformation used by the visual system.

Representing the forest before the trees: a global advantage effect in monkey inferotemporal cortex

Hierarchical stimuli (large shapes composed of small shapes) have long been used to study how humans perceive the global and the local content of a scene--the forest and the trees. Studies using these stimuli have revealed a global advantage effect: humans consistently report global shape faster than local shape. The neuronal underpinnings of this effect remain unclear. Here we demonstrate a correlate and possible mechanism in monkey inferotemporal cortex (IT). Inferotemporal neurons signal the global content of a hierarchical display approximately 30 ms before they signal its local content. This is a specific expression of a general principle, related to spatial scale or spatial frequency rather than to hierarchical level, whereby the representation of a large shape develops in IT before that of a small shape. These findings provide support for a coarse-to-fine model of visual scene representation.

V1 response timing and surface filling-in

There is ample evidence from demonstrations such as color induction and stabilized images that information from surface boundaries plays a special role in determining the perception of surface interiors. Surface interiors appear to "fill-in." Psychophysical experiments also show that surface perception involves a slow scale-dependent process distinct from mechanisms involved in contour perception. The present experiments aimed to test the hypothesis that surface perception is associated with relatively slow scale-dependent neural filling-in. We found that responses in macaque primary visual cortex (V1) are slower to surface interiors than responses to optimal bar stimuli. Moreover, we found that the response to a surface interior is delayed relative to the response to the surface's border and the extent of the delay is proportional to the distance between a receptive field and the border. These findings are consistent with some forms of neural filling-in and suggest that V1 may provide the neural substrate for perceptual filling-in.

Inhibition, spike threshold, and stimulus selectivity in primary visual cortex

Ever since Hubel and Wiesel described orientation selectivity in the visual cortex, the question of how precise selectivity emerges has been marked by considerable debate. There are essentially two views of how selectivity arises. Feed-forward models rely entirely on the organization of thalamocortical inputs. Feedback models rely on lateral inhibition to refine selectivity relative to a weak bias provided by thalamocortical inputs. The debate is driven by two divergent lines of evidence. On the one hand, many response properties appear to require lateral inhibition, including precise orientation and direction selectivity and crossorientation suppression. On the other hand, intracellular recordings have failed to find consistent evidence for lateral inhibition. Here we demonstrate a resolution to this paradox. Feed-forward models incorporating the intrinsic nonlinear properties of cortical neurons and feed-forward circuits (i.e., spike threshold, contrast saturation, and spike-rate rectification) can account for properties that have previously appeared to require lateral inhibition.

Optimal temporal decoding of neural population responses in a reaction-time visual detection task

Behavioral performance in detection and discrimination tasks is likely to be limited by the quality and nature of the signals carried by populations of neurons in early sensory cortical areas. Here we used voltage-sensitive dye imaging (VSDI) to directly measure neural population responses in the primary visual cortex (V1) of monkeys performing a reaction-time detection task. Focusing on the temporal properties of the population responses, we found that V1 responses are consistent with a stimulus-evoked response with amplitude and latency that depend on target contrast and a stimulus-independent additive noise with long-lasting temporal correlations. The noise had much lower amplitude than the ongoing activity reported previously in anesthetized animals. To understand the implications of these properties for subsequent processing stages that mediate behavior, we derived the Bayesian ideal observer that specifies how to optimally use neural responses in reaction time tasks. Using the ideal observer analysis, we show that 1) the observed temporal correlations limit the performance benefit that can be attained by accumulating V1 responses over time, 2) a simple temporal decorrelation operation with time-lagged excitation and inhibition minimizes the detrimental effect of these correlations, 3) the neural information relevant for target detection is concentrated in the initial response following stimulus onset, and 4) a decoder that optimally uses V1 responses far outperforms the monkey in both speed and accuracy. Finally, we demonstrate that for our particular detection task, temporal decorrelation followed by an appropriate running integrator can approach the speed and accuracy of the optimal decoder.

Standing waves and traveling waves distinguish two circuits in visual cortex

The visual cortex represents stimuli through the activity of neuronal populations. We measured the evolution of this activity in space and time by imaging voltage-sensitive dyes in cat area V1. Contrast-reversing stimuli elicit responses that oscillate at twice the stimulus frequency, indicating that signals originate mostly in complex cells. These responses stand clear of the noise, whose amplitude decreases as 1/frequency, and yield high-resolution maps of orientation preference and retinotopy. We first show how these maps are combined to yield the responses to focal, oriented stimuli. We then study the evolution of the oscillating activity in space and time. In the orientation domain, it is a standing wave. In the spatial domain, it is a traveling wave propagating at 0.2-0.5 m/s. These different dynamics indicate a fundamental distinction in the circuits underlying selectivity for position and orientation, two key stimulus attributes.

Linking neuronal and behavioral performance in a reaction-time visual detection task

Perceptual decisions are likely to be based on signals that are provided by populations of neurons in early sensory cortical areas. How these neural responses are combined across neurons and over time to mediate behavior is unknown. To study the link between neural responses and perceptual decisions, we recorded the activity of single units (SU) and multiple units (MU) in the primary visual cortex (V1) of monkeys while they performed a reaction-time visual detection task. We then determined how well the target could be detected from these neural signals. We found that, on average, the detection sensitivities supported by SU and MU in V1 are comparable with the detection sensitivity of the monkey even when considering neural responses during brief temporal intervals (median duration, 137 ms) that ended shortly before the monkey's reaction time. However, we observed systematic differences between the overall shape of the neurometric functions and the monkey's psychometric functions. We also examined the quantitative relationship between SU and MU activity and found that MU responses are consistent with the sum of the responses of multiple SU, most of which have low stimulus selectivity. Finally, we found weak but significant trial-to-trial covariations between V1 activity and behavioral choices, demonstrating for the first time that choice probability can be observed at the earliest stages of cortical sensory processing. Together, these results suggest that the activity of a large population of V1 neurons is combined suboptimally by subsequent processing stages to mediate behavioral performance in visual detection tasks.

Resonance or Integration? Self-Sustained Dynamics and Excitability of Neural Microcircuits

We investigated spontaneous activity and excitability in large networks of artificial spiking neurons. We compared three different spiking neuron models: integrate-and-fire (IF), regular-spiking (RS), and resonator (RES). First, we show that different models have different frequency-dependent response properties, yielding large differences in excitability. Then, we investigate the responsiveness of these models to a single afferent inhibitory/excitatory spike and calibrate the total synaptic drive such that they would exhibit similar peaks of the postsynaptic potentials (PSP). Based on the synaptic calibration, we build large microcircuits of IF, RS, and RES neurons and show that the resonance property favors homeostasis and self-sustainability of the network activity. On the other hand, integration produces instability while it endows the network with other useful properties, such as responsiveness to external inputs. We also investigate other potential sources of stable self-sustained activity and their relation to the membrane properties of neurons. We conclude that resonance and integration at the neuron level might interact in the brain to promote stability as well as flexibility and responsiveness to external input and that membrane properties, in general, are essential for determining the behavior of large networks of neurons.

Interference with Bottom-Up Feature Detection by Higher-Level Object Recognition

Drawing portraits upside down is a trick that allows novice artists to reproduce lower-level image features, e.g., contours, while reducing interference from higher-level face cognition. Limiting the available processing time to suffice for lower- but not higher-level operations is a more general way of reducing interference. We elucidate this interference in a novel visual-search task to find a target among distractors. The target had a unique lower-level orientation feature but was identical to distractors in its higher-level object shape. Through bottom-up processes, the unique feature attracted gaze to the target. Subsequently, recognizing the attended object as identically shaped as the distractors, viewpoint invariant object recognition interfered. Consequently, gaze often abandoned the target to search elsewhere. If the search stimulus was extinguished at time T after the gaze arrived at the target, reports of target location were more accurate for shorter (T<500 ms) presentations. This object-to-feature interference, though perhaps unexpected, could underlie common phenomena such as the visual-search asymmetry that finding a familiar letter N among its mirror images is more difficult than the converse. Our results should enable additional examination of known phenomena and interactions between different levels of visual processes.