Binocular disparity can explain the orientation of ocular dominance stripes in primate primary visual area (V1)

Topographic organization of areas V3 and V4 and its relation to supra-areal organization of the primate visual system

Areas V3 and V4 are commonly thought of as individual entities in the primate visual system, based on definition criteria such as their representation of visual space, connectivity, functional response properties, and relative anatomical location in cortex. Yet, large-scale functional and anatomical organization patterns not only emphasize distinctions within each area, but also links across visual cortex. Specifically, the visuotopic organization of V3 and V4 appears to be part of a larger, supra-areal organization, clustering these areas with early visual areas V1 and V2. In addition, connectivity patterns across visual cortex appear to vary within these areas as a function of their supra-areal eccentricity organization. This complicates the traditional view of these regions as individual functional "areas." Here, we will review the criteria for defining areas V3 and V4 and will discuss functional and anatomical studies in humans and monkeys that emphasize the integration of individual visual areas into broad, supra-areal clusters that work in concert for a common computational goal. Specifically, we propose that the visuotopic organization of V3 and V4, which provides the criteria for differentiating these areas, also unifies these areas into the supra-areal organization of early visual cortex. We propose that V3 and V4 play a critical role in this supra-areal organization by filtering information about the visual environment along parallel pathways across higher-order cortex.

The molecular basis for the development of neural maps

Neural development leads to the establishment of precise connectivity in the nervous system. By contrasting the information capacities of cortical connectivity and the genome, we suggest that simplifying rules are necessary in order to create cortical connections from the limited set of instructions contained in the genome. One of these rules may be employed by the visual system, where connections are formed on the basis of the interplay of molecular gradients and activity-dependent synaptic plasticity. We show how a simple model that accounts for such interplay can create both neural topographic maps and more complex patterns of ocular dominance, that is, the segregated binary mixture of projections from two eyes converging in the same visual area. With regard to the ocular dominance patterns, we show that pattern orientation may be instructed by the direction of the gradients of molecular labels. We also show that the periodicity of ocular dominance patterns may result from the interplay of the effects of molecular gradients and correlated neural activity. Overall, we propose that simple mechanisms can account for the formation of apparently complex features of neuronal connections.

Sparse coding can predict primary visual cortex receptive field changes induced by abnormal visual input

Receptive fields acquired through unsupervised learning of sparse representations of natural scenes have similar properties to primary visual cortex (V1) simple cell receptive fields. However, what drives in vivo development of receptive fields remains controversial. The strongest evidence for the importance of sensory experience in visual development comes from receptive field changes in animals reared with abnormal visual input. However, most sparse coding accounts have considered only normal visual input and the development of monocular receptive fields. Here, we applied three sparse coding models to binocular receptive field development across six abnormal rearing conditions. In every condition, the changes in receptive field properties previously observed experimentally were matched to a similar and highly faithful degree by all the models, suggesting that early sensory development can indeed be understood in terms of an impetus towards sparsity. As previously predicted in the literature, we found that asymmetries in inter-ocular correlation across orientations lead to orientation-specific binocular receptive fields. Finally we used our models to design a novel stimulus that, if present during rearing, is predicted by the sparsity principle to lead robustly to radically abnormal receptive fields.

The responses of neurons in the primary visual cortex (V1), a region of the brain involved in encoding visual input, are modified by the visual experience of the animal during development. For example, most neurons in animals reared viewing stripes of a particular orientation only respond to the orientation that the animal experienced. The responses of V1 cells in normal animals are similar to responses that simple optimisation algorithms can learn when trained on images. However, whether the similarity between these algorithms and V1 responses is merely coincidental has been unclear. Here, we used the results of a number of experiments where animals were reared with modified visual experience to test the explanatory power of three related optimisation algorithms. We did this by filtering the images for the algorithms in ways that mimicked the visual experience of the animals. This allowed us to show that the changes in V1 responses in experiment were consistent with the algorithms. This is evidence that the precepts of the algorithms, notably sparsity, can be used to understand the development of V1 responses. Further, we used our model to propose a novel rearing condition which we expect to have a dramatic effect on development.

The role of vision processing in prosthetic vision

Prosthetic vision provides vision which is reduced in resolution and dynamic range compared to normal human vision. This comes about both due to residual damage to the visual system from the condition that caused vision loss, and due to limitations of current technology. However, even with limitations, prosthetic vision may still be able to support functional performance which is sufficient for tasks which are key to restoring independent living and quality of life. Here vision processing can play a key role, ensuring that information which is critical to the performance of key tasks is available within the capability of the available prosthetic vision. In this paper, we frame vision processing for prosthetic vision, highlight some key areas which present problems in terms of quality of life, and present examples where vision processing can help achieve better outcomes.

Intrinsic activity in the fly brain gates visual information during behavioral choices

The small insect brain is often described as an input/output system that executes reflex-like behaviors. It can also initiate neural activity and behaviors intrinsically, seen as spontaneous behaviors, different arousal states and sleep. However, less is known about how intrinsic activity in neural circuits affects sensory information processing in the insect brain and variability in behavior. Here, by simultaneously monitoring Drosophila's behavioral choices and brain activity in a flight simulator system, we identify intrinsic activity that is associated with the act of selecting between visual stimuli. We recorded neural output (multiunit action potentials and local field potentials) in the left and right optic lobes of a tethered flying Drosophila, while its attempts to follow visual motion (yaw torque) were measured by a torque meter. We show that when facing competing motion stimuli on its left and right, Drosophila typically generate large torque responses that flip from side to side. The delayed onset (0.1–1 s) and spontaneous switch-like dynamics of these responses, and the fact that the flies sometimes oppose the stimuli by flying straight, make this behavior different from the classic steering reflexes. Drosophila, thus, seem to choose one stimulus at a time and attempt to rotate toward its direction. With this behavior, the neural output of the optic lobes alternates; being augmented on the side chosen for body rotation and suppressed on the opposite side, even though the visual input to the fly eyes stays the same. Thus, the flow of information from the fly eyes is gated intrinsically. Such modulation can be noise-induced or intentional; with one possibility being that the fly brain highlights chosen information while ignoring the irrelevant, similar to what we know to occur in higher animals.

Organization of the macaque extrastriate visual cortex re-examined using the principle of spatial continuity of function

How is the macaque monkey extrastriate cortex organized? Is vision divisible into separate tasks, such as object recognition and spatial processing, each emphasized in a different anatomical stream? If so, how many streams exist? What are the hierarchical relationships among areas? The present study approached the organization of the extrastriate cortex in a novel manner. A principled relationship exists between cortical function and cortical topography. Similar functions tend to be located near each other, within the constraints of mapping a highly dimensional space of functions onto the two-dimensional space of the cortex. We used this principle to re-examine the functional organization of the extrastriate cortex given current knowledge about its topographic organization. The goal of the study was to obtain a model of the functional relationships among the visual areas, including the number of functional streams into which they are grouped, the pattern of informational overlap among the streams, and the hierarchical relationships among areas. To test each functional description, we mapped it to a model cortex according to the principle of optimal continuity and assessed whether it accurately reconstructed a version of the extrastriate topography. Of the models tested, the one that best reconstructed the topography included four functional streams rather than two, six levels of hierarchy per stream, and a specific pattern of informational overlap among streams and areas. A specific mixture of functions was predicted for each visual area. This description matched findings in the physiological literature, and provided predictions of functional relationships that have yet to be tested physiologically.

Wiring optimization can relate neuronal structure and function

We pursue the hypothesis that neuronal placement in animals minimizes wiring costs for given functional constraints, as specified by synaptic connectivity. Using a newly compiled version of the Caenorhabditis elegans wiring diagram, we solve for the optimal layout of 279 nonpharyngeal neurons. In the optimal layout, most neurons are located close to their actual positions, suggesting that wiring minimization is an important factor. Yet some neurons exhibit strong deviations from "optimal" position. We propose that biological factors relating to axonal guidance and command neuron functions contribute to these deviations. We capture these factors by proposing a modified wiring cost function.

Role of primary visual cortex in the binocular integration of plaid motion perception

This study assessed the early mechanisms underlying perception of plaid motion. Thus, two superimposed gratings drifting in a rightward direction composed plaid stimuli whose global motion direction was perceived as the vector sum of the two components. The first experiment was aimed at comparing the perception of plaid motion when both components were presented to both eyes (dioptic) or separately to each eye (dichoptic). When components of the patterns had identical spatial frequencies, coherent motion was correctly perceived under dioptic and dichoptic viewing condition. However, the perceived direction deviated from the predicted direction when spatial frequency differences were introduced between components in both conditions. The results suggest that motion integration follows similar rules for dioptic and dichoptic plaids even though performance under dichoptic viewing did not reach dioptic levels. In the second experiment, the role of early cortical areas in the processing of both plaids was examined. As convergence of monocular inputs is needed for dichoptic perception, we tested the hypothesis that primary visual cortex (V1) is required for dichoptic plaid processing by delivering repetitive transcranial magnetic stimulation to this area. Ten minutes of magnetic stimulation disrupted subsequent dichoptic perception for approximately 15 min, whereas no significant changes were observed for dioptic plaid perception. Taken together, these findings suggest that V1 is not crucial for the processing of dioptic plaids but it is necessary for the binocular integration underlying dichoptic plaid motion perception.

Synaptic connectivity and neuronal morphology: two sides of the same coin

Neurons often possess elaborate axonal and dendritic arbors. Why do these arbors exist and what determines their form and dimensions? To answer these questions, I consider the wiring up of a large highly interconnected neuronal network, such as the cortical column. Implementation of such a network in the allotted volume requires all the salient features of neuronal morphology: the existence of branching dendrites and axons and the presence of dendritic spines. Therefore, the requirement of high interconnectivity is, in itself, sufficient to account for the existence of these features. Moreover, the actual lengths of axons and dendrites are close to the smallest possible length for a given interconnectivity, arguing that high interconnectivity is essential for cortical function.

Maps in the brain: what can we learn from them?

In mammalian visual cortex, neurons are organized according to their functional properties into multiple maps such as retinotopic, ocular dominance, orientation preference, direction of motion, and others. What determines the organization of cortical maps? We argue that cortical maps reflect neuronal connectivity in intracortical circuits. Because connecting distant neurons requires costly wiring (i.e., axons and dendrites), there is an evolutionary pressure to place connected neurons as close to each other as possible. Then, cortical maps may be viewed as solutions that minimize wiring cost for given intracortical connectivity. These solutions can help us in inferring intracortical connectivity and, ultimately, in understanding the function of the visual system.

The pattern of ocular dominance columns in cat primary visual cortex: intra- and interindividual variability of column spacing and its dependence on genetic background

We present a comprehensive analysis of the intrinsic variability of the periodicity of ocular dominance columns in cat primary visual cortex (area 17) and its relationship to genetic background and visual experience. We characterized the intra-areal and interindividual variability of column spacing in a large set (n = 49) of ocular dominance patterns adapting a recently developed technique for the two-dimensional analysis of orientation column patterns. Patterns were obtained from three different cat colonies (termed F, M and D), the cats having either normal visual experience or experimentally induced strabismus. Two-dimensional maps of local column spacing were calculated for every pattern. In individual cortices, local column spacings varied by > 50% with the majority of column spacings ranging between 0.6 and 1.5 mm in different animals. In animals from colonies F and M (n = 29), the mean column spacing ranged between 1.03 and 1.27 mm and exhibited no significant differences, either between the two breeds or between strabismic and normal animals. The mean spacing was moderately clustered in the left and right brain hemisphere of individual animals but not in littermates. In animals from colony D (n = 2), average column spacing ranged between 0.73 and 0.95 mm, and was thus significantly different from the distribution of spacings in animals from breeds F and M, suggesting an influence of genetic factors on the layout of ocular dominance columns. Local column spacing exhibited a considerable systematic intra-areal variation, with largest spacings along the representation of the horizontal meridian and smallest spacings along the peripheral representation of the vertical meridian. The total variability of ocular dominance column spacing comprised 24% systematic intra-areal variation, 18% interindividual differences of mean column spacing and 58% nonsystematic intra-areal variability.

Communication in neuronal networks

Brains perform with remarkable efficiency, are capable of prodigious computation, and are marvels of communication. We are beginning to understand some of the geometric, biophysical, and energy constraints that have governed the evolution of cortical networks. To operate efficiently within these constraints, nature has optimized the structure and function of cortical networks with design principles similar to those used in electronic networks. The brain also exploits the adaptability of biological systems to reconfigure in response to changing needs.

Connectivity optimization and the positioning of cortical areas

By examining many alternative arrangements of cortical areas, we have found that the arrangement actually present in the brain minimizes the volume of the axons required for interconnecting the areas. Our observations support the notion that the organization of cortical areas has evolved to optimize interareal connections.

Lateral connectivity and contextual interactions in macaque primary visual cortex

Two components of cortical circuits could mediate contour integration in primary visual cortex (V1): intrinsic horizontal connections and feedback from higher cortical areas. To distinguish between these, we combined functional mapping with a new technique for labeling axons, a recombinant adenovirus bearing the gene for green fluorescent protein (GFP), to determine the extent, density, and orientation specificity of V1 intrinsic connections and V2 to V1 feedback. Both connections cover portions of V1 representing regions of visual space up to eight times larger than receptive fields as classically defined, though the intrinsic connections are an order of magnitude denser than the feedback. Whereas the intrinsic connections link similarly oriented domains in V1, V2 to V1 feedback displays no such specificity. These findings suggest that V1 intrinsic horizontal connections provide a more likely substrate for contour integration.

Wiring optimization in cortical circuits

Wiring a brain presents a formidable problem because neural circuits require an enormous number of fast and durable connections. We propose that evolution was likely to have optimized neural circuits to minimize conduction delays in axons, passive cable attenuation in dendrites, and the length of "wire" used to construct circuits, and to have maximized the density of synapses. Here we ask the question: "What fraction of the volume should be taken up by axons and dendrites (i.e., wire) when these variables are at their optimal values?" The biophysical properties of axons and dendrites dictate that wire should occupy 3/5 of the volume in an optimally wired gray matter. We have measured the fraction of the volume occupied by each cellular component and find that the volume of wire is close to the predicted optimal value.

Ocular dominance development revisited

New approaches to the study of ocular dominance development, a model system for the development of neural architecture, indicate that eye-specific columns in primary visual cortex emerge substantially before the onset of the critical period, during which neural connections can be altered by visual experience. The timing, speed and specificity of column emergence implicate molecular patterning mechanisms, along with patterns of neural activity, in the generation of this columnar architecture.