Self-Organization of Orientation Maps, Lateral Connections, and Dynamic Receptive Fields in the Primary Visual Cortex. In: Dorffner G, Bischof H, Hornik K, editors. Artificial Neural Networks — ICANN 2001. Berlin: Springer Berlin Heidelberg; 2001. pp. 1147-52. [DOI: 10.1007/3-540-44668-0_160]

On the Role of LGN/V1 Spontaneous Activity as an Innate Learning Pattern for Visual Development

Correlated, spontaneous neural activity is known to play a necessary role in visual development, but the higher-order statistical structure of these coherent, amorphous patterns has only begun to emerge in the past decade. Several computational studies have demonstrated how this endogenous activity can be used to train a developing visual system. Models that generate spontaneous activity analogous to retinal waves have shown that these waves can serve as stimuli for efficient coding models of V1. This general strategy in development has one clear advantage: The same learning algorithm can be used both before and after eye-opening. This same insight can be applied to understanding LGN/V1 spontaneous activity. Although lateral geniculate nucleus (LGN) activity has been less discussed in the literature than retinal waves, here we argue that the waves found in the LGN have a number of properties that fill the role of a training pattern. We make the case that the role of “innate learning” with spontaneous activity is not only possible, but likely in later stages of visual development, and worth pursuing further using an efficient coding paradigm.

Cortical Maps

In this article, we review functional organization in sensory cortical regions—how the cortex represents the world. We consider four interrelated aspects of cortical organization: (1) the set of receptive fields of individual cortical sensory neurons, (2) how lateral interaction between cortical neurons reflects the similarity of their receptive fields, (3) the spatial distribution of receptive-field properties across the horizontal extent of the cortical tissue, and (4) how the spatial distributions of different receptive-field properties interact with one another. We show how these data are generally well explained by the theory of input-driven self-organization, with a family of computational models of cortical maps offering a parsimonious account for a wide range of map-related phenomena. We then discuss important challenges to this explanation, with respect to the maps present at birth, maps present under activity blockade, the limits of adult plasticity, and the lack of some maps in rodents. Because there is not at present another credible general theory for cortical map development, we conclude by proposing key experiments to help uncover other mechanisms that might also be operating during map development.

What, if anything, are topological maps for?

What, if anything, is the functional significance of spatial patterning in cortical feature maps? We ask this question of four major theories of cortical map formation: self-organizing maps, wiring optimization, place coding, and reaction-diffusion. We argue that (i) self-organizing maps yield spatial patterning only as a by-product of efficient mechanisms for developing environmentally appropriate distributions of feature preferences, (ii) wiring optimization assumes rather than explains a map-like organization, (iii) place-coding mechanisms can at best explain only a subset of maps in functional terms, and (iv) reaction-diffusion models suggest two factors in the evolution of maps, the first based on efficient development of feature distributions, and the second based on generating feature-specific long-range recurrent cortical circuitry. None of these explanations for the existence of topological maps requires spatial patterning in maps to be useful. Thus despite these useful frameworks for understanding how maps form and how they are wired, the possibility that patterns are merely epiphenomena in the evolution of mammalian neocortex cannot be rejected. The article is intended as a nontechnical introduction to the assumptions and predictions of these four important classes of models, along with other possible functional explanations for maps.

Building a mechanistic model of the development and function of the primary visual cortex

Researchers have used a very wide range of different experimental and theoretical approaches to help understand mammalian visual systems. These approaches tend to have quite different assumptions, strengths, and weaknesses. Computational models of the visual cortex, in particular, have typically implemented either a proposed circuit for part of the visual cortex of the adult, assuming a very specific wiring pattern based on findings from adults, or else attempted to explain the long-term development of a visual cortex region from an initially undifferentiated starting point. Previous models of adult V1 have been able to account for many of the measured properties of V1 neurons, while not explaining how these properties arise or why neurons have those properties in particular. Previous developmental models have been able to reproduce the overall organization of specific feature maps in V1, such as orientation maps, but are generally formulated at an abstract level that does not allow testing with real images or analysis of detailed neural properties relevant for visual function. In this review of results from a large set of new, integrative models developed from shared principles and a set of shared software components, I show how these models now represent a single, consistent explanation for a wide body of experimental evidence, and form a compact hypothesis for much of the development and behavior of neurons in the visual cortex. The models are the first developmental models with wiring consistent with V1, the first to have realistic behavior with respect to visual contrast, and the first to include all of the demonstrated visual feature dimensions. The goal is to have a comprehensive explanation for why V1 is wired as it is in the adult, and how that circuitry leads to the observed behavior of the neurons during visual tasks.