Population receptive fields of ON and OFF thalamic inputs to an orientation column in visual cortex

OPTICAL BLUR AFFECTS DIFFERENTLY ON AND OFF VISUAL PATHWAYS

The human eye has a crystalline lens that focuses retinal images at the point of fixation. Outside this fixation region, images are distorted by optical blur, which increases light scatter and reduces the spatial resolution and contrast processed by neuronal pathways. The spectacle lenses that humans use for optical correction also minify or magnify the images, affecting neuronal surround suppression in visual processing. Because light and dark stimuli are processed with ON and OFF pathways that have different spatial resolution, contrast sensitivity and surround suppression, optical blur and image magnification should affect differently the two pathways and the perception of lights and darks. Our results provide support for this prediction in cats and humans. We demonstrate that optical blur expands ON receptive fields while shrinking OFF receptive fields, as expected from the expansion of light stimuli and shrinkage of dark stimuli with light scatter. Spectacle-induced image magnification also shrinks OFF more than ON receptive fields, as expected from the stronger surround suppression in OFF than ON pathways. Optical blur also decreases the population response of OFF more than ON pathways, consistent with the different effects of light scatter on dark and light stimuli and the ON-OFF pathway differences in contrast sensitivity. Based on these results, we conclude that optical blur and image magnification reduce the receptive field sizes and cortical responses of OFF more than ON pathways, making the ON-OFF response balance a reliable signal to optimize the size and quality of the retinal image.

Binocular receptive-field construction in the primary visual cortex

ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.

Characterization of extracellular spike waveforms recorded in wallaby primary visual cortex

Extracellular recordings were made from 642 units in the primary visual cortex (V1) of a highly visual marsupial, the Tammar wallaby. The receptive field (RF) characteristics of the cells were objectively estimated using the non-linear input model (NIM), and these were correlated with spike shapes. We found that wallaby cortical units had 68% regular spiking (RS), 12% fast spiking (FS), 4% triphasic spiking (TS), 5% compound spiking (CS) and 11% positive spiking (PS). RS waveforms are most often associated with recordings from pyramidal or spiny stellate cell bodies, suggesting that recordings from these cell types dominate in the wallaby cortex. In wallaby, 70-80% of FS and RS cells had orientation selective RFs and had evenly distributed linear and nonlinear RFs. We found that 47% of wallaby PS units were non-orientation selective and they were dominated by linear RFs. Previous studies suggest that the PS units represent recordings from the axon terminals of non-orientation selective cells originating in the lateral geniculate nucleus (LGN). If this is also true in wallaby, as strongly suggested by their low response latencies and bursty spiking properties, the results suggest that significantly more neurons in wallaby LGN are already orientation selective. In wallaby, less than 10% of recorded spikes had triphasic (TS) or sluggish compound spiking (CS) waveforms. These units had a mixture of orientation selective and non-oriented properties, and their cellular origins remain difficult to classify.

Retinal input integration in excitatory and inhibitory neurons in the mouse superior colliculus in vivo

The superior colliculus (SC) is a midbrain structure that receives inputs from retinal ganglion cells (RGCs). The SC contains one of the highest densities of inhibitory neurons in the brain but whether excitatory and inhibitory SC neurons differentially integrate retinal activity in vivo is still largely unknown. We recently established a recording approach to measure the activity of RGCs simultaneously with their postsynaptic SC targets in vivo, to study how SC neurons integrate RGC activity. Here, we employ this method to investigate the functional properties that govern retinocollicular signaling in a cell type-specific manner by identifying GABAergic SC neurons using optotagging in VGAT-ChR2 mice. Our results demonstrate that both excitatory and inhibitory SC neurons receive comparably strong RGC inputs and similar wiring rules apply for RGCs innervation of both SC cell types, unlike the cell type-specific connectivity in the thalamocortical system. Moreover, retinal activity contributed more to the spiking activity of postsynaptic excitatory compared to inhibitory SC neurons. This study deepens our understanding of cell type-specific retinocollicular functional connectivity and emphasizes that the two major brain areas for visual processing, the visual cortex and the SC, differently integrate sensory afferent inputs.

Dynamic Recruitment of the Feedforward and Recurrent Mechanism for Black-White Asymmetry in the Primary Visual Cortex

Black and white information is asymmetrically distributed in natural scenes, evokes asymmetric neuronal responses, and causes asymmetric perceptions. Recognizing the universality and essentiality of black-white asymmetry in visual information processing, the neural substrates for black-white asymmetry remain unclear. To disentangle the role of the feedforward and recurrent mechanisms in the generation of cortical black-white asymmetry, we recorded the V1 laminar responses and LGN responses of anesthetized cats of both sexes. In a cortical column, we found that black-white asymmetry starts at the input layer and becomes more pronounced in the output layer. We also found distinct dynamics of black-white asymmetry between the output layer and the input layer. Specifically, black responses dominate in all layers after stimulus onset. After stimulus offset, black and white responses are balanced in the input layer, but black responses still dominate in the output layer. Compared with that in the input layer, the rebound response in the output layer is significantly suppressed. The relative suppression strength evoked by white stimuli is notably stronger and depends on the location within the ON-OFF cortical map. A model with delayed and polarity-selective cortical suppression explains black-white asymmetry in the output layer, within which prominent recurrent connections are identified by Granger causality analysis. In addition to black-white asymmetry in response strength, the interlaminar differences in spatial receptive field varied dynamically. Our findings suggest that the feedforward and recurrent mechanisms are dynamically recruited for the generation of black-white asymmetry in V1.SIGNIFICANCE STATEMENT Black-white asymmetry is universal and essential in visual information processing, yet the neural substrates for cortical black-white asymmetry remain unknown. Leveraging V1 laminar recordings, we provided the first laminar pattern of black-white asymmetry in cat V1 and found distinct dynamics of black-white asymmetry between the output layer and the input layer. Comparing black-white asymmetry across three visual hierarchies, the LGN, V1 input layer, and V1 output layer, we demonstrated that the feedforward and recurrent mechanisms are dynamically recruited for the generation of cortical black-white asymmetry. Our findings not only enhance our understanding of laminar processing within a cortical column but also elucidate how feedforward connections and recurrent connections interact to shape neuronal response properties.

Species-specific wiring of cortical circuits for small-world networks in the primary visual cortex

Long-range horizontal connections (LRCs) are conspicuous anatomical structures in the primary visual cortex (V1) of mammals, yet their detailed functions in relation to visual processing are not fully understood. Here, we show that LRCs are key components to organize a "small-world network" optimized for each size of the visual cortex, enabling the cost-efficient integration of visual information. Using computational simulations of a biologically inspired model neural network, we found that sparse LRCs added to networks, combined with dense local connections, compose a small-world network and significantly enhance image classification performance. We confirmed that the performance of the network appeared to be strongly correlated with the small-world coefficient of the model network under various conditions. Our theoretical model demonstrates that the amount of LRCs to build a small-world network depends on each size of cortex and that LRCs are beneficial only when the size of the network exceeds a certain threshold. Our model simulation of various sizes of cortices validates this prediction and provides an explanation of the species-specific existence of LRCs in animal data. Our results provide insight into a biological strategy of the brain to balance functional performance and resource cost.

Developmental alignment of feedforward inputs and recurrent network activity drives increased response selectivity and reliability in primary visual cortex following the onset of visual experience

Selective and reliable cortical sensory representations depend on synaptic interactions between feedforward inputs, conveying information from lower levels of the sensory pathway, and recurrent networks that reciprocally connect neurons functioning at the same hierarchical level. Here we explore the development of feedforward/recurrent interactions in primary visual cortex of the ferret that is responsible for the representation of orientation, focusing on the feedforward inputs from cortical layer 4 and its relation to the modular recurrent network in layer 2/3 before and after the onset of visual experience. Using simultaneous laminar electrophysiology and calcium imaging we found that in experienced animals, individual layer 4 and layer 2/3 neurons exhibit strongly correlated responses with the modular recurrent network structure in layer 2/3. Prior to experience, layer 2/3 neurons exhibit comparable modular correlation structure, but this correlation structure is missing for individual layer 4 neurons. Further analysis of the receptive field properties of layer 4 neurons in naïve animals revealed that they exhibit very poor orientation tuning compared to layer 2/3 neurons at this age, and this is accompanied by the lack of spatial segregation of ON and OFF subfields, the definitive property of layer 4 simple cells in experienced animals. Analysis of the response dynamics of layer 2/3 neurons with whole-cell patch recordings confirms that individual layer 2/3 neurons in naïve animals receive poorly-selective feedforward input that does not align with the orientation preference of the layer 2/3 responses. Further analysis reveals that the misaligned feedforward input is the underlying cause of reduced selectivity and increased response variability that is evident in the layer 2/3 responses of naïve animals. Altogether, our experiments indicate that the onset of visual experience is accompanied by a critical refinement in the responses of layer 4 neurons and the alignment of feedforward and recurrent networks that increases the selectivity and reliability of the representation of orientation in V1.

Differences in visual stimulation between reading and walking and implications for myopia development

Visual input plays an important role in the development of myopia (nearsightedness), a visual disorder that blurs vision at far distances. The risk of myopia progression increases with the time spent reading and decreases with outdoor activity for reasons that remain poorly understood. To investigate the stimulus parameters driving this disorder, we compared the visual input to the retina of humans performing two tasks associated with different risks of myopia progression, reading and walking. Human subjects performed the two tasks while wearing glasses with cameras and sensors that recorded visual scenes and visuomotor activity. When compared with walking, reading black text in white background reduced spatiotemporal contrast in central vision and increased it in peripheral vision, leading to a pronounced reduction in the ratio of central/peripheral strength of visual stimulation. It also made the luminance distribution heavily skewed toward negative dark contrast in central vision and positive light contrast in peripheral vision, decreasing the central/peripheral stimulation ratio of ON visual pathways. It also decreased fixation distance, blink rate, pupil size, and head-eye coordination reflexes dominated by ON pathways. Taken together with previous work, these results support the hypothesis that reading drives myopia progression by understimulating ON visual pathways.

Tablet-based 'ON/OFF' pathway test can distinguish between rod- and cone-dominated diseases

INTRODUCTION

The photopic ON pathway defect is associated with nocturnal vision loss. However, the measurement of ON function to detect a rod-dominated disease (rods affected more than cones) has not been explored. We evaluated whether the psychophysical evaluation of ON/OFF pathways can be used to distinguish cone-dominated from rod-dominated diseases.

METHODS

Thirty-seven patients with inherited retinal diseases were tested using the 'EyeSpeed' [iOS application] on an iPad. The test displayed a random number (1-3) of light or dark targets on a black-and-white noise background. Participants responded on a touch screen indicating the correct number of targets displayed. The outcome variables-reaction time, accuracy and performance index (speed [1/reaction time] * accuracy) to both light and dark targets were assessed for diagnostic ability using standard receiver-operating characteristic (ROC) analysis.

RESULTS

Mean ± standard deviation age and visual acuity for the cone- and rod-dominated groups were 25.15 ± 11.74 years, 0.80 ± 0.25 logMAR and 28.3 ± 14.29 years, 0.48 ± 0.26 logMAR, respectively. The median reaction time to light targets in rod-dominated disease [interquartile range] was 5.28 s [3.17], significantly greater than for patients with cone-dominated disease (2.07 s [0.93]; Mann-Whitney U test, p < 0.001). Amongst all of the outcome variables evaluated, the reaction time to light targets (criterion of ≥2.98 s) exhibited the highest area under the ROC curve (area = 0.89 ± 0.11; p < 0.001), with a sensitivity and specificity of 82.4% and 85% respectively.

CONCLUSIONS

Reaction time to light targets using the ON/OFF pathway paradigm is a valid marker to differentiate between rod- and cone-dominated retinal dystrophies. ON pathway function measured using a tablet-based test could act as a supplemental test in the diagnosis of challenging photoreceptor-specific inherited retinal diseases.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Thalamocortical boutons cluster by ON/OFF responses in mouse primary visual cortex

In higher mammals, the thalamic afferents to primary visual cortex cluster according to their responses to increases (ON) or decreases (OFF) in luminance. This feature of thalamocortical wiring is thought to create columnar, ON/OFF domains in V1. We have recently shown that mice also have ON/OFF cortical domains, but the organization of their thalamic afferents remains unknown. Here we measured the visual responses of thalamocortical boutons with two-photon imaging and found that they also cluster in space according to ON/OFF responses. Moreover, fluctuations in the relative density of ON/OFF boutons mirror fluctuations in the relative density of ON/OFF receptive field positions on the visual field. These findings indicate a segregation of ON/OFF signals already present in the thalamic input. We propose that ON/OFF clustering may reflect the spatial distribution of ON/OFF responses in retinal ganglion cell mosaics.NEW & NOTEWORTHY Neurons in primary visual cortex cluster into ON and OFF domains, which have been shown to be linked to the organization of receptive fields and cortical maps. Here we show that in the mouse such clustering is already present in the geniculate input, suggesting that the cortical architecture may be shaped by the representation of ON/OFF signals in the thalamus and the retina.

Natural scene sampling reveals reliable coarse-scale orientation tuning in human V1

Orientation selectivity in primate visual cortex is organized into cortical columns. Since cortical columns are at a finer spatial scale than the sampling resolution of standard BOLD fMRI measurements, analysis approaches have been proposed to peer past these spatial resolution limitations. It was recently found that these methods are predominantly sensitive to stimulus vignetting - a form of selectivity arising from an interaction of the oriented stimulus with the aperture edge. Beyond vignetting, it is not clear whether orientation-selective neural responses are detectable in BOLD measurements. Here, we leverage a dataset of visual cortical responses measured using high-field 7T fMRI. Fitting these responses using image-computable models, we compensate for vignetting and nonetheless find reliable tuning for orientation. Results further reveal a coarse-scale map of orientation preference that may constitute the neural basis for known perceptual anisotropies. These findings settle a long-standing debate in human neuroscience, and provide insights into functional organization principles of visual cortex.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

High-density electrode recordings reveal strong and specific connections between retinal ganglion cells and midbrain neurons

The superior colliculus is a midbrain structure that plays important roles in visually guided behaviors in mammals. Neurons in the superior colliculus receive inputs from retinal ganglion cells but how these inputs are integrated in vivo is unknown. Here, we discovered that high-density electrodes simultaneously capture the activity of retinal axons and their postsynaptic target neurons in the superior colliculus, in vivo. We show that retinal ganglion cell axons in the mouse provide a single cell precise representation of the retina as input to superior colliculus. This isomorphic mapping builds the scaffold for precise retinotopic wiring and functionally specific connection strength. Our methods are broadly applicable, which we demonstrate by recording retinal inputs in the optic tectum in zebra finches. We find common wiring rules in mice and zebra finches that provide a precise representation of the visual world encoded in retinal ganglion cells connections to neurons in retinorecipient areas.

ON/OFF domains shape receptive field structure in mouse visual cortex

In higher mammals, thalamic afferents to primary visual cortex (area V1) segregate according to their responses to increases (ON) or decreases (OFF) in luminance. This organization induces columnar, ON/OFF domains postulated to provide a scaffold for the emergence of orientation tuning. To further test this idea, we asked whether ON/OFF domains exist in mouse V1. Here we show that mouse V1 is indeed parceled into ON/OFF domains. Interestingly, fluctuations in the relative density of ON/OFF neurons on the cortical surface mirror fluctuations in the relative density of ON/OFF receptive field centers on the visual field. Moreover, the local diversity of cortical receptive fields is explained by a model in which neurons linearly combine a small number of ON and OFF signals available in their cortical neighborhoods. These findings suggest that ON/OFF domains originate in fluctuations of the balance between ON/OFF responses across the visual field which, in turn, shapes the structure of cortical receptive fields.

Age-related decline in function of ON and OFF visual pathways

Purpose

A simple psychophysical paradigm is available as a digital application in iOS devices such as iPad to measure the function of ON and OFF visual pathways. However, an age-matched normative database is not readily available. The purpose of the study is to evaluate the response of ON and OFF visual pathways as a function of age.

Methods

158 normal healthy adults (84 males and 74 females) whose age ranged 18–80 years participated in the study. None of them had any ocular disease (except cataract of grade II or less) and visual acuity of ≤ 20/25. Monocular testing (only one eye) was performed on the ‘EyeSpeed’ application on an iPad at 40cm distance. The targets ranged between 1 to 3 light or dark squares presented randomly in a noise background and participants responded by indicating the number of squares by touching the screen as fast as possible. The main outcome variables are reaction time, accuracy and performance index (1 / speed * accuracy).

Results

The median reaction time was shorter (Median (IQR): 1.53s (0.49) [dark] Vs 1.76s (0.58) [light], p < 0.001) and accuracy was higher (97.21% (3.30) [dark] Vs 95.15% (5.10) [light], p < 0.001) for dark targets than the light targets. Performance index and reaction time for both target types significantly correlated with age (ρ = -0.41 to -0.43; p < 0.001).

Conclusions

This normative database will be useful to quantify disease-specific defects. More importantly, the ON pathway function can potentially serve as a surrogate for rod photoreceptor function.

Mechanism underpinning the sharpening of orientation and spatial frequency selectivities in the tree shrew (Tupaia belangeri) primary visual cortex

Most neurons in the primary visual cortex (V1) of mammals show sharp orientation selectivity and band-pass spatial frequency tuning. Here, we examine whether sharpening of the broad tuning that exists subcortically, namely in the retina and the lateral geniculate nucleus (LGN), underlie the sharper tuning seen for both the above features in tree shrew V1. Since the transition from poor feature selectivity to sharp tuning occurs entirely within V1 in tree shrews, we examined the orientation selectivity and spatial frequency tuning of neurons within individual electrode penetrations. We found that most layer 4 and layer 2/3 neurons in the same cortical column preferred the same stimulus orientation. However, a subset of layer 3c neurons close to the layer 4 border preferred near orthogonal orientations, suggesting that layer 2/3 neurons may inherit the orientation preferences of their layer 4 input neurons and also receive cross-orientation inhibition from layer 3c neurons. We also found that layer 4 neurons showed sharper orientation selectivity at higher spatial frequencies, suggesting that attenuation of low spatial frequency responses by spatially broad inhibition acting on layer 4 inputs to layer 2/3 neurons can enhance both orientation and spatial frequency selectivities. However, in a proportion of layer 2/3 neurons, the sharper tuning of layer 2/3 neurons appeared to arise also or even mainly from inhibition specific to high spatial frequencies acting on the layer 4 inputs to layer 2/3. Overall, our results are consistent with the suggestion that in tree shrews, sharp feature selectivity in layer 2/3 can be established by intracortical mechanisms that sharpen biases observed in layer 4, which are in turn inherited presumably from thalamic afferents.

Effects of Light Isoflurane Anesthesia on Organization of Direction and Orientation Selectivity in the Superficial Layer of the Mouse Superior Colliculus

The superior colliculus (SC) is the midbrain center for integrating visual and multimodal sensory information. Neurons in the SC exhibit direction and orientation selectivity. Recent studies reported that neurons with similar preferences formed clusters in the mouse SC (Ahmadlou and Heimel, 2015; Feinberg and Meister, 2015; de Malmazet et al., 2018; Li et al., 2020). However, it remains controversial as to how these clusters are organized within the SC (Inayat et al., 2015; Chen et al., 2021). Here, we found that different brain states (i.e., awake or anesthetized with isoflurane) changed the selectivity of individual SC neurons and organizations of the neuronal population in both male and female mice. Using two-photon Ca2+ imaging, we examined both individual neuronal responses and the spatial patterns of their population responses. Under isoflurane anesthesia, orientation selectivity increased and a larger number of orientation-selective cells were observed when compared with the awake condition, whereas the proportions of direction-selective cells were similar in both conditions. Furthermore, direction- and orientation-selective cells located at closer positions showed more similar preferences, and cluster-like spatial patterns were enhanced. Inhibitory responses of direction-selective neurons were also reduced under isoflurane anesthesia. Thus, the changes in the spatial organization of response patterns were considered to be because of changes in the balance of excitation and inhibition, with excitation dominance, in the local circuits. These results provide new insights into the possibility that the functional organization of feature selectivity in the brain is affected by brain state.SIGNIFICANCE STATEMENT Recent large-scale recording studies are changing our view of visual maps in the superior colliculus (SC), including findings of cluster-like localizations of direction- and orientation-selective neurons. However, results from several laboratories are conflicting regarding the presence of cluster-like organization. Here, we demonstrated that light isoflurane anesthesia affected the direction- and orientation-tuning properties in the mouse superficial SC and that their cluster-like localization pattern was enhanced by the anesthesia. Furthermore, the effect of anesthesia on direction selectivity appeared to be different in the excitatory and inhibitory populations in the SC. Our results suggest that the functional organization of direction and orientation selectivity might be regulated by the excitation-inhibition balance that depends on the brain state.

Feedforward mechanisms of cross-orientation interactions in mouse V1

Sensory neurons are modulated by context. For example, in mouse primary visual cortex (V1), neuronal responses to the preferred orientation are modulated by the presence of superimposed orientations ("plaids"). The effects of this modulation are diverse; some neurons are suppressed, while others have larger responses to a plaid than its components. We investigated whether this diversity could be explained by a unified circuit mechanism. We report that this masking is maintained during suppression of cortical activity, arguing against cortical mechanisms. Instead, the heterogeneity of plaid responses is explained by an interaction between stimulus geometry and orientation tuning. Highly selective neurons are uniformly suppressed by plaids, whereas the effects in weakly selective neurons depend on the spatial configuration of the stimulus, transitioning systematically between suppression and facilitation. Thus, the diverse responses emerge as a consequence of the spatial structure of feedforward inputs, with no need to invoke cortical interactions.

Dissecting cascade computational components in spiking neural networks

Finding out the physical structure of neuronal circuits that governs neuronal responses is an important goal for brain research. With fast advances for large-scale recording techniques, identification of a neuronal circuit with multiple neurons and stages or layers becomes possible and highly demanding. Although methods for mapping the connection structure of circuits have been greatly developed in recent years, they are mostly limited to simple scenarios of a few neurons in a pairwise fashion; and dissecting dynamical circuits, particularly mapping out a complete functional circuit that converges to a single neuron, is still a challenging question. Here, we show that a recent method, termed spike-triggered non-negative matrix factorization (STNMF), can address these issues. By simulating different scenarios of spiking neural networks with various connections between neurons and stages, we demonstrate that STNMF is a persuasive method to dissect functional connections within a circuit. Using spiking activities recorded at neurons of the output layer, STNMF can obtain a complete circuit consisting of all cascade computational components of presynaptic neurons, as well as their spiking activities. For simulated simple and complex cells of the primary visual cortex, STNMF allows us to dissect the pathway of visual computation. Taken together, these results suggest that STNMF could provide a useful approach for investigating neuronal systems leveraging recorded functional neuronal activity.

It is well known that the computation of neuronal circuits is carried out through the staged and cascade structure of different types of neurons. Nevertheless, the information, particularly sensory information, is processed in a network primarily with feedforward connections through different pathways. A peculiar example is the early visual system, where light is transcoded by the retinal cells, routed by the lateral geniculate nucleus, and reached the primary visual cortex. One meticulous interest in recent years is to map out these physical structures of neuronal pathways. However, most methods so far are limited to taking snapshots of a static view of connections between neurons. It remains unclear how to obtain a functional and dynamical neuronal circuit beyond the simple scenarios of a few randomly sampled neurons. Using simulated spiking neural networks of visual pathways with different scenarios of multiple stages, mixed cell types, and natural image stimuli, we demonstrate that a recent computational tool, named spike-triggered non-negative matrix factorization, can resolve these issues. It enables us to recover the entire structural components of neural networks underlying the computation, together with the functional components of each individual neuron. Utilizing it for complex cells of the primary visual cortex allows us to reveal every underpinning of the nonlinear computation. Our results, together with other recent experimental and computational efforts, show that it is possible to systematically dissect neural circuitry with detailed structural and functional components.

Periodic clustering of simple and complex cells in visual cortex

Neurons in the primary visual cortex (V1) are often classified as simple or complex cells, but it is debated whether they are discrete hierarchical classes of neurons or if they represent a continuum of variation within a single class of cells. Herein, we show that simple and complex cells may arise commonly from the feedforward projections from the retina. From analysis of the cortical receptive fields in cats, we show evidence that simple and complex cells originate from the periodic variation of ON-OFF segregation in the feedforward projection of retinal mosaics, by which they organize into periodic clusters in V1. From data in cats, we observed that clusters of simple and complex receptive fields correlate topographically with orientation maps, which supports our model prediction. Our results suggest that simple and complex cells are not two distinct neural populations but arise from common retinal afferents, simultaneous with orientation tuning.

Sparse thalamocortical convergence

How many thalamic neurons converge onto a cortical cell? This is an important question, because the organization of thalamocortical projections can influence the cortical architecture.^1,2 Here, we estimate the degree of thalamocortical convergence in primary visual cortex by taking advantage of the cortical expansion-neurons within a restricted volume in primary visual cortex have overlapping receptive fields driven by a smaller set of inputs from the lateral geniculate nucleus.^3-5 Under these conditions, the measurements of cortical receptive fields in a population can be used to infer the receptive fields of their geniculate inputs and the weights of their projections using non-negative matrix factorization.⁶ The analysis reveals sparse connectivity,⁷ where a handful (~2-6) of thalamic inputs account for 90% of the total synaptic weight to a cortical neuron. Together with previous findings,⁸ these results paint a picture consistent with the idea that convergence of a few inputs partly determine the retinotopy and tuning properties of cortical cells.^8-13.

Different roles of subcortical inputs in V1 responses to luminance and contrast

Cells in the primary visual cortex (V1) generally respond weakly to large uniform luminance stimuli. Only a subset of V1 cells is thought to encode uniform luminance information. In natural scenes, local luminance is an important feature for defining an object that varies and coexists with local spatial contrast. However, the strategies used by V1 cells to encode local mean luminance for spatial contrast stimuli remain largely unclear. Here, using extracellular recordings in anesthetized cats, we investigated the responses of V1 cells by comparing with those of retinal ganglion (RG) cells and lateral geniculate nucleus (LGN) cells to simultaneous and rapid changes in luminance and spatial contrast. Almost all V1 cells exhibited a strong monotonic increasing luminance tuning when they were exposed to high spatial contrast. Thus, V1 cells encode the luminance carried by spatial contrast stimuli with the monotonically increasing response function. Moreover, high contrast decreased luminance tuning of OFF cells but increased that of in ON cells in RG and LGN. The luminance and contrast tunings of LGN ON cells were highly separable as V1 cells, whereas those of LGN OFF cells were lowly separable. These asymmetrical effects of spatial contrast on ON/OFF channels might underlie the robust ability of V1 cells to perform luminance tuning when exposed to spatial contrast stimuli.

Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper Organization in Mammalian Visual Cortex

In the mammalian primary visual cortex, neural tuning to stimulus orientation is organized in either columnar or salt-and-pepper patterns across species. For decades, this sharp contrast has spawned fundamental questions about the origin of functional architectures in visual cortex. However, it is unknown whether these patterns reflect disparate developmental mechanisms across mammalian taxa or simply originate from variation of biological parameters under a universal development process. In this work, after the analysis of data from eight mammalian species, we show that cortical organization is predictable by a single factor, the retino-cortical mapping ratio. Groups of species with or without columnar clustering are distinguished by the feedforward sampling ratio, and model simulations with controlled mapping conditions reproduce both types of organization. Prediction from the Nyquist theorem explains this parametric division of the patterns with high accuracy. Our results imply that evolutionary variation of physical parameters may induce development of distinct functional circuitry.

Projection of Orthogonal Tiling from the Retina to the Visual Cortex

In higher mammals, the primary visual cortex (V1) is organized into diverse tuning maps of visual features. The topography of these maps intersects orthogonally, but it remains unclear how such a systematic relationship can develop. Here, we show that the orthogonal organization already exists in retinal ganglion cell (RGC) mosaics, providing a blueprint of the organization in V1. From analysis of the RGC mosaics data in monkeys and cats, we find that the ON-OFF RGC distance and ON-OFF angle of neighboring RGCs are organized into a topographic tiling across mosaics, analogous to the orthogonal intersection of cortical tuning maps. Our model simulation shows that the ON-OFF distance and angle in RGC mosaics correspondingly initiate ocular dominance/spatial frequency tuning and orientation tuning, resulting in the orthogonal intersection of cortical tuning maps. These findings suggest that the regularly structured ON-OFF patterns mirrored from the retina initiate the uniform representation of combinations of map features over the visual space.

Three rules govern thalamocortical connectivity of fast-spike inhibitory interneurons in the visual cortex

Some cortical neurons receive highly selective thalamocortical (TC) input, but others do not. Here, we examine connectivity of single thalamic neurons (lateral geniculate nucleus, LGN) onto putative fast-spike inhibitory interneurons in layer 4 of rabbit visual cortex. We show that three 'rules' regulate this connectivity. These rules concern: (1) the precision of retinotopic alignment, (2) the amplitude of the postsynaptic local field potential elicited near the interneuron by spikes of the LGN neuron, and (3) the interneuron's response latency to strong, synchronous LGN input. We found that virtually all first-order fast-spike interneurons receive input from nearly all LGN axons that synapse nearby, regardless of their visual response properties. This was not the case for neighboring regular-spiking neurons. We conclude that profuse and highly promiscuous TC inputs to layer-4 fast-spike inhibitory interneurons generate response properties that are well-suited to mediate a fast, sensitive, and broadly tuned feed-forward inhibition of visual cortical excitatory neurons.

A Model for the Origin of Motion Direction Selectivity in Visual Cortex

Motion perception is a vital part of our sensory repertoire in that it contributes to navigation, awareness of moving objects, and communication. Motion sense in carnivores and primates originates with primary visual cortical neurons selective for motion direction. More than 60 years after the discovery of these neurons, there is still no consensus on the mechanism underlying direction selectivity. This paper describes a model of the cat's visual system in which direction selectivity results from the well-documented orientation selectivity of inhibitory neurons: inhomogeneities in the orientation preference map for inhibitory neurons leads to spatially asymmetric inhibition, and thus to direction selectivity. Stimulation of the model with a drifting grating shows that direction selectivity results from the relative timing of excitatory and inhibitory inputs to a neuron. Using a stationary contrast-reversing grating reveals that the inhibitory input is spatially displaced in the preferred direction relative to the excitatory input, and that this asymmetry leads to the timing difference. More generally, the model yields physiologically realistic estimates of the direction selectivity index, and it reproduces the critical finding with contrast-reversing gratings that response phase advances with grating spatial phase. It is concluded that a model based on intracortical inhibition can account well for the known properties of direction selectivity in carnivores and primates.SIGNIFICANCE STATEMENT Motion perception is vital for navigation, communication, and the awareness of moving objects. Motion sense depends on cortical neurons that are selective for motion direction, and this paper describes a model for the physiological mechanism underlying cortical direction selectivity. The essence of the model is that intracortical inhibition of a direction-selective cell is spatially inhomogeneous and therefore depends on whether a stimulus generates inhibition before or after reaching the cell's receptive field: the response is weaker in the former than in the latter case. If the model is correct, it will contribute to the understanding of motion processing in carnivores and primates.

Early Emergence of Solid Shape Coding in Natural and Deep Network Vision

Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape-processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep-network training.

Effects of visual adaptation on orientation selectivity in cat secondary visual cortex

Neuron orientation selectivity, otherwise known as the ability to respond optimally to a preferred orientation, has been extensively described in both primary and secondary visual cortices. This orientation selectivity, conserved through all cortical layers of a given column, is the primary basis for cortical organization and functional network emergence. While this selectivity is programmed and acquired since critical period, it has always been believed that in a mature brain, neurons' inherent functional features could not be changed. However, a plurality of studies has investigated the mature brain plasticity in V1, by changing the cells' orientation selectivity with visual adaptation. Using electrophysiological data in both V1 and V2 areas, this study aims to investigate the effects of adaptation on simultaneously recorded cells in both areas. Visual adaptation had an enhanced effect on V2 units, as they exhibited greater tuning curve shifts and a more pronounced decrease of their OSI. Not only did adaptation have a different effect on V2 neurons, it also elicited a different response depending on the neuron's cortical depth. Indeed, in V2, cells in layers II-III were more affected by visual adaptation, while infragranular layer V units exhibited little to no effect at all.

Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex

Purpose

The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants.

Results

SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification.

Conclusions

In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human.

Translational Relevance

As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.

Spontaneous Retinal Waves Can Generate Long-Range Horizontal Connectivity in Visual Cortex

In the primary visual cortex (V1) of higher mammals, long-range horizontal connections (LHCs) are observed to develop, linking iso-orientation domains of cortical tuning. It is unknown how this feature-specific wiring of circuitry develops before eye-opening. Here, we suggest that LHCs in V1 may originate from spatiotemporally structured feedforward activities generated from spontaneous retinal waves. Using model simulations based on the anatomy and observed activity patterns of the retina, we show that waves propagating in retinal mosaics can initialize the wiring of LHCs by coactivating neurons of similar tuning, whereas equivalent random activities cannot induce such organizations. Simulations showed that emerged LHCs can produce the patterned activities observed in V1, matching the topography of the underlying orientation map. The model can also reproduce feature-specific microcircuits in the salt-and-pepper organizations found in rodents. Our results imply that early peripheral activities contribute significantly to cortical development of functional circuits.SIGNIFICANCE STATEMENT Long-range horizontal connections (LHCs) in the primary visual cortex (V1) are observed to emerge before the onset of visual experience, thereby selectively connecting iso-domains of orientation map. However, it is unknown how such feature-specific wirings develop before eye-opening. Here, we show that LHCs in V1 may originate from the feature-specific activation of cortical neurons by spontaneous retinal waves during early developmental stages. Our simulations of a visual cortex model show that feedforward activities from the retina initialize the spatial organization of activity patterns in V1, which induces visual feature-specific wirings in the V1 neurons. Our model also explains the origin of cortical microcircuits observed in rodents, suggesting that the proposed developmental mechanism is universally applicable to circuits of various mammalian species.

Dimensional reduction of emergent spatiotemporal cortical dynamics via a maximum entropy moment closure

Modern electrophysiological recordings and optical imaging techniques have revealed a diverse spectrum of spatiotemporal neural activities underlying fundamental cognitive processing. Oscillations, traveling waves and other complex population dynamical patterns are often concomitant with sensory processing, information transfer, decision making and memory consolidation. While neural population models such as neural mass, population density and kinetic theoretical models have been used to capture a wide range of the experimentally observed dynamics, a full account of how the multi-scale dynamics emerges from the detailed biophysical properties of individual neurons and the network architecture remains elusive. Here we apply a recently developed coarse-graining framework for reduced-dimensional descriptions of neuronal networks to model visual cortical dynamics. We show that, without introducing any new parameters, how a sequence of models culminating in an augmented system of spatially-coupled ODEs can effectively model a wide range of the observed cortical dynamics, ranging from visual stimulus orientation dynamics to traveling waves induced by visual illusory stimuli. In addition to an efficient simulation method, this framework also offers an analytic approach to studying large-scale network dynamics. As such, the dimensional reduction naturally leads to mesoscopic variables that capture the interplay between neuronal population stochasticity and network architecture that we believe to underlie many emergent cortical phenomena.

Cortical Balance Between ON and OFF Visual Responses Is Modulated by the Spatial Properties of the Visual Stimulus

The primary visual cortex of carnivores and primates is dominated by the OFF visual pathway and responds more strongly to dark than light stimuli. Here, we demonstrate that this cortical OFF dominance is modulated by the size and spatial frequency of the stimulus in awake primates and we uncover a main neuronal mechanism underlying this modulation. We show that large grating patterns with low spatial frequencies drive five times more OFF-dominated than ON-dominated neurons, but this pronounced cortical OFF dominance is strongly reduced when the grating size decreases and the spatial frequency increases, as when the stimulus moves away from the observer. We demonstrate that the reduction in cortical OFF dominance is not caused by a selective reduction of visual responses in OFF-dominated neurons but by a change in the ON/OFF response balance of neurons with diverse receptive field properties that can be ON or OFF dominated, simple, or complex. We conclude that cortical OFF dominance is continuously adjusted by a neuronal mechanism that modulates ON/OFF response balance in multiple cortical neurons when the spatial properties of the visual stimulus change with viewing distance and/or optical blur.

Diversity of Feature Selectivity in Macaque Visual Cortex Arising from a Limited Number of Broadly Tuned Input Channels

Spike (action potential) responses of most primary visual cortical cells in the macaque are sharply tuned for the orientation of a line or an edge, and neurons preferring similar orientations are clustered together in cortical columns. The preferred stimulus orientation of these columns span the full range of orientations, as observed in recordings of spikes and in classical optical imaging of intrinsic signals. However, when we imaged the putative thalamic input to striate cortical cells that can be seen in imaging of intrinsic signals when they are analyzed on a larger spatial scale, we found that the orientation domain map of the primary visual cortex did not show the same diversity of orientations. This map was dominated by just the one orientation that is most commonly preferred by neurons in the retina and the lateral geniculate nucleus. This supports cortical feature selectivity and columnar architecture being built upon feed-forward signals transmitted from the thalamus in a very limited number of broadly tuned input channels.

Advanced Circuit and Cellular Imaging Methods in Nonhuman Primates

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

Spike-field Granger causality for hybrid neural data analysis

Neurotechnological innovations allow for simultaneous recording at various scales, ranging from spiking activity of individual neurons to large neural populations’ local field potentials (LFPs). This capability necessitates developing multiscale analysis of spike-field activity. A joint analysis of the hybrid neural data is crucial for bridging the scales between single neurons and local networks. Granger causality is a fundamental measure to evaluate directional influences among neural signals. However, it is mainly limited to inferring causal influence between the same type of signals—either LFPs or spike trains—and not well developed between two different signal types. Here we propose a model-free, nonparametric spike-field Granger causality measure for hybrid data analysis. Our measure is distinct from existing methods in that we use “binless” spikes (precise spike timing) rather than “binned” spikes (spike counts within small consecutive time windows). The latter clearly distort the information in the mixed analysis of spikes and LFP. Therefore, our spectral estimate of spike trains is directly applied to the neural point process itself, i.e., sequences of spike times rather than spike counts. Our measure is validated by an extensive set of simulated data. When the measure is applied to LFPs and spiking activity simultaneously recorded from visual areas V1 and V4 of monkeys performing a contour detection task, we are able to confirm computationally the long-standing experimental finding of the input-output relationship between LFPs and spikes. Importantly, we demonstrate that spike-field Granger causality can be used to reveal the modulatory effects that are inaccessible by traditional methods, such that spike→LFP Granger causality is modulated by the behavioral task, whereas LFP→spike Granger causality is mainly related to the average synaptic input.

NEW & NOTEWORTHY It is a pressing question to study the directional interactions between local field potential (LFP) and spiking activity. In this report, we propose a model-free, nonparametric spike-field Granger causality measure that can be used to reveal directional influences between spikes and LFPs. This new measure is crucial for bridging the scales between single neurons and neural networks; hence it represents an important step to explicate how the brain orchestrates information processing.

A model for the origin and development of visual orientation selectivity

Orientation selectivity is a key property of primary visual cortex that contributes, downstream, to object recognition. The origin of orientation selectivity, however, has been debated for decades. It is known that on- and off-centre subcortical pathways converge onto single neurons in primary visual cortex, and that the spatial offset between these pathways gives rise to orientation selectivity. On- and off-centre pathways are intermingled, however, so it is unclear how their inputs to cortex come to be spatially segregated. We here describe a model in which the segregation occurs through Hebbian strengthening and weakening of geniculocortical synapses during the development of the visual system. Our findings include the following. 1. Neighbouring on- and off-inputs to cortex largely cancelled each other at the start of development. At each receptive field location, the Hebbian process increased the strength of one input sign at the expense of the other sign, producing a spatial segregation of on- and off-inputs. 2. The resulting orientation selectivity was precise in that the bandwidths of the orientation tuning functions fell within empirical estimates. 3. The model produced maps of preferred orientation–complete with iso-orientation domains and pinwheels–similar to those found in real cortex. 4. These maps did not originate in cortical processes, but from clustering of off-centre subcortical pathways and the relative location of neighbouring on-centre clusters. We conclude that a model with intermingled on- and off-pathways shaped by Hebbian synaptic plasticity can explain both the origin and development of orientation selectivity.

Many neurons in mammalian primary visual cortex are highly selective for the orientation of visual contours and can therefore contribute to object recognition. Orientation selectivity depends on on- and off-centre retinal neurons that respond, respectively, to light and dark. We describe a signal-processing model that includes both subcortical pathways and cortical neurons. The model predicts the preferred orientation of a cortical neuron from the empirically determined spatial layout of retinal cells. Further, the subcortical-to-cortical connections change in strength during visual development, meaning that cortical neurons in the model have orientation selectivity just as precise as real neurons. Our model can therefore explain the origin of orientation selectivity and the way it develops during visual system maturation.

Activation of a Visual Cortical Column by a Directionally Selective Thalamocortical Neuron

The retinas of rabbits and rodents have directionally selective (DS) retinal ganglion cells that convey directional signals through the lateral geniculate nucleus (LGN) of the thalamus to the primary visual cortex (V1). Notably, the function and synaptic impact in V1 of these directional LGN signals are unknown. Here we measured, in awake rabbits, the synaptic impact generated in V1 by individual LGN DS neurons. We show that these neurons make fast and strong connections in layers 4 and 6, with postsynaptic effects that are similar to those made by LGN concentric neurons, the main thalamic drivers of V1. By contrast, the synaptic impact of LGN DS neurons on superficial cortical layers was not detectable. These results suggest that LGN DS neurons activate a cortical column by targeting the main cortical input layers and that the role of DS input to superficial cortical layers is likely to be weak and/or modulatory.

Amblyopia Affects the ON Visual Pathway More than the OFF

Visual information reaches the cerebral cortex through parallel ON and OFF pathways that signal the presence of light and dark stimuli in visual scenes. We have previously demonstrated that optical blur reduces visual salience more for light than dark stimuli because it removes the high spatial frequencies from the stimulus, and low spatial frequencies drive weaker ON than OFF cortical responses. Therefore, we hypothesized that sustained optical blur during brain development should weaken ON cortical pathways more than OFF, increasing the dominance of darks in visual perception. Here we provide support for this hypothesis in humans with anisometropic amblyopia who suffered sustained optical blur early after birth in one of the eyes. In addition, we show that the dark dominance in visual perception also increases in strabismic amblyopes that have their vision to high spatial frequencies reduced by mechanisms not associated with optical blur. Together, we show that amblyopia increases visual dark dominance by 3-10 times and that the increase in dark dominance is strongly correlated with amblyopia severity. These results can be replicated with a computational model that uses greater luminance/response saturation in ON than OFF pathways and, as a consequence, reduces more ON than OFF cortical responses to stimuli with low spatial frequencies. We conclude that amblyopia affects the ON cortical pathway more than the OFF, a finding that could have implications for future amblyopia treatments.SIGNIFICANCE STATEMENT Amblyopia is a loss of vision that affects 2-5% of children across the world and originates from a deficit in visual cortical circuitry. Current models assume that amblyopia affects similarly ON and OFF visual pathways, which signal light and dark features in visual scenes. Against this current belief, here we demonstrate that amblyopia affects the ON visual pathway more than the OFF, a finding that could have implications for new amblyopia treatments targeted at strengthening a weak ON visual pathway.

Toward a Biologically Plausible Model of LGN-V1 Pathways Based on Efficient Coding

Increasing evidence supports the hypothesis that the visual system employs a sparse code to represent visual stimuli, where information is encoded in an efficient way by a small population of cells that respond to sensory input at a given time. This includes simple cells in primary visual cortex (V1), which are defined by their linear spatial integration of visual stimuli. Various models of sparse coding have been proposed to explain physiological phenomena observed in simple cells. However, these models have usually made the simplifying assumption that inputs to simple cells already incorporate linear spatial summation. This overlooks the fact that these inputs are known to have strong non-linearities such the separation of ON and OFF pathways, or separation of excitatory and inhibitory neurons. Consequently these models ignore a range of important experimental phenomena that are related to the emergence of linear spatial summation from non-linear inputs, such as segregation of ON and OFF sub-regions of simple cell receptive fields, the push-pull effect of excitation and inhibition, and phase-reversed cortico-thalamic feedback. Here, we demonstrate that a two-layer model of the visual pathway from the lateral geniculate nucleus to V1 that incorporates these biological constraints on the neural circuits and is based on sparse coding can account for the emergence of these experimental phenomena, diverse shapes of receptive fields and contrast invariance of orientation tuning of simple cells when the model is trained on natural images. The model suggests that sparse coding can be implemented by the V1 simple cells using neural circuits with a simple biologically plausible architecture.

Ferrets as a Model for Higher-Level Visual Motion Processing

Ferrets are a major developmental animal model due to their early parturition. Here we show for the first time that ferrets could be used to study development of higher-level visual processes previously identified in primates. In primates, complex motion processing involves primary visual cortex (V1), which generates local motion signals, and higher-level visual area MT, which integrates these signals over more global spatial regions. Our data show similar transformations in motion signals between ferret V1 and higher-level visual area PSS, located in the posterior bank of the suprasylvian sulcus. We found that PSS neurons, like MT neurons, were tuned for stimulus motion and showed strong suppression between opposing direction inputs. Most strikingly, PSS, like MT, exhibited robust global motion signals when tested with coherent plaids-the classic test for motion integration across multiple moving elements. These PSS responses were described well by computational models developed for MT. Our findings establish the ferret as a strong animal model for development of higher-level visual processing.

Dynamic laminar rerouting of inter-areal mnemonic signal by cognitive operations in primate temporal cortex

Execution of cognitive functions is orchestrated by a brain-wide network comprising multiple regions. However, it remains elusive whether the cortical laminar pattern of inter-areal interactions exhibits dynamic routings, depending on cognitive operations. We address this issue by simultaneously recording neuronal activities from area 36 and area TE of the temporal cortex while monkeys performed a visual cued-recall task. We identify dynamic laminar routing of the inter-areal interaction: during visual processing of a presented cue, spiking activities of area 36 neurons are preferentially coherent with local field potentials at the supragranular layer of area TE, while the signal from the same neurons switches to target the infragranular layer of area TE during memory retrieval. This layer-dependent signal represents the to-be-recalled object, and has an impact on the local processing at the supragranular layer in both cognitive operations. Thus, cortical layers form a key structural basis for dynamic switching of cognitive operations.

Inter-areal interaction has been shown to support various cognitive functions. Here, the authors report that neurons in area 36 flexibly synchronize their activity with different layers of area TE within different epochs of a visually cued recall task suggesting dynamic rerouting of information.

Mechanisms underlying contrast-dependent orientation selectivity in mouse V1

Recently, sophisticated optogenetic tools for mouse have enabled many detailed studies of the neuronal circuits of its primary visual cortex (V1), providing much more specific information than is available for cat or monkey. Among various other differences, they show a striking contrast dependency in orientation selectivity in mouse V1 rather than the well-known contrast invariance for cat and monkey. Constrained by the existing experiment data, we develop a comprehensive large-scale model of an effective input layer of mouse V1 that successfully reproduces the contrast-dependent phenomena and many other response properties. The model helps to probe different mechanisms based on excitation–inhibition balance that underlie both contrast dependencies and invariance, and it provides implications for future studies on these circuits.

Recent experiments have shown that mouse primary visual cortex (V1) is very different from that of cat or monkey, including response properties—one of which is that contrast invariance in the orientation selectivity (OS) of the neurons’ firing rates is replaced in mouse with contrast-dependent sharpening (broadening) of OS in excitatory (inhibitory) neurons. These differences indicate a different circuit design for mouse V1 than that of cat or monkey. Here we develop a large-scale computational model of an effective input layer of mouse V1. Constrained by experiment data, the model successfully reproduces experimentally observed response properties—for example, distributions of firing rates, orientation tuning widths, and response modulations of simple and complex neurons, including the contrast dependence of orientation tuning curves. Analysis of the model shows that strong feedback inhibition and strong orientation-preferential cortical excitation to the excitatory population are the predominant mechanisms underlying the contrast-sharpening of OS in excitatory neurons, while the contrast-broadening of OS in inhibitory neurons results from a strong but nonpreferential cortical excitation to these inhibitory neurons, with the resulting contrast-broadened inhibition producing a secondary enhancement on the contrast-sharpened OS of excitatory neurons. Finally, based on these mechanisms, we show that adjusting the detailed balances between the predominant mechanisms can lead to contrast invariance—providing insights for future studies on contrast dependence (invariance).

Local tuning biases in mouse primary visual cortex

Neurons in primary visual cortex are selective to the orientation and spatial frequency of sinusoidal gratings. In the classic model of cortical organization, a population of neurons responding to the same region of the visual field but tuned to all possible feature combinations provides a detailed representation of the local image. Such a functional module is assumed to be replicated across primary visual cortex to provide a uniform representation of the image across the entire visual field. In contrast, it has been hypothesized that the tiling properties of ON- and OFF-center receptive fields in the retina, largely mirrored in the geniculate, may constrain cortical tuning at each location in the visual field. This model predicts the existence of local biases in tuning that vary across the visual field and would prevent the cortex from developing a uniform, modular representation as postulated by the classic model. Here, we confirm the existence of local tuning biases in the primary visual cortex of the mouse, lending support to the notion that cortical tuning may be constrained by signals from the periphery. NEW & NOTEWORTHY Populations of cortical neurons responding to the same part of the visual field are shown to have similar tuning. Such local biases are consistent with the hypothesis that cortical tuning, in mouse primary visual cortex, is constrained by signals from the periphery.

Thalamocortical Circuits and Functional Architecture

The thalamocortical pathway is the main route of communication between the eye and the cerebral cortex. During embryonic development, thalamocortical afferents travel to L4 and are sorted by receptive field position, eye of origin, and contrast polarity (i.e., preference for light or dark stimuli). In primates and carnivores, this sorting involves numerous afferents, most of which sample a limited region of the binocular field. Devoting abundant thalamocortical resources to process a limited visual field has a clear advantage: It allows many stimulus combinations to be sampled at each spatial location. Moreover, the sampling efficiency can be further enhanced by organizing the afferents in a cortical grid for eye input and contrast polarity. We argue that thalamocortical interactions within this eye-polarity grid can be used to represent multiple stimulus combinations found in nature and to build an accurate cortical map for multidimensional stimulus space.

Thalamocortical processing in vision

Visual information reaches the cerebral cortex through a major thalamocortical pathway that connects the lateral geniculate nucleus (LGN) of the thalamus with the primary visual area of the cortex (area V1). In humans, ∼3.4 million afferents from the LGN are distributed within a V1 surface of ∼2400 mm2, an afferent number that is reduced by half in the macaque and by more than two orders of magnitude in the mouse. Thalamocortical afferents are sorted in visual cortex based on the spatial position of their receptive fields to form a map of visual space. The visual resolution within this map is strongly correlated with total number of thalamic afferents that V1 receives and the area available to sort them. The ∼20,000 afferents of the mouse are only sorted by spatial position because they have to cover a large visual field (∼300 deg) within just 4 mm2 of V1 area. By contrast, the ∼500,000 afferents of the cat are also sorted by eye input and light/dark polarity because they cover a smaller visual field (∼200 deg) within a much larger V1 area (∼400 mm2), a sorting principle that is likely to apply also to macaques and humans. The increased precision of thalamic sorting allows building multiple copies of the V1 visual map for left/right eyes and light/dark polarities, which become interlaced to keep neurons representing the same visual point close together. In turn, this interlaced arrangement makes cortical neurons with different preferences for stimulus orientation to rotate around single cortical points forming a pinwheel pattern that allows more efficient processing of objects and visual textures.

Neuronal mechanisms underlying differences in spatial resolution between darks and lights in human vision

Artists and astronomers noticed centuries ago that humans perceive dark features in an image differently from light ones; however, the neuronal mechanisms underlying these dark/light asymmetries remained unknown. Based on computational modeling of neuronal responses, we have previously proposed that such perceptual dark/light asymmetries originate from a luminance/response saturation within the ON retinal pathway. Consistent with this prediction, here we show that stimulus conditions that increase ON luminance/response saturation (e.g., dark backgrounds) or its effect on light stimuli (e.g., optical blur) impair the perceptual discrimination and salience of light targets more than dark targets in human vision. We also show that, in cat visual cortex, the magnitude of the ON luminance/response saturation remains relatively constant under a wide range of luminance conditions that are common indoors, and only shifts away from the lowest luminance contrasts under low mesopic light. Finally, we show that the ON luminance/response saturation affects visual salience mostly when the high spatial frequencies of the image are reduced by poor illumination or optical blur. Because both low luminance and optical blur are risk factors in myopia, our results suggest a possible neuronal mechanism linking myopia progression with the function of the ON visual pathway.

Inhibition in Simple Cell Receptive Fields Is Broad and OFF-Subregion Biased

Inhibition in thalamorecipient layer 4 simple cells of primary visual cortex is believed to play important roles in establishing visual response properties and integrating visual inputs across their receptive fields (RFs). Simple cell RFs are characterized by nonoverlapping, spatially restricted subregions in which visual stimuli can either increase or decrease the firing rate of the cell, depending on contrast. Inhibition is believed to be triggered exclusively from visual stimulation of individual RF subregions. However, this view is at odds with the known anatomy of layer 4 interneurons in visual cortex and differs from recent findings in mouse visual cortex. Here we show with in vivo intracellular recordings in cats that while excitation is restricted to RF subregions, inhibition spans the width of simple cell RFs. Consequently, excitatory stimuli within a subregion concomitantly drive excitation and inhibition. Furthermore, we found that the distribution of inhibition across the RF is stronger toward OFF subregions. This inhibitory OFF-subregion bias has a functional consequence on spatial integration of inputs across the RF. A model based on the known anatomy of layer 4 demonstrates that the known proportion and connectivity of inhibitory neurons in layer 4 of primary visual cortex is sufficient to explain broad inhibition with an OFF-subregion bias while generating a variety of phase relations, including antiphase, between excitation and inhibition in response to drifting gratings.SIGNIFICANCE STATEMENT The wiring of excitatory and inhibitory neurons in cortical circuits is key to determining the response properties in sensory cortex. In the visual cortex, the first cells that receive visual input are simple cells in layer 4. The underlying circuitry responsible for the response properties of simple cells is not yet known. In this study, we challenge a long-held view concerning the pattern of inhibitory input and provide results that agree with current known anatomy. We show here that inhibition is evoked broadly across the receptive fields of simple cells, and we identify a surprising bias in inhibition within the receptive field. Our findings represent a step toward a unified view of inhibition across different species and sensory systems.

Orientation Tuning of Correlated Activity in the Developing Lateral Geniculate Nucleus

Neural circuits and the cells that comprise them undergo developmental changes in the spatial organization of their connections and in their temporal response properties. Within the lateral geniculate nucleus (LGN) of the dorsal thalamus, these changes have pronounced effects on the spatiotemporal receptive fields (STRFs) of neurons. An open and unresolved question is how STRF maturation affects stimulus-evoked correlated activity between pairs of LGN neurons during development. This is an important question to answer because stimulus-evoked correlated activity likely plays a role in establishing the specificity of thalamocortical connectivity and the receptive fields (RFs) of postsynaptic cortical neurons. Using multielectrode recording methods and white noise stimuli, we recorded neural activity from ensembles of LGN neurons in cats across early development. As expected, there was a progressive maturation of the spatial and temporal properties of visual responses. Using drifting bar stimuli and cross-correlation analysis, we also determined the orientation-tuning bandwidth of correlated activity between pairs of LGN neurons at different stages of development (Sillito and Jones, 2002; Andolina et al., 2007; Stanley et al., 2012; Kelly et al., 2014). Despite the larger RFs and slower responses of immature LGN neurons compared with mature neurons, our results show that correlated activity in the LGN was as tightly tuned for orientation early in development as it was in the adult. Closer examination revealed this age-invariant orientation tuning of correlated activity likely involves cellular mechanisms related to spike fatigue in young animals and a progressive decrease in response latency with development.SIGNIFICANCE STATEMENT Orientation tuning is a fundamental property of neurons in primary visual cortex. An important and unresolved question is how orientation tuning emerges during brain development. This study explores a potential mechanism for the establishment of orientation tuning based on correlated activity patterns among ensembles of maturing neurons in the lateral geniculate nucleus (LGN) of the thalamus. Results show that correlated activity between pairs of LGN neurons is more tightly tuned than predictions based simply on receptive field size, indicating that correlated activity has the properties needed to play an important role in the development of geniculocortical circuits and the emergence of cortical orientation tuning.

Interlayer Repulsion of Retinal Ganglion Cell Mosaics Regulates Spatial Organization of Functional Maps in the Visual Cortex

In higher mammals, orientation tuning of neurons is organized into a quasi-periodic pattern in the primary visual cortex. Our previous model studies suggested that the topography of cortical orientation maps may originate from moiré interference of ON and OFF retinal ganglion cell (RGC) mosaics, but did not account for how the consistent spatial period of maps could be achieved. Here we address this issue with two crucial findings on the development of RGC mosaics: first, homotypic local repulsion between RGCs can develop a long-range hexagonal periodicity. Second, heterotypic interaction restrains the alignment of ON and OFF mosaics, and generates a periodic interference pattern map with consistent spatial frequency. To validate our model, we quantitatively analyzed the RGC mosaics in cat data, and confirmed that the observed retinal mosaics showed evidence of heterotypic interactions, contrary to the previous view that ON and OFF mosaics are developed independently.SIGNIFICANCE STATEMENT Orientation map is one of the most studied functional maps in the brain, but it has remained unanswered how the consistent spatial periodicity of maps could be developed. In the current study, we address this issue with our developmental model for the retinal origin of orientation map. We showed that local repulsive interactions between retinal ganglion cells (RGCs) can develop a hexagonal periodicity in the RGC mosaics and restrict the alignment between ON and OFF mosaics, so that they generate a periodic pattern with consistent spatial frequency for both the RGC mosaics and the cortical orientation maps. Our results demonstrate that the organization of functional maps in visual cortex, including its structural consistency, may be constrained by a retinal blueprint.