Extended difference-of-Gaussians model incorporating cortical feedback for relay cells in the lateral geniculate nucleus of cat

Corticothalamic feedback sculpts visual spatial integration in mouse thalamus

En route from the retina to the cortex, visual information passes through the dorsolateral geniculate nucleus (dLGN) of the thalamus, where extensive corticothalamic (CT) feedback has been suggested to modulate spatial processing. How this modulation arises from direct excitatory and indirect inhibitory CT feedback pathways remains enigmatic. Here, we show that in awake mice, retinotopically organized cortical feedback sharpens receptive fields (RFs) and increases surround suppression in the dLGN. Guided by a network model indicating that widespread inhibitory CT feedback is necessary to reproduce these effects, we targeted the visual sector of the thalamic reticular nucleus (visTRN) for recordings. We found that visTRN neurons have large RFs, show little surround suppression and exhibit strong feedback-dependent responses to large stimuli. These features make them an ideal candidate for mediating feedback-enhanced surround suppression in the dLGN. We conclude that cortical feedback sculpts spatial integration in the dLGN, likely via recruitment of neurons in the visTRN.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

Firing-rate based network modeling of the dLGN circuit: Effects of cortical feedback on spatiotemporal response properties of relay cells

Visually evoked signals in the retina pass through the dorsal geniculate nucleus (dLGN) on the way to the visual cortex. This is however not a simple feedforward flow of information: there is a significant feedback from cortical cells back to both relay cells and interneurons in the dLGN. Despite four decades of experimental and theoretical studies, the functional role of this feedback is still debated. Here we use a firing-rate model, the extended difference-of-Gaussians (eDOG) model, to explore cortical feedback effects on visual responses of dLGN relay cells. For this model the responses are found by direct evaluation of two- or three-dimensional integrals allowing for fast and comprehensive studies of putative effects of different candidate organizations of the cortical feedback. Our analysis identifies a special mixed configuration of excitatory and inhibitory cortical feedback which seems to best account for available experimental data. This configuration consists of (i) a slow (long-delay) and spatially widespread inhibitory feedback, combined with (ii) a fast (short-delayed) and spatially narrow excitatory feedback, where (iii) the excitatory/inhibitory ON-ON connections are accompanied respectively by inhibitory/excitatory OFF-ON connections, i.e. following a phase-reversed arrangement. The recent development of optogenetic and pharmacogenetic methods has provided new tools for more precise manipulation and investigation of the thalamocortical circuit, in particular for mice. Such data will expectedly allow the eDOG model to be better constrained by data from specific animal model systems than has been possible until now for cat. We have therefore made the Python tool pyLGN which allows for easy adaptation of the eDOG model to new situations.

On route from the retina to primary visual cortex, visually evoked signals have to pass through the dorsal lateral geniculate nucleus (dLGN). However, this is not an exclusive feedforward flow of information as feedback exists from neurons in the cortex back to both relay cells and interneurons in the dLGN. The functional role of this feedback remains mostly unresolved. Here, we use a firing-rate model, the extended difference-of-Gaussians (eDOG) model, to explore cortical feedback effects on visual responses of dLGN relay cells. Our analysis indicates that a particular mix of excitatory and inhibitory cortical feedback agrees best with available experimental observations. In this configuration ON-center relay cells receive both excitatory and (indirect) inhibitory feedback from ON-center cortical cells (ON-ON feedback) where the excitatory feedback is fast and spatially narrow while the inhibitory feedback is slow and spatially widespread. In addition to the ON-ON feedback, the connections are accompanied by OFF-ON connections following a so-called phase-reversed (push-pull) arrangement. To facilitate further applications of the model, we have made the Python tool pyLGN which allows for easy modification and evaluation of the a priori quite general eDOG model to new situations.

Biophysical network modeling of the dLGN circuit: Effects of cortical feedback on spatial response properties of relay cells

Despite half-a-century of research since the seminal work of Hubel and Wiesel, the role of the dorsal lateral geniculate nucleus (dLGN) in shaping the visual signals is not properly understood. Placed on route from retina to primary visual cortex in the early visual pathway, a striking feature of the dLGN circuit is that both the relay cells (RCs) and interneurons (INs) not only receive feedforward input from retinal ganglion cells, but also a prominent feedback from cells in layer 6 of visual cortex. This feedback has been proposed to affect synchronicity and other temporal properties of the RC firing. It has also been seen to affect spatial properties such as the center-surround antagonism of thalamic receptive fields, i.e., the suppression of the response to very large stimuli compared to smaller, more optimal stimuli. Here we explore the spatial effects of cortical feedback on the RC response by means of a a comprehensive network model with biophysically detailed, single-compartment and multicompartment neuron models of RCs, INs and a population of orientation-selective layer 6 simple cells, consisting of pyramidal cells (PY). We have considered two different arrangements of synaptic feedback from the ON and OFF zones in the visual cortex to the dLGN: phase-reversed (‘push-pull’) and phase-matched (‘push-push’), as well as different spatial extents of the corticothalamic projection pattern. Our simulation results support that a phase-reversed arrangement provides a more effective way for cortical feedback to provide the increased center-surround antagonism seen in experiments both for flashing spots and, even more prominently, for patch gratings. This implies that ON-center RCs receive direct excitation from OFF-dominated cortical cells and indirect inhibitory feedback from ON-dominated cortical cells. The increased center-surround antagonism in the model is accompanied by spatial focusing, i.e., the maximum RC response occurs for smaller stimuli when feedback is present.

The functional role of the dorsal lateral geniculate nucleus (dLGN), placed on route from retina to primary visual cortex in the early visual pathway, is still poorly understood. A striking feature of the dLGN circuit is that dLGN cells not only receive feedforward input from the retina, but also a prominent feedback from cells in the visual cortex. It has been seen in experiments that cortical feedback modifies the spatial properties of dLGN cells in response to visual stimuli. In particular, it has been shown to increase the center-surround antagonism for flashing-spot and patch-grating visual stimuli, i.e., the suppression of responses to very large stimuli compared to smaller stimuli. Here we investigate the putative mechanisms behind this feature by means of a comprehensive network model of biophysically detailed neuron models for RCs and INs in the dLGN and orientation-selective cortical cells providing the feedback. Our results support that the experimentally observed feedback effects may be due to a phase-reversed (‘push-pull’) arrangement of the cortical feedback where ON-symmetry RCs receive (indirect) inhibitory feedback from ON-dominated cortical cell and excitation from OFF-dominated cortical cells, and vice versa for OFF-symmetry RCs.

Biophysical Network Modelling of the dLGN Circuit: Different Effects of Triadic and Axonal Inhibition on Visual Responses of Relay Cells

Despite its prominent placement between the retina and primary visual cortex in the early visual pathway, the role of the dorsal lateral geniculate nucleus (dLGN) in molding and regulating the visual signals entering the brain is still poorly understood. A striking feature of the dLGN circuit is that relay cells (RCs) and interneurons (INs) form so-called triadic synapses, where an IN dendritic terminal can be simultaneously postsynaptic to a retinal ganglion cell (GC) input and presynaptic to an RC dendrite, allowing for so-called triadic inhibition. Taking advantage of a recently developed biophysically detailed multicompartmental model for an IN, we here investigate putative effects of these different inhibitory actions of INs, i.e., triadic inhibition and standard axonal inhibition, on the response properties of RCs. We compute and investigate so-called area-response curves, that is, trial-averaged visual spike responses vs. spot size, for circular flashing spots in a network of RCs and INs. The model parameters are grossly tuned to give results in qualitative accordance with previous in vivo data of responses to such stimuli for cat GCs and RCs. We particularly investigate how the model ingredients affect salient response properties such as the receptive-field center size of RCs and INs, maximal responses and center-surround antagonisms. For example, while triadic inhibition not involving firing of IN action potentials was found to provide only a non-linear gain control of the conversion of input spikes to output spikes by RCs, axonal inhibition was in contrast found to substantially affect the receptive-field center size: the larger the inhibition, the more the RC center size shrinks compared to the GC providing the feedforward excitation. Thus, a possible role of the different inhibitory actions from INs to RCs in the dLGN circuit is to provide separate mechanisms for overall gain control (direct triadic inhibition) and regulation of spatial resolution (axonal inhibition) of visual signals sent to cortex.

A computational neural model of orientation detection based on multiple guesses: comparison of geometrical and algebraic models

The implementation of Hubel-Wiesel hypothesis that orientation selectivity of a simple cell is based on ordered arrangement of its afferent cells has some difficulties. It requires the receptive fields (RFs) of those ganglion cells (GCs) and LGN cells to be similar in size and sub-structure and highly arranged in a perfect order. It also requires an adequate number of regularly distributed simple cells to match ubiquitous edges. However, the anatomical and electrophysiological evidence is not strong enough to support this geometry-based model. These strict regularities also make the model very uneconomical in both evolution and neural computation. We propose a new neural model based on an algebraic method to estimate orientations. This approach synthesizes the guesses made by multiple GCs or LGN cells and calculates local orientation information subject to a group of constraints. This algebraic model need not obey the constraints of Hubel-Wiesel hypothesis, and is easily implemented with a neural network. By using the idea of a satisfiability problem with constraints, we also prove that the precision and efficiency of this model are mathematically practicable. The proposed model makes clear several major questions which Hubel-Wiesel model does not account for. Image-rebuilding experiments are conducted to check whether this model misses any important boundary in the visual field because of the estimation strategy. This study is significant in terms of explaining the neural mechanism of orientation detection, and finding the circuit structure and computational route in neural networks. For engineering applications, our model can be used in orientation detection and as a simulation platform for cell-to-cell communications to develop bio-inspired eye chips.

Sleep, neuroengineering and dynamics

Modeling of consciousness-related phenomena and neuroengineering are fields that are rapidly growing together. We review recent approaches and developments and point out some promising directions of future research: Understanding the dynamics of consciousness states and associated oscillations, pathological oscillations as well as their treatment by stimulation, neuroprosthetics and brain-computer-interface approaches, and stimulation approaches that probe, influence and strengthen memory consolidation. In all these fields, computational models connect theory, neurophysiology and neuroengineering research and pave a way towards medical applications.

Effects of cortical feedback on the spatial properties of relay cells in the lateral geniculate nucleus

Feedback connections to early-level sensory neurons have been shown to affect many characteristics of their neural response. Because selectivity for stimulus size is a fundamental property of visual neurons, we examined the summation tuning and discretely mapped receptive field (RF) properties of cells in the lateral geniculate nucleus (LGN) both with and without feedback from visual cortex. Using extracellular recording in halothane-anesthetized cats, we used small luminance probes displaced in Cartesian coordinates to measure discrete response area, and optimal sinusoidal gratings of varying diameter to estimate preferred optimal summation size and level of center-surround antagonism. In conditions where most cortical feedback was pharmacologically removed, discretely mapped RF response areas showed an overall significant enlargement for the population compared with control conditions. A switch to increased levels of burst firing, spatially displaced from the RF center, suggested this was mediated by changes in excitatory-inhibitory balance across visual space. With the use of coextensive stimulation, there were overall highly significant increases in the optimal summation size and reduction of surround antagonism with removal of cortical feedback in the LGN. When fitted with a difference-of-Gaussian (DOG) model, changes in the center size, center amplitude, and surround amplitude parameters were most significantly related to the removal of cortical feedback. In summary, corticothalamic innervation of the visual thalamus can modify spatial summation properties in LGN relay cells, an effect most parsimoniously explained by changes in the excitatory-inhibitory balance.

A minimal mechanistic model for temporal signal processing in the lateral geniculate nucleus

The receptive fields of cells in the lateral geniculate nucleus (LGN) are shaped by their diverse set of impinging inputs: feedforward synaptic inputs stemming from retina, and feedback inputs stemming from the visual cortex and the thalamic reticular nucleus. To probe the possible roles of these feedforward and feedback inputs in shaping the temporal receptive-field structure of LGN relay cells, we here present and investigate a minimal mechanistic firing-rate model tailored to elucidate their disparate features. The model for LGN relay ON cells includes feedforward excitation and inhibition (via interneurons) from retinal ON cells and excitatory and inhibitory (via thalamic reticular nucleus cells and interneurons) feedback from cortical ON and OFF cells. From a general firing-rate model formulated in terms of Volterra integral equations, we derive a single delay differential equation with absolute delay governing the dynamics of the system. A freely available and easy-to-use GUI-based MATLAB version of this minimal mechanistic LGN circuit model is provided. We particularly investigate the LGN relay-cell impulse response and find through thorough explorations of the model's parameter space that both purely feedforward models and feedback models with feedforward excitation only, can account quantitatively for previously reported experimental results. We find, however, that the purely feedforward model predicts two impulse response measures, the time to first peak and the biphasic index (measuring the relative weight of the rebound phase) to be anticorrelated. In contrast, the models with feedback predict different correlations between these two measures. This suggests an experimental test assessing the relative importance of feedforward and feedback connections in shaping the impulse response of LGN relay cells.

A wavelet-based neural model to optimize and read out a temporal population code

It has been proposed that the dense excitatory local connectivity of the neo-cortex plays a specific role in the transformation of spatial stimulus information into a temporal representation or a temporal population code (TPC). TPC provides for a rapid, robust, and high-capacity encoding of salient stimulus features with respect to position, rotation, and distortion. The TPC hypothesis gives a functional interpretation to a core feature of the cortical anatomy: its dense local and sparse long-range connectivity. Thus far, the question of how the TPC encoding can be decoded in downstream areas has not been addressed. Here, we present a neural circuit that decodes the spectral properties of the TPC using a biologically plausible implementation of a Haar transform. We perform a systematic investigation of our model in a recognition task using a standardized stimulus set. We consider alternative implementations using either regular spiking or bursting neurons and a range of spectral bands. Our results show that our wavelet readout circuit provides for the robust decoding of the TPC and further compresses the code without loosing speed or quality of decoding. We show that in the TPC signal the relevant stimulus information is present in the frequencies around 100 Hz. Our results show that the TPC is constructed around a small number of coding components that can be well decoded by wavelet coefficients in a neuronal implementation. The solution to the TPC decoding problem proposed here suggests that cortical processing streams might well consist of sequential operations where spatio-temporal transformations at lower levels forming a compact stimulus encoding using TPC that are subsequently decoded back to a spatial representation using wavelet transforms. In addition, the results presented here show that different properties of the stimulus might be transmitted to further processing stages using different frequency components that are captured by appropriately tuned wavelet-based decoders.