Orientation Selectivity from Very Sparse LGN Inputs in a Comprehensive Model of Macaque V1 Cortex

Efficient models of cortical activity via local dynamic equilibria and coarse-grained interactions

Biologically detailed models of brain circuitry are challenging to build and simulate due to the large number of neurons, their complex interactions, and the many unknown physiological parameters. Simplified mathematical models are more tractable, but harder to evaluate when too far removed from neuroanatomy/physiology. We propose that a multiscale model, coarse-grained (CG) while preserving local biological details, offers the best balance between biological realism and computability. This paper presents such a model. Generally, CG models focus on the interaction between groups of neurons-here termed "pixels"-rather than individual cells. In our case, dynamics are alternately updated at intra- and interpixel scales, with one informing the other, until convergence to equilibrium is achieved on both scales. An innovation is how we exploit the underlying biology: Taking advantage of the similarity in local anatomical structures across large regions of the cortex, we model intrapixel dynamics as a single dynamical system driven by "external" inputs. These inputs vary with events external to the pixel, but their ranges can be estimated a priori. Precomputing and tabulating all potential local responses speed up the updating procedure significantly compared to direct multiscale simulation. We illustrate our methodology using a model of the primate visual cortex. Except for local neuron-to-neuron variability (necessarily lost in any CG approximation) our model reproduces various features of large-scale network models at a tiny fraction of the computational cost. These include neuronal responses as a consequence of their orientation selectivity, a primary function of visual neurons.

A large-scale neuronal network modelling study: Stimulus size modulates gamma oscillations in the primary visual cortex by long-range connections

Stimulus size modulation of neuronal firing activity is a fundamental property of the primary visual cortex. Numerous biological experiments have shown that stimulus size modulation is affected by multiple factors at different spatiotemporal scales, but the exact pathways and mechanisms remain incompletely understood. In this paper, we establish a large-scale neuronal network model of primary visual cortex with layer 2/3 to study how gamma oscillation properties are modulated by stimulus size and especially how long-range connections affect the modulation as realistic neuronal properties and spatial distributions of synaptic connections are considered. It is shown that long-range horizontal synaptic connections are sufficient to produce dimensional modulation of firing rates and gamma oscillations. In particular, with increasing grating stimulus size, the firing rate increases and then decreases, the peak frequency of gamma oscillations decreases and the spectral power increases. These are consistent with biological experimental observations. Furthermore, we explain in detail how the number and spatial distribution of long-range connections affect the size modulation of gamma oscillations by using the analysis of neuronal firing activity and synaptic current fluctuations. Our results provide a mechanism explanation for size modulation of gamma oscillations in the primary visual cortex and reveal the important and unique role played by long-range connections, which contributes to a deeper understanding of the cognitive function of gamma oscillations in visual cortex.

Learning spiking neuronal networks with artificial neural networks: neural oscillations

First-principles-based modelings have been extremely successful in providing crucial insights and predictions for complex biological functions and phenomena. However, they can be hard to build and expensive to simulate for complex living systems. On the other hand, modern data-driven methods thrive at modeling many types of high-dimensional and noisy data. Still, the training and interpretation of these data-driven models remain challenging. Here, we combine the two types of methods to model stochastic neuronal network oscillations. Specifically, we develop a class of artificial neural networks to provide faithful surrogates to the high-dimensional, nonlinear oscillatory dynamics produced by a spiking neuronal network model. Furthermore, when the training data set is enlarged within a range of parameter choices, the artificial neural networks become generalizable to these parameters, covering cases in distinctly different dynamical regimes. In all, our work opens a new avenue for modeling complex neuronal network dynamics with artificial neural networks.

Data-driven multiscale computational models of cortical and subcortical regions

Data-driven computational models of neurons, synapses, microcircuits, and mesocircuits have become essential tools in modern brain research. The goal of these multiscale models is to integrate and synthesize information from different levels of brain organization, from cellular properties, dendritic excitability, and synaptic dynamics to microcircuits, mesocircuits, and ultimately behavior. This article surveys recent advances in the genesis of data-driven computational models of mammalian neural networks in cortical and subcortical areas. I discuss the challenges and opportunities in developing data-driven multiscale models, including the need for interdisciplinary collaborations, the importance of model validation and comparison, and the potential impact on basic and translational neuroscience research. Finally, I highlight future directions and emerging technologies that will enable more comprehensive and predictive data-driven models of brain function and dysfunction.

Neuronal composition of processing modules in human V1: laminar density for neuronal and non-neuronal populations and a comparison with macaque

The neuronal composition of homologous brain regions in different primates is important for understanding their processing capacities. Primary visual cortex (V1) has been widely studied in different members of the catarrhines. Neuronal density is considered to be central in defining the structure-function relationship. In human, there are large variations in the reported neuronal density from prior studies. We found the neuronal density in human V1 was 79,000 neurons/mm3, which is 35% of the neuronal density previously determined in macaque V1. Laminar density was proportionally similar between human and macaque. In V1, the ocular dominance column (ODC) contains the circuits for the emergence of orientation preference and spatial processing of a point image in many mammalian species. Analysis of the total neurons in an ODC and of the full number of neurons in macular vision (the central 15°) indicates that humans have 1.3× more neurons than macaques even though the density of neurons in macaque is 3× the density in human V1. We propose that the number of neurons in a functional processing unit rather than the number of neurons under a mm2 of cortex is more appropriate for cortical comparisons across species.

Beyond ℓ1 sparse coding in V1

Growing evidence indicates that only a sparse subset from a pool of sensory neurons is active for the encoding of visual stimuli at any instant in time. Traditionally, to replicate such biological sparsity, generative models have been using the ℓ1 norm as a penalty due to its convexity, which makes it amenable to fast and simple algorithmic solvers. In this work, we use biological vision as a test-bed and show that the soft thresholding operation associated to the use of the ℓ1 norm is highly suboptimal compared to other functions suited to approximating ℓp with 0 ≤ p < 1 (including recently proposed continuous exact relaxations), in terms of performance. We show that ℓ1 sparsity employs a pool with more neurons, i.e. has a higher degree of overcompleteness, in order to maintain the same reconstruction error as the other methods considered. More specifically, at the same sparsity level, the thresholding algorithm using the ℓ1 norm as a penalty requires a dictionary of ten times more units compared to the proposed approach, where a non-convex continuous relaxation of the ℓ0 pseudo-norm is used, to reconstruct the external stimulus equally well. At a fixed sparsity level, both ℓ0- and ℓ1-based regularization develop units with receptive field (RF) shapes similar to biological neurons in V1 (and a subset of neurons in V2), but ℓ0-based regularization shows approximately five times better reconstruction of the stimulus. Our results in conjunction with recent metabolic findings indicate that for V1 to operate efficiently it should follow a coding regime which uses a regularization that is closer to the ℓ0 pseudo-norm rather than the ℓ1 one, and suggests a similar mode of operation for the sensory cortex in general.

How to incorporate biological insights into network models and why it matters

Due to the staggering complexity of the brain and its neural circuitry, neuroscientists rely on the analysis of mathematical models to elucidate its function. From Hodgkin and Huxley's detailed description of the action potential in 1952 to today, new theories and increasing computational power have opened up novel avenues to study how neural circuits implement the computations that underlie behaviour. Computational neuroscientists have developed many models of neural circuits that differ in complexity, biological realism or emergent network properties. With recent advances in experimental techniques for detailed anatomical reconstructions or large-scale activity recordings, rich biological data have become more available. The challenge when building network models is to reflect experimental results, either through a high level of detail or by finding an appropriate level of abstraction. Meanwhile, machine learning has facilitated the development of artificial neural networks, which are trained to perform specific tasks. While they have proven successful at achieving task-oriented behaviour, they are often abstract constructs that differ in many features from the physiology of brain circuits. Thus, it is unclear whether the mechanisms underlying computation in biological circuits can be investigated by analysing artificial networks that accomplish the same function but differ in their mechanisms. Here, we argue that building biologically realistic network models is crucial to establishing causal relationships between neurons, synapses, circuits and behaviour. More specifically, we advocate for network models that consider the connectivity structure and the recorded activity dynamics while evaluating task performance.

Motion perception based on ON/OFF channels: A survey

Motion perception is an essential ability for animals and artificially intelligent systems interacting effectively, safely with surrounding objects and environments. Biological visual systems, that have naturally evolved over hundreds-million years, are quite efficient and robust for motion perception, whereas artificial vision systems are far from such capability. This paper argues that the gap can be significantly reduced by formulation of ON/OFF channels in motion perception models encoding luminance increment (ON) and decrement (OFF) responses within receptive field, separately. Such signal-bifurcating structure has been found in neural systems of many animal species articulating early motion is split and processed in segregated pathways. However, the corresponding biological substrates, and the necessity for artificial vision systems have never been elucidated together, leaving concerns on uniqueness and advantages of ON/OFF channels upon building dynamic vision systems to address real world challenges. This paper highlights the importance of ON/OFF channels in motion perception through surveying current progress covering both neuroscience and computationally modelling works with applications. Compared to related literature, this paper for the first time provides insights into implementation of different selectivity to directional motion of looming, translating, and small-sized target movement based on ON/OFF channels in keeping with soundness and robustness of biological principles. Existing challenges and future trends of such bio-plausible computational structure for visual perception in connection with hotspots of machine learning, advanced vision sensors like event-driven camera finally are discussed.

Non-Trivial Dynamics in the FizHugh-Rinzel Model and Non-Homogeneous Oscillatory-Excitable Reaction-Diffusions Systems

This article focuses on the qualitative analysis of complex dynamics arising in a few mathematical models in neuroscience context. We first discuss the dynamics arising in the three-dimensional FitzHugh-Rinzel (FHR) model and then illustrate those arising in a class of non-homogeneous FitzHugh-Nagumo (Nh-FHN) reaction-diffusion systems. FHR and Nh-FHN models can be used to generate relevant complex dynamics and wave-propagation phenomena in neuroscience context. Such complex dynamics include canards, mixed-mode oscillations (MMOs), Hopf-bifurcations and their spatially extended counterpart. Our article highlights original methods to characterize these complex dynamics and how they emerge in ordinary differential equations and spatially extended models.

Synchronization and oscillation behaviors of excitatory and inhibitory populations with spike-timing-dependent plasticity

The effect of synaptic plasticity on the synchronization mechanism of the cerebral cortex has been a hot research topic over the past two decades. There are a great deal of literatures on excitatory pyramidal neurons, but the mechanism of interaction between the inhibitory interneurons is still under exploration. In this study, we consider a complex network consisting of excitatory (E) pyramidal neurons and inhibitory (I) interneurons interacting with chemical synapses through spike-timing-dependent plasticity (STDP). To study the effects of eSTDP and iSTDP on synchronization and oscillation behaviors emerged in an excitatory-inhibitory balanced network, we analyzed three different cases, a small-world network of purely excitatory neurons with eSTDP, a small-world network of purely inhibitory neurons with iSTDP and a small-world network with excitatory-inhibitory balanced neurons. By varying the number of inhibitory interneurons, and that of connected edges in a small-world network, and the coupling strength, these networks exhibit different synchronization and oscillation behaviors. We found that the eSTDP facilitates synchronization effectively, while iSTDP has no significant impact on it. In addition, eSTDP and iSTDP restrict the balance of the excitatory-inhibitory balanced neuronal network together and play a fundamental role in maintaining network stability and synchronization. They also can be used to guide the treatment and further research of neurodegenerative diseases.

A Computational Model of Direction Selectivity in Macaque V1 Cortex Based on Dynamic Differences between On and Off Pathways

This paper is about neural mechanisms of direction selectivity (DS) in macaque primary visual cortex, V1. We present data (on male macaque) showing strong DS in a majority of simple cells in V1 layer 4Cα, the cortical layer that receives direct afferent input from the magnocellular division of the lateral geniculate nucleus (LGN). Magnocellular LGN cells are not direction-selective. To understand the mechanisms of DS, we built a large-scale, recurrent model of spiking neurons called DSV1. Like its predecessors, DSV1 reproduces many visual response properties of V1 cells including orientation selectivity. Two important new features of DSV1 are (1) DS is initiated by small, consistent dynamic differences in the visual responses of OFF and ON Magnocellular LGN cells, and (2) DS in the responses of most model simple cells is increased over those of their feedforward inputs; this increase is achieved through dynamic interaction of feedforward and intracortical synaptic currents without the use of intracortical direction-specific connections. The DSV1 model emulates experimental data in the following ways: (1) most 4Cα Simple cells were highly direction-selective but 4Cα Complex cells were not; (2) the preferred directions of the model's direction-selective Simple cells were invariant with spatial and temporal frequency (TF); (3) the distribution of the preferred/opposite ratio across the model's population of cells was very close to that found in experiments. The strong quantitative agreement between DS in data and in model simulations suggests that the neural mechanisms of DS in DSV1 may be similar to those in the real visual cortex.SIGNIFICANCE STATEMENT Motion perception is a vital part of our visual experience of the world. In monkeys, whose vision resembles that of humans, the neural computation of the direction of a moving target starts in the primary visual cortex, V1, in layer 4Cα that receives input from the eye through the lateral geniculate nucleus (LGN). How direction selectivity (DS) is generated in layer 4Cα is an outstanding unsolved problem in theoretical neuroscience. In this paper, we offer a solution based on plausible biological mechanisms. We present a new large-scale circuit model in which DS originates from slightly different LGN ON/OFF response time-courses and is enhanced in cortex without the need for direction-specific intracortical connections. The model's DS is in quantitative agreement with experiments.

Artificial Visual System for Orientation Detection Based on Hubel–Wiesel Model

The Hubel–Wiesel (HW) model is a classical neurobiological model for explaining the orientation selectivity of cortical cells. However, the HW model still has not been fully proved physiologically, and there are few concise but efficient systems to quantify and simulate the HW model and can be used for object orientation detection applications. To realize a straightforward and efficient quantitive method and validate the HW model’s reasonability and practicality, we use McCulloch-Pitts (MP) neuron model to simulate simple cells and complex cells and implement an artificial visual system (AVS) for two-dimensional object orientation detection. First, we realize four types of simple cells that are only responsible for detecting a specific orientation angle locally. Complex cells are realized with the sum function. Every local orientation information of an object is collected by simple cells and subsequently converged to the corresponding same type complex cells for computing global activation degree. Finally, the global orientation is obtained according to the activation degree of each type of complex cell. Based on this scheme, an AVS for global orientation detection is constructed. We conducted computer simulations to prove the feasibility and effectiveness of our scheme and the AVS. Computer simulations show that the mechanism-based AVS can make accurate orientation discrimination and shows striking biological similarities with the natural visual system, which indirectly proves the rationality of the Hubel–Wiesel model. Furthermore, compared with traditional CNN, we find that our AVS beats CNN on orientation detection tasks in identification accuracy, noise resistance, computation and learning cost, hardware implementation, and reasonability.

Revisiting horizontal connectivity rules in V1: from like-to-like towards like-to-all

Horizontal connections in the primary visual cortex of carnivores, ungulates and primates organize on a near-regular lattice. Given the similar length scale for the regularity found in cortical orientation maps, the currently accepted theoretical standpoint is that these maps are underpinned by a like-to-like connectivity rule: horizontal axons connect preferentially to neurons with similar preferred orientation. However, there is reason to doubt the rule's explanatory power, since a growing number of quantitative studies show that the like-to-like connectivity preference and bias mostly observed at short-range scale, are highly variable on a neuron-to-neuron level and depend on the origin of the presynaptic neuron. Despite the wide availability of published data, the accepted model of visual processing has never been revised. Here, we review three lines of independent evidence supporting a much-needed revision of the like-to-like connectivity rule, ranging from anatomy to population functional measures, computational models and to theoretical approaches. We advocate an alternative, distance-dependent connectivity rule that is consistent with new structural and functional evidence: from like-to-like bias at short horizontal distance to like-to-all at long horizontal distance. This generic rule accounts for the observed high heterogeneity in interactions between the orientation and retinotopic domains, that we argue is necessary to process non-trivial stimuli in a task-dependent manner.

Machine Learning-Derived Multimodal Neuroimaging of Presurgical Target Area to Predict Individual's Seizure Outcomes After Epilepsy Surgery

Objectives: Half of the patients who have tailored resection of the suspected epileptogenic zone for drug-resistant epilepsy have recurrent postoperative seizures. Although neuroimaging has become an indispensable part of delineating the epileptogenic zone, no validated method uses neuroimaging of presurgical target area to predict an individual's post-surgery seizure outcome. We aimed to develop and validate a machine learning-powered approach incorporating multimodal neuroimaging of a presurgical target area to predict an individual's post-surgery seizure outcome in patients with drug-resistant focal epilepsy. Materials and Methods: One hundred and forty-one patients with drug-resistant focal epilepsy were classified either as having seizure-free (Engel class I) or seizure-recurrence (Engel class II through IV) at least 1 year after surgery. The presurgical magnetic resonance imaging, positron emission tomography, computed tomography, and postsurgical magnetic resonance imaging were co-registered for surgical target volume of interest (VOI) segmentation; all VOIs were decomposed into nine fixed views, then were inputted into the deep residual network (DRN) that was pretrained on Tiny-ImageNet dataset to extract and transfer deep features. A multi-kernel support vector machine (MKSVM) was used to integrate multiple views of feature sets and to predict seizure outcomes of the targeted VOIs. Leave-one-out validation was applied to develop a model for verifying the prediction. In the end, performance using this approach was assessed by calculating accuracy, sensitivity, and specificity. Receiver operating characteristic curves were generated, and the optimal area under the receiver operating characteristic curve (AUC) was calculated as a metric for classifying outcomes. Results: Application of DRN-MKSVM model based on presurgical target area neuroimaging demonstrated good performance in predicting seizure outcomes. The AUC ranged from 0.799 to 0.952. Importantly, the classification performance DRN-MKSVM model using data from multiple neuroimaging showed an accuracy of 91.5%, a sensitivity of 96.2%, a specificity of 85.5%, and AUCs of 0.95, which were significantly better than any other single-modal neuroimaging (all p ˂ 0.05). Conclusion: DRN-MKSVM, using multimodal compared with unimodal neuroimaging from the surgical target area, accurately predicted postsurgical outcomes. The preoperative individualized prediction of seizure outcomes in patients who have been judged eligible for epilepsy surgery could be conveniently facilitated. This may aid epileptologists in presurgical evaluation by providing a tool to explore various surgical options, offering complementary information to existing clinical techniques.

Cortical Representation of Touch in Silico

With its six layers and ~ 12,000 neurons, a cortical column is a complex network whose function is plausibly greater than the sum of its constituents'. Functional characterization of its network components will require going beyond the brute-force modulation of the neural activity of a small group of neurons. Here we introduce an open-source, biologically inspired, computationally efficient network model of the somatosensory cortex's granular and supragranular layers after reconstructing the barrel cortex in soma resolution. Comparisons of the network activity to empirical observations showed that the in silico network replicates the known properties of touch representations and whisker deprivation-induced changes in synaptic strength induced in vivo. Simulations show that the history of the membrane potential acts as a spatial filter that determines the presynaptic population of neurons contributing to a post-synaptic action potential; this spatial filtering might be critical for synaptic integration of top-down and bottom-up information.

A data-informed mean-field approach to mapping of cortical parameter landscapes

Constraining the many biological parameters that govern cortical dynamics is computationally and conceptually difficult because of the curse of dimensionality. This paper addresses these challenges by proposing (1) a novel data-informed mean-field (MF) approach to efficiently map the parameter space of network models; and (2) an organizing principle for studying parameter space that enables the extraction biologically meaningful relations from this high-dimensional data. We illustrate these ideas using a large-scale network model of the Macaque primary visual cortex. Of the 10-20 model parameters, we identify 7 that are especially poorly constrained, and use the MF algorithm in (1) to discover the firing rate contours in this 7D parameter cube. Defining a "biologically plausible" region to consist of parameters that exhibit spontaneous Excitatory and Inhibitory firing rates compatible with experimental values, we find that this region is a slightly thickened codimension-1 submanifold. An implication of this finding is that while plausible regimes depend sensitively on parameters, they are also robust and flexible provided one compensates appropriately when parameters are varied. Our organizing principle for conceptualizing parameter dependence is to focus on certain 2D parameter planes that govern lateral inhibition: Intersecting these planes with the biologically plausible region leads to very simple geometric structures which, when suitably scaled, have a universal character independent of where the intersections are taken. In addition to elucidating the geometry of the plausible region, this invariance suggests useful approximate scaling relations. Our study offers, for the first time, a complete characterization of the set of all biologically plausible parameters for a detailed cortical model, which has been out of reach due to the high dimensionality of parameter space.

Gamma rhythms in the visual cortex: functions and mechanisms

Gamma-band activity, peaking around 30–100 Hz in the local field potential's power spectrum, has been found and intensively studied in many brain regions. Although gamma is thought to play a critical role in processing neural information in the brain, its cognitive functions and neural mechanisms remain unclear or debatable. Experimental studies showed that gamma rhythms are stochastic in time and vary with visual stimuli. Recent studies further showed that multiple rhythms coexist in V1 with distinct origins in different species. While all these experimental facts are a challenge for understanding the functions of gamma in the visual cortex, there are many signs of progress in computational studies. This review summarizes and discusses studies on gamma in the visual cortex from multiple perspectives and concludes that gamma rhythms are still a mystery. Combining experimental and computational studies seems the best way forward in the future.

Multiple gamma rhythms carry distinct spatial frequency information in primary visual cortex

Gamma rhythms in many brain regions, including the primary visual cortex (V1), are thought to play a role in information processing. Here, we report a surprising finding of 3 narrowband gamma rhythms in V1 that processed distinct spatial frequency (SF) signals and had different neural origins. The low gamma (LG; 25 to 40 Hz) rhythm was generated at the V1 superficial layer and preferred a higher SF compared with spike activity, whereas both the medium gamma (MG; 40 to 65 Hz), generated at the cortical level, and the high gamma HG; (65 to 85 Hz), originated precortically, preferred lower SF information. Furthermore, compared with the rates of spike activity, the powers of the 3 gammas had better performance in discriminating the edge and surface of simple objects. These findings suggest that gamma rhythms reflect the neural dynamics of neural circuitries that process different SF information in the visual system, which may be crucial for multiplexing SF information and synchronizing different features of an object.

A Model of the Early Visual System Based on Parallel Spike-Sequence Detection, Showing Orientation Selectivity

Simple Summary

A computational model of primates’ early visual processing, showing orientation selectivity, is presented. The system importantly integrates two key elements: (1) a neuromorphic spike-decoding structure that considerably resembles the circuitry between layers IV and II/III of the primary visual cortex, both in topology and operation; (2) the plasticity of intrinsic excitability, to embed recent findings about the operation of the same area. The model is proposed as a tool for the analysis and reproduction of the orientation selectivity phenomenon, whose underlying neuronal-level computational mechanisms are today the subject of intense scrutiny. In response to rotated Gabor patches the model is able to exhibit realistic orientation tuning curves and to reproduce responses similar to those found in neurophysiological recordings from the primary visual cortex obtained under the same task, considering different stages of the network. This demonstrates its aptness to capture the mechanisms underlying the evoked response in the primary visual cortex. Our tool is available online, and can be expanded to other experiments using a dedicated software library developed by the authors, to elucidate the computational mechanisms underlying orientation selectivity.

Abstract

Since the first half of the twentieth century, numerous studies have been conducted on how the visual cortex encodes basic image features. One of the hallmarks of basic feature extraction is the phenomenon of orientation selectivity, of which the underlying neuronal-level computational mechanisms remain partially unclear despite being intensively investigated. In this work we present a reduced visual system model (RVSM) of the first level of scene analysis, involving the retina, the lateral geniculate nucleus and the primary visual cortex (V1), showing orientation selectivity. The detection core of the RVSM is the neuromorphic spike-decoding structure MNSD, which is able to learn and recognize parallel spike sequences and considerably resembles the neuronal microcircuits of V1 in both topology and operation. This structure is equipped with plasticity of intrinsic excitability to embed recent findings about V1 operation. The RVSM, which embeds 81 groups of MNSD arranged in 4 oriented columns, is tested using sets of rotated Gabor patches as input. Finally, synthetic visual evoked activity generated by the RVSM is compared with real neurophysiological signal from V1 area: (1) postsynaptic activity of human subjects obtained by magnetoencephalography and (2) spiking activity of macaques obtained by multi-tetrode arrays. The system is implemented using the NEST simulator. The results attest to a good level of resemblance between the model response and real neurophysiological recordings. As the RVSM is available online, and the model parameters can be customized by the user, we propose it as a tool to elucidate the computational mechanisms underlying orientation selectivity.

A theory of direction selectivity for macaque primary visual cortex

This paper offers a theory for the origin of direction selectivity (DS) in the macaque primary visual cortex, V1. DS is essential for the perception of motion and control of pursuit eye movements. In the macaque visual pathway, neurons with DS first appear in V1, in the Simple cell population of the Magnocellular input layer 4Cα. The lateral geniculate nucleus (LGN) cells that project to these cortical neurons, however, are not direction selective. We hypothesize that DS is initiated in feed-forward LGN input, in the summed responses of LGN cells afferent to a cortical cell, and it is achieved through the interplay of 1) different visual response dynamics of ON and OFF LGN cells and 2) the wiring of ON and OFF LGN neurons to cortex. We identify specific temporal differences in the ON/OFF pathways that, together with item 2, produce distinct response time courses in separated subregions; analysis and simulations confirm the efficacy of the mechanisms proposed. To constrain the theory, we present data on Simple cells in layer 4Cα in response to drifting gratings. About half of the cells were found to have high DS, and the DS was broadband in spatial and temporal frequency (SF and TF). The proposed theory includes a complete analysis of how stimulus features such as SF and TF interact with ON/OFF dynamics and LGN-to-cortex wiring to determine the preferred direction and magnitude of DS.

Unraveling the mechanisms of surround suppression in early visual processing

This paper uses mathematical modeling to study the mechanisms of surround suppression in the primate visual cortex. We present a large-scale neural circuit model consisting of three interconnected components: LGN and two input layers (Layer 4Ca and Layer 6) of the primary visual cortex V1, covering several hundred hypercolumns. Anatomical structures are incorporated and physiological parameters from realistic modeling work are used. The remaining parameters are chosen to produce model outputs that emulate experimentally observed size-tuning curves. Our two main results are: (i) we discovered the character of the long-range connections in Layer 6 responsible for surround effects in the input layers; and (ii) we showed that a net-inhibitory feedback, i.e., feedback that excites I-cells more than E-cells, from Layer 6 to Layer 4 is conducive to producing surround properties consistent with experimental data. These results are obtained through parameter selection and model analysis. The effects of nonlinear recurrent excitation and inhibition are also discussed. A feature that distinguishes our model from previous modeling work on surround suppression is that we have tried to reproduce realistic lengthscales that are crucial for quantitative comparison with data. Due to its size and the large number of unknown parameters, the model is computationally challenging. We demonstrate a strategy that involves first locating baseline values for relevant parameters using a linear model, followed by the introduction of nonlinearities where needed. We find such a methodology effective, and propose it as a possibility in the modeling of complex biological systems.

A bio-syncretic phototransistor based on optogenetically engineered living cells

Human eyes rely on photosensitive receptors to convert light intensity into action potentials for visual perception, and thus bio-inspired photodetectors with bioengineered photoresponsive elements for visual prostheses have received considerable attention by virtue of superior biological functionality and better biocompatibility. However, the current bioengieered photodetectors based on biological elements face a lot of challenges such as slow response time and lack of effective detection of weak bioelectrical signals, resulting in difficulty to perform imaging. Here, we report a human eye-inspired phototransistor by integrating optogenetically engineered living cells and a graphene-based transistor. The living cells, engineered with photosensitive ion channels, channelrhodopsin-2 (ChR2), and thus endowed with the capability of transducing light intensity into bioelectrical signals, are coupled with the graphene layer of the transistor and can regulate the transistor's output. The results show that the photosensitive ion channels enable the phototransistor to output stronger photoelectrical currents with relatively fast response (~25 ms) and wider dynamic range, and demonstrate the transistor owns optical and biological gating with a significant large on/off ratio of 197.5 and high responsivity of 1.37 mA W^-1. An artificial imaging system, which mimics the pathway of human visual information transmission from the retina through the lateral geniculate nucleus to the visual cortex, is constructed with the transistor and demonstrate the feasibility of imaging using the bioengineered cells. This work shows a potential that optogenetically engineered cells can be used to develop novel visual prostheses and paves a new avenue for engineering bio-syncretic sensing devices.

Malleability of gamma rhythms enhances population-level correlations

An important problem in systems neuroscience is to understand how information is communicated among brain regions, and it has been proposed that communication is mediated by neuronal oscillations, such as rhythms in the gamma band. We sought to investigate this idea by using a network model with two components, a source (sending) and a target (receiving) component, both built to resemble local populations in the cerebral cortex. To measure the effectiveness of communication, we used population-level correlations in spike times between the source and target. We found that after correcting for a response time that is independent of initial conditions, spike-time correlations between the source and target are significant, due in large measure to the alignment of firing events in their gamma rhythms. But, we also found that regular oscillations cannot produce the results observed in our model simulations of cortical neurons. Surprisingly, it is the irregularity of gamma rhythms, the absence of internal clocks, together with the malleability of these rhythms and their tendency to align with external pulses - features that are known to be present in gamma rhythms in the real cortex - that produced the results observed. These findings and the mechanistic explanations we offered are our primary results. Our secondary result is a mathematical relationship between correlations and the sizes of the samples used for their calculation. As improving technology enables recording simultaneously from increasing numbers of neurons, this relationship could be useful for interpreting results from experimental recordings.

A Cortical-Inspired Sub-Riemannian Model for Poggendorff-Type Visual Illusions

We consider Wilson-Cowan-type models for the mathematical description of orientation-dependent Poggendorff-like illusions. Our modelling improves two previously proposed cortical-inspired approaches, embedding the sub-Riemannian heat kernel into the neuronal interaction term, in agreement with the intrinsically anisotropic functional architecture of V1 based on both local and lateral connections. For the numerical realisation of both models, we consider standard gradient descent algorithms combined with Fourier-based approaches for the efficient computation of the sub-Laplacian evolution. Our numerical results show that the use of the sub-Riemannian kernel allows us to reproduce numerically visual misperceptions and inpainting-type biases in a stronger way in comparison with the previous approaches.

Spatial modulation of visual responses arises in cortex with active navigation

During navigation, the visual responses of neurons in mouse primary visual cortex (V1) are modulated by the animal's spatial position. Here we show that this spatial modulation is similarly present across multiple higher visual areas but negligible in the main thalamic pathway into V1. Similar to hippocampus, spatial modulation in visual cortex strengthens with experience and with active behavior. Active navigation in a familiar environment, therefore, enhances the spatial modulation of visual signals starting in the cortex.

The Generation and Modulation of Distinct Gamma Oscillations with Local, Horizontal, and Feedback Connections in the Primary Visual Cortex: A Model Study on Large-Scale Networks

Gamma oscillation (GAMMA) in the local field potential (LFP) is a synchronized activity commonly found in many brain regions, and it has been thought as a functional signature of network connectivity in the brain, which plays important roles in information processing. Studies have shown that the response property of GAMMA is related to neural interaction through local recurrent connections (RC), feed-forward (FF), and feedback (FB) connections. However, the relationship between GAMMA and long-range horizontal connections (HC) in the brain remains unclear. Here, we aimed to understand this question in a large-scale network model for the primary visual cortex (V1). We created a computational model composed of multiple excitatory and inhibitory units with biologically plausible connectivity patterns for RC, FF, FB, and HC in V1; then, we quantitated GAMMA in network models at different strength levels of HC and other connection types. Surprisingly, we found that HC and FB, the two types of large-scale connections, play very different roles in generating and modulating GAMMA. While both FB and HC modulate a fast gamma oscillation (around 50-60 Hz) generated by FF and RC, HC generates a new GAMMA oscillating around 30 Hz, whose power and peak frequency can also be modulated by FB. Furthermore, response properties of the two GAMMAs in a network with both HC and FB are different in a way that is highly consistent with a recent experimental finding for distinct GAMMAs in macaque V1. The results suggest that distinct GAMMAs are signatures for neural connections in different spatial scales and they might be related to different functions for information integration. Our study, for the first time, pinpoints the underlying circuits for distinct GAMMAs in a mechanistic model for macaque V1, which might provide a new framework to study multiple gamma oscillations in other cortical regions.

Contrast response in a comprehensive network model of macaque V1

The response to contrast is one of the most important functions of the macaque primary visual cortex, V1, but up to now there has not been an adequate theory for it. To fill this gap in our understanding of cortical function, we built and analyzed a new large-scale, biologically constrained model of the input layer, 4Cα, of macaque V1. We called the new model CSY2. We challenged CSY2 with a three-parameter family of visual stimuli that varied in contrast, orientation, and spatial frequency. CSY2 accurately simulated experimental data and made many new predictions. It accounted for 1) the shapes of firing-rate-versus-contrast functions, 2) orientation and spatial frequency tuning versus contrast, and 3) the approximate contrast-invariance of cortical activity maps. Post-analysis revealed that the mechanisms that were needed to produce the successful simulations of contrast response included strong recurrent excitation and inhibition that find dynamic equilibria across the cortical surface, dynamic feedback between L6 and L4, and synaptic dynamics like inhibitory synaptic depression.

A Robust Collision Perception Visual Neural Network With Specific Selectivity to Darker Objects

Building an efficient and reliable collision perception visual system is a challenging problem for future robots and autonomous vehicles. The biological visual neural networks, which have evolved over millions of years in nature and are working perfectly in the real world, could be ideal models for designing artificial vision systems. In the locust's visual pathways, a lobula giant movement detector (LGMD), that is, the LGMD2, has been identified as a looming perception neuron that responds most strongly to darker approaching objects relative to their backgrounds; similar situations which many ground vehicles and robots are often faced with. However, little has been done on modeling the LGMD2 and investigating its potential in robotics and vehicles. In this article, we build an LGMD2 visual neural network which possesses the similar collision selectivity of an LGMD2 neuron in locust via the modeling of biased-ON and -OFF pathways splitting visual signals into parallel ON/OFF channels. With stronger inhibition (bias) in the ON pathway, this model responds selectively to darker looming objects. The proposed model has been tested systematically with a range of stimuli including real-world scenarios. It has also been implemented in a micro-mobile robot and tested with real-time experiments. The experimental results have verified the effectiveness and robustness of the proposed model for detecting darker looming objects against various dynamic and cluttered backgrounds.

DNN-assisted statistical analysis of a model of local cortical circuits

In neuroscience, computational modeling is an effective way to gain insight into cortical mechanisms, yet the construction and analysis of large-scale network models—not to mention the extraction of underlying principles—are themselves challenging tasks, due to the absence of suitable analytical tools and the prohibitive costs of systematic numerical exploration of high-dimensional parameter spaces. In this paper, we propose a data-driven approach assisted by deep neural networks (DNN). The idea is to first discover certain input-output relations, and then to leverage this information and the superior computation speeds of the well-trained DNN to guide parameter searches and to deduce theoretical understanding. To illustrate this novel approach, we used as a test case a medium-size network of integrate-and-fire neurons intended to model local cortical circuits. With the help of an accurate yet extremely efficient DNN surrogate, we revealed the statistics of model responses, providing a detailed picture of model behavior. The information obtained is both general and of a fundamental nature, with direct application to neuroscience. Our results suggest that the methodology proposed can be scaled up to larger and more complex biological networks when used in conjunction with other techniques of biological modeling.

Entropy, mutual information, and systematic measures of structured spiking neural networks

The aim of this paper is to investigate various information-theoretic measures, including entropy, mutual information, and some systematic measures that are based on mutual information, for a class of structured spiking neuronal networks. In order to analyze and compute these information-theoretic measures for large networks, we coarse-grained the data by ignoring the order of spikes that fall into the same small time bin. The resultant coarse-grained entropy mainly captures the information contained in the rhythm produced by a local population of the network. We first show that these information theoretical measures are well-defined and computable by proving stochastic stability and the law of large numbers. Then we use three neuronal network examples, from simple to complex, to investigate these information-theoretic measures. Several analytical and computational results about properties of these information-theoretic measures are given.

Enhanced Attention Using Head-mounted Virtual Reality

Some evidence suggests that experiencing a given scenario using virtual reality (VR) may engage greater attentional resources than experiencing the same scenario on a 2D computer monitor. However, the underlying neural processes associated with these VR-related effects, especially those pertaining to current consumer-friendly head-mounted displays of virtual reality (HMD-VR), remain unclear. Here, two experiments were conducted to compare task performance and EEG-based neural metrics captured during a perceptual discrimination task presented on two different viewing platforms. Forty participants (20–25 years old) completed this task using both an HMD-VR and traditional computer monitor in a within-group, randomized design. Although Experiment I (n = 20) was solely behavioral in design, Experiment II (n = 20) utilized combined EEG recordings to interrogate the neural correlates underlying potential performance differences across platforms. These experiments revealed that (1) there was no significant difference in the amount of arousal measured between platforms and (2) selective attention abilities in HMD-VR environment were enhanced from both a behavioral and neural perspective. These findings suggest that the allocation of attentional resources in HMD-VR may be superior to approaches more typically used to assess these abilities (e.g., desktop/laptop/tablet computers with 2D screens).

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

Ring models of binocular rivalry and fusion

When similar visual stimuli are presented binocularly to both eyes, one perceives a fused single image. However, when the two stimuli are distinct, one does not perceive a single image; instead, one perceives binocular rivalry. That is, one perceives one of the stimulated patterns for a few seconds, then the other for few seconds, and so on - with random transitions between the two percepts. Most theoretical studies focus on rivalry, with few considering the coexistence of fusion and rivalry. Here we develop three distinct computational neuronal network models which capture binocular rivalry with realistic stochastic properties, fusion, and the hysteretic transition between. Each is a conductance-based point neuron model, which is multi-layer with two ocular dominance columns (L & R) and with an idealized "ring" architecture where the orientation preference of each neuron labels its location on a ring. In each model, the primary mechanism initiating binocular rivalry is cross-column inhibition, with firing rate adaptation governing the temporal properties of the transitions between percepts. Under stimulation by similar visual patterns, each of three models uses its own mechanism to overcome cross-column inhibition, and thus to prevent rivalry and allow the fusion of similar images: The first model uses cross-column feedforward inhibition from the opposite eye to "shut off" the cross-column feedback inhibition; the second model "turns on" a second layer of monocular neurons as a parallel pathway to the binocular neurons, rivaling out of phase with the first layer, and together these two pathways represent fusion; and the third model uses cross-column excitation to overcome the cross-column inhibition and enable fusion. Thus, each of the idealized ring models depends upon a different mechanism for fusion that might emerge as an underlying mechanism present in real visual cortex.

Visual illusions via neural dynamics: Wilson-Cowan-type models and the efficient representation principle

We reproduce suprathreshold perception phenomena, specifically visual illusions, by Wilson-Cowan (WC)-type models of neuronal dynamics. Our findings show that the ability to replicate the illusions considered is related to how well the neural activity equations comply with the efficient representation principle. Our first contribution consists in showing that the WC equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the WC dynamics are minimizing. This leads us to consider an alternative, variational modeling, which has been previously employed for local histogram equalization (LHE) tasks. To adapt our model to the architecture of V1, we perform an extension that has an explicit dependence on local image orientation. Finally, we report several numerical experiments showing that LHE provides a better reproduction of visual illusions than the original WC formulation, and that its cortical extension is capable also to reproduce complex orientation-dependent illusions.NEW & NOTEWORTHY We show that the Wilson-Cowan equations can reproduce a number of brightness and orientation-dependent illusions. Then we formally prove that there cannot be an energy functional that the Wilson-Cowan equations are minimizing, making them suboptimal with respect to the efficient representation principle. We thus propose a slight modification that is consistent with such principle and show that this provides a better reproduction of visual illusions than the original Wilson-Cowan formulation. We also consider the cortical extension of both models to deal with more complex orientation-dependent illusions.

Functional Clusters of Neurons in Layer 6 of Macaque V1

Layer 6 appears to perform a very important role in the function of macaque primary visual cortex, V1, but not enough is understood about the functional characteristics of neurons in the layer 6 population. It is unclear to what extent the population is homogeneous with respect to their visual properties or if one can identify distinct subpopulations. Here we performed a cluster analysis based on measurements of the responses of single neurons in layer 6 of primary visual cortex in male macaque monkeys (Macaca fascicularis) to achromatic grating stimuli that varied in orientation, direction of motion, spatial and temporal frequency, and contrast. The visual stimuli were presented in a stimulus window that was also varied in size. Using the responses to parametric variation in these stimulus variables, we extracted a number of tuning response measures and used them in the cluster analysis. Six main clusters emerged along with some smaller clusters. Additionally, we asked whether parameter distributions from each of the clusters were statistically different. There were clear separations of parameters between some of the clusters, particularly for f1/f0 ratio, direction selectivity, and temporal frequency bandwidth, but other dimensions also showed differences between clusters. Our data suggest that in layer 6 there are multiple parallel circuits that provide information about different aspects of the visual stimulus.SIGNIFICANCE STATEMENT The cortex is multilayered and is involved in many high-level computations. In the current study, we have asked whether there are subpopulations of neurons, clusters, in layer 6 of cortex with different functional tuning properties that provide information about different aspects of the visual image. We identified six major functional clusters within layer 6. These findings show that there is much more complexity to the circuits in cortex than previously demonstrated and open up a new avenue for experimental investigation within layers of other cortical areas and for the elaboration of models of circuit function that incorporate many parallel pathways with different functional roles.

The Influence of Multi-Dimensional Cognition on the Formation of the Sense of Place in an Urban Riverfront Space

Urban riverfront spaces and associated riverine landscapes play important roles in promoting human-river interactions and shaping the regional characteristics of a city. This paper explored the urban riverfront space from the material level of the riverine landscape to a multi-dimensional cognitive level and constructed a theoretical exploration model of the influence of three cognitive dimensions (sensual cognition, intellectual cognition, and rational cognition) on the ‘sense of place’ (SOP) in urban riverfronts. In addition, the measurement scales for different cognitive dimensions were explored and designed. The structural equation model (SEM) was used to analyse 329 valid survey questionnaires in June 2019 in Dujiangyan Yihu Park, China. The analysis of the case study results showed that the overall theoretical model had a good model fit. The sensual cognition, intellectual cognition, and rational cognition all had a significant influence on the SOP in the riverfront park, of which the intellectual cognition had the most significant influence. Strengthening the creation of a riverine landscape for intellectual cognition is expected to enhance the SOP in riverfront spaces more effectively and achieve more enriched interactions between people and rivers.

Relation between gamma oscillations and neuronal plasticity in the visual cortex

Learning is thought to be mediated by activity-dependent modification of neuronal interactions. To avoid maladaptive modifications of synaptic transmission by spurious activity, synaptic plasticity has to be gated. In the case of supervised learning, these gating functions are accomplished by reinforcement through value-assigning systems. Here we show that the dynamic state of local circuits correlates with the occurrence of activity-dependent long-term changes in neuronal response properties. We find that repeated visual stimuli induce long-term changes of orientation preference of neuronal populations in visual cortex if stimuli induce synchronized population responses oscillating at ɣ-frequencies. This suggests that neuronal plasticity is controlled by a hierarchy of gating systems and assigns critical gating functions to resonance properties of local circuits.

Use-dependent long-term changes of neuronal response properties must be gated to prevent irrelevant activity from inducing inappropriate modifications. Here we test the hypothesis that local network dynamics contribute to such gating. As synaptic modifications depend on temporal contiguity between presynaptic and postsynaptic activity, we examined the effect of synchronized gamma (ɣ) oscillations on stimulation-dependent modifications of orientation selectivity in adult cat visual cortex. Changes of orientation maps were induced by pairing visual stimulation with electrical activation of the mesencephalic reticular formation. Changes in orientation selectivity were assessed with optical recording of intrinsic signals and multiunit recordings. When conditioning stimuli were associated with strong ɣ-oscillations, orientation domains matching the orientation of the conditioning grating stimulus became more responsive and expanded, because neurons with preferences differing by less than 30° from the orientation of the conditioning grating shifted their orientation preference toward the conditioned orientation. When conditioning stimuli induced no or only weak ɣ-oscillations, responsiveness of neurons driven by the conditioning stimulus decreased. These differential effects depended on the power of oscillations in the low ɣ-band (20 Hz to 48 Hz) and not on differences in discharge rate of cortical neurons, because there was no correlation between the discharge rates during conditioning and the occurrence of changes in orientation preference. Thus, occurrence and polarity of use-dependent long-term changes of cortical response properties appear to depend on the occurrence of ɣ-oscillations during induction and hence on the degree of temporal coherence of the change-inducing network activity.

A case study in the functional consequences of scaling the sizes of realistic cortical models

Neuroscience models come in a wide range of scales and specificity, from mean-field rate models to large-scale networks of spiking neurons. There are potential trade-offs between simplicity and realism, versatility and computational speed. This paper is about large-scale cortical network models, and the question we address is one of scalability: would scaling down cell density impact a network’s ability to reproduce cortical dynamics and function? We investigated this problem using a previously constructed realistic model of the monkey visual cortex that is true to size. Reducing cell density gradually up to 50-fold, we studied changes in model behavior. Size reduction without parameter adjustment was catastrophic. Surprisingly, relatively minor compensation in synaptic weights guided by a theoretical algorithm restored mean firing rates and basic function such as orientation selectivity to models 10-20 times smaller than the real cortex. Not all was normal in the reduced model cortices: intracellular dynamics acquired a character different from that of real neurons, and while the ability to relay feedforward inputs remained intact, reduced models showed signs of deficiency in functions that required dynamical interaction among cortical neurons. These findings are not confined to models of the visual cortex, and modelers should be aware of potential issues that accompany size reduction. Broader implications of this study include the importance of homeostatic maintenance of firing rates, and the functional consequences of feedforward versus recurrent dynamics, ideas that may shed light on other species and on systems suffering cell loss.

With the vast numbers of neurons in the cerebral cortex, models in neuroscience are, for practical reasons, often orders of magnitude smaller than the actual network. We examine in this article the scalability of cortical networks. We find that function and dynamics in a network depend on network size. For illustration, we use a previously constructed realistic model of monkey visual cortex. Reducing the number of cells in the model, we find that small changes in synaptic weights can help maintain firing rates. However, model characteristics change fundamentally in the reduced models. Neurons have abnormal intracellular dynamics. The model becomes dominated by feedforward inputs and is less capable of functions requiring neuronal interaction. Modelers need to be aware of the potential issues with reduced cortical network models.

Densities and Laminar Distributions of Kv3.1b-, PV-, GABA-, and SMI-32-Immunoreactive Neurons in Macaque Area V1

The Kv3.1b potassium channel subunit is associated with narrow spike widths and fast-spiking properties. In macaque primary visual cortex (V1), subsets of neurons have previously been found to be Kv3.1b-immunoreactive (ir) but not parvalbumin (PV)-ir or not GABA-ir, suggesting that they may be both fast-spiking and excitatory. This population includes Meynert cells, the large layer 5/6 pyramidal neurons that are also labeled by the neurofilament antibody SMI-32. In the present study, triple immunofluorescence labeling and confocal microscopy were used to measure the distribution of Kv3.1b-ir, non-PV-ir, non-GABA-ir neurons across cortical depth in V1, and to determine whether, like the Meynert cells, other Kv3.1b-ir excitatory neurons were also SMI-32-ir pyramidal neurons. We found that Kv3.1b-ir, non-PV-ir, non-GABA-ir neurons were most prevalent in the M pathway-associated layers 4 Cα and 4B. GABAergic neurons accounted for a smaller fraction (11%) of the total neuronal population across layers 1-6 than has previously been reported. Of Kv3.1b-ir neurons, PV expression reliably indicated GABA expression. Kv3.1b-ir, non-PV-ir neurons varied in SMI-32 coimmunoreactivity. The results suggest the existence of a heterogeneous population of excitatory neurons in macaque V1 with the potential for sustained high firing rates, and these neurons were particularly abundant in layers 4B and 4 Cα.

A Neuronal Network Model of the Primate Visual System: Color Mechanisms in the Retina, LGN and V1

Color plays a key role in human vision but the neural machinery that underlies the transformation from stimulus to perception is not well understood. Here, we implemented a two-dimensional network model of the first stages in the primate parvocellular pathway (retina, lateral geniculate nucleus and layer 4C[Formula: see text] in V1) consisting of conductance-based point neurons. Model parameters were tuned based on physiological and anatomical data from the primate foveal and parafoveal vision, the most relevant visual field areas for color vision. We exhaustively benchmarked the model against well-established chromatic and achromatic visual stimuli, showing spatial and temporal responses of the model to disk- and ring-shaped light flashes, spatially uniform squares and sine-wave gratings of varying spatial frequency. The spatiotemporal patterns of parvocellular cells and cortical cells are consistent with their classification into chromatically single-opponent and double-opponent groups, and nonopponent cells selective for luminance stimuli. The model was implemented in the widely used neural simulation tool NEST and released as open source software. The aim of our modeling is to provide a biologically realistic framework within which a broad range of neuronal interactions can be examined at several different levels, with a focus on understanding how color information is processed.

Bridging large-scale neuronal recordings and large-scale network models using dimensionality reduction

A long-standing goal in neuroscience has been to bring together neuronal recordings and neural network modeling to understand brain function. Neuronal recordings can inform the development of network models, and network models can in turn provide predictions for subsequent experiments. Traditionally, neuronal recordings and network models have been related using single-neuron and pairwise spike train statistics. We review here recent studies that have begun to relate neuronal recordings and network models based on the multi-dimensional structure of neuronal population activity, as identified using dimensionality reduction. This approach has been used to study working memory, decision making, motor control, and more. Dimensionality reduction has provided common ground for incisive comparisons and tight interplay between neuronal recordings and network models.

Major Feedforward Thalamic Input Into Layer 4C of Primary Visual Cortex in Primate

One of the underlying principles of how mammalian circuits are constructed is the relative influence of feedforward to recurrent synaptic drive. It has been dogma in sensory systems that the thalamic feedforward input is relatively weak and that there is a large amplification of the input signal by recurrent feedback. Here we show that in trichromatic primates there is a major feedforward input to layer 4C of primary visual cortex. Using a combination of 3D-electron-microscopy and 3D-confocal imaging of thalamic boutons we found that the average feedforward contribution was about 20% of the total excitatory input in the parvocellular (P) pathway, about 3 times the currently accepted values for primates. In the magnocellular (M) pathway it was around 15%, nearly twice the currently accepted values. New methods showed the total synaptic and cell densities were as much as 150% of currently accepted values. The new estimates of contributions of feedforward synaptic inputs into visual cortex call for a major revision of the design of the canonical cortical circuit.

Mechanisms underlying contrast-dependent orientation selectivity in mouse V1

Recently, sophisticated optogenetic tools for mouse have enabled many detailed studies of the neuronal circuits of its primary visual cortex (V1), providing much more specific information than is available for cat or monkey. Among various other differences, they show a striking contrast dependency in orientation selectivity in mouse V1 rather than the well-known contrast invariance for cat and monkey. Constrained by the existing experiment data, we develop a comprehensive large-scale model of an effective input layer of mouse V1 that successfully reproduces the contrast-dependent phenomena and many other response properties. The model helps to probe different mechanisms based on excitation–inhibition balance that underlie both contrast dependencies and invariance, and it provides implications for future studies on these circuits.

Recent experiments have shown that mouse primary visual cortex (V1) is very different from that of cat or monkey, including response properties—one of which is that contrast invariance in the orientation selectivity (OS) of the neurons’ firing rates is replaced in mouse with contrast-dependent sharpening (broadening) of OS in excitatory (inhibitory) neurons. These differences indicate a different circuit design for mouse V1 than that of cat or monkey. Here we develop a large-scale computational model of an effective input layer of mouse V1. Constrained by experiment data, the model successfully reproduces experimentally observed response properties—for example, distributions of firing rates, orientation tuning widths, and response modulations of simple and complex neurons, including the contrast dependence of orientation tuning curves. Analysis of the model shows that strong feedback inhibition and strong orientation-preferential cortical excitation to the excitatory population are the predominant mechanisms underlying the contrast-sharpening of OS in excitatory neurons, while the contrast-broadening of OS in inhibitory neurons results from a strong but nonpreferential cortical excitation to these inhibitory neurons, with the resulting contrast-broadened inhibition producing a secondary enhancement on the contrast-sharpened OS of excitatory neurons. Finally, based on these mechanisms, we show that adjusting the detailed balances between the predominant mechanisms can lead to contrast invariance—providing insights for future studies on contrast dependence (invariance).

Rhythm and Synchrony in a Cortical Network Model

We studied mechanisms for cortical gamma-band activity in the cerebral cortex and identified neurobiological factors that affect such activity. This was done by analyzing the behavior of a previously developed, data-driven, large-scale network model that simulated many visual functions of monkey V1 cortex (Chariker et al., 2016). Gamma activity was an emergent property of the model. The model's gamma activity, like that of the real cortex, was (1) episodic, (2) variable in frequency and phase, and (3) graded in power with stimulus variables like orientation. The spike firing of the model's neuronal population was only partially synchronous during multiple firing events (MFEs) that occurred at gamma rates. Detailed analysis of the model's MFEs showed that gamma-band activity was multidimensional in its sources. Most spikes were evoked by excitatory inputs. A large fraction of these inputs came from recurrent excitation within the local circuit, but feedforward and feedback excitation also contributed, either through direct pulsing or by raising the overall baseline. Inhibition was responsible for ending MFEs, but disinhibition led directly to only a small minority of the synchronized spikes. As a potential explanation for the wide range of gamma characteristics observed in different parts of cortex, we found that the relative rise times of AMPA and GABA synaptic conductances have a strong effect on the degree of synchrony in gamma.SIGNIFICANCE STATEMENT Canonical computations used throughout the cerebral cortex are performed in primary visual cortex (V1). Providing theoretical mechanisms for these computations will advance understanding of computation throughout cortex. We studied one dynamical feature, gamma-band rhythms, in a large-scale, data-driven, computational model of monkey V1. Our most significant conclusion is that the sources of gamma band activity are multidimensional. A second major finding is that the relative rise times of excitatory and inhibitory synaptic potentials have strong effects on spike synchrony and peak gamma band power. Insight gained from studying our V1 model can shed light on the functions of other cortical regions.

Shaping the collision selectivity in a looming sensitive neuron model with parallel ON and OFF pathways and spike frequency adaptation

Shaping the collision selectivity in vision-based artificial collision-detecting systems is still an open challenge. This paper presents a novel neuron model of a locust looming detector, i.e. the lobula giant movement detector (LGMD1), in order to provide effective solutions to enhance the collision selectivity of looming objects over other visual challenges. We propose an approach to model the biologically plausible mechanisms of ON and OFF pathways and a biophysical mechanism of spike frequency adaptation (SFA) in the proposed LGMD1 visual neural network. The ON and OFF pathways can separate both dark and light looming features for parallel spatiotemporal computations. This works effectively on perceiving a potential collision from dark or light objects that approach; such a bio-plausible structure can also separate LGMD1's collision selectivity to its neighbouring looming detector - the LGMD2. The SFA mechanism can enhance the LGMD1's collision selectivity to approaching objects rather than receding and translating stimuli, which is a significant improvement compared with similar LGMD1 neuron models. The proposed framework has been tested using off-line tests of synthetic and real-world stimuli, as well as on-line bio-robotic tests. The enhanced collision selectivity of the proposed model has been validated in systematic experiments. The computational simplicity and robustness of this work have also been verified by the bio-robotic tests, which demonstrates potential in building neuromorphic sensors for collision detection in both a fast and reliable manner.

How well do reduced models capture the dynamics in models of interacting neurons?

This paper introduces a class of stochastic models of interacting neurons with emergent dynamics similar to those seen in local cortical populations. Rigorous results on existence and uniqueness of nonequilibrium steady states are proved. These network models are then compared to very simple reduced models driven by the same mean excitatory and inhibitory currents. Discrepancies in firing rates between network and reduced models are investigated and explained by correlations in spiking, or partial synchronization, working in concert with "nonlinearities" in the time evolution of membrane potentials. The use of simple random walks and their first passage times to simulate fluctuations in neuronal membrane potentials and interspike times is also considered.

Relationship between the Dynamics of Orientation Tuning and Spatiotemporal Receptive Field Structures of Cat LGN Neurons

Simple cells in the cat primary visual cortex usually have elongated receptive fields (RFs), and their orientation selectivity can be largely predicted by their RFs. As to the relay cells in cats' lateral geniculate nucleus (LGN), they also have weak but significant orientation bias (OB). It is thus of interest to investigate the fine spatiotemporal receptive field (STRF) properties in LGN, compare them with the dynamics of orientation tuning, and examine the dynamic relationship between STRF and orientation sensitivity in LGN. We mapped the STRFs of the LGN neurons in cats with white noise and characterized the dynamics of the orientation tuning by flashing gratings. We found that most of the LGN neurons showed elongated RFs and that the elongation axes were consistent with the preferred orientations. STRFs and the dynamics of orientation tuning were closely correlated temporally: the elongation of RFs and OB emerged, peaked and decayed at the same pace, with unchanged elongation axis of RF and preferred orientation but consistently changing aspect ratio of RF and OB strength across time. Importantly, the above consistency between RF and orientation tuning was not influenced by the ablation of the primary visual cortex. Furthermore, biased orientation tuning emerged 20-30 ms earlier than those in the primary visual cortex. These data demonstrated that similar to the primary visual cortex, the orientation sensitivity was closely reflected by the RF properties in LGN. However, the elongated RF and OB in LGN did not originate from the primary visual cortex feedback.