Synaptic depression and cortical gain control

Dual-Ferroelectric-Coupling-Engineered Two-Dimensional Transistors for Multifunctional In-Memory Computing

In-memory computing featuring a radical departure from the von Neumann architecture is promising to substantially reduce the energy and time consumption for data-intensive computation. With the increasing challenges facing silicon complementary metal-oxide-semiconductor (CMOS) technology, developing in-memory computing hardware would require a different platform to deliver significantly enhanced functionalities at the material and device level. Here, we explore a dual-gate two-dimensional ferroelectric field-effect transistor (2D FeFET) as a basic device to form both nonvolatile logic gates and artificial synapses, addressing in-memory computing simultaneously in digital and analog spaces. Through diversifying the electrostatic behaviors in 2D transistors with the dual-ferroelectric-coupling effect, rich logic functionalities including linear (AND, OR) and nonlinear (XNOR) gates were obtained in unipolar (MoS₂) and ambipolar (MoTe₂) FeFETs. Combining both types of 2D FeFETs in a heterogeneous platform, an important computation circuit, i.e., a half-adder, was successfully constructed with an area-efficient two-transistor structure. Furthermore, with the same device structure, several key synaptic functions are shown at the device level, and an artificial neural network is simulated at the system level, manifesting its potential for neuromorphic computing. These findings highlight the prospects of dual-gate 2D FeFETs for the development of multifunctional in-memory computing hardware capable of both digital and analog computation.

Input rate encoding and gain control in dendrites of neocortical pyramidal neurons

Elucidating how neurons encode network activity is essential to understanding how the brain processes information. Neocortical pyramidal cells receive excitatory input onto spines distributed along dendritic branches. Local dendritic branch nonlinearities can boost the response to spatially clustered and synchronous input, but how this translates into the integration of patterns of ongoing activity remains unclear. To examine dendritic integration under naturalistic stimulus regimes, we use two-photon glutamate uncaging to repeatedly activate multiple dendritic spines at random intervals. In the proximal dendrites of two populations of layer 5 pyramidal neurons in the mouse motor cortex, spatially restricted synchrony is not a prerequisite for dendritic boosting. Branches encode afferent inputs with distinct rate sensitivities depending upon cell and branch type. Thus, inputs distributed along a dendritic branch can recruit supralinear boosting and the window of this nonlinearity may provide a mechanism by which dendrites can preferentially amplify slow-frequency network oscillations.

Hearing in Complex Environments: Auditory Gain Control, Attention, and Hearing Loss

Listening in noisy or complex sound environments is difficult for individuals with normal hearing and can be a debilitating impairment for those with hearing loss. Extracting meaningful information from a complex acoustic environment requires the ability to accurately encode specific sound features under highly variable listening conditions and segregate distinct sound streams from multiple overlapping sources. The auditory system employs a variety of mechanisms to achieve this auditory scene analysis. First, neurons across levels of the auditory system exhibit compensatory adaptations to their gain and dynamic range in response to prevailing sound stimulus statistics in the environment. These adaptations allow for robust representations of sound features that are to a large degree invariant to the level of background noise. Second, listeners can selectively attend to a desired sound target in an environment with multiple sound sources. This selective auditory attention is another form of sensory gain control, enhancing the representation of an attended sound source while suppressing responses to unattended sounds. This review will examine both “bottom-up” gain alterations in response to changes in environmental sound statistics as well as “top-down” mechanisms that allow for selective extraction of specific sound features in a complex auditory scene. Finally, we will discuss how hearing loss interacts with these gain control mechanisms, and the adaptive and/or maladaptive perceptual consequences of this plasticity.

Paired Feed-Forward Excitation With Delayed Inhibition Allows High Frequency Computations Across Brain Regions

The transmission of high frequency temporal information across brain regions is critical to perception, but the mechanisms underlying such transmission remain unclear. Long-range projection patterns across brain areas are often comprised of paired feed-forward excitation followed closely by delayed inhibition, including the thalamic triad synapse, thalamic projections to cortex, and projections within the hippocampus. Previous studies have shown that these joint projections produce a shortened period of depolarization, sharpening the timing window over which the postsynaptic neuron can fire. Here we show that these projections can facilitate the transmission of high frequency computations even at frequencies that are highly filtered by neuronal membranes. This temporal facilitation occurred over a range of synaptic parameter values, including variations in synaptic strength, synaptic time constants, short-term synaptic depression, and the delay between excitation and inhibition. Further, these projections can coordinate computations across multiple network levels, even amid ongoing local activity. We suggest that paired feed-forward excitation and inhibition provide a hybrid signal-carrying both a value and a clock-like trigger-to allow circuits to be responsive to input whenever it arrives.

Topology of synaptic connectivity constrains neuronal stimulus representation, predicting two complementary coding strategies

In motor-related brain regions, movement intention has been successfully decoded from in-vivo spike train by isolating a lower-dimension manifold that the high-dimensional spiking activity is constrained to. The mechanism enforcing this constraint remains unclear, although it has been hypothesized to be implemented by the connectivity of the sampled neurons. We test this idea and explore the interactions between local synaptic connectivity and its ability to encode information in a lower dimensional manifold through simulations of a detailed microcircuit model with realistic sources of noise. We confirm that even in isolation such a model can encode the identity of different stimuli in a lower-dimensional space. We then demonstrate that the reliability of the encoding depends on the connectivity between the sampled neurons by specifically sampling populations whose connectivity maximizes certain topological metrics. Finally, we developed an alternative method for determining stimulus identity from the activity of neurons by combining their spike trains with their recurrent connectivity. We found that this method performs better for sampled groups of neurons that perform worse under the classical approach, predicting the possibility of two separate encoding strategies in a single microcircuit.

Synaptic mechanisms of top-down control in the non-lemniscal inferior colliculus

Corticofugal projections to evolutionarily ancient, subcortical structures are ubiquitous across mammalian sensory systems. These 'descending' pathways enable the neocortex to control ascending sensory representations in a predictive or feedback manner, but the underlying cellular mechanisms are poorly understood. Here, we combine optogenetic approaches with in vivo and in vitro patch-clamp electrophysiology to study the projection from mouse auditory cortex to the inferior colliculus (IC), a major descending auditory pathway that controls IC neuron feature selectivity, plasticity, and auditory perceptual learning. Although individual auditory cortico-collicular synapses were generally weak, IC neurons often integrated inputs from multiple corticofugal axons that generated reliable, tonic depolarizations even during prolonged presynaptic activity. Latency measurements in vivo showed that descending signals reach the IC within 30 ms of sound onset, which in IC neurons corresponded to the peak of synaptic depolarizations evoked by short sounds. Activating ascending and descending pathways at latencies expected in vivo caused a NMDA receptor-dependent, supralinear excitatory postsynaptic potential summation, indicating that descending signals can nonlinearly amplify IC neurons' moment-to-moment acoustic responses. Our results shed light upon the synaptic bases of descending sensory control and imply that heterosynaptic cooperativity contributes to the auditory cortico-collicular pathway's role in plasticity and perceptual learning.

Synaptic changes modulate spontaneous transitions between tonic and bursting neural activities in coupled Hindmarsh-Rose neurons

Experimentally, certain cells in the brain exhibit a spike-burst activity with burst synchronization at transition to and during sleep (or drowsiness), while they demonstrate a desynchronized tonic activity in the waking state. We herein investigated the neural activities and their transitions by using a model of coupled Hindmarsh-Rose neurons in an Erdős-Rényi random network. By tuning synaptic strength, spontaneous transitions between tonic and bursting neural activities can be realized. With excitatory chemical synapses or electrical synapses, slow-wave activity (SWA) similar to that observed during sleep can appear, as a result of synchronized bursting activities. SWA cannot appear in a network that is dominated by inhibitory chemical synapses, because neurons exhibit desynchronized bursting activities. Moreover, we found that the critical synaptic strength related to the transitions of neural activities depends only on the network average degree (i.e., the average number of signals that all the neurons receive). We demonstrated, both numerically and analytically, that the critical synaptic strength and the network average degree obey a power-law relation with an exponent of -1. Our study provides a possible dynamical network mechanism of the transitions between tonic and bursting neural activities for the wakefulness-sleep cycle, and of the SWA during sleep. Further interesting and challenging investigations are briefly discussed as well.

From decision to action: Detailed modelling of frog tadpoles reveals neuronal mechanisms of decision-making and reproduces unpredictable swimming movements in response to sensory signals

How does the brain process sensory stimuli, and decide whether to initiate locomotor behaviour? To investigate this question we develop two whole body computer models of a tadpole. The "Central Nervous System" (CNS) model uses evidence from whole-cell recording to define 2300 neurons in 12 classes to study how sensory signals from the skin initiate and stop swimming. In response to skin stimulation, it generates realistic sensory pathway spiking and shows how hindbrain sensory memory populations on each side can compete to initiate reticulospinal neuron firing and start swimming. The 3-D "Virtual Tadpole" (VT) biomechanical model with realistic muscle innervation, body flexion, body-water interaction, and movement is then used to evaluate if motor nerve outputs from the CNS model can produce swimming-like movements in a volume of "water". We find that the whole tadpole VT model generates reliable and realistic swimming. Combining these two models opens new perspectives for experiments.

Numerical Simulation: Fluctuation in Background Synaptic Activity Regulates Synaptic Plasticity

Synaptic plasticity is vital for learning and memory in the brain. It consists of long-term potentiation (LTP) and long-term depression (LTD). Spike frequency is one of the major components of synaptic plasticity in the brain, a noisy environment. Recently, we mathematically analyzed the frequency-dependent synaptic plasticity (FDP) in vivo and found that LTP is more likely to occur with an increase in the frequency of background synaptic activity. Meanwhile, previous studies suggest statistical fluctuation in the amplitude of background synaptic activity. Little is understood, however, about its contribution to synaptic plasticity. To address this issue, we performed numerical simulations of a calcium-based synapse model. Then, we found attenuation of the tendency to become LTD due to an increase in the fluctuation of background synaptic activity, leading to an enhancement of synaptic weight. Our result suggests that the fluctuation affects synaptic plasticity in the brain.

Short-Term Plasticity Regulates Both Divisive Normalization and Adaptive Responses in Drosophila Olfactory System

In Drosophila, olfactory information received by olfactory receptor neurons (ORNs) is first processed by an incoherent feed forward neural circuit in the antennal lobe (AL) that consists of ORNs (input), inhibitory local neurons (LNs), and projection neurons (PNs). This “early” olfactory information processing has two important characteristics. First, response of a PN to its cognate ORN is normalized by the overall activity of other ORNs, a phenomenon termed “divisive normalization.” Second, PNs respond strongly to the onset of ORN activities, but they adapt to prolonged or continuously varying inputs. Despite the importance of these characteristics for learning and memory, their underlying mechanisms are not fully understood. Here, we develop a circuit model for describing the ORN-LN-PN dynamics by including key neuron-neuron interactions such as short-term plasticity (STP) and presynaptic inhibition (PI). By fitting our model to experimental data quantitatively, we show that a strong STP balanced between short-term facilitation (STF) and short-term depression (STD) is responsible for the observed nonlinear divisive normalization in Drosophila. Our circuit model suggests that either STP or PI alone can lead to adaptive response. However, by comparing our model results with experimental data, we find that both STP and PI work together to achieve a strong and robust adaptive response. Our model not only helps reveal the mechanisms underlying two main characteristics of the early olfactory process, it can also be used to predict PN responses to arbitrary time-dependent signals and to infer microscopic properties of the circuit (such as the strengths of STF and STD) from the measured input-output relation. Our circuit model may be useful for understanding the role of STP in other sensory systems.

Sensory Adaptation in the Whisker-Mediated Tactile System: Physiology, Theory, and Function

In the natural environment, organisms are constantly exposed to a continuous stream of sensory input. The dynamics of sensory input changes with organism's behaviour and environmental context. The contextual variations may induce >100-fold change in the parameters of the stimulation that an animal experiences. Thus, it is vital for the organism to adapt to the new diet of stimulation. The response properties of neurons, in turn, dynamically adjust to the prevailing properties of sensory stimulation, a process known as "neuronal adaptation." Neuronal adaptation is a ubiquitous phenomenon across all sensory modalities and occurs at different stages of processing from periphery to cortex. In spite of the wealth of research on contextual modulation and neuronal adaptation in visual and auditory systems, the neuronal and computational basis of sensory adaptation in somatosensory system is less understood. Here, we summarise the recent finding and views about the neuronal adaptation in the rodent whisker-mediated tactile system and further summarise the functional effect of neuronal adaptation on the response dynamics and encoding efficiency of neurons at single cell and population levels along the whisker-mediated touch system in rodents. Based on direct and indirect pieces of evidence presented here, we suggest sensory adaptation provides context-dependent functional mechanisms for noise reduction in sensory processing, salience processing and deviant stimulus detection, shift between integration and coincidence detection, band-pass frequency filtering, adjusting neuronal receptive fields, enhancing neural coding and improving discriminability around adapting stimuli, energy conservation, and disambiguating encoding of principal features of tactile stimuli.

The generation of cortical novelty responses through inhibitory plasticity

Animals depend on fast and reliable detection of novel stimuli in their environment. Neurons in multiple sensory areas respond more strongly to novel in comparison to familiar stimuli. Yet, it remains unclear which circuit, cellular, and synaptic mechanisms underlie those responses. Here, we show that spike-timing-dependent plasticity of inhibitory-to-excitatory synapses generates novelty responses in a recurrent spiking network model. Inhibitory plasticity increases the inhibition onto excitatory neurons tuned to familiar stimuli, while inhibition for novel stimuli remains low, leading to a network novelty response. The generation of novelty responses does not depend on the periodicity but rather on the distribution of presented stimuli. By including tuning of inhibitory neurons, the network further captures stimulus-specific adaptation. Finally, we suggest that disinhibition can control the amplification of novelty responses. Therefore, inhibitory plasticity provides a flexible, biologically plausible mechanism to detect the novelty of bottom-up stimuli, enabling us to make experimentally testable predictions.

A model of naturalistic decision making in preference tests

Decisions as to whether to continue with an ongoing activity or to switch to an alternative are a constant in an animal’s natural world, and in particular underlie foraging behavior and performance in food preference tests. Stimuli experienced by the animal both impact the choice and are themselves impacted by the choice, in a dynamic back and forth. Here, we present model neural circuits, based on spiking neurons, in which the choice to switch away from ongoing behavior instantiates this back and forth, arising as a state transition in neural activity. We analyze two classes of circuit, which differ in whether state transitions result from a loss of hedonic input from the stimulus (an “entice to stay” model) or from aversive stimulus-input (a “repel to leave” model). In both classes of model, we find that the mean time spent sampling a stimulus decreases with increasing value of the alternative stimulus, a fact that we linked to the inclusion of depressing synapses in our model. The competitive interaction is much greater in “entice to stay” model networks, which has qualitative features of the marginal value theorem, and thereby provides a framework for optimal foraging behavior. We offer suggestions as to how our models could be discriminatively tested through the analysis of electrophysiological and behavioral data.

Many decisions are of the ilk of whether to continue sampling a stimulus or to switch to an alternative, a key feature of foraging behavior. We produce two classes of model for such stay-switch decisions, which differ in how decisions to switch stimuli can arise. In an “entice-to-stay” model, a reduction in the necessary positive stimulus input causes switching decisions. In a “repel-to-leave” model, a rise in aversive stimulus input produces a switch decision. We find that in tasks where the sampling of one stimulus follows another, adaptive biological processes arising from a highly hedonic stimulus can reduce the time spent at the following stimulus, by up to ten-fold in the “entice-to-stay” models. Along with potentially observable behavioral differences that could distinguish the classes of networks, we also found signatures in neural activity, such as oscillation of neural firing rates and a rapid change in rates preceding the time of choice to leave a stimulus. In summary, our model findings lead to testable predictions and suggest a neural circuit-based framework for explaining foraging choices.

Intracellular Properties of Deep-Layer Pyramidal Neurons in Frontal Eye Field of Macaque Monkeys

Although many details remain unknown, several positive statements can be made about the laminar distribution of primate frontal eye field (FEF) neurons with different physiological properties. Most certainly, pyramidal neurons in the deep layer of FEF that project to the brainstem carry movement and fixation signals but clear evidence also support that at least some deep-layer pyramidal neurons projecting to the superior colliculus carry visual responses. Thus, deep-layer neurons in FEF are functionally heterogeneous. Despite the useful functional distinctions between neuronal responses in vivo, the underlying existence of distinct cell types remain uncertain, mostly due to methodological limitations of extracellular recordings in awake behaving primates. To substantiate the functionally defined cell types encountered in the deep layer of FEF, we measured the biophysical properties of pyramidal neurons recorded intracellularly in brain slices issued from macaque monkey biopsies. Here, we found that biophysical properties recorded in vitro permit us to distinguish two main subtypes of regular-spiking neurons, with, respectively, low-resistance and low excitability vs. high-resistance and strong excitability. These results provide useful constraints for cognitive models of visual attention and saccade production by indicating that at least two distinct populations of deep-layer neurons exist.

Short-Term Facilitation of Long-Range Corticocortical Synapses Revealed by Selective Optical Stimulation

Short-term plasticity regulates the strength of central synapses as a function of previous activity. In the neocortex, direct synaptic interactions between areas play a central role in cognitive function, but the activity-dependent regulation of these long-range corticocortical connections and their impact on a postsynaptic target neuron is unclear. Here, we use an optogenetic strategy to study the connections between mouse primary somatosensory and motor cortex. We found that short-term facilitation was strong in both corticocortical synapses, resulting in far more sustained responses than local intracortical and thalamocortical connections. A major difference between pathways was that the synaptic strength and magnitude of facilitation were distinct for individual excitatory cells located across all cortical layers and specific subtypes of GABAergic neurons. Facilitation was dependent on the presynaptic calcium sensor synaptotagmin-7 and altered by several optogenetic approaches. Current-clamp recordings revealed that during repetitive activation, the short-term dynamics of corticocortical synapses enhanced the excitability of layer 2/3 pyramidal neurons, increasing the probability of spiking with activity. Furthermore, the properties of the connections linking primary with secondary somatosensory cortex resemble those between somatosensory-motor areas. These short-term changes in transmission properties suggest long-range corticocortical synapses are specialized for conveying information over relatively extended periods.

Thalamus and claustrum control parallel layer 1 circuits in retrosplenial cortex

The granular retrosplenial cortex (RSG) is critical for both spatial and non-spatial behaviors, but the underlying neural codes remain poorly understood. Here, we use optogenetic circuit mapping in mice to reveal a double dissociation that allows parallel circuits in superficial RSG to process disparate inputs. The anterior thalamus and dorsal subiculum, sources of spatial information, strongly and selectively recruit small low-rheobase (LR) pyramidal cells in RSG. In contrast, neighboring regular-spiking (RS) cells are preferentially controlled by claustral and anterior cingulate inputs, sources of mostly non-spatial information. Precise sublaminar axonal and dendritic arborization within RSG layer 1, in particular, permits this parallel processing. Observed thalamocortical synaptic dynamics enable computational models of LR neurons to compute the speed of head rotation, despite receiving head direction inputs that do not explicitly encode speed. Thus, parallel input streams identify a distinct principal neuronal subtype ideally positioned to support spatial orientation computations in the RSG.

Assessment of optogenetically-driven strategies for prosthetic restoration of cortical vision in large-scale neural simulation of V1

The neural encoding of visual features in primary visual cortex (V1) is well understood, with strong correlates to low-level perception, making V1 a strong candidate for vision restoration through neuroprosthetics. However, the functional relevance of neural dynamics evoked through external stimulation directly imposed at the cortical level is poorly understood. Furthermore, protocols for designing cortical stimulation patterns that would induce a naturalistic perception of the encoded stimuli have not yet been established. Here, we demonstrate a proof of concept by solving these issues through a computational model, combining (1) a large-scale spiking neural network model of cat V1 and (2) a virtual prosthetic system transcoding the visual input into tailored light-stimulation patterns which drive in situ the optogenetically modified cortical tissue. Using such virtual experiments, we design a protocol for translating simple Fourier contrasted stimuli (gratings) into activation patterns of the optogenetic matrix stimulator. We then quantify the relationship between spatial configuration of the imposed light pattern and the induced cortical activity. Our simulations in the absence of visual drive (simulated blindness) show that optogenetic stimulation with a spatial resolution as low as 100 [Formula: see text]m, and light intensity as weak as [Formula: see text] photons/s/cm[Formula: see text] is sufficient to evoke activity patterns in V1 close to those evoked by normal vision.

Interoception, Trait Anxiety, and the Gut Microbiome: A Cognitive and Physiological Model

Trait anxiety is characterized as a constant and often subliminal state that persists during daily life. Interoception is the perception of internal states and sensations, including from the autonomic nervous system. This review aims to develop a predictive model to explain the emergence, manifestations, and maintenance of trait anxiety. The model begins with the assumption that anxiety states arise from active interoceptive inference. The subsequent activation of autonomic responses results from aversive sensory encounters. A cognitive model is proposed for trait anxiety that includes the aversive sensory components from interoception, exteroception, and proprioception. A further component of the hypothesis is that repeated exposure to subliminal anxiety-evoking sensory elements can lead to an overgeneralization of this response to other inputs that are generally non-aversive. Increased uncertainty may result when predicting the sensory environment, resulting in arbitrary interoceptive anxiety responses that may be due to unjustifiable causes. Arbitrary successful or unsuccessful matching of predictions and responses reduces the individual’s confidence to maintain the anxiety trait. In this review, the application of the proposed model is illustrated using gut microbial dysbiosis or imbalance of the gut microbiome.

Deep Predictive Learning in Neocortex and Pulvinar

How do humans learn from raw sensory experience? Throughout life, but most obviously in infancy, we learn without explicit instruction. We propose a detailed biological mechanism for the widely embraced idea that learning is driven by the differences between predictions and actual outcomes (i.e., predictive error-driven learning). Specifically, numerous weak projections into the pulvinar nucleus of the thalamus generate top-down predictions, and sparse driver inputs from lower areas supply the actual outcome, originating in Layer 5 intrinsic bursting neurons. Thus, the outcome representation is only briefly activated, roughly every 100 msec (i.e., 10 Hz, alpha), resulting in a temporal difference error signal, which drives local synaptic changes throughout the neocortex. This results in a biologically plausible form of error backpropagation learning. We implemented these mechanisms in a large-scale model of the visual system and found that the simulated inferotemporal pathway learns to systematically categorize 3-D objects according to invariant shape properties, based solely on predictive learning from raw visual inputs. These categories match human judgments on the same stimuli and are consistent with neural representations in inferotemporal cortex in primates.

Presynaptic endoplasmic reticulum regulates short-term plasticity in hippocampal synapses

Short-term plasticity preserves a brief history of synaptic activity that is communicated to the postsynaptic neuron. This is primarily regulated by a calcium signal initiated by voltage dependent calcium channels in the presynaptic terminal. Imaging studies of CA3-CA1 synapses reveal the presence of another source of calcium, the endoplasmic reticulum (ER) in all presynaptic terminals. However, the precise role of the ER in modifying STP remains unexplored. We performed in-silico experiments in synaptic geometries based on reconstructions of the rat CA3-CA1 synapses to investigate the contribution of ER. Our model predicts that presynaptic ER is critical in generating the observed short-term plasticity profile of CA3-CA1 synapses and allows synapses with low release probability to operate more reliably. Blocking the ER lowers facilitation in a manner similar to what has been previously characterized in animal models of Alzheimer's disease and underscores the important role played by presynaptic stores in normal function.

Brain Inspired Sequences Production by Spiking Neural Networks With Reward-Modulated STDP

Understanding and producing embedded sequences according to supra-regular grammars in language has always been considered a high-level cognitive function of human beings, named "syntax barrier" between humans and animals. However, some neurologists recently showed that macaques could be trained to produce embedded sequences involving supra-regular grammars through a well-designed experiment paradigm. Via comparing macaques and preschool children's experimental results, they claimed that human uniqueness might only lie in the speed and learning strategy resulting from the chunking mechanism. Inspired by their research, we proposed a Brain-inspired Sequence Production Spiking Neural Network (SP-SNN) to model the same production process, followed by memory and learning mechanisms of the multi-brain region cooperation. After experimental verification, we demonstrated that SP-SNN could also handle embedded sequence production tasks, striding over the "syntax barrier." SP-SNN used Population-Coding and STDP mechanism to realize working memory, Reward-Modulated STDP mechanism for acquiring supra-regular grammars. Therefore, SP-SNN needs to simultaneously coordinate short-term plasticity (STP) and long-term plasticity (LTP) mechanisms. Besides, we found that the chunking mechanism indeed makes a difference in improving our model's robustness. As far as we know, our work is the first one toward the "syntax barrier" in the SNN field, providing the computational foundation for further study of related underlying animals' neural mechanisms in the future.

A new era for executive function research: On the transition from centralized to distributed executive functioning

"Executive functions" (EFs) is an umbrella term for higher cognitive control functions such as working memory, inhibition, and cognitive flexibility. One of the most challenging problems in this field of research has been to explain how the wide range of cognitive processes subsumed as EFs are controlled without an all-powerful but ill-defined central executive in the brain. Efforts to localize control mechanisms in circumscribed brain regions have not led to a breakthrough in understanding how the brain controls and regulates itself. We propose to re-conceptualize EFs as emergent consequences of highly distributed brain processes that communicate with a pool of highly connected hub regions, thus precluding the need for a central executive. We further discuss how graph-theory driven analysis of brain networks offers a unique lens on this problem by providing a reference frame to study brain connectivity in EFs in a holistic way and helps to refine our understanding of the mechanisms underlying EFs by providing new, testable hypotheses and resolves empirical and theoretical inconsistencies in the EF literature.

Modulation of the dynamics of cerebellar Purkinje cells through the interaction of excitatory and inhibitory feedforward pathways

The dynamics of cerebellar neuronal networks is controlled by the underlying building blocks of neurons and synapses between them. For which, the computation of Purkinje cells (PCs), the only output cells of the cerebellar cortex, is implemented through various types of neural pathways interactively routing excitation and inhibition converged to PCs. Such tuning of excitation and inhibition, coming from the gating of specific pathways as well as short-term plasticity (STP) of the synapses, plays a dominant role in controlling the PC dynamics in terms of firing rate and spike timing. PCs receive cascade feedforward inputs from two major neural pathways: the first one is the feedforward excitatory pathway from granule cells (GCs) to PCs; the second one is the feedforward inhibition pathway from GCs, via molecular layer interneurons (MLIs), to PCs. The GC-PC pathway, together with short-term dynamics of excitatory synapses, has been a focus over past decades, whereas recent experimental evidence shows that MLIs also greatly contribute to controlling PC activity. Therefore, it is expected that the diversity of excitation gated by STP of GC-PC synapses, modulated by strong inhibition from MLI-PC synapses, can promote the computation performed by PCs. However, it remains unclear how these two neural pathways are interacted to modulate PC dynamics. Here using a computational model of PC network installed with these two neural pathways, we addressed this question to investigate the change of PC firing dynamics at the level of single cell and network. We show that the nonlinear characteristics of excitatory STP dynamics can significantly modulate PC spiking dynamics mediated by inhibition. The changes in PC firing rate, firing phase, and temporal spike pattern, are strongly modulated by these two factors in different ways. MLIs mainly contribute to variable delays in the postsynaptic action potentials of PCs while modulated by excitation STP. Notably, the diversity of synchronization and pause response in the PC network is governed not only by the balance of excitation and inhibition, but also by the synaptic STP, depending on input burst patterns. Especially, the pause response shown in the PC network can only emerge with the interaction of both pathways. Together with other recent findings, our results show that the interaction of feedforward pathways of excitation and inhibition, incorporated with synaptic short-term dynamics, can dramatically regulate the PC activities that consequently change the network dynamics of the cerebellar circuit.

It is well known that the dynamics of neuronal networks are controlled by various types of neural pathways that are interactively routing excitation and inhibition converged to postsynaptic neurons. In addition, gating of a specific neural pathway is enhanced by short-term plasticity of the synapses between neurons. However, it remains unclear how a combination of these factors, the strengths of excitation and inhibition, and their short-term dynamics respectively, contributes to the dynamics of single cells and neuronal networks. Using a network model of cerebellar Purkinje cells embedded with the feedforward excitatory pathway from granule cells and feedforward inhibition pathway of molecular layer interneurons. We show that the dynamics of firing rate, firing phase, and temporal spike pattern are notably yet differently modulated by these two pathways. At the single cell level, excitatory short-term plasticity nonlinearly modulates the input-output relationship of firing activity. At the network level, the diversity of synchronization and pause response is governed not only by the balance of excitation and inhibition, but also by synaptic short-term dynamics. Only when both neural pathways are incorporated, there is a strong pause response shown in the network. Our results, together with recent in vivo experimental observations in the cerebellum, show that the interaction of feedforward pathways of excitation and inhibition, together with synaptic short-term dynamics, can dramatically change the network dynamics of Purkinje cells.

Adaptive temporal processing of odor stimuli

The olfactory system translates chemical signals into neuronal signals that inform behavioral decisions of the animal. Odors are cues for source identity, but if monitored long enough, they can also be used to localize the source. Odor representations should therefore be robust to changing conditions and flexible in order to drive an appropriate behavior. In this review, we aim at discussing the main computations that allow robust and flexible encoding of odor information in the olfactory neural pathway.

Embodied working memory during ongoing input streams

Sensory stimuli endow animals with the ability to generate an internal representation. This representation can be maintained for a certain duration in the absence of previously elicited inputs. The reliance on an internal representation rather than purely on the basis of external stimuli is a hallmark feature of higher-order functions such as working memory. Patterns of neural activity produced in response to sensory inputs can continue long after the disappearance of previous inputs. Experimental and theoretical studies have largely invested in understanding how animals faithfully maintain sensory representations during ongoing reverberations of neural activity. However, these studies have focused on preassigned protocols of stimulus presentation, leaving out by default the possibility of exploring how the content of working memory interacts with ongoing input streams. Here, we study working memory using a network of spiking neurons with dynamic synapses subject to short-term and long-term synaptic plasticity. The formal model is embodied in a physical robot as a companion approach under which neuronal activity is directly linked to motor output. The artificial agent is used as a methodological tool for studying the formation of working memory capacity. To this end, we devise a keyboard listening framework to delineate the context under which working memory content is (1) refined, (2) overwritten or (3) resisted by ongoing new input streams. Ultimately, this study takes a neurorobotic perspective to resurface the long-standing implication of working memory in flexible cognition.

LTD is involved in the formation and maintenance of rat hippocampal CA1 place-cell fields

Hippocampal synaptic plasticity includes both long-term potentiation (LTP) and long-term depression (LTD) of synaptic strength, and has been implicated in shaping place field representations that form upon initial exposure to a novel environment. However, direct evidence causally linking either LTP or LTD to place fields remains limited. Here, we show that hippocampal LTD regulates the acute formation and maintenance of place fields using electrophysiology and blocking specifically LTD in freely-moving rats. We also show that exploration of a novel environment produces a widespread and pathway specific de novo synaptic depression in the dorsal hippocampus. Furthermore, disruption of this pathway-specific synaptic depression alters both the dynamics of place field formation and the stability of the newly formed place fields, affecting spatial memory in rats. These results suggest that activity-dependent synaptic depression is required for the acquisition and maintenance of novel spatial information.

The Missing Link Between Memory and Reinforcement Learning

Reinforcement learning systems usually assume that a value function is defined over all states (or state-action pairs) that can immediately give the value of a particular state or action. These values are used by a selection mechanism to decide which action to take. In contrast, when humans and animals make decisions, they collect evidence for different alternatives over time and take action only when sufficient evidence has been accumulated. We have previously developed a model of memory processing that includes semantic, episodic and working memory in a comprehensive architecture. Here, we describe how this memory mechanism can support decision making when the alternatives cannot be evaluated based on immediate sensory information alone. Instead we first imagine, and then evaluate a possible future that will result from choosing one of the alternatives. Here we present an extended model that can be used as a model for decision making that depends on accumulating evidence over time, whether that information comes from the sequential attention to different sensory properties or from internal simulation of the consequences of making a particular choice. We show how the new model explains both simple immediate choices, choices that depend on multiple sensory factors and complicated selections between alternatives that require forward looking simulations based on episodic and semantic memory structures. In this framework, vicarious trial and error is explained as an internal simulation that accumulates evidence for a particular choice. We argue that a system like this forms the "missing link" between more traditional ideas of semantic and episodic memory, and the associative nature of reinforcement learning.

Layer 6 ensembles can selectively regulate the behavioral impact and layer-specific representation of sensory deviants

Predictive models can enhance the salience of unanticipated input. Here, we tested a key potential node in neocortical model formation in this process, layer (L) 6, using behavioral, electrophysiological and imaging methods in mouse primary somatosensory neocortex. We found that deviant stimuli enhanced tactile detection and were encoded in L2/3 neural tuning. To test the contribution of L6, we applied weak optogenetic drive that changed which L6 neurons were sensory responsive, without affecting overall firing rates in L6 or L2/3. This stimulation selectively suppressed behavioral sensitivity to deviant stimuli, without impacting baseline performance. This stimulation also eliminated deviance encoding in L2/3 but did not impair basic stimulus responses across layers. In contrast, stronger L6 drive inhibited firing and suppressed overall sensory function. These findings indicate that, despite their sparse activity, specific ensembles of stimulus-driven L6 neurons are required to form neocortical predictions, and to realize their behavioral benefit.

Minds and Brains, Sleep and Psychiatry

Objective

This article offers a philosophical thesis for psychiatric disorders that rests upon some simple truths about the mind and brain. Specifically, it asks whether the dual aspect monism—that emerges from sleep research and theoretical neurobiology—can be applied to pathophysiology and psychopathology in psychiatry.

Methods

Our starting point is that the mind and brain are emergent aspects of the same (neuronal) dynamics; namely, the brain–mind. Our endpoint is that synaptic dysconnection syndromes inherit the same dual aspect; namely, aberrant inference or belief updating on the one hand, and a failure of neuromodulatory synaptic gain control on the other. We start with some basic considerations from sleep research that integrate the phenomenology of dreaming with the neurophysiology of sleep.

Results

We then leverage this treatment by treating the brain as an organ of inference. Our particular focus is on the role of precision (i.e., the representation of uncertainty) in belief updating and the accompanying synaptic mechanisms.

Conclusions

Finally, we suggest a dual aspect approach—based upon belief updating (i.e., mind processes) and its neurophysiological implementation (i.e., brain processes)—has a wide explanatory compass for psychiatry and various movement disorders. This approach identifies the kind of pathophysiology that underwrites psychopathology—and points to certain psychotherapeutic and psychopharmacological targets, which may stand in mechanistic relation to each other.

The ‘mind’ emerges from Bayesian belief updating in the ‘brain’

Psychopathology can be read as aberrant belief updating.

Aberrant belief updating follows from any neuromodulatory synaptopathy

The Functional Organization of Cortical and Thalamic Inputs onto Five Types of Striatal Neurons Is Determined by Source and Target Cell Identities

To understand striatal function, it is essential to know the functional organization of the numerous inputs targeting the diverse population of striatal neurons. Using optogenetics, we activated terminals from ipsi- or contralateral primary somatosensory cortex (S1) or primary motor cortex (M1), or thalamus while obtaining simultaneous whole-cell recordings from pairs or triplets of striatal medium spiny neurons (MSNs) and adjacent interneurons. Ipsilateral corticostriatal projections provided stronger excitation to fast-spiking interneurons (FSIs) than to MSNs and only sparse and weak excitation to low threshold-spiking interneurons (LTSIs) and cholinergic interneurons (ChINs). Projections from contralateral M1 evoked the strongest responses in LTSIs but none in ChINs, whereas thalamus provided the strongest excitation to ChINs but none to LTSIs. In addition, inputs varied in their glutamate receptor composition and their short-term plasticity. Our data revealed a highly selective organization of excitatory striatal afferents, which is determined by both pre- and postsynaptic neuronal identity.

•

Whole-cell recordings are obtained from neighboring striatal neurons of different types

•

FSIs receive the strongest inputs from S1, M1, and thalamic PF

•

LTSIs are primarily excited by contralateral M1

•

ChINs are primarily excited by PF and receive no input from contralateral M1 and S1

nNOS-expressing interneurons control basal and behaviorally evoked arterial dilation in somatosensory cortex of mice

Cortical neural activity is coupled to local arterial diameter and blood flow. However, which neurons control the dynamics of cerebral arteries is not well understood. We dissected the cellular mechanisms controlling the basal diameter and evoked dilation in cortical arteries in awake, head-fixed mice. Locomotion drove robust arterial dilation, increases in gamma band power in the local field potential (LFP), and increases calcium signals in pyramidal and neuronal nitric oxide synthase (nNOS)-expressing neurons. Chemogenetic or pharmocological modulation of overall neural activity up or down caused corresponding increases or decreases in basal arterial diameter. Modulation of pyramidal neuron activity alone had little effect on basal or evoked arterial dilation, despite pronounced changes in the LFP. Modulation of the activity of nNOS-expressing neurons drove changes in the basal and evoked arterial diameter without corresponding changes in population neural activity.

Paradoxical lesions, plasticity and active inference

Paradoxical lesions are secondary brain lesions that ameliorate functional deficits caused by the initial insult. This effect has been explained in several ways; particularly by the reduction of functional inhibition, or by increases in the excitatory-to-inhibitory synaptic balance within perilesional tissue. In this article, we simulate how and when a modification of the excitatory-inhibitory balance triggers the reversal of a functional deficit caused by a primary lesion. For this, we introduce in-silico lesions to an active inference model of auditory word repetition. The first in-silico lesion simulated damage to the extrinsic (between regions) connectivity causing a functional deficit that did not fully resolve over 100 trials of a word repetition task. The second lesion was implemented in the intrinsic (within region) connectivity, compromising the model's ability to rebalance excitatory-inhibitory connections during learning. We found that when the second lesion was mild, there was an increase in experience-dependent plasticity that enhanced performance relative to a single lesion. This paradoxical lesion effect disappeared when the second lesion was more severe because plasticity-related changes were disproportionately amplified in the intrinsic connectivity, relative to lesioned extrinsic connections. Finally, this framework was used to predict the physiological correlates of paradoxical lesions. This formal approach provides new insights into the computational and neurophysiological mechanisms that allow some patients to recover after large or multiple lesions.

Short-term depression and long-term plasticity together tune sensitive range of synaptic plasticity

Synaptic efficacy is subjected to activity-dependent changes on short- and long time scales. While short-term changes decay over minutes, long-term modifications last from hours up to a lifetime and are thought to constitute the basis of learning and memory. Both plasticity mechanisms have been studied extensively but how their interaction shapes synaptic dynamics is little known. To investigate how both short- and long-term plasticity together control the induction of synaptic depression and potentiation, we used numerical simulations and mathematical analysis of a calcium-based model, where pre- and postsynaptic activity induces calcium transients driving synaptic long-term plasticity. We found that the model implementing known synaptic short-term dynamics in the calcium transients can be successfully fitted to long-term plasticity data obtained in visual- and somatosensory cortex. Interestingly, the impact of spike-timing and firing rate changes on plasticity occurs in the prevalent firing rate range, which is different in both cortical areas considered here. Our findings suggest that short- and long-term plasticity are together tuned to adapt plasticity to area-specific activity statistics such as firing rates.

Synaptic long-term plasticity, the long-lasting change in efficacy of connections between neurons, is believed to underlie learning and memory. Synapses furthermore change their efficacy reversibly in an activity-dependent manner on the subsecond time scale, referred to as short-term plasticity. It is not known how both synaptic plasticity mechanisms—long- and short-term—interact during activity epochs. To address this question, we used a biologically-inspired plasticity model in which calcium drives changes in synaptic efficacy. We applied the model to plasticity data from visual- and somatosensory cortex and found that synaptic changes occur in very different firing rate ranges, which correspond to the prevalent firing rates in both structures. Our results suggest that short- and long-term plasticity act in a well concerted fashion.

Frequency-dependent spike-pattern changes in motor cortex during thalamic deep brain stimulation

The cerebellar-receiving area of the motor thalamus is the primary anatomical target for treating essential tremor with deep brain stimulation (DBS). Although neuroimaging studies have shown that higher stimulation frequencies in this target correlate with increased cortical metabolic activity, less is known about the cellular-level functional changes that occur in the primary motor cortex (M1) with thalamic stimulation and how these changes depend on the frequency of DBS. In this study, we used a preclinical animal model of DBS to collect single-unit spike recordings in M1 before, during, and after DBS targeting the cerebellar-receiving area of the motor thalamus (VPLo, nucleus ventralis posterior lateralis pars oralis). The effects of VPLo-DBS on M1 spike rates, interspike interval entropy, and peristimulus phase-locking were compared across stimulus pulse train frequencies ranging from 10 to 130 Hz. Although VPLo-DBS modulated the spike rates of 20-50% of individual M1 cells in a frequency-dependent manner, the population-level average spike rate only weakly depended on stimulation frequency. In contrast, the population-level entropy measure showed a pronounced decrease with high-frequency stimulation, caused by a subpopulation of cells that exhibited strong phase-locking and general spike-pattern regularization. Contrarily, low-frequency stimulation induced an entropy increase (spike-pattern disordering) in a relatively large portion of the recorded population, which diminished with higher stimulation frequencies. These results also suggest that changes in phase-locking and spike-pattern entropy are not necessarily equivalent pattern phenomena, but rather that they should both be weighed when quantifying stimulation-induced spike-pattern changes.NEW & NOTEWORTHY The network mechanisms of thalamic deep brain stimulation (DBS) are not well understood at the cellular level. This study investigated the neuronal firing rate and pattern changes in the motor cortex resulting from stimulation of the cerebellar-receiving area of the motor thalamus. We showed that there is a nonintuitive relationship between general entropy-based spike-pattern measures and phase-locked regularization to DBS.

The effects of chloride dynamics on substantia nigra pars reticulata responses to pallidal and striatal inputs

As a rodent basal ganglia (BG) output nucleus, the substantia nigra pars reticulata (SNr) is well positioned to impact behavior. SNr neurons receive GABAergic inputs from the striatum (direct pathway) and globus pallidus (GPe, indirect pathway). Dominant theories of action selection rely on these pathways' inhibitory actions. Yet, experimental results on SNr responses to these inputs are limited and include excitatory effects. Our study combines experimental and computational work to characterize, explain, and make predictions about these pathways. We observe diverse SNr responses to stimulation of SNr-projecting striatal and GPe neurons, including biphasic and excitatory effects, which our modeling shows can be explained by intracellular chloride processing. Our work predicts that ongoing GPe activity could tune the SNr operating mode, including its responses in decision-making scenarios, and GPe output may modulate synchrony and low-frequency oscillations of SNr neurons, which we confirm using optogenetic stimulation of GPe terminals within the SNr.

Presynaptic inhibition rapidly stabilises recurrent excitation in the face of plasticity

Hebbian plasticity, a mechanism believed to be the substrate of learning and memory, detects and further enhances correlated neural activity. Because this constitutes an unstable positive feedback loop, it requires additional homeostatic control. Computational work suggests that in recurrent networks, the homeostatic mechanisms observed in experiments are too slow to compensate instabilities arising from Hebbian plasticity and need to be complemented by rapid compensatory processes. We suggest presynaptic inhibition as a candidate that rapidly provides stability by compensating recurrent excitation induced by Hebbian changes. Presynaptic inhibition is mediated by presynaptic GABA receptors that effectively and reversibly attenuate transmitter release. Activation of these receptors can be triggered by excess network activity, hence providing a stabilising negative feedback loop that weakens recurrent interactions on sub-second timescales. We study the stabilising effect of presynaptic inhibition in recurrent networks, in which presynaptic inhibition is implemented as a multiplicative reduction of recurrent synaptic weights in response to increasing inhibitory activity. We show that networks with presynaptic inhibition display a gradual increase of firing rates with growing excitatory weights, in contrast to traditional excitatory-inhibitory networks. This alleviates the positive feedback loop between Hebbian plasticity and network activity and thereby allows homeostasis to act on timescales similar to those observed in experiments. Our results generalise to spiking networks with a biophysically more detailed implementation of the presynaptic inhibition mechanism. In conclusion, presynaptic inhibition provides a powerful compensatory mechanism that rapidly reduces effective recurrent interactions and thereby stabilises Hebbian learning.

Synapses between neurons change during learning and memory formation, a process termed synaptic plasticity. Established models of plasticity rely on strengthening synapses of co-active neurons. In recurrent networks, mutually connected neurons tend to be co-active. The emerging positive feedback loop is believed to be counteracted by homeostatic mechanisms that aim to keep neural activity at a given set point. However, theoretical work indicates that experimentally observed forms of homeostasis are too slow to maintain stable network activity. In this article, we suggest that presynaptic inhibition can alleviate this problem. Presynaptic inhibition is an inhibitory mechanism that weakens synapses rather than suppressing neural activity. Using mathematical analyses and computer simulations, we show that presynaptic inhibition can compensate the strengthening of recurrent connections and thus stabilises neural networks subject to synaptic plasticity, even if homeostasis acts on biologically plausible timescales.

Presynaptic dysfunction in neurodevelopmental disorders: Insights from the synaptic vesicle life cycle

The activity-dependent fusion, retrieval and recycling of synaptic vesicles is essential for the maintenance of neurotransmission. Until relatively recently it was believed that most mutations in genes that were essential for this process would be incompatible with life, because of this fundamental role. However, an ever-expanding number of mutations in this very cohort of genes are being identified in individuals with neurodevelopmental disorders, including autism, intellectual disability and epilepsy. This article will summarize the current state of knowledge linking mutations in presynaptic genes to neurodevelopmental disorders by sequentially covering the various stages of the synaptic vesicle life cycle. It will also discuss how perturbations of specific stages within this recycling process could translate into human disease. Finally, it will also provide perspectives on the potential for future therapy that are targeted to presynaptic function.

A circuit model of auditory cortex

The mammalian sensory cortex is composed of multiple types of inhibitory and excitatory neurons, which form sophisticated microcircuits for processing and transmitting sensory information. Despite rapid progress in understanding the function of distinct neuronal populations, the parameters of connectivity that are required for the function of these microcircuits remain unknown. Recent studies found that two most common inhibitory interneurons, parvalbumin- (PV) and somatostatin-(SST) positive interneurons control sound-evoked responses, temporal adaptation and network dynamics in the auditory cortex (AC). These studies can inform our understanding of parameters for the connectivity of excitatory-inhibitory cortical circuits. Specifically, we asked whether a common microcircuit can account for the disparate effects found in studies by different groups. By starting with a cortical rate model, we find that a simple current-compensating mechanism accounts for the experimental findings from multiple groups. They key mechanisms are two-fold. First, PVs compensate for reduced SST activity when thalamic inputs are strong with less compensation when thalamic inputs are weak. Second, SSTs are generally disinhibited by reduced PV activity regardless of thalamic input strength. These roles are augmented by plastic synapses. These roles reproduce the differential effects of PVs and SSTs in stimulus-specific adaptation, forward suppression and tuning-curve adaptation, as well as the influence of PVs on feedforward functional connectivity in the circuit. This circuit exhibits a balance of inhibitory and excitatory currents that persists on stimulation. This approach brings together multiple findings from different laboratories and identifies a circuit that can be used in future studies of upstream and downstream sensory processing.

Estimating and interpreting nonlinear receptive field of sensory neural responses with deep neural network models

Our understanding of nonlinear stimulus transformations by neural circuits is hindered by the lack of comprehensive yet interpretable computational modeling frameworks. Here, we propose a data-driven approach based on deep neural networks to directly model arbitrarily nonlinear stimulus-response mappings. Reformulating the exact function of a trained neural network as a collection of stimulus-dependent linear functions enables a locally linear receptive field interpretation of the neural network. Predicting the neural responses recorded invasively from the auditory cortex of neurosurgical patients as they listened to speech, this approach significantly improves the prediction accuracy of auditory cortical responses, particularly in nonprimary areas. Moreover, interpreting the functions learned by neural networks uncovered three distinct types of nonlinear transformations of speech that varied considerably from primary to nonprimary auditory regions. The ability of this framework to capture arbitrary stimulus-response mappings while maintaining model interpretability leads to a better understanding of cortical processing of sensory signals.

A Slow Short-Term Depression at Purkinje to Deep Cerebellar Nuclear Neuron Synapses Supports Gain-Control and Linear Encoding over Second-Long Time Windows

Modifications in the sensitivity of neural elements allow the brain to adapt its functions to varying demands. Frequency-dependent short-term synaptic depression (STD) provides a dynamic gain-control mechanism enabling adaptation to different background conditions alongside enhanced sensitivity to input-driven changes in activity. In contrast, synapses displaying frequency-invariant transmission can faithfully transfer ongoing presynaptic rates enabling linear processing, deemed critical for many functions. However, rigid frequency-invariant transmission may lead to runaway dynamics and low sensitivity to changes in rate. Here, I investigated the Purkinje cell to deep cerebellar nuclei neuron synapses (PC_DCNs), which display frequency invariance, and yet, PCs maintain background activity at disparate rates, even at rest. Using protracted PC_DCN activation (120 s) to mimic background activity in cerebellar slices from mature mice of both sexes, I identified a previously unrecognized, frequency-dependent, slow STD (S-STD), adapting IPSC amplitudes in tens of seconds to minutes. However, after changes in activation rates, over a behavior-relevant second-long time window, S-STD enabled scaled linear encoding of PC rates in synaptic charge transfer and DCN spiking activity. Combined electrophysiology, optogenetics, and statistical analysis suggested that S-STD mechanism is input-specific, involving decreased ready-to-release quanta, and distinct from faster short-term plasticity (f-STP). Accordingly, an S-STD component with a scaling effect (i.e., activity-dependent release sites inactivation), extending a model explaining PC_DCN release on shorter timescales using balanced f-STP, reproduced the experimental results. Thus, these results elucidates a novel slow gain-control mechanism able to support linear transfer of behavior-driven/learned PC rates concurrently with background activity adaptation, and furthermore, provides an alternative pathway to refine PC output.SIGNIFICANCE STATEMENT The brain can adapt to varying demands by dynamically changing the gain of its synapses; however, some tasks require ongoing linear transfer of presynaptic rates, seemingly incompatible with nonlinear gain adaptation. Here, I report a novel slow gain-control mechanism enabling scaled linear encoding of presynaptic rates over behavior-relevant time windows, and adaptation to background activity at the Purkinje to deep cerebellar nuclear neurons synapses (PC_DCNs). A previously unrecognized PC_DCNs slow and frequency-dependent short-term synaptic depression (S-STD) mediates this process. Experimental evidence and simulations suggested that scaled linear encoding emerges from the combination of S-STD slow dynamics and frequency-invariant transmission at faster timescales. These results demonstrate a mechanism reconciling rate code with background activity adaptation and suitable for flexibly tuning PCs output via background activity modulation.

Neural habituation enhances novelty detection: an EEG study of rapidly presented words

Huber and O'Reilly (2003) proposed that neural habituation aids perceptual processing, separating neural responses to currently viewed objects from recently viewed objects. However, synaptic depression has costs, producing repetition deficits. Prior work confirmed the transition from repetition benefits to deficits with increasing duration of a prime object, but the prediction of enhanced novelty detection was not tested. The current study examined this prediction with a same/different word priming task, using support vector machine (SVM) classification of EEG data, ERP analyses focused on the N400, and dynamic neural network simulations fit to behavioral data to provide a priori predictions of the ERP effects. Subjects made same/different judgements to a response word in relation to an immediately preceding brief target word; prime durations were short (50ms) or long (400ms), and long durations decreased P100/N170 responses to the target word, suggesting that this manipulation increased habituation. Following long duration primes, correct "different" judgments of primed response words increased, evidencing enhanced novelty detection. An SVM classifier predicted trial-by-trial behavior with 66.34% accuracy on held-out data, with greatest predictive power at a time pattern consistent with the N400. The habituation model was augmented with a maintained semantics layer (i.e., working memory) to generate behavior and N400 predictions. A second experiment used response-locked ERPs, confirming the model's assumption that residual activation in working memory is the basis of novelty decisions. These results support the theory that neural habituation enhances novelty detection, and the model assumption that the N400 reflects updating of semantic information in working memory.

A two-compartment model of synaptic computation and plasticity

The synapse is typically viewed as a single compartment, which acts as a linear gain controller on incoming input. Traditional plasticity rules enable this gain control to be dynamically optimized by Hebbian activity. Whilst this view nicely captures postsynaptic function, it neglects the non-linear dynamics of presynaptic function. Here we present a two-compartment model of the synapse in which the presynaptic terminal first acts to filter presynaptic input before the postsynaptic terminal, acting as a gain controller, amplifies or depresses transmission. We argue that both compartments are equipped with distinct plasticity rules to enable them to optimally adapt synaptic transmission to the statistics of pre- and postsynaptic activity. Specifically, we focus on how presynaptic plasticity enables presynaptic filtering to be optimally tuned to only transmit information relevant for postsynaptic firing. We end by discussing the advantages of having a presynaptic filter and propose future work to explore presynaptic function and plasticity in vivo.

Short term depression, presynaptic inhibition and local neuron diversity play key functional roles in the insect antennal lobe

As the oldest, but least understood sensory system in evolution, the olfactory system represents one of the most challenging research targets in sensory neurobiology. Although a large number of computational models of the olfactory system have been proposed, they do not account for the diversity in physiology, connectivity of local neurons, and several recent discoveries in the insect antennal lobe, a major olfactory organ in insects. Recent studies revealed that the response of some projection neurons were reduced by application of a GABA antagonist, and that insects are sensitive to odor pulse frequency. To account for these observations, we propose a spiking neural circuit model of the insect antennal lobe. Based on recent anatomical and physiological studies, we included three sub-types of local neurons as well as synaptic short-term depression (STD) in the model and showed that the interaction between STD and local neurons resulted in frequency-sensitive responses. We further discovered that the unexpected response of the projection neurons to the GABA antagonist is the result of complex interactions between STD and presynaptic inhibition, which is required for enhancing sensitivity to odor stimuli. Finally, we found that odor discrimination is improved if the innervation of the local neurons in the glomeruli follows a specific pattern. Our findings suggest that STD, presynaptic inhibition and diverse physiology and connectivity of local neurons are not independent properties, but they interact to play key roles in the function of antennal lobes.

Sequential Presentation Protects Working Memory From Catastrophic Interference

Neural network models of memory are notorious for catastrophic interference: Old items are forgotten as new items are memorized (French, 1999; McCloskey & Cohen, 1989). While working memory (WM) in human adults shows severe capacity limitations, these capacity limitations do not reflect neural network style catastrophic interference. However, our ability to quickly apprehend the numerosity of small sets of objects (i.e., subitizing) does show catastrophic capacity limitations, and this subitizing capacity and WM might reflect a common capacity. Accordingly, computational investigations (Knops, Piazza, Sengupta, Eger & Melcher, 2014; Sengupta, Surampudi & Melcher, 2014) suggest that mutual inhibition among neurons can explain both kinds of capacity limitations as well as why our ability to estimate the numerosity of larger sets is limited according to a Weber ratio signature. Based on simulations with a saliency map-like network and mathematical proofs, we provide three results. First, mutual inhibition among neurons leads to catastrophic interference when items are presented simultaneously. The network can remember a limited number of items, but when more items are presented, the network forgets all of them. Second, if memory items are presented sequentially rather than simultaneously, the network remembers the most recent items rather than forgetting all of them. Hence, the tendency in WM tasks to sequentially attend even to simultaneously presented items might not only reflect attentional limitations, but also an adaptive strategy to avoid catastrophic interference. Third, the mean activation level in the network can be used to estimate the number of items in small sets, but it does not accurately reflect the number of items in larger sets. Rather, we suggest that the Weber ratio signature of large number discrimination emerges naturally from the interaction between the limited precision of a numeric estimation system and a multiplicative gain control mechanism.

Bio-Inspired Techniques in a Fully Digital Approach for Lifelong Learning

Lifelong learning has deeply underpinned the resilience of biological organisms respect to a constantly changing environment. This flexibility has allowed the evolution of parallel-distributed systems able to merge past information with new stimulus for accurate and efficient brain-computation. Nowadays, there is a strong attempt to reproduce such intelligent systems in standard artificial neural networks (ANNs). However, despite some great results in specific tasks, ANNs still appear too rigid and static in real life respect to the biological systems. Thus, it is necessary to define a new neural paradigm capable of merging the lifelong resilience of biological organisms with the great accuracy of ANNs. Here, we present a digital implementation of a novel mixed supervised-unsupervised neural network capable of performing lifelong learning. The network uses a set of convolutional filters to extract features from the input images of the MNIST and the Fashion-MNIST training datasets. This information defines an original combination of responses of both trained classes and non-trained classes by transfer learning. The responses are then used in the subsequent unsupervised learning based on spike-timing dependent plasticity (STDP). This procedure allows the clustering of non-trained information thanks to bio-inspired algorithms such as neuronal redundancy and spike-frequency adaptation. We demonstrate the implementation of the neural network in a fully digital environment, such as the Xilinx Zynq-7000 System on Chip (SoC). We illustrate a user-friendly interface to test the network by choosing the number and the type of the non-trained classes, or drawing a custom pattern on a tablet. Finally, we propose a comparison of this work with networks based on memristive synaptic devices capable of continual learning, highlighting the main differences and capabilities respect to a fully digital approach.

Diverse roles of Synaptotagmin-7 in regulating vesicle fusion

Synaptotagmin 7 (Syt7) is a multifunctional calcium sensor expressed throughout the body. Its high calcium affinity makes it well suited to act in processes triggered by modest calcium increases within cells. In synaptic transmission, Syt7 has been shown to mediate asynchronous neurotransmitter release, facilitation, and vesicle replenishment. In this review we provide an update on recent developments, and the newly emerging roles of Syt7 in frequency invariant synaptic transmission and in suppressing spontaneous release. Additionally, we discuss Syt7's regulation of membrane fusion in non-neuronal cells, and its involvement in disease. How such diversity of functions is regulated remains an open question. We discuss several potential factors including temperature, presynaptic calcium signals, the localization of Syt7, and its interaction with other Syt isoforms.

Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity

Coarse-graining microscopic models of biological neural networks to obtain mesoscopic models of neural activities is an essential step towards multi-scale models of the brain. Here, we extend a recent theory for mesoscopic population dynamics with static synapses to the case of dynamic synapses exhibiting short-term plasticity (STP). The extended theory offers an approximate mean-field dynamics for the synaptic input currents arising from populations of spiking neurons and synapses undergoing Tsodyks-Markram STP. The approximate mean-field dynamics accounts for both finite number of synapses and correlation between the two synaptic variables of the model (utilization and available resources) and its numerical implementation is simple. Comparisons with Monte Carlo simulations of the microscopic model show that in both feedforward and recurrent networks, the mesoscopic mean-field model accurately reproduces the first- and second-order statistics of the total synaptic input into a postsynaptic neuron and accounts for stochastic switches between Up and Down states and for population spikes. The extended mesoscopic population theory of spiking neural networks with STP may be useful for a systematic reduction of detailed biophysical models of cortical microcircuits to numerically efficient and mathematically tractable mean-field models.