A Re-Examination of Hebbian-Covariance Rules and Spike Timing-Dependent Plasticity in Cat Visual Cortex in vivo

Induction of excitatory brain state governs plastic functional changes in visual cortical topology

Adult visual plasticity underlying local remodeling of the cortical circuitry in vivo appears to be associated with a spatiotemporal pattern of strongly increased spontaneous and evoked activity of populations of cells. Here we review and discuss pioneering work by us and others about principles of plasticity in the adult visual cortex, starting with our study which showed that a confined lesion in the cat retina causes increased excitability in the affected region in the primary visual cortex accompanied by fine-tuned restructuring of neuronal function. The underlying remodeling processes was further visualized with voltage-sensitive dye (VSD) imaging that allowed a direct tracking of retinal lesion-induced reorganization across horizontal cortical circuitries. Nowadays, application of noninvasive stimulation methods pursues the idea further of increased cortical excitability along with decreased inhibition as key factors for the induction of adult cortical plasticity. We used high-frequency transcranial magnetic stimulation (TMS), for the first time in combination with VSD optical imaging, and provided evidence that TMS-amplified excitability across large pools of neurons forms the basis for noninvasively targeting reorganization of orientation maps in the visual cortex. Our review has been compiled on the basis of these four own studies, which we discuss in the context of historical developments in the field of visual cortical plasticity and the current state of the literature. Overall, we suggest markers of LTP-like cortical changes at mesoscopic population level as a main driving force for the induction of visual plasticity in the adult. Elevations in excitability that predispose towards cortical plasticity are most likely a common property of all cortical modalities. Thus, interventions that increase cortical excitability are a promising starting point to drive perceptual and potentially motor learning in therapeutic applications.

Calcium and Spike Timing-Dependent Plasticity

Since its discovery, spike timing-dependent synaptic plasticity (STDP) has been thought to be a primary mechanism underlying the brain's ability to learn and to form new memories. However, despite the enormous interest in both the experimental and theoretical neuroscience communities in activity-dependent plasticity, it is still unclear whether plasticity rules inferred from in vitro experiments apply to in vivo conditions. Among the multiple reasons why plasticity rules in vivo might differ significantly from in vitro studies is that extracellular calcium concentration use in most studies is higher than concentrations estimated in vivo. STDP, like many forms of long-term synaptic plasticity, strongly depends on intracellular calcium influx for its induction. Here, we discuss the importance of considering physiological levels of extracellular calcium concentration to study functional plasticity.

Synaptic plasticity rules with physiological calcium levels

Spike-timing-dependent plasticity (STDP) is considered as a primary mechanism underlying formation of new memories during learning. Despite the growing interest in activity-dependent plasticity, it is still unclear whether synaptic plasticity rules inferred from in vitro experiments are correct in physiological conditions. The abnormally high calcium concentration used in in vitro studies of STDP suggests that in vivo plasticity rules may differ significantly from in vitro experiments, especially since STDP depends strongly on calcium for induction. We therefore studied here the influence of extracellular calcium on synaptic plasticity. Using a combination of experimental (patch-clamp recording and Ca²⁺ imaging at CA3-CA1 synapses) and theoretical approaches, we show here that the classic STDP rule in which pairs of single pre- and postsynaptic action potentials induce synaptic modifications is not valid in the physiological Ca²⁺ range. Rather, we found that these pairs of single stimuli are unable to induce any synaptic modification in 1.3 and 1.5 mM calcium and lead to depression in 1.8 mM. Plasticity can only be recovered when bursts of postsynaptic spikes are used, or when neurons fire at sufficiently high frequency. In conclusion, the STDP rule is profoundly altered in physiological Ca²⁺, but specific activity regimes restore a classical STDP profile.

Ocular dominance plasticity: Molecular mechanisms revisited

Ocular dominance plasticity (ODP) is a type of cortical plasticity operating in visual cortex of mammals that are endowed with binocular vision based on the competition-driven disparity. Earlier, a molecular mechanism was proposed that catecholamines play an important role in the maintenance of ODP in kittens. Having survived the initial test, the hypothesis was further advanced to identify noradrenaline (NA) as a key factor that regulates ODP in the immature cortex. Later, the ODP-promoting effect of NA is extended to the adult with age-related limitations. Following the enhanced NA availability, the chain events downstream lead to the β-adrenoreceptor-induced cAMP accumulation, which in turn activates the protein kinase A. Eventually, the protein kinase translocates to the cell nucleus to activate cAMP responsive element binding protein (CREB). CREB is a cellular transcription factor that controls the transcription of various genes, underpinning neuronal plasticity and long-term memory. In the advent of molecular genetics in that various types of new tools have become available with relative ease, ODP research has lightly adopted in the rodent model the original concepts and methodologies. Here, after briefly tracing the strategic maturation of our quest, the review moves to the later development of the field, with the emphasis placed around the following issues: (a) Are we testing ODP per se? (b) What does monocular deprivation deprive of the immature cortex? (c) The critical importance of binocular competition, (d) What is the adult plasticity? (e) Excitation-Inhibition balance in local circuits, and (f) Species differences in the animal models.

Habit learning in hierarchical cortex-basal ganglia loops

How do the multiple cortico-basal ganglia-thalamo-cortical loops interact? Are they parallel and fully independent or controlled by an arbitrator, or are they hierarchically organized? We introduce here a set of four key concepts, integrated and evaluated by means of a neuro-computational model, that bring together current ideas regarding cortex-basal ganglia interactions in the context of habit learning. According to key concept 1, each loop learns to select an intermediate objective at a different abstraction level, moving from goals in the ventral striatum to motor in the putamen. Key concept 2 proposes that the cortex integrates the basal ganglia selection with environmental information regarding the achieved objective. Key concept 3 claims shortcuts between loops, and key concept 4 predicts that loops compute their own prediction error signal for learning. Computational benefits of the key concepts are demonstrated. Contrasting with former concepts of habit learning, the loops collaborate to select goal-directed actions while training slower shortcuts develops habitual responses.

The impact of encoding-decoding schemes and weight normalization in spiking neural networks

Spike-timing Dependent Plasticity (STDP) is a learning mechanism that can capture causal relationships between events. STDP is considered a foundational element of memory and learning in biological neural networks. Previous research efforts endeavored to understand the functionality of STDP's learning window in spiking neural networks (SNNs). In this study, we investigate the interaction among different encoding/decoding schemes, STDP learning windows and normalization rules for the SNN classifier, trained and tested on MNIST, NIST and ETH80-Contour datasets. The results show that when no normalization rules are applied, classical STDP typically achieves the best performance. Additionally, first-spike decoding classifiers require much less decoding time than a spike count decoding classifier. Thirdly, when no normalization rule is applied, the classifier accuracy decreases as the encoding duration increases from 10ms to 34ms using count decoding scheme. Finally, normalization of output weights is shown to improve the performance of a first-spike decoding classifier, which reveals the importance of weight normalization to SNN.

Non-accidental properties, metric invariance, and encoding by neurons in a model of ventral stream visual object recognition, VisNet

When objects transform into different views, some properties are maintained, such as whether the edges are convex or concave, and these non-accidental properties are likely to be important in view-invariant object recognition. The metric properties, such as the degree of curvature, may change with different views, and are less likely to be useful in object recognition. It is shown that in a model of invariant visual object recognition in the ventral visual stream, VisNet, non-accidental properties are encoded much more than metric properties by neurons. Moreover, it is shown how with the temporal trace rule training in VisNet, non-accidental properties of objects become encoded by neurons, and how metric properties are treated invariantly. We also show how VisNet can generalize between different objects if they have the same non-accidental property, because the metric properties are likely to overlap. VisNet is a 4-layer unsupervised model of visual object recognition trained by competitive learning that utilizes a temporal trace learning rule to implement the learning of invariance using views that occur close together in time. A second crucial property of this model of object recognition is, when neurons in the level corresponding to the inferior temporal visual cortex respond selectively to objects, whether neurons in the intermediate layers can respond to combinations of features that may be parts of two or more objects. In an investigation using the four sides of a square presented in every possible combination, it was shown that even though different layer 4 neurons are tuned to encode each feature or feature combination orthogonally, neurons in the intermediate layers can respond to features or feature combinations present is several objects. This property is an important part of the way in which high capacity can be achieved in the four-layer ventral visual cortical pathway. These findings concerning non-accidental properties and the use of neurons in intermediate layers of the hierarchy help to emphasise fundamental underlying principles of the computations that may be implemented in the ventral cortical visual stream used in object recognition.

Mirror Neurons Modeled Through Spike-Timing-Dependent Plasticity are Affected by Channelopathies Associated with Autism Spectrum Disorder

Mirror neurons fire action potentials both when the agent performs a certain behavior and watches someone performing a similar action. Here, we present an original mirror neuron model based on the spike-timing-dependent plasticity (STDP) between two morpho-electrical models of neocortical pyramidal neurons. Both neurons fired spontaneously with basal firing rate that follows a Poisson distribution, and the STDP between them was modeled by the triplet algorithm. Our simulation results demonstrated that STDP is sufficient for the rise of mirror neuron function between the pairs of neocortical neurons. This is a proof of concept that pairs of neocortical neurons associating sensory inputs to motor outputs could operate like mirror neurons. In addition, we used the mirror neuron model to investigate whether channelopathies associated with autism spectrum disorder could impair the modeled mirror function. Our simulation results showed that impaired hyperpolarization-activated cationic currents (Ih) affected the mirror function between the pairs of neocortical neurons coupled by STDP.

Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level

Synaptic plasticity is thought to be the principal neuronal mechanism underlying learning. Models of plastic networks typically combine point neurons with spike-timing-dependent plasticity (STDP) as the learning rule. However, a point neuron does not capture the local non-linear processing of synaptic inputs allowed for by dendrites. Furthermore, experimental evidence suggests that STDP is not the only learning rule available to neurons. By implementing biophysically realistic neuron models, we study how dendrites enable multiple synaptic plasticity mechanisms to coexist in a single cell. In these models, we compare the conditions for STDP and for synaptic strengthening by local dendritic spikes. We also explore how the connectivity between two cells is affected by these plasticity rules and by different synaptic distributions. Finally, we show that how memory retention during associative learning can be prolonged in networks of neurons by including dendrites.

Synaptic plasticity is the neuronal mechanism underlying learning. Here the authors construct biophysical models of pyramidal neurons that reproduce observed plasticity gradients along the dendrite and show that dendritic spike dependent LTP which is predominant in distal sections can prolong memory retention.

Sleep: The hebbian reinforcement of the local inhibitory synapses

Sleep is ubiquitous among the animal realm, and represents about 30% of our lives. Despite numerous efforts, the reason behind our need for sleep is still unknown. The Theory of neuronal Cognition (TnC) proposes that sleep is the period of time during which the local inhibitory synapses (in particular the cortical ones) are replenished. Indeed, as long as the active brain stays awake, hebbian learning guarantees that efficient inhibitory synapses lose their efficiency – just because they are efficient at avoiding the activation of the targeted neurons. Since hebbian learning is the only known mechanism of synapse modification, it follows that to replenish the inhibitory synapses' efficiency, source and targeted neurons must be activated together. This is achieved by a local depolarization that may travel (wave). The period of time during which such slow waves are experienced has been named the "slow-wave sleep" (SWS). It is cut into several pieces by shorter periods of paradoxical sleep (REM) which activity resembles that of the awake state. Indeed, SWS – because it only allows local neural activation – decreases the excitatory long distance connections strength. To avoid losing the associations built during the awake state, these long distance activations are played again during the REM sleep. REM and SWS sleeps act together to guarantee that when the subject awakes again, his inhibitory synaptic efficiency is restored and his (excitatory) long distance associations are still there.

Reprogramming of orientation columns in visual cortex: a domino effect

Cortical organization rests upon the fundamental principle that neurons sharing similar properties are co-located. In the visual cortex, neurons are organized into orientation columns. In a column, most neurons respond optimally to the same axis of an oriented edge, that is, the preferred orientation. This orientation selectivity is believed to be absolute in adulthood. However, in a fully mature brain, it has been established that neurons change their selectivity following sensory experience or visual adaptation. Here, we show that after applying an adapter away from the tested cells, neurons whose receptive fields were located remotely from the adapted site also exhibit a novel selectivity in spite of the fact that they were not adapted. These results indicate a robust reconfiguration and remapping of the orientation domains with respect to each other thus removing the possibility of an orientation hole in the new hypercolumn. These data suggest that orientation columns transcend anatomy, and are almost strictly functionally dynamic.

Synaptic consolidation: from synapses to behavioral modeling

Synaptic plasticity, a key process for memory formation, manifests itself across different time scales ranging from a few seconds for plasticity induction up to hours or even years for consolidation and memory retention. We developed a three-layered model of synaptic consolidation that accounts for data across a large range of experimental conditions. Consolidation occurs in the model through the interaction of the synaptic efficacy with a scaffolding variable by a read-write process mediated by a tagging-related variable. Plasticity-inducing stimuli modify the efficacy, but the state of tag and scaffold can only change if a write protection mechanism is overcome. Our model makes a link from depotentiation protocols in vitro to behavioral results regarding the influence of novelty on inhibitory avoidance memory in rats.

The Theory of Neural Cognition Applied to Robotics

The Theory of neural Cognition (TnC) states that the brain does not process information, it only represents information (i.e., it is ‘only’ a memory). The TnC explains how a memory can become an actor pursuing various goals, and proposes explanations concerning the implementation of a large variety of cognitive abilities, such as attention, memory, language, planning, intelligence, emotions, motivation, pleasure, consciousness and personality. The explanatory power of this new framework extends further though, to tackle special psychological states such as hypnosis, the placebo effect and sleep, and brain diseases such as autism, Alzheimer's disease and schizophrenia. The most interesting findings concern robotics: because the TnC considers the cortical column to be the key cognitive unit (instead of the neuron), it reduces the requirements for a brain implementation to only 160,000 units (instead of 86 billion). A robot exhibiting human-like cognitive abilities is therefore within our reach.

Emerging feed-forward inhibition allows the robust formation of direction selectivity in the developing ferret visual cortex

The computation of direction selectivity requires that a cell respond to joint spatial and temporal characteristics of the stimulus that cannot be separated into independent components. Direction selectivity in ferret visual cortex is not present at the time of eye opening but instead develops in the days and weeks following eye opening in a process that requires visual experience with moving stimuli. Classic Hebbian or spike timing-dependent modification of excitatory feed-forward synaptic inputs is unable to produce direction-selective cells from unselective or weakly directionally biased initial conditions because inputs eventually grow so strong that they can independently drive cortical neurons, violating the joint spatial-temporal activation requirement. Furthermore, without some form of synaptic competition, cells cannot develop direction selectivity in response to training with bidirectional stimulation, as cells in ferret visual cortex do. We show that imposing a maximum lateral geniculate nucleus (LGN)-to-cortex synaptic weight allows neurons to develop direction-selective responses that maintain the requirement for joint spatial and temporal activation. We demonstrate that a novel form of inhibitory plasticity, postsynaptic activity-dependent long-term potentiation of inhibition (POSD-LTPi), which operates in the developing cortex at the time of eye opening, can provide synaptic competition and enables robust development of direction-selective receptive fields with unidirectional or bidirectional stimulation. We propose a general model of the development of spatiotemporal receptive fields that consists of two phases: an experience-independent establishment of initial biases, followed by an experience-dependent amplification or modification of these biases via correlation-based plasticity of excitatory inputs that compete against gradually increasing feed-forward inhibition.

Adaptation shifts preferred orientation of tuning curve in the mouse visual cortex

In frontalized mammals it has been demonstrated that adaptation produces shift of the peak of the orientation tuning curve of neuron following frequent or lengthier presentation of a non-preferred stimulus. Depending on the duration of adaptation the shift is attractive (toward the adapter) or repulsive (away from the adapter). Mouse exhibits a salt-and-pepper cortical organization of orientation maps, hence this species may respond differently to adaptation. To examine this question, we determined the effect of twelve minutes of adaptation to one particular orientation on neuronal orientation tuning curves in V1 of anesthetized mice. Multi-unit activity of neurons in V1 was recorded in a conventional fashion. Cells were stimulated with sine-wave drifting gratings whose orientation tilted in steps. Results revealed that similarly to cats and monkeys, majority of cells shifted their optimal orientation in the direction of the adapter while a small proportion exhibited a repulsive shift. Moreover, initially untuned cells showing poor tuning curves reacted to adaptation by displaying sharp orientation selectivity. It seems that modification of the cellular property following adaptation is a general phenomenon observed in all mammals in spite of the different organization pattern of the visual cortex. This study is of pertinence to comprehend the mechanistic pathways of brain plasticity.

How to train a neuron

A cellular learning rule known as spike-timing-dependent plasticity can form, reshape and erase the response preferences of visual cortex neurons.

Changing the responses of cortical neurons from sub- to suprathreshold using single spikes in vivo

Action Potential (APs) patterns of sensory cortex neurons encode a variety of stimulus features, but how can a neuron change the feature to which it responds? Here, we show that in vivo a spike-timing-dependent plasticity (STDP) protocol—consisting of pairing a postsynaptic AP with visually driven presynaptic inputs—modifies a neurons' AP-response in a bidirectional way that depends on the relative AP-timing during pairing. Whereas postsynaptic APs repeatedly following presynaptic activation can convert subthreshold into suprathreshold responses, APs repeatedly preceding presynaptic activation reduce AP responses to visual stimulation. These changes were paralleled by restructuring of the neurons response to surround stimulus locations and membrane-potential time-course. Computational simulations could reproduce the observed subthreshold voltage changes only when presynaptic temporal jitter was included. Together this shows that STDP rules can modify output patterns of sensory neurons and the timing of single-APs plays a crucial role in sensory coding and plasticity.

DOI:http://dx.doi.org/10.7554/eLife.00012.001

Nerve cells, called neurons, are one of the core components of the brain and form complex networks by connecting to other neurons via long, thin ‘wire-like’ processes called axons. Axons can extend across the brain, enabling neurons to form connections—or synapses—with thousands of others. It is through these complex networks that incoming information from sensory organs, such as the eye, is propagated through the brain and encoded.

The basic unit of communication between neurons is the action potential, often called a ‘spike’, which propagates along the network of axons and, through a chemical process at synapses, communicates with the postsynaptic neurons that the axon is connected to. These action potentials excite the neuron that they arrive at, and this excitatory process can generate a new action potential that then propagates along the axon to excite additional target neurons. In the visual areas of the cortex, neurons respond with action potentials when they ‘recognize’ a particular feature in a scene—a process called tuning. How a neuron becomes tuned to certain features in the world and not to others is unclear, as are the rules that enable a neuron to change what it is tuned to. What is clear, however, is that to understand this process is to understand the basis of sensory perception.

Memory storage and formation is thought to occur at synapses. The efficiency of signal transmission between neurons can increase or decrease over time, and this process is often referred to as synaptic plasticity. But for these synaptic changes to be transmitted to target neurons, the changes must alter the number of action potentials. Although it has been shown in vitro that the efficiency of synaptic transmission—that is the strength of the synapse—can be altered by changing the order in which the pre- and postsynaptic cells are activated (referred to as ‘Spike-timing-dependent plasticity’), this has never been shown to have an effect on the number of action potentials generated in a single neuron in vivo. It is therefore unknown whether this process is functionally relevant.

Now Pawlak et al. report that spike-timing-dependent plasticity in the visual cortex of anaesthetized rats can change the spiking of neurons in the visual cortex. They used a visual stimulus (a bar flashed up for half a second) to activate a presynaptic cell, and triggered a single action potential in the postsynaptic cell a very short time later. By repeatedly activating the cells in this way, they increased the strength of the synaptic connection between the two neurons. After a small number of these pairing activations, presenting the visual stimulus alone to the presynaptic cell was enough to trigger an action potential (a suprathreshold response) in the postsynaptic neuron—even though this was not the case prior to the pairing.

This study shows that timing rules known to change the strength of synaptic connections—and proposed to underlie learning and memory—have functional relevance in vivo, and that the timing of single action potentials can change the functional status of a cortical neuron.

DOI:http://dx.doi.org/10.7554/eLife.00012.002

Divisive normalization and neuronal oscillations in a single hierarchical framework of selective visual attention

Divisive normalization models of covert attention commonly use spike rate modulations as indicators of the effect of top-down attention. In addition, an increasing number of studies have shown that top-down attention increases the synchronization of neuronal oscillations as well, particularly in gamma-band frequencies (25–100 Hz). Although modulations of spike rate and synchronous oscillations are not mutually exclusive as mechanisms of attention, there has thus far been little effort to integrate these concepts into a single framework of attention. Here, we aim to provide such a unified framework by expanding the normalization model of attention with a multi-level hierarchical structure and a time dimension; allowing the simulation of a recently reported backward progression of attentional effects along the visual cortical hierarchy. A simple cascade of normalization models simulating different cortical areas is shown to cause signal degradation and a loss of stimulus discriminability over time. To negate this degradation and ensure stable neuronal stimulus representations, we incorporate a kind of oscillatory phase entrainment into our model that has previously been proposed as the “communication-through-coherence” (CTC) hypothesis. Our analysis shows that divisive normalization and oscillation models can complement each other in a unified account of the neural mechanisms of selective visual attention. The resulting hierarchical normalization and oscillation (HNO) model reproduces several additional spatial and temporal aspects of attentional modulation and predicts a latency effect on neuronal responses as a result of cued attention.