Neuromodulation of Spike-Timing-Dependent Plasticity: Past, Present, and Future

Advances on MXene-Based Memristors for Neuromorphic Computing: A Review on Synthesis, Mechanisms, and Future Directions

Neuromorphic computing seeks to replicate the capabilities of parallel processing, progressive learning, and inference while retaining low power consumption by drawing inspiration from the human brain. By further overcoming the constraints imposed by the traditional von Neumann architecture, this innovative approach has the potential to revolutionize modern computing systems. Memristors have emerged as a solution to implement neuromorphic computing in hardware, with research based on developing functional materials for resistive switching performance enhancement. Recently, two-dimensional MXenes, a family of transition metal carbides, nitrides, and carbonitrides, have begun to be integrated into these devices to achieve synaptic emulation. MXene-based memristors have already demonstrated diverse neuromorphic characteristics while enhancing the stability and reducing power consumption. The possibility of changing the physicochemical properties through modifications of the surface terminations, bandgap, interlayer spacing, and oxidation for each existing MXene makes them very promising. Here, recent advancements in MXene synthesis, device fabrication, and characterization of MXene-based neuromorphic artificial synapses are discussed. Then, we focus on understanding the resistive switching mechanisms and how they connect with theoretical and experimental data, along with the innovations made during the fabrication process. Additionally, we provide an in-depth review of the neuromorphic performance, making a connection with the resistive switching mechanism, along with a compendium of each relevant performance factor for nonvolatile and volatile applications. Finally, we state the remaining challenges in MXene-based devices for artificial synapses and the next steps that could be taken for future development.

Astrocyte D1/D5 Dopamine Receptors Govern Non-Hebbian Long-Term Potentiation at Sensory Synapses onto Lamina I Spinoparabrachial Neurons

Recent work demonstrated that activation of spinal D1 and D5 dopamine receptors (D1/D5Rs) facilitates non-Hebbian long-term potentiation (LTP) at primary afferent synapses onto spinal projection neurons. However, the cellular localization of the D1/D5Rs driving non-Hebbian LTP in spinal nociceptive circuits remains unknown, and it is also unclear whether D1/D5R signaling must occur concurrently with sensory input in order to promote non-Hebbian LTP at these synapses. Here we investigate these issues using cell-type-selective knockdown of D1Rs or D5Rs from lamina I spinoparabrachial neurons, dorsal root ganglion (DRG) neurons, or astrocytes in adult mice of either sex using Cre recombinase-based genetic strategies. The LTP evoked by low-frequency stimulation of primary afferents in the presence of the selective D1/D5R agonist SKF82958 persisted following the knockdown of D1R or D5R in spinoparabrachial neurons, suggesting that postsynaptic D1/D5R signaling was dispensable for non-Hebbian plasticity at sensory synapses onto these key output neurons of the superficial dorsal horn (SDH). Similarly, the knockdown of D1Rs or D5Rs in DRG neurons failed to influence SKF82958-enabled LTP in lamina I projection neurons. In contrast, SKF82958-induced LTP was suppressed by the knockdown of D1R or D5R in spinal astrocytes. Furthermore, the data indicate that the activation of D1R/D5Rs in spinal astrocytes can either retroactively or proactively drive non-Hebbian LTP in spinoparabrachial neurons. Collectively, these results suggest that dopaminergic signaling in astrocytes can strongly promote activity-dependent LTP in the SDH, which is predicted to significantly enhance the amplification of ascending nociceptive transmission from the spinal cord to the brain.

Mixed selectivity: Cellular computations for complexity

The property of mixed selectivity has been discussed at a computational level and offers a strategy to maximize computational power by adding versatility to the functional role of each neuron. Here, we offer a biologically grounded implementational-level mechanistic explanation for mixed selectivity in neural circuits. We define pure, linear, and nonlinear mixed selectivity and discuss how these response properties can be obtained in simple neural circuits. Neurons that respond to multiple, statistically independent variables display mixed selectivity. If their activity can be expressed as a weighted sum, then they exhibit linear mixed selectivity; otherwise, they exhibit nonlinear mixed selectivity. Neural representations based on diverse nonlinear mixed selectivity are high dimensional; hence, they confer enormous flexibility to a simple downstream readout neural circuit. However, a simple neural circuit cannot possibly encode all possible mixtures of variables simultaneously, as this would require a combinatorially large number of mixed selectivity neurons. Gating mechanisms like oscillations and neuromodulation can solve this problem by dynamically selecting which variables are mixed and transmitted to the readout.

Gradient-free training of recurrent neural networks using random perturbations

Recurrent neural networks (RNNs) hold immense potential for computations due to their Turing completeness and sequential processing capabilities, yet existing methods for their training encounter efficiency challenges. Backpropagation through time (BPTT), the prevailing method, extends the backpropagation (BP) algorithm by unrolling the RNN over time. However, this approach suffers from significant drawbacks, including the need to interleave forward and backward phases and store exact gradient information. Furthermore, BPTT has been shown to struggle to propagate gradient information for long sequences, leading to vanishing gradients. An alternative strategy to using gradient-based methods like BPTT involves stochastically approximating gradients through perturbation-based methods. This learning approach is exceptionally simple, necessitating only forward passes in the network and a global reinforcement signal as feedback. Despite its simplicity, the random nature of its updates typically leads to inefficient optimization, limiting its effectiveness in training neural networks. In this study, we present a new approach to perturbation-based learning in RNNs whose performance is competitive with BPTT, while maintaining the inherent advantages over gradient-based learning. To this end, we extend the recently introduced activity-based node perturbation (ANP) method to operate in the time domain, leading to more efficient learning and generalization. We subsequently conduct a range of experiments to validate our approach. Our results show similar performance, convergence time and scalability when compared to BPTT, strongly outperforming standard node perturbation and weight perturbation methods. These findings suggest that perturbation-based learning methods offer a versatile alternative to gradient-based methods for training RNNs which can be ideally suited for neuromorphic computing applications.

The model of the brain as a complex system: Interactions of physical, neural and mental states with neurocognitive functions

The isolated approaching of physical, neural and mental states and the binary classification into stable traits and fluctuating states previously lead to a limited understanding concerning underlying processes and possibilities to explain, measure and regulate neural and mental performance along with the interaction of mental states and neurocognitive traits. In this article these states are integrated by i) differentiating the model of the brain as a complex, self-organizing system, ii) showing possibilities to measure this model, iii) offering a classification of mental states and iv) presenting a holistic operationalization of state regulations and trait trainings to enhance neural and mental high-performance on a macro- and micro scale. This model integrates current findings from the theory of constructed emotions, the theory of thousand brains and complex systems theory and yields several testable hypotheses to provide an integrated reference frame for future research and applied target points to regulate and enhance performance.

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. We developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) in monkeys. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys measurement sensors which may lead to misclassification of these signals as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. We identified and discriminated cell type-specific units in the monkey striatum that were shown to correlate to specific behavioral task parameters related to reward size and eye movement direction. Synchronously recorded spike and dopamine signals displayed contrasting relations to the task variables, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Synapse-type-specific competitive Hebbian learning forms functional recurrent networks

Cortical networks exhibit complex stimulus-response patterns that are based on specific recurrent interactions between neurons. For example, the balance between excitatory and inhibitory currents has been identified as a central component of cortical computations. However, it remains unclear how the required synaptic connectivity can emerge in developing circuits where synapses between excitatory and inhibitory neurons are simultaneously plastic. Using theory and modeling, we propose that a wide range of cortical response properties can arise from a single plasticity paradigm that acts simultaneously at all excitatory and inhibitory connections-Hebbian learning that is stabilized by the synapse-type-specific competition for a limited supply of synaptic resources. In plastic recurrent circuits, this competition enables the formation and decorrelation of inhibition-balanced receptive fields. Networks develop an assembly structure with stronger synaptic connections between similarly tuned excitatory and inhibitory neurons and exhibit response normalization and orientation-specific center-surround suppression, reflecting the stimulus statistics during training. These results demonstrate how neurons can self-organize into functional networks and suggest an essential role for synapse-type-specific competitive learning in the development of cortical circuits.

Sensory encoding and memory in the mushroom body: signals, noise, and variability

To survive in changing environments, animals need to learn to associate specific sensory stimuli with positive or negative valence. How do they form stimulus-specific memories to distinguish between positively/negatively associated stimuli and other irrelevant stimuli? Solving this task is one of the functions of the mushroom body, the associative memory center in insect brains. Here we summarize recent work on sensory encoding and memory in the Drosophila mushroom body, highlighting general principles such as pattern separation, sparse coding, noise and variability, coincidence detection, and spatially localized neuromodulation, and placing the mushroom body in comparative perspective with mammalian memory systems.

Disentangling neuroplasticity mechanisms in post-stroke language recovery

A major objective in post-stroke aphasia research is to gain a deeper understanding of neuroplastic mechanisms that drive language recovery, with the ultimate goal of enhancing treatment outcomes. Subsequent to recent advances in neuroimaging techniques, we now have the ability to examine more closely how neural activity patterns change after a stroke. However, the way these neural activity changes relate to language impairments and language recovery is still debated. The aim of this review is to provide a theoretical framework to better investigate and interpret neuroplasticity mechanisms underlying language recovery in post-stroke aphasia. We detail two sets of neuroplasticity mechanisms observed at the synaptic level that may explain functional neuroimaging findings in post-stroke aphasia recovery at the network level: feedback-based homeostatic plasticity and associative Hebbian plasticity. In conjunction with these plasticity mechanisms, higher-order cognitive control processes dynamically modulate neural activity in other regions to meet communication demands, despite reduced neural resources. This work provides a network-level neurobiological framework for understanding neural changes observed in post-stroke aphasia and can be used to define guidelines for personalized treatment development.

The promotion-like effect of the M1-STN hyperdirect pathway induced by ccPAS enhanced balance performances: From the perspective of brain connectivity

AIMS

The present study aimed to explore the effect of cortico-cortical paired-associative stimulation (ccPAS) in modulating hyperdirect pathway and its influence on balance performance.

METHODS

Forty healthy participants were randomly allocated to the active ccPAS group (n = 20) or the sham ccPAS group (n = 20). The primary motor cortex and subthalamic nucleus were stimulated sequentially with ccPAS. Unlike the active ccPAS group, one wing of coil was tilted to form a 90° angle with scalp of stimulation locations for the sham ccPAS group. Magnetic resonance imaging, functional reach test (FRT), timed up and go (TUG) test, and limit of stability (LOS) test were performed, and correlation between them was also analyzed.

RESULTS

Three participants in the sham ccPAS group were excluded because of poor quality of NIfTI images. The active group had strengthened hyperdirect pathway, increased functional connectivity (FC) between orbital part of frontal cortex and bilateral precuneus, and decreased FC among basal ganglia (all p < 0.05). Regional network properties of triangular and orbital parts of IFG, middle cingulate cortex, and hippocampus increased. The active group performed better in FRT and LOS (all p < 0.05). FRT positively correlated with FC of the hyperdirect pathway (r = 0.439, p = 0.007) and FCs between orbital part of frontal cortex and bilateral precuneus (all p < 0.05).

CONCLUSION

The ccPAS enhanced balance performance by promotion-like plasticity mechanisms through the hyperdirect pathway.

A hybrid transistor with transcriptionally controlled computation and plasticity

Organic electrochemical transistors (OECTs) are ideal devices for translating biological signals into electrical readouts and have applications in bioelectronics, biosensing, and neuromorphic computing. Despite their potential, developing programmable and modular methods for living systems to interface with OECTs has proven challenging. Here we describe hybrid OECTs containing the model electroactive bacterium Shewanella oneidensis that enable the transduction of biological computations to electrical responses. Specifically, we fabricated planar p-type OECTs and demonstrated that channel de-doping is driven by extracellular electron transfer (EET) from S. oneidensis. Leveraging this mechanistic understanding and our ability to control EET flux via transcriptional regulation, we used plasmid-based Boolean logic gates to translate biological computation into current changes within the OECT. Finally, we demonstrated EET-driven changes to OECT synaptic plasticity. This work enables fundamental EET studies and OECT-based biosensing and biocomputing systems with genetically controllable and modular design elements.

Gamma oscillation plasticity is mediated via parvalbumin interneurons

Understanding the plasticity of neuronal networks is an emerging field of (patho-) physiological research, yet the underlying cellular mechanisms remain poorly understood. Gamma oscillations (30 to 80 hertz), a biomarker of cognitive performance, require and potentiate glutamatergic transmission onto parvalbumin-positive interneurons (PVIs), suggesting an interface for cell-to-network plasticity. In ex vivo local field potential recordings, we demonstrate long-term potentiation of hippocampal gamma power. Gamma potentiation obeys established rules of PVI plasticity, requiring calcium-permeable AMPA receptors (CP-AMPARs) and metabotropic glutamate receptors (mGluRs). A microcircuit computational model of CA3 gamma oscillations predicts CP-AMPAR plasticity onto PVIs critically outperforms pyramidal cell plasticity in increasing gamma power and completely accounts for gamma potentiation. We reaffirm this ex vivo in three PVI-targeting animal models, demonstrating that gamma potentiation requires PVI-specific signaling via a Gq/PKC pathway comprising mGluR5 and a Gi-sensitive, PKA-dependent pathway. Gamma activity-dependent, metabotropically mediated CP-AMPAR plasticity on PVIs may serve as a guiding principle in understanding network plasticity in health and disease.

Astrocytes in Pain Perception: A Systems Neuroscience Approach

Astrocytes play an active role in the function of the brain integrating neuronal activity and regulating back neuronal dynamic. They have recently emerged as active contributors of brain's emergent properties such as perceptions. Here, we analyzed the role of astrocytes in pain perception from the lens of systems neuroscience, and we do this by analyzing how astrocytes encode nociceptive information within brain processing areas and how they are key regulators of the internal state that determines pain perception. Specifically, we discuss the dynamic interactions between astrocytes and neuromodulators, such as noradrenaline, highlighting their role in shaping the level of activation of the neuronal ensemble, thereby influencing the experience of pain. Also, we will discuss the possible implications of an "Astro-NeuroMatrix" in the integration of pain across sensory, affective, and cognitive dimensions of pain perception.

Metabolic energetics underlying attractors in neural models

Neural population modeling, including the role of neural attractors, is a promising tool for understanding many aspects of brain function. We propose a modeling framework to connect the abstract variables used in modeling to recent cellular-level estimates of the bioenergetic costs of different aspects of neural activity, measured in ATP consumed per second per neuron. Based on recent work, an empirical reference for brain ATP use for the awake resting brain was estimated as ∼2 × 109 ATP/s-neuron across several mammalian species. The energetics framework was applied to the Wilson-Cowan (WC) model of two interacting populations of neurons, one excitatory (E) and one inhibitory (I). Attractors were considered to exhibit steady-state behavior and limit cycle behavior, both of which end when the excitatory stimulus ends, and sustained activity that persists after the stimulus ends. The energy cost of limit cycles, with oscillations much faster than the average neuronal firing rate of the population, is tracked more closely with the firing rate than the limit cycle frequency. Self-sustained firing driven by recurrent excitation, though, involves higher firing rates and a higher energy cost. As an example of a simple network in which each node is a WC model, a combination of three nodes can serve as a flexible circuit element that turns on with an oscillating output when input passes a threshold and then persists after the input ends (an "on-switch"), with moderate overall ATP use. The proposed framework can serve as a guide for anchoring neural population models to plausible bioenergetics requirements.NEW & NOTEWORTHY This work bridges two approaches for understanding brain function: cellular-level studies of the metabolic energy costs of different aspects of neural activity and neural population modeling, including the role of neural attractors. The proposed modeling framework connects energetic costs, in ATP consumed per second per neuron, to the more abstract variables used in neural population modeling. In particular, this work anchors potential neural attractors to physiologically plausible bioenergetics requirements.

Synchronous Measurements of Extracellular Action Potentials and Neurochemical Activity with Carbon Fiber Electrodes in Nonhuman Primates

Measuring the dynamic relationship between neuromodulators, such as dopamine, and neuronal action potentials is imperative to understand how these fundamental modes of neural signaling interact to mediate behavior. Here, we developed methods to measure concurrently dopamine and extracellular action potentials (i.e., spikes) and applied these in a monkey performing a behavioral task. Standard fast-scan cyclic voltammetric (FSCV) electrochemical (EChem) and electrophysiological (EPhys) recording systems are combined and used to collect spike and dopamine signals, respectively, from an array of carbon fiber (CF) sensors implanted in the monkey striatum. FSCV requires the application of small voltages at the implanted sensors to measure redox currents generated from target molecules, such as dopamine. These applied voltages create artifacts at neighboring EPhys-measurement sensors, producing signals that may falsely be classified as physiological spikes. Therefore, simple automated temporal interpolation algorithms were designed to remove these artifacts and enable accurate spike extraction. We validated these methods using simulated artifacts and demonstrated an average spike recovery rate of 84.5%. This spike extraction was performed on data collected from concurrent EChem and EPhys recordings made in a task-performing monkey to discriminate cell-type specific striatal units. These identified units were shown to correlate to specific behavioral task parameters related to reward size and eye-movement direction. Synchronous measures of spike and dopamine signals displayed contrasting relations to the behavioral task parameters, as taken from our small set of representative data, suggesting a complex relationship between these two modes of neural signaling. Future application of our methods will help advance our understanding of the interactions between neuromodulator signaling and neuronal activity, to elucidate more detailed mechanisms of neural circuitry and plasticity mediating behaviors in health and in disease.

Synaptic plasticity through a naturalistic lens

From the myriad of studies on neuronal plasticity, investigating its underlying molecular mechanisms up to its behavioral relevance, a very complex landscape has emerged. Recent efforts have been achieved toward more naturalistic investigations as an attempt to better capture the synaptic plasticity underpinning of learning and memory, which has been fostered by the development of in vivo electrophysiological and imaging tools. In this review, we examine these naturalistic investigations, by devoting a first part to synaptic plasticity rules issued from naturalistic in vivo-like activity patterns. We next give an overview of the novel tools, which enable an increased spatio-temporal specificity for detecting and manipulating plasticity expressed at individual spines up to neuronal circuit level during behavior. Finally, we put particular emphasis on works considering brain-body communication loops and macroscale contributors to synaptic plasticity, such as body internal states and brain energy metabolism.

Synchronization in STDP-driven memristive neural networks with time-varying topology

Synchronization is a widespread phenomenon in the brain. Despite numerous studies, the specific parameter configurations of the synaptic network structure and learning rules needed to achieve robust and enduring synchronization in neurons driven by spike-timing-dependent plasticity (STDP) and temporal networks subject to homeostatic structural plasticity (HSP) rules remain unclear. Here, we bridge this gap by determining the configurations required to achieve high and stable degrees of complete synchronization (CS) and phase synchronization (PS) in time-varying small-world and random neural networks driven by STDP and HSP. In particular, we found that decreasing P (which enhances the strengthening effect of STDP on the average synaptic weight) and increasing F (which speeds up the swapping rate of synapses between neurons) always lead to higher and more stable degrees of CS and PS in small-world and random networks, provided that the network parameters such as the synaptic time delay [Formula: see text], the average degree [Formula: see text], and the rewiring probability [Formula: see text] have some appropriate values. When [Formula: see text], [Formula: see text], and [Formula: see text] are not fixed at these appropriate values, the degree and stability of CS and PS may increase or decrease when F increases, depending on the network topology. It is also found that the time delay [Formula: see text] can induce intermittent CS and PS whose occurrence is independent F. Our results could have applications in designing neuromorphic circuits for optimal information processing and transmission via synchronization phenomena.

Acetylcholine facilitates localized synaptic potentiation and location specific feature binding

Forebrain acetylcholine (ACh) signaling has been shown to drive attention and learning. Recent experimental evidence of spatially and temporally constrained cholinergic signaling has sparked interest to investigate how it facilitates stimulus-induced learning. We use biophysical excitatory-inhibitory (E-I) multi-module neural network models to show that external stimuli and ACh signaling can mediate spatially constrained synaptic potentiation patterns. The effects of ACh on neural excitability are simulated by varying the conductance of a muscarinic receptor-regulated hyperpolarizing slow K+ current (m-current). Each network module consists of an E-I network with local excitatory connectivity and global inhibitory connectivity. The modules are interconnected with plastic excitatory synaptic connections, that change via a spike-timing-dependent plasticity (STDP) rule. Our results indicate that spatially constrained ACh release influences the information flow represented by network dynamics resulting in selective reorganization of inter-module interactions. Moreover the information flow depends on the level of synchrony in the network. For highly synchronous networks, the more excitable module leads firing in the less excitable one resulting in strengthening of the outgoing connections from the former and weakening of its incoming synapses. For networks with more noisy firing patterns, activity in high ACh regions is prone to induce feedback firing of synchronous volleys and thus strengthening of the incoming synapses to the more excitable region and weakening of outgoing synapses. Overall, these results suggest that spatially and directionally specific plasticity patterns, as are presumed necessary for feature binding, can be mediated by spatially constrained ACh release.

Can we manipulate brain connectivity? A systematic review of cortico-cortical paired associative stimulation effects

OBJECTIVE

Cortico-cortical paired associative stimulation (ccPAS) is a form of dual-site transcranial magnetic stimulation (TMS) entailing a series of single-TMS pulses paired at specific interstimulus intervals (ISI) delivered to distant cortical areas. The goal of this article is to systematically review its efficacy in inducing plasticity in humans focusing on stimulation parameters and hypotheses of underlying neurophysiology.

METHODS

A systematic review of the literature from 2009-2023 was undertaken to identify all articles utilizing ccPAS to study brain plasticity and connectivity. Six electronic databases were searched and included.

RESULTS

32 studies were identified. The studies targeted connections within the same hemisphere or between hemispheres. 28 ccPAS studies were in healthy participants, 1 study in schizophrenia, and 1 in Alzheimer's disease (AD) patients. 2 additional studies used cortico-cortical repetitive paired associative stimulation (cc-rPAS) in generalized anxiety disorder (GAD) patients. Outcome measures include electromyography (EMG), behavioral measures, electroencephalography (EEG), and functional magnetic resonance imaging (fMRI). ccPAS seems to be able to modulate brain connectivity depending on the ISI.

CONCLUSIONS

ccPAS can be used to modulate corticospinal excitability, brain activity, and behavior. Although the stimulation parameters used across studies reviewed in this paper are varied, ccPAS is a promising approach for basic research and potential clinical applications.

SIGNIFICANCE

Recent advances in neuroscience have caused a shift of interest from the study of single areas to a more complex approach focusing on networks of areas that orchestrate brain activity. Consequently, the TMS community is also witnessing a change, with a growing interest in targeting multiple brain areas rather than a single locus, as evidenced by an increasing number of papers using ccPAS. In light of this new enthusiasm for brain connectivity, this review summarizes existing literature and stimulation parameters that have proven effective in changing electrophysiological, behavioral, or neuroimaging-derived measures.

An event-driven Spike-DBN model for fault diagnosis using reward-STDP

Deep neural networks (DNNs) have shown high accuracy in fault diagnosis, but they struggle to effectively capture changes over time in multivariate time-series data and suffer from resource consumption issues. Spike deep belief networks (spike-DBNs) address these limitations by capturing the change in time-varying signals and reducing resource consumption, but they sacrifice accuracy. To overcome these limitations, we propose integrating an event-driven approach into spike-DBNs through the Latency-Rate coding method and the reward-STDP learning rule. The encoding method enhances the event representation capability, while the learning rule focuses on the global behavior of spiking neurons triggered by events. Our proposed method not only maintains low resource consumption but also improves the fault diagnosis ability of spike-DBNs. We conducted a series of experiments to verify our model's performance, and the results demonstrate that our proposed method improves the accuracy of fault classification of manipulators and reduces learning time by nearly 76% compared to spike-CNN under the same conditions.

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking artificial neural networks (ANNs). Here, we report an efficient brain-inspired computing algorithm for SNNs and ANNs, referred to here as neuromodulation-assisted credit assignment (NACA), which uses expectation signals to induce defined levels of neuromodulators to selective synapses, whereby the long-term synaptic potentiation and depression are modified in a nonlinear manner depending on the neuromodulator level. The NACA algorithm achieved high recognition accuracy with substantially reduced computational cost in learning spatial and temporal classification tasks. Notably, NACA was also verified as efficient for learning five different class continuous learning tasks with varying degrees of complexity, exhibiting a markedly mitigated catastrophic forgetting at low computational cost. Mapping synaptic weight changes showed that these benefits could be explained by the sparse and targeted synaptic modifications attributed to expectation-based global neuromodulation.

Advancements in Transcranial Magnetic Stimulation Research and the Path to Precision

Transcranial magnetic stimulation (TMS) has become increasingly popular in clinical practice in recent years, and there have been significant advances in the principles and stimulation modes of TMS. With the development of multi-mode and precise stimulation technology, it is crucial to have a comprehensive understanding of TMS. The neuroregulatory effects of TMS can vary depending on the specific mode of stimulation, highlighting the importance of exploring these effects through multimodal application. Additionally, the use of precise TMS therapy can help enhance our understanding of the neural mechanisms underlying these effects, providing us with a more comprehensive perspective. This article aims to review the mechanism of action, stimulation mode, multimodal application, and precision of TMS.

A Hybrid Transistor with Transcriptionally Controlled Computation and Plasticity

Organic electrochemical transistors (OECTs) are ideal devices for translating biological signals into electrical readouts and have applications in bioelectronics, biosensing, and neuromorphic computing. Despite their potential, developing programmable and modular methods for living systems to interface with OECTs has proven challenging. Here we describe hybrid OECTs containing the model electroactive bacterium Shewanella oneidensis that enable the transduction of biological computations to electrical responses. Specifically, we fabricated planar p-type OECTs and demonstrated that channel de-doping is driven by extracellular electron transfer (EET) from S. oneidensis. Leveraging this mechanistic understanding and our ability to control EET flux via transcriptional regulation, we used plasmid-based Boolean logic gates to translate biological computation into current changes within the OECT. Finally, we demonstrated EET-driven changes to OECT synaptic plasticity. This work enables fundamental EET studies and OECT-based biosensing and biocomputing systems with genetically controllable and modular design elements.

Sub-anesthetic doses of ketamine increase single cell entrainment in the rat auditory cortex during auditory steady-state response

BACKGROUND

Understanding the effects of the N-methyl-D-aspartate receptor (NMDA-R) antagonist ketamine on brain function is of considerable interest due to the discovery of its fast-acting antidepressant properties. It is well known that gamma oscillations are increased when ketamine is administered to rodents and humans, and increases in the auditory steady-state response (ASSR) have also been observed.

AIMS

To elucidate the cellular substrate of the increase in network activity and synchrony observed by sub-anesthetic doses of ketamine, the aim was to investigate spike timing and regularity and determine how this is affected by the animal's motor state.

METHODS

Single unit activity and local field potentials from the auditory cortex of awake, freely moving rats were recorded with microelectrode arrays during an ASSR paradigm.

RESULTS

Ketamine administration yielded a significant increase in ASSR power and phase locking, both significantly modulated by motor activity. Before drug administration, putative fast-spiking interneurons (FSIs) were significantly more entrained to the stimulus than putative pyramidal neurons (PYRs). The degree of entrainment significantly increased at lower doses of ketamine (3 and 10 mg/kg for FSIs, 10 mg/kg for PYRs). At the highest dose (30 mg/kg), a strong increase in tonic firing of PYRs was observed.

CONCLUSIONS

These findings suggest an involvement of FSIs in the increased network synchrony and provide a possible cellular explanation for the well-documented effects of ketamine-induced increase in power and synchronicity during ASSR. The results support the importance to evaluate different motor states separately for more translational preclinical research.

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Introduction

Spiking neural networks (SNNs), inspired by biological neural networks, have received a surge of interest due to its temporal encoding. Biological neural networks are driven by multiple plasticities, including spike timing-dependent plasticity (STDP), structural plasticity, and homeostatic plasticity, making network connection patterns and weights to change continuously during the lifecycle. However, it is unclear how these plasticities interact to shape neural networks and affect neural signal processing.

Method

Here, we propose a reward-modulated self-organization recurrent network with structural plasticity (RSRN-SP) to investigate this issue. Specifically, RSRN-SP uses spikes to encode information, and incorporate multiple plasticities including reward-modulated spike timing-dependent plasticity (R-STDP), homeostatic plasticity, and structural plasticity. On the one hand, combined with homeostatic plasticity, R-STDP is presented to guide the updating of synaptic weights. On the other hand, structural plasticity is utilized to simulate the growth and pruning of synaptic connections.

Results and discussion

Extensive experiments for sequential learning tasks are conducted to demonstrate the representational ability of the RSRN-SP, including counting task, motion prediction, and motion generation. Furthermore, the simulations also indicate that the characteristics arose from the RSRN-SP are consistent with biological observations.

Dendritic, delayed, and stochastic CaMKII activation underlies behavioral time scale plasticity in CA1 synapses

Behavioral time scale plasticity (BTSP), is a form of non-Hebbian plasticity induced by integrating pre- and postsynaptic components separated by behavioral time scale (seconds). BTSP in the hippocampal CA1 neurons underlies place cell formation. However, the molecular mechanisms underlying this behavioral time scale (eligibility trace) and synapse specificity are unknown. CaMKII can be activated in a synapse-specific manner and remain active for a few seconds, making it a compelling candidate for the eligibility trace during BTSP. Here, we show that BTSP can be induced in a single dendritic spine using 2-photon glutamate uncaging paired with postsynaptic current injection temporally separated by behavioral time scale. Using an improved CaMKII sensor, we saw no detectable CaMKII activation during this BTSP induction. Instead, we observed a dendritic, delayed, and stochastic CaMKII activation (DDSC) associated with Ca 2+ influx and plateau 20-40 s after BTSP induction. DDSC requires both pre-and postsynaptic activity, suggesting that CaMKII can integrate these two signals. Also, optogenetically blocking CaMKII 30 s after the BTSP protocol inhibited synaptic potentiation, indicating that DDSC is an essential mechanism of BTSP. IP3-dependent intracellular Ca 2+ release facilitates both DDSC and BTSP. Thus, our study suggests that the non-synapse specific CaMKII activation provides an instructive signal with an extensive time window over tens of seconds during BTSP.

Engram neurons: Encoding, consolidation, retrieval, and forgetting of memory

Tremendous strides have been made in our understanding of the neurobiological substrates of memory - the so-called memory "engram". Here, we integrate recent progress in the engram field to illustrate how engram neurons transform across the "lifespan" of a memory - from initial memory encoding, to consolidation and retrieval, and ultimately to forgetting. To do so, we first describe how cell-intrinsic properties shape the initial emergence of the engram at memory encoding. Second, we highlight how these encoding neurons preferentially participate in synaptic- and systems-level consolidation of memory. Third, we describe how these changes during encoding and consolidation guide neural reactivation during retrieval, and facilitate memory recall. Fourth, we describe neurobiological mechanisms of forgetting, and how these mechanisms can counteract engram properties established during memory encoding, consolidation, and retrieval. Motivated by recent experimental results across these four sections, we conclude by proposing some conceptual extensions to the traditional view of the engram, including broadening the view of cell-type participation within engrams and across memory stages. In collection, our review synthesizes general principles of the engram across memory stages, and describes future avenues to further understand the dynamic engram.

Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network

Although it may appear infeasible and impractical, building artificial intelligence (AI) using a bottom-up approach based on the understanding of neuroscience is straightforward. The lack of a generalized governing principle for biological neural networks (BNNs) forces us to address this problem by converting piecemeal information on the diverse features of neurons, synapses, and neural circuits into AI. In this review, we described recent attempts to build a biologically plausible neural network by following neuroscientifically similar strategies of neural network optimization or by implanting the outcome of the optimization, such as the properties of single computational units and the characteristics of the network architecture. In addition, we proposed a formalism of the relationship between the set of objectives that neural networks attempt to achieve, and neural network classes categorized by how closely their architectural features resemble those of BNN. This formalism is expected to define the potential roles of top-down and bottom-up approaches for building a biologically plausible neural network and offer a map helping the navigation of the gap between neuroscience and AI engineering.

Timing to be precise? An overview of spike timing-dependent plasticity, brain rhythmicity, and glial cells interplay within neuronal circuits

In the mammalian brain information processing and storage rely on the complex coding and decoding events performed by neuronal networks. These actions are based on the computational ability of neurons and their functional engagement in neuronal assemblies where precise timing of action potential firing is crucial. Neuronal circuits manage a myriad of spatially and temporally overlapping inputs to compute specific outputs that are proposed to underly memory traces formation, sensory perception, and cognitive behaviors. Spike-timing-dependent plasticity (STDP) and electrical brain rhythms are suggested to underlie such functions while the physiological evidence of assembly structures and mechanisms driving both processes continues to be scarce. Here, we review foundational and current evidence on timing precision and cooperative neuronal electrical activity driving STDP and brain rhythms, their interactions, and the emerging role of glial cells in such processes. We also provide an overview of their cognitive correlates and discuss current limitations and controversies, future perspectives on experimental approaches, and their application in humans.

Neuronal and astrocyte determinants of critical periods of plasticity

Windows of plasticity allow environmental experiences to produce intense activity-dependent changes during postnatal development. The reordering and refinement of neural connections occurs during these periods, significantly influencing the formation of brain circuits and physiological processes in adults. Recent advances have shed light on factors that determine the onset and duration of sensitive and critical periods of plasticity. Although GABAergic inhibition has classically been implicated in closing windows of plasticity, astrocytes and adenosinergic inhibition have also emerged more recently as key determinants of the duration of these periods of plasticity. Here, we review novel aspects of the involvement of GABAergic inhibition, the possible role of presynaptic NMDARs, and the emerging roles of astrocytes and adenosinergic inhibition in determining the duration of windows of plasticity in different brain regions.

Electrical stimulation methods and protocols for the treatment of traumatic brain injury: a critical review of preclinical research

BACKGROUND

Traumatic brain injury (TBI) is a leading cause of disabilities resulting from cognitive and neurological deficits, as well as psychological disorders. Only recently, preclinical research on electrical stimulation methods as a potential treatment of TBI sequelae has gained more traction. However, the underlying mechanisms of the anticipated improvements induced by these methods are still not fully understood. It remains unclear in which stage after TBI they are best applied to optimize the therapeutic outcome, preferably with persisting effects. Studies with animal models address these questions and investigate beneficial long- and short-term changes mediated by these novel modalities.

METHODS

In this review, we present the state-of-the-art in preclinical research on electrical stimulation methods used to treat TBI sequelae. We analyze publications on the most commonly used electrical stimulation methods, namely transcranial magnetic stimulation (TMS), transcranial direct current stimulation (tDCS), deep brain stimulation (DBS) and vagus nerve stimulation (VNS), that aim to treat disabilities caused by TBI. We discuss applied stimulation parameters, such as the amplitude, frequency, and length of stimulation, as well as stimulation time frames, specifically the onset of stimulation, how often stimulation sessions were repeated and the total length of the treatment. These parameters are then analyzed in the context of injury severity, the disability under investigation and the stimulated location, and the resulting therapeutic effects are compared. We provide a comprehensive and critical review and discuss directions for future research. RESULTS AND CONCLUSION: We find that the parameters used in studies on each of these stimulation methods vary widely, making it difficult to draw direct comparisons between stimulation protocols and therapeutic outcome. Persisting beneficial effects and adverse consequences of electrical simulation are rarely investigated, leaving many questions about their suitability for clinical applications. Nevertheless, we conclude that the stimulation methods discussed here show promising results that could be further supported by additional research in this field.

Local 5-HT signaling bi-directionally regulates the coincidence time window for associative learning

The coincidence between conditioned stimulus (CS) and unconditioned stimulus (US) is essential for associative learning; however, the mechanism regulating the duration of this temporal window remains unclear. Here, we found that serotonin (5-HT) bi-directionally regulates the coincidence time window of olfactory learning in Drosophila and affects synaptic plasticity of Kenyon cells (KCs) in the mushroom body (MB). Utilizing GPCR-activation-based (GRAB) neurotransmitter sensors, we found that KC-released acetylcholine (ACh) activates a serotonergic dorsal paired medial (DPM) neuron, which in turn provides inhibitory feedback to KCs. Physiological stimuli induce spatially heterogeneous 5-HT signals, which proportionally gate the intrinsic coincidence time windows of different MB compartments. Artificially reducing or increasing the DPM neuron-released 5-HT shortens or prolongs the coincidence window, respectively. In a sequential trace conditioning paradigm, this serotonergic neuromodulation helps to bridge the CS-US temporal gap. Altogether, we report a model circuitry for perceiving the temporal coincidence and determining the causal relationship between environmental events.

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

Combined effects of spike-timing-dependent plasticity and homeostatic structural plasticity on coherence resonance

Efficient processing and transfer of information in neurons have been linked to noise-induced resonance phenomena such as coherence resonance (CR), and adaptive rules in neural networks have been mostly linked to two prevalent mechanisms: spike-timing-dependent plasticity (STDP) and homeostatic structural plasticity (HSP). Thus this paper investigates CR in small-world and random adaptive networks of Hodgkin-Huxley neurons driven by STDP and HSP. Our numerical study indicates that the degree of CR strongly depends, and in different ways, on the adjusting rate parameter P, which controls STDP, on the characteristic rewiring frequency parameter F, which controls HSP, and on the parameters of the network topology. In particular, we found two robust behaviors. (i) Decreasing P (which enhances the weakening effect of STDP on synaptic weights) and decreasing F (which slows down the swapping rate of synapses between neurons) always leads to higher degrees of CR in small-world and random networks, provided that the synaptic time delay parameter τ_{c} has some appropriate values. (ii) Increasing the synaptic time delay τ_{c} induces multiple CR (MCR)-the occurrence of multiple peaks in the degree of coherence as τ_{c} changes-in small-world and random networks, with MCR becoming more pronounced at smaller values of P and F. Our results imply that STDP and HSP can jointly play an essential role in enhancing the time precision of firing necessary for optimal information processing and transfer in neural systems and could thus have applications in designing networks of noisy artificial neural circuits engineered to use CR to optimize information processing and transfer.

Neural learning rules for generating flexible predictions and computing the successor representation

The predictive nature of the hippocampus is thought to be useful for memory-guided cognitive behaviors. Inspired by the reinforcement learning literature, this notion has been formalized as a predictive map called the successor representation (SR). The SR captures a number of observations about hippocampal activity. However, the algorithm does not provide a neural mechanism for how such representations arise. Here, we show the dynamics of a recurrent neural network naturally calculate the SR when the synaptic weights match the transition probability matrix. Interestingly, the predictive horizon can be flexibly modulated simply by changing the network gain. We derive simple, biologically plausible learning rules to learn the SR in a recurrent network. We test our model with realistic inputs and match hippocampal data recorded during random foraging. Taken together, our results suggest that the SR is more accessible in neural circuits than previously thought and can support a broad range of cognitive functions.

Paired associative stimulation on the soleus H-Reflex using motor point and peripheral nerve stimulation

Paired associative stimulation (PAS) has been shown to modulate the corticospinal excitability via spike timing dependent plasticity (STDP). In this study, we aimed to suppress the spinal H-Reflex using PAS. We paired two stimulation modalities, i.e., peripheral nerve stimulation (PNS) and motor point stimulation (MPS). We used PNS to dominantly activate the Ia sensory axon, and we used MPS to dominantly activate the α-motoneuron cell body antidromically. Thus, we applied both PNS and MPS such that the α-motoneuron cell body was activated 5 ms before the activation of the Ia sensory axon ending at the Ia-α motoneuron synapse. If the spinal reflexes can be modulated by STDP, and a combination of MPS and PNS is timed appropriately, then the H-Reflex amplitude will decrease while no change in H-Reflex amplitude is expected for MPS or PNS only. To test this hypothesis, six young healthy participants (5M/1F: 26.8 ± 4.1 yrs) received one of the three following conditions on days separated by at least 24 hr: 1) PAS, 2) MPS only or 3) PNS only. The H-Reflex and M-wave recruitment curves of the soleus were measured immediately prior to, immediately after, 30 min and 60 min after the intervention. The normalized H-Reflex amplitudes were then compared across conditions and times using a two-way ANOVA (3 conditions × 4 times). No main effects of condition or time, or interaction effect were found. These results suggest that relying solely on STDP may be insufficient to inhibit the soleus H-Reflex.

A computational model of learning flexible navigation in a maze by layout-conforming replay of place cells

Recent experimental observations have shown that the reactivation of hippocampal place cells (PC) during sleep or wakeful immobility depicts trajectories that can go around barriers and can flexibly adapt to a changing maze layout. However, existing computational models of replay fall short of generating such layout-conforming replay, restricting their usage to simple environments, like linear tracks or open fields. In this paper, we propose a computational model that generates layout-conforming replay and explains how such replay drives the learning of flexible navigation in a maze. First, we propose a Hebbian-like rule to learn the inter-PC synaptic strength during exploration. Then we use a continuous attractor network (CAN) with feedback inhibition to model the interaction among place cells and hippocampal interneurons. The activity bump of place cells drifts along paths in the maze, which models layout-conforming replay. During replay in sleep, the synaptic strengths from place cells to striatal medium spiny neurons (MSN) are learned by a novel dopamine-modulated three-factor rule to store place-reward associations. During goal-directed navigation, the CAN periodically generates replay trajectories from the animal's location for path planning, and the trajectory leading to a maximal MSN activity is followed by the animal. We have implemented our model into a high-fidelity virtual rat in the MuJoCo physics simulator. Extensive experiments have demonstrated that its superior flexibility during navigation in a maze is due to a continuous re-learning of inter-PC and PC-MSN synaptic strength.

The effects of combined high-frequency repetitive transcranial magnetic stimulation and cervical nerve root magnetic stimulation on upper extremity motor recovery following stroke

Introduction

Upper limb motor impairments after stroke cause patients partial or total loss of the capability of performing daily living, working, and social activities, which significantly affects the quality of life (QoL) of patients and brings a heavy burden to their families and society. As a non-invasive neuromodulation technique, transcranial magnetic stimulation (TMS) can act not only on the cerebral cortex, but also on peripheral nerves, nerve roots, and muscle tissues. Previous studies have shown that magnetic stimulation on the cerebral cortex and peripheral tissues has a positive effect on the recovery of upper limb motor function after stroke, however, few studies have reported the combination of the two.

Objective

This study was to investigate whether high frequency repetitive transcranial magnetic stimulation (HF-rTMS) combined with cervical nerve root magnetic stimulation more effectively ameliorates upper limb motor function in stroke patients. We hypothesized that the combination of the two can achieve a synergistic effect and further promotes functional recovery.

Methods

Sixty patients with stroke were randomly divided into four groups and received real or sham rTMS stimulation and cervical nerve root magnetic stimulation consecutively before other therapies, once daily over five fractions per week for a total of 15 times. We evaluated the upper limb motor function and activities of daily living of the patients at the time of pre-treatment, post-treatment, and 3-month follow up.

Results

All patients completed study procedures without any adverse effects. The upper limb motor function and activities of daily living improved in patients of each group were improved after treatment (post 1) and 3 months after treatment (post 2). Combination treatment was significantly better than single treatments alone or sham.

Conclusion

Both rTMS and cervical nerve root magnetic stimulation effectively promoted upper limb motor recovery in patients with stroke. The protocol combining the two is more beneficial for motor improvement and patients can easily tolerate it.

Clinical trial registration

https://www.chictr.org.cn/, identifier ChiCTR2100048558.

Biphasic Cholinergic Modulation of Reverberatory Activity in Neuronal Networks

Acetylcholine (ACh) is an important neuromodulator in various cognitive functions. However, it is unclear how ACh influences neural circuit dynamics by altering cellular properties. Here, we investigated how ACh influences reverberatory activity in cultured neuronal networks. We found that ACh suppressed the occurrence of evoked reverberation at low to moderate doses, but to a much lesser extent at high doses. Moreover, high doses of ACh caused a longer duration of evoked reverberation, and a higher occurrence of spontaneous activity. With whole-cell recording from single neurons, we found that ACh inhibited excitatory postsynaptic currents (EPSCs) while elevating neuronal firing in a dose-dependent manner. Furthermore, all ACh-induced cellular and network changes were blocked by muscarinic, but not nicotinic receptor antagonists. With computational modeling, we found that simulated changes in EPSCs and the excitability of single cells mimicking the effects of ACh indeed modulated the evoked network reverberation similar to experimental observations. Thus, ACh modulates network dynamics in a biphasic fashion, probably by inhibiting excitatory synaptic transmission and facilitating neuronal excitability through muscarinic signaling pathways.

Activity-dependent Organization of Topographic Neural Circuits

Sensory information in the brain is organized into spatial representations, including retinotopic, somatotopic, and tonotopic maps, as well as ocular dominance columns. The spatial representation of sensory inputs is thought to be a fundamental organizational principle that is important for information processing. Topographic maps are plastic throughout an animal's life, reflecting changes in development and aging of brain circuitry, changes in the periphery and sensory input, and changes in circuitry, for instance in response to experience and learning. Here, we review mechanisms underlying the role of activity in the development, stability and plasticity of topographic maps, focusing on recent work suggesting that the spatial information in the visual field, and the resulting spatiotemporal patterns of activity, provide instructive cues that organize visual projections.

Sleep-mediated regulation of reward circuits: implications in substance use disorders

Our modern society suffers from both pervasive sleep loss and substance abuse-what may be the indications for sleep on substance use disorders (SUDs), and could sleep contribute to the individual variations in SUDs? Decades of research in sleep as well as in motivated behaviors have laid the foundation for us to begin to answer these questions. This review is intended to critically summarize the circuit, cellular, and molecular mechanisms by which sleep influences reward function, and to reveal critical challenges for future studies. The review also suggests that improving sleep quality may serve as complementary therapeutics for treating SUDs, and that formulating sleep metrics may be useful for predicting individual susceptibility to SUDs and other reward-associated psychiatric diseases.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

Subcortical glutamatergic inputs exhibit a Hebbian form of long-term potentiation in the dentate gyrus

The hippocampus receives glutamatergic and GABAergic inputs from subcortical regions. Despite the important roles of these subcortical inputs in the regulation of hippocampal circuit, it has not been explored whether associative activation of the subcorticohippocampal pathway induces Hebbian plasticity of subcortical inputs. Here, we demonstrate that the hypothalamic supramammillary nucleus (SuM) to the dentate granule cell (GC) synapses, which co-release glutamate and GABA, undergo associative long-term potentiation (LTP) of glutamatergic, but not GABAergic, co-transmission. This LTP is induced by pairing of SuM inputs with GC spikes. We found that this Hebbian LTP is input-specific, requires NMDA receptors and CaMKII activation, and is expressed postsynaptically. By the net increase in excitatory drive of SuM inputs following LTP induction, associative inputs of SuM and the perforant path effectively discharge GCs. Our results highlight the important role of associative plasticity at SuM-GC synapses in the regulation of dentate gyrus activity and for the encoding of SuM-related information.

Sleep, plasticity, and sensory neurodevelopment

A defining feature of early infancy is the immense neural plasticity that enables animals to develop a brain that is functionally integrated with a growing body. Early infancy is also defined as a period dominated by sleep. Here, we describe three conceptual frameworks that vary in terms of whether and how they incorporate sleep as a factor in the activity-dependent development of sensory and sensorimotor systems. The most widely accepted framework is exemplified by the visual system where retinal waves seemingly occur independent of sleep-wake states. An alternative framework is exemplified by the sensorimotor system where sensory feedback from sleep-specific movements activates the brain. We prefer a third framework that encompasses the first two but also captures the diverse ways in which sleep modulates activity-dependent development throughout the nervous system. Appreciation of the third framework will spur progress toward a more comprehensive and cohesive understanding of both typical and atypical neurodevelopment.

Dynamics of phase oscillator networks with synaptic weight and structural plasticity

We study the dynamics of Kuramoto oscillator networks with two distinct adaptation processes, one varying the coupling strengths and the other altering the network structure. Such systems model certain networks of oscillatory neurons where the neuronal dynamics, synaptic weights, and network structure interact with and shape each other. We model synaptic weight adaptation with spike-timing-dependent plasticity (STDP) that runs on a longer time scale than neuronal spiking. Structural changes that include addition and elimination of contacts occur at yet a longer time scale than the weight adaptations. First, we study the steady-state dynamics of Kuramoto networks that are bistable and can settle in synchronized or desynchronized states. To compare the impact of adding structural plasticity, we contrast the network with only STDP to one with a combination of STDP and structural plasticity. We show that the inclusion of structural plasticity optimizes the synchronized state of a network by allowing for synchronization with fewer links than a network with STDP alone. With non-identical units in the network, the addition of structural plasticity leads to the emergence of correlations between the oscillators' natural frequencies and node degrees. In the desynchronized regime, the structural plasticity decreases the number of contacts, leading to a sparse network. In this way, adding structural plasticity strengthens both synchronized and desynchronized states of a network. Second, we use desynchronizing coordinated reset stimulation and synchronizing periodic stimulation to induce desynchronized and synchronized states, respectively. Our findings indicate that a network with a combination of STDP and structural plasticity may require stronger and longer stimulation to switch between the states than a network with STDP only.

Memory trace imbalance in reinforcement and punishment systems can reinforce implicit choices leading to obsessive-compulsive behavior

We may view most of our daily activities as rational action selections; however, we sometimes reinforce maladaptive behaviors despite having explicit environmental knowledge. In this study, we model obsessive-compulsive disorder (OCD) symptoms as implicitly learned maladaptive behaviors. Simulations in the reinforcement learning framework show that agents implicitly learn to respond to intrusive thoughts when the memory trace signal for past actions decays differently for positive and negative prediction errors. Moreover, this model extends our understanding of therapeutic effects of behavioral therapy in OCD. Using empirical data, we confirm that patients with OCD show extremely imbalanced traces, which are normalized by serotonin enhancers. We find that healthy participants also vary in their obsessive-compulsive tendencies, consistent with the degree of imbalanced traces. These behavioral characteristics can be generalized to variations in the healthy population beyond the spectrum of clinical phenotypes.

Perspective on Nanofluidic Memristors: from Mechanism to Application

Nanofluidic memristors are memory resistors based on nanoconfined fluidic systems exhibiting history-dependent ion conductivity. Toward establishing powerful computing systems beyond the Harvard architecture, these ion-based neuromorphic devices attracted enormous research attention owing to the unique characteristics of ion-based conductors. However, the design of nanofluidic memristor is still at a primary state and a systematic guidance on the rational design of nanofluidic system is desperately required for the development of nanofluidic-based neuromorphic devices. Herein, we proposed a systematic review on the history, main mechanism and potential application of nanofluidic memristors in order to give a prospective view on the design principle of memristors based on nanofluidic systems. Furthermore, based on the present status of these devices, some fundamental challenges for this promising area were further discussed to show the possible application of these ion-based devices.

VGLUT3 neurons in median raphe control the efficacy of spatial memory retrieval via ETV4 regulation of VGLUT3 transcription

The raphe nucleus is critical for feeding, rewarding and memory. However, how the heterogenous raphe neurons are molecularly and structurally organized to engage their divergent functions remains unknown. Here, we genetically target a subset of neurons expressing VGLUT3. VGLUT3 neurons control the efficacy of spatial memory retrieval by synapsing directly with parvalbumin-expressing GABA interneurons (PGIs) in the dentate gyrus. In a mouse model of Alzheimer's disease (AD mice), VGLUT3→PGIs synaptic transmission is impaired by ETV4 inhibition of VGLUT3 transcription. ETV4 binds to a promoter region of VGLUT3 and activates VGLUT3 transcription in VGLUT3 neurons. Strengthening VGLUT3→PGIs synaptic transmission by ETV4 activation of VGLUT3 transcription upscales the efficacy of spatial memory retrieval in AD mice. This study reports a novel circuit and molecular mechanism underlying the efficacy of spatial memory retrieval via ETV4 inhibition of VGLUT3 transcription and hence provides a promising target for therapeutic intervention of the disease progression.

Neurotensin orchestrates valence assignment in the amygdala

The ability to associate temporally segregated information and assign positive or negative valence to environmental cues is paramount for survival. Studies have shown that different projections from the basolateral amygdala (BLA) are potentiated following reward or punishment learning1-7. However, we do not yet understand how valence-specific information is routed to the BLA neurons with the appropriate downstream projections, nor do we understand how to reconcile the sub-second timescales of synaptic plasticity8-11 with the longer timescales separating the predictive cues from their outcomes. Here we demonstrate that neurotensin (NT)-expressing neurons in the paraventricular nucleus of the thalamus (PVT) projecting to the BLA (PVT-BLA:NT) mediate valence assignment by exerting NT concentration-dependent modulation in BLA during associative learning. We found that optogenetic activation of the PVT-BLA:NT projection promotes reward learning, whereas PVT-BLA projection-specific knockout of the NT gene (Nts) augments punishment learning. Using genetically encoded calcium and NT sensors, we further revealed that both calcium dynamics within the PVT-BLA:NT projection and NT concentrations in the BLA are enhanced after reward learning and reduced after punishment learning. Finally, we showed that CRISPR-mediated knockout of the Nts gene in the PVT-BLA pathway blunts BLA neural dynamics and attenuates the preference for active behavioural strategies to reward and punishment predictive cues. In sum, we have identified NT as a neuropeptide that signals valence in the BLA, and showed that NT is a critical neuromodulator that orchestrates positive and negative valence assignment in amygdala neurons by extending valence-specific plasticity to behaviourally relevant timescales.