Redundancy in synaptic connections enables neurons to learn optimally

Asymmetry in synaptic connectivity balances redundancy and reachability in the Caenorhabditis elegans connectome

The brain is overall bilaterally symmetrical, but also exhibits considerable asymmetry. While symmetry may endow neural networks with robustness and resilience, asymmetry may enable parallel information processing and functional specialization. How is this tradeoff between symmetrical and asymmetrical brain architecture balanced? To address this, we focused on the Caenorhabditis elegans connectome, comprising 99 classes of bilaterally symmetrical neuron pairs. We found symmetry in the number of synaptic partners between neuron class members, but pronounced asymmetry in the identity of these synapses. We applied graph theoretical metrics for evaluating Redundancy, the selective reinforcement of specific neural paths by multiple alternative synaptic connections, and Reachability, the extent and diversity of synaptic connectivity of each neuron class. We found Redundancy and Reachability to be stochastically tunable by the level of network asymmetry, driving the C. elegans connectome to favor Redundancy over Reachability. These results elucidate fundamental relations between lateralized neural connectivity and function.

Parallel Synapses with Transmission Nonlinearities Enhance Neuronal Classification Capacity

Cortical neurons often establish multiple synaptic contacts with the same postsynaptic neuron. To avoid functional redundancy of these parallel synapses, it is crucial that each synapse exhibits distinct computational properties. Here we model the current to the soma contributed by each synapse as a sigmoidal transmission function of its presynaptic input, with learnable parameters such as amplitude, slope, and threshold. We evaluate the classification capacity of a neuron equipped with such nonlinear parallel synapses, and show that with a small number of parallel synapses per axon, it substantially exceeds that of the Perceptron. Furthermore, the number of correctly classified data points can increase superlinearly as the number of presynaptic axons grows. When training with an unrestricted number of parallel synapses, our model neuron can effectively implement an arbitrary aggregate transmission function for each axon, constrained only by monotonicity. Nevertheless, successful learning in the model neuron often requires only a small number of parallel synapses. We also apply these parallel synapses in a feedforward neural network trained to classify MNIST images, and show that they can increase the test accuracy. This demonstrates that multiple nonlinear synapses per input axon can substantially enhance a neuron's computational power.

Altered projection-specific synaptic remodeling and its modification by oxytocin in an idiopathic autism marmoset model

Alterations in the experience-dependent and autonomous elaboration of neural circuits are assumed to underlie autism spectrum disorder (ASD), though it is unclear what synaptic traits are responsible. Here, utilizing a valproic acid-induced ASD marmoset model, which shares common molecular features with idiopathic ASD, we investigate changes in the structural dynamics of tuft dendrites of upper-layer pyramidal neurons and adjacent axons in the dorsomedial prefrontal cortex through two-photon microscopy. In model marmosets, dendritic spine turnover is upregulated, and spines are generated in clusters and survived more often than in control marmosets. Presynaptic boutons in local axons, but not in commissural long-range axons, demonstrate hyperdynamic turnover in model marmosets, suggesting alterations in projection-specific plasticity. Intriguingly, nasal oxytocin administration attenuates clustered spine emergence in model marmosets. Enhanced clustered spine generation, possibly unique to certain presynaptic partners, may be associated with ASD and be a potential therapeutic target.

Synchronization of delayed coupled neurons with multiple synaptic connections

Synchronization is a key feature of the brain dynamics and is necessary for information transmission across brain regions and in higher brain functions like cognition, learning and memory. Experimental findings demonstrated that in cortical microcircuits there are multiple synapses between pairs of connected neurons. Synchronization of neurons in the presence of multiple synaptic connections may be relevant for optimal learning and memory, however, its effect on the dynamics of the neurons is not adequately studied. Here, we address the question that how changes in the strength of the synaptic connections and transmission delays between neurons impact synchronization in a two-neuron system with multiple synapses. To this end, we analytically and computationally investigated synchronization dynamics by considering both phase oscillator model and conductance-based Hodgkin-Huxley (HH) model. Our results show that symmetry/asymmetry of feedforward and feedback connections crucially determines stability of the phase locking of the system based on the strength of connections and delays. In both models, the two-neuron system with multiple synapses achieves in-phase synchrony in the presence of small and large delays, whereas an anti-phase synchronization state is favored for median delays. Our findings can expand the understanding of the functional role of multisynaptic contacts in neuronal synchronization and may shed light on the dynamical consequences of pathological multisynaptic connectivity in a number of brain disorders.

Dementia in Convolutional Neural Networks: Using Deep Learning Models to Simulate Neurodegeneration of the Visual System

Although current research aims to improve deep learning networks by applying knowledge about the healthy human brain and vice versa, the potential of using such networks to model and study neurodegenerative diseases remains largely unexplored. In this work, we present an in-depth feasibility study modeling progressive dementia in silico with deep convolutional neural networks. Therefore, networks were trained to perform visual object recognition and then progressively injured by applying neuronal as well as synaptic injury. After each iteration of injury, network object recognition accuracy, saliency map similarity between the intact and injured networks, and internal activations of the degenerating models were evaluated. The evaluation revealed that cognitive function of the network progressively decreased with increasing injury load whereas this effect was much more pronounced for synaptic damage. The effects of neurodegeneration found for the in silico model are especially similar to the loss of visual cognition seen in patients with posterior cortical atrophy.

Neuron-targeted Knockout of APE1 Forces Premature Cognitive Impairment and Synaptic Dysfunction in Adult Mice

Adaptable and consistent neural function relies at least in part on the ongoing repair of oxidative damage that can accumulate in the brain over a lifespan. To determine whether forebrain neuron-targeted knockout of AP endonuclease 1 (APE1), a critical enzyme in the base excision DNA repair pathway, contributes to neuronal impairments, we generated APE1 conditional knockout mice under the control of the CamKIIα promotor (APE1 cKO). Spatial learning and memory were tested using the Morris water maze. Synaptic markers, including synapsin, vGLUT, GABA1, and GAD were immunostained and quantified. Dendritic morphology and number were characterized using Golgi staining. Long-term potentiation (LTP) was measured in slices from the 6-month-old brain. APE1 cKO mice did not significantly differ from WT mice in the learning phase of the Morris water maze, but performed significantly worse during the memory phase of the Morris water maze. vGLUT, GABA1, and GAD immunostaining was significantly decreased in APE1 cKO mice without concomitant changes in the number of synapsin-positive structures, suggesting that neural networks may be impaired but not at the level of total presynaptic structures. Dendrites were reduced both in number and length of spines in APE1 cKO mice. APE1 cKO brain slices exhibited decreased LTP induction compared to WT brain slices. Together, these data indicate that the conditional loss of APE1 in forebrain neurons leads to a phenotype consistent with expedited brain aging.

Front and center: Maturational dysregulation of frontal lobe functional neuroanatomic connections in attention deficit hyperactivity disorder

Frontal lobe function may not universally explain all forms of attention deficit hyperactivity disorder (ADHD) but the frontal lobe hypothesis described supports an internally consistent model for integrating the numerous behaviors associated with ADHD. The paper examines the developmental trajectories of frontal and prefrontal lobe development, framing ADHD as maturational dysregulation concluding that the cognitive, motor, and behavioral abilities of the presumptive majority of ADHD children may not primarily be disordered or dysfunctional but reflect maturational dysregulation that is inconsistent with the psychomotor and cognitive expectations for the child’s chronological and mental age. ADHD children demonstrate decreased activation of the right and middle prefrontal cortex. Prefrontal and frontal lobe regions have an exuberant network of shared pathways with the diencephalic region, also having a regulatory function in arousal as well as with the ascending reticular formation which has a capacity for response suppression to task-irrelevant stimuli. Prefrontal lesions oftentimes are associated with the regulatory breakdown of goal-directed activity and impulsivity. In conclusion, a presumptive majority of childhood ADHD may result from maturational dysregulation of the frontal lobes with effects on the direct, indirect and/or, hyperdirect pathways.

Drifting neuronal representations: Bug or feature?

The brain displays a remarkable ability to sustain stable memories, allowing animals to execute precise behaviors or recall stimulus associations years after they were first learned. Yet, recent long-term recording experiments have revealed that single-neuron representations continuously change over time, contravening the classical assumption that learned features remain static. How do unstable neural codes support robust perception, memories, and actions? Here, we review recent experimental evidence for such representational drift across brain areas, as well as dissections of its functional characteristics and underlying mechanisms. We emphasize theoretical proposals for how drift need not only be a form of noise for which the brain must compensate. Rather, it can emerge from computationally beneficial mechanisms in hierarchical networks performing robust probabilistic computations.

Emergence of synaptic organization and computation in dendrites

Single neurons in the brain exhibit astounding computational capabilities, which gradually emerge throughout development and enable them to become integrated into complex neural circuits. These capabilities derive in part from the precise arrangement of synaptic inputs on the neurons' dendrites. While the full computational benefits of this arrangement are still unknown, a picture emerges in which synapses organize according to their functional properties across multiple spatial scales. In particular, on the local scale (tens of microns), excitatory synaptic inputs tend to form clusters according to their functional similarity, whereas on the scale of individual dendrites or the entire tree, synaptic inputs exhibit dendritic maps where excitatory synapse function varies smoothly with location on the tree. The development of this organization is supported by inhibitory synapses, which are carefully interleaved with excitatory synapses and can flexibly modulate activity and plasticity of excitatory synapses. Here, we summarize recent experimental and theoretical research on the developmental emergence of this synaptic organization and its impact on neural computations.

Maternal Cigarette Smoke Exposure Exaggerates the Behavioral Defects and Neuronal Loss Caused by Hypoxic-Ischemic Brain Injury in Female Offspring

Objective

Hypoxic-ischemic encephalopathy affects ∼6 in 1,000 preterm neonates, leading to significant neurological sequela (e.g., cognitive deficits and cerebral palsy). Maternal smoke exposure (SE) is one of the common causes of neurological disorders; however, female offspring seems to be less affected than males in our previous study. We also showed that maternal SE exaggerated neurological disorders caused by neonatal hypoxic-ischemic brain injury in adolescent male offspring. Here, we aimed to examine whether female littermates of these males are protected from such insult.

Methods

BALB/c dams were exposed to cigarette smoke generated from 2 cigarettes twice daily for 6 weeks before mating, during gestation and lactation. To induce hypoxic-ischemic brain injury, half of the pups from each litter underwent left carotid artery occlusion, followed by exposure to 8% oxygen (92% nitrogen) at postnatal day (P) 10. Behavioral tests were performed at P40–44, and brain tissues were collected at P45.

Results

Maternal SE worsened the defects in short-term memory and motor function in females with hypoxic-ischemic injury; however, reduced anxiety due to injury was observed in the control offspring, but not the SE offspring. Both hypoxic-ischemic injury and maternal SE caused significant loss of neuronal cells and synaptic proteins, along with increased oxidative stress and inflammatory responses.

Conclusion

Oxidative stress and inflammatory response due to maternal SE may be the mechanism of worsened neurological outcomes by hypoxic-ischemic brain injury in females, which was similar to their male littermates shown in our previous study.

Can Neuroscientists Test a New Physicalist Mind/Body View: DiCoToP (Diachronic Conjunctive Token Physicalism)?

Given that disparate mind/body views have interfered with interdisciplinary research in psychoanalysis and neuroscience, the mind/body problem itself is explored here. Adding a philosophy of mind framework, problems for both dualists and physicalists are presented, along with essential concepts including: independent mental causation, emergence, and multiple realization. To address some of these issues in a new light, this article advances an original mind/body account-Diachronic Conjunctive Token Physicalism (DiCoToP). Next, puzzles DiCoTop reveals, psychoanalytic problems it solves, and some empirical evidence accrued for views consistent with DiCoToP are presented. In closing, this piece challenges/appeals for neuroscience research to gain evidence for (or against) the DiCoToP view.

Role of NMDAR plasticity in a computational model of synaptic memory

A largely unexplored question in neuronal plasticity is whether synapses are capable of encoding and learning the timing of synaptic inputs. We address this question in a computational model of synaptic input time difference learning (SITDL), where N-methyl-d-aspartate receptor (NMDAR) isoform expression in silent synapses is affected by time differences between glutamate and voltage signals. We suggest that differences between NMDARs' glutamate and voltage gate conductances induce modifications of the synapse's NMDAR isoform population, consequently changing the timing of synaptic response. NMDAR expression at individual synapses can encode the precise time difference between signals. Thus, SITDL enables the learning and reconstruction of signals across multiple synapses of a single neuron. In addition to plausibly predicting the roles of NMDARs in synaptic plasticity, SITDL can be usefully applied in artificial neural network models.

Low-temperature emergent neuromorphic networks with correlated oxide devices

Neuromorphic computing-which aims to mimic the collective and emergent behavior of the brain's neurons, synapses, axons, and dendrites-offers an intriguing, potentially disruptive solution to society's ever-growing computational needs. Although much progress has been made in designing circuit elements that mimic the behavior of neurons and synapses, challenges remain in designing networks of elements that feature a collective response behavior. We present simulations of networks of circuits and devices based on superconducting and Mott-insulating oxides that display a multiplicity of emergent states that depend on the spatial configuration of the network. Our proposed network designs are based on experimentally known ways of tuning the properties of these oxides using light ions. We show how neuronal and synaptic behavior can be achieved with arrays of superconducting Josephson junction loops, all within the same device. We also show how a multiplicity of synaptic states could be achieved by designing arrays of devices based on hydrogenated rare earth nickelates. Together, our results demonstrate a research platform that utilizes the collective macroscopic properties of quantum materials to mimic the emergent behavior found in biological systems.

Emergence of local and global synaptic organization on cortical dendrites

Synaptic inputs on cortical dendrites are organized with remarkable subcellular precision at the micron level. This organization emerges during early postnatal development through patterned spontaneous activity and manifests both locally where nearby synapses are significantly correlated, and globally with distance to the soma. We propose a biophysically motivated synaptic plasticity model to dissect the mechanistic origins of this organization during development and elucidate synaptic clustering of different stimulus features in the adult. Our model captures local clustering of orientation in ferret and receptive field overlap in mouse visual cortex based on the receptive field diameter and the cortical magnification of visual space. Including action potential back-propagation explains branch clustering heterogeneity in the ferret and produces a global retinotopy gradient from soma to dendrite in the mouse. Therefore, by combining activity-dependent synaptic competition and species-specific receptive fields, our framework explains different aspects of synaptic organization regarding stimulus features and spatial scales.

Multiple synaptic connections into a single cortical pyramidal cell or interneuron in the anterior cingulate cortex of adult mice

The ACC is an important brain area for the processing of pain-related information. Studies of synaptic connections within the ACC provide an understanding of basic cellular and molecular mechanisms for brain functions such as pain, emotion and related cognitive functions. Previous study of ACC synaptic transmission mainly focused on presumably thalamic inputs into pyramidal cells. In the present study, we developed a new mapping technique by combining single neuron whole-cell patch-clamp recording with 64 multi-channel field potential recording (MED64) to examine the properties of excitatory inputs into a single neuron in the ACC. We found that a single patched pyramidal neuron or interneuron simultaneously received heterogeneous excitatory synaptic innervations from different subregions (ventral, dorsal, deep, and superficial layers) in the ACC. Conduction velocity is faster as stimulation distance increases in pyramidal neurons. Fast-spiking interneurons (FS-IN) show slower inactivation when compared to pyramidal neurons and regular-spiking interneurons (RS-IN) while pyramidal neurons displayed the most rapid activation. Bath application of non-competitive AMPA receptor antagonist GYKI 53655 followed by CNQX revealed that both FS-INs and RS-INs have AMPA and KA mediated components. Our studies provide a new strategy and technique for studying the network of synaptic connections.

The gradient clusteron: A model neuron that learns to solve classification tasks via dendritic nonlinearities, structural plasticity, and gradient descent

Synaptic clustering on neuronal dendrites has been hypothesized to play an important role in implementing pattern recognition. Neighboring synapses on a dendritic branch can interact in a synergistic, cooperative manner via nonlinear voltage-dependent mechanisms, such as NMDA receptors. Inspired by the NMDA receptor, the single-branch clusteron learning algorithm takes advantage of location-dependent multiplicative nonlinearities to solve classification tasks by randomly shuffling the locations of "under-performing" synapses on a model dendrite during learning ("structural plasticity"), eventually resulting in synapses with correlated activity being placed next to each other on the dendrite. We propose an alternative model, the gradient clusteron, or G-clusteron, which uses an analytically-derived gradient descent rule where synapses are "attracted to" or "repelled from" each other in an input- and location-dependent manner. We demonstrate the classification ability of this algorithm by testing it on the MNIST handwritten digit dataset and show that, when using a softmax activation function, the accuracy of the G-clusteron on the all-versus-all MNIST task (~85%) approaches that of logistic regression (~93%). In addition to the location update rule, we also derive a learning rule for the synaptic weights of the G-clusteron ("functional plasticity") and show that a G-clusteron that utilizes the weight update rule can achieve ~89% accuracy on the MNIST task. We also show that a G-clusteron with both the weight and location update rules can learn to solve the XOR problem from arbitrary initial conditions.

Synaptic plasticity as Bayesian inference

Learning, especially rapid learning, is critical for survival. However, learning is hard; a large number of synaptic weights must be set based on noisy, often ambiguous, sensory information. In such a high-noise regime, keeping track of probability distributions over weights is the optimal strategy. Here we hypothesize that synapses take that strategy; in essence, when they estimate weights, they include error bars. They then use that uncertainty to adjust their learning rates, with more uncertain weights having higher learning rates. We also make a second, independent, hypothesis: synapses communicate their uncertainty by linking it to variability in postsynaptic potential size, with more uncertainty leading to more variability. These two hypotheses cast synaptic plasticity as a problem of Bayesian inference, and thus provide a normative view of learning. They generalize known learning rules, offer an explanation for the large variability in the size of postsynaptic potentials and make falsifiable experimental predictions.

Science-Driven Societal Transformation, Part III: Design

Climate change, biodiversity loss, and other major social and environmental problems pose severe risks. Progress has been inadequate and scientists, global policy experts, and the general public increasingly conclude that transformational change is needed across all sectors of society in order to improve and maintain social and ecological wellbeing. At least two paths to transformation are conceivable: (1) reform of and innovation within existing societal systems (e.g., economic, legal, and governance systems); and (2) the de novo development of and migration to new and improved societal systems. This paper is the final in a three-part series of concept papers that together outline a novel science-driven research and development program aimed at the second path. It summarizes literature to build a narrative on the topic of de novo design of societal systems. The purpose is to raise issues, suggest design possibilities, and highlight directions and questions that could be explored in the context of this or any R&D program aimed at new system design. This paper does not present original research, but rather provides a synthesis of selected ideas from the literature. Following other papers in the series, a society is viewed as a superorganism and its societal systems as a cognitive architecture. Accordingly, a central goal of design is to improve the collective cognitive capacity of a society, rendering it more capable of achieving and sustainably maintaining vitality. Topics of attention, communication, self-identity, power, and influence are discussed in relation to societal cognition and system design. A prototypical societal system is described, and some design considerations are highlighted.

Rapid Bayesian learning in the mammalian olfactory system

Many experimental studies suggest that animals can rapidly learn to identify odors and predict the rewards associated with them. However, the underlying plasticity mechanism remains elusive. In particular, it is not clear how olfactory circuits achieve rapid, data efficient learning with local synaptic plasticity. Here, we formulate olfactory learning as a Bayesian optimization process, then map the learning rules into a computational model of the mammalian olfactory circuit. The model is capable of odor identification from a small number of observations, while reproducing cellular plasticity commonly observed during development. We extend the framework to reward-based learning, and show that the circuit is able to rapidly learn odor-reward association with a plausible neural architecture. These results deepen our theoretical understanding of unsupervised learning in the mammalian brain.

How can rodents make sense of the olfactory environment without supervision? Here, the authors formulate olfactory learning as an integrated Bayesian inference problem, then derive a set of synaptic plasticity rules and neural dynamics that enables near-optimal learning of odor identification.

Measurements of neuronal morphological variation across the rat neocortex

Neuron morphology is highly variable across the mammalian brain. It is thought that these attributes of neuronal cell shape, such as soma surface area and branching frequency, are determined by biological function and information processing. In this study, a large data set of neurons across the rat neocortex were clustered by their anatomical characters for evidence of distinctiveness among neocortical regions and the somatosensory layers. This data set of neuronal morphologies was compiled from 31 different lab sources with a validation procedure so that data records are potentially comparable across research studies. With this large set of heterogeneous data and by clustering analysis, this study shows that neuronal morphological traits overlap among neocortical and somatosensory regions. In the context of past neuroanatomical studies, this result is not congruent with tissue level analysis and strongly suggests further sampling of neuronal data to lessen the effect of confounding factors, such as the influence of different methodologies from use of heterogeneous samples of neuronal data.

Somatodendritic consistency check for temporal feature segmentation

The brain identifies potentially salient features within continuous information streams to process hierarchical temporal events. This requires the compression of information streams, for which effective computational principles are yet to be explored. Backpropagating action potentials can induce synaptic plasticity in the dendrites of cortical pyramidal neurons. By analogy with this effect, we model a self-supervising process that increases the similarity between dendritic and somatic activities where the somatic activity is normalized by a running average. We further show that a family of networks composed of the two-compartment neurons performs a surprisingly wide variety of complex unsupervised learning tasks, including chunking of temporal sequences and the source separation of mixed correlated signals. Common methods applicable to these temporal feature analyses were previously unknown. Our results suggest the powerful ability of neural networks with dendrites to analyze temporal features. This simple neuron model may also be potentially useful in neural engineering applications.

The authors propose a learning rule for a neuron model with dendrite. In their model, somatodendritic interaction implements self-supervised learning applicable to a wide range of sequence learning tasks, including spike pattern detection, chunking temporal input and blind source separation.

Classes of dendritic information processing

Dendrites are much more than passive neuronal components. Mounting experimental evidence and decades of computational work have decisively shown that dendrites leverage a host of nonlinear biophysical phenomena and actively participate in sophisticated computations, at the level of the single neuron and at the level of the network. However, a coherent view of their processing power is still lacking and dendrites are largely neglected in neural network models. Here, we describe four classes of dendritic information processing and delineate their implications at the algorithmic level. We propose that beyond the well-known spatiotemporal filtering of their inputs, dendrites are capable of selecting, routing and multiplexing information. By separating dendritic processing from axonal outputs, neuron networks gain a degree of freedom with implications for perception and learning.