Classes of dendritic information processing

Leveraging dendritic properties to advance machine learning and neuro-inspired computing

The brain is a remarkably capable and efficient system. It can process and store huge amounts of noisy and unstructured information, using minimal energy. In contrast, current artificial intelligence (AI) systems require vast resources for training while still struggling to compete in tasks that are trivial for biological agents. Thus, brain-inspired engineering has emerged as a promising new avenue for designing sustainable, next-generation AI systems. Here, we describe how dendritic mechanisms of biological neurons have inspired innovative solutions for significant AI problems, including credit assignment in multi-layer networks, catastrophic forgetting, and high-power consumption. These findings provide exciting alternatives to existing architectures, showing how dendritic research can pave the way for building more powerful and energy efficient artificial learning systems.

Neurobiological Causal Models of Language Processing

The language faculty is physically realized in the neurobiological infrastructure of the human brain. Despite significant efforts, an integrated understanding of this system remains a formidable challenge. What is missing from most theoretical accounts is a specification of the neural mechanisms that implement language function. Computational models that have been put forward generally lack an explicit neurobiological foundation. We propose a neurobiologically informed causal modeling approach which offers a framework for how to bridge this gap. A neurobiological causal model is a mechanistic description of language processing that is grounded in, and constrained by, the characteristics of the neurobiological substrate. It intends to model the generators of language behavior at the level of implementational causality. We describe key features and neurobiological component parts from which causal models can be built and provide guidelines on how to implement them in model simulations. Then we outline how this approach can shed new light on the core computational machinery for language, the long-term storage of words in the mental lexicon and combinatorial processing in sentence comprehension. In contrast to cognitive theories of behavior, causal models are formulated in the "machine language" of neurobiology which is universal to human cognition. We argue that neurobiological causal modeling should be pursued in addition to existing approaches. Eventually, this approach will allow us to develop an explicit computational neurobiology of language.

Silences, spikes and bursts: Three-part knot of the neural code

When a neuron breaks silence, it can emit action potentials in a number of patterns. Some responses are so sudden and intense that electrophysiologists felt the need to single them out, labelling action potentials emitted at a particularly high frequency with a metonym - bursts. Is there more to bursts than a figure of speech? After all, sudden bouts of high-frequency firing are expected to occur whenever inputs surge. The burst coding hypothesis advances that the neural code has three syllables: silences, spikes and bursts. We review evidence supporting this ternary code in terms of devoted mechanisms for burst generation, synaptic transmission and synaptic plasticity. We also review the learning and attention theories for which such a triad is beneficial.

Dendrites and efficiency: Optimizing performance and resource utilization

The brain is a highly efficient system that has evolved to optimize performance under limited resources. In this review, we highlight recent theoretical and experimental studies that support the view that dendrites make information processing and storage in the brain more efficient. This is achieved through the dynamic modulation of integration versus segregation of inputs and activity within a neuron. We argue that under conditions of limited energy and space, dendrites help biological networks to implement complex functions such as processing natural stimuli on behavioral timescales, performing the inference process on those stimuli in a context-specific manner, and storing the information in overlapping populations of neurons. A global picture starts to emerge, in which dendrites help the brain achieve efficiency through a combination of optimization strategies that balance the tradeoff between performance and resource utilization.

Parallel functional architectures within a single dendritic tree

The input-output transformation of individual neurons is a key building block of neural circuit dynamics. While previous models of this transformation vary widely in their complexity, they all describe the underlying functional architecture as unitary, such that each synaptic input makes a single contribution to the neuronal response. Here, we show that the input-output transformation of CA1 pyramidal cells is instead best captured by two distinct functional architectures operating in parallel. We used statistically principled methods to fit flexible, yet interpretable, models of the transformation of input spikes into the somatic "output" voltage and to automatically select among alternative functional architectures. With dendritic Na+ channels blocked, responses are accurately captured by a single static and global nonlinearity. In contrast, dendritic Na+-dependent integration requires a functional architecture with multiple dynamic nonlinearities and clustered connectivity. These two architectures incorporate distinct morphological and biophysical properties of the neuron and its synaptic organization.

Heuristic Tree-Partition-Based Parallel Method for Biophysically Detailed Neuron Simulation

Biophysically detailed neuron simulation is a powerful tool to explore the mechanisms behind biological experiments and bridge the gap between various scales in neuroscience research. However, the extremely high computational complexity of detailed neuron simulation restricts the modeling and exploration of detailed network models. The bottleneck is solving the system of linear equations. To accelerate detailed simulation, we propose a heuristic tree-partition-based parallel method (HTP) to parallelize the computation of the Hines algorithm, the kernel for solving linear equations, and leverage the strong parallel capability of the graphic processing unit (GPU) to achieve further speedup. We formulate the problem of how to get a fine parallel process as a tree-partition problem. Next, we present a heuristic partition algorithm to obtain an effective partition to efficiently parallelize the equation-solving process in detailed simulation. With further optimization on GPU, our HTP method achieves 2.2 to 8.5 folds speedup compared to the state-of-the-art GPU method and 36 to 660 folds speedup compared to the typical Hines algorithm.

Temporal derivative computation in the dorsal raphe network revealed by an experimentally driven augmented integrate-and-fire modeling framework

By means of an expansive innervation, the serotonin (5-HT) neurons of the dorsal raphe nucleus (DRN) are positioned to enact coordinated modulation of circuits distributed across the entire brain in order to adaptively regulate behavior. Yet the network computations that emerge from the excitability and connectivity features of the DRN are still poorly understood. To gain insight into these computations, we began by carrying out a detailed electrophysiological characterization of genetically identified mouse 5-HT and somatostatin (SOM) neurons. We next developed a single-neuron modeling framework that combines the realism of Hodgkin-Huxley models with the simplicity and predictive power of generalized integrate-and-fire models. We found that feedforward inhibition of 5-HT neurons by heterogeneous SOM neurons implemented divisive inhibition, while endocannabinoid-mediated modulation of excitatory drive to the DRN increased the gain of 5-HT output. Our most striking finding was that the output of the DRN encodes a mixture of the intensity and temporal derivative of its input, and that the temporal derivative component dominates this mixture precisely when the input is increasing rapidly. This network computation primarily emerged from prominent adaptation mechanisms found in 5-HT neurons, including a previously undescribed dynamic threshold. By applying a bottom-up neural network modeling approach, our results suggest that the DRN is particularly apt to encode input changes over short timescales, reflecting one of the salient emerging computations that dominate its output to regulate behavior.

Emerging memristive neurons for neuromorphic computing and sensing

Inspired by the principles of the biological nervous system, neuromorphic engineering has brought a promising alternative approach to intelligence computing with high energy efficiency and low consumption. As pivotal components of neuromorphic system, artificial spiking neurons are powerful information processing units and can achieve highly complex nonlinear computations. By leveraging the switching dynamic characteristics of memristive device, memristive neurons show rich spiking behaviors with simple circuit. This report reviews the memristive neurons and their applications in neuromorphic sensing and computing systems. The switching mechanisms that endow memristive devices with rich dynamics and nonlinearity are highlighted, and subsequently various nonlinear spiking neuron behaviors emulated in these memristive devices are reviewed. Then, recent development is introduced on neuromorphic system with memristive neurons for sensing and computing. Finally, we discuss challenges and outlooks of the memristive neurons toward high-performance neuromorphic hardware systems and provide an insightful perspective for the development of interactive neuromorphic electronic systems.

Morphological Features of Human Dendritic Spines

Dendritic spine features in human neurons follow the up-to-date knowledge presented in the previous chapters of this book. Human dendrites are notable for their heterogeneity in branching patterns and spatial distribution. These data relate to circuits and specialized functions. Spines enhance neuronal connectivity, modulate and integrate synaptic inputs, and provide additional plastic functions to microcircuits and large-scale networks. Spines present a continuum of shapes and sizes, whose number and distribution along the dendritic length are diverse in neurons and different areas. Indeed, human neurons vary from aspiny or "relatively aspiny" cells to neurons covered with a high density of intermingled pleomorphic spines on very long dendrites. In this chapter, we discuss the phylogenetic and ontogenetic development of human spines and describe the heterogeneous features of human spiny neurons along the spinal cord, brainstem, cerebellum, thalamus, basal ganglia, amygdala, hippocampal regions, and neocortical areas. Three-dimensional reconstructions of Golgi-impregnated dendritic spines and data from fluorescence microscopy are reviewed with ultrastructural findings to address the complex possibilities for synaptic processing and integration in humans. Pathological changes are also presented, for example, in Alzheimer's disease and schizophrenia. Basic morphological data can be linked to current techniques, and perspectives in this research field include the characterization of spines in human neurons with specific transcriptome features, molecular classification of cellular diversity, and electrophysiological identification of coexisting subpopulations of cells. These data would enlighten how cellular attributes determine neuron type-specific connectivity and brain wiring for our diverse aptitudes and behavior.

A novel non-linear neuron model based on multiplicative aggregation in quaternionic domain

The learning algorithm for a three-layered neural structure with novel non-linear quaternionic-valued multiplicative (QVM) neurons is proposed in this paper. The computing capability of non-linear aggregation in the cell body of biological neurons inspired the development of a non-linear neuron model. However, unlike linear neuron models, most non-linear neuron models are built on higher order aggregation, which is more mathematically complex and difficult to train. As a result, building non-linear neuron models with a simple structure is a difficult and time-consuming endeavor in the neurocomputing field. The concept of a QVM neuron model was influenced by the non-linear neuron model, which has a simple structure and the great computational ability. The suggested neuron’s linearity is determined by the weight and bias associated with each quaternionic-valued input. Non-commutative multiplication of all linearly connected quaternionic input-weight terms accommodates the non-linearity. To train three-layered networks with QVM neurons, the standard quaternionic-gradient-based backpropagation (QBP) algorithm is utilized. The computational and generalization capabilities of the QVM neuron are assessed through training and testing in the quaternionic domain utilizing benchmark problems, such as 3D and 4D chaotic time-series predictions, 3D geometrical transformations, and 3D face recognition. The training and testing outcomes are compared to conventional and root-power mean (RPM) neurons in quaternionic domain using training–testing MSEs, network topology (parameters), variance, and AIC as statistical measures. According to these findings, networks with QVM neurons have greater computational and generalization capabilities than networks with conventional and RPM neurons in quaternionic domain.

Inferring monosynaptic connections from paired dendritic spine Ca2+imaging and large-scale recording of extracellular spiking

Objective: Techniques to identify monosynaptic connections between neurons have been vital for neuroscience research, facilitating important advancements concerning network topology, synaptic plasticity, and synaptic integration, among others.Approach: Here, we introduce a novel approach to identify and monitor monosynaptic connections using high-resolution dendritic spine Ca2+imaging combined with simultaneous large-scale recording of extracellular electrical activity by means of high-density microelectrode arrays.Main results: We introduce an easily adoptable analysis pipeline that associates the imaged spine with its presynaptic unit and test it onin vitrorecordings. The method is further validated and optimized by simulating synaptically-evoked spine Ca2+transients based on measured spike trains in order to obtain simulated ground-truth connections.Significance: The proposed approach offers unique advantages as (a) it can be used to identify monosynaptic connections with an accurate localization of the synapse within the dendritic tree, (b) it provides precise information of presynaptic spiking, and (c) postsynaptic spine Ca2+signals and, finally, (d) the non-invasive nature of the proposed method allows for long-term measurements. The analysis toolkit together with the rich data sets that were acquired are made publicly available for further exploration by the research community.

Dynamic compartmental computations in tuft dendrites of layer 5 neurons during motor behavior

Tuft dendrites of layer 5 pyramidal neurons form specialized compartments important for motor learning and performance, yet their computational capabilities remain unclear. Structural-functional mapping of the tuft tree from the motor cortex during motor tasks revealed two morphologically distinct populations of layer 5 pyramidal tract neurons (PTNs) that exhibit specific tuft computational properties. Early bifurcating and large nexus PTNs showed marked tuft functional compartmentalization, representing different motor variable combinations within and between their two tuft hemi-trees. By contrast, late bifurcating and smaller nexus PTNs showed synchronous tuft activation. Dendritic structure and dynamic recruitment of the N-methyl-d-aspartate (NMDA)-spiking mechanism explained the differential compartmentalization patterns. Our findings support a morphologically dependent framework for motor computations, in which independent amplification units can be combinatorically recruited to represent different motor sequences within the same tree.

Periodicity Pitch Perception Part III: Sensibility and Pachinko Volatility

Neuromorphic computer models are used to explain sensory perceptions. Auditory models generate cochleagrams, which resemble the spike distributions in the auditory nerve. Neuron ensembles along the auditory pathway transform sensory inputs step by step and at the end pitch is represented in auditory categorical spaces. In two previous articles in the series on periodicity pitch perception an extended auditory model had been successfully used for explaining periodicity pitch proved for various musical instrument generated tones and sung vowels. In this third part in the series the focus is on octopus cells as they are central sensitivity elements in auditory cognition processes. A powerful numerical model had been devised, in which auditory nerve fibers (ANFs) spike events are the inputs, triggering the impulse responses of the octopus cells. Efficient algorithms are developed and demonstrated to explain the behavior of octopus cells with a focus on a simple event-based hardware implementation of a layer of octopus neurons. The main finding is, that an octopus' cell model in a local receptive field fine-tunes to a specific trajectory by a spike-timing-dependent plasticity (STDP) learning rule with synaptic pre-activation and the dendritic back-propagating signal as post condition. Successful learning explains away the teacher and there is thus no need for a temporally precise control of plasticity that distinguishes between learning and retrieval phases. Pitch learning is cascaded: At first octopus cells respond individually by self-adjustment to specific trajectories in their local receptive fields, then unions of octopus cells are collectively learned for pitch discrimination. Pitch estimation by inter-spike intervals is shown exemplary using two input scenarios: a simple sinus tone and a sung vowel. The model evaluation indicates an improvement in pitch estimation on a fixed time-scale.

Parallel processing in active dendrites during periods of intense spiking activity

A neuron's ability to perform parallel computations throughout its dendritic arbor substantially improves its computational capacity. However, during natural patterns of activity, the degree to which computations remain compartmentalized, especially in neurons with active dendritic trees, is not clear. Here, we examine how the direction of moving objects is computed across the bistratified dendritic arbors of ON-OFF direction-selective ganglion cells (DSGCs) in the mouse retina. We find that although local synaptic signals propagate efficiently throughout their dendritic trees, direction-selective computations in one part of the dendritic arbor have little effect on those being made elsewhere. Independent dendritic processing allows DSGCs to compute the direction of moving objects multiple times as they traverse their receptive fields, enabling them to rapidly detect changes in motion direction on a sub-receptive-field basis. These results demonstrate that the parallel processing capacity of neurons can be maintained even during periods of intense synaptic activity.

Dendritic Computing: Branching Deeper into Machine Learning

In this paper, we discuss the nonlinear computational power provided by dendrites in biological and artificial neurons. We start by briefly presenting biological evidence about the type of dendritic nonlinearities, respective plasticity rules and their effect on biological learning as assessed by computational models. Four major computational implications are identified as improved expressivity, more efficient use of resources, utilizing internal learning signals, and enabling continual learning. We then discuss examples of how dendritic computations have been used to solve real-world classification problems with performance reported on well known data sets used in machine learning. The works are categorized according to the three primary methods of plasticity used-structural plasticity, weight plasticity, or plasticity of synaptic delays. Finally, we show the recent trend of confluence between concepts of deep learning and dendritic computations and highlight some future research directions.

Active Dendrites and Local Field Potentials: Biophysical Mechanisms and Computational Explorations

Neurons and glial cells are endowed with membranes that express a rich repertoire of ion channels, transporters, and receptors. The constant flux of ions across the neuronal and glial membranes results in voltage fluctuations that can be recorded from the extracellular matrix. The high frequency components of this voltage signal contain information about the spiking activity, reflecting the output from the neurons surrounding the recording location. The low frequency components of the signal, referred to as the local field potential (LFP), have been traditionally thought to provide information about the synaptic inputs that impinge on the large dendritic trees of various neurons. In this review, we discuss recent computational and experimental studies pointing to a critical role of several active dendritic mechanisms that can influence the genesis and the location-dependent spectro-temporal dynamics of LFPs, spanning different brain regions. We strongly emphasize the need to account for the several fast and slow dendritic events and associated active mechanisms - including gradients in their expression profiles, inter- and intra-cellular spatio-temporal interactions spanning neurons and glia, heterogeneities and degeneracy across scales, neuromodulatory influences, and activitydependent plasticity - towards gaining important insights about the origins of LFP under different behavioral states in health and disease. We provide simple but essential guidelines on how to model LFPs taking into account these dendritic mechanisms, with detailed methodology on how to account for various heterogeneities and electrophysiological properties of neurons and synapses while studying LFPs.

Dendrite enlightenment

Neuronal dendrites acquire complex morphologies during development. These are not just the product of cell-intrinsic developmental programs; rather they are defined in close interaction with the cellular environment. Thus, to understand the molecular cascades that yield appropriate morphologies, it is essential to investigate them in vivo, in the actual complex tissue environment encountered by the differentiating neuron in the developing animal. Particularly, genetic approaches have pointed to factors controlling dendrite differentiation in vivo. These suggest that localized and transient molecular cascades might underlie the formation and stabilization of dendrite branches with neuron type-specific characteristics. Here, I highlight the need for studies of neuronal dendrite differentiation in the animal, the challenges provided by such an approach, and the promising pathways that have recently opened.

Activation function dependence of the storage capacity of treelike neural networks

The expressive power of artificial neural networks crucially depends on the nonlinearity of their activation functions. Though a wide variety of nonlinear activation functions have been proposed for use in artificial neural networks, a detailed understanding of their role in determining the expressive power of a network has not emerged. Here, we study how activation functions affect the storage capacity of treelike two-layer networks. We relate the boundedness or divergence of the capacity in the infinite-width limit to the smoothness of the activation function, elucidating the relationship between previously studied special cases. Our results show that nonlinearity can both increase capacity and decrease the robustness of classification, and provide simple estimates for the capacity of networks with several commonly used activation functions. Furthermore, they generate a hypothesis for the functional benefit of dendritic spikes in branched neurons.

Linear-nonlinear cascades capture synaptic dynamics

Short-term synaptic dynamics differ markedly across connections and strongly regulate how action potentials communicate information. To model the range of synaptic dynamics observed in experiments, we have developed a flexible mathematical framework based on a linear-nonlinear operation. This model can capture various experimentally observed features of synaptic dynamics and different types of heteroskedasticity. Despite its conceptual simplicity, we show that it is more adaptable than previous models. Combined with a standard maximum likelihood approach, synaptic dynamics can be accurately and efficiently characterized using naturalistic stimulation patterns. These results make explicit that synaptic processing bears algorithmic similarities with information processing in convolutional neural networks.

Topographic gradients of intrinsic dynamics across neocortex

The intrinsic dynamics of neuronal populations are shaped by both microscale attributes and macroscale connectome architecture. Here we comprehensively characterize the rich temporal patterns of neural activity throughout the human brain. Applying massive temporal feature extraction to regional haemodynamic activity, we systematically estimate over 6000 statistical properties of individual brain regions' time-series across the neocortex. We identify two robust spatial gradients of intrinsic dynamics, one spanning a ventromedial-dorsolateral axis and dominated by measures of signal autocorrelation, and the other spanning a unimodal-transmodal axis and dominated by measures of dynamic range. These gradients reflect spatial patterns of gene expression, intracortical myelin and cortical thickness, as well as structural and functional network embedding. Importantly, these gradients are correlated with patterns of meta-analytic functional activation, differentiating cognitive versus affective processing and sensory versus higher-order cognitive processing. Altogether, these findings demonstrate a link between microscale and macroscale architecture, intrinsic dynamics, and cognition.

Neuromorphic Engineering: From Biological to Spike-Based Hardware Nervous Systems

The human brain is a sophisticated, high-performance biocomputer that processes multiple complex tasks in parallel with high efficiency and remarkably low power consumption. Scientists have long been pursuing an artificial intelligence (AI) that can rival the human brain. Spiking neural networks based on neuromorphic computing platforms simulate the architecture and information processing of the intelligent brain, providing new insights for building AIs. The rapid development of materials engineering, device physics, chip integration, and neuroscience has led to exciting progress in neuromorphic computing with the goal of overcoming the von Neumann bottleneck. Herein, fundamental knowledge related to the structures and working principles of neurons and synapses of the biological nervous system is reviewed. An overview is then provided on the development of neuromorphic hardware systems, from artificial synapses and neurons to spike-based neuromorphic computing platforms. It is hoped that this review will shed new light on the evolution of brain-like computing.

Cortical synaptic architecture supports flexible sensory computations

Establishing the fundamental principles that underlie the integration of excitatory and inhibitory presynaptic input populations is crucial to understanding how individual cortical neurons transform signals from peripheral receptors. Here we review recent studies using novel tools to examine the functional properties of excitatory synaptic inputs and the tuning of excitation and inhibition onto individual neurons. New evidence challenges existing synaptic connectivity rules and suggests a more complex functional synaptic architecture that supports a broad range of operations, enabling single neurons to encode multiple sensory features and flexibly shape their computations in the face of diverse sensory input.

Dendritic integration in olfactory bulb granule cells upon simultaneous multispine activation: Low thresholds for nonlocal spiking activity

The inhibitory axonless olfactory bulb granule cells form reciprocal dendrodendritic synapses with mitral and tufted cells via large spines, mediating recurrent and lateral inhibition. As a case in point for dendritic transmitter release, rat granule cell dendrites are highly excitable, featuring local Na+ spine spikes and global Ca2+- and Na+-spikes. To investigate the transition from local to global signaling, we performed holographic, simultaneous 2-photon uncaging of glutamate at up to 12 granule cell spines, along with whole-cell recording and dendritic 2-photon Ca2+ imaging in acute juvenile rat brain slices. Coactivation of less than 10 reciprocal spines was sufficient to generate diverse regenerative signals that included regional dendritic Ca2+-spikes and dendritic Na+-spikes (D-spikes). Global Na+-spikes could be triggered in one third of granule cells. Individual spines and dendritic segments sensed the respective signal transitions as increments in Ca2+ entry. Dendritic integration as monitored by the somatic membrane potential was mostly linear until a threshold number of spines was activated, at which often D-spikes along with supralinear summation set in. As to the mechanisms supporting active integration, NMDA receptors (NMDARs) strongly contributed to all aspects of supralinearity, followed by dendritic voltage-gated Na+- and Ca2+-channels, whereas local Na+ spine spikes, as well as morphological variables, barely mattered. Because of the low numbers of coactive spines required to trigger dendritic Ca2+ signals and thus possibly lateral release of GABA onto mitral and tufted cells, we predict that thresholds for granule cell-mediated bulbar lateral inhibition are low. Moreover, D-spikes could provide a plausible substrate for granule cell-mediated gamma oscillations.

Network control through coordinated inhibition

Coordinated excitatory and inhibitory activity is required for proper brain functioning. Recent computational and experimental studies have demonstrated that activity patterns in recurrent cortical networks are dominated by inhibition. Whereas previous studies have suggested that inhibitory plasticity is important for homeostatic control, this new framework puts inhibition in the driver's seat. Complex neuronal networks in the brain comprise many configurations in parallel, controlled by external and internal 'switches'. Context-dependent modulation and plasticity of inhibitory connections play a key role in memory and learning. It is therefore important to realize that synaptic plasticity is often multisynaptic and that a proper balance between excitation and inhibition is not fixed, but depends on context and activity level.

δ-Catenin engages the autophagy pathway to sculpt the developing dendritic arbor

The development of the dendritic arbor in pyramidal neurons is critical for neural circuit function. Here, we uncovered a pathway in which δ-catenin, a component of the cadherin-catenin cell adhesion complex, promotes coordination of growth among individual dendrites and engages the autophagy mechanism to sculpt the developing dendritic arbor. Using a rat primary neuron model, time-lapse imaging, immunohistochemistry, and confocal microscopy, we found that apical and basolateral dendrites are coordinately sculpted during development. Loss or knockdown of δ-catenin uncoupled this coordination, leading to retraction of the apical dendrite without altering basolateral dendrite dynamics. Autophagy is a key cellular pathway that allows degradation of cellular components. We observed that the impairment of the dendritic arbor resulting from δ-catenin knockdown could be reversed by knockdown of autophagy-related 7 (ATG7), a component of the autophagy machinery. We propose that δ-catenin regulates the dendritic arbor by coordinating the dynamics of individual dendrites and that the autophagy mechanism may be leveraged by δ-catenin and other effectors to sculpt the developing dendritic arbor. Our findings have implications for the management of neurological disorders, such as autism and intellectual disability, that are characterized by dendritic aberrations.

A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.

Linking Structure and Function in Macroscale Brain Networks

Structure-function relationships are a fundamental principle of many naturally occurring systems. However, network neuroscience research suggests that there is an imperfect link between structural connectivity and functional connectivity in the brain. Here, we synthesize the current state of knowledge linking structure and function in macroscale brain networks and discuss the different types of models used to assess this relationship. We argue that current models do not include the requisite biological detail to completely predict function. Structural network reconstructions enriched with local molecular and cellular metadata, in concert with more nuanced representations of functions and properties, hold great potential for a truly multiscale understanding of the structure-function relationship.