The limits of brain determinacy

The adaptive stochasticity hypothesis: Modeling equifinality, multifinality, and adaptation to adversity

Neural phenotypes are the result of probabilistic developmental processes. This means that stochasticity is an intrinsic aspect of the brain as it self-organizes over a protracted period. In other words, while both genomic and environmental factors shape the developing nervous system, another significant-though often neglected-contributor is the randomness introduced by probability distributions. Using generative modeling of brain networks, we provide a framework for probing the contribution of stochasticity to neurodevelopmental diversity. To mimic the prenatal scaffold of brain structure set by activity-independent mechanisms, we start our simulations from the medio-posterior neonatal rich club (Developing Human Connectome Project, n = 630). From this initial starting point, models implementing Hebbian-like wiring processes generate variable yet consistently plausible brain network topologies. By analyzing repeated runs of the generative process (>107 simulations), we identify critical determinants and effects of stochasticity. Namely, we find that stochastic variation has a greater impact on brain organization when networks develop under weaker constraints. This heightened stochasticity makes brain networks more robust to random and targeted attacks, but more often results in non-normative phenotypic outcomes. To test our framework empirically, we evaluated whether stochasticity varies according to the experience of early-life deprivation using a cohort of neurodiverse children (Centre for Attention, Learning and Memory; n = 357). We show that low-socioeconomic status predicts more stochastic brain wiring. We conclude that stochasticity may be an unappreciated contributor to relevant developmental outcomes and make specific predictions for future research.

Brain Development and Stochastic Processes During Prenatal and Early Life: You Can't Lose It if You've Never Had It; But It's Better to Have It and Lose It, Than Never to Have Had It at All

Brain development, although largely driven by genetic processes, also is influenced by environmental factors. However, there has been little discussion in the psychiatric literature on the role of stochastic, or chance, events that take place during neurodevelopment. Studies suggest that the brain capitalizes on and regulates the extent of stochastic processes during development. Furthermore, because neurodevelopment is influenced by environmental factors, there is emerging evidence that fostering those positive environmental factors during prenatal and early life could optimize neurodevelopment and provide greater resilience, including those potentially resulting from stochastic processes. Evidence for the role of environmental factors in optimizing early brain development is supported by work in large population-based studies of child development, randomized control trials in high-risk populations, and early-life adoption studies. The public health message is that creating an environment that fosters optimal brain development during prenatal and early life could prevent psychopathology and provide the developing brain the best chance against negative stochastic processes and potential stressors that are inevitable later in life.

Efficient Reward-Based Structural Plasticity on a SpiNNaker 2 Prototype

Advances in neuroscience uncover the mechanisms employed by the brain to efficiently solve complex learning tasks with very limited resources. However, the efficiency is often lost when one tries to port these findings to a silicon substrate, since brain-inspired algorithms often make extensive use of complex functions, such as random number generators, that are expensive to compute on standard general purpose hardware. The prototype chip of the second generation SpiNNaker system is designed to overcome this problem. Low-power advanced RISC machine (ARM) processors equipped with a random number generator and an exponential function accelerator enable the efficient execution of brain-inspired algorithms. We implement the recently introduced reward-based synaptic sampling model that employs structural plasticity to learn a function or task. The numerical simulation of the model requires to update the synapse variables in each time step including an explorative random term. To the best of our knowledge, this is the most complex synapse model implemented so far on the SpiNNaker system. By making efficient use of the hardware accelerators and numerical optimizations, the computation time of one plasticity update is reduced by a factor of 2. This, combined with fitting the model into to the local static random access memory (SRAM), leads to 62% energy reduction compared to the case without accelerators and the use of external dynamic random access memory (DRAM). The model implementation is integrated into the SpiNNaker software framework allowing for scalability onto larger systems. The hardware-software system presented in this paper paves the way for power-efficient mobile and biomedical applications with biologically plausible brain-inspired algorithms.

Beyond Molecular Codes: Simple Rules to Wire Complex Brains

Molecular codes, like postal zip codes, are generally considered a robust way to ensure the specificity of neuronal target selection. However, a code capable of unambiguously generating complex neural circuits is difficult to conceive. Here, we re-examine the notion of molecular codes in the light of developmental algorithms. We explore how molecules and mechanisms that have been considered part of a code may alternatively implement simple pattern formation rules sufficient to ensure wiring specificity in neural circuits. This analysis delineates a pattern-based framework for circuit construction that may contribute to our understanding of brain wiring.

Stochastic developmental variation, an epigenetic source of phenotypic diversity with far-reaching biological consequences

This article reviews the production of different phenotypes from the same genotype in the same environment by stochastic cellular events, nonlinear mechanisms during patterning and morphogenesis, and probabilistic self-reinforcing circuitries in the adult life. These aspects of phenotypic variation are summarized under the term 'stochastic developmental variation' (SDV) in the following. In the past, SDV has been viewed primarily as a nuisance, impairing laboratory experiments, pharmaceutical testing, and true-to-type breeding. This article also emphasizes the positive biological effects of SDV and discusses implications for genotype-to-phenotype mapping, biological individuation, ecology, evolution, and applied biology. There is strong evidence from experiments with genetically identical organisms performed in narrowly standardized laboratory set-ups that SDV is a source of phenotypic variation in its own right aside from genetic variation and environmental variation. It is obviously mediated by molecular and higher-order epigenetic mechanisms. Comparison of SDV in animals, plants, fungi, protists, bacteria, archaeans, and viruses suggests that it is a ubiquitous and phylogenetically old phenomenon. In animals, it is usually smallest for morphometric traits and highest for life history traits and behaviour. SDV is thought to contribute to phenotypic diversity in all populations but is particularly relevant for asexually reproducing and genetically impoverished populations, where it generates individuality despite genetic uniformity. In each generation, SDV produces a range of phenotypes around a well-adapted target phenotype, which is interpreted as a bet-hedging strategy to cope with the unpredictability of dynamic environments. At least some manifestations of SDV are heritable, adaptable, selectable, and evolvable, and therefore, SDV may be seen as a hitherto overlooked evolution factor. SDV is also relevant for husbandry, agriculture, and medicine because most pathogens are asexuals that exploit this third source of phenotypic variation to modify infectivity and resistance to antibiotics. Since SDV affects all types of organisms and almost all aspects of life, it urgently requires more intense research and a better integration into biological thinking.

Neuroscience, quantum indeterminism and the Cartesian soul

Quantum indeterminism is frequently invoked as a solution to the problem of how a disembodied soul might interact with the brain (as Descartes proposed), and is sometimes invoked in theories of libertarian free will even when they do not involve dualistic assumptions. Taking as example the Eccles-Beck model of interaction between self (or soul) and brain at the level of synaptic exocytosis, I here evaluate the plausibility of these approaches. I conclude that Heisenbergian uncertainty is too small to affect synaptic function, and that amplification by chaos or by other means does not provide a solution to this problem. Furthermore, even if Heisenbergian effects did modify brain functioning, the changes would be swamped by those due to thermal noise. Cells and neural circuits have powerful noise-resistance mechanisms, that are adequate protection against thermal noise and must therefore be more than sufficient to buffer against Heisenbergian effects. Other forms of quantum indeterminism must be considered, because these can be much greater than Heisenbergian uncertainty, but these have not so far been shown to play a role in the brain.

Stochastic computations in cortical microcircuit models

Experimental data from neuroscience suggest that a substantial amount of knowledge is stored in the brain in the form of probability distributions over network states and trajectories of network states. We provide a theoretical foundation for this hypothesis by showing that even very detailed models for cortical microcircuits, with data-based diverse nonlinear neurons and synapses, have a stationary distribution of network states and trajectories of network states to which they converge exponentially fast from any initial state. We demonstrate that this convergence holds in spite of the non-reversibility of the stochastic dynamics of cortical microcircuits. We further show that, in the presence of background network oscillations, separate stationary distributions emerge for different phases of the oscillation, in accordance with experimentally reported phase-specific codes. We complement these theoretical results by computer simulations that investigate resulting computation times for typical probabilistic inference tasks on these internally stored distributions, such as marginalization or marginal maximum-a-posteriori estimation. Furthermore, we show that the inherent stochastic dynamics of generic cortical microcircuits enables them to quickly generate approximate solutions to difficult constraint satisfaction problems, where stored knowledge and current inputs jointly constrain possible solutions. This provides a powerful new computing paradigm for networks of spiking neurons, that also throws new light on how networks of neurons in the brain could carry out complex computational tasks such as prediction, imagination, memory recall and problem solving.

Patterned Brain Stimulation, What a Framework with Rhythmic and Noisy Components Might Tell Us about Recovery Maximization

Brain stimulation is having remarkable impact on clinical neurology. Brain stimulation can modulate neuronal activity in functionally segregated circumscribed regions of the human brain. Polarity, frequency, and noise specific stimulation can induce specific manipulations on neural activity. In contrast to neocortical stimulation, deep-brain stimulation has become a tool that can dramatically improve the impact clinicians can possibly have on movement disorders. In contrast, neocortical brain stimulation is proving to be remarkably susceptible to intrinsic brain-states. Although evidence is accumulating that brain stimulation can facilitate recovery processes in patients with cerebral stroke, the high variability of results impedes successful clinical implementation. Interestingly, recent data in healthy subjects suggests that brain-state dependent patterned stimulation might help resolve some of the intrinsic variability found in previous studies. In parallel, other studies suggest that noisy “stochastic resonance” (SR)-like processes are a non-negligible component in non-invasive brain stimulation studies. The hypothesis developed in this manuscript is that stimulation patterning with noisy and oscillatory components will help patients recover from stroke related deficits more reliably. To address this hypothesis we focus on two factors common to both neural computation (intrinsic variables) as well as brain stimulation (extrinsic variables): noise and oscillation. We review diverse theoretical and experimental evidence that demonstrates that subject-function specific brain-states are associated with specific oscillatory activity patterns. These states are transient and can be maintained by noisy processes. The resulting control procedures can resemble homeostatic or SR processes. In this context we try to extend awareness for inter-individual differences and the use of individualized stimulation in the recovery maximization of stroke patients.