Self-organisation of small-world networks by adaptive rewiring in response to graph diffusion

Hierarchical network structure as the source of hierarchical dynamics (power-law frequency spectra) in living and non-living systems: How state-trait continua (body plans, personalities) emerge from first principles in biophysics

Living systems are hierarchical control systems that display a small world network structure. In such structures, many smaller clusters are nested within fewer larger ones, producing a fractal-like structure with a 'power-law' cluster size distribution (a mereology). Just like their structure, the dynamics of living systems shows fractal-like qualities: the timeseries of inner message passing and overt behavior contain high frequencies or 'states' (treble) that are nested within lower frequencies or 'traits' (bass), producing a power-law frequency spectrum that is known as a 'state-trait continuum' in the behavioral sciences. Here, we argue that the power-law dynamics of living systems results from their power-law network structure: organisms 'vertically encode' the deep spatiotemporal structure of their (anticipated) environments, to the effect that many small clusters near the base of the hierarchy produce high frequency signal changes and fewer larger clusters at its top produce ultra-low frequencies. Such ultra-low frequencies exert a tonic regulatory pressure that produces morphological as well as behavioral traits (i.e., body plans and personalities). Nested-modular structure causes higher frequencies to be embedded within lower frequencies, producing a power-law state-trait continuum. At the heart of such dynamics lies the need for efficient energy dissipation through networks of coupled oscillators, which also governs the dynamics of non-living systems (e.q., earthquakes, stock market fluctuations). Since hierarchical structure produces hierarchical dynamics, the development and collapse of hierarchical structure (e.g., during maturation and disease) should leave specific traces in system dynamics (shifts in lower frequencies, i.e. morphological and behavioral traits) that may serve as early warning signs to system failure. The applications of this idea range from (bio)physics and phylogenesis to ontogenesis and clinical medicine.

Functional and spatial rewiring principles jointly regulate context-sensitive computation

Adaptive rewiring provides a basic principle of self-organizing connectivity in evolving neural network topology. By selectively adding connections to regions with intense signal flow and deleting underutilized connections, adaptive rewiring generates optimized brain-like, i.e. modular, small-world, and rich club connectivity structures. Besides topology, neural self-organization also follows spatial optimization principles, such as minimizing the neural wiring distance and topographic alignment of neural pathways. We simulated the interplay of these spatial principles and adaptive rewiring in evolving neural networks with weighted and directed connections. The neural traffic flow within the network is represented by the equivalent of diffusion dynamics for directed edges: consensus and advection. We observe a constructive synergy between adaptive and spatial rewiring, which contributes to network connectedness. In particular, wiring distance minimization facilitates adaptive rewiring in creating convergent-divergent units. These units support the flow of neural information and enable context-sensitive information processing in the sensory cortex and elsewhere. Convergent-divergent units consist of convergent hub nodes, which collect inputs from pools of nodes and project these signals via a densely interconnected set of intermediate nodes onto divergent hub nodes, which broadcast their output back to the network. Convergent-divergent units vary in the degree to which their intermediate nodes are isolated from the rest of the network. This degree, and hence the context-sensitivity of the network's processing style, is parametrically determined in the evolving network model by the relative prominence of spatial versus adaptive rewiring.

Network dynamics scale with levels of awareness

Small world topologies are thought to provide a valuable insight into human brain organisation and consciousness. However, functional magnetic resonance imaging studies in consciousness have not yielded consistent results. Given the importance of dynamics for both consciousness and cognition, here we investigate how the diversity of small world dynamics (quantified by sample entropy; dSW-E¹) scales with decreasing levels of awareness (i.e., sedation and disorders of consciousness). Paying particular attention to result reproducibility, we show that dSW-E is a consistent predictor of levels of awareness even when controlling for the underlying functional connectivity dynamics. We find that dSW-E of subcortical and cortical areas are predictive, with the former showing higher and more robust effect sizes across analyses. We find that the network dynamics of intermodular communication in the cerebellum also have unique predictive power for levels of awareness. Consequently, we propose that the dynamic reorganisation of the functional information architecture, in particular of the subcortex, is a characteristic that emerges with awareness and has explanatory power beyond that of the complexity of dynamic functional connectivity.

Adaptive rewiring in nonuniform coupled oscillators

Structural plasticity of the brain can be represented in a highly simplified form as adaptive rewiring, the relay of connections according to the spontaneous dynamic synchronization in network activity. Adaptive rewiring, over time, leads from initial random networks to brain-like complex networks, that is, networks with modular small-world structures and a rich-club effect. Adaptive rewiring has only been studied, however, in networks of identical oscillators with uniform or random coupling strengths. To implement information-processing functions (e.g., stimulus selection or memory storage), it is necessary to consider symmetry-breaking perturbations of oscillator amplitudes and coupling strengths. We studied whether nonuniformities in amplitude or connection strength could operate in tandem with adaptive rewiring. Throughout network evolution, either amplitude or connection strength of a subset of oscillators was kept different from the rest. In these extreme conditions, subsets might become isolated from the rest of the network or otherwise interfere with the development of network complexity. However, whereas these subsets form distinctive structural and functional communities, they generally maintain connectivity with the rest of the network and allow the development of network complexity. Pathological development was observed only in a small proportion of the models. These results suggest that adaptive rewiring can robustly operate alongside information processing in biological and artificial neural networks.

Permutation Entropy as a Universal Disorder Criterion: How Disorders at Different Scale Levels Are Manifestations of the Same Underlying Principle

What do bacteria, cells, organs, people, and social communities have in common? At first sight, perhaps not much. They involve totally different agents and scale levels of observation. On second thought, however, perhaps they share everything. A growing body of literature suggests that living systems at different scale levels of observation follow the same architectural principles and process information in similar ways. Moreover, such systems appear to respond in similar ways to rising levels of stress, especially when stress levels approach near-lethal levels. To explain such communalities, we argue that all organisms (including humans) can be modeled as hierarchical Bayesian controls systems that are governed by the same biophysical principles. Such systems show generic changes when taxed beyond their ability to correct for environmental disturbances. Without exception, stressed organisms show rising levels of 'disorder' (randomness, unpredictability) in internal message passing and overt behavior. We argue that such changes can be explained by a collapse of allostatic (high-level integrative) control, which normally synchronizes activity of the various components of a living system to produce order. The selective overload and cascading failure of highly connected (hub) nodes flattens hierarchical control, producing maladaptive behavior. Thus, we present a theory according to which organic concepts such as stress, a loss of control, disorder, disease, and death can be operationalized in biophysical terms that apply to all scale levels of organization. Given the presumed universality of this mechanism, 'losing control' appears to involve the same process anywhere, whether involving bacteria succumbing to an antibiotic agent, people suffering from physical or mental disorders, or social systems slipping into warfare. On a practical note, measures of disorder may serve as early warning signs of system failure even when catastrophic failure is still some distance away.

Adaptive Rewiring in Weighted Networks Shows Specificity, Robustness, and Flexibility

Brain network connections rewire adaptively in response to neural activity. Adaptive rewiring may be understood as a process which, at its every step, is aimed at optimizing the efficiency of signal diffusion. In evolving model networks, this amounts to creating shortcut connections in regions with high diffusion and pruning where diffusion is low. Adaptive rewiring leads over time to topologies akin to brain anatomy: small worlds with rich club and modular or centralized structures. We continue our investigation of adaptive rewiring by focusing on three desiderata: specificity of evolving model network architectures, robustness of dynamically maintained architectures, and flexibility of network evolution to stochastically deviate from specificity and robustness. Our adaptive rewiring model simulations show that specificity and robustness characterize alternative modes of network operation, controlled by a single parameter, the rewiring interval. Small control parameter shifts across a critical transition zone allow switching between the two modes. Adaptive rewiring exhibits greater flexibility for skewed, lognormal connection weight distributions than for normally distributed ones. The results qualify adaptive rewiring as a key principle of self-organized complexity in network architectures, in particular of those that characterize the variety of functional architectures in the brain.

How higher goals are constructed and collapse under stress: A hierarchical Bayesian control systems perspective

In this paper, we show that organisms can be modeled as hierarchical Bayesian control systems with small world and information bottleneck (bow-tie) network structure. Such systems combine hierarchical perception with hierarchical goal setting and hierarchical action control. We argue that hierarchical Bayesian control systems produce deep hierarchies of goal states, from which it follows that organisms must have some form of 'highest goals'. For all organisms, these involve internal (self) models, external (social) models and overarching (normative) models. We show that goal hierarchies tend to decompose in a top-down manner under severe and prolonged levels of stress. This produces behavior that favors short-term and self-referential goals over long term, social and/or normative goals. The collapse of goal hierarchies is universally accompanied by an increase in entropy (disorder) in control systems that can serve as an early warning sign for tipping points (disease or death of the organism). In humans, learning goal hierarchies corresponds to personality development (maturation). The failure of goal hierarchies to mature properly corresponds to personality deficits. A top-down collapse of such hierarchies under stress is identified as a common factor in all forms of episodic mental disorders (psychopathology). The paper concludes by discussing ways of testing these hypotheses empirically.

Toward a Universal Theoretical Framework to Understand Robustness and Resilience: From Cells to Systems

Research across a range of biological subdisciplines and scales, ranging from molecular to ecosystemic, provides ample evidence that living systems generally exhibit both a degree of resistance to disruption and an ability to recover following disturbance. Not only do mechanisms of robustness and resilience exist across and between systems, but those mechanisms exhibit ubiquitous and scalable commonalities in pattern and function. Mechanisms such as redundancy, plasticity, interconnectivity, and coordination of subunits appear to be crucial internal players in the determination of stability. Similarly, factors external to the system such as the amplitude, frequency, and predictability of disruptors, or the prevalence of key limiting resources, may constrain pathways of response. In the face of a rapidly changing environment, there is a pressing need to develop a common framework for describing, assessing, and predicting robustness and resilience within and across living systems.

Adaptive rewiring evolves brain-like structure in weighted networks

Activity-dependent plasticity refers to a range of mechanisms for adaptively reshaping neuronal connections. We model their common principle in terms of adaptive rewiring of network connectivity, while representing neural activity by diffusion on the network: Where diffusion is intensive, shortcut connections are established, while underused connections are pruned. In binary networks, this process is known to steer initially random networks robustly to high levels of structural complexity, reflecting the global characteristics of brain anatomy: modular or centralized small world topologies. We investigate whether this result extends to more realistic, weighted networks. Both normally- and lognormally-distributed weighted networks evolve either modular or centralized topologies. Which of these prevails depends on a single control parameter, representing global homeostatic or normalizing regulation mechanisms. Intermediate control parameter values exhibit the greatest levels of network complexity, incorporating both modular and centralized tendencies. The simulation results allow us to propose diffusion based adaptive rewiring as a parsimonious model for activity-dependent reshaping of brain connectivity structure.

Topology Effects on Sparse Control of Complex Networks with Laplacian Dynamics

Ease of control of complex networks has been assessed extensively in terms of structural controllability and observability, and minimum control energy criteria. Here we adopt a sparsity-promoting feedback control framework for undirected networks with Laplacian dynamics and distinct topological features. The control objective considered is to minimize the effect of disturbance signals, magnitude of control signals and cost of feedback channels. We show that depending on the cost of feedback channels, different complex network structures become the least expensive option to control. Specifically, increased cost of feedback channels favors organized topological complexity such as modularity and centralization. Thus, although sparse and heterogeneous undirected networks may require larger numbers of actuators and sensors for structural controllability, networks with Laplacian dynamics are shown to be easier to control when accounting for the cost of feedback channels.

Topological reinforcement as a principle of modularity emergence in brain networks

Modularity is a ubiquitous topological feature of structural brain networks at various scales. Although a variety of potential mechanisms have been proposed, the fundamental principles by which modularity emerges in neural networks remain elusive. We tackle this question with a plasticity model of neural networks derived from a purely topological perspective. Our topological reinforcement model acts enhancing the topological overlap between nodes, that is, iteratively allowing connections between non-neighbor nodes with high neighborhood similarity. This rule reliably evolves synthetic random networks toward a modular architecture. Such final modular structure reflects initial "proto-modules," thus allowing to predict the modules of the evolved graph. Subsequently, we show that this topological selection principle might be biologically implemented as a Hebbian rule. Concretely, we explore a simple model of excitable dynamics, where the plasticity rule acts based on the functional connectivity (co-activations) between nodes. Results produced by the activity-based model are consistent with the ones from the purely topological rule in terms of the final network configuration and modules composition. Our findings suggest that the selective reinforcement of topological overlap may be a fundamental mechanism contributing to modularity emergence in brain networks.

Integrating molecular networks with genetic variant interpretation for precision medicine

More reliable and cheaper sequencing technologies have revealed the vast mutational landscapes characteristic of many phenotypes. The analysis of such genetic variants has led to successful identification of altered proteins underlying many Mendelian disorders. Nevertheless the simple one‐variant one‐phenotype model valid for many monogenic diseases does not capture the complexity of polygenic traits and disorders. Although experimental and computational approaches have improved detection of functionally deleterious variants and important interactions between gene products, the development of comprehensive models relating genotype and phenotypes remains a challenge in the field of genomic medicine. In this context, a new view of the pathologic state as significant perturbation of the network of interactions between biomolecules is crucial for the identification of biochemical pathways associated with complex phenotypes. Seminal studies in systems biology combined the analysis of genetic variation with protein–protein interaction networks to demonstrate that even as biological systems evolve to be robust to genetic variation, their topologies create disease vulnerabilities. More recent analyses model the impact of genetic variants as changes to the “wiring” of the interactome to better capture heterogeneity in genotype–phenotype relationships. These studies lay the foundation for using networks to predict variant effects at scale using machine‐learning or algorithmic approaches. A wealth of databases and resources for the annotation of genotype–phenotype relationships have been developed to support developments in this area. This overview describes how study of the molecular interactome has generated insights linking the organization of biological systems to disease mechanism, and how this information can enable precision medicine.

This article is categorized under:

Translational, Genomic, and Systems Medicine > Translational Medicine

Biological Mechanisms > Cell Signaling

Models of Systems Properties and Processes > Mechanistic Models

Analytical and Computational Methods > Computational Methods

Gene therapy reduces Parkinson’s disease symptoms by reorganizing functional brain connectivity

Gene therapy is emerging as a promising approach for treating neurological disorders, including Parkinson’s disease (PD). A phase 2 clinical trial showed that delivering glutamic acid decarboxylase (GAD) into the subthalamic nucleus (STN) of patients with PD had therapeutic effects. To determine the mechanism underlying this response, we analyzed metabolic imaging data from patients who received gene therapy and those randomized to sham surgery, all of whom had been scanned preoperatively and at 6 and 12 months after surgery. Those who receivedGADgene therapy developed a unique treatment-dependent polysynaptic brain circuit that we termed as theGAD–related pattern (GADRP), which reflected the formation of new polysynaptic functional pathways linking the STN to motor cortical regions. Patients in both the treatment group and the sham group expressed the previously reported placebo network (the sham surgery–related pattern or SSRP) when blinded to the treatment received. However, only the appearance of the GADRP correlated with clinical improvement in the gene therapy–treated subjects. Treatment-induced brain circuits can thus be useful in clinical trials for isolating true treatment responses and providing insight into their underlying biological mechanisms.