Learning function from structure in neuromorphic networks

Shaping dynamical neural computations using spatiotemporal constraints

Dynamics play a critical role in computation. The principled evolution of states over time enables both biological and artificial networks to represent and integrate information to make decisions. In the past few decades, significant multidisciplinary progress has been made in bridging the gap between how we understand biological versus artificial computation, including how insights gained from one can translate to the other. Research has revealed that neurobiology is a key determinant of brain network architecture, which gives rise to spatiotemporally constrained patterns of activity that underlie computation. Here, we discuss how neural systems use dynamics for computation, and claim that the biological constraints that shape brain networks may be leveraged to improve the implementation of artificial neural networks. To formalize this discussion, we consider a natural artificial analog of the brain that has been used extensively to model neural computation: the recurrent neural network (RNN). In both the brain and the RNN, we emphasize the common computational substrate atop which dynamics occur-the connectivity between neurons-and we explore the unique computational advantages offered by biophysical constraints such as resource efficiency, spatial embedding, and neurodevelopment.

Dynamic structure-function coupling across three major psychiatric disorders

BACKGROUND

Convergent evidence has suggested atypical relationships between brain structure and function in major psychiatric disorders, yet how the abnormal patterns coincide and/or differ across different disorders remains largely unknown. Here, we aim to investigate the common and/or unique dynamic structure-function coupling patterns across major depressive disorder (MDD), bipolar disorder (BD), and schizophrenia (SZ).

METHODS

We quantified the dynamic structure-function coupling in 452 patients with psychiatric disorders (MDD/BD/SZ = 166/168/118) and 205 unaffected controls at three distinct brain network levels, such as global, meso-, and local levels. We also correlated dynamic structure-function coupling with the topological features of functional networks to examine how the structure-function relationship facilitates brain information communication over time.

RESULTS

The dynamic structure-function coupling is preserved for the three disorders at the global network level. Similar abnormalities in the rich-club organization are found in two distinct functional configuration states at the meso-level and are associated with the disease severity of MDD, BD, and SZ. At the local level, shared and unique alterations are observed in the brain regions involving the visual, cognitive control, and default mode networks. In addition, the relationships between structure-function coupling and the topological features of functional networks are altered in a manner indicative of state specificity.

CONCLUSIONS

These findings suggest both transdiagnostic and illness-specific alterations in the dynamic structure-function relationship of large-scale brain networks across MDD, BD, and SZ, providing new insights and potential biomarkers into the neurodevelopmental basis underlying the behavioral and cognitive deficits observed in these disorders.

Imitating and exploring the human brain's resting and task-performing states via brain computing: scaling and architecture

A computational human brain model with the voxel-wise assimilation method was established based on individual structural and functional imaging data. We found that the more similar the brain model is to the biological counterpart in both scale and architecture, the more similarity was found between the assimilated model and the biological brain both in resting states and during tasks by quantitative metrics. The hypothesis that resting state activity reflects internal body states was validated by the interoceptive circuit's capability to enhance the similarity between the simulation model and the biological brain. We identified that the removal of connections from the primary visual cortex (V1) to downstream visual pathways significantly decreased the similarity at the hippocampus between the model and its biological counterpart, despite a slight influence on the whole brain. In conclusion, the model and methodology present a solid quantitative framework for a digital twin brain for discovering the relationship between brain architecture and functions, and for digitally trying and testing diverse cognitive, medical and lesioning approaches that would otherwise be unfeasible in real subjects.

Group-common and individual-specific effects of structure-function coupling in human brain networks with graph neural networks

The human cerebral cortex is organized into functionally segregated but synchronized regions bridged by the structural connectivity of white matter pathways. While structure-function coupling has been implicated in cognitive development and neuropsychiatric disorders, studies yield inconsistent findings. The extent to which the structure-function coupling reflects reliable individual differences or primarily group-common characteristics remains unclear, at both the global and regional brain levels. By leveraging two independent, high-quality datasets, we found that the graph neural network accurately predicted unseen individuals' functional connectivity from structural connectivity, reflecting a strong structure-function coupling. This coupling was primarily driven by network topology and was substantially stronger than that of the linear models. Moreover, we observed that structure-function coupling was dominated by group-common effects, with subtle yet significant individual-specific effects. The regional group and individual effects of coupling were hierarchically organized across the cortex along a sensorimotor-association axis, with lower group and higher individual effects in association cortices. These findings emphasize the importance of considering both group and individual effects in understanding cortical structure-function coupling, suggesting insights into interpreting individual differences of the coupling and informing connectivity-guided therapeutics.

Emergence of brain-inspired small-world spiking neural network through neuroevolution

Studies suggest that the brain's high efficiency and low energy consumption may be closely related to its small-world topology and critical dynamics. However, existing efforts on the performance-oriented structural evolution of spiking neural networks (SNNs) are time-consuming and ignore the core structural properties of the brain. Here, we introduce a multi-objective Evolutionary Liquid State Machine (ELSM), which blends the small-world coefficient and criticality to evolve models and guide the emergence of brain-inspired, efficient structures. Experiments reveal ELSM's consistent and comparable performance, achieving 97.23% on NMNIST and outperforming LSM models on MNIST and Fashion-MNIST with 98.12% and 88.81% accuracies, respectively. Further analysis shows its versatility and spontaneous evolution of topologies such as hub nodes, short paths, long-tailed degree distributions, and numerous communities. This study evolves recurrent spiking neural networks into brain-inspired energy-efficient structures, showcasing versatility in multiple tasks and potential for adaptive general artificial intelligence.

Mindfulness meditation styles differently modulate source-level MEG microstate dynamics and complexity

Background

The investigation of mindfulness meditation practice, classically divided into focused attention meditation (FAM), and open monitoring meditation (OMM) styles, has seen a long tradition of theoretical, affective, neurophysiological and clinical studies. In particular, the high temporal resolution of magnetoencephalography (MEG) or electroencephalography (EEG) has been exploited to fill the gap between the personal experience of meditation practice and its neural correlates. Mounting evidence, in fact, shows that human brain activity is highly dynamic, transiting between different brain states (microstates). In this study, we aimed at exploring MEG microstates at source-level during FAM, OMM and in the resting state, as well as the complexity and criticality of dynamic transitions between microstates.

Methods

Ten right-handed Theravada Buddhist monks with a meditative expertise of minimum 2,265 h participated in the experiment. MEG data were acquired during a randomized block design task (6 min FAM, 6 min OMM, with each meditative block preceded and followed by 3 min resting state). Source reconstruction was performed using eLORETA on individual cortical space, and then parcellated according to the Human Connect Project atlas. Microstate analysis was then applied to parcel level signals in order to derive microstate topographies and indices. In addition, from microstate sequences, the Hurst exponent and the Lempel-Ziv complexity (LZC) were computed.

Results

Our results show that the coverage and occurrence of specific microstates are modulated either by being in a meditative state or by performing a specific meditation style. Hurst exponent values in both meditation conditions are reduced with respect to the value observed during rest, LZC shows significant differences between OMM, FAM, and REST, with a progressive increase from REST to FAM to OMM.

Discussion

Importantly, we report changes in brain criticality indices during meditation and between meditation styles, in line with a state-like effect of meditation on cognitive performance. In line with previous reports, we suggest that the change in cognitive state experienced in meditation is paralleled by a shift with respect to critical points in brain dynamics.

Understanding divergence: Placing developmental neuroscience in its dynamic context

Neurodevelopment is not merely a process of brain maturation, but an adaptation to constraints unique to each individual and to the environments we co-create. However, our theoretical and methodological toolkits often ignore this reality. There is growing awareness that a shift is needed that allows us to study divergence of brain and behaviour across conventional categorical boundaries. However, we argue that in future our study of divergence must also incorporate the developmental dynamics that capture the emergence of those neurodevelopmental differences. This crucial step will require adjustments in study design and methodology. If our ultimate aim is to incorporate the developmental dynamics that capture how, and ultimately when, divergence takes place then we will need an analytic toolkit equal to these ambitions. We argue that the over reliance on group averages has been a conceptual dead-end with regard to the neurodevelopmental differences. This is in part because any individual differences and developmental dynamics are inevitably lost within the group average. Instead, analytic approaches which are themselves new, or simply newly applied within this context, may allow us to shift our theoretical and methodological frameworks from groups to individuals. Likewise, methods capable of modelling complex dynamic systems may allow us to understand the emergent dynamics only possible at the level of an interacting neural system.

Connectome-based reservoir computing with the conn2res toolbox

The connection patterns of neural circuits form a complex network. How signaling in these circuits manifests as complex cognition and adaptive behaviour remains the central question in neuroscience. Concomitant advances in connectomics and artificial intelligence open fundamentally new opportunities to understand how connection patterns shape computational capacity in biological brain networks. Reservoir computing is a versatile paradigm that uses high-dimensional, nonlinear dynamical systems to perform computations and approximate cognitive functions. Here we present conn2res: an open-source Python toolbox for implementing biological neural networks as artificial neural networks. conn2res is modular, allowing arbitrary network architecture and dynamics to be imposed. The toolbox allows researchers to input connectomes reconstructed using multiple techniques, from tract tracing to noninvasive diffusion imaging, and to impose multiple dynamical systems, from spiking neurons to memristive dynamics. The versatility of the conn2res toolbox allows us to ask new questions at the confluence of neuroscience and artificial intelligence. By reconceptualizing function as computation, conn2res sets the stage for a more mechanistic understanding of structure-function relationships in brain networks.

Unbiased construction of constitutive relations for soft materials from experiments via rheology-informed neural networks

The ability to concisely describe the dynamical behavior of soft materials through closed-form constitutive relations holds the key to accelerated and informed design of materials and processes. The conventional approach is to construct constitutive relations through simplifying assumptions and approximating the time- and rate-dependent stress response of a complex fluid to an imposed deformation. While traditional frameworks have been foundational to our current understanding of soft materials, they often face a twofold existential limitation: i) Constructed on ideal and generalized assumptions, precise recovery of material-specific details is usually serendipitous, if possible, and ii) inherent biases that are involved by making those assumptions commonly come at the cost of new physical insight. This work introduces an approach by leveraging recent advances in scientific machine learning methodologies to discover the governing constitutive equation from experimental data for complex fluids. Our rheology-informed neural network framework is found capable of learning the hidden rheology of a complex fluid through a limited number of experiments. This is followed by construction of an unbiased material-specific constitutive relation that accurately describes a wide range of bulk dynamical behavior of the material. While extremely efficient in closed-form model discovery for a real-world complex system, the model also provides insight into the underpinning physics of the material.

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

The architecture design and multi-scale learning principles of the human brain that evolved over hundreds of millions of years are crucial to realizing human-like intelligence. Spiking neural network based Liquid State Machine (LSM) serves as a suitable architecture to study brain-inspired intelligence because of its brain-inspired structure and the potential for integrating multiple biological principles. Existing researches on LSM focus on different certain perspectives, including high-dimensional encoding or optimization of the liquid layer, network architecture search, and application to hardware devices. There is still a lack of in-depth inspiration from the learning and structural evolution mechanism of the brain. Considering these limitations, this paper presents a novel LSM learning model that integrates adaptive structural evolution and multi-scale biological learning rules. For structural evolution, an adaptive evolvable LSM model is developed to optimize the neural architecture design of liquid layer with separation property. For brain-inspired learning of LSM, we propose a dopamine-modulated Bienenstock-Cooper-Munros (DA-BCM) method that incorporates global long-term dopamine regulation and local trace-based BCM synaptic plasticity. Comparative experimental results on different decision-making tasks show that introducing structural evolution of the liquid layer, and the DA-BCM regulation of the liquid layer and the readout layer could improve the decision-making ability of LSM and flexibly adapt to rule reversal. This work is committed to exploring how evolution can help to design more appropriate network architectures and how multi-scale neuroplasticity principles coordinated to enable the optimization and learning of LSMs for relatively complex decision-making tasks.

Connectome-based modelling of neurodegenerative diseases: towards precision medicine and mechanistic insight

Neurodegenerative diseases are the most common cause of dementia. Although their underlying molecular pathologies have been identified, there is substantial heterogeneity in the patterns of progressive brain alterations across and within these diseases. Recent advances in neuroimaging methods have revealed that pathological proteins accumulate along specific macroscale brain networks, implicating the network architecture of the brain in the system-level pathophysiology of neurodegenerative diseases. However, the extent to which 'network-based neurodegeneration' applies across the wide range of neurodegenerative disorders remains unclear. Here, we discuss the state-of-the-art of neuroimaging-based connectomics for the mapping and prediction of neurodegenerative processes. We review findings supporting brain networks as passive conduits through which pathological proteins spread. As an alternative view, we also discuss complementary work suggesting that network alterations actively modulate the spreading of pathological proteins between connected brain regions. We conclude this Perspective by proposing an integrative framework in which connectome-based models can be advanced along three dimensions of innovation: incorporating parameters that modulate propagation behaviour on the basis of measurable biological features; building patient-tailored models that use individual-level information and allowing model parameters to interact dynamically over time. We discuss promises and pitfalls of these strategies for improving disease insights and moving towards precision medicine.

Tomography of memory engrams in self-organizing nanowire connectomes

Self-organizing memristive nanowire connectomes have been exploited for physical (in materia) implementation of brain-inspired computing paradigms. Despite having been shown that the emergent behavior relies on weight plasticity at single junction/synapse level and on wiring plasticity involving topological changes, a shift to multiterminal paradigms is needed to unveil dynamics at the network level. Here, we report on tomographical evidence of memory engrams (or memory traces) in nanowire connectomes, i.e., physicochemical changes in biological neural substrates supposed to endow the representation of experience stored in the brain. An experimental/modeling approach shows that spatially correlated short-term plasticity effects can turn into long-lasting engram memory patterns inherently related to network topology inhomogeneities. The ability to exploit both encoding and consolidation of information on the same physical substrate would open radically new perspectives for in materia computing, while offering to neuroscientists an alternative platform to understand the role of memory in learning and knowledge.

Reservoir computing using self-sustained oscillations in a locally connected neural network

Understanding how the structural organization of neural networks influences their computational capabilities is of great interest to both machine learning and neuroscience communities. In our previous work, we introduced a novel learning system, called the reservoir of basal dynamics (reBASICS), which features a modular neural architecture (small-sized random neural networks) capable of reducing chaoticity of neural activity and of producing stable self-sustained limit cycle activities. The integration of these limit cycles is achieved by linear summation of their weights, and arbitrary time series are learned by modulating these weights. Despite its excellent learning performance, interpreting a modular structure of isolated small networks as a brain network has posed a significant challenge. Here, we investigate how local connectivity, a well-known characteristic of brain networks, contributes to reducing neural system chaoticity and generates self-sustained limit cycles based on empirical experiments. Moreover, we present the learning performance of the locally connected reBASICS in two tasks: a motor timing task and a learning task of the Lorenz time series. Although its performance was inferior to that of modular reBASICS, locally connected reBASICS could learn a time series of tens of seconds while the time constant of neural units was ten milliseconds. This work indicates that the locality of connectivity in neural networks may contribute to generation of stable self-sustained oscillations to learn arbitrary long-term time series, as well as the economy of wiring cost.

From Brain Models to Robotic Embodied Cognition: How Does Biological Plausibility Inform Neuromorphic Systems?

We examine the challenging "marriage" between computational efficiency and biological plausibility-A crucial node in the domain of spiking neural networks at the intersection of neuroscience, artificial intelligence, and robotics. Through a transdisciplinary review, we retrace the historical and most recent constraining influences that these parallel fields have exerted on descriptive analysis of the brain, construction of predictive brain models, and ultimately, the embodiment of neural networks in an enacted robotic agent. We study models of Spiking Neural Networks (SNN) as the central means enabling autonomous and intelligent behaviors in biological systems. We then provide a critical comparison of the available hardware and software to emulate SNNs for investigating biological entities and their application on artificial systems. Neuromorphics is identified as a promising tool to embody SNNs in real physical systems and different neuromorphic chips are compared. The concepts required for describing SNNs are dissected and contextualized in the new no man's land between cognitive neuroscience and artificial intelligence. Although there are recent reviews on the application of neuromorphic computing in various modules of the guidance, navigation, and control of robotic systems, the focus of this paper is more on closing the cognition loop in SNN-embodied robotics. We argue that biologically viable spiking neuronal models used for electroencephalogram signals are excellent candidates for furthering our knowledge of the explainability of SNNs. We complete our survey by reviewing different robotic modules that can benefit from neuromorphic hardware, e.g., perception (with a focus on vision), localization, and cognition. We conclude that the tradeoff between symbolic computational power and biological plausibility of hardware can be best addressed by neuromorphics, whose presence in neurorobotics provides an accountable empirical testbench for investigating synthetic and natural embodied cognition. We argue this is where both theoretical and empirical future work should converge in multidisciplinary efforts involving neuroscience, artificial intelligence, and robotics.

How to incorporate biological insights into network models and why it matters

Due to the staggering complexity of the brain and its neural circuitry, neuroscientists rely on the analysis of mathematical models to elucidate its function. From Hodgkin and Huxley's detailed description of the action potential in 1952 to today, new theories and increasing computational power have opened up novel avenues to study how neural circuits implement the computations that underlie behaviour. Computational neuroscientists have developed many models of neural circuits that differ in complexity, biological realism or emergent network properties. With recent advances in experimental techniques for detailed anatomical reconstructions or large-scale activity recordings, rich biological data have become more available. The challenge when building network models is to reflect experimental results, either through a high level of detail or by finding an appropriate level of abstraction. Meanwhile, machine learning has facilitated the development of artificial neural networks, which are trained to perform specific tasks. While they have proven successful at achieving task-oriented behaviour, they are often abstract constructs that differ in many features from the physiology of brain circuits. Thus, it is unclear whether the mechanisms underlying computation in biological circuits can be investigated by analysing artificial networks that accomplish the same function but differ in their mechanisms. Here, we argue that building biologically realistic network models is crucial to establishing causal relationships between neurons, synapses, circuits and behaviour. More specifically, we advocate for network models that consider the connectivity structure and the recorded activity dynamics while evaluating task performance.

Exploring neural heterogeneity in inattention and hyperactivity

Inattention and hyperactivity are cardinal symptoms of Attention Deficit Hyperactivity Disorder (ADHD). These characteristics have also been observed across a range of other neurodevelopmental conditions, such as autism and dyspraxia, suggesting that they might best be studied across diagnostic categories. Here, we evaluated the associations between inattention and hyperactivity behaviours and features of the structural brain network (connectome) in a large transdiagnostic sample of children (Centre for Attention, Learning, and Memory; n = 383). In our sample, we found that a single latent factor explains 77.6% of variance in scores across multiple questionnaires measuring inattention and hyperactivity. Partial Least-Squares (PLS) regression revealed that variability in this latent factor could not be explained by a linear component representing nodewise properties of connectomes. We then investigated the type and extent of neural heterogeneity in a subset of our sample with clinically-elevated levels of inattention and hyperactivity. Multidimensional scaling combined with k-means clustering revealed two neural subtypes in children with elevated levels of inattention and hyperactivity (n = 232), differentiated primarily by nodal communicability-a measure which demarcates the extent to which neural signals propagate through specific brain regions. These different clusters had similar behavioural profiles, which included high levels of inattention and hyperactivity. However, one of the clusters scored higher on multiple cognitive assessment measures of executive function. We conclude that inattention and hyperactivity are so common in children with neurodevelopmental difficulties because they emerge through multiple different trajectories of brain development. In our own data, we can identify two of these possible trajectories, which are reflected by measures of structural brain network topology and cognition.

Scale-free behavioral dynamics directly linked with scale-free cortical dynamics

Naturally occurring body movements and collective neural activity both exhibit complex dynamics, often with scale-free, fractal spatiotemporal structure. Scale-free dynamics of both brain and behavior are important because each is associated with functional benefits to the organism. Despite their similarities, scale-free brain activity and scale-free behavior have been studied separately, without a unified explanation. Here, we show that scale-free dynamics of mouse behavior and neurons in the visual cortex are strongly related. Surprisingly, the scale-free neural activity is limited to specific subsets of neurons, and these scale-free subsets exhibit stochastic winner-take-all competition with other neural subsets. This observation is inconsistent with prevailing theories of scale-free dynamics in neural systems, which stem from the criticality hypothesis. We develop a computational model which incorporates known cell-type-specific circuit structure, explaining our findings with a new type of critical dynamics. Our results establish neural underpinnings of scale-free behavior and clear behavioral relevance of scale-free neural activity.

Microfluidic cell engineering on high-density microelectrode arrays for assessing structure-function relationships in living neuronal networks

Neuronal networks in dissociated culture combined with cell engineering technology offer a pivotal platform to constructively explore the relationship between structure and function in living neuronal networks. Here, we fabricated defined neuronal networks possessing a modular architecture on high-density microelectrode arrays (HD-MEAs), a state-of-the-art electrophysiological tool for recording neural activity with high spatial and temporal resolutions. We first established a surface coating protocol using a cell-permissive hydrogel to stably attach a polydimethylsiloxane microfluidic film on the HD-MEA. We then recorded the spontaneous neural activity of the engineered neuronal network, which revealed an important portrait of the engineered neuronal network-modular architecture enhances functional complexity by reducing the excessive neural correlation between spatially segregated modules. The results of this study highlight the impact of HD-MEA recordings combined with cell engineering technologies as a novel tool in neuroscience to constructively assess the structure-function relationships in neuronal networks.

A connectomics-based taxonomy of mammals

Mammalian taxonomies are conventionally defined by morphological traits and genetics. How species differ in terms of neural circuits and whether inter-species differences in neural circuit organization conform to these taxonomies is unknown. The main obstacle to the comparison of neural architectures has been differences in network reconstruction techniques, yielding species-specific connectomes that are not directly comparable to one another. Here, we comprehensively chart connectome organization across the mammalian phylogenetic spectrum using a common reconstruction protocol. We analyse the mammalian MRI (MaMI) data set, a database that encompasses high-resolution ex vivo structural and diffusion MRI scans of 124 species across 12 taxonomic orders and 5 superorders, collected using a unified MRI protocol. We assess similarity between species connectomes using two methods: similarity of Laplacian eigenspectra and similarity of multiscale topological features. We find greater inter-species similarities among species within the same taxonomic order, suggesting that connectome organization reflects established taxonomic relationships defined by morphology and genetics. While all connectomes retain hallmark global features and relative proportions of connection classes, inter-species variation is driven by local regional connectivity profiles. By encoding connectomes into a common frame of reference, these findings establish a foundation for investigating how neural circuits change over phylogeny, forging a link from genes to circuits to behaviour.

How critical is brain criticality?

Criticality is the singular state of complex systems poised at the brink of a phase transition between order and randomness. Such systems display remarkable information-processing capabilities, evoking the compelling hypothesis that the brain may itself be critical. This foundational idea is now drawing renewed interest thanks to high-density data and converging cross-disciplinary knowledge. Together, these lines of inquiry have shed light on the intimate link between criticality, computation, and cognition. Here, we review these emerging trends in criticality neuroscience, highlighting new data pertaining to the edge of chaos and near-criticality, and making a case for the distance to criticality as a useful metric for probing cognitive states and mental illness. This unfolding progress in the field contributes to establishing criticality theory as a powerful mechanistic framework for studying emergent function and its efficiency in both biological and artificial neural networks.

Reservoir computing with 3D nanowire networks

Networks of nanowires are currently being explored for a range of applications in brain-like (or neuromorphic) computing, and especially in reservoir computing (RC). Fabrication of real-world computing devices requires that the nanowires are deposited sequentially, leading to stacking of the wires on top of each other. However, most simulations of computational tasks using these systems treat the nanowires as 1D objects lying in a perfectly 2D plane - the effect of stacking on RC performance has not yet been established. Here we use detailed simulations to compare the performance of perfectly 2D and quasi-3D (stacked) networks of nanowires in two tasks: memory capacity and nonlinear transformation. We also show that our model of the junctions between nanowires is general enough to describe a wide range of memristive networks, and consider the impact of physically realistic electrode configurations on performance. We show that the various networks and configurations have a strikingly similar performance in RC tasks, which is surprising given their radically different topologies. Our results show that networks with an experimentally achievable number of electrodes perform close to the upper bounds achievable when using the information from every wire. However, we also show important differences, in particular that the quasi-3D networks are more resilient to changes in the input parameters, generalizing better to noisy training data. Since previous literature suggests that topology plays an important role in computing performance, these results may have important implications for future applications of nanowire networks in neuromorphic computing.

Forecasting brain activity based on models of spatiotemporal brain dynamics: A comparison of graph neural network architectures

Comprehending the interplay between spatial and temporal characteristics of neural dynamics can contribute to our understanding of information processing in the human brain. Graph neural networks (GNNs) provide a new possibility to interpret graph-structured signals like those observed in complex brain networks. In our study we compare different spatiotemporal GNN architectures and study their ability to model neural activity distributions obtained in functional MRI (fMRI) studies. We evaluate the performance of the GNN models on a variety of scenarios in MRI studies and also compare it to a VAR model, which is currently often used for directed functional connectivity analysis. We show that by learning localized functional interactions on the anatomical substrate, GNN-based approaches are able to robustly scale to large network studies, even when available data are scarce. By including anatomical connectivity as the physical substrate for information propagation, such GNNs also provide a multimodal perspective on directed connectivity analysis, offering a novel possibility to investigate the spatiotemporal dynamics in brain networks.

Null models in network neuroscience

Recent advances in imaging and tracing technology provide increasingly detailed reconstructions of brain connectomes. Concomitant analytic advances enable rigorous identification and quantification of functionally important features of brain network architecture. Null models are a flexible tool to statistically benchmark the presence or magnitude of features of interest, by selectively preserving specific architectural properties of brain networks while systematically randomizing others. Here we describe the logic, implementation and interpretation of null models of connectomes. We introduce randomization and generative approaches to constructing null networks, and outline a taxonomy of network methods for statistical inference. We highlight the spectrum of null models - from liberal models that control few network properties, to conservative models that recapitulate multiple properties of empirical networks - that allow us to operationalize and test detailed hypotheses about the structure and function of brain networks. We review emerging scenarios for the application of null models in network neuroscience, including for spatially embedded networks, annotated networks and correlation-derived networks. Finally, we consider the limits of null models, as well as outstanding questions for the field.

Digital rheometer twins: Learning the hidden rheology of complex fluids through rheology-informed graph neural networks

SignificanceScience-based data-driven methods that can describe the rheological behavior of complex fluids can be transformative across many disciplines. Digital rheometer twins, which are developed here, can significantly reduce the cost, time, and energy required to characterize complex fluids and predict their future behavior. This is made possible by combining two different methods of informing neural networks with the rheological underpinnings of a system, resulting in quantitative recovery of a gel's response to different flow protocols. The platform developed here is general enough that it can be extended to areas well beyond complex fluids modeling.

Robustness and Flexibility of Neural Function through Dynamical Criticality

In theoretical biology, robustness refers to the ability of a biological system to function properly even under perturbation of basic parameters (e.g., temperature or pH), which in mathematical models is reflected in not needing to fine-tune basic parameter constants; flexibility refers to the ability of a system to switch functions or behaviors easily and effortlessly. While there are extensive explorations of the concept of robustness and what it requires mathematically, understanding flexibility has proven more elusive, as well as also elucidating the apparent opposition between what is required mathematically for models to implement either. In this paper we address a number of arguments in theoretical neuroscience showing that both robustness and flexibility can be attained by systems that poise themselves at the onset of a large number of dynamical bifurcations, or dynamical criticality, and how such poising can have a profound influence on integration of information processing and function. Finally, we examine critical map lattices, which are coupled map lattices where the coupling is dynamically critical in the sense of having purely imaginary eigenvalues. We show that these map lattices provide an explicit connection between dynamical criticality in the sense we have used and “edge of chaos” criticality.

The parallel computing of node centrality based on GPU

Many systems in real world can be represented as network, and network analysis can help us understand these systems. Node centrality is an important problem and has attracted a lot of attention in the field of network analysis. As the rapid development of information technology, the scale of network data is rapidly increasing. However, node centrality computation in large-scale networks is time consuming. Parallel computing is an alternative to speed up the computation of node centrality. GPU, which has been a core component of modern computer, can make a large number of core tasks work in parallel and has the ability of big data processing, and has been widely used to accelerate computing. Therefore, according to the parallel characteristic of GPU, we design the parallel algorithms to compute three widely used node centralities, i.e., closeness centrality, betweenness centrality and PageRank centrality. Firstly, we classify the three node centralities into two groups according to their definitions; secondly, we design the parallel algorithms by mapping the centrality computation of different nodes into different blocks or threads in GPU; thirdly, we analyze the correlations between different centralities in several networks, benefited from the designed parallel algorithms. Experimental results show that the parallel algorithms designed in this paper can speed up the computation of node centrality in large-scale networks, and the closeness centrality and the betweenness centrality are weakly correlated, although both of them are based on the shortest path.

Prefrontal connectomics: from anatomy to human imaging

The fundamental importance of prefrontal cortical connectivity to information processing and, therefore, disorders of cognition, emotion, and behavior has been recognized for decades. Anatomic tracing studies in animals have formed the basis for delineating the direct monosynaptic connectivity, from cells of origin, through axon trajectories, to synaptic terminals. Advances in neuroimaging combined with network science have taken the lead in developing complex wiring diagrams or connectomes of the human brain. A key question is how well these magnetic resonance imaging (MRI)-derived networks and hubs reflect the anatomic "hard wiring" first proposed to underlie the distribution of information for large-scale network interactions. In this review, we address this challenge by focusing on what is known about monosynaptic prefrontal cortical connections in non-human primates and how this compares to MRI-derived measurements of network organization in humans. First, we outline the anatomic cortical connections and pathways for each prefrontal cortex (PFC) region. We then review the available MRI-based techniques for indirectly measuring structural and functional connectivity, and introduce graph theoretical methods for analysis of hubs, modules, and topologically integrative features of the connectome. Finally, we bring these two approaches together, using specific examples, to demonstrate how monosynaptic connections, demonstrated by tract-tracing studies, can directly inform understanding of the composition of PFC nodes and hubs, and the edges or pathways that connect PFC to cortical and subcortical areas.