Architecture, constraints, and behavior

Revisiting the evolution of bow-tie architecture in signaling networks

Bow-tie architecture is a layered network structure that has a narrow middle layer with multiple inputs and outputs. Such structures are widely seen in the molecular networks in cells, suggesting that a universal evolutionary mechanism underlies the emergence of bow-tie architecture. The previous theoretical studies have implemented evolutionary simulations of the feedforward network to satisfy a given input-output goal and proposed that the bow-tie architecture emerges when the ideal input-output relation is given as a rank-deficient matrix with mutations in network link intensities in a multiplicative manner. Here, we report that the bow-tie network inevitably appears when the link intensities representing molecular interactions are small at the initial condition of the evolutionary simulation, regardless of the rank of the goal matrix. Our dynamical system analysis clarifies the mechanisms underlying the emergence of the bow-tie structure. Further, we demonstrate that the increase in the input-output matrix reduces the width of the middle layer, resulting in the emergence of bow-tie architecture, even when evolution starts from large link intensities. Our data suggest that bow-tie architecture emerges as a side effect of evolution rather than as a result of evolutionary adaptation.

Mutation protocols share with sexual reproduction the physiological role of producing genetic variation within 'constraints that deconstrain'

Because the universe of possible DNA sequences is inconceivably vast, organisms have evolved mechanisms for exploring DNA sequence space while substantially reducing the hazard that would otherwise accrue to any process of random, accidental mutation. One such mechanism is meiotic recombination. Although sexual reproduction imposes a seemingly paradoxical 50% cost to fitness, sex evidently prevails because this cost is outweighed by the advantage of equipping offspring with genetic variation to accommodate environmental vicissitudes. The potential adaptive utility of additional mechanisms for producing genetic variation has long been obscured by a presumption that the vast majority of mutations are deleterious. Perhaps surprisingly, the probability for adaptive variation can be increased by several mechanisms that generate mutations abundantly. Such mechanisms, here called 'mutation protocols', implement implicit 'constraints that deconstrain'. Like meiotic recombination, they produce genetic variation in forms that minimize potential for harm while providing a reasonably high probability for benefit. One example is replication slippage of simple sequence repeats (SSRs); this process yields abundant, reversible mutations, typically with small quantitative effect on phenotype. This enables SSRs to function as adjustable 'tuning knobs'. There exists a clear pathway for SSRs to be shaped through indirect selection favouring their implicit tuning-knob protocol. Several other molecular mechanisms comprise probable components of additional mutation protocols. Biologists might plausibly regard such mechanisms of mutation not primarily as sources of deleterious genetic mistakes but also as potentially adaptive processes for 'exploring' DNA sequence space.

Self-Improvising Memory: A Perspective on Memories as Agential, Dynamically Reinterpreting Cognitive Glue

Many studies on memory emphasize the material substrate and mechanisms by which data can be stored and reliably read out. Here, I focus on complementary aspects: the need for agents to dynamically reinterpret and modify memories to suit their ever-changing selves and environment. Using examples from developmental biology, evolution, and synthetic bioengineering, in addition to neuroscience, I propose that a perspective on memory as preserving salience, not fidelity, is applicable to many phenomena on scales from cells to societies. Continuous commitment to creative, adaptive confabulation, from the molecular to the behavioral levels, is the answer to the persistence paradox as it applies to individuals and whole lineages. I also speculate that a substrate-independent, processual view of life and mind suggests that memories, as patterns in the excitable medium of cognitive systems, could be seen as active agents in the sense-making process. I explore a view of life as a diverse set of embodied perspectives-nested agents who interpret each other's and their own past messages and actions as best as they can (polycomputation). This synthesis suggests unifying symmetries across scales and disciplines, which is of relevance to research programs in Diverse Intelligence and the engineering of novel embodied minds.

Memetics and the Parallel Architecture

The evolution of human communication and culture is among the most significant-and challenging-questions we face in attempting to understand the evolution of our species. This article takes up two frameworks for theorizing about human communication and culture, namely, Jackendoff's Parallel Architecture of the human language faculty, and the cultural evolutionary framework of Memetics. The aim is to show that the two frameworks uniquely complement one another in some theoretically important ways. In particular, the Parallel Architecture's account of the lexicon significantly expands the range of linguistic phenomena that are plausibly covered by Memetics (e.g., from words to constructions and pure rules of syntax). At the same time, taking a "meme's-eye-view" of the lexicon retools the Parallel Architecture's treatment of the origins and subsequent cultural evolution of language.

Sensorimotor delays constrain robust locomotion in a 3D kinematic model of fly walking

Walking animals must maintain stability in the presence of external perturbations, despite significant temporal delays in neural signaling and muscle actuation. Here, we develop a 3D kinematic model with a layered control architecture to investigate how sensorimotor delays constrain robustness of walking behavior in the fruit fly, Drosophila. Motivated by the anatomical architecture of insect locomotor control circuits, our model consists of three component layers: a neural network that generates realistic 3D joint kinematics for each leg, an optimal controller that executes the joint kinematics while accounting for delays, and an inter-leg coordinator. The model generates realistic simulated walking that matches real fly walking kinematics and sustains walking even when subjected to unexpected perturbations, generalizing beyond its training data. However, we found that the model's robustness to perturbations deteriorates when sensorimotor delay parameters exceed the physiological range. These results suggest that fly sensorimotor control circuits operate close to the temporal limit at which they can detect and respond to external perturbations. More broadly, we show how a modular, layered model architecture can be used to investigate physiological constraints on animal behavior.

Robustness and complexity

When a system robustly corrects component-level errors, the direct pressure on component performance declines. Components become less reliable, maintain more genetic variability, or drift neutrally, creating new forms of complexity. Examples include the hourglass pattern of biological development and the hourglass architecture for robustly complex systems in engineering.

Redefining stroke rehabilitation: Mobilizing the embodied goal-oriented brain

Advancements in stroke rehabilitation remain limited and call for a reorientation. Based on recent results, this study proposes a network-centric perspective on stroke, positing that it not only causes localized deficits but also affects the brain's intricate network of networks, transiting it into a pathological state. Translating these system-level insights into interventions requires brain theory, and the Distributed Adaptive Control (DAC) theory offers such a framework. When applied in the rehabilitation gaming system, these principles demonstrate superior results over conventional methods. This impact stems from activating extensive brain networks, particularly the executive control network, focused motor learning, and maintaining excitatory-inhibitory balance, which is essential for neural repair and functional reorganization. The analysis stresses uniting preclinical and clinical research and placing the architecture of the embodied volitional brain at the centre of rehabilitation approaches.

Collective synchrony of mating signals modulated by ecological cues and social signals in bioluminescent sea fireflies

Individuals often employ simple rules that can emergently synchronize behaviour. Some collective behaviours are intuitively beneficial, but others like mate signalling in leks occur across taxa despite theoretical individual costs. Whether disparate instances of synchronous signalling are similarly organized is unknown, largely due to challenges observing many individuals simultaneously. Recording field collectives and ex situ playback experiments, we describe principles of synchronous bioluminescent signals produced by marine ostracods (Crustacea; Luxorina) that seem behaviorally convergent with terrestrial fireflies, and with whom they last shared a common ancestor over 500 Mya. Like synchronous fireflies, groups of signalling males use visual cues (intensity and duration of light) to decide when to signal. Individual ostracods also modulate their signal based on the distance to nearest neighbours. During peak darkness, luminescent 'waves' of synchronous displays emerge and ripple across the sea floor approximately every 60 s, but such periodicity decays within and between nights after the full moon. Our data reveal these bioluminescent aggregations are sensitive to both ecological and social light sources. Because the function of collective signals is difficult to dissect, evolutionary convergence, like in the synchronous visual displays of diverse arthropods, provides natural replicates to understand the generalities that produce emergent group behaviour.

An insect-inspired model facilitating autonomous navigation by incorporating goal approaching and collision avoidance

Being one of the most fundamental and crucial capacity of robots and animals, autonomous navigation that consists of goal approaching and collision avoidance enables completion of various tasks while traversing different environments. In light of the impressive navigational abilities of insects despite their tiny brains compared to mammals, the idea of seeking solutions from insects for the two key problems of navigation, i.e., goal approaching and collision avoidance, has fascinated researchers and engineers for many years. However, previous bio-inspired studies have focused on merely one of these two problems at one time. Insect-inspired navigation algorithms that synthetically incorporate both goal approaching and collision avoidance, and studies that investigate the interactions of these two mechanisms in the context of sensory-motor closed-loop autonomous navigation are lacking. To fill this gap, we propose an insect-inspired autonomous navigation algorithm to integrate the goal approaching mechanism as the global working memory inspired by the sweat bee's path integration (PI) mechanism, and the collision avoidance model as the local immediate cue built upon the locust's lobula giant movement detector (LGMD) model. The presented algorithm is utilized to drive agents to complete navigation task in a sensory-motor closed-loop manner within a bounded static or dynamic environment. Simulation results demonstrate that the synthetic algorithm is capable of guiding the agent to complete challenging navigation tasks in a robust and efficient way. This study takes the first tentative step to integrate the insect-like navigation mechanisms with different functionalities (i.e., global goal and local interrupt) into a coordinated control system that future research avenues could build upon.

Understanding brain functional architecture through robotics

Robotics is increasingly seen as a useful test bed for computational models of the brain functional architecture underlying animal behavior. We provide an overview of past and current work, focusing on probabilistic and dynamical models, including approaches premised on the free energy principle, situating this endeavor in relation to evidence that the brain constitutes a layered control system. We argue that future neurorobotic models should integrate multiple neurobiological constraints and be hybrid in nature.

Layered feedback control overcomes performance trade-off in synthetic biomolecular networks

Layered feedback is an optimization strategy in feedback control designs widely used in engineering. Control theory suggests that layering multiple feedbacks could overcome the robustness-speed performance trade-off limit. In natural biological networks, genes are often regulated in layers to adapt to environmental perturbations. It is hypothesized layering architecture could also overcome the robustness-speed performance trade-off in genetic networks. In this work, we validate this hypothesis with a synthetic biomolecular network in living E. coli cells. We start with system dynamics analysis using models of various complexities to guide the design of a layered control architecture in living cells. Experimentally, we interrogate system dynamics under three groups of perturbations. We consistently observe that the layered control improves system performance in the robustness-speed domain. This work confirms that layered control could be adopted in synthetic biomolecular networks for performance optimization. It also provides insights into understanding genetic feedback control architectures in nature.

Scaffolding layered control architectures through constraint closure: insights into brain evolution and development

The functional organization of the mammalian brain can be considered to form a layered control architecture, but how this complex system has emerged through evolution and is constructed during development remains a puzzle. Here we consider brain organization through the framework of constraint closure, viewed as a general characteristic of living systems, that they are composed of multiple sub-systems that constrain each other at different timescales. We do so by developing a new formalism for constraint closure, inspired by a previous model showing how within-lifetime dynamics can constrain between-lifetime dynamics, and we demonstrate how this interaction can be generalized to multi-layered systems. Through this model, we consider brain organization in the context of two major examples of constraint closure-physiological regulation and visual orienting. Our analysis draws attention to the capacity of layered brain architectures to scaffold themselves across multiple timescales, including the ability of cortical processes to constrain the evolution of sub-cortical processes, and of the latter to constrain the space in which cortical systems self-organize and refine themselves. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

How the insect central complex could coordinate multimodal navigation

The central complex of the insect midbrain is thought to coordinate insect guidance strategies. Computational models can account for specific behaviours, but their applicability across sensory and task domains remains untested. Here, we assess the capacity of our previous model (Sun et al. 2020) of visual navigation to generalise to olfactory navigation and its coordination with other guidance in flies and ants. We show that fundamental to this capacity is the use of a biologically plausible neural copy-and-shift mechanism that ensures sensory information is presented in a format compatible with the insect steering circuit regardless of its source. Moreover, the same mechanism is shown to allow the transfer cues from unstable/egocentric to stable/geocentric frames of reference, providing a first account of the mechanism by which foraging insects robustly recover from environmental disturbances. We propose that these circuits can be flexibly repurposed by different insect navigators to address their unique ecological needs.

Divergent COVID-19 Disease Trajectories Predicted by a DAMP-Centered Immune Network Model

COVID-19 presentations range from mild to moderate through severe disease but also manifest with persistent illness or viral recrudescence. We hypothesized that the spectrum of COVID-19 disease manifestations was a consequence of SARS-CoV-2-mediated delay in the pathogen-associated molecular pattern (PAMP) response, including dampened type I interferon signaling, thereby shifting the balance of the immune response to be dominated by damage-associated molecular pattern (DAMP) signaling. To test the hypothesis, we constructed a parsimonious mechanistic mathematical model. After calibration of the model for initial viral load and then by varying a few key parameters, we show that the core model generates four distinct viral load, immune response and associated disease trajectories termed “patient archetypes”, whose temporal dynamics are reflected in clinical data from hospitalized COVID-19 patients. The model also accounts for responses to corticosteroid therapy and predicts that vaccine-induced neutralizing antibodies and cellular memory will be protective, including from severe COVID-19 disease. This generalizable modeling framework could be used to analyze protective and pathogenic immune responses to diverse viral infections.

Modeling the subjective perspective of consciousness and its role in the control of behaviours

Consciousness has been hypothesized to operate as a global workspace, which accesses and integrates multimodal information in a uni_ed manner, supports expectation violation monitoring and reduction, and the motivation, programming and control of action. One important yet open issue concerns how the subjective perspective at the core of consciousness, and subjective properties of manifestation of the environment in such perspective as an embodied experience, play a role in such process. We operationalised the concept of subjective perspective using the principles of the Projective Consciousness Model (PCM), based on the projective geometrical concept of Field of Consciousness. We show how these principles can account for documented relationships between appraisal and distance as an inverse distance law, yield a generative model of a_ective and epistemic drives based on purely subjective parameters, such as the apparent size of objects, and can be generalised to implement Theory of Mind, in a manner that is consistent with simulation theory. We used simulations of arti_cial agents, based on psychological rationale, to demonstrate how different model parameters could generate a variety of emergent adaptive and maladaptive behaviours that are relevant to developmental and clinical psychology: the ability to be resilient in the face of obstacles through imaginary projections, the emergence of social approach and joint attention behaviours, the ability to take advantage of false beliefs attributed to others, the emergence of avoidance behaviours as observed in social anxiety disorders, the presence of restricted interests as observed in autism spectrum disorders. The simulation of agents was applied to a speci_c robotic context, and agents' behaviours were demonstrated by controlling the corresponding robots. Our results contribute to advance the scienti_c understanding of the causal relationships between core aspects of the phenomenology of consciousness and its functions in human cybernetics.

Expect the Unexpected: Leveraging the Human-Robot Ecosystem to Handle Unexpected Robot Failures

Unexpected robot failures are inevitable. We propose to leverage socio-technical relations within the human-robot ecosystem to support adaptable strategies for handling unexpected failures. The Theory of Graceful Extensibility is used to understand how characteristics of the ecosystem can influence its ability to respond to unexpected events. By expanding our perspective from Human-Robot Interaction to the Human-Robot Ecosystem, adaptable failure-handling strategies are identified, alongside technical, social and organizational arrangements that are needed to support them. We argue that robotics and HRI communities should pursue more holistic approaches to failure-handling, recognizing the need to embrace the unexpected and consider socio-technical relations within the human robot ecosystem when designing failure-handling strategies.

The Integrated Information Theory of consciousness: A case of mistaken identity

Giulio Tononi's Integrated Information Theory (IIT) proposes explaining consciousness by directly identifying it with integrated information. We examine the construct validity of IIT's measure of consciousness, phi (Φ), by analyzing its formal properties, its relation to key aspects of consciousness, and its co-variation with relevant empirical circumstances. Our analysis shows that IIT's identification of consciousness with the causal efficacy with which differentiated networks accomplish global information transfer (which is what Φ in fact measures) is mistaken. This misidentification has the consequence of requiring the attribution of consciousness to a range of natural systems and artifacts that include, but are not limited to, large-scale electrical power grids, gene-regulation networks, some electronic circuit boards, and social networks. Instead of treating this consequence of the theory as a disconfirmation, IIT embraces it. By regarding these systems as bearers of consciousness ex hypothesi, IIT is led towards the orbit of panpsychist ideation. This departure from science as we know it can be avoided by recognizing the functional misattribution at the heart of IIT's identity claim. We show, for example, what function is actually performed, at least in the human case, by the cortical combination of differentiation with integration that IIT identifies with consciousness. Finally, we examine what lessons may be drawn from IIT's failure to provide a credible account of consciousness for progress in the very active field of research concerned with exploring the phenomenon from formal and neural points of view.

Why Do Big Data and Machine Learning Entail the Fractional Dynamics?

Fractional-order calculus is about the differentiation and integration of non-integer orders. Fractional calculus (FC) is based on fractional-order thinking (FOT) and has been shown to help us to understand complex systems better, improve the processing of complex signals, enhance the control of complex systems, increase the performance of optimization, and even extend the enabling of the potential for creativity. In this article, the authors discuss the fractional dynamics, FOT and rich fractional stochastic models. First, the use of fractional dynamics in big data analytics for quantifying big data variability stemming from the generation of complex systems is justified. Second, we show why fractional dynamics is needed in machine learning and optimal randomness when asking: "is there a more optimal way to optimize?". Third, an optimal randomness case study for a stochastic configuration network (SCN) machine-learning method with heavy-tailed distributions is discussed. Finally, views on big data and (physics-informed) machine learning with fractional dynamics for future research are presented with concluding remarks.

Curing the broken brain model of addiction: Neurorehabilitation from a systems perspective

The dominant biomedical perspective on addictions has been that they are chronic brain diseases. While we acknowledge that the brains of people with addictions differ from those without, we argue that the "broken brain" model of addiction has important limitations. We propose that a systems-level perspective more effectively captures the integrated architecture of the embodied and situated human mind and brain in relation to the development of addictions. This more dynamic conceptualization places addiction in the broader context of the addicted brain that drives behavior, where the addicted brain is the substrate of the addicted mind, that in turn is situated in a physical and socio-cultural environment. From this perspective, neurorehabilitation should shift from a "broken-brain" to a systems theoretical framework, which includes high-level concepts related to the physical and social environment, motivation, self-image, and the meaning of alternative activities, which in turn will dynamically influence subsequent brain adaptations. We call this integrated approach system-oriented neurorehabilitation. We illustrate our proposal by showing the link between addiction and the architecture of the embodied brain, including a systems-level perspective on classical conditioning, which has been successfully translated into neurorehabilitation. Central to this example is the notion that the human brain makes predictions on future states as well as expected (or counterfactual) errors, in the context of its goals. We advocate system-oriented neurorehabilitation of addiction where the patients' goals are central in targeted, personalized assessment and intervention.

Principles of convergence in nature and society and their application: from nanoscale, digits, and logic steps to global progress

Knowledge, technology, and society as well as natural systems are increasingly coherent and complex, and new systems are continuously formed at their interfaces. Convergence is a problem-solving strategy to holistically understand, create, and transform a system for reaching a common goal, such as advancing an emerging technology in society. The systems may be either in natural, scientific, technological, economic, or societal settings. Convergence offers a unifying strategy applicable to all systems that can be modeled as evolving neural-like networks. The paper presents an overview of the convergence science including underlying theories, principles, and methods and illustrates its implementation in key areas of application. The convergence approach begins with deep integration of previously separated fields, communities, and modes of thinking, to form and improve a new system, from where solutions divergence to previously unattainable applications and outcomes. The worldwide science and technology (S&T) landscape is changing at the beginning of the twenty-first century because of convergence. First, there is the affirmation of three transdisciplinary general-purpose technologies-nanotechnology, digital technology, and artificial intelligence (AI). A second main characteristics is the deep integration of five foundational science and technology fields (NBICA: nanoscale, modern biology, information, cognition, and artificial intelligence) from their basic elements-atoms, genes, bits, neurons, and logic steps and their collective action-to address global challenges and opportunities. The affirmation of nanotechnology at the confluence of disciplines toward systematic control of matter at the nanoscale has been an enabling inspiration and foundation for other S&T fields, emerging industries, and convergence solutions in society. Several future opportunities for implementation of convergence principles are the global S&T system, realizing sustainable society, advancing human capabilities, and conflict resolution.

Supramodal Mechanisms of the Cognitive Control Network in Uncertainty Processing

Information processing under conditions of uncertainty requires the involvement of cognitive control. Despite behavioral evidence of the supramodal function (i.e., independent of sensory modality) of cognitive control, the underlying neural mechanism needs to be directly tested. This study used functional magnetic imaging together with visual and auditory perceptual decision-making tasks to examine brain activation as a function of uncertainty in the two stimulus modalities. The results revealed a monotonic increase in activation in the cortical regions of the cognitive control network (CCN) as a function of uncertainty in the visual and auditory modalities. The intrinsic connectivity between the CCN and sensory regions was similar for the visual and auditory modalities. Furthermore, multivariate patterns of activation in the CCN predicted the level of uncertainty within and across stimulus modalities. These findings suggest that the CCN implements cognitive control by processing uncertainty as abstract information independent of stimulus modality.

Regulating cellular cyclic adenosine monophosphate: "Sources," "sinks," and now, "tunable valves"

A number of hormones and growth factors stimulate target cells via the second messenger pathways, which in turn regulate cellular phenotypes. Cyclic adenosine monophosphate (cAMP) is a ubiquitous second messenger that facilitates numerous signal transduction pathways; its production in cells is tightly balanced by ligand-stimulated receptors that activate adenylate cyclases (ACs), that is, "source" and by phosphodiesterases (PDEs) that hydrolyze it, that is, "sinks." Because it regulates various cellular functions, including cell growth and differentiation, gene transcription and protein expression, the cAMP signaling pathway has been exploited for the treatment of numerous human diseases. Reduction in cAMP is achieved by blocking "sources"; however, elevation in cAMP is achieved by either stimulating "source" or blocking "sinks." Here we discuss an alternative paradigm for the regulation of cellular cAMP via GIV/Girdin, the prototypical member of a family of modulators of trimeric GTPases, Guanine nucleotide Exchange Modulators (GEMs). Cells upregulate or downregulate cellular levels of GIV-GEM, which modulates cellular cAMP via spatiotemporal mechanisms distinct from the two most often targeted classes of cAMP modulators, "sources" and "sinks." A network-based compartmental model for the paradigm of GEM-facilitated cAMP signaling has recently revealed that GEMs such as GIV serve much like a "tunable valve" that cells may employ to finetune cellular levels of cAMP. Because dysregulated signaling via GIV and other GEMs has been implicated in multiple disease states, GEMs constitute a hitherto untapped class of targets that could be exploited for modulating aberrant cAMP signaling in disease states. This article is categorized under: Models of Systems Properties and Processes > Mechanistic Models Biological Mechanisms > Cell Signaling.

Travel in city road networks follows similar transport trade-off principles to neural and plant arbors

Both engineered and biological transportation networks face trade-offs in their design. Network users desire to quickly get from one location in the network to another, whereas network planners need to minimize costs in building infrastructure. Here, we use the theory of Pareto optimality to study this design trade-off in the road networks of 101 cities, with wide-ranging population sizes, land areas and geographies. Using a simple one parameter trade-off function, we find that most cities lie near the Pareto front and are significantly closer to the front than expected by alternate design structures. To account for other optimization dimensions or constraints that may be important (e.g. traffic congestion, geography), we performed a higher-order Pareto optimality analysis and found that most cities analysed lie within a region of design space bounded by only four archetypal cities. The trade-offs studied here are also faced and well-optimized by two biological transport networks-neural arbors in the brain and branching architectures of plant shoots-suggesting similar design principles across some biological and engineered transport systems.

A predictive computational model reveals that GIV/girdin serves as a tunable valve for EGFR-stimulated cyclic AMP signals

Cellular levels of the versatile second messenger cyclic (c)AMP are regulated by the antagonistic actions of the canonical G protein → adenylyl cyclase pathway that is initiated by G-protein–coupled receptors (GPCRs) and attenuated by phosphodiesterases (PDEs). Dysregulated cAMP signaling drives many diseases; for example, its low levels facilitate numerous sinister properties of cancer cells. Recently, an alternative paradigm for cAMP signaling has emerged in which growth factor–receptor tyrosine kinases (RTKs; e.g., EGFR) access and modulate G proteins via a cytosolic guanine-nucleotide exchange modulator (GEM), GIV/girdin; dysregulation of this pathway is frequently encountered in cancers. In this study, we present a network-based compartmental model for the paradigm of GEM-facilitated cross-talk between RTKs and G proteins and how that impacts cellular cAMP. Our model predicts that cross-talk between GIV, Gα_s, and Gα_i proteins dampens ligand-stimulated cAMP dynamics. This prediction was experimentally verified by measuring cAMP levels in cells under different conditions. We further predict that the direct proportionality of cAMP concentration as a function of receptor number and the inverse proportionality of cAMP concentration as a function of PDE concentration are both altered by GIV levels. Taking these results together, our model reveals that GIV acts as a tunable control valve that regulates cAMP flux after growth factor stimulation. For a given stimulus, when GIV levels are high, cAMP levels are low, and vice versa. In doing so, GIV modulates cAMP via mechanisms distinct from the two most often targeted classes of cAMP modulators, GPCRs and PDEs.

The Crisis of Reproducibility, the Denominator Problem and the Scientific Role of Multi-scale Modeling

The “Crisis of Reproducibility” has received considerable attention both within the scientific community and without. While factors associated with scientific culture and practical practice are most often invoked, I propose that the Crisis of Reproducibility is ultimately a failure of generalization with a fundamental scientific basis in the methods used for biomedical research. The Denominator Problem describes how limitations intrinsic to the two primary approaches of biomedical research, clinical studies and preclinical experimental biology, lead to an inability to effectively characterize the full extent of biological heterogeneity, which compromises the task of generalizing acquired knowledge. Drawing on the example of the unifying role of theory in the physical sciences, I propose that multi-scale mathematical and dynamic computational models, when mapped to the modular structure of biological systems, can serve a unifying role as formal representations of what is conserved and similar from one biological context to another. This ability to explicitly describe the generation of heterogeneity from similarity addresses the Denominator Problem and provides a scientific response to the Crisis of Reproducibility.

Optimal feedback control to describe multiple representations of primary motor cortex neurons

Primary motor cortex (M1) neurons are tuned in response to several parameters related to motor control, and it was recently reported that M1 is important in feedback control. However, it remains unclear how M1 neurons encode information to control the musculoskeletal system. In this study, we examined the underlying computational mechanisms of M1 based on optimal feedback control (OFC) theory, which is a plausible hypothesis for neuromotor control. We modelled an isometric torque production task that required joint torque to be regulated and maintained at desired levels in a musculoskeletal system physically constrained by muscles, which act by pulling rather than pushing. Then, a feedback controller was computed using an optimisation approach under the constraint. In the presence of neuromotor noise, known as signal-dependent noise, the sensory feedback gain is tuned to an extrinsic motor output, such as the hand force, like a population response of M1 neurons. Moreover, a distribution of the preferred directions (PDs) of M1 neurons can be predicted via feedback gain. Therefore, we suggest that neural activity in M1 is optimised for the musculoskeletal system. Furthermore, if the feedback controller is represented in M1, OFC can describe multiple representations of M1, including not only the distribution of PDs but also the response of the neuronal population.

Coordination of Orofacial Motor Actions into Exploratory Behavior by Rat

The delineation of sensorimotor circuits that guide exploration begins with an understanding of the pattern of motor outputs [1]. These motor patterns provide a clue to the form of the underlying circuits [2-4] (but see [5]). We focus on the behaviors that rodents use to explore their peripersonal space through goal-directed positioning of their nose, head, and vibrissae. Rodents sniff in response to novel odors, reward expectation, and as part of social interactions [6-12]. Sniffing serves olfaction [13, 14], while whisking synchronized to sniffing serves vibrissa-based touch [6, 15, 16]. We quantify the ethology of exploratory nose and head movements in relation to breathing. We find that sniffing is accompanied by prominent lateral and vertical deflections of the nose, i.e., twitches, which are driven by activation of the deflector nasi muscles [17]. On the timescale of individual breaths, nose motion is rhythmic and has a maximum deflection following the onset of inspiration. On a longer timescale, excursions of the nose persist for several breaths and are accompanied by an asymmetry in vibrissa positioning toward the same side of the face. Such directed deflections can be triggered by a lateralized source of odor. Lastly, bobbing of the head as the animal cranes and explores is phase-locked to sniffing and to movement of the nose. These data, along with prior results on the resetting of the whisk cycle at the onset of inspiration [15, 16, 18], reveal that the onset of each breath initiates a "snapshot" of the orofacial sensory environment. VIDEO ABSTRACT.

Multiscale Modeling in the Clinic: Drug Design and Development

A wide range of length and time scales are relevant to pharmacology, especially in drug development, drug design and drug delivery. Therefore, multiscale computational modeling and simulation methods and paradigms that advance the linkage of phenomena occurring at these multiple scales have become increasingly important. Multiscale approaches present in silico opportunities to advance laboratory research to bedside clinical applications in pharmaceuticals research. This is achievable through the capability of modeling to reveal phenomena occurring across multiple spatial and temporal scales, which are not otherwise readily accessible to experimentation. The resultant models, when validated, are capable of making testable predictions to guide drug design and delivery. In this review we describe the goals, methods, and opportunities of multiscale modeling in drug design and development. We demonstrate the impact of multiple scales of modeling in this field. We indicate the common mathematical and computational techniques employed for multiscale modeling approaches used in pharmacometric and systems pharmacology models in drug development and present several examples illustrating the current state-of-the-art models for (1) excitable systems and applications in cardiac disease; (2) stem cell driven complex biosystems; (3) nanoparticle delivery, with applications to angiogenesis and cancer therapy; (4) host-pathogen interactions and their use in metabolic disorders, inflammation and sepsis; and (5) computer-aided design of nanomedical systems. We conclude with a focus on barriers to successful clinical translation of drug development, drug design and drug delivery multiscale models.

Actuating critical care therapeutics

Viewing the intensive care unit (ICU) as a control system with inputs (patients) and outputs (outcomes), we focus on actuation (therapies) of the system and how to enhance our understanding of status of patients and their trajectory in the ICU. To incorporate the results of these analytics meaningfully, we feel that a reassessment of predictive scoring systems and of ways to optimally characterize and display the patient's "state space" to clinicians is important. Advances in sensing (diagnostics) and computation have not yet led to significantly better actuation, and so we focus on ways that data can be used to improve actuation in the ICU, in particular by following therapeutic burden along with disease severity. This article is meant to encourage discussion about how the critical care community can best deal with the data they see each day, and prepare for recommendations that will inevitably arise from application of major federal and state initiatives in big data analytics and precision medicine.

Information processing by simple molecular motifs and susceptibility to noise

Biological organisms rely on their ability to sense and respond appropriately to their environment. The molecular mechanisms that facilitate these essential processes are however subject to a range of random effects and stochastic processes, which jointly affect the reliability of information transmission between receptors and, for example, the physiological downstream response. Information is mathematically defined in terms of the entropy; and the extent of information flowing across an information channel or signalling system is typically measured by the 'mutual information', or the reduction in the uncertainty about the output once the input signal is known. Here, we quantify how extrinsic and intrinsic noise affects the transmission of simple signals along simple motifs of molecular interaction networks. Even for very simple systems, the effects of the different sources of variability alone and in combination can give rise to bewildering complexity. In particular, extrinsic variability is apt to generate 'apparent' information that can, in extreme cases, mask the actual information that for a single system would flow between the different molecular components making up cellular signalling pathways. We show how this artificial inflation in apparent information arises and how the effects of different types of noise alone and in combination can be understood.

The natural defense system and the normative self model

Infectious agents are not the only agressors, and the immune system is not the sole defender of the organism. In an enlarged perspective, the ‘normative self model’ postulates that a ‘natural defense system’ protects man and other complex organisms against the environmental and internal hazards of life, including infections and cancers. It involves multiple error detection and correction mechanisms that confer robustness to the body at all levels of its organization. According to the model, the self relies on a set of physiological norms, and NONself (meaning : Non Obedient to the Norms of the self) is anything ‘off-norms’. The natural defense system comprises a set of ‘civil defenses’ (to which all cells in organs and tissues contribute), and a ‘professional army ‘, made of a smaller set of mobile cells. Mobile and non mobile cells differ in their tuning abilities. Tuning extends the recognition capabilities of NONself by the mobile cells, which increase their defensive function. To prevent them to drift, which would compromise self/NONself discrimination, the more plastic mobile cells need to periodically refer to the more stable non mobile cells to keep within physiological standards.

Expanding perspectives on cognition in humans, animals, and machines

Over the past decade neuroscience has been attacking the problem of cognition with increasing vigor. Yet, what exactly is cognition, beyond a general signifier of anything seemingly complex the brain does? Here, we briefly review attempts to define, describe, explain, build, enhance and experience cognition. We highlight perspectives including psychology, molecular biology, computation, dynamical systems, machine learning, behavior and phenomenology. This survey of the landscape reveals not a clear target for explanation but a pluralistic and evolving scene with diverse opportunities for grounding future research. We argue that rather than getting to the bottom of it, over the next century, by deconstructing and redefining cognition, neuroscience will and should expand rather than merely reduce our concept of the mind.

Motor cortex is required for learning but not for executing a motor skill

Motor cortex is widely believed to underlie the acquisition and execution of motor skills, but its contributions to these processes are not fully understood. One reason is that studies on motor skills often conflate motor cortex's established role in dexterous control with roles in learning and producing task-specific motor sequences. To dissociate these aspects, we developed a motor task for rats that trains spatiotemporally precise movement patterns without requirements for dexterity. Remarkably, motor cortex lesions had no discernible effect on the acquired skills, which were expressed in their distinct pre-lesion forms on the very first day of post-lesion training. Motor cortex lesions prior to training, however, rendered rats unable to acquire the stereotyped motor sequences required for the task. These results suggest a remarkable capacity of subcortical motor circuits to execute learned skills and a previously unappreciated role for motor cortex in "tutoring" these circuits during learning.

Operational models of infrastructure resilience

We propose a definition of infrastructure resilience that is tied to the operation (or function) of an infrastructure as a system of interacting components and that can be objectively evaluated using quantitative models. Specifically, for any particular system, we use quantitative models of system operation to represent the decisions of an infrastructure operator who guides the behavior of the system as a whole, even in the presence of disruptions. Modeling infrastructure operation in this way makes it possible to systematically evaluate the consequences associated with the loss of infrastructure components, and leads to a precise notion of "operational resilience" that facilitates model verification, validation, and reproducible results. Using a simple example of a notional infrastructure, we demonstrate how to use these models for (1) assessing the operational resilience of an infrastructure system, (2) identifying critical vulnerabilities that threaten its continued function, and (3) advising policymakers on investments to improve resilience.

A Framework for Quantitative Modeling of Neural Circuits Involved in Sleep-to-Wake Transition

Identifying the neuronal circuits and dynamics of sleep-to-wake transition is essential to understanding brain regulation of behavioral states, including sleep–wake cycles, arousal, and hyperarousal. Recent work by different laboratories has used optogenetics to determine the role of individual neuromodulators in state transitions. The optogenetically driven data do not yet provide a multi-dimensional schematic of the mechanisms underlying changes in vigilance states. This work presents a modeling framework to interpret, assist, and drive research on the sleep-regulatory network. We identify feedback, redundancy, and gating hierarchy as three fundamental aspects of this model. The presented model is expected to expand as additional data on the contribution of each transmitter to a vigilance state becomes available. Incorporation of conductance-based models of neuronal ensembles into this model and existing models of cortical excitability will provide more comprehensive insight into sleep dynamics as well as sleep and arousal-related disorders.

Engineering control into medicine

The human body is a tightly controlled engineering miracle. However, medical training generally does not cover "control" (in the engineering sense) in physiology, pathophysiology, and therapeutics. A better understanding of how evolved controls maintain normal homeostasis is critical for understanding the failure mode of controlled systems, that is, disease. We believe that teaching and research must incorporate an understanding of the control systems in physiology and take advantage of the quantitative tools used by engineering to understand complex systems. Control systems are ubiquitous in physiology, although often unrecognized. Here we provide selected examples of the role of control in physiology (heart rate variability, immunity), pathophysiology (inflammation in sepsis), and therapeutic devices (diabetes and the artificial pancreas). We also present a high-level background to the concept of robustly controlled systems and examples of clinical insights using the controls framework.

A unifying computational framework for stability and flexibility of arousal

Arousal and consciousness flexibly adjust to salient cues, but remain stable despite noise and disturbance. Diverse, highly interconnected neural networks govern the underlying transitions of behavioral state; these networks are robust but very complex. Frameworks from systems engineering provide powerful tools for understanding functional logic behind component complexity. From a general systems viewpoint, a minimum of three communicating control modules may enable flexibility and stability to coexist. Comparators would subtract current arousal from desired arousal, producing an error signal. Regulators would compute control signals from this error. Generators would convert control signals into arousal, which is fed back to comparators, to make the system noise-proof through self-correction. Can specific neurons correspond to these control elements? To explore this, here we consider the brain-wide orexin/hypocretin network, which is experimentally established to be vital for flexible and stable arousal. We discuss whether orexin neurons may act as comparators, and their target neurons as regulators and generators. Experiments are proposed for testing such predictions, based on computational simulations showing that comparators, regulators, and generators have distinct temporal signatures of activity. If some regulators integrate orexin-communicated errors, robust arousal control may be achieved via integral feedback (a basic engineering strategy for tracking a set-point despite noise). An integral feedback view also suggests functional roles for specific molecular aspects, such as differing life-spans of orexin peptides. The proposed framework offers a unifying logic for molecular, cellular, and network details of arousal systems, and provides insight into behavioral state transitions, complex behavior, and bases for disease.

Mini-max feedback control as a computational theory of sensorimotor control in the presence of structural uncertainty

We propose a mini-max feedback control (MMFC) model as a robust approach to human motor control under conditions of uncertain dynamics, such as structural uncertainty. The MMFC model is an expansion of the optimal feedback control (OFC) model. According to this scheme, motor commands are generated to minimize the maximal cost, based on an assumption of worst-case uncertainty, characterized by familiarity with novel dynamics. We simulated linear dynamic systems with different types of force fields–stable and unstable dynamics–and compared the performance of MMFC to that of OFC. MMFC delivered better performance than OFC in terms of stability and the achievement of tasks. Moreover, the gain in positional feedback with the MMFC model in the unstable dynamics was tuned to the direction of instability. It is assumed that the shape modulations of the gain in positional feedback in unstable dynamics played the same role as that played by end-point stiffness observed in human studies. Accordingly, we suggest that MMFC is a plausible model that predicts motor behavior under conditions of uncertain dynamics.

The emotion system promotes diversity and evolvability

Studies on the relationship between the optimal phenotype and its environment have had limited focus on genotype-to-phenotype pathways and their evolutionary consequences. Here, we study how multi-layered trait architecture and its associated constraints prescribe diversity. Using an idealized model of the emotion system in fish, we find that trait architecture yields genetic and phenotypic diversity even in absence of frequency-dependent selection or environmental variation. That is, for a given environment, phenotype frequency distributions are predictable while gene pools are not. The conservation of phenotypic traits among these genetically different populations is due to the multi-layered trait architecture, in which one adaptation at a higher architectural level can be achieved by several different adaptations at a lower level. Our results emphasize the role of convergent evolution and the organismal level of selection. While trait architecture makes individuals more constrained than what has been assumed in optimization theory, the resulting populations are genetically more diverse and adaptable. The emotion system in animals may thus have evolved by natural selection because it simultaneously enhances three important functions, the behavioural robustness of individuals, the evolvability of gene pools and the rate of evolutionary innovation at several architectural levels.

Robust efficiency and actuator saturation explain healthy heart rate control and variability

The correlation of healthy states with heart rate variability (HRV) using time series analyses is well documented. Whereas these studies note the accepted proximal role of autonomic nervous system balance in HRV patterns, the responsible deeper physiological, clinically relevant mechanisms have not been fully explained. Using mathematical tools from control theory, we combine mechanistic models of basic physiology with experimental exercise data from healthy human subjects to explain causal relationships among states of stress vs. health, HR control, and HRV, and more importantly, the physiologic requirements and constraints underlying these relationships. Nonlinear dynamics play an important explanatory role--most fundamentally in the actuator saturations arising from unavoidable tradeoffs in robust homeostasis and metabolic efficiency. These results are grounded in domain-specific mechanisms, tradeoffs, and constraints, but they also illustrate important, universal properties of complex systems. We show that the study of complex biological phenomena like HRV requires a framework which facilitates inclusion of diverse domain specifics (e.g., due to physiology, evolution, and measurement technology) in addition to general theories of efficiency, robustness, feedback, dynamics, and supporting mathematical tools.

An agent-based modeling framework linking inflammation and cancer using evolutionary principles: description of a generative hierarchy for the hallmarks of cancer and developing a bridge between mechanism and epidemiological data

Inflammation plays a critical role in the development and progression of cancer, evident in multiple patient populations manifesting increased, non-resolving inflammation, such as inflammatory bowel disease, viral hepatitis and obesity. Given the complexity of both the inflammatory response and the process of oncogenesis, we utilize principles from the field of Translational Systems Biology to bridge the gap between basic mechanistic knowledge and clinical/epidemiologic data by integrating inflammation and oncogenesis within an agent-based model, the Inflammation and Cancer Agent-based Model (ICABM). The ICABM utilizes two previously published and clinically/epidemiologically validated mechanistic models to demonstrate the role of an increased inflammatory milieu on oncogenesis. Development of the ICABM required the creation of a generative hierarchy of the basic hallmarks of cancer to provide a foundation to ground the plethora of molecular and pathway components currently being studied. The ordering schema emphasizes the essential role of a fitness/selection frame shift to sub-organismal evolution as a basic property of cancer, where the generation of genetic instability as a negative effect for multicellular eukaryotic organisms represents the restoration of genetic plasticity used as an adaptive strategy by colonies of prokaryotic unicellular organisms. Simulations with the ICABM demonstrate that inflammation provides a functional environmental context that drives the shift to sub-organismal evolution, where increasingly inflammatory environments led to increasingly damaged genomes in microtumors (tumors below clinical detection size) and cancers. The flexibility of this platform readily facilitates tailoring the ICABM to specific cancers, their associated mechanisms and available epidemiological data. One clinical example of an epidemiological finding that could be investigated with this platform is the increased incidence of triple negative breast cancers in the premenopausal African-American population, which has been identified as having up-regulated of markers of inflammation. The fundamental nature of the ICABM suggests its usefulness as a base platform upon which additional molecular detail could be added as needed.

An explanatory evo-devo model for the developmental hourglass

The "developmental hourglass'' describes a pattern of increasing morphological divergence towards earlier and later embryonic development, separated by a period of significant conservation across distant species (the "phylotypic stage''). Recent studies have found evidence in support of the hourglass effect at the genomic level. For instance, the phylotypic stage expresses the oldest and most conserved transcriptomes. However, the regulatory mechanism that causes the hourglass pattern remains an open question. Here, we use an evolutionary model of regulatory gene interactions during development to identify the conditions under which the hourglass effect can emerge in a general setting. The model focuses on the hierarchical gene regulatory network that controls the developmental process, and on the evolution of a population under random perturbations in the structure of that network. The model predicts, under fairly general assumptions, the emergence of an hourglass pattern in the structure of a temporal representation of the underlying gene regulatory network. The evolutionary age of the corresponding genes also follows an hourglass pattern, with the oldest genes concentrated at the hourglass waist. The key behind the hourglass effect is that developmental regulators should have an increasingly specific function as development progresses. Analysis of developmental gene expression profiles from Drosophila melanogaster and Arabidopsis thaliana provide consistent results with our theoretical predictions.