Using Emulation to Engineer and Understand Simulations of Biological Systems

Incorporating temporal information during feature engineering bolsters emulation of spatio-temporal emergence

MOTIVATION

Emergent biological dynamics derive from the evolution of lower-level spatial and temporal processes. A long-standing challenge for scientists and engineers is identifying simple low-level rules that give rise to complex higher-level dynamics. High-resolution biological data acquisition enables this identification and has evolved at a rapid pace for both experimental and computational approaches. Simultaneously harnessing the resolution and managing the expense of emerging technologies-e.g. live cell imaging, scRNAseq, agent-based models-requires a deeper understanding of how spatial and temporal axes impact biological systems. Effective emulation is a promising solution to manage the expense of increasingly complex high-resolution computational models. In this research, we focus on the emulation of a tumor microenvironment agent-based model to examine the relationship between spatial and temporal environment features, and emergent tumor properties.

RESULTS

Despite significant feature engineering, we find limited predictive capacity of tumor properties from initial system representations. However, incorporating temporal information derived from intermediate simulation states dramatically improves the predictive performance of machine learning models. We train a deep-learning emulator on intermediate simulation states and observe promising enhancements over emulators trained solely on initial conditions. Our results underscore the importance of incorporating temporal information in the evaluation of spatio-temporal emergent behavior. Nevertheless, the emulators exhibit inconsistent performance, suggesting that the underlying model characterizes unique cell populations dynamics that are not easily replaced.

AVAILABILITY AND IMPLEMENTATION

All source codes for the agent-based model, emulation, and analyses are publicly available at the corresponding DOIs: 10.5281/zenodo.10622155, 10.5281/zenodo.10611675, 10.5281/zenodo.10621244, respectively.

Development and Analysis of Multiscale Models for Tuberculosis: From Molecules to Populations

Although infectious disease dynamics are often analyzed at the macro-scale, increasing numbers of drug-resistant infections highlight the importance of within-host modeling that simultaneously solves across multiple scales to effectively respond to epidemics. We review multiscale modeling approaches for complex, interconnected biological systems and discuss critical steps involved in building, analyzing, and applying such models within the discipline of model credibility. We also present our two tools: CaliPro, for calibrating multiscale models (MSMs) to datasets, and tunable resolution, for fine- and coarse-graining sub-models while retaining insights. We include as an example our work simulating infection with Mycobacterium tuberculosis to demonstrate modeling choices and how predictions are made to generate new insights and test interventions. We discuss some of the current challenges of incorporating novel datasets, rigorously training computational biologists, and increasing the reach of MSMs. We also offer several promising future research directions of incorporating within-host dynamics into applications ranging from combinatorial treatment to epidemic response.

A study of error diversity in robotic swarms for task partitioning in foraging tasks

Often in swarm robotics, an assumption is made that all robots in the swarm behave the same and will have a similar (if not the same) error model. However, in reality, this is not the case, and this lack of uniformity in the error model, and other operations, can lead to various emergent behaviors. This paper considers the impact of the error model and compares robots in a swarm that operate using the same error model (uniform error) against each robot in the swarm having a different error model (thus introducing error diversity). Experiments are presented in the context of a foraging task. Simulation and physical experimental results show the importance of the error model and diversity in achieving the expected swarm behavior.

Thymic B Cells as a New Player in the Type 1 Diabetes Response

Type 1 diabetes (T1d) results from a sustained autoreactive T and B cell response towards insulin-producing β cells in the islets of Langerhans. The autoreactive nature of the condition has led to many investigations addressing the genetic or cellular changes in primary lymphoid tissues that impairs central tolerance- a key process in the deletion of autoreactive T and B cells during their development. For T cells, these studies have largely focused on medullary thymic epithelial cells (mTECs) critical for the effective negative selection of autoreactive T cells in the thymus. Recently, a new cellular player that impacts positively or negatively on the deletion of autoreactive T cells during their development has come to light, thymic B cells. Normally a small population within the thymus of mouse and man, thymic B cells expand in T1d as well as other autoimmune conditions, reside in thymic ectopic germinal centres and secrete autoantibodies that bind selective mTECs precipitating mTEC death. In this review we will discuss the ontogeny, characteristics and functionality of thymic B cells in healthy and autoimmune settings. Furthermore, we explore how in silico approaches may help decipher the complex cellular interplay of thymic B cells with other cells within the thymic microenvironment leading to new avenues for therapeutic intervention.

Global sensitivity analysis of biological multi-scale models

Mathematical models of biological systems need to both reflect and manage the inherent complexities of biological phenomena. Through their versatility and ability to capture behavior at multiple scales, multi-scale models offer a valuable approach. Due to the typically nonlinear and stochastic nature of multi-scale models as well as unknown parameter values, various types of uncertainty are present; thus, effective assessment and quantification of such uncertainty through sensitivity analysis is important. In this review, we discuss global sensitivity analysis in the context of multi-scale and multi-compartment models and highlight its value in model development and analysis. We present an overview of sensitivity analysis methods, approaches for extending such methods to a multi-scale setting, and examples of how sensitivity analysis can inform model reduction. Through schematics and references to past work, we aim to emphasize the advantages and usefulness of such techniques.

Mechanistic Models of Cellular Signaling, Cytokine Crosstalk, and Cell-Cell Communication in Immunology

The cells of the immune system respond to a great variety of different signals that frequently reach them simultaneously. Computational models of signaling pathways and cellular behavior can help us explore the biochemical mechanisms at play during such responses, in particular when those models aim at incorporating molecular details of intracellular reaction networks. Such detailed models can encompass hypotheses about the interactions among molecular binding domains and how these interactions are modulated by, for instance, post-translational modifications, or steric constraints in multi-molecular complexes. In this way, the models become formal representations of mechanistic immunological hypotheses that can be tested through quantitative simulations. Due to the large number of parameters (molecular abundances, association-, dissociation-, and enzymatic transformation rates) the goal of simulating the models can, however, in many cases no longer be the fitting of particular parameter values. Rather, the simulations perform sweeps through parameter space to test whether a model can account for certain experimentally observed features when allowing the parameter values to vary within experimentally determined or physiologically reasonable ranges. We illustrate how this approach can be used to explore possible mechanisms of immunological pathway crosstalk. Probing the input-output behavior of mechanistic pathway models through systematic simulated variations of receptor stimuli will soon allow us to derive cell population behavior from single-cell models, thereby bridging a scale gap that currently still is frequently addressed through heuristic phenomenological multi-scale models.