Learning-accelerated discovery of immune-tumour interactions

A review of mechanistic learning in mathematical oncology

Mechanistic learning refers to the synergistic combination of mechanistic mathematical modeling and data-driven machine or deep learning. This emerging field finds increasing applications in (mathematical) oncology. This review aims to capture the current state of the field and provides a perspective on how mechanistic learning may progress in the oncology domain. We highlight the synergistic potential of mechanistic learning and point out similarities and differences between purely data-driven and mechanistic approaches concerning model complexity, data requirements, outputs generated, and interpretability of the algorithms and their results. Four categories of mechanistic learning (sequential, parallel, extrinsic, intrinsic) of mechanistic learning are presented with specific examples. We discuss a range of techniques including physics-informed neural networks, surrogate model learning, and digital twins. Example applications address complex problems predominantly from the domain of oncology research such as longitudinal tumor response predictions or time-to-event modeling. As the field of mechanistic learning advances, we aim for this review and proposed categorization framework to foster additional collaboration between the data- and knowledge-driven modeling fields. Further collaboration will help address difficult issues in oncology such as limited data availability, requirements of model transparency, and complex input data which are embraced in a mechanistic learning framework.

Digitize your Biology! Modeling multicellular systems through interpretable cell behavior

Cells are fundamental units of life, constantly interacting and evolving as dynamical systems. While recent spatial multi-omics can quantitate individual cells' characteristics and regulatory programs, forecasting their evolution ultimately requires mathematical modeling. We develop a conceptual framework-a cell behavior hypothesis grammar-that uses natural language statements (cell rules) to create mathematical models. This allows us to systematically integrate biological knowledge and multi-omics data to make them computable. We can then perform virtual "thought experiments" that challenge and extend our understanding of multicellular systems, and ultimately generate new testable hypotheses. In this paper, we motivate and describe the grammar, provide a reference implementation, and demonstrate its potential through a series of examples in tumor biology and immunotherapy. Altogether, this approach provides a bridge between biological, clinical, and systems biology researchers for mathematical modeling of biological systems at scale, allowing the community to extrapolate from single-cell characterization to emergent multicellular behavior.

PhysiBoSS 2.0: a sustainable integration of stochastic Boolean and agent-based modelling frameworks

In systems biology, mathematical models and simulations play a crucial role in understanding complex biological systems. Different modelling frameworks are employed depending on the nature and scales of the system under study. For instance, signalling and regulatory networks can be simulated using Boolean modelling, whereas multicellular systems can be studied using agent-based modelling. Herein, we present PhysiBoSS 2.0, a hybrid agent-based modelling framework that allows simulating signalling and regulatory networks within individual cell agents. PhysiBoSS 2.0 is a redesign and reimplementation of PhysiBoSS 1.0 and was conceived as an add-on that expands the PhysiCell functionalities by enabling the simulation of intracellular cell signalling using MaBoSS while keeping a decoupled, maintainable and model-agnostic design. PhysiBoSS 2.0 also expands the set of functionalities offered to the users, including custom models and cell specifications, mechanistic submodels of substrate internalisation and detailed control over simulation parameters. Together with PhysiBoSS 2.0, we introduce PCTK, a Python package developed for handling and processing simulation outputs, and generating summary plots and 3D renders. PhysiBoSS 2.0 allows studying the interplay between the microenvironment, the signalling pathways that control cellular processes and population dynamics, suitable for modelling cancer. We show different approaches for integrating Boolean networks into multi-scale simulations using strategies to study the drug effects and synergies in models of cancer cell lines and validate them using experimental data. PhysiBoSS 2.0 is open-source and publicly available on GitHub with several repositories of accompanying interoperable tools.

A computational modeling approach for predicting multicell spheroid patterns based on signaling-induced differential adhesion

Physiological and pathological processes including embryogenesis and tumorigenesis rely on the ability of individual cells to work collectively to form multicell patterns. In these heterogeneous multicell systems, cell-cell signaling induces differential adhesion between cells that leads to tissue-level patterning. However, the sensitivity of pattern formation to changes in the strengths of signaling or cell adhesion processes is not well understood. Prior work has explored these issues using synthetically engineered heterogeneous multicell spheroid systems, in which cell subpopulations engage in bidirectional intercellular signaling to regulate the expression of different cadherins. While engineered cell systems provide excellent experimental tools to observe pattern formation in cell populations, computational models of these systems may be leveraged to explore more systematically how specific combinations of signaling and adhesion parameters can drive the emergence of unique patterns. We developed and validated two- and three-dimensional agent-based models (ABMs) of spheroid patterning for previously described cells engineered with a bidirectional signaling circuit that regulates N- and P-cadherin expression. Systematic exploration of model predictions, some of which were experimentally validated, revealed how cell seeding parameters, the order of signaling events, probabilities of induced cadherin expression, and homotypic adhesion strengths affect pattern formation. Unsupervised clustering was also used to map combinations of signaling and adhesion parameters to these unique spheroid patterns predicted by the ABM. Finally, we demonstrated how the model may be deployed to design new synthetic cell signaling circuits based on a desired final multicell pattern.

Optimizing Dosage-Specific Treatments in a Multi-Scale Model of a Tumor Growth

The emergence of cell resistance in cancer treatment is a complex phenomenon that emerges from the interplay of processes that occur at different scales. For instance, molecular mechanisms and population-level dynamics such as competition and cell–cell variability have been described as playing a key role in the emergence and evolution of cell resistances. Multi-scale models are a useful tool for studying biology at very different times and spatial scales, as they can integrate different processes occurring at the molecular, cellular, and intercellular levels. In the present work, we use an extended hybrid multi-scale model of 3T3 fibroblast spheroid to perform a deep exploration of the parameter space of effective treatment strategies based on TNF pulses. To explore the parameter space of effective treatments in different scenarios and conditions, we have developed an HPC-optimized model exploration workflow based on EMEWS. We first studied the effect of the cells’ spatial distribution in the values of the treatment parameters by optimizing the supply strategies in 2D monolayers and 3D spheroids of different sizes. We later study the robustness of the effective treatments when heterogeneous populations of cells are considered. We found that our model exploration workflow can find effective treatments in all the studied conditions. Our results show that cells’ spatial geometry and population variability should be considered when optimizing treatment strategies in order to find robust parameter sets.

Supporting Computational Apprenticeship Through Educational and Software Infrastructure: A Case Study in a Mathematical Oncology Research Lab

There is growing awareness of the need for mathematics and computing to quantitatively understand the complex dynamics and feedbacks in the life sciences. Although several institutions and research groups are conducting pioneering multidisciplinary research, communication and education across fields remain a bottleneck. The opportunity is ripe for using education research-supported mechanisms of cross-disciplinary training at the intersection of mathematics, computation, and biology. This case study uses the computational apprenticeship theoretical framework to describe the efforts of a computational biology lab to rapidly prototype, test, and refine a mentorship infrastructure for undergraduate research experiences. We describe the challenges, benefits, and lessons learned, as well as the utility of the computational apprenticeship framework in supporting computational/math students learning and contributing to biology, and biologists in learning computational methods. We also explore implications for undergraduate classroom instruction and cross-disciplinary scientific communication.

Navigating Multi-Scale Cancer Systems Biology Towards Model-Driven Clinical Oncology and Its Applications in Personalized Therapeutics

Rapid advancements in high-throughput omics technologies and experimental protocols have led to the generation of vast amounts of scale-specific biomolecular data on cancer that now populates several online databases and resources. Cancer systems biology models built using this data have the potential to provide specific insights into complex multifactorial aberrations underpinning tumor initiation, development, and metastasis. Furthermore, the annotation of these single- and multi-scale models with patient data can additionally assist in designing personalized therapeutic interventions as well as aid in clinical decision-making. Here, we have systematically reviewed the emergence and evolution of (i) repositories with scale-specific and multi-scale biomolecular cancer data, (ii) systems biology models developed using this data, (iii) associated simulation software for the development of personalized cancer therapeutics, and (iv) translational attempts to pipeline multi-scale panomics data for data-driven in silico clinical oncology. The review concludes that the absence of a generic, zero-code, panomics-based multi-scale modeling pipeline and associated software framework, impedes the development and seamless deployment of personalized in silico multi-scale models in clinical settings.

Iterative community-driven development of a SARS-CoV-2 tissue simulator

The 2019 novel coronavirus, SARS-CoV-2, is a pathogen of critical significance to international public health. Knowledge of the interplay between molecular-scale virus-receptor interactions, single-cell viral replication, intracellular-scale viral transport, and emergent tissue-scale viral propagation is limited. Moreover, little is known about immune system-virus-tissue interactions and how these can result in low-level (asymptomatic) infections in some cases and acute respiratory distress syndrome (ARDS) in others, particularly with respect to presentation in different age groups or pre-existing inflammatory risk factors. Given the nonlinear interactions within and among each of these processes, multiscale simulation models can shed light on the emergent dynamics that lead to divergent outcomes, identify actionable "choke points" for pharmacologic interventions, screen potential therapies, and identify potential biomarkers that differentiate patient outcomes. Given the complexity of the problem and the acute need for an actionable model to guide therapy discovery and optimization, we introduce and iteratively refine a prototype of a multiscale model of SARS-CoV-2 dynamics in lung tissue. The first prototype model was built and shared internationally as open source code and an online interactive model in under 12 hours, and community domain expertise is driving regular refinements. In a sustained community effort, this consortium is integrating data and expertise across virology, immunology, mathematical biology, quantitative systems physiology, cloud and high performance computing, and other domains to accelerate our response to this critical threat to international health. More broadly, this effort is creating a reusable, modular framework for studying viral replication and immune response in tissues, which can also potentially be adapted to related problems in immunology and immunotherapy.

The Use of Artificial Neural Networks to Forecast the Behavior of Agent-Based Models of Pathophysiology: An Example Utilizing an Agent-Based Model of Sepsis

Introduction: Disease states are being characterized at finer and finer levels of resolution via biomarker or gene expression profiles, while at the same time. Machine learning (ML) is increasingly used to analyze and potentially classify or predict the behavior of biological systems based on such characterization. As ML applications are extremely data-intensive, given the relative sparsity of biomedical data sets ML training of artificial neural networks (ANNs) often require the use of synthetic training data. Agent-based models (ABMs) that incorporate known biological mechanisms and their associated stochastic properties are a potential means of generating synthetic data. Herein we present an example of ML used to train an artificial neural network (ANN) as a surrogate system used to predict the time evolution of an ABM focusing on the clinical condition of sepsis. Methods: The disease trajectories for clinical sepsis, in terms of temporal cytokine and phenotypic dynamics, can be interpreted as a random dynamical system. The Innate Immune Response Agent-based Model (IIRABM) is a well-established model that utilizes known cellular and molecular rules to simulate disease trajectories corresponding to clinical sepsis. We have utilized two distinct neural network architectures, Long Short-Term Memory and Multi-Layer Perceptron, to take a time sequence of five measurements of eleven IIRABM simulated serum cytokine concentrations as input and to return both the future cytokine trajectories as well as an aggregate metric representing the patient's state of health. Results: The ANNs predicted model trajectories with the expected amount of error, due to stochasticity in the simulation, and recognizing that the mapping from a specific cytokine profile to a state-of-health is not unique. The Multi-Layer Perceptron neural network, generated predictions with a more accurate forecasted trajectory cone. Discussion: This work serves as a proof-of-concept for the use of ANNs to predict disease progression in sepsis as represented by an ABM. The findings demonstrate that multicellular systems with intrinsic stochasticity can be approximated with an ANN, but that forecasting a specific trajectory of the system requires sequential updating of the system state to provide a rolling forecast horizon.

A persistent invasive phenotype in post-hypoxic tumor cells is revealed by fate mapping and computational modeling

Hypoxia is a critical factor in solid tumors that has been associated with cancer progression and aggressiveness. We recently developed a hypoxia fate mapping system to trace post-hypoxic cells within a tumor for the first time. This approach uses an oxygen-dependent fluorescent switch and allowed us to measure key biological features such as oxygen distribution, cell proliferation, and migration. We developed a computational model to investigate the motility and phenotypic persistence of hypoxic and post-hypoxic cells during tumor progression. The cellular behavior was defined by phenotypic persistence time, cell movement bias, and the fraction of cells that respond to an enhanced migratory stimulus. This work combined advanced cell tracking and imaging techniques with mathematical modeling, to reveal that a persistent invasive migratory phenotype that develops under hypoxia is required for cellular escape into the surrounding tissue, promoting the formation of invasive structures (“plumes”) that expand toward the oxygenated tumor regions.

•

A fluorescent fate mapping system allows tracking of hypoxic and post-hypoxic cells

•

Computational modeling predicts the formation of post-hypoxic invasive plumes

•

Simulations show post-hypoxic cells must maintain persistant migration to form plumes

•

Tracking cells exposed to intratumoral hypoxia confirms persistent migration

Matrix adhesion and remodeling diversifies modes of cancer invasion across spatial scales

The metastasis of malignant epithelial tumors begins with the egress of transformed cells from the confines of their basement membrane (BM) to their surrounding collagen-rich stroma. Invasion can be morphologically diverse: when breast cancer cells are separately cultured within BM-like matrix, collagen I (Coll I), or a combination of both, they exhibit collective-, dispersed mesenchymal-, and a mixed collective-dispersed (multimodal)- invasion, respectively. In this paper, we asked how distinct these invasive modes are with respect to the cellular and microenvironmental cues that drive them. A rigorous computational exploration of invasion was performed within an experimentally motivated Cellular Potts-based modeling environment. The model comprised of adhesive interactions between cancer cells, BM- and Coll I-like extracellular matrix (ECM), and reaction-diffusion-based remodeling of ECM. The model outputs were parameters cognate to dispersed- and collective- invasion. A clustering analysis of the output distribution curated through a careful examination of subsumed phenotypes suggested at least four distinct invasive states: dispersed, papillary-collective, bulk-collective, and multimodal, in addition to an indolent/non-invasive state. Mapping input values to specific output clusters suggested that each of these invasive states are specified by distinct input signatures of proliferation, adhesion and ECM remodeling. In addition, specific input perturbations allowed transitions between the clusters and revealed the variation in the robustness between the invasive states. Our systems-level approach proffers quantitative insights into how the diversity in ECM microenvironments may steer invasion into diverse phenotypic modes during early dissemination of breast cancer and contributes to tumor heterogeneity.

Nested active learning for efficient model contextualization and parameterization: pathway to generating simulated populations using multi-scale computational models

There is increasing interest in the use of mechanism-based multi-scale computational models (such as agent-based models (ABMs)) to generate simulated clinical populations in order to discover and evaluate potential diagnostic and therapeutic modalities. The description of the environment in which a biomedical simulation operates (model context) and parameterization of internal model rules (model content) requires the optimization of a large number of free parameters. In this work, we utilize a nested active learning (AL) workflow to efficiently parameterize and contextualize an ABM of systemic inflammation used to examine sepsis. Contextual parameter space was examined using four parameters external to the model's rule set. The model's internal parameterization, which represents gene expression and associated cellular behaviors, was explored through the augmentation or inhibition of signaling pathways for 12 signaling mediators associated with inflammation and wound healing. We have implemented a nested AL approach in which the clinically relevant (CR) model environment space for a given internal model parameterization is mapped using a small Artificial Neural Network (ANN). The outer AL level workflow is a larger ANN that uses AL to efficiently regress the volume and centroid location of the CR space given by a single internal parameterization. We have reduced the number of simulations required to efficiently map the CR parameter space of this model by approximately 99%. In addition, we have shown that more complex models with a larger number of variables may expect further improvements in efficiency.

In silico optimization of cancer therapies with multiple types of nanoparticles applied at different times

BACKGROUND AND OBJECTIVE

Cancer tumors constitute a complicated environment for conventional anti-cancer treatments to confront, so solutions with higher complexity and, thus, robustness to diverse conditions are required. Alternations in the tumor composition have been documented, as a result of a conventional treatment, making an ensemble of cells drug resistant. Consequently, a possible answer to this problem could be the delivery of the pharmaceutic compound with the assistance of nano-particles (NPs) that modify the delivery characteristics and biodistribution of the therapy. Nonetheless, to tackle the dynamic response of the tumor, a variety of application times of different types of NPs could be a way forward.

METHODS

The in silico optimization was investigated here, in terms of the design parameters of multiple NPs and their application times. The optimization methodology used an open-source simulator to provide the fitness of each possible treatment. Because the number of different NPs that will achieve the best performance is not known a priori, the evolutionary algorithm utilizes a variable length genome approach, namely a metameric representation and accordingly modified operators.

RESULTS

The results highlight the fact that different application times have a significant effect on the robustness of a treatment. Whereas, applying all NPs at earlier time slots and without the ordered sequence unveiled by the optimization process, proved to be less effective.

CONCLUSIONS

The design and development of a dynamic tool that will navigate through the large search space of possible combinations can provide efficient solutions that prove to be beyond human intuition.

A generalizable data-driven multicellular model of pancreatic ductal adenocarcinoma

BACKGROUND

Mechanistic models, when combined with pertinent data, can improve our knowledge regarding important molecular and cellular mechanisms found in cancer. These models make the prediction of tissue-level response to drug treatment possible, which can lead to new therapies and improved patient outcomes. Here we present a data-driven multiscale modeling framework to study molecular interactions between cancer, stromal, and immune cells found in the tumor microenvironment. We also develop methods to use molecular data available in The Cancer Genome Atlas to generate sample-specific models of cancer.

RESULTS

By combining published models of different cells relevant to pancreatic ductal adenocarcinoma (PDAC), we built an agent-based model of the multicellular pancreatic tumor microenvironment, formally describing cell type-specific molecular interactions and cytokine-mediated cell-cell communications. We used an ensemble-based modeling approach to systematically explore how variations in the tumor microenvironment affect the viability of cancer cells. The results suggest that the autocrine loop involving EGF signaling is a key interaction modulator between pancreatic cancer and stellate cells. EGF is also found to be associated with previously described subtypes of PDAC. Moreover, the model allows a systematic exploration of the effect of possible therapeutic perturbations; our simulations suggest that reducing bFGF secretion by stellate cells will have, on average, a positive impact on cancer apoptosis.

CONCLUSIONS

The developed framework allows model-driven hypotheses to be generated regarding therapeutically relevant PDAC states with potential molecular and cellular drivers indicating specific intervention strategies.

Key challenges facing data-driven multicellular systems biology

Increasingly sophisticated experiments, coupled with large-scale computational models, have the potential to systematically test biological hypotheses to drive our understanding of multicellular systems. In this short review, we explore key challenges that must be overcome to achieve robust, repeatable data-driven multicellular systems biology. If these challenges can be solved, we can grow beyond the current state of isolated tools and datasets to a community-driven ecosystem of interoperable data, software utilities, and computational modeling platforms. Progress is within our grasp, but it will take community (and financial) commitment.