ImmunoGrid: towards agent-based simulations of the human immune system at a natural scale

Parallelisation strategies for agent based simulation of immune systems

BACKGROUND

In recent years, the study of immune response behaviour using bottom up approach, Agent Based Modeling (ABM), has attracted considerable efforts. The ABM approach is a very common technique in the biological domain due to high demand for a large scale analysis tools for the collection and interpretation of information to solve biological problems. Simulating massive multi-agent systems (i.e. simulations containing a large number of agents/entities) requires major computational effort which is only achievable through the use of parallel computing approaches.

RESULTS

This paper explores different approaches to parallelising the key component of biological and immune system models within an ABM model: pairwise interactions. The focus of this paper is on the performance and algorithmic design choices of cell interactions in continuous and discrete space where agents/entities are competing to interact with one another within a parallel environment.

CONCLUSIONS

Our performance results demonstrate the applicability of these methods to a broader class of biological systems exhibiting typical cell to cell interactions. The advantage and disadvantage of each implementation is discussed showing each can be used as the basis for developing complete immune system models on parallel hardware.

Game of neutrophils: modeling the balance between apoptosis and necrosis

Background

Neutrophils are one of the key players in the human innate immune system (HIIS). In the event of an insult where the body is exposed to inflammation triggering moieties (ITMs), neutrophils are mobilized towards the site of insult and antagonize the inflammation. If the inflammation is cleared, neutrophils go into a programmed death called apoptosis. However, if the insult is intense or persistent, neutrophils take on a violent death pathway called necrosis, which involves the rupture of their cytoplasmic content into the surrounding tissue that causes local tissue damage, thus further aggravating inflammation. This seemingly paradoxical phenomenon fuels the inflammatory process by triggering the recruitment of additional neutrophils to the site of inflammation, aimed to contribute to the complete neutralization of severe inflammation. This delicate balance between the cost and benefit of the neutrophils’ choice of death pathway has been optimized during the evolution of the innate immune system. The goal of our work is to understand how the tradeoff between the cost and benefit of the different death pathways of neutrophils, in response to various levels of insults, has been optimized over evolutionary time by using the concepts of evolutionary game theory.

Results

We show that by using evolutionary game theory, we are able to formulate a game that predicts the percentage of necrosis and apoptosis when exposed to various levels of insults.

Conclusion

By adopting an evolutionary perspective, we identify the driving mechanisms leading to the delicate balance between apoptosis and necrosis in neutrophils’ cell death in response to different insults. Using our simple model, we verify that indeed, the global cost of remaining ITMs is the driving mechanism that reproduces the percentage of necrosis and apoptosis observed in data and neutrophils need sufficient information of the overall inflammation to be able to pick a death pathway that presumably increases the survival of the organism.

Nonclinical immunogenicity risk assessment of therapeutic proteins

Therapeutic protein drugs have significantly improved the management of many severe and chronic diseases. However, their development and optimal clinical application are complicated by the induction of unwanted immune responses. Therapeutic protein-induced antidrug antibodies can alter drug pharmacokinetics and pharmacodynamics leading to impaired efficacy and occasionally serious safety issues. There has been a growing interest over the past decade in developing methods to assess the risk of unwanted immunogenicity during preclinical drug development, with the aim to mitigate the risk during the molecular design phase, clinical development and when products reach the market. Here, we discuss approaches to therapeutic protein immunogenicity risk assessment, with attention to assays and in vivo models used to mitigate this risk.

Multiscale Agent-Based and Hybrid Modeling of the Tumor Immune Microenvironment

Multiscale systems biology and systems pharmacology are powerful methodologies that are playing increasingly important roles in understanding the fundamental mechanisms of biological phenomena and in clinical applications. In this review, we summarize the state of the art in the applications of agent-based models (ABM) and hybrid modeling to the tumor immune microenvironment and cancer immune response, including immunotherapy. Heterogeneity is a hallmark of cancer; tumor heterogeneity at the molecular, cellular, and tissue scales is a major determinant of metastasis, drug resistance, and low response rate to molecular targeted therapies and immunotherapies. Agent-based modeling is an effective methodology to obtain and understand quantitative characteristics of these processes and to propose clinical solutions aimed at overcoming the current obstacles in cancer treatment. We review models focusing on intra-tumor heterogeneity, particularly on interactions between cancer cells and stromal cells, including immune cells, the role of tumor-associated vasculature in the immune response, immune-related tumor mechanobiology, and cancer immunotherapy. We discuss the role of digital pathology in parameterizing and validating spatial computational models and potential applications to therapeutics.

Cell studio: A platform for interactive, 3D graphical simulation of immunological processes

The field of computer modeling and simulation of biological systems is rapidly advancing, backed by significant progress in the fields of experimentation techniques, computer hardware, and programming software. The result of a simulation may be delivered in several ways, from numerical results, through graphs of the simulated run, to a visualization of the simulation. The vision of an in-silico experiment mimicking an in-vitro or in-vivo experiment as it is viewed under a microscope is appealing but technically demanding and computationally intensive. Here, we report “Cell Studio,” a generic, hybrid platform to simulate an immune microenvironment with biological and biophysical rules. We use game engines—generic programs for game creation which offer ready-made assets and tools—to create a visualized, interactive 3D simulation. We also utilize a scalable architecture that delegates the computational load to a server. The user may view the simulation, move the “camera” around, stop, fast-forward, and rewind it and inject soluble molecules into the extracellular medium at any point in time. During simulation, graphs are created in real time for a broad view of system-wide processes. The model is parametrized using a user-friendly Graphical User Interface (GUI). We show a simple validation simulation and compare its results with those from a “classical” simulation, validated against a “wet” experiment. We believe that interactive, real-time 3D visualization may aid in generating insights from the model and encourage intuition about the immunological scenario.

Statistical ensemble of gene regulatory networks of macrophage differentiation

BACKGROUND

Macrophages cover a major role in the immune system, being the most plastic cell yielding several key immune functions.

METHODS

Here we derived a minimalistic gene regulatory network model for the differentiation of macrophages into the two phenotypes M1 (pro-) and M2 (anti-inflammatory).

RESULTS

To test the model, we simulated a large number of such networks as in a statistical ensemble. In other words, to enable the inter-cellular crosstalk required to obtain an immune activation in which the macrophage plays its role, the simulated networks are not taken in isolation but combined with other cellular agents, thus setting up a discrete minimalistic model of the immune system at the microscopic/intracellular (i.e., genetic regulation) and mesoscopic/intercellular scale.

CONCLUSIONS

We show that within the mesoscopic level description of cellular interaction and cooperation, the gene regulatory logic is coherent and contributes to the overall dynamics of the ensembles that shows, statistically, the expected behaviour.

Mathematical Models for Immunology: Current State of the Art and Future Research Directions

The advances in genetics and biochemistry that have taken place over the last 10 years led to significant advances in experimental and clinical immunology. In turn, this has led to the development of new mathematical models to investigate qualitatively and quantitatively various open questions in immunology. In this study we present a review of some research areas in mathematical immunology that evolved over the last 10 years. To this end, we take a step-by-step approach in discussing a range of models derived to study the dynamics of both the innate and immune responses at the molecular, cellular and tissue scales. To emphasise the use of mathematics in modelling in this area, we also review some of the mathematical tools used to investigate these models. Finally, we discuss some future trends in both experimental immunology and mathematical immunology for the upcoming years.

Development of an Agent-Based Model (ABM) to Simulate the Immune System and Integration of a Regression Method to Estimate the Key ABM Parameters by Fitting the Experimental Data

Agent-based models (ABM) and differential equations (DE) are two commonly used methods for immune system simulation. However, it is difficult for ABM to estimate key parameters of the model by incorporating experimental data, whereas the differential equation model is incapable of describing the complicated immune system in detail. To overcome these problems, we developed an integrated ABM regression model (IABMR). It can combine the advantages of ABM and DE by employing ABM to mimic the multi-scale immune system with various phenotypes and types of cells as well as using the input and output of ABM to build up the Loess regression for key parameter estimation. Next, we employed the greedy algorithm to estimate the key parameters of the ABM with respect to the same experimental data set and used ABM to describe a 3D immune system similar to previous studies that employed the DE model. These results indicate that IABMR not only has the potential to simulate the immune system at various scales, phenotypes and cell types, but can also accurately infer the key parameters like DE model. Therefore, this study innovatively developed a complex system development mechanism that could simulate the complicated immune system in detail like ABM and validate the reliability and efficiency of model like DE by fitting the experimental data.

Spatial and functional heterogeneities shape collective behavior of tumor-immune networks

Tumor growth involves a dynamic interplay between cancer cells and host cells, which collectively form a tumor microenvironmental network that either suppresses or promotes tumor growth under different conditions. The transition from tumor suppression to tumor promotion is mediated by a tumor-induced shift in the local immune state, and despite the clinical challenge this shift poses, little is known about how such dysfunctional immune states are initiated. Clinical and experimental observations have indicated that differences in both the composition and spatial distribution of different cell types and/or signaling molecules within the tumor microenvironment can strongly impact tumor pathogenesis and ultimately patient prognosis. How such “functional” and “spatial” heterogeneities confer such effects, however, is not known. To investigate these phenomena at a level currently inaccessible by direct observation, we developed a computational model of a nascent metastatic tumor capturing salient features of known tumor-immune interactions that faithfully recapitulates key features of existing experimental observations. Surprisingly, over a wide range of model formulations, we observed that heterogeneity in both spatial organization and cell phenotype drove the emergence of immunosuppressive network states. We determined that this observation is general and robust to parameter choice by developing a systems-level sensitivity analysis technique, and we extended this analysis to generate other parameter-independent, experimentally testable hypotheses. Lastly, we leveraged this model as an in silico test bed to evaluate potential strategies for engineering cell-based therapies to overcome tumor associated immune dysfunction and thereby identified modes of immune modulation predicted to be most effective. Collectively, this work establishes a new integrated framework for investigating and modulating tumor-immune networks and provides insights into how such interactions may shape early stages of tumor formation.

Over the course of tumor growth, cancer cells interact with normal cells via processes that are difficult to understand by experiment alone. This challenge is particularly pronounced at early stages of tumor formation, when experimental observation is most limited. Elucidating such interactions could inform both understanding of cancer and clinical practice. To address this need we developed a computational model capturing the current understanding of how individual metastatic tumor cells and immune cells sense and contribute to the tumor environment, which in turn enabled us to investigate the complex, collective behavior of these systems. Surprisingly, we discovered that tumor escape from immune control was enhanced by the existence of small differences (or heterogeneities) in the responses of individual immune cells to their environment, as well as by heterogeneities in the way that cells and the molecules they secrete are arranged in space. These conclusions held true over a range of model formulations, suggesting that this is a general feature of these tumor-immune networks. Finally, we used this model as a test bed to evaluate potential strategies for enhancing immunological control of early tumors, ultimately predicting that specifically modulating tumor-associated immune dysfunction may be more effective than simply enhanced tumor killing.

A mechanistic, multiscale mathematical model of immunogenicity for therapeutic proteins: part 1-theoretical model

A mechanistic, multiscale mathematical model of immunogenicity for therapeutic proteins was formulated by recapitulating key biological mechanisms, including antigen presentation, activation, proliferation, and differentiation of immune cells, secretion of antidrug antibodies (ADA), as well as in vivo disposition of ADA and therapeutic proteins. This system-level model contains three scales: a subcellular level representing antigen presentation processes by dendritic cells; a cellular level accounting for cell kinetics during humoral immune response; and a whole-body level accounting for therapeutic protein in vivo disposition. The model simulations for in vivo responses against antigenic protein challenge are consistent with many known immunological observations. By simulating immune responses under various initial parameter conditions, the model suggests hypotheses for future experimental investigation and contributes to the mechanistic understanding of immunogenicity. With future experimental validation, this model may potentially provide a platform to generate and test hypotheses about immunogenicity risk assessment and ultimately aid in immunogenicity prediction.

Reconceiving autoimmunity: An overview

Three interconnected positions are advocated: (1) although serving as a useful model, the immune self does not exist as such; (2) instead of a self/nonself demarcation, the immune system 'sees' itself, i.e., it does not ignore the 'self' or attack the 'other;' but exhibits a spectrum of responses, which when viewed from outside the system appear as discrimination of 'self' and 'nonself' based on certain criteria of reactivity. When immune reactions are conceived in terms of normal physiology and open exchange with the environment, where borders dividing host and foreign are elusive and changing, host defense is only part of the immune system's functions, which actually comprise two basic tasks: protection, i.e., to preserve host integrity, and maintenance of organismic identity. And thus (3) if the spectrum of immunity is enlarged, differentiating low reactive 'autoimmune' reactions from activated immune responses against the 'other' is only a matter of degree. Simply, all immunity is 'autoimmunity,' and the pathologic state of immunity directed at normal constituents of the organism is a particular case of dis-regulation, which appropriately is designated, autoimmune. Other uses of 'autoimmunity' and its congeners function as the semantic remnants of Burnet's original self/nonself theory and should be replaced. A new nomenclature is proposed, concinnity, which more accurately designates the physiology of the animal's ordinary housekeeping economy mediated by the immune system than 'autoimmunity' when used to describe such normal functions.

Physio-environmental sensing and live modeling

In daily life, humans are constantly interacting with their environment. Evidence is emerging that this interaction is a very important modulator of health and well-being, even more so in our rapidly ageing society. Information and communication technology lies at the heart of the human health care revolution. It cannot remain acceptable to use out of date data analysis and predictive algorithms when superior alternatives exist. Communication network speed, high penetration of home broadband, availability of various mobile network options, together with the available detailed biological data for individuals, are producing promising advances in computerized systems that will turn information on human-environment interactions into actual knowledge with the potential to help make medical and lifestyle decisions. We introduced and discussed a key scenario in which hardware and software technologies capable of simultaneously sensing physiological and environmental signals process health care data in real-time to issue alarms, warnings, or simple recommendations to the patient or carers.

Agent-based models of cellular systems

Software agents are particularly suitable for engineering models and simulations of cellular systems. In a very natural and intuitive manner, individual software components are therein delegated to reproduce "in silico" the behavior of individual components of alive systems at a given level of resolution. Individuals' actions and interactions among individuals allow complex collective behavior to emerge. In this chapter we first introduce the readers to software agents and multi-agent systems, reviewing the evolution of agent-based modeling of biomolecular systems in the last decade. We then describe the main tools, platforms, and methodologies available for programming societies of agents, possibly profiting also of toolkits that do not require advanced programming skills.

Mathematical modeling of the immune system recognition to mammary carcinoma antigen

The definition of artificial immunity, realized through vaccinations, is nowadays a practice widely developed in order to eliminate cancer disease. The present paper deals with an improved version of a mathematical model recently analyzed and related to the competition between immune system cells and mammary carcinoma cells under the action of a vaccine (Triplex). The model describes in detail both the humoral and cellular response of the immune system to the tumor associate antigen and the recognition process between B cells, T cells and antigen presenting cells. The control of the tumor cells growth occurs through the definition of different vaccine protocols. The performed numerical simulations of the model are in agreement with in vivo experiments on transgenic mice.

Optimal vaccination schedule search using genetic algorithm over MPI technology

BACKGROUND

Immunological strategies that achieve the prevention of tumor growth are based on the presumption that the immune system, if triggered before tumor onset, could be able to defend from specific cancers. In supporting this assertion, in the last decade active immunization approaches prevented some virus-related cancers in humans. An immunopreventive cell vaccine for the non-virus-related human breast cancer has been recently developed. This vaccine, called Triplex, targets the HER-2-neu oncogene in HER-2/neu transgenic mice and has shown to almost completely prevent HER-2/neu-driven mammary carcinogenesis when administered with an intensive and life-long schedule.

METHODS

To better understand the preventive efficacy of the Triplex vaccine in reduced schedules we employed a computational approach. The computer model developed allowed us to test in silico specific vaccination schedules in the quest for optimality. Specifically here we present a parallel genetic algorithm able to suggest optimal vaccination schedule.

RESULTS & CONCLUSIONS

The enormous complexity of combinatorial space to be explored makes this approach the only possible one. The suggested schedule was then tested in vivo, giving good results. Finally, biologically relevant outcomes of optimization are presented.

Combining cellular automata and Lattice Boltzmann method to model multiscale avascular tumor growth coupled with nutrient diffusion and immune competition

In the last decades the Lattice Boltzmann method (LB) has been successfully used to simulate a variety of processes. The LB model describes the microscopic processes occurring at the cellular level and the macroscopic processes occurring at the continuum level with a unique function, the probability distribution function. Recently, it has been tried to couple deterministic approaches with probabilistic cellular automata (probabilistic CA) methods with the aim to model temporal evolution of tumor growths and three dimensional spatial evolution, obtaining hybrid methodologies. Despite the good results attained by CA-PDE methods, there is one important issue which has not been completely solved: the intrinsic stochastic nature of the interactions at the interface between cellular (microscopic) and continuum (macroscopic) level. CA methods are able to cope with the stochastic phenomena because of their probabilistic nature, while PDE methods are fully deterministic. Even if the coupling is mathematically correct, there could be important statistical effects that could be missed by the PDE approach. For such a reason, to be able to develop and manage a model that takes into account all these three level of complexity (cellular, molecular and continuum), we believe that PDE should be replaced with a statistic and stochastic model based on the numerical discretization of the Boltzmann equation: The Lattice Boltzmann (LB) method. In this work we introduce a new hybrid method to simulate tumor growth and immune system, by applying Cellular Automata Lattice Boltzmann (CA-LB) approach.

SimB16: modeling induced immune system response against B16-melanoma

Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the in silico results with the in vivo experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented in silico model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising in vivo experiments.

Understanding infectious agents from an in silico perspective

Knowledge of infectious diseases now emerging from genomic, proteomic, epidemiological and clinical data can provide insights into the mechanisms of immune function, disease pathogenesis and epidemiology. Here, we describe how considerable advances in computational methods of data mining, mathematical modeling in epidemiology and simulation have been used to enhance our understanding of infectious agents and discuss their impact on the discovery of new therapeutics and controlling their spread.

Modeling the competition between lung metastases and the immune system using agents

BACKGROUND

The Triplex cell vaccine is a cancer cellular vaccine that can prevent almost completely the mammary tumor onset in HER-2/neu transgenic mice. In a translational perspective, the activity of the Triplex vaccine was also investigated against lung metastases showing that the vaccine is an effective treatment also for the cure of metastases. A future human application of the Triplex vaccine should take into account several aspects of biological behavior of the involved entities to improve the efficacy of therapeutic treatment and to try to predict, for example, the outcomes of longer experiments in order to move faster towards clinical phase I trials. To help to address this problem, MetastaSim, a hybrid Agent Based - ODE model for the simulation of the vaccine-elicited immune system response against lung metastases in mice is presented. The model is used as in silico wet-lab. As a first application MetastaSim is used to find protocols capable of maximizing the total number of prevented metastases, minimizing the number of vaccine administrations.

RESULTS

The model shows that it is possible to obtain "in silico" a 45% reduction in the number of vaccinations. The analysis of the results further suggests that any optimal protocol for preventing lung metastases formation should be composed by an initial massive vaccine dosage followed by few vaccine recalls.

CONCLUSIONS

Such a reduction may represent an important result from the point of view of translational medicine to humans, since a downsizing of the number of vaccinations is usually advisable in order to minimize undesirable effects. The suggested vaccination strategy also represents a notable outcome. Even if this strategy is commonly used for many infectious diseases such as tetanus and hepatitis-B, it can be in fact considered as a relevant result in the field of cancer-vaccines immunotherapy. These results can be then used and verified in future "in vivo" experiments, and their outcome can be used to further improve and refine the model.