Towards anatomic scale agent-based modeling with a massively parallel spatially explicit general-purpose model of enteric tissue (SEGMEnT_HPC)

The Wound Environment Agent-based Model (WEABM): a digital twin platform for characterization and complex therapeutic discovery for volumetric muscle loss

Volumetric Muscle Loss (VML) injuries are characterized by significant loss of muscle mass, usually due to trauma or surgical resection, often with a residual open wound in clinical settings and subsequent loss of limb function due to the replacement of the lost muscle mass with non-functional scar. Being able to regrow functional muscle in VML injuries is a complex control problem that needs to override robust, evolutionarily conserved healing processes aimed at rapidly closing the defect in lieu of restoration of function. We propose that discovering and implementing this complex control can be accomplished by the development of a Medical Digital Twin of VML. Digital Twins (DTs) are the subject of a recent report from the National Academies of Science, Engineering and Medicine (NASEM), which provides guidance as to the definition, capabilities and research challenges associated with the development and implementation of DTs. Specifically, DTs are defined as dynamic computational models that can be personalized to an individual real world "twin" and are connected to that twin via an ongoing data link. DTs can be used to provide control on the real-world twin that is, by the ongoing data connection, adaptive. We have developed an anatomic scale cell-level agent-based model of VML termed the Wound Environment Agent Based Model (WEABM) that can serve as the computational specification for a DT of VML. Simulations of the WEABM provided fundamental insights into the biology of VML, and we used the WEABM in our previously developed pipeline for simulation-based Deep Reinforcement Learning (DRL) to train an artificial intelligence (AI) to implement a robust generalizable control policy aimed at increasing the healing of VML with functional muscle. The insights into VML obtained include: 1) a competition between fibrosis and myogenesis due to spatial constraints on available edges of intact myofibrils to initiate the myoblast differentiation process, 2) the need to biologically "close" the wound from atmospheric/environmental exposure, which represents an ongoing inflammatory stimulus that promotes fibrosis and 3) that selective, multimodal and adaptive local mediator-level control can shift the trajectory of healing away from a highly evolutionarily beneficial imperative to close the wound via fibrosis. Control discovery with the WEABM identified the following design principles: 1) multimodal adaptive tissue-level mediator control to mitigate pro-inflammation as well as the pro-fibrotic aspects of compensatory anti-inflammation, 2) tissue-level mediator manipulation to promote myogenesis, 3) the use of an engineered extracellular matrix (ECM) to functionally close the wound and 4) the administration of an anti-fibrotic agent focused on the collagen-producing function of fibroblasts and myofibroblasts. The WEABM-trained DRL AI integrates these control modalities and provides design specifications for a potential device that can implement the required wound sensing and intervention delivery capabilities needed. The proposed cyber-physical system integrates the control AI with a physical sense-and-actuate device that meets the tenets of DTs put forth in the NASEM report and can serve as an example schema for the future development of Medical DTs.

Combination Chemotherapy of Multidrug-resistant Early-stage Colon Cancer: Determining Optimal Dose Schedules by High-performance Computer Simulation

The goal of this project was to utilize mechanistic simulation to demonstrate a methodology that could determine drug combination dose schedules and dose intensities that would be most effective in eliminating multidrug resistant cancer cells in early-stage colon cancer. An agent-based model of cell dynamics in human colon crypts was calibrated using measurements of human biopsy specimens. Mutant cancer cells were simulated as cells that were resistant to each of two drugs when the drugs were used separately. The drugs, 5-flurouracil and sulindac, have different mechanisms of action. An artificial neural network was used to generate nearly two hundred thousand two-drug dose schedules. A high-performance computer simulated each dose schedule as a in silico clinical trial and evaluated each dose schedule for its efficiency to cure (eliminate) multidrug resistant cancer cells and its toxicity to the host, as indicated by continued crypt function. Among the dose schedules that were generated, 2430 dose schedules were found to cure all multidrug resistant mutants in each of the 50 simulated trials and retained colon crypt function. One dose schedule was optimal; it eliminated multidrug resistant cancer cells with the minimum toxicity and had a time schedule that would be practical for implementation in the clinic. These results demonstrate a procedure to identify which combination drug dose schedules could be most effective in eliminating drug resistant cancer cells. This was accomplished using a calibrated agent-based model of a human tissue, and a high-performance computer simulation of clinical trials.

Utilizing the Heterogeneity of Clinical Data for Model Refinement and Rule Discovery Through the Application of Genetic Algorithms to Calibrate a High-Dimensional Agent-Based Model of Systemic Inflammation

Introduction: Accounting for biological heterogeneity represents one of the greatest challenges in biomedical research. Dynamic computational and mathematical models can be used to enhance the study and understanding of biological systems, but traditional methods for calibration and validation commonly do not account for the heterogeneity of biological data, which may result in overfitting and brittleness of these models. Herein we propose a machine learning approach that utilizes genetic algorithms (GAs) to calibrate and refine an agent-based model (ABM) of acute systemic inflammation, with a focus on accounting for the heterogeneity seen in a clinical data set, thereby avoiding overfitting and increasing the robustness and potential generalizability of the underlying simulation model. Methods: Agent-based modeling is a frequently used modeling method for multi-scale mechanistic modeling. However, the same properties that make ABMs well suited to representing biological systems also present significant challenges with respect to their construction and calibration, particularly with respect to the selection of potential mechanistic rules and the large number of associated free parameters. We have proposed that machine learning approaches (such as GAs) can be used to more effectively and efficiently deal with rule selection and parameter space characterization; the current work applies GAs to the challenge of calibrating a complex ABM to a specific data set, while preserving biological heterogeneity reflected in the range and variance of the data. This project uses a GA to augment the rule-set for a previously validated ABM of acute systemic inflammation, the Innate Immune Response ABM (IIRABM) to clinical time series data of systemic cytokine levels from a population of burn patients. The genome for the GA is a vector generated from the IIRABM's Model Rule Matrix (MRM), which is a matrix representation of not only the constants/parameters associated with the IIRABM's cytokine interaction rules, but also the existence of rules themselves. Capturing heterogeneity is accomplished by a fitness function that incorporates the sample value range ("error bars") of the clinical data. Results: The GA-enabled parameter space exploration resulted in a set of putative MRM rules and associated parameterizations which closely match the cytokine time course data used to design the fitness function. The number of non-zero elements in the MRM increases significantly as the model parameterizations evolve toward a fitness function minimum, transitioning from a sparse to a dense matrix. This results in a model structure that more closely resembles (at a superficial level) the structure of data generated by a standard differential gene expression experimental study. Conclusion: We present an HPC-enabled machine learning/evolutionary computing approach to calibrate a complex ABM to complex clinical data while preserving biological heterogeneity. The integration of machine learning, HPC, and multi-scale mechanistic modeling provides a pathway forward to more effectively representing the heterogeneity of clinical populations and their data.

Agent-based models of inflammation in translational systems biology: A decade later

Agent-based modeling is a rule-based, discrete-event, and spatially explicit computational modeling method that employs computational objects that instantiate the rules and interactions among the individual components ("agents") of system. Agent-based modeling is well suited to translating into a computational model the knowledge generated from basic science research, particularly with respect to translating across scales the mechanisms of cellular behavior into aggregated cell population dynamics manifesting at the tissue and organ level. This capacity has made agent-based modeling an integral method in translational systems biology (TSB), an approach that uses multiscale dynamic computational modeling to explicitly represent disease processes in a clinically relevant fashion. The initial work in the early 2000s using agent-based models (ABMs) in TSB focused on examining acute inflammation and its intersection with wound healing; the decade since has seen vast growth in both the application of agent-based modeling to a wide array of disease processes as well as methodological advancements in the use and analysis of ABM. This report presents an update on an earlier review of ABMs in TSB and presents examples of exciting progress in the modeling of various organs and diseases that involve inflammation. This review also describes developments that integrate the use of ABMs with cutting-edge technologies such as high-performance computing, machine learning, and artificial intelligence, with a view toward the future integration of these methodologies. This article is categorized under: Translational, Genomic, and Systems Medicine > Translational Medicine Models of Systems Properties and Processes > Mechanistic Models Models of Systems Properties and Processes > Organ, Tissue, and Physiological Models Models of Systems Properties and Processes > Organismal Models.

Agent-based modeling of morphogenetic systems: Advantages and challenges

The complexity of morphogenesis poses a fundamental challenge to understanding the mechanisms governing the formation of biological patterns and structures. Over the past century, numerous processes have been identified as critically contributing to morphogenetic events, but the interplay between the various components and aspects of pattern formation have been much harder to grasp. The combination of traditional biology with mathematical and computational methods has had a profound effect on our current understanding of morphogenesis and led to significant insights and advancements in the field. In particular, the theoretical concepts of reaction–diffusion systems and positional information, proposed by Alan Turing and Lewis Wolpert, respectively, dramatically influenced our general view of morphogenesis, although typically in isolation from one another. In recent years, agent-based modeling has been emerging as a consolidation and implementation of the two theories within a single framework. Agent-based models (ABMs) are unique in their ability to integrate combinations of heterogeneous processes and investigate their respective dynamics, especially in the context of spatial phenomena. In this review, we highlight the benefits and technical challenges associated with ABMs as tools for examining morphogenetic events. These models display unparalleled flexibility for studying various morphogenetic phenomena at multiple levels and have the important advantage of informing future experimental work, including the targeted engineering of tissues and organs.

Optimization of Dose Schedules for Chemotherapy of Early Colon Cancer Determined by High-Performance Computer Simulations

Cancer chemotherapy dose schedules are conventionally applied intermittently, with dose duration of the order of hours, intervals between doses of days or weeks, and cycles repeated for weeks. The large number of possible combinations of values of duration, interval, and lethality has been an impediment to empirically determine the optimal set of treatment conditions. The purpose of this project was to determine the set of parameters for duration, interval, and lethality that would be most effective for treating early colon cancer. An agent-based computer model that simulated cell proliferation kinetics in normal human colon crypts was calibrated with measurements of human biopsy specimens. Mutant cells were simulated as proliferating and forming an adenoma, or dying if treated with cytotoxic chemotherapy. Using a high-performance computer, a total of 28 800 different parameter sets of duration, interval, and lethality were simulated. The effect of each parameter set on the stability of colon crypts, the time to cure a crypt of mutant cells, and the accumulated dose was determined. Of the 28 800 parameter sets, 434 parameter sets were effective in curing the crypts of mutant cells before they could form an adenoma and allowed the crypt normal cell dynamics to recover to pretreatment levels. A group of 14 similar parameter sets produced a minimal time to cure mutant cells. A different group of nine similar parameter sets produced the least accumulated dose. These parameter sets may be considered as candidate dose schedules to guide clinical trials for early colon cancer.

Engineering a Tumor Microenvironment-Mimetic Niche for Tissue Regeneration with Xenogeneic Cancer Cells

The insufficient number of cells suitable for transplantation is a long-standing problem to cell-based therapies aimed at tissue regeneration. Xenogeneic cancer cells (XCC) may be an alternative source of therapeutic cells, but their transplantation risks both immune rejection and unwanted spreading. In this study, a strategy to facilitate XCC transplantation is reported and their spreading in vivo is confined by constructing an engineering matrix that mimics the characteristics of tumor microenvironment. The data show that this matrix, a tumor homogenate-containing hydrogel (THAG), successfully creates an immunosuppressive enclave after transplantation into immunocompetent mice. XCC of different species and tissue origins seeded into THAG survive well, integrated with the host and developed the intrinsic morphology of the native tissue, without being eliminated or spreading out of the enclave. Most strikingly, immortalized human hepatocyte cells and rat β-cells loaded into THAG exert the physiological functions of the human liver and rat pancreas islets, respectively, in the mouse body. This study demonstrates a novel and feasible approach to harness the unique features of tumor development for tissue transplantation and regenerative medicine.

Examining the controllability of sepsis using genetic algorithms on an agent-based model of systemic inflammation

Sepsis, a manifestation of the body's inflammatory response to injury and infection, has a mortality rate of between 28%-50% and affects approximately 1 million patients annually in the United States. Currently, there are no therapies targeting the cellular/molecular processes driving sepsis that have demonstrated the ability to control this disease process in the clinical setting. We propose that this is in great part due to the considerable heterogeneity of the clinical trajectories that constitute clinical "sepsis," and that determining how this system can be controlled back into a state of health requires the application of concepts drawn from the field of dynamical systems. In this work, we consider the human immune system to be a random dynamical system, and investigate its potential controllability using an agent-based model of the innate immune response (the Innate Immune Response ABM or IIRABM) as a surrogate, proxy system. Simulation experiments with the IIRABM provide an explanation as to why single/limited cytokine perturbations at a single, or small number of, time points is unlikely to significantly improve the mortality rate of sepsis. We then use genetic algorithms (GA) to explore and characterize multi-targeted control strategies for the random dynamical immune system that guide it from a persistent, non-recovering inflammatory state (functionally equivalent to the clinical states of systemic inflammatory response syndrome (SIRS) or sepsis) to a state of health. We train the GA on a single parameter set with multiple stochastic replicates, and show that while the calculated results show good generalizability, more advanced strategies are needed to achieve the goal of adaptive personalized medicine. This work evaluating the extent of interventions needed to control a simplified surrogate model of sepsis provides insight into the scope of the clinical challenge, and can serve as a guide on the path towards true "precision control" of sepsis.

Mechanobiological model of arterial growth and remodeling

A coupled agent-based model (ABM) and finite element analysis (FEA) computational framework is developed to study the interplay of bio-chemo-mechanical factors in blood vessels and their role in maintaining homeostasis. The agent-based model implements the power of REPAST Simphony libraries and adapts its environment for biological simulations. Coupling a continuum-level model (FEA) to a cellular-level model (ABM) has enabled this computational framework to capture the response of blood vessels to increased or decreased levels of growth factors, proteases and other signaling molecules (on the micro scale) as well as altered blood pressure. Performance of the model is assessed by simulating porcine left anterior descending artery under normotensive conditions and transient increases in blood pressure and by analyzing sensitivity of the model to variations in the rule parameters of the ABM. These simulations proved that the model is stable under normotensive conditions and can recover from transient increases in blood pressure. Sensitivity studies revealed that the model is most sensitive to variations in the concentration of growth factors that affect cellular proliferation and regulate extracellular matrix composition (mainly collagen).

Introduction of a Framework for Dynamic Knowledge Representation of the Control Structure of Transplant Immunology: Employing the Power of Abstraction with a Solid Organ Transplant Agent-Based Model

Agent-based modeling has been used to characterize the nested control loops and non-linear dynamics associated with inflammatory and immune responses, particularly as a means of visualizing putative mechanistic hypotheses. This process is termed dynamic knowledge representation and serves a critical role in facilitating the ability to test and potentially falsify hypotheses in the current data- and hypothesis-rich biomedical research environment. Importantly, dynamic computational modeling aids in identifying useful abstractions, a fundamental scientific principle that pervades the physical sciences. Recognizing the critical scientific role of abstraction provides an intellectual and methodological counterweight to the tendency in biology to emphasize comprehensive description as the primary manifestation of biological knowledge. Transplant immunology represents yet another example of the challenge of identifying sufficient understanding of the inflammatory/immune response in order to develop and refine clinically effective interventions. Advances in immunosuppressive therapies have greatly improved solid organ transplant (SOT) outcomes, most notably by reducing and treating acute rejection. The end goal of these transplant immune strategies is to facilitate effective control of the balance between regulatory T cells and the effector/cytotoxic T-cell populations in order to generate, and ideally maintain, a tolerant phenotype. Characterizing the dynamics of immune cell populations and the interactive feedback loops that lead to graft rejection or tolerance is extremely challenging, but is necessary if rational modulation to induce transplant tolerance is to be accomplished. Herein is presented the solid organ agent-based model (SOTABM) as an initial example of an agent-based model (ABM) that abstractly reproduces the cellular and molecular components of the immune response to SOT. Despite its abstract nature, the SOTABM is able to qualitatively reproduce acute rejection and the suppression of acute rejection by immunosuppression to generate transplant tolerance. The SOTABM is intended as an initial example of how ABMs can be used to dynamically represent mechanistic knowledge concerning transplant immunology in a scalable and expandable form and can thus potentially serve as useful adjuncts to the investigation and development of control strategies to induce transplant tolerance.