Drug Development Digital Twins for Drug Discovery, Testing and Repurposing: A Schema for Requirements and Development

Artificial Intelligence (AI) Applications in Drug Discovery and Drug Delivery: Revolutionizing Personalized Medicine

Artificial intelligence (AI) encompasses a broad spectrum of techniques that have been utilized by pharmaceutical companies for decades, including machine learning, deep learning, and other advanced computational methods. These innovations have unlocked unprecedented opportunities for the acceleration of drug discovery and delivery, the optimization of treatment regimens, and the improvement of patient outcomes. AI is swiftly transforming the pharmaceutical industry, revolutionizing everything from drug development and discovery to personalized medicine, including target identification and validation, selection of excipients, prediction of the synthetic route, supply chain optimization, monitoring during continuous manufacturing processes, or predictive maintenance, among others. While the integration of AI promises to enhance efficiency, reduce costs, and improve both medicines and patient health, it also raises important questions from a regulatory point of view. In this review article, we will present a comprehensive overview of AI's applications in the pharmaceutical industry, covering areas such as drug discovery, target optimization, personalized medicine, drug safety, and more. By analyzing current research trends and case studies, we aim to shed light on AI's transformative impact on the pharmaceutical industry and its broader implications for healthcare.

Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology

Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.

From virtual patients to digital twins in immuno-oncology: lessons learned from mechanistic quantitative systems pharmacology modeling

Virtual patients and digital patients/twins are two similar concepts gaining increasing attention in health care with goals to accelerate drug development and improve patients' survival, but with their own limitations. Although methods have been proposed to generate virtual patient populations using mechanistic models, there are limited number of applications in immuno-oncology research. Furthermore, due to the stricter requirements of digital twins, they are often generated in a study-specific manner with models customized to particular clinical settings (e.g., treatment, cancer, and data types). Here, we discuss the challenges for virtual patient generation in immuno-oncology with our most recent experiences, initiatives to develop digital twins, and how research on these two concepts can inform each other.

A design specification for Critical Illness Digital Twins (CIDTs) to cure sepsis: responding to the National Academies of Sciences, Engineering and Medicine Report "Foundational Research Gaps and Future Directions for Digital Twins"

On December 15, 2023, The National Academies of Sciences, Engineering and Medicine (NASEM) released a report entitled: "Foundational Research Gaps and Future Directions for Digital Twins." The ostensible purpose of this report was to bring some structure to the burgeoning field of digital twins by providing a working definition and a series of research challenges that need to be addressed to allow this technology to fulfill its full potential. In the work presented herein we focus on five specific findings from the NASEM Report: 1) definition of a Digital Twin, 2) using "fit-for-purpose" guidance, 3) developing novel approaches to Verification, Validation and Uncertainty Quantification (VVUQ) of Digital Twins, 4) incorporating control as an explicit purpose for a Digital Twin and 5) using a Digital Twin to guide data collection and sensor development, and describe how these findings are addressed through the design specifications for a Critical Illness Digital Twin (CIDT) aimed at curing sepsis.

The Wound Environment Agent-based Model (WEABM): a digital twin platform for characterization and complex therapeutic discovery for volumetric muscle loss

Volumetric Muscle Loss (VML) injuries are characterized by significant loss of muscle mass, usually due to trauma or surgical resection, often with a residual open wound in clinical settings and subsequent loss of limb function due to the replacement of the lost muscle mass with non-functional scar. Being able to regrow functional muscle in VML injuries is a complex control problem that needs to override robust, evolutionarily conserved healing processes aimed at rapidly closing the defect in lieu of restoration of function. We propose that discovering and implementing this complex control can be accomplished by the development of a Medical Digital Twin of VML. Digital Twins (DTs) are the subject of a recent report from the National Academies of Science, Engineering and Medicine (NASEM), which provides guidance as to the definition, capabilities and research challenges associated with the development and implementation of DTs. Specifically, DTs are defined as dynamic computational models that can be personalized to an individual real world "twin" and are connected to that twin via an ongoing data link. DTs can be used to provide control on the real-world twin that is, by the ongoing data connection, adaptive. We have developed an anatomic scale cell-level agent-based model of VML termed the Wound Environment Agent Based Model (WEABM) that can serve as the computational specification for a DT of VML. Simulations of the WEABM provided fundamental insights into the biology of VML, and we used the WEABM in our previously developed pipeline for simulation-based Deep Reinforcement Learning (DRL) to train an artificial intelligence (AI) to implement a robust generalizable control policy aimed at increasing the healing of VML with functional muscle. The insights into VML obtained include: 1) a competition between fibrosis and myogenesis due to spatial constraints on available edges of intact myofibrils to initiate the myoblast differentiation process, 2) the need to biologically "close" the wound from atmospheric/environmental exposure, which represents an ongoing inflammatory stimulus that promotes fibrosis and 3) that selective, multimodal and adaptive local mediator-level control can shift the trajectory of healing away from a highly evolutionarily beneficial imperative to close the wound via fibrosis. Control discovery with the WEABM identified the following design principles: 1) multimodal adaptive tissue-level mediator control to mitigate pro-inflammation as well as the pro-fibrotic aspects of compensatory anti-inflammation, 2) tissue-level mediator manipulation to promote myogenesis, 3) the use of an engineered extracellular matrix (ECM) to functionally close the wound and 4) the administration of an anti-fibrotic agent focused on the collagen-producing function of fibroblasts and myofibroblasts. The WEABM-trained DRL AI integrates these control modalities and provides design specifications for a potential device that can implement the required wound sensing and intervention delivery capabilities needed. The proposed cyber-physical system integrates the control AI with a physical sense-and-actuate device that meets the tenets of DTs put forth in the NASEM report and can serve as an example schema for the future development of Medical DTs.

Digital twins and artificial intelligence in metabolic disease research

Digital twin technology is emerging as a transformative paradigm for personalized medicine in the management of chronic conditions. In this article, we explore the concept and key characteristics of a digital twin and its applications in chronic non-communicable metabolic disease management, with a focus on diabetes case studies. We cover various types of digital twin models, including mechanistic models based on ODEs, data-driven ML algorithms, and hybrid modeling strategies that combine the strengths of both approaches. We present successful case studies demonstrating the potential of digital twins in improving glucose outcomes for individuals with T1D and T2D, and discuss the benefits and challenges of translating digital twin research applications to clinical practice.

Surrogate modeling and control of medical digital twins

The vision of personalized medicine is to identify interventions that maintain or restore a person's health based on their individual biology. Medical digital twins, computational models that integrate a wide range of health-related data about a person and can be dynamically updated, are a key technology that can help guide medical decisions. Such medical digital twin models can be high-dimensional, multi-scale, and stochastic. To be practical for healthcare applications, they often need to be simplified into low-dimensional surrogate models that can be used for optimal design of interventions. This paper introduces surrogate modeling algorithms for the purpose of optimal control applications. As a use case, we focus on agent-based models (ABMs), a common model type in biomedicine for which there are no readily available optimal control algorithms. By deriving surrogate models that are based on systems of ordinary differential equations, we show how optimal control methods can be employed to compute effective interventions, which can then be lifted back to a given ABM. The relevance of the methods introduced here extends beyond medical digital twins to other complex dynamical systems.

Envisioning the Future of Personalized Medicine: Role and Realities of Digital Twins

Digital twins have emerged as a groundbreaking concept in personalized medicine, offering immense potential to transform health care delivery and improve patient outcomes. It is important to highlight the impact of digital twins on personalized medicine across the understanding of patient health, risk assessment, clinical trials and drug development, and patient monitoring. By mirroring individual health profiles, digital twins offer unparalleled insights into patient-specific conditions, enabling more accurate risk assessments and tailored interventions. However, their application extends beyond clinical benefits, prompting significant ethical debates over data privacy, consent, and potential biases in health care. The rapid evolution of this technology necessitates a careful balancing act between innovation and ethical responsibility. As the field of personalized medicine continues to evolve, digital twins hold tremendous promise in transforming health care delivery and revolutionizing patient care. While challenges exist, the continued development and integration of digital twins hold the potential to revolutionize personalized medicine, ushering in an era of tailored treatments and improved patient well-being. Digital twins can assist in recognizing trends and indicators that might signal the presence of diseases or forecast the likelihood of developing specific medical conditions, along with the progression of such diseases. Nevertheless, the use of human digital twins gives rise to ethical dilemmas related to informed consent, data ownership, and the potential for discrimination based on health profiles. There is a critical need for robust guidelines and regulations to navigate these challenges, ensuring that the pursuit of advanced health care solutions does not compromise patient rights and well-being. This viewpoint aims to ignite a comprehensive dialogue on the responsible integration of digital twins in medicine, advocating for a future where technology serves as a cornerstone for personalized, ethical, and effective patient care.

Concepts of multi-level dynamical modelling: understanding mechanisms of squamous cell carcinoma development in Fanconi anemia

Fanconi anemia (FA) is a rare disease (incidence of 1:300,000) primarily based on the inheritance of pathogenic variants in genes of the FA/BRCA (breast cancer) pathway. These variants ultimately reduce the functionality of different proteins involved in the repair of DNA interstrand crosslinks and DNA double-strand breaks. At birth, individuals with FA might present with typical malformations, particularly radial axis and renal malformations, as well as other physical abnormalities like skin pigmentation anomalies. During the first decade of life, FA mostly causes bone marrow failure due to reduced capacity and loss of the hematopoietic stem and progenitor cells. This often makes hematopoietic stem cell transplantation necessary, but this therapy increases the already intrinsic risk of developing squamous cell carcinoma (SCC) in early adult age. Due to the underlying genetic defect in FA, classical chemo-radiation-based treatment protocols cannot be applied. Therefore, detecting and treating the multi-step tumorigenesis process of SCC in an early stage, or even its progenitors, is the best option for prolonging the life of adult FA individuals. However, the small number of FA individuals makes classical evidence-based medicine approaches based on results from randomized clinical trials impossible. As an alternative, we introduce here the concept of multi-level dynamical modelling using large, longitudinally collected genome, proteome- and transcriptome-wide data sets from a small number of FA individuals. This mechanistic modelling approach is based on the "hallmarks of cancer in FA", which we derive from our unique database of the clinical history of over 750 FA individuals. Multi-omic data from healthy and diseased tissue samples of FA individuals are to be used for training constituent models of a multi-level tumorigenesis model, which will then be used to make experimentally testable predictions. In this way, mechanistic models facilitate not only a descriptive but also a functional understanding of SCC in FA. This approach will provide the basis for detecting signatures of SCCs at early stages and their precursors so they can be efficiently treated or even prevented, leading to a better prognosis and quality of life for the FA individual.

Preparing for the next pandemic: Simulation-based deep reinforcement learning to discover and test multimodal control of systemic inflammation using repurposed immunomodulatory agents

Background

Preparation to address the critical gap in a future pandemic between non-pharmacological measures and the deployment of new drugs/vaccines requires addressing two factors: 1) finding virus/pathogen-agnostic pathophysiological targets to mitigate disease severity and 2) finding a more rational approach to repurposing existing drugs. It is increasingly recognized that acute viral disease severity is heavily driven by the immune response to the infection ("cytokine storm" or "cytokine release syndrome"). There exist numerous clinically available biologics that suppress various pro-inflammatory cytokines/mediators, but it is extremely difficult to identify clinically effective treatment regimens with these agents. We propose that this is a complex control problem that resists standard methods of developing treatment regimens and accomplishing this goal requires the application of simulation-based, model-free deep reinforcement learning (DRL) in a fashion akin to training successful game-playing artificial intelligences (AIs). This proof-of-concept study determines if simulated sepsis (e.g. infection-driven cytokine storm) can be controlled in the absence of effective antimicrobial agents by targeting cytokines for which FDA-approved biologics currently exist.

Methods

We use a previously validated agent-based model, the Innate Immune Response Agent-based Model (IIRABM), for control discovery using DRL. DRL training used a Deep Deterministic Policy Gradient (DDPG) approach with a clinically plausible control interval of 6 hours with manipulation of six cytokines for which there are existing drugs: Tumor Necrosis Factor (TNF), Interleukin-1 (IL-1), Interleukin-4 (IL-4), Interleukin-8 (IL-8), Interleukin-12 (IL-12) and Interferon-γ(IFNg).

Results

DRL trained an AI policy that could improve outcomes from a baseline Recovered Rate of 61% to one with a Recovered Rate of 90% over ~21 days simulated time. This DRL policy was then tested on four different parameterizations not seen in training representing a range of host and microbe characteristics, demonstrating a range of improvement in Recovered Rate by +33% to +56.

Discussion

The current proof-of-concept study demonstrates that significant disease severity mitigation can potentially be accomplished with existing anti-mediator drugs, but only through a multi-modal, adaptive treatment policy requiring implementation with an AI. While the actual clinical implementation of this approach is a projection for the future, the current goal of this work is to inspire the development of a research ecosystem that marries what is needed to improve the simulation models with the development of the sensing/assay technologies to collect the data needed to iteratively refine those models.