A Flexible Approach for Context-Dependent Assessment of Quantitative Systems Pharmacology Models

An industry perspective on current QSP trends in drug development

2023 marks the 10th anniversary of Natpara's submission to the US FDA, which led to the first recorded regulatory interaction where a decision was supported by Quantitative and Systems Pharmacology (QSP) simulations. It had taken about 5 years for the timid QSP discipline to emerge as an effective Model-Informed Drug Development (MIDD) tool with visible impact in the pharmaceutical industry. Since then, the presence of QSP in the regulatory environment has continued to increase, to the point that the Agency reported 60 QSP submissions in 2020 alone, representing ~ 4% of their annual IND submissions [1]. What sort of industry mindset has enabled QSP to reach this level of success? How does QSP fit within the MIDD paradigm? Does QSP mean the same to Discovery and to Clinical Development projects? How do 'platforms' compare to 'fit-for-purpose' QSP models in an industrial setting? Can QSP and empirical Pharmacokinetic-Pharmacodynamic (PKPD) modelling be complementary? What level of validation is required to inform drug development decisions? This article reflects on all these questions, in particular addressing those audiences with limited line-of-sight into the drug industry decision-making machinery.

Assessing the performance of QSP models: biology as the driver for validation

Validation of a quantitative model is a critical step in establishing confidence in the model's suitability for whatever analysis it was designed. While processes for validation are well-established in the statistical sciences, the field of quantitative systems pharmacology (QSP) has taken a more piecemeal approach to defining and demonstrating validation. Although classical statistical methods can be used in a QSP context, proper validation of a mechanistic systems model requires a more nuanced approach to what precisely is being validated, and what role said validation plays in the larger context of the analysis. In this review, we summarize current thoughts of QSP validation in the scientific community, contrast the aims of statistical validation from several contexts (including inference, pharmacometrics analysis, and machine learning) with the challenges faced in QSP analysis, and use examples from published QSP models to define different stages or levels of validation, any of which may be sufficient depending on the context at hand.

Opportunities and Challenges of Disease Progression Modeling in Drug Development - An IQ Perspective

Disease progression modeling (DPM) represents an important model-informed drug development framework. The scientific communities support the use of DPM to accelerate and increase efficiency in drug development. This article summarizes International Consortium for Innovation & Quality (IQ) in Pharmaceutical Development mediated survey conducted across multiple biopharmaceutical companies on challenges and opportunities for DPM. Additionally, this summary highlights the viewpoints of IQ from the 2021 workshop hosted by the US Food and Drug Administration (FDA). Sixteen pharmaceutical companies participated in the IQ survey with 36 main questions. The types of questions included single/multiple choice, dichotomous, rank questions, and open-ended or free text. The key results show that DPM has different representation, it encompasses natural disease history, placebo response, standard of care as background therapy, and can even be interpreted as pharmacokinetic/pharmacodynamic modeling. The most common reasons for not implementing DPM as frequently seem to be difficulties in internal cross-functional alignment, lack of knowledge of disease/data, and time constraints. If successfully implemented, DPM can have an impact on dose selection, reduction of sample size, trial read-out support, patient selection/stratification, and supportive evidence for regulatory interactions. The key success factors and key challenges of disease progression models were highlighted in the survey and about 24 case studies across different therapeutic areas were submitted from various survey sponsors. Although DPM is still evolving, its current impact is limited but promising. The success of such models in the future will depend on collaboration, advanced analytics, availability of and access to relevant and adequate-quality data, collaborative regulatory guidance, and published examples of impact.

Towards a comprehensive assessment of QSP models: what would it take?

Quantitative Systems Pharmacology (QSP) has emerged as a powerful ensemble of approaches aiming at developing integrated mathematical and computational models elucidating the complex interactions between pharmacology, physiology, and disease. As the field grows and matures its applications expand beyond the boundaries of research and development and slowly enter the decision making and regulatory arenas. However, widespread acceptance and eventual adoption of a new modeling approach requires assessment criteria and quantifiable metrics that establish credibility and increase confidence in model predictions. QSP aims to provide an integrated understanding of pathology in the context of therapeutic interventions. Because of its ambitious nature and the fact that QSP emerged in an uncoordinated manner as a result of activities distributed across organizations and academic institutions, high entropy characterizes the tools, methods, and computational methodologies and approaches used. The eventual acceptance of QSP model predictions as supporting material for an application to a regulatory agency will require that two key aspects are considered: (1) increase confidence in the QSP framework, which drives standardization and assessment; and (2) careful articulation of the expectations. Both rely heavily on our ability to rigorously and consistently assess QSP models. In this manuscript, we wish to discuss the meaning and purpose of such an assessment in the context of QSP model development and elaborate on the differentiating features of QSP that render such an endeavor challenging. We argue that QSP establishes a conceptual, integrative framework rather than a specific and well-defined computational methodology. QSP elicits the use of a wide variety of modeling and computational methodologies optimized with respect to specific applications and available data modalities, which exceed the data structures employed by chemometrics and PK/PD models. While the range of options fosters creativity and promises to substantially advance our ability to design pharmaceutical interventions rationally and optimally, our expectations of QSP models need to be clearly articulated and agreed on, with assessment emphasizing the scope of QSP studies rather than the methods used. Nevertheless, QSP should not be considered an independent approach, rather one of many in the broader continuum of computational models.

Current practices for QSP model assessment: an IQ consortium survey

Quantitative Systems Pharmacology (QSP) modeling is increasingly applied in the pharmaceutical industry to influence decision making across a wide range of stages from early discovery to clinical development to post-marketing activities. Development of standards for how these models are constructed, assessed, and communicated is of active interest to the modeling community and regulators but is complicated by the wide variability in the structures and intended uses of the underlying models and the diverse expertise of QSP modelers. With this in mind, the IQ Consortium conducted a survey across the pharmaceutical/biotech industry to understand current practices for QSP modeling. This article presents the survey results and provides insights into current practices and methods used by QSP practitioners based on model type and the intended use at various stages of drug development. The survey also highlights key areas for future development including better integration with statistical methods, standardization of approaches towards virtual populations, and increased use of QSP models for late-stage clinical development and regulatory submissions.

Virtual Populations for Quantitative Systems Pharmacology Models

Quantitative systems pharmacology (QSP) places an emphasis on dynamic systems modeling, incorporating considerations from systems biology modeling and pharmacodynamics. The goal of QSP is often to quantitatively predict the effects of clinical therapeutics, their combinations, and their doses on clinical biomarkers and endpoints. In order to achieve this goal, strategies for incorporating clinical data into model calibration are critical. Virtual population (VPop) approaches facilitate model calibration while faced with challenges encountered in QSP model application, including modeling a breadth of clinical therapies, biomarkers, endpoints, utilizing data of varying structure and source, capturing observed clinical variability, and simulating with models that may require more substantial computational time and resources than often found in pharmacometrics applications. VPops are frequently developed in a process that may involve parameterization of isolated pathway models, integration into a larger QSP model, incorporation of clinical data, calibration, and quantitative validation that the model with the accompanying, calibrated VPop is suitable to address the intended question or help with the intended decision. Here, we introduce previous strategies for developing VPops in the context of a variety of therapeutic and safety areas: metabolic disorders, drug-induced liver injury, autoimmune diseases, and cancer. We introduce methodological considerations, prior work for sensitivity analysis and VPop algorithm design, and potential areas for future advancement. Finally, we give a more detailed application example of a VPop calibration algorithm that illustrates recent progress and many of the methodological considerations. In conclusion, although methodologies have varied, VPop strategies have been successfully applied to give valid clinical insights and predictions with the assistance of carefully defined and designed calibration and validation strategies. While a uniform VPop approach for all potential QSP applications may be challenging given the heterogeneity in use considerations, we anticipate continued innovation will help to drive VPop application for more challenging cases of greater scale while developing new rigorous methodologies and metrics.

Data-driven learning how oncogenic gene expression locally alters heterocellular networks

Developing drugs increasingly relies on mechanistic modeling and simulation. Models that capture causal relations among genetic drivers of oncogenesis, functional plasticity, and host immunity complement wet experiments. Unfortunately, formulating such mechanistic cell-level models currently relies on hand curation, which can bias how data is interpreted or the priority of drug targets. In modeling molecular-level networks, rules and algorithms are employed to limit a priori biases in formulating mechanistic models. Here we combine digital cytometry with Bayesian network inference to generate causal models of cell-level networks linking an increase in gene expression associated with oncogenesis with alterations in stromal and immune cell subsets from bulk transcriptomic datasets. We predict how increased Cell Communication Network factor 4, a secreted matricellular protein, alters the tumor microenvironment using data from patients diagnosed with breast cancer and melanoma. Predictions are then tested using two immunocompetent mouse models for melanoma, which provide consistent experimental results.

While mechanistic models play increasing roles in immuno-oncology, hand network curation is current practice. Here the authors use a Bayesian data-driven approach to infer how expression of a secreted oncogene alters the cellular landscape within the tumor.

Evaluation framework for systems models

As decisions in drug development increasingly rely on predictions from mechanistic systems models, assessing the predictive capability of such models is becoming more important. Several frameworks for the development of quantitative systems pharmacology (QSP) models have been proposed. In this paper, we add to this body of work with a framework that focuses on the appropriate use of qualitative and quantitative model evaluation methods. We provide details and references for those wishing to apply these methods, which include sensitivity and identifiability analyses, as well as concepts such as validation and uncertainty quantification. Many of these methods have been used successfully in other fields, but are not as common in QSP modeling. We illustrate how to apply these methods to evaluate QSP models, and propose methods to use in two case studies. We also share examples of misleading results when inappropriate analyses are used.

Chimeric Antigen Receptor T Cell Therapies: A Review of Cellular Kinetic-Pharmacodynamic Modeling Approaches

Chimeric antigen receptor T cell (CAR-T cell) therapies have shown significant efficacy in CD19+ leukemias and lymphomas. There remain many challenges and questions for improving next-generation CAR-T cell therapies, and mathematical modeling of CAR-T cells may play a role in supporting further development. In this review, we introduce a mathematical modeling taxonomy for a set of relatively simple cellular kinetic-pharmacodynamic models that describe the in vivo dynamics of CAR-T cell and their interactions with cancer cells. We then discuss potential extensions of this model to include target binding, tumor distribution, cytokine-release syndrome, immunophenotype differentiation, and genotypic heterogeneity.

History and Future Perspectives on the Discipline of Quantitative Systems Pharmacology Modeling and Its Applications

Mathematical biology and pharmacology models have a long and rich history in the fields of medicine and physiology, impacting our understanding of disease mechanisms and the development of novel therapeutics. With an increased focus on the pharmacology application of system models and the advances in data science spanning mechanistic and empirical approaches, there is a significant opportunity and promise to leverage these advancements to enhance the development and application of the systems pharmacology field. In this paper, we will review milestones in the evolution of mathematical biology and pharmacology models, highlight some of the gaps and challenges in developing and applying systems pharmacology models, and provide a vision for an integrated strategy that leverages advances in adjacent fields to overcome these challenges.

Quantitative Systems Pharmacology Approaches for Immuno-Oncology: Adding Virtual Patients to the Development Paradigm

Drug development in oncology commonly exploits the tools of molecular biology to gain therapeutic benefit through reprograming of cellular responses. In immuno‐oncology (IO) the aim is to direct the patient’s own immune system to fight cancer. After remarkable successes of antibodies targeting PD1/PD‐L1 and CTLA4 receptors in targeted patient populations, the focus of further development has shifted toward combination therapies. However, the current drug‐development approach of exploiting a vast number of possible combination targets and dosing regimens has proven to be challenging and is arguably inefficient. In particular, the unprecedented number of clinical trials testing different combinations may no longer be sustainable by the population of available patients. Further development in IO requires a step change in selection and validation of candidate therapies to decrease development attrition rate and limit the number of clinical trials. Quantitative systems pharmacology (QSP) proposes to tackle this challenge through mechanistic modeling and simulation. Compounds’ pharmacokinetics, target binding, and mechanisms of action as well as existing knowledge on the underlying tumor and immune system biology are described by quantitative, dynamic models aiming to predict clinical results for novel combinations. Here, we review the current QSP approaches, the legacy of mathematical models available to quantitative clinical pharmacologists describing interaction between tumor and immune system, and the recent development of IO QSP platform models. We argue that QSP and virtual patients can be integrated as a new tool in existing IO drug development approaches to increase the efficiency and effectiveness of the search for novel combination therapies.

Applications of Quantitative Systems Pharmacology in Model-Informed Drug Discovery: Perspective on Impact and Opportunities

Quantitative systems pharmacology (QSP) approaches have been increasingly applied in the pharmaceutical since the landmark white paper published in 2011 by a National Institutes of Health working group brought attention to the discipline. In this perspective, we discuss QSP in the context of other modeling approaches and highlight the impact of QSP across various stages of drug development and therapeutic areas. We discuss challenges to the field as well as future opportunities.