Structural identifiability of systems biology models: a critical comparison of methods

Molecular causality in the advent of foundation models

Correlation is not causation: this simple and uncontroversial statement has far-reaching implications. Defining and applying causality in biomedical research has posed significant challenges to the scientific community. In this perspective, we attempt to connect the partly disparate fields of systems biology, causal reasoning, and machine learning to inform future approaches in the field of systems biology and molecular medicine.

Two new user-friendly methods to assess pharmacometric parameter identifiability on categorical and continuous scales

Parameter identifiability methods assess whether the parameters of a model are uniquely determined by the observations. While the success of a model fit can provide some information on this, it can be valuable to determine identifiability before any fit has been attempted, or to separate identifiability from other issues. Two concepts that lean themselves well for identifiability analysis and have been underutilized are the sensitivity matrix (SM) and the Fisher information matrix (FIM). This paper presents two newly developed methods, one based on the SM and one based on the FIM. Both methods can assess local identifiability for a wide set of models, can be used with limited effort, and are freely available. The methods require the proposed model in the form of a set of differential equations, the parameter values, and the study design as input. They can be used a priori, as they do not need observed values or a successful model fit. Traditional methods provide a single categorical (yes/no) answer to the question of identifiability. In many cases, this is not very informative, and identifiability depends on study design (e.g., dose levels or observation times) and parameter values. Indicators on a continuous scale characterizing the level of identifiability would provide more detailed and relevant information, for example, to guide model development. Our two methods provide both categorical and continuous indicators. Both methods indicate which parameter combinations are difficult to identify by calculating the directions in parameter space that are least identifiable. The methods were validated with an example problem.

Achieving Occam's razor: Deep learning for optimal model reduction

All fields of science depend on mathematical models. Occam's razor refers to the principle that good models should exclude parameters beyond those minimally required to describe the systems they represent. This is because redundancy can lead to incorrect estimates of model parameters from data, and thus inaccurate or ambiguous conclusions. Here, we show how deep learning can be powerfully leveraged to apply Occam's razor to model parameters. Our method, FixFit, uses a feedforward deep neural network with a bottleneck layer to characterize and predict the behavior of a given model from its input parameters. FixFit has three major benefits. First, it provides a metric to quantify the original model's degree of complexity. Second, it allows for the unique fitting of data. Third, it provides an unbiased way to discriminate between experimental hypotheses that add value versus those that do not. In three use cases, we demonstrate the broad applicability of this method across scientific domains. To validate the method using a known system, we apply FixFit to recover known composite parameters for the Kepler orbit model and a dynamic model of blood glucose regulation. In the latter, we demonstrate the ability to fit the latent parameters to real data. To illustrate how the method can be applied to less well-established fields, we use it to identify parameters for a multi-scale brain model and reduce the search space for viable candidate mechanisms.

Navigating the landscape of parameter identifiability methods: A workflow recommendation for model development

In pharmacometric modeling, it is often important to know whether the data is sufficiently rich to identify the parameters of a proposed model. While it may be possible to assess this based on the results of a model fit, it is often difficult to disentangle identifiability issues from other model fitting and numerical problems. Furthermore, it can be of value to ascertain identifiability beforehand. This paper compares four methods for parameter identifiability, namely Differential Algebra for Identifiability of SYstems (DAISY), the sensitivity matrix method (SMM), Aliasing, and the Fisher information matrix method (FIMM). We discuss the characteristics of the methods and apply them to a set of applications, consisting of frequently used PK model structures, with suitable dosing regimens and sampling times. These applications were selected to validate the methods and demonstrate their usefulness. While traditional identifiability analysis provides a categorical result [PLoS One, 6, 2011, e27755; CPT Pharmacometrics Syst Pharmacol, 8, 2019, 259; Bioinformatics, 30, 2014, 1440], we argue that in practice a continuous scale better reflects the limitations on the data and is more informative. The methods were generally consistent in their evaluation of the applications. The Fisher information matrix method seemed to provide the most consistent answers. All methods provided information on the parameters that were unidentifiable. Some of the results were unexpected, indicating identifiability issues where none were foreseen, but could be explained upon further analysis. This illustrated the usefulness of identifiability assessment.

Making Predictions Using Poorly Identified Mathematical Models

Many commonly used mathematical models in the field of mathematical biology involve challenges of parameter non-identifiability. Practical non-identifiability, where the quality and quantity of data does not provide sufficiently precise parameter estimates is often encountered, even with relatively simple models. In particular, the situation where some parameters are identifiable and others are not is often encountered. In this work we apply a recent likelihood-based workflow, called Profile-Wise Analysis (PWA), to non-identifiable models for the first time. The PWA workflow addresses identifiability, parameter estimation, and prediction in a unified framework that is simple to implement and interpret. Previous implementations of the workflow have dealt with idealised identifiable problems only. In this study we illustrate how the PWA workflow can be applied to both structurally non-identifiable and practically non-identifiable models in the context of simple population growth models. Dealing with simple mathematical models allows us to present the PWA workflow in a didactic, self-contained document that can be studied together with relatively straightforward Julia code provided on GitHub . Working with simple mathematical models allows the PWA workflow prediction intervals to be compared with gold standard full likelihood prediction intervals. Together, our examples illustrate how the PWA workflow provides us with a systematic way of dealing with non-identifiability, especially compared to other approaches, such as seeking ad hoc parameter combinations, or simply setting parameter values to some arbitrary default value. Importantly, we show that the PWA workflow provides insight into the commonly-encountered situation where some parameters are identifiable and others are not, allowing us to explore how uncertainty in some parameters, and combinations of parameters, regardless of their identifiability status, influences model predictions in a way that is insightful and interpretable.

Structural and practical identifiability of contrast transport models for DCE-MRI

Contrast transport models are widely used to quantify blood flow and transport in dynamic contrast-enhanced magnetic resonance imaging. These models analyze the time course of the contrast agent concentration, providing diagnostic and prognostic value for many biological systems. Thus, ensuring accuracy and repeatability of the model parameter estimation is a fundamental concern. In this work, we analyze the structural and practical identifiability of a class of nested compartment models pervasively used in analysis of MRI data. We combine artificial and real data to study the role of noise in model parameter estimation. We observe that although all the models are structurally identifiable, practical identifiability strongly depends on the data characteristics. We analyze the impact of increasing data noise on parameter identifiability and show how the latter can be recovered with increased data quality. To complete the analysis, we show that the results do not depend on specific tissue characteristics or the type of enhancement patterns of contrast agent signal.

Mathematical modeling of transdermal delivery of topical drug formulations in a dynamic microfluidic diffusion chamber in health and disease

Mathematical models of epidermal and dermal transport are essential for optimization and development of products for percutaneous delivery both for local and systemic indication and for evaluation of dermal exposure to chemicals for assessing their toxicity. These models often help directly by providing information on the rate of drug penetration through the skin and thus on the dermal or systemic concentration of drugs which is the base of their pharmacological effect. The simulations are also helpful in analyzing experimental data, reducing the number of experiments and translating the in vitro investigations to an in-vivo setting. In this study skin penetration of topically administered caffeine cream was investigated in a skin-on-a-chip microfluidic diffusion chamber at room temperature and at 32°C. Also the transdermal penetration of caffeine in healthy and diseased conditions was compared in mouse skins from intact, psoriatic and allergic animals. In the last experimental setup dexamethasone, indomethacin, piroxicam and diclofenac were examined as a cream formulation for absorption across the dermal barrier. All the measured data were used for making mathematical simulation in a three-compartmental model. The calculated and measured results showed a good match, which findings indicate that our mathematical model might be applied for prediction of drug delivery through the skin under different circumstances and for various drugs in the novel, miniaturized diffusion chamber.

Revisiting the observability and identifiability properties of a popular HIV model

This paper revisits the observability and identifiability properties of a popular ODE model commonly adopted to characterize the HIV dynamics in HIV-infected patients with antiretroviral treatment. These properties are determined by using the general analytical solution of the unknown input observability problem, introduced very recently in Martinelli (2022). This solution provides the systematic procedures able to determine the state observability and the parameter identifiability of any ODE model, in particular, even in the presence of time varying parameters. Four variants of the HIV model are investigated. They differ because some of their parameters are considered constant or time varying. Fundamental new properties, which also highlight an error in the scientific literature, are automatically determined and discussed. Additionally, for each variant, the paper provides a quantitative answer to the following practical question: What is the minimal external information (external to the available measurements of the system outputs) required to make observable the state and identifiable all the model parameters? The answer to this fundamental question is obtained by exploiting the concept of continuous symmetry, recently introduced in Martinelli (2019). This concept allows us to determine a first preliminary general result which is then applied to the HIV model. Finally, for each variant, the paper concludes by providing a redefinition of the state and of the parameters in order to obtain a full description of the system only in terms of a state which is observable and a set of parameters which are identifiable (both constant and time varying).

Structural and practical identifiability analysis in bioengineering: a beginner's guide

Advancements in digital technology have brought modelling to the forefront in many disciplines from healthcare to architecture. Mathematical models, often represented using parametrised sets of ordinary differential equations, can be used to characterise different processes. To infer possible estimates for the unknown parameters, these models are usually calibrated using associated experimental data. Structural and practical identifiability analyses are a key component that should be assessed prior to parameter estimation. This is because identifiability analyses can provide insights as to whether or not a parameter can take on single, multiple, or even infinitely or countably many values which will ultimately have an impact on the reliability of the parameter estimates. Also, identifiability analyses can help to determine whether the data collected are sufficient or of good enough quality to truly estimate the parameters or if more data or even reparameterization of the model is necessary to proceed with the parameter estimation process. Thus, such analyses also provide an important role in terms of model design (structural identifiability analysis) and the collection of experimental data (practical identifiability analysis). Despite the popularity of using data to estimate the values of unknown parameters, structural and practical identifiability analyses of these models are often overlooked. Possible reasons for non-consideration of application of such analyses may be lack of awareness, accessibility, and usability issues, especially for more complicated models and methods of analysis. The aim of this study is to introduce and perform both structural and practical identifiability analyses in an accessible and informative manner via application to well established and commonly accepted bioengineering models. This will help to improve awareness of the importance of this stage of the modelling process and provide bioengineering researchers with an understanding of how to utilise the insights gained from such analyses in future model development.

Parameter Identifiability in PDE Models of Fluorescence Recovery After Photobleaching

Identifying unique parameters for mathematical models describing biological data can be challenging and often impossible. Parameter identifiability for partial differential equations models in cell biology is especially difficult given that many established in vivo measurements of protein dynamics average out the spatial dimensions. Here, we are motivated by recent experiments on the binding dynamics of the RNA-binding protein PTBP3 in RNP granules of frog oocytes based on fluorescence recovery after photobleaching (FRAP) measurements. FRAP is a widely-used experimental technique for probing protein dynamics in living cells, and is often modeled using simple reaction-diffusion models of the protein dynamics. We show that current methods of structural and practical parameter identifiability provide limited insights into identifiability of kinetic parameters for these PDE models and spatially-averaged FRAP data. We thus propose a pipeline for assessing parameter identifiability and for learning parameter combinations based on re-parametrization and profile likelihoods analysis. We show that this method is able to recover parameter combinations for synthetic FRAP datasets and investigate its application to real experimental data.

In vitro PK/PD modeling of tyrosine kinase inhibitors in non-small cell lung cancer cell lines

Tyrosine kinase inhibitors (TKIs) are routinely prescribed for the treatment of non-small cell lung cancer (NSCLC). As with all medications, patients can experience adverse events due to TKIs. Unfortunately, the relationship between many TKIs and the occurrence of certain adverse events remains unclear. There are limited in vivo studies which focus on TKIs and their effects on different regulation pathways. Many in vitro studies, however, that investigate the effects of TKIs observe additional changes, such as changes in gene activations or protein expressions. These studies could potentially help to gain greater understanding of the mechanisms for TKI induced adverse events. However, in order to utilize these pathways in a pharmacokinetic/pharmacodynamic (PK/PD) framework, an in vitro PK/PD model needs to be developed, in order to characterize the effects of TKIs in NSCLC cell lines. Through the use of ordinary differential equations, cell viability data and nonlinear mixed effects modeling, an in vitro TKI PK/PD model was developed with estimated PK and PD parameter values for the TKIs alectinib, crizotinib, erlotinib, and gefitinib. The relative standard errors for the population parameters are all less than 25%. The inclusion of random effects enabled the model to predict individual parameter values which provided a closer fit to the observed response. It is hoped that this model can be extended to include in vitro data of certain pathways that may potentially be linked with adverse events and provide a better understanding of TKI-induced adverse events.

Parameter identifiability and model selection for partial differential equation models of cell invasion

When employing mechanistic models to study biological phenomena, practical parameter identifiability is important for making accurate predictions across wide ranges of unseen scenarios, as well as for understanding the underlying mechanisms. In this work, we use a profile-likelihood approach to investigate parameter identifiability for four extensions of the Fisher-Kolmogorov-Petrovsky-Piskunov (Fisher-KPP) model, given experimental data from a cell invasion assay. We show that more complicated models tend to be less identifiable, with parameter estimates being more sensitive to subtle differences in experimental procedures, and that they require more data to be practically identifiable. As a result, we suggest that parameter identifiability should be considered alongside goodness-of-fit and model complexity as criteria for model selection.

Endothelial cells signaling and patterning under hypoxia: a mechanistic integrative computational model including the Notch-Dll4 pathway

Introduction: Several signaling pathways are activated during hypoxia to promote angiogenesis, leading to endothelial cell patterning, interaction, and downstream signaling. Understanding the mechanistic signaling differences between endothelial cells under normoxia and hypoxia and their response to different stimuli can guide therapies to modulate angiogenesis. We present a novel mechanistic model of interacting endothelial cells, including the main pathways involved in angiogenesis. Methods: We calibrate and fit the model parameters based on well-established modeling techniques that include structural and practical parameter identifiability, uncertainty quantification, and global sensitivity. Results: Our results indicate that the main pathways involved in patterning tip and stalk endothelial cells under hypoxia differ, and the time under hypoxia interferes with how different stimuli affect patterning. Additionally, our simulations indicate that Notch signaling might regulate vascular permeability and establish different Nitric Oxide release patterns for tip/stalk cells. Following simulations with various stimuli, our model suggests that factors such as time under hypoxia and oxygen availability must be considered for EC pattern control. Discussion: This project provides insights into the signaling and patterning of endothelial cells under various oxygen levels and stimulation by VEGFA and is our first integrative approach toward achieving EC control as a method for improving angiogenesis. Overall, our model provides a computational framework that can be built on to test angiogenesis-related therapies by modulation of different pathways, such as the Notch pathway.

Practical Identifiability of Plant Growth Models: A Unifying Framework and Its Specification for Three Local Indices

Amid the rise of machine learning models, a substantial portion of plant growth models remains mechanistic, seeking to capture an in-depth understanding of the underlying phenomena governing the system's dynamics. The development of these models typically involves parameter estimation from experimental data. Ensuring that the estimated parameters align closely with their respective "true" values is crucial since they hold biological interpretation, leading to the challenge of uniqueness in the solutions. Structural identifiability analysis addresses this issue under the assumption of perfect observations of system dynamics, whereas practical identifiability considers limited measurements and the accompanying noise. In the literature, definitions for structural identifiability vary only slightly among authors, whereas the concept and quantification of practical identifiability lack consensus, with several indices coexisting. In this work, we provide a unified framework for studying identifiability, accommodating different definitions that need to be instantiated depending on each application case. In a more applicative second step, we focus on three widely used methods for quantifying practical identifiability: collinearity indices, profile likelihood, and average relative error. We show the limitations of their local versions, and we propose a new risk index built on the profile likelihood-based confidence intervals. We illustrate the usefulness of these concepts for plant growth modeling using a discrete-time individual plant growth model, LNAS, and a continuous-time plant population epidemics model. Through this work, we aim to underline the significance of identifiability analysis as a complement to any parameter estimation study and offer guidance to the modeler.

Classical structural identifiability methodology applied to low-dimensional dynamic systems in receptor theory

Mathematical modelling has become a key tool in pharmacological analysis, towards understanding dynamics of cell signalling and quantifying ligand-receptor interactions. Ordinary differential equation (ODE) models in receptor theory may be used to parameterise such interactions using timecourse data, but attention needs to be paid to the theoretical identifiability of the parameters of interest. Identifiability analysis is an often overlooked step in many bio-modelling works. In this paper we introduce structural identifiability analysis (SIA) to the field of receptor theory by applying three classical SIA methods (transfer function, Taylor Series and similarity transformation) to ligand-receptor binding models of biological importance (single ligand and Motulsky-Mahan competition binding at monomers, and a recently presented model of a single ligand binding at receptor dimers). New results are obtained which indicate the identifiable parameters for a single timecourse for Motulsky-Mahan binding and dimerised receptor binding. Importantly, we further consider combinations of experiments which may be performed to overcome issues of non-identifiability, to ensure the practical applicability of the work. The three SIA methods are demonstrated through a tutorial-style approach, using detailed calculations, which show the methods to be tractable for the low-dimensional ODE models.

Implementing measurement error models with mechanistic mathematical models in a likelihood-based framework for estimation, identifiability analysis and prediction in the life sciences

Throughout the life sciences, we routinely seek to interpret measurements and observations using parametrized mechanistic mathematical models. A fundamental and often overlooked choice in this approach involves relating the solution of a mathematical model with noisy and incomplete measurement data. This is often achieved by assuming that the data are noisy measurements of the solution of a deterministic mathematical model, and that measurement errors are additive and normally distributed. While this assumption of additive Gaussian noise is extremely common and simple to implement and interpret, it is often unjustified and can lead to poor parameter estimates and non-physical predictions. One way to overcome this challenge is to implement a different measurement error model. In this review, we demonstrate how to implement a range of measurement error models in a likelihood-based framework for estimation, identifiability analysis and prediction, called profile-wise analysis. This frequentist approach to uncertainty quantification for mechanistic models leverages the profile likelihood for targeting parameters and understanding their influence on predictions. Case studies, motivated by simple caricature models routinely used in systems biology and mathematical biology literature, illustrate how the same ideas apply to different types of mathematical models. Open-source Julia code to reproduce results is available on GitHub.

Structural and practical identifiability of contrast transport models for DCE-MRI

Compartment models are widely used to quantify blood flow and transport in dynamic contrast-enhanced magnetic resonance imaging. These models analyze the time course of the contrast agent concentration, providing diagnostic and prognostic value for many biological systems. Thus, ensuring accuracy and repeatability of the model parameter estimation is a fundamental concern. In this work, we analyze the structural and practical identifiability of a class of nested compartment models pervasively used in analysis of MRI data. We combine artificial and real data to study the role of noise in model parameter estimation. We observe that although all the models are structurally identifiable, practical identifiability strongly depends on the data characteristics. We analyze the impact of increasing data noise on parameter identifiability and show how the latter can be recovered with increased data quality. To complete the analysis, we show that the results do not depend on specific tissue characteristics or the type of enhancement patterns of contrast agent signal.

A computational approach to identifiability analysis for a model of the propagation and control of COVID-19 in Chile

A computational approach is adapted to analyze the parameter identifiability of a compartmental model. The model is intended to describe the progression of the COVID-19 pandemic in Chile during the initial phase in early 2020 when government declared quarantine measures. The computational approach to analyze the structural and practical identifiability is applied in two parts, one for synthetic data and another for some Chilean regional data. The first part defines the identifiable parameter sets when these recover the true parameters used to create the synthetic data. The second part compares the results derived from synthetic data, estimating the identifiable parameter sets from regional Chilean epidemic data. Experiments provide evidence of the loss of identifiability if some initial conditions are estimated, the period of time used to fit is before the peak, and if a significant proportion of the population is involved in quarantine periods.

Structural identifiability analysis of epidemic models based on differential equations: a tutorial-based primer

The successful application of epidemic models hinges on our ability to estimate model parameters from limited observations reliably. An often-overlooked step before estimating model parameters consists of ensuring that the model parameters are structurally identifiable from the observed states of the system. In this tutorial-based primer, intended for a diverse audience, including students training in dynamic systems, we review and provide detailed guidance for conducting structural identifiability analysis of differential equation epidemic models based on a differential algebra approach using differential algebra for identifiability of systems (DAISY) and Mathematica (Wolfram Research). This approach aims to uncover any existing parameter correlations that preclude their estimation from the observed variables. We demonstrate this approach through examples, including tutorial videos of compartmental epidemic models previously employed to study transmission dynamics and control. We show that the lack of structural identifiability may be remedied by incorporating additional observations from different model states, assuming that the system's initial conditions are known, using prior information to fix some parameters involved in parameter correlations, or modifying the model based on existing parameter correlations. We also underscore how the results of structural identifiability analysis can help enrich compartmental diagrams of differential-equation models by indicating the observed state variables and the results of the structural identifiability analysis.

Profile-Wise Analysis: A profile likelihood-based workflow for identifiability analysis, estimation, and prediction with mechanistic mathematical models

Interpreting data using mechanistic mathematical models provides a foundation for discovery and decision-making in all areas of science and engineering. Developing mechanistic insight by combining mathematical models and experimental data is especially critical in mathematical biology as new data and new types of data are collected and reported. Key steps in using mechanistic mathematical models to interpret data include: (i) identifiability analysis; (ii) parameter estimation; and (iii) model prediction. Here we present a systematic, computationally-efficient workflow we call Profile-Wise Analysis (PWA) that addresses all three steps in a unified way. Recently-developed methods for constructing 'profile-wise' prediction intervals enable this workflow and provide the central linkage between different workflow components. These methods propagate profile-likelihood-based confidence sets for model parameters to predictions in a way that isolates how different parameter combinations affect model predictions. We show how to extend these profile-wise prediction intervals to two-dimensional interest parameters. We then demonstrate how to combine profile-wise prediction confidence sets to give an overall prediction confidence set that approximates the full likelihood-based prediction confidence set well. Our three case studies illustrate practical aspects of the workflow, focusing on ordinary differential equation (ODE) mechanistic models with both Gaussian and non-Gaussian noise models. While the case studies focus on ODE-based models, the workflow applies to other classes of mathematical models, including partial differential equations and simulation-based stochastic models. Open-source software on GitHub can be used to replicate the case studies.

Valorization of organic wastes using bioreactors for polyhydroxyalkanoate production: Recent advancement, sustainable approaches, challenges, and future perspectives

Microbial polyhydroxyalkanoates (PHA) are encouraging biodegradable polymers, which may ease the environmental problems caused by petroleum-derived plastics. However, there is a growing waste removal problem and the high price of pure feedstocks for PHA biosynthesis. This has directed to the forthcoming requirement to upgrade waste streams from various industries as feedstocks for PHA production. This review covers the state-of-the-art progress in utilizing low-cost carbon substrates, effective upstream and downstream processes, and waste stream recycling to sustain entire process circularity. This review also enlightens the use of various batch, fed-batch, continuous, and semi-continuous bioreactor systems with flexible results to enhance the productivity and simultaneously cost reduction. The life-cycle and techno-economic analyses, advanced tools and strategies for microbial PHA biosynthesis, and numerous factors affecting PHA commercialization were also covered. The review includes the ongoing and upcoming strategies viz. metabolic engineering, synthetic biology, morphology engineering, and automation to expand PHA diversity, diminish production costs, and improve PHA production with an objective of "zero-waste" and "circular bioeconomy" for a sustainable future.

Quantifying Parameter Interdependence in Stochastic Discrete Models of Biochemical Systems

Stochastic modeling of biochemical processes at the cellular level has been the subject of intense research in recent years. The Chemical Master Equation is a broadly utilized stochastic discrete model of such processes. Numerous important biochemical systems consist of many species subject to many reactions. As a result, their mathematical models depend on many parameters. In applications, some of the model parameters may be unknown, so their values need to be estimated from the experimental data. However, the problem of parameter value inference can be quite challenging, especially in the stochastic setting. To estimate accurately the values of a subset of parameters, the system should be sensitive with respect to variations in each of these parameters and they should not be correlated. In this paper, we propose a technique for detecting collinearity among models' parameters and we apply this method for selecting subsets of parameters that can be estimated from the available data. The analysis relies on finite-difference sensitivity estimations and the singular value decomposition of the sensitivity matrix. We illustrated the advantages of the proposed method by successfully testing it on several models of biochemical systems of practical interest.

Structural identifiability of biomolecular controller motifs with and without flow measurements as model output

Controller motifs are simple biomolecular reaction networks with negative feedback. They can explain how regulatory function is achieved and are often used as building blocks in mathematical models of biological systems. In this paper we perform an extensive investigation into structural identifiability of controller motifs, specifically the so-called basic and antithetic controller motifs. Structural identifiability analysis is a useful tool in the creation and evaluation of mathematical models: it can be used to ensure that model parameters can be determined uniquely and to examine which measurements are necessary for this purpose. This is especially useful for biological models where parameter estimation can be difficult due to limited availability of measureable outputs. Our aim with this work is to investigate how structural identifiability is affected by controller motif complexity and choice of measurements. To increase the number of potential outputs we propose two methods for including flow measurements and show how this affects structural identifiability in combination with, or in the absence of, concentration measurements. In our investigation, we analyze 128 different controller motif structures using a combination of flow and/or concentration measurements, giving a total of 3648 instances. Among all instances, 34% of the measurement combinations provided structural identifiability. Our main findings for the controller motifs include: i) a single measurement is insufficient for structural identifiability, ii) measurements related to different chemical species are necessary for structural identifiability. Applying these findings result in a reduced subset of 1568 instances, where 80% are structurally identifiable, and more complex/interconnected motifs appear easier to structurally identify. The model structures we have investigated are commonly used in models of biological systems, and our results demonstrate how different model structures and measurement combinations affect structural identifiability of controller motifs.

Statistical inference of the rates of cell proliferation and phenotypic switching in cancer

Recent evidence suggests that nongenetic (epigenetic) mechanisms play an important role at all stages of cancer evolution. In many cancers, these mechanisms have been observed to induce dynamic switching between two or more cell states, which commonly show differential responses to drug treatments. To understand how these cancers evolve over time, and how they respond to treatment, we need to understand the state-dependent rates of cell proliferation and phenotypic switching. In this work, we propose a rigorous statistical framework for estimating these parameters, using data from commonly performed cell line experiments, where phenotypes are sorted and expanded in culture. The framework explicitly models the stochastic dynamics of cell division, cell death and phenotypic switching, and it provides likelihood-based confidence intervals for the model parameters. The input data can be either the fraction of cells or the number of cells in each state at one or more time points. Through a combination of theoretical analysis and numerical simulations, we show that when cell fraction data is used, the rates of switching may be the only parameters that can be estimated accurately. On the other hand, using cell number data enables accurate estimation of the net division rate for each phenotype, and it can even enable estimation of the state-dependent rates of cell division and cell death. We conclude by applying our framework to a publicly available dataset.

Quantifying tissue growth, shape and collision via continuum models and Bayesian inference

Although tissues are usually studied in isolation, this situation rarely occurs in biology, as cells, tissues and organs coexist and interact across scales to determine both shape and function. Here, we take a quantitative approach combining data from recent experiments, mathematical modelling and Bayesian parameter inference, to describe the self-assembly of multiple epithelial sheets by growth and collision. We use two simple and well-studied continuum models, where cells move either randomly or following population pressure gradients. After suitable calibration, both models prove to be practically identifiable, and can reproduce the main features of single tissue expansions. However, our findings reveal that whenever tissue-tissue interactions become relevant, the random motion assumption can lead to unrealistic behaviour. Under this setting, a model accounting for population pressure from different cell populations is more appropriate and shows a better agreement with experimental measurements. Finally, we discuss how tissue shape and pressure affect multi-tissue collisions. Our work thus provides a systematic approach to quantify and predict complex tissue configurations with applications in the design of tissue composites and more generally in tissue engineering.

A plausible identifiable model of the canonical NF-κB signaling pathway

An overwhelming majority of mathematical models of regulatory pathways, including the intensively studied NF-κB pathway, remains non-identifiable, meaning that their parameters may not be determined by existing data. The existing NF-κB models that are capable of reproducing experimental data contain non-identifiable parameters, whereas simplified models with a smaller number of parameters exhibit dynamics that differs from that observed in experiments. Here, we reduced an existing model of the canonical NF-κB pathway by decreasing the number of equations from 15 to 6. The reduced model retains two negative feedback loops mediated by IκBα and A20, and in response to both tonic and pulsatile TNF stimulation exhibits dynamics that closely follow that of the original model. We carried out the sensitivity-based linear analysis and Monte Carlo-based analysis to demonstrate that the resulting model is both structurally and practically identifiable given measurements of 5 model variables from a simple TNF stimulation protocol. The reduced model is capable of reproducing different types of responses that are characteristic to regulatory motifs controlled by negative feedback loops: nearly-perfect adaptation as well as damped and sustained oscillations. It can serve as a building block of more comprehensive models of the immune response and cancer, where NF-κB plays a decisive role. Our approach, although may not be automatically generalized, suggests that models of other regulatory pathways can be transformed to identifiable, while retaining their dynamical features.

Endothelial cells signaling and patterning under hypoxia: a mechanistic integrative computational model including the Notch-Dll4 pathway

Several signaling pathways are activated during hypoxia to promote angiogenesis, leading to endothelial cell patterning, interaction, and downstream signaling. Understanding the mechanistic signaling differences between normoxia and hypoxia can guide therapies to modulate angiogenesis. We present a novel mechanistic model of interacting endothelial cells, including the main pathways involved in angiogenesis. We calibrate and fit the model parameters based on well-established modeling techniques. Our results indicate that the main pathways involved in the patterning of tip and stalk endothelial cells under hypoxia differ, and the time under hypoxia affects how a reaction affects patterning. Interestingly, the interaction of receptors with Neuropilin1 is also relevant for cell patterning. Our simulations under different oxygen concentrations indicate time- and oxygen-availability-dependent responses for the two cells. Following simulations with various stimuli, our model suggests that factors such as period under hypoxia and oxygen availability must be considered for pattern control. This project provides insights into the signaling and patterning of endothelial cells under hypoxia, contributing to studies in the field.

A target-cell limited model can reproduce influenza infection dynamics in hosts with differing immune responses

We consider a hierarchy of ordinary differential equation models that describe the within-host viral kinetics of influenza infections: the IR model explicitly accounts for an immune response to the virus, while the simpler, target-cell limited TEIV and TV models do not. We show that when the IR model is fitted to pooled experimental murine data of the viral load, fraction of dead cells, and immune response levels, its parameters values can be determined. However, if, as is common, only viral load data are available, we can estimate parameters of the TEIV and TV models but not the IR model. These results are substantiated by a structural and practical identifiability analysis. We then use the IR model to generate synthetic data representing infections in hosts whose immune responses differ. We fit the TV model to these synthetic datasets and show that it can reproduce the characteristic exponential increase and decay of viral load generated by the IR model. Furthermore, the values of the fitted parameters of the TV model can be mapped from the immune response parameters in the IR model. We conclude that, if only viral load data are available, a simple target-cell limited model can reproduce influenza infection dynamics and distinguish between hosts with differing immune responses.

Physics-informed neural entangled-ladder network for inhalation impedance of the respiratory system

BACKGROUND AND OBJECTIVES

The use of machine learning methods for modelling bio-systems is becoming prominent which can further improve bio-medical technologies. Physics-informed neural networks (PINNs) can embed the knowledge of physical laws that govern a system during the model training process. PINNs utilise differential equations in the model which traditionally used numerical methods that are computationally complex.

METHODS

We integrate PINNs with an entangled ladder network for modelling respiratory systems by considering a lungs conduction zone to evaluate the respiratory impedance for different initial conditions. We evaluate the respiratory impedance for the inhalation phase of breathing for a symmetric model of the human lungs using entanglement and continued fractions.

RESULTS

We obtain the impedance of the conduction zone of the lungs pulmonary airways using PINNs for nine different combinations of velocity and pressure of inhalation. We compare the results from PINNs with the finite element method using the mean absolute error and root mean square error. The results show that the impedance obtained with PINNs contrasts with the conventional forced oscillation test used for deducing the respiratory impedance. The results show similarity with the impedance plots for different respiratory diseases.

CONCLUSION

We find a decrease in impedance when the velocity of breathing is lowered gradually by 20%. Hence, the methodology can be used to design smart ventilators to the improve flow of breathing.

Recent advances, opportunities and challenges in cybergenetic identification and control of biomolecular networks

Cybergenetics is a new area of research aimed at developing digital and biological controllers for living systems. Synthetic biologists have begun exploiting cybergenetic tools and platforms to both accelerate the development of mathematical models and develop control strategies for complex biological phenomena. Here, we review the state of the art in cybergenetic identification and control. Our aim is to lower the entry barrier to this field and foster the adoption of methods and technologies that will accelerate the pace at which Synthetic Biology progresses toward applications.

Designing experimental conditions to use the Lotka-Volterra model to infer tumor cell line interaction types

The Lotka-Volterra model is widely used to model interactions between two species. Here, we generate synthetic data mimicking competitive, mutualistic and antagonistic interactions between two tumor cell lines, and then use the Lotka-Volterra model to infer the interaction type. Structural identifiability of the Lotka-Volterra model is confirmed, and practical identifiability is assessed for three experimental designs: (a) use of a single data set, with a mixture of both cell lines observed over time, (b) a sequential design where growth rates and carrying capacities are estimated using data from experiments in which each cell line is grown in isolation, and then interaction parameters are estimated from an experiment involving a mixture of both cell lines, and (c) a parallel experimental design where all model parameters are fitted to data from two mixtures (containing both cell lines but with different initial ratios) simultaneously. Each design is tested on data generated from the Lotka-Volterra model with noise added, to determine efficacy in an ideal sense. In addition to assessing each design for practical identifiability, we investigate how the predictive power of the model - i.e., its ability to fit data for initial ratios other than those to which it was calibrated - is affected by the choice of experimental design. The parallel calibration procedure is found to be optimal and is further tested on in silico data generated from a spatially-resolved cellular automaton model, which accounts for oxygen consumption and allows for variation in the intensity level of the interaction between the two cell lines. We use this study to highlight the care that must be taken when interpreting parameter estimates for the spatially-averaged Lotka-Volterra model when it is calibrated against data produced by the spatially-resolved cellular automaton model, since baseline competition for space and resources in the CA model may contribute to a discrepancy between the type of interaction used to generate the CA data and the type of interaction inferred by the LV model.

Benchmarking tools for a priori identifiability analysis

MOTIVATION

The theoretical possibility of determining the state and parameters of a dynamic model by measuring its outputs is given by its structural identifiability and its observability. These properties should be analysed before attempting to calibrate a model, but their a priori analysis can be challenging, requiring symbolic calculations that often have a high computational cost. In recent years, a number of software tools have been developed for this task, mostly in the systems biology community. These tools have vastly different features and capabilities, and a critical assessment of their performance is still lacking.

RESULTS

Here, we present a comprehensive study of the computational resources available for analysing structural identifiability. We consider 13 software tools developed in 7 programming languages and evaluate their performance using a set of 25 case studies created from 21 models. Our results reveal their strengths and weaknesses, provide guidelines for choosing the most appropriate tool for a given problem and highlight opportunities for future developments.

AVAILABILITY AND IMPLEMENTATION

https://github.com/Xabo-RB/Benchmarking_files.

Mechanistic model of MAPK signaling reveals how allostery and rewiring contribute to drug resistance

BRAF is prototypical of oncogenes that can be targeted therapeutically and the treatment of BRAF^V600E melanomas with RAF and MEK inhibitors results in rapid tumor regression. However, drug-induced rewiring generates a drug adapted state thought to be involved in acquired resistance and disease recurrence. In this article, we study mechanisms of adaptive rewiring in BRAF^V600E melanoma cells using an energy-based implementation of ordinary differential equation (ODE) modeling in combination with proteomic, transcriptomic and imaging data. We develop a method for causal tracing of ODE models and identify two parallel MAPK reaction channels that are differentially sensitive to RAF and MEK inhibitors due to differences in protein oligomerization and drug binding. We describe how these channels, and timescale separation between immediate-early signaling and transcriptional feedback, create a state in which the RAS-regulated MAPK channel can be activated by growth factors under conditions in which the BRAF^V600E -driven channel is fully inhibited. Further development of the approaches in this article is expected to yield a unified model of adaptive drug resistance in melanoma.

Localization of Noise in Biochemical Networks

Noise, or uncertainty in biochemical networks, has become an important aspect of many biological problems. Noise can arise and propagate from external factors and probabilistic chemical reactions occurring in small cellular compartments. For species survival, it is important to regulate such uncertainties in executing vital cell functions. Regulated noise can improve adaptability, whereas uncontrolled noise can cause diseases. Simulation can provide a detailed analysis of uncertainties, but parameters such as rate constants and initial conditions are usually unknown. A general understanding of noise dynamics from the perspective of network structure is highly desirable. In this study, we extended the previously developed law of localization for characterizing noise in terms of (co)variances and developed noise localization theory. With linear noise approximation, we can expand a biochemical network into an extended set of differential equations representing a fictitious network for pseudo-components consisting of variances and covariances, together with chemical species. Through localization analysis, perturbation responses at the steady state of pseudo-components can be summarized into a sensitivity matrix that only requires knowledge of network topology. Our work allows identification of buffering structures at the level of species, variances, and covariances and can provide insights into noise flow under non-steady-state conditions in the form of a pseudo-chemical reaction. We tested noise localization in various systems, and here we discuss its implications and potential applications. Results show that this theory is potentially applicable in discriminating models, scanning network topologies with interesting noise behavior, and designing and perturbing networks with the desired response.

ASAS-NANP symposium: Mathematical Modeling in Animal Nutrition: The power of identifiability analysis for dynamic modeling in animal science:a practitioner approach

Constructing dynamic mathematical models of biological systems requires estimating unknown parameters from available experimental data, usually using a statistical fitting procedure. This procedure is usually called parameter identification, parameter estimation, model fitting, or model calibration. In animal science, parameter identification is often performed without analytic considerations on the possibility of determining unique values of the model parameters. These analytical studies are related to the mathematical property of structural identifiability, which refers to the theoretical ability to recover unique values of the model parameters from the measures defined in an experimental setup and use the model structure as the sole basis. The structural identifiability analysis is a powerful tool for model construction because it informs whether the parameter identification problem is well-posed (i.e., the problem has a unique solution). Structural identifiability analysis is helpful to determine which actions (e.g., model reparameterization, choice of new data measurements, and change of the model structure) are needed to render the model parameters identifiable (when possible). The mathematical technicalities associated with structural identifiability analysis are very sophisticated. However, the development of dedicated, freely available software tools enables the application of identifiability analysis without needing to be an expert in mathematics and computer programming. We refer to such a non-expert user as a practitioner for hands-on purposes. However, a practitioner should be familiar with the model construction and software implementation process. In this paper, we propose to adopt a practitioner approach that takes advantage of available software tools to integrate identifiability analysis in the modeling practice in the animal science field. The application of structural identifiability implies switching our regard of the parameter identification problem as a downstream process (after data collection) to an upstream process (before data collection) where experiment design is applied to guarantee identifiability. This upstream approach will substantially improve the workflow of model construction toward robust and valuable models in animal science. Illustrative examples with different levels of complexity support our work. The source codes of the examples were provided for learning purposes and to promote open science practices.

Geometric analysis enables biological insight from complex non-identifiable models using simple surrogates

An enduring challenge in computational biology is to balance data quality and quantity with model complexity. Tools such as identifiability analysis and information criterion have been developed to harmonise this juxtaposition, yet cannot always resolve the mismatch between available data and the granularity required in mathematical models to answer important biological questions. Often, it is only simple phenomenological models, such as the logistic and Gompertz growth models, that are identifiable from standard experimental measurements. To draw insights from complex, non-identifiable models that incorporate key biological mechanisms of interest, we study the geometry of a map in parameter space from the complex model to a simple, identifiable, surrogate model. By studying how non-identifiable parameters in the complex model quantitatively relate to identifiable parameters in surrogate, we introduce and exploit a layer of interpretation between the set of non-identifiable parameters and the goodness-of-fit metric or likelihood studied in typical identifiability analysis. We demonstrate our approach by analysing a hierarchy of mathematical models for multicellular tumour spheroid growth experiments. Typical data from tumour spheroid experiments are limited and noisy, and corresponding mathematical models are very often made arbitrarily complex. Our geometric approach is able to predict non-identifiabilities, classify non-identifiable parameter spaces into identifiable parameter combinations that relate to features in the data characterised by parameters in a surrogate model, and overall provide additional biological insight from complex non-identifiable models.

Profile likelihood-based parameter and predictive interval analysis guides model choice for ecological population dynamics

Calibrating mathematical models to describe ecological data provides important insight via parameter estimation that is not possible from analysing data alone. When we undertake a mathematical modelling study of ecological or biological data, we must deal with the trade-off between data availability and model complexity. Dealing with the nexus between data availability and model complexity is an ongoing challenge in mathematical modelling, particularly in mathematical biology and mathematical ecology where data collection is often not standardised, and more broad questions about model selection remain relatively open. Therefore, choosing an appropriate model almost always requires case-by-case consideration. In this work we present a straightforward approach to quantitatively explore this trade-off using a case study exploring mathematical models of coral reef regrowth after some ecological disturbance, such as damage caused by a tropical cyclone. In particular, we compare a simple single species ordinary differential equation (ODE) model approach with a more complicated two-species coupled ODE model. Univariate profile likelihood analysis suggests that the both models are practically identifiable. To provide additional insight we construct and compare approximate prediction intervals using a new parameter-wise prediction approximation, confirming both the simple and complex models perform similarly with regard to making predictions. Our approximate parameter-wise prediction interval analysis provides explicit information about how each parameter affects the predictions of each model. Comparing our approximate prediction intervals with a more rigorous and computationally expensive evaluation of the full likelihood shows that the new approximations are reasonable in this case. All algorithms and software to support this work are freely available as jupyter notebooks on GitHub so that they can be adapted to deal with any other ODE-based models.

The Structural Identifiability of a Humidity-Driven Epidemiological Model of Influenza Transmission

Influenza epidemics cause considerable morbidity and mortality every year worldwide. Climate-driven epidemiological models are mainstream tools to understand seasonal transmission dynamics and predict future trends of influenza activity, especially in temperate regions. Testing the structural identifiability of these models is a fundamental prerequisite for the model to be applied in practice, by assessing whether the unknown model parameters can be uniquely determined from epidemic data. In this study, we applied a scaling method to analyse the structural identifiability of four types of commonly used humidity-driven epidemiological models. Specifically, we investigated whether the key epidemiological parameters (i.e., infectious period, the average duration of immunity, the average latency period, and the maximum and minimum daily basic reproductive number) can be uniquely determined simultaneously when prevalence data is observable. We found that each model is identifiable when the prevalence of infection is observable. The structural identifiability of these models will lay the foundation for testing practical identifiability in the future using synthetic prevalence data when considering observation noise. In practice, epidemiological models should be examined with caution before using them to estimate model parameters from epidemic data.

Structural identifiability of compartmental models for infectious disease transmission is influenced by data type

If model identifiability is not confirmed, inferences from infectious disease transmission models may not be reliable, so they might result in misleading recommendations. Structural identifiability analysis characterises whether it is possible to obtain unique solutions for all unknown model parameters, given the model structure. In this work, we studied the structural identifiability of some typical deterministic compartmental models for infectious disease transmission, focusing on the influence of the data type considered as model output on the identifiability of unknown model parameters, including initial conditions. We defined 26 model versions, each having a unique combination of underlying compartmental structure and data type(s) considered as model output(s). Four compartmental model structures and three common data types in disease surveillance (incidence, prevalence and detected vector counts) were studied. The structural identifiability of some parameters varied depending on the type of model output. In general, models with multiple data types as outputs had more structurally identifiable parameters, than did models with a single data type as output. This study highlights the importance of a careful consideration of data types as an integral part of the inference process with compartmental infectious disease transmission models.

Computationally efficient framework for diagnosing, understanding and predicting biphasic population growth

Throughout the life sciences, biological populations undergo multiple phases of growth, often referred to as biphasic growth for the commonly encountered situation involving two phases. Biphasic population growth occurs over a massive range of spatial and temporal scales, ranging from microscopic growth of tumours over several days, to decades-long regrowth of corals in coral reefs that can extend for hundreds of kilometres. Different mathematical models and statistical methods are used to diagnose, understand and predict biphasic growth. Common approaches can lead to inaccurate predictions of future growth that may result in inappropriate management and intervention strategies being implemented. Here, we develop a very general computationally efficient framework, based on profile likelihood analysis, for diagnosing, understanding and predicting biphasic population growth. The two key components of the framework are as follows: (i) an efficient method to form approximate confidence intervals for the change point of the growth dynamics and model parameters and (ii) parameter-wise profile predictions that systematically reveal the influence of individual model parameters on predictions. To illustrate our framework we explore real-world case studies across the life sciences.

Efficient inference and identifiability analysis for differential equation models with random parameters

Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data. Therefore, methods for exploring the identifiability of models that explicitly incorporate heterogeneity through variability in model parameters are relatively underdeveloped. We develop a new likelihood-based framework, based on moment matching, for inference and identifiability analysis of differential equation models that capture biological heterogeneity through parameters that vary according to probability distributions. As our novel method is based on an approximate likelihood function, it is highly flexible; we demonstrate identifiability analysis using both a frequentist approach based on profile likelihood, and a Bayesian approach based on Markov-chain Monte Carlo. Through three case studies, we demonstrate our method by providing a didactic guide to inference and identifiability analysis of hyperparameters that relate to the statistical moments of model parameters from independent observed data. Our approach has a computational cost comparable to analysis of models that neglect heterogeneity, a significant improvement over many existing alternatives. We demonstrate how analysis of random parameter models can aid better understanding of the sources of heterogeneity from biological data.

Internal model control based module for the elimination of meal and exercise announcements in hybrid artificial pancreas systems

BACKGROUND AND OBJECTIVES

Hybrid artificial pancreas systems outperform current insulin pump therapies in blood glucose regulation in type 1 diabetes. However, subjects still have to inform the system about meals intake and exercise to achieve reasonable control. These patient announcements may result in overburden and compromise controller performance if not provided timely and accurately. Here, a hybrid artificial pancreas is extended with an add-on module that releases subjects from meals and exercise announcements.

METHODS

The add-on module consists of an internal-model controller that generates a "virtual" control action to compensate for disturbances. This "virtual" action is converted into insulin delivery, rescue carbohydrates suggestions, or insulin-on-board limitations, depending on a switching logic based on glucose measurements and predictions. The controller parameters are tuned by optimization and then related to standard parameters from the open-loop therapy. This module is implemented in a hybrid artificial pancreas system proposed by our research group for validation. This hybrid system extended with the add-on module is compared with the hybrid controller with carbohydrate counting errors (hybrid) and the hybrid controller with an alternative unannounced meal compensation module based on a meal detection algorithm (meal detector). The validation used the educational version of the UVa/Padova simulator to simulate the three controllers under two scenarios: one with only meals and another with meals and exercise. The exercise was modeled as a temporal increase of the insulin sensitivity resulting in the glucose drop usually related to an aerobic exercise.

RESULTS

For the scenario with only meals, the three controllers achieved similar time in range (proposed: 85.1 [77.9,88.1]%, hybrid: 84.0 [75.9,86.4]%, meal detector: 81.9 [79.3,83.8]%, median [interquartile range]) with low time in moderate hypoglycemia. Under the scenario with meals and exercise, the proposed module reduces 4.61% the time in hypoglycemia achieved with the other controllers, suggesting an acceptable amount of rescues (27.2 [23.7, 31.0] g).

CONCLUSIONS

The proposed add-on module achieved promising results: it outperformed the meal-detector-based controller, even achieving a postprandial performance as good as the hybrid controller (with carbohydrate counting errors). Also, the rescue suggestion feature of the module mitigated exercise-induced hypoglycemia with admissible rescue amounts.

Limits of epidemic prediction using SIR models

The Susceptible-Infectious-Recovered (SIR) equations and their extensions comprise a commonly utilized set of models for understanding and predicting the course of an epidemic. In practice, it is of substantial interest to estimate the model parameters based on noisy observations early in the outbreak, well before the epidemic reaches its peak. This allows prediction of the subsequent course of the epidemic and design of appropriate interventions. However, accurately inferring SIR model parameters in such scenarios is problematic. This article provides novel, theoretical insight on this issue of practical identifiability of the SIR model. Our theory provides new understanding of the inferential limits of routinely used epidemic models and provides a valuable addition to current simulate-and-check methods. We illustrate some practical implications through application to a real-world epidemic data set.

Sensitivity analysis and inverse uncertainty quantification for the left ventricular passive mechanics

Personalized computational cardiac models are considered to be a unique and powerful tool in modern cardiology, integrating the knowledge of physiology, pathology and fundamental laws of mechanics in one framework. They have the potential to improve risk prediction in cardiac patients and assist in the development of new treatments. However, in order to use these models for clinical decision support, it is important that both the impact of model parameter perturbations on the predicted quantities of interest as well as the uncertainty of parameter estimation are properly quantified, where the first task is a priori in nature (meaning independent of any specific clinical data), while the second task is carried out a posteriori (meaning after specific clinical data have been obtained). The present study addresses these challenges for a widely used constitutive law of passive myocardium (the Holzapfel-Ogden model), using global sensitivity analysis (SA) to address the first challenge, and inverse-uncertainty quantification (I-UQ) for the second challenge. The SA is carried out on a range of different input parameters to a left ventricle (LV) model, making use of computationally efficient Gaussian process (GP) surrogate models in place of the numerical forward simulator. The results of the SA are then used to inform a low-order reparametrization of the constitutive law for passive myocardium under consideration. The quality of this parameterization in the context of an inverse problem having observed noisy experimental data is then quantified with an I-UQ study, which again makes use of GP surrogate models. The I-UQ is carried out in a Bayesian manner using Markov Chain Monte Carlo, which allows for full uncertainty quantification of the material parameter estimates. Our study reveals insights into the relation between SA and I-UQ, elucidates the dependence of parameter sensitivity and estimation uncertainty on external factors, like LV cavity pressure, and sheds new light on cardio-mechanic model formulation, with particular focus on the Holzapfel-Ogden myocardial model.

Parameter identifiability and model selection for sigmoid population growth models

Sigmoid growth models, such as the logistic, Gompertz and Richards' models, are widely used to study population dynamics ranging from microscopic populations of cancer cells, to continental-scale human populations. Fundamental questions about model selection and parameter estimation are critical if these models are to be used to make practical inferences. However, the question of parameter identifiability - whether a data set contains sufficient information to give unique or sufficiently precise parameter estimates - is often overlooked. We use a profile-likelihood approach to explore practical parameter identifiability using data describing the re-growth of hard coral. With this approach, we explore the relationship between parameter identifiability and model misspecification, finding that the logistic growth model does not suffer identifiability issues for the type of data we consider whereas the Gompertz and Richards' models encounter practical non-identifiability issues. This analysis of parameter identifiability and model selection is important because different growth models are in biological modelling without necessarily considering whether parameters are identifiable. Standard practices that do not consider parameter identifiability can lead to unreliable or imprecise parameter estimates and potentially misleading mechanistic interpretations. For example, using the Gompertz model, the estimate of the time scale of coral re-growth is 625 days when we estimate the initial density from the data, whereas it is 1429 days using a more standard approach where variability in the initial density is ignored. While tools developed here focus on three standard sigmoid growth models only, our theoretical developments are applicable to any sigmoid growth model and any appropriate data set. MATLAB implementations of all software are available on GitHub.

A Quantitative Systems Pharmacology Perspective on the Importance of Parameter Identifiability

There is an inherent tension in Quantitative Systems Pharmacology (QSP) between the need to incorporate mathematical descriptions of complex physiology and drug targets with the necessity of developing robust, predictive and well-constrained models. In addition to this, there is no “gold standard” for model development and assessment in QSP. Moreover, there can be confusion over terminology such as model and parameter identifiability; complex and simple models; virtual populations; and other concepts, which leads to potential miscommunication and misapplication of methodologies within modeling communities, both the QSP community and related disciplines. This perspective article highlights the pros and cons of using simple (often identifiable) vs. complex (more physiologically detailed but often non-identifiable) models, as well as aspects of parameter identifiability, sensitivity and inference methodologies for model development and analysis. The paper distills the central themes of the issue of identifiability and optimal model size and discusses open challenges.

Multi-Level Computational Modeling of Anti-Cancer Dendritic Cell Vaccination Utilized to Select Molecular Targets for Therapy Optimization

Dendritic cells (DCs) can be used for therapeutic vaccination against cancer. The success of this therapy depends on efficient tumor-antigen presentation to cytotoxic T lymphocytes (CTLs) and the induction of durable CTL responses by the DCs. Therefore, simulation of such a biological system by computational modeling is appealing because it can improve our understanding of the molecular mechanisms underlying CTL induction by DCs and help identify new strategies to improve therapeutic DC vaccination for cancer. Here, we developed a multi-level model accounting for the life cycle of DCs during anti-cancer immunotherapy. Specifically, the model is composed of three parts representing different stages of DC immunotherapy – the spreading and bio-distribution of intravenously injected DCs in human organs, the biochemical reactions regulating the DCs’ maturation and activation, and DC-mediated activation of CTLs. We calibrated the model using quantitative experimental data that account for the activation of key molecular circuits within DCs, the bio-distribution of DCs in the body, and the interaction between DCs and T cells. We showed how such a data-driven model can be exploited in combination with sensitivity analysis and model simulations to identify targets for enhancing anti-cancer DC vaccination. Since other previous works show how modeling improves therapy schedules and DC dosage, we here focused on the molecular optimization of the therapy. In line with this, we simulated the effect in DC vaccination of the concerted modulation of combined intracellular regulatory processes and proposed several possibilities that can enhance DC-mediated immunogenicity. Taken together, we present a comprehensive time-resolved multi-level model for studying DC vaccination in melanoma. Although the model is not intended for personalized patient therapy, it could be used as a tool for identifying molecular targets for optimizing DC-based therapy for cancer, which ultimately should be tested in in vitro and in vivo experiments.

A protocol for dynamic model calibration

Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and nonmeasurable parameters, which have to be determined by fitting the model to experimental data. In order to perform this task, known as parameter estimation or model calibration, the modeller faces challenges such as poor parameter identifiability, lack of sufficiently informative experimental data and the existence of local minima in the objective function landscape. These issues tend to worsen with larger model sizes, increasing the computational complexity and the number of unknown parameters. An incorrectly calibrated model is problematic because it may result in inaccurate predictions and misleading conclusions. For nonexpert users, there are a large number of potential pitfalls. Here, we provide a protocol that guides the user through all the steps involved in the calibration of dynamic models. We illustrate the methodology with two models and provide all the code required to reproduce the results and perform the same analysis on new models. Our protocol provides practitioners and researchers in biological modelling with a one-stop guide that is at the same time compact and sufficiently comprehensive to cover all aspects of the problem.