Identification of a time-varying intracellular signalling model through data clustering and parameter selection: application to NF-[inline-formula removed]B signalling pathway induced by LPS in the presence of BFA

Systems Engineering Approach to Modeling and Analysis of Chronic Obstructive Pulmonary Disease Part II: Extension for Variable Metabolic Rates

Recently, we developed a systems engineering model of the human cardiorespiratory system [Kurian et al. ACS Omega2023, 8 (23), 20524-20535. DOI: 10.1021/acsomega.3c00854] based on existing models of physiological processes and adapted it for chronic obstructive pulmonary disease (COPD)-an inflammatory lung disease with multiple manifestations and one of the leading causes of death in the world. This control engineering-based model is extended here to allow for variable metabolic rates established at different levels of physical activity. This required several changes to the original model: the model of the controller was enhanced to include the feedforward loop that is responsible for cardiorespiratory control under varying metabolic rates (activity level, characterized as metabolic equivalent of the task-Rm-and normalized to one at rest). In addition, a few refinements were made to the cardiorespiratory mechanics, primarily to introduce physiological processes that were not modeled earlier but became important at high metabolic rates. The extended model is verified by analyzing the impact of exercise (Rm > 1) on the cardiorespiratory system of healthy individuals. We further formally justify our previously proposed adaptation of the model for COPD patients through sensitivity analysis and refine the parameter tuning through the use of a parallel tempering stochastic global optimization method. The extended model successfully replicates experimentally observed abnormalities in COPD-the drop in arterial oxygen tension and dynamic hyperinflation under high metabolic rates-without being explicitly trained on any related data. It also supports the prospects of remote patient monitoring in COPD.

Hybrid modeling in bioprocess dynamics: Structural variabilities, implementation strategies, and practical challenges

Hybrid modeling, with an appropriate blend of the mechanistic and data-driven framework, is increasingly being adopted in bioprocess modeling, model-based experimental design (digital-twin), identification of critical process parameters, and optimization. However, the development of a hybrid model from experimental data is an inherently complex workflow, involving designed experiments, selection of the data-driven process, identification of model parameters, assessment fitness, and generalization capability. Depending on the complexity of the process system and purpose, each piece of these modules can flexibly be incorporated into the puzzle. However, this extra flexibility can be a cause of concern to trace an "optimal" model structure. In this paper, the development of hybrid models in a common bioprocess system, selection of data-driven components and their mapping to states, choice of parameter identification techniques, and model quality assurance are revisited. The challenges associated with hybrid-model development, and corrective actions have also been reviewed. The review also suggests the lack of data, and code sharing in communal repositories can be a hurdle in the exploration, and expansion of those tools in a bioprocess system.

Quantifying biochemical reaction rates from static population variability within incompletely observed complex networks

Quantifying biochemical reaction rates within complex cellular processes remains a key challenge of systems biology even as high-throughput single-cell data have become available to characterize snapshots of population variability. That is because complex systems with stochastic and non-linear interactions are difficult to analyze when not all components can be observed simultaneously and systems cannot be followed over time. Instead of using descriptive statistical models, we show that incompletely specified mechanistic models can be used to translate qualitative knowledge of interactions into reaction rate functions from covariability data between pairs of components. This promises to turn a globally intractable problem into a sequence of solvable inference problems to quantify complex interaction networks from incomplete snapshots of their stochastic fluctuations.

Introducing Parameter Clustering to the OED Procedure for Model Calibration of a Synthetic Inducible Promoter in S. cerevisiae

In recent years, synthetic gene circuits for adding new cell features have become one of the most powerful tools in biological and pharmaceutical research and development. However, because of the inherent non-linearity and noisy experimental data, the experiment-based model calibration of these synthetic parts is perceived as a laborious and time-consuming procedure. Although the optimal experimental design (OED) based on the Fisher information matrix (FIM) has been proved to be an effective means to improve the calibration efficiency, the required calculation increases dramatically with the model size (parameter number). To reduce the OED complexity without losing the calibration accuracy, this paper proposes two OED approaches with different parameter clustering methods and validates the accuracy of calibrated models with in-silico experiments. A model of an inducible synthetic promoter in S. cerevisiae is adopted for bench-marking. The comparison with the traditional off-line OED approach suggests that the OED approaches with both of the clustering methods significantly reduce the complexity of OED problems (for at least 49.0%), while slightly improving the calibration accuracy (11.8% and 19.6% lower estimation error in average for FIM-based and sensitivity-based approaches). This study implicates that for calibrating non-linear models of biological pathways, cluster-based OED could be a beneficial approach to improve the efficiency of optimal experimental design.

Development of a hybrid model for a partially known intracellular signaling pathway through correction term estimation and neural network modeling

Developing an accurate first-principle model is an important step in employing systems biology approaches to analyze an intracellular signaling pathway. However, an accurate first-principle model is difficult to be developed since it requires in-depth mechanistic understandings of the signaling pathway. Since underlying mechanisms such as the reaction network structure are not fully understood, significant discrepancy exists between predicted and actual signaling dynamics. Motivated by these considerations, this work proposes a hybrid modeling approach that combines a first-principle model and an artificial neural network (ANN) model so that predictions of the hybrid model surpass those of the original model. First, the proposed approach determines an optimal subset of model states whose dynamics should be corrected by the ANN by examining the correlation between each state and outputs through relative order. Second, an L2-regularized least-squares problem is solved to infer values of the correction terms that are necessary to minimize the discrepancy between the model predictions and available measurements. Third, an ANN is developed to generalize relationships between the values of the correction terms and the system dynamics. Lastly, the original first-principle model is coupled with the developed ANN to finalize the hybrid model development so that the model will possess generalized prediction capabilities while retaining the model interpretability. We have successfully validated the proposed methodology with two case studies, simplified apoptosis and lipopolysaccharide-induced NFκB signaling pathways, to develop hybrid models with in silico and in vitro measurements, respectively.

An intracellular signaling pathway is often represented by a set of nonlinear ordinary differential equations, which translate our current knowledge about the signaling pathway into a testable mathematical model. However, predictions from such models are often subject to high uncertainty since many signaling pathways are only partially known beforehand. In this study, we propose a systematic approach to develop a hybrid model to improve model accuracy by combining machine learning and the first-principle modeling. Specifically, model correction terms are learned from discrepancy between model predictions and measurements, and these terms are added to the first-principle model to enhance the prediction accuracy. Once these correction terms are learned from the data, an artificial neural network (ANN) model is developed to find an empirical relation between the model and the correction terms so that the developed ANN can be used to posses improved predictive capabilities even in new operating conditions (i.e., generalizability). The final hybrid model is then constructed by coupling the first-principle model with the developed ANN.

Time-dependent antagonist-agonist switching in receptor tyrosine kinase-mediated signaling

BACKGROUND

ErbB4/HER4 is a unique member of the ErbB family of receptor tyrosine kinases concerning its activation of anti-proliferative JAK2-STAT5 pathway when stimulated by ligand Neuregulin (NRG). Activation of this pathway leads to expression of genes like β-casein which promote cell differentiation. Recent experimental studies on mouse HC11 mammary epithelial cells stimulated by ligand Neuregulin (NRG) showed a time-dependent switching behavior in the β-casein expression. This behavior cannot be explained using currently available mechanistic models of the JAK-STAT pathway. We constructed an improved mechanistic model which introduces two crucial modifications to the canonical HER4-JAK2-STAT5 pathway based on literature findings. These modifications include competitive HER4 heterodimerization with other members of the ErbB family and a slower JAK2 independent activation STAT5 through HER4. We also performed global sensitivity analysis on the model to test the robustness of the predictions and parameter combinations that are sensitive to the outcome.

RESULTS

Our model was able to reproduce the time-dependent switching behavior of β-casein and also establish that the modifications mentioned above to the canonical JAK-STAT pathway are necessary to reproduce this behavior. The sensitivity studies show that the competitive HER4 heterodimerization reactions have a profound impact on the sensitivity of the pathway to NRG stimulation, while the slower JAK2-independent pathway is necessary for the late stage promotion of β-casein mRNA transcription. The difference in the time scales of the JAK-dependent and JAK-independent pathways was found to be the main contributing factor to the time-dependent switch. The transport rates controlling activated STAT5 dimer nuclear import and β-casein mRNA export to cytoplasm affected the time delay between NRG stimulation and peak β-casein mRNA activity.

CONCLUSION

This study highlights the effect of competitive and parallel reaction pathways on both short and long-term dynamics of receptor-mediated signaling. It provides robust and testable predictions of the dynamical behavior of the HER4 mediated JAK-STAT pathway which could be useful in designing treatments for various cancers where this pathway is activated/altered.