Development of a hybrid model for a partially known intracellular signaling pathway through correction term estimation and neural network modeling

Systems Engineering Approach to Modeling and Analysis of Chronic Obstructive Pulmonary Disease Part II: Extension for Variable Metabolic Rates

Recently, we developed a systems engineering model of the human cardiorespiratory system [Kurian et al. ACS Omega2023, 8 (23), 20524-20535. DOI: 10.1021/acsomega.3c00854] based on existing models of physiological processes and adapted it for chronic obstructive pulmonary disease (COPD)-an inflammatory lung disease with multiple manifestations and one of the leading causes of death in the world. This control engineering-based model is extended here to allow for variable metabolic rates established at different levels of physical activity. This required several changes to the original model: the model of the controller was enhanced to include the feedforward loop that is responsible for cardiorespiratory control under varying metabolic rates (activity level, characterized as metabolic equivalent of the task-Rm-and normalized to one at rest). In addition, a few refinements were made to the cardiorespiratory mechanics, primarily to introduce physiological processes that were not modeled earlier but became important at high metabolic rates. The extended model is verified by analyzing the impact of exercise (Rm > 1) on the cardiorespiratory system of healthy individuals. We further formally justify our previously proposed adaptation of the model for COPD patients through sensitivity analysis and refine the parameter tuning through the use of a parallel tempering stochastic global optimization method. The extended model successfully replicates experimentally observed abnormalities in COPD-the drop in arterial oxygen tension and dynamic hyperinflation under high metabolic rates-without being explicitly trained on any related data. It also supports the prospects of remote patient monitoring in COPD.

Hybrid modeling in bioprocess dynamics: Structural variabilities, implementation strategies, and practical challenges

Hybrid modeling, with an appropriate blend of the mechanistic and data-driven framework, is increasingly being adopted in bioprocess modeling, model-based experimental design (digital-twin), identification of critical process parameters, and optimization. However, the development of a hybrid model from experimental data is an inherently complex workflow, involving designed experiments, selection of the data-driven process, identification of model parameters, assessment fitness, and generalization capability. Depending on the complexity of the process system and purpose, each piece of these modules can flexibly be incorporated into the puzzle. However, this extra flexibility can be a cause of concern to trace an "optimal" model structure. In this paper, the development of hybrid models in a common bioprocess system, selection of data-driven components and their mapping to states, choice of parameter identification techniques, and model quality assurance are revisited. The challenges associated with hybrid-model development, and corrective actions have also been reviewed. The review also suggests the lack of data, and code sharing in communal repositories can be a hurdle in the exploration, and expansion of those tools in a bioprocess system.

A General Hybrid Modeling Framework for Systems Biology Applications: Combining Mechanistic Knowledge with Deep Neural Networks under the SBML Standard

In this paper, a computational framework is proposed that merges mechanistic modeling with deep neural networks obeying the Systems Biology Markup Language (SBML) standard. Over the last 20 years, the systems biology community has developed a large number of mechanistic models that are currently stored in public databases in SBML. With the proposed framework, existing SBML models may be redesigned into hybrid systems through the incorporation of deep neural networks into the model core, using a freely available python tool. The so-formed hybrid mechanistic/neural network models are trained with a deep learning algorithm based on the adaptive moment estimation method (ADAM), stochastic regularization and semidirect sensitivity equations. The trained hybrid models are encoded in SBML and uploaded in model databases, where they may be further analyzed as regular SBML models. This approach is illustrated with three well-known case studies: the Escherichia coli threonine synthesis model, the P58IPK signal transduction model, and the Yeast glycolytic oscillations model. The proposed framework is expected to greatly facilitate the widespread use of hybrid modeling techniques for systems biology applications.

Machine learning alternative to systems biology should not solely depend on data

In recent years, artificial intelligence (AI)/machine learning has emerged as a plausible alternative to systems biology for the elucidation of biological phenomena and in attaining specified design objective in synthetic biology. Although considered highly disruptive with numerous notable successes so far, we seek to bring attention to both the fundamental and practical pitfalls of their usage, especially in illuminating emergent behaviors from chaotic or stochastic systems in biology. Without deliberating on their suitability and the required data qualities and pre-processing approaches beforehand, the research and development community could experience similar 'AI winters' that had plagued other fields. Instead, we anticipate the integration or combination of the two approaches, where appropriate, moving forward.

Quantifying biochemical reaction rates from static population variability within incompletely observed complex networks

Quantifying biochemical reaction rates within complex cellular processes remains a key challenge of systems biology even as high-throughput single-cell data have become available to characterize snapshots of population variability. That is because complex systems with stochastic and non-linear interactions are difficult to analyze when not all components can be observed simultaneously and systems cannot be followed over time. Instead of using descriptive statistical models, we show that incompletely specified mechanistic models can be used to translate qualitative knowledge of interactions into reaction rate functions from covariability data between pairs of components. This promises to turn a globally intractable problem into a sequence of solvable inference problems to quantify complex interaction networks from incomplete snapshots of their stochastic fluctuations.

Emerging landscape of molecular interaction networks: Opportunities, challenges and prospects

Network biology finds application in interpreting molecular interaction networks and providing insightful inferences using graph theoretical analysis of biological systems. The integration of computational bio-modelling approaches with different hybrid network-based techniques provides additional information about the behaviour of complex systems. With increasing advances in high-throughput technologies in biological research, attempts have been made to incorporate this information into network structures, which has led to a continuous update of network biology approaches over time. The newly minted centrality measures accommodate the details of omics data and regulatory network structure information. The unification of graph network properties with classical mathematical and computational modelling approaches and technologically advanced approaches like machine-learning- and artificial intelligence-based algorithms leverages the potential application of these techniques. These computational advances prove beneficial and serve various applications such as essential gene prediction, identification of drug–disease interaction and gene prioritization. Hence, in this review, we have provided a comprehensive overview of the emerging landscape of molecular interaction networks using graph theoretical approaches. With the aim to provide information on the wide range of applications of network biology approaches in understanding the interaction and regulation of genes, proteins, enzymes and metabolites at different molecular levels, we have reviewed the methods that utilize network topological properties, emerging hybrid network-based approaches and applications that integrate machine learning techniques to analyse molecular interaction networks. Further, we have discussed the applications of these approaches in biomedical research with a note on future prospects.

Hybrid Models for Efficient Control, Optimization, and Monitoring of Thermo-Chemical Processes and Plants

This paper describes a procedure and an IT product that combine numerical models, expert knowledge, and data-based models through artificial intelligence (AI)-based hybrid models to enable the integrated control, optimization, and monitoring of processes and plants. The working principle of the hybrid model is demonstrated by NOx reduction through guided oscillating combustion at the pulverized fuel boiler pilot incineration plant at the Institute for Technical Chemistry, Karlsruhe Institute of Technology. The presented example refers to coal firing, but the approach can be easily applied to any other type of nitrogen-containing solid fuel. The need for a reduction in operation and maintenance costs for biomass-fired plants is huge, especially in the frame of emission reductions and, in the case of Germany, the potential loss of funding as a result of the Renewable Energy Law (Erneuerbare-Energien-Gesetz) for plants older than 20 years. Other social aspects, such as the departure of experienced personnel may be another reason for the increasing demand for data mining and the use of artificial intelligence (AI).