1
|
Wu W, Duan S, Sun Y, Yu Y, Liu D, Peng D. Deep fuzzy physics-informed neural networks for forward and inverse PDE problems. Neural Netw 2024; 181:106750. [PMID: 39427411 DOI: 10.1016/j.neunet.2024.106750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 08/20/2024] [Accepted: 09/17/2024] [Indexed: 10/22/2024]
Abstract
As a grid-independent approach for solving partial differential equations (PDEs), Physics-Informed Neural Networks (PINNs) have garnered significant attention due to their unique capability to simultaneously learn from both data and the governing physical equations. Existing PINNs methods always assume that the data is stable and reliable, but data obtained from commercial simulation software often inevitably have ambiguous and inaccurate problems. Obviously, this will have a negative impact on the use of PINNs to solve forward and inverse PDE problems. To overcome the above problems, this paper proposes a Deep Fuzzy Physics-Informed Neural Networks (FPINNs) that explores the uncertainty in data. Specifically, to capture the uncertainty behind the data, FPINNs learns fuzzy representation through the fuzzy membership function layer and fuzzy rule layer. Afterward, we use deep neural networks to learn neural representation. Subsequently, the fuzzy representation is integrated with the neural representation. Finally, the residual of the physical equation and the data error are considered as the two components of the loss function, guiding the network to optimize towards adherence to the physical laws for accurate prediction of the physical field. Extensive experiment results show that FPINNs outperforms these comparative methods in solving forward and inverse PDE problems on four widely used datasets. The demo code will be released at https://github.com/siyuancncd/FPINNs.
Collapse
Affiliation(s)
- Wenyuan Wu
- College of Computer Science, Sichuan University, Chengdu, 610065, China.
| | - Siyuan Duan
- College of Computer Science, Sichuan University, Chengdu, 610065, China.
| | - Yuan Sun
- College of Computer Science, Sichuan University, Chengdu, 610065, China.
| | - Yang Yu
- Science and Technology on Reactor System Design Technology Laboratory, Nuclear Power Institute of China, Chengdu, 610213, China; National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology, Changsha, 410073, China.
| | - Dong Liu
- Science and Technology on Reactor System Design Technology Laboratory, Nuclear Power Institute of China, Chengdu, 610213, China.
| | - Dezhong Peng
- College of Computer Science, Sichuan University, Chengdu, 610065, China.
| |
Collapse
|
2
|
Yeo HC, Vijay V, Selvarajoo K. Identifying effective evolutionary strategies-based protocol for uncovering reaction kinetic parameters under the effect of measurement noises. BMC Biol 2024; 22:235. [PMID: 39402553 PMCID: PMC11476556 DOI: 10.1186/s12915-024-02019-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 09/24/2024] [Indexed: 10/19/2024] Open
Abstract
BACKGROUND The transition from explanative modeling of fitted data to the predictive modeling of unseen data for systems biology endeavors necessitates the effective recovery of reaction parameters. Yet, the relative efficacy of optimization algorithms in doing so remains under-studied, as to the specific reaction kinetics and the effect of measurement noises. To this end, we simulate the reactions of an artificial pathway using 4 kinetic formulations: generalized mass action (GMA), Michaelis-Menten, linear-logarithmic, and convenience kinetics. We then compare the effectiveness of 5 evolutionary algorithms (CMAES, DE, SRES, ISRES, G3PCX) for objective function optimization in kinetic parameter hyperspace to determine the corresponding estimated parameters. RESULTS We quickly dropped the DE algorithm due to its poor performance. Baring measurement noise, we find the CMAES algorithm to only require a fraction of the computational cost incurred by other EAs for both GMA and linear-logarithmic kinetics yet performing as well by other criteria. However, with increasing noise, SRES and ISRES perform more reliably for GMA kinetics, but at considerably higher computational cost. Conversely, G3PCX is among the most efficacious for estimating Michaelis-Menten parameters regardless of noise, while achieving numerous folds saving in computational cost. Cost aside, we find SRES to be versatilely applicable across GMA, Michaelis-Menten, and linear-logarithmic kinetics, with good resilience to noise. Nonetheless, we could not identify the parameters of convenience kinetics using any algorithm. CONCLUSIONS Altogether, we identify a protocol for predicting reaction parameters under marked measurement noise, as a step towards predictive modeling for systems biology endeavors.
Collapse
Affiliation(s)
- Hock Chuan Yeo
- Bioinformatics Institute (BII), Agency for Science, Technology and Research (A*STAR), 30 Biopolis Street, Matrix #07-01, Singapore, 138761, Republic of Singapore
| | - Varsheni Vijay
- School of Biological Sciences, Nanyang Technological University (NTU), 60 Nanyang Drive, SBS-01s-45, Singapore, 637551, Republic of Singapore
| | - Kumar Selvarajoo
- Bioinformatics Institute (BII), Agency for Science, Technology and Research (A*STAR), 30 Biopolis Street, Matrix #07-01, Singapore, 138761, Republic of Singapore.
- Synthetic Biology Translational Research Program, Yong Loo Lin School of Medicine, National University of Singapore (NUS), 10 Medical drive, Singapore, 117597, Republic of Singapore.
- School of Biological Sciences, Nanyang Technological University (NTU), 60 Nanyang Drive, SBS-01s-45, Singapore, 637551, Republic of Singapore.
- Synthetic Biology for Clinical and Technological Innovation (SynCTI), National University of Singapore (NUS), 28 Medical Drive, Centre for Life Sciences #02-07, Singapore, 117456, Republic of Singapore.
| |
Collapse
|
3
|
Feng J, Zhang X, Tian T. Mathematical Modeling and Inference of Epidermal Growth Factor-Induced Mitogen-Activated Protein Kinase Cell Signaling Pathways. Int J Mol Sci 2024; 25:10204. [PMID: 39337687 PMCID: PMC11432143 DOI: 10.3390/ijms251810204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 09/18/2024] [Accepted: 09/21/2024] [Indexed: 09/30/2024] Open
Abstract
The mitogen-activated protein kinase (MAPK) pathway is an important intracellular signaling cascade that plays a key role in various cellular processes. Understanding the regulatory mechanisms of this pathway is essential for developing effective interventions and targeted therapies for related diseases. Recent advances in single-cell proteomic technologies have provided unprecedented opportunities to investigate the heterogeneity and noise within complex, multi-signaling networks across diverse cells and cell types. Mathematical modeling has become a powerful interdisciplinary tool that bridges mathematics and experimental biology, providing valuable insights into these intricate cellular processes. In addition, statistical methods have been developed to infer pathway topologies and estimate unknown parameters within dynamic models. This review presents a comprehensive analysis of how mathematical modeling of the MAPK pathway deepens our understanding of its regulatory mechanisms, enhances the prediction of system behavior, and informs experimental research, with a particular focus on recent advances in modeling and inference using single-cell proteomic data.
Collapse
Affiliation(s)
- Jinping Feng
- School of Mathematics and Statistics, Henan University, Kaifeng 475001, China
| | - Xinan Zhang
- School of Mathematics and Statistics, Central China Normal University, Wuhan 430079, China
| | - Tianhai Tian
- School of Mathematics, Monash University, Melbourne 3800, Australia
| |
Collapse
|
4
|
Penwarden M, Owhadi H, Kirby RM. Kolmogorov n-widths for multitask physics-informed machine learning (PIML) methods: Towards robust metrics. Neural Netw 2024; 180:106703. [PMID: 39293178 DOI: 10.1016/j.neunet.2024.106703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2024] [Revised: 06/27/2024] [Accepted: 09/03/2024] [Indexed: 09/20/2024]
Abstract
Physics-informed machine learning (PIML) as a means of solving partial differential equations (PDEs) has garnered much attention in the Computational Science and Engineering (CS&E) world. This topic encompasses a broad array of methods and models aimed at solving a single or a collection of PDE problems, called multitask learning. PIML is characterized by the incorporation of physical laws into the training process of machine learning models in lieu of large data when solving PDE problems. Despite the overall success of this collection of methods, it remains incredibly difficult to analyze, benchmark, and generally compare one approach to another. Using Kolmogorov n-widths as a measure of effectiveness of approximating functions, we judiciously apply this metric in the comparison of various multitask PIML architectures. We compute lower accuracy bounds and analyze the model's learned basis functions on various PDE problems. This is the first objective metric for comparing multitask PIML architectures and helps remove uncertainty in model validation from selective sampling and overfitting. We also identify avenues of improvement for model architectures, such as the choice of activation function, which can drastically affect model generalization to "worst-case" scenarios, which is not observed when reporting task-specific errors. We also incorporate this metric into the optimization process through regularization, which improves the models' generalizability over the multitask PDE problem.
Collapse
Affiliation(s)
- Michael Penwarden
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112, USA; Kahlert School of Computing, University of Utah, Salt Lake City, UT 84112, USA.
| | - Houman Owhadi
- Department of Computing and Mathematical Sciences, Caltech, Pasadena, CA 91125, USA.
| | - Robert M Kirby
- Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, UT 84112, USA; Kahlert School of Computing, University of Utah, Salt Lake City, UT 84112, USA.
| |
Collapse
|
5
|
Xu S, Xu T, Yang Y, Chen X. Learning metabolic dynamics from irregular observations by Bidirectional Time-Series State Transfer Network. mSystems 2024; 9:e0069724. [PMID: 39057922 PMCID: PMC11334518 DOI: 10.1128/msystems.00697-24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Accepted: 07/03/2024] [Indexed: 07/28/2024] Open
Abstract
Modeling microbial metabolic dynamics is important for the rational optimization of both biosynthetic systems and industrial processes to facilitate green and efficient biomanufacturing. Classical approaches utilize explicit equation systems to represent metabolic networks, enabling the quantification of pathway fluxes to identify metabolic bottlenecks. However, these white-box models, despite their diverse applications, have limitations in simulating metabolic dynamics and are intrinsically inaccurate for industrial strains that lack information on network structures and kinetic parameters. On the other hand, black-box models do not rely on prior mechanistic knowledge of strains but are built upon observed time-series trajectories of biosynthetic systems in action. In practice, these observations are typically irregular, with discontinuously observed time points across multiple independent batches, each time point potentially containing missing measurements. Learning from such irregular data remains challenging for existing approaches. To address this issue, we present the Bidirectional Time-Series State Transfer Network (BTSTN) for modeling metabolic dynamics directly from irregular observations. Using evaluation data sets derived from both ideal dynamic systems and a real-world fermentation process, we demonstrate that BTSTN accurately reconstructs dynamic behaviors and predicts future trajectories. This approach exhibits enhanced robustness against missing measurements and noise, as compared to the state-of-the-art methods.IMPORTANCEIndustrial biosynthetic systems often involve strains with unclear genetic backgrounds, posing challenges in modeling their distinct metabolic dynamics. In such scenarios, white-box models, which commonly rely on inferred networks, are thereby of limited applicability and accuracy. In contrast, black-box models, such as statistical models and neural networks, are directly fitted or learned from observed time-series trajectories of biosynthetic systems in action. These methods typically assume regular observations without missing time points or measurements. If the observations are irregular, a pre-processing step becomes necessary to obtain a fully filled data set for subsequent model training, which, at the same time, inevitably introduces errors into the resulting models. BTSTN is a novel approach that natively learns from irregular observations. This distinctive feature makes it a unique addition to the current arsenal of technologies modeling metabolic dynamics.
Collapse
Affiliation(s)
- Shaohua Xu
- School of Basic Medical Sciences and the First Affiliated Hospital Department of Radiation Oncology, Zhejiang University School of Medicine, Hangzhou, China
- Zhejiang Provincial Key Laboratory for Microbial Biochemistry and Metabolic Engineering, Hangzhou, China
| | - Ting Xu
- School of Basic Medical Sciences and the First Affiliated Hospital Department of Radiation Oncology, Zhejiang University School of Medicine, Hangzhou, China
| | - Yuping Yang
- School of Basic Medical Sciences and the First Affiliated Hospital Department of Radiation Oncology, Zhejiang University School of Medicine, Hangzhou, China
| | - Xin Chen
- School of Basic Medical Sciences and the First Affiliated Hospital Department of Radiation Oncology, Zhejiang University School of Medicine, Hangzhou, China
- Zhejiang Provincial Key Laboratory for Microbial Biochemistry and Metabolic Engineering, Hangzhou, China
| |
Collapse
|
6
|
Wu W, Daneker M, Turner KT, Jolley MA, Lu L. Identifying Heterogeneous Micromechanical Properties of Biological Tissues via Physics-Informed Neural Networks. SMALL METHODS 2024:e2400620. [PMID: 39091065 DOI: 10.1002/smtd.202400620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/19/2024] [Indexed: 08/04/2024]
Abstract
The heterogeneous micromechanical properties of biological tissues have profound implications across diverse medical and engineering domains. However, identifying full-field heterogeneous elastic properties of soft materials using traditional engineering approaches is fundamentally challenging due to difficulties in estimating local stress fields. Recently, there has been a growing interest in data-driven models for learning full-field mechanical responses, such as displacement and strain, from experimental or synthetic data. However, research studies on inferring full-field elastic properties of materials, a more challenging problem, are scarce, particularly for large deformation, hyperelastic materials. Here, a physics-informed machine learning approach is proposed to identify the elasticity map in nonlinear, large deformation hyperelastic materials. This study reports the prediction accuracies and computational efficiency of physics-informed neural networks (PINNs) in inferring the heterogeneous elasticity maps across materials with structural complexity that closely resemble real tissue microstructure, such as brain, tricuspid valve, and breast cancer tissues. Further, the improved architecture is applied to three hyperelastic constitutive models: Neo-Hookean, Mooney Rivlin, and Gent. The improved network architecture consistently produces accurate estimations of heterogeneous elasticity maps, even when there is up to 10% noise present in the training data.
Collapse
Affiliation(s)
- Wensi Wu
- Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
- Division of Cardiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
| | - Mitchell Daneker
- Department of Statistics and Data Science, Yale University, New Haven, CT, 06511, USA
- Department of Chemical and Biochemical Engineering, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Kevin T Turner
- Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Matthew A Jolley
- Department of Anesthesiology and Critical Care Medicine, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
- Division of Cardiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
| | - Lu Lu
- Department of Statistics and Data Science, Yale University, New Haven, CT, 06511, USA
- Wu Tsai Institute, Yale University, New Haven, CT, 06510, USA
| |
Collapse
|
7
|
Wu W, Daneker M, Turner KT, Jolley MA, Lu L. Identifying heterogeneous micromechanical properties of biological tissues via physics-informed neural networks. ARXIV 2024:arXiv:2402.10741v3. [PMID: 38745694 PMCID: PMC11092874] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
The heterogeneous micromechanical properties of biological tissues have profound implications across diverse medical and engineering domains. However, identifying full-field heterogeneous elastic properties of soft materials using traditional engineering approaches is fundamentally challenging due to difficulties in estimating local stress fields. Recently, there has been a growing interest in using data-driven models to learn full-field mechanical responses such as displacement and strain from experimental or synthetic data. However, research studies on inferring full-field elastic properties of materials, a more challenging problem, are scarce, particularly for large deformation, hyperelastic materials. Here, we propose a physics-informed machine learning approach to identify the elasticity map in nonlinear, large deformation hyperelastic materials. We evaluate the prediction accuracies and computational efficiency of physics-informed neural networks (PINNs) by inferring the heterogeneous elasticity maps across three materials with structural complexity that closely resemble real tissue patterns, such as brain tissue and tricuspid valve tissue. We further applied our improved architecture to three additional examples of breast cancer tissue and extended our analysis to three hyperelastic constitutive models: Neo-Hookean, Mooney Rivlin, and Gent. Our selected network architecture consistently produced highly accurate estimations of heterogeneous elasticity maps, even when there was up to 10% noise present in the training data.
Collapse
Affiliation(s)
- Wensi Wu
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA 19104
- Division of Cardiology, Children’s Hospital of Philadelphia, Philadelphia, PA 19104
| | - Mitchell Daneker
- Department of Statistics and Data Science, Yale University, New Haven, CT 06511
- Department of Chemical and Biochemical Engineering, University of Pennsylvania, Philadelphia, PA 19104
| | - Kevin T. Turner
- Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, Philadelphia, PA 19104
| | - Matthew A. Jolley
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA 19104
- Division of Cardiology, Children’s Hospital of Philadelphia, Philadelphia, PA 19104
| | - Lu Lu
- Department of Statistics and Data Science, Yale University, New Haven, CT 06511
| |
Collapse
|
8
|
Chee FT, Harun S, Mohd Daud K, Sulaiman S, Nor Muhammad NA. Exploring gene regulation and biological processes in insects: Insights from omics data using gene regulatory network models. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2024; 189:1-12. [PMID: 38604435 DOI: 10.1016/j.pbiomolbio.2024.04.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 12/18/2023] [Accepted: 04/03/2024] [Indexed: 04/13/2024]
Abstract
Gene regulatory network (GRN) comprises complicated yet intertwined gene-regulator relationships. Understanding the GRN dynamics will unravel the complexity behind the observed gene expressions. Insect gene regulation is often complicated due to their complex life cycles and diverse ecological adaptations. The main interest of this review is to have an update on the current mathematical modelling methods of GRNs to explain insect science. Several popular GRN architecture models are discussed, together with examples of applications in insect science. In the last part of this review, each model is compared from different aspects, including network scalability, computation complexity, robustness to noise and biological relevancy.
Collapse
Affiliation(s)
- Fong Ting Chee
- Institute of Systems Biology, Universiti Kebangsaan Malaysia, 43600 UKM Bangi, Selangor, Malaysia
| | - Sarahani Harun
- Institute of Systems Biology, Universiti Kebangsaan Malaysia, 43600 UKM Bangi, Selangor, Malaysia
| | - Kauthar Mohd Daud
- Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600, UKM Bangi, Selangor, Malaysia
| | - Suhaila Sulaiman
- FGV R&D Sdn Bhd, FGV Innovation Center, PT23417 Lengkuk Teknologi, Bandar Baru Enstek, 71760 Nilai, Negeri Sembilan, Malaysia
| | - Nor Azlan Nor Muhammad
- Institute of Systems Biology, Universiti Kebangsaan Malaysia, 43600 UKM Bangi, Selangor, Malaysia.
| |
Collapse
|
9
|
Cadavid JL, Li NT, McGuigan AP. Bridging systems biology and tissue engineering: Unleashing the full potential of complex 3D in vitro tissue models of disease. BIOPHYSICS REVIEWS 2024; 5:021301. [PMID: 38617201 PMCID: PMC11008916 DOI: 10.1063/5.0179125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 03/12/2024] [Indexed: 04/16/2024]
Abstract
Rapid advances in tissue engineering have resulted in more complex and physiologically relevant 3D in vitro tissue models with applications in fundamental biology and therapeutic development. However, the complexity provided by these models is often not leveraged fully due to the reductionist methods used to analyze them. Computational and mathematical models developed in the field of systems biology can address this issue. Yet, traditional systems biology has been mostly applied to simpler in vitro models with little physiological relevance and limited cellular complexity. Therefore, integrating these two inherently interdisciplinary fields can result in new insights and move both disciplines forward. In this review, we provide a systematic overview of how systems biology has been integrated with 3D in vitro tissue models and discuss key application areas where the synergies between both fields have led to important advances with potential translational impact. We then outline key directions for future research and discuss a framework for further integration between fields.
Collapse
|
10
|
Metzcar J, Jutzeler CR, Macklin P, Köhn-Luque A, Brüningk SC. A review of mechanistic learning in mathematical oncology. Front Immunol 2024; 15:1363144. [PMID: 38533513 PMCID: PMC10963621 DOI: 10.3389/fimmu.2024.1363144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 02/20/2024] [Indexed: 03/28/2024] Open
Abstract
Mechanistic learning refers to the synergistic combination of mechanistic mathematical modeling and data-driven machine or deep learning. This emerging field finds increasing applications in (mathematical) oncology. This review aims to capture the current state of the field and provides a perspective on how mechanistic learning may progress in the oncology domain. We highlight the synergistic potential of mechanistic learning and point out similarities and differences between purely data-driven and mechanistic approaches concerning model complexity, data requirements, outputs generated, and interpretability of the algorithms and their results. Four categories of mechanistic learning (sequential, parallel, extrinsic, intrinsic) of mechanistic learning are presented with specific examples. We discuss a range of techniques including physics-informed neural networks, surrogate model learning, and digital twins. Example applications address complex problems predominantly from the domain of oncology research such as longitudinal tumor response predictions or time-to-event modeling. As the field of mechanistic learning advances, we aim for this review and proposed categorization framework to foster additional collaboration between the data- and knowledge-driven modeling fields. Further collaboration will help address difficult issues in oncology such as limited data availability, requirements of model transparency, and complex input data which are embraced in a mechanistic learning framework.
Collapse
Affiliation(s)
- John Metzcar
- Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Bloomington, IN, United States
- Informatics, Luddy School of Informatics, Computing, and Engineering, Bloomington, IN, United States
| | - Catherine R. Jutzeler
- Department of Health Sciences and Technology (D-HEST), Eidgenössische Technische Hochschule Zürich (ETH), Zürich, Switzerland
- Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland
| | - Paul Macklin
- Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Bloomington, IN, United States
| | - Alvaro Köhn-Luque
- Oslo Centre for Biostatistics and Epidemiology, Faculty of Medicine, University of Oslo, Oslo, Norway
- Oslo Centre for Biostatistics and Epidemiology, Research Support Services, Oslo University Hospital, Oslo, Norway
| | - Sarah C. Brüningk
- Department of Health Sciences and Technology (D-HEST), Eidgenössische Technische Hochschule Zürich (ETH), Zürich, Switzerland
- Swiss Institute of Bioinformatics (SIB), Lausanne, Switzerland
| |
Collapse
|
11
|
Ahmadi Daryakenari N, De Florio M, Shukla K, Karniadakis GE. AI-Aristotle: A physics-informed framework for systems biology gray-box identification. PLoS Comput Biol 2024; 20:e1011916. [PMID: 38470870 PMCID: PMC10931529 DOI: 10.1371/journal.pcbi.1011916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 02/13/2024] [Indexed: 03/14/2024] Open
Abstract
Discovering mathematical equations that govern physical and biological systems from observed data is a fundamental challenge in scientific research. We present a new physics-informed framework for parameter estimation and missing physics identification (gray-box) in the field of Systems Biology. The proposed framework-named AI-Aristotle-combines the eXtreme Theory of Functional Connections (X-TFC) domain-decomposition and Physics-Informed Neural Networks (PINNs) with symbolic regression (SR) techniques for parameter discovery and gray-box identification. We test the accuracy, speed, flexibility, and robustness of AI-Aristotle based on two benchmark problems in Systems Biology: a pharmacokinetics drug absorption model and an ultradian endocrine model for glucose-insulin interactions. We compare the two machine learning methods (X-TFC and PINNs), and moreover, we employ two different symbolic regression techniques to cross-verify our results. To test the performance of AI-Aristotle, we use sparse synthetic data perturbed by uniformly distributed noise. More broadly, our work provides insights into the accuracy, cost, scalability, and robustness of integrating neural networks with symbolic regressors, offering a comprehensive guide for researchers tackling gray-box identification challenges in complex dynamical systems in biomedicine and beyond.
Collapse
Affiliation(s)
- Nazanin Ahmadi Daryakenari
- Center for Biomedical Engineering, School of Engineering, Brown University, Providence, Rhode Island, United States of America
| | - Mario De Florio
- Division of Applied Mathematics, Brown University, Providence, Rhode Island, United States of America
| | - Khemraj Shukla
- Division of Applied Mathematics, Brown University, Providence, Rhode Island, United States of America
| | - George Em Karniadakis
- Division of Applied Mathematics, Brown University, Providence, Rhode Island, United States of America
| |
Collapse
|
12
|
Lin Z, Mao Z, Ma R. Inferring biophysical properties of membranes during endocytosis using machine learning. SOFT MATTER 2024; 20:651-660. [PMID: 38164011 DOI: 10.1039/d3sm01221b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2024]
Abstract
Endocytosis is a fundamental cellular process in eukaryotic cells that facilitates the transport of molecules into the cell. With the help of fluorescence microscopy and electron tomography, researchers have accumulated extensive geometric data of membrane shapes during endocytosis. These data contain rich information about the mechanical properties of membranes, which are hard to access via experiments due to the small dimensions of the endocytic patch. In this study, we propose an approach that combines machine learning with the Helfrich theory of membranes to infer the mechanical properties of membranes during endocytosis from a dataset of membrane shapes extracted from electron tomography. Our results demonstrate that machine learning can output solutions that both match the experimental profile and satisfy the membrane shape equations derived from Helfrich theory. The learning results show that during the early stage of endocytosis, the inferred membrane tension is negative, indicating the presence of strong compressive forces at the boundary of the endocytic invagination. Our method presents a generic framework for extracting membrane information from super-resolution imaging.
Collapse
Affiliation(s)
- Zhiwei Lin
- Department of Physics, College of Physical Science and Technology, Xiamen University, Xiamen 361005, China.
| | - Zhiping Mao
- School of Mathematical Sciences, Fujian Provincial Key Laboratory of Mathematical Modeling and High-Performance Scientific Computing, Xiamen University, Xiamen 361005, China.
| | - Rui Ma
- Department of Physics, College of Physical Science and Technology, Xiamen University, Xiamen 361005, China.
- Fujian Provincial Key Laboratory for Soft Functional Materials Research, Research Institute for Biomimetics and Soft Matter, Xiamen University, Xiamen 361005, China
| |
Collapse
|
13
|
Prabhu S, Rangarajan S, Kothare M. Data-driven discovery of sparse dynamical model of cardiovascular system for model predictive control. Comput Biol Med 2023; 166:107513. [PMID: 37839218 PMCID: PMC10982123 DOI: 10.1016/j.compbiomed.2023.107513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 08/11/2023] [Accepted: 09/19/2023] [Indexed: 10/17/2023]
Abstract
Cardiovascular diseases remain the leading cause of death globally. In recent years, vagal nerve stimulation (VNS) has shown promising results in the treatment of a number of cardiovascular diseases. In this approach, mild electrical pulses are sent to the brain via the vagus nerve. This open-loop neurostimulation, however, leads to various side effects due to physiological and inter-patient variability and therefore a closed-loop delivery strategy of electrical pulses that accounts for this variability is desired. In this context, we envision data-driven sparse dynamical model parameterized by patient-specific data as appropriate for use in closed loop controller design. In this work, we build a dynamical model for mean arterial pressure and heart rate using the method sparse identification of nonlinear dynamics (SINDy). As a proxy for real datasets or measurements from a patient, we simulate a mechanistic model from the literature and then discover a data-driven model for predicting mean arterial pressure and heart rate in response to neural stimulus. This discovered model is then used to design a controller to be implemented in closed-loop via model predictive control. We observe that this data-driven model is interpretable, consistent with experiments, provides insights on the sensitivity of different stimulation locations and simplifies the formulation of the optimal control problem. Noting the set-point tracking performance of this closed-loop model-based controller that uses this discovered model, we conclude that the model is adequate in capturing the dynamics of a highly nonlinear cardiovascular system for the purpose of optimal predictive controller design.
Collapse
Affiliation(s)
- Siddharth Prabhu
- Chemical and Biomolecular Engineering, Lehigh University, Bethlehem, PA, USA.
| | - Srinivas Rangarajan
- Chemical and Biomolecular Engineering, Lehigh University, Bethlehem, PA, USA.
| | - Mayuresh Kothare
- Chemical and Biomolecular Engineering, Lehigh University, Bethlehem, PA, USA.
| |
Collapse
|
14
|
Taneja K, He X, He Q, Chen JS. A multi-resolution physics-informed recurrent neural network: formulation and application to musculoskeletal systems. COMPUTATIONAL MECHANICS 2023; 73:1125-1145. [PMID: 38699409 PMCID: PMC11060984 DOI: 10.1007/s00466-023-02403-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 09/21/2023] [Indexed: 05/05/2024]
Abstract
This work presents a multi-resolution physics-informed recurrent neural network (MR PI-RNN), for simultaneous prediction of musculoskeletal (MSK) motion and parameter identification of the MSK systems. The MSK application was selected as the model problem due to its challenging nature in mapping the high-frequency surface electromyography (sEMG) signals to the low-frequency body joint motion controlled by the MSK and muscle contraction dynamics. The proposed method utilizes the fast wavelet transform to decompose the mixed frequency input sEMG and output joint motion signals into nested multi-resolution signals. The prediction model is subsequently trained on coarser-scale input-output signals using a gated recurrent unit (GRU), and then the trained parameters are transferred to the next level of training with finer-scale signals. These training processes are repeated recursively under a transfer-learning fashion until the full-scale training (i.e., with unfiltered signals) is achieved, while satisfying the underlying dynamic equilibrium. Numerical examples on recorded subject data demonstrate the effectiveness of the proposed framework in generating a physics-informed forward-dynamics surrogate, which yields higher accuracy in motion predictions of elbow flexion-extension of an MSK system compared to the case with single-scale training. The framework is also capable of identifying muscle parameters that are physiologically consistent with the subject's kinematics data.
Collapse
Affiliation(s)
- Karan Taneja
- Department of Structural Engineering, University of California San Diego, La Jolla, CA USA
| | | | - QiZhi He
- Department of Civil, Environmental, and Geo- Engineering, University of Minnesota, Minneapolis, MN USA
| | - Jiun-Shyan Chen
- Department of Structural Engineering, University of California San Diego, La Jolla, CA USA
| |
Collapse
|
15
|
Ferrà A, Cecchini G, Nobbe Fisas FP, Casacuberta C, Cos I. A topological classifier to characterize brain states: When shape matters more than variance. PLoS One 2023; 18:e0292049. [PMID: 37782651 PMCID: PMC10545107 DOI: 10.1371/journal.pone.0292049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 08/04/2023] [Indexed: 10/04/2023] Open
Abstract
Despite the remarkable accuracies attained by machine learning classifiers to separate complex datasets in a supervised fashion, most of their operation falls short to provide an informed intuition about the structure of data, and, what is more important, about the phenomena being characterized by the given datasets. By contrast, topological data analysis (TDA) is devoted to study the shape of data clouds by means of persistence descriptors and provides a quantitative characterization of specific topological features of the dataset under scrutiny. Here we introduce a novel TDA-based classifier that works on the principle of assessing quantifiable changes on topological metrics caused by the addition of new input to a subset of data. We used this classifier with a high-dimensional electro-encephalographic (EEG) dataset recorded from eleven participants during a previous decision-making experiment in which three motivational states were induced through a manipulation of social pressure. We calculated silhouettes from persistence diagrams associated with each motivated state with a ready-made band-pass filtered version of these signals, and classified unlabeled signals according to their impact on each reference silhouette. Our results show that in addition to providing accuracies within the range of those of a nearest neighbour classifier, the TDA classifier provides formal intuition of the structure of the dataset as well as an estimate of its intrinsic dimension. Towards this end, we incorporated variance-based dimensionality reduction methods to our dataset and found that in most cases the accuracy of our TDA classifier remains essentially invariant beyond a certain dimension.
Collapse
Affiliation(s)
- Aina Ferrà
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Gloria Cecchini
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Fritz-Pere Nobbe Fisas
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Carles Casacuberta
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Catalonia, Spain
- Institut de Matemàtica de la Universitat de Barcelona (IMUB), Barcelona, Spin
| | - Ignasi Cos
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Barcelona, Catalonia, Spain
- Institut de Matemàtica de la Universitat de Barcelona (IMUB), Barcelona, Spin
- Serra-Húnter Fellow Programme, Barcelona, Catalonia, Spain
| |
Collapse
|
16
|
Keith B. The technique that can find a system's state through data alone. Nature 2023; 622:246-247. [PMID: 37821586 DOI: 10.1038/d41586-023-03070-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/13/2023]
|
17
|
He M, Tang B, Xiao Y, Tang S. Transmission dynamics informed neural network with application to COVID-19 infections. Comput Biol Med 2023; 165:107431. [PMID: 37696183 DOI: 10.1016/j.compbiomed.2023.107431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 07/26/2023] [Accepted: 08/28/2023] [Indexed: 09/13/2023]
Abstract
Since the end of 2019 the COVID-19 repeatedly surges with most countries/territories experiencing multiple waves, and mechanism-based epidemic models played important roles in understanding the transmission mechanism of multiple epidemic waves. However, capturing temporal changes of the transmissibility of COVID-19 during the multiple waves keeps ill-posed problem for traditional mechanism-based epidemic compartment models, because that the transmission rate is usually assumed to be specific piecewise functions and more parameters are added to the model once multiple epidemic waves involved, which poses a huge challenge to parameter estimation. Meanwhile, data-driven deep neural networks fail to discover the driving factors of repeated outbreaks and lack interpretability. In this study, aiming at developing a data-driven method to project time-dependent parameters but also merging the advantage of mechanism-based models, we propose a transmission dynamics informed neural network (TDINN) by encoding the SEIRD compartment model into deep neural networks. We show that the proposed TDINN algorithm performs very well when fitting the COVID-19 epidemic data with multiple waves, where the epidemics in the United States, Italy, South Africa, and Kenya, and several outbreaks the Omicron variant in China are taken as examples. In addition, the numerical simulation shows that the trained TDINN can also perform as a predictive model to capture the future development of COVID-19 epidemic. We find that the transmission rate inferred by the TDINN frequently fluctuates, and a feedback loop between the epidemic shifting and the changes of transmissibility drives the occurrence of multiple waves. We observe a long response delay to the implementation of control interventions in the four countries, while the decline of the transmission rate in the outbreaks in China usually happens once the implementation of control interventions. The further simulation show that 17 days' delay of the response to the implementation of control interventions lead to a roughly four-fold increase in daily reported cases in one epidemic wave in Italy, which suggest that a rapid response to policies that strengthen control interventions can be effective in flattening the epidemic curve or avoiding subsequent epidemic waves. We observe that the transmission rate in the outbreaks in China is already decreasing before enhancing control interventions, providing the evidence that the increasing of the epidemics can drive self-conscious behavioural changes to protect against infections.
Collapse
Affiliation(s)
- Mengqi He
- School of Mathematics and Statistics, Shaanxi Normal University, Xi'an, China
| | - Biao Tang
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, China.
| | - Yanni Xiao
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, China
| | - Sanyi Tang
- School of Mathematics and Statistics, Shaanxi Normal University, Xi'an, China
| |
Collapse
|
18
|
Zou X, Guo H, Jiang C, Nguyen DV, Chen GH, Wu D. Physics-informed neural network-based serial hybrid model capturing the hidden kinetics for sulfur-driven autotrophic denitrification process. WATER RESEARCH 2023; 243:120331. [PMID: 37454462 DOI: 10.1016/j.watres.2023.120331] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/04/2023] [Accepted: 07/09/2023] [Indexed: 07/18/2023]
Abstract
Sulfur-driven autotrophic denitrification (SdAD) is a biological process that can remove nitrate from low carbon/nitrogen (C/N) ratio wastewater. Although this process has been intensively researched, the mechanism whereby its intermediates (i.e., elemental sulfur and nitrite ions) are generated and accumulated remains elusive. Existing mathematical models developed for SdAD cannot accurately predict the intermediates in SdAD because of the incomplete knowledge of process kinetic resulting from changes in the environmental conditions and electron competition during SdAD. To address this limitation, we proposed a novel serial hybrid model structure based on a physics-informed neural network (PINN) to capture the dynamics of the process kinetics and predict the substrate concentrations in SdAD. In this study, we evaluated the model through numerical experiments and applied it to real case studies involving batch and continuous-flow reactor scenarios. By leveraging the PINN approach, the hybrid model yielded accurate predictions at both the state (i.e. substrate concentration) and kinetic levels in the numerical experiments and performed better than both mechanistic and purely data-driven models in the case studies. Furthermore, we used the trained hybrid model to design control strategies for SdAD and a novel integrated process involving SdAD and anammox for energy-efficient nitrogen removal. Finally, we discuss the advantages and application scope of the PINN-based hybrid model.
Collapse
Affiliation(s)
- Xu Zou
- Department of Civil and Environmental Engineering, Water Technology Center, Hong Kong Branch of Chinese National Engineering Research Center for Control & Treatment of Heavy Metal Pollution, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Hongxiao Guo
- Department of Civil and Environmental Engineering, Water Technology Center, Hong Kong Branch of Chinese National Engineering Research Center for Control & Treatment of Heavy Metal Pollution, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Chukuan Jiang
- Department of Civil and Environmental Engineering, Water Technology Center, Hong Kong Branch of Chinese National Engineering Research Center for Control & Treatment of Heavy Metal Pollution, The Hong Kong University of Science and Technology, Hong Kong, China
| | - Duc Viet Nguyen
- Centre for Environmental and Energy Research, Ghent University Global Campus, Incheon, Republic of Korea; Department of Green Chemistry and Technology, Centre for Advanced Process Technology for Urban REsource recovery (CAPTURE), Ghent University, Ghent, Belgium
| | - Guang-Hao Chen
- Department of Civil and Environmental Engineering, Water Technology Center, Hong Kong Branch of Chinese National Engineering Research Center for Control & Treatment of Heavy Metal Pollution, The Hong Kong University of Science and Technology, Hong Kong, China.
| | - Di Wu
- Department of Civil and Environmental Engineering, Water Technology Center, Hong Kong Branch of Chinese National Engineering Research Center for Control & Treatment of Heavy Metal Pollution, The Hong Kong University of Science and Technology, Hong Kong, China; Centre for Environmental and Energy Research, Ghent University Global Campus, Incheon, Republic of Korea; Department of Green Chemistry and Technology, Centre for Advanced Process Technology for Urban REsource recovery (CAPTURE), Ghent University, Ghent, Belgium.
| |
Collapse
|
19
|
Thompson JC, Zavala VM, Venturelli OS. Integrating a tailored recurrent neural network with Bayesian experimental design to optimize microbial community functions. PLoS Comput Biol 2023; 19:e1011436. [PMID: 37773951 PMCID: PMC10540976 DOI: 10.1371/journal.pcbi.1011436] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 08/16/2023] [Indexed: 10/01/2023] Open
Abstract
Microbiomes interact dynamically with their environment to perform exploitable functions such as production of valuable metabolites and degradation of toxic metabolites for a wide range of applications in human health, agriculture, and environmental cleanup. Developing computational models to predict the key bacterial species and environmental factors to build and optimize such functions are crucial to accelerate microbial community engineering. However, there is an unknown web of interactions that determine the highly complex and dynamic behavior of these systems, which precludes the development of models based on known mechanisms. By contrast, entirely data-driven machine learning models can produce physically unrealistic predictions and often require significant amounts of experimental data to learn system behavior. We develop a physically-constrained recurrent neural network that preserves model flexibility but is constrained to produce physically consistent predictions and show that it can outperform existing machine learning methods in the prediction of certain experimentally measured species abundance and metabolite concentrations. Further, we present a closed-loop, Bayesian experimental design algorithm to guide data collection by selecting experimental conditions that simultaneously maximize information gain and target microbial community functions. Using a bioreactor case study, we demonstrate how the proposed framework can be used to efficiently navigate a large design space to identify optimal operating conditions. The proposed methodology offers a flexible machine learning approach specifically tailored to optimize microbiome target functions through the sequential design of informative experiments that seek to explore and exploit community functions.
Collapse
Affiliation(s)
- Jaron C. Thompson
- Department of Chemical and Biological Engineering, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Biochemistry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| | - Victor M. Zavala
- Department of Chemical and Biological Engineering, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| | - Ophelia S. Venturelli
- Department of Chemical and Biological Engineering, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Biochemistry, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
- Department of Bacteriology, University of Wisconsin-Madison, Madison, Wisconsin, United States of America
| |
Collapse
|
20
|
Lee M. Recent Advances in Deep Learning for Protein-Protein Interaction Analysis: A Comprehensive Review. Molecules 2023; 28:5169. [PMID: 37446831 DOI: 10.3390/molecules28135169] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 06/30/2023] [Accepted: 06/30/2023] [Indexed: 07/15/2023] Open
Abstract
Deep learning, a potent branch of artificial intelligence, is steadily leaving its transformative imprint across multiple disciplines. Within computational biology, it is expediting progress in the understanding of Protein-Protein Interactions (PPIs), key components governing a wide array of biological functionalities. Hence, an in-depth exploration of PPIs is crucial for decoding the intricate biological system dynamics and unveiling potential avenues for therapeutic interventions. As the deployment of deep learning techniques in PPI analysis proliferates at an accelerated pace, there exists an immediate demand for an exhaustive review that encapsulates and critically assesses these novel developments. Addressing this requirement, this review offers a detailed analysis of the literature from 2021 to 2023, highlighting the cutting-edge deep learning methodologies harnessed for PPI analysis. Thus, this review stands as a crucial reference for researchers in the discipline, presenting an overview of the recent studies in the field. This consolidation helps elucidate the dynamic paradigm of PPI analysis, the evolution of deep learning techniques, and their interdependent dynamics. This scrutiny is expected to serve as a vital aid for researchers, both well-established and newcomers, assisting them in maneuvering the rapidly shifting terrain of deep learning applications in PPI analysis.
Collapse
Affiliation(s)
- Minhyeok Lee
- School of Electrical and Electronics Engineering, Chung-Ang University, Seoul 06974, Republic of Korea
| |
Collapse
|
21
|
WU W, DANEKER M, JOLLEY MA, TURNER KT, LU L. Effective data sampling strategies and boundary condition constraints of physics-informed neural networks for identifying material properties in solid mechanics. APPLIED MATHEMATICS AND MECHANICS 2023; 44:1039-1068. [PMID: 37501681 PMCID: PMC10373631 DOI: 10.1007/s10483-023-2995-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 05/09/2023] [Indexed: 07/29/2023]
Abstract
Material identification is critical for understanding the relationship between mechanical properties and the associated mechanical functions. However, material identification is a challenging task, especially when the characteristic of the material is highly nonlinear in nature, as is common in biological tissue. In this work, we identify unknown material properties in continuum solid mechanics via physics-informed neural networks (PINNs). To improve the accuracy and efficiency of PINNs, we develop efficient strategies to nonuniformly sample observational data. We also investigate different approaches to enforce Dirichlet-type boundary conditions (BCs) as soft or hard constraints. Finally, we apply the proposed methods to a diverse set of time-dependent and time-independent solid mechanic examples that span linear elastic and hyperelastic material space. The estimated material parameters achieve relative errors of less than 1%. As such, this work is relevant to diverse applications, including optimizing structural integrity and developing novel materials.
Collapse
Affiliation(s)
- W. WU
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, U. S. A
- Division of Pediatric Cardiology, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, U. S. A
| | - M. DANEKER
- Department of Chemical and Biomolecular Engineering, University of Pennsylvania, Philadelphia, PA 19104, U. S. A
| | - M. A. JOLLEY
- Department of Anesthesiology and Critical Care Medicine, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, U. S. A
- Division of Pediatric Cardiology, Children’s Hospital of Philadelphia, Philadelphia, PA 19104, U. S. A
| | - K. T. TURNER
- Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, Philadelphia, PA 19104, U. S. A
| | - L. LU
- Department of Chemical and Biomolecular Engineering, University of Pennsylvania, Philadelphia, PA 19104, U. S. A
| |
Collapse
|
22
|
Fritschi L, Lenk K. Parameter Inference for an Astrocyte Model using Machine Learning Approaches. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.16.540982. [PMID: 37292854 PMCID: PMC10245674 DOI: 10.1101/2023.05.16.540982] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Astrocytes are the largest subset of glial cells and perform structural, metabolic, and regulatory functions. They are directly involved in the communication at neuronal synapses and the maintenance of brain homeostasis. Several disorders, such as Alzheimer's, epilepsy, and schizophrenia, have been associated with astrocyte dysfunction. Computational models on various spatial levels have been proposed to aid in the understanding and research of astrocytes. The difficulty of computational astrocyte models is to fastly and precisely infer parameters. Physics informed neural networks (PINNs) use the underlying physics to infer parameters and, if necessary, dynamics that can not be observed. We have applied PINNs to estimate parameters for a computational model of an astrocytic compartment. The addition of two techniques helped with the gradient pathologies of the PINNS, the dynamic weighting of various loss components and the addition of Transformers. To overcome the issue that the neural network only learned the time dependence but did not know about eventual changes of the input stimulation to the astrocyte model, we followed an adaptation of PINNs from control theory (PINCs). In the end, we were able to infer parameters from artificial, noisy data, with stable results for the computational astrocyte model.
Collapse
Affiliation(s)
| | - Kerstin Lenk
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
- BioTechMed, 8010 Graz, Austria
| |
Collapse
|
23
|
van den Berg PR, Bérenger-Currias NMLP, Budnik B, Slavov N, Semrau S. Integration of a multi-omics stem cell differentiation dataset using a dynamical model. PLoS Genet 2023; 19:e1010744. [PMID: 37167320 DOI: 10.1371/journal.pgen.1010744] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 05/23/2023] [Accepted: 04/14/2023] [Indexed: 05/13/2023] Open
Abstract
Stem cell differentiation is a highly dynamic process involving pervasive changes in gene expression. The large majority of existing studies has characterized differentiation at the level of individual molecular profiles, such as the transcriptome or the proteome. To obtain a more comprehensive view, we measured protein, mRNA and microRNA abundance during retinoic acid-driven differentiation of mouse embryonic stem cells. We found that mRNA and protein abundance are typically only weakly correlated across time. To understand this finding, we developed a hierarchical dynamical model that allowed us to integrate all data sets. This model was able to explain mRNA-protein discordance for most genes and identified instances of potential microRNA-mediated regulation. Overexpression or depletion of microRNAs identified by the model, followed by RNA sequencing and protein quantification, were used to follow up on the predictions of the model. Overall, our study shows how multi-omics integration by a dynamical model could be used to nominate candidate regulators.
Collapse
Affiliation(s)
| | | | - Bogdan Budnik
- Mass Spectrometry and Proteomics Resource Laboratory, Harvard University, Cambridge, Massachusetts, United States of America
| | - Nikolai Slavov
- Department of Bioengineering, Northeastern University, Boston, Massachusetts, United States of America
| | - Stefan Semrau
- Leiden Institute of Physics, Leiden University, Leiden, Zuid-Holland, The Netherlands
| |
Collapse
|
24
|
Li X, Wang P, Song W, Gao W. Modal wavenumber estimation by combining physical informed neural network. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2023; 153:2637. [PMID: 37129677 DOI: 10.1121/10.0019305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Accepted: 04/14/2023] [Indexed: 05/03/2023]
Abstract
Estimation of modal wavenumbers is important for inference of geoacoustic properties and data-driven matched field processing in shallow water waveguides. This paper introduces a deep neural network called combining physical informed neural network (CPINN) for modal wavenumber estimation using a vertical linear array (VLA). Note that the sound field recorded by a VLA can be expressed as a linear superposition of finite modal depth functions, and the differential equations satisfied by the modal depth functions are related to the corresponding modal wavenumbers. CPINN can estimate the modal wavenumbers by introducing the proxies of the modal depth functions and constraining them to satisfy the corresponding differential equations. The performance of the CPINN is evaluated by simulated data in a noisy shallow water environment. Numerical results show that, when compared with the previous methods, CPINN does not need to know the exact horizontal distance between the sound source and the VLA. Moreover, CPINN can estimate the modal wavenumbers at the VLA position in the case where the range segment traversed by the source, i.e., the aperture in the range direction, is smaller than the maximum modal cycle distance and in a range-dependent waveguide.
Collapse
Affiliation(s)
- Xiaolei Li
- College of Marine Technology, Ocean University of China, Qingdao, 266100, China
| | - Pengyu Wang
- College of Electronic Engineering, Ocean University of China, Qingdao, 266100, China
| | - Wenhua Song
- College of Physics and Optoelectronic Engineering, Ocean University of China, Qingdao, 266100, China
| | - Wei Gao
- College of Marine Technology, Ocean University of China, Qingdao, 266100, China
| |
Collapse
|
25
|
Kumar AK, Jain S, Jain S, Ritam M, Xia Y, Chandra R. Physics-informed neural entangled-ladder network for inhalation impedance of the respiratory system. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 231:107421. [PMID: 36805280 DOI: 10.1016/j.cmpb.2023.107421] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 02/11/2023] [Accepted: 02/13/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVES The use of machine learning methods for modelling bio-systems is becoming prominent which can further improve bio-medical technologies. Physics-informed neural networks (PINNs) can embed the knowledge of physical laws that govern a system during the model training process. PINNs utilise differential equations in the model which traditionally used numerical methods that are computationally complex. METHODS We integrate PINNs with an entangled ladder network for modelling respiratory systems by considering a lungs conduction zone to evaluate the respiratory impedance for different initial conditions. We evaluate the respiratory impedance for the inhalation phase of breathing for a symmetric model of the human lungs using entanglement and continued fractions. RESULTS We obtain the impedance of the conduction zone of the lungs pulmonary airways using PINNs for nine different combinations of velocity and pressure of inhalation. We compare the results from PINNs with the finite element method using the mean absolute error and root mean square error. The results show that the impedance obtained with PINNs contrasts with the conventional forced oscillation test used for deducing the respiratory impedance. The results show similarity with the impedance plots for different respiratory diseases. CONCLUSION We find a decrease in impedance when the velocity of breathing is lowered gradually by 20%. Hence, the methodology can be used to design smart ventilators to the improve flow of breathing.
Collapse
Affiliation(s)
- Amit Krishan Kumar
- Faculty of Electrical-Electronic Engineering, Duy Tan University, Da Nang, 550000, Vietnam; State Key Laboratory of Intelligent Control and Decision of Complex Systems, School of Automation, Beijing Institute of Technology, Beijing, 100081, China.
| | - Snigdha Jain
- Department of Electronics and Communications Engineering, Indian Institute of Technology Guwahati, Assam, India.
| | - Shirin Jain
- Department of Electronics and Communications Engineering, Indian Institute of Technology Guwahati, Assam, India.
| | - M Ritam
- Department of Chemical Engineering, Indian Institute of Technology Guwahati, Assam, India.
| | - Yuanqing Xia
- State Key Laboratory of Intelligent Control and Decision of Complex Systems, School of Automation, Beijing Institute of Technology, Beijing, 100081, China.
| | - Rohitash Chandra
- Transitional Artificial Intelligence Research Group, School of Mathematics and Statistics, UNSW Sydney, NSW 2052, Australia.
| |
Collapse
|
26
|
Moya C, Zhang S, Lin G, Yue M. DeepONet-Grid-UQ: A Trustworthy Deep Operator Framework for Predicting the Power Grid’s Post-Fault Trajectories. Neurocomputing 2023. [DOI: 10.1016/j.neucom.2023.03.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/18/2023]
|
27
|
Cunha Jr A, Barton DAW, Ritto TG. Uncertainty quantification in mechanistic epidemic models via cross-entropy approximate Bayesian computation. NONLINEAR DYNAMICS 2023; 111:9649-9679. [PMID: 37025428 PMCID: PMC9961307 DOI: 10.1007/s11071-023-08327-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Accepted: 02/09/2023] [Indexed: 06/19/2023]
Abstract
This paper proposes a data-driven approximate Bayesian computation framework for parameter estimation and uncertainty quantification of epidemic models, which incorporates two novelties: (i) the identification of the initial conditions by using plausible dynamic states that are compatible with observational data; (ii) learning of an informative prior distribution for the model parameters via the cross-entropy method. The new methodology's effectiveness is illustrated with the aid of actual data from the COVID-19 epidemic in Rio de Janeiro city in Brazil, employing an ordinary differential equation-based model with a generalized SEIR mechanistic structure that includes time-dependent transmission rate, asymptomatics, and hospitalizations. A minimization problem with two cost terms (number of hospitalizations and deaths) is formulated, and twelve parameters are identified. The calibrated model provides a consistent description of the available data, able to extrapolate forecasts over a few weeks, making the proposed methodology very appealing for real-time epidemic modeling.
Collapse
Affiliation(s)
- Americo Cunha Jr
- Institute of Mathematics and Statistics, Rio de Janeiro State University – UERJ, Rio de Janeiro, Brazil
| | | | - Thiago G. Ritto
- Department of Mechanical Engineering, Federal University of Rio de Janeiro – UFRJ, Rio de Janeiro, Brazil
| |
Collapse
|
28
|
Bell MK, Rangamani P. Crosstalk between biochemical signalling network architecture and trafficking governs AMPAR dynamics in synaptic plasticity. J Physiol 2023. [PMID: 36620889 DOI: 10.1113/jp284029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 01/03/2023] [Indexed: 01/10/2023] Open
Abstract
Synaptic plasticity involves modification of both biochemical and structural components of neurons. Many studies have revealed that the change in the number density of the glutamatergic receptor AMPAR at the synapse is proportional to synaptic weight update; an increase in AMPAR corresponds to strengthening of synapses while a decrease in AMPAR density weakens synaptic connections. The dynamics of AMPAR are thought to be regulated by upstream signalling, primarily the calcium-CaMKII pathway, trafficking to and from the synapse, and influx from extrasynaptic sources. Previous work in the field of deterministic modelling of CaMKII dynamics has assumed bistable kinetics, while experiments and rule-based modelling have revealed that CaMKII dynamics can be either monostable or ultrasensitive. This raises the following question: how does the choice of model assumptions involving CaMKII dynamics influence AMPAR dynamics at the synapse? To answer this question, we have developed a set of models using compartmental ordinary differential equations to systematically investigate contributions of different signalling and trafficking variations, along with their coupled effects, on AMPAR dynamics at the synaptic site. We find that the properties of the model including network architecture describing different stability features of CaMKII and parameters that capture the endocytosis and exocytosis of AMPAR significantly affect the integration of fast upstream species by slower downstream species. Furthermore, we predict that the model outcome, as determined by bound AMPAR at the synaptic site, depends on (1) the choice of signalling model (bistable CaMKII or monostable CaMKII dynamics), (2) trafficking versus influx contributions and (3) frequency of stimulus. KEY POINTS: The density of AMPA receptors (AMPARs) at the postsynaptic density of the synapse provides a readout of synaptic plasticity, which involves crosstalk between complex biochemical signalling networks including CaMKII dynamics and trafficking pathways including exocytosis and endocytosis. Here we build a model that integrates CaMKII dynamics and AMPAR trafficking to explore this crosstalk. We compare different models of CaMKII that result in monostable or bistable kinetics and their impact on AMPAR dynamics. Our results show that AMPAR density depends on the coupling between aspects of biochemical signalling and trafficking. Specifically, assumptions regarding CaMKII dynamics and its stability features can alter AMPAR density at the synapse. Our model also predicts that the kinetics of trafficking versus influx of AMPAR from the extrasynaptic space can further impact AMPAR density. Thus, the contributions of both signalling and trafficking should be considered in computational models.
Collapse
Affiliation(s)
- Miriam K Bell
- Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, California, USA
| | - Padmini Rangamani
- Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, California, USA
| |
Collapse
|
29
|
Daneker M, Zhang Z, Karniadakis GE, Lu L. Systems Biology: Identifiability Analysis and Parameter Identification via Systems-Biology-Informed Neural Networks. Methods Mol Biol 2023; 2634:87-105. [PMID: 37074575 DOI: 10.1007/978-1-0716-3008-2_4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/20/2023]
Abstract
The dynamics of systems biological processes are usually modeled by a system of ordinary differential equations (ODEs) with many unknown parameters that need to be inferred from noisy and sparse measurements. Here, we introduce systems-biology-informed neural networks for parameter estimation by incorporating the system of ODEs into the neural networks. To complete the workflow of system identification, we also describe structural and practical identifiability analysis to analyze the identifiability of parameters. We use the ultradian endocrine model for glucose-insulin interaction as the example to demonstrate all these methods and their implementation.
Collapse
Affiliation(s)
- Mitchell Daneker
- Department of Chemical and Biomolecular Engineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Zhen Zhang
- Division of Applied Mathematics, Brown University, Providence, RI, USA
| | - George Em Karniadakis
- Division of Applied Mathematics, Brown University, Providence, RI, USA
- School of Engineering, Brown University, Providence, RI, USA
| | - Lu Lu
- Department of Chemical and Biomolecular Engineering, University of Pennsylvania, Philadelphia, PA, USA.
| |
Collapse
|
30
|
On generalization error of neural network models and its application to predictive control of nonlinear processes. Chem Eng Res Des 2023. [DOI: 10.1016/j.cherd.2022.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
31
|
Rahmim A, Brosch-Lenz J, Fele-Paranj A, Yousefirizi F, Soltani M, Uribe C, Saboury B. Theranostic digital twins for personalized radiopharmaceutical therapies: Reimagining theranostics via computational nuclear oncology. Front Oncol 2022; 12:1062592. [PMID: 36591527 PMCID: PMC9797662 DOI: 10.3389/fonc.2022.1062592] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 11/11/2022] [Indexed: 12/23/2022] Open
Abstract
This work emphasizes that patient data, including images, are not operable (clinically), but that digital twins are. Based on the former, the latter can be created. Subsequently, virtual clinical operations can be performed towards selection of optimal therapies. Digital twins are beginning to emerge in the field of medicine. We suggest that theranostic digital twins (TDTs) are amongst the most natural and feasible flavors of digitals twins. We elaborate on the importance of TDTs in a future where 'one-size-fits-all' therapeutic schemes, as prevalent nowadays, are transcended in radiopharmaceutical therapies (RPTs). Personalized RPTs will be deployed, including optimized intervention parameters. Examples include optimization of injected radioactivities, sites of injection, injection intervals and profiles, and combination therapies. Multi-modal multi-scale images, combined with other data and aided by artificial intelligence (AI) techniques, will be utilized towards routine digital twinning of our patients, and will enable improved deliveries of RPTs and overall healthcare.
Collapse
Affiliation(s)
- Arman Rahmim
- Department of Radiology, University of British Columbia, Vancouver, BC, Canada,Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada,School of Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada,*Correspondence: Arman Rahmim,
| | - Julia Brosch-Lenz
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Ali Fele-Paranj
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada,School of Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada
| | - Fereshteh Yousefirizi
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada
| | - Madjid Soltani
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada,Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada
| | - Carlos Uribe
- Department of Radiology, University of British Columbia, Vancouver, BC, Canada,Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada,Department of Functional Imaging, BC Cancer, Vancouver, BC, Canada
| | - Babak Saboury
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, Canada,Department of Radiology and Imaging Sciences, Clinical Center, National Institutes of Health, Bethesda, MD, United States
| |
Collapse
|
32
|
Taneja K, He X, He Q, Zhao X, Lin YA, Loh KJ, Chen JS. A Feature-Encoded Physics-Informed Parameter Identification Neural Network for Musculoskeletal Systems. J Biomech Eng 2022; 144:121006. [PMID: 35972808 PMCID: PMC9632475 DOI: 10.1115/1.4055238] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Revised: 08/05/2022] [Indexed: 11/08/2022]
Abstract
Identification of muscle-tendon force generation properties and muscle activities from physiological measurements, e.g., motion data and raw surface electromyography (sEMG), offers opportunities to construct a subject-specific musculoskeletal (MSK) digital twin system for health condition assessment and motion prediction. While machine learning approaches with capabilities in extracting complex features and patterns from a large amount of data have been applied to motion prediction given sEMG signals, the learned data-driven mapping is black-box and may not satisfy the underlying physics and has reduced generality. In this work, we propose a feature-encoded physics-informed parameter identification neural network (FEPI-PINN) for simultaneous prediction of motion and parameter identification of human MSK systems. In this approach, features of high-dimensional noisy sEMG signals are projected onto a low-dimensional noise-filtered embedding space for the enhancement of forwarding dynamics prediction. This FEPI-PINN model can be trained to relate sEMG signals to joint motion and simultaneously identify key MSK parameters. The numerical examples demonstrate that the proposed framework can effectively identify subject-specific muscle parameters and the trained physics-informed forward-dynamics surrogate yields accurate motion predictions of elbow flexion-extension motion that are in good agreement with the measured joint motion data.
Collapse
Affiliation(s)
- Karan Taneja
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| | - Xiaolong He
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| | - QiZhi He
- Department of Civil, Environmental, and Geo-Engineering, University of Minnesota, Minneapolis, MN 55455
| | - Xinlun Zhao
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| | - Yun-An Lin
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| | - Kenneth J. Loh
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| | - Jiun-Shyan Chen
- Department of Structural Engineering, University of California San Diego, La Jolla, CA 92093
| |
Collapse
|
33
|
Toward predictive engineering of gene circuits. Trends Biotechnol 2022; 41:760-768. [PMID: 36435671 DOI: 10.1016/j.tibtech.2022.11.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/26/2022] [Accepted: 11/02/2022] [Indexed: 11/25/2022]
Abstract
Many synthetic biology applications rely on programming living cells using gene circuits - the assembly and wiring of genetic elements to control cellular behaviors. Extensive progress has been made in constructing gene circuits with diverse functions and applications. For many circuit functions, however, it remains challenging to ensure that the circuits operate in a predictable manner. Although the notion of predictability may appear intuitive, close inspection suggests that it is not always clear what constitutes predictability. We dissect this concept and how it can be confounded by the complexity of a circuit, the complexity of the context, and the interplay between the two. We discuss circuit engineering strategies, in both computation and experiment, that have been used to improve the predictability of gene circuits.
Collapse
|
34
|
Moya C, Lin G. DAE-PINN: a physics-informed neural network model for simulating differential algebraic equations with application to power networks. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07886-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
35
|
Linden NJ, Kramer B, Rangamani P. Bayesian parameter estimation for dynamical models in systems biology. PLoS Comput Biol 2022; 18:e1010651. [PMID: 36269772 PMCID: PMC9629650 DOI: 10.1371/journal.pcbi.1010651] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 11/02/2022] [Accepted: 10/12/2022] [Indexed: 11/07/2022] Open
Abstract
Dynamical systems modeling, particularly via systems of ordinary differential equations, has been used to effectively capture the temporal behavior of different biochemical components in signal transduction networks. Despite the recent advances in experimental measurements, including sensor development and '-omics' studies that have helped populate protein-protein interaction networks in great detail, modeling in systems biology lacks systematic methods to estimate kinetic parameters and quantify associated uncertainties. This is because of multiple reasons, including sparse and noisy experimental measurements, lack of detailed molecular mechanisms underlying the reactions, and missing biochemical interactions. Additionally, the inherent nonlinearities with respect to the states and parameters associated with the system of differential equations further compound the challenges of parameter estimation. In this study, we propose a comprehensive framework for Bayesian parameter estimation and complete quantification of the effects of uncertainties in the data and models. We apply these methods to a series of signaling models of increasing mathematical complexity. Systematic analysis of these dynamical systems showed that parameter estimation depends on data sparsity, noise level, and model structure, including the existence of multiple steady states. These results highlight how focused uncertainty quantification can enrich systems biology modeling and enable additional quantitative analyses for parameter estimation.
Collapse
Affiliation(s)
- Nathaniel J. Linden
- Department of Mechanical and Aerospace Engineering, University of California San Diego, San Diego, California, United States of America
| | - Boris Kramer
- Department of Mechanical and Aerospace Engineering, University of California San Diego, San Diego, California, United States of America
| | - Padmini Rangamani
- Department of Mechanical and Aerospace Engineering, University of California San Diego, San Diego, California, United States of America
| |
Collapse
|
36
|
Yeo HC, Selvarajoo K. Machine learning alternative to systems biology should not solely depend on data. Brief Bioinform 2022; 23:6731718. [PMID: 36184188 PMCID: PMC9677488 DOI: 10.1093/bib/bbac436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 08/24/2022] [Accepted: 09/09/2022] [Indexed: 12/14/2022] Open
Abstract
In recent years, artificial intelligence (AI)/machine learning has emerged as a plausible alternative to systems biology for the elucidation of biological phenomena and in attaining specified design objective in synthetic biology. Although considered highly disruptive with numerous notable successes so far, we seek to bring attention to both the fundamental and practical pitfalls of their usage, especially in illuminating emergent behaviors from chaotic or stochastic systems in biology. Without deliberating on their suitability and the required data qualities and pre-processing approaches beforehand, the research and development community could experience similar 'AI winters' that had plagued other fields. Instead, we anticipate the integration or combination of the two approaches, where appropriate, moving forward.
Collapse
Affiliation(s)
- Hock Chuan Yeo
- Bioinformatics Institute (BII), Agency for Science, Technology and Research (A*STAR), Singapore
| | | |
Collapse
|
37
|
Investigating molecular transport in the human brain from MRI with physics-informed neural networks. Sci Rep 2022; 12:15475. [PMID: 36104360 PMCID: PMC9474534 DOI: 10.1038/s41598-022-19157-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Accepted: 08/24/2022] [Indexed: 11/23/2022] Open
Abstract
In recent years, a plethora of methods combining neural networks and partial differential equations have been developed. A widely known example are physics-informed neural networks, which solve problems involving partial differential equations by training a neural network. We apply physics-informed neural networks and the finite element method to estimate the diffusion coefficient governing the long term spread of molecules in the human brain from magnetic resonance images. Synthetic testcases are created to demonstrate that the standard formulation of the physics-informed neural network faces challenges with noisy measurements in our application. Our numerical results demonstrate that the residual of the partial differential equation after training needs to be small for accurate parameter recovery. To achieve this, we tune the weights and the norms used in the loss function and use residual based adaptive refinement of training points. We find that the diffusion coefficient estimated from magnetic resonance images with physics-informed neural networks becomes consistent with results from a finite element based approach when the residuum after training becomes small. The observations presented here are an important first step towards solving inverse problems on cohorts of patients in a semi-automated fashion with physics-informed neural networks.
Collapse
|
38
|
Sundaram A, Abdel-Khalik HS, Abdo MG. Preventing Reverse Engineering of Critical Industrial Data with DIOD. NUCL TECHNOL 2022. [DOI: 10.1080/00295450.2022.2102848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Affiliation(s)
- Arvind Sundaram
- Purdue University, 205 Gates Road, West Lafayette, Indiana 47906
| | | | - Mohammad G. Abdo
- Idaho National Laboratory, 1955 N. Fremont Road, Idaho Falls, Idaho 83415
| |
Collapse
|
39
|
Process Model Inversion in the Data-Driven Engineering Context for Improved Parameter Sensitivities. Processes (Basel) 2022. [DOI: 10.3390/pr10091764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Industry 4.0 has embraced process models in recent years, and the use of model-based digital twins has become even more critical in process systems engineering, monitoring, and control. However, the reliability of these models depends on the model parameters available. The accuracy of the estimated parameters is, in turn, determined by the amount and quality of the measurement data and the algorithm used for parameter identification. For the definition of the parameter identification problem, the ordinary least squares framework is still state-of-the-art in the literature, and better parameter estimates are only possible with additional data. In this work, we present an alternative strategy to identify model parameters by incorporating differential flatness for model inversion and neural ordinary differential equations for surrogate modeling. The novel concept results in an input-least-squares-based parameter identification problem with significant parameter sensitivity changes. To study these sensitivity effects, we use a classic one-dimensional diffusion-type problem, i.e., an omnipresent equation in process systems engineering and transport phenomena. As shown, the proposed concept ensures higher parameter sensitivities for two relevant scenarios. Based on the results derived, we also discuss general implications for data-driven engineering concepts used to identify process model parameters in the recent literature.
Collapse
|
40
|
Malingen SA, Rangamani P. Modelling membrane curvature generation using mechanics and machine learning. J R Soc Interface 2022; 19:20220448. [PMID: 36128706 PMCID: PMC9490339 DOI: 10.1098/rsif.2022.0448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Accepted: 08/24/2022] [Indexed: 11/12/2022] Open
Abstract
The deformation of cellular membranes regulates trafficking processes, such as exocytosis and endocytosis. Classically, the Helfrich continuum model is used to characterize the forces and mechanical parameters that cells tune to accomplish membrane shape changes. While this classical model effectively captures curvature generation, one of the core challenges in using it to approximate a biological process is selecting a set of mechanical parameters (including bending modulus and membrane tension) from a large set of reasonable values. We used the Helfrich model to generate a large synthetic dataset from a random sampling of realistic mechanical parameters and used this dataset to train machine-learning models. These models produced promising results, accurately classifying model behaviour and predicting membrane shape from mechanical parameters. We also note emerging methods in machine learning that can leverage the physical insight of the Helfrich model to improve performance and draw greater insight into how cells control membrane shape change.
Collapse
Affiliation(s)
- S. A. Malingen
- Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, CA 92093, USA
| | - P. Rangamani
- Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, CA 92093, USA
| |
Collapse
|
41
|
Physics-informed deep learning: A promising technique for system reliability assessment. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109217] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
42
|
Bhouri MA, Perdikaris P. Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2022; 380:20210201. [PMID: 35719075 DOI: 10.1098/rsta.2021.0201] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 11/11/2021] [Indexed: 06/15/2023]
Abstract
We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator-prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue 'Data-driven prediction in dynamical systems'.
Collapse
Affiliation(s)
- Mohamed Aziz Bhouri
- Department of Mechanical Engineering, and Applied Mechanics, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Paris Perdikaris
- Department of Mechanical Engineering, and Applied Mechanics, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
43
|
Promoting Sustainability through Next-Generation Biologics Drug Development. SUSTAINABILITY 2022. [DOI: 10.3390/su14084401] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The fourth industrial revolution in 2011 aimed to transform the traditional manufacturing processes. As part of this revolution, disruptive innovations in drug development and data science approaches have the potential to optimize CMC (chemistry, manufacture, and control). The real-time simulation of processes using “digital twins” can maximize efficiency while improving sustainability. As part of this review, we investigate how the World Health Organization’s 17 sustainability goals can apply toward next-generation drug development. We analyze the state-of-the-art laboratory leadership, inclusive personnel recruiting, the latest therapy approaches, and intelligent process automation. We also outline how modern data science techniques and machine tools for CMC help to shorten drug development time, reduce failure rates, and minimize resource usage. Finally, we systematically analyze and compare existing approaches to our experiences with the high-throughput laboratory KIWI-biolab at the TU Berlin. We describe a sustainable business model that accelerates scientific innovations and supports global action toward a sustainable future.
Collapse
|
44
|
Maddu S, Sturm D, Müller CL, Sbalzarini IF. Inverse Dirichlet weighting enables reliable training of physics informed neural networks. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2022. [DOI: 10.1088/2632-2153/ac3712] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Abstract
We characterize and remedy a failure mode that may arise from multi-scale dynamics with scale imbalances during training of deep neural networks, such as physics informed neural networks (PINNs). PINNs are popular machine-learning templates that allow for seamless integration of physical equation models with data. Their training amounts to solving an optimization problem over a weighted sum of data-fidelity and equation-fidelity objectives. Conflicts between objectives can arise from scale imbalances, heteroscedasticity in the data, stiffness of the physical equation, or from catastrophic interference during sequential training. We explain the training pathology arising from this and propose a simple yet effective inverse Dirichlet weighting strategy to alleviate the issue. We compare with Sobolev training of neural networks, providing the baseline of analytically ε-optimal training. We demonstrate the effectiveness of inverse Dirichlet weighting in various applications, including a multi-scale model of active turbulence, where we show orders of magnitude improvement in accuracy and convergence over conventional PINN training. For inverse modeling using sequential training, we find that inverse Dirichlet weighting protects a PINN against catastrophic forgetting.
Collapse
|
45
|
Herrero Martin C, Oved A, Chowdhury RA, Ullmann E, Peters NS, Bharath AA, Varela M. EP-PINNs: Cardiac Electrophysiology Characterisation Using Physics-Informed Neural Networks. Front Cardiovasc Med 2022; 8:768419. [PMID: 35187101 PMCID: PMC8850959 DOI: 10.3389/fcvm.2021.768419] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 12/22/2021] [Indexed: 11/13/2022] Open
Abstract
Accurately inferring underlying electrophysiological (EP) tissue properties from action potential recordings is expected to be clinically useful in the diagnosis and treatment of arrhythmias such as atrial fibrillation. It is, however, notoriously difficult to perform. We present EP-PINNs (Physics Informed Neural Networks), a novel tool for accurate action potential simulation and EP parameter estimation from sparse amounts of EP data. We demonstrate, using 1D and 2D in silico data, how EP-PINNs are able to reconstruct the spatio-temporal evolution of action potentials, whilst predicting parameters related to action potential duration (APD), excitability and diffusion coefficients. EP-PINNs are additionally able to identify heterogeneities in EP properties, making them potentially useful for the detection of fibrosis and other localised pathology linked to arrhythmias. Finally, we show EP-PINNs effectiveness on biological in vitro preparations, by characterising the effect of anti-arrhythmic drugs on APD using optical mapping data. EP-PINNs are a promising clinical tool for the characterisation and potential treatment guidance of arrhythmias.
Collapse
Affiliation(s)
- Clara Herrero Martin
- Department of Bioengineering, Imperial College London, London, United Kingdom
- ITACA Institute, Universitat Politècnica de València, Valencia, Spain
| | - Alon Oved
- Department of Computing, Imperial College London, London, United Kingdom
| | - Rasheda A. Chowdhury
- National Heart and Lung Institute, Imperial College London, London, United Kingdom
| | - Elisabeth Ullmann
- Department of Mathematics, Technical University of Munich, Munich, Germany
| | - Nicholas S. Peters
- National Heart and Lung Institute, Imperial College London, London, United Kingdom
| | - Anil A. Bharath
- Department of Bioengineering, Imperial College London, London, United Kingdom
| | - Marta Varela
- National Heart and Lung Institute, Imperial College London, London, United Kingdom
| |
Collapse
|
46
|
Cheng L, Qiu Y, Schmidt BJ, Wei GW. Review of applications and challenges of quantitative systems pharmacology modeling and machine learning for heart failure. J Pharmacokinet Pharmacodyn 2022; 49:39-50. [PMID: 34637069 PMCID: PMC8837528 DOI: 10.1007/s10928-021-09785-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Accepted: 09/22/2021] [Indexed: 12/24/2022]
Abstract
Quantitative systems pharmacology (QSP) is an important approach in pharmaceutical research and development that facilitates in silico generation of quantitative mechanistic hypotheses and enables in silico trials. As demonstrated by applications from numerous industry groups and interest from regulatory authorities, QSP is becoming an increasingly critical component in clinical drug development. With rapidly evolving computational tools and methods, QSP modeling has achieved important progress in pharmaceutical research and development, including for heart failure (HF). However, various challenges exist in the QSP modeling and clinical characterization of HF. Machine/deep learning (ML/DL) methods have had success in a wide variety of fields and disciplines. They provide data-driven approaches in HF diagnosis and modeling, and offer a novel strategy to inform QSP model development and calibration. The combination of ML/DL and QSP modeling becomes an emergent direction in the understanding of HF and clinical development new therapies. In this work, we review the current status and achievement in QSP and ML/DL for HF, and discuss remaining challenges and future perspectives in the field.
Collapse
Affiliation(s)
- Limei Cheng
- Quantitative Systems Pharmacology and Physiologically Based Pharmacokinetics, Bristol Myers Squibb, Princeton, NJ, 08536, USA.
| | - Yuchi Qiu
- Department of Mathematics, Michigan State University, East Lansing, MI, 48824, USA
| | - Brian J Schmidt
- Quantitative Systems Pharmacology and Physiologically Based Pharmacokinetics, Bristol Myers Squibb, Princeton, NJ, 08536, USA
| | - Guo-Wei Wei
- Department of Mathematics, Michigan State University, East Lansing, MI, 48824, USA
- Department of Electrical and Computer Engineering, Michigan State University, East Lansing, MI, 48824, USA
- Department of Biochemistry and Molecular Biology, Michigan State University, East Lansing, MI, 48824, USA
| |
Collapse
|
47
|
Zhang Z, Zhang P, Han C, Cong G, Yang CC, Deng Y. Online Machine Learning for Accelerating Molecular Dynamics Modeling of Cells. Front Mol Biosci 2022; 8:812248. [PMID: 35155570 PMCID: PMC8830520 DOI: 10.3389/fmolb.2021.812248] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 12/10/2021] [Indexed: 11/28/2022] Open
Abstract
We developed a biomechanics-informed online learning framework to learn the dynamics with ground truth generated with multiscale modeling simulation. It was built on Summit-like supercomputers, which were also used to benchmark and validate our framework on one physiologically significant modeling of deformable biological cells. We generalized the century-old equation of Jeffery orbits to a new equation of motion with additional parameters to account for the flow conditions and the cell deformability. Using simulation data at particle-based resolutions for flowing cells and the learned parameters from our framework, we validated the new equation by the motions, mostly rotations, of a human platelet in shear blood flow at various shear stresses and platelet deformability. Our online framework, which surrogates redundant computations in the conventional multiscale modeling by solutions of our learned equation, accelerates the conventional modeling by three orders of magnitude without visible loss of accuracy.
Collapse
Affiliation(s)
- Ziji Zhang
- Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United States
| | - Peng Zhang
- Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United States
| | - Changnian Han
- Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United States
| | - Guojing Cong
- Oak Ridge National Laboratory, Oak Ridge, TN, United States
| | - Chih-Chieh Yang
- IBM Thomas J. Watson Research Center, Yorktown Heights, NY, United States
| | - Yuefan Deng
- Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United States
- Mathematics, Division of Science, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
48
|
Androulakis IP. Teaching computational systems biology with an eye on quantitative systems pharmacology at the undergraduate level: Why do it, who would take it, and what should we teach? FRONTIERS IN SYSTEMS BIOLOGY 2022; 2:1044281. [PMID: 36866242 PMCID: PMC9977321 DOI: 10.3389/fsysb.2022.1044281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Computational systems biology (CSB) is a field that emerged primarily as the product of research activities. As such, it grew in several directions in a distributed and uncoordinated manner making the area appealing and fascinating. The idea of not having to follow a specific path but instead creating one fueled innovation. As the field matured, several interdisciplinary graduate programs emerged attempting to educate future generations of computational systems biologists. These educational initiatives coordinated the dissemination of information across student populations that had already decided to specialize in this field. However, we are now entering an era where CSB, having established itself as a valuable research discipline, is attempting the next major step: Entering undergraduate curricula. As interesting as this endeavor may sound, it has several difficulties, mainly because the field is not uniformly defined. In this manuscript, we argue that this diversity is a significant advantage and that several incarnations of an undergraduate-level CSB biology course could, and should, be developed tailored to programmatic needs. In this manuscript, we share our experiences creating a course as part of a Biomedical Engineering program.
Collapse
Affiliation(s)
- Ioannis P Androulakis
- Biomedical Engineering Department, New Brunswick, NJ, United States.,Chemical and Biochemical Engineering Department, Rutgers University, New Brunswick, NJ, United States
| |
Collapse
|
49
|
Sager S, Bernhardt F, Kehrle F, Merkert M, Potschka A, Meder B, Katus H, Scholz E. Expert-enhanced machine learning for cardiac arrhythmia classification. PLoS One 2021; 16:e0261571. [PMID: 34941897 PMCID: PMC8699667 DOI: 10.1371/journal.pone.0261571] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 12/05/2021] [Indexed: 12/12/2022] Open
Abstract
We propose a new method for the classification task of distinguishing atrial fibrillation (AFib) from regular atrial tachycardias including atrial flutter (AFlu) based on a surface electrocardiogram (ECG). Recently, many approaches for an automatic classification of cardiac arrhythmia were proposed and to our knowledge none of them can distinguish between these two. We discuss reasons why deep learning may not yield satisfactory results for this task. We generate new and clinically interpretable features using mathematical optimization for subsequent use within a machine learning (ML) model. These features are generated from the same input data by solving an additional regression problem with complicated combinatorial substructures. The resultant can be seen as a novel machine learning model that incorporates expert knowledge on the pathophysiology of atrial flutter. Our approach achieves an unprecedented accuracy of 82.84% and an area under the receiver operating characteristic (ROC) curve of 0.9, which classifies as "excellent" according to the classification indicator of diagnostic tests. One additional advantage of our approach is the inherent interpretability of the classification results. Our features give insight into a possibly occurring multilevel atrioventricular blocking mechanism, which may improve treatment decisions beyond the classification itself. Our research ideally complements existing textbook cardiac arrhythmia classification methods, which cannot provide a classification for the important case of AFib↔AFlu. The main contribution is the successful use of a novel mathematical model for multilevel atrioventricular block and optimization-driven inverse simulation to enhance machine learning for classification of the arguably most difficult cases in cardiac arrhythmia. A tailored Branch-and-Bound algorithm was implemented for the domain knowledge part, while standard algorithms such as Adam could be used for training.
Collapse
Affiliation(s)
- Sebastian Sager
- Department of Mathematics, Otto-von-Guericke University, Magdeburg, Germany
- Informatics for Life, Heidelberg, Germany
| | - Felix Bernhardt
- Department of Mathematics, Otto-von-Guericke University, Magdeburg, Germany
| | - Florian Kehrle
- Informatics for Life, Heidelberg, Germany
- Department of Internal Medicine III, University Hospital Heidelberg, Heidelberg, Germany
| | - Maximilian Merkert
- Institute of Optimization, Technical University Braunschweig, Braunschweig, Germany
| | - Andreas Potschka
- Institute of Mathematics, Clausthal University of Technology, Clausthal-Zellerfeld, Germany
| | - Benjamin Meder
- Informatics for Life, Heidelberg, Germany
- Department of Internal Medicine III, University Hospital Heidelberg, Heidelberg, Germany
| | - Hugo Katus
- Informatics for Life, Heidelberg, Germany
- Department of Internal Medicine III, University Hospital Heidelberg, Heidelberg, Germany
- German Centre for Cardiovascular Research, Heidelberg, Germany
| | - Eberhard Scholz
- Informatics for Life, Heidelberg, Germany
- GRN Gesundheitszentren Rhein-Neckar gGmbH, Schwetzingen, Germany
| |
Collapse
|
50
|
Passamonti F, Corrao G, Castellani G, Mora B, Maggioni G, Gale RP, Della Porta MG. The future of research in hematology: Integration of conventional studies with real-world data and artificial intelligence. Blood Rev 2021; 54:100914. [PMID: 34996639 DOI: 10.1016/j.blre.2021.100914] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 12/13/2021] [Accepted: 12/14/2021] [Indexed: 12/26/2022]
Abstract
Most national health-care systems approve new drugs based on data of safety and efficacy from large randomized clinical trials (RCTs). Strict selection biases and study-entry criteria of subjects included in RCTs often do not reflect those of the population where a therapy is intended to be used. Compliance to treatment in RCTs also differs considerably from real world settings and the relatively small size of most RCTs make them unlikely to detect rare but important safety signals. These and other considerations may explain the gap between evidence generated in RCTs and translating conclusions to health-care policies in the real world. Real-world evidence (RWE) derived from real-world data (RWD) is receiving increasing attention from scientists, clinicians, and health-care policy decision-makers - especially when it is processed by artificial intelligence (AI). We describe the potential of using RWD and AI in Hematology to support research and health-care decisions.
Collapse
Affiliation(s)
- Francesco Passamonti
- Department of Medicine and Surgery, University of Insubria, Varese, Italy; Hematology, ASST Sette Laghi, Ospedale di Circolo, Varese, Italy.
| | - Giovanni Corrao
- Department of Statistics and Quantitative Methods, Division of Biostatistics, Epidemiology and Public Health, University of Milano-Bicocca, Milan, Italy
| | - Gastone Castellani
- Department of Experimental, Diagnostic and Specialty Medicine, University of Bologna, Bologna, Italy
| | - Barbara Mora
- Department of Medicine and Surgery, University of Insubria, Varese, Italy; Hematology, ASST Sette Laghi, Ospedale di Circolo, Varese, Italy
| | - Giulia Maggioni
- IRCCS Humanitas Clinical and Research Center, Rozzano, Italy
| | - Robert Peter Gale
- Haematology Research Centre, Department of Immunolgy and Inflammation, Imperial College London, London, UK
| | - Matteo Giovanni Della Porta
- IRCCS Humanitas Clinical and Research Center, Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| |
Collapse
|