1
|
Mowbray MR, Wu C, Rogers AW, Rio-Chanona EAD, Zhang D. A reinforcement learning-based hybrid modeling framework for bioprocess kinetics identification. Biotechnol Bioeng 2023; 120:154-168. [PMID: 36225098 PMCID: PMC10092184 DOI: 10.1002/bit.28262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 07/18/2022] [Accepted: 10/09/2022] [Indexed: 11/09/2022]
Abstract
Constructing predictive models to simulate complex bioprocess dynamics, particularly time-varying (i.e., parameters varying over time) and history-dependent (i.e., current kinetics dependent on historical culture conditions) behavior, has been a longstanding research challenge. Current advances in hybrid modeling offer a solution to this by integrating kinetic models with data-driven techniques. This article proposes a novel two-step framework: first (i) speculate and combine several possible kinetic model structures sourced from process and phenomenological knowledge, then (ii) identify the most likely kinetic model structure and its parameter values using model-free Reinforcement Learning (RL). Specifically, Step 1 collates feasible history-dependent model structures, then Step 2 uses RL to simultaneously identify the correct model structure and the time-varying parameter trajectories. To demonstrate the performance of this framework, a range of in-silico case studies were carried out. The results show that the proposed framework can efficiently construct high-fidelity models to quantify both time-varying and history-dependent kinetic behaviors while minimizing the risks of over-parametrization and over-fitting. Finally, the primary advantages of the proposed framework and its limitation were thoroughly discussed in comparison to other existing hybrid modeling and model structure identification techniques, highlighting the potential of this framework for general bioprocess modeling.
Collapse
Affiliation(s)
- Max R Mowbray
- Department of Chemical Engineering, Centre for Process Integration, University of Manchester, Manchester, UK
| | - Chufan Wu
- Department of Chemical Engineering, Centre for Process Integration, University of Manchester, Manchester, UK
| | - Alexander W Rogers
- Department of Chemical Engineering, Centre for Process Integration, University of Manchester, Manchester, UK
| | | | - Dongda Zhang
- Department of Chemical Engineering, Centre for Process Integration, University of Manchester, Manchester, UK
| |
Collapse
|
2
|
Li Z, Nees M, Bettenbrock K, Rinas U. Is energy excess the initial trigger of carbon overflow metabolism? Transcriptional network response of carbon-limited Escherichia coli to transient carbon excess. Microb Cell Fact 2022; 21:67. [PMID: 35449049 PMCID: PMC9027384 DOI: 10.1186/s12934-022-01787-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 03/26/2022] [Indexed: 12/20/2022] Open
Abstract
Background Escherichia coli adapted to carbon-limiting conditions is generally geared for energy-efficient carbon utilization. This includes also the efficient utilization of glucose, which serves as a source for cellular building blocks as well as energy. Thus, catabolic and anabolic functions are balanced under these conditions to minimize wasteful carbon utilization. Exposure to glucose excess interferes with the fine-tuned coupling of anabolism and catabolism leading to the so-called carbon overflow metabolism noticeable through acetate formation and eventually growth inhibition. Results Cellular adaptations towards sudden but timely limited carbon excess conditions were analyzed by exposing slow-growing cells in steady state glucose-limited continuous culture to a single glucose pulse. Concentrations of metabolites as well as time-dependent transcriptome alterations were analyzed and a transcriptional network analysis performed to determine the most relevant transcription and sigma factor combinations which govern these adaptations. Down-regulation of genes related to carbon catabolism is observed mainly at the level of substrate uptake and downstream of pyruvate and not in between in the glycolytic pathway. It is mainly accomplished through the reduced activity of CRP-cAMP and through an increased influence of phosphorylated ArcA. The initiated transcriptomic change is directed towards down-regulation of genes, which contribute to active movement, carbon uptake and catabolic carbon processing, in particular to down-regulation of genes which contribute to efficient energy generation. Long-term changes persisting after glucose depletion and consumption of acetete encompassed reduced expression of genes related to active cell movement and enhanced expression of genes related to acid resistance, in particular acid resistance system 2 (GABA shunt) which can be also considered as an inefficient bypass of the TCA cycle. Conclusions Our analysis revealed that the major part of the trancriptomic response towards the glucose pulse is not directed towards enhanced cell proliferation but towards protection against excessive intracellular accumulation of potentially harmful concentration of metabolites including among others energy rich compounds such as ATP. Thus, resources are mainly utilized to cope with “overfeeding” and not for growth including long-lasting changes which may compromise the cells future ability to perform optimally under carbon-limiting conditions (reduced motility and ineffective substrate utilization). Supplementary Information The online version contains supplementary material available at 10.1186/s12934-022-01787-4.
Collapse
Affiliation(s)
- Zhaopeng Li
- Helmholtz Centre for Infection Research, Inhoffenstraße 7, 38124, Brunswick, Germany.,Technical Chemistry - Life Science, Leibniz University of Hannover, Callinstr. 5, 30167, Hannover, Germany
| | - Markus Nees
- Max Planck Institute for Dynamics of Complex Technical Systems, Sandtorstrasse 1, 39106, Magdeburg, Germany
| | - Katja Bettenbrock
- Max Planck Institute for Dynamics of Complex Technical Systems, Sandtorstrasse 1, 39106, Magdeburg, Germany
| | - Ursula Rinas
- Helmholtz Centre for Infection Research, Inhoffenstraße 7, 38124, Brunswick, Germany. .,Technical Chemistry - Life Science, Leibniz University of Hannover, Callinstr. 5, 30167, Hannover, Germany.
| |
Collapse
|
3
|
Shibasaki S, Mobilia M, Mitri S. Exclusion of the fittest predicts microbial community diversity in fluctuating environments. J R Soc Interface 2021; 18:20210613. [PMID: 34610260 PMCID: PMC8492180 DOI: 10.1098/rsif.2021.0613] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 09/09/2021] [Indexed: 11/12/2022] Open
Abstract
Microorganisms live in environments that inevitably fluctuate between mild and harsh conditions. As harsh conditions may cause extinctions, the rate at which fluctuations occur can shape microbial communities and their diversity, but we still lack an intuition on how. Here, we build a mathematical model describing two microbial species living in an environment where substrate supplies randomly switch between abundant and scarce. We then vary the rate of switching as well as different properties of the interacting species, and measure the probability of the weaker species driving the stronger one extinct. We find that this probability increases with the strength of demographic noise under harsh conditions and peaks at either low, high, or intermediate switching rates depending on both species' ability to withstand the harsh environment. This complex relationship shows why finding patterns between environmental fluctuations and diversity has historically been difficult. In parameter ranges where the fittest species was most likely to be excluded, however, the beta diversity in larger communities also peaked. In sum, how environmental fluctuations affect interactions between a few species pairs predicts their effect on the beta diversity of the whole community.
Collapse
Affiliation(s)
- Shota Shibasaki
- Department of Fundamental Microbiology, University of Lausanne, Lausanne, Switzerland
| | - Mauro Mobilia
- Department of Applied Mathematics, School of Mathematics, University of Leeds, Leeds, UK
| | - Sara Mitri
- Department of Fundamental Microbiology, University of Lausanne, Lausanne, Switzerland
- Swiss Institute of Bioinformatics, Lausanne, Switzerland
| |
Collapse
|
4
|
Vasilakou E, van Loosdrecht MCM, Wahl SA. Escherichia coli metabolism under short-term repetitive substrate dynamics: adaptation and trade-offs. Microb Cell Fact 2020; 19:116. [PMID: 32471427 PMCID: PMC7260802 DOI: 10.1186/s12934-020-01379-0] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2020] [Accepted: 05/25/2020] [Indexed: 12/04/2022] Open
Abstract
Background Microbial metabolism is highly dependent on the environmental conditions. Especially, the substrate concentration, as well as oxygen availability, determine the metabolic rates. In large-scale bioreactors, microorganisms encounter dynamic conditions in substrate and oxygen availability (mixing limitations), which influence their metabolism and subsequently their physiology. Earlier, single substrate pulse experiments were not able to explain the observed physiological changes generated under large-scale industrial fermentation conditions. Results In this study we applied a repetitive feast–famine regime in an aerobic Escherichia coli culture in a time-scale of seconds. The regime was applied for several generations, allowing cells to adapt to the (repetitive) dynamic environment. The observed response was highly reproducible over the cycles, indicating that cells were indeed fully adapted to the regime. We observed an increase of the specific substrate and oxygen consumption (average) rates during the feast–famine regime, compared to a steady-state (chemostat) reference environment. The increased rates at same (average) growth rate led to a reduced biomass yield (30% lower). Interestingly, this drop was not followed by increased by-product formation, pointing to the existence of energy-spilling reactions. During the feast–famine cycle, the cells rapidly increased their uptake rate. Within 10 s after the beginning of the feeding, the substrate uptake rate was higher (4.68 μmol/gCDW/s) than reported during batch growth (3.3 μmol/gCDW/s). The high uptake led to an accumulation of several intracellular metabolites, during the feast phase, accounting for up to 34% of the carbon supplied. Although the metabolite concentrations changed rapidly, the cellular energy charge remained unaffected, suggesting well-controlled balance between ATP producing and ATP consuming reactions. Conclusions The adaptation of the physiology and metabolism of E. coli under substrate dynamics, representative for large-scale fermenters, revealed the existence of several cellular mechanisms coping with stress. Changes in the substrate uptake system, storage potential and energy-spilling processes resulted to be of great importance. These metabolic strategies consist a meaningful step to further tackle reduced microbial performance, observed under large-scale cultivations.
Collapse
Affiliation(s)
- Eleni Vasilakou
- Department of Biotechnology, Delft University of Technology, Van der Maasweg, 2629 HZ, Delft, The Netherlands.
| | - Mark C M van Loosdrecht
- Department of Biotechnology, Delft University of Technology, Van der Maasweg, 2629 HZ, Delft, The Netherlands
| | - S Aljoscha Wahl
- Department of Biotechnology, Delft University of Technology, Van der Maasweg, 2629 HZ, Delft, The Netherlands.
| |
Collapse
|
5
|
Anane E, García ÁC, Haby B, Hans S, Krausch N, Krewinkel M, Hauptmann P, Neubauer P, Cruz Bournazou MN. A model‐based framework for parallel scale‐down fed‐batch cultivations in mini‐bioreactors for accelerated phenotyping. Biotechnol Bioeng 2019; 116:2906-2918. [DOI: 10.1002/bit.27116] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Revised: 06/25/2019] [Accepted: 07/09/2019] [Indexed: 12/18/2022]
Affiliation(s)
- Emmanuel Anane
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
| | - Ángel Córcoles García
- Biologics Development: Microbial Dev'tSanofi‐Aventis Deutschland GmbH Frankfurt Germany
| | - Benjamin Haby
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
| | - Sebastian Hans
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
| | - Niels Krausch
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
| | - Manuel Krewinkel
- Biologics Development: Microbial Dev'tSanofi‐Aventis Deutschland GmbH Frankfurt Germany
| | - Peter Hauptmann
- Biologics Development: Microbial Dev'tSanofi‐Aventis Deutschland GmbH Frankfurt Germany
| | - Peter Neubauer
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
| | - Mariano Nicolas Cruz Bournazou
- Department of Bioprocess EngineeringInstitute of BiotechnologyTechnische Universität Berlin Berlin Germany
- Department of Chemistry and Applied BiosciencesETH Zurich‐Institute of Chemical and Bioengineering Zurich Switzerland
- DataHow AG Zurich Switzerland
| |
Collapse
|
6
|
|
7
|
Current state and challenges for dynamic metabolic modeling. Curr Opin Microbiol 2016; 33:97-104. [PMID: 27472025 DOI: 10.1016/j.mib.2016.07.008] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2016] [Revised: 06/28/2016] [Accepted: 07/06/2016] [Indexed: 01/06/2023]
Abstract
While the stoichiometry of metabolism is probably the best studied cellular level, the dynamics in metabolism can still not be well described, predicted and, thus, engineered. Unknowns in the metabolic flux behavior arise from kinetic interactions, especially allosteric control mechanisms. While the stoichiometry of enzymes is preserved in vitro, their activity and kinetic behavior differs from the in vivo situation. Next to this challenge, it is infeasible to test the interaction of each enzyme with each intracellular metabolite in vitro exhaustively. As a consequence, the whole interacting metabolome has to be studied in vivo to identify the relevant enzymes properties. In this review we discuss current approaches for in vivo perturbation experiments, that is, stimulus response experiments using different setups and quantitative analytical approaches, including dynamic carbon tracing. Next to reliable and informative data, advanced modeling approaches and computational tools are required to identify kinetic mechanisms and their parameters.
Collapse
|
8
|
Meier K, Carstensen F, Wessling M, Regestein L, Büchs J. Quasi-continuous fermentation in a reverse-flow diafiltration bioreactor. Biochem Eng J 2014. [DOI: 10.1016/j.bej.2014.08.021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
9
|
Park J, Wu J, Polymenis M, Han A. Microchemostat array with small-volume fraction replenishment for steady-state microbial culture. LAB ON A CHIP 2013; 13:4217-4224. [PMID: 23986263 DOI: 10.1039/c3lc50665g] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
A chemostat is a bioreactor in which microorganisms can be cultured at steady-state by controlling the rate of culture medium inflow and waste outflow, thus maintaining media composition over time. Even though many microbial studies could greatly benefit from studying microbes in steady-state conditions, high instrument cost, complexity, and large reagent consumption hamper the routine use of chemostats. Microfluidic-based chemostats (i.e. microchemostats) can operate with significantly smaller reagent consumption while providing accurate chemostatic conditions at orders of magnitude lower cost compared to conventional chemostats. Also, microchemostats have the potential to significantly increase the throughput by integrating arrays of microchemostats. We present a microchemostat array with a unique two-depth culture chamber design that enables small-volume fraction replenishment of culture medium as low as 1% per replenishment cycle in a 250 nl volume. A system having an array of 8 microchemostats on a 40 × 60 mm(2) footprint could be automatically operated in parallel by a single controller unit as a demonstration for potential high throughput microbial studies. The model organism, Saccharomyces cerevisiae, successfully reached a stable steady-state of different cell densities as a demonstration of the chemostatic functionality by programming the dilution rates. Chemostatic functionality of the system was further confirmed by quantifying the budding index as a function of dilution rate, a strong indicator of growth-dependent cell division. In addition, the small-volume fraction replenishment feature minimized the cell density fluctuation during the culture. The developed system provides a robust, low-cost, and higher throughput solution to furthering studies in microbial physiology.
Collapse
Affiliation(s)
- Jaewon Park
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX 77843, USA.
| | | | | | | |
Collapse
|