Combining model structure identification and hybrid modelling for photo-production process predictive simulation and optimisation

Enhancing biomass conversion to bioenergy with machine learning: Gains and problems

The growing concerns about environmental sustainability and energy security, such as exhaustion of traditional fossil fuels and global carbon footprint growth have led to an increasing interest in alternative energy sources, especially bioenergy. Recently, numerous scenarios have been proposed regarding the use of bioenergy from different sources in the future energy systems. In this regard, one of the biggest challenges for scientists is managing, modeling, decision-making, and future forecasting of bioenergy systems. The development of machine learning (ML) techniques can provide new opportunities for modeling, optimizing and managing the production, consumption and environmental effects of bioenergy. However, researchers in bioenergy fields have not widely utilized the ML concepts and practices. Therefore, a comparative review of the current ML techniques used for bioenergy productions is presented in this paper. This review summarizes the common issues and difficulties existing in integrating ML with bioenergy studies, and discusses and proposes the possible solutions. Additionally, a detailed discussion of the appropriate ML application scenarios is also conducted in every sector of the entire bioenergy chain. This indicates the modernized conversion processes supported by ML techniques are imperative to accurately capture process-level subtleties, and thus improving techno-economic resilience and socio-ecological integrity of bioenergy production. All the efforts are believed to help in sustainable bioenergy production with ML technologies for the future.

Hybrid modeling in bioprocess dynamics: Structural variabilities, implementation strategies, and practical challenges

Hybrid modeling, with an appropriate blend of the mechanistic and data-driven framework, is increasingly being adopted in bioprocess modeling, model-based experimental design (digital-twin), identification of critical process parameters, and optimization. However, the development of a hybrid model from experimental data is an inherently complex workflow, involving designed experiments, selection of the data-driven process, identification of model parameters, assessment fitness, and generalization capability. Depending on the complexity of the process system and purpose, each piece of these modules can flexibly be incorporated into the puzzle. However, this extra flexibility can be a cause of concern to trace an "optimal" model structure. In this paper, the development of hybrid models in a common bioprocess system, selection of data-driven components and their mapping to states, choice of parameter identification techniques, and model quality assurance are revisited. The challenges associated with hybrid-model development, and corrective actions have also been reviewed. The review also suggests the lack of data, and code sharing in communal repositories can be a hurdle in the exploration, and expansion of those tools in a bioprocess system.

From Spatial-Temporal Multiscale Modeling to Application: Bridging the Valley of Death in Industrial Biotechnology

The Valley of Death confronts industrial biotechnology with a significant challenge to the commercialization of products. Fortunately, with the integration of computation, automation and artificial intelligence (AI) technology, the industrial biotechnology accelerates to cross the Valley of Death. The Fourth Industrial Revolution (Industry 4.0) has spurred advanced development of intelligent biomanufacturing, which has evolved the industrial structures in line with the worldwide trend. To achieve this, intelligent biomanufacturing can be structured into three main parts that comprise digitalization, modeling and intellectualization, with modeling forming a crucial link between the other two components. This paper provides an overview of mechanistic models, data-driven models and their applications in bioprocess development. We provide a detailed elaboration of the hybrid model and its applications in bioprocess engineering, including strain design, process control and optimization, as well as bioreactor scale-up. Finally, the challenges and opportunities of biomanufacturing towards Industry 4.0 are also discussed.

Big data and machine learning driven bioprocessing - Recent trends and critical analysis

Given the potential of machine learning algorithms in revolutionizing the bioengineering field, this paper examined and summarized the literature related to artificial intelligence (AI) in the bioprocessing field. Natural language processing (NLP) was employed to explore the direction of the research domain. All the papers from 2013 to 2022 with specific keywords of bioprocessing using AI were extracted from Scopus and grouped into two five-year periods of 2013-to-2017 and 2018-to-2022, where the past and recent research directions were compared. Based on this procedure, selected sample papers from recent five years were subjected to further review and analysis. The result shows that 50% of the publications in the past five-year focused on topics related to hybrid models, ANN, biopharmaceutical manufacturing, and biorefinery. The summarization and analysis of the outcome indicated that implementing AI could improve the design and process engineering strategies in bioprocessing fields.

A reinforcement learning-based hybrid modeling framework for bioprocess kinetics identification

Constructing predictive models to simulate complex bioprocess dynamics, particularly time-varying (i.e., parameters varying over time) and history-dependent (i.e., current kinetics dependent on historical culture conditions) behavior, has been a longstanding research challenge. Current advances in hybrid modeling offer a solution to this by integrating kinetic models with data-driven techniques. This article proposes a novel two-step framework: first (i) speculate and combine several possible kinetic model structures sourced from process and phenomenological knowledge, then (ii) identify the most likely kinetic model structure and its parameter values using model-free Reinforcement Learning (RL). Specifically, Step 1 collates feasible history-dependent model structures, then Step 2 uses RL to simultaneously identify the correct model structure and the time-varying parameter trajectories. To demonstrate the performance of this framework, a range of in-silico case studies were carried out. The results show that the proposed framework can efficiently construct high-fidelity models to quantify both time-varying and history-dependent kinetic behaviors while minimizing the risks of over-parametrization and over-fitting. Finally, the primary advantages of the proposed framework and its limitation were thoroughly discussed in comparison to other existing hybrid modeling and model structure identification techniques, highlighting the potential of this framework for general bioprocess modeling.

Complete Genome Sequencing Analysis of Deinococcus wulumuqiensis R12, an Extremely Radiation-Resistant Strain

Genome sequencing was performed by the PacBio RS II platform and Illumina HiSeq 4000 platform to discover the metabolic profile of the Deinococcus wulumuqiensis R12, which was isolated from radiation-contaminated soils in Xinjiang Uygur Autonomous Region of northwest China. The genome of 3.5 Mbp comprises one circular chromosome and four circular plasmids with 3679 genes and a GC content of 66.97%. A total of 41 new transcriptional factors were identified using the DeepTFactor tool. Genomic analysis revealed the presence of genes for homologous recombination repair, which suggested high recombination efficiency in R12. Three Type I and one Type II RM systems, two CRISPR arrays, and one Cas-Type IC protein were found, allowing the development of endogenous CRISPR-Cas gene-editing tools. Additionally, we found that R12 has a broad spectrum of substrate utilization, which was validated by physiological experiments. Genes involved in the carotenoid biosynthesis pathway and the antioxidative system were also identified. Overall, the comprehensive description of the genome of R12 will facilitate the additional exploitation of this strain as a versatile cell factory for biotechnological applications.

The role of machine learning to boost the bioenergy and biofuels conversion

The development and application of bioenergy and biofuels conversion technology can play a significant role for the production of renewable and sustainable energy sources in the future. However, the complexity of bioenergy systems and the limitations of human understanding make it difficult to build models based on experience or theory for accurate predictions. Recent developments in data science and machine learning (ML), can provide new opportunities. Accordingly, this critical review provides a deep insight into the application of ML in the bioenergy context. The latest advances in ML assisted bioenergy technology, including energy utilization of lignocellulosic biomass, microalgae cultivation, biofuels conversion and application, are reviewed in detail. The strengths and limitations of ML in bioenergy systems are comprehensively analysed. Moreover, we highlight the capabilities and potential of advanced ML methods when encountering multifarious tasks in the future prospects to advance a new generation of bioenergy and biofuels conversion technologies.

A transfer learning approach for predictive modeling of bioprocesses using small data

Predictive modeling of new biochemical systems with small data is a great challenge. To fill this gap, transfer learning, a subdomain of machine learning that serves to transfer knowledge from a generalized model to a more domain-specific model, provides a promising solution. While transfer learning has been used in natural language processing, image analysis, and chemical engineering fault detection, its application within biochemical engineering has not been systematically explored. In this study, we demonstrated the benefits of transfer learning when applied to predict dynamic behaviors of new biochemical processes. Two different case studies were presented to investigate the accuracy, reliability, and advantage of this innovative modeling approach. We thoroughly discussed the different transfer learning strategies and the effects of topology on transfer learning, comparing the performance of the transfer learning models against benchmark kinetic and data-driven models. Furthermore, strong connections between the underlying process mechanism and the transfer learning model's optimal structure were highlighted, suggesting the interpretability of transfer learning to enable more accurate prediction than a naive data-driven modeling approach. Therefore, this study shows a novel approach to effectively combining data from different resources for bioprocess simulation.

Kinetic and hybrid modeling for yeast astaxanthin production under uncertainty

Astaxanthin is a high-value compound commercially synthesized through Xanthophyllomyces dendrorhous fermentation. Using mixed sugars decomposed from biowastes for yeast fermentation provides a promising option to improve process sustainability. However, little effort has been made to investigate the effects of multiple sugars on X. dendrorhous biomass growth and astaxanthin production. Furthermore, the construction of a high-fidelity model is challenging due to the system's variability, also known as batch-to-batch variation. Two innovations are proposed in this study to address these challenges. First, a kinetic model was developed to compare process kinetics between the single sugar (glucose) based and the mixed sugar (glucose and sucrose) based fermentation methods. Then, the kinetic model parameters were modeled themselves as Gaussian processes, a probabilistic machine learning technique, to improve the accuracy and robustness of model predictions. We conclude that although the presence of sucrose does not affect the biomass growth kinetics, it introduces a competitive inhibitory mechanism that enhances astaxanthin accumulation by inducing adverse environmental conditions such as osmotic gradients. Moreover, the hybrid model was able to greatly reduce model simulation error and was particularly robust to uncertainty propagation. This study suggests the advantage of mixed sugar-based fermentation and provides a novel approach for bioprocess dynamic modeling.