Workflow to set up substantial target-oriented mechanistic process models in bioprocess engineering

Development and Validation of an Artificial Neural-Network-Based Optical Density Soft Sensor for a High-Throughput Fermentation System

Optical density (OD) is a critical process parameter during fermentation, this being directly related to cell density, which provides valuable information regarding the state of the process. However, to measure OD, sampling of the fermentation broth is required. This is particularly challenging for high-throughput-microbioreactor (HT-MBR) systems, which require robotic liquid-handling (LiHa) systems for process control tasks, such as pH regulation or carbon feed additions. Bioreactor volume is limited and automated at-line sampling occupies the resources of LiHa systems; this affects their ability to carry out the aforementioned pipetting operations. Minimizing the number of physical OD measurements is therefore of significant interest. However, fewer measurements also result in less process information. This resource conflict has previously represented a challenge. We present an artificial neural-network-based soft sensor developed for the real-time estimation of the OD in an MBR system. This sensor was able to estimate the OD to a high degree of accuracy (>95%), even without informative process variables stemming from, e.g., off-gas analysis only available at larger scales. Furthermore, we investigated and demonstrated scaling of the soft sensor’s generalization capabilities with the data from different antibody fragments expressing Escherichia coli strains. This study contributes to accelerated biopharmaceutical process development.

Comparison of mechanistic and hybrid modeling approaches for characterization of a CHO cultivation process: Requirements, pitfalls and solution paths

Despite the advantages of mathematical bioprocess modeling, successful model implementation already starts with experimental planning and accordingly can fail at this early stage. For this study, two different modeling approaches (mechanistic and hybrid) based on a four-dimensional antibody-producing CHO fed-batch process are compared. Overall, 33 experiments are performed in the fractional factorial four-dimensional design space and separated into four different complex data partitions subsequently used for model comparison and evaluation. The mechanistic model demonstrates the advantage of prior knowledge (i.e., known equations) to get informative value relatively independently of the utilized data partition. The hybrid approach displayes a higher data dependency but simultaneously yielded a higher accuracy on all data partitions. Furthermore, our results demonstrate that independent of the chosen modeling framework, a smart selection of only four initial experiments can already yield a very good representation of a full design space independent of the chosen modeling structure. Academic and industry researchers are recommended to pay more attention to experimental planning to maximize the process understanding obtained from mathematical modeling.

NyctiDB: A non-relational bioprocesses modeling database supported by an ontology

Strategies to exploit and enable the digitalization of industrial processes are on course to become game-changers in optimizing (bio)chemical facilities. To achieve this, these industries face an increasing need for process models and, as importantly, an efficient way to store the models and data/information. Therefore, this work proposes developing an online information storage system that can facilitate the reuse and expansion of process models and make them available to the digitalization cycle. This system is named NyctiDB, and it is a novel non-relational database coupled with a bioprocess ontology. The ontology supports the selection and classification of bioprocess models focused information, while the database is in charge of the online storage of said information. Through a series of online collections, NyctiDB contains essential knowledge for the design, monitoring, control, and optimization of a bioprocess based on its mathematical model. Once NyctiDB has been implemented, its applicability and usefulness are demonstrated through two applications. Application A shows how NyctiDB is integrated inside the software architecture of an online educational bioprocess simulator. This implies that NyctiDB provides the information for the visualization of different bioprocess behaviours and the modifications of the models in the software. Moreover, the information related to the parameters and conditions of each model is used to support the users’ understanding of the process. Additionally, application B illustrates that NyctiDB can be used as AI enabler to further the research in this field through open-source and reliable data. This can, in fact, be used as the information source for the AI frameworks when developing, for example, hybrid models or smart expert systems for bioprocesses. Henceforth, this work aims to provide a blueprint on how to collect bioprocess modeling information and connect it to facilitate and empower the Internet-of-Things paradigm and the digitalization of the biomanufacturing industries.

Generation and evaluation of input values for computational analysis of transport processes within tissue cultures

Techniques for tissue culture have seen significant advances during the last decades and novel 3D cell culture systems have become available. To control their high complexity, experimental techniques and their Digital Twins (modelling and computational tools) are combined to link different variables to process conditions and critical process parameters. This allows a rapid evaluation of the expected product quality. However, the use of mathematical simulation and Digital Twins is critically dependent on the precise description of the problem and correct input parameters. Errors here can lead to dramatically wrong conclusions. The intention of this review is to provide an overview of the state‐of‐the‐art and remaining challenges with respect to generating input values for computational analysis of mass and momentum transport processes within tissue cultures. It gives an overview on relevant aspects of transport processes in tissue cultures as well as modelling and computational tools to tackle these problems. Further focus is on techniques used for the determination of cell‐specific parameters and characterization of culture systems, including sensors for on‐line determination of relevant parameters. In conclusion, tissue culture techniques are well‐established, and modelling tools are technically mature. New sensor technologies are on the way, especially for organ chips. The greatest remaining challenge seems to be the proper addressing and handling of input parameters required for mathematical models. Following Good Modelling Practice approaches when setting up and validating computational models is, therefore, essential to get to better estimations of the interesting complex processes inside organotypic tissue cultures in the future.

Online estimation of changing metabolic capacities in continuous Corynebacterium glutamicum cultivations growing on a complex sugar mixture

Model‐based state estimators enable online monitoring of bioprocesses and, thereby, quantitative process understanding during running operations. During prolonged continuous bioprocesses strain physiology is affected by selection pressure. This can cause time‐variable metabolic capacities that lead to a considerable model‐plant mismatch reducing monitoring performance if model parameters are not adapted accordingly. Variability of metabolic capacities therefore needs to be integrated in the in silico representation of a process using model‐based monitoring approaches. To enable online monitoring of multiple concentrations as well as metabolic capacities during continuous bioprocessing of spent sulfite liquor with Corynebacterium glutamicum, this study presents a particle filtering framework that takes account of parametric variability. Physiological parameters are continuously adapted by Bayesian inference, using noninvasive off‐gas measurements. Additional information on current parameter importance is derived from time‐resolved sensitivity analysis. Experimental results show that the presented framework enables accurate online monitoring of long‐term culture dynamics, whereas state estimation without parameter adaption failed to quantify substrate metabolization and growth capacities under conditions of high selection pressure. Online estimated metabolic capacities are further deployed for multiobjective optimization to identify time‐variable optimal operating points. Thereby, the presented monitoring system forms a basis for adaptive control during continuous bioprocessing of lignocellulosic by‐product streams.

Monte Carlo-Based Error Propagation for a More Reliable Regression Analysis across Specific Rates in Bioprocesses

During process development, bioprocess data need to be converted into applicable knowledge. Therefore, it is crucial to evaluate the obtained data under the usage of transparent and reliable data reduction and correlation techniques. Within this contribution, we show a generic Monte Carlo error propagation and regression approach applied to two different, industrially relevant cultivation processes. Based on measurement uncertainties, errors for cell-specific growth, uptake, and production rates were determined across an evaluation chain, with interlinked inputs and outputs. These uncertainties were subsequently included in regression analysis to derive the covariance of the regression coefficients and the confidence bounds for prediction. The usefulness of the approach is shown within two case studies, based on the relations across biomass-specific rate control limits to guarantee high productivities in E. coli, and low lactate formation in a CHO cell fed-batch could be established. Besides the possibility to determine realistic errors on the evaluated process data, the presented approach helps to differentiate between reliable and unreliable correlations and prevents the wrong interpretations of relations based on uncertain data.

About Model Validation in Bioprocessing

In bioprocess engineering the Qualtiy by Design (QbD) initiative encourages the use of models to define design spaces. However, clear guidelines on how models for QbD are validated are still missing. In this review we provide a comprehensive overview of the validation methods, mathematical approaches, and metrics currently applied in bioprocess modeling. The methods cover analytics for data used for modeling, model training and selection, measures for predictiveness, and model uncertainties. We point out the general issues in model validation and calibration for different types of models and put this into the context of existing health authority recommendations. This review provides a starting point for developing a guide for model validation approaches. There is no one-fits-all approach, but this review should help to identify the best fitting validation method, or combination of methods, for the specific task and the type of bioprocess model that is being developed.

Digital Twins for Tissue Culture Techniques—Concepts, Expectations, and State of the Art

Techniques to provide in vitro tissue culture have undergone significant changes during the last decades, and current applications involve interactions of cells and organoids, three-dimensional cell co-cultures, and organ/body-on-chip tools. Efficient computer-aided and mathematical model-based methods are required for efficient and knowledge-driven characterization, optimization, and routine manufacturing of tissue culture systems. As an alternative to purely experimental-driven research, the usage of comprehensive mathematical models as a virtual in silico representation of the tissue culture, namely a digital twin, can be advantageous. Digital twins include the mechanistic of the biological system in the form of diverse mathematical models, which describe the interaction between tissue culture techniques and cell growth, metabolism, and the quality of the tissue. In this review, current concepts, expectations, and the state of the art of digital twins for tissue culture concepts will be highlighted. In general, DT’s can be applied along the full process chain and along the product life cycle. Due to the complexity, the focus of this review will be especially on the design, characterization, and operation of the tissue culture techniques.

Estimation of Process Model Parameters

Cell culture technology has become a substantial domain of modern biotechnology, particularly in the pharmaceutical market. Today, products manufactured from cells itself dominate the biopharmaceutical industry. In addition, a limited number of products made of in vitro cultivated cells for regenerative medicine were launched to the market. Modeling of such processes is an important task since these systems are usually nonlinear and complex. In this chapter, a framework for the estimation of process model parameters and its implementation is shown. It is aimed to support the parameter estimation task, which increases the potential of implementation and improvement of mathematical process models into the novel and existing bioprocesses. Apart from the parameter estimation, evaluation of the estimated parameters plays an essential role in order to verify these parameters and subsequently the selected model. The workflow is outlined and shown specifically on the basis of a mathematical process model describing a mammalian cell culture batch process.

Generic Workflow for the Setup of Mechanistic Process Models

Process models, consisting of transferable and applicable knowledge, can be used for various tasks such as process development and optimization, and for predicting and controlling critical process variables. In this regard, mechanistic process models, describing the mechanism of a system with a distinct model structure and characteristic parameters, are very promising.The development of a reliable and applicable model is usually the critical step, before model simulation and application show beneficial effects. In this chapter, a workflow for the generation of mechanistic process models is presented and applied on a typical cell culture process. The workflow includes the definition of critical reactions and the identification of their kinetics. By an iterative approach different reactions and kinetics are tested and model quality is assessed, leading to a final, target-oriented model.

Towards the Development of Digital Twins for the Bio-manufacturing Industry

The bio-manufacturing industry, along with other process industries, now has the opportunity to be engaged in the latest industrial revolution, also known as Industry 4.0. To successfully accomplish this, a physical-to-digital-to-physical information loop should be carefully developed. One way to achieve this is, for example, through the implementation of digital twins (DTs), which are virtual copies of the processes. Therefore, in this paper, the focus is on understanding the needs and challenges faced by the bio-manufacturing industry when dealing with this digitalized paradigm. To do so, two major building blocks of a DT, data and models, are highlighted and discussed. Hence, firstly, data and their characteristics and collection strategies are examined as well as new methods and tools for data processing. Secondly, modelling approaches and their potential of being used in DTs are reviewed. Finally, we share our vision with regard to the use of DTs in the bio-manufacturing industry aiming at bringing the DT a step closer to its full potential and realization.

Usage of Digital Twins Along a Typical Process Development Cycle

Digital methods for process design, monitoring, and control can convert classical trial-and-error bioprocess development to a quantitative engineering approach. By interconnecting hardware, software, data, and humans currently untapped process optimization potential can be accessed. The key component within such a framework is a digital twin interacting with its physical process counterpart. In this chapter, we show how digital twin guided process development can be applied on an exemplary microbial cultivation process. The usage of digital twins is described along a typical process development cycle, ranging from early strain characterization to real-time control applications. Along an illustrative case study on microbial upstream bioprocessing, we emphasize that digital twins can integrate entire process development cycles if the digital twin itself and the underlying models are continuously adapted to newly available data. Therefore, the digital twin can be regarded as a powerful knowledge management tool and a decision support system for efficient process development. Its full potential can be deployed in a real-time environment where targeted control actions can further improve process performance.

NMPC-Based Workflow for Simultaneous Process and Model Development Applied to a Fed-Batch Process for Recombinant C. glutamicum

For the fast and improved development of bioprocesses, new strategies are required where both strain and process development are performed in parallel. Here, a workflow based on a Nonlinear Model Predictive Control (NMPC) algorithm is described for the model-assisted development of biotechnological processes. By using the NMPC algorithm, the process is designed with respect to a target function (product yield, biomass concentration) with a drastically decreased number of experiments. A workflow for the usage of the NMPC algorithm as a process development tool is outlined. The NMPC algorithm is capable of improving various process states, such as product yield and biomass concentration. It uses on-line and at-line data and controls and optimizes the process by model-based process extrapolation. In this study, the algorithm is applied to a Corynebacterium glutamicum process. In conclusion, the potency of the NMPC algorithm as a powerful tool for process development is demonstrated. In particular, the benefits of the system regarding the characterization and optimization of a fed-batch process are outlined. With the NMPC algorithm, process development can be run simultaneously to strain development, resulting in a shortened time to market for novel products.

Current and future requirements to industrial analytical infrastructure-part 2: smart sensors

Complex processes meet and need Industry 4.0 capabilities. Shorter product cycles, flexible production needs, and direct assessment of product quality attributes and raw material attributes call for an increased need of new process analytical technologies (PAT) concepts. While individual PAT tools may be available since decades, we need holistic concepts to fulfill above industrial needs. In this series of two contributions, we want to present a combined view on the future of PAT (process analytical technology), which is projected in smart labs (Part 1) and smart sensors (Part 2). Part 2 of this feature article series describes the future functionality as well as the ingredients of a smart sensor aiming to eventually fuel full PAT functionality. The smart sensor consists of (i) chemical and process information in the physical twin by smart field devices, by measuring multiple components, and is fully connected in the IIoT 4.0 environment. In addition, (ii) it includes process intelligence in the digital twin, as to being able to generate knowledge from multi-sensor and multi-dimensional data. The cyber-physical system (CPS) combines both elements mentioned above and allows the smart sensor to be self-calibrating and self-optimizing. It maintains its operation autonomously. Furthermore, it allows—as central PAT enabler—a flexible but also target-oriented predictive control strategy and efficient process development and can compensate variations of the process and raw material attributes. Future cyber-physical production systems—like smart sensors—consist of the fusion of two main pillars, the physical and the digital twins. We discuss the individual elements of both pillars, such as connectivity, and chemical analytics on the one hand as well as hybrid models and knowledge workflows on the other. Finally, we discuss its integration needs in a CPS in order to allow its versatile deployment in efficient process development and advanced optimum predictive process control.

Design, Optimization, and Adaptive Control of Cell Culture Seed Trains

For the production of biopharmaceuticals, a procedure called seed train or inoculum train is required to generate an adequate number of cells for the inoculation of the production bioreactor. This seed train is time- and cost-intensive but offers potential for optimization. A method and a protocol are described for seed train mapping, directed modeling, and simulation as well as its optimization regarding selected optimization criteria such as optimal points in time for cell passaging. Furthermore, the method can also be applied for the transfer of a seed train to a different production plant or the design of a new seed train, for example, for a new cell line. Another application is to support the selection of the optimal clone for a new process. Seed train prediction can be performed for different clones, and so it can be analyzed how the seed train protocol would look like and for which clones a suitable seed train protocol could be found.Although the chapter is directed toward suspension cell lines, the method is also generally applicable, e.g., for adherent cell lines.

Digital Twins and Their Role in Model-Assisted Design of Experiments

Rising demands for biopharmaceuticals and the need to reduce manufacturing costs increase the pressure to develop productive and efficient bioprocesses. Among others, a major hurdle during process development and optimization studies is the huge experimental effort in conventional design of experiments (DoE) methods. As being an explorative approach, DoE requires extensive expert knowledge about the investigated factors and their boundary values and often leads to multiple rounds of time-consuming and costly experiments. The combination of DoE with a virtual representation of the bioprocess, called digital twin, in model-assisted DoE (mDoE) can be used as an alternative to decrease the number of experiments significantly. mDoE enables a knowledge-driven bioprocess development including the definition of a mathematical process model in the early development stages. In this chapter, digital twins and their role in mDoE are discussed. First, statistical DoE methods are introduced as the basis of mDoE. Second, the combination of a mathematical process model and DoE into mDoE is examined. This includes mathematical model structures and a selection scheme for the choice of DoE designs. Finally, the application of mDoE is discussed in a case study for the medium optimization in an antibody-producing Chinese hamster ovary cell culture process.

Monitoring and control strategies for inclusion body production in E. coli based on glycerol consumption

The Gram-negative bacterium E. coli is the host of choice for the production of a multitude of recombinant proteins in industry. Generally, cultivation is easy, media are cheap and a high product titer can be obtained. However, harsh induction procedures using IPTG as inducer are often referred to cause stress reactions, leading to a phenomenon known as metabolic burden and expression of inclusion bodies. In this contribution, we present different strategies for determination of critical timepoints for product stability in an E. coli IB bioprocess. As non-controlled feeding during induction regularly led to undesired product loss, we applied physiological feeding control. We found that the feeding strategy has indeed high impact on IB productivity. However, high applied q_s,C increased IB product titer, but subsequently stressed the cells and finally led to product degradation. Calculating the cumulated glycerol uptake of the cells during induction phase (dSn), we found an empirical value, which serves as a strong indicator for process performance and can be used as process analytical tool. We tested different approaches starting from offline control. Glycerol accumulation could be used as trigger to establish a model-based approach to predict titer and viable cell concentration for a model protein. This straight forward control and model-based approach is high beneficial for upstream development and for increasing stability.

Inclusion Body Bead Size in E. coli Controlled by Physiological Feeding

The Gram-negative bacterium E. coli is the host of choice for producing a multitude of recombinant proteins relevant in the pharmaceutical industry. Generally, cultivation is easy, media are cheap, and a high product titer can be obtained. However, harsh induction procedures combined with the usage of IPTG (isopropyl β-d-1 thiogalactopyranoside) as an inducer are often believed to cause stress reactions, leading to intracellular protein aggregates, which are so known as so-called inclusion bodies (IBs). Downstream applications in bacterial processes cause the bottleneck in overall process performance, as bacteria lack many post-translational modifications, resulting in time and cost-intensive approaches. Especially purification of inclusion bodies is notoriously known for its long processing times and low yields. In this contribution, we present screening strategies for determination of inclusion body bead size in an E. coli-based bioprocess producing exclusively inclusion bodies. Size can be seen as a critical quality attribute (CQA), as changes in inclusion body behavior have a major effect on subsequent downstream processing. A model-based approach was used, aiming to trigger a distinct inclusion body size: Physiological feeding control, using q_s,C as a critical process parameter, has a high impact on inclusion body size and could be modelled using a hyperbolic saturation mechanism calculated in form of a cumulated substrate uptake rate. Within this model, the sugar uptake rate of the cells, in the form of the cumulated sugar uptake-value, was simulated and considered being a key performance indicator for determination of the desired size. We want to highlight that the usage of the mentioned screening strategy in combination with a model-based approach will allow tuning of the process towards a certain inclusion body size using a q_s based control only. Optimized inclusion body size at the time-point of harvest should stabilize downstream processing and, therefore, increase the overall time-space yield. Furthermore, production of distinct inclusion body size may be interesting for application as a biocatalyst and nanoparticulate material.

Model-Based Methods in the Biopharmaceutical Process Lifecycle

Model-based methods are increasingly used in all areas of biopharmaceutical process technology. They can be applied in the field of experimental design, process characterization, process design, monitoring and control. Benefits of these methods are lower experimental effort, process transparency, clear rationality behind decisions and increased process robustness. The possibility of applying methods adopted from different scientific domains accelerates this trend further. In addition, model-based methods can help to implement regulatory requirements as suggested by recent Quality by Design and validation initiatives. The aim of this review is to give an overview of the state of the art of model-based methods, their applications, further challenges and possible solutions in the biopharmaceutical process life cycle. Today, despite these advantages, the potential of model-based methods is still not fully exhausted in bioprocess technology. This is due to a lack of (i) acceptance of the users, (ii) user-friendly tools provided by existing methods, (iii) implementation in existing process control systems and (iv) clear workflows to set up specific process models. We propose that model-based methods be applied throughout the lifecycle of a biopharmaceutical process, starting with the set-up of a process model, which is used for monitoring and control of process parameters, and ending with continuous and iterative process improvement via data mining techniques.