Validation Is Not Verification: Precise Terminology and Scientific Methods in Bioprocess Modeling

Physics-informed neural networks for biopharmaceutical cultivation processes: Consideration of varying process parameter settings

We present a new modeling approach for the study and prediction of important process outcomes of biotechnological cultivation processes under the influence of process parameter variations. Our model is based on physics-informed neural networks (PINNs) in combination with kinetic growth equations. Using Taylor series, multivariate external process parameter variations for important variables such as temperature, seeding cell density and feeding rates can be integrated into the corresponding kinetic rates and the governing growth equations. In addition to previous approaches, PINNs also allow continuous and differentiable functions as predictions for the process outcomes. Accordingly, our results show that PINNs in combination with Taylor-series expansions for kinetic growth equations provide a very high prediction accuracy for important process variables such as cell densities and concentrations as well as a detailed study of individual and combined parameter influences. Furthermore, the proposed approach can also be used to evaluate the outcomes of new parameter variations and combinations, which enables a saving of experiments in combination with a model-driven optimization study of the design space.

Artificial intelligence and machine learning applications in biopharmaceutical manufacturing

Artificial intelligence and machine learning (AI-ML) offer vast potential in optimal design, monitoring, and control of biopharmaceutical manufacturing. The driving forces for adoption of AI-ML techniques include the growing global demand for biotherapeutics and the shift toward Industry 4.0, spurring the rise of integrated process platforms and continuous processes that require intelligent, automated supervision. This review summarizes AI-ML applications in biopharmaceutical manufacturing, with a focus on the most used AI-ML algorithms, including multivariate data analysis, artificial neural networks, and reinforcement learning. Perspectives on the future growth of AI-ML applications in the area and the challenges of implementing these techniques at manufacturing scale are also presented.

Promoting Sustainability through Next-Generation Biologics Drug Development

The fourth industrial revolution in 2011 aimed to transform the traditional manufacturing processes. As part of this revolution, disruptive innovations in drug development and data science approaches have the potential to optimize CMC (chemistry, manufacture, and control). The real-time simulation of processes using “digital twins” can maximize efficiency while improving sustainability. As part of this review, we investigate how the World Health Organization’s 17 sustainability goals can apply toward next-generation drug development. We analyze the state-of-the-art laboratory leadership, inclusive personnel recruiting, the latest therapy approaches, and intelligent process automation. We also outline how modern data science techniques and machine tools for CMC help to shorten drug development time, reduce failure rates, and minimize resource usage. Finally, we systematically analyze and compare existing approaches to our experiences with the high-throughput laboratory KIWI-biolab at the TU Berlin. We describe a sustainable business model that accelerates scientific innovations and supports global action toward a sustainable future.

Holistic Process Models: A Bayesian Predictive Ensemble Method for Single and Coupled Unit Operation Models

The coupling of individual models in terms of end-to-end calculations for unit operations in manufacturing processes is a challenging task. We present a probability distribution-based approach for the combined outcomes of parametric and non-parametric models. With this so-called Bayesian predictive ensemble, the statistical moments such as mean value and standard deviation can be accurately computed without any further approximation. It is shown that the ensemble of different model predictions leads to an uninformed prior distribution, which can be transformed into a predictive posterior distribution using Bayesian inference and numerical Markov Chain Monte Carlo calculations. We demonstrate the advantages of our method using several numerical examples. Our approach is not restricted to certain unit operations, and can also be used for the more robust interpretation and assessment of model predictions in general.

About Model Validation in Bioprocessing

In bioprocess engineering the Qualtiy by Design (QbD) initiative encourages the use of models to define design spaces. However, clear guidelines on how models for QbD are validated are still missing. In this review we provide a comprehensive overview of the validation methods, mathematical approaches, and metrics currently applied in bioprocess modeling. The methods cover analytics for data used for modeling, model training and selection, measures for predictiveness, and model uncertainties. We point out the general issues in model validation and calibration for different types of models and put this into the context of existing health authority recommendations. This review provides a starting point for developing a guide for model validation approaches. There is no one-fits-all approach, but this review should help to identify the best fitting validation method, or combination of methods, for the specific task and the type of bioprocess model that is being developed.