About Model Validation in Bioprocessing

Modeling multi-component separation in hydrophobic interaction chromatography with improved parameter-by-parameter estimation method

Mechanistic models are powerful tools for chromatographic process development and optimization. However, hydrophobic interaction chromatography (HIC) mechanistic models lack an effective and logical parameter estimation method, especially for multi-component system. In this study, a parameter-by-parameter method for multi-component system (called as mPbP-HIC) was derived based on the retention mechanism to estimate the six parameters of the Mollerup isotherm for HIC. The linear parameters (ks,i and keq,i) and nonlinear parameters (ni and qmax,i) of the isotherm can be estimated by the linear regression (LR) and the linear approximation (LA) steps, respectively. The remaining two parameters (kp,i and kkin,i) are obtained by the inverse method (IM). The proposed method was verified with a two-component model system. The results showed that the model could accurately predict the protein elution at a loading of 10 g/L. However, the elution curve fitting was unsatisfactory for high loadings (12 g/L and 14 g/L), which is mainly attributed to the demanding experimental conditions of the LA step and the potential large estimation error of the parameter qmax. Therefore, the inverse method was introduced to further calibrate the parameter qmax, thereby reducing the estimation error and improving the curve fitting. Moreover, the simplified linear approximation (SLA) was proposed by reasonable assumption, which provides the initial guess of qmax without solving any complex matrix and avoids the problem of matrix unsolvable. In the improved mPbP-HIC method, qmax would be initialized by the SLA and finally determined by the inverse method, and this strategy was named as SLA+IM. The experimental validation showed that the improved mPbP-HIC method has a better curve fitting, and the use of SLA+IM reduces the error accumulation effect. In process optimization, the parameters estimated by the improved mPbP-HIC method provided the model with excellent predictive ability and reasonable extrapolation. In conclusion, the SLA+IM strategy makes the improved mPbP-HIC method more rational and can be easily applied to the practical separation of protein mixture, which would accelerate the process development for HIC in downstream of biopharmaceuticals.

Building blocks needed for mechanistic modeling of bioprocesses: A critical review based on protein production by CHO cells

This paper reviews the key building blocks needed to develop a mechanistic model for use as an operational production tool. The Chinese Hamster Ovary (CHO) cell, one of the most widely used hosts for antibody production in the pharmaceutical industry, is considered as a case study. CHO cell metabolism is characterized by two main phases, exponential growth followed by a stationary phase with strong protein production. This process presents an appropriate degree of complexity to outline the modeling strategy. The paper is organized into four main steps: (1) CHO systems and data collection; (2) metabolic analysis; (3) formulation of the mathematical model; and finally, (4) numerical solution, calibration, and validation. The overall approach can build a predictive model of target variables. According to the literature, one of the main current modeling challenges lies in understanding and predicting the spontaneous metabolic shift. Possible candidates for the trigger of the metabolic shift include the concentration of lactate and carbon dioxide. In our opinion, ammonium, which is also an inhibiting product, should be further investigated. Finally, the expected progress in the emerging field of hybrid modeling, which combines the best of mechanistic modeling and machine learning, is presented as a fascinating breakthrough. Note that the modeling strategy discussed here is a general framework that can be applied to any bioprocess.

From big data to big insights: statistical and bioinformatic approaches for exploring the lipidome

The goal of lipidomic studies is to provide a broad characterization of cellular lipids present and changing in a sample of interest. Recent lipidomic research has significantly contributed to revealing the multifaceted roles that lipids play in fundamental cellular processes, including signaling, energy storage, and structural support. Furthermore, these findings have shed light on how lipids dynamically respond to various perturbations. Continued advancement in analytical techniques has also led to improved abilities to detect and identify novel lipid species, resulting in increasingly large datasets. Statistical analysis of these datasets can be challenging not only because of their vast size, but also because of the highly correlated data structure that exists due to many lipids belonging to the same metabolic or regulatory pathways. Interpretation of these lipidomic datasets is also hindered by a lack of current biological knowledge for the individual lipids. These limitations can therefore make lipidomic data analysis a daunting task. To address these difficulties and shed light on opportunities and also weaknesses in current tools, we have assembled this review. Here, we illustrate common statistical approaches for finding patterns in lipidomic datasets, including univariate hypothesis testing, unsupervised clustering, supervised classification modeling, and deep learning approaches. We then describe various bioinformatic tools often used to biologically contextualize results of interest. Overall, this review provides a framework for guiding lipidomic data analysis to promote a greater assessment of lipidomic results, while understanding potential advantages and weaknesses along the way.

Habitat suitability of Opuntia ficus-indica (L.) MILL. (CACTACEAE): a comparative temporal evaluation using diverse bio-climatic earth system models and ensemble machine learning approach

A comprehensive evaluation of the habitat suitability across the India was conducted for the introduced species Opuntia ficus-indica. This assessment utilized a newly developed model called BioClimInd, takes into account five Earth System Models (ESMs). These ESMs consider two different emission scenarios known as Representative Concentration Pathways (RCP), specifically RCP 4.5 and RCP 8.5. Additionally, the assessment considered two future time frames: 2040-2079 (60) and 2060-2099 (80). Current study provided the threshold limit of different climatic variables in annual, quarter and monthly time slots like temperature annual range (26-30 °C), mean temperature of the driest quarter (25-28 °C); mean temperature of the coldest month (22-25 °C); minimum temperature of coldest month (13-17 °C); precipitation of the wettest month (250-500 mm); potential evapotranspiration Thronthwaite (1740-1800 mm). Predictive climatic habitat suitability posits that the introduction of this exotic species is deemed unsuitable in the Northern as well as the entirety of the cooler eastern areas of the country. The states of Rajasthan and Gujarat exhibit the highest degree of habitat suitability for this particular species. Niche hypervolumes and climatic variables affecting fundamental and realized niches were also assessed. This study proposes using multi-climatic exploration to evaluate habitats for introduced species to reduce modeling uncertainties.

Empirical methods for the validation of time-to-event mathematical models taking into account uncertainty and variability: application to EGFR + lung adenocarcinoma

BACKGROUND

Over the past several decades, metrics have been defined to assess the quality of various types of models and to compare their performance depending on their capacity to explain the variance found in real-life data. However, available validation methods are mostly designed for statistical regressions rather than for mechanistic models. To our knowledge, in the latter case, there are no consensus standards, for instance for the validation of predictions against real-world data given the variability and uncertainty of the data. In this work, we focus on the prediction of time-to-event curves using as an application example a mechanistic model of non-small cell lung cancer. We designed four empirical methods to assess both model performance and reliability of predictions: two methods based on bootstrapped versions of parametric statistical tests: log-rank and combined weighted log-ranks (MaxCombo); and two methods based on bootstrapped prediction intervals, referred to here as raw coverage and the juncture metric. We also introduced the notion of observation time uncertainty to take into consideration the real life delay between the moment when an event happens, and the moment when it is observed and reported.

RESULTS

We highlight the advantages and disadvantages of these methods according to their application context. We have shown that the context of use of the model has an impact on the model validation process. Thanks to the use of several validation metrics we have highlighted the limit of the model to predict the evolution of the disease in the whole population of mutations at the same time, and that it was more efficient with specific predictions in the target mutation populations. The choice and use of a single metric could have led to an erroneous validation of the model and its context of use.

CONCLUSIONS

With this work, we stress the importance of making judicious choices for a metric, and how using a combination of metrics could be more relevant, with the objective of validating a given model and its predictions within a specific context of use. We also show how the reliability of the results depends both on the metric and on the statistical comparisons, and that the conditions of application and the type of available information need to be taken into account to choose the best validation strategy.

Hybrid modeling in bioprocess dynamics: Structural variabilities, implementation strategies, and practical challenges

Hybrid modeling, with an appropriate blend of the mechanistic and data-driven framework, is increasingly being adopted in bioprocess modeling, model-based experimental design (digital-twin), identification of critical process parameters, and optimization. However, the development of a hybrid model from experimental data is an inherently complex workflow, involving designed experiments, selection of the data-driven process, identification of model parameters, assessment fitness, and generalization capability. Depending on the complexity of the process system and purpose, each piece of these modules can flexibly be incorporated into the puzzle. However, this extra flexibility can be a cause of concern to trace an "optimal" model structure. In this paper, the development of hybrid models in a common bioprocess system, selection of data-driven components and their mapping to states, choice of parameter identification techniques, and model quality assurance are revisited. The challenges associated with hybrid-model development, and corrective actions have also been reviewed. The review also suggests the lack of data, and code sharing in communal repositories can be a hurdle in the exploration, and expansion of those tools in a bioprocess system.

Boost dynamic protocols for producing mammalian biopharmaceuticals with intensified DoE—a practical guide to analyses with OLS and hybrid modeling

Introduction: For the implementation of robust bioprocesses, understanding of temporal cell behavior with respect to relevant inputs is crucial. Intensified Design of Experiments (iDoE) is an efficient tool to assess the joint influence of input parameters by including intra-experimental changes.

Methods: We applied iDoE to the production phase of a monoclonal antibody in a mammalian bioprocess. The multidimensional design space spanned by temperature, dissolved oxygen (DO), timing of change, and growth category was investigated in 12 cultivations. We built ordinary least squares (OLS) and hybrid models (HM) on the iDoE-data, validated them with classical DoE (cDoE)-derived data, and used the models as in silico representation for process optimization.

Results: If the complexity of interactions between changing setpoints of inputs is sufficiently captured during planning and modeling, iDoE proved to be valid for characterizing the mammalian biopharmaceutical production phase. For local behavior and flexible composition of optimization goals, OLS regressions can easily be implemented. To predict global and interconnected dynamics while incorporating mass balances, HM holds potential.

Discussion: iDoE will boost protocols that optimize inputs for different bioprocess phases. The described key aspects of OLS- and HM-based analyses of iDoE-data shall guide future applications during manufacturing.

How Chemometrics Can Fight Milk Adulteration

Adulteration and fraud are amongst the wrong practices followed nowadays due to the attitude of some people to gain more money or their tendency to mislead consumers. Obviously, the industry follows stringent controls and methodologies in order to protect consumers as well as the origin of the food products, and investment in these technologies is highly critical. In this context, chemometric techniques proved to be very efficient in detecting and even quantifying the number of substances used as adulterants. The extraction of relevant information from different kinds of data is a crucial feature to achieve this aim. However, these techniques are not always used properly. In fact, training is important along with investment in these technologies in order to cope effectively and not only reduce fraud but also advertise the geographical origin of the various food and drink products. The aim of this paper is to present an overview of the different chemometric techniques (from clustering to classification and regression applied to several analytical data) along with spectroscopy, chromatography, electrochemical sensors, and other on-site detection devices in the battle against milk adulteration. Moreover, the steps which should be followed to develop a chemometric model to face adulteration issues are carefully presented with the required critical discussion.

The use of predictive models to develop chromatography-based purification processes

Chromatography is the workhorse of biopharmaceutical downstream processing because it can selectively enrich a target product while removing impurities from complex feed streams. This is achieved by exploiting differences in molecular properties, such as size, charge and hydrophobicity (alone or in different combinations). Accordingly, many parameters must be tested during process development in order to maximize product purity and recovery, including resin and ligand types, conductivity, pH, gradient profiles, and the sequence of separation operations. The number of possible experimental conditions quickly becomes unmanageable. Although the range of suitable conditions can be narrowed based on experience, the time and cost of the work remain high even when using high-throughput laboratory automation. In contrast, chromatography modeling using inexpensive, parallelized computer hardware can provide expert knowledge, predicting conditions that achieve high purity and efficient recovery. The prediction of suitable conditions in silico reduces the number of empirical tests required and provides in-depth process understanding, which is recommended by regulatory authorities. In this article, we discuss the benefits and specific challenges of chromatography modeling. We describe the experimental characterization of chromatography devices and settings prior to modeling, such as the determination of column porosity. We also consider the challenges that must be overcome when models are set up and calibrated, including the cross-validation and verification of data-driven and hybrid (combined data-driven and mechanistic) models. This review will therefore support researchers intending to establish a chromatography modeling workflow in their laboratory.

Promoting Sustainability through Next-Generation Biologics Drug Development

The fourth industrial revolution in 2011 aimed to transform the traditional manufacturing processes. As part of this revolution, disruptive innovations in drug development and data science approaches have the potential to optimize CMC (chemistry, manufacture, and control). The real-time simulation of processes using “digital twins” can maximize efficiency while improving sustainability. As part of this review, we investigate how the World Health Organization’s 17 sustainability goals can apply toward next-generation drug development. We analyze the state-of-the-art laboratory leadership, inclusive personnel recruiting, the latest therapy approaches, and intelligent process automation. We also outline how modern data science techniques and machine tools for CMC help to shorten drug development time, reduce failure rates, and minimize resource usage. Finally, we systematically analyze and compare existing approaches to our experiences with the high-throughput laboratory KIWI-biolab at the TU Berlin. We describe a sustainable business model that accelerates scientific innovations and supports global action toward a sustainable future.

Holistic Process Models: A Bayesian Predictive Ensemble Method for Single and Coupled Unit Operation Models

The coupling of individual models in terms of end-to-end calculations for unit operations in manufacturing processes is a challenging task. We present a probability distribution-based approach for the combined outcomes of parametric and non-parametric models. With this so-called Bayesian predictive ensemble, the statistical moments such as mean value and standard deviation can be accurately computed without any further approximation. It is shown that the ensemble of different model predictions leads to an uninformed prior distribution, which can be transformed into a predictive posterior distribution using Bayesian inference and numerical Markov Chain Monte Carlo calculations. We demonstrate the advantages of our method using several numerical examples. Our approach is not restricted to certain unit operations, and can also be used for the more robust interpretation and assessment of model predictions in general.

Towards Autonomous Process Control—Digital Twin for CHO Cell-Based Antibody Manufacturing Using a Dynamic Metabolic Model

The development of new biologics is becoming more challenging due to global competition and increased requirements for process understanding and assured quality in regulatory approval. As a result, there is a need for predictive, mechanistic process models. These reduce the resources and time required in process development, generating understanding, expanding the possible operating space, and providing the basis for a digital twin for automated process control. Monoclonal antibodies are an important representative of industrially produced biologics that can be used for a wide range of applications. In this work, the validation of a mechanistic process model with respect to sensitivity, as well as accuracy and precision, is presented. For the investigated process conditions, the concentration of glycine, phenylalanine, tyrosine, and glutamine have been identified as significant influencing factors for product formation via statistical evaluation. Cell growth is, under the investigated process conditions, significantly dependent on the concentration of glucose within the investigated design space. Other significant amino acids were identified. A Monte Carlo simulation was used to simulate the cultivation run with an optimized medium resulting from the sensitivity analysis. The precision of the model was shown to have a 95% confidence interval. The model shown here includes the implementation of cell death in addition to models described in the literature.

Applying intensified design of experiments to mammalian cell culture processes

The analysis of data collected using design of experiments (DoE) is the current gold standard to determine the influence of input parameters and their interactions on process performance and product quality. In early development, knowledge on the bioprocess of a new product is limited. Many input parameters need to be investigated for a thorough investigation. For eukaryotic cell cultures, intensified DoE (iDoE) has been proposed as efficient tool, requiring fewer bioreactor runs by introducing setpoint changes during the bioprocess. We report the first successful application of iDoE to mammalian cell culture, performing sequential setpoint changes in the growth phase for the selected input parameters temperature and dissolved oxygen. The process performance data were analyzed using ordinary least squares regression. Our results indicate iDoE to be applicable to mammalian bioprocesses and to be a cost-efficient option to inform modeling early on during process development. Even though only half the number of bioreactor runs were used in comparison to a classical DoE approach, the resulting models revealed comparable input-output relations. Being able to examine several setpoint levels within one bioreactor run, we confirm iDoE to be a promising tool to speed up biopharmaceutical process development.