Modeling and optimization of a pharmaceutical crystallization process by using neural networks and genetic algorithms

Explainable deep recurrent neural networks for the batch analysis of a pharmaceutical tableting process in the spirit of Pharma 4.0

Due to the continuously increasing Cost of Goods Sold, the pharmaceutical industry has faced several challenges, and the Right First-Time principle with data-driven decision-making has become more pressing to sustain competitiveness. Thus, in this work, three different types of artificial neural network (ANN) models were developed, compared, and interpreted by analyzing an open-access dataset from a real pharmaceutical tableting production process. First, the multilayer perceptron (MLP) model was used to describe the total waste based on 20 raw material properties and 25 statistical descriptors of the time series data collected throughout the tableting (e.g., tableting speed and compression force). Then using 10 process time series data in addition to the raw material properties, the cumulative waste, during manufacturing was also predicted by long short-term memory (LSTM) and bidirectional LSTM (biLSTM) recurrent neural networks (RNN). The LSTM network was used to forecast the waste production profile to allow preventive actions. The results showed that RNNs were able to predict the waste trajectory, the best model resulting in 1096 and 2174 tablets training and testing root mean squared errors, respectively. For a better understanding of the process, and the models and to help the decision-support systems and control strategies, interpretation methods were implemented for all ANNs, which increased the process understanding by identifying the most influential material attributes and process parameters. The presented methodology is applicable to various critical quality attributes in several fields of pharmaceutics and therefore is a useful tool for realizing the Pharma 4.0 concept.

Computing Topological Invariants of Deep Neural Networks

A deep neural network has multiple layers to learn more complex patterns and is built to simulate the activity of the human brain. Currently, it provides the best solutions to many problems in image recognition, speech recognition, and natural language processing. The present study deals with the topological properties of deep neural networks. The topological index is a numeric quantity associated to the connectivity of the network and is correlated to the efficiency and accuracy of the output of the network. Different degree-related topological indices such as Zagreb index, Randic index, atom-bond connectivity index, geometric-arithmetic index, forgotten index, multiple Zagreb indices, and hyper-Zagreb index of deep neural network with a finite number of hidden layers are computed in this study.

Applications of Artificial Intelligence and Machine Learning Algorithms to Crystallization

Artificial intelligence and specifically machine learning applications are nowadays used in a variety of scientific applications and cutting-edge technologies, where they have a transformative impact. Such an assembly of statistical and linear algebra methods making use of large data sets is becoming more and more integrated into chemistry and crystallization research workflows. This review aims to present, for the first time, a holistic overview of machine learning and cheminformatics applications as a novel, powerful means to accelerate the discovery of new crystal structures, predict key properties of organic crystalline materials, simulate, understand, and control the dynamics of complex crystallization process systems, as well as contribute to high throughput automation of chemical process development involving crystalline materials. We critically review the advances in these new, rapidly emerging research areas, raising awareness in issues such as the bridging of machine learning models with first-principles mechanistic models, data set size, structure, and quality, as well as the selection of appropriate descriptors. At the same time, we propose future research at the interface of applied mathematics, chemistry, and crystallography. Overall, this review aims to increase the adoption of such methods and tools by chemists and scientists across industry and academia.

Application of Artificial Neural Networks in the Process Analytical Technology of Pharmaceutical Manufacturing-a Review

Industry 4.0 has started to transform the manufacturing industries by embracing digitalization, automation, and big data, aiming for interconnected systems, autonomous decisions, and smart factories. Machine learning techniques, such as artificial neural networks (ANN), have emerged as potent tools to address the related computational tasks. These advancements have also reached the pharmaceutical industry, where the Process Analytical Technology (PAT) initiative has already paved the way for the real-time analysis of the processes and the science- and risk-based flexible production. This paper aims to assess the potential of ANNs within the PAT concept to aid the modernization of pharmaceutical manufacturing. The current state of ANNs is systematically reviewed for the most common manufacturing steps of solid pharmaceutical products, and possible research gaps and future directions are identified. In this way, this review could aid the further development of machine learning techniques for pharmaceutical production and eventually contribute to the implementation of intelligent manufacturing lines with automated quality assurance.

Optimization of Position and Number of Hotspot Detectors Using Artificial Neural Network and Genetic Algorithm to Estimate Material Levels Inside a Silo

To realize efficient operation of a silo, level management of internal storage is crucial. In this study, to address the existing measurement limitations, a silo hotspot detector, which is typically utilized for internal silo temperature monitoring, was employed. The internal temperature data measured using the hotspot detectors were used to train an artificial neural network (ANN) algorithm to predict the level of the internal storage of the silo. The prediction accuracy was evaluated by comparing the predicted data with ground truth data. We combined the ANN model with the genetic algorithm (GA) to improve the prediction accuracy and establish efficient sensor installation positions and number to proceed with optimization. Simulation results demonstrated that the best predictive performance (up to 97% accuracy) was achieved when the ANN structure was 9-19-19-1. Furthermore, the numbers of efficient sensors and sensors positions determined using the proposed ANN-GA technique were reduced from seven to five or four, thereby ensuring economic feasibility.

Progress in Research on Artificial Intelligence Applied to Polymorphism and Cocrystal Prediction

Artificial intelligence (AI) is a technology that builds an artificial system with certain intelligence and uses computer software and hardware to simulate intelligent human behavior. When combined with drug research and development, AI can considerably shorten this cycle, improve research efficiency, and minimize costs. The use of machine learning to discover novel materials and predict material properties has become a new research direction. On the basis of the current status of worldwide research on the combination of AI and crystal form and cocrystal, this mini-review analyzes and explores the application of AI in polymorphism prediction, crystal structure analysis, crystal property prediction, cocrystal former (CCF) screening, cocrystal composition prediction, and cocrystal formation prediction. This study provides insights into the future applications of AI in related fields.

Applications of Machine Learning in Solid Oral Dosage Form Development

This review comprehensively summarizes the application of machine learning in solid oral dosage form development over the past three decades. In both academia and industry, machine learning is increasingly applied for multiple preformulation/formulation and process development studies. Further, this review provides the authors' perspectives on how pharmaceutical scientists can use machine learning for right projects and in right ways; some key ingredients include (1) the determination of inputs, outputs, and objectives; (2) the generation of a database containing high-quality data; (3) the development of machine learning models based on dataset training and model optimization; (4) the application of trained models in making predictions for new samples. It is expected by the authors and others that machine learning will promisingly play a more important role in tomorrow's projects for solid oral dosage form development.

Geometrical design of a crystal growth system guided by a machine learning algorithm

This study proposes a new high-speed method for designing crystal growth systems. It is capable of optimizing large numbers of parameters simultaneously which is difficult for traditional experimental and computational techniques.

Application of Artificial Neural Networks in Crystal Growth of Electronic and Opto-Electronic Materials

In this review, we summarize the results concerning the application of artificial neural networks (ANNs) in the crystal growth of electronic and opto-electronic materials. The main reason for using ANNs is to detect the patterns and relationships in non-linear static and dynamic data sets which are common in crystal growth processes, all in a real time. The fast forecasting is particularly important for the process control, since common numerical simulations are slow and in situ measurements of key process parameters are not feasible. This important machine learning approach thus makes it possible to determine optimized parameters for high-quality up-scaled crystals in real time.

Rationalising crystal nucleation of organic molecules in solution using artificial neural networks

Artificial neural network modelling is used to analyse and predict primary nucleation based on various physicochemical solute and solvent parameters.

Artificial intelligence based model for optimization of COD removal efficiency of an up-flow anaerobic sludge blanket reactor in the saline wastewater treatment

The complex non-linear behavior presented in the biological treatment of wastewater requires an accurate model to predict the system performance. This study evaluates the effectiveness of an artificial intelligence (AI) model, based on the combination of artificial neural networks (ANNs) and genetic algorithms (GAs), to find the optimum performance of an up-flow anaerobic sludge blanket reactor (UASB) for saline wastewater treatment. Chemical oxygen demand (COD) removal was predicted using conductivity, organic loading rate (OLR) and temperature as input variables. The ANN model was built from experimental data and performance was assessed through the maximum mean absolute percentage error (= 9.226%) computed from the measured and model predicted values of the COD. Accordingly, the ANN model was used as a fitness function in a GA to find the best operational condition. In the worst case scenario (low energy requirements, high OLR usage and high salinity) this model guaranteed COD removal efficiency values above 70%. This result is consistent and was validated experimentally, confirming that this ANN-GA model can be used as a tool to achieve the best performance of a UASB reactor with the minimum requirement of energy for saline wastewater treatment.