Applications of machine vision in pharmaceutical technology: A review

High throughput in-line content uniformity measurement of tablets based on real-time UV imaging

This paper presents a precursor of a novel, high-throughput, in-line system, which utilizes ultraviolet (UV) imaging in order to predict the active pharmaceutical ingredient (API) content of tablets in real-time, non-destructive manner. Pimobendan, cardiovascular drug used in veterinary medicine was chosen as a fluorescent model API. Two experiments were carried out using different measurement setups, where the tablets were moving at different speeds. The blue colour components of the images were used to predict the pimobendan content of the tablets, and as a reference method, traditional UV spectroscopy was used to measure the API content of the dissolved tablets. In the case of the first, slower experiment (with a conveyor belt speed of 83 mm/s), a second order polynomial was fitted to the calibration tablets containing a nominal dose of 1.25, 5 and 10 mg of pimobendan and it was used to predict the API content. The RMSEP obtained was 0.428 mg for the validation tablets with a relative error as low as 7% for the target level. For the second, faster experiment (1000 mm/s) the same polynomial was used to predict the pimobendan concentration of a different set of tablets, achieving a relative error of 2.03%. Finally, the throughput of both systems was calculated to assess their applicability to meet the requirements of a pharmaceutical manufacturing line. The first system could inspect up to 93375 tablets per hour, while the second was able to process up to 360000 tablets in an hour, making it suitable for industrial application. By using these developed systems, the API content of all produced tablets could be determined non-destructively, which can greatly improve patient safety.

The current state-of-the art in pharmaceutical continuous film coating - A review

In this decade, one of the major trends in the pharmaceutical industry is the adoption of continuous manufacturing. This requires the development of continuous equivalents of essential pharmaceutical processes such as film coating. The process of film coating is the last step of the processing of solid dosage forms and is critical because it determines the visual appearance of the end product, along with ensuring its stability and possibly even defining the rate of drug release. Several manufacturers advertise continuous solutions for film coating, these include semi-continuous and fully continuous appliances. State-of-the-art continuous coaters can match the throughput of continuous manufacturing lines, because largest appliances have a capacity of 1200-1500 kg/h. The paper also describes the main challenges related to continuous film coating including waste production at the beginning and end of the process and the problem caused by elastic recovery of the tablets when film coating is performed immediately after tablet compression. Lastly, we give an overview of the in-line sensors that can be used to monitor the quality of the film coated tablets, enabling real-time quality control of the process. Near-infrared and Raman spectroscopy can measure the mass gain of the tablets, while terahertz pulsed imaging and optical coherence tomography enable coating thickness measurement of individual tablets and even the characterization of intra-tablet coating thickness variability. UV imaging and machine vision can also measure coating thickness, and they are also excellent for detecting tablets with defective coating.

A deep learning approach to perform defect classification of freeze-dried product

Cosmetic inspection of freeze-dried products is an important part of the post-manufacturing quality control process. Traditionally done by human visual inspection, this method poses typical challenges and shortcomings that can be addressed with innovative techniques. While many cosmetic defects can occur, some are considered more critical than others as they can be harmful to the patient or affect the drug's efficacy. With the rise of artificial intelligence and computer vision technology, faster and more reproducible quality control is possible, allowing real-time monitoring on a continuous manufacturing line. In this study, several continuously freeze-dried samples were prepared using formulations and process settings that lead deliberately to specific defects faced in freeze-drying as well as defect-free samples. Two approaches (i.e. patch-based approach and multi-label classification) capable of handling high-resolution images based on Convolutional Neural Networks were developed and compared to select the optimal one. Additional visualisation techniques were used to enhance model understanding further. The best approach achieved perfect precision and recall on critical defects, with a prediction time of less than 50 ms to make a decision on the acceptance or rejection of vials generated.

A simple circularity-based approach for nanoparticle size histograms beyond the spherical approximation

Conventional Transmission Electron Microscopy (TEM) is widely used for routine characterization of the size and shape of an assembly of (nano)particles. While the most basic approach only uses the projected area of each particle to infer its size (the "circular equivalent diameter" corresponding to the so-called "spherical approximation"), other shape descriptors can be determined and used for more elaborate analyses. In this article we present a generic model of particles, considered to be made of a few individual grains, and show how the equivalent size (i.e. a particle volume information) can be reliably deduced using only two basic parameters: the projected area and the perimeter of a particle. We compare this simple model to the spherical and ellipsoidal approximations and discuss its benefits. Then, partial coalescence of grains in a particle is also considered and we show how a simple analytical approximation, based on the circularity parameter of each particle, can improve the experimental determination of a particle size histogram. The analysis of experimental observations on nanoparticles assemblies obtained by mass-selected cluster deposition is presented, to illustrate the efficiency of the proposed approach for the determination of particle size just from conventional TEM images. We show how the presence of multimers offers an excellent opportunity to validate our improved and simple procedure. In addition, since the circularity plays a central role in this approach, attention is attracted on the perimeter determination in a pixelated image.

Automated tablet defect detection and the prediction of disintegration time and crushing strength with deep learning based on tablet surface images

This paper presents novel measurement methods, where deep learning was used to detect tableting defects and determine the crushing strength and disintegration time of tablets on images captured by machine vision. Five different classes of defects were used and the accuracy of the real-time defect recognition performed with the deep learning algorithm YOLOv5 was 99.2 %. The system can already match the production capability of tablet presses, with still further room left for improvement. The YOLOv5 algorithm was also used to determine the disintegration time and crushing strength of tablets produced at different compression force settings based on their surface texture. With these accurate, low-cost methods, the 100 % screening of the produced tablets could be carried out, resulting in the improvement of quality control and effectiveness of pharmaceutical production.

Evaluation of floatability characteristics of gastroretentive tablets using VIS imaging with artificial neural networks

Gastroretentive dosage forms are recommended for several active substances because it is often necessary for the drug to be released from the carrier system into the stomach over an extended period. Among gastroretentive dosage forms, floating tablets are a very popular pharmaceutical technology. In this study, it was investigated whether a rapid, nondestructive method can be used to characterize the floating properties of a tablet. To accomplish our objective, the same composition was compressed, and varied compression forces were applied to achieve the desired tablet. In addition to physical examinations, digital microscopic images of the tablets were captured and analyzed using image analysis techniques, allowing the investigation of the floatability of the dosage form. Image processing algorithms and artificial neural networks (ANNs) were utilized to classify the samples based on their strength and floatability. The input dataset consisted solely of the acquired images. It has been shown by our research that visible imaging coupled with pattern recognition neural networks is an efficient way to categorize these samples based on their floatability. Rapid and non-destructive digital imaging of tablet surfaces is facilitated by this method, offering insights into both crushing strength and floating properties.

Past, Current, and Future: Application of Image Analysis in Small Molecule Pharmaceutical Development

The often-perceived limitations of image analysis have for many years impeded the widespread application of such systems as first line characterisation tools. Image analysis has, however, undergone a notable resurgence in the pharmaceutical industry fuelled by developments system capabilities and the desire of scientists to characterize the morphological nature of their particles more adequately. The importance of particle shape as well as size is now widely acknowledged. With the increasing use of modelling and simulations, and ongoing developments though the integration of machine learning and artificial intelligence, the utility of image analysis is increasing significantly driven by the richness of the data obtained. Such datasets provide means to circumvent the requirement to rely on less informative descriptors and enable the move towards the use of whole distributions. Combining the improved particle size and shape measurement and description with advances in modelling and simulations is enabling improved means to elucidate the link between particle and bulk powder properties. In addition to improved capabilities to describe input materials, approaches to characterize single components within multicomponent systems are providing scientists means to understand how their material may change during manufacture thus providing a means to link the behaviour of final dosage forms with the particle properties at the point of action. The aim is to provide an overview of image analysis and update readers with innovations and capabilities to other methods in the small molecule arena. We will also describe the use of AI for the improved analysis using image analysis.

UV/VIS-imaging of white caffeine tablets for prediction of CQAs: API content, crushing strength, friability, disintegration time and dissolution profile

The paper provides a demonstration of how UV/VIS imaging can be employed to evaluate the crushing strength, friability, disintegration time and dissolution profile of tablets comprised of solely white components. The samples were produced using different levels of compression force and API content of anhydrous caffeine. Images were acquired from both sides of the samples using UV illumination for the API content prediction, while the other parameters were assessed using VIS illumination. Based on the color histograms of the UV images, API content was predicted with 5.6 % relative error. Textural analysis of the VIS images yielded crushing strength predictions under 10 % relative error. Regarding friability, three groups were established according to the weight loss of the samples. Likewise, the evaluation of disintegration time led to the identification of three groups: <10 s, 11-35 s, and over 36 s. Successful classification of the samples was achieved with machine learning algorithms. Finally, immediate release dissolution profiles were accurately predicted under 5 % of RMSE with an artificial neural network. The 50 ms exposition time during image acquisition and the resulting outcomes underscore the practicality of machine vision for real-time quality control in solid dosage forms, regardless of the color of the API.

YOLO-PBESW: A Lightweight Deep Learning Model for the Efficient Identification of Indomethacin Crystal Morphologies in Microfluidic Droplets

Crystallization is important to the pharmaceutical, the chemical, and the materials fields, where the morphology of crystals is one of the key factors affecting the quality of crystallization. High-throughput screening based on microfluidic droplets is a potent technique to accelerate the discovery and development of new crystal morphologies with active pharmaceutical ingredients. However, massive crystal morphologies' datum needs to be identified completely and accurately, which is time-consuming and labor-intensive. Therefore, effective morphologies' detection and small-target tracking are essential for high-efficiency experiments. In this paper, a new improved algorithm YOLOv8 (YOLO-PBESW) for detecting indomethacin crystals with different morphologies is proposed. We enhanced its capability in detecting small targets through the integration of a high-resolution feature layer P2, and the adoption of a BiFPN structure. Additionally, in this paper, adding the EMA mechanism before the P2 detection head was implemented to improve network attention towards global features. Furthermore, we utilized SimSPPF to replace SPPF to mitigate computational costs and reduce inference time. Lastly, the CIoU loss function was substituted with WIoUv3 to improve detection performance. The experimental findings indicate that the enhanced YOLOv8 model attained advancements, achieving AP metrics of 93.3%, 77.6%, 80.2%, and 99.5% for crystal wire, crystal rod, crystal sheet, and jelly-like phases, respectively. The model also achieved a precision of 85.2%, a recall of 83.8%, and an F1 score of 84.5%, with a mAP of 87.6%. In terms of computational efficiency, the model's dimensions and operational efficiency are reported as 5.46 MB, and it took 12.89 ms to process each image with a speed of 77.52 FPS. Compared with state-of-the-art lightweight small object detection models such as the FFCA-YOLO series, our proposed YOLO-PBESW model achieved improvements in detecting indomethacin crystal morphologies, particularly for crystal sheets and crystal rods. The model demonstrated AP values that exceeded L-FFCA-YOLO by 7.4% for crystal sheets and 3.9% for crystal rods, while also delivering a superior F1-score. Furthermore, YOLO-PBESW maintained a lower computational complexity, with parameters of only 11.8 GFLOPs and 2.65 M, and achieved a higher FPS. These outcomes collectively demonstrate that our method achieved a balance between precision and computational speed.

Non-invasive estimation of the powder size distribution from a single speckle image

Non-invasive characterization of powders may take one of two approaches: imaging and counting individual particles; or relying on scattered light to estimate the particle size distribution (PSD) of the ensemble. The former approach runs into practical difficulties, as the system must conform to the working distance and other restrictions of the imaging optics. The latter approach requires an inverse map from the speckle autocorrelation to the particle sizes. The principle relies on the pupil function determining the basic sidelobe shape, whereas the particle size spread modulates the sidelobe intensity. We recently showed that it is feasible to invert the speckle autocorrelation and obtain the PSD using a neural network, trained efficiently through a physics-informed semi-generative approach. In this work, we eliminate one of the most time-consuming steps of our previous method by engineering the pupil function. By judiciously blocking portions of the pupil, we sacrifice some photons but in return we achieve much enhanced sidelobes and, hence, higher sensitivity to the change of the size distribution. The result is a 60 × reduction in total acquisition and processing time, or 0.25 seconds per frame in our implementation. Almost real-time operation in our system is not only more appealing toward rapid industrial adoption, it also paves the way for quantitative characterization of complex spatial or temporal dynamics in drying, blending, and other chemical and pharmaceutical manufacturing processes.

Real-time visual intelligence for defect detection in pharmaceutical packaging

Defect detection in pharmaceutical blister packages is the most challenging task to get an accurate result in detecting defects that arise in tablets while manufacturing. Conventional defect detection methods include human intervention to check the quality of tablets within the blister packages, which is inefficient, time-consuming, and increases labor costs. To mitigate this issue, the YOLO family is primarily used in many industries for real-time defect detection in continuous production. To enhance the feature extraction capability and reduce the computational overhead in a real-time environment, the CBS-YOLOv8 is proposed by enhancing the YOLOv8 model. In the proposed CBS-YOLOv8, coordinate attention is introduced to improve the feature extraction capability by capturing the spatial and cross-channel information and also maintaining the long-range dependencies. The BiFPN (weighted bi-directional feature pyramid network) is also introduced in YOLOv8 to enhance the feature fusion at each convolution layer to avoid more precise information loss. The model's efficiency is enhanced through the implementation of SimSPPF (simple spatial pyramid pooling fast), which reduces computational demands and model complexity, resulting in improved speed. A custom dataset containing defective tablet images is used to train the proposed model. The performance of the CBS-YOLOv8 model is then evaluated by comparing it with various other models. Experimental results on the custom dataset reveal that the CBS-YOLOv8 model achieves a mAP of 97.4% and an inference speed of 79.25 FPS, outperforming other models. The proposed model is also evaluated on SESOVERA-ST saline bottle fill level monitoring dataset achieved the mAP50 of 99.3%. This demonstrates that CBS-YOLOv8 provides an optimized inspection process, enabling prompt detection and correction of defects, thus bolstering quality assurance practices in manufacturing settings.

Real-time release testing of in vitro dissolution and blend uniformity in a continuous powder blending process by NIR spectroscopy and machine vision

Continuous manufacturing is gaining increasing interest in the pharmaceutical industry, also requiring real-time and non-destructive quality monitoring. Multiple studies have already addressed the possibility of surrogate in vitro dissolution testing, but the utilization has rarely been demonstrated in real-time. Therefore, in this work, the in-line applicability of an artificial intelligence-based dissolution surrogate model is developed the first time. NIR spectroscopy-based partial least squares regression and artificial neural networks were developed and tested in-line and at-line to assess the blend uniformity and dissolution of encapsulated acetylsalicylic acid (ASA) - microcrystalline cellulose (MCC) powder blends in a continuous blending process. The studied blend is related to a previously published end-to-end manufacturing line, where the varying size of the ASA crystals obtained from a continuous crystallization significantly affected the dissolution of the final product. The in-line monitoring was suitable for detecting the variations in the ASA content and dissolution caused by the feeding of ASA with different particle sizes, and the at-line predictions agreed well with the measured validation dissolution curves (f2 = 80.5). The results were further validated using machine vision-based particle size analysis. Consequently, this work could contribute to the advancement of RTRT in continuous end-to-end processes.

UV imaging for the rapid at-line content determination of different colourless APIs in their tablets with artificial neural networks

This paper presents a novel high-resolution and rapid (50 ms) UV imaging system, which was used for at-line, non-destructive API content determination of tablets. For the experiments, amlodipine and valsartan were selected as two colourless APIs with different UV induced fluorescent properties according to the measured solid fluorescent spectra. Images were captured with a LED-based UV illumination (385-395 nm) of tablets containing amlodipine or valsartan and common tableting excipients. Blue or green colour components from the RGB colour space were extracted from the images and used as an input dataset to execute API content prediction with artificial neural networks. The traditional destructive, solution-based transmission UV measurement was applied as reference method. After the optimization of the number of hidden layer neurons it was found that the relative error of the content prediction was 4.41 % and 3.98 % in the case of amlodipine and valsartan containing tablets respectively. The results open the possibility to use the proposed UV imaging-based system as a rapid, in-line tool for 100 % API content screening in order to greatly improve pharmaceutical quality control and process understanding.

Machine vision-based non-destructive dissolution prediction of meloxicam-containing tablets

Machine vision systems have emerged for quality assessment of solid dosage forms in the pharmaceutical industry. These can offer a versatile tool for continuous manufacturing while supporting the framework of process analytical technology, quality-by-design, and real-time release testing. The aim of this work is to develop a digital UV/VIS imaging-based system for predicting the in vitro dissolution of meloxicam-containing tablets. The alteration of the dissolution profiles of the samples required different levels of the critical process parameters, including compression force, particle size and content of the API. These process parameters were predicted non-destructively by multivariate analysis of UV/VIS images taken from the tablets. The dissolution profile prediction was also executed using solely the image data and applying artificial neural networks. The prediction error (RMSE) of the dissolution profile points was less than 5%. The alteration of the API content directly affected the maximum concentrations observed at the end of the dissolution tests. This parameter was predicted with a relative error of less than 10% by PLS models that are based on the color components of UV and VIS images. In conclusion, this paper presents a modern, non-destructive PAT solution for real-time testing of the dissolution of tablets.

UV-VIS imaging-based investigation of API concentration fluctuation caused by the sticking behaviour of pharmaceutical powder blends

Surface powder sticking in pharmaceutical mixing vessels poses a risk to the uniformity and quality of drug formulations. This study explores methods for evaluating the amount of pharmaceutical powder mixtures adhering to the metallic surfaces. Binary powder blends consisting of amlodipine and microcrystalline cellulose (MCC) were used to investigate the effect of the mixing order on the adherence to the vessel wall. Elevated API concentrations were measured on the wall and within the dislodged material from the surface, regardless of the mixing order of the components. UV imaging was used to determine the particle size and the distribution of the API on the metallic surface. The results were compared to chemical maps obtained by Raman chemical imaging. The combination of UV and VIS imaging enabled the rapid acquisition of chemical maps, covering a substantially large area representative of the analysed sample. UV imaging was also applied in tablet inspection to detect tablets that fail to meet the content uniformity criteria. The results present powder adherence as a possible source of poor content uniformity, highlighting the need for 100% inspection of pharmaceutical products to ensure product quality and safety.

Feature extraction of particle morphologies of pharmaceutical excipients from scanning electron microscope images using convolutional neural networks

Scanning electron microscopy (SEM) images are the most widely used tool for evaluating particle morphology; however, quantitative evaluation using SEM images is time-consuming and often neglected. In this study, we aimed to extract features related to particle morphology of pharmaceutical excipients from SEM images using a convolutional neural network (CNN). SEM images of 67 excipients were acquired and used as models. A classification CNN model of the excipients was constructed based on the SEM images. Further, features were extracted from the middle layer of this CNN model, and the data was compressed to two dimensions using uniform manifold approximation and projection. Lastly, hierarchical clustering analysis (HCA) was performed to categorize the excipients into several clusters and identify similarities among the samples. The classification CNN model showed high accuracy, allowing each excipient to be identified with a high degree of accuracy. HCA revealed that the 67 excipients were classified into seven clusters. Additionally, the particle morphologies of excipients belonging to the same cluster were found to be very similar. These results suggest that CNN models are useful tools for extracting information and identifying similarities among the particle morphologies of excipients.

The role of artificial intelligence in generating original scientific research

Artificial intelligence (AI) is a revolutionary technology that is finding wide application across numerous sectors. Large language models (LLMs) are an emerging subset technology of AI and have been developed to communicate using human languages. At their core, LLMs are trained with vast amounts of information extracted from the internet, including text and images. Their ability to create human-like, expert text in almost any subject means they are increasingly being used as an aid to presentation, particularly in scientific writing. However, we wondered whether LLMs could go further, generating original scientific research and preparing the results for publication. We taskedGPT-4, an LLM, to write an original pharmaceutics manuscript, on a topic that is itself novel. It was able to conceive a research hypothesis, define an experimental protocol, produce photo-realistic images of 3D printed tablets, generate believable analytical data from a range of instruments and write a convincing publication-ready manuscript with evidence of critical interpretation. The model achieved all this is less than 1 h. Moreover, the generated data were multi-modal in nature, including thermal analyses, vibrational spectroscopy and dissolution testing, demonstrating multi-disciplinary expertise in the LLM. One area in which the model failed, however, was in referencing to the literature. Since the generated experimental results appeared believable though, we suggest that LLMs could certainly play a role in scientific research but with human input, interpretation and data validation. We discuss the potential benefits and current bottlenecks for realising this ambition here.

Image processing-based online analysis and feedback control system for droplet dripping process

Droplets find wide application across diverse industries, where maintaining their quality is paramount. Precise control over the substance content within droplets demands non-destructive and online analysis techniques, such as Process Analytical Technology (PAT), often integrated with control strategies. In this context, the present study focuses on the example of controlling droplet quality during the dripping process of pills. Leveraging the dripping and image acquisition systems established in previous research, a novel feedback control system centered on image processing was devised for the quality control of dripping pills. The system was developed and its efficacy was assessed, yielding satisfactory outcomes. The proposed system facilitates real-time monitoring of pill weight through the analysis of droplet images during the dripping process, thereby offering real-time feedback control of pill weight. Importantly, this system holds potential for broader applications beyond the scope of this study.

Attitude measurement of ultraclose-range spacecraft based on improved YOLOv5s and adaptive Hough circle extraction

In order to fulfill the requirements for various operations in space, such as rendezvous, docking, and capturing, there is a pressing need to achieve ultraclose-range spacecraft pose measurement. This paper addresses the challenges of pose measurement under low-light conditions at ultraclose range by introducing a stereovision solution based on target detection and adaptive circle extraction. Initially, an improved target detection algorithm is employed to expedite feature object detection. Subsequently, an adaptive circle extraction algorithm is developed through analysis of camera imaging to surmount challenges related to feature extraction and potential feature loss in the space environment. This approach facilitates swift and accurate measurement of spacecraft at ultraclose range. The results showcase a 66.36% reduction in parameter count for the enhanced target detection algorithm compared with the prevalent YOLOv7_tiny algorithm. Additionally, the adaptive circle extraction algorithm demonstrates an 11.4% increase in cooperative target feature extraction precision compared with existing methods while maintaining requisite detection speed. Simulation experiments indicate that the real-time position measurement error for spacecraft at ultraclose range is less than 0.18 mm, and angle measurement error is less than 0.05°. This presents a viable visual solution for spacecraft pose measurement at ultraclose range in low-light environments.

Image-based simultaneous particle size distribution and concentration measurement of powder blend components with deep learning and machine vision

This work presents a system, where deep learning was used on images captured with a digital camera to simultaneously determine the API concentration and the particle size distribution (PSD) of two components of a powder blend. The blend consisted of acetylsalicylic acid (ASA) and calcium hydrogen phosphate (CHP), and the predicted API concentration was found corresponding with the HPLC measurements. The PSDs determined with the method corresponded with those measured with laser diffraction particle size analysis. This novel method provides fast and simple measurements and could be suitable for detecting segregation in the powder. By examining the powders discharged from a batch blender, the API concentrations at the top and bottom of the container could be measured, yielding information about the adequacy of the blending and improving the quality control of the manufacturing process.

Virtually Possible: Enhancing Quality Control of 3D-Printed Medicines with Machine Vision Trained on Photorealistic Images

Three-dimensional (3D) printing is an advanced pharmaceutical manufacturing technology, and concerted efforts are underway to establish its applicability to various industries. However, for any technology to achieve widespread adoption, robustness and reliability are critical factors. Machine vision (MV), a subset of artificial intelligence (AI), has emerged as a powerful tool to replace human inspection with unprecedented speed and accuracy. Previous studies have demonstrated the potential of MV in pharmaceutical processes. However, training models using real images proves to be both costly and time consuming. In this study, we present an alternative approach, where synthetic images were used to train models to classify the quality of dosage forms. We generated 200 photorealistic virtual images that replicated 3D-printed dosage forms, where seven machine learning techniques (MLTs) were used to perform image classification. By exploring various MV pipelines, including image resizing and transformation, we achieved remarkable classification accuracies of 80.8%, 74.3%, and 75.5% for capsules, tablets, and films, respectively, for classifying stereolithography (SLA)-printed dosage forms. Additionally, we subjected the MLTs to rigorous stress tests, evaluating their scalability to classify over 3000 images and their ability to handle irrelevant images, where accuracies of 66.5% (capsules), 72.0% (tablets), and 70.9% (films) were obtained. Moreover, model confidence was also measured, and Brier scores ranged from 0.20 to 0.40. Our results demonstrate promising proof of concept that virtual images exhibit great potential for image classification of SLA-printed dosage forms. By using photorealistic virtual images, which are faster and cheaper to generate, we pave the way for accelerated, reliable, and sustainable AI model development to enhance the quality control of 3D-printed medicines.

In-line particle size measurement during granule fluidization using convolutional neural network-aided process imaging

This paper presents a machine learning-based image analysis method to monitor the particle size distribution of fluidized granules. The key components of the direct imaging system are a rigid fiber-optic endoscope, a light source and a high-speed camera, which allow for real-time monitoring of the granules. The system was implemented into a custom-made 3D-printed device that could reproduce the particle movement characteristic in a fluidized-bed granulator. The suitability of the method was evaluated by determining the particle size distribution (PSD) of various granule mixtures within the 100-2000 μm size range. The convolutional neural network-based software was able to successfully detect the granules that were in focus despite the dense flow of the particles. The volumetric PSDs were compared with off-line reference measurements obtained by dynamic image analysis and laser diffraction. Similar trends were observed across the PSDs acquired with all three methods. The results of this study demonstrate the feasibility of performing real-time particle size analysis using machine vision as an in-line process analytical technology (PAT) tool.

Imaging techniques for studying solid dosage formulation: Principles and applications

Classic methods for evaluating the disintegration and dissolution kinetics of solid dosage forms are no longer sufficient to meet the growing demands in the pharmaceutical field. Hence, scientists have turned to imaging techniques and computer technology to develop innovative visualization methods. These methods allow for a visual understanding of the disintegration or dissolution process and offer valuable insights into the drug release kinetics. This article aims to provide an overview of the commonly used imaging techniques and their applications in studying the disintegration or dissolution of solid dosage forms. Therefore, imaging presents a novel and alternative approach to understanding the mechanisms of disintegration and dissolution in the formulation study of solid dosages.

Image-Based Sensor for Liquid Level Monitoring during Bottling with Application to Craft and Home-Brewing

Although craft and home brewing have fueled the beer renaissance in the last decade, affordable, reliable, and simple sensing equipment for such breweries is limited. Thus, this manuscript is motivated by the improvement of the bottle-filling process in such settings with the objective of developing a liquid level sensor based on a novel application of the known optical phenomena of light refraction. Based on the different refraction indices of liquid and air (and critical angle based on Snell's law), along with a novel LED light source positioning, a reliable liquid level sensor system was built with the aid of an embedded microcontroller. The used operating principle is general and can be used in applications other than the proposed one. The proposed method was extensively tested in a laboratory and limited production settings with a speed of 7 Hz using different liquids and container shapes. It was compared for accuracy to other sensing principles such as ultrasound, infrared, and time-of-flight. It demonstrated comparable or better performance with a height error ranging between -0.1534 mm in static conditions and 1.608 mm for realistic dynamic conditions and good repeatability on the production line with a 4.3 mm standard deviation of the mean.

Extracting particle size distribution from laser speckle with a physics-enhanced autocorrelation-based estimator (PEACE)

Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A non-invasive and real-time monitoring probe in the drying process is required, but there is no suitable candidate for this purpose. In this report, we develop a theoretical relationship from the PSD to the speckle image and describe a physics-enhanced autocorrelation-based estimator (PEACE) machine learning algorithm for speckle analysis to measure the PSD of a powder surface. This method solves both the forward and inverse problems together and enjoys increased interpretability, since the machine learning approximator is regularized by the physical law.

Online 3D Characterization of Micrometer-Sized Cuboidal Particles in Suspension

Characterization of particle size and shape is central to the study of particulate matter in its broadest sense. Whilst 1D characterization defines the state of the art, the development of 2D and 3D characterization methods has attracted increasing attention, due to a common need to measure particle shape alongside size. Herein, ensembles of micrometer-sized cuboidal particles are studied, for which reliable sizing techniques are currently missing. Such particles must be characterized using three orthogonal dimensions to completely describe their size and shape. To this end, the utility of an online and in-flow multiprojection imaging tool coupled with machine learning is experimentally assessed. Central to this activity, a methodology is outlined to produce micrometer-sized, non-spherical analytical standards. Such analytical standards are fabricated using photolithography, and consist of monodisperse micro-cuboidal particles of user-defined size and shape. The aforementioned activities are addressed through an experimental framework that fabricates analytical standards and subsequently uses them to validate the performance of our multiprojection imaging tool. Significantly, it is shown that the same set of data collected for particle sizing can also be used to estimate particle orientation in flow, thus defining a rapid and robust protocol to investigate the behavior of dilute particle-laden flows.

Identification and Localisation Algorithm for Sugarcane Stem Nodes by Combining YOLOv3 and Traditional Methods of Computer Vision

Sugarcane stem node identification is the core technology required for the intelligence and mechanization of the sugarcane industry. However, detecting stem nodes quickly and accurately is still a significant challenge. In this paper, in order to solve this problem, a new algorithm combining YOLOv3 and traditional methods of computer vision is proposed, which can improve the identification rate during automated cutting. First, the input image is preprocessed, during which affine transformation is used to correct the posture of the sugarcane and a rotation matrix is established to obtain the region of interest of the sugarcane. Then, a dataset is built to train the YOLOv3 network model and the position of the stem nodes is initially determined using the YOLOv3 model. Finally, the position of the stem nodes is further located accurately. In this step, a new gradient operator is proposed to extract the edge of the image after YOLOv3 recognition. Then, a local threshold determination method is proposed, which is used to binarize the image after edge extraction. Finally, a localization algorithm for stem nodes is designed to accurately determine the number and location of the stem nodes. The experimental results show that the precision rate, recall rate, and harmonic mean of the stem node recognition algorithm in this paper are 99.68%, 100%, and 99.84%, respectively. Compared to the YOLOv3 network, the precision rate and the harmonic mean are improved by 2.28% and 1.13%, respectively. Compared to other methods introduced in this paper, this algorithm has the highest recognition rate.

The Use of Novel, Rapid Analytical Tools in the Assessment of the Stability of Tablets—A Pilot Analysis of Expired and Unexpired Tablets Containing Nifuroxazide

In the analysis of finished pharmaceutical products, numerous innovative analytical techniques are often used, i.e., Raman spectroscopy, scanning electron microscopy, computer microtomography, directional hemispherical reflectance, and hyperspectral analyses. These techniques allow for the identification of changes in solid phases. Many advantages over other techniques can be attributed to these techniques, e.g., they are rapid, non-destructive, and comprehensive. They allow for the identification of changes occurring in solid phases. However, the above-mentioned methods are still not standard procedures in pharmaceutical research. The present study aimed to assess the possible usefulness of total directional hemispherical reflectance (THR), hyperspectral imaging, and computer microtomography to evaluate the stability of tablets containing nifuroxazide during storage. In the study, expired and unexpired coating tablets containing nifuroxazide (n = 10 each) were analyzed. In addition, four unexpired tablets were stored at 40°C over 3 months (stressed tablets). Reflectance was determined with seven wavelength bands from 335 nm to 2500 nm using an SOC-410 Directional Hemispherical Reflectometer (Surface Optics Corporation, San Diego, CA, USA). A Specim IQ hyperspectral camera (Spectral Imaging Ltd., Oulu, Finland) was used with a wavelength range of 400–1030 nm. Tablets were also scanned using X-ray microtomography (Phoenix vǀtomeǀx, GE Sensing & Inspection Technologies GmbH, Wunstorf, Germany). The results indicated that total reflectance was lower in expired tablets than in unexpired tablets in all spectral bands, except for 700–1100 nm and 1700–2500 nm. In turn, the stressed tablets showed higher THR values than expired tablets in all spectral bands, except for 1000–1700 nm. In addition, hyperspectral analysis of the homogeneity of the tablets, as well as X-ray microtomographic analysis of tablet density and coating thickness, indicated that these parameters differed significantly between the analyzed tablets.

Challenges and Opportunities of Implementing Data Fusion in Process Analytical Technology-A Review

The release of the FDA's guidance on Process Analytical Technology has motivated and supported the pharmaceutical industry to deliver consistent quality medicine by acquiring a deeper understanding of the product performance and process interplay. The technical opportunities to reach this high-level control have considerably evolved since 2004 due to the development of advanced analytical sensors and chemometric tools. However, their transfer to the highly regulated pharmaceutical sector has been limited. To this respect, data fusion strategies have been extensively applied in different sectors, such as food or chemical, to provide a more robust performance of the analytical platforms. This survey evaluates the challenges and opportunities of implementing data fusion within the PAT concept by identifying transfer opportunities from other sectors. Special attention is given to the data types available from pharmaceutical manufacturing and their compatibility with data fusion strategies. Furthermore, the integration into Pharma 4.0 is discussed.

Real-time coating thickness measurement and defect recognition of film coated tablets with machine vision and deep learning

This paper presents a system, where images acquired with a digital camera are coupled with image analysis and deep learning to identify and categorize film coating defects and to measure the film coating thickness of tablets. There were 5 different classes of defective tablets, and the YOLOv5 algorithm was utilized to recognize defects, the accuracy of the classification was 98.2%. In order to characterize coating thickness, the diameter of the tablets in pixels was measured, which was used to measure the coating thickness of the tablets. The proposed system can be easily scaled up to match the production capability of continuous film coaters. With the developed technique, the complete screening of the produced tablets can be achieved in real-time resulting in the improvement of quality control.

Review on Starter Pellets: Inert and Functional Cores

A significant proportion of pharmaceuticals are now considered multiparticulate systems. Modified-release drug delivery formulations can be designed with engineering precision, and patient-centric dosing can be accomplished relatively easily using multi-unit systems. In many cases, Multiple-Unit Pellet Systems (MUPS) are formulated on the basis of a neutral excipient core which may carry the layered drug surrounded also by functional coating. In the present summary, commonly used starter pellets are presented. The manuscript describes the main properties of the various nuclei related to their micro- and macrostructure. In the case of layered pellets formed based on different inert pellet cores, the drug release mechanism can be expected in detail. Finally, the authors would like to prove the industrial significance of inert cores by presenting some of the commercially available formulations.

Application of Artificial Neural Networks in the Process Analytical Technology of Pharmaceutical Manufacturing-a Review

Industry 4.0 has started to transform the manufacturing industries by embracing digitalization, automation, and big data, aiming for interconnected systems, autonomous decisions, and smart factories. Machine learning techniques, such as artificial neural networks (ANN), have emerged as potent tools to address the related computational tasks. These advancements have also reached the pharmaceutical industry, where the Process Analytical Technology (PAT) initiative has already paved the way for the real-time analysis of the processes and the science- and risk-based flexible production. This paper aims to assess the potential of ANNs within the PAT concept to aid the modernization of pharmaceutical manufacturing. The current state of ANNs is systematically reviewed for the most common manufacturing steps of solid pharmaceutical products, and possible research gaps and future directions are identified. In this way, this review could aid the further development of machine learning techniques for pharmaceutical production and eventually contribute to the implementation of intelligent manufacturing lines with automated quality assurance.

A generalized image analytical algorithm for investigating tablet disintegration

Commonly used methods for analyzing tablet disintegration are based on visual observations and can thus be user-dependent. To address this, a generally applicable image analytical algorithm has been developed for machine vision-based quantification of tablet disintegration. The algorithm has been tested with a conventional immediate release tablet, as well as model compacts disintegrating mainly through erosion, and finally, with a polymeric slow-release system. Despite differences in disintegration mechanisms between these compacts, the developed image analytical algorithm demonstrated its general applicability through quantifying the extent of disintegration without adaptation of image analytical parameters. The reproducibility of the approach was estimated with commercial tablets, and further, it could differentiate a range of different model compacts. The developed image analytical algorithm mimics the human decision-making processes and the current experience-based visual evaluation of disintegration time. In doing so the algorithmic method allows a user-independent approach for development of the optimal tablet formulation as well as gaining an understanding on how the selection of excipients and manufacturing processes ultimately influences tablet disintegration.

UV/VIS imaging-based PAT tool for drug particle size inspection in intact tablets supported by pattern recognition neural networks

The potential of machine vision systems has not currently been exploited for pharmaceutical applications, although expected to provide revolutionary solutions for in-process and final product testing. The presented paper aimed to analyze the particle size of meloxicam, a yellow model active pharmaceutical ingredient, in intact tablets by a digital UV/VIS imaging-based machine vision system. Two image processing algorithms were developed and coupled with pattern recognition neural networks for UV and VIS images for particle size-based classification of the prepared tablets. The developed method can identify tablets containing finer or larger particles than the target with more than 97% accuracy. Two algorithms were developed for UV and VIS images for particle size analysis of the prepared tablets. According to the applied statistical tests, the obtained particle size distributions were similar to the results of the laser diffraction-based reference method. Digital UV/VIS imaging combined with multivariate data analysis can provide a new non-destructive, rapid, in-line tool for particle size analysis in tablets.

A review on the modernization of pharmaceutical development and manufacturing - Trends, perspectives, and the role of mathematical modeling

Recently, the pharmaceutical industry has been facing several challenges associated to the use of outdated development and manufacturing technologies. The return on investment on research and development has been shrinking, and, at the same time, an alarming number of shortages and recalls for quality concerns has been registered. The pharmaceutical industry has been responding to these issues through a technological modernization of development and manufacturing, under the support of initiatives and activities such as quality-by-design (QbD), process analytical technology, and pharmaceutical emerging technology. In this review, we analyze this modernization trend, with emphasis on the role that mathematical modeling plays within it. We begin by outlining the main socio-economic trends of the pharmaceutical industry, and by highlighting the life-cycle stages of a pharmaceutical product in which technological modernization can help both achieve consistently high product quality and increase return on investment. Then, we review the historical evolution of the pharmaceutical regulatory framework, and we discuss the current state of implementation and future trends of QbD. The pharmaceutical emerging technology is reviewed afterwards, and a discussion on the evolution of QbD into the more effective quality-by-control (QbC) paradigm is presented. Further, we illustrate how mathematical modeling can support the implementation of QbD and QbC across all stages of the pharmaceutical life-cycle. In this respect, we review academic and industrial applications demonstrating the impact of mathematical modeling on three key activities within pharmaceutical development and manufacturing, namely design space description, process monitoring, and active process control. Finally, we discuss some future research opportunities on the use of mathematical modeling in industrial pharmaceutical environments.

Potential of Deep Learning Methods for Deep Level Particle Characterization in Crystallization

Crystalline particle properties, which are defined throughout the crystallization process chain, are strongly tied to the quality of the final product bringing along the need of detailed particle characterization. The most important characteristics are the size, shape and purity, which are influenced by agglomeration. Therefore, a pure size determination is often insufficient and a deep level evaluation regarding agglomerates and primary crystals bound in agglomerates is desirable as basis to increase the quality of crystalline products. We present a promising deep learning approach for particle characterization in crystallization. In an end-to-end fashion, the interactions and processing steps are minimized. Based on instance segmentation, all crystals containing single crystals, agglomerates and primary crystals in agglomerates are detected and classified with pixel-level accuracy. The deep learning approach shows superior performance to previous image analysis methods and reaches a new level of detail. In experimental studies, L-alanine is crystallized from aqueous solution. A detailed description of size and number of all particles including primary crystals is provided and characteristic measures for the level of agglomeration are given. This can lead to a better process understanding and has the potential to serve as cornerstone for kinetic studies.

Indirect monitoring of ultralow dose API content in continuous wet granulation and tableting by machine vision

This paper presents new machine vision-based methods for indirect real-time quantification of ultralow drug content during continuous twin-screw wet granulation and tableting. Granulation was performed with a solution containing carvedilol (CAR) as API in the ultralow dose range (0.05w/w% in the granule) and the addition of riboflavin (RI) as a coloured tracer. An in-line calibration in the range of 0.047-0.058 w/w% was prepared for the measurement of CAR concentration using colour analysis (CA) and particle size analysis (PSA), and the validation with HPLC resulted in respective relative errors of 2.62% and 2.30% showing great accuracy. To improve the technique, a second in-line calibration was conducted in a broader CAR concentration range of 0.039-0.063 w/w% utilizing only half the amount of RI (0.045 w/w%), while doubling the output of the granulation line to 2 kg/h, producing a relative error of 4.51% and 4.29%, respectively. Finally, it was shown that the CA technique can also be carried on to monitor the CAR content of tablets in the 42-62 μg dose range with a relative error of 5.20%. Machine vision was proven to be a potent indirect method for the in-line, determination and monitoring of ultralow API content during continuous manufacturing.

In-line cosmetic end-point detection of batch coating processes for colored tablets using multivariate image analysis

In this study, an in-line Process Analytical Technology (PAT) for cosmetic (non-functional) coating unit operations is developed using images of the tablet bed acquired in real-time by an inexpensive industrial camera and lighting system. The cosmetic end-point of multiple batches, run under different operating conditions, is automatically computed from these images using a Multivariate Image Analysis (MIA) methodology in conjunction with a stability determination strategy. The end-points detected by the algorithm differed, on average, by 3% in terms of total batch time from those identified visually by a trained operator. Since traditional practice typically relies on a coating overage to ensure full batch aspect homogeneity in the face of disturbances, the current in-line method can be used to reduce coating material and processing time (over 40% for the operating policy adopted in this work). Additionally, monitoring of the color features calculated by the algorithm allowed the identification of abnormal process conditions affecting visible coating uniformity. This work also addresses practical challenges related to image acquisition in the harsh environment of a pan coater, bringing this tool closer to a state of maturity for implementation in production units and opening the path for their optimization, monitoring, and automatic control.

Powder composition monitoring in continuous pharmaceutical solid-dosage form manufacturing using state estimation - Proof of concept

In continuous solid-dosage form manufacturing, the powder feeding system is responsible for supplying downstream the correct formulation of the drug product ingredients. The composition of the powder delivered by the feeding system is inferred from the measurements of powder mass flow from the system feeders. The mass flows are, in turn, inferred from the loss in weight measured in the feeder hoppers. Most loss-in-weight feeders post-process the mass flow signal to deliver a smoothed value to the user. However, such estimated mass flows can exhibit a low signal-to-noise ratio. As the feeders are critical elements of the control strategy of the manufacturing line, better instantaneous estimates of mass flow are desirable for improving the quality assurance. In this study, we propose a model-based approach for monitoring the composition of the powder fed to a continuous solid-dosage line. The monitoring system is based on a moving-horizon state estimator, which carries out model-based reconciliation of the feeder mass measurements, thus enabling accurate composition estimation of the powder mixture. Experimental datasets from a direct compression line are used to validate the methodology. Results demonstrate improvement with respect to current industrial solutions.

Image Analysis: A Versatile Tool in the Manufacturing and Quality Control of Pharmaceutical Dosage Forms

In pharmaceutical sciences, visual inspection is one of the oldest methods used for description in pharmacopeias and is still an important part of the characterization and qualification of active ingredients, excipients, and dosage forms. With the development of technology, it is now also possible to take images of various pharmaceutical dosage forms with different imaging methods in a size range that is hardly visible or completely invisible to the human eye. By analyzing high-quality designs, physicochemical processes can be understood, and the results can be used even in the optimization of the composition of the dosage form and in the development of its production. The present study aims to show some of the countless ways image analysis can be used in the manufacturing and quality assessment of different dosage forms. This summary also includes measurements and an evaluation of, amongst others, a less studied dosage form, medicated foams.