Machine Learning and Deep Learning Based Computational Approaches in Automatic Microorganisms Image Recognition: Methodologies, Challenges, and Developments

Joint use of population pharmacokinetics and machine learning for prediction of valproic acid plasma concentration in elderly epileptic patients

BACKGROUND

Valproic acid (VPA) is a commonly used broad-spectrum antiepileptic drug. For elderly epileptic patients, VPA plasma concentrations have a considerable variation. We aim to establish a prediction model via a combination of machine learning and population pharmacokinetics (PPK) for VPA plasma concentration.

METHODS

A retrospective study was performed incorporating 43 variables, including PPK parameters. Recursive Feature Elimination with Cross-Validation was used for feature selection. Multiple algorithms were employed for ensemble model, and the model was interpreted by Shapley Additive exPlanations.

RESULTS

The inclusion of PPK parameters significantly enhances the performance of individual algorithm model. The composition of categorical boosting, light gradient boosting machine, and random forest (7:2:1) with the highest R2 (0.74) was determined as the ensemble model. The model included 11 variables after feature selection, of which the predictive performance was comparable to the model that incorporated all variables.

CONCLUSIONS

Our model was specifically tailored for elderly epileptic patients, providing an efficient and cost-effective approach to predict VPA plasma concentration. The model combined classical PPK with machine learning, and underwent optimization through feature selection and algorithm integration. Our model can serve as a fundamental tool for clinicians in determining VPA plasma concentration and individualized dosing regimens accordingly.

Roadmap on computational methods in optical imaging and holography [invited]

Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging. In addition to registering the perspectives of the modern-day architects of the above research areas, the roadmap also reports some of the latest studies on the topic. Computational codes and pseudocodes are presented for computational methods in a plug-and-play fashion for readers to not only read and understand but also practice the latest algorithms with their data. We believe that this roadmap will be a valuable tool for analyzing the current trends in computational methods to predict and prepare the future of computational methods in optical imaging and holography.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00340-024-08280-3.

Enhancing museum experience through deep learning and multimedia technology

Amidst the swift progression of artificial intelligence (AI) technology, the museum sector has witnessed a notable inclination towards its adoption. This manuscript endeavours to amplify the interactive milieu of contemporary museum patrons by amalgamating a deep learning algorithm with multimedia technology. The crux of our investigation is the exploration of an adaptive convolutional neural network (CNN) to enrich the interactive engagement of museum visitors. Initially, we leverage the adaptive CNN for the image recognition chore pertaining to museum artifacts and exhibits, thereby facilitating automatic recognition and categorization. Furthermore, to surmount the constraints of conventional pooling algorithms in image feature extraction, we suggest an adaptive pooling algorithm, grounded in the maximum pooling algorithm paradigm. Subsequently, multimedia algorithms are amalgamated into the interactive apparatus, enabling visitors to immerse in exhibits and avail more profound information and experiences. Through juxtaposition with traditional image processing algorithms, the efficacy of our proposed algorithm within a museum ambiance is assessed. Experimental outcomes evince that our algorithm attains superior accuracy and robustness in artifact identification and classification endeavours. In comparison to alternative algorithms, our methodology furnishes more precise and comprehensive displays and interpretations, accurately discerning and categorizing a myriad of exhibit types. This research unveils innovative notions for the digital metamorphosis and advancement of modern museums. Through the incorporation of avant-garde deep learning algorithms and multimedia technologies, the museum visitor experience is elevated, proffering more enthralling and interactive displays. The elucidations of this manuscript hold substantial merit for the continual evolution and innovation within the museum industry.

U2-Net and ResNet50-Based Automatic Pipeline for Bacterial Colony Counting

In this paper, an automatic colony counting system based on an improved image preprocessing algorithm and convolutional neural network (CNN)-assisted automatic counting method was developed. Firstly, we assembled an LED backlighting illumination platform as an image capturing system to obtain photographs of laboratory cultures. Consequently, a dataset was introduced consisting of 390 photos of agar plate cultures, which included 8 microorganisms. Secondly, we implemented a new algorithm for image preprocessing based on light intensity correction, which facilitated clearer differentiation between colony and media areas. Thirdly, a U2-Net was used to predict the probability distribution of the edge of the Petri dish in images to locate region of interest (ROI), and then threshold segmentation was applied to separate it. This U2-Net achieved an F1 score of 99.5% and a mean absolute error (MAE) of 0.0033 on the validation set. Then, another U2-Net was used to separate the colony region within the ROI. This U2-Net achieved an F1 score of 96.5% and an MAE of 0.005 on the validation set. After that, the colony area was segmented into multiple components containing single or adhesive colonies. Finally, the colony components (CC) were innovatively rotated and the image crops were resized as the input (with 14,921 image crops in the training set and 4281 image crops in the validation set) for the ResNet50 network to automatically count the number of colonies. Our method achieved an overall recovery of 97.82% for colony counting and exhibited excellent performance in adhesion classification. To the best of our knowledge, the proposed "light intensity correction-based image preprocessing→U2-Net segmentation for Petri dish edge→U2-Net segmentation for colony region→ResNet50-based counting" scheme represents a new attempt and demonstrates a high degree of automation and accuracy in recognizing and counting single-colony and multi-colony targets.

Deep learning diagnostic performance and visual insights in differentiating benign and malignant thyroid nodules on ultrasound images

This study aims to construct and evaluate a deep learning model, utilizing ultrasound images, to accurately differentiate benign and malignant thyroid nodules. The objective includes visualizing the model's process for interpretability and comparing its diagnostic precision with a cohort of 80 radiologists. We employed ResNet as the classification backbone for thyroid nodule prediction. The model was trained using 2096 ultrasound images of 655 distinct thyroid nodules. For performance evaluation, an independent test set comprising 100 cases of thyroid nodules was curated. In addition, to demonstrate the superiority of the artificial intelligence (AI) model over radiologists, a Turing test was conducted with 80 radiologists of varying clinical experience. This was meant to assess which group of radiologists' conclusions were in closer alignment with AI predictions. Furthermore, to highlight the interpretability of the AI model, gradient-weighted class activation mapping (Grad-CAM) was employed to visualize the model's areas of focus during its prediction process. In this cohort, AI diagnostics demonstrated a sensitivity of 81.67%, a specificity of 60%, and an overall diagnostic accuracy of 73%. In comparison, the panel of radiologists on average exhibited a diagnostic accuracy of 62.9%. The AI's diagnostic process was significantly faster than that of the radiologists. The generated heat-maps highlighted the model's focus on areas characterized by calcification, solid echo and higher echo intensity, suggesting these areas might be indicative of malignant thyroid nodules. Our study supports the notion that deep learning can be a valuable diagnostic tool with comparable accuracy to experienced senior radiologists in the diagnosis of malignant thyroid nodules. The interpretability of the AI model's process suggests that it could be clinically meaningful. Further studies are necessary to improve diagnostic accuracy and support auxiliary diagnoses in primary care settings.

Opportunities and challenges for deep learning in cell dynamics research

The growth of artificial intelligence (AI) has led to an increase in the adoption of computer vision and deep learning (DL) techniques for the evaluation of microscopy images and movies. This adoption has not only addressed hurdles in quantitative analysis of dynamic cell biological processes but has also started to support advances in drug development, precision medicine, and genome-phenome mapping. We survey existing AI-based techniques and tools, as well as open-source datasets, with a specific focus on the computational tasks of segmentation, classification, and tracking of cellular and subcellular structures and dynamics. We summarise long-standing challenges in microscopy video analysis from a computational perspective and review emerging research frontiers and innovative applications for DL-guided automation in cell dynamics research.

An experimental setup and segmentation method for CFU counting on agar plate for the assessment of drinking water

Quantification of bacterial colonies on an agar plate is a daily routine for a microbiologist to determine the number of viable microorganisms in the sample. In general, microbiologists perform a visual assessment of bacterial colonies which is time-consuming (takes 2 min per plate), tedious, and subjective. Some automatic counting algorithms are developed that save labour and time, but their results are affected by the non-illumination on an agar plate. To improve this, the present manuscript aims to develop an inexpensive and efficient device to acquire S.aureus images via an automatic counting method using image processing techniques under real laboratory conditions. The proposed method (P_ColonyCount) includes the region of interest extraction and color space transformation followed by filtering, thresholding, morphological operation, distance transform, and watershed technique for the quantification of isolated and overlapping colonies. The present work also shows a comparative study on grayscale, K, and green channels by applying different filter and thresholding techniques on 42 images. The results of all channels were compared with the score provided by the expert (manual count). Out of all the proposed method (P_ColonyCount), the K channel gives the best outcome in comparison with the other two channels (grayscale and green) in terms of precision, recall, and F-measure which are 0.99, 0.99, and 0.99 (2 h), 0.98, 0.99, and 0.98 (4 h), and 0.98, 0.98, 0.98 (6 h) respectively. The execution time of the manual and the proposed method (P_ColonyCount) for 42 images ranges from 19 to 113 s and 15 to 31 s respectively. Apart from this, a user-friendly graphical user interface is also developed for the convenient enumeration of colonies without any expert knowledge/training. The developed imaging device will be useful for researchers and teaching lab settings.

Developments in Image Processing Using Deep Learning and Reinforcement Learning

The growth in the volume of data generated, consumed, and stored, which is estimated to exceed 180 zettabytes in 2025, represents a major challenge both for organizations and for society in general. In addition to being larger, datasets are increasingly complex, bringing new theoretical and computational challenges. Alongside this evolution, data science tools have exploded in popularity over the past two decades due to their myriad of applications when dealing with complex data, their high accuracy, flexible customization, and excellent adaptability. When it comes to images, data analysis presents additional challenges because as the quality of an image increases, which is desirable, so does the volume of data to be processed. Although classic machine learning (ML) techniques are still widely used in different research fields and industries, there has been great interest from the scientific community in the development of new artificial intelligence (AI) techniques. The resurgence of neural networks has boosted remarkable advances in areas such as the understanding and processing of images. In this study, we conducted a comprehensive survey regarding advances in AI design and the optimization solutions proposed to deal with image processing challenges. Despite the good results that have been achieved, there are still many challenges to face in this field of study. In this work, we discuss the main and more recent improvements, applications, and developments when targeting image processing applications, and we propose future research directions in this field of constant and fast evolution.

Yeast cell detection using fuzzy automatic contrast enhancement (FACE) and you only look once (YOLO)

In contemporary biomedical research, the accurate automatic detection of cells within intricate microscopic imagery stands as a cornerstone for scientific advancement. Leveraging state-of-the-art deep learning techniques, this study introduces a novel amalgamation of Fuzzy Automatic Contrast Enhancement (FACE) and the You Only Look Once (YOLO) framework to address this critical challenge of automatic cell detection. Yeast cells, representing a vital component of the fungi family, hold profound significance in elucidating the intricacies of eukaryotic cells and human biology. The proposed methodology introduces a paradigm shift in cell detection by optimizing image contrast through optimal fuzzy clustering within the FACE approach. This advancement mitigates the shortcomings of conventional contrast enhancement techniques, minimizing artifacts and suboptimal outcomes. Further enhancing contrast, a universal contrast enhancement variable is ingeniously introduced, enriching image clarity with automatic precision. Experimental validation encompasses a diverse range of yeast cell images subjected to rigorous quantitative assessment via Root-Mean-Square Contrast and Root-Mean-Square Deviation (RMSD). Comparative analyses against conventional enhancement methods showcase the superior performance of the FACE-enhanced images. Notably, the integration of the innovative You Only Look Once (YOLOv5) facilitates automatic cell detection within a finely partitioned grid system. This leads to the development of two models-one operating on pristine raw images, the other harnessing the enriched landscape of FACE-enhanced imagery. Strikingly, the FACE enhancement achieves exceptional accuracy in automatic yeast cell detection by YOLOv5 across both raw and enhanced images. Comprehensive performance evaluations encompassing tenfold accuracy assessments and confidence scoring substantiate the robustness of the FACE-YOLO model. Notably, the integration of FACE-enhanced images serves as a catalyst, significantly elevating the performance of YOLOv5 detection. Complementing these efforts, OpenCV lends computational acumen to delineate precise yeast cell contours and coordinates, augmenting the precision of cell detection.

An Efficient and Effective Framework for Intestinal Parasite Egg Detection Using YOLOv5

Intestinal parasitic infections pose a grave threat to human health, particularly in tropical and subtropical regions. The traditional manual microscopy system of intestinal parasite detection remains the gold standard procedure for diagnosing parasite cysts or eggs. This approach is costly, time-consuming (30 min per sample), highly tedious, and requires a specialist. However, computer vision, based on deep learning, has made great strides in recent years. Despite the significant advances in deep convolutional neural network-based architectures, little research has been conducted to explore these techniques' potential in parasitology, specifically for intestinal parasites. This research presents a novel proposal for state-of-the-art transfer learning architecture for the detection and classification of intestinal parasite eggs from images. The ultimate goal is to ensure prompt treatment for patients while also alleviating the burden on experts. Our approach comprised two main stages: image pre-processing and augmentation in the first stage, and YOLOv5 algorithms for detection and classification in the second stage, followed by performance comparison based on different parameters. Remarkably, our algorithms achieved a mean average precision of approximately 97% and a detection time of only 8.5 ms per sample for a dataset of 5393 intestinal parasite images. This innovative approach holds tremendous potential to form a solid theoretical basis for real-time detection and classification in routine clinical examinations, addressing the increasing demand and accelerating the diagnostic process. Our research contributes to the development of cutting-edge technologies for the efficient and accurate detection of intestinal parasite eggs, advancing the field of medical imaging and diagnosis.

Predicting plasma concentration of quetiapine in patients with depression using machine learning techniques based on real-world evidence

OBJECTIVES

We develop a model for predicting quetiapine levels in patients with depression, using machine learning to support decisions on clinical regimens.

METHODS

Inpatients diagnosed with depression at the First Hospital of Hebei Medical University from 1 November 2019, to 31 August were enrolled. The ratio of training cohort to testing cohort was fixed at 80%:20% for the whole dataset. Univariate analysis was executed on all information to screen the important variables influencing quetiapine TDM. The prediction abilities of nine machine learning and deep learning algorithms were compared. The prediction model was created using an algorithm with better model performance, and the model's interpretation was done using the SHapley Additive exPlanation.

RESULTS

There were 333 individuals and 412 cases of quetiapine TDM included in the study. Six significant variables were selected to establish the individualized medication model. A quetiapine concentration prediction model was created through CatBoost. In the testing cohort, the projected TDM's accuracy was 61.45%. The prediction accuracy of quetiapine concentration within the effective range (200-750 ng/mL) was 75.47%.

CONCLUSIONS

This study predicts the plasma concentration of quetiapine in depression patients by machine learning, which is meaningful for the clinical medication guidance.

A Comprehensive Survey with Quantitative Comparison of Image Analysis Methods for Microorganism Biovolume Measurements

With the acceleration of urbanization and living standards, microorganisms play an increasingly important role in industrial production, bio-technique, and food safety testing. Microorganism biovolume measurements are one of the essential parts of microbial analysis. However, traditional manual measurement methods are time-consuming and challenging to measure the characteristics precisely. With the development of digital image processing techniques, the characteristics of the microbial population can be detected and quantified. The applications of the microorganism biovolume measurement method have developed since the 1980s. More than 62 articles are reviewed in this study, and the articles are grouped by digital image analysis methods with time. This study has high research significance and application value, which can be referred to as microbial researchers to comprehensively understand microorganism biovolume measurements using digital image analysis methods and potential applications.

Construction and Interpretation of Prediction Model of Teicoplanin Trough Concentration via Machine Learning

Objective

To establish an optimal model to predict the teicoplanin trough concentrations by machine learning, and explain the feature importance in the prediction model using the SHapley Additive exPlanation (SHAP) method.

Methods

A retrospective study was performed on 279 therapeutic drug monitoring (TDM) measurements obtained from 192 patients who were treated with teicoplanin intravenously at the First Affiliated Hospital of Army Medical University from November 2017 to July 2021. This study included 27 variables, and the teicoplanin trough concentrations were considered as the target variable. The whole dataset was divided into a training group and testing group at the ratio of 8:2, and predictive performance was compared among six different algorithms. Algorithms with higher model performance (top 3) were selected to establish the ensemble prediction model and SHAP was employed to interpret the model.

Results

Three algorithms (SVR, GBRT, and RF) with high R² scores (0.676, 0.670, and 0.656, respectively) were selected to construct the ensemble model at the ratio of 6:3:1. The model with R² = 0.720, MAE = 3.628, MSE = 22.571, absolute accuracy of 83.93%, and relative accuracy of 60.71% was obtained, which performed better in model fitting and had better prediction accuracy than any single algorithm. The feature importance and direction of each variable were visually demonstrated by SHAP values, in which teicoplanin administration and renal function were the most important factors.

Conclusion

We firstly adopted a machine learning approach to predict the teicoplanin trough concentration, and interpreted the prediction model by the SHAP method, which is of great significance and value for the clinical medication guidance.

Mitigating spread of contamination in meat supply chain management using deep learning

Industry 4.0 recommends a paradigm shift from traditional manufacturing to automated industrial practices, especially in different parts of supply chain management. Besides, the Sustainable Development Goal (SDG) 12 underscores the urgency of ensuring a sustainable supply chain with novel technologies including Artificial Intelligence to decrease food loss, which has the potential of mitigating food waste. These new technologies can increase productivity, especially in perishable products of the supply chain by reducing expenses, increasing the accuracy of operations, accelerating processes, and decreasing the carbon footprint of food. Artificial intelligence techniques such as deep learning can be utilized in various sections of meat supply chain management--where highly perishable products like spoiled meat need to be separated from wholesome ones to prevent cross-contamination with food-borne pathogens. Therefore, to automate this process and prevent meat spoilage and/or improve meat shelf life which is crucial to consumer meat preferences and sustainable consumption, a classification model was trained by the DCNN and PSO algorithms with 100% accuracy, which discerns wholesome meat from spoiled ones.

Automated Bacterial Classifications Using Machine Learning Based Computational Techniques: Architectures, Challenges and Open Research Issues

Bacteria are important in a variety of practical domains, including industry, agriculture, medicine etc. A very few species of bacteria are favourable to humans. Whereas, majority of them are extremely dangerous and causes variety of life threatening illness to different living organisms. Traditionally, this class of microbes is detected and classified using different approaches like gram staining, biochemical testing, motility testing etc. However with the availability of large amount of data and technical advances in the field of medical and computer science, the machine learning methods have been widely used and have shown tremendous performance in automatic detection of bacteria. The inclusion of latest technology employing different Artificial Intelligence techniques are greatly assisting microbiologist in solving extremely complex problems in this domain. This paper presents a review of the literature on various machine learning approaches that have been used to classify bacteria, for the period 1998-2020. The resources include research papers and book chapters from different publishers of national and international repute such as Elsevier, Springer, IEEE, PLOS, etc. The study carried out a detailed and critical analysis of penetrating different Machine learning methodologies in the field of bacterial classification along with their limitations and future scope. In addition, different opportunities and challenges in implementing these techniques in the concerned field are also presented to provide a deep insight to the researchers working in this field.