Comparison of traditional image processing and deep learning approaches for classification of white blood cells in peripheral blood smear images

Automated Blood Cell Detection and Classification in Microscopic Images Using YOLOv11 and Optimized Weights

Background/Objectives: Accurate detection and classification of blood cell types in microscopic images are crucial for diagnosing various hematological conditions. This study aims to develop and evaluate advanced architectures for automating blood cell detection and classification using the newly proposed YOLOv10 and YOLOv11 models, with a specific focus on identifying red blood cells (RBCs), white blood cells (WBCs), and platelets in microscopic images as a preliminary step of the complete blood count (CBC). Methods: The Blood Cell Count Detection (BCCD) dataset was enriched using data augmentation techniques to improve model robustness and diversity. Extensive experiments were performed, including complete weight initialization, advanced optimization strategies, and meticulous hyperparameter tuning for the YOLOv11 architecture. Results: The YOLOv11-l model achieved an overall mean Average Precision (mAP) of 93.8%, reflecting its robust accuracy across multiple blood cell types. Conclusions: The findings underscore the efficacy of the YOLOv11 architecture in automating blood cell classification with high precision, demonstrating its potential to enhance hematological analyses and support clinical diagnosis.

Engineered feature embeddings meet deep learning: A novel strategy to improve bone marrow cell classification and model transparency

Cytomorphology evaluation of bone marrow cell is the initial step to diagnose different hematological diseases. This assessment is still manually performed by trained specialists, who may be a bottleneck within the clinical process. Deep learning algorithms are a promising approach to automate this bone marrow cell evaluation. These artificial intelligence models have focused on limited cell subtypes, mainly associated to a particular disease, and are frequently presented as black boxes. The herein introduced strategy presents an engineered feature representation, the region-attention embedding, which improves the deep learning classification performance of a cytomorphology with 21 bone marrow cell subtypes. This embedding is built upon a specific organization of cytology features within a squared matrix by distributing them after pre-segmented cell regions, i.e., cytoplasm, nucleus, and whole-cell. This novel cell image representation, aimed to preserve spatial/regional relations, is used as input of the network. Combination of region-attention embedding and deep learning networks (Xception and ResNet50) provides local relevance associated to image regions, adding up interpretable information to the prediction. Additionally, this approach is evaluated in a public database with the largest number of cell subtypes (21) by a thorough evaluation scheme with three iterations of a 3-fold cross-validation, performed in 80% of the images (n = 89,484), and a testing process in an unseen set of images composed by the remaining 20% of the images (n = 22,371). This evaluation process demonstrates the introduced strategy outperforms previously published approaches in an equivalent validation set, with a f1-score of 0.82, and presented competitive results on the unseen data partition with a f1-score of 0.56.

AML leukocyte classification method for small samples based on ACGAN

Leukemia is a class of hematologic malignancies, of which acute myeloid leukemia (AML) is the most common. Screening and diagnosis of AML are performed by microscopic examination or chemical testing of images of the patient's peripheral blood smear. In smear-microscopy, the ability to quickly identify, count, and differentiate different types of blood cells is critical for disease diagnosis. With the development of deep learning (DL), classification techniques based on neural networks have been applied to the recognition of blood cells. However, DL methods have high requirements for the number of valid datasets. This study aims to assess the applicability of the auxiliary classification generative adversarial network (ACGAN) in the classification task for small samples of white blood cells. The method is trained on the TCIA dataset, and the classification accuracy is compared with two classical classifiers and the current state-of-the-art methods. The results are evaluated using accuracy, precision, recall, and F1 score. The accuracy of the ACGAN on the validation set is 97.1 % and the precision, recall, and F1 scores on the validation set are 97.5 , 97.3, and 97.4 %, respectively. In addition, ACGAN received a higher score in comparison with other advanced methods, which can indicate that it is competitive in classification accuracy.

An Innovative Hybrid Model for Automatic Detection of White Blood Cells in Clinical Laboratories

Background: Microscopic examination of peripheral blood is a standard practice in clinical medicine. Although manual examination is considered the gold standard, it presents several disadvantages, such as interobserver variability, being quite time-consuming, and requiring well-trained professionals. New automatic digital algorithms have been developed to eliminate the disadvantages of manual examination and improve the workload of clinical laboratories. Objectives: Regular analysis of peripheral blood cells and careful interpretation of their results are critical for protecting individual health and early diagnosis of diseases. Because many diseases can occur due to this, this study aims to detect white blood cells automatically. Methods: A hybrid model has been developed for this purpose. In the developed model, feature extraction has been performed with MobileNetV2 and EfficientNetb0 architectures. In the next step, the neighborhood component analysis (NCA) method eliminated unnecessary features in the feature maps so that the model could work faster. Then, different features of the same image were combined, and the extracted features were combined to increase the model's performance. Results: The optimized feature map was classified into different classifiers in the last step. The proposed model obtained a competitive accuracy value of 95.6%. Conclusions: The results obtained in the proposed model show that the proposed model can be used in the detection of white blood cells.

Toward Digital Periodontal Health: Recent Advances and Future Perspectives

Periodontal diseases, ranging from gingivitis to periodontitis, are prevalent oral diseases affecting over 50% of the global population. These diseases arise from infections and inflammation of the gums and supporting bones, significantly impacting oral health. The established link between periodontal diseases and systemic diseases, such as cardiovascular diseases, underscores their importance as a public health concern. Consequently, the early detection and prevention of periodontal diseases have become critical objectives in healthcare, particularly through the integration of advanced artificial intelligence (AI) technologies. This paper aims to bridge the gap between clinical practices and cutting-edge technologies by providing a comprehensive review of current research. We examine the identification of causative factors, disease progression, and the role of AI in enhancing early detection and treatment. Our goal is to underscore the importance of early intervention in improving patient outcomes and to stimulate further interest among researchers, bioengineers, and AI specialists in the ongoing exploration of AI applications in periodontal disease diagnosis.

Comprehensive data analysis of white blood cells with classification and segmentation by using deep learning approaches

Deep learning approaches have frequently been used in the classification and segmentation of human peripheral blood cells. The common feature of previous studies was that they used more than one dataset, but used them separately. No study has been found that combines more than two datasets to use together. In classification, five types of white blood cells were identified by using a mixture of four different datasets. In segmentation, four types of white blood cells were determined, and three different neural networks, including CNN (Convolutional Neural Network), UNet and SegNet, were applied. The classification results of the presented study were compared with those of related studies. The balanced accuracy was 98.03%, and the test accuracy of the train-independent dataset was determined to be 97.27%. For segmentation, accuracy rates of 98.9% for train-dependent dataset and 92.82% for train-independent dataset for the proposed CNN were obtained in both nucleus and cytoplasm detection. In the presented study, the proposed method showed that it could detect white blood cells from a train-independent dataset with high accuracy. Additionally, it is promising as a diagnostic tool that can be used in the clinical field, with successful results in classification and segmentation.

Fluorescent chemosensors facilitate the visualization of plant health and their living environment in sustainable agriculture

Globally, 91% of plant production encounters diverse environmental stresses that adversely affect their growth, leading to severe yield losses of 50-60%. In this case, monitoring the connection between the environment and plant health can balance population demands with environmental protection and resource distribution. Fluorescent chemosensors have shown great progress in monitoring the health and environment of plants due to their high sensitivity and biocompatibility. However, to date, no comprehensive analysis and systematic summary of fluorescent chemosensors used in monitoring the correlation between plant health and their environment have been reported. Thus, herein, we summarize the current fluorescent chemosensors ranging from their design strategies to applications in monitoring plant-environment interaction processes. First, we highlight the types of fluorescent chemosensors with design strategies to resolve the bottlenecks encountered in monitoring the health and living environment of plants. In addition, the applications of fluorescent small-molecule, nano and supramolecular chemosensors in the visualization of the health and living environment of plants are discussed. Finally, the major challenges and perspectives in this field are presented. This work will provide guidance for the design of efficient fluorescent chemosensors to monitor plant health, and then promote sustainable agricultural development.

Hematologic cancer diagnosis and classification using machine and deep learning: State-of-the-art techniques and emerging research directives

Hematology is the study of diagnosis and treatment options for blood diseases, including cancer. Cancer is considered one of the deadliest diseases across all age categories. Diagnosing such a deadly disease at the initial stage is essential to cure the disease. Hematologists and pathologists rely on microscopic evaluation of blood or bone marrow smear images to diagnose blood-related ailments. The abundance of overlapping cells, cells of varying densities among platelets, non-illumination levels, and the amount of red and white blood cells make it more difficult to diagnose illness using blood cell images. Pathologists are required to put more effort into the traditional, time-consuming system. Nowadays, it becomes possible with machine learning and deep learning techniques, to automate the diagnostic processes, categorize microscopic blood cells, and improve the accuracy of the procedure and its speed as the models developed using these methods may guide an assisting tool. In this article, we have acquired, analyzed, scrutinized, and finally selected around 57 research papers from various machine learning and deep learning methodologies that have been employed in the diagnosis of leukemia and its classification over the past 20 years, which have been published between the years 2003 and 2023 by PubMed, IEEE, Science Direct, Google Scholar and other pertinent sources. Our primary emphasis is on evaluating the advantages and limitations of analogous research endeavors to provide a concise and valuable research directive that can be of significant utility to fellow researchers in the field.

Efficient leukocytes detection and classification in microscopic blood images using convolutional neural network coupled with a dual attention network

Leukocytes, also called White Blood Cells (WBCs) or leucocytes, are the cells that play a pivotal role in human health and are vital indicators of diseases such as malaria, leukemia, AIDS, and other viral infections. WBCs detection and classification in blood smears offers insights to pathologists, aiding diagnosis across medical conditions. Traditional techniques, including manual counting, detection, classification, and visual inspection of microscopic images by medical professionals, pose challenges due to their labor-intensive nature. However, traditional methods are time consuming and sometimes susceptible to errors. Here, we propose a high-performance convolutional neural network (CNN) coupled with a dual-attention network that efficiently detects and classifies WBCs in microscopic thick smear images. The main aim of this study was to enhance clinical hematology systems and expedite medical diagnostic processes. In the proposed technique, we utilized a deep convolutional generative adversarial network (DCGAN) to overcome the limitations imposed by limited training data and employed a dual attention mechanism to improve accuracy, efficiency, and generalization. The proposed technique achieved overall accuracy rates of 99.83%, 99.35%, and 99.60% for the peripheral blood cell (PBC), leukocyte images for segmentation and classification (LISC), and Raabin-WBC benchmark datasets, respectively. Our proposed approach outperforms state-of-the-art methods in terms of accuracy, highlighting the effectiveness of the strategies employed and their potential to enhance diagnostic capabilities and advance real-world healthcare practices and diagnostic systems.

Comprehensive quantitative analysis of erythrocytes and leukocytes using trace volume of human blood using microfluidic-image cytometry and machine learning

A diagnostic test based on microfluidic image cytometry and machine learning has been designed and applied for accurate classification of erythrocytes and leukocytes, including a unique fully-automated 5-part quantitative differentiation into neutrophils, lymphocytes, monocytes, eosinophils, and basophils, using minute amounts of whole blood in a single counting chamber. A low-cost disposable multilayer microdevice for microfluidic image cytometry was developed that comprises a 1 mm × 22 mm × 70 μm (w × l × h) rectangular microchannel, allowing the analysis of trace volume of blood (20 μL) for each assay. Automated analysis of digitized binary images applying a border following algorithm was performed allowing the qualitative analysis of erythrocytes. Bright-field imaging was used for the detection of erythrocytes and fluorescence imaging for 5-part differentiation of leukocytes after acridine orange staining, applying a convolutional neural network enabling unparalleled speed for identification and automated morphology classification yielding 98.57% accuracy. Blood samples were obtained from 30 volunteers and count values did not significantly differ from data obtained using a commercial automated hematology analyzer.

Explainable CAD System for Classification of Acute Lymphoblastic Leukemia Based on a Robust White Blood Cell Segmentation

Leukemia is a significant health challenge, with high incidence and mortality rates. Computer-aided diagnosis (CAD) has emerged as a promising approach. However, deep-learning methods suffer from the "black box problem", leading to unreliable diagnoses. This research proposes an Explainable AI (XAI) Leukemia classification method that addresses this issue by incorporating a robust White Blood Cell (WBC) nuclei segmentation as a hard attention mechanism. The segmentation of WBC is achieved by combining image processing and U-Net techniques, resulting in improved overall performance. The segmented images are fed into modified ResNet-50 models, where the MLP classifier, activation functions, and training scheme have been tested for leukemia subtype classification. Additionally, we add visual explainability and feature space analysis techniques to offer an interpretable classification. Our segmentation algorithm achieves an Intersection over Union (IoU) of 0.91, in six databases. Furthermore, the deep-learning classifier achieves an accuracy of 99.9% on testing. The Grad CAM methods and clustering space analysis confirm improved network focus when classifying segmented images compared to non-segmented images. Overall, the proposed visual explainable CAD system has the potential to assist physicians in diagnosing leukemia and improving patient outcomes.

Digital assessment of peripheral blood and bone marrow aspirate smears

The diagnosis of benign and neoplastic hematologic disorders relies on analysis of peripheral blood and bone marrow aspirate smears. As demonstrated by the widespread laboratory adoption of hematology analyzers for automated assessment of peripheral blood, digital analysis of these samples provides many significant benefits compared to relying solely on manual review. Nonetheless, analogous instruments for digital bone marrow aspirate smear assessment have yet to be clinically implemented. In this review, we first provide a historical overview detailing the implementation of hematology analyzers for digital peripheral blood assessment in the clinical laboratory, including the improvements in accuracy, scope, and throughput of current instruments over prior generations. We also describe recent research in digital peripheral blood assessment, particularly in the development of advanced machine learning models that may soon be incorporated into commercial instruments. Next, we provide an overview of recent research in digital assessment of bone marrow aspirate smears and how these approaches could soon lead to development and clinical adoption of instrumentation for automated bone marrow aspirate smear analysis. Finally, we describe the relative advantages and provide our vision for the future of digital assessment of peripheral blood and bone marrow aspirate smears, including what improvements we can soon expect in the hematology laboratory.

Artificial intelligence-assisted diagnosis of hematologic diseases based on bone marrow smears using deep neural networks

BACKGROUND AND OBJECTIVES

The morphological examination of bone marrow (BM) cells is essential in both diagnosing and treating various hematologic diseases. However, it is still done manually with a heavy workload. An artificial intelligence-assisted diagnosis support system of BM cells is highly required to reduce the workloads of examiners and improve the reproducibility of the results.

METHODS

In this paper, we proposed an artificial intelligence-assisted diagnosis support system of morphological examination based on bone marrow smears including cells detection, classification and prediction of leukemia types. For cell detection, we trained the novel YOLOX-s model to locate cells precisely and obtain single cell images. For cell classification, we regarded it as a fine- grained classification task and proposed a novel architecture called MLFL-Net utilizing multi-level features. Furthermore, we predicted the leukemia types on a dataset including 40 normal people (BM transplantation donors) and 40 patients of different kinds of acute leukemia according to the World Health Organization (WHO) standard.

RESULTS

We constructed a large-scale data set of 11,788 fully-annotated micrographs from 728 smears and 131,300 expert-annotated single cell images. With the data set, the detection model achieved 0.9797 AUC and 4.33% box placement error. For cell classification, the total accuracy of our proposed MLFL-Net reached 89.53% which outperformed all the other related models in identifying cell categories. In the meantime, we took acute leukemia as an example to explore the leukemia types prediction procedure of hematological disease. It generated the same diagnostic prediction as the experts gave for 92.5 percent of the cohort.

CONCLUSION

This Artificial Intelligence-assisted system can be implemented to aid in clinical decision making and accelerate diagnosis. The method will contribute to promote the intelligence and modernization of BM cytomorphology, which has vital significance of the development of the medical career.

Machine Learning-Based Detection of Dengue from Blood Smear Images Utilizing Platelet and Lymphocyte Characteristics

Dengue fever, also known as break-bone fever, can be life-threatening. Caused by DENV, an RNA virus from the Flaviviridae family, dengue is currently a globally important public health problem. The clinical methods available for dengue diagnosis require skilled supervision. They are manual, time-consuming, labor-intensive, and not affordable to common people. This paper describes a method that can support clinicians during dengue diagnosis. It is proposed to automate the peripheral blood smear (PBS) examination using Artificial Intelligence (AI) to aid dengue diagnosis. Nowadays, AI, especially Machine Learning (ML), is increasingly being explored for successful analyses in the biomedical field. Digital pathology coupled with AI holds great potential in developing healthcare services. The automation system developed incorporates a blob detection method to detect platelets and thrombocytopenia from the PBS images. The results achieved are clinically acceptable. Moreover, an ML-based technique is proposed to detect dengue from the images of PBS based on the lymphocyte nucleus. Ten features are extracted, including six morphological and four Gray Level Spatial Dependance Matrix (GLSDM) features, out of the lymphocyte nucleus of normal and dengue cases. Features are then subjected to various popular supervised classifiers built using a ten-fold cross-validation policy for automated dengue detection. Among all the classifiers, the best performance was achieved by Support Vector Machine (SVM) and Decision Tree (DT), each with an accuracy of 93.62%. Furthermore, 1000 deep features extracted using pre-trained MobileNetV2 and 177 textural features extracted using Local binary pattern (LBP) from the lymphocyte nucleus are subjected to feature selection. The ReliefF selected 100 most significant features are then fed to the classifiers. The best performance was attained using an SVM classifier with 95.74% accuracy. With the obtained results, it is evident that this proposed approach can efficiently contribute as an adjuvant tool for diagnosing dengue from the digital microscopic images of PBS.

VGGNet-Cnn based classification of white blood cell leukemia with efficient salp swarm optimization algorithm

White blood cell (WBC) leukemia is caused by an excess of leukocytes in the bone marrow, and image-based identification of malignant WBCs is important for its detection. This research describes a new hybrid technique for accurate classification of WBC leukemia. To increase the image quality, the preprocessing is done using Contrast Limited Adaptive Histogram Equalization (CLAHE). The images are then segmented using Hidden Markov Random Fields (HMRF). To extract features from WBC images, Visual Geometry Group Network (VGGNet), a powerful Convolutional Neural Network (CNN) architecture, is used After that, an Efficient Salp Swarm Algorithm (ESSA) is used to optimize the extracted features. The proposed method is tested on two Acute Lymphoblastic Leukemia Image Databases, yielding good accuracy of 98.1% for dataset 1 and 98.8% for dataset 2. While enhancing accuracy, the ESSA optimization picked just 1K out of 25K features retrieved with VGGNet. The combination of CNN feature extraction with ESSA feature optimization could be effective for a variety of additional image classification tasks.

Deep Learning in Medical Hyperspectral Images: A Review

With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.

Standardized and axially vascularized calcium phosphate-based implants for segmental mandibular defects: A promising proof of concept

The reconstruction of massive segmental mandibular bone defects (SMDs) remains challenging even today; the current gold standard in human clinics being vascularized bone transplantation (VBT). As alternative to this onerous approach, bone tissue engineering strategies have been widely investigated. However, they displayed limited clinical success, particularly in failing to address the essential problem of quick vascularization of the implant. Although routinely used in clinics, the insertion of intrinsic vascularization in bioengineered constructs for the rapid formation of a feeding angiosome remains uncommon. In a clinically relevant model (sheep), a custom calcium phosphate-based bioceramic soaked with autologous bone marrow and perfused by an arteriovenous loop was tested to regenerate a massive SMD and was compared to VBT (clinical standard). Animals did not support well the VBT treatment, and the study was aborted 2 weeks after surgery due to ethical and animal welfare considerations. SMD regeneration was successful with the custom vascularized bone construct. Implants were well osseointegrated and vascularized after only 3 months of implantation and totally entrapped in lamellar bone after 12 months; a healthy yellow bone marrow filled the remaining space. STATEMENT OF SIGNIFICANCE: Regenerative medicine struggles with the generation of large functional bone volume. Among them segmental mandibular defects are particularly challenging to restore. The standard of care, based on bone free flaps, still displays ethical and technical drawbacks (e.g., donor site morbidity). Modern engineering technologies (e.g., 3D printing, digital chain) were combined to relevant surgical techniques to provide a pre-clinical proof of concept, investigating for the benefits of such a strategy in bone-related regenerative field. Results proved that a synthetic-biologics-free approach is able to regenerate a critical size segmental mandibular defect of 15 cm³ in a relevant preclinical model, mimicking real life scenarii of segmental mandibular defect, with a full physiological regeneration of the defect after 12 months.

An efficient computer vision-based approach for acute lymphoblastic leukemia prediction

Leukemia (blood cancer) diseases arise when the number of White blood cells (WBCs) is imbalanced in the human body. When the bone marrow produces many immature WBCs that kill healthy cells, acute lymphocytic leukemia (ALL) impacts people of all ages. Thus, timely predicting this disease can increase the chance of survival, and the patient can get his therapy early. Manual prediction is very expensive and time-consuming. Therefore, automated prediction techniques are essential. In this research, we propose an ensemble automated prediction approach that uses four machine learning algorithms K-Nearest Neighbor (KNN), Support Vector Machine (SVM), Random Forest (RF), and Naive Bayes (NB). The C-NMC leukemia dataset is used from the Kaggle repository to predict leukemia. Dataset is divided into two classes cancer and healthy cells. We perform data preprocessing steps, such as the first images being cropped using minimum and maximum points. Feature extraction is performed to extract the feature using pre-trained Convolutional Neural Network-based Deep Neural Network (DNN) architectures (VGG19, ResNet50, or ResNet101). Data scaling is performed by using the MinMaxScaler normalization technique. Analysis of Variance (ANOVA), Recursive Feature Elimination (RFE), and Random Forest (RF) as feature Selection techniques. Classification machine learning algorithms and ensemble voting are applied to selected features. Results reveal that SVM with 90.0% accuracy outperforms compared to other algorithms.

Vision-Based Detection and Classification of Used Electronic Parts

Economic and environmental sustainability is becoming increasingly important in today's world. Electronic waste (e-waste) is on the rise and options to reuse parts should be explored. Hence, this paper presents the development of vision-based methods for the detection and classification of used electronics parts. In particular, the problem of classifying commonly used and relatively expensive electronic project parts such as capacitors, potentiometers, and voltage regulator ICs is investigated. A multiple object workspace scenario with an overhead camera is investigated. A customized object detection algorithm determines regions of interest and extracts data for classification. Three classification methods are explored: (a) shallow neural networks (SNNs), (b) support vector machines (SVMs), and (c) deep learning with convolutional neural networks (CNNs). All three methods utilize 30 × 30-pixel grayscale image inputs. Shallow neural networks achieved the lowest overall accuracy of 85.6%. The SVM implementation produced its best results using a cubic kernel and principal component analysis (PCA) with 20 features. An overall accuracy of 95.2% was achieved with this setting. The deep learning CNN model has three convolution layers, two pooling layers, one fully connected layer, softmax, and a classification layer. The convolution layer filter size was set to four and adjusting the number of filters produced little variation in accuracy. An overall accuracy of 98.1% was achieved with the CNN model.

Classification of White Blood Cells: A Comprehensive Study Using Transfer Learning Based on Convolutional Neural Networks

White blood cells (WBCs) in the human immune system defend against infection and protect the body from external hazardous objects. They are comprised of neutrophils, eosinophils, basophils, monocytes, and lymphocytes, whereby each accounts for a distinct percentage and performs specific functions. Traditionally, the clinical laboratory procedure for quantifying the specific types of white blood cells is an integral part of a complete blood count (CBC) test, which aids in monitoring the health of people. With the advancements in deep learning, blood film images can be classified in less time and with high accuracy using various algorithms. This paper exploits a number of state-of-the-art deep learning models and their variations based on CNN architecture. A comparative study on model performance based on accuracy, F1-score, recall, precision, number of parameters, and time was conducted, and DenseNet161 was found to demonstrate a superior performance among its counterparts. In addition, advanced optimization techniques such as normalization, mixed-up augmentation, and label smoothing were also employed on DenseNet to further refine its performance.

Advances and challenges in automated malaria diagnosis using digital microscopy imaging with artificial intelligence tools: A review

Malaria is an infectious disease caused by parasites of the genus Plasmodium spp. It is transmitted to humans by the bite of an infected female Anopheles mosquito. It is the most common disease in resource-poor settings, with 241 million malaria cases reported in 2020 according to the World Health Organization. Optical microscopy examination of blood smears is the gold standard technique for malaria diagnosis; however, it is a time-consuming method and a well-trained microscopist is needed to perform the microbiological diagnosis. New techniques based on digital imaging analysis by deep learning and artificial intelligence methods are a challenging alternative tool for the diagnosis of infectious diseases. In particular, systems based on Convolutional Neural Networks for image detection of the malaria parasites emulate the microscopy visualization of an expert. Microscope automation provides a fast and low-cost diagnosis, requiring less supervision. Smartphones are a suitable option for microscopic diagnosis, allowing image capture and software identification of parasites. In addition, image analysis techniques could be a fast and optimal solution for the diagnosis of malaria, tuberculosis, or Neglected Tropical Diseases in endemic areas with low resources. The implementation of automated diagnosis by using smartphone applications and new digital imaging technologies in low-income areas is a challenge to achieve. Moreover, automating the movement of the microscope slide and image autofocusing of the samples by hardware implementation would systemize the procedure. These new diagnostic tools would join the global effort to fight against pandemic malaria and other infectious and poverty-related diseases.

Machine learning-based detection of label-free cancer stem-like cell fate

The detection of cancer stem-like cells (CSCs) is mainly based on molecular markers or functional tests giving a posteriori results. Therefore label-free and real-time detection of single CSCs remains a difficult challenge. The recent development of microfluidics has made it possible to perform high-throughput single cell imaging under controlled conditions and geometries. Such a throughput requires adapted image analysis pipelines while providing the necessary amount of data for the development of machine-learning algorithms. In this paper, we provide a data-driven study to assess the complexity of brightfield time-lapses to monitor the fate of isolated cancer stem-like cells in non-adherent conditions. We combined for the first time individual cell fate and cell state temporality analysis in a unique algorithm. We show that with our experimental system and on two different primary cell lines our optimized deep learning based algorithm outperforms classical computer vision and shallow learning-based algorithms in terms of accuracy while being faster than cutting-edge convolutional neural network (CNNs). With this study, we show that tailoring our deep learning-based algorithm to the image analysis problem yields better results than pre-trained models. As a result, such a rapid and accurate CNN is compatible with the rise of high-throughput data generation and opens the door to on-the-fly CSC fate analysis.

White Blood Cell Classification Using Texture and RGB Features of Oversampled Microscopic Images

White blood cell (WBC) type classification is a task of significant importance for diagnosis using microscopic images of WBC, which develop immunity to fight against infections and foreign substances. WBCs consist of different types, and abnormalities in a type of WBC may potentially represent a disease such as leukemia. Existing studies are limited by low accuracy and overrated performance, often caused by model overfit due to an imbalanced dataset. Additionally, many studies consider a lower number of WBC types, and the accuracy is exaggerated. This study presents a hybrid feature set of selective features and synthetic minority oversampling technique-based resampling to mitigate the influence of the above-mentioned problems. Furthermore, machine learning models are adopted for being less computationally complex, requiring less data for training, and providing robust results. Experiments are performed using both machine- and deep learning models for performance comparison using the original dataset, augmented dataset, and oversampled dataset to analyze the performances of the models. The results suggest that a hybrid feature set of both texture and RGB features from microscopic images, selected using Chi2, produces a high accuracy of 0.97 with random forest. Performance appraisal using k-fold cross-validation and comparison with existing state-of-the-art studies shows that the proposed approach outperforms existing studies regarding the obtained accuracy and computational complexity.

Leukemia segmentation and classification: A comprehensive survey

Blood is made up of leukocytes (WBCs), erythrocytes (RBCs), and thrombocytes. The ratio of blood cancer diseases is increasing rapidly, among which leukemia is one of the famous cancer which may lead to death. Leukemia cancer is initiated by the unnecessary growth of immature WBCs present in the sponge tissues of bone marrow. It is generally analyzed by etiologists by perceiving slides of blood smear images under a microscope. The morphological features and blood cells count facilitated the etiologists to detect leukemia. Due to the late detection and expensive instruments used for leukemia analysis, the death rate has risen significantly. The fluorescence-based cell sorting technique and manual recounts using a hemocytometer are error-prone and imprecise. Leukemia detection methods consist of pre-processing, segmentation, features extraction, and classification. In this article, recent deep learning methodologies and challenges for leukemia detection are discussed. These methods are helpful to examine the microscopic blood smears images and for the detection of leukemia more accurately.

Discrimination between normal and cancer white blood cells using holographic projection technique

White blood cells (WBCs) play a vital role in the diagnosis of many blood diseases. Such diagnosis is based on the morphological analysis of blood microscopic images which is performed manually by skilled hematologist. However, this method has many drawbacks, such as the dependence on the hematologist's skill, slow performance, and varying accuracy. Therefore, in the current study, a new optical method for discrimination between normal and cancer WBCs of peripheral blood film (PBF) images is presented. This method is based on holographic projection technique which is able to provide an accurate and fast optical reconstruction method of WBCs floating in the air. Besides, it can provide a 3D visualization map of one WBC with its characterization parameters from only a single 2D hologram. To achieve that, at first, WBCs are accurately segmented from the microscopic PBF images using a developed in-house MATLAB code. Then, their associated phase computer-generated holograms (CGHs) are calculated using the well-known iterative Fourier transform algorithm (IFTA). Within the utilized algorithm, a speckle noise reduction technique, based on temporal multiplexing of spatial frequencies, is applied to minimize the speckle noise across the reconstruction plane. Additionally, a special hologram modulation is added to the calculated holograms to provide a 3D visualization map of one WBC, and discriminate normal and cancer WBCs. Finally, the calculated phase-holograms are uploaded on a phase-only spatial light modulator (SLM) for optical reconstruction. The optical reconstruction of such phase-holograms yields precise representation of normal and cancer WBCs. Moreover, a 3D visualization map of one WBC with its characterization parameters is provided. Therefore, the proposed technique can be used as a valuable tool for interpretation and analysis of WBCs, this in turn could provide an improvement in diagnosis and prognosis of blood diseases.

An integrated and automated testing approach on Inception Restnet-V3 based on convolutional neural network for leukocytes image classification

OBJECTIVES

The leukocyte is a specialized immune cell that functions as the foundation of the immune system and keeps the body healthy. The WBC classification plays a vital role in diagnosing various disorders in the medical area, including infectious diseases, immune deficiencies, leukemia, and COVID-19. A few decades ago, Machine Learning algorithms classified WBC types required for image segmentation, and the feature extraction stages, but this new approach becomes automatic while existing models can be fine-tuned for specific classifications.

METHODS

The inception architecture and deep learning model-based Resnet connection are integrated into this article. Our proposed method, inception Resnet-v3, was used to classify WBCs into five categories using 15.7k images. Pathologists made diagnoses of all images so a model could be trained to classify five distinct types of cells.

RESULTS

After implementing the proposed architecture on a large dataset of 5 categories of human peripheral white blood cells, it achieved high accuracy than VGG, U-Net and Resnet. We tested our model with WBC images from additional public datasets such as the Kaagel data sets and Raabin data sets of which the accuracy was 98.80% and 98.95%.

CONCLUSIONS

Considering the large sample sizes, we believe the proposed method can be used for improving the diagnostic performance of clinical blood examinations as well as a promising alternative for machine learning. Test results obtained with the system have been satisfying, with outstanding values for Accuracy, Precision, Recall, Specificity and F1 Score.

White blood cell classification via a discriminative region detection assisted feature aggregation network

White blood cell (WBC) classification plays an important role in human pathological diagnosis since WBCs will show different appearance when they fight with various disease pathogens. Although many previous white blood cell classification have been proposed and earned great success, their classification accuracy is still significantly affected by some practical issues such as uneven staining, boundary blur and nuclear intra-class variability. In this paper, we propose a deep neural network for WBC classification via discriminative region detection assisted feature aggregation (DRFA-Net), which can accurately locate the WBC area to boost final classification performance. Specifically, DRFA-Net uses an adaptive feature enhancement module to refine multi-level deep features in a bilateral manner for efficiently capturing both high-level semantic information and low-level details of WBC images. Considering the fact that background areas could inevitably produce interference, we design a network branch to detect the WBC area with the supervision of segmented ground truth. The bilaterally refined features obtained from two directions are finally aggregated for final classification, and the detected WBC area is utilized to highlight the features of discriminative regions by an attention mechanism. Extensive experiments on several public datasets are conducted to validate that our proposed DRFA-Net can obtain higher accuracies when compared with other state-of-the-art WBC classification methods.

Design of Moving Target Detection System Using Lightweight Deep Learning Model and Its Impact on the Development of Sports Industry

The intelligent tracking and detection of athletes' actions and the improvement of action standardization are of great practical significance to reducing the injury caused by sports in the sports industry. For the problems of nonstandard movement and single movement mode, this exploration takes the video of sports events as the object and combines it with the video general feature extraction of convolutional neural network (CNN) in the field of deep learning and the filtering detection algorithm of motion trajectory. Then, a target detection and tracking system model is proposed to track and detect targets in sports in real-time. Moreover, through experiments, the performance of the proposed system model is analyzed. After testing the detection quantity, response rate, data loss rate, and target detection accuracy of the model, the results show that the model can track and monitor 50 targets with a loss rate of 3%, a response speed of 4 s and a target detection accuracy of 80%. It can play an excellent role in sports events and postgame video analysis, and provide a good basis and certain design ideas for the goal tracking of the sports industry.

Artificial intelligence and its applications in digital hematopathology

The advent of whole-slide imaging, faster image data generation, and cheaper forms of data storage have made it easier for pathologists to manipulate digital slide images and interpret more detailed biological processes in conjunction with clinical samples. In parallel, with continuous breakthroughs in object detection, image feature extraction, image classification and image segmentation, artificial intelligence (AI) is becoming the most beneficial technology for high-throughput analysis of image data in various biomedical imaging disciplines. Integrating digital images into biological workflows, advanced algorithms, and computer vision techniques expands the biologist's horizons beyond the microscope slide. Here, we introduce recent developments in AI applied to microscopy in hematopathology. We give an overview of its concepts and present its applications in normal or abnormal hematopoietic cells identification. We discuss how AI shows great potential to push the limits of microscopy and enhance the resolution, signal and information content of acquired data. Its shortcomings are discussed, as well as future directions for the field.

Optimizing a Deep Residual Neural Network with Genetic Algorithm for Acute Lymphoblastic Leukemia Classification

Acute lymphoblastic leukemia (ALL) is the most common childhood cancer worldwide, and it is characterized by the production of immature malignant cells in the bone marrow. Computer vision techniques provide automated analysis that can help specialists diagnose this disease. Microscopy image analysis is the most economical method for the initial screening of patients with ALL, but this task is subjective and time-consuming. In this study, we propose a hybrid model using a genetic algorithm (GA) and a residual convolutional neural network (CNN), ResNet-50V2, to predict ALL using microscopy images available in ALL-IDB dataset. However, accurate prediction requires suitable hyperparameters setup, and tuning these values manually still poses challenges. Hence, this paper uses GA to find the best hyperparameters that lead to the highest accuracy rate in the models. Also, we compare the performance of GA hyperparameter optimization with Random Search and Bayesian optimization methods. The results show that GA optimization improves the accuracy of the classifier, obtaining 98.46% in terms of accuracy. Additionally, our approach sheds new perspectives on identifying leukemia based on computer vision strategies, which could be an alternative for applications in a real-world scenario.

Explainable AI in Diagnosing and Anticipating Leukemia Using Transfer Learning Method

White blood cells (WBCs) are blood cells that fight infections and diseases as a part of the immune system. They are also known as "defender cells." But the imbalance in the number of WBCs in the blood can be hazardous. Leukemia is the most common blood cancer caused by an overabundance of WBCs in the immune system. Acute lymphocytic leukemia (ALL) usually occurs when the bone marrow creates many immature WBCs that destroy healthy cells. People of all ages, including children and adolescents, can be affected by ALL. The rapid proliferation of atypical lymphocyte cells can cause a reduction in new blood cells and increase the chances of death in patients. Therefore, early and precise cancer detection can help with better therapy and a higher survival probability in the case of leukemia. However, diagnosing ALL is time-consuming and complicated, and manual analysis is expensive, with subjective and error-prone outcomes. Thus, detecting normal and malignant cells reliably and accurately is crucial. For this reason, automatic detection using computer-aided diagnostic models can help doctors effectively detect early leukemia. The entire approach may be automated using image processing techniques, reducing physicians' workload and increasing diagnosis accuracy. The impact of deep learning (DL) on medical research has recently proven quite beneficial, offering new avenues and possibilities in the healthcare domain for diagnostic techniques. However, to make that happen soon in DL, the entire community must overcome the explainability limit. Because of the black box operation's shortcomings in artificial intelligence (AI) models' decisions, there is a lack of liability and trust in the outcomes. But explainable artificial intelligence (XAI) can solve this problem by interpreting the predictions of AI systems. This study emphasizes leukemia, specifically ALL. The proposed strategy recognizes acute lymphoblastic leukemia as an automated procedure that applies different transfer learning models to classify ALL. Hence, using local interpretable model-agnostic explanations (LIME) to assure validity and reliability, this method also explains the cause of a specific classification. The proposed method achieved 98.38% accuracy with the InceptionV3 model. Experimental results were found between different transfer learning methods, including ResNet101V2, VGG19, and InceptionResNetV2, later verified with the LIME algorithm for XAI, where the proposed method performed the best. The obtained results and their reliability demonstrate that it can be preferred in identifying ALL, which will assist medical examiners.

WBC-based segmentation and classification on microscopic images: a minor improvement

Introduction

White blood cells (WBCs) are immunity cells which fight against viruses and bacteria in the human body. Microscope images of captured WBCs for processing and analysis are important to interpret the body condition. At present, there is no robust automated method to segment and classify WBCs images with high accuracy. This paper aims to improve on WBCs image segmentation and classification method.

Methods

A triple thresholding method was proposed to segment the WBCs; meanwhile, a convolutional neural network (CNN)-based binary classification model that adopts transfer learning technique was proposed to detect and classify WBCs as a healthy or a malignant. The input dataset of this research work is the Acute Lymphoblastic Leukemia Image Database (ALL-IDB). The process first converts the captured microscope images into HSV format for obtaining the H component. Otsu thresholding is applied to segment the WBC area. A 13 × 13 kernel with two iterations was used to apply morphological opening on image to ameliorate output results. Collected cell masks were used to detect the contour of each cell on the original image. To classify WBCs into a healthy or a malignant category, characteristics and conditions of WBCs are to be examined. A transfer learning technique and pre-trained InceptionV3 model were employed to extract the features from the images for classification.

Results

The proposed WBCs segmentation method yields 90.45% accuracy, 83.81% of the structural similarity index, 76.25% of the dice similarity coefficient, and is computationally efficient. The accuracy of fine-tuned classifier model for training, validation and test sets are 93.27%, 92.31% and 96.15% respectively. The obtained results are high in accuracy and precision are over 96% and with lower loss value.

Discussion

Triple thresholding outperforms K-means clustering in segmenting smaller dataset. Pre-trained InceptionV3 model and transfer learning improve the flexibility and ability of classifier.

A content-based image retrieval system for the diagnosis of lymphoma using blood micrographs: An incorporation of deep learning with a traditional learning approach

Lymphomas, or cancers of the lymphatic system, account for around half of all blood cancers diagnosed each year. Lymphoma is a condition that is difficult to diagnose, and accurate diagnosis is critical for effective treatment. Manual microscopic analysis of blood cells requires the involvement of medical experts, whose precision is dependent on their abilities, and it takes time. This paper describes a content-based image retrieval system that uses deep learning-based feature extraction and a traditional learning method for feature reduction to retrieve similar images from a database to aid early/initial lymphoma diagnosis. The proposed algorithm employs a pre-trained network called ResNet-101 to extract image features required to distinguish four types of cells: lymphoma cells, blasts, lymphocytes, and other cells. The issue of class imbalance is resolved by over-sampling the training data followed by data augmentation. Deep learning features are extracted using the activations of the feature layer in the pre-trained net, then dimensionality reduction techniques are used to select discriminant features for the image retrieval system. Euclidean distance is used as the similarity measure to retrieve similar images from the database. The experimentation uses a microscopic blood image dataset with 1673 leukocytes of the categories blasts, lymphoma, lymphocytes, and other cells. The proposed algorithm achieves 98.74% precision in lymphoma cell classification and 99.22% precision @10 for lymphoma cell image retrieval. Experimental findings confirm our approach's practicability and effectiveness. Extended studies endorse the idea of using the prescribed system in actual medical applications, helping doctors diagnose lymphoma, dramatically reducing human resource requirements.

An Efficient Multi-Level Convolutional Neural Network Approach for White Blood Cells Classification

The evaluation of white blood cells is essential to assess the quality of the human immune system; however, the assessment of the blood smear depends on the pathologist’s expertise. Most machine learning tools make a one-level classification for white blood cell classification. This work presents a two-stage hybrid multi-level scheme that efficiently classifies four cell groups: lymphocytes and monocytes (mononuclear) and segmented neutrophils and eosinophils (polymorphonuclear). At the first level, a Faster R-CNN network is applied for the identification of the region of interest of white blood cells, together with the separation of mononuclear cells from polymorphonuclear cells. Once separated, two parallel convolutional neural networks with the MobileNet structure are used to recognize the subclasses in the second level. The results obtained using Monte Carlo cross-validation show that the proposed model has a performance metric of around 98.4% (accuracy, recall, precision, and F1-score). The proposed model represents a good alternative for computer-aided diagnosis (CAD) tools for supporting the pathologist in the clinical laboratory in assessing white blood cells from blood smear images.

Systematic segmentation method based on PCA of image hue features for white blood cell counting

Leukocyte (white blood cell, WBC) count is an essential factor that physicians use to diagnose infections and provide adequate treatment. Currently, WBC count is determined manually or semi-automatically, which often leads to miscounting. In this paper, we propose an automated method that uses a bioinspired segmentation mimicking the human perception of color. It is based on the claim that a person can locate WBCs in a blood smear image via the high chromatic contrast. First, by applying principal component analysis over RGB, HSV, and L*a*b* spaces, with specific combinations, pixels of leukocytes present high chromatic variance; this results in increased contrast with the average hue of the other blood smear elements. Second, chromaticity is processed as a feature, without separating hue components; this is different to most of the current automation that perform mathematical operations between hue components in an intuitive way. As a result of this systematic method, WBC recognition is computationally efficient, overlapping WBCs are separated, and the final count is more precise. In experiments with the ALL-IDB benchmark, the performance of the proposed segmentation was assessed by comparing the WBC from the processed images with the ground truth. Compared with previous methods, the proposed method achieved similar results in sensitivity and precision and approximately 0.2% higher specificity and 0.3% higher accuracy for pixel classification in the segmentation stage; as well, the counting results are similar to previous works.

Weakly Supervised Ternary Stream Data Augmentation Fine-Grained Classification Network for Identifying Acute Lymphoblastic Leukemia

Due to the high incidence of acute lymphoblastic leukemia (ALL) worldwide as well as its rapid and fatal progression, timely microscopy screening of peripheral blood smears is essential for the rapid diagnosis of ALL. However, screening manually is time-consuming and tedious and may lead to missed or misdiagnosis due to subjective bias; on the other hand, artificially intelligent diagnostic algorithms are constrained by the limited sample size of the data and are prone to overfitting, resulting in limited applications. Conventional data augmentation is commonly adopted to expand the amount of training data, avoid overfitting, and improve the performance of deep models. However, in practical applications, random data augmentation, such as random image cropping or erasing, is difficult to realistically occur in specific tasks and may instead introduce tremendous background noises that modify actual distribution of data, thereby degrading model performance. In this paper, to assist in the early and accurate diagnosis of acute lymphoblastic leukemia, we present a ternary stream-driven weakly supervised data augmentation classification network (WT-DFN) to identify lymphoblasts in a fine-grained scale using microscopic images of peripheral blood smears. Concretely, for each training image, we first generate attention maps to represent the distinguishable part of the target by weakly supervised learning. Then, guided by these attention maps, we produce the other two streams via attention cropping and attention erasing to obtain the fine-grained distinctive features. The proposed WT-DFN improves the classification accuracy of the model from two aspects: (1) in the images can be seen details since cropping attention regions provide the accurate location of the object, which ensures our model looks at the object closer and discovers certain detailed features; (2) images can be seen more since erasing attention mechanism forces the model to extract more discriminative parts' features. Validation suggests that the proposed method is capable of addressing the high intraclass variances located in lymphocyte classes, as well as the low interclass variances between lymphoblasts and other normal or reactive lymphocytes. The proposed method yields the best performance on the public dataset and the real clinical dataset among competitive methods.

Artificial Intelligence: A New Tool in Oncologist's Armamentarium

Artificial intelligence (AI) has become an essential tool in human life because of its pivotal role in communications, transportation, media, and social networking. Inspired by the complex neuronal network and its functions in human beings, AI, using computer-based algorithms and training, had been explored since the 1950s. To tackle the enormous amount of patients' clinical data, imaging, histopathological data, and the increasing pace of research on new treatments and clinical trials, and ever-changing guidelines for treatment with the advent of novel drugs and evidence, AI is the need of the hour. There are numerous publications and active work on AI's role in the field of oncology. In this review, we discuss the fundamental terminology of AI, its applications in oncology on the whole, and its limitations. There is an inter-relationship between AI, machine learning and, deep learning. The virtual branch of AI deals with machine learning. While the physical branch of AI deals with the delivery of different forms of treatment—surgery, targeted drug delivery, and elderly care. The applications of AI in oncology include cancer screening, diagnosis (clinical, imaging, and histopathological), radiation therapy (image acquisition, tumor and organs at risk segmentation, image registration, planning, and delivery), prediction of treatment outcomes and toxicities, prediction of cancer cell sensitivity to therapeutics and clinical decision-making. A specific area of interest is in the development of effective drug combinations tailored to every patient and tumor with the help of AI. Radiomics, the new kid on the block, deals with the planning and administration of radiotherapy. As with any new invention, AI has its fallacies. The limitations include lack of external validation and proof of generalizability, difficulty in data access for rare diseases, ethical and legal issues, no precise logic behind the prediction, and last but not the least, lack of education and expertise among medical professionals. A collaboration between departments of clinical oncology, bioinformatics, and data sciences can help overcome these problems in the near future.

Automated detection of leukemia by pretrained deep neural networks and transfer learning: A comparison

Leukemia is usually diagnosed by viewing the smears of blood and bone marrow using microscopes and complex Cytochemical tests can be used to authorize and classify leukemia. But these methods are costly, slow and affected by the proficiency and expertise of the specialists concerned. Leukemia can be detected with the help of image processing-based methods by analyzing microscopic smear images to detect the presence of leukemic cells and such techniques are simple, fast, cheap and not biased by the specialists. The proposed study presents a computer aided diagnosis system that uses pretrained deep Convolutional Neural Networks (CNNs) for detection of leukemia images against normal images. The use of pretrained networks is comparatively an easy method of applying deep learning for image analysis and the comparison results of the present study can be used to choose appropriate networks for diagnostic tasks. The microscopic images used in the proposed work were downloaded from a public dataset ALL-IDB. In the proposed work, image classification is done without using any image segregation and feature extraction practices and the study used pretrained series network AlexNet, VGG-16, VGG-19, Directed Acyclic Graph (DAG) networks GoogLeNet, Inceptionv3, MobileNet-v2, Xception, DenseNet-201, Inception-ResNet-v2 and residual networks ResNet-18, ResNet-50 and ResNet-101 for performing the classification and comparison. A classification accuracy of 100% is obtained with all the pretrained networks used in the study for ALL_IDB1 dataset and for ALL_IDB2 dataset, 100% accuracy is obtained with all networks except the AlexNet and VGG-16. The efficacy of three optimization algorithms Stochastic Gradient Descent with Momentum (SGDM), Root Mean Square propagation (RMSprop) and Adaptive Moment estimation (ADAM) is also compared in all the classifications performed. The study considered the detection of leukemia in general only, and classification of leukemia into different types can be attempted as a future work.

Classification of white blood cells using weighted optimized deformable convolutional neural networks

BACKGROUND

Machine learning (ML) algorithms have been widely used in the classification of white blood cells (WBCs). However, the performance of ML algorithms still needs to be addressed for being short of gold standard data sets, and even the implementation of the proposed algorithms.

METHODS

In this study, the method of two-module weighted optimized deformable convolutional neural networks (TWO-DCNN) was proposed for WBC classification. Our algorithm is characterized as two-module transfer learning and deformable convolutional (DC) layers for the betterment of robustness. To validate the performance, our method was compared with classical MLs of VGG16, VGG19, Inception-V3, ResNet-50, support vector machine (SVM), multilayer perceptron (MLP), decision tree (DT) and random forest (RF) on our undisclosed WBC data set and public BCCD data set.

RESULTS

TWO-DCNN achieved the best performance with the precisions (PREs) of 95.7%, 94.5% and 91.6%, recalls (RECs) of 95.7%, 94.5% and 91.6%, F1-scores (F1s) of 95.7%, 94.5% and 91.6%, area under curves (AUCs) of 0.98, 0.97 and 0.95 for low-resolution and noisy undisclosed data sets, BCCD data set, respectively.

CONCLUSIONS

With accurate feature extraction and optimized network weights, the proposed TWO-DCNN showed the best performance in WBC classification for low-resolution and noisy data sets. It could be used as an alternative method for clinical applications.

TopoResNet: A Hybrid Deep Learning Architecture and Its Application to Skin Lesion Classification

The application of artificial intelligence (AI) to various medical subfields has been a popular topic of research in recent years. In particular, deep learning has been widely used and has proven effective in many cases. Topological data analysis (TDA)—a rising field at the intersection of mathematics, statistics, and computer science—offers new insights into data. In this work, we develop a novel deep learning architecture that we call TopoResNet that integrates topological information into the residual neural network architecture. To demonstrate TopoResNet, we apply it to a skin lesion classification problem. We find that TopoResNet improves the accuracy and the stability of the training process.

New segmentation and feature extraction algorithm for classification of white blood cells in peripheral smear images

This article addresses a new method for the classification of white blood cells (WBCs) using image processing techniques and machine learning methods. The proposed method consists of three steps: detecting the nucleus and cytoplasm, extracting features, and classification. At first, a new algorithm is designed to segment the nucleus. For the cytoplasm to be detected, only a part of it located inside the convex hull of the nucleus is involved in the process. This attitude helps us overcome the difficulties of segmenting the cytoplasm. In the second phase, three shapes and four novel color features are devised and extracted. Finally, by using an SVM model, the WBCs are classified. The segmentation algorithm can detect the nucleus with a dice similarity coefficient of 0.9675. The proposed method can categorize WBCs in Raabin-WBC, LISC, and BCCD datasets with accuracies of 94.65%, 92.21%, and 94.20%, respectively. Besides, we show that the proposed method possesses more generalization power than pre-trained CNN models. It is worth mentioning that the hyperparameters of the classifier are fixed only with the Raabin-WBC dataset, and these parameters are not readjusted for LISC and BCCD datasets.

Machine Learning in Oncology: What Should Clinicians Know?

The volume and complexity of scientific and clinical data in oncology have grown markedly over recent years, including but not limited to the realms of electronic health data, radiographic and histologic data, and genomics. This growth holds promise for a deeper understanding of malignancy and, accordingly, more personalized and effective oncologic care. Such goals require, however, the development of new methods to fully make use of the wealth of available data. Improvements in computer processing power and algorithm development have positioned machine learning, a branch of artificial intelligence, to play a prominent role in oncology research and practice. This review provides an overview of the basics of machine learning and highlights current progress and challenges in applying this technology to cancer diagnosis, prognosis, and treatment recommendations, including a discussion of current takeaways for clinicians.

Hybrid Inception v3 XGBoost Model for Acute Lymphoblastic Leukemia Classification

Acute lymphoblastic leukemia (ALL) is the most common type of pediatric malignancy which accounts for 25% of all pediatric cancers. It is a life-threatening disease which if left untreated can cause death within a few weeks. Many computerized methods have been proposed for the detection of ALL from microscopic cell images. In this paper, we propose a hybrid Inception v3 XGBoost model for the classification of acute lymphoblastic leukemia (ALL) from microscopic white blood cell images. In the proposed model, Inception v3 acts as the image feature extractor and the XGBoost model acts as the classification head. Experiments indicate that the proposed model performs better than the other methods identified in literature. The proposed hybrid model achieves a weighted F1 score of 0.986. Through experiments, we demonstrate that using an XGBoost classification head instead of a softmax classification head improves classification performance for this dataset for several different CNN backbones (feature extractors). We also visualize the attention map of the features extracted by Inception v3 to interpret the features learnt by the proposed model.

An End-to-End Pipeline for Early Diagnosis of Acute Promyelocytic Leukemia Based on a Compact CNN Model

Timely microscopy screening of peripheral blood smears is essential for the diagnosis of acute promyelocytic leukemia (APL) due to the occurrence of early death (ED) before or during the initial therapy. Screening manually is time-consuming and tedious, and may lead to missed diagnosis or misdiagnosis because of subjective bias. To address these problems, we develop a three-step pipeline to help in the early diagnosis of APL from peripheral blood smears. The entire pipeline consists of leukocytes focusing, cell classification and diagnostic opinions. As the key component of the pipeline, a compact classification model based on attention embedded convolutional neural network blocks is proposed to distinguish promyelocytes from normal leukocytes. The compact classification model is validated on both the combination of two public datasets, APL-Cytomorphology_LMU and APL-Cytomorphology_JHH, as well as the clinical dataset, to yield a precision of 96.53% and 99.20%, respectively. The results indicate that our model outperforms the other evaluated popular classification models owing to its better accuracy and smaller size. Furthermore, the entire pipeline is validated on realistic patient data. The proposed method promises to act as an assistant tool for APL diagnosis.

Attention-Aware Residual Network Based Manifold Learning for White Blood Cells Classification

The classification of six types of white blood cells (WBCs) is considered essential for leukemia diagnosis, while the classification is labor-intensive and strict with the clinical experience. To relieve the complicated process with an efficient and automatic method, we propose the Attention-aware Residual Network based Manifold Learning model (ARML) to classify WBCs. The proposed ARML model leverages the adaptive attention-aware residual learning to exploit the category-relevant image-level features and strengthen the first-order feature representation ability. To learn more discriminatory information than the first-order ones, the second-order features are characterized. Afterwards, ARML encodes both the first- and second-order features with Gaussian embedding into the Riemannian manifold to learn the underlying non-linear structure of the features for classification. ARML can be trained in an end-to-end fashion, and the learnable parameters are iteratively optimized. 10800 WBCs images (1800 images for each type) is collected, 9000 images and five-fold cross-validation are used for training and validation of the model, while additional 1800 images for testing. The results show that ARML achieving average classification accuracy of 0.953 outperforms other state-of-the-art methods with fewer trainable parameters. In the ablation study, ARML achieves improved accuracy against its three variants: without manifold learning (AR), without attention-aware learning (RML), and AR without attention-aware learning. The t-SNE results illustrate that ARML has learned more distinguishable features than the comparison methods, which benefits the WBCs classification. ARML provides a clinically feasible WBCs classification solution for leukemia diagnose with an efficient manner.