Automatic detection and classification of leukocytes using convolutional neural networks

Utilizing Deep Feature Fusion for Automatic Leukemia Classification: An Internet of Medical Things-Enabled Deep Learning Framework

Acute lymphoblastic leukemia, commonly referred to as ALL, is a type of cancer that can affect both the blood and the bone marrow. The process of diagnosis is a difficult one since it often calls for specialist testing, such as blood tests, bone marrow aspiration, and biopsy, all of which are highly time-consuming and expensive. It is essential to obtain an early diagnosis of ALL in order to start therapy in a timely and suitable manner. In recent medical diagnostics, substantial progress has been achieved through the integration of artificial intelligence (AI) and Internet of Things (IoT) devices. Our proposal introduces a new AI-based Internet of Medical Things (IoMT) framework designed to automatically identify leukemia from peripheral blood smear (PBS) images. In this study, we present a novel deep learning-based fusion model to detect ALL types of leukemia. The system seamlessly delivers the diagnostic reports to the centralized database, inclusive of patient-specific devices. After collecting blood samples from the hospital, the PBS images are transmitted to the cloud server through a WiFi-enabled microscopic device. In the cloud server, a new fusion model that is capable of classifying ALL from PBS images is configured. The fusion model is trained using a dataset including 6512 original and segmented images from 89 individuals. Two input channels are used for the purpose of feature extraction in the fusion model. These channels include both the original and the segmented images. VGG16 is responsible for extracting features from the original images, whereas DenseNet-121 is responsible for extracting features from the segmented images. The two output features are merged together, and dense layers are used for the categorization of leukemia. The fusion model that has been suggested obtains an accuracy of 99.89%, a precision of 99.80%, and a recall of 99.72%, which places it in an excellent position for the categorization of leukemia. The proposed model outperformed several state-of-the-art Convolutional Neural Network (CNN) models in terms of performance. Consequently, this proposed model has the potential to save lives and effort. For a more comprehensive simulation of the entire methodology, a web application (Beta Version) has been developed in this study. This application is designed to determine the presence or absence of leukemia in individuals. The findings of this study hold significant potential for application in biomedical research, particularly in enhancing the accuracy of computer-aided leukemia detection.

Hematologic cancer diagnosis and classification using machine and deep learning: State-of-the-art techniques and emerging research directives

Hematology is the study of diagnosis and treatment options for blood diseases, including cancer. Cancer is considered one of the deadliest diseases across all age categories. Diagnosing such a deadly disease at the initial stage is essential to cure the disease. Hematologists and pathologists rely on microscopic evaluation of blood or bone marrow smear images to diagnose blood-related ailments. The abundance of overlapping cells, cells of varying densities among platelets, non-illumination levels, and the amount of red and white blood cells make it more difficult to diagnose illness using blood cell images. Pathologists are required to put more effort into the traditional, time-consuming system. Nowadays, it becomes possible with machine learning and deep learning techniques, to automate the diagnostic processes, categorize microscopic blood cells, and improve the accuracy of the procedure and its speed as the models developed using these methods may guide an assisting tool. In this article, we have acquired, analyzed, scrutinized, and finally selected around 57 research papers from various machine learning and deep learning methodologies that have been employed in the diagnosis of leukemia and its classification over the past 20 years, which have been published between the years 2003 and 2023 by PubMed, IEEE, Science Direct, Google Scholar and other pertinent sources. Our primary emphasis is on evaluating the advantages and limitations of analogous research endeavors to provide a concise and valuable research directive that can be of significant utility to fellow researchers in the field.

Blood cell image segmentation and classification: a systematic review

Background

Blood diseases such as leukemia, anemia, lymphoma, and thalassemia are hematological disorders that relate to abnormalities in the morphology and concentration of blood elements, specifically white blood cells (WBC) and red blood cells (RBC). Accurate and efficient diagnosis of these conditions significantly depends on the expertise of hematologists and pathologists. To assist the pathologist in the diagnostic process, there has been growing interest in utilizing computer-aided diagnostic (CAD) techniques, particularly those using medical image processing and machine learning algorithms. Previous surveys in this domain have been narrowly focused, often only addressing specific areas like segmentation or classification but lacking a holistic view like segmentation, classification, feature extraction, dataset utilization, evaluation matrices, etc.

Methodology

This survey aims to provide a comprehensive and systematic review of existing literature and research work in the field of blood image analysis using deep learning techniques. It particularly focuses on medical image processing techniques and deep learning algorithms that excel in the morphological characterization of WBCs and RBCs. The review is structured to cover four main areas: segmentation techniques, classification methodologies, descriptive feature selection, evaluation parameters, and dataset selection for the analysis of WBCs and RBCs.

Results

Our analysis reveals several interesting trends and preferences among researchers. Regarding dataset selection, approximately 50% of research related to WBC segmentation and 60% for RBC segmentation opted for manually obtaining images rather than using a predefined dataset. When it comes to classification, 45% of the previous work on WBCs chose the ALL-IDB dataset, while a significant 73% of researchers focused on RBC classification decided to manually obtain images from medical institutions instead of utilizing predefined datasets. In terms of feature selection for classification, morphological features were the most popular, being chosen in 55% and 80% of studies related to WBC and RBC classification, respectively.

Conclusion

The diagnostic accuracy for blood-related diseases like leukemia, anemia, lymphoma, and thalassemia can be significantly enhanced through the effective use of CAD techniques, which have evolved considerably in recent years. This survey provides a broad and in-depth review of the techniques being employed, from image segmentation to classification, feature selection, utilization of evaluation matrices, and dataset selection. The inconsistency in dataset selection suggests a need for standardized, high-quality datasets to strengthen the diagnostic capabilities of these techniques further. Additionally, the popularity of morphological features indicates that future research could further explore and innovate in this direction.

Medical Image Classifications for 6G IoT-Enabled Smart Health Systems

As day-to-day-generated data become massive in the 6G-enabled Internet of medical things (IoMT), the process of medical diagnosis becomes critical in the healthcare system. This paper presents a framework incorporated into the 6G-enabled IoMT to improve prediction accuracy and provide a real-time medical diagnosis. The proposed framework integrates deep learning and optimization techniques to render accurate and precise results. The medical computed tomography images are preprocessed and fed into an efficient neural network designed for learning image representations and converting each image to a feature vector. The extracted features from each image are then learned using a MobileNetV3 architecture. Furthermore, we enhanced the performance of the arithmetic optimization algorithm (AOA) based on the hunger games search (HGS). In the developed method, named AOAHG, the operators of the HGS are applied to enhance the AOA's exploitation ability while allocating the feasible region. The developed AOAG selects the most relevant features and ensures the overall model classification improvement. To assess the validity of our framework, we conducted evaluation experiments on four datasets, including ISIC-2016 and PH2 for skin cancer detection, white blood cell (WBC) detection, and optical coherence tomography (OCT) classification, using different evaluation metrics. The framework showed remarkable performance compared to currently existing methods in the literature. In addition, the developed AOAHG provided results better than other FS approaches according to the obtained accuracy, precision, recall, and F1-score as performance measures. For example, AOAHG had 87.30%, 96.40%, 88.60%, and 99.69% for the ISIC, PH2, WBC, and OCT datasets, respectively.

BCNet: A Deep Learning Computer-Aided Diagnosis Framework for Human Peripheral Blood Cell Identification

Blood cells carry important information that can be used to represent a person's current state of health. The identification of different types of blood cells in a timely and precise manner is essential to cutting the infection risks that people face on a daily basis. The BCNet is an artificial intelligence (AI)-based deep learning (DL) framework that was proposed based on the capability of transfer learning with a convolutional neural network to rapidly and automatically identify the blood cells in an eight-class identification scenario: Basophil, Eosinophil, Erythroblast, Immature Granulocytes, Lymphocyte, Monocyte, Neutrophil, and Platelet. For the purpose of establishing the dependability and viability of BCNet, exhaustive experiments consisting of five-fold cross-validation tests are carried out. Using the transfer learning strategy, we conducted in-depth comprehensive experiments on the proposed BCNet's architecture and test it with three optimizers of ADAM, RMSprop (RMSP), and stochastic gradient descent (SGD). Meanwhile, the performance of the proposed BCNet is directly compared using the same dataset with the state-of-the-art deep learning models of DensNet, ResNet, Inception, and MobileNet. When employing the different optimizers, the BCNet framework demonstrated better classification performance with ADAM and RMSP optimizers. The best evaluation performance was achieved using the RMSP optimizer in terms of 98.51% accuracy and 96.24% F1-score. Compared with the baseline model, the BCNet clearly improved the prediction accuracy performance 1.94%, 3.33%, and 1.65% using the optimizers of ADAM, RMSP, and SGD, respectively. The proposed BCNet model outperformed the AI models of DenseNet, ResNet, Inception, and MobileNet in terms of the testing time of a single blood cell image by 10.98, 4.26, 2.03, and 0.21 msec. In comparison to the most recent deep learning models, the BCNet model could be able to generate encouraging outcomes. It is essential for the advancement of healthcare facilities to have such a recognition rate improving the detection performance of the blood cells.

A Method for Expanding the Training Set of White Blood Cell Images

In medicine, the count of different types of white blood cells can be used as the basis for diagnosing certain diseases or evaluating the treatment effects of diseases. The recognition and counting of white blood cells have important clinical significance. But the effect of recognition based on machine learning is affected by the size of the training set. At present, researchers mainly rely on image rotation and cropping to expand the dataset. These methods either add features to the white blood cell image or require manual intervention and are inefficient. In this paper, a method for expanding the training set of white blood cell images is proposed. After rotating the image at any angle, Canny is used to extract the edge of the black area caused by the rotation and then fill the black area to achieve the purpose of expanding the training set. The experimental results show that after using the method proposed in this paper to expand the training set to train the three models of ResNet, MobileNet, and ShuffleNet, and comparing the original dataset and the method trained by the simple rotated image expanded dataset, the recognition accuracy of the three models is obviously improved without manual intervention.

Deep learning application of the discrimination of bone marrow aspiration cells in patients with myelodysplastic syndromes

Myelodysplastic syndromes (MDS) are a group of hematologic neoplasms accompanied by dysplasia of the bone marrow hematopoietic cells with cytopenia. Detecting dysplasia is important in the diagnosis of MDS, but it takes considerable time and effort. Also, since the assessment of dysplasia is subjective and difficult to quantify, a more efficient tool is needed for quality control and standardization of bone marrow aspiration smear interpretation. In this study, we developed and evaluated an algorithm to automatically discriminate hematopoietic cell lineages and detect dysplastic cells in bone marrow aspiration smears using deep learning technology. Bone marrow aspiration images were acquired from 34 patients diagnosed with MDS and from 24 normal bone marrow slides. In total, 8065 cells were classified into eight categories: normal erythrocytes, normal granulocytes, normal megakaryocytes, dysplastic erythrocytes, dysplastic granulocytes, dysplastic megakaryocytes, blasts, and others. The algorithm demonstrated acceptable performance in classifying dysplastic cells, with an AUC of 0.945-0.996 and accuracy of 0.912-0.993. The algorithm developed in this study could be used as an auxiliary tool for diagnosing patients with MDS and is expected to contribute to shortening the time required for MDS bone marrow aspiration diagnosis and standardizing visual reading.

Leukemia segmentation and classification: A comprehensive survey

Blood is made up of leukocytes (WBCs), erythrocytes (RBCs), and thrombocytes. The ratio of blood cancer diseases is increasing rapidly, among which leukemia is one of the famous cancer which may lead to death. Leukemia cancer is initiated by the unnecessary growth of immature WBCs present in the sponge tissues of bone marrow. It is generally analyzed by etiologists by perceiving slides of blood smear images under a microscope. The morphological features and blood cells count facilitated the etiologists to detect leukemia. Due to the late detection and expensive instruments used for leukemia analysis, the death rate has risen significantly. The fluorescence-based cell sorting technique and manual recounts using a hemocytometer are error-prone and imprecise. Leukemia detection methods consist of pre-processing, segmentation, features extraction, and classification. In this article, recent deep learning methodologies and challenges for leukemia detection are discussed. These methods are helpful to examine the microscopic blood smears images and for the detection of leukemia more accurately.

AHA-AO: Artificial Hummingbird Algorithm with Aquila Optimization for Efficient Feature Selection in Medical Image Classification

This paper presents a system for medical image diagnosis that uses transfer learning (TL) and feature selection techniques. The main aim of TL on pre-trained models such as MobileNetV3 is to extract features from raw images. Here, a novel feature selection optimization algorithm called the Artificial Hummingbird Algorithm based on Aquila Optimization (AHA-AO) is proposed. The AHA-AO is used to select only the most relevant features and ensure the improvement of the overall model classification. Our methodology was evaluated using four datasets, namely, ISIC-2016, PH2, Chest-XRay, and Blood-Cell. We compared the proposed feature selection algorithm with five of the most popular feature selection optimization algorithms. We obtained an accuracy of 87.30% for the ISIC-2016 dataset, 97.50% for the PH2 dataset, 86.90% for the Chest-XRay dataset, and 88.60% for the Blood-cell dataset. The AHA-AO outperformed the other optimization techniques. Moreover, the developed AHA-AO was faster than the other feature selection models during the process of determining the relevant features. The proposed feature selection algorithm successfully improved the performance and the speed of the overall deep learning models.

Medical Image Classification Using Transfer Learning and Chaos Game Optimization on the Internet of Medical Things

The Internet of Medical Things (IoMT) has dramatically benefited medical professionals that patients and physicians can access from all regions. Although the automatic detection and prediction of diseases such as melanoma and leukemia is still being investigated and studied in IoMT, existing approaches are not able to achieve a high degree of efficiency. Thus, with a new approach that provides better results, patients would access the adequate treatments earlier and the death rate would be reduced. Therefore, this paper introduces an IoMT proposal for medical images' classification that may be used anywhere, i.e., it is an ubiquitous approach. It was designed in two stages: first, we employ a transfer learning (TL)-based method for feature extraction, which is carried out using MobileNetV3; second, we use the chaos game optimization (CGO) for feature selection, with the aim of excluding unnecessary features and improving the performance, which is key in IoMT. Our methodology was evaluated using ISIC-2016, PH2, and Blood-Cell datasets. The experimental results indicated that the proposed approach obtained an accuracy of 88.39% on ISIC-2016, 97.52% on PH2, and 88.79% on Blood-cell datsets. Moreover, our approach had successful performances for the metrics employed compared to other existing methods.

Detecting Malignant Leukemia Cells Using Microscopic Blood Smear Images: A Deep Learning Approach

Leukemia is a form of blood cancer that develops when the human body’s bone marrow contains too many white blood cells. This medical condition affects adults and is considered a prevalent form of cancer in children. Treatment for leukaemia is determined by the type and the extent to which cancer has developed across the body. It is crucial to diagnose leukaemia early in order to provide adequate care and to cure patients. Researchers have been working on advanced diagnostics systems based on Machine Learning (ML) approaches to diagnose leukaemia early. In this research, we employ deep learning (DL) based convolutional neural network (CNN) and hybridized two individual blocks of CNN named CNN-1 and CNN-2 to detect acute lymphoblastic leukaemia (ALL), acute myeloid leukaemia (AML), and multiple myeloma (MM). The proposed model detects malignant leukaemia cells using microscopic blood smear images. We construct a dataset of about 4150 images from a public directory. The main challenges were background removal, ripping out un-essential blood components of blood supplies, reduce the noise and blurriness and minimal method for image segmentation. To accomplish the pre-processing and segmentation, we transform RGB color-space into the greyscale 8-bit mode, enhancing the contrast of images using the image intensity adjustment method and adaptive histogram equalisation (AHE) method. We increase the structure and sharpness of images by multiplication of binary image with the output of enhanced images. In the next step, complement is done to get the background in black colour and nucleus of blood in white colour. Thereafter, we applied area operation and closing operation to remove background noise. Finally, we multiply the final output to source image to regenerate the images dataset in RGB colour space, and we resize dataset images to [400, 400]. After applying all methods and techniques, we have managed to get noiseless, non-blurred, sharped and segmented images of the lesion. In next step, enhanced segmented images are given as input to CNNs. Two parallel CCN models are trained, which extract deep features. The extracted features are further combined using the Canonical Correlation Analysis (CCA) fusion method to get more prominent features. We used five classification algorithms, namely, SVM, Bagging ensemble, total boosts, RUSBoost, and fine KNN, to evaluate the performance of feature extraction algorithms. Among the classification algorithms, Bagging ensemble outperformed the other algorithms by achieving the highest accuracy of 97.04%.

CVD-HNet: Classifying Pneumonia and COVID-19 in Chest X-ray Images Using Deep Network

The use of computer-assisted analysis to improve image interpretation has been a long-standing challenge in the medical imaging industry. In terms of image comprehension, Continuous advances in AI (Artificial Intelligence), predominantly in DL (Deep Learning) techniques, are supporting in the classification, Detection, and quantification of anomalies in medical images. DL techniques are the most rapidly evolving branch of AI, and it's recently been successfully pragmatic in a variety of fields, including medicine. This paper provides a classification method for COVID 19 infected X-ray images based on new novel deep CNN model. For COVID19 specified pneumonia analysis, two new customized CNN architectures, CVD-HNet1 (COVID-HybridNetwork1) and CVD-HNet2 (COVID-HybridNetwork2), have been designed. The suggested method utilizes operations based on boundaries and regions, as well as convolution processes, in a systematic manner. In comparison to existing CNNs, the suggested classification method achieves excellent Accuracy 98 percent, F Score 0.99 and MCC 0.97. These results indicate impressive classification accuracy on a limited dataset, with more training examples, much better results can be achieved. Overall, our CVD-HNet model could be a useful tool for radiologists in diagnosing and detecting COVID 19 instances early.

Deep Learning-Based Classification of Cancer Cell in Leptomeningeal Metastasis on Cytomorphologic Features of Cerebrospinal Fluid

Background

It is a critical challenge to diagnose leptomeningeal metastasis (LM), given its technical difficulty and the lack of typical symptoms. The existing gold standard of diagnosing LM is to use positive cerebrospinal fluid (CSF) cytology, which consumes significantly more time to classify cells under a microscope.

Objective

This study aims to establish a deep learning model to classify cancer cells in CSF, thus facilitating doctors to achieve an accurate and fast diagnosis of LM in an early stage.

Method

The cerebrospinal fluid laboratory of Xijing Hospital provides 53,255 cells from 90 LM patients in the research. We used two deep convolutional neural networks (CNN) models to classify cells in the CSF. A five-way cell classification model (CNN1) consists of lymphocytes, monocytes, neutrophils, erythrocytes, and cancer cells. A four-way cancer cell classification model (CNN2) consists of lung cancer cells, gastric cancer cells, breast cancer cells, and pancreatic cancer cells. Here, the CNN models were constructed by Resnet-inception-V2. We evaluated the performance of the proposed models on two external datasets and compared them with the results from 42 doctors of various levels of experience in the human-machine tests. Furthermore, we develop a computer-aided diagnosis (CAD) software to generate cytology diagnosis reports in the research rapidly.

Results

With respect to the validation set, the mean average precision (mAP) of CNN1 is over 95% and that of CNN2 is close to 80%. Hence, the proposed deep learning model effectively classifies cells in CSF to facilitate the screening of cancer cells. In the human-machine tests, the accuracy of CNN1 is similar to the results from experts, with higher accuracy than doctors in other levels. Moreover, the overall accuracy of CNN2 is 10% higher than that of experts, with a time consumption of only one-third of that consumed by an expert. Using the CAD software saves 90% working time of cytologists.

Conclusion

A deep learning method has been developed to assist the LM diagnosis with high accuracy and low time consumption effectively. Thanks to labeled data and step-by-step training, our proposed method can successfully classify cancer cells in the CSF to assist LM diagnosis early. In addition, this unique research can predict cancer’s primary source of LM, which relies on cytomorphologic features without immunohistochemistry. Our results show that deep learning can be widely used in medical images to classify cerebrospinal fluid cells. For complex cancer classification tasks, the accuracy of the proposed method is significantly higher than that of specialist doctors, and its performance is better than that of junior doctors and interns. The application of CNNs and CAD software may ultimately aid in expediting the diagnosis and overcoming the shortage of experienced cytologists, thereby facilitating earlier treatment and improving the prognosis of LM.

WBC-AMNet: Automatic classification of WBC images using deep feature fusion network based on focalized attention mechanism

The recognition and classification of White Blood Cell (WBC) play a remarkable role in blood-related diseases (i.e., leukemia, infections) diagnosis. For the highly similar morphology of different WBC subtypes, it is too confused to classify the WBC effectively and accurately for visual observation of blood cell smears. This paper proposes a Deep Convolutional Neural Network (DCNN) with feature fusion strategies, named WBC-AMNet, for automatically classifying WBC subtypes based on focalized attention mechanism. To obtain more localized attention of CNN, the fusion features of the first and the last convolutional layer are extracted by focalized attention mechanism combining Squeeze-and-Excitation (SE) and Gather-Excite (GE) modules. The new method performs successfully in classifying monocytes, neutrophils, lymphocytes, and eosinophils on the complex background with an overall accuracy of 95.66%, better than that of general CNNs. The multi-classification accuracy of WBC-AMNet with the background segmentation is over 98% in all cases. In addition, Gradient-weighted Class Activation Mapping (Grad-CAM) is employed to visualize the attention heatmaps of different feature maps.

Establishment and Verification of Neural Network for Rapid and Accurate Cytological Examination of Four Types of Cerebrospinal Fluid Cells

Fast and accurate cerebrospinal fluid cytology is the key to the diagnosis of many central nervous system diseases. However, in actual clinical work, cytological counting and classification of cerebrospinal fluid are often time-consuming and prone to human error. In this report, we have developed a deep neural network (DNN) for cell counting and classification of cerebrospinal fluid cytology. The May-Grünwald-Giemsa (MGG) stained image is annotated and input into the DNN network. The main cell types include lymphocytes, monocytes, neutrophils, and red blood cells. In clinical practice, the use of DNN is compared with the results of expert examinations in the professional cerebrospinal fluid room of a First-line 3A Hospital. The results show that the report produced by the DNN network is more accurate, with an accuracy of 95% and a reduction in turnaround time by 86%. This study shows the feasibility of applying DNN to clinical cerebrospinal fluid cytology.

A review on deep learning in medical image analysis

Ongoing improvements in AI, particularly concerning deep learning techniques, are assisting to identify, classify, and quantify patterns in clinical images. Deep learning is the quickest developing field in artificial intelligence and is effectively utilized lately in numerous areas, including medication. A brief outline is given on studies carried out on the region of application: neuro, brain, retinal, pneumonic, computerized pathology, bosom, heart, breast, bone, stomach, and musculoskeletal. For information exploration, knowledge deployment, and knowledge-based prediction, deep learning networks can be successfully applied to big data. In the field of medical image processing methods and analysis, fundamental information and state-of-the-art approaches with deep learning are presented in this paper. The primary goals of this paper are to present research on medical image processing as well as to define and implement the key guidelines that are identified and addressed.

Systematic segmentation method based on PCA of image hue features for white blood cell counting

Leukocyte (white blood cell, WBC) count is an essential factor that physicians use to diagnose infections and provide adequate treatment. Currently, WBC count is determined manually or semi-automatically, which often leads to miscounting. In this paper, we propose an automated method that uses a bioinspired segmentation mimicking the human perception of color. It is based on the claim that a person can locate WBCs in a blood smear image via the high chromatic contrast. First, by applying principal component analysis over RGB, HSV, and L*a*b* spaces, with specific combinations, pixels of leukocytes present high chromatic variance; this results in increased contrast with the average hue of the other blood smear elements. Second, chromaticity is processed as a feature, without separating hue components; this is different to most of the current automation that perform mathematical operations between hue components in an intuitive way. As a result of this systematic method, WBC recognition is computationally efficient, overlapping WBCs are separated, and the final count is more precise. In experiments with the ALL-IDB benchmark, the performance of the proposed segmentation was assessed by comparing the WBC from the processed images with the ground truth. Compared with previous methods, the proposed method achieved similar results in sensitivity and precision and approximately 0.2% higher specificity and 0.3% higher accuracy for pixel classification in the segmentation stage; as well, the counting results are similar to previous works.

IoT Application of Transfer Learning in Hybrid Artificial Intelligence Systems for Acute Lymphoblastic Leukemia Classification

Acute lymphoblastic leukemia is the most common cancer in children, and its diagnosis mainly includes microscopic blood tests of the bone marrow. Therefore, there is a need for a correct classification of white blood cells. The approach developed in this article is based on an optimized and small IoT-friendly neural network architecture. The application of learning transfer in hybrid artificial intelligence systems is offered. The hybrid system consisted of a MobileNet v2 encoder pre-trained on the ImageNet dataset and machine learning algorithms performing the role of the head. These were the XGBoost, Random Forest, and Decision Tree algorithms. In this work, the average accuracy was over 90%, reaching 97.4%. This work proves that using hybrid artificial intelligence systems for tasks with a low computational complexity of the processing units demonstrates a high classification accuracy. The methods used in this study, confirmed by the promising results, can be an effective tool in diagnosing other blood diseases, facilitating the work of a network of medical institutions to carry out the correct treatment schedule.

Classification of white blood cells using weighted optimized deformable convolutional neural networks

BACKGROUND

Machine learning (ML) algorithms have been widely used in the classification of white blood cells (WBCs). However, the performance of ML algorithms still needs to be addressed for being short of gold standard data sets, and even the implementation of the proposed algorithms.

METHODS

In this study, the method of two-module weighted optimized deformable convolutional neural networks (TWO-DCNN) was proposed for WBC classification. Our algorithm is characterized as two-module transfer learning and deformable convolutional (DC) layers for the betterment of robustness. To validate the performance, our method was compared with classical MLs of VGG16, VGG19, Inception-V3, ResNet-50, support vector machine (SVM), multilayer perceptron (MLP), decision tree (DT) and random forest (RF) on our undisclosed WBC data set and public BCCD data set.

RESULTS

TWO-DCNN achieved the best performance with the precisions (PREs) of 95.7%, 94.5% and 91.6%, recalls (RECs) of 95.7%, 94.5% and 91.6%, F1-scores (F1s) of 95.7%, 94.5% and 91.6%, area under curves (AUCs) of 0.98, 0.97 and 0.95 for low-resolution and noisy undisclosed data sets, BCCD data set, respectively.

CONCLUSIONS

With accurate feature extraction and optimized network weights, the proposed TWO-DCNN showed the best performance in WBC classification for low-resolution and noisy data sets. It could be used as an alternative method for clinical applications.

An Attention-Based Convolutional Neural Network for Acute Lymphoblastic Leukemia Classification

Leukemia is a kind of blood cancer that influences people of all ages and is one of the leading causes of death worldwide. Acute lymphoblastic leukemia (ALL) is the most widely recognized type of leukemia found in the bone marrow of the human body. Traditional disease diagnostic techniques like blood and bone marrow examinations are slow and painful, resulting in the demand for non-invasive and fast methods. This work presents a non-invasive, convolutional neural network (CNN) based approach that utilizes medical images to perform the diagnosis task. The proposed solution consisting of a CNN-based model uses an attention module called Efficient Channel Attention (ECA) with the visual geometry group from oxford (VGG16) to extract better quality deep features from the image dataset, leading to better feature representation and better classification results. The proposed method shows that the ECA module helps to overcome morphological similarities between ALL cancer and healthy cell images. Various augmentation techniques are also employed to increase the quality and quantity of training data. We used the classification of normal vs. malignant cells (C-NMC) dataset and divided it into seven folds based on subject-level variability, which is usually ignored in previous methods. Experimental results show that our proposed CNN model can successfully extract deep features and achieved an accuracy of 91.1%. The obtained findings show that the proposed method may be utilized to diagnose ALL and would help pathologists.

Tens of images can suffice to train neural networks for malignant leukocyte detection

Convolutional neural networks (CNNs) excel as powerful tools for biomedical image classification. It is commonly assumed that training CNNs requires large amounts of annotated data. This is a bottleneck in many medical applications where annotation relies on expert knowledge. Here, we analyze the binary classification performance of a CNN on two independent cytomorphology datasets as a function of training set size. Specifically, we train a sequential model to discriminate non-malignant leukocytes from blast cells, whose appearance in the peripheral blood is a hallmark of leukemia. We systematically vary training set size, finding that tens of training images suffice for a binary classification with an ROC-AUC over 90%. Saliency maps and layer-wise relevance propagation visualizations suggest that the network learns to increasingly focus on nuclear structures of leukocytes as the number of training images is increased. A low dimensional tSNE representation reveals that while the two classes are separated already for a few training images, the distinction between the classes becomes clearer when more training images are used. To evaluate the performance in a multi-class problem, we annotated single-cell images from a acute lymphoblastic leukemia dataset into six different hematopoietic classes. Multi-class prediction suggests that also here few single-cell images suffice if differences between morphological classes are large enough. The incorporation of deep learning algorithms into clinical practice has the potential to reduce variability and cost, democratize usage of expertise, and allow for early detection of disease onset and relapse. Our approach evaluates the performance of a deep learning based cytology classifier with respect to size and complexity of the training data and the classification task.

Image Analysis Using Machine Learning for Automated Detection of Hemoglobin H Inclusions in Blood Smears - A Method for Morphologic Detection of Rare Cells

Background

Morphologic rare cell detection is a laborious, operator-dependent process which has the potential to be improved by the use of image analysis using artificial intelligence. Detection of rare hemoglobin H (HbH) inclusions in red cells in the peripheral blood is a common screening method for alpha-thalassemia. This study aims to develop a convolutional neural network-based algorithm for the detection of HbH inclusions.

Methods

Digital images of HbH-positive and HbH-negative blood smears were used to train and test the software. The software performance was tested on images obtained at various magnifications and on different scanning platforms. Another model was developed for total red cell counting and was used to confirm HbH cell frequency in alpha-thalassemia trait. The threshold minimum red cells to image for analysis was determined by Poisson modeling and validated on image sets.

Results

The sensitivity and specificity of the software for HbH+ cells on images obtained at ×100, ×60, and ×40 objectives were close to 91% and 99%, respectively. When an AI-aided diagnostic model was tested on a pilot of 40 whole slide images (WSIs), good inter-rater reliability and high sensitivity and specificity of slide-level classification were obtained. Using the lowest frequency of HbH+ cells (1 in 100,000) observed in our study, we estimated that a minimum of 2.4 × 10⁶ red cells would need to be analyzed to reduce misclassification at the slide level. The minimum required smear size was validated on 78 image sets which confirmed its validity.

Conclusions

WSI image analysis can be utilized effectively for morphologic rare cell detection. The software can be further developed on WISs and evaluated in future clinical validation studies comparing AI-aided diagnosis with the routine diagnostic method.

BloodCaps: A capsule network based model for the multiclassification of human peripheral blood cells

BACKGROUND AND OBJECTIVE

The classification of human peripheral blood cells yields significance in the detection of inflammation, infections and blood cell disorders such as leukemia. Limitations in traditional algorithms for blood cell classification and increased computational processing power have allowed machine learning methods to be utilized for this clinically prevalent task.

METHODS

In the current work, we present BloodCaps, a capsule based model designed for the accurate multiclassification of a diverse and broad spectrum of blood cells.

RESULTS

Implemented on a large-scale dataset of 8 categories of human peripheral blood cells, the proposed architecture achieved an overall accuracy of 99.3%, outperforming convolutional neural networks such as AlexNet(81.5%), VGG16(97.8%), ResNet-18(95.9%) and InceptionV3(98.4%). Furthermore, we devised three new datasets(low-resolution dataset, small dataset, and low-resolution small dataset) from the original dataset, and tested BloodCaps in comparison with AlexNet, VGG16, ResNet-18, and InceptionV3. To further validate the applicability of our proposed model, we tested BloodCaps on additional public datasets such as the All IDB2, BCCD, and Cell Vision datasets. Compared with the reported results, BloodCaps showed the best performance in all three scenarios.

CONCLUSIONS

The proposed method proved superior in octal classification among all three datasets. We believe the proposed method represents a promising tool to improve the diagnostic performance of clinical blood examinations.

Artificial intelligence and digital pathology: Opportunities and implications for immuno-oncology

The field of immuno-oncology has expanded rapidly over the past decade, but key questions remain. How does tumour-immune interaction regulate disease progression? How can we prospectively identify patients who will benefit from immunotherapy? Identifying measurable features of the tumour immune-microenvironment which have prognostic or predictive value will be key to making meaningful gains in these areas. Recent developments in deep learning enable big-data analysis of pathological samples. Digital approaches allow data to be acquired, integrated and analysed far beyond what is possible with conventional techniques, and to do so efficiently and at scale. This has the potential to reshape what can be achieved in terms of volume, precision and reliability of output, enabling data for large cohorts to be summarised and compared. This review examines applications of artificial intelligence (AI) to important questions in immuno-oncology (IO). We discuss general considerations that need to be taken into account before AI can be applied in any clinical setting. We describe AI methods that have been applied to the field of IO to date and present several examples of their use.

Classification of lymphocytes, monocytes, eosinophils, and neutrophils on white blood cells using hybrid Alexnet-GoogleNet-SVM

White blood cells (WBC), which form the basis of the immune system, protect the body from foreign invaders and infectious diseases. While the number and structural features of WBCs can provide important information about the health of people, the ratio of the subtypes of these cells and observable deformations are a good indicator in the diagnostic process. The recognition of cells of the type of lymphocytes, neutrophils, eosinophils, basophils and monocytes is critical. In this article, Deep Learning based Hybrid CNN (Convololutional Neural Network) model is proposed for classification of eosinophils, lymphocytes, monocytes, and neutrophils WBCs. The model presented is based on pretrained Alexnet and Googlenet architectures. The feature vector in the last pooling layer of both CNN architectures has been merged, and the resulting feature vector is classified by the Support Vector Machine. To determine the superiority of the proposed method, the classification was also performed and compared using pretrained Alexnet and Googlenet. Hybrid Alexnet-Googlenet-SVM model provides higher accuracy than pretrained Alexnet and Googlenet. The proposed method has been tested with WBC images from Kaggle and LISC database. Accuracy and F1-score were 99.73%, 0.99 and 98.23%, 0.98 for both data sets, respectively.

Deep-Learning Based Label-Free Classification of Activated and Inactivated Neutrophils for Rapid Immune State Monitoring

The differential count of white blood cells (WBCs) is one widely used approach to assess the status of a patient’s immune system. Currently, the main methods of differential WBC counting are manual counting and automatic instrument analysis with labeling preprocessing. But these two methods are complicated to operate and may interfere with the physiological states of cells. Therefore, we propose a deep learning-based method to perform label-free classification of three types of WBCs based on their morphologies to judge the activated or inactivated neutrophils. Over 90% accuracy was finally achieved by a pre-trained fine-tuning Resnet-50 network. This deep learning-based method for label-free WBC classification can tackle the problem of complex instrumental operation and interference of fluorescent labeling to the physiological states of the cells, which is promising for future point-of-care applications.

Fully Automated Detection and Classification of White Blood Cells

The measure of White Blood Cells (WBC) in the blood is an important indicator of pathological conditions. Computer vision based methods for differential counting of WBC are increasing due to their advantages over traditional methods. However, most of these methods are proposed for single WBC images which are pre-processed, and do not generalize for raw microscopic images with multiple WBC. Moreover, they do not have the capability to detect the absence of WBC in the images. This paper proposes an image processing algorithm based on K-Means clustering to detect the presence of WBC in raw microscopic images and to localize them, and a VGG-16 classifier to classify those cells with a classification accuracy of 95.89%.

Automated design for recognition of blood cells diseases from hematopathology using classical features selection and ELM

In the human immune system, the white blood cells (WBC) creates bone and lymphoid masses. These cells defend the human body toward several infections, such as fungi and bacteria. The popular WBC types are Eosinophils, Lymphocytes, Neutrophils, and Monocytes, which are manually diagnosis by the experts. The manual diagnosis process is complicated and time-consuming; therefore, an automated system is required to classify these WBC. In this article, a new method is presented for WBC classification using feature selection and extreme learning machine (ELM). At the very first step, data augmentation is performed to increases the number of images and then implement a new contrast stretching technique name pixel stretch (PS). In the next step, color and gray level size zone matrix (GLSZM) features are calculated from PS images and fused in one vector based on the level of high similarity. However, few redundant features are also included that affect the classification performance. For handling this problem, a maximum relevance probability (MRP) based feature selection technique is implemented. The best-selected features computed from a fitness function are ELM in this work. All maximum relevance features are put to ELM, and this process is continued until the error rate is minimized. In the end, the final selected features are classified through Cubic SVM. For validation of the proposed method, LISC and Dhruv datasets are used, and it achieved the highest accuracy of 96.60%. From the results, it is clearly shown that the proposed method results are improved as compared to other implemented techniques.

Segmentation of White Blood Cell, Nucleus and Cytoplasm in Digital Haematology Microscope Images: A Review-Challenges, Current and Future Potential Techniques

Segmentation of white blood cells in digital haematology microscope images represents one of the major tools in the diagnosis and evaluation of blood disorders. Pathological examinations are being the gold standard in many haematology and histophathology, and also play a key role in the diagnosis of diseases. In clinical diagnosis, white blood cells are analysed by pathologists from peripheral blood smears samples of patients. This analysis is mainly based on morphological features and characteristics of the white blood cells and their nuclei and cytoplasm, including, shapes, sizes, colours, textures, maturity stages and staining processes. Recently, Computer Aided Diagnosis techniques have been rapidly growing in the digital haematology area related to white blood cells, and their nuclei and cytoplasm detection, as well as their segmentation and classification techniques. In digital haematology image analysis, these techniques have played and will continue to play, a vital role for providing traceable clinical information, consolidating pertinent second opinions, and minimizing human intervention. This study outlines, discusses, and introduces the major trends from a particular review of detection and segmentation methods for white blood cells and their nuclei and cytoplasm from digital haematology microscope images. Performance of existing methods have been comprehensively compared, taking into account databases used, number of images and limitations. This study can also help us to identify the challenges that remain, in achieving a robust analysis of white blood cell microscope images, which could support the diagnosis of blood disorders and assist researchers and pathologists in the future. The impact of this work is to enhance the accuracy of pathologists' decisions and their efficiency, and overall benefit the patients for faster and more accurate diagnosis. The significant of the paper on intelligent system is that provides future potential techniques for solving overlapping white blood cell identification and other problems microscopic images. The accurate segmentation and detection of white blood cells can increase the accuracy of cell counting system for diagnosing diseases in the future.

Automated MRI-Based Deep Learning Model for Detection of Alzheimer’s Disease Process

In the context of neuro-pathological disorders, neuroimaging has been widely accepted as a clinical tool for diagnosing patients with Alzheimer’s disease (AD) and mild cognitive impairment (MCI). The advanced deep learning method, a novel brain imaging technique, was applied in this study to evaluate its contribution to improving the diagnostic accuracy of AD. Three-dimensional convolutional neural networks (3D-CNNs) were applied with magnetic resonance imaging (MRI) to execute binary and ternary disease classification models. The dataset from the Alzheimer’s disease neuroimaging initiative (ADNI) was used to compare the deep learning performances across 3D-CNN, 3D-CNN-support vector machine (SVM) and two-dimensional (2D)-CNN models. The outcomes of accuracy with ternary classification for 2D-CNN, 3D-CNN and 3D-CNN-SVM were [Formula: see text]%, [Formula: see text]% and [Formula: see text]% respectively. The 3D-CNN-SVM yielded a ternary classification accuracy of 93.71%, 96.82% and 96.73% for NC, MCI and AD diagnoses, respectively. Furthermore, 3D-CNN-SVM showed the best performance for binary classification. Our study indicated that ‘NC versus MCI’ showed accuracy, sensitivity and specificity of 98.90%, 98.90% and 98.80%; ‘NC versus AD’ showed accuracy, sensitivity and specificity of 99.10%, 99.80% and 98.40%; and ‘MCI versus AD’ showed accuracy, sensitivity and specificity of 89.40%, 86.70% and 84.00%, respectively. This study clearly demonstrates that 3D-CNN-SVM yields better performance with MRI compared to currently utilized deep learning methods. In addition, 3D-CNN-SVM proved to be efficient without having to manually perform any prior feature extraction and is totally independent of the variability of imaging protocols and scanners. This suggests that it can potentially be exploited by untrained operators and extended to virtual patient imaging data. Furthermore, owing to the safety, noninvasiveness and nonirradiative properties of the MRI modality, 3D-CNN-SMV may serve as an effective screening option for AD in the general population. This study holds value in distinguishing AD and MCI subjects from normal controls and to improve value-based care of patients in clinical practice.

A computer-assisted human peripheral blood leukocyte image classification method based on Siamese network

A computer-assisted human peripheral blood leukocyte image classification method based on Siamese network is proposed. Firstly, a Siamese network with two identical convolutional neural network (CNN) sub-networks and a logistic regression for leukocyte five classification is designed, which can learn not only distinguishing features but also a similarity metric. Then for each category of the leukocytes, a typical sample is selected by the hematologist. To train the Siamese network, a leukocyte and a typical sample that belong to the same category make up a genuine pair and the leukocyte with the rest four typical samples respectively make up four impostor pairs. Obviously, the number of the genuine pairs is lesser than that of the impostor pairs. Thus, a data augmentation method suitable for leukocyte is used to enrich the amount of the genuine pairs. By training the Siamese network using the genuine pairs and impostor pairs, the Siamese network can not only shorten the similarity metric between the leukocyte and the same category of the typical sample but also increase the similarity metrics between the leukocyte and the different categories of the typical samples. Experimental results indicate that the proposed method can achieve 98.8% average testing accuracy. Graphical abstract.

Expert knowledge for the recognition of leukemic cells

This work shows the advantage of expert knowledge for leukemic cell recognition. In the medical area, visual analysis of microscopic images has regularly used biological samples to recognize hematological disorders. Nowadays, techniques of image recognition are needed to achieve an adequate identification of blood tissues. This paper presents a procedure to acquire expert knowledge from blood cell images. We apply Gaussian mixtures, evolutionary computing, and standard techniques of image processing to extract knowledge. This information feeds a support vector machine or multilayer perceptron to classify healthy or leukemic cells. Additionally, convolutional neural networks are used as a benchmark to compare our proposed method with the state of the art. We use a public database of 260 healthy and leukemic cell images. Results show that our traditional pattern recognition methodology matches deep learning accuracy since the recognition of blood cells achieves 99.63%, whereas the convolutional neural networks reach 97.74% on average. Moreover, the computational effort of our approach is minimal, while meeting the requirement of being explainable.

Improving Augmented Human Intelligence to Distinguish Burkitt Lymphoma From Diffuse Large B-Cell Lymphoma Cases

OBJECTIVES

To assess and improve the assistive role of a deep, densely connected convolutional neural network (CNN) to hematopathologists in differentiating histologic images of Burkitt lymphoma (BL) from diffuse large B-cell lymphoma (DLBCL).

METHODS

A total of 10,818 images from BL (n = 34) and DLBCL (n = 36) cases were used to either train or apply different CNNs. Networks differed by number of training images and pixels of images, absence of color, pixel and staining augmentation, and depth of the network, among other parameters.

RESULTS

Cases classified correctly were 17 of 18 (94%), nine with 100% of images correct by the best performing network showing a receiver operating characteristic curve analysis area under the curve 0.92 for both DLBCL and BL. The best performing CNN used all available training images, two random subcrops per image of 448 × 448 pixels, random H&E staining image augmentation, random horizontal flipping of images, random alteration of contrast, reduction on validation error plateau of 15 epochs, block size of six, batch size of 32, and depth of 22. Other networks and decreasing training images had poorer performance.

CONCLUSIONS

CNNs are promising augmented human intelligence tools for differentiating a subset of BL and DLBCL cases.

Personalized design technique for the dental occlusal surface based on conditional generative adversarial networks

The tooth defect is a frequently occurring disease within the field of dental clinic. However, the traditional manual restoration for the defective tooth needs an especially long treatment time, and dental computer aided design and manufacture (CAD/CAM) systems fail to restore the personalized anatomical features of natural teeth. Aiming to address the shortcomings of existed methods, this article proposes an intelligent network model for designing tooth crown surface based on conditional generative adversarial networks. Then, the data set for training the network model is constructed via generating depth maps of 3D tooth models scanned by the intraoral. Through adversarial training, the network model is able to generate tooth occlusal surface under the constraint of the space occlusal relationship, the perceptual loss, and occlusal groove filter loss. Finally, we carry out the assessment experiments for the quality of the occlusal surface and the occlusal relationship with the opposing tooth. The experimental results demonstrate that our method can automatically reconstruct the personalized anatomical features on occlusal surface and shorten the treatment time while restoring the full functionality of the defective tooth.

Deep Transfer Learning in Diagnosing Leukemia in Blood Cells

Leukemia is a fatal disease that threatens the lives of many patients. Early detection can effectively improve its rate of remission. This paper proposes two automated classification models based on blood microscopic images to detect leukemia by employing transfer learning, rather than traditional approaches that have several disadvantages. In the first model, blood microscopic images are pre-processed; then, features are extracted by a pre-trained deep convolutional neural network named AlexNet, which makes classifications according to numerous well-known classifiers. In the second model, after pre-processing the images, AlexNet is fine-tuned for both feature extraction and classification. Experiments were conducted on a dataset consisting of 2820 images confirming that the second model performs better than the first because of 100% classification accuracy.

Combining DC-GAN with ResNet for blood cell image classification

In medicine, white blood cells (WBCs) play an important role in the human immune system. The different types of WBC abnormalities are related to different diseases so that the total number and classification of WBCs are critical for clinical diagnosis and therapy. However, the traditional method of white blood cell classification is to segment the cells, extract features, and then classify them. Such method depends on the good segmentation, and the accuracy is not high. Moreover, the insufficient data or unbalanced samples can cause the low classification accuracy of model by using deep learning in medical diagnosis. To solve these problems, this paper proposes a new blood cell image classification framework which is based on a deep convolutional generative adversarial network (DC-GAN) and a residual neural network (ResNet). In particular, we introduce a new loss function which is improved the discriminative power of the deeply learned features. The experiments show that our model has a good performance on the classification of WBC images, and the accuracy reaches 91.7%. Graphical Abstract Overview of the proposed method, we use the deep convolution generative adversarial networks (DC-GAN) to generate new samples that are used as supplementary input to a ResNet, the transfer learning method is used to initialize the parameters of the network, the output of the DC-GAN and the parameters are applied the final classification network. In particular, we introduced a modified loss function for classification to increase inter-class variations and decrease intra-class differences.

SDCT-AuxNetθ: DCT augmented stain deconvolutional CNN with auxiliary classifier for cancer diagnosis

Acute lymphoblastic leukemia (ALL) is a pervasive pediatric white blood cell cancer across the globe. With the popularity of convolutional neural networks (CNNs), computer-aided diagnosis of cancer has attracted considerable attention. Such tools are easily deployable and are cost-effective. Hence, these can enable extensive coverage of cancer diagnostic facilities. However, the development of such a tool for ALL cancer was challenging so far due to the non-availability of a large training dataset. The visual similarity between the malignant and normal cells adds to the complexity of the problem. This paper discusses the recent release of a large dataset and presents a novel deep learning architecture for the classification of cell images of ALL cancer. The proposed architecture, namely, SDCT-AuxNet^θ is a 2-module framework that utilizes a compact CNN as the main classifier in one module and a Kernel SVM as the auxiliary classifier in the other one. While CNN classifier uses features through bilinear-pooling, spectral-averaged features are used by the auxiliary classifier. Further, this CNN is trained on the stain deconvolved quantity images in the optical density domain instead of the conventional RGB images. A novel test strategy is proposed that exploits both the classifiers for decision making using the confidence scores of their predicted class labels. Elaborate experiments have been carried out on our recently released public dataset of 15114 images of ALL cancer and healthy cells to establish the validity of the proposed methodology that is also robust to subject-level variability. A weighted F1 score of 94.8% is obtained that is best so far on this challenging dataset.

Classification of white blood cells using capsule networks

BACKGROUND

While the number and structural features of white blood cells (WBC) can provide important information about the health status of human beings, the ratio of sub-types of these cells and the deformations that can be observed serve as a good indicator in the diagnosis process of some diseases. Hence, correct identification and classification of the WBC types is of great importance. In addition, the fact that the diagnostic process that is carried out manually is slow, and the success is directly proportional to the expert's skills makes this problem an excellent field of application for computer-aided diagnostic systems. Unfortunately, both the ethical reasons and the cost of image acquisition process is one of the biggest obstacles to the fact that researchers working with medical images are able to collect enough data to produce a stable model. For that reasons, researchers who want to perform a successful analysis with small data sets using classical machine learning methods need to undergo their data a long and error-prone pre-process, while those using deep learning methods need to increase the data size using augmentation techniques. As a result, there is a need for a model that does not need pre-processing and can perform a successful classification in small data sets.

METHODS

WBCs were classified under five categories using a small data set via capsule networks, a new deep learning method. We improved the model using many techniques and compared the results with the most known deep learning methods.

RESULTS

Both the above-mentioned problems were overcame and higher success rates were obtained compared to other deep learning models. While, convolutional neural networks (CNN) and transfer learning (TL) models suffered from over-fitting, capsule networks learned well training data and achieved a high accuracy on test data (96.86%).

CONCLUSION

In this study, we briefly discussed the abilities of capsule networks in a case study. We showed that capsule networks are a quite successful alternative for deep learning and medical data analysis when the sample size is limited.

Nucleus and cytoplasm-based segmentation and actor-critic neural network for acute lymphocytic leukaemia detection in single cell blood smear images

Acute lymphoblastic leukaemia (ALL), which is due to the malfunctioning in the bone marrow, is common among people all over the world. The haematologist suffers a lot to discriminate the presence of leukaemia in the patients using the blood smears. To overcome the inaccuracy and reliability issues, this paper proposes an automatic method of leukaemia detection, named chronological Sine Cosine Algorithm-based actor-critic neural network (Chrono-SCA-ACNN). Initially, the blood smear images are segmented using the proposed entropy-based hybrid model, from which the image-level features and statistical features are extracted from the segments. Then, the selected features are applied to the proposed classifier, which detects the leukaemia. In the proposed Chrono-SCA-ACNN, the optimal weights are selected by the proposed Chrono-SCA, which is the integration of the chronological concept in the SCA. Finally, the experimentation is performed using the ALL-IDB2 database, and the effectiveness of the proposed method over the existing methods is evaluated. From the analysis, the accuracy of the proposed method is found to be 0.99, which proves that it outperforms the existing classification methodologies. Graphical abstract Block diagram of proposed Leukaemia detection. The main aim of the paper is to segment and classify the WBCs for ALL detection in single cell blood smear images. Initially, the blood smear image is subjected to pre-processing in order to enhance the quality of the input image so as to make it effective for the further processes associated with Leukaemia detection. The pre-processed image is applied to the segmentation process that segments the cytoplasm and nucleus using the Entropy-based hybrid model. The entropy-based hybrid model is developed using the FCM and active contour to segment the cytoplasm and nucleus that is fused using the entropy. The segments are subjected to the feature extraction that extracts the statistical features and the color histogram-based features from the segments. The features are presented to the Actor-Critic Neural Network and the weights of the Neural Network (NN) are optimally tuned using the proposed Chrono-SCA. The block diagram of the proposed method of leukaemia detection is depicted in Fig. 1.

Human peripheral blood leukocyte classification method based on convolutional neural network and data augmentation

PURPOSE

Human peripheral blood leukocytes' classification is important for diagnosing blood diseases. Many microscopic leukocyte image automatic detection methods are proposed. In recent years, convolutional neural networks (CNNs) are applied to microscopic leukocyte image automatic classification. But when a CNN is used for microscopic leukocyte image classification, the dataset's scarcity and imbalance will lead to low classification accuracy. To improve classification accuracy, a data augmentation method is proposed, and a resampling method is adopted when using a CNN method.

METHODS

First, a deep CNN model for microscopic leukocyte image classification is designed. Then, a new data augmentation method based on feature concentration is proposed to enrich the dataset and overcome the problem of dataset scarcity. To make the CNN model focus on the leukocyte region, many images are generated by putting a segmented leukocyte into images with different microscopic surroundings using an image processing method. Finally, taking the imbalance of the five kinds of leukocytes in the dataset into consideration, a resampling method is adopted. The resampling method iteratively feeds the leukocyte images with a low proportion to the CNN model within an epoch to ensure that images of each of the five kinds of leukocytes are represented in relatively equal numbers in each batch.

RESULTS

The experimental results demonstrate that the proposed classification method can achieve 97.6% average testing accuracy. Classification precision for the five kinds of leukocytes is above 93.4%, while sensitivity is above 92.5%. Both the proposed data augmentation and the resampling methods improve classification accuracy.

CONCLUSIONS

A human peripheral blood leukocyte classification method based on a CNN and data augmentation is proposed. The problem of dataset scarcity is solved by the proposed data augmentation method, and the dataset imbalance is solved by a resampling method.

Mutual Information based hybrid model and deep learning for Acute Lymphocytic Leukemia detection in single cell blood smear images

BACKGROUND AND OBJECTIVE

Due to the development in digital microscopic imaging, image processing and classification has become an interesting area for diagnostic research. Various techniques are available in the literature for the detection of Acute Lymphocytic Leukemia from the single cell blood smear images. The purpose of this work is to develop an effective method for leukemia detection.

METHODS

This work has developed deep learning based leukemia detection module from the blood smear images. Here, the detection scheme carries out pre-processing, segmentation, feature extraction and classification. The segmentation is done by the proposed Mutual Information (MI) based hybrid model, which combines the segmentation results of the active contour model and fuzzy C means algorithm. Then, from the segmented images, the statistical and the Local Directional Pattern (LDP) features are extracted and provided to the proposed Chronological Sine Cosine Algorithm (SCA) based Deep CNN classifier for the classification.

RESULTS

For the experimentation, the blood smear images are considered from the AA-IDB2 database and evaluated based on metrics, such as True Positive Rate (TPR), True Negative Rate (TNR), and accuracy. Simulation results reveal that the proposed Chronological SCA based Deep CNN classifier has the accuracy of 98.7%.

CONCLUSIONS

The performance of the proposed Chronological SCA-based Deep CNN classifier is compared with the state-of-the-art methods. The analysis shows that the proposed classifier has comparatively improved performance and determines the leukemia from the blood smear images.