1
|
Cheng W, Liu J, Wang C, Jiang R, Jiang M, Kong F. Application of image recognition technology in pathological diagnosis of blood smears. Clin Exp Med 2024; 24:181. [PMID: 39105953 PMCID: PMC11303489 DOI: 10.1007/s10238-024-01379-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Accepted: 05/13/2024] [Indexed: 08/07/2024]
Abstract
Traditional manual blood smear diagnosis methods are time-consuming and prone to errors, often relying heavily on the experience of clinical laboratory analysts for accuracy. As breakthroughs in key technologies such as neural networks and deep learning continue to drive digital transformation in the medical field, image recognition technology is increasingly being leveraged to enhance existing medical processes. In recent years, advancements in computer technology have led to improved efficiency in the identification of blood cells in blood smears through the use of image recognition technology. This paper provides a comprehensive summary of the methods and steps involved in utilizing image recognition algorithms for diagnosing diseases in blood smears, with a focus on malaria and leukemia. Furthermore, it offers a forward-looking research direction for the development of a comprehensive blood cell pathological detection system.
Collapse
Affiliation(s)
- Wangxinjun Cheng
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Jingshuang Liu
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Chaofeng Wang
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Ruiyin Jiang
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Mei Jiang
- Department of Clinical Laboratory, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China.
| | - Fancong Kong
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China.
| |
Collapse
|
2
|
MoradiAmin M, Yousefpour M, Samadzadehaghdam N, Ghahari L, Ghorbani M, Mafi M. Automatic classification of acute lymphoblastic leukemia cells and lymphocyte subtypes based on a novel convolutional neural network. Microsc Res Tech 2024; 87:1615-1626. [PMID: 38445461 DOI: 10.1002/jemt.24551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 01/14/2024] [Accepted: 02/26/2024] [Indexed: 03/07/2024]
Abstract
Acute lymphoblastic leukemia (ALL) is a life-threatening disease that commonly affects children and is classified into three subtypes: L1, L2, and L3. Traditionally, ALL is diagnosed through morphological analysis, involving the examination of blood and bone marrow smears by pathologists. However, this manual process is time-consuming, laborious, and prone to errors. Moreover, the significant morphological similarity between ALL and various lymphocyte subtypes, such as normal, atypic, and reactive lymphocytes, further complicates the feature extraction and detection process. The aim of this study is to develop an accurate and efficient automatic system to distinguish ALL cells from these similar lymphocyte subtypes without the need for direct feature extraction. First, the contrast of microscopic images is enhanced using histogram equalization, which improves the visibility of important features. Next, a fuzzy C-means clustering algorithm is employed to segment cell nuclei, as they play a crucial role in ALL diagnosis. Finally, a novel convolutional neural network (CNN) with three convolutional layers is utilized to classify the segmented nuclei into six distinct classes. The CNN is trained on a labeled dataset, allowing it to learn the distinguishing features of each class. To evaluate the performance of the proposed model, quantitative metrics are employed, and a comparison is made with three well-known deep networks: VGG-16, DenseNet, and Xception. The results demonstrate that the proposed model outperforms these networks, achieving an approximate accuracy of 97%. Moreover, the model's performance surpasses that of other studies focused on 6-class classification in the context of ALL diagnosis. RESEARCH HIGHLIGHTS: Deep neural networks eliminate the requirement for feature extraction in ALL classification The proposed convolutional neural network achieves an impressive accuracy of approximately 97% in classifying six ALL and lymphocyte subtypes.
Collapse
Affiliation(s)
- Morteza MoradiAmin
- Department of Physiology, Faculty of Medicine, AJA University of Medical Sciences, Tehran, Iran
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences (TUMS), Tehran, Iran
| | - Mitra Yousefpour
- Department of Physiology, Faculty of Medicine, AJA University of Medical Sciences, Tehran, Iran
| | - Nasser Samadzadehaghdam
- Department of Biomedical Engineering, Faculty of Advanced Medical Sciences, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Laya Ghahari
- Department of Anatomy, Faculty of Medicine, AJA University of Medical Sciences, Tehran, Iran
| | - Mahdi Ghorbani
- Department of Medical Laboratory Sciences, School of Allied Medical Sciences, AJA University of Medical Sciences, Tehran, Iran
- Medical Biotechnology Research Center, AJA University of Medical Sciences, Tehran, Iran
| | - Majid Mafi
- Mechanical Engineering Department, Iran University of Science and Technology, Tehran, Iran
| |
Collapse
|
3
|
Rubinos Rodriguez J, Fernandez S, Swartz N, Alonge A, Bhullar F, Betros T, Girdler M, Patel N, Adas S, Cervone A, Jacobs RJ. A Chronological Overview of Using Deep Learning for Leukemia Detection: A Scoping Review. Cureus 2024; 16:e61379. [PMID: 38947677 PMCID: PMC11214573 DOI: 10.7759/cureus.61379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Accepted: 05/30/2024] [Indexed: 07/02/2024] Open
Abstract
Leukemia is a rare but fatal cancer of the blood. This cancer arises from abnormal bone marrow cells and requires prompt diagnosis for effective treatment and positive patient prognosis. Traditional diagnostic methods (e.g., microscopy, flow cytometry, and biopsy) pose challenges in both accuracy and time, demanding an inquisition on the development and use of deep learning (DL) models, such as convolutional neural networks (CNN), which could allow for a faster and more exact diagnosis. Using specific, objective criteria, DL might hold promise as a tool for physicians to diagnose leukemia. The purpose of this review was to report the relevant available published literature on using DL to diagnose leukemia. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, articles published between 2010 and 2023 were searched using Embase, Ovid MEDLINE, and Web of Science, searching the terms "leukemia" AND "deep learning" or "artificial neural network" OR "neural network" AND "diagnosis" OR "detection." After screening retrieved articles using pre-determined eligibility criteria, 20 articles were included in the final review and reported chronologically due to the nascent nature of the phenomenon. The initial studies laid the groundwork for subsequent innovations, illustrating the transition from specialized methods to more generalized approaches capitalizing on DL technologies for leukemia detection. This summary of recent DL models revealed a paradigm shift toward integrated architectures, resulting in notable enhancements in accuracy and efficiency. The continuous refinement of models and techniques, coupled with an emphasis on simplicity and efficiency, positions DL as a promising tool for leukemia detection. With the help of these neural networks, leukemia detection could be hastened, allowing for an improved long-term outlook and prognosis. Further research is warranted using real-life scenarios to confirm the suggested transformative effects DL models could have on leukemia diagnosis.
Collapse
Affiliation(s)
- Jorge Rubinos Rodriguez
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Santiago Fernandez
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Nicholas Swartz
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Austin Alonge
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Fahad Bhullar
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Trevor Betros
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Michael Girdler
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Neil Patel
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Sayf Adas
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Adam Cervone
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| | - Robin J Jacobs
- Medicine, Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, USA
| |
Collapse
|
4
|
Zheng X, Tang P, Ai L, Liu D, Zhang Y, Wang B. White blood cell detection using saliency detection and CenterNet: A two-stage approach. JOURNAL OF BIOPHOTONICS 2023; 16:e202200174. [PMID: 36101492 DOI: 10.1002/jbio.202200174] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 08/23/2022] [Accepted: 09/12/2022] [Indexed: 06/15/2023]
Abstract
White blood cell (WBC) detection plays a vital role in peripheral blood smear analysis. However, cell detection remains a challenging task due to multi-cell adhesion, different staining and imaging conditions. Owing to the powerful feature extraction capability of deep learning, object detection methods based on convolutional neural networks (CNNs) have been widely applied in medical image analysis. Nevertheless, the CNN training is time-consuming and inaccuracy, especially for large-scale blood smear images, where most of the images are background. To address the problem, we propose a two-stage approach that treats WBC detection as a small salient object detection task. In the first saliency detection stage, we use the Itti's visual attention model to locate the regions of interest (ROIs), based on the proposed adaptive center-surround difference (ACSD) operator. In the second WBC detection stage, the modified CenterNet model is performed on ROI sub-images to obtain a more accurate localization and classification result of each WBC. Experimental results showed that our method exceeds the performance of several existing methods on two different data sets, and achieves a state-of-the-art mAP of over 98.8%.
Collapse
Affiliation(s)
- Xin Zheng
- School of Computer and Information, Anqing Normal University, Anqing, China
- The University Key Laboratory of Intelligent Perception and Computing of Anhui Province, Anqing Normal University, Anqing, China
| | - Pan Tang
- School of Computer and Information, Anqing Normal University, Anqing, China
| | - Liefu Ai
- School of Computer and Information, Anqing Normal University, Anqing, China
- The University Key Laboratory of Intelligent Perception and Computing of Anhui Province, Anqing Normal University, Anqing, China
| | - Deyang Liu
- School of Computer and Information, Anqing Normal University, Anqing, China
- The University Key Laboratory of Intelligent Perception and Computing of Anhui Province, Anqing Normal University, Anqing, China
| | - Youzhi Zhang
- School of Computer and Information, Anqing Normal University, Anqing, China
- The University Key Laboratory of Intelligent Perception and Computing of Anhui Province, Anqing Normal University, Anqing, China
| | - Boyang Wang
- School of Computer and Information, Anqing Normal University, Anqing, China
| |
Collapse
|
5
|
Dhalla S, Mittal A, Gupta S, Kaur J, Harshit, Kaur H. A combination of simple and dilated convolution with attention mechanism in a feature pyramid network to segment leukocytes from blood smear images. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
6
|
Braiki M, Nasreddine K, Benzinou A, Hymery N. Fuzzy Model for the Automatic Recognition of Human Dendritic Cells. J Imaging 2023; 9:jimaging9010013. [PMID: 36662111 PMCID: PMC9866805 DOI: 10.3390/jimaging9010013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 11/14/2022] [Accepted: 12/21/2022] [Indexed: 01/11/2023] Open
Abstract
Background and objective: Nowadays, foodborne illness is considered one of the most outgrowing diseases in the world, and studies show that its rate increases sharply each year. Foodborne illness is considered a public health problem which is caused by numerous factors, such as food intoxications, allergies, intolerances, etc. Mycotoxin is one of the food contaminants which is caused by various species of molds (or fungi), which, in turn, causes intoxications that can be chronic or acute. Thus, even low concentrations of Mycotoxin have a severely harmful impact on human health. It is, therefore, necessary to develop an assessment tool for evaluating their impact on the immune response. Recently, researchers have approved a new method of investigation using human dendritic cells, yet the analysis of the geometric properties of these cells is still visual. Moreover, this type of analysis is subjective, time-consuming, and difficult to perform manually. In this paper, we address the automation of this evaluation using image-processing techniques. Methods: Automatic classification approaches of microscopic dendritic cell images are developed to provide a fast and objective evaluation. The first proposed classifier is based on support vector machines (SVM) and Fisher's linear discriminant analysis (FLD) method. The FLD-SVM classifier does not provide satisfactory results due to the significant confusion between the inhibited cells on one hand, and the other two cell types (mature and immature) on the other hand. Then, another strategy was suggested to enhance dendritic cell recognition results that are emitted from microscopic images. This strategy is mainly based on fuzzy logic which allows us to consider the uncertainties and inaccuracies of the given data. Results: These proposed methods are tested on a real dataset consisting of 421 images of microscopic dendritic cells, where the fuzzy classification scheme efficiently improved the classification results by successfully classifying 96.77% of the dendritic cells. Conclusions: The fuzzy classification-based tools provide cell maturity and inhibition rates which help biologists evaluate severe health impacts caused by food contaminants.
Collapse
Affiliation(s)
- Marwa Braiki
- ENIB, UMR CNRS 6285 LabSTICC, 29238 Brest, France
| | - Kamal Nasreddine
- ENIB, UMR CNRS 6285 LabSTICC, 29238 Brest, France
- Correspondence:
| | | | - Nolwenn Hymery
- Univ Brest, Laboratoire Universitaire de Biodiversité et Écologie Microbienne, 29280 Plouzané, France
| |
Collapse
|
7
|
Saleem S, Amin J, Sharif M, Mallah GA, Kadry S, Gandomi AH. Leukemia segmentation and classification: A comprehensive survey. Comput Biol Med 2022; 150:106028. [PMID: 36126356 DOI: 10.1016/j.compbiomed.2022.106028] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 07/11/2022] [Accepted: 08/20/2022] [Indexed: 11/30/2022]
Abstract
Blood is made up of leukocytes (WBCs), erythrocytes (RBCs), and thrombocytes. The ratio of blood cancer diseases is increasing rapidly, among which leukemia is one of the famous cancer which may lead to death. Leukemia cancer is initiated by the unnecessary growth of immature WBCs present in the sponge tissues of bone marrow. It is generally analyzed by etiologists by perceiving slides of blood smear images under a microscope. The morphological features and blood cells count facilitated the etiologists to detect leukemia. Due to the late detection and expensive instruments used for leukemia analysis, the death rate has risen significantly. The fluorescence-based cell sorting technique and manual recounts using a hemocytometer are error-prone and imprecise. Leukemia detection methods consist of pre-processing, segmentation, features extraction, and classification. In this article, recent deep learning methodologies and challenges for leukemia detection are discussed. These methods are helpful to examine the microscopic blood smears images and for the detection of leukemia more accurately.
Collapse
Affiliation(s)
- Saba Saleem
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | | | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, Kristiansand, Norway; Department of Electrical and Computer Engineering, Lebanese American University, Byblos, Lebanon
| | - Amir H Gandomi
- Faculty of Engineering & Information Technology, University of Technology Sydney, Ultimo, NSW, 2007, Australia.
| |
Collapse
|
8
|
Interpretable Lightweight Ensemble Classification of Normal versus Leukemic Cells. COMPUTERS 2022. [DOI: 10.3390/computers11080125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The lymphocyte classification problem is usually solved by deep learning approaches based on convolutional neural networks with multiple layers. However, these techniques require specific hardware and long training times. This work proposes a lightweight image classification system capable of discriminating between healthy and cancerous lymphocytes of leukemia patients using image processing and feature-based machine learning techniques that require less training time and can run on a standard CPU. The features are composed of statistical, morphological, textural, frequency, and contour features extracted from each image and used to train a set of lightweight algorithms that classify the lymphocytes into malignant or healthy. After the training, these classifiers were combined into an ensemble classifier to improve the results. The proposed method has a lower computational cost than most deep learning approaches in learning time and neural network size. Our results contribute to the leukemia classification system, showing that high performance can be achieved by classifiers trained with a rich set of features. This study extends a previous work by combining simple classifiers into a single ensemble solution. With principal component analysis, it is possible to reduce the number of features used while maintaining a high accuracy.
Collapse
|
9
|
Hu Y, Luo Y, Tang G, Huang Y, Kang J, Wang D. Artificial intelligence and its applications in digital hematopathology. BLOOD SCIENCE 2022; 4:136-142. [PMID: 36518598 PMCID: PMC9742095 DOI: 10.1097/bs9.0000000000000130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Accepted: 06/16/2022] [Indexed: 11/26/2022] Open
Abstract
The advent of whole-slide imaging, faster image data generation, and cheaper forms of data storage have made it easier for pathologists to manipulate digital slide images and interpret more detailed biological processes in conjunction with clinical samples. In parallel, with continuous breakthroughs in object detection, image feature extraction, image classification and image segmentation, artificial intelligence (AI) is becoming the most beneficial technology for high-throughput analysis of image data in various biomedical imaging disciplines. Integrating digital images into biological workflows, advanced algorithms, and computer vision techniques expands the biologist's horizons beyond the microscope slide. Here, we introduce recent developments in AI applied to microscopy in hematopathology. We give an overview of its concepts and present its applications in normal or abnormal hematopoietic cells identification. We discuss how AI shows great potential to push the limits of microscopy and enhance the resolution, signal and information content of acquired data. Its shortcomings are discussed, as well as future directions for the field.
Collapse
Affiliation(s)
- Yongfei Hu
- Department of Bioinformatics, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
- Dermatology Hospital, Southern Medical University, Guangzhou, China
| | - Yinglun Luo
- Department of Bioinformatics, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
| | - Guangjue Tang
- Department of Bioinformatics, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
| | - Yan Huang
- Cancer Research Institute, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
| | - Juanjuan Kang
- Affiliated Foshan Maternity & Child Healthcare Hospital, Southern Medical University (Foshan Maternity & Child Healthcare Hospital), Foshan, China
| | - Dong Wang
- Department of Bioinformatics, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
| |
Collapse
|
10
|
Liu K, Hu J. Classification of acute myeloid leukemia M1 and M2 subtypes using machine learning. Comput Biol Med 2022; 147:105741. [PMID: 35738057 DOI: 10.1016/j.compbiomed.2022.105741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 05/24/2022] [Accepted: 06/11/2022] [Indexed: 11/25/2022]
Abstract
BACKGROUND Classification of acute myeloid leukemia (AML) relies on manual analysis of bone marrow or peripheral blood smear images. We aimed to construct a machine learning model for automatic classification of AML-M1 and M2 subtypes in bone marrow smear images. METHODS Bone marrow smear images of AML patients were extracted from the Cancer Imaging Archive (TCIA) open database. Classification criteria of AML subtypes were based on the French-American-British (FAB) classification system. Random forest method and broad learning system (BLS) were used to develop the classification model. Morphological features, radiomics features, and clinical features were extracted. The performance of the classification model was evaluated by calculating accuracy, precision, recall, F1-score, and area under the curve (AUC). A total of 50 bone marrow smear images (AML-M1, 31 cases; AML-M2, 19 cases) with 500 slices were included in this study. RESULTS A total of 43 morphological features, 276 radiomics features, and 1 clinical feature were extracted. Finally, 9 variables including 2 morphological features, 6 radiomics features, and 1 clinical feature were selected into the classification model. The best classification performance was observed in the random forest model with 9 variables, with the average accuracy, AUC, F1-score, recall, and precision of the model being 0.998 ± 0.003, 0.998 ± 0.004, 0.998 ± 0.004, 0.996 ± 0.009, and 1 ± 0, respectively. CONCLUSION The random forest model performed well for the classification of AML-M1 and M2, which may provide a tool for clinicians to classify AML-M1 and M2.
Collapse
Affiliation(s)
- Ke Liu
- Department of Hematology, The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, 471003, China.
| | - Jie Hu
- Department of Medical Record Management, The First Affiliated Hospital, and College of Clinical Medicine of Henan University of Science and Technology, Luoyang, 471003, China
| |
Collapse
|
11
|
Rodellar J, Barrera K, Alférez S, Boldú L, Laguna J, Molina A, Merino A. A Deep Learning Approach for the Morphological Recognition of Reactive Lymphocytes in Patients with COVID-19 Infection. Bioengineering (Basel) 2022; 9:bioengineering9050229. [PMID: 35621507 PMCID: PMC9137554 DOI: 10.3390/bioengineering9050229] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 05/11/2022] [Accepted: 05/17/2022] [Indexed: 11/16/2022] Open
Abstract
Laboratory medicine plays a fundamental role in the detection, diagnosis and management of COVID-19 infection. Recent observations of the morphology of cells circulating in blood found the presence of particular reactive lymphocytes (COVID-19 RL) in some of the infected patients and demonstrated that it was an indicator of a better prognosis of the disease. Visual morphological analysis is time consuming, requires smear review by expert clinical pathologists, and is prone to subjectivity. This paper presents a convolutional neural network system designed for automatic recognition of COVID-19 RL. It is based on the Xception71 structure and is trained using images of blood cells from real infected patients. An experimental study is carried out with a group of 92 individuals. The input for the system is a set of images selected by the clinical pathologist from the blood smear of a patient. The output is the prediction whether the patient belongs to the group associated with better prognosis of the disease. A threshold is obtained for the classification system to predict that the smear belongs to this group. With this threshold, the experimental test shows excellent performance metrics: 98.3% sensitivity and precision, 97.1% specificity, and 97.8% accuracy. The system does not require costly calculations and can potentially be integrated into clinical practice to assist clinical pathologists in a more objective smear review for early prognosis.
Collapse
Affiliation(s)
- José Rodellar
- Department of Mathematics, Barcelona Est Engineering School, Universitat Politècnica de Catalunya, 08019 Barcelona, Spain;
- Correspondence:
| | - Kevin Barrera
- Department of Mathematics, Barcelona Est Engineering School, Universitat Politècnica de Catalunya, 08019 Barcelona, Spain;
| | - Santiago Alférez
- School of Engineering, Science and Technology, Universidad del Rosario, Bogotá 111711, Colombia;
| | - Laura Boldú
- Biomedical Diagnostic Center, Core Laboratory, Department of Biochemistry and Molecular Genetics, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (L.B.); (J.L.); (A.M.); (A.M.)
| | - Javier Laguna
- Biomedical Diagnostic Center, Core Laboratory, Department of Biochemistry and Molecular Genetics, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (L.B.); (J.L.); (A.M.); (A.M.)
| | - Angel Molina
- Biomedical Diagnostic Center, Core Laboratory, Department of Biochemistry and Molecular Genetics, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (L.B.); (J.L.); (A.M.); (A.M.)
| | - Anna Merino
- Biomedical Diagnostic Center, Core Laboratory, Department of Biochemistry and Molecular Genetics, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (L.B.); (J.L.); (A.M.); (A.M.)
| |
Collapse
|
12
|
Gupta R, Gehlot S, Gupta A. C-NMC: B-lineage acute lymphoblastic leukaemia: A blood cancer dataset. Med Eng Phys 2022; 103:103793. [PMID: 35500994 DOI: 10.1016/j.medengphy.2022.103793] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 03/04/2022] [Accepted: 03/24/2022] [Indexed: 10/18/2022]
Abstract
Development of computer-aided cancer diagnostic tools is an active research area owing to the advancements in deep-learning domain. Such technological solutions provide affordable and easily deployable diagnostic tools. Leukaemia, or blood cancer, is one of the leading cancers causing more than 0.3 million deaths every year. In order to aid the development of such an AI-enabled tool, we collected and curated a microscopic image dataset, namely C-NMC, of more than 15000 cancer cell images at a very high resolution of B-Lineage Acute Lymphoblastic Leukaemia (B-ALL). The dataset is prepared at the subject-level and contains images of both healthy and cancer patients. So far, this is the largest (as well as curated) dataset on B-ALL cancer in the public domain. C-NMC is available at The Cancer Imaging Archive (TCIA), USA and can be helpful for the research community worldwide for the development of B-ALL cancer diagnostic tools. This dataset was utilized in an international medical imaging challenge held at ISBI 2019 conference in Venice, Italy. In this paper, we present a detailed description and challenges of this dataset. We also present benchmarking results of all the methods applied so far on this dataset.
Collapse
Affiliation(s)
- Ritu Gupta
- Laboratory Oncology Unit, Dr. B.R.A.IRCH, AIIMS, New Delhi, India.
| | - Shiv Gehlot
- SBILab, Department of ECE, IIIT-Delhi, Delhi, India
| | - Anubha Gupta
- SBILab, Department of ECE, IIIT-Delhi, Delhi, India.
| |
Collapse
|
13
|
Fuzzy clustering of Acute Lymphoblastic Leukemia images assisted by Eagle strategy and morphological reconstruction. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.108008] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
14
|
Kumar I, Bhatt C, Vimal V, Qamar S. Automated white corpuscles nucleus segmentation using deep neural network from microscopic blood smear. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-189773] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
The white corpuscles nucleus segmentation from microscopic blood images is major steps to diagnose blood-related diseases. The perfect and speedy segmentation system assists the hematologists to identify the diseases and take appropriate decision for better treatment. Therefore, fully automated white corpuscles nucleus segmentation model using deep convolution neural network, is proposed in the present study. The proposed model uses the combination of ‘binary_cross_entropy’ and ‘adam’ for maintaining learning rate in each network weight. To validate the potential and capability of the above proposed solution, ALL-IDB2 dataset is used. The complete set of images is partitioned into training and testing set and tedious experimentations have been performed. The best performing model is selected and the obtained training and testing accuracy of best performing model is reported as 98.69 % and 99.02 %, respectively. The staging analysis of proposed model is evaluated using sensitivity, specificity, Jaccard index, dice coefficient, accuracy and structure similarity index. The capability of proposed model is compared with performance of the region-based contour and fuzzy-based level-set method for same set of images and concluded that proposed model method is more accurate and effective for clinical purpose.
Collapse
Affiliation(s)
- Indrajeet Kumar
- Graphic Era Hill University, CSE Department, Dehradun, India
| | | | - Vrince Vimal
- Graphic Era Hill University, CSE Department, Dehradun, India
| | - Shamimul Qamar
- College of Science and Arts Dhahran Al Janub King Khalid University ABHA, Saudi Arabia
| |
Collapse
|
15
|
Anilkumar KK, Manoj VJ, Sagi TM. Automated detection of leukemia by pretrained deep neural networks and transfer learning: A comparison. Med Eng Phys 2021; 98:8-19. [PMID: 34848042 DOI: 10.1016/j.medengphy.2021.10.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 09/04/2021] [Accepted: 10/11/2021] [Indexed: 10/20/2022]
Abstract
Leukemia is usually diagnosed by viewing the smears of blood and bone marrow using microscopes and complex Cytochemical tests can be used to authorize and classify leukemia. But these methods are costly, slow and affected by the proficiency and expertise of the specialists concerned. Leukemia can be detected with the help of image processing-based methods by analyzing microscopic smear images to detect the presence of leukemic cells and such techniques are simple, fast, cheap and not biased by the specialists. The proposed study presents a computer aided diagnosis system that uses pretrained deep Convolutional Neural Networks (CNNs) for detection of leukemia images against normal images. The use of pretrained networks is comparatively an easy method of applying deep learning for image analysis and the comparison results of the present study can be used to choose appropriate networks for diagnostic tasks. The microscopic images used in the proposed work were downloaded from a public dataset ALL-IDB. In the proposed work, image classification is done without using any image segregation and feature extraction practices and the study used pretrained series network AlexNet, VGG-16, VGG-19, Directed Acyclic Graph (DAG) networks GoogLeNet, Inceptionv3, MobileNet-v2, Xception, DenseNet-201, Inception-ResNet-v2 and residual networks ResNet-18, ResNet-50 and ResNet-101 for performing the classification and comparison. A classification accuracy of 100% is obtained with all the pretrained networks used in the study for ALL_IDB1 dataset and for ALL_IDB2 dataset, 100% accuracy is obtained with all networks except the AlexNet and VGG-16. The efficacy of three optimization algorithms Stochastic Gradient Descent with Momentum (SGDM), Root Mean Square propagation (RMSprop) and Adaptive Moment estimation (ADAM) is also compared in all the classifications performed. The study considered the detection of leukemia in general only, and classification of leukemia into different types can be attempted as a future work.
Collapse
Affiliation(s)
- K K Anilkumar
- Department of Electronics and Communication, Cochin University College of Engineering Kuttanad, Cochin University of Science and Technology, Pulincunnu P.O., Alappuzha, Kerala 688504, India.
| | - V J Manoj
- Department of Electronics and Communication, Cochin University College of Engineering Kuttanad, Cochin University of Science and Technology, Pulincunnu P.O., Alappuzha, Kerala 688504, India
| | - T M Sagi
- Department of Medical Lab Technology, St. Thomas College of Allied Health Sciences, Changanacherry P.O., Kottayam, Kerala 686104, India
| |
Collapse
|
16
|
Qiao Y, Zhang Y, Liu N, Chen P, Liu Y. An End-to-End Pipeline for Early Diagnosis of Acute Promyelocytic Leukemia Based on a Compact CNN Model. Diagnostics (Basel) 2021; 11:diagnostics11071237. [PMID: 34359320 PMCID: PMC8304210 DOI: 10.3390/diagnostics11071237] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/06/2021] [Accepted: 07/06/2021] [Indexed: 01/31/2023] Open
Abstract
Timely microscopy screening of peripheral blood smears is essential for the diagnosis of acute promyelocytic leukemia (APL) due to the occurrence of early death (ED) before or during the initial therapy. Screening manually is time-consuming and tedious, and may lead to missed diagnosis or misdiagnosis because of subjective bias. To address these problems, we develop a three-step pipeline to help in the early diagnosis of APL from peripheral blood smears. The entire pipeline consists of leukocytes focusing, cell classification and diagnostic opinions. As the key component of the pipeline, a compact classification model based on attention embedded convolutional neural network blocks is proposed to distinguish promyelocytes from normal leukocytes. The compact classification model is validated on both the combination of two public datasets, APL-Cytomorphology_LMU and APL-Cytomorphology_JHH, as well as the clinical dataset, to yield a precision of 96.53% and 99.20%, respectively. The results indicate that our model outperforms the other evaluated popular classification models owing to its better accuracy and smaller size. Furthermore, the entire pipeline is validated on realistic patient data. The proposed method promises to act as an assistant tool for APL diagnosis.
Collapse
Affiliation(s)
- Yifan Qiao
- The College of Computer Science, Sichuan University, Chengdu 610065, China; (Y.Q.); (Y.Z.)
| | - Yi Zhang
- The College of Computer Science, Sichuan University, Chengdu 610065, China; (Y.Q.); (Y.Z.)
| | - Nian Liu
- The College of Electrical Engineering, Sichuan University, Chengdu 610065, China;
| | - Pu Chen
- The Department of Laboratory Medicine, Zhongshan Hospital, Fudan University, Shanghai 200032, China
- Correspondence: (P.C.); (Y.L.); Tel.: +86-021-64041990 (ext. 2435) (P.C.); +86-028-85120790 (Y.L.)
| | - Yan Liu
- The College of Electrical Engineering, Sichuan University, Chengdu 610065, China;
- Correspondence: (P.C.); (Y.L.); Tel.: +86-021-64041990 (ext. 2435) (P.C.); +86-028-85120790 (Y.L.)
| |
Collapse
|
17
|
A CNN-based unified framework utilizing projection loss in unison with label noise handling for multiple Myeloma cancer diagnosis. Med Image Anal 2021; 72:102099. [PMID: 34098240 DOI: 10.1016/j.media.2021.102099] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 04/26/2021] [Accepted: 04/27/2021] [Indexed: 01/16/2023]
Abstract
Multiple Myeloma (MM) is a malignancy of plasma cells. Similar to other forms of cancer, it demands prompt diagnosis for reducing the risk of mortality. The conventional diagnostic tools are resource-intense and hence, these solutions are not easily scalable for extending their reach to the masses. Advancements in deep learning have led to rapid developments in affordable, resource optimized, easily deployable computer-assisted solutions. This work proposes a unified framework for MM diagnosis using microscopic blood cell imaging data that addresses the key challenges of inter-class visual similarity of healthy versus cancer cells and that of the label noise of the dataset. To extract class distinctive features, we propose projection loss to maximize the projection of a sample's activation on the respective class vector besides imposing orthogonality constraints on the class vectors. This projection loss is used along with the cross-entropy loss to design a dual branch architecture that helps achieve improved performance and provides scope for targeting the label noise problem. Based on this architecture, two methodologies have been proposed to correct the noisy labels. A coupling classifier has also been proposed to resolve the conflicts in the dual-branch architecture's predictions. We have utilized a large dataset of 72 subjects (26 healthy and 46 MM cancer) containing a total of 74996 images (including 34555 training cell images and 40441 test cell images). This is so far the most extensive dataset on Multiple Myeloma cancer ever reported in the literature. An ablation study has also been carried out. The proposed architecture performs best with a balanced accuracy of 94.17% on binary cell classification of healthy versus cancer in the comparative performance with ten state-of-the-art architectures. Extensive experiments on two additional publicly available datasets of two different modalities have also been utilized for analyzing the label noise handling capability of the proposed methodology. The code will be available under https://github.com/shivgahlout/CAD-MM.
Collapse
|
18
|
Automated Detection of B Cell and T Cell Acute Lymphoblastic Leukaemia Using Deep Learning. Ing Rech Biomed 2021. [DOI: 10.1016/j.irbm.2021.05.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
|
19
|
Zhou M, Wu K, Yu L, Xu M, Yang J, Shen Q, Liu B, Shi L, Wu S, Dong B, Wang H, Yuan J, Shen S, Zhao L. Development and Evaluation of a Leukemia Diagnosis System Using Deep Learning in Real Clinical Scenarios. Front Pediatr 2021; 9:693676. [PMID: 34249819 PMCID: PMC8264256 DOI: 10.3389/fped.2021.693676] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Accepted: 05/27/2021] [Indexed: 11/13/2022] Open
Abstract
Leukemia is the most common malignancy affecting children. The morphologic analysis of bone marrow smears is an important initial step for diagnosis. Recent publications demonstrated that artificial intelligence is able to classify blood cells but a long way from clinical use. A total of 1,732 bone marrow images were used for the training of a convolutional neural network (CNN). New techniques of deep learning were integrated and an end-to-end leukemia diagnosis system was developed by using raw images without pre-processing. The system creatively imitated the workflow of a hematologist by detecting and excluding uncountable and crushed cells, then classifying and counting the remain cells to make a diagnosis. The performance of the CNN in classifying WBCs achieved an accuracy of 82.93%, precision of 86.07% and F1 score of 82.02%. And the performance in diagnosing acute lymphoid leukemia achieved an accuracy of 89%, sensitivity of 86% and specificity of 95%. The system also performs well at detecting the bone marrow metastasis of lymphoma and neuroblastoma, achieving an average accuracy of 82.93%. This is the first study which included a wider variety of cell types in leukemia diagnosis, and achieved a relatively high performance in real clinical scenarios.
Collapse
Affiliation(s)
- Min Zhou
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Department of Hematology, Shanghai Children's Medical Center, Shanghai, China
| | - Kefei Wu
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Department of Hematology, Shanghai Children's Medical Center, Shanghai, China
| | - Lisha Yu
- Department of Hematology, Shanghai Children's Medical Center, Shanghai, China
| | - Mengdi Xu
- Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China.,YITU AI Research Institute for Healthcare, Zhejiang, China
| | - Junjun Yang
- Department of Laboratory Medicine, The Second Affiliated Hospital and Yuying Children's Hospital of Wenzhou Medical University, Zhejiang, China
| | - Qing Shen
- Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China.,YITU AI Research Institute for Healthcare, Zhejiang, China
| | - Bo Liu
- Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China.,YITU AI Research Institute for Healthcare, Zhejiang, China
| | - Lei Shi
- Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China.,YITU AI Research Institute for Healthcare, Zhejiang, China
| | - Shuang Wu
- Shanghai Key Laboratory of Artificial Intelligence for Medical Image and Knowledge Graph, Shanghai, China.,YITU AI Research Institute for Healthcare, Zhejiang, China
| | - Bin Dong
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China
| | - Hansong Wang
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Children Health Advocacy Institute, China Hospital Development Institute of Shanghai Jiaotong University, Shanghai, China
| | - Jiajun Yuan
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Division of Medical Administration, Shanghai Children's Medical Center, Shanghai, China
| | - Shuhong Shen
- Department of Hematology, Shanghai Children's Medical Center, Shanghai, China
| | - Liebin Zhao
- Pediatric AI Clinical Application and Research Center, Shanghai Children's Medical Center, Shanghai, China.,Children Health Advocacy Institute, China Hospital Development Institute of Shanghai Jiaotong University, Shanghai, China
| |
Collapse
|
20
|
Anilkumar K, Manoj V, Sagi T. A survey on image segmentation of blood and bone marrow smear images with emphasis to automated detection of Leukemia. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2020.08.010] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
21
|
Gehlot S, Gupta A, Gupta R. SDCT-AuxNet θ: DCT augmented stain deconvolutional CNN with auxiliary classifier for cancer diagnosis. Med Image Anal 2020; 61:101661. [PMID: 32066066 DOI: 10.1016/j.media.2020.101661] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Revised: 01/27/2020] [Accepted: 01/28/2020] [Indexed: 12/13/2022]
Abstract
Acute lymphoblastic leukemia (ALL) is a pervasive pediatric white blood cell cancer across the globe. With the popularity of convolutional neural networks (CNNs), computer-aided diagnosis of cancer has attracted considerable attention. Such tools are easily deployable and are cost-effective. Hence, these can enable extensive coverage of cancer diagnostic facilities. However, the development of such a tool for ALL cancer was challenging so far due to the non-availability of a large training dataset. The visual similarity between the malignant and normal cells adds to the complexity of the problem. This paper discusses the recent release of a large dataset and presents a novel deep learning architecture for the classification of cell images of ALL cancer. The proposed architecture, namely, SDCT-AuxNetθ is a 2-module framework that utilizes a compact CNN as the main classifier in one module and a Kernel SVM as the auxiliary classifier in the other one. While CNN classifier uses features through bilinear-pooling, spectral-averaged features are used by the auxiliary classifier. Further, this CNN is trained on the stain deconvolved quantity images in the optical density domain instead of the conventional RGB images. A novel test strategy is proposed that exploits both the classifiers for decision making using the confidence scores of their predicted class labels. Elaborate experiments have been carried out on our recently released public dataset of 15114 images of ALL cancer and healthy cells to establish the validity of the proposed methodology that is also robust to subject-level variability. A weighted F1 score of 94.8% is obtained that is best so far on this challenging dataset.
Collapse
Affiliation(s)
- Shiv Gehlot
- SBILab, Department of ECE, IIIT-Delhi, New Delhi, 110020, India
| | - Anubha Gupta
- SBILab, Department of ECE, IIIT-Delhi, New Delhi, 110020, India.
| | - Ritu Gupta
- Laboratory Oncology Unit, Dr. B.R.A.IRCH, AIIMS, New Delhi 110029, India.
| |
Collapse
|
22
|
Kimura K, Tabe Y, Ai T, Takehara I, Fukuda H, Takahashi H, Naito T, Komatsu N, Uchihashi K, Ohsaka A. A novel automated image analysis system using deep convolutional neural networks can assist to differentiate MDS and AA. Sci Rep 2019; 9:13385. [PMID: 31527646 PMCID: PMC6746738 DOI: 10.1038/s41598-019-49942-z] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2019] [Accepted: 08/29/2019] [Indexed: 12/31/2022] Open
Abstract
Detection of dysmorphic cells in peripheral blood (PB) smears is essential in diagnostic screening of hematological diseases. Myelodysplastic syndromes (MDS) are hematopoietic neoplasms characterized by dysplastic and ineffective hematopoiesis, which diagnosis is mainly based on morphological findings of PB and bone marrow. We developed an automated diagnostic support system of MDS by combining an automated blood cell image-recognition system using a deep learning system (DLS) powered by convolutional neural networks (CNNs) with a decision-making system using extreme gradient boosting (XGBoost). The DLS of blood cell image-recognition has been trained using datasets consisting of 695,030 blood cell images taken from 3,261 PB smears including hematopoietic malignancies. The DLS simultaneously classified 17 blood cell types and 97 morphological features of such cells with >93.5% sensitivity and >96.0% specificity. The automated MDS diagnostic system successfully differentiated MDS from aplastic anemia (AA) with high accuracy; 96.2% of sensitivity and 100% of specificity (AUC 0.990). This is the first CNN-based automated initial diagnostic system for MDS using PB smears, which is applicable to develop new automated diagnostic systems for various hematological disorders.
Collapse
Affiliation(s)
- Konobu Kimura
- Department of Next Generation Hematology Laboratory Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan.,Sysmex Corporation, Kobe, Japan
| | - Yoko Tabe
- Department of Next Generation Hematology Laboratory Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan. .,Department of Clinical Laboratory Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan.
| | - Tomohiko Ai
- Department of Clinical Laboratory Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | | | - Hiroshi Fukuda
- Department of General Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Hiromizu Takahashi
- Department of General Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Toshio Naito
- Department of General Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | - Norio Komatsu
- Department of Hematology, Juntendo University Graduate School of Medicine, Tokyo, Japan
| | | | - Akimichi Ohsaka
- Department of Next Generation Hematology Laboratory Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan.,Department of Transfusion Medicine and Stem Cell Regulation, Juntendo University Graduate School of Medicine, Tokyo, Japan
| |
Collapse
|
23
|
Salah HT, Muhsen IN, Salama ME, Owaidah T, Hashmi SK. Machine learning applications in the diagnosis of leukemia: Current trends and future directions. Int J Lab Hematol 2019; 41:717-725. [PMID: 31498973 DOI: 10.1111/ijlh.13089] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2019] [Revised: 06/27/2019] [Accepted: 07/11/2019] [Indexed: 01/08/2023]
Abstract
Machine learning (ML) offers opportunities to advance pathological diagnosis, especially with increasing trends in digitalizing microscopic images. Diagnosing leukemia is time-consuming and challenging in many areas globally and there is a growing trend in utilizing ML techniques for its diagnosis. In this review, we aimed to describe the literature of ML utilization in the diagnosis of the four common types of leukemia: acute lymphocytic leukemia (ALL), chronic lymphocytic leukemia (CLL), acute myeloid leukemia (AML), and chronic myelogenous leukemia (CML). Using a strict selection criterion, utilizing MeSH terminology and Boolean logic, an electronic search of MEDLINE and IEEE Xplore Digital Library was performed. The electronic search was complemented by handsearching of references of related studies and the top results of Google Scholar. The full texts of 58 articles were reviewed, out of which, 22 studies were included. The number of studies discussing ALL, AML, CLL, and CML was 12, 8, 3, and 1, respectively. No studies were prospectively applying algorithms in real-world scenarios. Majority of studies had small and homogenous samples and used supervised learning for classification tasks. 91% of the studies were performed after 2010, and 74% of the included studies applied ML algorithms to microscopic diagnosis of leukemia. The included studies illustrated the need to develop the field of ML research, including the transformation from solely designing algorithms to practically applying them clinically.
Collapse
Affiliation(s)
- Haneen T Salah
- College of Medicine, Alfaisal University, Riyadh, Saudi Arabia
| | - Ibrahim N Muhsen
- Department of Medicine, Houston Methodist Hospital, Houston, TX, USA
| | - Mohamed E Salama
- Department of Laboratory Medicine & Pathology, Mayo Clinic, Rochester, MN, USA
| | - Tarek Owaidah
- Department of Pathology and Laboratory Medicine, King Faisal Specialist Hospital and Research Center, Riyadh, Saudi Arabia
| | - Shahrukh K Hashmi
- Oncology Center, King Faisal Specialist Hospital and Research Center, Riyadh, Saudi Arabia.,Division of Hematology, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
24
|
Ghane N, Vard A, Talebi A, Nematollahy P. Classification of chronic myeloid leukemia cell subtypes based on microscopic image analysis. EXCLI JOURNAL 2019; 18:382-404. [PMID: 31338009 PMCID: PMC6635720 DOI: 10.17179/excli2019-1292] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Accepted: 06/04/2019] [Indexed: 11/10/2022]
Abstract
This paper presents a simple and efficient computer-aided diagnosis method to classify Chronic Myeloid Leukemia (CML) cells based on microscopic image processing. In the proposed method, a novel combination of both typical and new features is introduced for classification of CML cells. Next, an effective decision tree classifier is proposed to classify CML cells into eight groups. The proposed method was evaluated on 1730 CML cell images containing 714 cells of non-cancerous bone marrow aspiration and 1016 cells of cancerous peripheral blood smears. The performance of the proposed classification method was compared to manual labels made by two experts. The average values of accuracy, specificity and sensitivity were 99.0 %, 99.4 % and 98.3 %, respectively for all groups of CML. In addition, Cohen's kappa coefficient demonstrated high conformity, 0.99, between joint diagnostic results of two experts and the obtained results of the proposed approach. According to the obtained results, the suggested method has a high capability to classify effective cells of CML and can be applied as a simple, affordable and reliable computer-aided diagnosis tool to help pathologists to diagnose CML.
Collapse
Affiliation(s)
- Narjes Ghane
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine and Student Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Alireza Vard
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine and Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Ardeshir Talebi
- Department of Pathology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Pardis Nematollahy
- Department of Pathology, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
25
|
Boldú L, Merino A, Alférez S, Molina A, Acevedo A, Rodellar J. Automatic recognition of different types of acute leukaemia in peripheral blood by image analysis. J Clin Pathol 2019; 72:755-761. [PMID: 31256009 DOI: 10.1136/jclinpath-2019-205949] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 06/07/2019] [Accepted: 06/08/2019] [Indexed: 11/03/2022]
Abstract
AIMS Morphological differentiation among different blast cell lineages is a difficult task and there is a lack of automated analysers able to recognise these abnormal cells. This study aims to develop a machine learning approach to predict the diagnosis of acute leukaemia using peripheral blood (PB) images. METHODS A set of 442 smears was analysed from 206 patients. It was split into a training set with 75% of these smears and a testing set with the remaining 25%. Colour clustering and mathematical morphology were used to segment cell images, which allowed the extraction of 2,867 geometric, colour and texture features. Several classification techniques were studied to obtain the most accurate classification method. Afterwards, the classifier was assessed with the images of the testing set. The final strategy was to predict the patient's diagnosis using the PB smear, and the final assessment was done with the cell images of the smears of the testing set. RESULTS The highest classification accuracy was achieved with the selection of 700 features with linear discriminant analysis. The overall classification accuracy for the six groups of cell types was 85.8%, while the overall classification accuracy for individual smears was 94% as compared with the true confirmed diagnosis. CONCLUSIONS The proposed method achieves a high diagnostic precision in the recognition of different types of blast cells among other mononuclear cells circulating in blood. It is the first encouraging step towards the idea of being a diagnostic support tool in the future.
Collapse
Affiliation(s)
- Laura Boldú
- Biochemistry and Molecular Genetics, Biomedical Diagnostic Center, Hospital Clinic of Barcelona, Barcelona, Catalonia, Spain
| | - Anna Merino
- Biochemistry and Molecular Genetics, Biomedical Diagnostic Center, Hospital Clinic of Barcelona, Barcelona, Catalonia, Spain
| | - Santiago Alférez
- Mathematics, EEBE, Technical University of Catalonia, Barcelona, Catalonia, Spain
| | - Angel Molina
- Biochemistry and Molecular Genetics, Biomedical Diagnostic Center, Hospital Clinic of Barcelona, Barcelona, Catalonia, Spain
| | - Andrea Acevedo
- Mathematics, EEBE, Technical University of Catalonia, Barcelona, Catalonia, Spain
| | - José Rodellar
- Mathematics, EEBE, Technical University of Catalonia, Barcelona, Catalonia, Spain
| |
Collapse
|
26
|
Wang Q, Bi S, Sun M, Wang Y, Wang D, Yang S. Deep learning approach to peripheral leukocyte recognition. PLoS One 2019; 14:e0218808. [PMID: 31237896 PMCID: PMC6592546 DOI: 10.1371/journal.pone.0218808] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2019] [Accepted: 06/10/2019] [Indexed: 11/18/2022] Open
Abstract
Microscopic examination of peripheral blood plays an important role in the field of diagnosis and control of major diseases. Peripheral leukocyte recognition by manual requires medical technicians to observe blood smears through light microscopy, using their experience and expertise to discriminate and analyze different cells, which is time-consuming, labor-intensive and subjective. The traditional systems based on feature engineering often need to ensure successful segmentation and then manually extract certain quantitative and qualitative features for recognition but still remaining a limitation of poor robustness. The classification pipeline based on convolutional neural network is of automatic feature extraction and free of segmentation but hard to deal with multiple object recognition. In this paper, we take leukocyte recognition as object detection task and apply two remarkable object detection approaches, Single Shot Multibox Detector and An Incremental Improvement Version of You Only Look Once. To improve recognition performance, some key factors involving these object detection approaches are explored and the detection models are generated using the train set of 14,700 annotated images. Finally, we evaluate these detection models on test sets consisting of 1,120 annotated images and 7,868 labeled single object images corresponding to 11 categories of peripheral leukocytes, respectively. A best mean average precision of 93.10% and mean accuracy of 90.09% are achieved while the inference time is 53 ms per image on a NVIDIA GTX1080Ti GPU.
Collapse
Affiliation(s)
- Qiwei Wang
- School of Mechanical Engineering & Automation, Beihang University, Beijing, China
| | - Shusheng Bi
- School of Mechanical Engineering & Automation, Beihang University, Beijing, China
| | - Minglei Sun
- School of Mechanical Engineering & Automation, Beihang University, Beijing, China
| | - Yuliang Wang
- School of Mechanical Engineering & Automation, Beihang University, Beijing, China
| | - Di Wang
- Department of Technology Research, Beijing iCELL Medical Co. Ltd., Beijing, China
| | - Shaobao Yang
- Department of Technology Research, Beijing iCELL Medical Co. Ltd., Beijing, China
| |
Collapse
|
27
|
Puigví L, Merino A, Alférez S, Boldú L, Acevedo A, Rodellar J. Quantitative Cytologic Descriptors to Differentiate CLL, Sézary, Granular, and Villous Lymphocytes Through Image Analysis. Am J Clin Pathol 2019; 152:74-85. [PMID: 30989170 DOI: 10.1093/ajcp/aqz025] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVES We aimed to find descriptors to identify chronic lymphocytic leukemia (CLL), Sézary, granular, and villous lymphocytes among normal and abnormal lymphocytes in peripheral blood. METHODS Image analysis was applied to 768 images from 15 different types of lymphoid cells and monocytes to determine four discriminant descriptors. For each descriptor, numerical scales were obtained using 627 images from 79 patients. An assessment of the four descriptors was performed using smears from 209 new patients. RESULTS Cyan correlation of the nucleus identified clumped chromatin, and standard deviation of the granulometric curve of the cyan of the nucleus was specific for cerebriform chromatin. Skewness of the histogram of the u component of the cytoplasm identified cytoplasmic granulation. Hairiness showed specificity for cytoplasmic villi. In the assessment, 96% of the smears were correctly classified. CONCLUSIONS The quantitative descriptors obtained through image analysis may contribute to the morphologic identification of the abnormal lymphoid cells considered in this article.
Collapse
Affiliation(s)
- Laura Puigví
- Biomedical Diagnostic Centre, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
- Department of Mathematics, Barcelona Est Engineering School, Technical University of Catalonia, Barcelona, Spain
| | - Anna Merino
- Biomedical Diagnostic Centre, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | - Santiago Alférez
- Department of Mathematics, Barcelona Est Engineering School, Technical University of Catalonia, Barcelona, Spain
| | - Laura Boldú
- Biomedical Diagnostic Centre, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | - Andrea Acevedo
- Department of Mathematics, Barcelona Est Engineering School, Technical University of Catalonia, Barcelona, Spain
| | - José Rodellar
- Department of Mathematics, Barcelona Est Engineering School, Technical University of Catalonia, Barcelona, Spain
| |
Collapse
|
28
|
Andrade AR, Vogado LHS, Veras RDMS, Silva RRV, Araujo FHD, Medeiros FNS. Recent computational methods for white blood cell nuclei segmentation: A comparative study. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 173:1-14. [PMID: 31046984 DOI: 10.1016/j.cmpb.2019.03.001] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2018] [Revised: 02/05/2019] [Accepted: 03/04/2019] [Indexed: 06/09/2023]
Abstract
BACKGROUND AND OBJECTIVE Leukaemia is a disease found worldwide; it is a type of cancer that originates in the bone marrow and is characterised by an abnormal proliferation of white blood cells (leukocytes). In order to correctly identify this abnormality, haematologists examine blood smears from patients. A diagnosis obtained by this method may be influenced by factors such as the experience and level of fatigue of the haematologist, resulting in non-standard reports and even errors. In the literature, several methods have been proposed that involve algorithms to diagnose this disease. However, no reviews or surveys have been conducted. This paper therefore presents an empirical investigation of computational methods focusing on the segmentation of leukocytes. METHODS In our study, 15 segmentation methods were evaluated using five public image databases: ALL-IDB2, BloodSeg, Leukocytes, JTSC Database and CellaVision. Following the standard methodology for literature evaluation, we conducted a pixel-level segmentation evaluation by comparing the segmented image with its corresponding ground truth. In order to identify the strengths and weaknesses of these methods, we performed an evaluation using six evaluation metrics: accuracy, specificity, precision, recall, kappa, Dice, and true positive rate. RESULTS The segmentation algorithms performed significantly differently for different image databases, and for each database, a different algorithm achieved the best results. Moreover, the two best methods achieved average accuracy values higher than 97%, with an excellent kappa index. Also, the average Dice index indicated that the similarity between the segmented leukocyte and its ground truth was higher than 0.85 for these two methods This result confirms the high level of similarity between these images but does not guarantee that a method has segmented all leukocyte nuclei. We also found that the method that performed best segmented only 58.44% of all leukocytes. CONCLUSIONS Of the techniques used to segment leukocytes, we note that clustering algorithms, the Otsu threshold, simple arithmetic operations and region growing are the approaches most widely used for this purpose. However, these computational methods have not yet overcome all the challenges posed by this problem.
Collapse
Affiliation(s)
| | | | | | | | | | - Fátima N S Medeiros
- Teleinformatics Engineering Department, Federal University of Ceará, Ceará, Brazil.
| |
Collapse
|
29
|
Kuok CP, Horng MH, Liao YM, Chow NH, Sun YN. An effective and accurate identification system of Mycobacterium tuberculosis using convolution neural networks. Microsc Res Tech 2019; 82:709-719. [PMID: 30741460 DOI: 10.1002/jemt.23217] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Revised: 11/09/2018] [Accepted: 12/15/2018] [Indexed: 12/27/2022]
Abstract
Tuberculosis (TB) remains the leading cause of morbidity and mortality from infectious disease in developing countries. The sputum smear microscopy remains the primary diagnostic laboratory test. However, microscopic examination is always time-consuming and tedious. Therefore, an effective computer-aided image identification system is needed to provide timely assistance in diagnosis. The current identification system usually suffers from complex color variations of the images, resulting in plentiful of false object detection. To overcome the dilemma, we propose a two-stage Mycobacterium tuberculosis identification system, consisting of candidate detection and classification using convolution neural networks (CNNs). The refined Faster region-based CNN was used to distinguish candidates of M. tuberculosis and the actual ones were classified by utilizing CNN-based classifier. We first compared three different CNNs, including ensemble CNN, single-member CNN, and deep CNN. The experimental results showed that both ensemble and deep CNNs were on par with similar identification performance when analyzing more than 19,000 images. A much better recall value was achieved by using our proposed system in comparison with conventional pixel-based support vector machine method for M. tuberculosis bacilli detection.
Collapse
Affiliation(s)
- Chan-Pang Kuok
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Ming-Huwi Horng
- Department of Computer Science and Information Engineering, National Pingtung University, Pingtung, Taiwan
| | - Yu-Ming Liao
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
| | - Nan-Haw Chow
- Department of Pathology, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Yung-Nien Sun
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan.,MOST AI Biomedical Research Center, Tainan, Taiwan
| |
Collapse
|
30
|
Kozlowski C, Brumm J, Cain G. An Automated Image Analysis Method to Quantify Veterinary Bone Marrow Cellularity on H&E Sections. Toxicol Pathol 2018; 46:324-335. [DOI: 10.1177/0192623318766457] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Bone marrow toxicity is a common finding when assessing safety of drug candidate molecules. Standard hematoxylin and eosin (H&E) marrow tissue sections are typically manually evaluated to provide a semiquantitative assessment of overall cellularity. Here, we developed an automated image analysis method that allows quantitative assessment of changes in bone marrow cell population in sternal bone. In order to test whether the method was repeatable and sensitive, we compared the automated method with manual subjective histopathology scoring of total cellularity in rat sternal bone marrow samples across 17 independently run studies. The automated method was consistent with manual scoring methodology for detecting altered bone marrow cellularity and, in multiple cases, identified changes at lower doses. The image analysis method allows rapid and more quantitative assessment of bone marrow toxicity compared to manual examination of H&E slides, making it an excellent tool to aid detection of bone marrow cell depletion in preclinical toxicologic studies.
Collapse
Affiliation(s)
- Cleopatra Kozlowski
- Safety Assessment Pathology, Genentech Inc., South San Francisco, California, USA
| | - Jochen Brumm
- Biostatistics, Genentech Inc., South San Francisco, California, USA
| | - Gary Cain
- Safety Assessment Pathology, Genentech Inc., South San Francisco, California, USA
| |
Collapse
|
31
|
Shafique S, Tehsin S. Computer-Aided Diagnosis of Acute Lymphoblastic Leukaemia. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:6125289. [PMID: 29681996 PMCID: PMC5851334 DOI: 10.1155/2018/6125289] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2017] [Revised: 12/31/2017] [Accepted: 01/31/2018] [Indexed: 11/19/2022]
Abstract
Leukaemia is a form of blood cancer which affects the white blood cells and damages the bone marrow. Usually complete blood count (CBC) and bone marrow aspiration are used to diagnose the acute lymphoblastic leukaemia. It can be a fatal disease if not diagnosed at the earlier stage. In practice, manual microscopic evaluation of stained sample slide is used for diagnosis of leukaemia. But manual diagnostic methods are time-consuming, less accurate, and prone to errors due to various human factors like stress, fatigue, and so forth. Therefore, different automated systems have been proposed to wrestle the glitches in the manual diagnostic methods. In recent past, some computer-aided leukaemia diagnosis methods are presented. These automated systems are fast, reliable, and accurate as compared to manual diagnosis methods. This paper presents review of computer-aided diagnosis systems regarding their methodologies that include enhancement, segmentation, feature extraction, classification, and accuracy.
Collapse
Affiliation(s)
- Sarmad Shafique
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| | - Samabia Tehsin
- Department of Computer Science, Bahria University, Islamabad, Pakistan
| |
Collapse
|
32
|
Jamshidi A, Faghih-Roohi S, Hajizadeh S, Núñez A, Babuska R, Dollevoet R, Li Z, De Schutter B. A Big Data Analysis Approach for Rail Failure Risk Assessment. RISK ANALYSIS : AN OFFICIAL PUBLICATION OF THE SOCIETY FOR RISK ANALYSIS 2017; 37:1495-1507. [PMID: 28561899 DOI: 10.1111/risa.12836] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Railway infrastructure monitoring is a vital task to ensure rail transportation safety. A rail failure could result in not only a considerable impact on train delays and maintenance costs, but also on safety of passengers. In this article, the aim is to assess the risk of a rail failure by analyzing a type of rail surface defect called squats that are detected automatically among the huge number of records from video cameras. We propose an image processing approach for automatic detection of squats, especially severe types that are prone to rail breaks. We measure the visual length of the squats and use them to model the failure risk. For the assessment of the rail failure risk, we estimate the probability of rail failure based on the growth of squats. Moreover, we perform severity and crack growth analyses to consider the impact of rail traffic loads on defects in three different growth scenarios. The failure risk estimations are provided for several samples of squats with different crack growth lengths on a busy rail track of the Dutch railway network. The results illustrate the practicality and efficiency of the proposed approach.
Collapse
Affiliation(s)
- Ali Jamshidi
- Section of Railway Engineering, Delft University of Technology, Delft, The Netherlands
| | - Shahrzad Faghih-Roohi
- Delft Center For Systems and Control, Delft University of Technology, The Netherlands
| | - Siamak Hajizadeh
- Section of Railway Engineering, Delft University of Technology, Delft, The Netherlands
| | - Alfredo Núñez
- Section of Railway Engineering, Delft University of Technology, Delft, The Netherlands
| | - Robert Babuska
- Delft Center For Systems and Control, Delft University of Technology, The Netherlands
| | - Rolf Dollevoet
- Section of Railway Engineering, Delft University of Technology, Delft, The Netherlands
| | - Zili Li
- Section of Railway Engineering, Delft University of Technology, Delft, The Netherlands
| | - Bart De Schutter
- Delft Center For Systems and Control, Delft University of Technology, The Netherlands
| |
Collapse
|