1
|
Islam MM, Rifat HR, Shahid MSB, Akhter A, Uddin MA. Utilizing Deep Feature Fusion for Automatic Leukemia Classification: An Internet of Medical Things-Enabled Deep Learning Framework. SENSORS (BASEL, SWITZERLAND) 2024; 24:4420. [PMID: 39001200 PMCID: PMC11244606 DOI: 10.3390/s24134420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 06/30/2024] [Accepted: 07/05/2024] [Indexed: 07/16/2024]
Abstract
Acute lymphoblastic leukemia, commonly referred to as ALL, is a type of cancer that can affect both the blood and the bone marrow. The process of diagnosis is a difficult one since it often calls for specialist testing, such as blood tests, bone marrow aspiration, and biopsy, all of which are highly time-consuming and expensive. It is essential to obtain an early diagnosis of ALL in order to start therapy in a timely and suitable manner. In recent medical diagnostics, substantial progress has been achieved through the integration of artificial intelligence (AI) and Internet of Things (IoT) devices. Our proposal introduces a new AI-based Internet of Medical Things (IoMT) framework designed to automatically identify leukemia from peripheral blood smear (PBS) images. In this study, we present a novel deep learning-based fusion model to detect ALL types of leukemia. The system seamlessly delivers the diagnostic reports to the centralized database, inclusive of patient-specific devices. After collecting blood samples from the hospital, the PBS images are transmitted to the cloud server through a WiFi-enabled microscopic device. In the cloud server, a new fusion model that is capable of classifying ALL from PBS images is configured. The fusion model is trained using a dataset including 6512 original and segmented images from 89 individuals. Two input channels are used for the purpose of feature extraction in the fusion model. These channels include both the original and the segmented images. VGG16 is responsible for extracting features from the original images, whereas DenseNet-121 is responsible for extracting features from the segmented images. The two output features are merged together, and dense layers are used for the categorization of leukemia. The fusion model that has been suggested obtains an accuracy of 99.89%, a precision of 99.80%, and a recall of 99.72%, which places it in an excellent position for the categorization of leukemia. The proposed model outperformed several state-of-the-art Convolutional Neural Network (CNN) models in terms of performance. Consequently, this proposed model has the potential to save lives and effort. For a more comprehensive simulation of the entire methodology, a web application (Beta Version) has been developed in this study. This application is designed to determine the presence or absence of leukemia in individuals. The findings of this study hold significant potential for application in biomedical research, particularly in enhancing the accuracy of computer-aided leukemia detection.
Collapse
Affiliation(s)
- Md Manowarul Islam
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Habibur Rahman Rifat
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Md Shamim Bin Shahid
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Arnisha Akhter
- Department of Computer Science and Engineering, Jagannath University, Dhaka 1100, Bangladesh
| | - Md Ashraf Uddin
- School of Info Technology, Deakin University, Burwood, VIC 3125, Australia
| |
Collapse
|
2
|
Yao B, Chao L, Asadi M, Alnowibet KA. Modified osprey algorithm for optimizing capsule neural network in leukemia image recognition. Sci Rep 2024; 14:15402. [PMID: 38965305 PMCID: PMC11224281 DOI: 10.1038/s41598-024-66187-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Accepted: 06/28/2024] [Indexed: 07/06/2024] Open
Abstract
The diagnosis of leukemia is a serious matter that requires immediate and accurate attention. This research presents a revolutionary method for diagnosing leukemia using a Capsule Neural Network (CapsNet) with an optimized design. CapsNet is a cutting-edge neural network that effectively captures complex features and spatial relationships within images. To improve the CapsNet's performance, a Modified Version of Osprey Optimization Algorithm (MOA) has been utilized. Thesuggested approach has been tested on the ALL-IDB database, a widely recognized dataset for leukemia image classification. Comparative analysis with various machine learning techniques, including Combined combine MobilenetV2 and ResNet18 (MBV2/Res) network, Depth-wise convolution model, a hybrid model that combines a genetic algorithm with ResNet-50V2 (ResNet/GA), and SVM/JAYA demonstrated the superiority of our method in different terms. As a result, the proposed method is a robust and powerful tool for diagnosing leukemia from medical images.
Collapse
Affiliation(s)
- Bingying Yao
- Software Engineering Department, Software Engineering Institute Of Guangzhou, Guangzhou, 510000, China
| | - Li Chao
- College of Information Technology, Guangdong Industry Polytechnic, Foshan, 510300, China.
| | - Mehdi Asadi
- Ankara Yıldırım Beyazıt University (AYBU), 06010, Ankara, Turkey.
| | - Khalid A Alnowibet
- Statistics and Operations Research Department, College of Science, King Saud University, Riyadh, 11451, Kingdom of Saudi Arabia
| |
Collapse
|
3
|
Didi I, Alliot JM, Dumas PY, Vergez F, Tavitian S, Largeaud L, Bidet A, Rieu JB, Luquet I, Lechevalier N, Delabesse E, Sarry A, De Grande AC, Bérard E, Pigneux A, Récher C, Simoncini D, Bertoli S. Artificial intelligence-based prediction models for acute myeloid leukemia using real-life data: A DATAML registry study. Leuk Res 2024; 136:107437. [PMID: 38215555 DOI: 10.1016/j.leukres.2024.107437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 12/19/2023] [Accepted: 01/05/2024] [Indexed: 01/14/2024]
Abstract
We designed artificial intelligence-based prediction models (AIPM) using 52 diagnostic variables from 3687 patients included in the DATAML registry treated with intensive chemotherapy (IC, N = 3030) or azacitidine (AZA, N = 657) for an acute myeloid leukemia (AML). A neural network called multilayer perceptron (MLP) achieved a prediction accuracy for overall survival (OS) of 68.5% and 62.1% in the IC and AZA cohorts, respectively. The Boruta algorithm could select the most important variables for prediction without decreasing accuracy. Thirteen features were retained with this algorithm in the IC cohort: age, cytogenetic risk, white blood cells count, LDH, platelet count, albumin, MPO expression, mean corpuscular volume, CD117 expression, NPM1 mutation, AML status (de novo or secondary), multilineage dysplasia and ASXL1 mutation; and 7 variables in the AZA cohort: blood blasts, serum ferritin, CD56, LDH, hemoglobin, CD13 and disseminated intravascular coagulation (DIC). We believe that AIPM could help hematologists to deal with the huge amount of data available at diagnosis, enabling them to have an OS estimation and guide their treatment choice. Our registry-based AIPM could offer a large real-life dataset with original and exhaustive features and select a low number of diagnostic features with an equivalent accuracy of prediction, more appropriate to routine practice.
Collapse
Affiliation(s)
| | | | - Pierre-Yves Dumas
- Centre Hospitalier Universitaire de Bordeaux, Service d'Hématologie Clinique et de Thérapie Cellulaire, Bordeaux, France; Université de Bordeaux, Bordeaux, France; Institut National de la Santé et de la Recherche Médicale, U1035 Bordeaux, France
| | - François Vergez
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer Toulouse-Oncopole, Laboratoire d'hématologie, Toulouse, France; Centre de Recherches en Cancérologie de Toulouse, Université Toulouse 3 Paul Sabatier, Toulouse, France
| | - Suzanne Tavitian
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer de Toulouse-Oncopole, Service d'hématologie, Toulouse, France
| | - Laëtitia Largeaud
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer Toulouse-Oncopole, Laboratoire d'hématologie, Toulouse, France; Centre de Recherches en Cancérologie de Toulouse, Université Toulouse 3 Paul Sabatier, Toulouse, France
| | - Audrey Bidet
- CHU Bordeaux, Laboratoire d'Hématologie Biologique, F-33000 Bordeaux, France
| | - Jean-Baptiste Rieu
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer Toulouse-Oncopole, Laboratoire d'hématologie, Toulouse, France
| | - Isabelle Luquet
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer Toulouse-Oncopole, Laboratoire d'hématologie, Toulouse, France
| | - Nicolas Lechevalier
- CHU Bordeaux, Laboratoire d'Hématologie Biologique, F-33000 Bordeaux, France
| | - Eric Delabesse
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer Toulouse-Oncopole, Laboratoire d'hématologie, Toulouse, France; Centre de Recherches en Cancérologie de Toulouse, Université Toulouse 3 Paul Sabatier, Toulouse, France
| | - Audrey Sarry
- Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer de Toulouse-Oncopole, Service d'hématologie, Toulouse, France
| | - Anne-Charlotte De Grande
- Centre Hospitalier Universitaire de Bordeaux, Service d'Hématologie Clinique et de Thérapie Cellulaire, Bordeaux, France
| | - Emilie Bérard
- Department of Epidemiology, Health Economics and Public Health, UMR 1295 CERPOP, University of Toulouse, INSERM, UPS, Toulouse University Hospital (CHU), Toulouse, France
| | - Arnaud Pigneux
- Centre Hospitalier Universitaire de Bordeaux, Service d'Hématologie Clinique et de Thérapie Cellulaire, Bordeaux, France; Université de Bordeaux, Bordeaux, France
| | - Christian Récher
- Centre de Recherches en Cancérologie de Toulouse, Université Toulouse 3 Paul Sabatier, Toulouse, France; Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer de Toulouse-Oncopole, Service d'hématologie, Toulouse, France
| | - David Simoncini
- IRIT UMR 5505-CNRS, Université Toulouse I Capitole, Toulouse, France
| | - Sarah Bertoli
- Centre de Recherches en Cancérologie de Toulouse, Université Toulouse 3 Paul Sabatier, Toulouse, France; Centre Hospitalo-Universitaire de Toulouse, Institut Universitaire du Cancer de Toulouse-Oncopole, Service d'hématologie, Toulouse, France.
| |
Collapse
|
4
|
Elsayed B, Elhadary M, Elshoeibi RM, Elshoeibi AM, Badr A, Metwally O, ElSherif RA, Salem ME, Khadadah F, Alshurafa A, Mudawi D, Yassin M. Deep learning enhances acute lymphoblastic leukemia diagnosis and classification using bone marrow images. Front Oncol 2023; 13:1330977. [PMID: 38125946 PMCID: PMC10731043 DOI: 10.3389/fonc.2023.1330977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 11/27/2023] [Indexed: 12/23/2023] Open
Abstract
Acute lymphoblastic leukemia (ALL) poses a significant health challenge, particularly in pediatric cases, requiring precise and rapid diagnostic approaches. This comprehensive review explores the transformative capacity of deep learning (DL) in enhancing ALL diagnosis and classification, focusing on bone marrow image analysis. Examining ten studies conducted between 2013 and 2023 across various countries, including India, China, KSA, and Mexico, the synthesis underscores the adaptability and proficiency of DL methodologies in detecting leukemia. Innovative DL models, notably Convolutional Neural Networks (CNNs) with Cat-Boosting, XG-Boosting, and Transfer Learning techniques, demonstrate notable approaches. Some models achieve outstanding accuracy, with one CNN reaching 100% in cancer cell classification. The incorporation of novel algorithms like Cat-Swarm Optimization and specialized CNN architectures contributes to superior classification accuracy. Performance metrics highlight these achievements, with models consistently outperforming traditional diagnostic methods. For instance, a CNN with Cat-Boosting attains 100% accuracy, while others hover around 99%, showcasing DL models' robustness in ALL diagnosis. Despite acknowledged challenges, such as the need for larger and more diverse datasets, these findings underscore DL's transformative potential in reshaping leukemia diagnostics. The high numerical accuracies accentuate a promising trajectory toward more efficient and accurate ALL diagnosis in clinical settings, prompting ongoing research to address challenges and refine DL models for optimal clinical integration.
Collapse
Affiliation(s)
| | | | | | | | - Ahmed Badr
- College of Medicine, Qatar University, Doha, Qatar
| | | | | | | | - Fatima Khadadah
- Cancer Genetics Lab, Kuwait Cancer Control Centre, Kuwait City, Kuwait
| | - Awni Alshurafa
- Department of Medical Oncology, National Center for Cancer Care and Research, Doha, Qatar
| | - Deena Mudawi
- Department of Medical Oncology, National Center for Cancer Care and Research, Doha, Qatar
| | - Mohamed Yassin
- College of Medicine, Qatar University, Doha, Qatar
- Department of Medical Oncology, National Center for Cancer Care and Research, Doha, Qatar
| |
Collapse
|
5
|
Saleem S, Amin J, Sharif M, Mallah GA, Kadry S, Gandomi AH. Leukemia segmentation and classification: A comprehensive survey. Comput Biol Med 2022; 150:106028. [PMID: 36126356 DOI: 10.1016/j.compbiomed.2022.106028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 07/11/2022] [Accepted: 08/20/2022] [Indexed: 11/30/2022]
Abstract
Blood is made up of leukocytes (WBCs), erythrocytes (RBCs), and thrombocytes. The ratio of blood cancer diseases is increasing rapidly, among which leukemia is one of the famous cancer which may lead to death. Leukemia cancer is initiated by the unnecessary growth of immature WBCs present in the sponge tissues of bone marrow. It is generally analyzed by etiologists by perceiving slides of blood smear images under a microscope. The morphological features and blood cells count facilitated the etiologists to detect leukemia. Due to the late detection and expensive instruments used for leukemia analysis, the death rate has risen significantly. The fluorescence-based cell sorting technique and manual recounts using a hemocytometer are error-prone and imprecise. Leukemia detection methods consist of pre-processing, segmentation, features extraction, and classification. In this article, recent deep learning methodologies and challenges for leukemia detection are discussed. These methods are helpful to examine the microscopic blood smears images and for the detection of leukemia more accurately.
Collapse
Affiliation(s)
- Saba Saleem
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | | | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, Kristiansand, Norway; Department of Electrical and Computer Engineering, Lebanese American University, Byblos, Lebanon
| | - Amir H Gandomi
- Faculty of Engineering & Information Technology, University of Technology Sydney, Ultimo, NSW, 2007, Australia.
| |
Collapse
|
6
|
DBN Neural Network Model Combined with Meta-Analysis on the Curative Effect of Acupuncture and Massage. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:8488167. [PMID: 36105643 PMCID: PMC9467747 DOI: 10.1155/2022/8488167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 08/01/2022] [Accepted: 08/14/2022] [Indexed: 11/17/2022]
Abstract
Acupuncture and massage are among the oldest medical treatments in China. During the acupuncture process, as well as the subsequent needle extraction process, there are differences in the acupuncture intensity, treatment duration, and acupuncture depth. For both medical treatments of acupuncture and massage, this article learns and analyzes a large amount of literature and applies DBN neural network method to build a human skeletal model to simulate and identify medical professional steps such as acupuncture therapy. The research results show that the recognition rate of DBN reaches 92.1% after the training of 1000 samples. After learning all the training samples, the DBN model achieved feature recognition accuracy of 96.4%, 97.68%, 96.66%, and 92.27% for the test samples of mixed needling process, needle insertion operation, needle extraction operation, and rotary needle handling process, respectively. The research in this article can contribute to the modernization of Chinese medicine by maximizing the simulation of the force on the human body when receiving needling and tui-na, as well as the clinical treatment effect.
Collapse
|
7
|
Reena MR, Ameer PM. A content-based image retrieval system for the diagnosis of lymphoma using blood micrographs: An incorporation of deep learning with a traditional learning approach. Comput Biol Med 2022; 145:105463. [PMID: 35421794 DOI: 10.1016/j.compbiomed.2022.105463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 03/24/2022] [Accepted: 03/25/2022] [Indexed: 12/01/2022]
Abstract
Lymphomas, or cancers of the lymphatic system, account for around half of all blood cancers diagnosed each year. Lymphoma is a condition that is difficult to diagnose, and accurate diagnosis is critical for effective treatment. Manual microscopic analysis of blood cells requires the involvement of medical experts, whose precision is dependent on their abilities, and it takes time. This paper describes a content-based image retrieval system that uses deep learning-based feature extraction and a traditional learning method for feature reduction to retrieve similar images from a database to aid early/initial lymphoma diagnosis. The proposed algorithm employs a pre-trained network called ResNet-101 to extract image features required to distinguish four types of cells: lymphoma cells, blasts, lymphocytes, and other cells. The issue of class imbalance is resolved by over-sampling the training data followed by data augmentation. Deep learning features are extracted using the activations of the feature layer in the pre-trained net, then dimensionality reduction techniques are used to select discriminant features for the image retrieval system. Euclidean distance is used as the similarity measure to retrieve similar images from the database. The experimentation uses a microscopic blood image dataset with 1673 leukocytes of the categories blasts, lymphoma, lymphocytes, and other cells. The proposed algorithm achieves 98.74% precision in lymphoma cell classification and 99.22% precision @10 for lymphoma cell image retrieval. Experimental findings confirm our approach's practicability and effectiveness. Extended studies endorse the idea of using the prescribed system in actual medical applications, helping doctors diagnose lymphoma, dramatically reducing human resource requirements.
Collapse
Affiliation(s)
- M Roy Reena
- Department of Electronics and Communication Engineering, National Institute of Technology, Calicut, India.
| | - P M Ameer
- Department of Electronics and Communication Engineering, National Institute of Technology, Calicut, India
| |
Collapse
|
8
|
On the Reliability of CNNs in Clinical Practice: A Computer-Aided Diagnosis System Case Study. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12073269] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
Abstract
Leukocytes classification is essential to assess their number and status since they are the body’s first defence against infection and disease. Automation of the process can reduce the laborious manual process of review and diagnosis by operators and has been the subject of study for at least two decades. Most computer-aided systems exploit convolutional neural networks for classification purposes without any intermediate step to produce an accurate classification. This work explores the current limitations of deep learning-based methods applied to medical blood smear data. In particular, we consider leukocyte analysis oriented towards leukaemia prediction as a case study. In particular, we aim to demonstrate that a single classification step can undoubtedly lead to incorrect predictions or, worse, to correct predictions obtained with wrong indicators provided by the images. By generating new synthetic leukocyte data, it is possible to demonstrate that the inclusion of a fine-grained method, such as detection or segmentation, before classification is essential to allow the network to understand the adequate information on individual white blood cells correctly. The effectiveness of this study is thoroughly analysed and quantified through a series of experiments on a public data set of blood smears taken under a microscope. Experimental results show that residual networks perform statistically better in this scenario, even though they make correct predictions with incorrect information.
Collapse
|