1
|
Cheng W, Liu J, Wang C, Jiang R, Jiang M, Kong F. Application of image recognition technology in pathological diagnosis of blood smears. Clin Exp Med 2024; 24:181. [PMID: 39105953 PMCID: PMC11303489 DOI: 10.1007/s10238-024-01379-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2024] [Accepted: 05/13/2024] [Indexed: 08/07/2024]
Abstract
Traditional manual blood smear diagnosis methods are time-consuming and prone to errors, often relying heavily on the experience of clinical laboratory analysts for accuracy. As breakthroughs in key technologies such as neural networks and deep learning continue to drive digital transformation in the medical field, image recognition technology is increasingly being leveraged to enhance existing medical processes. In recent years, advancements in computer technology have led to improved efficiency in the identification of blood cells in blood smears through the use of image recognition technology. This paper provides a comprehensive summary of the methods and steps involved in utilizing image recognition algorithms for diagnosing diseases in blood smears, with a focus on malaria and leukemia. Furthermore, it offers a forward-looking research direction for the development of a comprehensive blood cell pathological detection system.
Collapse
Affiliation(s)
- Wangxinjun Cheng
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Jingshuang Liu
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Chaofeng Wang
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Ruiyin Jiang
- Queen Mary College, Nanchang University, Nanchang, 330006, China
| | - Mei Jiang
- Department of Clinical Laboratory, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China.
| | - Fancong Kong
- Center of Hematology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, 330006, China.
| |
Collapse
|
2
|
Acherar A, Tannier X, Tantaoui I, Brossas JY, Thellier M, Piarroux R. Evaluating Plasmodium falciparum automatic detection and parasitemia estimation: A comparative study on thin blood smear images. PLoS One 2024; 19:e0304789. [PMID: 38829858 PMCID: PMC11146722 DOI: 10.1371/journal.pone.0304789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 05/17/2024] [Indexed: 06/05/2024] Open
Abstract
Malaria is a deadly disease that is transmitted through mosquito bites. Microscopists use a microscope to examine thin blood smears at high magnification (1000x) to identify parasites in red blood cells (RBCs). Estimating parasitemia is essential in determining the severity of the Plasmodium falciparum infection and guiding treatment. However, this process is time-consuming, labor-intensive, and subject to variation, which can directly affect patient outcomes. In this retrospective study, we compared three methods for measuring parasitemia from a collection of anonymized thin blood smears of patients with Plasmodium falciparum obtained from the Clinical Department of Parasitology-Mycology, National Reference Center (NRC) for Malaria in Paris, France. We first analyzed the impact of the number of field images on parasitemia count using our framework, MALARIS, which features a top-classifier convolutional neural network (CNN). Additionally, we studied the variation between different microscopists using two manual techniques to demonstrate the need for a reliable and reproducible automated system. Finally, we included thin blood smear images from an additional 102 patients to compare the performance and correlation of our system with manual microscopy and flow cytometry. Our results showed strong correlations between the three methods, with a coefficient of determination between 0.87 and 0.92.
Collapse
Affiliation(s)
- Aniss Acherar
- Inserm, Institut Pierre-Louis d’Épidémiologie et de Santé Publique, IPLESP, Sorbonne Université, Paris, France
- SCAI (Sorbonne Center for Artificial Intelligence), Sorbonne Université, Paris, France
| | - Xavier Tannier
- Sorbonne Université, Inserm, Laboratoire d’Informatique Médicale et d’Ingénierie des Connaissances pour la e-Santé, LIMICS, Université Sorbonne Paris Nord, Paris, France
| | - Ilhame Tantaoui
- AP-HP, Service de Parasitologie-Mycologie, CNR du Paludisme, Groupe Hospitalier Pitié-Salpêtrière, Paris, France
| | - Jean-Yves Brossas
- AP-HP, Service de Parasitologie-Mycologie, CNR du Paludisme, Groupe Hospitalier Pitié-Salpêtrière, Paris, France
| | - Marc Thellier
- Inserm, Institut Pierre-Louis d’Épidémiologie et de Santé Publique, IPLESP, Sorbonne Université, Paris, France
- AP-HP, Service de Parasitologie-Mycologie, CNR du Paludisme, Groupe Hospitalier Pitié-Salpêtrière, Paris, France
| | - Renaud Piarroux
- Inserm, Institut Pierre-Louis d’Épidémiologie et de Santé Publique, IPLESP, Sorbonne Université, Paris, France
- AP-HP, Service de Parasitologie-Mycologie, CNR du Paludisme, Groupe Hospitalier Pitié-Salpêtrière, Paris, France
| |
Collapse
|
3
|
Wang G, Luo G, Lian H, Chen L, Wu W, Liu H. Application of Deep Learning in Clinical Settings for Detecting and Classifying Malaria Parasites in Thin Blood Smears. Open Forum Infect Dis 2023; 10:ofad469. [PMID: 37937045 PMCID: PMC10627339 DOI: 10.1093/ofid/ofad469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 09/13/2023] [Indexed: 11/09/2023] Open
Abstract
Background Scarcity of annotated image data sets of thin blood smears makes expert-level differentiation among Plasmodium species challenging. Here, we aimed to establish a deep learning algorithm for identifying and classifying malaria parasites in thin blood smears and evaluate its performance and clinical prospect. Methods You Only Look Once v7 was used as the backbone network for training the artificial intelligence algorithm model. The training, validation, and test sets for each malaria parasite category were randomly selected. A comprehensive analysis was performed on 12 708 thin blood smear images of various infective stages of 12 546 malaria parasites, including P falciparum, P vivax, P malariae, P ovale, P knowlesi, and P cynomolgi. Peripheral blood samples were obtained from 380 patients diagnosed with malaria. Additionally, blood samples from monkeys diagnosed with malaria were used to analyze P cynomolgi. The accuracy for detecting Plasmodium-infected blood cells was assessed through various evaluation metrics. Results The total time to identify 1116 malaria parasites was 13 seconds, with an average analysis time of 0.01 seconds for each parasite in the test set. The average precision was 0.902, with a recall and precision of infected erythrocytes of 96.0% and 94.9%, respectively. Sensitivity and specificity exceeded 96.8% and 99.3%, with an area under the receiver operating characteristic curve >0.999. The highest sensitivity (97.8%) and specificity (99.8%) were observed for trophozoites and merozoites. Conclusions The algorithm can help facilitate the clinical and morphologic examination of malaria parasites.
Collapse
Affiliation(s)
- Geng Wang
- Department of Clinical Laboratory, Peking Union Medical College Hospital, Beijing, China
| | - Guoju Luo
- Department of Clinical Laboratory, Peking Union Medical College Hospital, Beijing, China
| | - Heqing Lian
- Beijing Xiaoying Technology Co, Ltd, Beijing, China
| | - Lei Chen
- Beijing Xiaoying Technology Co, Ltd, Beijing, China
| | - Wei Wu
- Department of Clinical Laboratory, Peking Union Medical College Hospital, Beijing, China
| | - Hui Liu
- Central Laboratory, Yunnan Institute of Parasite Diseases, Puer, China
| |
Collapse
|
4
|
Liu R, Liu T, Dan T, Yang S, Li Y, Luo B, Zhuang Y, Fan X, Zhang X, Cai H, Teng Y. AIDMAN: An AI-based object detection system for malaria diagnosis from smartphone thin-blood-smear images. PATTERNS (NEW YORK, N.Y.) 2023; 4:100806. [PMID: 37720337 PMCID: PMC10499858 DOI: 10.1016/j.patter.2023.100806] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 03/02/2023] [Accepted: 07/07/2023] [Indexed: 09/19/2023]
Abstract
Malaria is a significant public health concern, with ∼95% of cases occurring in Africa, but accurate and timely diagnosis is problematic in remote and low-income areas. Here, we developed an artificial intelligence-based object detection system for malaria diagnosis (AIDMAN). In this system, the YOLOv5 model is used to detect cells in a thin blood smear. An attentional aligner model (AAM) is then applied for cellular classification that consists of multi-scale features, a local context aligner, and multi-scale attention. Finally, a convolutional neural network classifier is applied for diagnosis using blood-smear images, reducing interference caused by false positive cells. The results demonstrate that AIDMAN handles interference well, with a diagnostic accuracy of 98.62% for cells and 97% for blood-smear images. The prospective clinical validation accuracy of 98.44% is comparable to that of microscopists. AIDMAN shows clinically acceptable detection of malaria parasites and could aid malaria diagnosis, especially in areas lacking experienced parasitologists and equipment.
Collapse
Affiliation(s)
- Ruicun Liu
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Tuoyu Liu
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Tingting Dan
- School of Computer Science and Engineering, South China University of Technology, Guangzhou 510600, China
| | - Shan Yang
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Yanbing Li
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Boyu Luo
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Yingtan Zhuang
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Xinyue Fan
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| | - Xianchao Zhang
- Key Laboratory of Medical Electronics and Digital Health of Zhejiang Province, Jiaxing University, Jiaxing 314001, China
- Engineering Research Center of Intelligent Human Health Situation Awareness of Zhejiang Province, Jiaxing University, Jiaxing 314001, China
| | - Hongmin Cai
- School of Computer Science and Engineering, South China University of Technology, Guangzhou 510600, China
| | - Yue Teng
- State Key Laboratory of Pathogen and Biosecurity, Beijing Institute of Microbiology and Epidemiology, Beijing 100071, China
| |
Collapse
|
5
|
Yang Y, He H, Wang J, Chen L, Xu Y, Ge C, Li S. Blood quality evaluation via on-chip classification of cell morphology using a deep learning algorithm. LAB ON A CHIP 2023; 23:2113-2121. [PMID: 36946151 DOI: 10.1039/d2lc01078j] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
The quality of red blood cells (RBCs) in stored blood has a direct impact on the recovery of patients treated by blood transfusion, which directly reflects the quality of blood. The traditional means for blood quality evaluation involve the use of reagents and multi-step and time-consuming operations. Here, a low-cost, multi-classification, label-free and high-precision method is developed, which combines microfluidic technology and a deep learning algorithm together to recognize and classify RBCs based on morphology. The microfluidic channel is designed to effectively and controllably solve the problem of cell overlap, which has a severe negative impact on the identification of cells. The object detection model in the deep learning algorithm is optimized and used to recognize multiple RBCs simultaneously in the whole field of view, so as to classify them into six morphological subcategories and count the numbers in each subgroup. The mean average precision of the developed object detection model reaches 89.24%. The blood quality can be evaluated by calculating the morphology index (MI) according to the numbers of cells in subgroups. The validation of the method is verified by evaluating three blood samples stored for 7 days, 21 days and 42 days, which have MIs of 84.53%, 73.33% and 24.34%, respectively, indicating good agreement with the actual blood quality. This method has the merits of cell identification in a wide channel, no need for single cell alignment as the image cytometry does and it is not only applicable to the quality evaluation of RBCs, but can also be used for general cell identifications with different morphologies.
Collapse
Affiliation(s)
- Yuping Yang
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
- Chongqing College of Electronic Engineering, Chongqing 401331, China
| | - Hong He
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
| | - Junju Wang
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
| | - Li Chen
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
| | - Yi Xu
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
| | - Chuang Ge
- Chongqing Key Laboratory of Translational Research for Cancer Metastasis and Individualized Treatment, Chongqing University Cancer Hospital, Chongqing 400030, China.
| | - Shunbo Li
- Key Laboratory of Optoelectronic Technology and Systems, Ministry of Education & Key Disciplines Laboratory of Novel Micro-Nano Devices and System Technology, College of Optoelectronic Engineering, Chongqing University, Chongqing 400044, China.
| |
Collapse
|
6
|
Ikerionwu C, Ugwuishiwu C, Okpala I, James I, Okoronkwo M, Nnadi C, Orji U, Ebem D, Ike A. Application of machine and deep learning algorithms in optical microscopic detection of Plasmodium: A malaria diagnostic tool for the future. Photodiagnosis Photodyn Ther 2022; 40:103198. [PMID: 36379305 DOI: 10.1016/j.pdpdt.2022.103198] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 11/07/2022] [Accepted: 11/08/2022] [Indexed: 11/14/2022]
Abstract
Machine and deep learning techniques are prevalent in the medical discipline due to their high level of accuracy in disease diagnosis. One such disease is malaria caused by Plasmodium falciparum and transmitted by the female anopheles mosquito. According to the World Health Organisation (WHO), millions of people are infected annually, leading to inevitable deaths in the infected population. Statistical records show that early detection of malaria parasites could prevent deaths and machine learning (ML) has proved helpful in the early detection of malarial parasites. Human error is identified to be a major cause of inaccurate diagnostics in the traditional microscopy malaria diagnosis method. Therefore, the method would be more reliable if human expert dependency is restricted or entirely removed, and thus, the motivation of this paper. This study presents a systematic review to understand the prevalent machine learning algorithms applied to a low-cost, portable optical microscope in the automation of blood film interpretation for malaria parasite detection. Peer-reviewed papers were downloaded from selected reputable databases eg. Elsevier, IEEExplore, Pubmed, Scopus, Web of Science, etc. The extant literature suggests that convolutional neural network (CNN) and its variants (deep learning) account for 41.9% of the microscopy malaria diagnosis using machine learning with a prediction accuracy of 99.23%. Thus, the findings suggest that early detection of the malaria parasite has improved through the application of CNN and other ML algorithms on microscopic malaria parasite detection.
Collapse
Affiliation(s)
- Charles Ikerionwu
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Software Engineering, Federal University of Technology, Owerri, Imo State, Nigeria
| | - Chikodili Ugwuishiwu
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Computer Science, University of Nigeria, Nsukka, Enugu State, Nigeria.
| | - Izunna Okpala
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Information Technology, University of Cincinnati, USA
| | - Idara James
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Computer Science, Akwa Ibom State University, Nigeria
| | - Matthew Okoronkwo
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Computer Science, University of Nigeria, Nsukka, Enugu State, Nigeria
| | - Charles Nnadi
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Deprtment of Pharmaceutical and Medicinal Chemistry, Faculty of Pharmaceutical Sciences, University of Nigeria, Nsukka, Enugu State, Nigeria
| | - Ugochukwu Orji
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Computer Science, University of Nigeria, Nsukka, Enugu State, Nigeria
| | - Deborah Ebem
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Computer Science, University of Nigeria, Nsukka, Enugu State, Nigeria
| | - Anthony Ike
- Machine Learning on Disease Diagnosis Research Group, Nigeria; Department of Microbiology, University of Nigeria, Nsukka, Enugu State, Nigeria
| |
Collapse
|
7
|
Jang M, Kim M, Bae SJ, Lee SH, Koh JM, Kim N. Opportunistic Osteoporosis Screening Using Chest Radiographs With Deep Learning: Development and External Validation With a Cohort Dataset. J Bone Miner Res 2022; 37:369-377. [PMID: 34812546 DOI: 10.1002/jbmr.4477] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 11/05/2021] [Accepted: 11/17/2021] [Indexed: 01/02/2023]
Abstract
Osteoporosis is a common, but silent disease until it is complicated by fractures that are associated with morbidity and mortality. Over the past few years, although deep learning-based disease diagnosis on chest radiographs has yielded promising results, osteoporosis screening remains unexplored. Paired data with 13,026 chest radiographs and dual-energy X-ray absorptiometry (DXA) results from the Health Screening and Promotion Center of Asan Medical Center, between 2012 and 2019, were used as the primary dataset in this study. For the external test, we additionally used the Asan osteoporosis cohort dataset (1089 chest radiographs, 2010 and 2017). Using a well-performed deep learning model, we trained the OsPor-screen model with labels defined by DXA based diagnosis of osteoporosis (lumbar spine, femoral neck, or total hip T-score ≤ -2.5) in a supervised learning manner. The OsPor-screen model was assessed in the internal and external test sets. We performed substudies for evaluating the effect of various anatomical subregions and image sizes of input images. OsPor-screen model performances including sensitivity, specificity, and area under the curve (AUC) were measured in the internal and external test sets. In addition, visual explanations of the model to predict each class were expressed in gradient-weighted class activation maps (Grad-CAMs). The OsPor-screen model showed promising performances. Osteoporosis screening with the OsPor-screen model achieved an AUC of 0.91 (95% confidence interval [CI], 0.90-0.92) and an AUC of 0.88 (95% CI, 0.85-0.90) in the internal and external test set, respectively. Even though the medical relevance of these average Grad-CAMs is unclear, these results suggest that a deep learning-based model using chest radiographs could have the potential to be used for opportunistic automated screening of patients with osteoporosis in clinical settings. © 2021 American Society for Bone and Mineral Research (ASBMR).
Collapse
Affiliation(s)
- Miso Jang
- Department of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.,Department of Medicine, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Mingyu Kim
- Department of Medicine, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| | - Sung Jin Bae
- Department of Health Screening and Promotion Center, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Seung Hun Lee
- Division of Endocrinology and Metabolism, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jung-Min Koh
- Division of Endocrinology and Metabolism, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Namkug Kim
- Department of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.,Department of Convergence Medicine, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea
| |
Collapse
|
8
|
Rhoads DD. Computer Vision and Artificial Intelligence Are Emerging Diagnostic Tools for the Clinical Microbiologist. J Clin Microbiol 2020; 58:e00511-20. [PMID: 32295889 PMCID: PMC7269399 DOI: 10.1128/jcm.00511-20] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Artificial intelligence (AI) is increasingly becoming an important component of clinical microbiology informatics. Researchers, microbiologists, laboratorians, and diagnosticians are interested in AI-based testing because these solutions have the potential to improve a test's turnaround time, quality, and cost. A study by Mathison et al. used computer vision AI (B. A. Mathison, J. L. Kohan, J. F. Walker, R. B. Smith, et al., J Clin Microbiol 58:e02053-19, 2020, https://doi.org/10.1128/JCM.02053-19), but additional opportunities for AI applications exist within the clinical microbiology laboratory. Large data sets within clinical microbiology that are amenable to the development of AI diagnostics include genomic information from isolated bacteria, metagenomic microbial findings from primary specimens, mass spectra captured from cultured bacterial isolates, and large digital images, which is the medium that Mathison et al. chose to use. AI in general and computer vision in specific are emerging tools that clinical microbiologists need to study, develop, and implement in order to improve clinical microbiology.
Collapse
Affiliation(s)
- Daniel D Rhoads
- Department of Pathology, Case Western Reserve University, Cleveland, Ohio, USA
| |
Collapse
|