1
|
Sadafi A, Bordukova M, Makhro A, Navab N, Bogdanova A, Marr C. RedTell: an AI tool for interpretable analysis of red blood cell morphology. Front Physiol 2023; 14:1058720. [PMID: 37304818 PMCID: PMC10250619 DOI: 10.3389/fphys.2023.1058720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Accepted: 04/13/2023] [Indexed: 06/13/2023] Open
Abstract
Introduction: Hematologists analyze microscopic images of red blood cells to study their morphology and functionality, detect disorders and search for drugs. However, accurate analysis of a large number of red blood cells needs automated computational approaches that rely on annotated datasets, expensive computational resources, and computer science expertise. We introduce RedTell, an AI tool for the interpretable analysis of red blood cell morphology comprising four single-cell modules: segmentation, feature extraction, assistance in data annotation, and classification. Methods: Cell segmentation is performed by a trained Mask R-CNN working robustly on a wide range of datasets requiring no or minimum fine-tuning. Over 130 features that are regularly used in research are extracted for every detected red blood cell. If required, users can train task-specific, highly accurate decision tree-based classifiers to categorize cells, requiring a minimal number of annotations and providing interpretable feature importance. Results: We demonstrate RedTell's applicability and power in three case studies. In the first case study we analyze the difference of the extracted features between the cells coming from patients suffering from different diseases, in the second study we use RedTell to analyze the control samples and use the extracted features to classify cells into echinocytes, discocytes and stomatocytes and finally in the last use case we distinguish sickle cells in sickle cell disease patients. Discussion: We believe that RedTell can accelerate and standardize red blood cell research and help gain new insights into mechanisms, diagnosis, and treatment of red blood cell associated disorders.
Collapse
Affiliation(s)
- Ario Sadafi
- Institute of AI for Health, Helmholtz Zentrum München—German Research Center for Environmental Health, Neuherberg, Germany
- Chair for Computer Aided Medical Procedures & Augmented Reality, Technical University of Munich, Garching, Germany
| | - Maria Bordukova
- Institute of AI for Health, Helmholtz Zentrum München—German Research Center for Environmental Health, Neuherberg, Germany
| | - Asya Makhro
- Red Blood Cell Research Group, Institute of Veterinary Physiology, Vetsuisse Faculty and the Zurich Center for Integrative Human Physiology, University of Zurich, Zurich, Switzerland
| | - Nassir Navab
- Chair for Computer Aided Medical Procedures & Augmented Reality, Technical University of Munich, Garching, Germany
- Computer Aided Medical Procedures, Johns Hopkins University, Baltimore, MD, United States
| | - Anna Bogdanova
- Red Blood Cell Research Group, Institute of Veterinary Physiology, Vetsuisse Faculty and the Zurich Center for Integrative Human Physiology, University of Zurich, Zurich, Switzerland
| | - Carsten Marr
- Institute of AI for Health, Helmholtz Zentrum München—German Research Center for Environmental Health, Neuherberg, Germany
| |
Collapse
|
2
|
K.T. N, Prasad K, Singh BMK. Analysis of red blood cells from peripheral blood smear images for anemia detection: a methodological review. Med Biol Eng Comput 2022; 60:2445-2462. [PMID: 35838854 PMCID: PMC9365735 DOI: 10.1007/s11517-022-02614-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 04/22/2022] [Indexed: 11/10/2022]
Abstract
Anemia is a blood disorder which is caused due to inadequate red blood cells and hemoglobin concentration. It occurs in all phases of life cycle but is more dominant in pregnant women and infants. According to the survey conducted by the World Health Organization (WHO) (McLean et al., Public Health Nutr 12(4):444–454, 2009), anemia affects 1.62 billion people constituting 24.8% of the population and is considered the world’s second leading cause of illness. The Peripheral Blood Smear (PBS) examination plays an important role in evaluating hematological disorders. Anemia is diagnosed using PBS. Being the most powerful analytical tool, manual analysis approach is still in use even though it is tedious, prone to errors, time-consuming and requires qualified laboratorians. It is evident that there is a need for an inexpensive, automatic and robust technique to detect RBC disorders from PBS. Automation of PBS analysis is very active field of research that motivated many research groups to develop methods using image processing. In this paper, we present a review of the methods used to analyze the characteristics of RBC from PBS images using image processing techniques. We have categorized these methods into three groups based on approaches such as RBC segmentation, RBC classification and detection of anemia, and classification of anemia. The outcome of this review has been presented as a list of observations.
Collapse
|
3
|
Adaptive thresholding technique based classification of red blood cell and sickle cell using Naïve Bayes Classifier and K-nearest neighbor classifier. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102745] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
4
|
Petrović N, Moyà-Alcover G, Jaume-i-Capó A, González-Hidalgo M. Sickle-cell disease diagnosis support selecting the most appropriate machine learning method: Towards a general and interpretable approach for cell morphology analysis from microscopy images. Comput Biol Med 2020; 126:104027. [DOI: 10.1016/j.compbiomed.2020.104027] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 09/13/2020] [Accepted: 09/30/2020] [Indexed: 12/01/2022]
|
5
|
Herold-Garcia S, Fernandes LAF. New Methods for Morphological Erythrocytes Classification. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:4068-4071. [PMID: 31946765 DOI: 10.1109/embc.2019.8857013] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Specialists may gauge the severity of sickle cell disease crisis by quantifying the number of abnormal-looking and sickle-shaped erythrocytes in blood smears. State-of-the-art integral geometry-based descriptors for automatic classification of erythrocytes as normal cells, sickle cells or cells with other deformations have achieved excellent results. Unfortunately, they are computationally expensive, requiring powerful desktop computers and a great deal of memory to run. We propose two new integral geometry-based descriptors for the shape of erythrocytes. Like state-of-the-art techniques, the overall sensitivity of our solutions is above 94%. Nevertheless, our descriptors are designed to avoid a great amount of computation in comparison to similar solutions and to present a lower memory footprint. Our descriptors offer a high specificity of normal cells and a high sensitivity of deformed cells, making them a good alternative in clinical applications.
Collapse
|
6
|
Delgado-Font W, Escobedo-Nicot M, González-Hidalgo M, Herold-Garcia S, Jaume-I-Capó A, Mir A. Diagnosis support of sickle cell anemia by classifying red blood cell shape in peripheral blood images. Med Biol Eng Comput 2020; 58:1265-1284. [PMID: 32222951 DOI: 10.1007/s11517-019-02085-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2019] [Accepted: 11/18/2019] [Indexed: 11/30/2022]
Abstract
Red blood cell (RBC) deformation is the consequence of several diseases, including sickle cell anemia, which causes recurring episodes of pain and severe pronounced anemia. Monitoring patients with these diseases involves the observation of peripheral blood samples under a microscope, a time-consuming procedure. Moreover, a specialist is required to perform this technique, and owing to the subjective nature of the observation of isolated RBCs, the error rate is high. In this paper, we propose an automated method for differentially enumerating RBCs that uses peripheral blood smear image analysis. In this method, the objects of interest in the image are segmented using a Chan-Vese active contour model. An analysis is then performed to classify the RBCs, also called erythrocytes, as normal or elongated or having other deformations, using the basic shape analysis descriptors: circular shape factor (CSF) and elliptical shape factor (ESF). To analyze cells that become partially occluded in a cluster during sample preparation, an elliptical adjustment is performed to allow the analysis of erythrocytes with discoidal and elongated shapes. The images of patient blood samples used in the study were acquired by a clinical laboratory specialist in the Special Hematology Department of the "Dr. Juan Bruno Zayas" General Hospital in Santiago de Cuba. A comparison of the results obtained by the proposed method in our experiments with those obtained by some state-of-the-art methods showed that the proposed method is superior for the diagnosis of sickle cell anemia. This superiority is achieved for evidenced by the obtained F-measure value (0.97 for normal cells and 0.95 for elongated ones) and several overall multiclass performance measures. The results achieved by the proposed method are suitable for the purpose of clinical treatment and diagnostic support of sickle cell anemia. We present a new method to obtain erythrocyte shape classification using peripheral blood smear sample images. The aim of the method is to segment the cells, to separate clusters and classify cells (circulars, elongated and others). We compared our method with state-of the-art. Results showed that our method with is superior for the diagnosis support of sickle cell anemia.
Collapse
Affiliation(s)
- Wilkie Delgado-Font
- Departamento de Computación, Facultad de Ciencias Naturales y Exactas, Universidad de Oriente, Santiago de Cuba, Cuba
| | - Miriela Escobedo-Nicot
- Departamento de Computación, Facultad de Ciencias Naturales y Exactas, Universidad de Oriente, Santiago de Cuba, Cuba
| | - Manuel González-Hidalgo
- Balearic Islands Health Research Institute (IdISBa), Soft Computing, Image Processing and Aggregation (SCOPIA) Research Group, Department of Mathematics and Computer Science, Universitat de les Illes Balears, Palma, Spain
| | - Silena Herold-Garcia
- Departamento de Computación, Facultad de Ciencias Naturales y Exactas, Universidad de Oriente, Santiago de Cuba, Cuba
| | - Antoni Jaume-I-Capó
- Research Institute of Health Sciences (IUNICS), Computer Graphics and Vision and AI Group (UGiVIA), Department of Mathematics and Computer Science, Universitat de les Illes Balears, Palma, Spain.
| | - Arnau Mir
- Balearic Islands Health Research Institute (IdISBa), Computational Biology and Bioinformatics (BIOCOM) Research Group, Department of Mathematics and Computer Science, Universitat de les Illes Balears, Palma, Spain
| |
Collapse
|
7
|
Deep Learning Models for Classification of Red Blood Cells in Microscopy Images to Aid in Sickle Cell Anemia Diagnosis. ELECTRONICS 2020. [DOI: 10.3390/electronics9030427] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Sickle cell anemia, which is also called sickle cell disease (SCD), is a hematological disorder that causes occlusion in blood vessels, leading to hurtful episodes and even death. The key function of red blood cells (erythrocytes) is to supply all the parts of the human body with oxygen. Red blood cells (RBCs) form a crescent or sickle shape when sickle cell anemia affects them. This abnormal shape makes it difficult for sickle cells to move through the bloodstream, hence decreasing the oxygen flow. The precise classification of RBCs is the first step toward accurate diagnosis, which aids in evaluating the danger level of sickle cell anemia. The manual classification methods of erythrocytes require immense time, and it is possible that errors may be made throughout the classification stage. Traditional computer-aided techniques, which have been employed for erythrocyte classification, are based on handcrafted features techniques, and their performance relies on the selected features. They also are very sensitive to different sizes, colors, and complex shapes. However, microscopy images of erythrocytes are very complex in shape with different sizes. To this end, this research proposes lightweight deep learning models that classify the erythrocytes into three classes: circular (normal), elongated (sickle cells), and other blood content. These models are different in the number of layers and learnable filters. The available datasets of red blood cells with sickle cell disease are very small for training deep learning models. Therefore, addressing the lack of training data is the main aim of this paper. To tackle this issue and optimize the performance, the transfer learning technique is utilized. Transfer learning does not significantly affect performance on medical image tasks when the source domain is completely different from the target domain. In some cases, it can degrade the performance. Hence, we have applied the same domain transfer learning, unlike other methods that used the ImageNet dataset for transfer learning. To minimize the overfitting effect, we have utilized several data augmentation techniques. Our model obtained state-of-the-art performance and outperformed the latest methods by achieving an accuracy of 99.54% with our model and 99.98% with our model plus a multiclass SVM classifier on the erythrocytesIDB dataset and 98.87% on the collected dataset.
Collapse
|
8
|
Das PK, Meher S, Panda R, Abraham A. A Review of Automated Methods for the Detection of Sickle Cell Disease. IEEE Rev Biomed Eng 2019; 13:309-324. [PMID: 31107662 DOI: 10.1109/rbme.2019.2917780] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Detection of sickle cell disease is a crucial job in medical image analysis. It emphasizes elaborate analysis of proper disease diagnosis after accurate detection followed by a classification of irregularities, which plays a vital role in the sickle cell disease diagnosis, treatment planning, and treatment outcome evaluation. Proper segmentation of complex cell clusters makes sickle cell detection more accurate and robust. Cell morphology has a key role in the detection of the sickle cell because the shapes of the normal blood cell and sickle cell differ significantly. This review emphasizes state-of-the-art methods and recent advances in detection, segmentation, and classification of sickle cell disease. We discuss key challenges encountered during the segmentation of overlapping blood cells. Moreover, standard validation measures that have been employed to yield performance analysis of various methods are also discussed. The methodologies and experiments in this review will be useful to further research and work in this area.
Collapse
|
9
|
Huang J, Tu T, Wang W, Gao Z, Zhou G, Zhang W, Wu X, Liu W. Aligned topography mediated cell elongation reverses pathological phenotype of
in vitro
cultured keloid fibroblasts. J Biomed Mater Res A 2019; 107:1366-1378. [DOI: 10.1002/jbm.a.36650] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2018] [Revised: 12/17/2018] [Accepted: 02/04/2019] [Indexed: 01/01/2023]
Affiliation(s)
- Jia Huang
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Tian Tu
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Wenbo Wang
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Zhen Gao
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Guangdong Zhou
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Wenjie Zhang
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Xiaoli Wu
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| | - Wei Liu
- Department of Plastic and Reconstructive Surgery, Shanghai Ninth People's Hospital, Shanghai Key Laboratory of Tissue Engineering Research, National Tissue Engineering Center of ChinaShanghai Jiao Tong University School of Medicine Shanghai People's Republic of China
| |
Collapse
|