1
|
Fei M, Shen Z, Song Z, Wang X, Cao M, Yao L, Zhao X, Wang Q, Zhang L. Distillation of multi-class cervical lesion cell detection via synthesis-aided pre-training and patch-level feature alignment. Neural Netw 2024; 178:106405. [PMID: 38815471 DOI: 10.1016/j.neunet.2024.106405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 05/10/2024] [Accepted: 05/20/2024] [Indexed: 06/01/2024]
Abstract
Automated detection of cervical abnormal cells from Thin-prep cytologic test (TCT) images is crucial for efficient cervical abnormal screening using computer-aided diagnosis systems. However, the construction of the detection model is hindered by the preparation of the training images, which usually suffers from issues of class imbalance and incomplete annotations. Additionally, existing methods often overlook the visual feature correlations among cells, which are crucial in cervical lesion cell detection as pathologists commonly rely on surrounding cells for identification. In this paper, we propose a distillation framework that utilizes a patch-level pre-training network to guide the training of an image-level detection network, which can be applied to various detectors without changing their architectures during inference. The main contribution is three-fold: (1) We propose the Balanced Pre-training Model (BPM) as the patch-level cervical cell classification model, which employs an image synthesis model to construct a class-balanced patch dataset for pre-training. (2) We design the Score Correction Loss (SCL) to enable the detection network to distill knowledge from the BPM model, thereby mitigating the impact of incomplete annotations. (3) We design the Patch Correlation Consistency (PCC) strategy to exploit the correlation information of extracted cells, consistent with the behavior of cytopathologists. Experiments on public and private datasets demonstrate the superior performance of the proposed distillation method, as well as its adaptability to various detection architectures.
Collapse
Affiliation(s)
- Manman Fei
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Zhenrong Shen
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Zhiyun Song
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Xin Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Maosong Cao
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, 201210, China
| | - Linlin Yao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Xiangyu Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Qian Wang
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, 201210, China
| | - Lichi Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China.
| |
Collapse
|
2
|
Li G, Li X, Wang Y, Gong S, Yang Y, Xu C. Detection of Cervical Lesion Cell/Clumps Based on Adaptive Feature Extraction. Bioengineering (Basel) 2024; 11:686. [PMID: 39061768 PMCID: PMC11274185 DOI: 10.3390/bioengineering11070686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 06/20/2024] [Accepted: 06/28/2024] [Indexed: 07/28/2024] Open
Abstract
Automated detection of cervical lesion cell/clumps in cervical cytological images is essential for computer-aided diagnosis. In this task, the shape and size of the lesion cell/clumps appeared to vary considerably, reducing the detection performance of cervical lesion cell/clumps. To address the issue, we propose an adaptive feature extraction network for cervical lesion cell/clumps detection, called AFE-Net. Specifically, we propose the adaptive module to acquire the features of cervical lesion cell/clumps, while introducing the global bias mechanism to acquire the global average information, aiming at combining the adaptive features with the global information to improve the representation of the target features in the model, and thus enhance the detection performance of the model. Furthermore, we analyze the results of the popular bounding box loss on the model and propose the new bounding box loss tendency-IoU (TIoU). Finally, the network achieves the mean Average Precision (mAP) of 64.8% on the CDetector dataset, with 30.7 million parameters. Compared with YOLOv7 of 62.6% and 34.8M, the model improved mAP by 2.2% and reduced the number of parameters by 11.8%.
Collapse
Affiliation(s)
- Gang Li
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, China; (G.L.); (X.L.); (Y.Y.)
| | - Xingguang Li
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, China; (G.L.); (X.L.); (Y.Y.)
| | - Yuting Wang
- Department of Gastroenterology, Children’s Hospital of Chongqing Medical University, Chongqing 400014, China;
- National Clinical Research Center for Child Health and Disorders, Chongqing 400014, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing 400014, China
- Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, Chongqing 400014, China
| | - Shu Gong
- Department of Gastroenterology, Children’s Hospital of Chongqing Medical University, Chongqing 400014, China;
- National Clinical Research Center for Child Health and Disorders, Chongqing 400014, China
- Ministry of Education Key Laboratory of Child Development and Disorders, Chongqing 400014, China
- Chongqing Key Laboratory of Child Neurodevelopment and Cognitive Disorders, Chongqing 400014, China
| | - Yanting Yang
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, China; (G.L.); (X.L.); (Y.Y.)
| | - Chuanyun Xu
- College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
| |
Collapse
|
3
|
Glüge S, Balabanov S, Koelzer VH, Ott T. Evaluation of deep learning training strategies for the classification of bone marrow cell images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107924. [PMID: 37979517 DOI: 10.1016/j.cmpb.2023.107924] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 09/28/2023] [Accepted: 11/06/2023] [Indexed: 11/20/2023]
Abstract
BACKGROUND AND OBJECTIVE The classification of bone marrow (BM) cells by light microscopy is an important cornerstone of hematological diagnosis, performed thousands of times a day by highly trained specialists in laboratories worldwide. As the manual evaluation of blood or BM smears is very time-consuming and prone to inter-observer variation, new reliable automated systems are needed. METHODS We aim to improve the automatic classification performance of hematological cell types. Therefore, we evaluate four state-of-the-art Convolutional Neural Network (CNN) architectures on a dataset of 171,374 microscopic cytological single-cell images obtained from BM smears from 945 patients diagnosed with a variety of hematological diseases. We further evaluate the effect of an in-domain vs. out-of-domain pre-training, and assess whether class activation maps provide human-interpretable explanations for the models' predictions. RESULTS The best performing pre-trained model (Regnet_y_32gf) yields a mean precision, recall, and F1 scores of 0.787±0.060, 0.755±0.061, and 0.762±0.050, respectively. This is a 53.5% improvement in precision and 7.3% improvement in recall over previous results with CNNs (ResNeXt-50) that were trained from scratch. The out-of-domain pre-training apparently yields general feature extractors/filters that apply very well to the BM cell classification use case. The class activation maps on cell types with characteristic morphological features were found to be consistent with the explanations of a human domain expert. For example, the Auer rods in the cytoplasm were the predictive cellular feature for correctly classified images of faggot cells. CONCLUSIONS Our study provides data that can help hematology laboratories to choose the optimal training strategy for blood cell classification deep learning models to improve computer-assisted blood and bone marrow cell identification. It also highlights the need for more specific training data, i.e. images of difficult-to-classify classes, including cells labeled with disease information.
Collapse
Affiliation(s)
- Stefan Glüge
- Institute of Computational Life Sciences, Zurich University of Applied Sciences, Schloss 1, 8820 Wädenswil, Switzerland.
| | - Stefan Balabanov
- Department of Medical Oncology and Haematology, University Hospital Zurich and University of Zurich, Rämistrasse 100, 8091 Zurich, Switzerland
| | - Viktor Hendrik Koelzer
- Department of Pathology and Molecular Pathology, University Hospital Zurich and University of Zurich, Schmelzbergstrasse 12, 8091 Zurich, Switzerland
| | - Thomas Ott
- Institute of Computational Life Sciences, Zurich University of Applied Sciences, Schloss 1, 8820 Wädenswil, Switzerland
| |
Collapse
|
4
|
Zhao J, He YJ, Zhou SH, Qin J, Xie YN. CNSeg: A dataset for cervical nuclear segmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 241:107732. [PMID: 37544166 DOI: 10.1016/j.cmpb.2023.107732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 05/31/2023] [Accepted: 07/23/2023] [Indexed: 08/08/2023]
Abstract
BACKGROUND AND OBJECTIVE Nuclear segmentation in cervical cell images is a crucial technique for automatic cytopathology diagnosis. Experimental evaluation of nuclear segmentation methods with datasets is helpful in promoting the advancement of nuclear segmentation techniques. However, public datasets are not enough for a reasonable and comprehensive evaluation because of insufficient quantity, single data source, and low segmentation difficulty. METHODS Therefore, we provide the largest dataset for cervical nuclear segmentation (CNSeg). It contains 124,000 annotated nuclei collected from 1,530 patients under different conditions. The image styles in this dataset cover most practical application scenarios, including microbial infection, cytopathic heterogeneity, overlapping nuclei, etc. To evaluate the performance of segmentation methods from different aspects, we divided the CNSeg dataset into three subsets, namely the patch segmentation dataset (PatchSeg) with nuclei images collected under complex conditions, the cluster segmentation dataset (ClusterSeg) with cluster nuclei, and the domain segmentation dataset (DomainSeg) with data from different domains. Furthermore, we propose a post-processing method that processes overlapping nuclei single ones. RESULTS AND CONCLUSION Experiments show that our dataset can comprehensively evaluate cervical nuclear segmentation methods from different aspects. We provide guidelines for other researchers to use the dataset. https://github.com/jingzhaohlj/AL-Net.
Collapse
Affiliation(s)
- Jing Zhao
- Northeast Forestry University, Mechanical and Electrical Engineering, Harbin 150006, China
| | - Yong-Jun He
- Harbin Institute of Technology, School of Computer Science, Harbin 150001, China.
| | - Shu-Hang Zhou
- Wenzhou Business College, Information Engineering, Wenzhou 325035, China
| | - Jian Qin
- Harbin University of Science and Technology, School of Computer Science and Technology, No. 52 Xuefu Road, 150080 Harbin, China
| | - Yi-Ning Xie
- Northeast Forestry University, Mechanical and Electrical Engineering, Harbin 150006, China
| |
Collapse
|
5
|
Liang Y, Feng S, Liu Q, Kuang H, Liu J, Liao L, Du Y, Wang J. Exploring Contextual Relationships for Cervical Abnormal Cell Detection. IEEE J Biomed Health Inform 2023; 27:4086-4097. [PMID: 37192032 DOI: 10.1109/jbhi.2023.3276919] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Cervical abnormal cell detection is a challenging task as the morphological discrepancies between abnormal and normal cells are usually subtle. To determine whether a cervical cell is normal or abnormal, cytopathologists always take surrounding cells as references to identify its abnormality. To mimic these behaviors, we propose to explore contextual relationships to boost the performance of cervical abnormal cell detection. Specifically, both contextual relationships between cells and cell-to-global images are exploited to enhance features of each region of interest (RoI) proposal. Accordingly, two modules, dubbed as RoI-relationship attention module (RRAM) and global RoI attention module (GRAM), are developed and their combination strategies are also investigated. We establish a strong baseline by using Double-Head Faster R-CNN with a feature pyramid network (FPN) and integrate our RRAM and GRAM into it to validate the effectiveness of the proposed modules. Experiments conducted on a large cervical cell detection dataset reveal that the introduction of RRAM and GRAM both achieves better average precision (AP) than the baseline methods. Moreover, when cascading RRAM and GRAM, our method outperforms the state-of-the-art (SOTA) methods. Furthermore, we show that the proposed feature-enhancing scheme can facilitate image- and smear-level classification.
Collapse
|
6
|
Deep learning for computational cytology: A survey. Med Image Anal 2023; 84:102691. [PMID: 36455333 DOI: 10.1016/j.media.2022.102691] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 10/22/2022] [Accepted: 11/09/2022] [Indexed: 11/16/2022]
Abstract
Computational cytology is a critical, rapid-developing, yet challenging topic in medical image computing concerned with analyzing digitized cytology images by computer-aided technologies for cancer screening. Recently, an increasing number of deep learning (DL) approaches have made significant achievements in medical image analysis, leading to boosting publications of cytological studies. In this article, we survey more than 120 publications of DL-based cytology image analysis to investigate the advanced methods and comprehensive applications. We first introduce various deep learning schemes, including fully supervised, weakly supervised, unsupervised, and transfer learning. Then, we systematically summarize public datasets, evaluation metrics, versatile cytology image analysis applications including cell classification, slide-level cancer screening, nuclei or cell detection and segmentation. Finally, we discuss current challenges and potential research directions of computational cytology.
Collapse
|
7
|
Liang Y, Yin Z, Liu H, Zeng H, Wang J, Liu J, Che N. Weakly Supervised Deep Nuclei Segmentation With Sparsely Annotated Bounding Boxes for DNA Image Cytometry. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2023; 20:785-795. [PMID: 34951851 DOI: 10.1109/tcbb.2021.3138189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Nuclei segmentation is an essential step in DNA ploidy analysis by image-based cytometry (DNA-ICM) which is widely used in cytopathology and allows an objective measurement of DNA content (ploidy). The routine fully supervised learning-based method requires often tedious and expensive pixel-wise labels. In this paper, we propose a novel weakly supervised nuclei segmentation framework which exploits only sparsely annotated bounding boxes, without any segmentation labels. The key is to integrate the traditional image segmentation and self-training into fully supervised instance segmentation. We first leverage the traditional segmentation to generate coarse masks for each box-annotated nucleus to supervise the training of a teacher model, which is then responsible for both the refinement of these coarse masks and pseudo labels generation of unlabeled nuclei. These pseudo labels and refined masks along with the original manually annotated bounding boxes jointly supervise the training of student model. Both teacher and student share the same architecture and especially the student is initialized by the teacher. We have extensively evaluated our method with both our DNA-ICM dataset and public cytopathological dataset. Without bells and whistles, our method outperforms all existing weakly supervised entries on both datasets. Code and our DNA-ICM dataset are publicly available at https://github.com/CVIU-CSU/Weakly-Supervised-Nuclei-Segmentation.
Collapse
|
8
|
Allahqoli L, Laganà AS, Mazidimoradi A, Salehiniya H, Günther V, Chiantera V, Karimi Goghari S, Ghiasvand MM, Rahmani A, Momenimovahed Z, Alkatout I. Diagnosis of Cervical Cancer and Pre-Cancerous Lesions by Artificial Intelligence: A Systematic Review. Diagnostics (Basel) 2022; 12:2771. [PMID: 36428831 PMCID: PMC9689914 DOI: 10.3390/diagnostics12112771] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 11/06/2022] [Accepted: 11/10/2022] [Indexed: 11/16/2022] Open
Abstract
OBJECTIVE The likelihood of timely treatment for cervical cancer increases with timely detection of abnormal cervical cells. Automated methods of detecting abnormal cervical cells were established because manual identification requires skilled pathologists and is time consuming and prone to error. The purpose of this systematic review is to evaluate the diagnostic performance of artificial intelligence (AI) technologies for the prediction, screening, and diagnosis of cervical cancer and pre-cancerous lesions. MATERIALS AND METHODS Comprehensive searches were performed on three databases: Medline, Web of Science Core Collection (Indexes = SCI-EXPANDED, SSCI, A & HCI Timespan) and Scopus to find papers published until July 2022. Articles that applied any AI technique for the prediction, screening, and diagnosis of cervical cancer were included in the review. No time restriction was applied. Articles were searched, screened, incorporated, and analyzed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines. RESULTS The primary search yielded 2538 articles. After screening and evaluation of eligibility, 117 studies were incorporated in the review. AI techniques were found to play a significant role in screening systems for pre-cancerous and cancerous cervical lesions. The accuracy of the algorithms in predicting cervical cancer varied from 70% to 100%. AI techniques make a distinction between cancerous and normal Pap smears with 80-100% accuracy. AI is expected to serve as a practical tool for doctors in making accurate clinical diagnoses. The reported sensitivity and specificity of AI in colposcopy for the detection of CIN2+ were 71.9-98.22% and 51.8-96.2%, respectively. CONCLUSION The present review highlights the acceptable performance of AI systems in the prediction, screening, or detection of cervical cancer and pre-cancerous lesions, especially when faced with a paucity of specialized centers or medical resources. In combination with human evaluation, AI could serve as a helpful tool in the interpretation of cervical smears or images.
Collapse
Affiliation(s)
- Leila Allahqoli
- Midwifery Department, Ministry of Health and Medical Education, Tehran 1467664961, Iran
| | - Antonio Simone Laganà
- Unit of Gynecologic Oncology, ARNAS “Civico-Di Cristina-Benfratelli”, Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (PROMISE), University of Palermo, 90127 Palermo, Italy
| | - Afrooz Mazidimoradi
- Neyriz Public Health Clinic, Shiraz University of Medical Sciences, Shiraz 7134814336, Iran
| | - Hamid Salehiniya
- Social Determinants of Health Research Center, Birjand University of Medical Sciences, Birjand 9717853577, Iran
| | - Veronika Günther
- University Hospitals Schleswig-Holstein, Campus Kiel, Kiel School of Gynaecological Endoscopy, Arnold-Heller-Str. 3, Haus 24, 24105 Kiel, Germany
| | - Vito Chiantera
- Unit of Gynecologic Oncology, ARNAS “Civico-Di Cristina-Benfratelli”, Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (PROMISE), University of Palermo, 90127 Palermo, Italy
| | - Shirin Karimi Goghari
- School of Industrial and Systems Engineering, Tarbiat Modares University (TMU), Tehran 1411713114, Iran
| | - Mohammad Matin Ghiasvand
- Department of Computer Engineering, Amirkabir University of Technology (AUT), Tehran 1591634311, Iran
| | - Azam Rahmani
- Nursing and Midwifery Care Research Centre, School of Nursing and Midwifery, Tehran University of Medical Sciences, Tehran 141973317, Iran
| | - Zohre Momenimovahed
- Reproductive Health Department, Qom University of Medical Sciences, Qom 3716993456, Iran
| | - Ibrahim Alkatout
- University Hospitals Schleswig-Holstein, Campus Kiel, Kiel School of Gynaecological Endoscopy, Arnold-Heller-Str. 3, Haus 24, 24105 Kiel, Germany
| |
Collapse
|
9
|
Xu C, Li M, Li G, Zhang Y, Sun C, Bai N. Cervical Cell/Clumps Detection in Cytology Images Using Transfer Learning. Diagnostics (Basel) 2022; 12:2477. [PMID: 36292166 PMCID: PMC9600700 DOI: 10.3390/diagnostics12102477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 10/07/2022] [Accepted: 10/10/2022] [Indexed: 12/04/2022] Open
Abstract
Cervical cancer is one of the most common and deadliest cancers among women and poses a serious health risk. Automated screening and diagnosis of cervical cancer will help improve the accuracy of cervical cell screening. In recent years, there have been many studies conducted using deep learning methods for automatic cervical cancer screening and diagnosis. Deep-learning-based Convolutional Neural Network (CNN) models require large amounts of data for training, but large cervical cell datasets with annotations are difficult to obtain. Some studies have used transfer learning approaches to handle this problem. However, such studies used the same transfer learning method that is the backbone network initialization by the ImageNet pre-trained model in two different types of tasks, the detection and classification of cervical cell/clumps. Considering the differences between detection and classification tasks, this study proposes the use of COCO pre-trained models when using deep learning methods for cervical cell/clumps detection tasks to better handle limited data set problem at training time. To further improve the model detection performance, based on transfer learning, we conducted multi-scale training according to the actual situation of the dataset. Considering the effect of bounding box loss on the precision of cervical cell/clumps detection, we analyzed the effects of different bounding box losses on the detection performance of the model and demonstrated that using a loss function consistent with the type of pre-trained model can help improve the model performance. We analyzed the effect of mean and std of different datasets on the performance of the model. It was demonstrated that the detection performance was optimal when using the mean and std of the cervical cell dataset used in the current study. Ultimately, based on backbone Resnet50, the mean Average Precision (mAP) of the network model is 61.6% and Average Recall (AR) is 87.7%. Compared to the current values of 48.8% and 64.0% in the used dataset, the model detection performance is significantly improved by 12.8% and 23.7%, respectively.
Collapse
Affiliation(s)
- Chuanyun Xu
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400054, China
- College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
| | - Mengwei Li
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400054, China
| | - Gang Li
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400054, China
| | - Yang Zhang
- College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
| | - Chengjie Sun
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400054, China
| | - Nanlan Bai
- School of Artificial Intelligence, Chongqing University of Technology, Chongqing 400054, China
| |
Collapse
|
10
|
Chen T, Zheng W, Ying H, Tan X, Li K, Li X, Chen DZ, Wu J. A Task Decomposing and Cell Comparing Method for Cervical Lesion Cell Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:2432-2442. [PMID: 35349436 DOI: 10.1109/tmi.2022.3163171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Automatic detection of cervical lesion cells or cell clumps using cervical cytology images is critical to computer-aided diagnosis (CAD) for accurate, objective, and efficient cervical cancer screening. Recently, many methods based on modern object detectors were proposed and showed great potential for automatic cervical lesion detection. Although effective, several issues still hinder further performance improvement of such known methods, such as large appearance variances between single-cell and multi-cell lesion regions, neglecting normal cells, and visual similarity among abnormal cells. To tackle these issues, we propose a new task decomposing and cell comparing network, called TDCC-Net, for cervical lesion cell detection. Specifically, our task decomposing scheme decomposes the original detection task into two subtasks and models them separately, which aims to learn more efficient and useful feature representations for specific cell structures and then improve the detection performance of the original task. Our cell comparing scheme imitates clinical diagnosis of experts and performs cell comparison with a dynamic comparing module (normal-abnormal cells comparing) and an instance contrastive loss (abnormal-abnormal cells comparing). Comprehensive experiments on a large cervical cytology image dataset confirm the superiority of our method over state-of-the-art methods.
Collapse
|
11
|
Robust whole slide image analysis for cervical cancer screening using deep learning. Nat Commun 2021; 12:5639. [PMID: 34561435 PMCID: PMC8463673 DOI: 10.1038/s41467-021-25296-x] [Citation(s) in RCA: 42] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Accepted: 08/03/2021] [Indexed: 01/20/2023] Open
Abstract
Computer-assisted diagnosis is key for scaling up cervical cancer screening. However, current recognition algorithms perform poorly on whole slide image (WSI) analysis, fail to generalize for diverse staining and imaging, and show sub-optimal clinical-level verification. Here, we develop a progressive lesion cell recognition method combining low- and high-resolution WSIs to recommend lesion cells and a recurrent neural network-based WSI classification model to evaluate the lesion degree of WSIs. We train and validate our WSI analysis system on 3,545 patient-wise WSIs with 79,911 annotations from multiple hospitals and several imaging instruments. On multi-center independent test sets of 1,170 patient-wise WSIs, we achieve 93.5% Specificity and 95.1% Sensitivity for classifying slides, comparing favourably to the average performance of three independent cytopathologists, and obtain 88.5% true positive rate for highlighting the top 10 lesion cells on 447 positive slides. After deployment, our system recognizes a one giga-pixel WSI in about 1.5 min. Computer-assisted diagnosis is key for scaling up cervical cancer screening, but current algorithms perform poorly on whole slide image analysis and generalization. Here, the authors present a WSI classification and top lesion cell recommendation system using deep learning, and achieve comparable results with cytologists.
Collapse
|
12
|
Cao L, Yang J, Rong Z, Li L, Xia B, You C, Lou G, Jiang L, Du C, Meng H, Wang W, Wang M, Li K, Hou Y. A novel attention-guided convolutional network for the detection of abnormal cervical cells in cervical cancer screening. Med Image Anal 2021; 73:102197. [PMID: 34403932 DOI: 10.1016/j.media.2021.102197] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Revised: 06/10/2021] [Accepted: 07/23/2021] [Indexed: 12/24/2022]
Abstract
Early detection of abnormal cervical cells in cervical cancer screening increases the chances of timely treatment. But manual detection requires experienced pathologists and is time-consuming and error prone. Previously, some methods have been proposed for automated abnormal cervical cell detection, whose performance yet remained debatable. Here, we develop an attention feature pyramid network (AttFPN) for automatic abnormal cervical cell detection in cervical cytology images to assist pathologists to make a more accurate diagnosis. Our proposed method consists of two main components. First, an attention module mimicking the way pathologists reading a cervical cytology image. It learns what features to emphasize or suppress by refining extracted features effectively. Second, a multi-scale region-based feature fusion network guided by clinical knowledge to fuse the refined features for detecting abnormal cervical cells at different scales. The region proposals in the multi-scale network are designed according to the clinical knowledge about size and shape distribution of real abnormal cervical cells. Our method, trained and validated with 7030 annotated cervical cytology images, performs better than the state of art deep learning-based methods. The overall sensitivity, specificity, accuracy, and AUC of an independent testing dataset with 3970 cervical cytology images is 95.83%, 94.81%, 95.08% and 0.991, respectively, which is comparable to that of an experienced pathologist with 10 years of experience. Besides, we further validated our method on an external dataset with 110 cases and 35,013 images from a different organization, the case-level sensitivity, specificity, accuracy, and AUC is 91.30%, 90.62%, 90.91% and 0.934, respectively. Average diagnostic time of our method is 0.04s per image, which is much quicker than the average time of pathologists (14.83s per image). Thus, our AttFPN is effective and efficient in cervical cancer screening, and improvement of clinical workflows for the benefit of potential patients. Our code is available at https://github.com/cl2227619761/TCT_Detection.
Collapse
Affiliation(s)
- Lei Cao
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China
| | - Jinying Yang
- Department of Pathology, Heilongjiang Maternal and Child Health Care Hospital, Harbin 150001, China
| | - Zhiwei Rong
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China
| | - Lulu Li
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China
| | - Bairong Xia
- The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Anhui province cancer hospital, Hefei 230031, Anhui, China
| | - Chong You
- Beijing International Center for Mathematical Research, Peking University, Beijing 100191, China
| | - Ge Lou
- Department of Gynecology Oncology, Harbin Medical University Cancer Hospital, Harbin 150081, P.R. China
| | - Lei Jiang
- Department of Pathology, the Second Affiliated Hospital of Harbin Medical University, Harbin 150001, China
| | - Chun Du
- Department of Pathology, Precision Medical Center, Harbin Medical University Cancer Hospital, Harbin 150081, China
| | - Hongxue Meng
- Department of Pathology, Precision Medical Center, Harbin Medical University Cancer Hospital, Harbin 150081, China
| | - Wenjie Wang
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China
| | - Meng Wang
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China
| | - Kang Li
- Department of Biostatistics, School of Public Health, Harbin Medical University, Harbin 150081, China.
| | - Yan Hou
- Department of Biostatistics, School of Public Health, Peking University, Beijing 100191, China.
| |
Collapse
|
13
|
Liang Y, Pan C, Sun W, Liu Q, Du Y. Global context-aware cervical cell detection with soft scale anchor matching. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 204:106061. [PMID: 33819821 DOI: 10.1016/j.cmpb.2021.106061] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 03/18/2021] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE Computer-aided cervical cancer screening based on an automated recognition of cervical cells has the potential to significantly reduce error rate and increase productivity compared to manual screening. Traditional methods often rely on the success of accurate cell segmentation and discriminative hand-crafted features extraction. Recently, detector based on convolutional neural network is applied to reduce the dependency on hand-crafted features and eliminate the necessary segmentation. However, these methods tend to yield too much false positive predictions. METHODS This paper proposes a global context-aware framework to deal with this problem, which integrates global context information by an image-level classification branch and a weighted loss. And the prediction of this branch is merged into cell detection for filtering false positive predictions. Furthermore, a new ground truth assignment strategy in the feature pyramid called soft scale anchor matching is proposed, which matches ground truths with anchors across scales softly. This strategy searches the most appropriate representation of ground truths in each layer and add more positive samples with different scales, which facilitate the feature learning. RESULTS Our proposed methods finally get 5.7% increase in mean average precision and 18.5% increase in specificity with sacrifice of 2.6% delay in inference time. CONCLUSIONS Our proposed methods which totally avoid the dependence on segmentation of cervical cells, show the great potential to reduce the workload for pathologists in automation-assisted cervical cancer screening.
Collapse
Affiliation(s)
- Yixiong Liang
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Changli Pan
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Wanxin Sun
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Qing Liu
- School of Computer Science and Engineering, Central South University, Changsha, China.
| | - Yun Du
- The Fourth Hospital of Hebei Medical University, Hebei Province China-Japan Friendship Center for Cancer Detection, China.
| |
Collapse
|
14
|
AIN ALIAS NUR, AZANI MUSTAFA WAN, AMINUDIN JAMLOS MOHD, ALKHAYYAT AHMED, SHAKIR AB RAHMAN KHAIRUL, Q. MALIK RAMI. Improvement method for cervical cancer detection: A comparative analysis. Oncol Res 2021. [DOI: 10.32604/or.2022.025897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2023] Open
|