1
|
Chen T, Zheng W, Hu H, Luo C, Chen J, Yuan C, Lu W, Chen DZ, Gao H, Wu J. A Corresponding Region Fusion Framework for Multi-Modal Cervical Lesion Detection. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2024; 21:959-970. [PMID: 35635817 DOI: 10.1109/tcbb.2022.3178725] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Cervical lesion detection (CLD) using colposcopic images of multi-modality (acetic and iodine) is critical to computer-aided diagnosis (CAD) systems for accurate, objective, and comprehensive cervical cancer screening. To robustly capture lesion features and conform with clinical diagnosis practice, we propose a novel corresponding region fusion network (CRFNet) for multi-modal CLD. CRFNet first extracts feature maps and generates proposals for each modality, then performs proposal shifting to obtain corresponding regions under large position shifts between modalities, and finally fuses those region features with a new corresponding channel attention to detect lesion regions on both modalities. To evaluate CRFNet, we build a large multi-modal colposcopic image dataset collected from our collaborative hospital. We show that our proposed CRFNet surpasses known single-modal and multi-modal CLD methods and achieves state-of-the-art performance, especially in terms of Average Precision.
Collapse
|
2
|
Gupta A, Parveen A, Kumar A, Yadav P. Advancement in Deep Learning Methods for Diagnosis and Prognosis of Cervical Cancer. Curr Genomics 2022; 23:234-245. [PMID: 36777879 PMCID: PMC9875539 DOI: 10.2174/1389202923666220511155939] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 03/20/2022] [Accepted: 03/25/2022] [Indexed: 11/22/2022] Open
Abstract
Cervical cancer is the leading cause of death in women, mainly in developing countries, including India. Recent advancements in technologies could allow for more rapid, cost-effective, and sensitive screening and treatment measures for cervical cancer. To this end, deep learning-based methods have received importance for classifying cervical cancer patients into different risk groups. Furthermore, deep learning models are now available to study the progression and treatment of cancerous cervical conditions. Undoubtedly, deep learning methods can enhance our knowledge toward a better understanding of cervical cancer progression. However, it is essential to thoroughly validate the deep learning-based models before they can be implicated in everyday clinical practice. This work reviews recent development in deep learning approaches employed in cervical cancer diagnosis and prognosis. Further, we provide an overview of recent methods and databases leveraging these new approaches for cervical cancer risk prediction and patient outcomes. Finally, we conclude the state-of-the-art approaches for future research opportunities in this domain.
Collapse
Affiliation(s)
- Akshat Gupta
- Department of Biotechnology, Motilal Nehru National Institute of Technology, Allahabad, Prayagraj, 211004, India
| | - Alisha Parveen
- Rudolf-Zenker, Institute of Experimental Surgery, Rostock University Medical Center, Rostock, Germany
| | - Abhishek Kumar
- Institute of Bioinformatics, International Technology Park, Bangalore, 560066, India;,Manipal Academy of Higher Education (MAHE), Manipal, Karnataka, 576104, India
| | - Pankaj Yadav
- Department of Bioscience and Bioengineering, Indian Institute of Technology, Jodhpur, 342037 India,Address correspondence to this author at the Department of Bioscience and Bioengineering, Indian Institute of Technology, Jodhpur, 342037 Rajasthan, India; Tel: +91 (0) 291 280-1211; E-mail:
| |
Collapse
|
3
|
Dual-attention EfficientNet based on multi-view feature fusion for cervical squamous intraepithelial lesions diagnosis. Biocybern Biomed Eng 2022. [DOI: 10.1016/j.bbe.2022.02.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
4
|
HLDnet: Novel deep learning based Artificial Intelligence tool fuses acetic acid and Lugol’s iodine cervicograms for accurate pre-cancer screening. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103163] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
5
|
Chen T, Liu X, Feng R, Wang W, Yuan C, Lu W, He H, Gao H, Ying H, Chen DZ, Wu J. Discriminative Cervical Lesion Detection in Colposcopic Images with Global Class Activation and Local Bin Excitation. IEEE J Biomed Health Inform 2021; 26:1411-1421. [PMID: 34314364 DOI: 10.1109/jbhi.2021.3100367] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Accurate cervical lesion detection (CLD) methods using colposcopic images are highly demanded in computer-aided diagnosis (CAD) for automatic diagnosis of High-grade Squamous Intraepithelial Lesions (HSIL). However, compared to natural scene images, the specific characteristics of colposcopic images, such as low contrast, visual similarity, and ambiguous lesion boundaries, pose difficulties to accurately locating HSIL regions and also significantly impede the performance improvement of existing CLD approaches. To tackle these difficulties and better capture cervical lesions, we develop novel feature enhancing mechanisms from both global and local perspectives, and propose a new discriminative CLD framework, called CervixNet, with a Global Class Activation (GCA) module and a Local Bin Excitation (LBE) module. Specifically, the GCA module learns discriminative features by introducing an auxiliary classifier, and guides our model to focus on HSIL regions while ignoring noisy regions. It globally facilitates the feature extraction process and helps boost feature discriminability. Further, our LBE module excites lesion features in a local manner, and allows the lesion regions to be more fine-grained enhanced by explicitly modelling the inter-dependencies among bins of proposal feature. Extensive experiments on a number of 9888 clinical colposcopic images verify the superiority of our method (AP .75=20.45) over state-of-the-art models on four widely used metrics.
Collapse
|
6
|
Automated Cell Nuclei Segmentation on Cervical Smear Images Using Structure Analysis. JOURNAL OF BIOMIMETICS BIOMATERIALS AND BIOMEDICAL ENGINEERING 2021. [DOI: 10.4028/www.scientific.net/jbbbe.51.105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Cervical cancer is a common cancer that affects women around the world, and it is also the most common cancer in the developing countries. The cancer burden has increased due to several factors, such as population growth and ageing. In the early century, the systematization of cervical cancer cells takes some time to process manually, and the result that comes out is also inaccurate. This article presents a new nucleus segmentation on pap smear cell images based on structured analysis or morphological approach. Morphology is a broad set of image processing operations that process images based on shape, size and structure. This operation applies a structural element of the image to create an output image of the same size. The most basic of these operations are dilation and erosion. The results of the numerical analysis indicate that the proposed method achieved about 94.38% (sensitivity), 82.56% (specificity) and 93% (accuracy). Also, the resulting performance was compared to a few existing techniques such as Bradley Method, Nick Method and Sauvola Method. The results presented here may facilitate improvements in the detection method of the pap smear cell image to resolve the time-consuming issue and support better system performance to prevent low precision result of the Human Papilloma Virus (HPV) stages. The main impact of this paper is will help the doctor to identify the patient disease based on Pap smear analysis such as cervical cancer and increase the percentages of accuracy compared to the conventional method. Successful implementation of the nucleus detection techniques on Pap smear image can become a standard technique for the diagnosis of various microbiological infections such as Malaria and Tuberculosis.
Collapse
|
7
|
Using Dynamic Features for Automatic Cervical Precancer Detection. Diagnostics (Basel) 2021; 11:diagnostics11040716. [PMID: 33920732 PMCID: PMC8073487 DOI: 10.3390/diagnostics11040716] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 04/07/2021] [Accepted: 04/15/2021] [Indexed: 11/17/2022] Open
Abstract
Cervical cancer remains a major public health concern in developing countries due to financial and human resource constraints. Visual inspection with acetic acid (VIA) of the cervix was widely promoted and routinely used as a low-cost primary screening test in low- and middle-income countries. It can be performed by a variety of health workers and the result is immediate. VIA provides a transient whitening effect which appears and disappears differently in precancerous and cancerous lesions, as compared to benign conditions. Colposcopes are often used during VIA to magnify the view of the cervix and allow clinicians to visually assess it. However, this assessment is generally subjective and unreliable even for experienced clinicians. Computer-aided techniques may improve the accuracy of VIA diagnosis and be an important determinant in the promotion of cervical cancer screening. This work proposes a smartphone-based solution that automatically detects cervical precancer from the dynamic features extracted from videos taken during VIA. The proposed solution achieves a sensitivity and specificity of 0.9 and 0.87 respectively, and could be a solution for screening in countries that suffer from the lack of expensive tools such as colposcopes and well-trained clinicians.
Collapse
|
8
|
Sarvamangala DR, Kulkarni RV. Convolutional neural networks in medical image understanding: a survey. EVOLUTIONARY INTELLIGENCE 2021; 15:1-22. [PMID: 33425040 PMCID: PMC7778711 DOI: 10.1007/s12065-020-00540-3] [Citation(s) in RCA: 127] [Impact Index Per Article: 42.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 10/05/2020] [Accepted: 11/22/2020] [Indexed: 12/23/2022]
Abstract
Imaging techniques are used to capture anomalies of the human body. The captured images must be understood for diagnosis, prognosis and treatment planning of the anomalies. Medical image understanding is generally performed by skilled medical professionals. However, the scarce availability of human experts and the fatigue and rough estimate procedures involved with them limit the effectiveness of image understanding performed by skilled medical professionals. Convolutional neural networks (CNNs) are effective tools for image understanding. They have outperformed human experts in many image understanding tasks. This article aims to provide a comprehensive survey of applications of CNNs in medical image understanding. The underlying objective is to motivate medical image understanding researchers to extensively apply CNNs in their research and diagnosis. A brief introduction to CNNs has been presented. A discussion on CNN and its various award-winning frameworks have been presented. The major medical image understanding tasks, namely image classification, segmentation, localization and detection have been introduced. Applications of CNN in medical image understanding of the ailments of brain, breast, lung and other organs have been surveyed critically and comprehensively. A critical discussion on some of the challenges is also presented.
Collapse
|
9
|
Yue Z, Ding S, Zhao W, Wang H, Ma J, Zhang Y, Zhang Y. Automatic CIN Grades Prediction of Sequential Cervigram Image Using LSTM With Multistate CNN Features. IEEE J Biomed Health Inform 2020; 24:844-854. [DOI: 10.1109/jbhi.2019.2922682] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
10
|
Conceição T, Braga C, Rosado L, Vasconcelos MJM. A Review of Computational Methods for Cervical Cells Segmentation and Abnormality Classification. Int J Mol Sci 2019; 20:E5114. [PMID: 31618951 PMCID: PMC6834130 DOI: 10.3390/ijms20205114] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Revised: 10/07/2019] [Accepted: 10/09/2019] [Indexed: 02/07/2023] Open
Abstract
Cervical cancer is the one of the most common cancers in women worldwide, affecting around 570,000 new patients each year. Although there have been great improvements over the years, current screening procedures can still suffer from long and tedious workflows and ambiguities. The increasing interest in the development of computer-aided solutions for cervical cancer screening is to aid with these common practical difficulties, which are especially frequent in the low-income countries where most deaths caused by cervical cancer occur. In this review, an overview of the disease and its current screening procedures is firstly introduced. Furthermore, an in-depth analysis of the most relevant computational methods available on the literature for cervical cells analysis is presented. Particularly, this work focuses on topics related to automated quality assessment, segmentation and classification, including an extensive literature review and respective critical discussion. Since the major goal of this timely review is to support the development of new automated tools that can facilitate cervical screening procedures, this work also provides some considerations regarding the next generation of computer-aided diagnosis systems and future research directions.
Collapse
Affiliation(s)
| | | | - Luís Rosado
- Fraunhofer Portugal AICOS, 4200-135 Porto, Portugal.
| | | |
Collapse
|
11
|
Sarwar A, Sheikh AA, Manhas J, Sharma V. Segmentation of cervical cells for automated screening of cervical cancer: a review. Artif Intell Rev 2019. [DOI: 10.1007/s10462-019-09735-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
|
12
|
Korkut Y. Assessment of knowledge, attitudes, and behaviors regarding breast and cervical cancer among women in western Turkey. J Int Med Res 2019; 47:1660-1666. [PMID: 30845853 PMCID: PMC6460627 DOI: 10.1177/0300060519830252] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Objective We aimed to assess knowledge, attitudes, and practices regarding breast and cervical cancer and screening methods among women living western Turkey. Methods A questionnaire survey was administered to women aged ≥21 years. Data were collected using a 12-item questionnaire measuring women's knowledge, attitudes, and practice levels, including among participants who were health workers. Results A total 668 women were included in the study. The average age was 37.48 ± 11.85 years. Most women had a primary-level education (43.4%) and most (50.3%) were homemakers; 27.1% of participants were health care workers. The differences in age, education, and occupation among participants were evaluated according to whether participants perform breast self-examination and have undergone Pap testing. The distribution of women according to age group showed that with increased age, the frequency of performing these two behaviors decreased, with women over 55 years old accounting for a significantly higher proportion than other age groups. Conclusions In our study, the level of knowledge and attitudes regarding breast and cervical cancers among women was similar to that in previous studies and was higher than expected, especially among women who were health workers. However, all women had inadequate frequency of performing screening tests.
Collapse
Affiliation(s)
- Yasemin Korkut
- Department of Family Medicine, Kutahya Health Sciences University, Kütahya, Turkey
| |
Collapse
|
13
|
Chen T, Ma X, Liu X, Wang W, Feng R, Chen J, Yuan C, Lu W, Chen DZ, Wu J. Multi-view Learning with Feature Level Fusion for Cervical Dysplasia Diagnosis. LECTURE NOTES IN COMPUTER SCIENCE 2019. [DOI: 10.1007/978-3-030-32239-7_37] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
14
|
Xu T, Zhang H, Xin C, Kim E, Long LR, Xue Z, Antani S, Huang X. Multi-feature based Benchmark for Cervical Dysplasia Classification Evaluation. PATTERN RECOGNITION 2017; 63:468-475. [PMID: 28603299 PMCID: PMC5464748 DOI: 10.1016/j.patcog.2016.09.027] [Citation(s) in RCA: 38] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Cervical cancer is one of the most common types of cancer in women worldwide. Most deaths due to the disease occur in less developed areas of the world. In this work, we introduce a new image dataset along with expert annotated diagnoses for evaluating image-based cervical disease classification algorithms. A large number of Cervigram® images are selected from a database provided by the US National Cancer Institute. For each image, we extract three complementary pyramid features: Pyramid histogram in L*A*B* color space (PLAB), Pyramid Histogram of Oriented Gradients (PHOG), and Pyramid histogram of Local Binary Patterns (PLBP). Other than hand-crafted pyramid features, we investigate the performance of convolutional neural network (CNN) features for cervical disease classification. Our experimental results demonstrate the effectiveness of both our hand-crafted and our deep features. We intend to release this multi-feature dataset and our extensive evaluations using seven classic classifiers can serve as the baseline.
Collapse
Affiliation(s)
- Tao Xu
- Computer Science and Engineering Department, Lehigh University, Bethlehem, PA, USA
| | - Han Zhang
- Department of Computer Science, Rutgers University, Piscataway, NJ, USA
| | - Cheng Xin
- Computer Science and Engineering Department, Lehigh University, Bethlehem, PA, USA
| | - Edward Kim
- Computing Sciences Department, Villanova University, Villanova, PA, USA
| | - L. Rodney Long
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Zhiyun Xue
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Sameer Antani
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Xiaolei Huang
- Computer Science and Engineering Department, Lehigh University, Bethlehem, PA, USA
| |
Collapse
|
15
|
Automatic cytoplasm and nuclei segmentation for color cervical smear image using an efficient gap-search MRF. Comput Biol Med 2016; 71:46-56. [DOI: 10.1016/j.compbiomed.2016.01.025] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2015] [Revised: 01/10/2016] [Accepted: 01/22/2016] [Indexed: 11/19/2022]
|
16
|
Korsnes MS, Korsnes R. Lifetime Distributions from Tracking Individual BC3H1 Cells Subjected to Yessotoxin. Front Bioeng Biotechnol 2015; 3:166. [PMID: 26557641 PMCID: PMC4617161 DOI: 10.3389/fbioe.2015.00166] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2015] [Accepted: 10/02/2015] [Indexed: 11/21/2022] Open
Abstract
This work shows examples of lifetime distributions for individual BC3H1 cells after start of exposure to the marine toxin yessotoxin (YTX) in an experimental dish. The present tracking of many single cells from time-lapse microscopy data demonstrates the complexity in individual cell fate and which can be masked in aggregate properties. This contribution also demonstrates the general practicality of cell tracking. It can serve as a conceptually simple and non-intrusive method for high throughput early analysis of cytotoxic effects to assess early and late time points relevant for further analyzes or to assess for variability and sub-populations of interest. The present examples of lifetime distributions seem partly to reflect different cell death modalities. Differences between cell lifetime distributions derived from populations in different experimental dishes can potentially provide measures of inter-cellular influence. Such outcomes may help to understand tumor-cell resistance to drug therapy and to predict the probability of metastasis.
Collapse
Affiliation(s)
- Mónica Suárez Korsnes
- Department of Chemistry, Biotechnology and Food Science, Norwegian University of Life Sciences , Ås , Norway
| | - Reinert Korsnes
- Norwegian Institute of Bioeconomy Research , Ås , Norway ; Norwegian Defense Research Establishment , Kjeller , Norway
| |
Collapse
|