1
|
Aboobacker S, Vijayasenan D, S SD, Suresh PK, Sreeram S. Semantic segmentation of low magnification effusion cytology images: A semi-supervised approach. Comput Biol Med 2022; 150:106179. [PMID: 36252367 DOI: 10.1016/j.compbiomed.2022.106179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 09/09/2022] [Accepted: 10/01/2022] [Indexed: 11/17/2022]
Abstract
Cytopathologists examine microscopic images obtained at various magnifications to identify malignancy in effusions. They locate the malignant cell clusters at a low magnification and then zoom in to investigate cell-level features at a high magnification. This study predicts the malignancy at low magnification levels such as 4X and 10X in effusion cytology images to reduce scanning time. However, the most challenging problem is annotating the low magnification images, particularly the 4X images. This paper extends two semi-supervised learning (SSL) models, MixMatch and FixMatch, for semantic segmentation. The original FixMatch and MixMatch algorithms are designed for classification tasks. While performing image augmentation, the generated pseudo labels are spatially altered. We introduce reverse augmentation to compensate for the effect of the spatial alterations. The extended models are trained using labelled 10X and unlabelled 4X images. The average F-score of benign and malignant pixels on the predictions of 4X images is improved approximately by 9% for both Extended MixMatch and Extended FixMatch respectively compared with the baseline model. In the Extended MixMatch, 62% sub-regions of low magnification images are eliminated from scanning at a higher magnification, thereby saving scanning time.
Collapse
Affiliation(s)
- Shajahan Aboobacker
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, 575025, Karnataka, India.
| | - Deepu Vijayasenan
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, 575025, Karnataka, India
| | - Sumam David S
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, 575025, Karnataka, India
| | - Pooja K Suresh
- Department of Pathology, Kasturba Medical College Mangalore, Manipal Academy of Higher Education, Manipal, 575001, Karnataka, India
| | - Saraswathy Sreeram
- Department of Pathology, Kasturba Medical College Mangalore, Manipal Academy of Higher Education, Manipal, 575001, Karnataka, India
| |
Collapse
|
2
|
Deep convolutional neural network-based classification of cancer cells on cytological pleural effusion images. Mod Pathol 2022; 35:609-614. [PMID: 35013527 PMCID: PMC9042694 DOI: 10.1038/s41379-021-00987-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 11/20/2021] [Accepted: 11/22/2021] [Indexed: 11/23/2022]
Abstract
Lung cancer is one of the leading causes of cancer-related death worldwide. Cytology plays an important role in the initial evaluation and diagnosis of patients with lung cancer. However, due to the subjectivity of cytopathologists and the region-dependent diagnostic levels, the low consistency of liquid-based cytological diagnosis results in certain proportions of misdiagnoses and missed diagnoses. In this study, we performed a weakly supervised deep learning method for the classification of benign and malignant cells in lung cytological images through a deep convolutional neural network (DCNN). A total of 404 cases of lung cancer cells in effusion cytology specimens from Shanghai Pulmonary Hospital were investigated, in which 266, 78, and 60 cases were used as the training, validation and test sets, respectively. The proposed method was evaluated on 60 whole-slide images (WSIs) of lung cancer pleural effusion specimens. This study showed that the method had an accuracy, sensitivity, and specificity respectively of 91.67%, 87.50% and 94.44% in classifying malignant and benign lesions (or normal). The area under the receiver operating characteristic (ROC) curve (AUC) was 0.9526 (95% confidence interval (CI): 0.9019-9.9909). In contrast, the average accuracies of senior and junior cytopathologists were 98.34% and 83.34%, respectively. The proposed deep learning method will be useful and may assist pathologists with different levels of experience in the diagnosis of cancer cells on cytological pleural effusion images in the future.
Collapse
|
3
|
Mahbod A, Schaefer G, Löw C, Dorffner G, Ecker R, Ellinger I. Investigating the Impact of the Bit Depth of Fluorescence-Stained Images on the Performance of Deep Learning-Based Nuclei Instance Segmentation. Diagnostics (Basel) 2021; 11:967. [PMID: 34072131 PMCID: PMC8230326 DOI: 10.3390/diagnostics11060967] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 05/05/2021] [Accepted: 05/25/2021] [Indexed: 11/25/2022] Open
Abstract
Nuclei instance segmentation can be considered as a key point in the computer-mediated analysis of histological fluorescence-stained (FS) images. Many computer-assisted approaches have been proposed for this task, and among them, supervised deep learning (DL) methods deliver the best performances. An important criterion that can affect the DL-based nuclei instance segmentation performance of FS images is the utilised image bit depth, but to our knowledge, no study has been conducted so far to investigate this impact. In this work, we released a fully annotated FS histological image dataset of nuclei at different image magnifications and from five different mouse organs. Moreover, by different pre-processing techniques and using one of the state-of-the-art DL-based methods, we investigated the impact of image bit depth (i.e., eight bits vs. sixteen bits) on the nuclei instance segmentation performance. The results obtained from our dataset and another publicly available dataset showed very competitive nuclei instance segmentation performances for the models trained with 8 bit and 16 bit images. This suggested that processing 8 bit images is sufficient for nuclei instance segmentation of FS images in most cases. The dataset including the raw image patches, as well as the corresponding segmentation masks is publicly available in the published GitHub repository.
Collapse
Affiliation(s)
- Amirreza Mahbod
- Institute for Pathophysiology and Allergy Research, Medical University of Vienna, A-1090 Vienna, Austria; (C.L.); (I.E.)
| | - Gerald Schaefer
- Department of Computer Science, Loughborough University, Loughborough LE11 3TT, UK;
| | - Christine Löw
- Institute for Pathophysiology and Allergy Research, Medical University of Vienna, A-1090 Vienna, Austria; (C.L.); (I.E.)
| | - Georg Dorffner
- Section for Artificial Intelligence and Decision Support, Medical University of Vienna, 1090 Vienna, Austria;
| | - Rupert Ecker
- Department of Research and Development, TissueGnostics GmbH, 1020 Vienna, Austria;
| | - Isabella Ellinger
- Institute for Pathophysiology and Allergy Research, Medical University of Vienna, A-1090 Vienna, Austria; (C.L.); (I.E.)
| |
Collapse
|
4
|
Awan R, Benes K, Azam A, Song TH, Shaban M, Verrill C, Tsang YW, Snead D, Minhas F, Rajpoot N. Deep learning based digital cell profiles for risk stratification of urine cytology images. Cytometry A 2021; 99:732-742. [PMID: 33486882 DOI: 10.1002/cyto.a.24313] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2020] [Revised: 12/05/2020] [Accepted: 12/15/2020] [Indexed: 11/06/2022]
Abstract
Urine cytology is a test for the detection of high-grade bladder cancer. In clinical practice, the pathologist would manually scan the sample under the microscope to locate atypical and malignant cells. They would assess the morphology of these cells to make a diagnosis. Accurate identification of atypical and malignant cells in urine cytology is a challenging task and is an essential part of identifying different diagnosis with low-risk and high-risk malignancy. Computer-assisted identification of malignancy in urine cytology can be complementary to the clinicians for treatment management and in providing advice for carrying out further tests. In this study, we presented a method for identifying atypical and malignant cells followed by their profiling to predict the risk of diagnosis automatically. For cell detection and classification, we employed two different deep learning-based approaches. Based on the best performing network predictions at the cell level, we identified low-risk and high-risk cases using the count of atypical cells and the total count of atypical and malignant cells. The area under the receiver operating characteristic (ROC) curve shows that a total count of atypical and malignant cells is comparably better at diagnosis as compared to the count of malignant cells only. We obtained area under the ROC curve with the count of malignant cells and the total count of atypical and malignant cells as 0.81 and 0.83, respectively. Our experiments also demonstrate that the digital risk could be a better predictor of the final histopathology-based diagnosis. We also analyzed the variability in annotations at both cell and whole slide image level and also explored the possible inherent rationales behind this variability.
Collapse
Affiliation(s)
- Ruqayya Awan
- Department of Computer Science, University of Warwick, Coventry, UK
| | - Ksenija Benes
- The Royal Wolverhampton NHS Trust, Wolverhampton, UK
| | - Ayesha Azam
- Department of Computer Science, University of Warwick, Coventry, UK.,Department of Pathology, University Hospitals Coventry and Warwickshire, Coventry, UK
| | - Tzu-Hsi Song
- Department of Computer Science, University of Warwick, Coventry, UK.,Laboratory of Quantitative Cellular Imaging, Worcester Polytechnic Institute, Worcester, Massachusetts, USA
| | - Muhammad Shaban
- Department of Computer Science, University of Warwick, Coventry, UK
| | - Clare Verrill
- Nuffield Department of Surgical Sciences and Oxford NIHR Biomedical Research Centre, University of Oxford, Oxford, UK
| | - Yee Wah Tsang
- Department of Pathology, University Hospitals Coventry and Warwickshire, Coventry, UK
| | - David Snead
- Department of Pathology, University Hospitals Coventry and Warwickshire, Coventry, UK
| | - Fayyaz Minhas
- Department of Computer Science, University of Warwick, Coventry, UK
| | - Nasir Rajpoot
- Department of Computer Science, University of Warwick, Coventry, UK.,Department of Pathology, University Hospitals Coventry and Warwickshire, Coventry, UK.,The Alan Turing Institute, London, UK
| |
Collapse
|
5
|
ACDC: Automated Cell Detection and Counting for Time-Lapse Fluorescence Microscopy. APPLIED SCIENCES-BASEL 2020; 10. [PMID: 34306736 PMCID: PMC8297459 DOI: 10.3390/app10186187] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Advances in microscopy imaging technologies have enabled the visualization of live-cell dynamic processes using time-lapse microscopy imaging. However, modern methods exhibit several limitations related to the training phases and to time constraints, hindering their application in the laboratory practice. In this work, we present a novel method, named Automated Cell Detection and Counting (ACDC), designed for activity detection of fluorescent labeled cell nuclei in time-lapse microscopy. ACDC overcomes the limitations of the literature methods, by first applying bilateral filtering on the original image to smooth the input cell images while preserving edge sharpness, and then by exploiting the watershed transform and morphological filtering. Moreover, ACDC represents a feasible solution for the laboratory practice, as it can leverage multi-core architectures in computer clusters to efficiently handle large-scale imaging datasets. Indeed, our Parent-Workers implementation of ACDC allows to obtain up to a 3.7× speed-up compared to the sequential counterpart. ACDC was tested on two distinct cell imaging datasets to assess its accuracy and effectiveness on images with different characteristics. We achieved an accurate cell-count and nuclei segmentation without relying on large-scale annotated datasets, a result confirmed by the average Dice Similarity Coefficients of 76.84 and 88.64 and the Pearson coefficients of 0.99 and 0.96, calculated against the manual cell counting, on the two tested datasets.
Collapse
|