1
|
Ali H, Haq IU, Cui L, Feng J. MSAL-Net: improve accurate segmentation of nuclei in histopathology images by multiscale attention learning network. BMC Med Inform Decis Mak 2022; 22:90. [PMID: 35379228 PMCID: PMC8978355 DOI: 10.1186/s12911-022-01826-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 03/24/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The digital pathology images obtain the essential information about the patient's disease, and the automated nuclei segmentation results can help doctors make better decisions about diagnosing the disease. With the speedy advancement of convolutional neural networks in image processing, deep learning has been shown to play a significant role in the various analysis of medical images, such as nuclei segmentation, mitosis detection and segmentation etc. Recently, several U-net based methods have been developed to solve the automated nuclei segmentation problems. However, these methods fail to deal with the weak features representation from the initial layers and introduce the noise into the decoder path. In this paper, we propose a multiscale attention learning network (MSAL-Net), where the dense dilated convolutions block captures more comprehensive nuclei context information, and a newly modified decoder part is introduced, which integrates with efficient channel attention and boundary refinement modules to effectively learn spatial information for better prediction and further refine the nuclei cell of boundaries. RESULTS Both qualitative and quantitative results are obtained on the publicly available MoNuseg dataset. Extensive experiment results verify that our proposed method significantly outperforms state-of-the-art methods as well as the vanilla Unet method in the segmentation task. Furthermore, we visually demonstrate the effect of our modified decoder part. CONCLUSION The MSAL-Net shows superiority with a novel decoder to segment the touching and blurred background nuclei cells obtained from histopathology images with better performance for accurate decoding.
Collapse
Affiliation(s)
- Haider Ali
- School of Information Science and Technology, Northwest University, Xian, China
| | - Imran ul Haq
- School of Information Science and Technology, Northwest University, Xian, China
| | - Lei Cui
- School of Information Science and Technology, Northwest University, Xian, China
| | - Jun Feng
- School of Information Science and Technology, Northwest University, Xian, China
| |
Collapse
|
2
|
Fu F, Guenther A, Sakhdari A, McKee TD, Xia D. Deep Learning Accurately Quantifies Plasma Cell Percentages on CD138-Stained Bone Marrow Samples. J Pathol Inform 2022; 13:100011. [PMID: 35242448 PMCID: PMC8873946 DOI: 10.1016/j.jpi.2022.100011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 01/03/2022] [Indexed: 11/08/2022] Open
Abstract
The diagnosis of plasma cell neoplasms requires accurate, and ideally precise, percentages. This plasma cell percentage is often determined by visual estimation of CD138-stained bone marrow biopsies and clot sections. While not necessarily inaccurate, estimates are by definition imprecise. For this study, we hypothesized that deep learning can be used to improve precision. We trained a semantic segmentation-based convolutional neural network (CNN) using annotations of CD138+ and CD138- cells provided by one pathologist on small image patches of bone marrow and validated the CNN on an independent test set of image patches using annotations from two pathologists and a non-deep learning commercial software. On validation, we found that the intraclass correlation coefficients for plasma cell percentages between the CNN and pathologist #1, a non-deep learning commercial software and pathologist #1, and pathologists #1 and #2 were 0.975, 0.892, and 0.994, respectively. The overall results show that CNN labels were almost as accurate as pathologist labels at a cell-by-cell level. Once satisfied with performance, we scaled-up the CNN to evaluate whole slide images (WSIs), and deployed the system as a workflow friendly web application to measure plasma cell percentages using snapshots taken from microscope cameras.
Collapse
Affiliation(s)
- Fred Fu
- STTARR Innovation Centre, University Health Network, Toronto, ON, Canada
| | - Angela Guenther
- Division of Hematopathology and Transfusion Medicine, University Health Network, Toronto, ON, Canada
- Scarborough Health Network, Toronto, ON, Canada
| | - Ali Sakhdari
- Division of Hematopathology and Transfusion Medicine, University Health Network, Toronto, ON, Canada
| | - Trevor D. McKee
- STTARR Innovation Centre, University Health Network, Toronto, ON, Canada
- HistoWiz Inc., Brooklyn, NY, USA
| | - Daniel Xia
- Division of Hematopathology and Transfusion Medicine, University Health Network, Toronto, ON, Canada
| |
Collapse
|
3
|
Bodén ACS, Molin J, Garvin S, West RA, Lundström C, Treanor D. The human-in-the-loop: an evaluation of pathologists' interaction with artificial intelligence in clinical practice. Histopathology 2021; 79:210-218. [PMID: 33590577 DOI: 10.1111/his.14356] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 01/24/2021] [Accepted: 02/14/2021] [Indexed: 12/21/2022]
Abstract
AIMS One of the major drivers of the adoption of digital pathology in clinical practice is the possibility of introducing digital image analysis (DIA) to assist with diagnostic tasks. This offers potential increases in accuracy, reproducibility, and efficiency. Whereas stand-alone DIA has great potential benefit for research, little is known about the effect of DIA assistance in clinical use. The aim of this study was to investigate the clinical use characteristics of a DIA application for Ki67 proliferation assessment. Specifically, the human-in-the-loop interplay between DIA and pathologists was studied. METHODS AND RESULTS We retrospectively investigated breast cancer Ki67 areas assessed with human-in-the-loop DIA and compared them with visual and automatic approaches. The results, expressed as standard deviation of the error in the Ki67 index, showed that visual estimation ('eyeballing') (14.9 percentage points) performed significantly worse (P < 0.05) than DIA alone (7.2 percentage points) and DIA with human-in-the-loop corrections (6.9 percentage points). At the overall level, no improvement resulting from the addition of human-in-the-loop corrections to the automatic DIA results could be seen. For individual cases, however, human-in-the-loop corrections could address major DIA errors in terms of poor thresholding of faint staining and incorrect tumour-stroma separation. CONCLUSION The findings indicate that the primary value of human-in-the-loop corrections is to address major weaknesses of a DIA application, rather than fine-tuning the DIA quantifications.
Collapse
Affiliation(s)
- Anna C S Bodén
- Department of Clinical Pathology, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden.,Centre for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| | | | - Stina Garvin
- Department of Clinical Pathology, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden
| | - Rebecca A West
- Leeds Teaching Hospitals NHS Trust, Leeds, UK.,Department of Histopathology, Dewsbury and District Hospital, Dewsbury, UK
| | - Claes Lundström
- Centre for Medical Image Science and Visualization, Linköping University, Linköping, Sweden.,Sectra AB, Linköping, Sweden
| | - Darren Treanor
- Department of Clinical Pathology, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden.,Centre for Medical Image Science and Visualization, Linköping University, Linköping, Sweden.,Leeds Teaching Hospitals NHS Trust, Leeds, UK.,Pathology and Data Analytics, University of Leeds, Leeds, UK
| |
Collapse
|
4
|
Wan T, Zhao L, Feng H, Li D, Tong C, Qin Z. Robust nuclei segmentation in histopathology using ASPPU-Net and boundary refinement. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.08.103] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|
5
|
Computational Nuclei Segmentation Methods in Digital Pathology: A Survey. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING 2019. [DOI: 10.1007/s11831-019-09366-4] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
6
|
Höfener H, Homeyer A, Weiss N, Molin J, Lundström CF, Hahn HK. Deep learning nuclei detection: A simple approach can deliver state-of-the-art results. Comput Med Imaging Graph 2018; 70:43-52. [PMID: 30286333 DOI: 10.1016/j.compmedimag.2018.08.010] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2018] [Revised: 07/13/2018] [Accepted: 08/23/2018] [Indexed: 11/28/2022]
Abstract
BACKGROUND Deep convolutional neural networks have become a widespread tool for the detection of nuclei in histopathology images. Many implementations share a basic approach that includes generation of an intermediate map indicating the presence of a nucleus center, which we refer to as PMap. Nevertheless, these implementations often still differ in several parameters, resulting in different detection qualities. METHODS We identified several essential parameters and configured the basic PMap approach using combinations of them. We thoroughly evaluated and compared various configurations on multiple datasets with respect to detection quality, efficiency and training effort. RESULTS Post-processing of the PMap was found to have the largest impact on detection quality. Also, two different network architectures were identified that improve either detection quality or runtime performance. The best-performing configuration yields f1-measures of 0.816 on H&E stained images of colorectal adenocarcinomas and 0.819 on Ki-67 stained images of breast tumor tissue. On average, it was fully trained in less than 15,000 iterations and processed 4.15 megapixels per second at prediction time. CONCLUSIONS The basic PMap approach is greatly affected by certain parameters. Our evaluation provides guidance on their impact and best settings. When configured properly, this simple and efficient approach can yield equal detection quality as more complex and time-consuming state-of-the-art approaches.
Collapse
Affiliation(s)
| | - André Homeyer
- Fraunhofer MEVIS, Am Fallturm 1, 28359, Bremen, Germany.
| | - Nick Weiss
- Fraunhofer MEVIS, Am Fallturm 1, 28359, Bremen, Germany.
| | - Jesper Molin
- Sectra AB, Teknikringen 20, 58330, Linköping, Sweden.
| | - Claes F Lundström
- Sectra AB, Teknikringen 20, 58330, Linköping, Sweden; Center for Medical Image Science and Visualization, Linköping University, 58183, Linköping, Sweden.
| | - Horst K Hahn
- Fraunhofer MEVIS, Am Fallturm 1, 28359, Bremen, Germany; Jacobs University, Campus Ring 1, 28759, Bremen, Germany.
| |
Collapse
|