1
|
Bokhorst JM, Nagtegaal ID, Fraggetta F, Vatrano S, Mesker W, Vieth M, van der Laak J, Ciompi F. Deep learning for multi-class semantic segmentation enables colorectal cancer detection and classification in digital pathology images. Sci Rep 2023; 13:8398. [PMID: 37225743 DOI: 10.1038/s41598-023-35491-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 05/18/2023] [Indexed: 05/26/2023] Open
Abstract
In colorectal cancer (CRC), artificial intelligence (AI) can alleviate the laborious task of characterization and reporting on resected biopsies, including polyps, the numbers of which are increasing as a result of CRC population screening programs ongoing in many countries all around the globe. Here, we present an approach to address two major challenges in the automated assessment of CRC histopathology whole-slide images. We present an AI-based method to segment multiple ([Formula: see text]) tissue compartments in the H &E-stained whole-slide image, which provides a different, more perceptible picture of tissue morphology and composition. We test and compare a panel of state-of-the-art loss functions available for segmentation models, and provide indications about their use in histopathology image segmentation, based on the analysis of (a) a multi-centric cohort of CRC cases from five medical centers in the Netherlands and Germany, and (b) two publicly available datasets on segmentation in CRC. We used the best performing AI model as the basis for a computer-aided diagnosis system that classifies colon biopsies into four main categories that are relevant pathologically. We report the performance of this system on an independent cohort of more than 1000 patients. The results show that with a good segmentation network as a base, a tool can be developed which can support pathologists in the risk stratification of colorectal cancer patients, among other possible uses. We have made the segmentation model available for research use on https://grand-challenge.org/algorithms/colon-tissue-segmentation/ .
Collapse
Affiliation(s)
- John-Melle Bokhorst
- Department of pathology, Radboud University Medical Center, Nijmegen, The Netherlands.
| | - Iris D Nagtegaal
- Department of pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Filippo Fraggetta
- Pathology Unit Gravina Hospital, Gravina Hospital, Caltagirone, Italy
| | - Simona Vatrano
- Pathology Unit Gravina Hospital, Gravina Hospital, Caltagirone, Italy
| | - Wilma Mesker
- Leids Universitair Medisch Centrum, Leiden, The Netherlands
| | - Michael Vieth
- Klinikum Bayreuth, Friedrich-Alexander-University Erlangen-Nuremberg, Bayreuth, Germany
| | - Jeroen van der Laak
- Department of pathology, Radboud University Medical Center, Nijmegen, The Netherlands
- Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| | - Francesco Ciompi
- Department of pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
2
|
Zhu W, Huang H, Zhou Y, Shi F, Shen H, Chen R, Hua R, Wang W, Xu S, Luo X. Automatic segmentation of white matter hyperintensities in routine clinical brain MRI by 2D VB-Net: A large-scale study. Front Aging Neurosci 2022; 14:915009. [PMID: 35966772 PMCID: PMC9372352 DOI: 10.3389/fnagi.2022.915009] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 07/14/2022] [Indexed: 11/13/2022] Open
Abstract
White matter hyperintensities (WMH) are imaging manifestations frequently observed in various neurological disorders, yet the clinical application of WMH quantification is limited. In this study, we designed a series of dedicated WMH labeling protocols and proposed a convolutional neural network named 2D VB-Net for the segmentation of WMH and other coexisting intracranial lesions based on a large dataset of 1,045 subjects across various demographics and multiple scanners using 2D thick-slice protocols that are more commonly applied in clinical practice. Using our labeling pipeline, the Dice consistency of the WMH regions manually depicted by two observers was 0.878, which formed a solid basis for the development and evaluation of the automatic segmentation system. The proposed algorithm outperformed other state-of-the-art methods (uResNet, 3D V-Net and Visual Geometry Group network) in the segmentation of WMH and other coexisting intracranial lesions and was well validated on datasets with thick-slice magnetic resonance (MR) images and the 2017 medical image computing and computer assisted intervention WMH Segmentation Challenge dataset (with thin-slice MR images), all showing excellent effectiveness. Furthermore, our method can subclassify WMH to display the WMH distributions and is very lightweight. Additionally, in terms of correlation to visual rating scores, our algorithm showed excellent consistency with the manual delineations and was overall better than those from other competing methods. In conclusion, we developed an automatic WMH quantification framework for multiple application scenarios, exhibiting a promising future in clinical practice.
Collapse
Affiliation(s)
- Wenhao Zhu
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Hao Huang
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yaqi Zhou
- Shanghai United Imaging Intelligence, Wuhan, China
| | - Feng Shi
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Hong Shen
- Shanghai United Imaging Intelligence, Wuhan, China
| | - Ran Chen
- Shanghai United Imaging Intelligence, Wuhan, China
| | - Rui Hua
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Wei Wang
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Shabei Xu
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiang Luo
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
3
|
Towards an Accurate MRI Acute Ischemic Stroke Lesion Segmentation Based on Bioheat Equation and U-Net Model. Int J Biomed Imaging 2022; 2022:5529726. [PMID: 35880140 PMCID: PMC9308529 DOI: 10.1155/2022/5529726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 08/11/2021] [Accepted: 07/04/2022] [Indexed: 11/29/2022] Open
Abstract
Acute ischemic stroke represents a cerebrovascular disease, for which it is practical, albeit challenging to segment and differentiate infarct core from salvageable penumbra brain tissue. Ischemic stroke causes the variation of cerebral blood flow and heat generation due to metabolism. Therefore, the temperature is modified in the ischemic stroke region. In this paper, we incorporate acute ischemic stroke temperature profile to reinforce segmentation accuracy in MRI. Pennes bioheat equation was used to generate brain thermal images that may provide rich information regarding the temperature change in acute ischemic stroke lesions. The thermal images were generated by calculating the temperature of the brain with acute ischemic stroke. Then, U-Net was used in this paper for the segmentation of acute ischemic stroke. A dataset of 3192 images was created to train U-Net using k-fold crossvalidation. The training time was about 10 hours and 35 minutes in NVIDIA GPU. Next, the obtained trained model was compared with recent methods to analyze the effect of the ischemic stroke temperature profile in segmentation. The obtained results show that significant parts of acute ischemic stroke and background areas are segmented only in thermal images, which proves the importance of using thermal information to improve the segmentation outcomes in MRI diagnosis.
Collapse
|
4
|
Sreejith S, Subramanian R, Karthik S. Using patching asymmetric regions to assess ischemic stroke lesion in neuro imaging. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-212457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Ischemic stroke is a universal ailment that endangers the life of patients and makes them bedridden until death. Over a decade, doctors and radiologists have been dissecting patient status straightforwardly from the printouts of the slice images delivered by different diagnostic imaging modalities. Computed Tomography (CT) is a frequently used imaging strategy for therapeutic analysis and neuroanatomical investigations. The main objective of the paper is to develop a simple technique with less architectural complication and power consumption. The proposed work is to section the ischemic stroke lesion more efficiently from multi-succession CT images using patching the asymmetric region. The Hough transform segment and extracts the features from the asymmetric region of the CT image and finally, the random forest is implemented to classify the unusual tissues from the CT image dependent on their pathological properties. RF classifier has been trained for different parts of the cerebrum for fragmenting the stroke lesion. The acquired outcomes produce better segmentation accuracy when compared with different strategies. The overall efficiency of the proposed method determines the Ischemic stroke with an accuracy of 95% with an RF classifier. Hence this method can be used in the segmentation process of stroke lesions.
Collapse
Affiliation(s)
- S. Sreejith
- Department of Electronics & Communication Engineering, SNS College of Technology, Coimbatore, Tamilnadu, India
| | - R. Subramanian
- Department of Electrical & Electronics Engineering, SNS College of Technology, Coimbatore, Tamilnadu, India
| | - S. Karthik
- Department of Computer Science & Engineering, SNS College of Technology, Coimbatore, Tamilnadu, India
| |
Collapse
|
5
|
Huang W, Shu X, Wang Z, Zhang L, Chen C, Xu J, Yi Z. Feature Pyramid Network With Level-Aware Attention for Meningioma Segmentation. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2022. [DOI: 10.1109/tetci.2022.3146965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
6
|
Qiu B, van der Wel H, Kraeima J, Glas HH, Guo J, Borra RJH, Witjes MJH, van Ooijen PMA. Mandible Segmentation of Dental CBCT Scans Affected by Metal Artifacts Using Coarse-to-Fine Learning Model. J Pers Med 2021; 11:560. [PMID: 34208429 PMCID: PMC8232763 DOI: 10.3390/jpm11060560] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 06/10/2021] [Accepted: 06/14/2021] [Indexed: 11/16/2022] Open
Abstract
Accurate segmentation of the mandible from cone-beam computed tomography (CBCT) scans is an important step for building a personalized 3D digital mandible model for maxillofacial surgery and orthodontic treatment planning because of the low radiation dose and short scanning duration. CBCT images, however, exhibit lower contrast and higher levels of noise and artifacts due to extremely low radiation in comparison with the conventional computed tomography (CT), which makes automatic mandible segmentation from CBCT data challenging. In this work, we propose a novel coarse-to-fine segmentation framework based on 3D convolutional neural network and recurrent SegUnet for mandible segmentation in CBCT scans. Specifically, the mandible segmentation is decomposed into two stages: localization of the mandible-like region by rough segmentation and further accurate segmentation of the mandible details. The method was evaluated using a dental CBCT dataset. In addition, we evaluated the proposed method and compared it with state-of-the-art methods in two CT datasets. The experiments indicate that the proposed algorithm can provide more accurate and robust segmentation results for different imaging techniques in comparison with the state-of-the-art models with respect to these three datasets.
Collapse
Affiliation(s)
- Bingjiang Qiu
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Hylke van der Wel
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Joep Kraeima
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Haye Hendrik Glas
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Jiapan Guo
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Ronald J. H. Borra
- Medical Imaging Center (MIC), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
| | - Max Johannes Hendrikus Witjes
- 3D Lab, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands; (B.Q.); (H.v.d.W.); (J.K.); (H.H.G.); (M.J.H.W.)
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| | - Peter M. A. van Ooijen
- Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands;
- Data Science Center in Health (DASH), University Medical Center Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
| |
Collapse
|
7
|
Karthik R, Menaka R, Johnson A, Anand S. Neuroimaging and deep learning for brain stroke detection - A review of recent advancements and future prospects. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105728. [PMID: 32882591 DOI: 10.1016/j.cmpb.2020.105728] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2020] [Accepted: 08/23/2020] [Indexed: 05/24/2023]
Abstract
BACKGROUND AND OBJECTIVE In recent years, deep learning algorithms have created a massive impact on addressing research challenges in different domains. The medical field also greatly benefits from the use of improving deep learning models which save time and produce accurate results. This research aims to emphasize the impact of deep learning models in brain stroke detection and lesion segmentation. This is achieved by discussing the state of the art approaches proposed by the recent works in this field. METHODS In this study, the advancements in stroke lesion detection and segmentation were focused. The survey analyses 113 research papers published in different academic research databases. The research articles have been filtered out based on specific criteria to obtain the most prominent insights related to stroke lesion detection and segmentation. RESULTS The features of the stroke lesion vary based on the type of imaging modality. To develop an effective method for stroke lesion detection, the features need to be carefully extracted from the input images. This review takes an attempt to categorize and discuss the different deep architectures employed for stroke lesion detection and segmentation, based on the underlying imaging modality. This further assists in understanding the relevance of the two-deep neural network components in medical image analysis namely Convolutional Neural Network (CNN) and Fully Convolutional Network (FCN). It hints at other possible deep architectures that can be proposed for better results towards stroke lesion detection. Also, the emerging trends and breakthroughs in stroke detection have been detailed in this evaluation. CONCLUSION This work concludes by examining the technical and non-technical challenges faced by researchers and indicate the future implications in stroke detection. It could support the bio-medical researchers to propose better solutions for stroke lesion detection.
Collapse
Affiliation(s)
- R Karthik
- Center for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India.
| | - R Menaka
- Center for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India.
| | - Annie Johnson
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| | - Sundar Anand
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| |
Collapse
|