1
|
Islam T, Hoque ME, Ullah M, Islam T, Nishu NA, Islam R. CNN-based deep learning approach for classification of invasive ductal and metastasis types of breast carcinoma. Cancer Med 2024; 13:e70069. [PMID: 39215495 PMCID: PMC11364780 DOI: 10.1002/cam4.70069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 04/04/2024] [Accepted: 07/23/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVE Breast cancer is one of the leading cancer causes among women worldwide. It can be classified as invasive ductal carcinoma (IDC) or metastatic cancer. Early detection of breast cancer is challenging due to the lack of early warning signs. Generally, a mammogram is recommended by specialists for screening. Existing approaches are not accurate enough for real-time diagnostic applications and thus require better and smarter cancer diagnostic approaches. This study aims to develop a customized machine-learning framework that will give more accurate predictions for IDC and metastasis cancer classification. METHODS This work proposes a convolutional neural network (CNN) model for classifying IDC and metastatic breast cancer. The study utilized a large-scale dataset of microscopic histopathological images to automatically perceive a hierarchical manner of learning and understanding. RESULTS It is evident that using machine learning techniques significantly (15%-25%) boost the effectiveness of determining cancer vulnerability, malignancy, and demise. The results demonstrate an excellent performance ensuring an average of 95% accuracy in classifying metastatic cells against benign ones and 89% accuracy was obtained in terms of detecting IDC. CONCLUSIONS The results suggest that the proposed model improves classification accuracy. Therefore, it could be applied effectively in classifying IDC and metastatic cancer in comparison to other state-of-the-art models.
Collapse
Affiliation(s)
- Tobibul Islam
- Department of Biomedical EngineeringMilitary Institute of Science and TechnologyDhakaBangladesh
| | - Md Enamul Hoque
- Department of Biomedical EngineeringMilitary Institute of Science and TechnologyDhakaBangladesh
| | - Mohammad Ullah
- Center for Advance Intelligent MaterialsUniversiti Malaysia PahangKuantanMalaysia
| | - Toufiqul Islam
- Department of SurgeryM Abdur Rahim Medical CollegeDinajpurBangladesh
| | | | - Rabiul Islam
- Department of Electrical and Computer EngineeringTexas A&M UniversityCollege StationTexasUSA
| |
Collapse
|
2
|
Mandair D, Reis-Filho JS, Ashworth A. Biological insights and novel biomarker discovery through deep learning approaches in breast cancer histopathology. NPJ Breast Cancer 2023; 9:21. [PMID: 37024522 PMCID: PMC10079681 DOI: 10.1038/s41523-023-00518-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 02/27/2023] [Indexed: 04/08/2023] Open
Abstract
Breast cancer remains a highly prevalent disease with considerable inter- and intra-tumoral heterogeneity complicating prognostication and treatment decisions. The utilization and depth of genomic, transcriptomic and proteomic data for cancer has exploded over recent times and the addition of spatial context to this information, by understanding the correlating morphologic and spatial patterns of cells in tissue samples, has created an exciting frontier of research, histo-genomics. At the same time, deep learning (DL), a class of machine learning algorithms employing artificial neural networks, has rapidly progressed in the last decade with a confluence of technical developments - including the advent of modern graphic processing units (GPU), allowing efficient implementation of increasingly complex architectures at scale; advances in the theoretical and practical design of network architectures; and access to larger datasets for training - all leading to sweeping advances in image classification and object detection. In this review, we examine recent developments in the application of DL in breast cancer histology with particular emphasis of those producing biologic insights or novel biomarkers, spanning the extraction of genomic information to the use of stroma to predict cancer recurrence, with the aim of suggesting avenues for further advancing this exciting field.
Collapse
Affiliation(s)
- Divneet Mandair
- UCSF Helen Diller Family Comprehensive Cancer Center, San Francisco, CA, 94158, USA
| | | | - Alan Ashworth
- UCSF Helen Diller Family Comprehensive Cancer Center, San Francisco, CA, 94158, USA.
| |
Collapse
|
3
|
Yan W, Tang X, Wang L, He C, Cui X, Yuan S, Zhang H. Applicability analysis of immunotherapy for lung cancer patients based on deep learning. Methods 2022; 205:149-156. [PMID: 35809770 DOI: 10.1016/j.ymeth.2022.07.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 06/27/2022] [Accepted: 07/03/2022] [Indexed: 11/17/2022] Open
Abstract
According to global and Chinese cancer statistics, lung cancer is the second most common cancer globally with the highest mortality rate and a severe threat to human life and health. In recent years, immunotherapy has made significant breakthroughs in the treatment of cancer patients. However, only 30% of patients are applicable and may have immune-related adverse events. The traditional immunological inspection methods have limitations and often can not obtain the expected benefits. Deep learning is a typical representation learning method that can spontaneously mine the hidden feature of effective classification from seas of data. In order to alleviate medical resources and reduce costs, this paper proposes a deep learning-based method to predict patients best suited for immune checkpoint blocking therapy from patients CT images. The deep immunotherapy analysis method proposed in this paper is divided into three steps:(1) Using LUNA16 public dataset to develop a deep learning model for nodule detection. (2) Nodule detection was performed on the Anti-PD-1_Lung dataset, and the effectiveness of immunotherapy was determined by comparing the detection results of nodules before and after immunotherapy. (3) After the data set was processed, the deep learning method trained and analyzed the Lung images. According to the experimental results and comparative analysis, the proposed deep immunotherapy analysis method has a good performance in the detection of nodules. It works for the predictions for the applicability of immunotherapy for lung cancer.1.
Collapse
Affiliation(s)
- Wenjing Yan
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China
| | - Xiao Tang
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China
| | - Lidong Wang
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China
| | - Chao He
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China
| | - Xinran Cui
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China
| | - Shuai Yuan
- College of Software, Jilin University, Changchun 130000, PR China
| | - Hao Zhang
- College of Computer Science and Technology, Jilin University, Jilin 130000, PR China; College of Software, Jilin University, Changchun 130000, PR China.
| |
Collapse
|
4
|
Liew XY, Hameed N, Clos J. A Review of Computer-Aided Expert Systems for Breast Cancer Diagnosis. Cancers (Basel) 2021; 13:2764. [PMID: 34199444 PMCID: PMC8199592 DOI: 10.3390/cancers13112764] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 05/25/2021] [Accepted: 05/28/2021] [Indexed: 11/18/2022] Open
Abstract
A computer-aided diagnosis (CAD) expert system is a powerful tool to efficiently assist a pathologist in achieving an early diagnosis of breast cancer. This process identifies the presence of cancer in breast tissue samples and the distinct type of cancer stages. In a standard CAD system, the main process involves image pre-processing, segmentation, feature extraction, feature selection, classification, and performance evaluation. In this review paper, we reviewed the existing state-of-the-art machine learning approaches applied at each stage involving conventional methods and deep learning methods, the comparisons within methods, and we provide technical details with advantages and disadvantages. The aims are to investigate the impact of CAD systems using histopathology images, investigate deep learning methods that outperform conventional methods, and provide a summary for future researchers to analyse and improve the existing techniques used. Lastly, we will discuss the research gaps of existing machine learning approaches for implementation and propose future direction guidelines for upcoming researchers.
Collapse
Affiliation(s)
- Xin Yu Liew
- Jubilee Campus, University of Nottingham, Wollaton Road, Nottingham NG8 1BB, UK; (N.H.); (J.C.)
| | | | | |
Collapse
|
5
|
Abstract
Histopathological images (HIs) are the gold standard for evaluating some types of tumors for cancer diagnosis. The analysis of such images is time and resource-consuming and very challenging even for experienced pathologists, resulting in inter-observer and intra-observer disagreements. One of the ways of accelerating such an analysis is to use computer-aided diagnosis (CAD) systems. This paper presents a review on machine learning methods for histopathological image analysis, including shallow and deep learning methods. We also cover the most common tasks in HI analysis, such as segmentation and feature extraction. Besides, we present a list of publicly available and private datasets that have been used in HI research.
Collapse
|
6
|
Vellal AD, Sirinukunwattan K, Kensler KH, Baker GM, Stancu AL, Pyle ME, Collins LC, Schnitt SJ, Connolly JL, Veta M, Eliassen AH, Tamimi RM, Heng YJ. Deep Learning Image Analysis of Benign Breast Disease to Identify Subsequent Risk of Breast Cancer. JNCI Cancer Spectr 2021; 5:pkaa119. [PMID: 33644680 PMCID: PMC7898083 DOI: 10.1093/jncics/pkaa119] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 11/04/2020] [Accepted: 12/18/2020] [Indexed: 12/16/2022] Open
Abstract
Background New biomarkers of risk may improve breast cancer (BC) risk prediction. We developed a computational pathology method to segment benign breast disease (BBD) whole slide images into epithelium, fibrous stroma, and fat. We applied our method to the BBD BC nested case-control study within the Nurses' Health Studies to assess whether computer-derived tissue composition or a morphometric signature was associated with subsequent risk of BC. Methods Tissue segmentation and nuclei detection deep-learning networks were established and applied to 3795 whole slide images from 293 cases who developed BC and 1132 controls who did not. Percentages of each tissue region were calculated, and 615 morphometric features were extracted. Elastic net regression was used to create a BC morphometric signature. Associations between BC risk factors and age-adjusted tissue composition among controls were assessed using analysis of covariance. Unconditional logistic regression, adjusting for the matching factors, BBD histological subtypes, parity, menopausal status, and body mass index evaluated the relationship between tissue composition and BC risk. All statistical tests were 2-sided. Results Among controls, direction of associations between BBD subtypes, parity, and number of births with breast composition varied by tissue region; select regions were associated with childhood body size, body mass index, age of menarche, and menopausal status (all P < .05). A higher proportion of epithelial tissue was associated with increased BC risk (odds ratio = 1.39, 95% confidence interval = 0.91 to 2.14, for highest vs lowest quartiles, P trend = .047). No morphometric signature was associated with BC. Conclusions The amount of epithelial tissue may be incorporated into risk assessment models to improve BC risk prediction.
Collapse
Affiliation(s)
- Adithya D Vellal
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Korsuk Sirinukunwattan
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
- Department of Engineering Science, Institute of Biomedical Engineering (IBME), University of Oxford, Oxford, UK
- Big Data Institute, University of Oxford, Li Ka Shing Centre for Health Information and Discovery, Oxford, UK
- NIHR Oxford Biomedical Research Centre, Oxford University NHS Foundation Trust, Oxford, UK
| | - Kevin H Kensler
- Division of Population Sciences, Dana Farber Cancer Institute, Boston, MA, USA
| | - Gabrielle M Baker
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Andreea L Stancu
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Michael E Pyle
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Laura C Collins
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Stuart J Schnitt
- Dana-Farber/Brigham and Women's Cancer Center, Harvard Medical School, Dana-Farber Cancer Institute-Brigham and Women's Hospital, Boston, MA, USA
| | - James L Connolly
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Mitko Veta
- Medical Image Analysis Group, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - A Heather Eliassen
- Channing Division of Network Medicine, Department of Medicine, Harvard Medical School, Brigham and Women's Hospital, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Rulla M Tamimi
- Channing Division of Network Medicine, Department of Medicine, Harvard Medical School, Brigham and Women's Hospital, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA
| | - Yujing J Heng
- Department of Pathology, Harvard Medical School, Beth Israel Deaconess Medical Center, Boston, MA, USA
| |
Collapse
|
7
|
Abstract
Deep learning has pushed the scope of digital pathology beyond simple digitization and telemedicine. The incorporation of these algorithms in routine workflow is on the horizon and maybe a disruptive technology, reducing processing time, and increasing detection of anomalies. While the newest computational methods enjoy much of the press, incorporating deep learning into standard laboratory workflow requires many more steps than simply training and testing a model. Image analysis using deep learning methods often requires substantial pre- and post-processing order to improve interpretation and prediction. Similar to any data processing pipeline, images must be prepared for modeling and the resultant predictions need further processing for interpretation. Examples include artifact detection, color normalization, image subsampling or tiling, removal of errant predictions, etc. Once processed, predictions are complicated by image file size - typically several gigabytes when unpacked. This forces images to be tiled, meaning that a series of subsamples from the whole-slide image (WSI) are used in modeling. Herein, we review many of these methods as they pertain to the analysis of biopsy slides and discuss the multitude of unique issues that are part of the analysis of very large images.
Collapse
|
8
|
Tabu Search and Machine-Learning Classification of Benign and Malignant Proliferative Breast Lesions. BIOMED RESEARCH INTERNATIONAL 2020; 2020:4671349. [PMID: 32258124 PMCID: PMC7064857 DOI: 10.1155/2020/4671349] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Revised: 01/05/2020] [Accepted: 01/22/2020] [Indexed: 11/24/2022]
Abstract
Breast cancer is the most diagnosed cancer among women around the world. The development of computer-aided diagnosis tools is essential to help pathologists to accurately interpret and discriminate between malignant and benign tumors. This paper proposes the development of an automated proliferative breast lesion diagnosis based on machine-learning algorithms. We used Tabu search to select the most significant features. The evaluation of the feature is based on the dependency degree of each attribute in the rough set. The categorization of reduced features was built using five machine-learning algorithms. The proposed models were applied to the BIDMC-MGH and Wisconsin Diagnostic Breast Cancer datasets. The performance measures of the used models were evaluated owing to five criteria. The top performing models were AdaBoost and logistic regression. Comparisons with others works prove the efficiency of the proposed method for superior diagnosis of breast cancer against the reviewed classification techniques.
Collapse
|
9
|
Abstract
MOTIVATION Estimating the future course of patients with cancer lesions is invaluable to physicians; however, current clinical methods fail to effectively use the vast amount of multimodal data that is available for cancer patients. To tackle this problem, we constructed a multimodal neural network-based model to predict the survival of patients for 20 different cancer types using clinical data, mRNA expression data, microRNA expression data and histopathology whole slide images (WSIs). We developed an unsupervised encoder to compress these four data modalities into a single feature vector for each patient, handling missing data through a resilient, multimodal dropout method. Encoding methods were tailored to each data type-using deep highway networks to extract features from clinical and genomic data, and convolutional neural networks to extract features from WSIs. RESULTS We used pancancer data to train these feature encodings and predict single cancer and pancancer overall survival, achieving a C-index of 0.78 overall. This work shows that it is possible to build a pancancer model for prognosis that also predicts prognosis in single cancer sites. Furthermore, our model handles multiple data modalities, efficiently analyzes WSIs and represents patient multimodal data flexibly into an unsupervised, informative representation. We thus present a powerful automated tool to accurately determine prognosis, a key step towards personalized treatment for cancer patients. AVAILABILITY AND IMPLEMENTATION https://github.com/gevaertlab/MultimodalPrognosis.
Collapse
Affiliation(s)
| | - Olivier Gevaert
- Department of Medicine and Biomedical Data Science, Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA, USA
| |
Collapse
|
10
|
Nagpal K, Foote D, Liu Y, Chen PHC, Wulczyn E, Tan F, Olson N, Smith JL, Mohtashamian A, Wren JH, Corrado GS, MacDonald R, Peng LH, Amin MB, Evans AJ, Sangoi AR, Mermel CH, Hipp JD, Stumpe MC. Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. NPJ Digit Med 2019; 2:48. [PMID: 31304394 PMCID: PMC6555810 DOI: 10.1038/s41746-019-0112-2] [Citation(s) in RCA: 167] [Impact Index Per Article: 33.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 04/15/2019] [Indexed: 12/20/2022] Open
Abstract
For prostate cancer patients, the Gleason score is one of the most important prognostic factors, potentially determining treatment independent of the stage. However, Gleason scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility. Here we present a deep learning system (DLS) for Gleason scoring whole-slide images of prostatectomies. Our system was developed using 112 million pathologist-annotated image patches from 1226 slides, and evaluated on an independent validation dataset of 331 slides. Compared to a reference standard provided by genitourinary pathology experts, the mean accuracy among 29 general pathologists was 0.61 on the validation set. The DLS achieved a significantly higher diagnostic accuracy of 0.70 (p = 0.002) and trended towards better patient risk stratification in correlations to clinical follow-up data. Our approach could improve the accuracy of Gleason scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. The DLS also goes beyond the current Gleason system to more finely characterize and quantitate tumor morphology, providing opportunities for refinement of the Gleason system itself.
Collapse
Affiliation(s)
- Kunal Nagpal
- Google AI Healthcare, Google, Mountain View, CA USA
| | - Davis Foote
- Google AI Healthcare, Google, Mountain View, CA USA
| | - Yun Liu
- Google AI Healthcare, Google, Mountain View, CA USA
| | | | | | - Fraser Tan
- Google AI Healthcare, Google, Mountain View, CA USA
| | - Niels Olson
- Laboratory Department, Naval Medical Center San Diego, San Diego, CA USA
| | - Jenny L. Smith
- Laboratory Department, Naval Medical Center San Diego, San Diego, CA USA
| | - Arash Mohtashamian
- Laboratory Department, Naval Medical Center San Diego, San Diego, CA USA
| | | | | | | | - Lily H. Peng
- Google AI Healthcare, Google, Mountain View, CA USA
| | - Mahul B. Amin
- Department of Pathology and Laboratory Medicine, University of Tennessee Health Science Center, Memphis, TN USA
| | - Andrew J. Evans
- Department of Pathology, Laboratory Medicine and Pathology, University Health Network and University of Toronto, Toronto, ON Canada
| | - Ankur R. Sangoi
- Department of Pathology, El Camino Hospital, Mountain View, CA USA
| | | | | | - Martin C. Stumpe
- Google AI Healthcare, Google, Mountain View, CA USA
- Present Address: AI and Data Science, Tempus Labs Inc, Chicago, United States
| |
Collapse
|
11
|
Syed S, Al-Boni M, Khan MN, Sadiq K, Iqbal NT, Moskaluk CA, Kelly P, Amadi B, Ali SA, Moore SR, Brown DE. Assessment of Machine Learning Detection of Environmental Enteropathy and Celiac Disease in Children. JAMA Netw Open 2019; 2:e195822. [PMID: 31199451 PMCID: PMC6575155 DOI: 10.1001/jamanetworkopen.2019.5822] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2019] [Accepted: 04/30/2019] [Indexed: 12/16/2022] Open
Abstract
Importance Duodenal biopsies from children with enteropathies associated with undernutrition, such as environmental enteropathy (EE) and celiac disease (CD), display significant histopathological overlap. Objective To develop a convolutional neural network (CNN) to enhance the detection of pathologic morphological features in diseased vs healthy duodenal tissue. Design, Setting, and Participants In this prospective diagnostic study, a CNN consisting of 4 convolutions, 1 fully connected layer, and 1 softmax layer was trained on duodenal biopsy images. Data were provided by 3 sites: Aga Khan University Hospital, Karachi, Pakistan; University Teaching Hospital, Lusaka, Zambia; and University of Virginia, Charlottesville. Duodenal biopsy slides from 102 children (10 with EE from Aga Khan University Hospital, 16 with EE from University Teaching Hospital, 34 with CD from University of Virginia, and 42 with no disease from University of Virginia) were converted into 3118 images. The CNN was designed and analyzed at the University of Virginia. The data were collected, prepared, and analyzed between November 2017 and February 2018. Main Outcomes and Measures Classification accuracy of the CNN per image and per case and incorrect classification rate identified by aggregated 10-fold cross-validation confusion/error matrices of CNN models. Results Overall, 102 children participated in this study, with a median (interquartile range) age of 31.0 (20.3-75.5) months and a roughly equal sex distribution, with 53 boys (51.9%). The model demonstrated 93.4% case-detection accuracy and had a false-negative rate of 2.4%. Confusion metrics indicated most incorrect classifications were between patients with CD and healthy patients. Feature map activations were visualized and learned distinctive patterns, including microlevel features in duodenal tissues, such as alterations in secretory cell populations. Conclusions and Relevance A machine learning-based histopathological analysis model demonstrating 93.4% classification accuracy was developed for identifying and differentiating between duodenal biopsies from children with EE and CD. The combination of the CNN with a deconvolutional network enabled feature recognition and highlighted secretory cells' role in the model's ability to differentiate between these histologically similar diseases.
Collapse
Affiliation(s)
- Sana Syed
- Division of Pediatric Gastroenterology and Hepatology, Department of Pediatrics, University of Virginia, Charlottesville
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | - Mohammad Al-Boni
- Systems and Information Engineering, University of Virginia, Charlottesville
| | - Marium N. Khan
- Division of Pediatric Gastroenterology and Hepatology, Department of Pediatrics, University of Virginia, Charlottesville
| | - Kamran Sadiq
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | - Najeeha T. Iqbal
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | | | - Paul Kelly
- Blizard Institute, Barts and The London School of Medicine, Queen Mary University of London, London, United Kingdom
- Tropical Gastroenterology and Nutrition Group, University of Zambia School of Medicine, Lusaka, Zambia
| | - Beatrice Amadi
- Tropical Gastroenterology and Nutrition Group, University of Zambia School of Medicine, Lusaka, Zambia
| | - S. Asad Ali
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | - Sean R. Moore
- Division of Pediatric Gastroenterology and Hepatology, Department of Pediatrics, University of Virginia, Charlottesville
| | - Donald E. Brown
- Data Science Institute, University of Virginia, Charlottesville
| |
Collapse
|
12
|
Abram TJ, Floriano PN, James R, Kerr AR, Thornhill MH, Redding SW, Vigneswaran N, Raja R, McRae MP, McDevitt JT. Development of a cytology-based multivariate analytical risk index for oral cancer. Oral Oncol 2019; 92:6-11. [PMID: 31010626 DOI: 10.1016/j.oraloncology.2019.02.011] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2018] [Revised: 12/18/2018] [Accepted: 02/11/2019] [Indexed: 12/14/2022]
Abstract
OBJECTIVES The diagnosis and management of oral cavity cancers are often complicated by the uncertainty of which patients will undergo malignant transformation, obligating close surveillance over time. However, serial biopsies are undesirable, highly invasive, and subject to inherent issues with poor inter-pathologist agreement and unpredictability as a surrogate for malignant transformation and clinical outcomes. The goal of this study was to develop and evaluate a Multivariate Analytical Risk Index for Oral Cancer (MARIO) with potential to provide non-invasive, sensitive, and quantitative risk assessments for monitoring lesion progression. MATERIALS AND METHODS A series of predictive models were developed and validated using previously recorded single-cell data from oral cytology samples resulting in a "continuous risk score". Model development consisted of: (1) training base classification models for each diagnostic class pair, (2) pairwise coupling to obtain diagnostic class probabilities, and (3) a weighted aggregation resulting in a continuous MARIO. RESULTS AND CONCLUSIONS Diagnostic accuracy based on optimized cut-points for the test dataset ranged from 76.0% for Benign, to 82.4% for Dysplastic, 89.6% for Malignant, and 97.6% for Normal controls for an overall MARIO accuracy of 72.8%. Furthermore, a strong positive relationship with diagnostic severity was demonstrated (Pearson's coefficient = 0.805 for test dataset) as well as the ability of the MARIO to respond to subtle changes in cell composition. The development of a continuous MARIO for PMOL is presented, resulting in a sensitive, accurate, and non-invasive method with potential for enabling monitoring disease progression, recurrence, and the need for therapeutic intervention of these lesions.
Collapse
Affiliation(s)
- Timothy J Abram
- Rice University, Department of Bioengineering, Houston, TX, USA
| | - Pierre N Floriano
- Rice University, Department of Bioengineering, Houston, TX, USA; NeoTherma Oncology, Houston, TX, USA
| | | | - A Ross Kerr
- New York University College of Dentistry, Department of Oral and Maxillofacial Pathology, Radiology & Medicine, New York, NY, USA
| | - Martin H Thornhill
- Department of Oral & Maxillofacial Medicine, Surgery and Pathology, School of Clinical Dentistry, University of Sheffield, Sheffield, UK
| | - Spencer W Redding
- The University of Texas Health Science Center at San Antonio, Department of Comprehensive Dentistry and Mays Cancer Center, San Antonio, TX, USA
| | - Nadarajah Vigneswaran
- The University of Texas Health Science Center at Houston, Department of Diagnostic and Biomedical Sciences, Houston, TX, USA
| | - Rameez Raja
- Rice University, Department of Bioengineering, Houston, TX, USA
| | - Michael P McRae
- Rice University, Department of Bioengineering, Houston, TX, USA; Department of Biomaterials, Bioengineering Institute, New York University, 433 First Avenue, Room 820, New York, NY 10010-4086, USA
| | - John T McDevitt
- Rice University, Department of Bioengineering, Houston, TX, USA; Department of Biomaterials, Bioengineering Institute, New York University, 433 First Avenue, Room 820, New York, NY 10010-4086, USA.
| |
Collapse
|
13
|
Ehteshami Bejnordi B, Mullooly M, Pfeiffer RM, Fan S, Vacek PM, Weaver DL, Herschorn S, Brinton LA, van Ginneken B, Karssemeijer N, Beck AH, Gierach GL, van der Laak JAWM, Sherman ME. Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies. Mod Pathol 2018; 31:1502-1512. [PMID: 29899550 PMCID: PMC6752036 DOI: 10.1038/s41379-018-0073-z] [Citation(s) in RCA: 108] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2017] [Revised: 04/04/2018] [Accepted: 04/08/2018] [Indexed: 12/21/2022]
Abstract
The breast stromal microenvironment is a pivotal factor in breast cancer development, growth and metastases. Although pathologists often detect morphologic changes in stroma by light microscopy, visual classification of such changes is subjective and non-quantitative, limiting its diagnostic utility. To gain insights into stromal changes associated with breast cancer, we applied automated machine learning techniques to digital images of 2387 hematoxylin and eosin stained tissue sections of benign and malignant image-guided breast biopsies performed to investigate mammographic abnormalities among 882 patients, ages 40-65 years, that were enrolled in the Breast Radiology Evaluation and Study of Tissues (BREAST) Stamp Project. Using deep convolutional neural networks, we trained an algorithm to discriminate between stroma surrounding invasive cancer and stroma from benign biopsies. In test sets (928 whole-slide images from 330 patients), this algorithm could distinguish biopsies diagnosed as invasive cancer from benign biopsies solely based on the stromal characteristics (area under the receiver operator characteristics curve = 0.962). Furthermore, without being trained specifically using ductal carcinoma in situ as an outcome, the algorithm detected tumor-associated stroma in greater amounts and at larger distances from grade 3 versus grade 1 ductal carcinoma in situ. Collectively, these results suggest that algorithms based on deep convolutional neural networks that evaluate only stroma may prove useful to classify breast biopsies and aid in understanding and evaluating the biology of breast lesions.
Collapse
Affiliation(s)
- Babak Ehteshami Bejnordi
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Maeve Mullooly
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD, USA
- Cancer Prevention Fellowship Program, Division of Cancer Prevention, National Cancer Institute, Bethesda, MD, USA
| | - Ruth M Pfeiffer
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD, USA
| | - Shaoqi Fan
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD, USA
| | - Pamela M Vacek
- Department of Medical Biostatistics, University of Vermont, Burlington, VT, USA
| | - Donald L Weaver
- Department of Pathology, University of Vermont, Burlington, VT, USA
| | - Sally Herschorn
- University of Vermont Cancer Center, Burlington, VT, USA
- Department of Radiology, University of Vermont, Burlington, VT, USA
| | - Louise A Brinton
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD, USA
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Nico Karssemeijer
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Andrew H Beck
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
- PathAI, Inc., Cambridge, MA, USA
| | - Gretchen L Gierach
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD, USA
| | - Jeroen A W M van der Laak
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands.
- Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands.
| | | |
Collapse
|
14
|
Dalmış MU, Vreemann S, Kooi T, Mann RM, Karssemeijer N, Gubern-Mérida A. Fully automated detection of breast cancer in screening MRI using convolutional neural networks. J Med Imaging (Bellingham) 2018; 5:014502. [PMID: 29340287 PMCID: PMC5763014 DOI: 10.1117/1.jmi.5.1.014502] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2017] [Accepted: 12/18/2017] [Indexed: 11/14/2022] Open
Abstract
Current computer-aided detection (CADe) systems for contrast-enhanced breast MRI rely on both spatial information obtained from the early-phase and temporal information obtained from the late-phase of the contrast enhancement. However, late-phase information might not be available in a screening setting, such as in abbreviated MRI protocols, where acquisition is limited to early-phase scans. We used deep learning to develop a CADe system that exploits the spatial information obtained from the early-phase scans. This system uses three-dimensional (3-D) morphological information in the candidate locations and the symmetry information arising from the enhancement differences of the two breasts. We compared the proposed system to a previously developed system, which uses the full dynamic breast MRI protocol. For training and testing, we used 385 MRI scans, containing 161 malignant lesions. Performance was measured by averaging the sensitivity values between 1/8-eight false positives. In our experiments, the proposed system obtained a significantly ([Formula: see text]) higher average sensitivity ([Formula: see text]) compared with that of the previous CADe system ([Formula: see text]). In conclusion, we developed a CADe system that is able to exploit the spatial information obtained from the early-phase scans and can be used in screening programs where abbreviated MRI protocols are used.
Collapse
Affiliation(s)
- Mehmet Ufuk Dalmış
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| | - Suzan Vreemann
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| | - Thijs Kooi
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| | - Ritse M. Mann
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| | - Nico Karssemeijer
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| | - Albert Gubern-Mérida
- Radboud University Medical Center (RadboudUMC), Diagnostic Image Analysis Group (DIAG) Nijmegen, The Netherlands
| |
Collapse
|
15
|
Bejnordi BE, Zuidhof G, Balkenhol M, Hermsen M, Bult P, van Ginneken B, Karssemeijer N, Litjens G, van der Laak J. Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images. J Med Imaging (Bellingham) 2017; 4:044504. [PMID: 29285517 PMCID: PMC5729919 DOI: 10.1117/1.jmi.4.4.044504] [Citation(s) in RCA: 87] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2017] [Accepted: 11/14/2017] [Indexed: 12/31/2022] Open
Abstract
Currently, histopathological tissue examination by a pathologist represents the gold standard for breast lesion diagnostics. Automated classification of histopathological whole-slide images (WSIs) is challenging owing to the wide range of appearances of benign lesions and the visual similarity of ductal carcinoma in-situ (DCIS) to invasive lesions at the cellular level. Consequently, analysis of tissue at high resolutions with a large contextual area is necessary. We present context-aware stacked convolutional neural networks (CNN) for classification of breast WSIs into normal/benign, DCIS, and invasive ductal carcinoma (IDC). We first train a CNN using high pixel resolution to capture cellular level information. The feature responses generated by this model are then fed as input to a second CNN, stacked on top of the first. Training of this stacked architecture with large input patches enables learning of fine-grained (cellular) details and global tissue structures. Our system is trained and evaluated on a dataset containing 221 WSIs of hematoxylin and eosin stained breast tissue specimens. The system achieves an AUC of 0.962 for the binary classification of nonmalignant and malignant slides and obtains a three-class accuracy of 81.3% for classification of WSIs into normal/benign, DCIS, and IDC, demonstrating its potential for routine diagnostics.
Collapse
Affiliation(s)
- Babak Ehteshami Bejnordi
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Guido Zuidhof
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| | - Maschenka Balkenhol
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| | - Meyke Hermsen
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| | - Peter Bult
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| | - Bram van Ginneken
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Nico Karssemeijer
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
| | - Geert Litjens
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| | - Jeroen van der Laak
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Nijmegen, The Netherlands
- Radboud University Medical Center, Diagnostic Image Analysis Group, Department of Pathology, Nijmegen, The Netherlands
| |
Collapse
|