1
|
Zamojski D, Gogler A, Scieglinska D, Marczyk M. EpidermaQuant: Unsupervised Detection and Quantification of Epidermal Differentiation Markers on H-DAB-Stained Images of Reconstructed Human Epidermis. Diagnostics (Basel) 2024; 14:1904. [PMID: 39272688 PMCID: PMC11394256 DOI: 10.3390/diagnostics14171904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Revised: 08/22/2024] [Accepted: 08/27/2024] [Indexed: 09/15/2024] Open
Abstract
The integrity of the reconstructed human epidermis generated in vitro can be assessed using histological analyses combined with immunohistochemical staining of keratinocyte differentiation markers. Technical differences during the preparation and capture of stained images may influence the outcome of computational methods. Due to the specific nature of the analyzed material, no annotated datasets or dedicated methods are publicly available. Using a dataset with 598 unannotated images showing cross-sections of in vitro reconstructed human epidermis stained with DAB-based immunohistochemistry reaction to visualize four different keratinocyte differentiation marker proteins (filaggrin, keratin 10, Ki67, HSPA2) and counterstained with hematoxylin, we developed an unsupervised method for the detection and quantification of immunohistochemical staining. The pipeline consists of the following steps: (i) color normalization; (ii) color deconvolution; (iii) morphological operations; (iv) automatic image rotation; and (v) clustering. The most effective combination of methods includes (i) Reinhard's normalization; (ii) Ruifrok and Johnston color-deconvolution method; (iii) proposed image-rotation method based on boundary distribution of image intensity; and (iv) k-means clustering. The results of the work should enhance the performance of quantitative analyses of protein markers in reconstructed human epidermis samples and enable the comparison of their spatial distribution between different experimental conditions.
Collapse
Affiliation(s)
- Dawid Zamojski
- Department of Data Science and Engineering, Silesian University of Technology, 44-100 Gliwice, Poland
- Genetic Laboratory, Gyncentrum Sp. z o.o., 41-208 Sosnowiec, Poland
| | - Agnieszka Gogler
- Center for Translational Research and Molecular Biology of Cancer, Maria Sklodowska-Curie National Research Institute of Oncology Gliwice Branch, 44-102 Gliwice, Poland
| | - Dorota Scieglinska
- Center for Translational Research and Molecular Biology of Cancer, Maria Sklodowska-Curie National Research Institute of Oncology Gliwice Branch, 44-102 Gliwice, Poland
| | - Michal Marczyk
- Department of Data Science and Engineering, Silesian University of Technology, 44-100 Gliwice, Poland
- Yale Cancer Center, Yale School of Medicine, New Haven, CT 06510, USA
| |
Collapse
|
2
|
Poalelungi DG, Neagu AI, Fulga A, Neagu M, Tutunaru D, Nechita A, Fulga I. Revolutionizing Pathology with Artificial Intelligence: Innovations in Immunohistochemistry. J Pers Med 2024; 14:693. [PMID: 39063947 PMCID: PMC11278211 DOI: 10.3390/jpm14070693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Revised: 06/25/2024] [Accepted: 06/26/2024] [Indexed: 07/28/2024] Open
Abstract
Artificial intelligence (AI) is a reality of our times, and it has been successfully implemented in all fields, including medicine. As a relatively new domain, all efforts are directed towards creating algorithms applicable in most medical specialties. Pathology, as one of the most important areas of interest for precision medicine, has received significant attention in the development and implementation of AI algorithms. This focus is especially important for achieving accurate diagnoses. Moreover, immunohistochemistry (IHC) serves as a complementary diagnostic tool in pathology. It can be further augmented through the application of deep learning (DL) and machine learning (ML) algorithms for assessing and analyzing immunohistochemical markers. Such advancements can aid in delineating targeted therapeutic approaches and prognostic stratification. This article explores the applications and integration of various AI software programs and platforms used in immunohistochemical analysis. It concludes by highlighting the application of these technologies to pathologies such as breast, prostate, lung, melanocytic proliferations, and hematologic conditions. Additionally, it underscores the necessity for further innovative diagnostic algorithms to assist physicians in the diagnostic process.
Collapse
Affiliation(s)
- Diana Gina Poalelungi
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei St., 800578 Galati, Romania
| | - Anca Iulia Neagu
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint John Clinical Emergency Hospital for Children, 800487 Galati, Romania
| | - Ana Fulga
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei St., 800578 Galati, Romania
| | - Marius Neagu
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei St., 800578 Galati, Romania
| | - Dana Tutunaru
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei St., 800578 Galati, Romania
| | - Aurel Nechita
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint John Clinical Emergency Hospital for Children, 800487 Galati, Romania
| | - Iuliu Fulga
- Faculty of Medicine and Pharmacy, Dunarea de Jos University of Galati, 35 AI Cuza St., 800010 Galati, Romania; (D.G.P.); (M.N.); (D.T.); (A.N.); (I.F.)
- Saint Apostle Andrew Emergency County Clinical Hospital, 177 Brailei St., 800578 Galati, Romania
| |
Collapse
|
3
|
Sun H, Kang EY, Chen H, Sweeney KJ, Suchko M, Wu Y, Wen J, Krishnamurthy S, Albarracin CT, Ding QQ, Foo WC, Sahin AA. Immunohistochemical assessment of HER2 low breast cancer: interobserver reproducibility and correlation with digital image analysis. Breast Cancer Res Treat 2024; 205:403-411. [PMID: 38441847 DOI: 10.1007/s10549-024-07256-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 01/18/2024] [Indexed: 05/19/2024]
Abstract
PURPOSE The recent findings from the DESTINY-Breast04 trial highlighted the clinical importance of distinguishing between HER2 immunohistochemistry (IHC) scores 0 and 1 + in metastatic breast cancer (BC). However, pathologist interpretation of HER2 IHC scoring is subjective, and standardized methodology is needed. We evaluated the consistency of HER2 IHC scoring among pathologists and the accuracy of digital image analysis (DIA) in interpreting HER2 IHC staining in cases of HER2-low BC. METHODS Fifty whole-slide biopsies of BC with HER2 IHC staining were evaluated, comprising 25 cases originally reported as IHC score 0 and 25 as 1 +. These slides were digitally scanned. Six pathologists with breast expertise independently reviewed and scored the scanned images, and DIA was applied. Agreement among pathologists and concordance between pathologist scores and DIA results were statistically analyzed using Kendall coefficient of concordance (W) tests. RESULTS Substantial agreement among at least five of the six pathologists was found for 18 of the score 0 cases (72%) and 15 of the score 1 + cases (60%), indicating excellent interobserver agreement (W = 0.828). DIA scores were highly concordant with pathologist scores in 96% of cases (47/49), indicating excellent concordance (W = 0.959). CONCLUSION Although breast subspecialty pathologists were relatively consistent in evaluating BC with HER2 IHC scores of 0 and 1 +, DIA may be a reliable supplementary tool to enhance the standardization and quantification of HER2 IHC assessment, especially in challenging cases where results may be ambiguous (i.e., scores 0-1 +). These findings hold promise for improving the accuracy and consistency of HER2 testing.
Collapse
Affiliation(s)
- Hongxia Sun
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Eun Young Kang
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Hui Chen
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Keith J Sweeney
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Michael Suchko
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Yun Wu
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Jianguo Wen
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Savitri Krishnamurthy
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Constance T Albarracin
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Qing-Qing Ding
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Wai Chin Foo
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA
| | - Aysegul A Sahin
- Department of Pathology, Unit 85, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX, USA.
| |
Collapse
|
4
|
Ivanova M, Pescia C, Trapani D, Venetis K, Frascarelli C, Mane E, Cursano G, Sajjadi E, Scatena C, Cerbelli B, d’Amati G, Porta FM, Guerini-Rocco E, Criscitiello C, Curigliano G, Fusco N. Early Breast Cancer Risk Assessment: Integrating Histopathology with Artificial Intelligence. Cancers (Basel) 2024; 16:1981. [PMID: 38893102 PMCID: PMC11171409 DOI: 10.3390/cancers16111981] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Revised: 05/13/2024] [Accepted: 05/17/2024] [Indexed: 06/21/2024] Open
Abstract
Effective risk assessment in early breast cancer is essential for informed clinical decision-making, yet consensus on defining risk categories remains challenging. This paper explores evolving approaches in risk stratification, encompassing histopathological, immunohistochemical, and molecular biomarkers alongside cutting-edge artificial intelligence (AI) techniques. Leveraging machine learning, deep learning, and convolutional neural networks, AI is reshaping predictive algorithms for recurrence risk, thereby revolutionizing diagnostic accuracy and treatment planning. Beyond detection, AI applications extend to histological subtyping, grading, lymph node assessment, and molecular feature identification, fostering personalized therapy decisions. With rising cancer rates, it is crucial to implement AI to accelerate breakthroughs in clinical practice, benefiting both patients and healthcare providers. However, it is important to recognize that while AI offers powerful automation and analysis tools, it lacks the nuanced understanding, clinical context, and ethical considerations inherent to human pathologists in patient care. Hence, the successful integration of AI into clinical practice demands collaborative efforts between medical experts and computational pathologists to optimize patient outcomes.
Collapse
Affiliation(s)
- Mariia Ivanova
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Carlo Pescia
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Dario Trapani
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Konstantinos Venetis
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Chiara Frascarelli
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Eltjona Mane
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Giulia Cursano
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Elham Sajjadi
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Cristian Scatena
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy;
| | - Bruna Cerbelli
- Department of Medical-Surgical Sciences and Biotechnologies, Sapienza University of Rome, 00185 Rome, Italy;
| | - Giulia d’Amati
- Department of Radiological, Oncological and Pathological Sciences, Sapienza University of Rome, 00185 Rome, Italy;
| | - Francesca Maria Porta
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
| | - Elena Guerini-Rocco
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Carmen Criscitiello
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Giuseppe Curigliano
- Division of New Drugs and Early Drug Development for Innovative Therapies, European Institute of Oncology IRCCS, 20141 Milan, Italy; (D.T.); (C.C.); (G.C.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| | - Nicola Fusco
- Division of Pathology, European Institute of Oncology IRCCS, 20141 Milan, Italy; (M.I.); (C.P.); (K.V.); (C.F.); (E.M.); (G.C.); (E.S.); (F.M.P.); (E.G.-R.)
- Department of Oncology and Hemato-Oncology, University of Milan, 20122 Milan, Italy
| |
Collapse
|
5
|
Wang J, Xia YC, Tian BX, Li JT, Li HY, Dong H, Li XG, Yu H, Zhu YY, Ma J, Jiang YJ, Jin GZ. Novel quantitative immunohistochemistry method using histone H3, family 3B as the internal reference standard for measuring human epidermal growth factor receptor 2 expression in breast cancer. Cancer 2024; 130:1424-1434. [PMID: 38217532 DOI: 10.1002/cncr.35176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 11/09/2023] [Accepted: 11/14/2023] [Indexed: 01/15/2024]
Abstract
BACKGROUND Immunohistochemistry (IHC) is an essential technique in surgical and clinical pathology for detecting diagnostic, prognostic, and predictive biomarkers for personalized cancer therapy. However, the lack of standardization and reference controls results in poor reproducibility, and a reliable tool for IHC quantification is urgently required. The objective of this study was to describe a novel approach in which H3F3B (histone H3, family 3B) can be used as an internal reference standard to quantify protein expression levels using IHC. METHODS The authors enrolled 89 patients who had human epidermal growth factor receptor 2 (HER2)-positive breast cancer (BC). They used a novel IHC-based assay to measure protein expression using H3F3B as the internal reference standard. H3F3B was uniformly expressed at the protein level in all tumor regions in cancer tissues. HER2 expression levels were measured with the H-score using HALO software. RESULTS Kaplan-Meier analysis indicated that, among patients who had HER2-positive BC in The Cancer Genome Atlas data set and the authors' data set, the subgroup with low HER2 expression had a significantly better prognosis than the subgroup with high HER2 expression. Furthermore, the authors observed that HER2 expression levels were precisely evaluated using the proposed method, which can classify patients who are at higher risk of HER2-positive BC to receive trastuzumab-based adjuvant therapy. Dual-color IHC with H3F3B is an excellent tool for internal and external quality control of HER2 expression assays. CONCLUSIONS The proposed IHC-based quantification method accurately assesses HER2 expression levels and provides insights for predicting clinical prognosis in patients with HER2-positive BC who receive trastuzumab-based adjuvant therapy.
Collapse
Affiliation(s)
- Jie Wang
- Department of Breast Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ye-Chen Xia
- Hongqiao International Institute of Medicine, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Bao-Xing Tian
- Department of Breast Surgery, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ju-Tang Li
- Department of Obstetrics and Gynecology, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Heng-Yu Li
- Department of Thyroid and Breast Surgery, Changhai Hospital, Naval Military Medical University, Shanghai, China
| | - Hui Dong
- Department of Pathology, Eastern Hepatobiliary Surgery Hospital, Second Military Medical University, Shanghai, China
| | - Xiao-Guang Li
- Department of General Surgery, Shanghai Fourth People's Hospital Affiliated to Tongji University School of Medicine, Shanghai, China
| | - Hua Yu
- Department of Pathology, Eastern Hepatobiliary Surgery Hospital, Second Military Medical University, Shanghai, China
| | - Yu-Yao Zhu
- Department of Pathology, Eastern Hepatobiliary Surgery Hospital, Second Military Medical University, Shanghai, China
| | - Jun Ma
- Department of General Practitioners, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ying-Jie Jiang
- Department of Pathology, Changhai Hospital, Naval Military Medical University, Shanghai, China
| | - Guang-Zhi Jin
- Department of Pathology, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Department of Interventional Radiology, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
6
|
Jung M, Song SG, Cho SI, Shin S, Lee T, Jung W, Lee H, Park J, Song S, Park G, Song H, Park S, Lee J, Kang M, Park J, Pereira S, Yoo D, Chung K, Ali SM, Kim SW. Augmented interpretation of HER2, ER, and PR in breast cancer by artificial intelligence analyzer: enhancing interobserver agreement through a reader study of 201 cases. Breast Cancer Res 2024; 26:31. [PMID: 38395930 PMCID: PMC10885430 DOI: 10.1186/s13058-024-01784-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 02/11/2024] [Indexed: 02/25/2024] Open
Abstract
BACKGROUND Accurate classification of breast cancer molecular subtypes is crucial in determining treatment strategies and predicting clinical outcomes. This classification largely depends on the assessment of human epidermal growth factor receptor 2 (HER2), estrogen receptor (ER), and progesterone receptor (PR) status. However, variability in interpretation among pathologists pose challenges to the accuracy of this classification. This study evaluates the role of artificial intelligence (AI) in enhancing the consistency of these evaluations. METHODS AI-powered HER2 and ER/PR analyzers, consisting of cell and tissue models, were developed using 1,259 HER2, 744 ER, and 466 PR-stained immunohistochemistry (IHC) whole-slide images of breast cancer. External validation cohort comprising HER2, ER, and PR IHCs of 201 breast cancer cases were analyzed with these AI-powered analyzers. Three board-certified pathologists independently assessed these cases without AI annotation. Then, cases with differing interpretations between pathologists and the AI analyzer were revisited with AI assistance, focusing on evaluating the influence of AI assistance on the concordance among pathologists during the revised evaluation compared to the initial assessment. RESULTS Reevaluation was required in 61 (30.3%), 42 (20.9%), and 80 (39.8%) of HER2, in 15 (7.5%), 17 (8.5%), and 11 (5.5%) of ER, and in 26 (12.9%), 24 (11.9%), and 28 (13.9%) of PR evaluations by the pathologists, respectively. Compared to initial interpretations, the assistance of AI led to a notable increase in the agreement among three pathologists on the status of HER2 (from 49.3 to 74.1%, p < 0.001), ER (from 93.0 to 96.5%, p = 0.096), and PR (from 84.6 to 91.5%, p = 0.006). This improvement was especially evident in cases of HER2 2+ and 1+, where the concordance significantly increased from 46.2 to 68.4% and from 26.5 to 70.7%, respectively. Consequently, a refinement in the classification of breast cancer molecular subtypes (from 58.2 to 78.6%, p < 0.001) was achieved with AI assistance. CONCLUSIONS This study underscores the significant role of AI analyzers in improving pathologists' concordance in the classification of breast cancer molecular subtypes.
Collapse
Affiliation(s)
- Minsun Jung
- Department of Pathology, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Seung Geun Song
- Department of Pathology, Seoul National University College of Medicine, Seoul, Republic of Korea
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - So-Woon Kim
- Department of Pathology, Kyung Hee University Hospital, Kyung Hee University College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
7
|
Soliman A, Li Z, Parwani AV. Artificial intelligence's impact on breast cancer pathology: a literature review. Diagn Pathol 2024; 19:38. [PMID: 38388367 PMCID: PMC10882736 DOI: 10.1186/s13000-024-01453-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 01/26/2024] [Indexed: 02/24/2024] Open
Abstract
This review discusses the profound impact of artificial intelligence (AI) on breast cancer (BC) diagnosis and management within the field of pathology. It examines the various applications of AI across diverse aspects of BC pathology, highlighting key findings from multiple studies. Integrating AI into routine pathology practice stands to improve diagnostic accuracy, thereby contributing to reducing avoidable errors. Additionally, AI has excelled in identifying invasive breast tumors and lymph node metastasis through its capacity to process large whole-slide images adeptly. Adaptive sampling techniques and powerful convolutional neural networks mark these achievements. The evaluation of hormonal status, which is imperative for BC treatment choices, has also been enhanced by AI quantitative analysis, aiding interobserver concordance and reliability. Breast cancer grading and mitotic count evaluation also benefit from AI intervention. AI-based frameworks effectively classify breast carcinomas, even for moderately graded cases that traditional methods struggle with. Moreover, AI-assisted mitotic figures quantification surpasses manual counting in precision and sensitivity, fostering improved prognosis. The assessment of tumor-infiltrating lymphocytes in triple-negative breast cancer using AI yields insights into patient survival prognosis. Furthermore, AI-powered predictions of neoadjuvant chemotherapy response demonstrate potential for streamlining treatment strategies. Addressing limitations, such as preanalytical variables, annotation demands, and differentiation challenges, is pivotal for realizing AI's full potential in BC pathology. Despite the existing hurdles, AI's multifaceted contributions to BC pathology hold great promise, providing enhanced accuracy, efficiency, and standardization. Continued research and innovation are crucial for overcoming obstacles and fully harnessing AI's transformative capabilities in breast cancer diagnosis and assessment.
Collapse
Affiliation(s)
- Amr Soliman
- Department of Pathology, Ohio State University, Columbus, OH, USA
| | - Zaibo Li
- Department of Pathology, Ohio State University, Columbus, OH, USA
| | - Anil V Parwani
- Department of Pathology, Ohio State University, Columbus, OH, USA.
| |
Collapse
|
8
|
Zilenaite-Petrulaitiene D, Rasmusson A, Besusparis J, Valkiuniene RB, Augulis R, Laurinaviciene A, Plancoulaine B, Petkevicius L, Laurinavicius A. Intratumoral heterogeneity of Ki67 proliferation index outperforms conventional immunohistochemistry prognostic factors in estrogen receptor-positive HER2-negative breast cancer. Virchows Arch 2024:10.1007/s00428-024-03737-4. [PMID: 38217716 DOI: 10.1007/s00428-024-03737-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2023] [Revised: 12/27/2023] [Accepted: 01/04/2024] [Indexed: 01/15/2024]
Abstract
In breast cancer (BC), pathologists visually score ER, PR, HER2, and Ki67 biomarkers to assess tumor properties and predict patient outcomes. This does not systematically account for intratumoral heterogeneity (ITH) which has been reported to provide prognostic value. This study utilized digital image analysis (DIA) and computational pathology methods to investigate the prognostic value of ITH indicators in ER-positive (ER+) HER2-negative (HER2-) BC patients. Whole slide images (WSIs) of surgically excised specimens stained for ER, PR, Ki67, and HER2 from 254 patients were used. DIA with tumor tissue segmentation and detection of biomarker-positive cells was performed. The DIA-generated data were subsampled by a hexagonal grid to compute Haralick's texture indicators for ER, PR, and Ki67. Cox regression analyses were performed to assess the prognostic significance of the immunohistochemistry (IHC) and ITH indicators in the context of clinicopathologic variables. In multivariable analysis, the ITH of Ki67-positive cells, measured by Haralick's texture entropy, emerged as an independent predictor of worse BC-specific survival (BCSS) (hazard ratio (HR) = 2.64, p-value = 0.0049), along with lymph node involvement (HR = 2.26, p-value = 0.0195). Remarkably, the entropy representing the spatial disarrangement of tumor proliferation outperformed the proliferation rate per se established either by pathology reports or DIA. We conclude that the Ki67 entropy indicator enables a more comprehensive risk assessment with regard to BCSS, especially in cases with borderline Ki67 proliferation rates. The study further demonstrates the benefits of high-capacity DIA-generated data for quantifying the essentially subvisual ITH properties.
Collapse
Affiliation(s)
- Dovile Zilenaite-Petrulaitiene
- Institute of Informatics, Faculty of Mathematics and Informatics, Vilnius University, Naugarduko Str. 24, 03225, Vilnius, Lithuania.
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania.
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania.
| | - Allan Rasmusson
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| | - Justinas Besusparis
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| | - Ruta Barbora Valkiuniene
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| | - Renaldas Augulis
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| | - Aida Laurinaviciene
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| | - Benoit Plancoulaine
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- Path-Image/BioTiCla, University of Caen Normandy, François Baclesse Comprehensive Cancer Center, 3 Av. du Général Harris, 14000, Caen, France
| | - Linas Petkevicius
- Institute of Informatics, Faculty of Mathematics and Informatics, Vilnius University, Naugarduko Str. 24, 03225, Vilnius, Lithuania
| | - Arvydas Laurinavicius
- Department of Pathology and Forensic Medicine, Institute of Biomedical Sciences, Faculty of Medicine, Vilnius University, M. K. Ciurlionio Str. 21, 03101, Vilnius, Lithuania
- National Centre of Pathology, affiliate of Vilnius University Hospital Santaros Klinikos, P. Baublio Str. 5, 08406, Vilnius, Lithuania
| |
Collapse
|
9
|
Liu Y, Han D, Parwani AV, Li Z. Applications of Artificial Intelligence in Breast Pathology. Arch Pathol Lab Med 2023; 147:1003-1013. [PMID: 36800539 DOI: 10.5858/arpa.2022-0457-ra] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/15/2022] [Indexed: 02/19/2023]
Abstract
CONTEXT.— Increasing implementation of whole slide imaging together with digital workflow and advances in computing capacity enable the use of artificial intelligence (AI) in pathology, including breast pathology. Breast pathologists often face a significant workload, with diagnosis complexity, tedious repetitive tasks, and semiquantitative evaluation of biomarkers. Recent advances in developing AI algorithms have provided promising approaches to meet the demand in breast pathology. OBJECTIVE.— To provide an updated review of AI in breast pathology. We examined the success and challenges of current and potential AI applications in diagnosing and grading breast carcinomas and other pathologic changes, detecting lymph node metastasis, quantifying breast cancer biomarkers, predicting prognosis and therapy response, and predicting potential molecular changes. DATA SOURCES.— We obtained data and information by searching and reviewing literature on AI in breast pathology from PubMed and based our own experience. CONCLUSIONS.— With the increasing application in breast pathology, AI not only assists in pathology diagnosis to improve accuracy and reduce pathologists' workload, but also provides new information in predicting prognosis and therapy response.
Collapse
Affiliation(s)
- Yueping Liu
- From the Department of Pathology, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China (Liu, Han)
| | - Dandan Han
- From the Department of Pathology, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China (Liu, Han)
| | - Anil V Parwani
- The Department of Pathology, The Ohio State University, Columbus (Parwani, Li)
| | - Zaibo Li
- From the Department of Pathology, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China (Liu, Han)
| |
Collapse
|
10
|
Monné Rodríguez JM, Frisk AL, Kreutzer R, Lemarchand T, Lezmi S, Saravanan C, Stierstorfer B, Thuilliez C, Vezzali E, Wieczorek G, Yun SW, Schaudien D. European Society of Toxicologic Pathology (Pathology 2.0 Molecular Pathology Special Interest Group): Review of In Situ Hybridization Techniques for Drug Research and Development. Toxicol Pathol 2023; 51:92-111. [PMID: 37449403 PMCID: PMC10467011 DOI: 10.1177/01926233231178282] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/18/2023]
Abstract
In situ hybridization (ISH) is used for the localization of specific nucleic acid sequences in cells or tissues by complementary binding of a nucleotide probe to a specific target nucleic acid sequence. In the last years, the specificity and sensitivity of ISH assays were improved by innovative techniques like synthetic nucleic acids and tandem oligonucleotide probes combined with signal amplification methods like branched DNA, hybridization chain reaction and tyramide signal amplification. These improvements increased the application spectrum for ISH on formalin-fixed paraffin-embedded tissues. ISH is a powerful tool to investigate DNA, mRNA transcripts, regulatory noncoding RNA, and therapeutic oligonucleotides. ISH can be used to obtain spatial information of a cell type, subcellular localization, or expression levels of targets. Since immunohistochemistry and ISH share similar workflows, their combination can address simultaneous transcriptomics and proteomics questions. The goal of this review paper is to revisit the current state of the scientific approaches in ISH and its application in drug research and development.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | - Seong-Wook Yun
- Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach an der Riß, Germany
| | - Dirk Schaudien
- Fraunhofer Institute for Toxicology and Experimental Medicine, Hannover, Germany
| |
Collapse
|
11
|
Sanguedolce F, Zanelli M, Palicelli A, Bisagni A, Zizzo M, Ascani S, Pedicillo MC, Cormio A, Falagario UG, Carrieri G, Cormio L. HER2 Expression in Bladder Cancer: A Focused View on Its Diagnostic, Prognostic, and Predictive Role. Int J Mol Sci 2023; 24:ijms24043720. [PMID: 36835131 PMCID: PMC9962688 DOI: 10.3390/ijms24043720] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2023] [Revised: 02/04/2023] [Accepted: 02/07/2023] [Indexed: 02/15/2023] Open
Abstract
Bladder cancer (BC) is a heterogeneous disease from a molecular, morphological, and clinical standpoint. HER2 is a known oncogene involved in bladder carcinogenesis. Assessing HER2 overexpression as a result of its molecular changes in a routine pathology practice using immunohistochemistry might be a useful adjunct in several scenarios, namely (1) to correctly identify flat urothelial lesions and inverted urothelial lesions in the diagnostic setting; (2) to provide prognostic hints in both non-muscle invasive (NMI) and muscle invasive (MI) tumors, thus supplementing risk stratification tools, especially when evaluating higher-risk tumors such as those with variant morphology; (3) to improve antibody panels as a surrogate marker of BC molecular subtyping. Furthermore, the potential of HER2 as a therapeutic target has been only partly explored so far, in light of the ongoing development of novel target therapies.
Collapse
Affiliation(s)
- Francesca Sanguedolce
- Pathology Unit, Policlinico Riuniti, University of Foggia, 71122 Foggia, Italy
- Correspondence:
| | - Magda Zanelli
- Pathology Unit, Azienda USL-IRCCS di Reggio Emilia, 42123 Reggio Emilia, Italy
| | - Andrea Palicelli
- Pathology Unit, Azienda USL-IRCCS di Reggio Emilia, 42123 Reggio Emilia, Italy
| | - Alessandra Bisagni
- Pathology Unit, Azienda USL-IRCCS di Reggio Emilia, 42123 Reggio Emilia, Italy
| | - Maurizio Zizzo
- Surgical Oncology Unit, Azienda USL-IRCCS di Reggio Emilia, 42123 Reggio Emilia, Italy
| | - Stefano Ascani
- Pathology Unit, Azienda Ospedaliera Santa Maria di Terni, University of Perugia, 05100 Terni, Italy
| | | | - Angelo Cormio
- Urology Unit, Azienda Ospedaliero-Universitaria Ospedali Riuniti Di Ancona, Università Politecnica Delle Marche, 60126 Ancona, Italy
| | - Ugo Giovanni Falagario
- Department of Urology and Renal Transplantation, Policlinico Riuniti, University of Foggia, 71122 Foggia, Italy
| | - Giuseppe Carrieri
- Department of Urology and Renal Transplantation, Policlinico Riuniti, University of Foggia, 71122 Foggia, Italy
| | - Luigi Cormio
- Department of Urology and Renal Transplantation, Policlinico Riuniti, University of Foggia, 71122 Foggia, Italy
- Department of Urology, Bonomo Teaching Hospital, 76123 Andria, Italy
| |
Collapse
|
12
|
Sode M, Thagaard J, Eriksen JO, Laenkholm AV. Digital image analysis and assisted reading of the HER2 score display reduced concordance: pitfalls in the categorisation of HER2-low breast cancer. Histopathology 2023; 82:912-924. [PMID: 36737248 DOI: 10.1111/his.14877] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 01/11/2023] [Accepted: 02/01/2023] [Indexed: 02/05/2023]
Abstract
AIMS Digital image analysis (DIA) is used increasingly as an assisting tool to evaluate biomarkers, including human epidermal growth factor receptor 2 (HER2) in invasive breast cancer (BC). DIA can assist pathologists in HER2 evaluation by presenting quantitative information about the HER2 staining in APP assisted reading (AR). Concurrently, the HER2-low category (HER2-1+/2+ without HER2 gene amplification) has gained prominence due to newly developed antibody-drug conjugates. However, major inter- and intraobserver variability have been observed for the entity. The present quality assurance study investigated the concordance between DIA and AR in clinical use, especially concerning the HER2-low category. METHODS AND RESULTS HER2 immunohistochemistry (IHC) in 761 tumours from 727 patients was evaluated in tissue microarray (TMA) cores by DIA (Visiopharm HER2-CONNECT) and AR. Overall concordance between HER2-scores were 73% (n = 552, weighted-κ: 0.66), and 88% (n = 669, weighted-κ: 0.70), when combining HER2-0/1+. A total of 205 scores were discordant by one category, while four were discordant by two categories. A heterogeneous HER2 pattern was relatively common in the discordant cases and a pitfall in the categorisation of HER2-low BC. AR more commonly reassigned a lower HER2 score (from HER2-1+ to HER2-0) within the HER2-low subgroup (n = 624) compared with DIA. CONCLUSION DIA and AR display moderate agreement with heterogeneous and aberrant staining, representing a source of discordance and a pitfall in the evaluation of HER2.
Collapse
Affiliation(s)
- Michael Sode
- Department of Pathology, Zealand University Hospital, Roskilde, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | | | - Jens Ole Eriksen
- Department of Pathology, Zealand University Hospital, Roskilde, Denmark
| | - Anne-Vibeke Laenkholm
- Department of Pathology, Zealand University Hospital, Roskilde, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
13
|
Hou Y, Peng Y, Li Z. Update on prognostic and predictive biomarkers of breast cancer. Semin Diagn Pathol 2022; 39:322-332. [PMID: 35752515 DOI: 10.1053/j.semdp.2022.06.015] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/06/2022] [Revised: 06/10/2022] [Accepted: 06/15/2022] [Indexed: 11/11/2022]
Abstract
Breast cancer represents a heterogeneous group of human cancer at both histological and molecular levels. Estrogen receptor (ER), progesterone receptor (PR) and human epidermal growth factor receptor 2 (HER2) are the most commonly used biomarkers in clinical practice for making treatment plans for breast cancer patients by oncologists. Recently, PD-L1 testing plays an important role for immunotherapy for triple-negative breast cancer. With the increased understanding of the molecular characterization of breast cancer and the emergence of novel targeted therapies, more potential biomarkers are needed for the development of more personalized treatments. In this review, we summarized several main prognostic and predictive biomarkers in breast cancer at genomic, transcriptomic and proteomic levels, including hormone receptors, HER2, Ki67, multiple gene expression assays, PD-L1 testing, mismatch repair deficiency/microsatellite instability, tumor mutational burden, PIK3CA, ESR1 andNTRK and briefly introduced the roles of digital imaging analysis in breast biomarker evaluation.
Collapse
Affiliation(s)
- Yanjun Hou
- Department of Pathology, Atrium Health Wake Forest Baptist Medical Center, Winston Salem, NC
| | - Yan Peng
- Department of Pathology, University of Texas Southwestern Medical Center, Dallas, TX
| | - Zaibo Li
- Department of pathology, The Ohio State University Wexner Medical Center, Columbus OH.
| |
Collapse
|
14
|
Yousif M, Huang Y, Sciallis A, Kleer CG, Pang J, Smola B, Naik K, McClintock DS, Zhao L, Kunju LP, Balis UGJ, Pantanowitz L. Quantitative Image Analysis as an Adjunct to Manual Scoring of ER, PgR, and HER2 in Invasive Breast Carcinoma. Am J Clin Pathol 2022; 157:899-907. [PMID: 34875014 DOI: 10.1093/ajcp/aqab206] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 11/08/2021] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVES Biomarker expression evaluation for estrogen receptor (ER), progesterone receptor (PgR), and human epidermal growth factor receptor 2 (HER2) is an essential prognostic and predictive parameter for breast cancer and critical for guiding hormonal and neoadjuvant therapy. This study compared quantitative image analysis (QIA) with pathologists' scoring for ER, PgR, and HER2. METHODS A retrospective analysis was undertaken of 1,367 invasive breast carcinomas, including all histopathology subtypes, for which ER, PgR, and HER2 were analyzed by manual scoring and QIA. The resulting scores were compared, and in a subset of HER2 cases (n = 373, 26%), scores were correlated with available fluorescence in situ hybridization (FISH) results. RESULTS Concordance between QIA and manual scores for ER, PgR, and HER2 was 93%, 96%, and 90%, respectively. Discordant cases had low positive scores (1%-10%) for ER (n = 33), were due to nonrepresentative region selection (eg, ductal carcinoma in situ) or tumor heterogeneity for PgR (n = 43), and were of one-step difference (negative to equivocal, equivocal to positive, or vice versa) for HER2 (n = 90). Among HER2 cases where FISH results were available, only four (1.0%) showed discordant QIA and FISH results. CONCLUSIONS QIA is a computer-aided diagnostic support tool for pathologists. It significantly improves ER, PgR, and HER2 scoring standardization. QIA demonstrated excellent concordance with pathologists' scores. To avoid pitfalls, pathologist oversight of representative region selection is recommended.
Collapse
Affiliation(s)
- Mustafa Yousif
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
- Department of Pathology, Vanderbilt University Medical Center , Nashville, TN ¸ USA
| | - Yiyuan Huang
- Department of Biostatistics, University of Michigan , Ann Arbor, MI ¸ USA
| | - Andrew Sciallis
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Celina G Kleer
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Judy Pang
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Brian Smola
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Kalyani Naik
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - David S McClintock
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Lili Zhao
- Department of Biostatistics, University of Michigan , Ann Arbor, MI ¸ USA
| | - Lakshmi P Kunju
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Ulysses G J Balis
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| | - Liron Pantanowitz
- Department of Pathology, University of Michigan Medical School , Ann Arbor, MI ¸ USA
| |
Collapse
|
15
|
Yousif M, van Diest PJ, Laurinavicius A, Rimm D, van der Laak J, Madabhushi A, Schnitt S, Pantanowitz L. Artificial intelligence applied to breast pathology. Virchows Arch 2021; 480:191-209. [PMID: 34791536 DOI: 10.1007/s00428-021-03213-3] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 09/12/2021] [Accepted: 09/27/2021] [Indexed: 12/12/2022]
Abstract
The convergence of digital pathology and computer vision is increasingly enabling computers to perform tasks performed by humans. As a result, artificial intelligence (AI) is having an astoundingly positive effect on the field of pathology, including breast pathology. Research using machine learning and the development of algorithms that learn patterns from labeled digital data based on "deep learning" neural networks and feature-engineered approaches to analyze histology images have recently provided promising results. Thus far, image analysis and more complex AI-based tools have demonstrated excellent success performing tasks such as the quantification of breast biomarkers and Ki67, mitosis detection, lymph node metastasis recognition, tissue segmentation for diagnosing breast carcinoma, prognostication, computational assessment of tumor-infiltrating lymphocytes, and prediction of molecular expression as well as treatment response and benefit of therapy from routine H&E images. This review critically examines the literature regarding these applications of AI in the area of breast pathology.
Collapse
Affiliation(s)
- Mustafa Yousif
- Department of Pathology, University of Michigan, Ann Arbor, MI, USA.
- Department of Pathology, Vanderbilt University Medical Center, Nashville, TN, USA.
| | - Paul J van Diest
- Department of Pathology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Arvydas Laurinavicius
- Department of Pathology, Pharmacology and Forensic Medicine, Faculty of Medicine, Vilnius University, and National Center of Pathology, Affiliate of Vilnius University Hospital Santaros Klinikos, Vilnius, Lithuania
| | - David Rimm
- Department of Pathology, Yale University School of Medicine, New Haven, CT, USA
| | - Jeroen van der Laak
- Department of Pathology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University, and Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA
- Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA
| | - Stuart Schnitt
- Department of Pathology, Brigham and Women's Hospital and Harvard Medical School, Breast Oncology Program, Dana-Farber/Brigham and Women's Cancer Center, Boston, MA, USA
| | | |
Collapse
|
16
|
Lara H, Li Z, Abels E, Aeffner F, Bui MM, ElGabry EA, Kozlowski C, Montalto MC, Parwani AV, Zarella MD, Bowman D, Rimm D, Pantanowitz L. Quantitative Image Analysis for Tissue Biomarker Use: A White Paper From the Digital Pathology Association. Appl Immunohistochem Mol Morphol 2021; 29:479-493. [PMID: 33734106 PMCID: PMC8354563 DOI: 10.1097/pai.0000000000000930] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 02/12/2021] [Indexed: 01/19/2023]
Abstract
Tissue biomarkers have been of increasing utility for scientific research, diagnosing disease, and treatment response prediction. There has been a steady shift away from qualitative assessment toward providing more quantitative scores for these biomarkers. The application of quantitative image analysis has thus become an indispensable tool for in-depth tissue biomarker interrogation in these contexts. This white paper reviews current technologies being employed for quantitative image analysis, their application and pitfalls, regulatory framework demands, and guidelines established for promoting their safe adoption in clinical practice.
Collapse
Affiliation(s)
- Haydee Lara
- GlaxoSmithKline-R&D, Cellular Biomarkers, Collegeville, PA
| | - Zaibo Li
- The Ohio State University, Columbus, OH
| | | | - Famke Aeffner
- Translational Safety and Bioanalytical Sciences, Amgen Research, Amgen Inc
| | | | | | | | | | | | | | | | - David Rimm
- Yale University School of Medicine, New Haven, CT
| | | |
Collapse
|
17
|
Yue M, Zhang J, Wang X, Yan K, Cai L, Tian K, Niu S, Han X, Yu Y, Huang J, Han D, Yao J, Liu Y. Can AI-assisted microscope facilitate breast HER2 interpretation? A multi-institutional ring study. Virchows Arch 2021; 479:443-449. [PMID: 34279719 DOI: 10.1007/s00428-021-03154-x] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Revised: 06/20/2021] [Accepted: 07/03/2021] [Indexed: 11/26/2022]
Abstract
The level of human epidermal growth factor receptor-2 (HER2) protein and gene expression in breast cancer is an essential factor in judging the prognosis of breast cancer patients. Several investigations have shown high intraobserver and interobserver variability in the evaluation of HER2 staining by visual examination. In this study, we aim to propose an artificial intelligence (AI)-assisted microscope to improve the HER2 assessment accuracy and reliability. Our AI-assisted microscope was equipped with a conventional microscope with a cell-level classification-based HER2 scoring algorithm and an augmented reality module to enable pathologists to obtain AI results in real time. We organized a three-round ring study of 50 infiltrating duct carcinoma not otherwise specified (NOS) cases without neoadjuvant treatment, and recruited 33 pathologists from 6 hospitals. In the first ring study (RS1), the pathologists read 50 HER2 whole-slide images (WSIs) through an online system. After a 2-week washout period, they read the HER2 slides using a conventional microscope in RS2. After another 2-week washout period, the pathologists used our AI microscope for assisted interpretation in RS3. The consistency and accuracy of HER2 assessment by the AI-assisted microscope were significantly improved (p < 0.001) over those obtained using a conventional microscope and online WSI. Specifically, our AI-assisted microscope improved the precision of immunohistochemistry (IHC) 3 + and 2 + scoring while ensuring the recall of fluorescent in situ hybridization (FISH)-positive results in IHC 2 + . Also, the average acceptance rate of AI for all pathologists was 0.90, demonstrating that the pathologists agreed with most AI scoring results.
Collapse
MESH Headings
- Artificial Intelligence
- Automation, Laboratory
- Biomarkers, Tumor/analysis
- Biomarkers, Tumor/genetics
- Breast Neoplasms/chemistry
- Breast Neoplasms/genetics
- Breast Neoplasms/pathology
- Carcinoma, Ductal, Breast/chemistry
- Carcinoma, Ductal, Breast/genetics
- Carcinoma, Ductal, Breast/pathology
- China
- Female
- Humans
- Image Interpretation, Computer-Assisted
- Immunohistochemistry
- In Situ Hybridization, Fluorescence
- Microscopy/instrumentation
- Observer Variation
- Predictive Value of Tests
- Receptor, ErbB-2/analysis
- Receptor, ErbB-2/genetics
- Reproducibility of Results
- Retrospective Studies
Collapse
Affiliation(s)
- Meng Yue
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Jun Zhang
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China
| | - Xinran Wang
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Kezhou Yan
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China
| | - Lijing Cai
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Kuan Tian
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China
| | - Shuyao Niu
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Xiao Han
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China
| | - Yongqiang Yu
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Junzhou Huang
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China
| | - Dandan Han
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China
| | - Jianhua Yao
- Tencent AI Lab, Nanshan District, Tencent Binhai Building, No. 33, Haitian Second Road, Shenzhen, 518054, Guangdong, China.
| | - Yueping Liu
- Department of Pathology, The Fourth Hospital of Hebei Medical University, No. 12 Jiankang Road, Shijiazhuang, 050011, Hebei, China.
| |
Collapse
|
18
|
Memon R, Prieto Granada CN, Harada S, Winokur T, Reddy V, Kahn AG, Siegal GP, Wei S. Discordance Between Immunohistochemistry and In Situ Hybridization to Detect HER2 Overexpression/Gene Amplification in Breast Cancer in the Modern Age: A Single Institution Experience and Pooled Literature Review Study. Clin Breast Cancer 2021; 22:e123-e133. [PMID: 34120846 DOI: 10.1016/j.clbc.2021.05.004] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 04/26/2021] [Accepted: 05/08/2021] [Indexed: 01/08/2023]
Abstract
BACKGROUND Human epidermal growth factor 2 (HER2) amplification and/or overexpression occurs in 12% to 25% of breast cancers. Accurate detection of HER2 is critical in predicting response to HER2-targeted therapy. Both immunohistochemistry (IHC) and in situ hybridization (ISH) are FDA-approved methods for detecting HER2 status because its protein overexpression is largely attributable to gene amplification. However, variable discordant results between IHC and ISH have been reported. METHODS We determined the frequency of HER2 IHC/ISH discordance in these patients and also performed a pooled literature review analysis. RESULTS Of the 1125 consecutive primary or metastatic breast cancers with HER2 IHC and ISH performed simultaneously between 2015 and 2020, 84.6% had an unequivocal HER2 status. Discordance was found in 30 cases from 26 patients, including 13 IHC-/ISH+ and 17 IHC+/ISH-, representing 1.6% and 11.9% of IHC- and IHC+ cases, respectively. Review of the literature between 2001 and 2020 identified 46 relevant studies, with a total of 43,468 cases with IHC and ISH performed. The IHC-/ISH+ and IHC+/ISH- discordances were seen in all antibody clones and ISH methods used. The IHC+/ISH- discordance was significantly higher than IHC-/ISH+ (13.8% vs. 3%, P < .0001). The overall discordance constituted 4% of all cases and 5.4% of those with an unequivocal IHC status. Significantly lower incongruities for both IHC-/ISH+ and IHC+/ISH- were found in those published after 2018. The discordances probably reflect altered biology of HER2 oncogene/oncoprotein. Routinely performing both IHC and ISH may uncover such cases to prevent denial of potentially beneficial targeted therapy.
Collapse
Affiliation(s)
| | | | - Shuko Harada
- Department of Pathology; O'Neal Comprehensive Cancer Center, University of Alabama at Birmingham, Birmingham, AL
| | | | | | | | - Gene P Siegal
- Department of Pathology; O'Neal Comprehensive Cancer Center, University of Alabama at Birmingham, Birmingham, AL
| | - Shi Wei
- Department of Pathology; O'Neal Comprehensive Cancer Center, University of Alabama at Birmingham, Birmingham, AL.
| |
Collapse
|
19
|
Li AC, Zhao J, Zhao C, Ma Z, Hartage R, Zhang Y, Li X, Parwani AV. Quantitative digital imaging analysis of HER2 immunohistochemistry predicts the response to anti-HER2 neoadjuvant chemotherapy in HER2-positive breast carcinoma. Breast Cancer Res Treat 2020; 180:321-329. [PMID: 32002765 DOI: 10.1007/s10549-020-05546-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Accepted: 01/21/2020] [Indexed: 01/04/2023]
Abstract
PURPOSE Patients with HER2-positive breast cancer commonly receive anti-HER2 neoadjuvant chemotherapy and pathologic complete response (pCR) can be achieved in up to half of the patients. HER2 protein expression detected by immunohistochemistry (IHC) can be quantified using digital imaging analysis (DIA) as a value of membranous connectivity. We aimed to investigate the association HER2 IHC DIA quantitative results with response to anti-HER2 neoadjuvant chemotherapy. METHODS Digitized HER2 IHC whole slide images were analyzed using Visiopharm HER2-CONNECT to obtain quantitative HER2 membranous connectivity from a cohort of 153 HER2+ invasive breast carcinoma cases treated with anti-HER2 neoadjuvant chemotherapy (NAC). HER2 connectivity and other factors including age, histologic grade, ER, PR, and HER2 fluorescence in situ hybridization (FISH) were analyzed for association with the response to anti-HER2 NAC. RESULTS Eighty-three cases (54.2%) had pCR, while 70 (45.8%) showed residual tumor. Younger age, negative ER/PR, higher HER2 DIA connectivity, higher HER2 FISH ratio and copy number were significantly associated with pCR in univariate analysis. Multivariate analysis demonstrated only age, HER2 DIA connectivity, PR negativity, and HER2 copy number was significantly associated with pCR, whereas HER2 DIA connectivity had the strongest association. CONCLUSIONS HER2 IHC DIA connectivity is the most important factor predicting pCR to anti-HER2 neoadjuvant chemotherapy in patients with HER2-positive breast cancer.
Collapse
Affiliation(s)
- Aidan C Li
- Dublin Jerome High School, Dublin, OH, USA
| | - Jing Zhao
- Department of Pathology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Chao Zhao
- Center for Biostatistics, Emory University, Atlanta, GA, USA
| | - Zhongliang Ma
- Department of Surgery, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Ramon Hartage
- Department of Pathology, The Ohio State University, Columbus, OH, USA
| | - Yunxiang Zhang
- Department of Pathology, Weifang People's Hospital, Weifang, China
| | - Xiaoxian Li
- Department of Pathology, Emory University, Atlanta, GA, USA.
| | - Anil V Parwani
- Department of Pathology, The Ohio State University, Columbus, OH, USA.
| |
Collapse
|