Is it necessary to evaluate nuclei in HER2 FISH evaluation?

Review of In Situ Hybridization (ISH) Stain Images Using Computational Techniques

Recent advancements in medical imaging have greatly enhanced the application of computational techniques in digital pathology, particularly for the classification of breast cancer using in situ hybridization (ISH) imaging. HER2 amplification, a key prognostic marker in 20-25% of breast cancers, can be assessed through alterations in gene copy number or protein expression. However, challenges persist due to the heterogeneity of nuclear regions and complexities in cancer biomarker detection. This review examines semi-automated and fully automated computational methods for analyzing ISH images with a focus on HER2 gene amplification. Literature from 1997 to 2023 is analyzed, emphasizing silver-enhanced in situ hybridization (SISH) and its integration with image processing and machine learning techniques. Both conventional machine learning approaches and recent advances in deep learning are compared. The review reveals that automated ISH analysis in combination with bright-field microscopy provides a cost-effective and scalable solution for routine pathology. The integration of deep learning techniques shows promise in improving accuracy over conventional methods, although there are limitations related to data variability and computational demands. Automated ISH analysis can reduce manual labor and increase diagnostic accuracy. Future research should focus on refining these computational methods, particularly in handling the complex nature of HER2 status evaluation, and integrate best practices to further enhance clinical adoption of these techniques.

Deep learning to automatically evaluate HER2 gene amplification status from fluorescence in situ hybridization images

Human epidermal growth factor receptor 2 (HER2) gene amplification helps identify breast cancer patients who may respond to targeted anti-HER2 therapy. This study aims to develop an automated method for quantifying HER2 fluorescence in situ hybridization (FISH) signals and improve the working efficiency of pathologists. An Aitrox artificial intelligence (AI) model based on deep learning was constructed, and a comparison between the AI model and traditional manual counting was performed. In total, 918 FISH images from 320 consecutive invasive breast cancers were analysed and automatically classified into 5 groups according to the 2018 ASCO/CAP guidelines. The overall classification accuracy was 85.33% (157/184) with a mean average precision of 0.735. In Group 5, the most common group, the consistency was as high as 95.90% (117/122), while the consistency was low in the other groups due to the limited number of cases. The causes of this inconsistency, including clustered HER2 signals, coarse CEP17 signals and some section quality problems, were analysed. The developed AI model is a reliable tool for evaluating HER2 amplification statuses, especially for breast cancer in Group 5; additional cases from multiple centres could further improve the accuracy achieved for other groups.

Automated density-based counting of FISH amplification signals for HER2 status assessment

BACKGROUND

Automated image analysis can make quantification of FISH signals in histological sections more efficient and reproducible. Current detection-based methods, however, often fail to accurately quantify densely clustered FISH signals.

METHODS

We propose a novel density-based approach to quantifying FISH signals. Instead of detecting individual signals, this approach quantifies FISH signals in terms of the integral over a density map predicted by Deep Learning. We apply the density-based approach to the task of counting and determining ratios of ERBB2 and CEN17 signals and compare it to common detection-based and area-based approaches.

RESULTS

The ratios determined by our approach were strongly correlated with results obtained by manual annotation of individual FISH signals (Pearson's r = 0.907). In addition, they were highly consistent with cutoff-scores determined by a pathologist (balanced concordance = 0.971). The density-based approach generally outperformed the other approaches. Its superiority was particularly evident in the presence of dense signal clusters.

CONCLUSIONS

The presented approach enables accurate and efficient automated quantification of FISH signals. Since signals in clusters can hardly be detected individually even by human observers, the density-based quantification performs better than detection-based approaches.

Automated Image Analysis of HER2 Fluorescence In Situ Hybridization to Refine Definitions of Genetic Heterogeneity in Breast Cancer Tissue

Human epidermal growth factor receptor 2 gene- (HER2-) targeted therapy for breast cancer relies primarily on HER2 overexpression established by immunohistochemistry (IHC) with borderline cases being further tested for amplification by fluorescence in situ hybridization (FISH). Manual interpretation of HER2 FISH is based on a limited number of cells and rather complex definitions of equivocal, polysomic, and genetically heterogeneous (GH) cases. Image analysis (IA) can extract high-capacity data and potentially improve HER2 testing in borderline cases. We investigated statistically derived indicators of HER2 heterogeneity in HER2 FISH data obtained by automated IA of 50 IHC borderline (2+) cases of invasive ductal breast carcinoma. Overall, IA significantly underestimated the conventional HER2, CEP17 counts, and HER2/CEP17 ratio; however, it collected more amplified cells in some cases below the lower limit of GH definition by manual procedure. Indicators for amplification, polysomy, and bimodality were extracted by factor analysis and allowed clustering of the tumors into amplified, nonamplified, and equivocal/polysomy categories. The bimodality indicator provided independent cell diversity characteristics for all clusters. Tumors classified as bimodal only partially coincided with the conventional GH heterogeneity category. We conclude that automated high-capacity nonselective tumor cell assay can generate evidence-based HER2 intratumor heterogeneity indicators to refine GH definitions.

Localization of spots in FISH images of breast cancer using 3-D shape analysis

The fluorescence in situ (FISH) belongs to the most often used molecular cytogenetic techniques, applied in many areas of diagnosis and research. The analysis of FISH images relies on localization and counting the red and green spots in order to determine HER2 status of the breast cancer samples. The algorithm of spot localization presented in the paper is based on 3-D shape analysis of the image objects. The subsequent regions of the image are matched to the reference pattern and the results of this matching influence localization of spots. The paper compares different shapes of the reference pattern and their efficiency in spot localization. The numerical experiments have been performed on the basis of 12 cases (patients), each represented by three images. Few thousands of cells have been analysed. The quantitative analyses comparing different versions of algorithm are presented and compared to the expert results. The best version of the procedure provides the absolute relative difference to the expert results smaller than 3%. These results confirm high efficiency of the proposed approach to the spot identification. The proposed method of FISH image analysis improves the efficiency of detecting fluorescent signals in FISH images. The evaluation results are encouraging for further testing of the developed automatic system directed to application in medical practice.