HER2 immunohistochemistry inter-observer reproducibility in 205 cases of invasive breast carcinoma additionally tested by ISH

Performance of a HER2 testing algorithm tailored for urothelial bladder cancer: A Bi-centre study

Aims

This study aimed to develop an AI algorithm for automated HER2 scoring in urothelial bladder cancer (UBCa) and assess the interobserver agreement using both manual and AI-assisted methods based on breast cancer criteria.

Methods and Results

We utilized 330 slides from two institutions for initial AI development and selected 200 slides for the ring study, involving six pathologists (3 senior, 3 junior). Our AI algorithm achieved high accuracy in two independent tests, with accuracies of 0.94 and 0.92. In the ring study, the AI-assisted method improved both accuracy (0.66 vs 0.94) and consistency (kappa=0.48; 95 % CI, 0.443-0.526 vs kappa=0.87; 95 % CI, 0.852-0.885) compared to manual scoring, especially in HER2-low cases (F1-scores: 0.63 vs 0.92). Additionally, in 62.3 % of heterogeneous HER2-positive cases, the interpretation accuracy significantly improved (0.49 vs 0.93). Pathologists, particularly junior ones, experienced enhanced accuracy and consistency with AI assistance.

Conclusions

This is the first study to provide a quantification algorithm for HER2 scoring in UBCa to assist pathologists in diagnosis. The ring study demonstrated that HER2 scoring based on breast cancer criteria can be effectively applied to UBCa. Furthermore, AI assistance significantly improves the accuracy and consistency of interpretations among pathologists with varying levels of experience, even in heterogeneous cases.

Immunohistochemical assessment of HER2 low breast cancer: interobserver reproducibility and correlation with digital image analysis

PURPOSE

The recent findings from the DESTINY-Breast04 trial highlighted the clinical importance of distinguishing between HER2 immunohistochemistry (IHC) scores 0 and 1 + in metastatic breast cancer (BC). However, pathologist interpretation of HER2 IHC scoring is subjective, and standardized methodology is needed. We evaluated the consistency of HER2 IHC scoring among pathologists and the accuracy of digital image analysis (DIA) in interpreting HER2 IHC staining in cases of HER2-low BC.

METHODS

Fifty whole-slide biopsies of BC with HER2 IHC staining were evaluated, comprising 25 cases originally reported as IHC score 0 and 25 as 1 +. These slides were digitally scanned. Six pathologists with breast expertise independently reviewed and scored the scanned images, and DIA was applied. Agreement among pathologists and concordance between pathologist scores and DIA results were statistically analyzed using Kendall coefficient of concordance (W) tests.

RESULTS

Substantial agreement among at least five of the six pathologists was found for 18 of the score 0 cases (72%) and 15 of the score 1 + cases (60%), indicating excellent interobserver agreement (W = 0.828). DIA scores were highly concordant with pathologist scores in 96% of cases (47/49), indicating excellent concordance (W = 0.959).

CONCLUSION

Although breast subspecialty pathologists were relatively consistent in evaluating BC with HER2 IHC scores of 0 and 1 +, DIA may be a reliable supplementary tool to enhance the standardization and quantification of HER2 IHC assessment, especially in challenging cases where results may be ambiguous (i.e., scores 0-1 +). These findings hold promise for improving the accuracy and consistency of HER2 testing.

New approaches for human epidermal growth factor receptor 2-low and human epidermal growth factor receptor 2-overexpressing metastatic breast cancer

PURPOSE OF REVIEW

In recent years, there has been a flurry of activity in the human epidermal growth factor receptor 2 (HER2)-positive metastatic breast cancer space. New, powerful drugs like trastuzumab deruxtecan have challenged our fundamental definition of what HER2 expression means as a predictive biomarker.

RECENT FINDINGS

Recent approvals of multiple agents in the second line-metastatic setting have given patients access to a variety of new agents, but also raise questions with regard to optimal sequencing.

SUMMARY

This review will explore current issues with HER2 testing, recently approved drugs in the HER2+ and HER2 low spaces, as well as novel agents/combinations on the horizon.

High inter-laboratory variability in the assessment of HER2-low breast cancer: a national registry study on 50,714 Danish patients

BACKGROUND

Considering the recent advancements in the treatment of breast cancer with low expression of human epidermal growth factor receptor 2 (HER2), we aimed to examine inter-laboratory variability in the assessment of HER2-low breast cancer across all Danish pathology departments.

METHODS

From the Danish Breast Cancer Group, we obtained data on all women diagnosed with primary invasive breast cancer in 2007-2019 who were subsequently assigned for curatively intended treatment.

RESULTS

Of 50,714 patients, HER2 score and status were recorded for 48,382, among whom 59.2% belonged to the HER2-low group (score 1+ or 2+ without gene amplification), 26.8% had a HER2 score of 0, and 14.0% were HER2 positive. The proportion of HER2-low cases ranged from 46.3 to 71.8% among pathology departments (P < 0.0001) and from 49.3 to 65.6% over the years (P < 0.0001). In comparison, HER2 positivity rates ranged from 11.8 to 17.2% among departments (P < 0.0001) and from 12.6 to 15.7% over the years (P = 0.005). In the eight departments with the highest number of patients, variability in HER2-low cases increased from 2011 to 2019, although the same immunohistochemical assay was used. By multivariable logistic regression, the examining department was significantly related to both HER2 score 0 and HER2 positivity (P < 0.0001) but showed greater dispersion in odds ratios in the former case (range 0.25-1.41 vs. 0.84-1.27).

CONCLUSIONS

Our data showed high inter-laboratory variability in the assessment of HER2-low breast cancer. The findings cast doubt on whether the current test method for HER2 is robust and reliable enough to select HER2-low patients for HER2-targeted treatment in daily clinical practice.

Differences in Treatment Outcomes Between Patients with HER2-Low versus HER2-Zero, Hormone Receptor-Positive Advanced-Stage Breast Cancer Treated with Ribociclib

Background

Metastatic breast cancers (MBC) with no expression of human epidermal growth factor receptor-2 (HER2) are recently classified into two groups; HER2-zero [HER2-immunohistochemistry (IHC) score of 0 (IHC-0)] and HER2-low, defined as those with IHC score of 1+ or 2+ with negative in situ hybridization (ISH) assay. We investigate differences in treatment outcomes between both groups treated with endocrine therapy (ET) and the CDK4/6 inhibitor ribociclib.

Methods

Data were retrospectively collected for patients with HR-positive+/HER2-negative MBC who received ribociclib with an aromatase inhibitor (AI) or fulvestrant and were divided into two groups: HER2-zero and HER2-low.

Results

A total of 257 patients, median age 48 (22-87) years, all with MBC who were treated with ET and ribociclib were enrolled. One hundred and thirty-seven (53.3%) patients had de novo MBC, and majority (n = 162, 63.0%) received ribociclib as a first-line therapy. In total, 114 (44.4%) patients had HER2-zero (IHC-0), while 143 (55.6%) others had HER2-low disease. The overall response rate (ORR) was 52.0% for the HER2-zero group compared to 39.4% for the HER2-low group, p = 0.005. The median PFS was 22.2 (95% confidence interval [CI], 19.4-NR) months for HER2-zero versus 17.3 (95% CI, 14.1-20.6) months for HER2-low, P = 0.0039. In multivariable analysis, HER2-low expression remained significant determinant of inferior PFS after adjusting for other factors, including the site of metastasis, prior chemotherapy, and the line of treatment.

Conclusion

In patients with MBC treated with ET and ribociclib, level of HER2 negativity may affect treatment outcomes; patients with HER2-zero had better response rate and PFS compared to those with HER2-low disease. These findings, if confirmed in larger studies, may help oncologists select patients with HER2-low for better treatment options.

Digital image analysis and assisted reading of the HER2 score display reduced concordance: pitfalls in the categorisation of HER2-low breast cancer

AIMS

Digital image analysis (DIA) is used increasingly as an assisting tool to evaluate biomarkers, including human epidermal growth factor receptor 2 (HER2) in invasive breast cancer (BC). DIA can assist pathologists in HER2 evaluation by presenting quantitative information about the HER2 staining in APP assisted reading (AR). Concurrently, the HER2-low category (HER2-1+/2+ without HER2 gene amplification) has gained prominence due to newly developed antibody-drug conjugates. However, major inter- and intraobserver variability have been observed for the entity. The present quality assurance study investigated the concordance between DIA and AR in clinical use, especially concerning the HER2-low category.

METHODS AND RESULTS

HER2 immunohistochemistry (IHC) in 761 tumours from 727 patients was evaluated in tissue microarray (TMA) cores by DIA (Visiopharm HER2-CONNECT) and AR. Overall concordance between HER2-scores were 73% (n = 552, weighted-κ: 0.66), and 88% (n = 669, weighted-κ: 0.70), when combining HER2-0/1+. A total of 205 scores were discordant by one category, while four were discordant by two categories. A heterogeneous HER2 pattern was relatively common in the discordant cases and a pitfall in the categorisation of HER2-low BC. AR more commonly reassigned a lower HER2 score (from HER2-1+ to HER2-0) within the HER2-low subgroup (n = 624) compared with DIA.

CONCLUSION

DIA and AR display moderate agreement with heterogeneous and aberrant staining, representing a source of discordance and a pitfall in the evaluation of HER2.

Characterization of Hormone Receptor and HER2 Status in Breast Cancer Using Mass Spectrometry Imaging

Immunohistochemical evaluation of estrogen receptor, progesterone receptor, and human epidermal growth factor receptor-2 status stratify the different subtypes of breast cancer and define the treatment course. Triple-negative breast cancer (TNBC), which does not register receptor overexpression, is often associated with worse patient prognosis. Mass spectrometry imaging transcribes the molecular content of tissue specimens without requiring additional tags or preliminary analysis of the samples, being therefore an excellent methodology for an unbiased determination of tissue constituents, in particular tumor markers. In this study, the proteomic content of 1191 human breast cancer samples was characterized by mass spectrometry imaging and the epithelial regions were employed to train and test machine-learning models to characterize the individual receptor status and to classify TNBC. The classification models presented yielded high accuracies for estrogen and progesterone receptors and over 95% accuracy for classification of TNBC. Analysis of the molecular features revealed that vimentin overexpression is associated with TNBC, supported by immunohistochemistry validation, revealing a new potential target for diagnosis and treatment.

Multi-institutional Assessment of Pathologist Scoring HER2 Immunohistochemistry

The HercepTest was approved 20+ years ago as the companion diagnostic test for trastuzumab in human epidermal growth factor 2 (HER2) or ERBB2 gene-amplified/overexpressing breast cancers. Subsequent HER2 immunohistochemistry (IHC) assays followed, including the now most common Ventana 4B5 assay. Although this IHC assay has become the clinical standard, its reliability, reproducibility, and accuracy have largely been approved and accepted on the basis of concordance among small numbers of pathologists without validation in a real-world setting. In this study, we evaluated the concordance and interrater reliability of scoring HER2 IHC in 170 breast cancer biopsies by 18 breast cancer-specialized pathologists from 15 institutions. We used the Observers Needed to Evaluate Subjective Tests method to determine the plateau of concordance and the minimum number of pathologists needed to estimate interrater agreement values for large numbers of raters, as seen in the real-world setting. We report substantial discordance within the intermediate categories (<1% agreement for 1+ and 3.6% agreement for 2+) in the 4-category HER2 IHC scoring system. The discordance within the IHC 0 cases is also substantial with an overall percent agreement (OPA) of only 25% and poor interrater reliability metrics (0.49 Fleiss' kappa, 0.55 intraclass correlation coefficient). This discordance can be partially reduced by using a 3-category system (28.8% vs 46.5% OPA for 4-category and 3-category scoring systems, respectively). Observers Needed to Evaluate Subjective Tests plots suggest that the OPA for the task of determining a HER2 IHC score 0 from not 0 plateaus statistically around 59.4% at 10 raters. Conversely, at the task of scoring HER2 IHC as 3+ or not 3+ pathologists' concordance was much higher with an OPA that plateaus at 87.1% with 6 raters. This suggests that legacy HER2 IHC remains valuable for finding the patients in whom the ERBB2 gene is amplified but unacceptably discordant in assigning HER2-low or HER2-negative status for the emerging HER2-low therapies.

Interobserver Variation in the Assessment of Immunohistochemistry Expression Levels in HER2-Negative Breast Cancer: Can We Improve the Identification of Low Levels of HER2 Expression by Adjusting the Criteria? An International Interobserver Study

The classification of human epidermal growth factor receptor 2 (HER2) expression is optimized to detect HER2-amplified breast cancer (BC). However, novel HER2-targeting agents are also effective for BCs with low levels of HER2. This raises the question whether the current guidelines for HER2 testing are sufficiently reproducible to identify HER2-low BC. The aim of this multicenter international study was to assess the interobserver agreement of specific HER2 immunohistochemistry scores in cases with negative HER2 results (0, 1+, or 2+/in situ hybridization negative) according to the current American Society of Clinical Oncology/College of American Pathologists (ASCO/CAP) guidelines. Furthermore, we evaluated whether the agreement improved by redefining immunohistochemistry (IHC) scoring criteria or by adding fluorescent in situ hybridization (FISH). We conducted a 2-round study of 105 nonamplified BCs. During the first assessment, 16 pathologists used the latest version of the ASCO/CAP guidelines. After a consensus meeting, the same pathologists scored the same digital slides using modified IHC scoring criteria based on the 2007 ASCO/CAP guidelines, and an extra "ultralow" category was added. Overall, the interobserver agreement was limited (4.7% of cases with 100% agreement) in the first round, but this was improved by clustering IHC categories. In the second round, the highest reproducibility was observed when comparing IHC 0 with the ultralow/1+/2+ grouped cluster (74.3% of cases with 100% agreement). The FISH results were not statistically different between HER2-0 and HER2-low cases, regardless of the IHC criteria used. In conclusion, our study suggests that the modified 2007 ASCO/CAP criteria were more reproducible in distinguishing HER2-0 from HER2-low cases than the 2018 ASCO/CAP criteria. However, the reproducibility was still moderate, which was not improved by adding FISH. This could lead to a suboptimal selection of patients eligible for novel HER2-targeting agents. If the threshold between HER2 IHC 0 and 1+ is to be clinically actionable, there is a need for clearer, more reproducible IHC definitions, training, and/or development of more accurate methods to detect this subtle difference in protein expression levels.

Reproducibility of scoring criteria for HER2 immunohistochemistry in endometrial serous carcinoma: a multi-institutional interobserver agreement study

Targeted anti-human epidermal growth factor receptor 2 (HER2) therapy has recently been proven to improve progression-free and overall survival of patients with advanced stage or recurrent endometrial serous carcinoma. To date, no specific pathology HER2 testing or scoring guidelines exist for endometrial cancer. However, based on evidence from the recent successful clinical trial and comprehensive pre-trial pathologic studies, a new set of HER2 scoring criteria have been proposed for endometrial serous carcinoma-distinct from the existing breast and gastric cancer-specific criteria. We present the first study assessing interobserver agreement of HER2 scores using the proposed serous endometrial cancer-specific scoring system. A digitally scanned set of 40 HER2-immunostained slides of endometrial serous carcinoma were sent to seven gynecologic pathologists, who independently assigned HER2 scores for each slide following a brief tutorial. Follow-up fluorescent in situ hybridization (FISH) for HER2 gene amplification was performed on cases with interobserver disagreement when a 2+ HER2 score was assigned by at least one observer. Complete agreement of HER2 scores among all 7 observers was achieved on 15 cases, and all but one case had an agreement by at least 4 observers. The overall agreement was 72.3% (kappa 0.60), 77.5% (kappa 0.65), and 83.3% (kappa 0.65), using four (0 to 3+ ), three (0/1+ , 2+ , 3+ ), or two (0/1+ , 2/3+ ) HER2 scoring categories, respectively. Based on the combination of HER2 immunostaining scores and FISH, the interobserver disagreement may have potentially resulted in a clinically significant difference in HER2 status only in three tumors. We conclude, that the proposed serous endometrial cancer-specific HER2 scoring criteria are reproducible among gynecologic pathologists with moderate to substantial interobserver agreement rates comparable to those of previously reported in breast and gastric carcinomas. Our findings significantly strengthen the foundation for establishing endometrial cancer-specific HER2 scoring guidelines in the future.

"HER2 immunohistochemistry inter-observer reproducibility in 205 cases of invasive breast carcinoma additionally tested by ISH" Answer to the statistical issue to avoid misinterpretation

Assessment of HER2 biomarker in invasive breast carcinoma patients allows a specific therapeutic approach. Clinical guidelines indicate immunohistochemistry (IHC) and in situ hybridization (ISH) to test HER2, however both have drawbacks which results in low reproducibility of results especially in equivocal cases. Our main objective is to quantify inter-observer IHC reproducibility and cross it with the ISH result. Our series includes 205 invasive breast carcinoma cases sent for ISH retest from 14 hospitals, 5 observers to assess the IHC and 1 observer for ISH of each case. We found that the observers only achieve an absolute agreement for IHC in 1 out of 3 cases. The inter-observer concordance for IHC is low (0.2 ≤ k ≤ 0.4) or moderate (0.41 ≤ k ≤ 0.6). In ISH positive cases the concordance for IHC is higher than in the ISH negative cases. In conclusion, the study shows low and moderate IHC inter-observer concordance, finding the more worrying values among the ISH negative cases which are the most part of this particular sample. Subjective interpretation of the techniques, among other factors, has negative impact in HER2 evaluation. To offset this limitation we have checked that reaching a consensus from different observers for HER2 IHC assessment improves the results.