A Root Cause Analysis Into the High Error Rate in Clinical Immunohistochemistry

Quantitative comparison of immunohistochemical HER2-low detection in an interlaboratory study

AIMS

Recently, human epidermal growth factor 2 (HER2)-low (i.e. HER2 score 1+ or 2+ without amplification) breast cancer patients became eligible for trastuzumab-deruxtecan treatment. To improve assay standardisation and detection of HER2-low in a quantitative manner, we conducted an external quality assessment-like study in the Netherlands. Dynamic range cell lines and immunohistochemistry (IHC) calibrators were used to quantify HER2 expression and to assess interlaboratory variability.

METHODS AND RESULTS

Three blank slides with a dynamic range cell line and an IHC calibrator were stained with routine HER2 assays by 35 laboratories. Four different antibody clones were used: 19 (54.3%) 4B5, six (17.1%) A0485, five (14.3%) DG44 (HercepTest) and five (14.3%) SP3. Laboratories used two different detection kits for 4B5 assays: 14 (73.7%) ultraView and five (26.3%) OptiView. Variability of HER2 expression in cell lines, measured with artificial intelligence software, was median (min-max) = negative core 0.5% (0.0-57.0), 1+ core 4.3% (1.6-71.3), 2+ core 42.8% (30.4-92.6) and 3+ core 96.2% (91.8-98.8). The calibrators DG44 and 4B5 OptiView had the highest analytical sensitivity, closely followed by 4B5 ultraView. SP3 was the least sensitive. Calibrators of A0485 assays were not analysable due to background staining.

CONCLUSIONS

As assays were validated for detecting HER2-amplified tumours, not all assays and antibodies proved suitable for HER2-low detection. Some tests showed distinct expression in the negative cell line. Dynamic range cell line controls and quantitative analysis using calibrators demonstrated more interlaboratory variability than commonly appreciated. Revalidation of HER2 tests by laboratories is needed to ensure clinical applicable HER2-low assays.

Multiplexed immunolabelling of cancer using bioconjugated plasmonic gold-silver alloy nanoparticles

Reliable protein detection methods are vital for advancing biological research and medical diagnostics. While immunohistochemistry and immunofluorescence are commonly employed, their limitations underscore the necessity for alternative approaches. This study introduces immunoplasmonic labelling, utilizing plasmonic nanoparticles (NPs), specifically designed gold and gold-silver alloy NPs (Au:Ag NPs), for multiplexed and quantitative protein detection. These NPs, when coupled with antibodies targeting proteins of interest, enable accurate counting and evaluation of protein expression levels while overcoming issues such as autofluorescence. In this study, we compare two nanoparticle functionalization strategies-one coating based on thiolated PEG and one coating based on calix[4]arenes-on gold and gold-silver alloy nanoparticles of varying sizes. Overall results tend to demonstrate a greater versatility for the calix[4]arene-based coating. With this coating and using the classical EDC/sulfo-NHS cross-linking procedure, we also demonstrate the successful multiplexed immunolabelling of Her2, CD44, and EpCAM in breast cancer cell lines (SK-BR-3 and MDA-MB-231). Furthermore, we introduce a user-friendly software for automatic NP detection and classification by colour, providing a promising proof-of-concept for the practical application of immunoplasmonic techniques in the quantitative analysis of biopsies in the clinical setting.

Fit-for-Purpose Ki-67 Immunohistochemistry Assays for Breast Cancer

New therapies are being developed for breast cancer, and in this process, some "old" biomarkers are reutilized and given a new purpose. It is not always recognized that by changing a biomarker's intended use, a new biomarker assay is created. The Ki-67 biomarker is typically assessed by immunohistochemistry (IHC) to provide a proliferative index in breast cancer. Canadian laboratories assessed the analytical performance and diagnostic accuracy of their Ki-67 IHC laboratory-developed tests (LDTs) of relevance for the LDTs' clinical utility. Canadian clinical IHC laboratories enrolled in the Canadian Biomarker Quality Assurance Pilot Run for Ki-67 in breast cancer by invitation. The Dako Ki-67 IHC pharmDx assay was employed as a study reference assay. The Dako central laboratory was the reference laboratory. Participants received unstained slides of breast cancer tissue microarrays with 32 cases and performed their in-house Ki-67 assays. The results were assessed using QuPath, an open-source software application for bioimage analysis. Positive percent agreement (PPA, sensitivity) and negative percent agreement (NPA, specificity) were calculated against the Dako Ki-67 IHC pharmDx assay for 5%, 10%, 20%, and 30% cutoffs. Overall, PPA and NPA varied depending on the selected cutoff; participants were more successful with 5% and 10%, than with 20% and 30% cutoffs. Only 4 of 16 laboratories had robust IHC protocols with acceptable PPA for all cutoffs. The lowest PPA for the 5% cutoff was 85%, for 10% was 63%, for 20% was 14%, and for 30% was 13%. The lowest NPA for the 5% cutoff was 50%, for 10% was 33%, for 20% was 50%, and for 30% was 57%. Despite many years of international efforts to standardize IHC testing for Ki-67 in breast cancer, our results indicate that Canadian clinical LDTs have a wide analytical sensitivity range and poor agreement for 20% and 30% cutoffs. The poor agreement was not due to the readout but rather due to IHC protocol conditions. International Ki-67 in Breast Cancer Working Group (IKWG) recommendations related to Ki-67 IHC standardization cannot take full effect without reliable fit-for-purpose reference materials that are required for the initial assay calibration, assay performance monitoring, and proficiency testing.

Root Cause Analysis: Unraveling Common Laboratory Challenges

Diverse errors occur in a pathology laboratory and manual mistakes are the most common. There are various advancements to replace manual procedures with digitized automation techniques. Guidelines and protocols are available to run a standard pathology laboratory. But, even with such attempts to reinforce and strengthen the protocols, the complete elimination of errors is yet not possible. Root cause analysis (RCA) is the best way forward to develop an error-free laboratory, In this review, the importance of RCA, common errors taking place in laboratories, methods to carry out RCA, and its effectiveness are discussed in detail. The review also highlights the potential of RCA to provide long-term quality improvement and efficient laboratory management.

Clinical Proteomics for Solid Organ Tissues

The evaluation of biopsied solid organ tissue has long relied on visual examination using a microscope. Immunohistochemistry is critical in this process, labeling and detecting cell lineage markers and therapeutic targets. However, while the practice of immunohistochemistry has reshaped diagnostic pathology and facilitated improvements in cancer treatment, it has also been subject to pervasive challenges with respect to standardization and reproducibility. Efforts are ongoing to improve immunohistochemistry, but for some applications, the benefit of such initiatives could be impeded by its reliance on monospecific antibody-protein reagents and limited multiplexing capacity. This perspective surveys the relevant challenges facing traditional immunohistochemistry and describes how mass spectrometry, particularly liquid chromatography-tandem mass spectrometry, could help alleviate problems. In particular, targeted mass spectrometry assays could facilitate measurements of individual proteins or analyte panels, using internal standards for more robust quantification and improved interlaboratory reproducibility. Meanwhile, untargeted mass spectrometry, showcased to date clinically in the form of amyloid typing, is inherently multiplexed, facilitating the detection and crude quantification of 100s to 1000s of proteins in a single analysis. Further, data-independent acquisition has yet to be applied in clinical practice, but offers particular strengths that could appeal to clinical users. Finally, we discuss the guidance that is needed to facilitate broader utilization in clinical environments and achieve standardization.

Standardizing HER2 immunohistochemistry assessment: calibration of color and intensity variation in whole slide imaging caused by staining and scanning

In the evaluation of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) - one of the standard biomarkers for breast cancer- visual assessment is laborious and subjective. Image analysis using whole slide image (WSI) could produce more consistent results; however, color variability in WSIs due to the choice of stain and scanning processes may impact image analysis. We therefore developed a calibration protocol to diminish the staining and scanning variations of WSI using two calibrator slides. The IHC calibrator slide (IHC-CS) contains peptide-coated microbeads with different concentrations. The color distribution obtained from the WSI of stained IHC-CS reflects the staining process and scanner characteristics. A color chart slide (CCS) is also useful for calibrating the color variation due to the scanner. The results of the automated HER2 assessment were compared to confirm the effectiveness of two calibration slides. The IHC-CS and HER2 breast cancer cases were stained on different days. All stained slides and CCS were digitized by two different WSI scanners. Results revealed 100% concordance between automated evaluation and the pathologist's assessment with both the scanner and staining calibration. The proposed method may enable consistent evaluation of HER2.

Lessons Learned, Challenges Taken, and Actions Made for "Precision" Immunohistochemistry. Analysis and Perspectives From the NordiQC Proficiency Testing Program

Immunohistochemistry (IHC) has for decades been an integrated method within pathology applied to gain diagnostic, prognostic, and predictive information. However, the multimodality of the analytical phase of IHC is a challenge to ensure the reproducibility of IHC, which has been documented by external quality assessment (EQA) programs for many biomarkers. More than 600 laboratories participate in the Nordic immunohistochemical Quality Control EQA program for IHC. In the period, 2017-2021, 65 different biomarkers were assessed and a total of 31,967 results were evaluated. An overall pass rate of 79% was obtained being an improvement compared with 71% for the period, 2003-2015. The pass rates for established predictive biomarkers (estrogen receptor, progesterone receptor, and HER2) for breast carcinoma were most successful showing mean pass rates of 89% to 92%. Diagnostic IHC biomarkers as PAX8, SOX10, and different cytokeratins showed a wide spectrum of pass rates ranging from 37% to 95%, mean level of 75%, and attributed to central parameters as access to sensitive and specific antibodies but also related to purpose of the IHC test and validation performed accordingly to this. Seven new diagnostic biomarkers were introduced, and all showed inferior pass rates compared with the average level for diagnostic biomarkers emphasizing the challenge to optimize, validate, and implement new IHC biomarkers. Nordic immunohistochemical Quality Control operates by "Fit-For-Purpose" EQA principles and for programmed death-ligand 1, 2 segments are offered aligned to the "3-dimensional" approach-bridging diagnostic tests, drugs to be offered, and diseases addressed. Mean pass rates of 65% and 79% was obtained in the 2 segments for programmed death-ligand 1.

LiverQuant: An Improved Method for Quantitative Analysis of Liver Pathology

Current means to quantify cells, gene expression, and fibrosis of liver histological slides are not standardized in the research community and typically rely upon data acquired from a selection of random regions identified in each slide. As such, analyses are subject to selection bias as well as limited subsets of available data elements throughout the slide. A whole-slide analysis of cells and fibrosis would provide for a more accurate and complete quantitative analysis, along with minimization of intra- and inter-experimental variables. Herein, we present LiverQuant, a method for quantifying whole-slide scans of digitized histologic images to render a more comprehensive analysis of presented data elements. After loading images and preparing the project in the QuPath program, researchers are provided with one to two scripts per analysis that generate an average intensity threshold for their staining, automated tissue annotation, and downstream detection of their anticipated cellular matrices. When compared with two standard methodologies for histological quantification, LiverQuant had two significant advantages: increased speed and a 50-fold greater tissue area coverage. Using publicly available open-source code (GitHub), LiverQuant improves the reliability and reproducibility of experimental results while reducing the time scientists require to perform bulk analysis of liver histology. This analytical process is readily adaptable by most laboratories, requires minimal optimization, and its principles and code can be optimized for use in other organs. Graphical overview.

Novel markers in breast pathology

Breast pathology is an ever-expanding database of information which includes markers, or biomarkers, that detect or help treat the disease as prognostic or predictive information. This review focuses on these aspects of biomarkers which are grounded in immunohistochemistry, liquid biopsies and next-generation sequencing.

Root Cause Analysis (RCA) of Adverse Events in One of the Biggest Western Iranian General Hospitals: Short Communication

Background: In developing and underdeveloped countries, medical error is often either not reported or reported improperly for various reasons. Root cause analysis (RCA) is a systematic method to determine how various factors contribute to the occurrence of medical errors. Objectives: The current study analyzed the root cause of one of western Iran’s biggest general hospitals. Methods: This retrospective RCA was conducted through a qualitative approach in 2019 following the National Patient Safety Agency (NPSA) protocol in seven steps: Initialization of the process, collecting and mapping information, identifying issues related to care delivery problems (CDP) or service delivery problems (SDP), event analysis, identifying the involved factors in the event - root causes, providing solutions, implementing solutions, and submission of reports. Results: According to the results of this study, 61 cases were examined, and committees accepted the errors in 11 cases. Here, 49 CDP and 13 SDP factors were identified. Care delivery problems factors were selected for all events based on the team’s viewpoints. Overall, task-related causes (20 cases), individual causes (17 cases), management-related causes (14 cases), training-related causes (8 cases), and causes related to work environment and conditions (7 cases) were specified. Conclusions: Accepting mistakes is the first step in the hope of improvement. In this hospital, only 11 cases of mistakes had been accepted by the authorities. In most cases, the proposed solutions to this issue included personnel training, monitoring system strengthening, and developing and standardizing processes. Overall, this study and other similar studies showed errors during service delivery and through service providers.

Digital Image Analysis and Quantitative Bead Standards in Root Cause Analysis of Immunohistochemical Staining Variability: A Real-world Example

Assessment of automated immunohistochemical staining platform performance is largely limited to the visual evaluation of individual slides by trained personnel. Quantitative assessment of stain intensity is not typically performed. Here we describe our experience with 2 quantitative strategies that were instrumental in root cause investigations performed to identify the sources of suboptimal staining quality (decreased stain intensity and increased variability). In addition, these tools were utilized as adjuncts in validation of a new immunohistochemical staining instrument. The novel methods utilized in the investigation include quantitative assessment of whole slide images (WSI) and commercially available quantitative calibrators. Over the course of ~13 months, these methods helped to identify and verify correction of 2 sources of suboptimal staining. One root cause of suboptimal staining was insufficient/variable power delivery from our building's electrical circuit. This led us to use uninterruptible power managers for all automated immunostainer instruments, which restored expected stain intensity and consistency. Later, we encountered one instrument that, despite passing all vendor quality control checks and not showing error alerts was suspected of yielding suboptimal stain quality. WSI analysis and quantitative calibrators provided a clear evidence that proved critical in confirming the pathologists' visual impressions. This led to the replacement of the instrument, which was then validated using a combination of standard validation metrics supplemented by WSI analysis and quantitative calibrators. These root cause analyses document 2 variables that are critical in producing optimal immunohistochemical stain results and also provide real-world examples of how the application of quantitative tools to measure automated immunohistochemical stain output can provide a greater objectivity when assessing immunohistochemical stain quality.

Quantitative comparison of PD-L1 IHC assays against NIST standard reference material 1934

Companion diagnostic immunohistochemistry (IHC) tests are developed and performed without incorporating the tools and principles of laboratory metrology. Basic analytic assay parameters such as lower limit of detection (LOD) and dynamic range are unknown to both assay developers and end users. We solved this problem by developing completely new tools for IHC-calibrators with units of measure traceable to National Institute of Standards & Technology (NIST) Standard Reference Material (SRM) 1934. In this study, we demonstrate the clinical impact and opportunity for incorporating these changes into PD-L1 testing. Forty-one laboratories in North America and Europe were surveyed with newly-developed PD-L1 calibrators. The survey sampled a broad representation of commercial and laboratory-developed tests (LDTs). Using the PD-L1 calibrators, we quantified analytic test parameters that were previously only inferred indirectly after large clinical studies. The data show that the four FDA-cleared PD-L1 assays represent three different levels of analytic sensitivity. The new analytic sensitivity data explain why some patients' tissue samples were positive by one assay and negative by another. The outcome depends on the assay's lower LOD. Also, why previous attempts to harmonize certain PD-L1 assays were unsuccessful; the assays' dynamic ranges were too disparate and did not overlap. PD-L1 assay calibration also clarifies the exact performance characteristics of LDTs relative to FDA-cleared commercial assays. Some LDTs' analytic response curves are indistinguishable from their predicate FDA-cleared assay. IHC assay calibration represents an important transition for companion diagnostic testing. The new tools will improve patient treatment stratification, test harmonization, and foster accuracy as tests transition from clinical trials to broad clinical use.

Recent advances in nanomaterials-based electrochemical immunosensors and aptasensors for HER2 assessment in breast cancer

Human epidermal growth factor receptor 2 (HER2) is one of the key molecular targets in breast cancer pathogenesis. Overexpression and/or amplification of HER2 in approximately 15-20% of breast cancer patients is associated with high mortality and poor prognosis. Accumulating evidence shows that accurate and sensitive detection of HER2 improves the survival outcomes for HER2-positive breast cancer patients from targeted therapies. The current methods of clinical determination of HER2 expression levels are based on slide-based assays that rely on invasively collected primary tumours. Alternatively, ELISA-based detection of the shredded HER2 extracellular domain (HER2-ECD) of has been suggested as a surrogate method for monitoring disease progress and treatment response in breast cancer patients. In the past decade, biosensors have emerged as an alternative modality for the detection of circulating HER2-ECD in human serum samples. In particular, electrochemical biosensors based on nanomaterials and antibodies and aptamers have been increasingly developed as promising tools for rapid, sensitive, and cost-effective detection of HER2-ECD. These biosensors harness the high affinity and specificity of antibodies and aptamers, and unique conductive properties, biocompatibility, large surface area, and chemical stability of nanomaterials for selective and sensitive assessment of the HER2. This review provides an overview of the recent advances in the application of nanomaterials-based immunosensors and aptasensors for detection of circulating HER2-ECD. In particular, various electrochemical techniques, detection approaches, and nanomaterials are discussed. Further, analytical figures of merit of various HER2 immunosensors and aptasensors are compared. Finally, possible challenges and potential opportunities for biosensor-based detection of HER2-ECD are discussed.

Development and Validation of Measurement Traceability for In Situ Immunoassays

BACKGROUND

Immunoassays for protein analytes measured in situ support a $2 billion laboratory testing industry that suffers from significant interlaboratory disparities, affecting patient treatment. The root cause is that immunohistochemical testing lacks the generally accepted tools for analytic standardization, including reference standards and traceable units of measure. Until now, the creation of these tools has represented an insoluble technical hurdle.

METHODS

We address the need with a new concept in metrology-that is, linked traceability. Rather than calculating analyte concentration directly, which has proven too variable, we calculate concentration by measuring an attached fluorescein, traceable to NIST Standard Reference Material 1934, a fluorescein standard.

RESULTS

For validation, newly developed estrogen receptor (ER) calibrators were deployed in tandem with an array of 80 breast cancer tissue sections in a national external quality assessment program. Laboratory performance was assessed using both the ER standards and the tissue array. Similar to previous studies, the tissue array revealed substantial discrepancies in ER test results among the participating laboratories. The new ER calibrators revealed a broad range of analytic sensitivity, with the lower limits of detection ranging from 7310 to 74 790 molecules of ER. The data demonstrate, for the first time, that the variable test results correlate with analytic sensitivity, which can now be measured quantitatively.

CONCLUSIONS

The reference standard enables precise interlaboratory alignment of immunohistochemistry test sensitivity for measuring cellular proteins in situ. The introduction of a reference standard and traceable units of measure for protein expression marks an important milestone.

Conjugating immunoassays to mass spectrometry: Solutions to contemporary challenges in clinical diagnostics

Developments in immunoassays and mass spectrometry have independently influenced diagnostic technology. However, both techniques possess unique strengths and limitations, which define their ability to meet evolving requirements for faster, more affordable and more accurate clinical tests. In response, hybrid techniques, which combine the accessibility and ease-of-use of immunoassays with the sensitivity, high throughput and multiplexing capabilities of mass spectrometry are continually being explored. Developments in antibody conjugation methodology have expanded the role of these biomolecules to applications outside of conventional colorimetric assays and histology. Furthermore, the range of different mass spectrometry ionisation and analysis technologies has enabled its successful adaptation as a detection method for numerous clinically relevant immunological assays. Several recent examples of combined mass spectrometry-immunoassay techniques demonstrate the potential of these methods as improved diagnostic tests for several important human diseases. The present challenges are to continue technological advancements in mass spectrometry instrumentation and develop improved bioconjugation methods, which can overcome their existing limitations and demonstrate the clinical significance of these hybrid approaches.

Estrogen and Progesterone Receptor Testing in Breast Cancer: American Society of Clinical Oncology/College of American Pathologists Guideline Update

PURPOSE.—

To update key recommendations of the American Society of Clinical Oncology/College of American Pathologists estrogen receptor (ER) and progesterone receptor (PgR) testing in breast cancer guideline.

METHODS.—

A multidisciplinary international Expert Panel was convened to update the clinical practice guideline recommendations informed by a systematic review of the medical literature.

RECOMMENDATIONS.—

The Expert Panel continues to recommend ER testing of invasive breast cancers by validated immunohistochemistry as the standard for predicting which patients may benefit from endocrine therapy, and no other assays are recommended for this purpose. Breast cancer samples with 1% to 100% of tumor nuclei positive should be interpreted as ER positive. However, the Expert Panel acknowledges that there are limited data on endocrine therapy benefit for cancers with 1% to 10% of cells staining ER positive. Samples with these results should be reported using a new reporting category, ER Low Positive, with a recommended comment. A sample is considered ER negative if < 1% or 0% of tumor cell nuclei are immunoreactive. Additional strategies recommended to promote optimal performance, interpretation, and reporting of cases with an initial low to no ER staining result include establishing a laboratory-specific standard operating procedure describing additional steps used by the laboratory to confirm/adjudicate results. The status of controls should be reported for cases with 0% to 10% staining. Similar principles apply to PgR testing, which is used primarily for prognostic purposes in the setting of an ER-positive cancer. Testing of ductal carcinoma in situ (DCIS) for ER is recommended to determine potential benefit of endocrine therapies to reduce risk of future breast cancer, while testing DCIS for PgR is considered optional. Additional information can be found at www.asco.org/breast-cancer-guidelines .

Estrogen and Progesterone Receptor Testing in Breast Cancer: ASCO/CAP Guideline Update

PURPOSE

To update key recommendations of the American Society of Clinical Oncology/College of American Pathologists estrogen (ER) and progesterone receptor (PgR) testing in breast cancer guideline.

METHODS

A multidisciplinary international Expert Panel was convened to update the clinical practice guideline recommendations informed by a systematic review of the medical literature.

RECOMMENDATIONS

The Expert Panel continues to recommend ER testing of invasive breast cancers by validated immunohistochemistry as the standard for predicting which patients may benefit from endocrine therapy, and no other assays are recommended for this purpose. Breast cancer samples with 1% to 100% of tumor nuclei positive should be interpreted as ER positive. However, the Expert Panel acknowledges that there are limited data on endocrine therapy benefit for cancers with 1% to 10% of cells staining ER positive. Samples with these results should be reported using a new reporting category, ER Low Positive, with a recommended comment. A sample is considered ER negative if < 1% or 0% of tumor cell nuclei are immunoreactive. Additional strategies recommended to promote optimal performance, interpretation, and reporting of cases with an initial low to no ER staining result include establishing a laboratory-specific standard operating procedure describing additional steps used by the laboratory to confirm/adjudicate results. The status of controls should be reported for cases with 0% to 10% staining. Similar principles apply to PgR testing, which is used primarily for prognostic purposes in the setting of an ER-positive cancer. Testing of ductal carcinoma in situ (DCIS) for ER is recommended to determine potential benefit of endocrine therapies to reduce risk of future breast cancer, while testing DCIS for PgR is considered optional. Additional information can be found at www.asco.org/breast-cancer-guidelines.