Color Standardization and Stain Intensity Calibration for Whole Slide Image-Based Immunohistochemistry Assessment

Automated quantification of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) using whole slide imaging (WSI) is expected to eliminate subjectivity in visual assessment. However, the color intensity in WSI varies depending on the staining process and scanner device. Such variations affect the image analysis results. This paper presents methods to diminish the influence of color variation produced in the staining process using a calibrator slide consisting of peptide-coated microbeads. The calibrator slide is stained along with tissue sample slides, and the 3,3'-diaminobenzidine (DAB) color intensities of the microbeads are used for calibrating the color variation of the sample slides. An off-the-shelf image analysis tool is employed for the automated assessment, in which cells are classified by the thresholds for the membrane staining. We have adopted two methods for calibrating the color variation based on the DAB color intensities obtained from the calibrator slide: (1) thresholds for classifying the DAB membranous intensity are adjusted, and (2) the color intensity of WSI is corrected. In the experiment, the calibrator slides and tissue of breast cancer slides were stained together on different days and used to test our protocol. With the proposed protocol, the discordance in the HER2 evaluation was reduced to one slide out of 120 slides.

Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments

The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.

Standardizing HER2 immunohistochemistry assessment: calibration of color and intensity variation in whole slide imaging caused by staining and scanning

In the evaluation of human epidermal growth factor receptor 2 (HER2) immunohistochemistry (IHC) - one of the standard biomarkers for breast cancer- visual assessment is laborious and subjective. Image analysis using whole slide image (WSI) could produce more consistent results; however, color variability in WSIs due to the choice of stain and scanning processes may impact image analysis. We therefore developed a calibration protocol to diminish the staining and scanning variations of WSI using two calibrator slides. The IHC calibrator slide (IHC-CS) contains peptide-coated microbeads with different concentrations. The color distribution obtained from the WSI of stained IHC-CS reflects the staining process and scanner characteristics. A color chart slide (CCS) is also useful for calibrating the color variation due to the scanner. The results of the automated HER2 assessment were compared to confirm the effectiveness of two calibration slides. The IHC-CS and HER2 breast cancer cases were stained on different days. All stained slides and CCS were digitized by two different WSI scanners. Results revealed 100% concordance between automated evaluation and the pathologist's assessment with both the scanner and staining calibration. The proposed method may enable consistent evaluation of HER2.

Yttrium-90 Activity Quantification in PET/CT-Guided Biopsy Specimens from Colorectal Hepatic Metastases Immediately after Transarterial Radioembolization Using Micro-CT and Autoradiography

PURPOSE

To evaluate the yttrium-90 (90Y) activity distribution in biopsy tissue samples of the treated liver to quantify the dose with higher spatial resolution than positron emission tomography (PET) for accurate investigation of correlations with microscopic biological effects and to evaluate the radiation safety of this procedure.

MATERIALS AND METHODS

Eighty-six core biopsy specimens were obtained from 18 colorectal liver metastases (CLMs) immediately after 90Y transarterial radioembolization (TARE) with either resin or glass microspheres using real-time 90Y PET/CT guidance in 17 patients. A high-resolution micro-computed tomography (micro-CT) scanner was used to image the microspheres in part of the specimens and allow quantification of 90Y activity directly or by calibrating autoradiography (ARG) images. The mean doses to the specimens were derived from the measured specimens' activity concentrations and from the PET/CT scan at the location of the biopsy needle tip for all cases. Staff exposures were monitored.

RESULTS

The mean measured 90Y activity concentration in the CLM specimens at time of infusion was 2.4 ± 4.0 MBq/mL. The biopsies revealed higher activity heterogeneity than PET. Radiation exposure to the interventional radiologists during post-TARE biopsy procedures was minimal.

CONCLUSIONS

Counting the microspheres and measuring the activity in biopsy specimens obtained after TARE are safe and feasible and can be used to determine the administered activity and its distribution in the treated and biopsied liver tissue with high spatial resolution. Complementing 90Y PET/CT imaging with this approach promises to yield more accurate direct correlation of histopathological changes and absorbed dose in the examined specimens.

Pathological Evaluation of Rectal Cancer Specimens Using Micro-Computed Tomography

Whole-block imaging (WBI) using micro-computed tomography (micro-CT) allows the nondestructive reconstruction of a three-dimensional view of tissues, implying that WBI may be used for accurate pathological evaluation of patients with rectal cancer. HOWEVER, the clinical impact of this approach is unclear. We aimed to clarify the efficacy of WBI in the whole-mount specimens of locally advanced rectal cancer. A total of 237 whole-mount formalin-fixed paraffin-embedded blocks from 13 patients with rectal cancer who underwent surgical treatment were enrolled and scanned with micro-CT to generate three-dimensional images. WBI was evaluated following the conventional pathological review of the corresponding whole-slide imaging (WSI). WBI identified all tumor sites detected using WSI. Furthermore, WBI revealed one additional tumor site, which was not detected using WSI. Tumor resection margin was significantly closer to the soft-tissue edge when measured using WBI (7.7 mm vs. 6.6 mm, p < 0.01). Seventy-six percent of tumor deposits on WSI were changed according to the evidence of tumor interaction with the surrounding tissues confirmed using WBI. Furthermore, WBI revealed 25 additional lymph nodes, six of which were metastatic. The combination of conventional hematoxylin and eosin-stained imaging and WBI may contribute to an accurate pathological assessment.

Micro-computed tomography: A novel diagnostic technique for the evaluation of gastrointestinal specimens

Micro-computed tomography (micro-CT) is a non-destructive modality that can be used to obtain high-resolution three-dimensional (3 D) images of the whole sample tissue; the usefulness of micro-CT has been reported for evaluation of breast cancer and lung cancer. However, this novel diagnostic technique has never been used for evaluating endoscopically resected gastrointestinal specimens. In the present study, we scanned 13 formalin-fixed paraffin-embedded (FFPE) tissue blocks of a normal human colon and gastric tissue samples using micro-CT. The evaluation comprised a comparison of the acquired whole block images with the images of the corresponding cross-sectional slice of the hematoxylin and eosin-stained slide. Micro-CT was able to produce images of the whole sample and clearly depict tissues such as glandular structures, muscularis mucosae, and blood vessels in the FFPE tissue blocks of normal gastrointestinal samples. Furthermore, the 3 D reconstructed could be used to create a cross-sectional image and reflected the surface structure of samples obtained from any site. Micro-CT has the potential to become a highly promising pathological diagnostic assistance tool for endoscopically resected gastrointestinal specimens in combination with conventional microscopic examination.

Counting mitoses: SI(ze) matters!

Mitoses are often assessed by pathologists to assist the diagnosis of cancer, and to grade malignancy, informing prognosis. Historically, this has been done by expressing the number of mitoses per n high power fields (HPFs), ignoring the fact that microscope fields may differ substantially, even at the same high power (×400) magnification. Despite a requirement to define HPF size in scientific papers, many authors fail to address this issue adequately. The problem is compounded by the switch to digital pathology systems, where ×400 equivalent fields are rectangular and also vary in the area displayed. The potential for error is considerable, and at times this may affect patient care. This is easily solved by the use of standardized international (SI) units. We, therefore, recommend that features such as mitoses are always counted per mm2, with an indication of the area to be counted and the method used (usually "hotspot" or "average") to obtain the results.

Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center

OBJECTIVE

Broad adoption of digital pathology (DP) is still lacking, and examples for DP connecting diagnostic, research, and educational use cases are missing. We blueprint a holistic DP solution at a large academic medical center ubiquitously integrated into clinical workflows; researchapplications including molecular, genetic, and tissue databases; and educational processes.

MATERIALS AND METHODS

We built a vendor-agnostic, integrated viewer for reviewing, annotating, sharing, and quality assurance of digital slides in a clinical or research context. It is the first homegrown viewer cleared by New York State provisional approval in 2020 for primary diagnosis and remote sign-out during the COVID-19 (coronavirus disease 2019) pandemic. We further introduce an interconnected Honest Broker for BioInformatics Technology (HoBBIT) to systematically compile and share large-scale DP research datasets including anonymized images, redacted pathology reports, and clinical data of patients with consent.

RESULTS

The solution has been operationally used over 3 years by 926 pathologists and researchers evaluating 288 903 digital slides. A total of 51% of these were reviewed within 1 month after scanning. Seamless integration of the viewer into 4 hospital systems clearly increases the adoption of DP. HoBBIT directly impacts the translation of knowledge in pathology into effective new health measures, including artificial intelligence-driven detection models for prostate cancer, basal cell carcinoma, and breast cancer metastases, developed and validated on thousands of cases.

CONCLUSIONS

We highlight major challenges and lessons learned when going digital to provide orientation for other pathologists. Building interconnected solutions will not only increase adoption of DP, but also facilitate next-generation computational pathology at scale for enhanced cancer research.

Conditions, possibility and priority for admission into inpatient hospice/palliative care units in Japan: a nationwide survey

BACKGROUND

Known barriers to admission into inpatient hospice/palliative care units (PCUs) include poor accessibility and stringent conditions for admission. However, the exact criteria are unclear. The aim of this study was to clarify the actual conditions, possibilities and priorities for admission to PCU in Japan.

METHODS

We conducted a nationwide, anonymous, self-administered questionnaire survey to the responsible physicians of all 251 PCUs in 2014.

RESULTS

Responses were received from 190 institutions (response rate 76%). The most frequent condition for admission was 'either the patient or the family knows the diagnosis' [86%, 95% confidence interval (CI): 80-90]. For the conditions for admission to PCU, 10-40% fewer facilities answered that the patient's consent or understanding was required compared with those that answered the patient or family's consent was sufficient. Seventy-one percent (95% CI: 64-77) of PCUs answered that either the patient or a family member needed to agree to a do-not-resuscitate (DNR) policy. The factors most likely to result in refusal of admission to a PCU varied greatly. Ninety-four percent (95% CI: 90-97) of PCUs answered that patients who had undergone a long waiting time after applying for admission would be given higher priority, and approximately 50% of PCUs answered they gave priority to their outpatients and inpatients.

CONCLUSIONS

The findings of this study should be used to modify the system so that appropriate palliative care can be provided to patients who wish to be admitted to PCU.

Multifaceted array-based keloidal gene expression profiling reveals specific MDFI upregulation in keloid lesions

BACKGROUND

Keloid lesions are characterized by mesenchymal cell proliferation and excessive extracellular matrix deposition. Previous microarray analyses have been performed to investigate the mechanism of keloid development. However, the molecular pathology that contributes to keloid development remains obscure.

AIM

To explore the underlying essential molecules of keloids using microarrays.

METHODS

We performed microarray analyses of keloid and nonlesional skin tissues both in vivo and in vitro. Gene expression levels were compared between tissues and cells. Quantitative reverse transcription (qRT)-PCR and immunohistochemical staining were used to determine the expression levels of molecules of interest in keloid tissues.

RESULTS

Several common molecules were upregulated in both keloid tissues and keloid-lesional fibroblasts. PTPRD and NTM were upregulated both in vivo and in vitro. The genes MDFI and ITGA4 were located at the centre of the gene coexpression network analysis using keloid tissues. qRT-PCR revealed significant expression levels of PTPRD and MDFI in keloid tissues. Immunopathological staining revealed that MDFI-positive cells, which have fibroblast characteristics, were located in the keloid-associated lymphoid tissue (KALT) portion of the keloid tissue.

CONCLUSION

Our gene expression profiles of keloids could distinguish the difference between lesional tissue and cultured lesional fibroblasts, and MDFI was found to be commonly expressed in both tissues and cells. Thus, MDFI-positive cells, which were located in the KALT, may play an important role in keloid pathogenesis and thus might be useful for in vitro keloid studies.

Automated 3D scoring of fluorescence in situ hybridization (FISH) using a confocal whole slide imaging scanner

Fluorescence in situ hybridization (FISH) is a technique to visualize specific DNA/RNA sequences within the cell nuclei and provide the presence, location and structural integrity of genes on chromosomes. A confocal Whole Slide Imaging (WSI) scanner technology has superior depth resolution compared to wide-field fluorescence imaging. Confocal WSI has the ability to perform serial optical sections with specimen imaging, which is critical for 3D tissue reconstruction for volumetric spatial analysis. The standard clinical manual scoring for FISH is labor-intensive, time-consuming and subjective. Application of multi-gene FISH analysis alongside 3D imaging, significantly increase the level of complexity required for an accurate 3D analysis. Therefore, the purpose of this study is to establish automated 3D FISH scoring for z-stack images from confocal WSI scanner. The algorithm and the application we developed, SHIMARIS PAFQ, successfully employs 3D calculations for clear individual cell nuclei segmentation, gene signals detection and distribution of break-apart probes signal patterns, including standard break-apart, and variant patterns due to truncation, and deletion, etc. The analysis was accurate and precise when compared with ground truth clinical manual counting and scoring reported in ten lymphoma and solid tumors cases. The algorithm and the application we developed, SHIMARIS PAFQ, is objective and more efficient than the conventional procedure. It enables the automated counting of more nuclei, precisely detecting additional abnormal signal variations in nuclei patterns and analyzes gigabyte multi-layer stacking imaging data of tissue samples from patients. Currently, we are developing a deep learning algorithm for automated tumor area detection to be integrated with SHIMARIS PAFQ.

Using Automated Machine Learning to Predict the Mortality of Patients With COVID-19: Prediction Model Development Study

BACKGROUND

During a pandemic, it is important for clinicians to stratify patients and decide who receives limited medical resources. Machine learning models have been proposed to accurately predict COVID-19 disease severity. Previous studies have typically tested only one machine learning algorithm and limited performance evaluation to area under the curve analysis. To obtain the best results possible, it may be important to test different machine learning algorithms to find the best prediction model.

OBJECTIVE

In this study, we aimed to use automated machine learning (autoML) to train various machine learning algorithms. We selected the model that best predicted patients' chances of surviving a SARS-CoV-2 infection. In addition, we identified which variables (ie, vital signs, biomarkers, comorbidities, etc) were the most influential in generating an accurate model.

METHODS

Data were retrospectively collected from all patients who tested positive for COVID-19 at our institution between March 1 and July 3, 2020. We collected 48 variables from each patient within 36 hours before or after the index time (ie, real-time polymerase chain reaction positivity). Patients were followed for 30 days or until death. Patients' data were used to build 20 machine learning models with various algorithms via autoML. The performance of machine learning models was measured by analyzing the area under the precision-recall curve (AUPCR). Subsequently, we established model interpretability via Shapley additive explanation and partial dependence plots to identify and rank variables that drove model predictions. Afterward, we conducted dimensionality reduction to extract the 10 most influential variables. AutoML models were retrained by only using these 10 variables, and the output models were evaluated against the model that used 48 variables.

RESULTS

Data from 4313 patients were used to develop the models. The best model that was generated by using autoML and 48 variables was the stacked ensemble model (AUPRC=0.807). The two best independent models were the gradient boost machine and extreme gradient boost models, which had an AUPRC of 0.803 and 0.793, respectively. The deep learning model (AUPRC=0.73) was substantially inferior to the other models. The 10 most influential variables for generating high-performing models were systolic and diastolic blood pressure, age, pulse oximetry level, blood urea nitrogen level, lactate dehydrogenase level, D-dimer level, troponin level, respiratory rate, and Charlson comorbidity score. After the autoML models were retrained with these 10 variables, the stacked ensemble model still had the best performance (AUPRC=0.791).

CONCLUSIONS

We used autoML to develop high-performing models that predicted the survival of patients with COVID-19. In addition, we identified important variables that correlated with mortality. This is proof of concept that autoML is an efficient, effective, and informative method for generating machine learning-based clinical decision support tools.

Detection and assessment of capsular invasion, vascular invasion and lymph node metastasis volume in thyroid carcinoma using microCT scanning of paraffin tissue blocks (3D whole block imaging): a proof of concept

In the modern era, detailed pathologic characteristics of a thyroid tumor are crucial to achieve accurate diagnosis and guide treatment. The presence of capsular invasion (CI) is diagnostic for carcinoma, whereas vascular invasion (VI) and nodal metastasis (NM) are included in risk stratification. However, the very definition of CI and VI is surrounded by controversies and an accurate assessment of NM is lacking. Whole Block Imaging (WBI) by microCT is a new imaging modality to create 3D reconstruction of whole tissue block with microscopic level resolution without the need for tissue sectioning. In this study, we aimed to define CI, VI, and NM volume using WBI by microCT. Twenty-eight paraffin blocks (PBs) from 26 thyroid tumors were scanned. Ten PBs contained CI, whereas 7 had VI. 3D microCT images were compared with whole slide images (WSI) of corresponding H&E slides. In 2 cases with VI and/or CI, WSI of serial H&E slides were obtained and underwent 3D-reconstruction to be compared with the WBI. Satellite tumor nodules beyond tumor capsule were shown to be CI by demonstrating the point of penetration using microCT and 3D reconstruction. Additional foci of CI were detected using microCT. VI was seen using microCT. Fibrin associated with tumor thrombus was not always present on serially sectioned H&E slides. WBI by microCT scanner was able to assess the volume of NM. In conclusion, WBI is able to detect CI, VI, and assess the volume of NM in thyroid carcinoma without tissue sectioning. It is the ultimate method for the complete sampling of the tumor capsule. It has the potential to increase the detection rate of CI, better define criteria for CI and VI, and provide an accurate assessment of the volume of nodal disease. This technology may impact the future practice of surgical pathology.

Impact of door-to-deployment time of venoarterial extracorporeal membrane oxygenation for out-of-hospital refractory cardiac arrest patients secondary to cardiovascular causes

Background

Door-to-balloon time in patients with ST-elevation myocardial infarction is reported to be an independent predictor of the prognostic implication. However, the effect of door-to-deployment time (DTDT) of venoarterial extracorporeal membrane oxygenation (VA-ECMO) on patients with out-of-hospital cardiac arrest (OHCA) is unclear.

Purpose

This single-center, retrospective, observational study aimed to evaluate the effect of DTDT of VA-ECMO for mortality or neurological outcome of extracorporeal cardiopulmonary resuscitation (ECPR) in patients with cardiogenic OHCA.

Method

This single-center, retrospective, observational study was conducted from January 2008 to April 2019. The primary endpoint was 1-month overall survival measured after ECMO initiation. Moreover, the secondary endpoint was 1-month survival with favorable neurological functions defined as having a cerebral performance category score of 1 or 2.

Result

A total of 3082 patients with OHCA were brought to our institution and 84 received ECPR. Of these, 51 consecutive adult patients with cardiogenic OHCA without sustained return of spontaneous circulation during transport were included in this analysis. Approximately 18 patients (18/51, 35.3%) survived after 1 month and were discharged. Among the survivors, 15 (15/18, 83.3%) were discharged with a favorable neurological outcome. The baseline characteristics between the survivors and non-survivors were not significantly different, except for the initial shockable rhythm [18/18 (100%) versus 28/33 (84.9%), P=0.03]. There were no significant differences between the median time from collapse to hospital arrival [31.0 min (IQR 25.0–31.0) versus 29.0 min (IQR 25.0–39.5), P=0.53] and from call to hospital arrival [28.0 min (IQR 22.0–32.5) versus 27.0 min (IQR 23.3–34.5), P=0.56]. The median DTDT of VA-ECMO was significantly shorter in survivors [13.0 min (IQR 11.5–18.3) versus 21.0 minutes (IQR 15.5–32.0), P=0.01]. The Kaplan–Meier survival analysis showed that the group with a DTDT ≤20 min had a significantly higher 1-month overall survival rate (P&lt;0.01) and survival rate with a favorable neurological outcome (P=0.01) than that with a DTDT &gt;20 minutes. Using the Cox proportional hazards analysis, DTDT ≤20 minutes and bystander-witnessed significantly affected the overall survival rate at 1 month [adjusted hazard ratio (HR), 0.44; 95% confidence interval (CI), 0.20–0.95; P=0.03 and adjusted HR, 0.31; 95% CI, 0.13–0.74; P&lt;0.01, respectively]. Regarding survival rate with a favorable neurological outcome, the result was relatively similar [adjusted HR, 0.46; 95% CI, 0.22–0.96; P=0.04 and adjusted HR, 0.37; 95% CI, 0.16–0.85; P=0.02, respectively].

Conclusion

This study revealed that the DTDT of VA-ECMO is significantly associated with the 1-month mortality and neurological prognosis of patients with cardiogenic OHCA. However, further studies will be required to confirm these findings.

Kaplan-Meier survival curve

Funding Acknowledgement

Type of funding source: None

Color standardization and optimization in whole slide imaging

Whole slide imaging (WSI) has various uses, including the development of decision support systems, image analysis, education, conferences, and remote diagnostics. It is also used to develop artificial intelligence using machine learning methods. In the clinical setting, however, many issues have hindered the implementation of WSI. These issues are becoming more important as WSI is gaining wider use in clinical practice, particularly with the implementation of artificial intelligence in pathological diagnosis. One of the most important issues is the standardization of color for WSI, which is an important component of digital pathology. In this paper, we review the major factors of color variation and how to evaluate and modify color variation to establish color standardization. There are five major reasons for color variation, which include specimen thickness, staining, scanner, viewer, and display. Recognizing that the color is not standardized is the first step towards standardization, and it is difficult to ascertain whether the appropriate color of the WSI is displayed at the reviewers' end.

Banff Digital Pathology Working Group: Going digital in transplant pathology

The Banff Digital Pathology Working Group (DPWG) was formed in the time leading up to and during the joint American Society for Histocompatibility and Immunogenetics/Banff Meeting, September 23-27, 2019, held in Pittsburgh, Pennsylvania. At the meeting, the 14th Banff Conference, presentations directly and peripherally related to the topic of "digital pathology" were presented; and discussions before, during, and after the meeting have resulted in a list of issues to address for the DPWG. Included are practice standardization, integrative approaches for study classification, scoring of histologic parameters (eg, interstitial fibrosis and tubular atrophy and inflammation), algorithm classification, and precision diagnosis (eg, molecular pathways and therapeutics). Since the meeting, a survey with international participation of mostly pathologists (81%) was conducted, showing that whole slide imaging is available at the majority of centers (71%) but that artificial intelligence (AI)/machine learning was only used in ≈12% of centers, with a wide variety of programs/algorithms employed. Digitalization is not just an end in itself. It also is a necessary precondition for AI and other approaches. Discussions at the meeting and the survey highlight the unmet need for a Banff DPWG and point the way toward future contributions that can be made.

Three-Dimensional Histologic, Immunohistochemical, and Multiplex Immunofluorescence Analyses of Dynamic Vessel Co-Option of Spread Through Air Spaces in Lung Adenocarcinoma

INTRODUCTION

Spread through air spaces (STAS) is a method of invasion in lung adenocarcinoma and is associated with tumor recurrence and poor survival. The spatial orientation of STAS cells in the lung alveolar parenchyma is not known. The aim of this study was to use high-resolution and high-quality three-dimensional (3D) reconstruction of images from immunohistochemical (IHC) and multiplex immunofluorescence (IF) experiments to understand the spatial architecture of tumor cell clusters by STAS in the lung parenchyma.

METHODS

Four lung adenocarcinomas, three micropapillary-predominant and one solid predominant adenocarcinoma subtypes, were investigated. A 3D reconstruction image was created from formalin-fixed, paraffin-embedded blocks. A total of 350 serial sections were obtained and subjected to hematoxylin and eosin (100 slides), IHC (200 slides), and multiplex IF staining (50 slides) with the following antibodies: cluster of differentiation 31, collagen type IV, thyroid transcription factor-1, and E-cadherin. Whole slide images were reconstructed into 3D images for evaluation.

RESULTS

Serial 3D image analysis by hematoxylin and eosin, IHC, and IF staining revealed that the micropapillary clusters and solid nests of STAS are focally attached to the alveolar walls, away from the main tumor.

CONCLUSIONS

Our 3D reconstructions found that STAS tumor cells can attach to the alveolar walls rather than appearing free floating, as seen on the two-dimensional sections. This suggests that the tumor cells detach from the main tumor, migrate through air spaces, and reattach to the alveolar walls through vessel co-option, allowing them to survive and grow. This may explain the higher recurrence rate and worse survival of patients with STAS-positive tumors who undergo limited resection than those who undergo lobectomy.

Automatic quantification of HER2 gene amplification in invasive breast cancer from chromogenic in situ hybridization whole slide images

Human epidermal growth factor receptor 2 (HER2), a transmembrane tyrosine kinase receptor encoded by the ERBB2 gene on chromosome 17q12, is a predictive and prognostic biomarker in invasive breast cancer (BC). Approximately 20% of BC are HER2-positive as a result of ERBB2 gene amplification and overexpression of the HER2 protein. Quantification of HER2 is performed routinely on all invasive BCs, to assist in clinical decision making for prognosis and treatment for HER2-positive BC patients by manually counting gene signals. We propose an automated system to quantify the HER2 gene status from chromogenic in situ hybridization (CISH) whole slide images (WSI) in invasive BC. The proposed method selects untruncated and nonoverlapped singular nuclei from the cancer regions using color unmixing and machine learning techniques. Then, HER2 and chromosome enumeration probe 17 (CEP17) signals are detected based on the RGB intensity and counted per nucleus. Finally, the HER2-to-CEP17 signal ratio is calculated to determine the HER2 amplification status following the ASCO/CAP 2018 guidelines. The proposed method reduced the labor and time for the quantification. In the experiment, the correlation coefficient between the proposed automatic CISH quantification method and pathologist manual enumeration was 0.98. The p -values larger than 0.05 from the one-sided paired t -test ensured that the proposed method yields statistically indifferent results to the reference method. The method was established on WSI scanned by two different scanners. Through the experiments, the capability of the proposed system has been demonstrated.

Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners

BACKGROUND

The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope.

METHODS

Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen's Kappa and determined "true" MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity.

RESULTS

In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly "substantial" or greater (Kappa = 0.594-0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001).

CONCLUSIONS

This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.

Implementation of Digital Pathology Offers Clinical and Operational Increase in Efficiency and Cost Savings

CONTEXT.—

Digital pathology (DP) implementations vary in scale, based on aims of intended operation. Few laboratories have completed a full-scale DP implementation, which may be due to high overhead costs that disrupt the traditional pathology workflow. Neither standardized criteria nor benchmark data have yet been published showing practical return on investment after implementing a DP platform.

OBJECTIVE.—

To provide benchmark data and practical metrics to support operational efficiency and cost savings in a large academic center.

DESIGN.—

Metrics reviewed include archived pathology asset retrieval; ancillary test request for recurrent/metastatic disease; cost analysis and turnaround time (TAT); and DP experience survey.

RESULTS.—

Glass slide requests from the department slide archive and an off-site surgery center showed a 93% and 97% decrease, respectively. Ancillary immunohistochemical orders, compared in 2014 (52%)-before whole slide images (WSIs) were available in the laboratory information system-and 2017 (21%) showed $114 000/y in anticipated savings. Comprehensive comparative cost analysis showed a 5-year $1.3 million savings. Surgical resection cases with prior WSIs showed a 1-day decrease in TAT. A DP experience survey showed 80% of respondents agreed WSIs improved their clinical sign-out experience.

CONCLUSIONS.—

Implementing a DP operation showed a noteworthy increase in efficiency and operational utility. Digital pathology deployments and operations may be gauged by the following metrics: number of glass slide requests as WSIs become available, decrease in confirmatory testing for patients with metastatic/recurrent disease, long-term decrease in off-site pathology asset costs, and faster TAT. Other departments may use our benchmark data and metrics to enhance patient care and demonstrate return on investment to justify adoption of DP.

The Importance of eSlide Macro Images for Primary Diagnosis with Whole Slide Imaging

Introduction:

A whole slide image (WSI) is typically comprised of a macro image (low-power snapshot of the entire glass slide) and stacked tiles in a pyramid structure (with the lowest resolution thumbnail at the top). The macro image shows the label and all pieces of tissue on the slide. Many whole slide scanner vendors do not readily show the macro overview to pathologists. We demonstrate that failure to do so may result in a serious misdiagnosis.

Materials and Methods:

Various examples of errors were accumulated that occurred during the digitization of glass slides where the virtual slide differed from the macro image of the original glass slide. Such examples were retrieved from pathology laboratories using different types of scanners in the USA, Canada, Europe, and Asia.

Results:

The reasons for image errors were categorized into technical problems (e.g., automatic tissue finder failure, image mismatches, and poor scan coverage) and human operator mistakes (e.g., improper manual region of interest selection). These errors were all detected because they were highlighted in the macro image.

Conclusion:

Our experience indicates that WSI can be subject to inadvertent errors related to glitches in scanning slides, corrupt images, or mistakes made by humans when scanning slides. Displaying the macro image that accompanies WSIs is critical from a quality control perspective in digital pathology practice as this can help detect these serious image-related problems and avoid compromised diagnoses.

Quality control of hospital preparations: Establishment of a simple and rapid method for quantifying ulinastatin in vaginal suppositories

Ulinastatin vaginal suppositories, used to prevent threatened premature delivery, are frequently used in hospitals. However, there is no established method for quantifying ulinastatin contained in suppositories. Therefore, we investigated a simple and efficient method for quantifying ulinastatin contained in suppositories. Our analytical method involved removal of the base; optimising the enzyme inhibition reaction time and enzyme reaction time; and measuring the absorbance. The modified method was reproducible, operation time was significantly shortened, and cost was reduced to approximately 1/17 of that of the previously reported method. This simple and rapid quantitative method could contribute to the improvement of quality control of ulinastatin vaginal suppositories as an extemporaneous hospital preparation.

Laparoscopic ventral rectopexy in patients with fecal incontinence associated with rectoanal intussusception: prospective evaluation of clinical, physiological and morphological changes

BACKGROUND

Physiological changes after laparoscopic ventral rectopexy (LVR) in patients with rectoanal intussusception (RAI) remain unclear. This study was undertaken to evaluate physiological and morphological changes after LVR for RAI, and to study clinical outcomes following LVR with special reference to fecal incontinence (FI).

METHODS

The study was conducted on patients who had LVR for RAI between February 2012 and December 2016 at our institution Patients with RAI and FI were included in the study. Patients with RAI and obstructed defecation and those with RAI and neurologic FI were not included. The patients had anorectal manometry preoperatively, and 3, 6, and 12 months postoperatively. Defecography was performed before and 6 months after the procedure. FI was evaluated using the Fecal Incontinence Severity Index (FISI).

RESULTS

There were 34 patients (median age 77 years (range 60-93) years). Thirty-two patients (94%) were female and the median number of vaginal deliveries was 2 (range 0-5). Neither maximum resting pressure nor maximum squeeze pressure increased postoperatively. There was an overall increase in both defecatory desire volume (median preoperative 75 ml vs. 90 ml at 12 months; p = 0.002) and maximum tolerated volume (median preoperative 145 ml vs.175 ml at 12 months; p = 0.002). Postoperatively, RAI was eliminated in all patients but one, although 13 had residual rectorectal intussusception found at defecography. There was an overall reduction in both rectocele size (median preop 29 mm vs. postop 10 mm; p = 0.008) and pelvic floor descent (median preop 26 mm vs. postop 20 mm; p = 0.005). Twelve months after surgery, a reduction of at least 50% was observed in the FISI score for 31 incontinent patients (91%).

CONCLUSIONS

LVR for RAI produced adequate improvement of FI, and successful anatomical correction of RAI was confirmed by postoperative proctography. Postoperative increase in the rectal volume may have a positive effect on continence.

Temporal and spatial variations of 134Cs and 137Cs levels in the Sea of Japan and Pacific coastal region: Implications for dispersion of FDNPP-derived radiocesium

To investigate the dispersion of Fukushima Dai-ichi Nuclear Power Plant (FDNPP)-derived radiocesium in the Sea of Japan and western Pacific coastal region and determine the sources of radiocesium in these areas, we examined the temporal and spatial variations of ¹³⁴Cs and ¹³⁷Cs concentrations (activities) during 2011-2016 in seawaters around the western Japanese Archipelago, particularly in the Sea of Japan. In May 2013, the surface concentration of ¹³⁴Cs was ∼0.5 mBq/L (decay-corrected to March 11, 2011), and that of ¹³⁷Cs exceeded the pre-accident level in this study area, where the effects of radiocesium depositions just after the FDNPP accident disappeared in surface waters in October 2011. Subsequently, radiocesium concentrations gradually increased during 2013-2016 (∼0.5-1 mBq/L for ¹³⁴Cs), exhibiting approximately homogeneous distributions in each year. The temporal and spatial variations of ¹³⁴Cs and ¹³⁷Cs concentrations indicated that FDNPP-derived radiocesium around the western Japanese Archipelago, including the Sea of Japan, has been supported by the Kuroshio Current and its branch, Tsushima Warm Current, during 2013-2016. However, in the Sea of Japan, the penetration of ¹³⁴Cs was limited to depths of less than ∼200 m during three years following the re-delivery of FDNPP-derived radiocesium.

Three-dimensional Imaging and Scanning: Current and Future Applications for Pathology

Imaging is vital for the assessment of physiologic and phenotypic details. In the past, biomedical imaging was heavily reliant on analog, low-throughput methods, which would produce two-dimensional images. However, newer, digital, and high-throughput three-dimensional (3D) imaging methods, which rely on computer vision and computer graphics, are transforming the way biomedical professionals practice. 3D imaging has been useful in diagnostic, prognostic, and therapeutic decision-making for the medical and biomedical professions. Herein, we summarize current imaging methods that enable optimal 3D histopathologic reconstruction: Scanning, 3D scanning, and whole slide imaging. Briefly mentioned are emerging platforms, which combine robotics, sectioning, and imaging in their pursuit to digitize and automate the entire microscopy workflow. Finally, both current and emerging 3D imaging methods are discussed in relation to current and future applications within the context of pathology.

A Study of the Growth Patterns of Breast Carcinoma Using 3D Reconstruction: A Pilot Study

Lumpectomy with microscopically clear margins is a safe and effective approach for surgical management of breast carcinoma. Margins are positive for tumor in 18-50% of lumpectomies, as it is not possible to accurately determine the shape or microscopic borders of a tumor preoperatively or intraoperatively. We examined the 3D microanatomy and growth patterns of common breast carcinoma subtypes to provide guidance for lumpectomy surgery. Prospective consent was obtained for the use of excess tissue from patients undergoing lumpectomy or mastectomy for breast carcinoma. Tissue blocks from nine breast carcinomas were serially sectioned. Hematoxylin and eosin-stained slides at 100 μm intervals were scanned using a Nanozoomer (Hamamatsu, Japan) microscopic-resolution scanner. Three-dimensional reconstructions of tumors were created from scanned images using Reconstruct, open-access software. Breast carcinoma subtypes demonstrated characteristic growth patterns within breast tissue, which may have implications for lumpectomy surgery. Invasive ductal carcinomas showed a spherical shape, with a spiculated surface representing tumor cells infiltrating into surrounding parenchyma. Ductal carcinoma in situ appeared to spread along the duct system, creating dilated, tortuous, tumor-filled ducts. The invasive lobular carcinomas examined had a haphazard, linear, infiltrative growth pattern, different from the shape seen in ductal carcinomas. Our preliminary work suggests that invasive ductal and invasive lobular carcinomas appear to have distinct growth patterns in three dimensions and ductal carcinoma in situ appears to grow in a linear fashion along the duct network. The microanatomy studies described have the potential to guide refinements in breast lumpectomy technique.

Deformable image registration between pathological images and MR image via an optical macro image

Computed tomography (CT) and magnetic resonance (MR) imaging have been widely used for visualizing the inside of the human body. However, in many cases, pathological diagnosis is conducted through a biopsy or resection of an organ to evaluate the condition of tissues as definitive diagnosis. To provide more advanced information onto CT or MR image, it is necessary to reveal the relationship between tissue information and image signals. We propose a registration scheme for a set of PT images of divided specimens and a 3D-MR image by reference to an optical macro image (OM image) captured by an optical camera. We conducted a fundamental study using a resected human brain after the death of a brain cancer patient. We constructed two kinds of registration processes using the OM image as the base for both registrations to make conversion parameters between the PT and MR images. The aligned PT images had shapes similar to the OM image. On the other hand, the extracted cross-sectional MR image was similar to the OM image. From these resultant conversion parameters, the corresponding region on the PT image could be searched and displayed when an arbitrary pixel on the MR image was selected. The relationship between the PT and MR images of the whole brain can be analyzed using the proposed method. We confirmed that same regions between the PT and MR images could be searched and displayed using resultant information obtained by the proposed method. In terms of the accuracy of proposed method, the TREs were 0.56±0.39mm and 0.87±0.42mm. We can analyze the relationship between tissue information and MR signals using the proposed method.

EGFR Mutations and ALK Rearrangements Are Associated with Low Response Rates to PD-1 Pathway Blockade in Non-Small Cell Lung Cancer: A Retrospective Analysis

PURPOSE

PD-1 inhibitors are established agents in the management of non-small cell lung cancer (NSCLC); however, only a subset of patients derives clinical benefit. To determine the activity of PD-1/PD-L1 inhibitors within clinically relevant molecular subgroups, we retrospectively evaluated response patterns among EGFR-mutant, anaplastic lymphoma kinase (ALK)-positive, and EGFR wild-type/ALK-negative patients.

EXPERIMENTAL DESIGN

We identified 58 patients treated with PD-1/PD-L1 inhibitors. Objective response rates (ORR) were assessed using RECIST v1.1. PD-L1 expression and CD8(+) tumor-infiltrating lymphocytes (TIL) were evaluated by IHC.

RESULTS

Objective responses were observed in 1 of 28 (3.6%) EGFR-mutant or ALK-positive patients versus 7 of 30 (23.3%) EGFR wild-type and ALK-negative/unknown patients (P = 0.053). The ORR among never- or light- (≤10 pack years) smokers was 4.2% versus 20.6% among heavy smokers (P = 0.123). In an independent cohort of advanced EGFR-mutant (N = 68) and ALK-positive (N = 27) patients, PD-L1 expression was observed in 24%/16%/11% and 63%/47%/26% of pre-tyrosine kinase inhibitor (TKI) biopsies using cutoffs of ≥1%, ≥5%, and ≥50% tumor cell staining, respectively. Among EGFR-mutant patients with paired, pre- and post-TKI-resistant biopsies (N = 57), PD-L1 expression levels changed after resistance in 16 (28%) patients. Concurrent PD-L1 expression (≥5%) and high levels of CD8(+) TILs (grade ≥2) were observed in only 1 pretreatment (2.1%) and 5 resistant (11.6%) EGFR-mutant specimens and was not observed in any ALK-positive, pre- or post-TKI specimens.

CONCLUSIONS

NSCLCs harboring EGFR mutations or ALK rearrangements are associated with low ORRs to PD-1/PD-L1 inhibitors. Low rates of concurrent PD-L1 expression and CD8(+) TILs within the tumor microenvironment may underlie these clinical observations. Clin Cancer Res; 22(18); 4585-93. ©2016 AACRSee related commentary by Gettinger and Politi, p. 4539.

Development of a 2D Image Reconstruction and Viewing System for Histological Images from Multiple Tissue Blocks: Towards High-Resolution Whole-Organ 3D Histological Images

High-resolution 3D histology image reconstruction of the whole brain organ starts from reconstructing the high-resolution 2D histology images of a brain slice. In this paper, we introduced a method to automatically align the histology images of thin tissue sections cut from the multiple paraffin-embedded tissue blocks of a brain slice. For this method, we employed template matching and incorporated an optimization technique to further improve the accuracy of the 2D reconstructed image. In the template matching, we used the gross image of the brain slice as a reference to the reconstructed 2D histology image of the slice, while in the optimization procedure, we utilized the Jaccard index as the metric of the reconstruction accuracy. The results of our experiment on the initial 3 different whole-brain tissue slices showed that while the method works, it is also constrained by tissue deformations introduced during the tissue processing and slicing. The size of the reconstructed high-resolution 2D histology image of a brain slice is huge, and designing an image viewer that makes particularly efficient use of the computing power of a standard computer used in our laboratories is of interest. We also present the initial implementation of our 2D image viewer system in this paper.