Diagnostic concordance among pathologists interpreting breast biopsy specimens

Consistency of BRCA1 and BRCA2 Variant Classifications Among Clinical Diagnostic Laboratories

BACKGROUND

Genetic tests of the cancer predisposition genes BRCA1 and BRCA2 inform significant clinical decisions for both physicians and patients. Most uncovered variants are benign, and determining which few are pathogenic (disease-causing) is sometimes challenging and can potentially be inconsistent among laboratories. The ClinVar database makes de-identified clinical variant classifications from multiple laboratories publicly available for comparison and review, per recommendations of the American Medical Association (AMA), the American College of Medical Genetics (ACMG), the National Society for Genetic Counselors (NSGC), and other organizations.

METHODS

Classifications of more than 2000 BRCA1/2 variants in ClinVar representing approximately 22,000 patients were dichotomized as clinically actionable or not actionable and compared across up to seven laboratories. The properties of these variants and classification differences were investigated in detail.

RESULTS

Per-variant concordance was 98.5% (CI 97.9%-99.0%). All discordant variants were rare; thus, per patient concordance was estimated to be higher: 99.7%. ClinVar facilitated resolution of many of the discordant variants, and concordance increased to 99.0% per variant and 99.8% per patient when reclassified (but not yet resubmitted) variants and submission errors were addressed. Most of the remaining discordances appeared to involve either legitimate differences in expert judgment regarding particular scientific evidence, or were classifications that predated availability of important scientific evidence.

CONCLUSIONS

Significant classification disagreements among the professional clinical laboratories represented in ClinVar are infrequent yet important. The unrestricted sharing of clinical genetic data allows detailed interlaboratory quality control and peer review, as exemplified by this study.

Pathologists' diagnosis of invasive melanoma and melanocytic proliferations: observer accuracy and reproducibility study

Objective To quantify the accuracy and reproducibility of pathologists' diagnoses of melanocytic skin lesions.Design Observer accuracy and reproducibility study.Setting 10 US states.Participants Skin biopsy cases (n=240), grouped into sets of 36 or 48. Pathologists from 10 US states were randomized to independently interpret the same set on two occasions (phases 1 and 2), at least eight months apart.Main outcome measures Pathologists' interpretations were condensed into five classes: I (eg, nevus or mild atypia); II (eg, moderate atypia); III (eg, severe atypia or melanoma in situ); IV (eg, pathologic stage T1a (pT1a) early invasive melanoma); and V (eg, ≥pT1b invasive melanoma). Reproducibility was assessed by intraobserver and interobserver concordance rates, and accuracy by concordance with three reference diagnoses.Results In phase 1, 187 pathologists completed 8976 independent case interpretations resulting in an average of 10 (SD 4) different diagnostic terms applied to each case. Among pathologists interpreting the same cases in both phases, when pathologists diagnosed a case as class I or class V during phase 1, they gave the same diagnosis in phase 2 for the majority of cases (class I 76.7%; class V 82.6%). However, the intraobserver reproducibility was lower for cases interpreted as class II (35.2%), class III (59.5%), and class IV (63.2%). Average interobserver concordance rates were lower, but with similar trends. Accuracy using a consensus diagnosis of experienced pathologists as reference varied by class: I, 92% (95% confidence interval 90% to 94%); II, 25% (22% to 28%); III, 40% (37% to 44%); IV, 43% (39% to 46%); and V, 72% (69% to 75%). It is estimated that at a population level, 82.8% (81.0% to 84.5%) of melanocytic skin biopsy diagnoses would have their diagnosis verified if reviewed by a consensus reference panel of experienced pathologists, with 8.0% (6.2% to 9.9%) of cases overinterpreted by the initial pathologist and 9.2% (8.8% to 9.6%) underinterpreted.Conclusion Diagnoses spanning moderately dysplastic nevi to early stage invasive melanoma were neither reproducible nor accurate in this large study of pathologists in the USA. Efforts to improve clinical practice should include using a standardized classification system, acknowledging uncertainty in pathology reports, and developing tools such as molecular markers to support pathologists' visual assessments.

Overinterpretation is common in pathological diagnosis of appendix cancer during patient referral for oncologic care

CONTEXT

Low-grade appendiceal mucinous neoplasm (LAMN) and appendiceal adenocarcinoma are known to cause the majority of pseudomyxoma peritonei (PMP, i.e. mucinous ascites); however, recognition and proper classification of these neoplasms can be difficult despite established diagnostic criteria.

OBJECTIVE

To determine the pathological diagnostic concordance for appendix neoplasia and related lesions during patient referral to an academic medical center specialized in treating patients with PMP.

DESIGN

The anatomic pathology laboratory information system was searched to identify cases over a two-year period containing appendix specimens with mucinous neoplasia evaluated by an outside pathology group and by in-house slide review at a single large academic medical center during patient referral.

RESULTS

161 cases containing appendix specimens were identified over this period. Forty-six of 161 cases (28.6%) contained appendiceal primary neoplasia or lesions. Of these, the originating pathologist diagnosed 23 cases (50%) as adenocarcinoma and 23 cases (50%) as LAMN; however, the reference pathologist diagnosed 29 cases (63.0%) as LAMN, 13 cases (28.3%) as adenocarcinoma, and 4 cases (8.7%) as ruptured simple mucocele. Importantly, for cases in which the originating pathologist rendered a diagnosis of adenocarcinoma, the reference pathologist rendered a diagnosis of adenocarcinoma (56.5%, 13 of 23), LAMN (39.1%, 9 of 23), or simple mucocele (4.3%, 1 of 23). The overall diagnostic concordance rate for these major classifications was 71.7% (33 of 46) with an unweighted observed kappa value of 0.48 (95% CI, 0.27-0.69), consistent with moderate interobserver agreement. All of the observed discordance (28.3%) for major classifications could be attributed to over-interpretation. In addition, the majority of LAMN cases (65.5%) had potential diagnostic deficiencies including over-interpretation as adenocarcinoma and lacking or discordant risk stratification (i.e. documentation of extra-appendiceal neoplastic epithelium).

CONCLUSIONS

Appendiceal mucinous lesions remain a difficult area for appropriate pathological classification with substantial discordance due to over-interpretation in this study. The findings highlight the critical need for recognition and application of diagnostic criteria regarding these tumors. Recently published consensus guidelines and a checklist provided herein may help facilitate improvement of diagnostic concordance and thereby reduce over-interpretation and potential overtreatment. Further studies are needed to determine the extent of this phenomenon and its potential clinical impact.

Classification of breast cancer histology images using Convolutional Neural Networks

Breast cancer is one of the main causes of cancer death worldwide. The diagnosis of biopsy tissue with hematoxylin and eosin stained images is non-trivial and specialists often disagree on the final diagnosis. Computer-aided Diagnosis systems contribute to reduce the cost and increase the efficiency of this process. Conventional classification approaches rely on feature extraction methods designed for a specific problem based on field-knowledge. To overcome the many difficulties of the feature-based approaches, deep learning methods are becoming important alternatives. A method for the classification of hematoxylin and eosin stained breast biopsy images using Convolutional Neural Networks (CNNs) is proposed. Images are classified in four classes, normal tissue, benign lesion, in situ carcinoma and invasive carcinoma, and in two classes, carcinoma and non-carcinoma. The architecture of the network is designed to retrieve information at different scales, including both nuclei and overall tissue organization. This design allows the extension of the proposed system to whole-slide histology images. The features extracted by the CNN are also used for training a Support Vector Machine classifier. Accuracies of 77.8% for four class and 83.3% for carcinoma/non-carcinoma are achieved. The sensitivity of our method for cancer cases is 95.6%.

The diagnostic challenge of low-grade ductal carcinoma in situ

BACKGROUND

Diagnostic agreement among pathologists is 84% for ductal carcinoma in situ (DCIS). Studies of interpretive variation according to grade are limited.

METHODS

A national sample of 115 pathologists interpreted 240 breast pathology test set cases in the Breast Pathology Study and their interpretations were compared to expert consensus interpretations. We assessed agreement of pathologists' interpretations with a consensus reference diagnosis of DCIS dichotomised into low- and high-grade lesions. Generalised estimating equations were used in logistic regression models of rates of under- and over-interpretation of DCIS by grade.

RESULTS

We evaluated 2097 independent interpretations of DCIS (512 low-grade DCIS and 1585 high-grade DCIS). Agreement with reference diagnoses was 46% (95% confidence interval [CI] 42-51) for low-grade DCIS and 83% (95% CI 81-86) for high-grade DCIS. The proportion of reference low-grade DCIS interpretations over-interpreted by pathologists (i.e. categorised as either high-grade DCIS or invasive cancer) was 23% (95% CI 19-28); 30% (95% CI 26-34) were interpreted as a lower diagnostic category (atypia or benign proliferative). Reference high-grade DCIS was under-interpreted in 14% (95% CI 12-16) of observations and only over-interpreted 3% (95% CI 2-4).

CONCLUSION

Grade is a major factor when examining pathologists' variability in diagnosing DCIS, with much lower agreement for low-grade DCIS cases compared to high-grade. These findings support the hypothesis that low-grade DCIS poses a greater interpretive challenge than high-grade DCIS, which should be considered when developing DCIS management strategies.

Surgical implications and variability in the use of the flat epithelial atypia diagnosis on breast biopsy specimens

OBJECTIVES

Flat epithelial atypia (FEA) is a relatively new diagnostic term with uncertain clinical significance for surgical management. Any implied risk of invasive breast cancer associated with FEA is contingent upon diagnostic reproducibility, yet little is known regarding its use.

MATERIALS AND METHODS

Pathologists in the Breast Pathology Study interpreted one of four 60-case test sets, one slide per case, constructed from 240 breast biopsy specimens. An electronic data form with standardized diagnostic categories was used; participants were instructed to indicate all diagnoses present. We assessed participants' use of FEA as a diagnostic term within: 1) each test set; 2) 72 cases classified by reference as benign without FEA; and 3) six cases classified by reference as FEA. 115 pathologists participated, providing 6900 total independent assessments.

RESULTS

Notation of FEA ranged from 0% to 35% of the cases interpreted, with most pathologists noting FEA on 4 or more test cases. At least one participant noted FEA in 34 of the 72 benign non-FEA cases. For the 6 reference FEA cases, participant agreement with the case reference FEA diagnosis ranged from 17% to 52%; diagnoses noted by participating pathologists for these FEA cases included columnar cell hyperplasia, usual ductal hyperplasia, atypical lobular hyperplasia, and atypical ductal hyperplasia.

CONCLUSIONS

We observed wide variation in the diagnosis of FEA among U.S. pathologists. This suggests that perceptions of diagnostic criteria and any implied risk associated with FEA may also vary. Surgical excision following a core biopsy diagnosis of FEA should be reconsidered and studied further.

Diagnostic Reproducibility: What Happens When the Same Pathologist Interprets the Same Breast Biopsy Specimen at Two Points in Time?

BACKGROUND

Surgeons may receive a different diagnosis when a breast biopsy is interpreted by a second pathologist. The extent to which diagnostic agreement by the same pathologist varies at two time points is unknown.

METHODS

Pathologists from eight U.S. states independently interpreted 60 breast specimens, one glass slide per case, on two occasions separated by ≥9 months. Reproducibility was assessed by comparing interpretations between the two time points; associations between reproducibility (intraobserver agreement rates); and characteristics of pathologists and cases were determined and also compared with interobserver agreement of baseline interpretations.

RESULTS

Sixty-five percent of invited, responding pathologists were eligible and consented; 49 interpreted glass slides in both study phases, resulting in 2940 interpretations. Intraobserver agreement rates between the two phases were 92% [95% confidence interval (CI) 88-95] for invasive breast cancer, 84% (95% CI 81-87) for ductal carcinoma-in-situ, 53% (95% CI 47-59) for atypia, and 84% (95% CI 81-86) for benign without atypia. When comparing all study participants' case interpretations at baseline, interobserver agreement rates were 89% (95% CI 84-92) for invasive cancer, 79% (95% CI 76-81) for ductal carcinoma-in-situ, 43% (95% CI 41-45) for atypia, and 77% (95% CI 74-79) for benign without atypia.

CONCLUSIONS

Interpretive agreement between two time points by the same individual pathologist was low for atypia and was similar to observed rates of agreement for atypia between different pathologists. Physicians and patients should be aware of the diagnostic challenges associated with a breast biopsy diagnosis of atypia when considering treatment and surveillance decisions.

Characteristics of a Breast Pathology Consultation Practice

CONTEXT

- Intradepartmental consultation is a routine practice commonly used for new diagnoses. Expert interinstitutional case review provides insight into particularly challenging cases.

OBJECTIVE

- To investigate the practice of breast pathology consultation at a large tertiary care center.

DESIGN

- We reviewed breast pathology cases sent for private consultation and internal cases reviewed by multiple pathologists at a tertiary center. Requisitions and reports were evaluated for diagnostic reason for consultation, rate of multiple pathologist review at the tertiary center, use of immunohistochemistry, and, for private consultation cases, type of sender and concordance with the outside diagnosis.

RESULTS

- In the 985 private consultation cases, the most frequent reasons for review were borderline atypia (292 of 878; 33.3%), papillary lesion classification (151 of 878; 17.2%), evaluating invasion (123 of 878; 14%), subtyping carcinoma (75 of 878; 8.5%), and spindle cell (67 of 878; 7.6%) and fibroepithelial (65 of 878; 7.4%) lesion classification. Of 4981 consecutive internal cases, 358 (7.2%) were reviewed, most frequently for borderline atypia (90 of 358; 25.1%), subtyping carcinoma (63 of 358; 17.6%), staging/prognostic features (59 of 358; 16.5%), fibroepithelial lesion classification (45 of 358; 12.6%), evaluating invasion (37 of 358; 10.3%), and papillary (20 of 358; 5.6%) and spindle cell (18 of 358; 5.0%) lesion classification. Of all internal cases, those with a final diagnosis of atypia had a significantly higher rate of review (58 of 241; 24.1%) than those with benign (119 of 2933; 4.1%) or carcinoma (182 of 1807; 10.1%) diagnoses. Immunohistochemistry aided in diagnosis of 39.7% (391 of 985) and 21.2% (76 of 359) of consultation and internally reviewed cases, respectively.

CONCLUSIONS

- This study confirms areas of breast pathology that represent diagnostic challenge and supports that pathologists are appropriately using expert consultation.

A Randomized Study Comparing Digital Imaging to Traditional Glass Slide Microscopy for Breast Biopsy and Cancer Diagnosis

Background:

Digital whole slide imaging may be useful for obtaining second opinions and is used in many countries. However, the U.S. Food and Drug Administration requires verification studies.

Methods:

Pathologists were randomized to interpret one of four sets of breast biopsy cases during two phases, separated by ≥9 months, using glass slides or digital format (sixty cases per set, one slide per case, n = 240 cases). Accuracy was assessed by comparing interpretations to a consensus reference standard. Intraobserver reproducibility was assessed by comparing the agreement of interpretations on the same cases between two phases. Estimated probabilities of confirmation by a reference panel (i.e., predictive values) were obtained by incorporating data on the population prevalence of diagnoses.

Results:

Sixty-five percent of responding pathologists were eligible, and 252 consented to randomization; 208 completed Phase I (115 glass, 93 digital); and 172 completed Phase II (86 glass, 86 digital). Accuracy was slightly higher using glass compared to digital format and varied by category: invasive carcinoma, 96% versus 93% (P = 0.04); ductal carcinoma in situ (DCIS), 84% versus 79% (P < 0.01); atypia, 48% versus 43% (P = 0.08); and benign without atypia, 87% versus 82% (P < 0.01). There was a small decrease in intraobserver agreement when the format changed compared to when glass slides were used in both phases (P = 0.08). Predictive values for confirmation by a reference panel using glass versus digital were: invasive carcinoma, 98% and 97% (not significant [NS]); DCIS, 70% and 57% (P = 0.007); atypia, 38% and 28% (P = 0.002); and benign without atypia, 97% and 96% (NS).

Conclusions:

In this large randomized study, digital format interpretations were similar to glass slide interpretations of benign and invasive cancer cases. However, cases in the middle of the spectrum, where more inherent variability exists, may be more problematic in digital format. Future studies evaluating the effect these findings exert on clinical practice and patient outcomes are required.

Is the outcome at surgery different when flat epithelial atypia and lobular neoplasia are found in association at biopsy?

OBJECTIVE

To assess the impact on the final outcome at surgery of flat epithelial atypia (FEA) when found concomitantly with lobular neoplasia (LN) in biopsy specimens compared with pure biopsy-proven FEA.

METHODS

The approval from the institutional review board of the CHUM (Centre Hospitalier Universitaire de Montréal) was obtained. A retrospective review of our database between 2009 and 2013 identified 81 females (mean age 54 years, range 38-90 years) with 81 FEA biopsy-proven lesions. These were pure or associated with LN only in 59/81 (73%) and 22/81 (27%) cases, respectively. Overall, 57/81 (70%) patients underwent surgery and 24/81 (30%) patients underwent mammographic surveillance with a mean follow-up of 36 months.

RESULTS

FEA presented more often as microcalcifications in 68/81 (84%) patients and were mostly amorphous in 49/68 (72%). After excluding radio pathologically discordant cases, pure FEA proved to be malignant at surgery in 1/41 (2%; 95% confidence interval 0.06-12.9). There was no statistically significant difference in the upgrade to malignancy whether FEA lesions were pure or associated to LN at biopsy (p = 0.4245); however, when paired in biopsy specimens, these lesions were more frequently associated with atypical ductal hyperplasia (ADH) at surgery than with pure FEA (p = 0.012).

CONCLUSION

Our results show a 2% upgrade rate to malignancy of pure FEA lesions. When FEA is found in association with LN at biopsy, surgical excision yields more frequently ADH than pure FEA thus warranting close surveillance or even surgical excision. Advances in knowledge: The association of LN with FEA at biopsy was more frequently associated with ADH at surgery than with pure FEA. If a biopsy-proven FEA lesion is deemed concordant with the imaging finding, when paired with LN at biopsy, careful surveillance or even surgical excision is suggested.

Second Opinions From Medical Oncologists for Early-Stage Breast Cancer: Prevalence, Correlates, and Consequences

IMPORTANCE

Advances in the evaluation and treatment of breast cancer have made the clinical decision-making context much more complex. A second opinion from a medical oncologist may facilitate decision making for women with breast cancer, yet little is known about second opinion use.

OBJECTIVE

To investigate the patterns and correlates of second opinion use and the effect on chemotherapy decisions.

DESIGN, SETTING, AND PARTICIPANTS

A total of 1901 women newly diagnosed with stages 0 to II breast cancer between July 2013 and September 2014 (response rate, 71.0%) were accrued through 2 population-based Surveillance, Epidemiology, and End Results registries (Georgia and Los Angeles County, California) and surveyed about their experiences with medical oncologists, decision making, and chemotherapy use.

MAIN OUTCOMES AND MEASURES

Factors associated with second opinion use were evaluated using logistic regression. Also assessed was the association between second opinion and chemotherapy use, adjusting for chemotherapy indication and propensity for receiving a second opinion. Multiple imputation and weighting were used to account for missing data.

RESULTS

A total of 1901 patients with stage I to II breast cancer (mean [SD] age, 61.6 [11.0] years; 1071 [56.3%] non-Hispanic white) saw any medical oncologist. Analysis of multiply imputed, weighted data (mean n = 1866) showed that 168 (9.8%) (SE, 0.74%) received a second opinion and 54 (3.2%) (SE, 0.47%) received chemotherapy from the second oncologist. Satisfaction with chemotherapy decisions was high and did not differ between those who did (mean [SD], 4.3 [0.08] on a 1- to 5-point scale) or did not (4.4 [0.03]) obtain a second opinion (P = .29). Predictors of second opinion use included college education vs less education (odds ratio [OR], 1.85; 95% CI, 1.24-2.75), frequent use of internet-based support groups (OR, 2.15; 95% CI, 1.12-4.11), an intermediate result on the 21-gene recurrence score assay (OR, 1.85; 95% CI, 1.11-3.09), and a variant of uncertain significance on hereditary cancer genetic testing (OR, 3.24; 95% CI, 1.09-9.59). After controlling for patient and tumor characteristics, second opinion use was not associated with chemotherapy receipt (OR, 1.04; 95% CI, 0.71-1.52).

CONCLUSIONS AND RELEVANCE

Second opinion use was low (<10%) among patients with early-stage breast cancer, and high decision satisfaction regardless of second opinion use suggests little unmet demand. Along with educational level and use of internet support groups, uncertain results on genomic testing predicted second opinion use. Patient demand for second opinions may increase as more complex genomic tests are disseminated.

The BIG 2.04 MRC/EORTC SUPREMO Trial: pathology quality assurance of a large phase 3 randomised international clinical trial of postmastectomy radiotherapy in intermediate-risk breast cancer

Introduction

SUPREMO is a phase 3 randomised trial evaluating radiotherapy post-mastectomy for intermediate-risk breast cancer. 1688 patients were enrolled from 16 countries between 2006 and 2013. We report the results of central pathology review carried out for quality assurance.

Patients and methods

A single recut haematoxylin and eosin (H&E) tumour section was assessed by one of two reviewing pathologists, blinded to the originally reported pathology and patient data. Tumour type, grade and lymphovascular invasion were reviewed to assess if they met the inclusion criteria. Slides from potentially ineligible patients on central review were scanned and reviewed online together by the two pathologists and a consensus reached. A subset of 25 of these cases was double-reported independently by the pathologists prior to the online assessment.

Results

The major contributors to the trial were the UK (75%) and the Netherlands (10%). There is a striking difference in lymphovascular invasion (LVi) rates (41.6 vs. 15.1% (UK); p = <0.0001) and proportions of grade 3 carcinomas (54.0 vs. 42.0% (UK); p = <0.0001) on comparing local reporting with central review. There was no difference in the locally reported frequency of LVi rates in node-positive (N+) and node-negative (N−) subgroups (40.3 vs. 38.0%; p = 0.40) but a significant difference in the reviewed frequency (16.9 vs. 9.9%; p = 0.004). Of the N− cases, 104 (25.1%) would have been ineligible by initial central review by virtue of grade and/or lymphovascular invasion status. Following online consensus review, this fell to 70 cases (16.3% of N− cases, 4.1% of all cases).

Conclusions

These data have important implications for the design, powering and interpretation of outcomes from this and future clinical trials. If critical pathology criteria are determinants for trial entry, serious consideration should be given to up-front central pathology review.

Electronic supplementary material

The online version of this article (doi:10.1007/s10549-017-4145-4) contains supplementary material, which is available to authorized users.

Breast Lesion Elastography Region of Interest Selection and Quantitative Heterogeneity: A Systematic Review and Meta-Analysis

In this systematic review and meta-analysis, we report measured elasticities of benign and malignant breast pathologies from shear wave elastography (SWE), quantitatively confirm the effect of the selected region of interest (ROI) on these measures and test the hypothesis that a metric of heterogeneity based on the mean and maximum elasticity can improve specificity of diagnosis. The elasticities of benign, malignant and specific pathologic states are reported from 22 publications encompassing 2989 patients, identified from a structured search of the literature from May to September 2015. Twelve articles were included in a meta-analysis that grouped results by the method of ROI selection to discriminate between different pathologies. We observe a significant correlation between the method of selection of ROI for malignant mean (p < 0.001) and maximum (p = 0.027) elasticities, but no correlation with benign measures. We define a quantitative heterogeneity parameter, the "stiffness gradient," computed from the mean and maximum measured elasticities. The stiffness gradient out-performed the current standard maximum elasticity metric in stratifying malignancy risk by a margin of 15% for the partial ROI, and 42% for the maximized ROI. An anecdotal example of improved differentiation using the stiffness gradient on pathology-specific lesions is also provided. These results quantitatively indicate that the method of ROI selection in SWE not only has a significant impact on the resulting mean reported elasticity of a lesion, but may provide some insight into lesion heterogeneity. Our results suggest that further exploration of quantitative heterogeneity is warranted to improve the specificity of diagnosis.

Mammographic breast density and risk of breast cancer in women with atypical hyperplasia: an observational cohort study from the Mayo Clinic Benign Breast Disease (BBD) cohort

Background

Atypical hyperplasia (AH) and mammographic breast density (MBD) are established risk factors for breast cancer (BC), but their joint contributions are not well understood. We examine associations of MBD and BC by histologic impression, including AH, in a subcohort of women from the Mayo Clinic Benign Breast Disease Cohort.

Methods

Women with a diagnosis of BBD and mammogram between 1985 and 2001 were eligible. Histologic impression was assessed via pathology review and coded as non-proliferative disease (NP), proliferative disease without atypia (PDWA) and AH. MBD was assessed clinically using parenchymal pattern (PP) or BI-RADS criteria and categorized as low, moderate or high. Percent density (PD) was also available for a subset of women. BC and clinical information were obtained by questionnaires, medical records and the Mayo Clinic Tumor Registry. Women were followed from date of benign biopsy to BC, death or last contact. Standardized incidence ratios (SIRs) compared the observed number of BCs to expected counts. Cox regression estimated multivariate-adjusted MBD hazard ratios.

Results

Of the 6271 women included in the study, 1132 (18.0%) had low MBD, 2921 (46.6%) had moderate MBD, and 2218 (35.4%) had high MBD. A total of 3532 women (56.3%) had NP, 2269 (36.2%) had PDWA and 470 (7.5%) had AH. Over a median follow-up of 14.3 years, 528 BCs were observed. The association of MBD and BC risk differed by histologic impression (p-interaction = 0.03), such that there was a strong MBD and BC association among NP (p < 0.001) but non-significant associations for PDWA (p = 0.27) and AH (p = 0.96). MBD and BC associations for AH women were not significant within subsets defined by type of MBD measure (PP vs. BI-RADS), age at biopsy, number of foci of AH, type of AH (lobular vs. ductal) and body mass index, and after adjustment for potential confounding variables. Women with atypia who also had high PD (>50%) demonstrated marginal evidence of increased BC risk (SIR 4.98), but results were not statistically significant.

Conclusion

We found no evidence of an association between MBD and subsequent BC risk in women with AH.

Electronic supplementary material

The online version of this article (doi:10.1186/s12885-017-3082-2) contains supplementary material, which is available to authorized users.

Estimate of false-positive breast cancer diagnoses from accuracy studies: a systematic review

Background

False-positive histological diagnoses have the same consequences of overdiagnosis in terms of unnecessary treatment. The aim of this systematic review is to assess their frequency at needle core biopsy (CB) and/or surgical excision of the breast.

Methods

PubMed, Embase, Cochrane Library were systematically searched up to 30 October 2015. Eligibility criteria: cross-sectional studies assessing diagnostic accuracy of CB compared with surgical excision; studies assessing reproducibility of pathologists reading the same slides. Outcomes: false-positive rates; Misclassification of Benign as Malignant (MBM) histological diagnosis; K statistic. Independent reviewers extracted data and assessed quality using an adapted QUADAS-2 tool.

Results

Sixteen studies assessed CB false-positive rates. In 10 studies (41 989 screen-detected lesions), the range of false-positive rates was 0%–7.1%. Twenty-seven studies assessed pathologists' reproducibility. Studies with consecutive, random or stratified samples of all the specimens: at CB the MBM range was 0.25%–2.4% (K values 0.83–0.98); at surgical excision, it was 0.67%–1.2% (K values 0.86–0.94). Studies with enriched samples: the MBM range was 1.4%–6.2% (K values 0.57–0.86). Studies of cases selected for second opinion: the MBM range was 0.29%–12.2% (K values 0.48 and 0.50).

Conclusions

High heterogeneity of the included studies precluded formal pooling estimates. When considering studies of higher sample size or methodological quality, false-positive rates and MBM are around 1%. The impact of false-positive histological diagnoses of breast cancer on unnecessary treatment, as well as that of overdiagnosis, is not negligible and is of importance in clinical practice.

Accuracy is in the eyes of the pathologist: The visual interpretive process and diagnostic accuracy with digital whole slide images

Digital whole slide imaging is an increasingly common medium in pathology, with application to education, telemedicine, and rendering second opinions. It has also made it possible to use eye tracking devices to explore the dynamic visual inspection and interpretation of histopathological features of tissue while pathologists review cases. Using whole slide images, the present study examined how a pathologist's diagnosis is influenced by fixed case-level factors, their prior clinical experience, and their patterns of visual inspection. Participating pathologists interpreted one of two test sets, each containing 12 digital whole slide images of breast biopsy specimens. Cases represented four diagnostic categories as determined via expert consensus: benign without atypia, atypia, ductal carcinoma in situ (DCIS), and invasive cancer. Each case included one or more regions of interest (ROIs) previously determined as of critical diagnostic importance. During pathologist interpretation we tracked eye movements, viewer tool behavior (zooming, panning), and interpretation time. Models were built using logistic and linear regression with generalized estimating equations, testing whether variables at the level of the pathologists, cases, and visual interpretive behavior would independently and/or interactively predict diagnostic accuracy and efficiency. Diagnostic accuracy varied as a function of case consensus diagnosis, replicating earlier research. As would be expected, benign cases tended to elicit false positives, and atypia, DCIS, and invasive cases tended to elicit false negatives. Pathologist experience levels, case consensus diagnosis, case difficulty, eye fixation durations, and the extent to which pathologists' eyes fixated within versus outside of diagnostic ROIs, all independently or interactively predicted diagnostic accuracy. Higher zooming behavior predicted a tendency to over-interpret benign and atypia cases, but not DCIS cases. Efficiency was not predicted by pathologist- or visual search-level variables. Results provide new insights into the medical interpretive process and demonstrate the complex interactions between pathologists and cases that guide diagnostic decision-making. Implications for training, clinical practice, and computer-aided decision aids are considered.

Overestimating Overdiagnosis in Breast Cancer Screening

Overdiagnosis in breast cancer has been a focus of increasing concern with wide ranges of calculations made indirectly through the study of prospective randomized trials and analyses of large registries. While most admit that some degree of overdiagnosis is inherent with ductal carcinoma in situ (DCIS), the rate of overdiagnosis with invasive disease is highly controversial. Although it is generally accepted that overdiagnosis is calculated through indirect means and deductive reasoning, this is not entirely the case. Patients who refuse treatment, yet curiously return for follow-up, allow a direct glimpse at the natural history of screen-detected cancers. And historic autopsy studies offer information as to undiagnosed disease prevalence from the pre-screening era. While these autopsy studies support a modest degree of overdiagnosis in DCIS, they do not support widespread overdiagnosis for invasive cancer. The 1.3% mean incidence of invasive disease from seven autopsy studies correlates closely with disease prevalence, a direct observation that cancers do not remain quiescent in the breast until death. If invasive breast cancer does not regress in untreated patients and does not remain quiescent, then the high estimates being calculated for overdiagnosis are more likely to be length bias from long natural histories rather than true overdiagnosis.

DATA SHARING AND REPRODUCIBLE CLINICAL GENETIC TESTING: SUCCESSES AND CHALLENGES

Open sharing of clinical genetic data promises to both monitor and eventually improve the reproducibility of variant interpretation among clinical testing laboratories. A significant public data resource has been developed by the NIH ClinVar initiative, which includes submissions from hundreds of laboratories and clinics worldwide. We analyzed a subset of ClinVar data focused on specific clinical areas and we find high reproducibility (>90% concordance) among labs, although challenges for the community are clearly identified in this dataset. We further review results for the commonly tested BRCA1 and BRCA2 genes, which show even higher concordance, although the significant fragmentation of data into different silos presents an ongoing challenge now being addressed by the BRCA Exchange. We encourage all laboratories and clinics to contribute to these important resources.

Misdiagnosis of obstetrical cases and the clinical and cost consequences to patients: a cross-sectional study of urban providers in the Philippines

BACKGROUND

Misdiagnosis may be a significant and under-recognized quality of care problem. In birthing facilities located in anurban Philippine setting, we investigated the diagnostic accuracy for three obstetric conditions: cephalopelvic disproportion (CPD), post-partum hemorrhage (PPH), and pre-eclampsia.

DESIGN

Identical simulated cases were used to measure diagnostic accuracy for every provider (n=103). We linked misdiagnosis - identified by the simulated cases - to obstetrical complications of the patients at the participating facilities. Patient-level data on health outcomes and costs were obtained from medical records and follow-home in-person interviews.

RESULTS

The prevalence of misdiagnosis among obstetric providers was 29.8% overall, 25% for CPD, 33% for PPH, and 31% for pre-eclampsia. Linking provider decision-making to patients, we found those who misdiagnosed the simulated cases were more likely to have patients with a complication (OR 2.96; 95% CI 1.39-3.77) compared with those who did not misdiagnose. Complicated patients were significantly less likely to be referred to a hospital immediately, were more likely to be readmitted to a hospital after delivery, had significantly higher medical costs, and lost more income than non-complicated patients.

CONCLUSION

Diagnosis is arguably the most important task a clinician performs because it determines the subsequent course of evaluation and treatment, with the direct and indirect costs of diagnostic error, placing large financial burdens on the patient.

Updates in the treatment of ductal carcinoma in situ of the breast

PURPOSE OF REVIEW

Ductal carcinoma in situ (DCIS) accounts for approximately 20% of mammographically diagnosed breast cancers. Currently, there is a trend to consider DCIS as a lesion for which treatment deescalation is advocated to avoid overtreatment, that is, radiotherapy in addition to breast-conserving surgery or even surgery at all.

RECENT FINDINGS

The long-term follow-up updates of the four first-generation randomized trials comparing lumpectomy with and without radiation therapy have confirmed that radiation halves the local failure rates. However, radiotherapy is not associated with a survival benefit just as affirmed by the recently published evaluation of the Surveillance, Epidemiology, and End Results registries database, including 108,196 women with DCIS. Nevertheless, the risk of dying of breast cancer increases about factor 18 after experience of an invasive local recurrence. That means at least some DCIS have the potential to progress to a life threatening disease. At the same time, none of the recently updated prospective trials that tested the outcome after excision alone in low-risk DCIS achieved a 10-year local failure rate below 10%.

SUMMARY

DCIS is not a uniform disease. Its clinical behaviour is heterogeneous, but up to date no citeria are available that allow a precise identification of patients with low or very low progression risk who do not need irradiation. Therefore, excision followed by radiotherapy is still the standard of care in patients undergoing breast conservation. Promising new approaches for risk estimation have to be validated prospectively before their use in daily practice can be recommended.

Histological features associated with diagnostic agreement in atypical ductal hyperplasia of the breast: illustrative cases from the B-Path study

AIMS

This study examined the case-specific characteristics associated with interobserver diagnostic agreement in atypical ductal hyperplasia (ADH) of the breast.

METHODS AND RESULTS

Seventy-two test set cases with a consensus diagnosis of ADH from the B-Path study were evaluated. Cases were scored for 17 histological features, which were then correlated with the participant agreement with the consensus ADH diagnosis. Participating pathologists' perceptions of case difficulty, borderline features or whether they would obtain a second opinion were also examined for associations with agreement. Of the 2070 participant interpretations of the 72 consensus ADH cases, 48% were scored by participants as difficult and 45% as borderline between two diagnoses; the presence of both of these features was significantly associated with increased agreement (P < 0.001). A second opinion would have been obtained in 80% of interpretations, and this was associated with increased agreement (P < 0.001). Diagnostic agreement ranged from 10% to 89% on a case-by-case basis. Cases with papillary lesions, cribriform architecture and obvious cytological monotony were associated with higher agreement. Lower agreement rates were associated with solid or micropapillary architecture, borderline cytological monotony, or cases without a diagnostic area that was obvious on low power.

CONCLUSIONS

The results of this study suggest that pathologists frequently recognize the challenge of ADH cases, with some cases being more prone to diagnostic variability. In addition, there are specific histological features associated with diagnostic agreement on ADH cases. Multiple example images from cases in this test set are provided to serve as educational illustrations of these challenges.

Region of interest identification and diagnostic agreement in breast pathology

A pathologist's accurate interpretation relies on identifying relevant histopathological features. Little is known about the precise relationship between feature identification and diagnostic decision making. We hypothesized that greater overlap between a pathologist's selected diagnostic region of interest (ROI) and a consensus derived ROI is associated with higher diagnostic accuracy. We developed breast biopsy test cases that included atypical ductal hyperplasia (n=80); ductal carcinoma in situ (n=78); and invasive breast cancer (n=22). Benign cases were excluded due to the absence of specific abnormalities. Three experienced breast pathologists conducted an independent review of the 180 digital whole slide images, established a reference consensus diagnosis and marked one or more diagnostic ROIs for each case. Forty-four participating pathologists independently diagnosed and marked ROIs on the images. Participant diagnoses and ROI were compared with consensus reference diagnoses and ROI. Regression models tested whether percent overlap between participant ROI and consensus reference ROI predicted diagnostic accuracy. Each of the 44 participants interpreted 39-50 cases for a total of 1972 individual diagnoses. Percent ROI overlap with the expert reference ROI was higher in pathologists who self-reported academic affiliation (69 vs 65%, P=0.002). Percent overlap between participants' ROI and consensus reference ROI was then classified into ordinal categories: 0, 1-33, 34-65, 66-99 and 100% overlap. For each incremental change in the ordinal percent ROI overlap, diagnostic agreement increased by 60% (OR 1.6, 95% CI (1.5-1.7), P<0.001) and the association remained significant even after adjustment for other covariates. The magnitude of the association between ROI overlap and diagnostic agreement increased with increasing diagnostic severity. The findings indicate that pathologists are more likely to converge with an expert reference diagnosis when they identify an overlapping diagnostic image region, suggesting that future computer-aided detection systems that highlight potential diagnostic regions could be a helpful tool to improve accuracy and education.

Antibody-supervised deep learning for quantification of tumor-infiltrating immune cells in hematoxylin and eosin stained breast cancer samples

BACKGROUND

Immune cell infiltration in tumor is an emerging prognostic biomarker in breast cancer. The gold standard for quantification of immune cells in tissue sections is visual assessment through a microscope, which is subjective and semi-quantitative. In this study, we propose and evaluate an approach based on antibody-guided annotation and deep learning to quantify immune cell-rich areas in hematoxylin and eosin (H&E) stained samples.

METHODS

Consecutive sections of formalin-fixed parafin-embedded samples obtained from the primary tumor of twenty breast cancer patients were cut and stained with H&E and the pan-leukocyte CD45 antibody. The stained slides were digitally scanned, and a training set of immune cell-rich and cell-poor tissue regions was annotated in H&E whole-slide images using the CD45-expression as a guide. In analysis, the images were divided into small homogenous regions, superpixels, from which features were extracted using a pretrained convolutional neural network (CNN) and classified with a support of vector machine. The CNN approach was compared to texture-based classification and to visual assessments performed by two pathologists.

RESULTS

In a set of 123,442 labeled superpixels, the CNN approach achieved an F-score of 0.94 (range: 0.92-0.94) in discrimination of immune cell-rich and cell-poor regions, as compared to an F-score of 0.88 (range: 0.87-0.89) obtained with the texture-based classification. When compared to visual assessment of 200 images, an agreement of 90% (κ = 0.79) to quantify immune infiltration with the CNN approach was achieved while the inter-observer agreement between pathologists was 90% (κ = 0.78).

CONCLUSIONS

Our findings indicate that deep learning can be applied to quantify immune cell infiltration in breast cancer samples using a basic morphology staining only. A good discrimination of immune cell-rich areas was achieved, well in concordance with both leukocyte antigen expression and pathologists' visual assessment.

Pattern classification of endocervical adenocarcinoma: reproducibility and review of criteria

Previously, our international team proposed a three-tiered pattern classification (Pattern Classification) system for endocervical adenocarcinoma of the usual type that correlates with nodal disease and recurrence. Pattern Classification-A tumors have well-demarcated glands lacking destructive stromal invasion or lymphovascular invasion, Pattern Classification-B tumors show localized, limited destructive invasion arising from A-type glands, and Pattern Classification-C tumors have diffuse destructive stromal invasion, significant (filling a 4 × field) confluence, or solid architecture. Twenty-four cases of Pattern Classification-A, 22 Pattern Classification-B, and 38 Pattern Classification-C from the tumor set used in the original description were chosen using the reference diagnosis originally established. One H&E slide per case was reviewed by seven gynecologic pathologists, four from the original study. Kappa statistics were prepared, and cases with discrepancies reviewed. We found a majority agreement with reference diagnosis in 81% of cases, with complete or near-complete (six of seven) agreement in 50%. Overall concordance was 74%. Overall kappa (agreement among pathologists) was 0.488 (moderate agreement). Pattern Classification-B has lowest kappa, and agreement was not improved by combining B+C. Six of seven reviewers had substantial agreement by weighted kappas (>0.6), with one reviewer accounting for the majority of cases under or overcalled by two tiers. Confluence filling a 4 × field, labyrinthine glands, or solid architecture accounted for undercalling other reference diagnosis-C cases. Missing a few individually infiltrative cells was the most common cause of undercalling reference diagnosis-B. Small foci of inflamed, loose or desmoplastic stroma lacking infiltrative tumor cells in reference diagnosis-A appeared to account for those cases up-graded to Pattern Classification-B. In summary, an overall concordance of 74% indicates that the criteria can be reproducibly applied by gynecologic pathologists. Further refinement of criteria should allow use of this powerful classification system to delineate which cervical adenocarcinomas can be safely treated conservatively.

Long-Term Safety of Observation in Selected Women Following Core Biopsy Diagnosis of Atypical Ductal Hyperplasia

PURPOSE

Atypical ductal hyperplasia (ADH) found on core biopsy is associated with an upgrade to carcinoma in 10-30 % of women, thus surgical excision remains the standard of care. This study compares the incidence of breast cancer in women with ADH who were observed with those who underwent surgical excision of the ADH site.

METHODS

Our departmental, prospectively maintained registry was reviewed to identify patients with ADH diagnosed by core biopsy. Surgically treated patients were excluded if upstaged to carcinoma following excision for ADH diagnosis. Breast cancer events were classified as index site (site of ADH biopsy), ipsilateral breast unrelated to index site, or contralateral breast.

RESULTS

Overall, 175 women met the study criteria; 125 were observed and 50 underwent excision. With a median follow-up of 3 years, 14 breast cancer events were noted in 13 patients. In the surgery group, six women developed breast cancer (12 %), including one bilateral, compared with seven cancers (5.6 %) in the observed group (p = 0.14). Index site events and ipsilateral cancers were the same in both groups [2 vs. 0.8 % (p = 0.49) and 4 versus 4.8 % (p = 1.00), respectively]. All contralateral cancers occurred in the surgical group (8 vs. 0 %; p < 0.01). A prior history of breast cancer was the only variable associated with subsequent breast cancer events (hazard ratio 12.53, 95 % confidence interval 3.30-47.57).

CONCLUSION

Observation is appropriate in selected women with ADH on core biopsy. Index site failures are rare and are superseded by cancer risk elsewhere in the breast.

Clinical and pathological assessment of high-risk ductal and lobular breast lesions: What surgeons must know

Terminology in pathology is sometimes over-complicated and may be misinterpreted by clinicians facing patients and having difficulty answering questions posed by them. This may especially be true for some breast lesions with an increased risk of malignant transformation, the complex terminology of which reflects attempts to stratify them according to potential risk. On the basis of morphological and molecular features, both ductal and lobular proliferations have been classified and named in different ways by pathologists, and this often makes it difficult for the treating physicians and the patients to fully understand the nature of the lesions and their associated risks. In order to clarify pathology reports, unambiguous and simple terms are needed.

Atypical Ductal Hyperplasia Bordering on Ductal Carcinoma In Situ

BACKGROUND

The clinical implications of the diagnosis of atypical ductal hyperplasia (ADH) and ductal carcinoma in situ (DCIS) are very different. Yet there are "borderline" breast lesions that have characteristics of both ADH and DCIS. We examined interobserver diagnostic variability for such lesions and correlated pathologic features of the lesions with clinical outcomes.

METHODS

We identified all cases of borderline ADH/DCIS lesions treated at our center from 1997 to 2010. Five specialized breast pathologists blinded to clinical outcomes independently reviewed all available slides from each case and were instructed to classify each as benign, ADH, or DCIS. A majority diagnosis (MajDx) was defined as a diagnosis agreed upon by ≥3 pathologists.

RESULTS

A total of 105 women with borderline ADH/DCIS and slides available for review were identified. The MajDx was ADH in 84 (80%), and DCIS in 18 (17%). There were split diagnoses in 3 (3%). MajDx of DCIS correlated significantly with lesion size and nuclear grade. There was diagnostic agreement by all 5 pathologists in 30% of cases, 4 pathologists in 42%, and 3 pathologists in 25%. At a median follow-up of 37 months, 4 (3.8%) patients developed subsequent ipsilateral breast carcinoma (2 invasive, 2 DCIS); all 4 cases had MajDx of ADH.

CONCLUSIONS

Borderline ADH/DCIS represents an entity for which reproducible categorization as ADH or DCIS cannot be achieved. Furthermore, histologic features of borderline lesions resulting in MajDx of ADH vs. DCIS are not prognostic for risk of subsequent breast carcinoma.

Review of the national external quality assessment (EQA) scheme for breast pathology in the UK

Background

The National Health Service Breast Screening Programme (NHSBSP; pathology) external quality assurance (EQA) scheme aims to provide a mechanism for examination and monitoring of concordance of pathology reporting within the UK. This study aims to review the breast EQA scheme performance data collected over a 24-year period following its introduction.

Methods

Data on circulations, number of cases and diagnosis were collected. Detailed analyses with and without combinations of certain diagnostic entities, and over different time periods were performed.

Results

Overall, of 576 cases (172 benign, 11 atypical hyperplasia, 98 ductal carcinoma in situ/microinvasive and 295 invasive disease), consistency of assessment of diagnostic parameters was very high (overall k=0.80; k for benign diagnosis=0.79; k for invasive disease=0.91). For distinguishing benign versus malignant lesions, no further improvement is considered possible in view of the limitations of the scheme methodology. Although diagnostic consistency of atypical hyperplasia remains at a low level, combining it with the benign category results in a high level of agreement (k=0.93). The level of consistency of reporting prognostic information is variable and some items such as lymphovascular invasion and tumour size measurement may need further intervention to improve their reporting consistency. Although the level of consistency of reporting of histological grade remained at a moderate level overall (k=0.48), it was variable among cases and appears to have levelled off; no further significant improvement is expected and no significant impact of the previous publication of guidelines is observed.

Conclusions

These results provide further evidence to indicate the value of the breast EQA scheme in monitoring performance and the identification of specific areas where improvement or new approaches are required. For most parameters, the concordance of reporting reached a plateaux a few years after the introduction of the EQA scheme. It is important to maintain this high level and also to tackle specific low-performance areas innovatively.

Pupil diameter changes reflect difficulty and diagnostic accuracy during medical image interpretation

Background

No automated methods exist to objectively monitor and evaluate the diagnostic process while physicians review computerized medical images. The present study tested whether using eye tracking to monitor tonic and phasic pupil dynamics may prove valuable in tracking interpretive difficulty and predicting diagnostic accuracy.

Methods

Pathologists interpreted digitized breast biopsies varying in diagnosis and rated difficulty, while pupil diameter was monitored. Tonic diameter was recorded during the entire duration of interpretation, and phasic diameter was examined when the eyes fixated on a pre-determined diagnostic region during inspection.

Results

Tonic pupil diameter was higher with increasing rated difficulty levels of cases. Phasic diameter was interactively influenced by case difficulty and the eventual agreement with consensus diagnosis. More difficult cases produced increases in pupil diameter, but only when the pathologists’ diagnoses were ultimately correct. All results were robust after adjusting for the potential impact of screen brightness on pupil diameter.

Conclusions

Results contribute new understandings of the diagnostic process, theoretical positions regarding locus coeruleus-norepinephrine system function, and suggest novel approaches to monitoring, evaluating, and guiding medical image interpretation.

Identifying and processing the gap between perceived and actual agreement in breast pathology interpretation

We examined how pathologists' process their perceptions of how their interpretations on diagnoses for breast pathology cases agree with a reference standard. To accomplish this, we created an individualized self-directed continuing medical education program that showed pathologists interpreting breast specimens how their interpretations on a test set compared with a reference diagnosis developed by a consensus panel of experienced breast pathologists. After interpreting a test set of 60 cases, 92 participating pathologists were asked to estimate how their interpretations compared with the standard for benign without atypia, atypia, ductal carcinoma in situ and invasive cancer. We then asked pathologists their thoughts about learning about differences in their perceptions compared with actual agreement. Overall, participants tended to overestimate their agreement with the reference standard, with a mean difference of 5.5% (75.9% actual agreement; 81.4% estimated agreement), especially for atypia and were least likely to overestimate it for invasive breast cancer. Non-academic affiliated pathologists were more likely to more closely estimate their performance relative to academic affiliated pathologists (77.6 vs 48%; P=0.001), whereas participants affiliated with an academic medical center were more likely to underestimate agreement with their diagnoses compared with non-academic affiliated pathologists (40 vs 6%). Before the continuing medical education program, nearly 55% (54.9%) of participants could not estimate whether they would overinterpret the cases or underinterpret them relative to the reference diagnosis. Nearly 80% (79.8%) reported learning new information from this individualized web-based continuing medical education program, and 23.9% of pathologists identified strategies they would change their practice to improve. In conclusion, when evaluating breast pathology specimens, pathologists do a good job of estimating their diagnostic agreement with a reference standard, but for atypia cases, pathologists tend to overestimate diagnostic agreement. Many participants were able to identify ways to improve.

Evaluation of 12 strategies for obtaining second opinions to improve interpretation of breast histopathology: simulation study

OBJECTIVE

 To evaluate the potential effect of second opinions on improving the accuracy of diagnostic interpretation of breast histopathology.

DESIGN

 Simulation study.

SETTING

 12 different strategies for acquiring independent second opinions.

PARTICIPANTS

 Interpretations of 240 breast biopsy specimens by 115 pathologists, one slide for each case, compared with reference diagnoses derived by expert consensus.

MAIN OUTCOME MEASURES

 Misclassification rates for individual pathologists and for 12 simulated strategies for second opinions. Simulations compared accuracy of diagnoses from single pathologists with that of diagnoses based on pairing interpretations from first and second independent pathologists, where resolution of disagreements was by an independent third pathologist. 12 strategies were evaluated in which acquisition of second opinions depended on initial diagnoses, assessment of case difficulty or borderline characteristics, pathologists' clinical volumes, or whether a second opinion was required by policy or desired by the pathologists. The 240 cases included benign without atypia (10% non-proliferative, 20% proliferative without atypia), atypia (30%), ductal carcinoma in situ (DCIS, 30%), and invasive cancer (10%). Overall misclassification rates and agreement statistics depended on the composition of the test set, which included a higher prevalence of difficult cases than in typical practice.

RESULTS

 Misclassification rates significantly decreased (P<0.001) with all second opinion strategies except for the strategy limiting second opinions only to cases of invasive cancer. The overall misclassification rate decreased from 24.7% to 18.1% when all cases received second opinions (P<0.001). Obtaining both first and second opinions from pathologists with a high volume (≥10 breast biopsy specimens weekly) resulted in the lowest misclassification rate in this test set (14.3%, 95% confidence interval 10.9% to 18.0%). Obtaining second opinions only for cases with initial interpretations of atypia, DCIS, or invasive cancer decreased the over-interpretation of benign cases without atypia from 12.9% to 6.0%. Atypia cases had the highest misclassification rate after single interpretation (52.2%), remaining at more than 34% in all second opinion scenarios.

CONCLUSION

 Second opinions can statistically significantly improve diagnostic agreement for pathologists' interpretations of breast biopsy specimens; however, variability in diagnosis will not be completely eliminated, especially for breast specimens with atypia.

How Can Advanced Imaging Be Used to Mitigate Potential Breast Cancer Overdiagnosis?

Radiologists, as administrators and interpreters of screening mammography, are considered by some to be major contributors to the potential harms of screening, including overdiagnosis and overtreatment. In this article, we outline current efforts within the breast imaging community toward mitigating screening harms, including the widespread adoption of tomosynthesis and potentially adjusting screening frequency and thresholds for image-guided breast biopsy. However, the emerging field of breast radiomics may offer the greatest promise for reducing overdiagnosis by identifying imaging-based biomarkers strongly associated with tumor biology, and therefore helping prevent the harms of unnecessary treatment for indolent cancers.

Variability in Pathologists' Interpretations of Individual Breast Biopsy Slides: A Population Perspective

BACKGROUND

The effect of physician diagnostic variability on accuracy at a population level depends on the prevalence of diagnoses.

OBJECTIVE

To estimate how diagnostic variability affects accuracy from the perspective of a U.S. woman aged 50 to 59 years having a breast biopsy.

DESIGN

Applied probability using Bayes' theorem.

SETTING

B-Path (Breast Pathology) Study comparing pathologists' interpretations of a single biopsy slide versus a reference consensus interpretation from 3 experts.

PARTICIPANTS

115 practicing pathologists (6900 total interpretations from 240 distinct cases).

MEASUREMENTS

A single representative slide from each of the 240 cases was used to estimate the proportion of biopsies with a diagnosis that would be verified if the same slide were interpreted by a reference group of 3 expert pathologists. Probabilities of confirmation (predictive values) were estimated using B-Path Study results and prevalence of biopsy diagnoses for women aged 50 to 59 years in the Breast Cancer Surveillance Consortium.

RESULTS

Overall, if 1 representative slide were used per case, 92.3% (95% CI, 91.4% to 93.1%) of breast biopsy diagnoses would be verified by reference consensus diagnoses, with 4.6% (CI, 3.9% to 5.3%) overinterpreted and 3.2% (CI, 2.7% to 3.6%) underinterpreted. Verification of invasive breast cancer and benign without atypia diagnoses is highly probable; estimated predictive values were 97.7% (CI, 96.5% to 98.7%) and 97.1% (CI, 96.7% to 97.4%), respectively. Verification is less probable for atypia (53.6% overinterpreted and 8.6% underinterpreted) and ductal carcinoma in situ (DCIS) (18.5% overinterpreted and 11.8% underinterpreted).

LIMITATIONS

Estimates are based on a testing situation with 1 slide used per case and without access to second opinions. Population-adjusted estimates may differ for women from other age groups, unscreened women, or women in different practice settings.

CONCLUSION

This analysis, based on interpretation of a single breast biopsy slide per case, predicts a low likelihood that a diagnosis of atypia or DCIS would be verified by a reference consensus diagnosis. This diagnostic grey zone should be considered in clinical management decisions in patients with these diagnoses.

PRIMARY FUNDING SOURCE

National Cancer Institute.

Reliability of diagnosis from Mohs slides: interpersonal and intrapersonal agreement on basal cell carcinoma presence and histological subtype

BACKGROUND

The success of Mohs micrographic surgery (MMS) depends partly on the correct diagnosis of slides.

OBJECTIVES

To determine reliability of diagnosis from Mohs slides.

METHODS

This was a prospective study evaluating the reliability of diagnosis from Mohs slides of basal cell carcinoma (BCC) presence, BCC location on the slide and BCC subtype among six raters who independently assessed 50 Mohs slides twice with a 2-month interval. Slides were randomly selected whereby difficult-to-diagnose slides were oversampled. For each slide, a reference diagnosis was established by an expert panel. Cohen's kappa (κ) was calculated to determine levels of agreement interpersonally (rater vs. reference diagnosis) and intrapersonally (rater at T1 vs. T2). Multivariable logistic regression was used to determine independent risk factors for slides with interpersonal discordant diagnosis. The variables studied were BCC presence, whether a slide was scored as easy or difficult to diagnose, review duration of the 50 slides, profession and years of experience in diagnosis from Mohs slides.

RESULTS

Interpersonal and intrapersonal agreement were substantial on BCC presence (κ = 0·66 and 0·68) and moderate on BCC subtype (κ = 0·45 and 0·55). Slides that were scored as difficult to diagnose were an independent risk factor for interpersonal discordant diagnosis on BCC presence (odds ratio 3·54, 95% confidence interval 1·81-6·84).

CONCLUSIONS

Reliability of diagnosis from Mohs slides was substantial on BCC presence and moderate on BCC subtype. For slides that are scored difficult to diagnose, a second opinion is recommended to prevent misinterpretation and thereby recurrence of skin cancer.

The Influence of Disease Severity of Preceding Clinical Cases on Pathologists' Medical Decision Making

BACKGROUND

Medical decision making may be influenced by contextual factors. We evaluated whether pathologists are influenced by disease severity of recently observed cases.

METHODS

Pathologists independently interpreted 60 breast biopsy specimens (one slide per case; 240 total cases in the study) in a prospective randomized observational study. Pathologists interpreted the same cases in 2 phases, separated by a washout period of >6 months. Participants were not informed that the cases were identical in each phase, and the sequence was reordered randomly for each pathologist and between phases. A consensus reference diagnosis was established for each case by 3 experienced breast pathologists. Ordered logit models examined the effect the pathologists' diagnoses on the preceding case or the 5 preceding cases had on their diagnosis for the subsequent index case.

RESULTS

Among 152 pathologists, 49 provided interpretive data in both phases I and II, 66 from only phase I, and 37 from phase II only. In phase I, pathologists were more likely to indicate a more severe diagnosis than the reference diagnosis when the preceding case was diagnosed as ductal carcinoma in situ (DCIS) or invasive cancer (proportional odds ratio [POR], 1.28; 95% confidence interval [CI], 1.15-1.42). Results were similar when considering the preceding 5 cases and for the pathologists in phase II who interpreted the same cases in a different order compared with phase I (POR, 1.17; 95% CI, 1.05-1.31).

CONCLUSION

Physicians appear to be influenced by the severity of previously interpreted test cases. Understanding types and sources of diagnostic bias may lead to improved assessment of accuracy and better patient care.

Examining the Relationship between Pre-Malignant Breast Lesions, Carcinogenesis and Tumor Evolution in the Mammary Epithelium Using an Agent-Based Model

INTRODUCTION

Breast cancer, the product of numerous rare mutational events that occur over an extended time period, presents numerous challenges to investigators interested in studying the transformation from normal breast epithelium to malignancy using traditional laboratory methods, particularly with respect to characterizing transitional and pre-malignant states. Dynamic computational modeling can provide insight into these pathophysiological dynamics, and as such we use a previously validated agent-based computational model of the mammary epithelium (the DEABM) to investigate the probabilistic mechanisms by which normal populations of ductal cells could transform into states replicating features of both pre-malignant breast lesions and a diverse set of breast cancer subtypes.

METHODS

The DEABM consists of simulated cellular populations governed by algorithms based on accepted and previously published cellular mechanisms. Cells respond to hormones, undergo mitosis, apoptosis and cellular differentiation. Heritable mutations to 12 genes prominently implicated in breast cancer are acquired via a probabilistic mechanism. 3000 simulations of the 40-year period of menstrual cycling were run in wild-type (WT) and BRCA1-mutated groups. Simulations were analyzed by development of hyperplastic states, incidence of malignancy, hormone receptor and HER-2 status, frequency of mutation to particular genes, and whether mutations were early events in carcinogenesis.

RESULTS

Cancer incidence in WT (2.6%) and BRCA1-mutated (45.9%) populations closely matched published epidemiologic rates. Hormone receptor expression profiles in both WT and BRCA groups also closely matched epidemiologic data. Hyperplastic populations carried more mutations than normal populations and mutations were similar to early mutations found in ER+ tumors (telomerase, E-cadherin, TGFB, RUNX3, p < .01). ER- tumors carried significantly more mutations and carried more early mutations in BRCA1, c-MYC and genes associated with epithelial-mesenchymal transition.

CONCLUSIONS

The DEABM generates diverse tumors that express tumor markers consistent with epidemiologic data. The DEABM also generates non-invasive, hyperplastic populations, analogous to atypia or ductal carcinoma in situ (DCIS), via mutations to genes known to be present in hyperplastic lesions and as early mutations in breast cancers. The results demonstrate that agent-based models are well-suited to studying tumor evolution through stages of carcinogenesis and have the potential to be used to develop prevention and treatment strategies.

Fundamental developments in infrared spectroscopic imaging for biomedical applications

Infrared chemical imaging is a rapidly emerging field with new advances in instrumentation, data acquisition and data analysis. These developments have had significant impact in biomedical applications and numerous studies have now shown that this technology offers great promise for the improved diagnosis of the diseased state. Relying on purely biochemical signatures rather than contrast from exogenous dyes and stains, infrared chemical imaging has the potential to revolutionise histopathology for improved disease diagnosis. In this review we discuss the recent advances in infrared spectroscopic imaging specifically related to spectral histopathology (SHP) and consider the current state of the field. Finally we consider the practical application of SHP for disease diagnosis and consider potential barriers to clinical translation highlighting current directions and the future outlook.

Factors related to breast cancer detection mode and time to diagnosis in Alberta, Canada: a population-based retrospective cohort study

Background

Understanding the factors affecting the mode and timeliness of breast cancer diagnosis is important to optimizing patient experiences and outcomes. The purposes of the study were to identify factors related to the length of the diagnostic interval and assess how they vary by mode of diagnosis: screen or symptom detection.

Methods

All female residents of Alberta diagnosed with first primary breast cancer in years 2004–2010 were identified from the Alberta Cancer Registry. Data were linked to Physician Claims and screening program databases. Screen-detected patients were identified as having a screening mammogram within 6-months prior to diagnosis; remaining patients were considered symptom-detected. Separate quantile regression was conducted for each detection mode to assess the relationship between demographic/clinical and healthcare factors.

Results

Overall, 38 % of the 12,373 breast cancer cases were screen-detected compared to 47 % of the screen-eligible population. Health region of residence was strongly associated with cancer detection mode. The median diagnostic interval for screen and symptom-detected cancers was 19 and 21 days, respectively. The variation by health region, however, was large ranging from an estimated median of 4 to 37 days for screen-detected patients and from 17 to 33 days for symptom-detected patients. Cancer stage was inversely associated with the diagnostic interval for symptom-detected cancers, but not for screen-detected cancers.

Conclusion

Significant variation by health region in both the percentage of women with screen-detected cancer and the length of the diagnostic interval for screen and symptom-detected breast cancers suggests there could be important differences in local breast cancer diagnostic care coordination.

Management of atypical lobular hyperplasia, atypical ductal hyperplasia, and lobular carcinoma in situ

Atypical hyperplasia and lobular carcinoma in situ are rare proliferative breast lesions, growing inside ducts and terminal ducto-lobular units. They represent a marker of increased risk for breast cancer and a non-obligate precursor of malignancy. Evidence available on diagnosis and management is scarce. They are frequently found incidentally associated with other lesions, but can be visible through mammography, ultrasound or magnetic resonance. Due to the risk of underestimation, surgical excision is often performed. The analysis of imaging and histopathological characteristics could help identifying low-risk cases, for which surgery is not necessary. Chemopreventive agents can be used for risk reduction. Careful imaging follow up is mandatory; the role of breast MRI as screening modality is under discussion.

Real-world data in the molecular era-finding the reality in the real world

Real-world data (RWD) promises to provide a pivotal element to the understanding of personalized medicine. However, without true representation (or the reality) of the patient-disease biosystem and its molecular contributors, RWD may hamper rather than help this advancement. In this review article, we discuss RWD vs. clinical reality and the disconnects that exist currently (emphasizing molecular medicine), and methods of closing the gaps between RWD and reality.

Progress in Medicine: Experts Take Stock

In the year-end editorial, the PLOS Medicine editors ask 11 researchers and clinicians about the most relevant challenges, promising research, and important initiatives in their fields as we head into 2016.