26
|
Lee G, Singanamalli A, Wang H, Feldman MD, Master SR, Shih NNC, Spangler E, Rebbeck T, Tomaszewski JE, Madabhushi A. Supervised multi-view canonical correlation analysis (sMVCCA): integrating histologic and proteomic features for predicting recurrent prostate cancer. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:284-297. [PMID: 25203987 DOI: 10.1109/tmi.2014.2355175] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
In this work, we present a new methodology to facilitate prediction of recurrent prostate cancer (CaP) following radical prostatectomy (RP) via the integration of quantitative image features and protein expression in the excised prostate. Creating a fused predictor from high-dimensional data streams is challenging because the classifier must 1) account for the "curse of dimensionality" problem, which hinders classifier performance when the number of features exceeds the number of patient studies and 2) balance potential mismatches in the number of features across different channels to avoid classifier bias towards channels with more features. Our new data integration methodology, supervised Multi-view Canonical Correlation Analysis (sMVCCA), aims to integrate infinite views of highdimensional data to provide more amenable data representations for disease classification. Additionally, we demonstrate sMVCCA using Spearman's rank correlation which, unlike Pearson's correlation, can account for nonlinear correlations and outliers. Forty CaP patients with pathological Gleason scores 6-8 were considered for this study. 21 of these men revealed biochemical recurrence (BCR) following RP, while 19 did not. For each patient, 189 quantitative histomorphometric attributes and 650 protein expression levels were extracted from the primary tumor nodule. The fused histomorphometric/proteomic representation via sMVCCA combined with a random forest classifier predicted BCR with a mean AUC of 0.74 and a maximum AUC of 0.9286. We found sMVCCA to perform statistically significantly (p < 0.05) better than comparative state-of-the-art data fusion strategies for predicting BCR. Furthermore, Kaplan-Meier analysis demonstrated improved BCR-free survival prediction for the sMVCCA-fused classifier as compared to histology or proteomic features alone.
Collapse
|
27
|
Lee G, Sparks R, Ali S, Shih NNC, Feldman MD, Spangler E, Rebbeck T, Tomaszewski JE, Madabhushi A. Co-occurring gland angularity in localized subgraphs: predicting biochemical recurrence in intermediate-risk prostate cancer patients. PLoS One 2014; 9:e97954. [PMID: 24875018 PMCID: PMC4038543 DOI: 10.1371/journal.pone.0097954] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2014] [Accepted: 04/27/2014] [Indexed: 11/19/2022] Open
Abstract
Quantitative histomorphometry (QH) refers to the application of advanced computational image analysis to reproducibly describe disease appearance on digitized histopathology images. QH thus could serve as an important complementary tool for pathologists in interrogating and interpreting cancer morphology and malignancy. In the US, annually, over 60,000 prostate cancer patients undergo radical prostatectomy treatment. Around 10,000 of these men experience biochemical recurrence within 5 years of surgery, a marker for local or distant disease recurrence. The ability to predict the risk of biochemical recurrence soon after surgery could allow for adjuvant therapies to be prescribed as necessary to improve long term treatment outcomes. The underlying hypothesis with our approach, co-occurring gland angularity (CGA), is that in benign or less aggressive prostate cancer, gland orientations within local neighborhoods are similar to each other but are more chaotically arranged in aggressive disease. By modeling the extent of the disorder, we can differentiate surgically removed prostate tissue sections from (a) benign and malignant regions and (b) more and less aggressive prostate cancer. For a cohort of 40 intermediate-risk (mostly Gleason sum 7) surgically cured prostate cancer patients where half suffered biochemical recurrence, the CGA features were able to predict biochemical recurrence with 73% accuracy. Additionally, for 80 regions of interest chosen from the 40 studies, corresponding to both normal and cancerous cases, the CGA features yielded a 99% accuracy. CGAs were shown to be statistically signicantly () better at predicting BCR compared to state-of-the-art QH methods and postoperative prostate cancer nomograms.
Collapse
|
28
|
Toth RJ, Shih N, Tomaszewski JE, Feldman MD, Kutter O, Yu DN, Paulus JC, Paladini G, Madabhushi A. Histostitcher™: An informatics software platform for reconstructing whole-mount prostate histology using the extensible imaging platform framework. J Pathol Inform 2014; 5:8. [PMID: 24843820 PMCID: PMC4023035 DOI: 10.4103/2153-3539.129441] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2013] [Accepted: 12/18/2013] [Indexed: 11/04/2022] Open
Abstract
CONTEXT Co-registration of ex-vivo histologic images with pre-operative imaging (e.g., magnetic resonance imaging [MRI]) can be used to align and map disease extent, and to identify quantitative imaging signatures. However, ex-vivo histology images are frequently sectioned into quarters prior to imaging. AIMS This work presents Histostitcher™, a software system designed to create a pseudo whole mount histology section (WMHS) from a stitching of four individual histology quadrant images. MATERIALS AND METHODS Histostitcher™ uses user-identified fiducials on the boundary of two quadrants to stitch such quadrants. An original prototype of Histostitcher™ was designed using the Matlab programming languages. However, clinical use was limited due to slow performance, computer memory constraints and an inefficient workflow. The latest version was created using the extensible imaging platform (XIP™) architecture in the C++ programming language. A fast, graphics processor unit renderer was designed to intelligently cache the visible parts of the histology quadrants and the workflow was significantly improved to allow modifying existing fiducials, fast transformations of the quadrants and saving/loading sessions. RESULTS The new stitching platform yielded significantly more efficient workflow and reconstruction than the previous prototype. It was tested on a traditional desktop computer, a Windows 8 Surface Pro table device and a 27 inch multi-touch display, with little performance difference between the different devices. CONCLUSIONS Histostitcher™ is a fast, efficient framework for reconstructing pseudo WMHS from individually imaged quadrants. The highly modular XIP™ framework was used to develop an intuitive interface and future work will entail mapping the disease extent from the pseudo WMHS onto pre-operative MRI.
Collapse
|
29
|
Agner SC, Rosen MA, Englander S, Tomaszewski JE, Feldman MD, Zhang P, Mies C, Schnall MD, Madabhushi A. Computerized image analysis for identifying triple-negative breast cancers and differentiating them from other molecular subtypes of breast cancer on dynamic contrast-enhanced MR images: a feasibility study. Radiology 2014; 272:91-9. [PMID: 24620909 DOI: 10.1148/radiol.14121031] [Citation(s) in RCA: 110] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
PURPOSE To determine the feasibility of using a computer-aided diagnosis (CAD) system to differentiate among triple-negative breast cancer, estrogen receptor (ER)-positive cancer, human epidermal growth factor receptor type 2 (HER2)-positive cancer, and benign fibroadenoma lesions on dynamic contrast material-enhanced (DCE) magnetic resonance (MR) images. MATERIALS AND METHODS This is a retrospective study of prospectively acquired breast MR imaging data collected from an institutional review board-approved, HIPAA-compliant study between 2002 and 2007. Written informed consent was obtained from all patients. The authors collected DCE MR images from 65 women with 76 breast lesions who had been recruited into a larger study of breast MR imaging. The women had triple-negative (n = 21), ER-positive (n = 25), HER2-positive (n = 18), or fibroadenoma (n = 12) lesions. All lesions were classified as Breast Imaging Reporting and Data System category 4 or higher on the basis of previous imaging. Images were subject to quantitative feature extraction, feed-forward feature selection by means of linear discriminant analysis, and lesion classification by using a support vector machine classifier. The area under the receiver operating characteristic curve (Az) was calculated for each of five lesion classification tasks involving triple-negative breast cancers. RESULTS For each pair-wise lesion type comparison, linear discriminant analysis helped identify the most discriminatory features, which in conjunction with a support vector machine classifier yielded an Az of 0.73 (95% confidence interval [CI]: 0.59, 0.87) for triple-negative cancer versus all non-triple-negative lesions, 0.74 (95% CI: 0.60, 0.88) for triple-negative cancer versus ER- and HER2-positive cancer, 0.77 (95% CI: 0.63, 0.91) for triple-negative versus ER-positive cancer, 0.74 (95% CI: 0.58, 0.89) for triple-negative versus HER2-positive cancer, and 0.97 (95% CI: 0.91, 1.00) for triple-negative cancer versus fibroadenoma. CONCLUSION Triple-negative cancers possess certain characteristic features on DCE MR images that can be captured and quantified with CAD, enabling good discrimination of triple-negative cancers from non-triple-negative cancers, as well as between triple-negative cancers and benign fibroadenomas. Such CAD algorithms may provide added diagnostic benefit in identifying the highly aggressive triple-negative cancer phenotype with DCE MR imaging in high-risk women.
Collapse
|
30
|
Bai S, Wei S, Pasha TL, Yao Y, Tomaszewski JE, Bing Z. Immunohistochemical Studies of Metastatic Germ-Cell Tumors in Retroperitoneal Dissection Specimens. Int J Surg Pathol 2013; 21:342-51. [DOI: 10.1177/1066896912471849] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Germ-cell tumors (GCTs) are the most common malignancies in adolescent and young men. These tumors are highly treatable, even at an advanced stage; therefore, accurate diagnosis is imperative. In this study, we evaluated immunohistochemical stains for SALL4, NANOG, glypican-3 (GPC3), D2-40, and CD30 with adequate control in retroperitoneal dissection specimens under the same laboratory conditions. The study groups included 31 cases of metastatic testicular GCTs with the following components: 11 seminomas, 14 embryonal carcinoma (ECs), 12 yolk sac tumor (YSTs), 8 teratomas, 10 cases of metastatic melanomas, 14 cases of malignant lymphomas, and 11 cases of metastatic, poorly differentiated carcinoma. SALL4 showed diffuse nuclear labeling for all seminomas, ECs, and YSTs. NANOG showed diffuse nuclear positivity in all seminomas and ECs. Metastatic carcinomas, melanomas, and malignant lymphomas were negative for these 2 markers. Gypican-3, D2-40, and CD30 showed sensitive staining for YSTs, seminomas, and ECs, respectively. In conclusion, SALL4 and NANOG are sensitive and specific markers for GCTs. GPC3, D2-40, and CD30 are sensitive but not specific for individual components of GCTs and may be useful in aiding in the differential diagnosis for the individual component of GCTs when the identity of GCT is established.
Collapse
|
31
|
Montone KT, Tomaszewski JE. In Situ Hybridization Protocol for Overall Preservation of mRNA in Fixed Tissues with a Poly d(T) Oligonucleotide Probe. J Histotechnol 2013. [DOI: 10.1179/his.1993.16.4.315] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
32
|
Bai S, Nunez AL, Wei S, Ziober A, Yao Y, Tomaszewski JE, Bing Z. Microsatellite instability and TARBP2 mutation study in upper urinary tract urothelial carcinoma. Am J Clin Pathol 2013; 139:765-70. [PMID: 23690119 DOI: 10.1309/ajcpbslp8xhswlow] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
Microsatellite instability (MSI) contributes to the tumorigenesis of upper urinary tract urothelial carcinomas (UUT-UCs). In this study, we first used MLH1 and MSH2 immunohistochemistry to identify patients with loss of expression of either or both of these proteins in 132 UUT-UCs. We found a total loss of MSH2 expression in 4 patients. MSI was evaluated using 5 markers in these 4 cases. All of the tumors had high MSI (MSI-H) status. Trans-activation responsive RNA-binding protein 2, an integral component of DICER1-containing complex, was a putative target of DNA mismatch repair deficiency. Truncating mutation has been identified in gastrointestinal cancers with MSI. No previous study has evaluated the mutation status of this gene in MSI UUT-UCs. In this study, we analyze the mutation of TARBP2 in MSI-H UUT-UCs with reverse transcription polymerase chain reaction. No truncating mutations were identified in the MSI-H UUT-UCs.
Collapse
|
33
|
Bing Z, Lal P, Lu S, Ziober A, Tomaszewski JE. Role of carbonic anhydrase IX, α-methylacyl coenzyme a racemase, cytokeratin 7, and galectin-3 in the evaluation of renal neoplasms: a tissue microarray immunohistochemical study. Ann Diagn Pathol 2013; 17:58-62. [DOI: 10.1016/j.anndiagpath.2012.07.002] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2012] [Revised: 07/05/2012] [Accepted: 07/05/2012] [Indexed: 12/18/2022]
|
34
|
Bing Z, Li J, Master SR, Lee CC, Puthiyaveettil R, Tomaszewski JE. Fluorescence in situ hybridization study of chromosome abnormalities of upper urinary tract urothelial carcinoma in paraffin-embedded tissue. Am J Clin Pathol 2012; 138:382-9. [PMID: 22912355 DOI: 10.1309/ajcpuxap6p2gvbti] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
Urothelial carcinomas arising from the upper urinary tract (renal pelvis and ureter) are rare and few molecular genetic studies of these tumors have been conducted to date. We investigated hyperploidy at chromosomes 3, 7, and 17 using a multitarget fluorescence in situ hybridization system to identify genetic alterations in patients with urothelial carcinomas of the upper urinary tract. Chromosomal aberrations are seen most frequently in the high-grade tumors. A highly significant relationship was found between an increase in the percentage of hyperdiploidy and high grade for each chromosome (chromosome 3, P = 6 × 10(-4); chromosome 7, P = 2 × 10(-4); chromosome 17, P = 6 × 10(-5)). To determine whether these associations were independent for each chromosome, the correlation between percentage of hyperdiploidy for each pair of chromosomes was examined. In each case, the correlation was highly significant (R = 0.89-0.91). No statistically significant association was found between percentage of hyperdiploidy and tumor stage for any chromosome.
Collapse
|
35
|
Golugula A, Lee G, Master SR, Feldman MD, Tomaszewski JE, Madabhushi A. Supervised regularized canonical correlation analysis: integrating histologic and proteomic data for predicting biochemical failures. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2011:6434-7. [PMID: 22255811 DOI: 10.1109/iembs.2011.6091588] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Multimodal data, especially imaging and non-imaging data, is being routinely acquired in the context of disease diagnostics; however computational challenges have limited the ability to quantitatively integrate imaging and non-imaging data channels with different dimensionalities for making diagnostic and prognostic predictions. The objective of this work is to create a common subspace to simultaneously accommodate both the imaging and non-imaging data, called a metaspace. This metaspace can be used to build a meta-classifier that produces better classification results than a classifier that is based on a single modality alone. In this paper, we present a novel Supervised Regularized Canonical Correlation Analysis (SRCCA) algorithm that (1) enables the quantitative integration of data from multiple modalities using a feature selection scheme, (2) is regularized, and (3) is computationally cheap. We leverage this SRCCA framework towards the fusion of proteomic and histologic image signatures for identifying prostate cancer patients at risk for biochemical recurrence following radical prostatectomy. For a cohort of 19 prostate cancer patients, SRCCA was able to yield a lower fused dimensional metaspace comprising both the histological and proteomic attributes. In conjunction with SRCCA, a random forest classifier was able to identify patients at risk for biochemical failure with a maximum accuracy of 93%. The classifier performance in the SRCCA space was statistically significantly higher compared to the fused data representations obtained either with Canonical Correlation Analysis (CCA) or Regularized CCA.
Collapse
|
36
|
Liu C, Koeberlein B, Feldman MD, Mueller R, Wang Z, Li Y, Lane K, Hoyt CC, Tomaszewski JE, Naji A, Rickels MR. Accumulation of intrahepatic islet amyloid in a nonhuman primate transplant model. Endocrinology 2012; 153:1673-83. [PMID: 22355065 PMCID: PMC3320262 DOI: 10.1210/en.2011-1560] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Islet amyloid is hypothesized to play a role in nonimmunologic transplanted islet graft loss. We performed a quantitative histologic analysis of liver biopsies from intrahepatic islet grafts transplanted in streptozotocin-induced diabetic cynomolgus macaques. Seven animals treated with antithymocyte globulin (ATG) and rapamycin or ATG and rituximab experienced islet graft rejection with lymphocytic infiltrates present on islet graft biopsies. Except for one case involving the oldest and largest donor where amyloid was present on initial biopsy 1 month after transplant, none of the six other cases with rejection contained amyloid, including one case biopsied serially to 25 months. In contrast, four out of six animals treated with ATG and rituximab and rapamycin had no evidence of rejection at the time of biopsy (two animals that discontinued rapamycin had mild periislet lymphocytes), and all four cases followed more than 4 months demonstrated amyloid deposition at subsequent time points. Amyloid severity increased with time after transplant (r = 0.68; P < 0.05) and with decreasing islet β-cell area (r = -0.68; P < 0.05). In two islet recipients with no evidence of rejection and still normoglycemic and insulin independent at the first detection of amyloid, β-cell secretory capacity declined over time coincident with increasing amyloid severity and decreasing β-cell area, with both animals eventually becoming hyperglycemic and insulin dependent. Transplanted islet amyloid also developed in autologous islets placed sc. These results indicate that in cynomolgus macaques, transplanted islets may accumulate amyloid over time associated with subsequent decline in β-cell mass and function and support the development of intrahepatic islet amyloid as a potential mechanism for nonimmunologic islet graft loss.
Collapse
|
37
|
Bing Z, Yao Y, Pasha T, Tomaszewski JE, Zhang PJ. p53 in Pure Epithelioid PEComa. Int J Surg Pathol 2012; 20:115-22. [DOI: 10.1177/1066896912441829] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Pure epithelioid PEComa (PEP; so-called epithelioid angiomyolipoma) is rare and is more often associated with aggressive behaviors. The pathogenesis of PEP has been poorly understood. The authors studied p53 expression and gene mutation in PEPs by immunohistochemistry, single-strand conformation polymorphism, and direct sequencing in paraffin material from 8 PEPs. A group of classic angiomyolipomas (AMLs) were also analyzed for comparison. Five PEPs were from kidneys and 1 each from the heart, the liver, and the uterus. PEPs showed much stronger p53 nuclear staining (Allred score 6.4 ± 2.5) than the classic AML (2.3 ± 2.9) ( P < .01). There was no p53 single-strand conformation polymorphism identified in either the PEPs or the 8 classic AMLs. p53 mutation analyses by direct sequencing of exons 5 to 9 showed 4 mutations in 3 of 8 PEPs but none in any of the 8 classic AMLs. The mutations included 2 missense mutations in a hepatic PEComa and 2 silent mutations in 2 renal PEPs. Both the missense mutations in the hepatic PEComa involved the exon 5, one involving codon 165, with change from CAG to CAC (coding amino acid changed from glutamine to histidine), and the other involving codon 182, with change from TGC to TAC (coding amino acid changed from cysteine to tyrosine). The finding of stronger p53 expression and mutations in epithelioid angiomyolipomas might have contributed to their less predictable behavior. However, the abnormal p53 expression cannot be entirely explained by p53 mutations in the exons examined in the PEPs.
Collapse
|
38
|
Hipp J, Monaco J, Kunju LP, Cheng J, Yagi Y, Rodriguez-Canales J, Emmert-Buck MR, Hewitt S, Feldman MD, Tomaszewski JE, Toner M, Tompkins RG, Flotte T, Lucas D, Gilbertson JR, Madabhushi A, Balis U. Integration of architectural and cytologic driven image algorithms for prostate adenocarcinoma identification. Anal Cell Pathol (Amst) 2012; 35:251-265. [PMID: 22425661 PMCID: PMC4605585 DOI: 10.3233/acp-2012-0054] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2011] [Accepted: 02/06/2012] [Indexed: 05/31/2023] Open
Abstract
INTRODUCTION The advent of digital slides offers new opportunities within the practice of pathology such as the use of image analysis techniques to facilitate computer aided diagnosis (CAD) solutions. Use of CAD holds promise to enable new levels of decision support and allow for additional layers of quality assurance and consistency in rendered diagnoses. However, the development and testing of prostate cancer CAD solutions requires a ground truth map of the cancer to enable the generation of receiver operator characteristic (ROC) curves. This requires a pathologist to annotate, or paint, each of the malignant glands in prostate cancer with an image editor software - a time consuming and exhaustive process. Recently, two CAD algorithms have been described: probabilistic pairwise Markov models (PPMM) and spatially-invariant vector quantization (SIVQ). Briefly, SIVQ operates as a highly sensitive and specific pattern matching algorithm, making it optimal for the identification of any epithelial morphology, whereas PPMM operates as a highly sensitive detector of malignant perturbations in glandular lumenal architecture. METHODS By recapitulating algorithmically how a pathologist reviews prostate tissue sections, we created an algorithmic cascade of PPMM and SIVQ algorithms as previously described by Doyle el al. [1] where PPMM identifies the glands with abnormal lumenal architecture, and this area is then screened by SIVQ to identify the epithelium. RESULTS The performance of this algorithm cascade was assessed qualitatively (with the use of heatmaps) and quantitatively (with the use of ROC curves) and demonstrates greater performance in the identification of malignant prostatic epithelium. CONCLUSION This ability to semi-autonomously paint nearly all the malignant epithelium of prostate cancer has immediate applications to future prostate cancer CAD development as a validated ground truth generator. In addition, such an approach has potential applications as a pre-screening/quality assurance tool.
Collapse
|
39
|
Golugula A, Lee G, Master SR, Feldman MD, Tomaszewski JE, Speicher DW, Madabhushi A. Supervised regularized canonical correlation analysis: integrating histologic and proteomic measurements for predicting biochemical recurrence following prostate surgery. BMC Bioinformatics 2011; 12:483. [PMID: 22182303 PMCID: PMC3267835 DOI: 10.1186/1471-2105-12-483] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2011] [Accepted: 12/19/2011] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Multimodal data, especially imaging and non-imaging data, is being routinely acquired in the context of disease diagnostics; however, computational challenges have limited the ability to quantitatively integrate imaging and non-imaging data channels with different dimensionalities and scales. To the best of our knowledge relatively few attempts have been made to quantitatively fuse such data to construct classifiers and none have attempted to quantitatively combine histology (imaging) and proteomic (non-imaging) measurements for making diagnostic and prognostic predictions. The objective of this work is to create a common subspace to simultaneously accommodate both the imaging and non-imaging data (and hence data corresponding to different scales and dimensionalities), called a metaspace. This metaspace can be used to build a meta-classifier that produces better classification results than a classifier that is based on a single modality alone. Canonical Correlation Analysis (CCA) and Regularized CCA (RCCA) are statistical techniques that extract correlations between two modes of data to construct a homogeneous, uniform representation of heterogeneous data channels. In this paper, we present a novel modification to CCA and RCCA, Supervised Regularized Canonical Correlation Analysis (SRCCA), that (1) enables the quantitative integration of data from multiple modalities using a feature selection scheme, (2) is regularized, and (3) is computationally cheap. We leverage this SRCCA framework towards the fusion of proteomic and histologic image signatures for identifying prostate cancer patients at the risk of 5 year biochemical recurrence following radical prostatectomy. RESULTS A cohort of 19 grade, stage matched prostate cancer patients, all of whom had radical prostatectomy, including 10 of whom had biochemical recurrence within 5 years of surgery and 9 of whom did not, were considered in this study. The aim was to construct a lower fused dimensional metaspace comprising both the histological and proteomic measurements obtained from the site of the dominant nodule on the surgical specimen. In conjunction with SRCCA, a random forest classifier was able to identify prostate cancer patients, who developed biochemical recurrence within 5 years, with a maximum classification accuracy of 93%. CONCLUSIONS The classifier performance in the SRCCA space was found to be statistically significantly higher compared to the fused data representations obtained, not only from CCA and RCCA, but also two other statistical techniques called Principal Component Analysis and Partial Least Squares Regression. These results suggest that SRCCA is a computationally efficient and a highly accurate scheme for representing multimodal (histologic and proteomic) data in a metaspace and that it could be used to construct fused biomarkers for predicting disease recurrence and prognosis.
Collapse
|
40
|
Hipp J, Cheng J, Pantanowitz L, Hewitt S, Yagi Y, Monaco J, Madabhushi A, Rodriguez-Canales J, Hanson J, Roy-Chowdhuri S, Filie AC, Feldman MD, Tomaszewski JE, Shih NN, Brodsky V, Giaccone G, Emmert-Buck MR, Balis UJ. Image microarrays (IMA): Digital pathology's missing tool. J Pathol Inform 2011; 2:47. [PMID: 22200030 PMCID: PMC3237063 DOI: 10.4103/2153-3539.86829] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2011] [Accepted: 09/23/2011] [Indexed: 12/04/2022] Open
Abstract
Introduction: The increasing availability of whole slide imaging (WSI) data sets (digital slides) from glass slides offers new opportunities for the development of computer-aided diagnostic (CAD) algorithms. With the all-digital pathology workflow that these data sets will enable in the near future, literally millions of digital slides will be generated and stored. Consequently, the field in general and pathologists, specifically, will need tools to help extract actionable information from this new and vast collective repository. Methods: To address this limitation, we designed and implemented a tool (dCORE) to enable the systematic capture of image tiles with constrained size and resolution that contain desired histopathologic features. Results: In this communication, we describe a user-friendly tool that will enable pathologists to mine digital slides archives to create image microarrays (IMAs). IMAs are to digital slides as tissue microarrays (TMAs) are to cell blocks. Thus, a single digital slide could be transformed into an array of hundreds to thousands of high quality digital images, with each containing key diagnostic morphologies and appropriate controls. Current manual digital image cut-and-paste methods that allow for the creation of a grid of images (such as an IMA) of matching resolutions are tedious. Conclusion: The ability to create IMAs representing hundreds to thousands of vetted morphologic features has numerous applications in education, proficiency testing, consensus case review, and research. Lastly, in a manner analogous to the way conventional TMA technology has significantly accelerated in situ studies of tissue specimens use of IMAs has similar potential to significantly accelerate CAD algorithm development.
Collapse
|
41
|
Chappelow J, Tomaszewski JE, Feldman M, Shih N, Madabhushi A. HistoStitcher(©): an interactive program for accurate and rapid reconstruction of digitized whole histological sections from tissue fragments. Comput Med Imaging Graph 2011; 35:557-67. [PMID: 21397459 PMCID: PMC3118267 DOI: 10.1016/j.compmedimag.2011.01.010] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2010] [Revised: 01/27/2011] [Accepted: 01/27/2011] [Indexed: 11/25/2022]
Abstract
We present an interactive program called HistoStitcher(©) for accurate and rapid reassembly of histology fragments into a pseudo-whole digitized histological section. HistoStitcher(©) provides both an intuitive graphical interface to assist the operator in performing the stitch of adjacent histology fragments by selecting pairs of anatomical landmarks, and a set of computational routines for determining and applying an optimal linear transformation to generate the stitched image. Reconstruction of whole histological sections from images of slides containing smaller fragments is required in applications where preparation of whole sections of large tissue specimens is not feasible or efficient, and such whole mounts are required to facilitate (a) disease annotation and (b) image registration with radiological images. Unlike manual reassembly of image fragments in a general purpose image editing program (such as Photoshop), HistoStitcher(©) provides memory efficient operation on high resolution digitized histology images and a highly flexible stitching process capable of producing more accurate results in less time. Further, by parameterizing the series of transformations determined by the stitching process, the stitching parameters can be saved, loaded at a later time, refined, or reapplied to multi-resolution scans, or quickly transmitted to another site. In this paper, we describe in detail the design of HistoStitcher(©) and the mathematical routines used for calculating the optimal image transformation, and demonstrate its operation for stitching high resolution histology quadrants of a prostate specimen to form a digitally reassembled whole histology section, for 8 different patient studies. To evaluate stitching quality, a 6 point scoring scheme, which assesses the alignment and continuity of anatomical structures important for disease annotation, is employed by three independent expert pathologists. For 6 studies compared with this scheme, reconstructed sections generated via HistoStitcher(©) scored higher than reconstructions generated by an expert pathologist using Photoshop.
Collapse
|
42
|
Reshef R, Luskin MR, Kamoun M, Vardhanabhuti S, Tomaszewski JE, Stadtmauer EA, Porter DL, Heitjan DF, Tsai DE. Association of HLA polymorphisms with post-transplant lymphoproliferative disorder in solid-organ transplant recipients. Am J Transplant 2011; 11:817-25. [PMID: 21401872 PMCID: PMC3072270 DOI: 10.1111/j.1600-6143.2011.03454.x] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
The association between HLA polymorphisms and PTLD was investigated in a case-control study, comparing 110 predominantly adult solid-organ transplant recipients who developed PTLD to 5601 who did not. Donor and recipient HLA were analyzed. We detected a significant association between recipient HLA-A26 and the development of PTLD (OR 2.74; p = 0.0007). In Caucasian recipients, both recipient and donor HLA-A26 were independently associated with development of PTLD (recipient A26 OR 2.99; p = 0.0004, donor A26 OR 2.81; p = 0.002). Analysis of HLA-A and -B haplotypes revealed that recipient HLA-A26, B38 haplotype was strongly correlated with a higher incidence of EBV-positive PTLD (OR 3.99; p = 0.001). The common ancestral haplotype HLA-A1, B8, DR3, when carried by the donor, was protective against PTLD (OR 0.41; p = 0.05). Several other HLA specificities demonstrated associations with clinical and pathological characteristics as well as survival. These findings demonstrate the importance of HLA polymorphisms in modulating the risk for PTLD, and may be useful in risk stratification and development of monitoring and prophylaxis strategies.
Collapse
|
43
|
Resnick MJ, Lee DJ, Magerfleisch L, Vanarsdalen KN, Tomaszewski JE, Wein AJ, Malkowicz SB, Guzzo TJ. Repeat prostate biopsy and the incremental risk of clinically insignificant prostate cancer. Urology 2011; 77:548-52. [PMID: 21215436 DOI: 10.1016/j.urology.2010.08.063] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2010] [Revised: 08/15/2010] [Accepted: 08/26/2010] [Indexed: 01/23/2023]
Abstract
OBJECTIVES To determine the incremental risk of diagnosis of clinically insignificant prostate cancer with serial prostate biopsies. METHODS We reviewed our institutional radical prostatectomy (RP) database comprising 2411 consecutive patients undergoing RP. We then stratified patients by the prostate biopsy on which their cancer was diagnosed and correlated biopsy number with the risk of clinically insignificant disease and adverse pathology at radical prostatectomy. RESULTS A total of 1867 (77.4%), 281 (11.9%), and 175 (7.3%) patients underwent 1, 2, and 3 or more prostate biopsies, respectively, before RP. Increasing number of prostate biopsies was associated with increasing prostate volume (P <.01), prostate-specific antigen (P <.01), associated prostate intraepithelial neoplasia (P <.01), and increased likelihood of clinical Gleason 6 or less disease (P <.01). On pathologic analysis, increasing number of prostate biopsies was associated with increased risk of low-volume (P <.01), organ-confined (P <.01) disease. The risk of clinically insignificant disease was found to be 31.1%, 43.8%, and 46.8% in those undergoing 1, 2, and 3+ prostate biopsies, respectively. Conversely, the risk of adverse pathology was found to be 64.6%, 53.0%, and 52.0% in those undergoing 1, 2, and 3+ prostate biopsies, respectively. CONCLUSIONS Patients undergoing multiple prostate biopsies before RP are more likely to harbor clinically insignificant prostate cancer than those who only undergo 1 biopsy before resection. Nonetheless, the risk of adverse pathology in patients undergoing serial biopsies remains significant. The increased risk of prostate cancer overdiagnosis and overtreatment must be balanced with the continued risk of clinically significant disease when counseling patients regarding serial biopsies.
Collapse
|
44
|
Guzzo TJ, Resnick MJ, Canter DJ, Balandra A, Bergey MR, Magerfleisch L, Tomaszewski JE, Vaughn DJ, Malkowicz SB. Impact of adjuvant chemotherapy on patients with lymph node metastasis at the time of radical cystectomy. THE CANADIAN JOURNAL OF UROLOGY 2010; 17:5465-5471. [PMID: 21172112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
INTRODUCTION Radical cystectomy (RC) remains the gold standard treatment for patients with muscle-invasive bladder cancer. Unfortunately, a significant proportion of patients will have lymph node involvement at the time of RC. We set out to determine the impact of adjuvant cisplatin-based chemotherapy (AC) in a cohort of lymph node positive patients following RC. PATIENTS AND METHODS We reviewed our RC database and isolated patients with lymph node positive disease at the time of RC. Univariate and multivariable analysis was performed to identify predictors of poor outcome in patients receiving AC. Overall survival (OS), disease specific survival (DSS) and recurrence free survival (RFS) were calculated for those patients who received AC compared to those who did not. RESULTS Of the 316 patients, we identified 85 patients with metastatic lymph node involvement at the time of RC. Fifty-five (65%) of these patients received AC. Median follow up was 46 months. On multivariable analysis lymph node positive patients receiving AC had significantly improved OS, DSS and RFS compared to patients who did not receive AC (p = 0.031, p = 0.028, p = 0.004). The delivery of AC conferred the greatest recurrence-free, disease-specific, and overall survival advantages to those with lymph node densities (LND) of < 20% with (p = 0.016, p = 0.011, p = 0.007, respectively). CONCLUSION AC administered to patients with known lymph node metastasis conferred a significant survival advantage compared to observation. Furthermore, a LND of < 20% predicts of a more favorable response to AC. Further studies in larger patient populations are warranted to reveal the exact impact of AC in this subset of patients.
Collapse
|
45
|
Resnick MJ, Bergey M, Magerfleisch L, Tomaszewski JE, Malkowicz SB, Guzzo TJ. Longitudinal evaluation of the concordance and prognostic value of lymphovascular invasion in transurethral resection and radical cystectomy specimens. BJU Int 2010; 107:46-52. [DOI: 10.1111/j.1464-410x.2010.09635.x] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
46
|
Monaco JP, Tomaszewski JE, Feldman MD, Hagemann I, Moradi M, Mousavi P, Boag A, Davidson C, Abolmaesumi P, Madabhushi A. High-throughput detection of prostate cancer in histological sections using probabilistic pairwise Markov models. Med Image Anal 2010; 14:617-29. [PMID: 20493759 DOI: 10.1016/j.media.2010.04.007] [Citation(s) in RCA: 90] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2009] [Revised: 04/11/2010] [Accepted: 04/23/2010] [Indexed: 11/25/2022]
Abstract
In this paper we present a high-throughput system for detecting regions of carcinoma of the prostate (CaP) in HSs from radical prostatectomies (RPs) using probabilistic pairwise Markov models (PPMMs), a novel type of Markov random field (MRF). At diagnostic resolution a digitized HS can contain 80Kx70K pixels - far too many for current automated Gleason grading algorithms to process. However, grading can be separated into two distinct steps: (1) detecting cancerous regions and (2) then grading these regions. The detection step does not require diagnostic resolution and can be performed much more quickly. Thus, we introduce a CaP detection system capable of analyzing an entire digitized whole-mount HS (2x1.75cm(2)) in under three minutes (on a desktop computer) while achieving a CaP detection sensitivity and specificity of 0.87 and 0.90, respectively. We obtain this high-throughput by tailoring the system to analyze the HSs at low resolution (8microm per pixel). This motivates the following algorithm: (Step 1) glands are segmented, (Step 2) the segmented glands are classified as malignant or benign, and (Step 3) the malignant glands are consolidated into continuous regions. The classification of individual glands leverages two features: gland size and the tendency for proximate glands to share the same class. The latter feature describes a spatial dependency which we model using a Markov prior. Typically, Markov priors are expressed as the product of potential functions. Unfortunately, potential functions are mathematical abstractions, and constructing priors through their selection becomes an ad hoc procedure, resulting in simplistic models such as the Potts. Addressing this problem, we introduce PPMMs which formulate priors in terms of probability density functions, allowing the creation of more sophisticated models. To demonstrate the efficacy of our CaP detection system and assess the advantages of using a PPMM prior instead of the Potts, we alternately incorporate both priors into our algorithm and rigorously evaluate system performance, extracting statistics from over 6000 simulations run across 40 RP specimens. Perhaps the most indicative result is as follows: at a CaP sensitivity of 0.87 the accompanying false positive rates of the system when alternately employing the PPMM and Potts priors are 0.10 and 0.20, respectively.
Collapse
|
47
|
Fatakdawala H, Xu J, Basavanhally A, Bhanot G, Ganesan S, Feldman M, Tomaszewski JE, Madabhushi A. Expectation-maximization-driven geodesic active contour with overlap resolution (EMaGACOR): application to lymphocyte segmentation on breast cancer histopathology. IEEE Trans Biomed Eng 2010; 57:1676-89. [PMID: 20172780 DOI: 10.1109/tbme.2010.2041232] [Citation(s) in RCA: 141] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The presence of lymphocytic infiltration (LI) has been correlated with nodal metastasis and tumor recurrence in HER2+ breast cancer (BC). The ability to automatically detect and quantify extent of LI on histopathology imagery could potentially result in the development of an image based prognostic tool for human epidermal growth factor receptor-2 (HER2+) BC patients. Lymphocyte segmentation in hematoxylin and eosin (H&E) stained BC histopathology images is complicated by the similarity in appearance between lymphocyte nuclei and other structures (e.g., cancer nuclei) in the image. Additional challenges include biological variability, histological artifacts, and high prevalence of overlapping objects. Although active contours are widely employed in image segmentation, they are limited in their ability to segment overlapping objects and are sensitive to initialization. In this paper, we present a new segmentation scheme, expectation-maximization (EM) driven geodesic active contour with overlap resolution (EMaGACOR), which we apply to automatically detecting and segmenting lymphocytes on HER2+ BC histopathology images. EMaGACOR utilizes the expectation-maximization algorithm for automatically initializing a geodesic active contour (GAC) and includes a novel scheme based on heuristic splitting of contours via identification of high concavity points for resolving overlapping structures. EMaGACOR was evaluated on a total of 100 HER2+ breast biopsy histology images and was found to have a detection sensitivity of over 86% and a positive predictive value of over 64%. By comparison, the EMaGAC model (without overlap resolution) and GAC model yielded corresponding detection sensitivities of 42% and 19%, respectively. Furthermore, EMaGACOR was able to correctly resolve over 90% of overlaps between intersecting lymphocytes. Hausdorff distance (HD) and mean absolute distance (MAD) for EMaGACOR were found to be 2.1 and 0.9 pixels, respectively, and significantly better compared to the corresponding performance of the EMaGAC and GAC models. EMaGACOR is an efficient, robust, reproducible, and accurate segmentation technique that could potentially be applied to other biomedical image analysis problems.
Collapse
|
48
|
Resnick MJ, Canter DJ, Guzzo TJ, Magerfleisch L, Tomaszewski JE, Brucker BM, Bergey MR, Sonnad SS, Wein AJ, Malkowicz SB. Defining pathological variables to predict biochemical failure in patients with positive surgical margins at radical prostatectomy: implications for adjuvant radiotherapy. BJU Int 2009; 105:1377-80. [DOI: 10.1111/j.1464-410x.2009.08953.x] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
49
|
Basavanhally AN, Ganesan S, Agner S, Monaco JP, Feldman MD, Tomaszewski JE, Bhanot G, Madabhushi A. Computerized image-based detection and grading of lymphocytic infiltration in HER2+ breast cancer histopathology. IEEE Trans Biomed Eng 2009; 57:642-53. [PMID: 19884074 DOI: 10.1109/tbme.2009.2035305] [Citation(s) in RCA: 189] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The identification of phenotypic changes in breast cancer (BC) histopathology on account of corresponding molecular changes is of significant clinical importance in predicting disease outcome. One such example is the presence of lymphocytic infiltration (LI) in histopathology, which has been correlated with nodal metastasis and distant recurrence in HER2+ BC patients. In this paper, we present a computer-aided diagnosis (CADx) scheme to automatically detect and grade the extent of LI in digitized HER2+ BC histopathology. Lymphocytes are first automatically detected by a combination of region growing and Markov random field algorithms. Using the centers of individual detected lymphocytes as vertices, three graphs (Voronoi diagram, Delaunay triangulation, and minimum spanning tree) are constructed and a total of 50 image-derived features describing the arrangement of the lymphocytes are extracted from each sample. A nonlinear dimensionality reduction scheme, graph embedding (GE), is then used to project the high-dimensional feature vector into a reduced 3-D embedding space. A support vector machine classifier is used to discriminate samples with high and low LI in the reduced dimensional embedding space. A total of 41 HER2+ hematoxylin-and-eosin-stained images obtained from 12 patients were considered in this study. For more than 100 three-fold cross-validation trials, the architectural feature set successfully distinguished samples of high and low LI levels with a classification accuracy greater than 90%. The popular unsupervised Varma-Zisserman texton-based classification scheme was used for comparison and yielded a classification accuracy of only 60%. Additionally, the projection of the 50 image-derived features for all 41 tissue samples into a reduced dimensional space via GE allowed for the visualization of a smooth manifold that revealed a continuum between low, intermediate, and high levels of LI. Since it is known that extent of LI in BC biopsy specimens is a prognostic indicator, our CADx scheme will potentially help clinicians determine disease outcome and allow them to make better therapy recommendations for patients with HER2+ BC.
Collapse
|
50
|
Bing Z, Pasha T, Tomaszewski JE, Zhang P. CDX2 Expression in Yolk Sac Component of Testicular Germ Cell Tumors. Int J Surg Pathol 2009; 17:373-7. [DOI: 10.1177/1066896909338598] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
CDX2 has been detected in the majority of colorectal adenocarcinoma cases and may be useful in determining the sites of origin of tumors. In this study, the authors evaluated CDX2 expression in germ cell tumors (GCTs) by immunohistochemistry. Forty cases of testicular GCTs and 8 cases of metastatic GCTs were retrieved for study. In the 40 cases of testicular GCTs, 13 were pure seminomas and 27 mixed GCTs. Yolk sac tumor (YST) was identified by morphology and glypican 3 staining in 20 testicular mixed GCTs. Of these 20 cases, 8 cases showed 1+ positivity for CDX2. Other primitive components of GCTs were negative. For the 6 cases of metastatic mixed GCT with YST, 4 cases were positive, 2+ in 2 cases and 1+ in 2 cases. The positivity of CDX2 in GCTs warrants including YST in the differential diagnosis of adenocarcinoma of unknown origin.
Collapse
|