Mapping stain distribution in pathology slides using whole slide imaging

Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology

Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.

Artificial Intelligence in Kidney Cancer

Artificial intelligence is rapidly expanding into nearly all facets of life, particularly within the field of medicine. The diagnosis, characterization, management, and treatment of kidney cancer is ripe with areas for improvement that may be met with the promises of artificial intelligence. Here, we explore the impact of current research work in artificial intelligence for clinicians caring for patients with renal cancer, with a focus on the perspectives of radiologists, pathologists, and urologists. Promising preliminary results indicate that artificial intelligence may assist in the diagnosis and risk stratification of newly discovered renal masses and help guide the clinical treatment of patients with kidney cancer. However, much of the work in this field is still in its early stages, limited in its broader applicability, and hampered by small datasets, the varied appearance and presentation of kidney cancers, and the intrinsic limitations of the rigidly structured tasks artificial intelligence algorithms are trained to complete. Nonetheless, the continued exploration of artificial intelligence holds promise toward improving the clinical care of patients with kidney cancer.

Structural Analysis and Optimization of Convolutional Neural Networks with a Small Sample Size

Deep neural networks have gained immense popularity in the Big Data problem; however, the availability of training samples can be relatively limited in specific application domains, particularly medical imaging, and consequently leading to overfitting problems. This “Small Data” challenge may need a mindset that is entirely different from the existing Big Data paradigm. Here, under the small data scenarios, we examined whether the network structure has a substantial influence on the performance and whether the optimal structure is predominantly determined by sample size or data nature. To this end, we listed all possible combinations of layers given an upper bound of the VC-dimension to study how structural hyperparameters affected the performance. Our results showed that structural optimization improved accuracy by 27.99%, 16.44%, and 13.11% over random selection for a sample size of 100, 500, and 1,000 in the MNIST dataset, respectively, suggesting that the importance of the network structure increases as the sample size becomes smaller. Furthermore, the optimal network structure was mostly determined by the data nature (photographic, calligraphic, or medical images), and less affected by the sample size, suggesting that the optimal network structure is data-driven, not sample size driven. After network structure optimization, the convolutional neural network could achieve 91.13% accuracy with only 500 samples, 93.66% accuracy with only 1000 samples for the MNIST dataset and 94.10% accuracy with only 3300 samples for the Mitosis (microscopic) dataset. These results indicate the primary importance of the network structure and the nature of the data in facing the Small Data challenge.

Automated Renal Cancer Grading Using Nuclear Pleomorphic Patterns

PURPOSE

Nuclear pleomorphic patterns are essential for Fuhrman grading of clear cell renal cell carcinoma (ccRCC). Manual observation of renal histopathologic slides may lead to subjective and inconsistent assessment between pathologists. An automated, image-based system that classifies ccRCC slides by quantifying nuclear pleomorphic patterns in an objective and consistent interpretable fashion can aid pathologists in histopathologic assessment.

METHODS

In the current study, histopathologic tissue slides of 59 patients with ccRCC who underwent surgery at Singapore General Hospital were assembled retrospectively. An automated image classification pipeline detects and analyzes prominent nucleoli in ccRCC images to classify them as either low (Fuhrman grade 1 and 2) or high (Fuhrman grade 3 and 4). The pipeline uses machine learning and image pixel intensity-based feature extraction techniques for nuclear analysis. We trained classification systems that concurrently analyze different permutations of multiple prominent nucleoli image patches.

RESULTS

Given the parameters for feature combination and extraction, we present experimental results across various configurations for the classification of a given ccRCC histopathologic image. We also demonstrate that the image score used by the pipeline, termed fraction value, is correlated ( R = 0.59) with an existing multigene assay-based scoring system that has previously been demonstrated to be a strong indicator of prognosis in patients with ccRCC.

CONCLUSION

The current method provides an objective and fully automated way by which to process pathologic slides. The correlation study with a multigene assay-based scoring system also allows us to provide quantitative interpretation for already established nuclear pleomorphic patterns in ccRCC. This method can be extended to other cancers whose corresponding grading systems use nuclear pattern information.

Recurrence analysis on prostate cancer patients with Gleason score 7 using integrated histopathology whole-slide images and genomic data through deep neural networks

Prostate cancer is the most common nonskin-related cancer, affecting one in seven men in the United States. Gleason score, a sum of the primary and secondary Gleason patterns, is one of the best predictors of prostate cancer outcomes. Recently, significant progress has been made in molecular subtyping prostate cancer through the use of genomic sequencing. It has been established that prostate cancer patients presented with a Gleason score 7 show heterogeneity in both disease recurrence and survival. We built a unified system using publicly available whole-slide images and genomic data of histopathology specimens through deep neural networks to identify a set of computational biomarkers. Using a survival model, the experimental results on the public prostate dataset showed that the computational biomarkers extracted by our approach had hazard ratio as 5.73 and C -index as 0.74, which were higher than standard clinical prognostic factors and other engineered image texture features. Collectively, the results of this study highlight the important role of neural network analysis of prostate cancer and the potential of such approaches in other precision medicine applications.

Image Analysis in Surgical Pathology

Digitization of glass slides of surgical pathology samples facilitates a number of value-added capabilities beyond what a pathologist could previously do with a microscope. Image analysis is one of the most fundamental opportunities to leverage the advantages that digital pathology provides. The ability to quantify aspects of a digital image is an extraordinary opportunity to collect data with exquisite accuracy and reliability. In this review, we describe the history of image analysis in pathology and the present state of technology processes as well as examples of research and clinical use.

Application of clinical bioinformatics in lung cancer-specific biomarkers

The fact that lung cancer is a heterogeneous disease suggests that there is a high likelihood that effective lung cancer biomarkers will need to address patient-specific molecular defects, clinical characters, and aspects of the tumor microenvironment. In this transition, clinical bioinformatics tools and resources are the most appropriate means to improve the analysis, as major biological databases are now containing clinical data alongside genomics, proteomics, and other biological data. Clinical bioinformatics comprises a series of concepts and approaches that have been used successfully both to delineate novel biological mechanisms and to drive translational advances in individualized healthcare. In this article, we outline several of emerging clinical bioinformatics-based strategies as they apply specifically to lung cancer.

Mapping immune cell infiltration using restricted diffusion MRI

PURPOSE

Diffusion MRI provides a noninvasive way to assess tissue microstructure. Based on diffusion MRI, we propose a model-free method called restricted diffusion imaging (RDI) to quantify restricted diffusion and correlate it with cellularity.

THEORY AND METHODS

An analytical relation between q-space signals and the density of restricted spins was derived to quantify restricted diffusion. A phantom study was conducted to investigate the performance of RDI, and RDI was applied to an animal study to assess immune cell infiltration in myocardial tissues with ischemia-reperfusion injury.

RESULTS

Our phantom study showed a correlation coefficient of 0.998 between cell density and the restricted diffusion quantified by RDI. The animal study also showed that the high-value regions in RDI matched well with the macrophage infiltration areas in the H&E stained slides. In comparison with diffusion tensor imaging (DTI), RDI exhibited its outperformance to detect macrophage infiltration and delineate inflammatory myocardium.

CONCLUSION

RDI can be used to reveal cell density and detect immune cell infiltration. RDI exhibits better specificity than the diffusivity measurement derived from DTI. Magn Reson Med 77:603-612, 2017. © 2016 International Society for Magnetic Resonance in Medicine.

Automated grading of renal cell carcinoma using whole slide imaging

INTRODUCTION

Recent technology developments have demonstrated the benefit of using whole slide imaging (WSI) in computer-aided diagnosis. In this paper, we explore the feasibility of using automatic WSI analysis to assist grading of clear cell renal cell carcinoma (RCC), which is a manual task traditionally performed by pathologists.

MATERIALS AND METHODS

Automatic WSI analysis was applied to 39 hematoxylin and eosin-stained digitized slides of clear cell RCC with varying grades. Kernel regression was used to estimate the spatial distribution of nuclear size across the entire slides. The analysis results were correlated with Fuhrman nuclear grades determined by pathologists.

RESULTS

The spatial distribution of nuclear size provided a panoramic view of the tissue sections. The distribution images facilitated locating regions of interest, such as high-grade regions and areas with necrosis. The statistical analysis showed that the maximum nuclear size was significantly different (P < 0.001) between low-grade (Grades I and II) and high-grade tumors (Grades III and IV). The receiver operating characteristics analysis showed that the maximum nuclear size distinguished high-grade and low-grade tumors with a false positive rate of 0.2 and a true positive rate of 1.0. The area under the curve is 0.97.

CONCLUSION

The automatic WSI analysis allows pathologists to see the spatial distribution of nuclei size inside the tumors. The maximum nuclear size can also be used to differentiate low-grade and high-grade clear cell RCC with good sensitivity and specificity. These data suggest that automatic WSI analysis may facilitate pathologic grading of renal tumors and reduce variability encountered with manual grading.