1
|
Shen A, Wang F, Paul S, Bhuvanapalli D, Alayof J, Farris AB, Teodoro G, Brat DJ, Kong J. An integrative web-based software tool for multi-dimensional pathology whole-slide image analytics. Phys Med Biol 2022; 67:10.1088/1361-6560/ac8fde. [PMID: 36067783 PMCID: PMC10039615 DOI: 10.1088/1361-6560/ac8fde] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Accepted: 09/06/2022] [Indexed: 11/12/2022]
Abstract
Objective.In the era of precision medicine, human tumor atlas-oriented studies have been significantly facilitated by high-resolution, multi-modal tissue based microscopic pathology image analytics. To better support such tissue-based investigations, we have developed Digital Pathology Laboratory (DPLab), a publicly available web-based platform, to assist biomedical research groups, non-technical end users, and clinicians for pathology whole-slide image visualization, annotation, analysis, and sharing via web browsers.Approach.A major advancement of this work is the easy-to-follow methods to reconstruct three-dimension (3D) tissue image volumes by registering two-dimension (2D) whole-slide pathology images of serial tissue sections stained by hematoxylin and eosin (H&E), and immunohistochemistry (IHC). The integration of these serial slides stained by different methods provides cellular phenotype and pathophysiologic states in the context of a 3D tissue micro-environment. DPLab is hosted on a publicly accessible server and connected to a backend computational cluster for intensive image analysis computations, with results visualized, downloaded, and shared via a web interface.Main results.Equipped with an analysis toolbox of numerous image processing algorithms, DPLab supports continued integration of community-contributed algorithms and presents an effective solution to improve the accessibility and dissemination of image analysis algorithms by research communities.Significance.DPLab represents the first step in making next generation tissue investigation tools widely available to the research community, enabling and facilitating discovery of clinically relevant disease mechanisms in a digital 3D tissue space.
Collapse
Affiliation(s)
- Alice Shen
- School of Medicine, University of California at San Diego, San Diego, CA USA
| | - Fusheng Wang
- Department of Computer Science, Stony Brook University, Stony Brook, NY USA
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY USA
| | - Saptarshi Paul
- Department of Computer Science, Georgia State University, Atlanta, GA USA
| | - Divya Bhuvanapalli
- Department of Computer Science, Georgia State University, Atlanta, GA USA
| | | | - Alton B. Farris
- Department of Pathology and Laboratory Medicine, Emory University, Atlanta, GA USA
| | - George Teodoro
- Department of Computer Science in University of Brasilia, Brasília, DF Brazil
| | - Daniel J. Brat
- Department of Pathology, Northwestern University, Chicago, IL USA
| | - Jun Kong
- Department of Computer Science, Georgia State University, Atlanta, GA USA
- Department of Mathematics and Statistics, Georgia State University, Atlanta, GA USA
- Winship Cancer Institute, Emory University, Atlanta, GA USA
| |
Collapse
|
2
|
Barsoum I, Tawedrous E, Faragalla H, Yousef GM. Histo-genomics: digital pathology at the forefront of precision medicine. ACTA ACUST UNITED AC 2020; 6:203-212. [PMID: 30827078 DOI: 10.1515/dx-2018-0064] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Accepted: 09/28/2018] [Indexed: 12/26/2022]
Abstract
The toughest challenge OMICs face is that they provide extremely high molecular resolution but poor spatial information. Understanding the cellular/histological context of the overwhelming genetic data is critical for a full understanding of the clinical behavior of a malignant tumor. Digital pathology can add an extra layer of information to help visualize in a spatial and microenvironmental context the molecular information of cancer. Thus, histo-genomics provide a unique chance for data integration. In the era of a precision medicine, a four-dimensional (4D) (temporal/spatial) analysis of cancer aided by digital pathology can be a critical step to understand the evolution/progression of different cancers and consequently tailor individual treatment plans. For instance, the integration of molecular biomarkers expression into a three-dimensional (3D) image of a digitally scanned tumor can offer a better understanding of its subtype, behavior, host immune response and prognosis. Using advanced digital image analysis, a larger spectrum of parameters can be analyzed as potential predictors of clinical behavior. Correlation between morphological features and host immune response can be also performed with therapeutic implications. Radio-histomics, or the interface of radiological images and histology is another emerging exciting field which encompasses the integration of radiological imaging with digital pathological images, genomics, and clinical data to portray a more holistic approach to understating and treating disease. These advances in digital slide scanning are not without technical challenges, which will be addressed carefully in this review with quick peek at its future.
Collapse
Affiliation(s)
- Ivraym Barsoum
- Department of Pathology and Molecular Medicine, Faculty of Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Eriny Tawedrous
- Department of Laboratory Medicine, and the Keenan Research Centre for Biomedical Science at the Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Canada
| | - Hala Faragalla
- Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Canada
| | - George M Yousef
- Department of Laboratory Medicine, and the Keenan Research Centre for Biomedical Science at the Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, Canada.,Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Canada.,Department of Pediatric Laboratory Medicine, The Hospital for Sick Children, 555 University Avenue, Toronto, ON M5G 1X8, Canada
| |
Collapse
|
3
|
Vo H, Kong J, Teng D, Liang Y, Aji A, Teodoro G, Wang F. MaReIA: A Cloud MapReduce Based High Performance Whole Slide Image Analysis Framework. DISTRIBUTED AND PARALLEL DATABASES 2019; 37:251-272. [PMID: 31217669 PMCID: PMC6583906 DOI: 10.1007/s10619-018-7237-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Recent advancements in systematic analysis of high resolution whole slide images have increase efficiency of diagnosis, prognosis and prediction of cancer and important diseases. Due to the enormous sizes and dimensions of whole slide images, the analysis requires extensive computing resources which are not commonly available. Images have to be tiled for processing due to computer memory limitations, which lead to inaccurate results due to the ignorance of boundary crossing objects. Thus, we propose a generic and highly scalable cloud-based image analysis framework for whole slide images. The framework enables parallelized integration of image analysis steps, such as segmentation and aggregation of micro-structures in a single pipeline, and generation of final objects manageable by databases. The core concept relies on the abstraction of objects in whole slide images as different classes of spatial geometries, which in turn can be handled as text based records in MapReduce. The framework applies an overlapping partitioning scheme on images, and provides parallelization of tiling and image segmentation based on MapReduce architecture. It further provides robust object normalization, graceful handling of boundary objects with an efficient spatial indexing based matching method to generate accurate results. Our experiments on Amazon EMR show that MaReIA is highly scalable, generic and extremely cost effective by benchmark tests.
Collapse
Affiliation(s)
- Hoang Vo
- Department of Computer Science, Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY
| | - Jun Kong
- Department of Biomedical Informatics, Emory University, Atlanta, GA
| | - Dejun Teng
- Department of Computer Science and Engineering, Ohio State University, Columbus, OH
| | - Yanhui Liang
- Department of Computer Science, Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY
| | | | - George Teodoro
- Department of Computer Science, University of Brasília, Brasília, DF, Brazil
| | - Fusheng Wang
- Department of Computer Science, Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY
| |
Collapse
|
4
|
Saco A, Diaz A, Hernandez M, Martinez D, Montironi C, Castillo P, Rakislova N, Del Pino M, Martinez A, Ordi J. Validation of whole-slide imaging in the primary diagnosis of liver biopsies in a University Hospital. Dig Liver Dis 2017; 49:1240-1246. [PMID: 28780052 DOI: 10.1016/j.dld.2017.07.002] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/30/2017] [Revised: 06/11/2017] [Accepted: 07/11/2017] [Indexed: 12/11/2022]
Abstract
BACKGROUND Experience in the use of whole slide imaging (WSI) for primary diagnosis is limited and there are no comprehensive reports evaluating this technology in liver biopsy specimens. AIMS To determine the accuracy of interpretation of WSI compared with conventional light microscopy (CLM) in the diagnosis of needle liver biopsies. METHODS Two experienced liver pathologists blindly analyzed 176 consecutive biopsies from the Pathology Department at the Hospital Clinic of Barcelona. One of the observers performed the initial evaluation with CLM, and the second evaluation with WSI, whereas the second observer performed the first evaluation with WSI and the second with CLM. All slides were digitized in a Ventana iScan HT at 400× and evaluated with the Virtuoso viewer (Roche diagnostics). We used kappa statistics (κ) for two observations. RESULTS Intra-observer agreement between WSI and CLM evaluations was almost perfect (96.6%, κ=0.9; 95% confidence interval [95% CI]: 0.9-1 for observer 1, and 90.3%, κ=0.9; 95%CI: 0.8-0.9 for observer 2). Both native and transplantation biopsies showed an almost perfect concordance in the diagnosis. CONCLUSION Diagnosis of needle liver biopsy specimens using WSI is accurate. This technology can reliably be introduced in routine diagnosis.
Collapse
Affiliation(s)
- Adela Saco
- Department of Pathology, Hospital Clínic, Barcelona, Spain
| | - Alba Diaz
- Department of Pathology, Hospital Clínic, Barcelona, Spain
| | | | | | | | - Paola Castillo
- Department of Pathology, Hospital Clínic, Barcelona, Spain; ISGlobal, Barcelona Ctr. Int. Health Res. (CRESIB), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
| | | | - Marta Del Pino
- ISGlobal, Barcelona Ctr. Int. Health Res. (CRESIB), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain; Institute of Gynecology, Obstetrics and Neonatology, Hospital Clínic - Institut d́Investigacions Biomèdiques August Pi I Sunyer (IDIBAPS), Faculty of Medicine, University of Barcelona, Spain
| | - Antonio Martinez
- Department of Pathology, Hospital Clínic, Barcelona, Spain; ISGlobal, Barcelona Ctr. Int. Health Res. (CRESIB), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain
| | - Jaume Ordi
- Department of Pathology, Hospital Clínic, Barcelona, Spain; ISGlobal, Barcelona Ctr. Int. Health Res. (CRESIB), Hospital Clínic - Universitat de Barcelona, Barcelona, Spain; University of Barcelona, School of Medicine, Barcelona, Spain.
| |
Collapse
|
5
|
Wang Y, Chen S, Ni Y, Magee D, Pu Y, Zhou Q, Wang Z, Zhang L, Huang X, Hu Q. Three-dimensional reconstruction with serial whole-mount sections of oral tongue squamous cell carcinoma: A preliminary study. J Oral Pathol Med 2017; 47:53-59. [PMID: 28960470 DOI: 10.1111/jop.12644] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/24/2017] [Indexed: 12/14/2022]
Abstract
OBJECTIVES Margin status and invasion pattern are prognostic factors for oral tongue squamous cell carcinoma (OTSCC). Current methods to identify these factors are limited to 2D observation; it is necessary to explore 3D reconstruction with whole-mount sample to improve the accuracy of analysis. This study aimed to study the tissue preparation, section generation, and 3D reconstruction with whole-mount OTSCC specimen. STUDY DESIGN Two OTSCC samples were retrieved from Nanjing Stomatological Hospital, Medical School of Nanjing University. One sample was sliced into 3 equal-sized pieces and subjected to different processing schedules to determine the best method. The second sample was processed accordingly. Serial whole-mount sections of the second sample were generated, stained with HE/anticytokine antibody in intersection manner, and scanned into digital images. Digital images were aligned and reconstructed into 3D images with Hetero Genius Medical Image Manager 3D Pathology Add-On [HGMIM3D]. RESULTS Successful serial whole-mount sections of comparable quality to traditional sections were generated. Three-dimensional images with serial whole-mount sections were successfully generated. CONCLUSIONS Whole-mount histopathological 3D reconstruction of OTSCC was successfully generated, providing a solid foundation for comprehensive margin and invasion analysis. Although future study and improvement were needed, whole-mount histopathological 3D reconstruction proved to be a promising method in OTSCC study.
Collapse
Affiliation(s)
- Yujia Wang
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Sheng Chen
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Yanhong Ni
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Derek Magee
- The School of Computing, University of Leeds, Leeds, UK
| | - Yumei Pu
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Qian Zhou
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Zhiyong Wang
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Lei Zhang
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Xiaofeng Huang
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| | - Qingang Hu
- Nangjing Stomatological Hospital, Medical School of Nanjing University, Nanjing, China
| |
Collapse
|
6
|
Liang Y, Wang F, Zhang P, Saltz JH, Brat DJ, Kong J. Development of a Framework for Large Scale Three-Dimensional Pathology and Biomarker Imaging and Spatial Analytics. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE PROCEEDINGS. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE 2017; 2017:75-84. [PMID: 28815110 PMCID: PMC5543358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
With the rapid advancement in large-throughput scanning technologies, digital pathology has emerged as platform with promise for diagnostic approaches, but also for high-throughput quantitative data extraction and analysis for translational research. Digital pathology and biomarker images are rich sources of information on tissue architecture, cell diversity and morphology, and molecular pathway activation. However, the understanding of disease in three-dimension (3D) has been hampered by their traditional two-dimension (2D) representations on histologic slides. In this paper, we propose a scalable image processing framework to quantitatively investigate 3D phenotypic and cell-specific molecular features from digital pathology and biomarker images in information- lossless 3D tissue space. We also develop a generalized 3D spatial data management framework with multi-level parallelism and provide a sustainable infrastructure for rapid spatial queries through scalable and efficient spatial data processing. The developed framework can facilitate biomedical research by efficiently processing large-scale, 3D pathology and in-situ biomarker imaging data.
Collapse
Affiliation(s)
- Yanhui Liang
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY
| | - Fusheng Wang
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY;,Department of Computer Science, Stony Brook University, Stony Brook, NY
| | - Pengyue Zhang
- Department of Computer Science, Stony Brook University, Stony Brook, NY
| | - Joel H. Saltz
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, NY
| | - Daniel J. Brat
- Department of Biomedical Informatics, Emory University, Atlanta, GA
| | - Jun Kong
- Department of Biomedical Informatics, Emory University, Atlanta, GA
| |
Collapse
|
7
|
Abstract
The development of whole-slide imaging has paved the way for digitizing of glass slides that are the basis for surgical pathology. This transformative technology has changed the landscape in research applications and education but despite its tremendous potential, its adoption for clinical use has been slow. We review the various niche applications that initiated awareness of this technology, provide examples of clinical use cases, and discuss the requirements and challenges for full adoption in clinical diagnosis. The opportunities for applications of image analysis tools in a workflow will be changed by integration of whole-slide imaging into routine diagnosis.
Collapse
|
8
|
Cheng CL, Tan PH. Digital pathology in the diagnostic setting: beyond technology into best practice and service management. J Clin Pathol 2017; 70:454-457. [PMID: 28062660 DOI: 10.1136/jclinpath-2016-204272] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2016] [Accepted: 12/10/2016] [Indexed: 11/04/2022]
Abstract
Digital pathology (DP) and whole-slide imaging (WSI) technology have matured substantially over the last few years and there is growing evidence from validation studies that WSI is comparable to glass slides for histopathology diagnosis, although with some limitations, which can be appropriately minimised. Whether the controlled environment of validation studies translates to the same level of robustness when WSI is used in the actual diagnostic setting depends on the technical quality of WSI acquisition and on factors that influence the pre-image acquisition variables including the quality of glass slide inputs, and postimage acquisition variables such as access and use of WSI. The concept of 'DP service management' is introduced to fulfil the holistic needs of a laboratory intending to use the DP solution incorporating WSI for diagnostic purposes. The DP service management team should be an integral part of the diagnostic laboratory as it plays a central role undertaking responsibility to address an extensive range of issues from technical and training to governance and accreditation, hence ensuring a viable and sustainable diagnostic DP integration and usage. The pathologist as a specialist in the field and key decision maker of histopathology diagnoses has the duty and responsibility to acquaint and familiarise with DP and WSI when using the technology, especially on their indications and limitations, so as to take full advantage of these tools to enhance diagnostic quality.
Collapse
Affiliation(s)
- Chee Leong Cheng
- Division of Pathology, Department of Anatomical Pathology, Singapore General Hospital, Singapore, Republic of Singapore
| | - Puay Hoon Tan
- Division of Pathology, Singapore General Hospital, Singapore, Republic of Singapore
| |
Collapse
|
9
|
Jiang M, Zhang S, Huang J, Yang L, Metaxas DN. Scalable histopathological image analysis via supervised hashing with multiple features. Med Image Anal 2016; 34:3-12. [PMID: 27521299 DOI: 10.1016/j.media.2016.07.011] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2016] [Revised: 04/08/2016] [Accepted: 07/28/2016] [Indexed: 11/18/2022]
Abstract
Histopathology is crucial to diagnosis of cancer, yet its interpretation is tedious and challenging. To facilitate this procedure, content-based image retrieval methods have been developed as case-based reasoning tools. Especially, with the rapid growth of digital histopathology, hashing-based retrieval approaches are gaining popularity due to their exceptional efficiency and scalability. Nevertheless, few hashing-based histopathological image analysis methods perform feature fusion, despite the fact that it is a common practice to improve image retrieval performance. In response, we exploit joint kernel-based supervised hashing (JKSH) to integrate complementary features in a hashing framework. Specifically, hashing functions are designed based on linearly combined kernel functions associated with individual features. Supervised information is incorporated to bridge the semantic gap between low-level features and high-level diagnosis. An alternating optimization method is utilized to learn the kernel combination and hashing functions. The obtained hashing functions compress multiple high-dimensional features into tens of binary bits, enabling fast retrieval from a large database. Our approach is extensively validated on 3121 breast-tissue histopathological images by distinguishing between actionable and benign cases. It achieves 88.1% retrieval precision and 91.3% classification accuracy within 16.5 ms query time, comparing favorably with traditional methods.
Collapse
Affiliation(s)
- Menglin Jiang
- Department of Computer Science, Rutgers University, Piscataway, NJ 08854, USA
| | - Shaoting Zhang
- Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC 28223, USA.
| | - Junzhou Huang
- Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, TX 76019, USA
| | - Lin Yang
- Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Dimitris N Metaxas
- Department of Computer Science, Rutgers University, Piscataway, NJ 08854, USA
| |
Collapse
|