1
|
Tajbakhsh K, Stanowska O, Neels A, Perren A, Zboray R. 3D Virtual Histopathology by Phase-Contrast X-Ray Micro-CT for Follicular Thyroid Neoplasms. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2670-2678. [PMID: 38437150 DOI: 10.1109/tmi.2024.3372602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
Histological analysis is the core of follicular thyroid carcinoma (FTC) classification. The histopathological criteria of capsular and vascular invasion define malignancy and aggressiveness of FTC. Analysis of multiple sections is cumbersome and as only a minute tissue fraction is analyzed during histopathology, under-sampling remains a problem. Application of an efficient tool for complete tissue imaging in 3D would speed-up diagnosis and increase accuracy. We show that X-ray propagation-based imaging (XPBI) of paraffin-embedded tissue blocks is a valuable complementary method for follicular thyroid carcinoma diagnosis and assessment. It enables a fast, non-destructive and accurate 3D virtual histology of the FTC resection specimen. We demonstrate that XPBI virtual slices can reliably evaluate capsular invasions. Then we discuss the accessible morphological information from XPBI and their significance for vascular invasion diagnosis. We show 3D morphological information that allow to discern vascular invasions. The results are validated by comparing XPBI images with clinically accepted histology slides revised by and under supervision of two experienced endocrine pathologists.
Collapse
|
2
|
Dizbay Sak S, Sevim S, Buyuksungur A, Kayı Cangır A, Orhan K. The Value of Micro-CT in the Diagnosis of Lung Carcinoma: A Radio-Histopathological Perspective. Diagnostics (Basel) 2023; 13:3262. [PMID: 37892083 PMCID: PMC10606474 DOI: 10.3390/diagnostics13203262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 10/12/2023] [Accepted: 10/17/2023] [Indexed: 10/29/2023] Open
Abstract
Micro-computed tomography (micro-CT) is a relatively new imaging modality and the three-dimensional (3D) images obtained via micro-CT allow researchers to collect both quantitative and qualitative information on various types of samples. Micro-CT could potentially be used to examine human diseases and several studies have been published on this topic in the last decade. In this study, the potential uses of micro-CT in understanding and evaluating lung carcinoma and the relevant studies conducted on lung and other tumors are summarized. Currently, the resolution of benchtop laboratory micro-CT units has not reached the levels that can be obtained with light microscopy, and it is not possible to detect the histopathological features (e.g., tumor type, adenocarcinoma pattern, spread through air spaces) required for lung cancer management. However, its ability to provide 3D images in any plane of section, without disturbing the integrity of the specimen, suggests that it can be used as an auxiliary technique, especially in surgical margin examination, the evaluation of tumor invasion in the entire specimen, and calculation of primary and metastatic tumor volume. Along with future developments in micro-CT technology, it can be expected that the image resolution will gradually improve, the examination time will decrease, and the relevant software will be more user friendly. As a result of these developments, micro-CT may enter pathology laboratories as an auxiliary method in the pathological evaluation of lung tumors. However, the safety, performance, and cost effectiveness of micro-CT in the areas of possible clinical application should be investigated. If micro-CT passes all these tests, it may lead to the convergence of radiology and pathology applications performed independently in separate units today, and the birth of a new type of diagnostician who has equal knowledge of the histological and radiological features of tumors.
Collapse
Affiliation(s)
- Serpil Dizbay Sak
- Department of Pathology, Faculty of Medicine, Ankara University, Ankara 06230, Turkey
| | - Selim Sevim
- Department of Pathology, Faculty of Medicine, Ankara University, Ankara 06230, Turkey
| | - Arda Buyuksungur
- Department of Basic Medical Sciences, Faculty of Dentistry, Ankara University, Ankara 06560, Turkey
| | - Ayten Kayı Cangır
- Department of Thoracic Surgery Ankara, Faculty of Medicine, Ankara University, Ankara 06230, Turkey
| | - Kaan Orhan
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara 06560, Turkey
| |
Collapse
|
3
|
Al-Thelaya K, Gilal NU, Alzubaidi M, Majeed F, Agus M, Schneider J, Househ M. Applications of discriminative and deep learning feature extraction methods for whole slide image analysis: A survey. J Pathol Inform 2023; 14:100335. [PMID: 37928897 PMCID: PMC10622844 DOI: 10.1016/j.jpi.2023.100335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/17/2023] [Accepted: 07/19/2023] [Indexed: 11/07/2023] Open
Abstract
Digital pathology technologies, including whole slide imaging (WSI), have significantly improved modern clinical practices by facilitating storing, viewing, processing, and sharing digital scans of tissue glass slides. Researchers have proposed various artificial intelligence (AI) solutions for digital pathology applications, such as automated image analysis, to extract diagnostic information from WSI for improving pathology productivity, accuracy, and reproducibility. Feature extraction methods play a crucial role in transforming raw image data into meaningful representations for analysis, facilitating the characterization of tissue structures, cellular properties, and pathological patterns. These features have diverse applications in several digital pathology applications, such as cancer prognosis and diagnosis. Deep learning-based feature extraction methods have emerged as a promising approach to accurately represent WSI contents and have demonstrated superior performance in histology-related tasks. In this survey, we provide a comprehensive overview of feature extraction methods, including both manual and deep learning-based techniques, for the analysis of WSIs. We review relevant literature, analyze the discriminative and geometric features of WSIs (i.e., features suited to support the diagnostic process and extracted by "engineered" methods as opposed to AI), and explore predictive modeling techniques using AI and deep learning. This survey examines the advances, challenges, and opportunities in this rapidly evolving field, emphasizing the potential for accurate diagnosis, prognosis, and decision-making in digital pathology.
Collapse
Affiliation(s)
- Khaled Al-Thelaya
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Nauman Ullah Gilal
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mahmood Alzubaidi
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Fahad Majeed
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Marco Agus
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Jens Schneider
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mowafa Househ
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
4
|
Groeneboom NE, Yates SC, Puchades MA, Bjaalie JG. Nutil: A Pre- and Post-processing Toolbox for Histological Rodent Brain Section Images. Front Neuroinform 2020; 14:37. [PMID: 32973479 PMCID: PMC7472695 DOI: 10.3389/fninf.2020.00037] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2019] [Accepted: 07/17/2020] [Indexed: 02/01/2023] Open
Abstract
With recent technological advances in microscopy and image acquisition of tissue sections, further developments of tools are required for viewing, transforming, and analyzing the ever-increasing amounts of high-resolution data produced. In the field of neuroscience, histological images of whole rodent brain sections are commonly used for investigating brain connections as well as cellular and molecular organization in the normal and diseased brain, but present a problem for the typical neuroscientist with no or limited programming experience in terms of the pre- and post-processing steps needed for analysis. To meet this need we have designed Nutil, an open access and stand-alone executable software that enables automated transformations, post-processing, and analyses of 2D section images using multi-core processing (OpenMP). The software is written in C++ for efficiency, and provides the user with a clean and easy graphical user interface for specifying the input and output parameters. Nutil currently contains four separate tools: (1) A transformation toolchain named “Transform” that allows for rotation, mirroring and scaling, resizing, and renaming of very large tiled tiff images. (2) “TiffCreator” enables the generation of tiled TIFF images from other image formats such as PNG and JPEG. (3) A “Resize” tool completes the preprocessing toolset and allows downscaling of PNG and JPEG images with output in PNG format. (4) The fourth tool is a post-processing method called “Quantifier” that enables the quantification of segmented objects in the context of regions defined by brain atlas maps generated with the QuickNII software based on a 3D reference atlas (mouse or rat). The output consists of a set of report files, point cloud coordinate files for visualization in reference atlas space, and reference atlas images superimposed with color-coded objects. The Nutil software is made available by the Human Brain Project (https://www.humanbrainproject.eu) at https://www.nitrc.org/projects/nutil/.
Collapse
Affiliation(s)
- Nicolaas E Groeneboom
- Neural Systems Laboratory, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway
| | - Sharon C Yates
- Neural Systems Laboratory, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway
| | - Maja A Puchades
- Neural Systems Laboratory, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway
| | - Jan G Bjaalie
- Neural Systems Laboratory, Institute of Basic Medical Sciences, University of Oslo, Oslo, Norway
| |
Collapse
|
5
|
Yagi Y, Aly RG, Tabata K, Barlas A, Rekhtman N, Eguchi T, Montecalvo J, Hameed M, Manova-Todorova K, Adusumilli PS, Travis WD. Three-Dimensional Histologic, Immunohistochemical, and Multiplex Immunofluorescence Analyses of Dynamic Vessel Co-Option of Spread Through Air Spaces in Lung Adenocarcinoma. J Thorac Oncol 2020; 15:589-600. [PMID: 31887430 PMCID: PMC7288352 DOI: 10.1016/j.jtho.2019.12.112] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 12/09/2019] [Accepted: 12/13/2019] [Indexed: 01/15/2023]
Abstract
INTRODUCTION Spread through air spaces (STAS) is a method of invasion in lung adenocarcinoma and is associated with tumor recurrence and poor survival. The spatial orientation of STAS cells in the lung alveolar parenchyma is not known. The aim of this study was to use high-resolution and high-quality three-dimensional (3D) reconstruction of images from immunohistochemical (IHC) and multiplex immunofluorescence (IF) experiments to understand the spatial architecture of tumor cell clusters by STAS in the lung parenchyma. METHODS Four lung adenocarcinomas, three micropapillary-predominant and one solid predominant adenocarcinoma subtypes, were investigated. A 3D reconstruction image was created from formalin-fixed, paraffin-embedded blocks. A total of 350 serial sections were obtained and subjected to hematoxylin and eosin (100 slides), IHC (200 slides), and multiplex IF staining (50 slides) with the following antibodies: cluster of differentiation 31, collagen type IV, thyroid transcription factor-1, and E-cadherin. Whole slide images were reconstructed into 3D images for evaluation. RESULTS Serial 3D image analysis by hematoxylin and eosin, IHC, and IF staining revealed that the micropapillary clusters and solid nests of STAS are focally attached to the alveolar walls, away from the main tumor. CONCLUSIONS Our 3D reconstructions found that STAS tumor cells can attach to the alveolar walls rather than appearing free floating, as seen on the two-dimensional sections. This suggests that the tumor cells detach from the main tumor, migrate through air spaces, and reattach to the alveolar walls through vessel co-option, allowing them to survive and grow. This may explain the higher recurrence rate and worse survival of patients with STAS-positive tumors who undergo limited resection than those who undergo lobectomy.
Collapse
Affiliation(s)
- Yukako Yagi
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Rania G Aly
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York; Department of Pathology, Alexandria University, Alexandria, Egypt
| | - Kazuhiro Tabata
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York; Department of Pathology, Nagasaki University Hospital, Nagasaki, Japan
| | - Afsar Barlas
- Molecular Cytology, Core Facility, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Natasha Rekhtman
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Takashi Eguchi
- Thoracic Surgery Service, Memorial Sloan Kettering Cancer Center, New York, New York; Division of Thoracic Surgery, Department of Surgery, Shinshu University, Matsumoto, Japan
| | - Joeseph Montecalvo
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York; Department of Pathology, Henry Ford Hospital System, Detroit, Michigan
| | - Meera Hameed
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Katia Manova-Todorova
- Molecular Cytology, Core Facility, Memorial Sloan Kettering Cancer Center, New York, New York
| | - Prasad S Adusumilli
- Thoracic Surgery Service, Memorial Sloan Kettering Cancer Center, New York, New York; Center for Cell Engineering, Memorial Sloan Kettering Cancer Center, New York, New York
| | - William D Travis
- Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York.
| |
Collapse
|
6
|
Prajapati S, Madrigal E, Friedman MT. Acquisition, Visualization and Potential Applications of 3D Data in Anatomic Pathology. Discoveries (Craiova) 2016; 4:e68. [PMID: 32309587 PMCID: PMC6941555 DOI: 10.15190/d.2016.15] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Although human anatomy and histology are naturally three-dimensional (3D), commonly used diagnostic and educational tools are technologically restricted to providing two-dimensional representations (e.g. gross photography and glass slides). This limitation may be overcome by employing techniques to acquire and display 3D data, which refers to the digital information used to describe a 3D object mathematically. There are several established and experimental strategies to capture macroscopic and microscopic 3D data. In addition, recent hardware and software innovations have propelled the visualization of 3D models, including virtual and augmented reality. Accompanying these advances are novel clinical and non-clinical applications of 3D data in pathology. Medical education and research stand to benefit a great deal from utilizing 3D data as it can change our understanding of complex anatomical and histological structures. Although these technologies are yet to be adopted in routine surgical pathology, forensic pathology has embraced 3D scanning and model reconstruction. In this review, we intend to provide a general overview of the technologies and emerging applications involved with 3D data.
Collapse
Affiliation(s)
- Shyam Prajapati
- Mount Sinai Health System, Department of Diagnostic Pathology and Laboratory Medicine, New York, NY, USA
| | - Emilio Madrigal
- Mount Sinai Health System, Department of Diagnostic Pathology and Laboratory Medicine, New York, NY, USA
| | - Mark T Friedman
- Mount Sinai Health System, Department of Diagnostic Pathology and Laboratory Medicine, New York, NY, USA
| |
Collapse
|
7
|
Ohnishi T, Nakamura Y, Tanaka T, Tanaka T, Hashimoto N, Haneishi H, Batchelor TT, Gerstner ER, Taylor JW, Snuderl M, Yagi Y. Deformable image registration between pathological images and MR image via an optical macro image. Pathol Res Pract 2016; 212:927-936. [PMID: 27613662 PMCID: PMC5097673 DOI: 10.1016/j.prp.2016.07.018] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/31/2015] [Revised: 07/02/2016] [Accepted: 07/31/2016] [Indexed: 02/05/2023]
Abstract
Computed tomography (CT) and magnetic resonance (MR) imaging have been widely used for visualizing the inside of the human body. However, in many cases, pathological diagnosis is conducted through a biopsy or resection of an organ to evaluate the condition of tissues as definitive diagnosis. To provide more advanced information onto CT or MR image, it is necessary to reveal the relationship between tissue information and image signals. We propose a registration scheme for a set of PT images of divided specimens and a 3D-MR image by reference to an optical macro image (OM image) captured by an optical camera. We conducted a fundamental study using a resected human brain after the death of a brain cancer patient. We constructed two kinds of registration processes using the OM image as the base for both registrations to make conversion parameters between the PT and MR images. The aligned PT images had shapes similar to the OM image. On the other hand, the extracted cross-sectional MR image was similar to the OM image. From these resultant conversion parameters, the corresponding region on the PT image could be searched and displayed when an arbitrary pixel on the MR image was selected. The relationship between the PT and MR images of the whole brain can be analyzed using the proposed method. We confirmed that same regions between the PT and MR images could be searched and displayed using resultant information obtained by the proposed method. In terms of the accuracy of proposed method, the TREs were 0.56±0.39mm and 0.87±0.42mm. We can analyze the relationship between tissue information and MR signals using the proposed method.
Collapse
Affiliation(s)
- Takashi Ohnishi
- Center for Frontier Medical Engineering, Chiba University, 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, Japan.
| | - Yuka Nakamura
- Graduate School of Engineering, Chiba University, Japan
| | - Toru Tanaka
- Graduate School of Engineering, Chiba University, Japan
| | - Takuya Tanaka
- Graduate School of Engineering, Chiba University, Japan
| | - Noriaki Hashimoto
- Center for Frontier Medical Engineering, Chiba University, 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, Japan
| | - Hideaki Haneishi
- Center for Frontier Medical Engineering, Chiba University, 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, Japan
| | - Tracy T Batchelor
- Massachusetts General Hospital Cancer Center, Boston, MA 02144, USA; Harvard Medical School, Boston, MA 02215, USA
| | - Elizabeth R Gerstner
- Massachusetts General Hospital Cancer Center, Boston, MA 02144, USA; Harvard Medical School, Boston, MA 02215, USA
| | - Jennie W Taylor
- Massachusetts General Hospital Cancer Center, Boston, MA 02144, USA; Harvard Medical School, Boston, MA 02215, USA
| | - Matija Snuderl
- New York University Langone Medical Center, New York, NY 10016, USA
| | - Yukako Yagi
- Harvard Medical School, Boston, MA 02215, USA; Massachusetts General Hospital Pathology Imaging and Communication Technology (PICT) Center, Boston, MA 02214, USA
| |
Collapse
|
8
|
García-Rojo M, Ordi J. Trying to Understand Digital Pathology before We Move to Computational Pathology. Pathobiology 2016; 83:57-60. [PMID: 27100520 DOI: 10.1159/000443904] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
|