1
|
Patkar S, Harmon S, Sesterhenn I, Lis R, Merino M, Young D, Brown GT, Greenfield KM, McGeeney JD, Elsamanoudi S, Tan SH, Schafer C, Jiang J, Petrovics G, Dobi A, Rentas FJ, Pinto PA, Chesnut GT, Choyke P, Turkbey B, Moncur JT. A selective CutMix approach improves generalizability of deep learning-based grading and risk assessment of prostate cancer. J Pathol Inform 2024; 15:100381. [PMID: 38953042 PMCID: PMC11215954 DOI: 10.1016/j.jpi.2024.100381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 03/27/2024] [Accepted: 04/29/2024] [Indexed: 07/03/2024] Open
Abstract
The Gleason score is an important predictor of prognosis in prostate cancer. However, its subjective nature can result in over- or under-grading. Our objective was to train an artificial intelligence (AI)-based algorithm to grade prostate cancer in specimens from patients who underwent radical prostatectomy (RP) and to assess the correlation of AI-estimated proportions of different Gleason patterns with biochemical recurrence-free survival (RFS), metastasis-free survival (MFS), and overall survival (OS). Training and validation of algorithms for cancer detection and grading were completed with three large datasets containing a total of 580 whole-mount prostate slides from 191 RP patients at two centers and 6218 annotated needle biopsy slides from the publicly available Prostate Cancer Grading Assessment dataset. A cancer detection model was trained using MobileNetV3 on 0.5 mm × 0.5 mm cancer areas (tiles) captured at 10× magnification. For cancer grading, a Gleason pattern detector was trained on tiles using a ResNet50 convolutional neural network and a selective CutMix training strategy involving a mixture of real and artificial examples. This strategy resulted in improved model generalizability in the test set compared with three different control experiments when evaluated on both needle biopsy slides and whole-mount prostate slides from different centers. In an additional test cohort of RP patients who were clinically followed over 30 years, quantitative Gleason pattern AI estimates achieved concordance indexes of 0.69, 0.72, and 0.64 for predicting RFS, MFS, and OS times, outperforming the control experiments and International Society of Urological Pathology system (ISUP) grading by pathologists. Finally, unsupervised clustering of test RP patient specimens into low-, medium-, and high-risk groups based on AI-estimated proportions of each Gleason pattern resulted in significantly improved RFS and MFS stratification compared with ISUP grading. In summary, deep learning-based quantitative Gleason scoring using a selective CutMix training strategy may improve prognostication after prostate cancer surgery.
Collapse
Affiliation(s)
- Sushant Patkar
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | - Stephanie Harmon
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | | | - Rosina Lis
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | - Maria Merino
- Laboratory of Pathology, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Denise Young
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - G. Thomas Brown
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | | | | | - Sally Elsamanoudi
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - Shyh-Han Tan
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - Cara Schafer
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - Jiji Jiang
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - Gyorgy Petrovics
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | - Albert Dobi
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc., Bethesda, MD 20817, USA
| | | | - Peter A. Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | - Gregory T. Chesnut
- Center for Prostate Disease Research, Murtha Cancer Center Research Program, Department of Surgery, Uniformed Services University of the Health Sciences, Bethesda, MD 20817, USA
- F. Edward Hebert School of Medicine, Uniformed Services University of the Health Sciences, Bethesda, MD 20814, USA
- Urology Service, Walter Reed National Military Medical Center, Bethesda, MD 20814, USA
| | - Peter Choyke
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | - Baris Turkbey
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA
| | - Joel T. Moncur
- The Joint Pathology Center, Silver Spring, MD 20910, USA
| |
Collapse
|
2
|
Song AH, Williams M, Williamson DFK, Chow SSL, Jaume G, Gao G, Zhang A, Chen B, Baras AS, Serafin R, Colling R, Downes MR, Farré X, Humphrey P, Verrill C, True LD, Parwani AV, Liu JTC, Mahmood F. Analysis of 3D pathology samples using weakly supervised AI. Cell 2024; 187:2502-2520.e17. [PMID: 38729110 PMCID: PMC11168832 DOI: 10.1016/j.cell.2024.03.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 01/15/2024] [Accepted: 03/25/2024] [Indexed: 05/12/2024]
Abstract
Human tissue, which is inherently three-dimensional (3D), is traditionally examined through standard-of-care histopathology as limited two-dimensional (2D) cross-sections that can insufficiently represent the tissue due to sampling bias. To holistically characterize histomorphology, 3D imaging modalities have been developed, but clinical translation is hampered by complex manual evaluation and lack of computational platforms to distill clinical insights from large, high-resolution datasets. We present TriPath, a deep-learning platform for processing tissue volumes and efficiently predicting clinical outcomes based on 3D morphological features. Recurrence risk-stratification models were trained on prostate cancer specimens imaged with open-top light-sheet microscopy or microcomputed tomography. By comprehensively capturing 3D morphologies, 3D volume-based prognostication achieves superior performance to traditional 2D slice-based approaches, including clinical/histopathological baselines from six certified genitourinary pathologists. Incorporating greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, further emphasizing the value of capturing larger extents of heterogeneous morphology.
Collapse
Affiliation(s)
- Andrew H Song
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Mane Williams
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA; Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Drew F K Williamson
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Sarah S L Chow
- Department of Mechanical Engineering, Bioengineering, and Laboratory Medicine & Pathology, University of Washington, Seattle, WA, USA
| | - Guillaume Jaume
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Gan Gao
- Department of Mechanical Engineering, Bioengineering, and Laboratory Medicine & Pathology, University of Washington, Seattle, WA, USA
| | - Andrew Zhang
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Bowen Chen
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Alexander S Baras
- Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, USA; Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Robert Serafin
- Department of Mechanical Engineering, Bioengineering, and Laboratory Medicine & Pathology, University of Washington, Seattle, WA, USA
| | - Richard Colling
- Nuffield Department of Surgical Sciences, University of Oxford, UK; Department of Cellular Pathology, Oxford University Hospitals NHS Foundations Trust, John Radcliffe Hospital, Oxford, UK
| | - Michelle R Downes
- Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | - Xavier Farré
- Public Health Agency of Catalonia, Lleida, Spain
| | - Peter Humphrey
- Department of Pathology, Yale School of Medicine, New Haven, CT, USA
| | - Clare Verrill
- Nuffield Department of Surgical Sciences, University of Oxford, UK; Department of Cellular Pathology, Oxford University Hospitals NHS Foundations Trust, John Radcliffe Hospital, Oxford, UK; NIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | - Lawrence D True
- Department of Laboratory Medicine & Pathology, University of Washington School of Medicine, Seattle, WA, USA
| | - Anil V Parwani
- Department of Pathology, The Ohio State University, Columbus, OH, USA
| | - Jonathan T C Liu
- Department of Mechanical Engineering, Bioengineering, and Laboratory Medicine & Pathology, University of Washington, Seattle, WA, USA.
| | - Faisal Mahmood
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA; Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA.
| |
Collapse
|
3
|
Wang L, Li M, Hwang TH. The 3D Revolution in Cancer Discovery. Cancer Discov 2024; 14:625-629. [PMID: 38571426 DOI: 10.1158/2159-8290.cd-23-1499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/05/2024]
Abstract
SUMMARY The transition from 2D to 3D spatial profiling marks a revolutionary era in cancer research, offering unprecedented potential to enhance cancer diagnosis and treatment. This commentary outlines the experimental and computational advancements and challenges in 3D spatial molecular profiling, underscoring the innovation needed in imaging tools, software, artificial intelligence, and machine learning to overcome implementation hurdles and harness the full potential of 3D analysis in the field.
Collapse
Affiliation(s)
- Linghua Wang
- Department of Genomic Medicine, The University of Texas MD Anderson Cancer Center, Houston, Texas
- UTHealth Houston Graduate School of Biomedical Sciences, The University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Mingyao Li
- Statistical Center for Single-Cell and Spatial Genomics, Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Tae Hyun Hwang
- Department of Artificial Intelligence and Informatics, Mayo Clinic, Jacksonville, Florida
| |
Collapse
|
4
|
Bishop KW, Erion Barner LA, Han Q, Baraznenok E, Lan L, Poudel C, Gao G, Serafin RB, Chow SSL, Glaser AK, Janowczyk A, Brenes D, Huang H, Miyasato D, True LD, Kang S, Vaughan JC, Liu JTC. An end-to-end workflow for nondestructive 3D pathology. Nat Protoc 2024; 19:1122-1148. [PMID: 38263522 DOI: 10.1038/s41596-023-00934-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 10/23/2023] [Indexed: 01/25/2024]
Abstract
Recent advances in 3D pathology offer the ability to image orders of magnitude more tissue than conventional pathology methods while also providing a volumetric context that is not achievable with 2D tissue sections, and all without requiring destructive tissue sectioning. Generating high-quality 3D pathology datasets on a consistent basis, however, is not trivial and requires careful attention to a series of details during tissue preparation, imaging and initial data processing, as well as iterative optimization of the entire process. Here, we provide an end-to-end procedure covering all aspects of a 3D pathology workflow (using light-sheet microscopy as an illustrative imaging platform) with sufficient detail to perform well-controlled preclinical and clinical studies. Although 3D pathology is compatible with diverse staining protocols and computationally generated color palettes for visual analysis, this protocol focuses on the use of a fluorescent analog of hematoxylin and eosin, which remains the most common stain used for gold-standard pathological reports. We present our guidelines for a broad range of end users (e.g., biologists, clinical researchers and engineers) in a simple format. The end-to-end workflow requires 3-6 d to complete, bearing in mind that data analysis may take longer.
Collapse
Affiliation(s)
- Kevin W Bishop
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
- Department of Bioengineering, University of Washington, Seattle, WA, USA
| | | | - Qinghua Han
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
- Department of Bioengineering, University of Washington, Seattle, WA, USA
| | - Elena Baraznenok
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
- Department of Bioengineering, University of Washington, Seattle, WA, USA
| | - Lydia Lan
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
- Department of Biology, University of Washington, Seattle, WA, USA
| | - Chetan Poudel
- Department of Chemistry, University of Washington, Seattle, WA, USA
| | - Gan Gao
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Robert B Serafin
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Sarah S L Chow
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Adam K Glaser
- Allen Institute for Neural Dynamics, Seattle, WA, USA
| | - Andrew Janowczyk
- Department of Biomedical Engineering, Emory University, Atlanta, GA, USA
- Department of Oncology, Division of Precision Oncology, University Hospital of Geneva, Geneva, Switzerland
- Department of Diagnostics, Division of Clinical Pathology, University Hospital of Geneva, Geneva, Switzerland
| | - David Brenes
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Hongyi Huang
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Dominie Miyasato
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Lawrence D True
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA, USA
| | - Soyoung Kang
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA
| | - Joshua C Vaughan
- Department of Chemistry, University of Washington, Seattle, WA, USA
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Jonathan T C Liu
- Department of Mechanical Engineering, University of Washington, Seattle, WA, USA.
- Department of Bioengineering, University of Washington, Seattle, WA, USA.
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, WA, USA.
| |
Collapse
|
5
|
Park WY, Yun J, Shin J, Oh BH, Yoon G, Hong SM, Kim KH. Open-top Bessel beam two-photon light sheet microscopy for three-dimensional pathology. eLife 2024; 12:RP92614. [PMID: 38488831 PMCID: PMC10942781 DOI: 10.7554/elife.92614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/17/2024] Open
Abstract
Nondestructive pathology based on three-dimensional (3D) optical microscopy holds promise as a complement to traditional destructive hematoxylin and eosin (H&E) stained slide-based pathology by providing cellular information in high throughput manner. However, conventional techniques provided superficial information only due to shallow imaging depths. Herein, we developed open-top two-photon light sheet microscopy (OT-TP-LSM) for intraoperative 3D pathology. An extended depth of field two-photon excitation light sheet was generated by scanning a nondiffractive Bessel beam, and selective planar imaging was conducted with cameras at 400 frames/s max during the lateral translation of tissue specimens. Intrinsic second harmonic generation was collected for additional extracellular matrix (ECM) visualization. OT-TP-LSM was tested in various human cancer specimens including skin, pancreas, and prostate. High imaging depths were achieved owing to long excitation wavelengths and long wavelength fluorophores. 3D visualization of both cells and ECM enhanced the ability of cancer detection. Furthermore, an unsupervised deep learning network was employed for the style transfer of OT-TP-LSM images to virtual H&E images. The virtual H&E images exhibited comparable histological characteristics to real ones. OT-TP-LSM may have the potential for histopathological examination in surgical and biopsy applications by rapidly providing 3D information.
Collapse
Affiliation(s)
- Won Yeong Park
- Department of Mechanical Engineering, Pohang University of Science and TechnologyPohangRepublic of Korea
| | - Jieun Yun
- Department of Mechanical Engineering, Pohang University of Science and TechnologyPohangRepublic of Korea
| | - Jinho Shin
- Department of Medicine, University of Ulsan College of Medicine, SeoulSeoulRepublic of Korea
| | - Byung Ho Oh
- Department of Dermatology, College of Medicine, Yonsei UniversitySeoulRepublic of Korea
| | - Gilsuk Yoon
- Department of Pathology, School of Medicine, Kyungpook National UniversityDaeguRepublic of Korea
| | - Seung-Mo Hong
- Department of Pathology, Asan Medical Center, University of Ulsan College of MedicineSeoulRepublic of Korea
| | - Ki Hean Kim
- Department of Mechanical Engineering, Pohang University of Science and TechnologyPohangRepublic of Korea
- Medical Science and Engineering Program, School of Convergence Science and Technology, Pohang University of Science and TechnologyPohangRepublic of Korea
- Institute for Convergence Research and Education in Advanced Technology, Yonsei UniversitySeoulRepublic of Korea
| |
Collapse
|
6
|
Wang R, Chow SSL, Serafin RB, Xie W, Han Q, Baraznenok E, Lan L, Bishop KW, Liu JTC. Direct three-dimensional segmentation of prostate glands with nnU-Net. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:036001. [PMID: 38434772 PMCID: PMC10905031 DOI: 10.1117/1.jbo.29.3.036001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 02/06/2024] [Accepted: 02/09/2024] [Indexed: 03/05/2024]
Abstract
Significance In recent years, we and others have developed non-destructive methods to obtain three-dimensional (3D) pathology datasets of clinical biopsies and surgical specimens. For prostate cancer risk stratification (prognostication), standard-of-care Gleason grading is based on examining the morphology of prostate glands in thin 2D sections. This motivates us to perform 3D segmentation of prostate glands in our 3D pathology datasets for the purposes of computational analysis of 3D glandular features that could offer improved prognostic performance. Aim To facilitate prostate cancer risk assessment, we developed a computationally efficient and accurate deep learning model for 3D gland segmentation based on open-top light-sheet microscopy datasets of human prostate biopsies stained with a fluorescent analog of hematoxylin and eosin (H&E). Approach For 3D gland segmentation based on our H&E-analog 3D pathology datasets, we previously developed a hybrid deep learning and computer vision-based pipeline, called image translation-assisted segmentation in 3D (ITAS3D), which required a complex two-stage procedure and tedious manual optimization of parameters. To simplify this procedure, we use the 3D gland-segmentation masks previously generated by ITAS3D as training datasets for a direct end-to-end deep learning-based segmentation model, nnU-Net. The inputs to this model are 3D pathology datasets of prostate biopsies rapidly stained with an inexpensive fluorescent analog of H&E and the outputs are 3D semantic segmentation masks of the gland epithelium, gland lumen, and surrounding stromal compartments within the tissue. Results nnU-Net demonstrates remarkable accuracy in 3D gland segmentations even with limited training data. Moreover, compared with the previous ITAS3D pipeline, nnU-Net operation is simpler and faster, and it can maintain good accuracy even with lower-resolution inputs. Conclusions Our trained DL-based 3D segmentation model will facilitate future studies to demonstrate the value of computational 3D pathology for guiding critical treatment decisions for patients with prostate cancer.
Collapse
Affiliation(s)
- Rui Wang
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
| | - Sarah S. L. Chow
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
| | - Robert B. Serafin
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
| | - Weisi Xie
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
| | - Qinghua Han
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
| | - Elena Baraznenok
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
| | - Lydia Lan
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
- University of Washington, Department of Biology, Seattle, Washington, United States
| | - Kevin W. Bishop
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
| | - Jonathan T. C. Liu
- University of Washington, Department of Mechanical Engineering, Seattle, Washington, United States
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
- University of Washington, Department of Laboratory Medicine and Pathology, Seattle, Washington, United States
| |
Collapse
|
7
|
Liu JTC, Chow SSL, Colling R, Downes MR, Farré X, Humphrey P, Janowczyk A, Mirtti T, Verrill C, Zlobec I, True LD. Engineering the future of 3D pathology. J Pathol Clin Res 2024; 10:e347. [PMID: 37919231 PMCID: PMC10807588 DOI: 10.1002/cjp2.347] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 10/06/2023] [Accepted: 10/15/2023] [Indexed: 11/04/2023]
Abstract
In recent years, technological advances in tissue preparation, high-throughput volumetric microscopy, and computational infrastructure have enabled rapid developments in nondestructive 3D pathology, in which high-resolution histologic datasets are obtained from thick tissue specimens, such as whole biopsies, without the need for physical sectioning onto glass slides. While 3D pathology generates massive datasets that are attractive for automated computational analysis, there is also a desire to use 3D pathology to improve the visual assessment of tissue histology. In this perspective, we discuss and provide examples of potential advantages of 3D pathology for the visual assessment of clinical specimens and the challenges of dealing with large 3D datasets (of individual or multiple specimens) that pathologists have not been trained to interpret. We discuss the need for artificial intelligence triaging algorithms and explainable analysis methods to assist pathologists or other domain experts in the interpretation of these novel, often complex, large datasets.
Collapse
Affiliation(s)
- Jonathan TC Liu
- Department of Mechanical EngineeringUniversity of WashingtonSeattleWAUSA
- Department of Laboratory Medicine & PathologyUniversity of Washington School of MedicineSeattleUSA
- Department of BioengineeringUniversity of WashingtonSeattleUSA
| | - Sarah SL Chow
- Department of Mechanical EngineeringUniversity of WashingtonSeattleWAUSA
| | | | | | | | - Peter Humphrey
- Department of UrologyYale School of MedicineNew HavenCTUSA
| | - Andrew Janowczyk
- Wallace H Coulter Department of Biomedical EngineeringEmory University and Georgia Institute of TechnologyAtlantaGAUSA
- Geneva University HospitalsGenevaSwitzerland
| | - Tuomas Mirtti
- Helsinki University Hospital and University of HelsinkiHelsinkiFinland
- Emory University School of MedicineAtlantaGAUSA
| | - Clare Verrill
- John Radcliffe HospitalUniversity of OxfordOxfordUK
- NIHR Oxford Biomedical Research CentreOxford University Hospitals NHS Foundation TrustOxfordUK
| | - Inti Zlobec
- Institute for Tissue Medicine and PathologyUniversity of BernBernSwitzerland
| | - Lawrence D True
- Department of Laboratory Medicine & PathologyUniversity of Washington School of MedicineSeattleUSA
| |
Collapse
|
8
|
Bishop KW, Barner LAE, Han Q, Baraznenok E, Lan L, Poudel C, Gao G, Serafin RB, Chow SS, Glaser AK, Janowczyk A, Brenes D, Huang H, Miyasato D, True LD, Kang S, Vaughan JC, Liu JT. An end-to-end workflow for non-destructive 3D pathology. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.03.551845. [PMID: 37577615 PMCID: PMC10418226 DOI: 10.1101/2023.08.03.551845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2023]
Abstract
Recent advances in 3D pathology offer the ability to image orders-of-magnitude more tissue than conventional pathology while providing a volumetric context that is lacking with 2D tissue sections, all without requiring destructive tissue sectioning. Generating high-quality 3D pathology datasets on a consistent basis is non-trivial, requiring careful attention to many details regarding tissue preparation, imaging, and data/image processing in an iterative process. Here we provide an end-to-end protocol covering all aspects of a 3D pathology workflow (using light-sheet microscopy as an illustrative imaging platform) with sufficient detail to perform well-controlled preclinical and clinical studies. While 3D pathology is compatible with diverse staining protocols and computationally generated color palettes for visual analysis, this protocol will focus on a fluorescent analog of hematoxylin and eosin (H&E), which remains the most common stain for gold-standard diagnostic determinations. We present our guidelines for a broad range of end-users (e.g., biologists, clinical researchers, and engineers) in a simple tutorial format.
Collapse
Affiliation(s)
- Kevin W. Bishop
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
- Department of Bioengineering, University of Washington, Seattle, Washington, USA
| | | | - Qinghua Han
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
- Department of Bioengineering, University of Washington, Seattle, Washington, USA
| | - Elena Baraznenok
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
- Department of Bioengineering, University of Washington, Seattle, Washington, USA
| | - Lydia Lan
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
- Department of Biology, University of Washington, Seattle, Washington, USA
| | - Chetan Poudel
- Department of Chemistry, University of Washington, Seattle, Washington, USA
| | - Gan Gao
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Robert B. Serafin
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Sarah S.L. Chow
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Adam K. Glaser
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Andrew Janowczyk
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, GA, USA
- Department of Oncology, Division of Precision Oncology, University Hospital of Geneva, Geneva, Switzerland
- Department of Clinical Pathology, Division of Clinical Pathology, University Hospital of Geneva, Geneva, Switzerland
| | - David Brenes
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Hongyi Huang
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Dominie Miyasato
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Lawrence D. True
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, Washington, USA
| | - Soyoung Kang
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
| | - Joshua C. Vaughan
- Department of Chemistry, University of Washington, Seattle, Washington, USA
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington, USA
| | - Jonathan T.C. Liu
- Department of Mechanical Engineering, University of Washington, Seattle, Washington, USA
- Department of Bioengineering, University of Washington, Seattle, Washington, USA
- Department of Laboratory Medicine and Pathology, University of Washington, Seattle, Washington, USA
| |
Collapse
|