1
|
Wang N, Zhang C, Wei X, Yan T, Zhou W, Zhang J, Kang H, Yuan Z, Chen X. Harnessing the power of optical microscopy for visualization and analysis of histopathological images. BIOMEDICAL OPTICS EXPRESS 2023; 14:5451-5465. [PMID: 37854561 PMCID: PMC10581782 DOI: 10.1364/boe.501893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/29/2023] [Accepted: 09/01/2023] [Indexed: 10/20/2023]
Abstract
Histopathology is the foundation and gold standard for identifying diseases, and precise quantification of histopathological images can provide the pathologist with objective clues to make a more convincing diagnosis. Optical microscopy (OM), an important branch of optical imaging technology that provides high-resolution images of tissue cytology and structural morphology, has been used in the diagnosis of histopathology and evolved into a new disciplinary direction of optical microscopic histopathology (OMH). There are a number of ex-vivo studies providing applicability of different OMH approaches, and a transfer of these techniques toward in vivo diagnosis is currently in progress. Furthermore, combined with advanced artificial intelligence algorithms, OMH allows for improved diagnostic reliability and convenience due to the complementarity of retrieval information. In this review, we cover recent advances in OMH, including the exploration of new techniques in OMH as well as their applications, and look ahead to new challenges in OMH. These typical application examples well demonstrate the application potential and clinical value of OMH techniques in histopathological diagnosis.
Collapse
Affiliation(s)
- Nan Wang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Chang Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Xinyu Wei
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
| | - Tianyu Yan
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Wangting Zhou
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Jiaojiao Zhang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Huan Kang
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
| | - Zhen Yuan
- Faculty of Health Sciences, University of Macau, Macau, 999078, China
| | - Xueli Chen
- Center for Biomedical-photonics and Molecular Imaging, Xi’an Key Laboratory of Intelligent Sensing and Regulation of Trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi’an, Shaanxi 710126, China
- Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi’an, Shaanxi 710126, China
- Inovation Center for Advanced Medical Imaging and Intelligent Medicine, Guangzhou Institute of Technology, Xidian University, Guangzhou, Guangdong 510555, China
| |
Collapse
|
2
|
Martell MT, Haven NJM, Cikaluk BD, Restall BS, McAlister EA, Mittal R, Adam BA, Giannakopoulos N, Peiris L, Silverman S, Deschenes J, Li X, Zemp RJ. Deep learning-enabled realistic virtual histology with ultraviolet photoacoustic remote sensing microscopy. Nat Commun 2023; 14:5967. [PMID: 37749108 PMCID: PMC10519961 DOI: 10.1038/s41467-023-41574-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 09/11/2023] [Indexed: 09/27/2023] Open
Abstract
The goal of oncologic surgeries is complete tumor resection, yet positive margins are frequently found postoperatively using gold standard H&E-stained histology methods. Frozen section analysis is sometimes performed for rapid intraoperative margin evaluation, albeit with known inaccuracies. Here, we introduce a label-free histological imaging method based on an ultraviolet photoacoustic remote sensing and scattering microscope, combined with unsupervised deep learning using a cycle-consistent generative adversarial network for realistic virtual staining. Unstained tissues are scanned at rates of up to 7 mins/cm2, at resolution equivalent to 400x digital histopathology. Quantitative validation suggests strong concordance with conventional histology in benign and malignant prostate and breast tissues. In diagnostic utility studies we demonstrate a mean sensitivity and specificity of 0.96 and 0.91 in breast specimens, and respectively 0.87 and 0.94 in prostate specimens. We also find virtual stain quality is preferred (P = 0.03) compared to frozen section analysis in a blinded survey of pathologists.
Collapse
Affiliation(s)
- Matthew T Martell
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Nathaniel J M Haven
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Brendyn D Cikaluk
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Brendon S Restall
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Ewan A McAlister
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Rohan Mittal
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Benjamin A Adam
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Nadia Giannakopoulos
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Lashan Peiris
- Department of Surgery, University of Alberta, 8440 - 112 Street, Edmonton, AB, T6G 2B7, Canada
| | - Sveta Silverman
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Jean Deschenes
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Xingyu Li
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Roger J Zemp
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada.
| |
Collapse
|
3
|
Cikaluk BD, Restall BS, Haven NJM, Martell MT, McAlister EA, Zemp RJ. Rapid ultraviolet photoacoustic remote sensing microscopy using voice-coil stage scanning. OPTICS EXPRESS 2023; 31:10136-10149. [PMID: 37157568 DOI: 10.1364/oe.481313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
There is an unmet need for fast virtual histology technologies that exhibit histological realism and can scan large sections of fresh tissue within intraoperative time-frames. Ultraviolet photoacoustic remote sensing microscopy (UV-PARS) is an emerging imaging modality capable of producing virtual histology images that show good concordance to conventional histology stains. However, a UV-PARS scanning system that can perform rapid intraoperative imaging over mm-scale fields-of-view at fine resolution (<500 nm) has yet to be demonstrated. In this work, we present a UV-PARS system which utilizes voice-coil stage scanning to demonstrate finely resolved images for 2×2 mm2 areas at 500 nm sampling resolution in 1.33 minutes and coarsely resolved images for 4×4 mm2 areas at 900 nm sampling resolution in 2.5 minutes. The results of this work demonstrate the speed and resolution capabilities of the UV-PARS voice-coil system and further develop the potential for UV-PARS microscopy to be employed in a clinical setting.
Collapse
|
4
|
Zhou J, Zhou J, Wang W, Liang S, Jing L, Bo SH, Chen SL. Miniature non-contact photoacoustic probe based on fiber-optic photoacoustic remote sensing microscopy. OPTICS LETTERS 2021; 46:5767-5770. [PMID: 34780457 DOI: 10.1364/ol.444889] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Accepted: 10/29/2021] [Indexed: 06/13/2023]
Abstract
Photoacoustic (PA) remote sensing (PARS) microscopy, featured by non-contact operation, has shown great potential for PA microscopy (PAM) imaging applications. However, current PARS microscopy systems are mainly based on free-space light, making the imaging head bulky and inconvenient to use. These issues hinder selected applications such as PA endoscopy and handheld PAM. Here, we report a miniature probe capable of non-contact PAM based on PARS microscopy. By utilizing fiber-optic components including a wavelength division multiplexer and an optical circulator, the imaging head can be highly miniaturized with a diameter of ∼3.0mm. Also, since all light is transmitted via fibers, the fiber-optic PARS microscopy system is relatively easy to build and facilitates scanning of the probe. In vivo imaging of a zebrafish larva and imaging of lithium metal batteries are conducted using the probe, showing its good imaging capability.
Collapse
|
5
|
Three-dimensional virtual histology in unprocessed resected tissues with photoacoustic remote sensing (PARS) microscopy and optical coherence tomography (OCT). Sci Rep 2021; 11:13723. [PMID: 34215785 PMCID: PMC8253737 DOI: 10.1038/s41598-021-93222-8] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 06/16/2021] [Indexed: 12/21/2022] Open
Abstract
Histological images are critical in the diagnosis and treatment of cancers. Unfortunately, current methods for capturing these microscopy images require resource intensive tissue preparation that may delay diagnosis for days or weeks. To streamline this process, clinicians are limited to assessing small macroscopically representative subsets of tissues. Here, a combined photoacoustic remote sensing (PARS) microscope and swept source optical coherence tomography system designed to circumvent these diagnostic limitations is presented. The proposed multimodal microscope provides label-free three-dimensional depth resolved virtual histology visualizations, capturing nuclear and extranuclear tissue morphology directly on thick unprocessed specimens. The capabilities of the proposed method are demonstrated directly in unprocessed formalin fixed resected tissues. The first images of nuclear contrast in resected human tissues, and the first three-dimensional visualization of subsurface nuclear morphology in resected Rattus tissues, captured with a non-contact photoacoustic system are presented here. Moreover, the proposed system captures the first co-registered OCT and PARS images enabling direct histological assessment of unprocessed tissues. This work represents a vital step towards the development of a rapid histological imaging modality to circumvent the limitations of current histopathology techniques.
Collapse
|