1
|
Wong IHM, Chen Z, Shi L, Lo CTK, Kang L, Dai W, Wong TTW. Deep learning-assisted low-cost autofluorescence microscopy for rapid slide-free imaging with virtual histological staining. BIOMEDICAL OPTICS EXPRESS 2024; 15:2187-2201. [PMID: 38633074 PMCID: PMC11019672 DOI: 10.1364/boe.515018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/27/2024] [Accepted: 02/20/2024] [Indexed: 04/19/2024]
Abstract
Slide-free imaging techniques have shown great promise in improving the histological workflow. For example, computational high-throughput autofluorescence microscopy by pattern illumination (CHAMP) has achieved high resolution with a long depth of field, which, however, requires a costly ultraviolet laser. Here, simply using a low-cost light-emitting diode (LED), we propose a deep learning-assisted framework of enhanced widefield microscopy, termed EW-LED, to generate results similar to CHAMP (the learning target). Comparing EW-LED and CHAMP, EW-LED reduces the cost by 85×, shortening the image acquisition time and computation time by 36× and 17×, respectively. This framework can be applied to other imaging modalities, enhancing widefield images for better virtual histology.
Collapse
Affiliation(s)
| | | | - Lulin Shi
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Claudia T. K. Lo
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Lei Kang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Weixing Dai
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Terence T. W. Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| |
Collapse
|
2
|
Martell MT, Haven NJM, Cikaluk BD, Restall BS, McAlister EA, Mittal R, Adam BA, Giannakopoulos N, Peiris L, Silverman S, Deschenes J, Li X, Zemp RJ. Deep learning-enabled realistic virtual histology with ultraviolet photoacoustic remote sensing microscopy. Nat Commun 2023; 14:5967. [PMID: 37749108 PMCID: PMC10519961 DOI: 10.1038/s41467-023-41574-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 09/11/2023] [Indexed: 09/27/2023] Open
Abstract
The goal of oncologic surgeries is complete tumor resection, yet positive margins are frequently found postoperatively using gold standard H&E-stained histology methods. Frozen section analysis is sometimes performed for rapid intraoperative margin evaluation, albeit with known inaccuracies. Here, we introduce a label-free histological imaging method based on an ultraviolet photoacoustic remote sensing and scattering microscope, combined with unsupervised deep learning using a cycle-consistent generative adversarial network for realistic virtual staining. Unstained tissues are scanned at rates of up to 7 mins/cm2, at resolution equivalent to 400x digital histopathology. Quantitative validation suggests strong concordance with conventional histology in benign and malignant prostate and breast tissues. In diagnostic utility studies we demonstrate a mean sensitivity and specificity of 0.96 and 0.91 in breast specimens, and respectively 0.87 and 0.94 in prostate specimens. We also find virtual stain quality is preferred (P = 0.03) compared to frozen section analysis in a blinded survey of pathologists.
Collapse
Affiliation(s)
- Matthew T Martell
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Nathaniel J M Haven
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Brendyn D Cikaluk
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Brendon S Restall
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Ewan A McAlister
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Rohan Mittal
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Benjamin A Adam
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Nadia Giannakopoulos
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Lashan Peiris
- Department of Surgery, University of Alberta, 8440 - 112 Street, Edmonton, AB, T6G 2B7, Canada
| | - Sveta Silverman
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Jean Deschenes
- Department of Laboratory Medicine and Pathology, University of Alberta, 11405 87 Avenue NW, Edmonton, AB, T6G 1C9, Canada
| | - Xingyu Li
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada
| | - Roger J Zemp
- Department of Electrical and Computer Engineering, University of Alberta, 116 Street & 85 Avenue, Edmonton, AB, T6G 2R3, Canada.
| |
Collapse
|
3
|
Song W, Guo C, Zhao Y, Wang YC, Zhu S, Min C, Yuan X. Ultraviolet metasurface-assisted photoacoustic microscopy with great enhancement in DOF for fast histology imaging. PHOTOACOUSTICS 2023; 32:100525. [PMID: 37645256 PMCID: PMC10461204 DOI: 10.1016/j.pacs.2023.100525] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 06/14/2023] [Accepted: 06/22/2023] [Indexed: 08/31/2023]
Abstract
Pathology interpretations of tissue rely on the gold standard of histology imaging, potentially hampering timely access to critical information for diagnosis and management of neoplasms because of tedious sample preparations. Slide-free capture of cell nuclei in unprocessed specimens without staining is preferable; however, inevitable irregular surfaces in fresh tissues results in limitations. An ultraviolet metasurface with the ability to generate an ultraviolet optical focus maintaining < 1.1-µm in lateral resolution and ∼290 µm in depth of field (DOF) is proposed for fast, high resolution, label-free photoacoustic histological imaging of unprocessed tissues with uneven surfaces. Microanatomical characteristics of the cell nuclei can be observed, as demonstrated by the mouse brain samples that were cut by hand and a ∼3 × 3-mm2 field of view was imaged in ∼27 min. Therefore, ultraviolet metasurface-assisted photoacoustic microscopy is anticipated to benefit intraoperative pathological assessments and basic scientific research by alleviating laborious tissue preparations.
Collapse
Affiliation(s)
- Wei Song
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics & State Key Laboratory of Radio Frequency Heterogeneous, Shenzhen University, Shenzhen 518060, China
| | - Changkui Guo
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics & State Key Laboratory of Radio Frequency Heterogeneous, Shenzhen University, Shenzhen 518060, China
| | - Yuting Zhao
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics & State Key Laboratory of Radio Frequency Heterogeneous, Shenzhen University, Shenzhen 518060, China
| | - Ya-chao Wang
- Depart of Neurosurgery, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen 518060, China
| | - Siwei Zhu
- The Institute of Translational Medicine, Tianjin Union Medical Center of Nankai University, Tianjin 300121, China
| | - Changjun Min
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics & State Key Laboratory of Radio Frequency Heterogeneous, Shenzhen University, Shenzhen 518060, China
| | - Xiaocong Yuan
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics & State Key Laboratory of Radio Frequency Heterogeneous, Shenzhen University, Shenzhen 518060, China
- Research Center for Humanoid Sensing, Zhejiang Laboratory, Hangzhou 311100, China
| |
Collapse
|
4
|
Zhao Y, Guo C, Zhang Y, Song W, Min C, Yuan X. Ultraviolet metalens for photoacoustic microscopy with an elongated depth of focus. OPTICS LETTERS 2023; 48:3435-3438. [PMID: 37390149 DOI: 10.1364/ol.485946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 05/30/2023] [Indexed: 07/02/2023]
Abstract
Ultraviolet photoacoustic microscopy (UV-PAM) can achieve in vivo imaging without exogenous markers and play an important role in pathological diagnosis. However, traditional UV-PAM is unable to detect enough photoacoustic signals due to the very limited depth of focus (DOF) of excited light and the sharp decrease in energy with increasing sample depth. Here, we design a millimeter-scale UV metalens based on the extended Nijboer-Zernike wavefront-shaping theory which can effectively extend the DOF of a UV-PAM system to about 220 μm while maintaining a good lateral resolution of 1.063 μm. To experimentally verify the performance of the UV metalens, a UV-PAM system is built to achieve the volume imaging of a series of tungsten filaments at different depths. This work demonstrates the great potential of the proposed metalens-based UV-PAM in the detection of accurate diagnostic information for clinicopathologic imaging.
Collapse
|
5
|
Wang T, Shi P, Luo D, Guo J, Liu H, Yuan J, Jin H, Wu X, Zhang Y, Xiong Z, Zhu J, Zhou R, Zhang R. A Convenient All-Cell Optical Imaging Method Compatible with Serial SEM for Brain Mapping. Brain Sci 2023; 13:711. [PMID: 37239183 PMCID: PMC10216590 DOI: 10.3390/brainsci13050711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 04/04/2023] [Accepted: 04/12/2023] [Indexed: 05/28/2023] Open
Abstract
The mammalian brain, with its complexity and intricacy, poses significant challenges for researchers aiming to understand its inner workings. Optical multilayer interference tomography (OMLIT) is a novel, promising imaging technique that enables the mapping and reconstruction of mesoscale all-cell brain atlases and is seamlessly compatible with tape-based serial scanning electron microscopy (SEM) for microscale mapping in the same tissue. However, currently, OMLIT suffers from imperfect coatings, leading to background noise and image contamination. In this study, we introduced a new imaging configuration using carbon spraying to eliminate the tape-coating step, resulting in reduced noise and enhanced imaging quality. We demonstrated the improved imaging quality and validated its applicability through a correlative light-electron imaging workflow. Our method successfully reconstructed all cells and vasculature within a large OMLIT dataset, enabling basic morphological classification and analysis. We also show that this approach can perform effectively on thicker sections, extending its applicability to sub-micron scale slices, saving sample preparation and imaging time, and increasing imaging throughput. Consequently, this method emerges as a promising candidate for high-speed, high-throughput brain tissue reconstruction and analysis. Our findings open new avenues for exploring the structure and function of the brain using OMLIT images.
Collapse
Affiliation(s)
- Tianyi Wang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Suzhou 215163, China
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Peiyao Shi
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Dingsan Luo
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Jun Guo
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| | - Hui Liu
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Jinyun Yuan
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Haiqun Jin
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| | - Xiaolong Wu
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| | - Yueyi Zhang
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| | - Zhiwei Xiong
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| | - Jinlong Zhu
- State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Renjie Zhou
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Ruobing Zhang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Suzhou 215163, China
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| |
Collapse
|
6
|
Label-free intraoperative histology of bone tissue via deep-learning-assisted ultraviolet photoacoustic microscopy. Nat Biomed Eng 2023; 7:124-134. [PMID: 36123403 DOI: 10.1038/s41551-022-00940-z] [Citation(s) in RCA: 39] [Impact Index Per Article: 39.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 08/15/2022] [Indexed: 11/09/2022]
Abstract
Obtaining frozen sections of bone tissue for intraoperative examination is challenging. To identify the bony edge of resection, orthopaedic oncologists therefore rely on pre-operative X-ray computed tomography or magnetic resonance imaging. However, these techniques do not allow for accurate diagnosis or for intraoperative confirmation of the tumour margins, and in bony sarcomas, they can lead to bone margins up to 10-fold wider (1,000-fold volumetrically) than necessary. Here, we show that real-time three-dimensional contour-scanning of tissue via ultraviolet photoacoustic microscopy in reflection mode can be used to intraoperatively evaluate undecalcified and decalcified thick bone specimens, without the need for tissue sectioning. We validate the technique with gold-standard haematoxylin-and-eosin histology images acquired via a traditional optical microscope, and also show that an unsupervised generative adversarial network can virtually stain the ultraviolet-photoacoustic-microscopy images, allowing pathologists to readily identify cancerous features. Label-free and slide-free histology via ultraviolet photoacoustic microscopy may allow for rapid diagnoses of bone-tissue pathologies and aid the intraoperative determination of tumour margins.
Collapse
|
7
|
Li D, Tao C, Hu Z, Zhang Z, Liu X. Local-flexible coupling optical-resolution photoacoustic microscopy with enhanced sensitivity. OPTICS LETTERS 2022; 47:3515-3518. [PMID: 35838717 DOI: 10.1364/ol.457652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Accepted: 06/24/2022] [Indexed: 06/15/2023]
Abstract
An acoustic coupling scheme largely determines the performance of optical-resolution photoacoustic microscopy (OR-PAM), including practicability, sensitivity, and stability. In this study, we propose OR-PAM based on a local-flexible acoustic coupling scheme, which includes a well-designed combiner connecting a set of circulating systems. The combiner integrates an objective lens and an ultrasonic transducer, controls the water level, restricts the flow rate, and drains bubbles. The circulating system provides sustained and steady flowing water. The flowing water constrained in the combiner and the circulating system forms a flexible and stable local contact between the sample and the transducer. Phantom experiments demonstrate that the proposed method can maintain high optical resolution but improve the detection sensitivity by approximately 1.9 times in comparison to dry coupling. In vivo imaging experiments of the mouse eyeground are conducted to examine the practicability of the proposed system in biomedicine. Moreover, in vivo experiments show that OR-PAM based on local-flexible coupling can reveal more details of eyeground microvasculatures, benefiting from its enhanced sensitivity. These merits promise that OR-PAM based on local-flexible coupling may have broad applications in biomedical fields.
Collapse
|
8
|
Song W, Wang YC, Chen H, Li X, Zhou L, Min C, Zhu S, Yuan X. Label-free identification of human glioma xenograft of mouse brain with quantitative ultraviolet photoacoustic histology imaging. JOURNAL OF BIOPHOTONICS 2022; 15:e202100329. [PMID: 35000293 DOI: 10.1002/jbio.202100329] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2021] [Revised: 12/14/2021] [Accepted: 01/07/2022] [Indexed: 06/14/2023]
Abstract
The ability to unveil molecular specificities of endogenous nonfluorescent chromophores of ultraviolet photoacoustic imaging technology enables label-free histology imaging of tissue specimens. In this work, we exploit ultraviolet photoacoustic microscopy for identifying human glioma xenograft of mouse brain ex vivo. Intrinsically excellent imaging contrast of cell nucleus at ultraviolet photoacoustic illumination along with good spatial resolution allows for discerning the brain glioma of freshly-harvested thick brain slices, which circumvents laborious time-consuming preparations of the tissue specimens including micrometer-thick slicing and H&E staining that are prerequisites in standard histology analysis. The identification of tumor margins and quantitative analysis of tumor areas is implemented, representing good agreement with the standard H&E-stained observations. Quantitative ultraviolet photoacoustic microscopy can access fast pathological assessment to the brain tissues, and thus potentially facilitates intraoperative brain tumor resection to precisely remove all cancerous cells and preserve healthy tissue for maintaining its essential function.
Collapse
Affiliation(s)
- Wei Song
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Ya-Chao Wang
- Department of Neurosurgery, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen, China
- The Institute Translational Medicine, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen, China
| | - Huang Chen
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Xiangzhu Li
- Department of Neurosurgery, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen, China
| | - Lingxiao Zhou
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Changjun Min
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| | - Siwei Zhu
- The Institute of Translational Medicine, Tianjin Union Medical Center of Nankai University, Tianjin, China
| | - Xiaocong Yuan
- Nanophotonics Research Center, Shenzhen Key Laboratory of Micro-Scale Optical Information Technology, Institute of Microscale Optoelectronics, Shenzhen University, Shenzhen, China
| |
Collapse
|
9
|
Functional photoacoustic microscopy of hemodynamics: a review. Biomed Eng Lett 2022; 12:97-124. [PMID: 35529339 PMCID: PMC9046529 DOI: 10.1007/s13534-022-00220-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Revised: 01/24/2022] [Accepted: 01/30/2022] [Indexed: 12/19/2022] Open
Abstract
Functional blood imaging can reflect tissue metabolism and organ viability, which is important for life science and biomedical studies. However, conventional imaging modalities either cannot provide sufficient contrast or cannot support simultaneous multi-functional imaging for hemodynamics. Photoacoustic imaging, as a hybrid imaging modality, can provide sufficient optical contrast and high spatial resolution, making it a powerful tool for in vivo vascular imaging. By using the optical-acoustic confocal alignment, photoacoustic imaging can even provide subcellular insight, referred as optical-resolution photoacoustic microscopy (OR-PAM). Based on a multi-wavelength laser source and developed the calculation methods, OR-PAM can provide multi-functional hemodynamic microscopic imaging of the total hemoglobin concentration (CHb), oxygen saturation (sO2), blood flow (BF), partial oxygen pressure (pO2), oxygen extraction fraction, and metabolic rate of oxygen (MRO2). This concise review aims to systematically introduce the principles and methods to acquire various functional parameters for hemodynamics by photoacoustic microscopy in recent studies, with characteristics and advantages comparison, typical biomedical applications introduction, and future outlook discussion.
Collapse
|
10
|
Torke PR, Nuster R, Paltauf G. Photoacoustic computational ghost imaging. OPTICS LETTERS 2022; 47:1462-1465. [PMID: 35290338 DOI: 10.1364/ol.452229] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 02/20/2022] [Indexed: 06/14/2023]
Abstract
Photoacoustic imaging with optical resolution usually requires a single-pixel raster scan. An alternative approach based on illumination with patterns obtained from a Hadamard matrix, measurement of the generated ultrasound wave with a single detector, followed by a reconstruction known from computational ghost imaging is demonstrated here. Since many pixels on the object are illuminated at the same time, thereby contributing to the recorded signal, this approach gives a better contrast-to-noise ratio compared to the raster scan, as demonstrated in a phantom experiment. Furthermore, exploiting the temporal information for depth-resolved imaging is possible. The proposed method will be beneficial in situations where the radiant exposure of a sample is limited due to either safety precautions or the properties of the available light source.
Collapse
|
11
|
Kang L, Li X, Zhang Y, Wong TTW. Deep learning enables ultraviolet photoacoustic microscopy based histological imaging with near real-time virtual staining. PHOTOACOUSTICS 2022; 25:100308. [PMID: 34703763 PMCID: PMC8521289 DOI: 10.1016/j.pacs.2021.100308] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 09/27/2021] [Accepted: 09/29/2021] [Indexed: 06/02/2023]
Abstract
Histological images can reveal rich cellular information of tissue sections, which are widely used by pathologists in disease diagnosis. However, the gold standard for histopathological examination is based on thin sections on slides, which involves inevitable time-consuming and labor-intensive tissue processing steps, hindering the possibility of intraoperative pathological assessment of the precious patient specimens. Here, by incorporating ultraviolet photoacoustic microscopy (UV-PAM) with deep learning, we show a rapid and label-free histological imaging method that can generate virtually stained histological images (termed Deep-PAM) for both thin sections and thick fresh tissue specimens. With the tissue non-destructive nature of UV-PAM, the imaged intact specimens can be reused for other ancillary tests. We demonstrated Deep-PAM on various tissue preparation protocols, including formalin-fixation and paraffin-embedding sections (7-µm thick) and frozen sections (7-µm thick) in traditional histology, and rapid assessment of intact fresh tissue (~ 2-mm thick, within 15 min for a tissue with a surface area of 5 mm × 5 mm). Deep-PAM potentially serves as a comprehensive histological imaging method that can be simultaneously applied in preoperative, intraoperative, and postoperative disease diagnosis.
Collapse
Affiliation(s)
- Lei Kang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Xiufeng Li
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Yan Zhang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Terence T W Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| |
Collapse
|
12
|
Zhang Y, Kang L, Wong IHM, Dai W, Li X, Chan RCK, Hsin MKY, Wong TTW. High-Throughput, Label-Free and Slide-Free Histological Imaging by Computational Microscopy and Unsupervised Learning. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2102358. [PMID: 34747142 PMCID: PMC8805566 DOI: 10.1002/advs.202102358] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 10/03/2021] [Indexed: 06/13/2023]
Abstract
Rapid and high-resolution histological imaging with minimal tissue preparation has long been a challenging and yet captivating medical pursuit. Here, the authors propose a promising and transformative histological imaging method, termed computational high-throughput autofluorescence microscopy by pattern illumination (CHAMP). With the assistance of computational microscopy, CHAMP enables high-throughput and label-free imaging of thick and unprocessed tissues with large surface irregularity at an acquisition speed of 10 mm2 /10 s with 1.1-µm lateral resolution. Moreover, the CHAMP image can be transformed into a virtually stained histological image (Deep-CHAMP) through unsupervised learning within 15 s, where significant cellular features are quantitatively extracted with high accuracy. The versatility of CHAMP is experimentally demonstrated using mouse brain/kidney and human lung tissues prepared with various clinical protocols, which enables a rapid and accurate intraoperative/postoperative pathological examination without tissue processing or staining, demonstrating its great potential as an assistive imaging platform for surgeons and pathologists to provide optimal adjuvant treatment.
Collapse
Affiliation(s)
- Yan Zhang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Lei Kang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Ivy H M Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Weixing Dai
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Xiufeng Li
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Ronald C K Chan
- Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Shatin, Hong Kong, China
| | - Michael K Y Hsin
- Department of Cardiothoracic Surgery, Queen Mary Hospital, Kowloon, Hong Kong, China
| | - Terence T W Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| |
Collapse
|
13
|
Restall BS, Cikaluk BD, Martell MT, Haven NJM, Mittal R, Silverman S, Peiris L, Deschenes J, Adam BA, Kinnaird A, Zemp RJ. Fast hybrid optomechanical scanning photoacoustic remote sensing microscopy for virtual histology. BIOMEDICAL OPTICS EXPRESS 2022; 13:39-47. [PMID: 35154852 PMCID: PMC8803023 DOI: 10.1364/boe.443751] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 11/01/2021] [Accepted: 11/23/2021] [Indexed: 05/25/2023]
Abstract
A rapid scanning microscopy method for hematoxylin and eosin (H&E) like images is sought after for interoperative diagnosis of solid tumor margins. The rapid observation and diagnosis of histological samples can greatly lower surgical risk and improve patient outcomes from solid tumor resection surgeries. Photoacoustic remote sensing (PARS) has recently been demonstrated to provide images of virtual H&E stains with excellent concordance with true H&E staining of formalin-fixed, paraffin embedded tissues. By using PARS with constant velocity and 1D galvanometer mirror scanning we acquire large virtual H&E images (10mm x 5mm) of prostate tissue in less than 3.5 minutes without staining, and over two orders of magnitude faster data acquisition than the current PARS imaging speed.
Collapse
Affiliation(s)
- Brendon S. Restall
- University of Alberta, Electrical and Computer Engineering Department, Edmonton, Canada
| | - Brendyn D. Cikaluk
- University of Alberta, Electrical and Computer Engineering Department, Edmonton, Canada
| | - Matthew. T. Martell
- University of Alberta, Electrical and Computer Engineering Department, Edmonton, Canada
| | - Nathaniel J. M. Haven
- University of Alberta, Electrical and Computer Engineering Department, Edmonton, Canada
| | - Rohan Mittal
- Department of Laboratory Medicine and Pathology, University of Alberta, Edmonton, Canada
| | - Sveta Silverman
- Laboratory Medicine, Misericordia Hospital, Edmonton, Canada
| | - Lashan Peiris
- Division of Department of Surgery, University of Alberta, Edmonton, Canada
| | - Jean Deschenes
- Department of Laboratory Medicine and Pathology, University of Alberta, Edmonton, Canada
| | - Benjamin A. Adam
- Department of Laboratory Medicine and Pathology, University of Alberta, Edmonton, Canada
| | - Adam Kinnaird
- Division of Urology, Department of Surgery, University of Alberta, Edmonton, Canada
| | - Roger J. Zemp
- University of Alberta, Electrical and Computer Engineering Department, Edmonton, Canada
| |
Collapse
|
14
|
Chen J, Zhang Y, Bai S, Zhu J, Chirarattananon P, Ni K, Zhou Q, Wang L. Dual-foci fast-scanning photoacoustic microscopy with 3.2-MHz A-line rate. PHOTOACOUSTICS 2021; 23:100292. [PMID: 34430201 PMCID: PMC8367837 DOI: 10.1016/j.pacs.2021.100292] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 07/12/2021] [Accepted: 08/03/2021] [Indexed: 05/02/2023]
Abstract
We report fiber-based dual-foci fast-scanning OR-PAM that can double the scanning rate without compromising the imaging resolution, the field of view, and the detection sensitivity. To achieve fast scanning speed, the OR-PAM system uses a single-axis water-immersible resonant scanning mirror that can confocally scan the optical and acoustic beams at 1018 Hz with a 3-mm range. Pulse energies of 45∼100-nJ are sufficient for acquiring vascular and oxygen-saturation images. The dual-foci method can double the B-scan rate to 2036 Hz. Using two lasers and stimulated Raman scattering, we achieve dual-wavelength excitation on both foci, and the total A-line rate is 3.2-MHz. In in vivo experiments, we inject epinephrine and monitor the hemodynamic and oxygen saturation response in the peripheral vessels at 1.7 Hz over 2.5 × 6.7 mm2. Dual-foci OR-PAM offers a new imaging tool for the study of fast physiological and pathological changes.
Collapse
Affiliation(s)
- Jiangbo Chen
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
| | - Yachao Zhang
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
| | - Songnan Bai
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
| | - Jingyi Zhu
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
| | - Pakpong Chirarattananon
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
| | - Kai Ni
- Division of Advanced Manufacturing, Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518055, China
| | - Qian Zhou
- Division of Advanced Manufacturing, Shenzhen International Graduate School, Tsinghua University, Shenzhen, 518055, China
| | - Lidai Wang
- Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China
- City University of Hong Kong Shenzhen Research Institute, Yuexing Yi Dao, Shenzhen, Guang Dong, 518057, China
- Corresponding author at: Department of Biomedical Engineering, City University of Hong Kong, 83 Tat Chee Ave, Kowloon, Hong Kong SAR, China; City University of Hong Kong Shenzhen Research Institute, Yuexing Yi Dao, Shenzhen, Guang Dong, 518057, China.
| |
Collapse
|
15
|
Chen Z, Yu W, Wong IHM, Wong TTW. Deep-learning-assisted microscopy with ultraviolet surface excitation for rapid slide-free histological imaging. BIOMEDICAL OPTICS EXPRESS 2021; 12:5920-5938. [PMID: 34692225 PMCID: PMC8515972 DOI: 10.1364/boe.433597] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Revised: 07/15/2021] [Accepted: 08/03/2021] [Indexed: 05/08/2023]
Abstract
Histopathological examination of tissue sections is the gold standard for disease diagnosis. However, the conventional histopathology workflow requires lengthy and laborious sample preparation to obtain thin tissue slices, causing about a one-week delay to generate an accurate diagnostic report. Recently, microscopy with ultraviolet surface excitation (MUSE), a rapid and slide-free imaging technique, has been developed to image fresh and thick tissues with specific molecular contrast. Here, we propose to apply an unsupervised generative adversarial network framework to translate colorful MUSE images into Deep-MUSE images that highly resemble hematoxylin and eosin staining, allowing easy adaptation by pathologists. By eliminating the needs of all sample processing steps (except staining), a MUSE image with subcellular resolution for a typical brain biopsy (5 mm × 5 mm) can be acquired in 5 minutes, which is further translated into a Deep-MUSE image in 40 seconds, simplifying the standard histopathology workflow dramatically and providing histological images intraoperatively.
Collapse
Affiliation(s)
- Zhenghui Chen
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Wentao Yu
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Ivy H. M. Wong
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| | - Terence T. W. Wong
- Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
| |
Collapse
|
16
|
Li X, Tsang VTC, Kang L, Zhang Y, Wong TTW. High-speed high-resolution laser diode-based photoacoustic microscopy for in vivo microvasculature imaging. Vis Comput Ind Biomed Art 2021; 4:1. [PMID: 33426603 PMCID: PMC7797394 DOI: 10.1186/s42492-020-00067-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 12/22/2020] [Indexed: 11/10/2022] Open
Abstract
Laser diodes (LDs) have been considered as cost-effective and compact excitation sources to overcome the requirement of costly and bulky pulsed laser sources that are commonly used in photoacoustic microscopy (PAM). However, the spatial resolution and/or imaging speed of previously reported LD-based PAM systems have not been optimized simultaneously. In this paper, we developed a high-speed and high-resolution LD-based PAM system using a continuous wave LD, operating at a pulsed mode, with a repetition rate of 30 kHz, as an excitation source. A hybrid scanning mechanism that synchronizes a one-dimensional galvanometer mirror and a two-dimensional motorized stage is applied to achieve a fast imaging capability without signal averaging due to the high signal-to-noise ratio. By optimizing the optical system, a high lateral resolution of 4.8 μm has been achieved. In vivo microvasculature imaging of a mouse ear has been demonstrated to show the high performance of our LD-based PAM system.
Collapse
Affiliation(s)
- Xiufeng Li
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Victor T C Tsang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Lei Kang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Yan Zhang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China
| | - Terence T W Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Hong Kong, China.
| |
Collapse
|
17
|
Tsang VT, Li X, Wong TT. A Review of Endogenous and Exogenous Contrast Agents Used in Photoacoustic Tomography with Different Sensing Configurations. SENSORS 2020; 20:s20195595. [PMID: 33003566 PMCID: PMC7582683 DOI: 10.3390/s20195595] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Revised: 09/18/2020] [Accepted: 09/26/2020] [Indexed: 12/17/2022]
Abstract
Optical-based sensing approaches have long been an indispensable way to detect molecules in biological tissues for various biomedical research and applications. The advancement in optical microscopy is one of the main drivers for discoveries and innovations in both life science and biomedical imaging. However, the shallow imaging depth due to the use of ballistic photons fundamentally limits optical imaging approaches’ translational potential to a clinical setting. Photoacoustic (PA) tomography (PAT) is a rapidly growing hybrid imaging modality that is capable of acoustically detecting optical contrast. PAT uniquely enjoys high-resolution deep-tissue imaging owing to the utilization of diffused photons. The exploration of endogenous contrast agents and the development of exogenous contrast agents further improve the molecular specificity for PAT. PAT’s versatile design and non-invasive nature have proven its great potential as a biomedical imaging tool for a multitude of biomedical applications. In this review, representative endogenous and exogenous PA contrast agents will be introduced alongside common PAT system configurations, including the latest advances of all-optical acoustic sensing techniques.
Collapse
|