1
|
Zheng S, Koyama M, Mertz J. Multiplane HiLo microscopy with speckle illumination and non-local means denoising. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:116502. [PMID: 38078150 PMCID: PMC10704089 DOI: 10.1117/1.jbo.28.11.116502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 10/27/2023] [Accepted: 11/03/2023] [Indexed: 12/18/2023]
Abstract
Significance HiLo microscopy synthesizes an optically sectioned image from two images, one obtained with uniform and another with patterned illumination, such as laser speckle. Speckle-based HiLo has the advantage of being robust to aberrations but is susceptible to residual speckle noise that is difficult to control. We present a computational method to reduce this residual noise without undermining resolution. In addition, we improve the versatility of HiLo microscopy by enabling simultaneous multiplane imaging (here nine planes). Aim Our goal is to perform fast, high-contrast, multiplane imaging with a conventional camera-based fluorescence microscope. Approach Multiplane HiLo imaging is achieved with the use of a single camera and z-splitter prism. Speckle noise reduction is based on the application of a non-local means (NLM) denoising method to perform ensemble averaging of speckle grains. Results We demonstrate the capabilities of multiplane HiLo with NLM denoising both with synthesized data and by imaging cardiac and brain activity in zebrafish larvae at 40 Hz frame rates. Conclusions Multiplane HiLo microscopy aided by NLM denoising provides a simple tool for fast optically sectioned volumetric imaging that can be of general utility for fluorescence imaging applications.
Collapse
Affiliation(s)
- Shuqi Zheng
- Boston University, Department of Electrical and Computer Engineering, Boston, Massachusetts, United States
| | - Minoru Koyama
- University of Toronto, Department of Cell and Systems Biology, Scarborough, Ontario, Canada
| | - Jerome Mertz
- Boston University, Department of Biomedical Engineering, Boston, Massachusetts, United States
| |
Collapse
|
2
|
Chen X, Zhong S, Hou Y, Cao R, Wang W, Li D, Dai Q, Kim D, Xi P. Superresolution structured illumination microscopy reconstruction algorithms: a review. LIGHT, SCIENCE & APPLICATIONS 2023; 12:172. [PMID: 37433801 DOI: 10.1038/s41377-023-01204-4] [Citation(s) in RCA: 21] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 05/24/2023] [Accepted: 06/05/2023] [Indexed: 07/13/2023]
Abstract
Structured illumination microscopy (SIM) has become the standard for next-generation wide-field microscopy, offering ultrahigh imaging speed, superresolution, a large field-of-view, and long-term imaging. Over the past decade, SIM hardware and software have flourished, leading to successful applications in various biological questions. However, unlocking the full potential of SIM system hardware requires the development of advanced reconstruction algorithms. Here, we introduce the basic theory of two SIM algorithms, namely, optical sectioning SIM (OS-SIM) and superresolution SIM (SR-SIM), and summarize their implementation modalities. We then provide a brief overview of existing OS-SIM processing algorithms and review the development of SR-SIM reconstruction algorithms, focusing primarily on 2D-SIM, 3D-SIM, and blind-SIM. To showcase the state-of-the-art development of SIM systems and assist users in selecting a commercial SIM system for a specific application, we compare the features of representative off-the-shelf SIM systems. Finally, we provide perspectives on the potential future developments of SIM.
Collapse
Affiliation(s)
- Xin Chen
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Suyi Zhong
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Yiwei Hou
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Ruijie Cao
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Wenyi Wang
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Dong Li
- National Laboratory of Biomacromolecules, CAS Center for Excellence in Biomacromolecules, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
| | - Qionghai Dai
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
- Beijing Key Laboratory of Multidimension & Multiscale Computational Photography, Tsinghua University, Beijing, China
- Beijing Laboratory of Brain and Cognitive Intelligence, Beijing Municipal Education Commission, Beijing, China
| | - Donghyun Kim
- School of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, Korea
| | - Peng Xi
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China.
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China.
| |
Collapse
|
3
|
Qiao W, Li Y, Ning K, Luo Q, Gong H, Yuan J. Differential synthetic illumination based on multi-line detection for resolution and contrast enhancement of line confocal microscopy. OPTICS EXPRESS 2023; 31:16093-16106. [PMID: 37157695 DOI: 10.1364/oe.491422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Line confocal (LC) microscopy is a fast 3D imaging technique, but its asymmetric detection slit limits resolution and optical sectioning. To address this, we propose the differential synthetic illumination (DSI) method based on multi-line detection to enhance the spatial resolution and optical sectioning capability of the LC system. The DSI method allows the imaging process to simultaneously accomplish on a single camera, which ensures the rapidity and stability of the imaging process. DSI-LC improves X- and Z-axis resolution by 1.28 and 1.26 times, respectively, and optical sectioning by 2.6 times compared to LC. Furthermore, the spatially resolved power and contrast are also demonstrated by imaging pollen, microtubule, and the fiber of the GFP fluorescence-labeled mouse brain. Finally, Video-rate imaging of zebrafish larval heart beating in a 665.6 × 332.8 µm2 field-of-view is achieved. DSI-LC provides a promising approach for 3D large-scale and functional imaging in vivo with improved resolution, contrast, and robustness.
Collapse
|
4
|
Yoon T, Kim PU, Ahn H, Kim T, Eom TJ, Kim K, Choi JR. Resolution-enhanced optical inspection system to examine metallic nanostructures using structured illumination. APPLIED OPTICS 2022; 61:6819-6826. [PMID: 36255761 DOI: 10.1364/ao.457806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Accepted: 07/15/2022] [Indexed: 06/16/2023]
Abstract
We developed a structured illumination-based optical inspection system to inspect metallic nanostructures in real time. To address this, we used post-image-processing techniques to enhance the image resolution. To examine the fabricated metallic nanostructures in real time, a compact and highly resolved optical inspection system was designed for practical industrial use. Structured illumination microscopy yields multiple images with various linear illumination patterns, which can be used to reconstruct resolution-enhanced images. Images of nanosized posts and complex structures reflected in the structured illumination were reconstructed into images with improved resolution. A comparison with wide-field images demonstrates that the optical inspection system exhibits high performance and is available as a real-time nanostructure inspection platform. Because it does not require special environmental conditions and enables multiple systems to be covered in arrays, the developed system is expected to provide real-time and noninvasive inspections during the production of large-area nanostructured components.
Collapse
|
5
|
The development and clinical application of microscopic endoscopy for in vivo optical biopsies: Endocytoscopy and confocal laser endomicroscopy. Photodiagnosis Photodyn Ther 2022; 38:102826. [PMID: 35337998 DOI: 10.1016/j.pdpdt.2022.102826] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Accepted: 03/21/2022] [Indexed: 12/20/2022]
Abstract
Endoscopies are crucial for detecting and diagnosing diseases in gastroenterology, pulmonology, urology, and other fields. To accurately diagnose diseases, sample biopsies are indispensable and are currently considered the gold standard. However, random 4-quadrant biopsies have sampling errors and time delays. To provide intraoperative real-time microscopic images of suspicious lesions, microscopic endoscopy for in vivo optical biopsy has been developed, including endocytoscopy and confocal laser endomicroscopy. This article reviews recent advances in technology and clinical applications, as well as their shortcomings and future directions.
Collapse
|
6
|
Hickey SM, Ung B, Bader C, Brooks R, Lazniewska J, Johnson IRD, Sorvina A, Logan J, Martini C, Moore CR, Karageorgos L, Sweetman MJ, Brooks DA. Fluorescence Microscopy-An Outline of Hardware, Biological Handling, and Fluorophore Considerations. Cells 2021; 11:35. [PMID: 35011596 PMCID: PMC8750338 DOI: 10.3390/cells11010035] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 12/21/2021] [Accepted: 12/21/2021] [Indexed: 12/16/2022] Open
Abstract
Fluorescence microscopy has become a critical tool for researchers to understand biological processes at the cellular level. Micrographs from fixed and live-cell imaging procedures feature in a plethora of scientific articles for the field of cell biology, but the complexities of fluorescence microscopy as an imaging tool can sometimes be overlooked or misunderstood. This review seeks to cover the three fundamental considerations when designing fluorescence microscopy experiments: (1) hardware availability; (2) amenability of biological models to fluorescence microscopy; and (3) suitability of imaging agents for intended applications. This review will help equip the reader to make judicious decisions when designing fluorescence microscopy experiments that deliver high-resolution and informative images for cell biology.
Collapse
Affiliation(s)
- Shane M. Hickey
- Clinical and Health Sciences, University of South Australia, Adelaide 5000, Australia; (C.B.); (R.B.); (J.L.); (I.R.D.J.); (A.S.); (J.L.); (C.M.); (C.R.M.); (L.K.); (M.J.S.); (D.A.B.)
| | - Ben Ung
- Clinical and Health Sciences, University of South Australia, Adelaide 5000, Australia; (C.B.); (R.B.); (J.L.); (I.R.D.J.); (A.S.); (J.L.); (C.M.); (C.R.M.); (L.K.); (M.J.S.); (D.A.B.)
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
7
|
Shi R, Zhang Y, Zhou T, Kong L. HiLo Based Line Scanning Temporal Focusing Microscopy for High-Speed, Deep Tissue Imaging. MEMBRANES 2021; 11:membranes11080634. [PMID: 34436397 PMCID: PMC8400873 DOI: 10.3390/membranes11080634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Revised: 08/10/2021] [Accepted: 08/11/2021] [Indexed: 01/12/2023]
Abstract
High-speed, optical-sectioning imaging is highly desired in biomedical studies, as most bio-structures and bio-dynamics are in three-dimensions. Compared to point-scanning techniques, line scanning temporal focusing microscopy (LSTFM) is a promising method that can achieve high temporal resolution while maintaining a deep penetration depth. However, the contrast and axial confinement would still be deteriorated in scattering tissue imaging. Here, we propose a HiLo-based LSTFM, utilizing structured illumination to inhibit the fluorescence background and, thus, enhance the image contrast and axial confinement in deep imaging. We demonstrate the superiority of our method by performing volumetric imaging of neurons and dynamical imaging of microglia in mouse brains in vivo.
Collapse
Affiliation(s)
- Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China;
| | - Yuanlong Zhang
- Department of Automation, Tsinghua University, Beijing 100084, China; (Y.Z.); (T.Z.)
| | - Tiankuang Zhou
- Department of Automation, Tsinghua University, Beijing 100084, China; (Y.Z.); (T.Z.)
- Graduate School at Shenzhen, Tsinghua University, Shenzhen 518055, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China;
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China
- Correspondence:
| |
Collapse
|
8
|
Luo Y, Chu CH, Vyas S, Kuo HY, Chia YH, Chen MK, Shi X, Tanaka T, Misawa H, Huang YY, Tsai DP. Varifocal Metalens for Optical Sectioning Fluorescence Microscopy. NANO LETTERS 2021; 21:5133-5142. [PMID: 34097419 DOI: 10.1021/acs.nanolett.1c01114] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Fluorescence microscopy with optical sectioning capabilities is extensively utilized in biological research to obtain three-dimensional structural images of volumetric samples. Tunable lenses have been applied in microscopy for axial scanning to acquire multiplane images. However, images acquired by conventional tunable lenses suffer from spherical aberration and distortions. Here, we design, fabricate, and implement a dielectric Moiré metalens for fluorescence imaging. The Moiré metalens consists of two complementary phase metasurfaces, with variable focal length, ranging from ∼10 to ∼125 mm at 532 nm by tuning mutual angles. In addition, a telecentric configuration using the Moiré metalens is designed for high-contrast multiplane fluorescence imaging. The performance of our system is evaluated by optically sectioned images obtained from HiLo illumination of fluorescently labeled beads, as well as ex vivo mice intestine tissue samples. The compact design of the varifocal metalens may find important applications in fluorescence microscopy and endoscopy for clinical purposes.
Collapse
Affiliation(s)
- Yuan Luo
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- YongLin Institute of Health, National Taiwan University, Taipei 10672, Taiwan
- Institute of Biomedical Engineering, National Taiwan University, Taipei 10051, Taiwan
| | - Cheng Hung Chu
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- Research Center for Applied Sciences, Academia Sinica, Taipei 11529, Taiwan
- Innovative Photon Manipulation Research Team, RIKEN Center for Advanced Photonics, Saitama 351-0198, Japan
| | - Sunil Vyas
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
| | - Hsin Yu Kuo
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- Research Center for Applied Sciences, Academia Sinica, Taipei 11529, Taiwan
- Department of Physics, National Taiwan University, Taipei 10617, Taiwan
| | - Yu Hsin Chia
- Institute of Medical Device and Imaging, National Taiwan University, Taipei 10051, Taiwan
- Institute of Biomedical Engineering, National Taiwan University, Taipei 10051, Taiwan
| | - Mu Ku Chen
- Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong
| | - Xu Shi
- Research Institute for Electronic Science Hokkaido University, Sapporo 001-0021, Japan
| | - Takuo Tanaka
- Innovative Photon Manipulation Research Team, RIKEN Center for Advanced Photonics, Saitama 351-0198, Japan
- Metamaterial Laboratory, RIKEN Cluster for Pioneering Research, Saitama 351-0198, Japan
- Institute of Post-LED Photonics, Tokushima University, Tokushima 770-8506, Japan
| | - Hiroaki Misawa
- Research Institute for Electronic Science Hokkaido University, Sapporo 001-0021, Japan
| | - Yi-You Huang
- Institute of Biomedical Engineering, National Taiwan University, Taipei 10051, Taiwan
- Department of Biomedical Engineering, National Taiwan University Hospital, Taipei 100225, Taiwan
| | - Din Ping Tsai
- Research Center for Applied Sciences, Academia Sinica, Taipei 11529, Taiwan
- Department of Physics, National Taiwan University, Taipei 10617, Taiwan
- Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Kowloon 999077, Hong Kong
| |
Collapse
|
9
|
Qiao W, Jin R, Luo T, Li Y, Fan G, Luo Q, Yuan J. Single-scan HiLo with line-illumination strategy for optical section imaging of thick tissues. BIOMEDICAL OPTICS EXPRESS 2021; 12:2373-2383. [PMID: 33996235 PMCID: PMC8086481 DOI: 10.1364/boe.419377] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 03/18/2021] [Accepted: 03/22/2021] [Indexed: 05/25/2023]
Abstract
Optical sectioning has been widely employed for inhibiting out-of-focus backgrounds in three-dimensional (3D) imaging of biological samples. However, point scanning imaging or multiple acquisitions for wide-field optical sectioning in epi-illumination microscopy remains time-consuming for large-scale imaging. In this paper, we propose a single-scan optical sectioning method based on the hybrid illumination (HiLo) algorithm with a line-illumination strategy. Our method combines HiLo background inhibition with confocal slit detection. It thereby offers a higher optical sectioning capability than wide-field HiLo and line-confocal imaging without extra modulation and multiple data acquisition. To demonstrate the optical-sectioning capability of our system, we imaged a thin fluorescent plane and different fluorescence-labeled mouse tissue. Our method shows an excellent background inhibition in thick tissue and thus potentially provides an alternative tool for 3D imaging of large-scale biological tissue.
Collapse
Affiliation(s)
- Wei Qiao
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Rui Jin
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Tianpeng Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Yafeng Li
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Guoqing Fan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
- School of Biomedical Engineering, Hainan University, Haikou, China
| | - Jing Yuan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| |
Collapse
|