1
|
Hu G, Greene J, Zhu J, Yang Q, Zheng S, Li Y, Alido J, Guo R, Mertz J, Tian L. HiLo microscopy with caustic illumination. BIOMEDICAL OPTICS EXPRESS 2024; 15:4101-4110. [PMID: 39022539 PMCID: PMC11249696 DOI: 10.1364/boe.527264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 05/18/2024] [Accepted: 05/19/2024] [Indexed: 07/20/2024]
Abstract
HiLo microscopy is an optical sectioning structured illumination microscopy technique based on computationally combining two images: one with uniform illumination and the other with structured illumination. The most widely used structured illumination in HiLo microscopy is random speckle patterns, due to their simplicity and resilience to tissue scattering. Here, we present a novel HiLo microscopy strategy based on random caustic patterns. Building on an off-the-shelf diffuser and a low-coherence LED source, we demonstrate that caustic HiLo can achieve 4.5 µm optical sectioning capability with a 20× 0.75 NA objective. In addition, with the distinct intensity statistical properties of caustic patterns, we show that our caustic HiLo outperforms speckle HiLo, achieving enhanced optical sectioning capability and preservation of fine features by imaging scattering fixed brain sections of 100 µm, 300 µm, and 500 µm thicknesses. We anticipate that this new structured illumination technique may find various biomedical imaging applications.
Collapse
Affiliation(s)
- Guorong Hu
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Joseph Greene
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Jiabei Zhu
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Qianwan Yang
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Shuqi Zheng
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Yunzhe Li
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
- Currently with the Department of Electrical Engineering & Computer Sciences, University of California, Berkeley, California 94720, USA
| | - Jeffrey Alido
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Ruipeng Guo
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Jerome Mertz
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
- Department of Biomedical Engineering, Boston University
, Boston, Massachusetts 02215, USA
| | - Lei Tian
- Department of Electrical & Computer Engineering, Boston University
, Boston, Massachusetts 02215, USA
- Department of Biomedical Engineering, Boston University
, Boston, Massachusetts 02215, USA
| |
Collapse
|
2
|
Jiao Z, Pan M, Yousaf K, Doveiko D, Maclean M, Griffin D, Chen Y, Li DDU. Smartphone-based optical sectioning (SOS) microscopy with a telecentric design for fluorescence imaging. J Microsc 2024. [PMID: 38808665 DOI: 10.1111/jmi.13334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 04/15/2024] [Accepted: 05/17/2024] [Indexed: 05/30/2024]
Abstract
We propose a smartphone-based optical sectioning (SOS) microscope based on the HiLo technique, with a single smartphone replacing a high-cost illumination source and a camera sensor. We built our SOS with off-the-shelf optical, mechanical cage systems with 3D-printed adapters to seamlessly integrate the smartphone with the SOS main body. The liquid light guide can be integrated with the adapter, guiding the smartphone's LED light to the digital mirror device (DMD) with neglectable loss. We used an electrically tuneable lens (ETL) instead of a mechanical translation stage to realise low-cost axial scanning. The ETL was conjugated to the objective lens's back pupil plane (BPP) to construct a telecentric design by a 4f configuration to maintain the lateral magnification for different axial positions. SOS has a 571.5 µm telecentric scanning range and an 11.7 µm axial resolution. The broadband smartphone LED torch can effectively excite fluorescent polystyrene (PS) beads. We successfully used SOS for high-contrast fluorescent PS beads imaging with different wavelengths and optical sectioning imaging of multilayer fluorescent PS beads. To our knowledge, the proposed SOS is the first smartphone-based HiLo optical sectioning microscopy (£1965), which can save around £7035 compared with a traditional HiLo system (£9000). It is a powerful tool for biomedical research in resource-limited areas.
Collapse
Affiliation(s)
- Ziao Jiao
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, Scotland, UK
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, Scotland, UK
| | - Mingliang Pan
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, Scotland, UK
| | - Khadija Yousaf
- Department of Physics, University of Strathclyde, Glasgow, Scotland, UK
| | - Daniel Doveiko
- Department of Physics, University of Strathclyde, Glasgow, Scotland, UK
| | - Michelle Maclean
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, Scotland, UK
- Department of Electronic & Electrical Engineering, The Robertson Trust Laboratory for Electronic Sterilisation Technologies (ROLEST), University of Strathclyde, Glasgow, UK
| | - David Griffin
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, Scotland, UK
| | - Yu Chen
- Department of Physics, University of Strathclyde, Glasgow, Scotland, UK
| | - David Day Uei Li
- Department of Biomedical Engineering, University of Strathclyde, Glasgow, Scotland, UK
- Strathclyde Institute of Pharmacy and Biomedical Sciences, University of Strathclyde, Glasgow, Scotland, UK
| |
Collapse
|
3
|
Chia Y, Liao W, Vyas S, Chu CH, Yamaguchi T, Liu X, Tanaka T, Huang Y, Chen MK, Chen W, Tsai DP, Luo Y. In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2307837. [PMID: 38488694 PMCID: PMC11132035 DOI: 10.1002/advs.202307837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 12/30/2023] [Indexed: 05/29/2024]
Abstract
Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.
Collapse
Grants
- NSTC 112-2221-E-002-055-MY3 National Science and Technology Council, Taiwan
- NSTC 112-2221-E-002-212-MY3 National Science and Technology Council, Taiwan
- MOST-108-2221-E-002-168-MY4 National Science and Technology Council, Taiwan
- NTU-CC-113L891102 National Taiwan University
- NTU-113L8507 National Taiwan University
- NTU-CC-112L892902 National Taiwan University
- NTU-107L7728 National Taiwan University
- NTU-107L7807 National Taiwan University
- NTU-YIH-08HZT49001 National Taiwan University
- AoE/P-502/20 University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- C1015-21E University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- C5031-22G University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- CityU15303521 University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- CityU11310522 University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- CityU11305223 University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- CityU11300123 University Grants Committee / Research Grants Council of the Hong Kong Special Administrative Region, China
- 2020B1515120073 Department of Science and Technology of Guangdong Province
- 9380131 City University of Hong Kong
- 9610628 City University of Hong Kong
- 7005867 City University of Hong Kong
- JPMJCR1904 JST CREST
- NHRI-EX113-11327EI National Health Research Institutes
- National Science and Technology Council, Taiwan
- National Taiwan University
- Department of Science and Technology of Guangdong Province
- City University of Hong Kong
- National Health Research Institutes
Collapse
Affiliation(s)
- Yu‐Hsin Chia
- Department of Biomedical EngineeringNational Taiwan UniversityTaipei10051Taiwan
- Institute of Medical Device and ImagingNational Taiwan UniversityTaipei10051Taiwan
| | - Wei‐Hao Liao
- Department of Physical Medicine and RehabilitationNational Taiwan University Hospital & National Taiwan University College of MedicineTaipei10051Taiwan
| | - Sunil Vyas
- Institute of Medical Device and ImagingNational Taiwan UniversityTaipei10051Taiwan
| | - Cheng Hung Chu
- YongLin Institute of HealthNational Taiwan UniversityTaipei10087Taiwan
| | - Takeshi Yamaguchi
- Innovative Photon Manipulation Research TeamRIKEN Center for Advanced PhotonicsSaitama351‐0198Japan
| | - Xiaoyuan Liu
- Department of Electrical EngineeringCity University of Hong KongKowloon999077Hong Kong, China
| | - Takuo Tanaka
- Innovative Photon Manipulation Research TeamRIKEN Center for Advanced PhotonicsSaitama351‐0198Japan
| | - Yi‐You Huang
- Department of Biomedical EngineeringNational Taiwan UniversityTaipei10051Taiwan
- Institute of Medical Device and ImagingNational Taiwan UniversityTaipei10051Taiwan
- Department of Biomedical EngineeringNational Taiwan University HospitalTaipei10051Taiwan
| | - Mu Ku Chen
- Department of Electrical EngineeringCity University of Hong KongKowloon999077Hong Kong, China
- Centre for Biosystems, Neuroscience and NanotechnologyCity University of Hong KongKowloon999077Hong Kong, China
- The State Key Laboratory of Terahertz and Millimeter WavesCity University of Hong KongKowloon999077Hong Kong, China
| | - Wen‐Shiang Chen
- Department of Physical Medicine and RehabilitationNational Taiwan University Hospital & National Taiwan University College of MedicineTaipei10051Taiwan
- Institute of Biomedical Engineering and NanomedicineNational Health Research InstitutesMiaoli35053Taiwan
| | - Din Ping Tsai
- Department of Electrical EngineeringCity University of Hong KongKowloon999077Hong Kong, China
- Centre for Biosystems, Neuroscience and NanotechnologyCity University of Hong KongKowloon999077Hong Kong, China
- The State Key Laboratory of Terahertz and Millimeter WavesCity University of Hong KongKowloon999077Hong Kong, China
| | - Yuan Luo
- Institute of Medical Device and ImagingNational Taiwan UniversityTaipei10051Taiwan
- YongLin Institute of HealthNational Taiwan UniversityTaipei10087Taiwan
- Molecular Imaging CenterNational Taiwan UniversityTaipei10672Taiwan
- Program for Precision Health and Intelligent MedicineNational Taiwan UniversityTaipei106319Taiwan
| |
Collapse
|
4
|
Zhang G, Li X, Zhang Y, Han X, Li X, Yu J, Liu B, Wu J, Yu L, Dai Q. Bio-friendly long-term subcellular dynamic recording by self-supervised image enhancement microscopy. Nat Methods 2023; 20:1957-1970. [PMID: 37957429 PMCID: PMC10703694 DOI: 10.1038/s41592-023-02058-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 09/29/2023] [Indexed: 11/15/2023]
Abstract
Fluorescence microscopy has become an indispensable tool for revealing the dynamic regulation of cells and organelles. However, stochastic noise inherently restricts optical interrogation quality and exacerbates observation fidelity when balancing the joint demands of high frame rate, long-term recording and low phototoxicity. Here we propose DeepSeMi, a self-supervised-learning-based denoising framework capable of increasing signal-to-noise ratio by over 12 dB across various conditions. With the introduction of newly designed eccentric blind-spot convolution filters, DeepSeMi effectively denoises images with no loss of spatiotemporal resolution. In combination with confocal microscopy, DeepSeMi allows for recording organelle interactions in four colors at high frame rates across tens of thousands of frames, monitoring migrasomes and retractosomes over a half day, and imaging ultra-phototoxicity-sensitive Dictyostelium cells over thousands of frames. Through comprehensive validations across various samples and instruments, we prove DeepSeMi to be a versatile and biocompatible tool for breaking the shot-noise limit.
Collapse
Affiliation(s)
- Guoxun Zhang
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
| | - Xiaopeng Li
- State Key Laboratory of Membrane Biology, Tsinghua University-Peking University Joint Center for Life Sciences, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing, China
| | - Yuanlong Zhang
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
| | - Xiaofei Han
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
| | - Xinyang Li
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
| | - Jinqiang Yu
- State Key Laboratory of Membrane Biology, Tsinghua University-Peking University Joint Center for Life Sciences, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing, China
| | - Boqi Liu
- State Key Laboratory of Membrane Biology, Tsinghua University-Peking University Joint Center for Life Sciences, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing, China
| | - Jiamin Wu
- Department of Automation, Tsinghua University, Beijing, China.
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China.
- Shanghai AI Laboratory, Shanghai, China.
| | - Li Yu
- State Key Laboratory of Membrane Biology, Tsinghua University-Peking University Joint Center for Life Sciences, Beijing Frontier Research Center for Biological Structure, School of Life Sciences, Tsinghua University, Beijing, China.
| | - Qionghai Dai
- Department of Automation, Tsinghua University, Beijing, China.
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China.
| |
Collapse
|
5
|
Zheng S, Koyama M, Mertz J. Multiplane HiLo microscopy with speckle illumination and non-local means denoising. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:116502. [PMID: 38078150 PMCID: PMC10704089 DOI: 10.1117/1.jbo.28.11.116502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 10/27/2023] [Accepted: 11/03/2023] [Indexed: 12/18/2023]
Abstract
Significance HiLo microscopy synthesizes an optically sectioned image from two images, one obtained with uniform and another with patterned illumination, such as laser speckle. Speckle-based HiLo has the advantage of being robust to aberrations but is susceptible to residual speckle noise that is difficult to control. We present a computational method to reduce this residual noise without undermining resolution. In addition, we improve the versatility of HiLo microscopy by enabling simultaneous multiplane imaging (here nine planes). Aim Our goal is to perform fast, high-contrast, multiplane imaging with a conventional camera-based fluorescence microscope. Approach Multiplane HiLo imaging is achieved with the use of a single camera and z-splitter prism. Speckle noise reduction is based on the application of a non-local means (NLM) denoising method to perform ensemble averaging of speckle grains. Results We demonstrate the capabilities of multiplane HiLo with NLM denoising both with synthesized data and by imaging cardiac and brain activity in zebrafish larvae at 40 Hz frame rates. Conclusions Multiplane HiLo microscopy aided by NLM denoising provides a simple tool for fast optically sectioned volumetric imaging that can be of general utility for fluorescence imaging applications.
Collapse
Affiliation(s)
- Shuqi Zheng
- Boston University, Department of Electrical and Computer Engineering, Boston, Massachusetts, United States
| | - Minoru Koyama
- University of Toronto, Department of Cell and Systems Biology, Scarborough, Ontario, Canada
| | - Jerome Mertz
- Boston University, Department of Biomedical Engineering, Boston, Massachusetts, United States
| |
Collapse
|
6
|
Weinberg G, Weiss U, Katz O. Image scanning lensless fiber-bundle endomicroscopy. OPTICS EXPRESS 2023; 31:37050-37057. [PMID: 38017842 DOI: 10.1364/oe.496369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Accepted: 09/07/2023] [Indexed: 11/30/2023]
Abstract
Fiber-based confocal endomicroscopy has shown great promise for minimally-invasive deep-tissue imaging. Despite its advantages, confocal fiber-bundle endoscopy inherently suffers from undersampling due to the spacing between fiber cores, and low collection efficiency when the target is not in proximity to the distal fiber facet. Here, we demonstrate an adaptation of image-scanning microscopy (ISM) to lensless fiber bundle endoscopy, doubling the spatial sampling frequency and significantly improving collection efficiency. Our approach only requires replacing the confocal detector with a camera. It improves the spatial resolution for targets placed at a distance from the fiber tip, and addresses the fundamental challenge of aliasing/pixelization artifacts.
Collapse
|
7
|
Scarbrough D, Thomas A, Field J, Bartels R, Squier J. Cascaded domain multiphoton spatial frequency modulation imaging. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:106502. [PMID: 37799937 PMCID: PMC10548116 DOI: 10.1117/1.jbo.28.10.106502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 09/14/2023] [Accepted: 09/19/2023] [Indexed: 10/07/2023]
Abstract
Significance Multiphoton microscopy is a powerful imaging tool for biomedical applications. A variety of techniques and respective benefits exist for multiphoton microscopy, but an enhanced resolution is especially desired. Additionally multiphoton microscopy requires ultrafast pulses for excitation, so optimization of the pulse duration at the sample is critical for strong signals. Aim We aim to perform enhanced resolution imaging that is robust to scattering using a structured illumination technique while also providing a rapid and easily repeatable means to optimize group delay dispersion (GDD) compensation through to the sample. Approach Spatial frequency modulation imaging (SPIFI) is used in two domains: the spatial domain (SD) and the wavelength domain (WD). The WD-SPIFI system is an in-line tool enabling GDD optimization that considers all material through to the sample. The SD-SPIFI system follows and enables enhanced resolution imaging. Results The WD-SPIFI dispersion optimization performance is confirmed with independent pulse characterization, enabling rapid optimization of pulses for imaging with the SD-SPIFI system. The SD-SPIFI system demonstrates enhanced resolution imaging without the use of photon counting enabled by signal to noise improvements due to the WD-SPIFI system. Conclusions Implementing SPIFI in-line in two domains enables full-path dispersion compensation optimization through to the sample for enhanced resolution multiphoton microscopy.
Collapse
Affiliation(s)
- Daniel Scarbrough
- Colorado School of Mines, Department of Physics, Golden, Colorado, United States
| | - Anna Thomas
- Colorado School of Mines, Department of Physics, Golden, Colorado, United States
| | - Jeff Field
- Colorado State University, Department of Electrical and Computer Engineering, Fort Collins, Colorado, United States
- Colorado State University, Center for Imaging and Surface Science, Fort Collins, Colorado, United States
| | - Randy Bartels
- Colorado State University, Department of Electrical and Computer Engineering, Fort Collins, Colorado, United States
- Colorado State University, School of Biomedical Engineering, Fort Collins, Colorado, United States
| | - Jeff Squier
- Colorado School of Mines, Department of Physics, Golden, Colorado, United States
| |
Collapse
|
8
|
Zhai J, Shi R, Fan K, Kong L. Background inhibited and speed-loss-free volumetric imaging in vivo based on structured-illumination Fourier light field microscopy. Front Neurosci 2022; 16:1004228. [PMID: 36248666 PMCID: PMC9558295 DOI: 10.3389/fnins.2022.1004228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Benefiting from its advantages in fast volumetric imaging for recording biodynamics, Fourier light field microscopy (FLFM) has a wide range of applications in biomedical research, especially in neuroscience. However, the imaging quality of the FLFM is always deteriorated by both the out-of-focus background and the strong scattering in biological samples. Here we propose a structured-illumination and interleaved-reconstruction based Fourier light field microscopy (SI-FLFM), in which we can filter out the background fluorescence in FLFM without sacrificing imaging speed. We demonstrate the superiority of our SI-FLFM in high-speed, background-inhibited volumetric imaging of various biodynamics in larval zebrafish and mice in vivo. The signal-to-background ratio (SBR) is improved by tens of times. And the volumetric imaging speed can be up to 40 Hz, avoiding artifacts caused by temporal under-sampling in conventional structured illumination microscopy. These suggest that our SI-FLFM is suitable for applications of weak fluorescence signals but high imaging speed requirements.
Collapse
Affiliation(s)
- Jiazhen Zhai
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Kuikui Fan
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China
- *Correspondence: Lingjie Kong,
| |
Collapse
|
9
|
Zhang Y, Kang L, Lo CTK, Tsang VTC, Wong TTW. Rapid slide-free and non-destructive histological imaging using wide-field optical-sectioning microscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:2782-2796. [PMID: 35774335 PMCID: PMC9203115 DOI: 10.1364/boe.454501] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 03/31/2022] [Accepted: 03/31/2022] [Indexed: 06/15/2023]
Abstract
Histopathology based on formalin-fixed and paraffin-embedded tissues has long been the gold standard for surgical margin assessment (SMA). However, routine pathological practice is lengthy and laborious, failing to guide surgeons intraoperatively. In this report, we propose a practical and low-cost histological imaging method with wide-field optical-sectioning microscopy (i.e., High-and-Low-frequency (HiLo) microscopy). HiLo can achieve rapid and non-destructive imaging of freshly-excised tissues at an extremely high acquisition speed of 5 cm2/min with a spatial resolution of 1.3 µm (lateral) and 5.8 µm (axial), showing great potential as an SMA tool that can provide immediate feedback to surgeons and pathologists for intraoperative decision-making. We demonstrate that HiLo enables rapid extraction of diagnostic features for different subtypes of human lung adenocarcinoma and hepatocellular carcinoma, producing surface images of rough specimens with large field-of-views and cellular features that are comparable to the clinical standard. Our results show promising clinical translations of HiLo microscopy to improve the current standard of care.
Collapse
|
10
|
Comparison of Two- and Three-Beam Interference Pattern Generation in Structured Illumination Microscopy. PHOTONICS 2021. [DOI: 10.3390/photonics8120526] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Structured illumination microscopy (SIM) provides wide-field optical sectioning in the focal plane by modulating the imaging information using fringe pattern illumination. For generating the fringe pattern illumination, a digital micro-mirror device (DMD) is commonly used due to its flexibility and fast refresh rate. However, the benefit of different pattern generation, for example, the two-beam interference mode and the three-beam interference mode, has not been clearly investigated. In this study, we systematically analyze the optical sectioning provided by the two-beam inference mode and the three-beam interference mode of DMD. The theoretical analysis and imaging results show that the two-beam interference mode is suitable for fast imaging of the superficial dynamic target due to reduced number of phase shifts needed to form the image, and the three-beam interference mode is ideal for imaging three-dimensional volume due to its superior optical sectioning by the improved modulation of the illumination patterns. These results, we believe, will provide better guidance for the use of DMD for SIM imaging and also for the choice of beam patterns in SIM application in the future.
Collapse
|
11
|
Shi R, Zhang Y, Zhou T, Kong L. HiLo Based Line Scanning Temporal Focusing Microscopy for High-Speed, Deep Tissue Imaging. MEMBRANES 2021; 11:membranes11080634. [PMID: 34436397 PMCID: PMC8400873 DOI: 10.3390/membranes11080634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Revised: 08/10/2021] [Accepted: 08/11/2021] [Indexed: 01/12/2023]
Abstract
High-speed, optical-sectioning imaging is highly desired in biomedical studies, as most bio-structures and bio-dynamics are in three-dimensions. Compared to point-scanning techniques, line scanning temporal focusing microscopy (LSTFM) is a promising method that can achieve high temporal resolution while maintaining a deep penetration depth. However, the contrast and axial confinement would still be deteriorated in scattering tissue imaging. Here, we propose a HiLo-based LSTFM, utilizing structured illumination to inhibit the fluorescence background and, thus, enhance the image contrast and axial confinement in deep imaging. We demonstrate the superiority of our method by performing volumetric imaging of neurons and dynamical imaging of microglia in mouse brains in vivo.
Collapse
Affiliation(s)
- Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China;
| | - Yuanlong Zhang
- Department of Automation, Tsinghua University, Beijing 100084, China; (Y.Z.); (T.Z.)
| | - Tiankuang Zhou
- Department of Automation, Tsinghua University, Beijing 100084, China; (Y.Z.); (T.Z.)
- Graduate School at Shenzhen, Tsinghua University, Shenzhen 518055, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China;
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China
- Correspondence:
| |
Collapse
|
12
|
Qiao W, Jin R, Luo T, Li Y, Fan G, Luo Q, Yuan J. Single-scan HiLo with line-illumination strategy for optical section imaging of thick tissues. BIOMEDICAL OPTICS EXPRESS 2021; 12:2373-2383. [PMID: 33996235 PMCID: PMC8086481 DOI: 10.1364/boe.419377] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 03/18/2021] [Accepted: 03/22/2021] [Indexed: 05/25/2023]
Abstract
Optical sectioning has been widely employed for inhibiting out-of-focus backgrounds in three-dimensional (3D) imaging of biological samples. However, point scanning imaging or multiple acquisitions for wide-field optical sectioning in epi-illumination microscopy remains time-consuming for large-scale imaging. In this paper, we propose a single-scan optical sectioning method based on the hybrid illumination (HiLo) algorithm with a line-illumination strategy. Our method combines HiLo background inhibition with confocal slit detection. It thereby offers a higher optical sectioning capability than wide-field HiLo and line-confocal imaging without extra modulation and multiple data acquisition. To demonstrate the optical-sectioning capability of our system, we imaged a thin fluorescent plane and different fluorescence-labeled mouse tissue. Our method shows an excellent background inhibition in thick tissue and thus potentially provides an alternative tool for 3D imaging of large-scale biological tissue.
Collapse
Affiliation(s)
- Wei Qiao
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Rui Jin
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Tianpeng Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Yafeng Li
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Guoqing Fan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
- School of Biomedical Engineering, Hainan University, Haikou, China
| | - Jing Yuan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| |
Collapse
|
13
|
Chai C, Chen C, Liu X, Lei Z. Deep learning based one-shot optically-sectioned structured illumination microscopy for surface measurement. OPTICS EXPRESS 2021; 29:4010-4021. [PMID: 33770989 DOI: 10.1364/oe.415210] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Accepted: 01/14/2021] [Indexed: 06/12/2023]
Abstract
Optically-sectioned structured illumination microscopy (OS-SIM) is broadly used for biological imaging and engineering surface measurement owing to its simple, low-cost, scanning-free experimental setup and excellent optical sectioning capability. However, the efficiency of current optically-sectioned methods in OS-SIM is yet limited for surface measurement because a set of wide-field images under uniform or structured illumination are needed to derive an optical section at each scanning height. In this paper, a deep-learning-based one-shot optically-sectioned method, called Deep-OS-SIM, is proposed to improve the efficiency of OS-SIM for surface measurement. Specifically, we develop a convolutional neural network (CNN) to learn the statistical invariance of optical sectioning across structured illumination images. By taking full advantage of the high entropy properties of structured illumination images to train the CNN, fast convergence and low training error are achieved in our method even for low-textured surfaces. The well-trained CNN is then applied to a plane mirror for testing, demonstrating the ability of the method to reconstruct high-quality optical sectioning from only one instead of two or three raw structured illumination frames. Further measurement experiments on a standard step and milled surface show that the proposed method has similar accuracy to OS-SIM techniques but with higher imaging speed.
Collapse
|
14
|
Hsiao H, Lin CY, Vyas S, Huang KY, Yeh JA, Luo Y. Telecentric design for digital-scanning-based HiLo optical sectioning endomicroscopy with an electrically tunable lens. JOURNAL OF BIOPHOTONICS 2021; 14:e202000335. [PMID: 33125188 DOI: 10.1002/jbio.202000335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 10/15/2020] [Accepted: 10/26/2020] [Indexed: 06/11/2023]
Abstract
Confocal endoscopy has been widely used to obtain fine optically sectioned images. However, confocal endomicroscopic images are formed by point-by-point scanning in both lateral and axial directions, which results in long image acquisition time. Here, an endomicroscope with telecentric configuration is presented to achieve nonmechanical and rapid axial scanning for volumetric fluorescence imaging. In our system, optical sectioning in wide-field fashion is obtained through HiLo imaging with a digital micromirror device. Axial scanning, without mechanical moving parts, is conducted by digital focus adjustment using an electrically tunable lens, offering constant magnification and contrast. We demonstrate imaging performance of our system with optically sectioned images using fluorescently labeled beads, as well as ex vivo mice cardiac tissue samples. Our system provides multiple advantages, in terms of improved scanning range, and reduced image acquisition time, which shows great potentials for three-dimensional biopsies of volumetric biological samples.
Collapse
Affiliation(s)
- Haw Hsiao
- Department of Mechanical Engineering, National Taiwan University, Taipei, Taiwan
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
| | - Chen-Yen Lin
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
| | - Sunil Vyas
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
| | - Kuang-Yuh Huang
- Department of Mechanical Engineering, National Taiwan University, Taipei, Taiwan
| | - J Andrew Yeh
- Department of Power Mechanical Engineering, National Tsing Hua University, Hsinchu, Taiwan
| | - Yuan Luo
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
- Molecule Imaging Center, National Taiwan University, Taipei, Taiwan
- YongLin Institute of Health, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
15
|
Chia YH, Yeh JA, Huang YY, Luo Y. Simultaneous multi-color optical sectioning fluorescence microscopy with wavelength-coded volume holographic gratings. OPTICS EXPRESS 2020; 28:37177-37187. [PMID: 33379556 DOI: 10.1364/oe.409179] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 11/08/2020] [Indexed: 06/12/2023]
Abstract
Optical sectioning fluorescence microscopy provides high contrast images of volumetric samples and has been widely used for many biological applications. However, simultaneously acquiring multi-color fluorescence images require additional optical elements and devices, which are bulky, wavelength specific, and not cost-effective. In this paper, wavelength-coded volume holographic gratings (WC-VHGs) based optical sectioning fluorescence microscopy is proposed to simultaneously offer multi-color fluorescence images with fine out-of-focus background rejection. Due to wavelength degeneracy, multiplexed WC-VHGs are capable of acquiring multi-wavelength fluorescence images in a single shot, and displaying the laterally separated multi-wavelength images onto CCD. In our system optical sectioning capability is achieved through speckle illumination and HiLo imaging method. To demonstrate imaging characteristics of our system, dual-wavelength fluorescence images of both standard fluorescent microspheres and ex vivo mT/mG mice cardiac tissue are presented. Current results may find important applications in hyperspectral imaging for biomedical research.
Collapse
|
16
|
Xu Z, Forsberg E, Guo Y, Cai F, He S. Light-Sheet Microscopy for Surface Topography Measurements and Quantitative Analysis. SENSORS 2020; 20:s20102842. [PMID: 32429437 PMCID: PMC7288151 DOI: 10.3390/s20102842] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 05/06/2020] [Accepted: 05/13/2020] [Indexed: 12/13/2022]
Abstract
A novel light-sheet microscopy (LSM) system that uses the laser triangulation method to quantitatively calculate and analyze the surface topography of opaque samples is discussed. A spatial resolution of at least 10 μm in z-direction, 10 μm in x-direction and 25 μm in y-direction with a large field-of-view (FOV) is achieved. A set of sample measurements that verify the system′s functionality in various applications are presented. The system has a simple mechanical structure, such that the spatial resolution is easily improved by replacement of the objective, and a linear calibration formula, which enables convenient system calibration. As implemented, the system has strong potential for, e.g., industrial sample line inspections, however, since the method utilizes reflected/scattered light, it also has the potential for three-dimensional analysis of translucent and layered structures.
Collapse
Affiliation(s)
- Zhanpeng Xu
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, China; (Z.X.); (E.F.); (Y.G.)
| | - Erik Forsberg
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, China; (Z.X.); (E.F.); (Y.G.)
| | - Yang Guo
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, China; (Z.X.); (E.F.); (Y.G.)
| | - Fuhong Cai
- School of Biomedical Engineering, Hainan University, Haikou 570228, China;
| | - Sailing He
- Centre for Optical and Electromagnetic Research, National Engineering Research Center for Optical Instruments, Zhejiang Provincial Key Laboratory for Sensing Technologies, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310058, China; (Z.X.); (E.F.); (Y.G.)
- Correspondence: ; Tel.: +86-571-8820-6525
| |
Collapse
|
17
|
Chong C, Simin L, Gang W, Yong L, Linbo W, Guang Y, Xin J, Hui L. Four-dimensional visualization of zebrafish cardiovascular and vessel dynamics by a structured illumination microscope with electrically tunable lens. BIOMEDICAL OPTICS EXPRESS 2020; 11:1203-1215. [PMID: 32133243 PMCID: PMC7041440 DOI: 10.1364/boe.382114] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 01/18/2020] [Accepted: 01/21/2020] [Indexed: 05/18/2023]
Abstract
We established a four-dimensional (4D) microscopy method using structured illumination for optical axial imaging with an electrically tunable lens. With its fast imaging capability, the dynamics of the cardiovascular system of the zebrafish and cerebral vessels were imaged based on the coverage of two stacks (25 layers) per second with lateral /axial resolutions of 0.6 µm and 1.8 µm, respectively. Time lapse imaging clearly shows the contractile-relaxation response of the beating heart at different cardiac phases and with different mobilities of blood vessels in different regions. This new 4D technique will facilitate in vivo imaging of organ function, generation, as well as drug responses in small-sized animals.
Collapse
Affiliation(s)
- Chen Chong
- University of Science and Technology of China, Hefei, Anhui 230041, China
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Li Simin
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Wen Gang
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Liang Yong
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Wang Linbo
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Yang Guang
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Jin Xin
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| | - Li Hui
- University of Science and Technology of China, Hefei, Anhui 230041, China
- Jiangsu Key Laboratory of Medical Optics, CAS Center for Excellence in Molecular Cell Science, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, Jiangsu 215163, China
| |
Collapse
|
18
|
Shi R, Jin C, Xie H, Zhang Y, Li X, Dai Q, Kong L. Multi-plane, wide-field fluorescent microscopy for biodynamic imaging in vivo. BIOMEDICAL OPTICS EXPRESS 2019; 10:6625-6635. [PMID: 31853421 PMCID: PMC6913411 DOI: 10.1364/boe.10.006625] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Revised: 10/05/2019] [Accepted: 10/30/2019] [Indexed: 05/29/2023]
Abstract
Wide-field fluorescent microscopy (WFFM) is widely employed in biomedical studies, due to its inherent advantages in high-speed imaging of biological dynamics noninvasively and specifically. However, WFFM suffers from the loss of axial resolution and the poor resistance to light scattering in deep tissue imaging. Here we propose a novel WFFM which has the capability in optical sectioning and volumetric imaging. We perform speckle illumination with a digital-micromirror-device for optical sectioning and employ an electrically tunable lens for defocusing modulation so as to quickly switch the image planes. We demonstrate its applications in multi-plane, wide-field imaging of biological dynamics in both zebrafish brains and mouse brains in vivo.
Collapse
Affiliation(s)
- Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Cheng Jin
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
| | - Hao Xie
- Department of Automation, Tsinghua University, Beijing 100084, China
| | - Yuanlong Zhang
- Department of Automation, Tsinghua University, Beijing 100084, China
| | - Xinyang Li
- Department of Automation, Tsinghua University, Beijing 100084, China
- Graduate School at Shenzhen, Tsinghua University, Shenzhen 518055, China
| | - Qionghai Dai
- Department of Automation, Tsinghua University, Beijing 100084, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing 100084, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China
| |
Collapse
|
19
|
Zhang H, Vyas K, Yang GZ. Line scanning, fiber bundle fluorescence HiLo endomicroscopy with confocal slit detection. JOURNAL OF BIOMEDICAL OPTICS 2019; 24:1-7. [PMID: 31724344 PMCID: PMC7003141 DOI: 10.1117/1.jbo.24.11.116501] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Accepted: 10/07/2019] [Indexed: 05/03/2023]
Abstract
Fiber bundle fluorescence endomicroscopy is an effective method for in vivo imaging of biological tissue samples. Line-scanning confocal laser endomicroscopy realizes confocal imaging at a much higher frame rate compared to the point scanning system, but with reduced optical sectioning. To address this problem, we describe a fiber bundle endomicroscopy system that utilizes the HiLo technique to enhance the optical sectioning while still maintaining high image acquisition rates. Confocal HiLo endomicroscopy is achieved by synchronizing the scanning hybrid-illumination laser line with the rolling shutter of a CMOS camera. An evident improvement of axial sectioning is achieved as compared to the line-scanning confocal endomicroscopy without the HiLo technique. Comparisons are also made with epifluorescence endomicroscopy with and without HiLo. The optical sectioning enhancement is demonstrated on lens tissue as well as porcine kidney tissue.
Collapse
Affiliation(s)
- Haojie Zhang
- Hamlyn Centre for Robotic Surgery, Imperial College London, South Kingston Campus, London, United Kingdom
- Address all correspondence to Haojie Zhang, E-mail:
| | - Khushi Vyas
- Hamlyn Centre for Robotic Surgery, Imperial College London, South Kingston Campus, London, United Kingdom
| | - Guang-Zhong Yang
- Hamlyn Centre for Robotic Surgery, Imperial College London, South Kingston Campus, London, United Kingdom
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
20
|
A 2-dimensional ratchet model describes assembly initiation of a specialized bacterial cell surface. Proc Natl Acad Sci U S A 2019; 116:21789-21799. [PMID: 31597735 DOI: 10.1073/pnas.1907397116] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023] Open
Abstract
Bacterial spores are dormant cells that are encased in a thick protein shell, the "coat," which participates in protecting the organism's DNA from environmental insults. The coat is composed of dozens of proteins that assemble in an orchestrated fashion during sporulation. In Bacillus subtilis, 2 proteins initiate coat assembly: SpoVM, which preferentially binds to micron-scale convex membranes and marks the surface of the developing spore as the site for coat assembly; and SpoIVA, a structural protein recruited by SpoVM that uses ATP hydrolysis to drive its irreversible polymerization around the developing spore. Here, we describe the initiation of coat assembly by SpoVM and SpoIVA. Using single-molecule fluorescence microscopy in vivo in sporulating cells and in vitro on synthetic spores, we report that SpoVM's localization is primarily driven by a lower off-rate on membranes of preferred curvature in the absence of other coat proteins. Recruitment and polymerization of SpoIVA results in the entrapment of SpoVM on the forespore surface. Using experimentally derived reaction parameters, we show that a 2-dimensional ratchet model can describe the interdependent localization dynamics of SpoVM and SpoIVA, wherein SpoVM displays a longer residence time on the forespore surface, which favors recruitment of SpoIVA to that location. Localized SpoIVA polymerization in turn prevents further sampling of other membranes by prelocalized SpoVM molecules. Our model therefore describes the dynamics of structural proteins as they localize and assemble at the correct place and time within a cell to form a supramolecular complex.
Collapse
|
21
|
Xie Z, Tang Y, Feng J, Liu J, Hu S. Accurate surface profilometry using differential optical sectioning microscopy with structured illumination. OPTICS EXPRESS 2019; 27:11721-11733. [PMID: 31053014 DOI: 10.1364/oe.27.011721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 03/28/2019] [Indexed: 06/09/2023]
Abstract
A differential optical sectioning microscopy with structured-illumination (DOSM-SI) with enhanced axial precision is explored in this paper for three-dimensional (3D) measurement. As the segment of data on the linear region of the contrast depth response curve (CDR) is very sensitive to variation of the height information, the DOSM-SI introduces a new CDR2 with an axial shift to intersect the linear region of the CDR1, which is achieved by using two charge-coupled detectors (CCDs) in the optical path. The CCD1 is located on the imaging plane and the CCD2 is displaced from the imaging plane. The difference between the CDR1 and CDR2 for each pixel is defined as the differential depth response curve (DCDR). Further, the zero-crossing point of the DCDR for each pixel is accurately extracted using the line-fitting technique, and finally, the sample surface can be reconstructed with a high resolution and precision. Since the slope around the zero-crossing point of the DCDR is apparently larger than that of near the focal position, an enhanced resolution and precision can be realized in DOSM-SI. The experiments and theoretical analysis are elaborated to demonstrate the feasibility of DOSM-SI.
Collapse
|
22
|
Macias-Romero C, Teulon C, Didier M, Roke S. Endogenous SHG and 2PEF coherence imaging of substructures in neurons in 3D. OPTICS EXPRESS 2019; 27:2235-2247. [PMID: 30732263 DOI: 10.1364/oe.27.002235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Neuronal morphology, long-distance transport and signalling critically depend on the organization of microtubules in the cytoskeleton. Second harmonic generation (SHG) imaging has been recognized as a potentially powerful tool for in situ label-free neuroimaging with specific sensitivity to microtubules. We study here the structural organization of microtubules in living neurons using a wide-field multiphoton microscope that performs 3D imaging using a structured illumination. This microscope allows label-free high throughput imaging of living mammalian neurons. We show that we can image structural correlations by taking advantage of the structured illumination and the coherence of the emitted light. The result allows us to study the microtubule organization throughout the development of the neuron and to differentiate between the regions of the cytoskeleton in the matured neuron.
Collapse
|
23
|
Dussaux C, Szabo V, Chastagnier Y, Fodor J, Léger JF, Bourdieu L, Perroy J, Ventalon C. Fast confocal fluorescence imaging in freely behaving mice. Sci Rep 2018; 8:16262. [PMID: 30389966 PMCID: PMC6214968 DOI: 10.1038/s41598-018-34472-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2018] [Accepted: 10/12/2018] [Indexed: 12/13/2022] Open
Abstract
Fluorescence imaging in the brain of freely behaving mice is challenging due to severe miniaturization constraints. In particular, the ability to image a large field of view at high temporal resolution and with efficient out-of-focus background rejection still raises technical difficulties. Here, we present a novel fiberscope system that provides fast (up to 200 Hz) background-free fluorescence imaging in freely behaving mice over a field of view of diameter 230 μm. The fiberscope is composed of a custom-made multipoint-scanning confocal microscope coupled to the animal with an image guide and a micro-objective. By simultaneously registering a multipoint-scanning confocal image and a conventional widefield image, we subtracted the residual out-of-focus background and provided a background-free confocal image. Illumination and detection pinholes were created using a digital micromirror device, providing high adaptability to the sample structure and imaging conditions. Using this novel imaging tool, we demonstrated fast fluorescence imaging of microvasculature up to 120 μm deep in the mouse cortex, with an out-of-focus background reduced by two orders of magnitude compared with widefield microscopy. Taking advantage of the high acquisition rate (200 Hz), we measured red blood cell velocity in the cortical microvasculature and showed an increase in awake, unrestrained mice compared with anaesthetized animals.
Collapse
Affiliation(s)
- Clara Dussaux
- Institut de biologie de l'École Normale Supérieure (IBENS), École Normale Supérieure, CNRS, INSERM, PSL Research University, 46 rue d'Ulm, Paris, 75005, France
| | - Vivien Szabo
- IGF, Univ. Montpellier, CNRS, INSERM, 141 rue de la Cardonille, Montpellier, 34094, France
| | - Yan Chastagnier
- IGF, Univ. Montpellier, CNRS, INSERM, 141 rue de la Cardonille, Montpellier, 34094, France
| | - Jozsua Fodor
- Institut de biologie de l'École Normale Supérieure (IBENS), École Normale Supérieure, CNRS, INSERM, PSL Research University, 46 rue d'Ulm, Paris, 75005, France
| | - Jean-François Léger
- Institut de biologie de l'École Normale Supérieure (IBENS), École Normale Supérieure, CNRS, INSERM, PSL Research University, 46 rue d'Ulm, Paris, 75005, France
| | - Laurent Bourdieu
- Institut de biologie de l'École Normale Supérieure (IBENS), École Normale Supérieure, CNRS, INSERM, PSL Research University, 46 rue d'Ulm, Paris, 75005, France
| | - Julie Perroy
- IGF, Univ. Montpellier, CNRS, INSERM, 141 rue de la Cardonille, Montpellier, 34094, France
| | - Cathie Ventalon
- Institut de biologie de l'École Normale Supérieure (IBENS), École Normale Supérieure, CNRS, INSERM, PSL Research University, 46 rue d'Ulm, Paris, 75005, France.
| |
Collapse
|
24
|
Lin WT, Lin CY, Singh VR, Luo Y. Speckle illumination holographic non-scanning fluorescence endoscopy. JOURNAL OF BIOPHOTONICS 2018; 11:e201800010. [PMID: 29920960 PMCID: PMC6466634 DOI: 10.1002/jbio.201800010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2018] [Accepted: 05/24/2018] [Indexed: 05/08/2023]
Abstract
Optical sectioning endoscopy such as confocal endoscopy offers capabilities to obtain three-dimensional (3D) information from various biological samples by discriminating between the desired in-focus signals and out-of-focus background. However, in general confocal images are formed through point-by-point scanning and the scanning time is proportional to the 3D space-bandwidth product. Recently, structured illumination endoscopy has been utilized for optically sectioned wide-field imaging, but it still needs axial scanning to acquire images from different depths of focal plane. Here, we report wide-field, multiplane, optical sectioning endoscopic imaging, incorporating 3D active speckle-based illumination and multiplexed volume holographic gratings, to simultaneously obtain images of fluorescently labeled tissue structures from different depths, without the need of scanning. We present the design, and implementation, as well as experimental data, demonstrating this endoscopic system's ability to obtain optically sectioned multiplane fluorescent images of tissue samples, with cellular level resolution in wide-field fashion, and no need for mechanical or optical axial scanning.(A) Schematic drawing of the SIHN endoscopy to simultaneously acquire multiplane images from different depths. (B) Uniform, and (C) SIHN illuminated images of standard fluorescence beads (25 μm in diameter) for the two axial planes. (D) Intensity profile on fluorescently labeled signal (ie, in-focus) and background (ie, out-of-focus) of microspheres.
Collapse
Affiliation(s)
- Wei-Tang Lin
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
- School of Medicine, National Taiwan University, Taipei, Taiwan
| | - Chen-Yen Lin
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, Taiwan
- Department of Electrical Engineering and Graduate Institute of Photonics and Optoelectronics, National Taiwan University, Taipei, Taiwan
| | - Vijay Raj Singh
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts
| | - Yuan Luo
- School of Medicine, National Taiwan University, Taipei, Taiwan
- Molecular Imaging Center, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
25
|
Lal A, Shan C, Zhao K, Liu W, Huang X, Zong W, Chen L, Xi P. A frequency domain SIM reconstruction algorithm using reduced number of images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 27:4555-4570. [PMID: 29993579 DOI: 10.1109/tip.2018.2842149] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Conventional two-dimensional structured illumination microscopy (SIM) requires 9 raw images to reconstruct a super-resolved image. In order to increase the frame rate of 2DSIM, attempts are being made to reduce the number of raw SIM images. However, all the proposed SIM reconstruction algorithms (SIM-RA) capable of reconstructing super-resolution (SR) image with a reduced number of raw SIM images operate in the spatial domain. Here, we present a frequency domain SIM-RA based on ordinary least squares technique, which enables reconstruction of SR image using 4 raw SIM images. Unlike the spatial domain RA, which produces the SR image through iterative convergence, the presented RA provides a single step solution. It also reveals the fundamental limitation of least number of raw images required for resolution doubling in SIM.
Collapse
|
26
|
Zhang Y, Suo J, Wang Y, Dai Q. Doubling the pixel count limitation of single-pixel imaging via sinusoidal amplitude modulation. OPTICS EXPRESS 2018; 26:6929-6942. [PMID: 29609379 DOI: 10.1364/oe.26.006929] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2018] [Accepted: 02/20/2018] [Indexed: 06/08/2023]
Abstract
We demonstrate a single-pixel imaging (SPI) method that can achieve pixel resolution beyond the physical limitation of the spatial light modulator (SLM), by adopting sinusoidal amplitude modulation and frequency filtering. Through light field analysis, we observe that the induced intensity with a squared value of the amplitude contains higher frequency components. By filtering out the zero frequency of the sinusoidal amplitude in the Fourier domain, we can separate out the higher frequency components, which enables SPI with higher resolving ability and thus beyond the limitation of the SLM. Further, to address the speed issue in grayscale spatial light modulation, we propose a fast implementation scheme with tens-of-kilohertz refresh rate. Specifically, we use a digital micromirror device (DMD) working at the full frame rate to conduct binarized sinusoidal patterning in the spatial domain and pinhole filtering eliminating the binarization error in the Fourier domain. For experimental validation, we build a single-pixel microscope to retrieve 1200 × 1200-pixel images via a sub-megapixel DMD, and the setup achieves comparable performance to array sensor microscopy and provides additional sectioning ability.
Collapse
|
27
|
Chang CY, Lin CH, Lin CY, Sie YD, Hu YY, Tsai SF, Chen SJ. Temporal focusing-based widefield multiphoton microscopy with spatially modulated illumination for biotissue imaging. JOURNAL OF BIOPHOTONICS 2018; 11:e201600287. [PMID: 28464488 DOI: 10.1002/jbio.201600287] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2016] [Revised: 01/29/2017] [Accepted: 03/14/2017] [Indexed: 06/07/2023]
Abstract
A developed temporal focusing-based multiphoton excitation microscope (TFMPEM) has a digital micromirror device (DMD) which is adopted not only as a blazed grating for light spatial dispersion but also for patterned illumination simultaneously. Herein, the TFMPEM has been extended to implement spatially modulated illumination at structured frequency and orientation to increase the beam coverage at the back-focal aperture of the objective lens. The axial excitation confinement (AEC) of TFMPEM can be condensed from 3.0 μm to 1.5 μm for a 50 % improvement. By using the TFMPEM with HiLo technique as two structured illuminations at the same spatial frequency but different orientation, reconstructed biotissue images according to the condensed AEC structured illumination are shown obviously superior in contrast and better scattering suppression. Picture: TPEF images of the eosin-stained mouse cerebellar cortex by conventional TFMPEM (left), and the TFMPEM with HiLo technique as 1.09 μm-1 spatially modulated illumination at 90° (center) and 0° (right) orientations.
Collapse
Affiliation(s)
- Chia-Yuan Chang
- Center for Micro/Nano Science and Technology, National Cheng Kung University, 701, Tainan, Taiwan
- Department of Engineering Science, National Cheng Kung University, 701, Tainan, Taiwan
| | - Cheng-Han Lin
- Department of Engineering Science, National Cheng Kung University, 701, Tainan, Taiwan
| | - Chun-Yu Lin
- Advanced Optoelectronic Technology Center, National Cheng Kung University, 701, Tainan, Taiwan
| | - Yong-Da Sie
- Department of Engineering Science, National Cheng Kung University, 701, Tainan, Taiwan
| | - Yvonne Yuling Hu
- Department of Photonics, National Cheng Kung University, 701, Tainan, Taiwan
| | - Sheng-Feng Tsai
- Institute of Basic Medical Sciences, National Cheng Kung University, 701, Tainan, Taiwan
| | - Shean-Jen Chen
- Advanced Optoelectronic Technology Center, National Cheng Kung University, 701, Tainan, Taiwan
- College of Photonics, National Chiao Tung University, 711 Tainan, Taiwan
| |
Collapse
|
28
|
Pant S, Duan Y, Xiong F, Chen N. Augmented line-scan focal modulation microscopy for multi-dimensional imaging of zebrafish heart in vivo. BIOMEDICAL OPTICS EXPRESS 2017; 8:5698-5707. [PMID: 29296498 PMCID: PMC5745113 DOI: 10.1364/boe.8.005698] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2017] [Revised: 11/14/2017] [Accepted: 11/15/2017] [Indexed: 05/18/2023]
Abstract
Multi-dimensional fluorescence imaging of live animal models demands strong optical sectioning, high spatial resolution, fast image acquisition, and minimal photobleaching. While conventional laser scanning microscopes are capable of deep penetration and sub-cellular resolution, they are generally too slow and causing excessive photobleaching for volumetric or time-lapse imaging. We demonstrate the performance of an augmented line-scan focal modulation microscope (aLSFMM), a high-speed imaging platform that affords above video-rate imaging speed by the use of line scanning. Exceptional background rejection is accomplished by combining a confocal slit with focal modulation. The image quality is further improved by merging the information from simultaneously acquired focal modulation and confocal images. Such a hybrid imaging scheme makes it possible to use very low power excitation light in high-speed imaging, and therefore leads to reduced photobleaching that is desirable for three-dimensional (3D) and four-dimensional (4D) in vivo image acquisition.
Collapse
|
29
|
Macias-Romero C, Nahalka I, Okur HI, Roke S. Optical imaging of surface chemistry and dynamics in confinement. Science 2017; 357:784-788. [PMID: 28729352 DOI: 10.1126/science.aal4346] [Citation(s) in RCA: 69] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2016] [Revised: 04/05/2017] [Accepted: 06/30/2017] [Indexed: 12/23/2022]
Abstract
We imaged the interfacial structure and dynamics of water in a microscopically confined geometry, in three dimensions and on millisecond time scales, with a structurally illuminated wide-field second harmonic microscope. The second harmonic images reported on the orientational order of interfacial water, induced by charge-dipole interactions between water molecules and surface charges. The images were converted into surface potential maps. Spatially resolved surface acid dissociation constant (pKa,s) values were determined for the silica deprotonation reaction by following pH-induced chemical changes on the curved and confined surfaces of a glass microcapillary immersed in aqueous solutions. These values ranged from 2.3 to 10.7 along the wall of a single capillary because of surface heterogeneities. Water molecules that rotate along an oscillating external electric field were also imaged.
Collapse
Affiliation(s)
- Carlos Macias-Romero
- Laboratory for Fundamental BioPhotonics, Institute of Bioengineering, and Institute of Materials Science, School of Engineering, and Lausanne Centre for Ultrafast Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Igor Nahalka
- Laboratory for Fundamental BioPhotonics, Institute of Bioengineering, and Institute of Materials Science, School of Engineering, and Lausanne Centre for Ultrafast Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Halil I Okur
- Laboratory for Fundamental BioPhotonics, Institute of Bioengineering, and Institute of Materials Science, School of Engineering, and Lausanne Centre for Ultrafast Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
| | - Sylvie Roke
- Laboratory for Fundamental BioPhotonics, Institute of Bioengineering, and Institute of Materials Science, School of Engineering, and Lausanne Centre for Ultrafast Science, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland.
| |
Collapse
|
30
|
Sawyer TW, Petersburg R, Bohndiek SE. Tolerancing the alignment of large-core optical fibers, fiber bundles and light guides using a Fourier approach. APPLIED OPTICS 2017; 56:3303-3310. [PMID: 28430250 PMCID: PMC5405873 DOI: 10.1364/ao.56.003303] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2016] [Accepted: 03/18/2017] [Indexed: 06/07/2023]
Abstract
Optical fiber technology is found in a wide variety of applications to flexibly relay light between two points, enabling information transfer across long distances and allowing access to hard-to-reach areas. Large-core optical fibers and light guides find frequent use in illumination and spectroscopic applications, for example, endoscopy and high-resolution astronomical spectroscopy. Proper alignment is critical for maximizing throughput in optical fiber coupling systems; however, there currently are no formal approaches to tolerancing the alignment of a light-guide coupling system. Here, we propose a Fourier alignment sensitivity (FAS) algorithm to determine the optimal tolerances on the alignment of a light guide by computing the alignment sensitivity. The algorithm shows excellent agreement with both simulated and experimentally measured values and improves on the computation time of equivalent ray-tracing simulations by two orders of magnitude. We then apply FAS to tolerance and fabricate a coupling system, which is shown to meet specifications, thus validating FAS as a tolerancing technique. These results indicate that FAS is a flexible and rapid means to quantify the alignment sensitivity of a light guide, widely informing the design and tolerancing of coupling systems.
Collapse
Affiliation(s)
- Travis W. Sawyer
- Department of Physics, University of Cambridge, Cambridge, United
Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge,
Cambridge, United Kingdom
| | - Ryan Petersburg
- Department of Physics, Yale University, New Haven, CT, 06511
| | - Sarah E. Bohndiek
- Department of Physics, University of Cambridge, Cambridge, United
Kingdom
- Cancer Research UK Cambridge Institute, University of Cambridge,
Cambridge, United Kingdom
| |
Collapse
|
31
|
Lin CY, Lin WH, Chien JH, Tsai JC, Luo Y. In vivo volumetric fluorescence sectioning microscopy with mechanical-scan-free hybrid illumination imaging. BIOMEDICAL OPTICS EXPRESS 2016; 7:3968-3978. [PMID: 27867708 PMCID: PMC5102523 DOI: 10.1364/boe.7.003968] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2016] [Revised: 08/20/2016] [Accepted: 08/20/2016] [Indexed: 05/26/2023]
Abstract
Optical sectioning microscopy in wide-field fashion has been widely used to obtain three-dimensional images of biological samples; however, it requires scanning in depth and considerable time to acquire multiple depth information of a volumetric sample. In this paper, in vivo optical sectioning microscopy with volumetric hybrid illumination, with no mechanical moving parts, is presented. The proposed system is configured such that the optical sectioning is provided by hybrid illumination using a digital micro-mirror device (DMD) for uniform and non-uniform pattern projection, while the depth of imaging planes is varied by using an electrically tunable-focus lens with invariant magnification and resolution. We present and characterize the design, implementation, and experimentally demonstrate the proposed system's ability through 3D imaging of in vivo Canenorhabditis elegans' growth cones.
Collapse
Affiliation(s)
- Chen-Yen Lin
- Department of Electrical Engineering and Graduate Institute of Photonics and Optoelectronics, National Taiwan University, Taipei 10617, Taiwan
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan
| | - Wei-Hsin Lin
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan
- School of Medicine, National Taiwan University, Taipei, 10051, Taiwan
| | - Ju-Hsuan Chien
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan
| | - Jui-Chang Tsai
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan
| | - Yuan Luo
- Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan
- Molecular Imaging Center, National Taiwan University, Taipei 10055, Taiwan
| |
Collapse
|
32
|
Ba C, Palmiere M, Ritt J, Mertz J. Dual-modality endomicroscopy with co-registered fluorescence and phase contrast. BIOMEDICAL OPTICS EXPRESS 2016; 7:3403-3411. [PMID: 27699107 PMCID: PMC5030019 DOI: 10.1364/boe.7.003403] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2016] [Revised: 08/08/2016] [Accepted: 08/08/2016] [Indexed: 05/09/2023]
Abstract
We describe a dual-modality laser scanning endomicroscope that provides simultaneous fluorescence contrast based on confocal laser endomicroscopy (CLE) and phase-gradient contrast based on scanning oblique back-scattering microscopy (sOBM). The probe consists of a 2.6mm-diameter micro-objective attached to a 30,000-core flexible fiber bundle. The dual contrasts are inherently co-registered, providing complementary information on labeled and un-labeled sample structure. Proof of principle demonstrations are presented with ex-vivo mouse colon tissue.
Collapse
|
33
|
Pedrazzani M, Loriette V, Tchenio P, Benrezzak S, Nutarelli D, Fragola A. Sensorless adaptive optics implementation in widefield optical sectioning microscopy inside in vivo Drosophila brain. JOURNAL OF BIOMEDICAL OPTICS 2016; 21:36006. [PMID: 26968001 DOI: 10.1117/1.jbo.21.3.036006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2015] [Accepted: 02/11/2016] [Indexed: 06/05/2023]
Abstract
We present an implementation of a sensorless adaptive optics loop in a widefield fluorescence microscope. This setup is designed to compensate for aberrations induced by the sample on both excitation and emission pathways. It allows fast optical sectioning inside a living Drosophila brain. We present a detailed characterization of the system performances. We prove that the gain brought to optical sectioning by realizing structured illumination microscopy with adaptive optics down to 50 μm deep inside living Drosophila brain.
Collapse
Affiliation(s)
- Mélanie Pedrazzani
- Université Paris-Saclay, Laboratoire Aimé Cotton, CNRS, Université Paris-Sud, ENS Cachan, Orsay Cedex 91405, France
| | - Vincent Loriette
- CNRS, Laboratoire de Physique et d'Étude des Matériaux, ESPCI, 10 Rue Vauquelin, Paris 75005, France
| | - Paul Tchenio
- Université Paris-Saclay, Laboratoire Aimé Cotton, CNRS, Université Paris-Sud, ENS Cachan, Orsay Cedex 91405, FrancecCNRS, Gènes et Dynamiques des Systèmes de Mémoire, Unité de Neurobiologie, ESPCI, 10 Rue Vauquelin, Paris 75005, France
| | - Sakina Benrezzak
- Université Paris-Saclay, Laboratoire Aimé Cotton, CNRS, Université Paris-Sud, ENS Cachan, Orsay Cedex 91405, France
| | - Daniele Nutarelli
- Université Paris-Saclay, Laboratoire Aimé Cotton, CNRS, Université Paris-Sud, ENS Cachan, Orsay Cedex 91405, France
| | - Alexandra Fragola
- CNRS, Laboratoire de Physique et d'Étude des Matériaux, ESPCI, 10 Rue Vauquelin, Paris 75005, France
| |
Collapse
|
34
|
Lauterbach MA, Ronzitti E, Sternberg JR, Wyart C, Emiliani V. Fast Calcium Imaging with Optical Sectioning via HiLo Microscopy. PLoS One 2015; 10:e0143681. [PMID: 26625116 PMCID: PMC4666667 DOI: 10.1371/journal.pone.0143681] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2015] [Accepted: 11/09/2015] [Indexed: 11/18/2022] Open
Abstract
Imaging intracellular calcium concentration via reporters that change their fluorescence properties upon binding of calcium, referred to as calcium imaging, has revolutionized our way to probe neuronal activity non-invasively. To reach neurons densely located deep in the tissue, optical sectioning at high rate of acquisition is necessary but difficult to achieve in a cost effective manner. Here we implement an accessible solution relying on HiLo microscopy to provide robust optical sectioning with a high frame rate in vivo. We show that large calcium signals can be recorded from dense neuronal populations at high acquisition rates. We quantify the optical sectioning capabilities and demonstrate the benefits of HiLo microscopy compared to wide-field microscopy for calcium imaging and 3D reconstruction. We apply HiLo microscopy to functional calcium imaging at 100 frames per second deep in biological tissues. This approach enables us to discriminate neuronal activity of motor neurons from different depths in the spinal cord of zebrafish embryos. We observe distinct time courses of calcium signals in somata and axons. We show that our method enables to remove large fluctuations of the background fluorescence. All together our setup can be implemented to provide efficient optical sectioning in vivo at low cost on a wide range of existing microscopes.
Collapse
Affiliation(s)
- Marcel A. Lauterbach
- Wavefront-Engineering Microscopy Group, Neurophotonics Laboratory, CNRS UMR8250, University Paris Descartes, Sorbonne Paris Cité, Paris, France
| | - Emiliano Ronzitti
- Wavefront-Engineering Microscopy Group, Neurophotonics Laboratory, CNRS UMR8250, University Paris Descartes, Sorbonne Paris Cité, Paris, France
| | - Jenna R. Sternberg
- Institut du Cerveau et de la Moelle Epinière (ICM), INSERM U1127, CNRS UMR 7225, Sorbonne Paris Cité, University Pierre et Marie Curie Paris 06 UMR S 1127, Paris, France
| | - Claire Wyart
- Institut du Cerveau et de la Moelle Epinière (ICM), INSERM U1127, CNRS UMR 7225, Sorbonne Paris Cité, University Pierre et Marie Curie Paris 06 UMR S 1127, Paris, France
| | - Valentina Emiliani
- Wavefront-Engineering Microscopy Group, Neurophotonics Laboratory, CNRS UMR8250, University Paris Descartes, Sorbonne Paris Cité, Paris, France
- * E-mail:
| |
Collapse
|
35
|
Full-color structured illumination optical sectioning microscopy. Sci Rep 2015; 5:14513. [PMID: 26415516 PMCID: PMC4586488 DOI: 10.1038/srep14513] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2015] [Accepted: 09/02/2015] [Indexed: 11/17/2022] Open
Abstract
In merits of super-resolved resolution and fast speed of three-dimensional (3D) optical sectioning capability, structured illumination microscopy (SIM) has found variety of applications in biomedical imaging. So far, most SIM systems use monochrome CCD or CMOS cameras to acquire images and discard the natural color information of the specimens. Although multicolor integration scheme are employed, multiple excitation sources and detectors are required and the spectral information is limited to a few of wavelengths. Here, we report a new method for full-color SIM with a color digital camera. A data processing algorithm based on HSV (Hue, Saturation, and Value) color space is proposed, in which the recorded color raw images are processed in the Hue, Saturation, Value color channels, and then reconstructed to a 3D image with full color. We demonstrated some 3D optical sectioning results on samples such as mixed pollen grains, insects, micro-chips and the surface of coins. The presented technique is applicable to some circumstance where color information plays crucial roles, such as in materials science and surface morphology.
Collapse
|
36
|
Zhou X, Bedggood P, Bui B, Nguyen CT, He Z, Metha A. Contrast-based sensorless adaptive optics for retinal imaging. BIOMEDICAL OPTICS EXPRESS 2015; 6:3577-95. [PMID: 26417525 PMCID: PMC4574681 DOI: 10.1364/boe.6.003577] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2015] [Revised: 08/13/2015] [Accepted: 08/18/2015] [Indexed: 05/05/2023]
Abstract
Conventional adaptive optics ophthalmoscopes use wavefront sensing methods to characterize ocular aberrations for real-time correction. However, there are important situations in which the wavefront sensing step is susceptible to difficulties that affect the accuracy of the correction. To circumvent these, wavefront sensorless adaptive optics (or non-wavefront sensing AO; NS-AO) imaging has recently been developed and has been applied to point-scanning based retinal imaging modalities. In this study we show, for the first time, contrast-based NS-AO ophthalmoscopy for full-frame in vivo imaging of human and animal eyes. We suggest a robust image quality metric that could be used for any imaging modality, and test its performance against other metrics using (physical) model eyes.
Collapse
|
37
|
Hughes M, Yang GZ. High speed, line-scanning, fiber bundle fluorescence confocal endomicroscopy for improved mosaicking. BIOMEDICAL OPTICS EXPRESS 2015; 6:1241-52. [PMID: 25909008 PMCID: PMC4399663 DOI: 10.1364/boe.6.001241] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2014] [Revised: 01/12/2015] [Accepted: 01/12/2015] [Indexed: 05/09/2023]
Abstract
A significant limitation of fiber bundle endomicroscopy systems is that the field of view tends to be small, usually only several hundred micrometers in diameter. Image mosaicking techniques can increase the effective image size, but require careful manipulation of the probe to ensure sufficient overlap between adjacent frames. For confocal endomicroscopes, which typically have frame rates on the order of 10 fps, this is particularly challenging. In this paper we demonstrate that line-scanning confocal endomicroscopy can, by use of a high speed linear CCD camera, achieve a frame rate of 120 fps while maintaining sufficient resolution and signal-to-noise ratio to allow imaging of topically stained gastrointestinal tissues. This leads to improved performance of a cross-correlation based mosaicking algorithm when compared with lower frame-rate systems.
Collapse
|
38
|
Double-exposure optical sectioning structured illumination microscopy based on Hilbert transform reconstruction. PLoS One 2015; 10:e0120892. [PMID: 25799234 PMCID: PMC4370656 DOI: 10.1371/journal.pone.0120892] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2014] [Accepted: 01/27/2015] [Indexed: 11/18/2022] Open
Abstract
Structured illumination microscopy (SIM) with axially optical sectioning capability has found widespread applications in three-dimensional live cell imaging in recent years, since it combines high sensitivity, short image acquisition time, and high spatial resolution. To obtain one sectioned slice, three raw images with a fixed phase-shift, normally 2π/3, are generally required. In this paper, we report a data processing algorithm based on the one-dimensional Hilbert transform, which needs only two raw images with arbitrary phase-shift for each single slice. The proposed algorithm is different from the previous two-dimensional Hilbert spiral transform algorithm in theory. The presented algorithm has the advantages of simpler data processing procedure, faster computation speed and better reconstructed image quality. The validity of the scheme is verified by imaging biological samples in our developed DMD-based LED-illumination SIM system.
Collapse
|
39
|
Luo Y, Singh VR, Bhattacharya D, Yew EYS, Tsai JC, Yu SL, Chen HH, Wong JM, Matsudaira P, So PTC, Barbastathis G. Talbot holographic illumination nonscanning (THIN) fluorescence microscopy. LASER & PHOTONICS REVIEWS 2014; 8:L71-L75. [PMID: 25678936 PMCID: PMC4321697 DOI: 10.1002/lpor.201400053] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Optical sectioning techniques offer the ability to acquire three-dimensional information from various organ tissues by discriminating between the desired in-focus and out-of-focus (background) signals. Alternative techniques to confocal, such as active structured illumination, exist for fast optically sectioned images, but they require individual axial planes to be imaged consecutively. In this article, an imaging technique (THIN), by utilizing active Talbot illumination in 3D and multiplexed holographic Bragg filters for depth discrimination, is demonstrated for imaging in vivo 3D biopsy without mechanical or optical axial scanning.
Collapse
Affiliation(s)
- Yuan Luo
- Center for Optoelectronic Biomedicine, College of Medicine, National Taiwan University, Taipei, 10051, Taiwan R.O.C
- Molecular Imaging Center, National Taiwan University, Taipei, 10055, Taiwan R.O.C
- Corresponding authors: ;
| | - Vijay Raj Singh
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Corresponding authors: ;
| | - Dipanjan Bhattacharya
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Centre for BioImaging Science (CBIS), Blk S1A, Level 2, National University of Singapore, 14 Science Drive 4, 117546, Singapore
- MechanoBiology Institute (MBI), National University of Singapore, 117411, Singapore
| | - Elijah Y. S. Yew
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA
| | - Jui-Chang Tsai
- Center for Optoelectronic Biomedicine, College of Medicine, National Taiwan University, Taipei, 10051, Taiwan R.O.C
| | - Sung-Liang Yu
- Department of Clinical Laboratory Sciences and Medical Biotechnology, College of Medicine, National Taiwan University, Taipei, 10055, Taiwan R.O.C
| | - Hsi-Hsun Chen
- Center for Optoelectronic Biomedicine, College of Medicine, National Taiwan University, Taipei, 10051, Taiwan R.O.C
- Molecular Imaging Center, National Taiwan University, Taipei, 10055, Taiwan R.O.C
| | - Jau-Min Wong
- Department of Internal Medicine, National Taiwan University Hospital, Taipei, 10048, Taiwan, R.O.C
| | - Paul Matsudaira
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Centre for BioImaging Science (CBIS), Blk S1A, Level 2, National University of Singapore, 14 Science Drive 4, 117546, Singapore
- MechanoBiology Institute (MBI), National University of Singapore, 117411, Singapore
| | - Peter T. C. So
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA
- Department of Biomedical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA
| | - George Barbastathis
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 CREATE Way, #10-01 CREATE Tower, 138602, Singapore
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, 02139, USA
| |
Collapse
|
40
|
Zhou X, Bedggood P, Metha A. Improving high resolution retinal image quality using speckle illumination HiLo imaging. BIOMEDICAL OPTICS EXPRESS 2014; 5:2563-79. [PMID: 25136486 PMCID: PMC4132989 DOI: 10.1364/boe.5.002563] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/05/2014] [Revised: 06/30/2014] [Accepted: 06/30/2014] [Indexed: 05/15/2023]
Abstract
Retinal image quality from flood illumination adaptive optics (AO) ophthalmoscopes is adversely affected by out-of-focus light scatter due to the lack of confocality. This effect is more pronounced in small eyes, such as that of rodents, because the requisite high optical power confers a large dioptric thickness to the retina. A recently-developed structured illumination microscopy (SIM) technique called HiLo imaging has been shown to reduce the effect of out-of-focus light scatter in flood illumination microscopes and produce pseudo-confocal images with significantly improved image quality. In this work, we adopted the HiLo technique to a flood AO ophthalmoscope and performed AO imaging in both (physical) model and live rat eyes. The improvement in image quality from HiLo imaging is shown both qualitatively and quantitatively by using spatial spectral analysis.
Collapse
|
41
|
Patorski K, Trusiak M, Tkaczyk T. Optically-sectioned two-shot structured illumination microscopy with Hilbert-Huang processing. OPTICS EXPRESS 2014; 22:9517-27. [PMID: 24787840 PMCID: PMC4083048 DOI: 10.1364/oe.22.009517] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
We introduce a fast, simple, adaptive and experimentally robust method for reconstructing background-rejected optically-sectioned images using two-shot structured illumination microscopy. Our innovative data demodulation method needs two grid-illumination images mutually phase shifted by π (half a grid period) but precise phase displacement between two frames is not required. Upon frames subtraction the input pattern with increased grid modulation is obtained. The first demodulation stage comprises two-dimensional data processing based on the empirical mode decomposition for the object spatial frequency selection (noise reduction and bias term removal). The second stage consists in calculating high contrast image using the two-dimensional spiral Hilbert transform. Our algorithm effectiveness is compared with the results calculated for the same input data using structured-illumination (SIM) and HiLo microscopy methods. The input data were collected for studying highly scattering tissue samples in reflectance mode. Results of our approach compare very favorably with SIM and HiLo techniques.
Collapse
Affiliation(s)
- Krzysztof Patorski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Maciej Trusiak
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Tomasz Tkaczyk
- Rice University, Department of Bioengineering, 6100 Main Street, Houston, TX 77005-1892, USA
| |
Collapse
|
42
|
Kyrish M, Dobbs J, Jain S, Wang X, Yu D, Richards-Kortum R, Tkaczyk TS. Needle-based fluorescence endomicroscopy via structured illumination with a plastic, achromatic objective. JOURNAL OF BIOMEDICAL OPTICS 2013; 18:096003. [PMID: 24002190 PMCID: PMC3759804 DOI: 10.1117/1.jbo.18.9.096003] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2013] [Revised: 07/19/2013] [Accepted: 07/31/2013] [Indexed: 05/18/2023]
Abstract
In order to diagnose cancer, a sample must be removed, prepared, and examined under a microscope, which is expensive, invasive, and time consuming. Fiber optic fluorescence endomicroscopy, where an image guide is used to obtain high-resolution images of tissue in vivo, has shown promise as an alternative to conventional biopsies. However, the resolution of standard endomicroscopy is limited by the fiber bundle sampling frequency and out-of-focus light. A system is presented which incorporates a plastic, achromatic objective to increase the sampling and which provides optical sectioning via structured illumination to reject background light. An image is relayed from the sample by a fiber bundle with the custom 2.1-mm outer diameter objective lens integrated to the distal tip. The objective is corrected for the excitation and the emission wavelengths of proflavine (452 and 515 nm). It magnifies the object onto the fiber bundle to improve the system's lateral resolution by increasing the sampling. The plastic lenses were fabricated via single-point diamond turning and assembled using a zero alignment technique. Ex vivo images of normal and neoplastic murine mammary tissues stained with proflavine are captured. The system achieves higher contrast and resolves smaller features than standard fluorescence endomicroscopy.
Collapse
Affiliation(s)
- Matthew Kyrish
- Rice University, Department of Bioengineering, 6100 Main Street, Houston, Texas 77005
| | - Jessica Dobbs
- Rice University, Department of Bioengineering, 6100 Main Street, Houston, Texas 77005
| | - Shalini Jain
- MD Anderson Cancer Center, Department of Molecular and Cellular Oncology, 1515 Holcombe Boulevard, Box 108, Houston, Texas 77030
| | - Xiao Wang
- MD Anderson Cancer Center, Department of Molecular and Cellular Oncology, 1515 Holcombe Boulevard, Box 108, Houston, Texas 77030
| | - Dihua Yu
- MD Anderson Cancer Center, Department of Molecular and Cellular Oncology, 1515 Holcombe Boulevard, Box 108, Houston, Texas 77030
| | | | - Tomasz S. Tkaczyk
- Rice University, Department of Bioengineering, 6100 Main Street, Houston, Texas 77005
- Address all correspondence to: Tomasz S. Tkaczyk, Rice University, Department of Bioengineering, 6100 Main Street, Houston, Texas 77005. Tel: 713-348-4362; Fax: 713-348-5877; E-mail:
| |
Collapse
|
43
|
Fu HL, Mueller JL, Javid MP, Mito JK, Kirsch DG, Ramanujam N, Brown JQ. Optimization of a widefield structured illumination microscope for non-destructive assessment and quantification of nuclear features in tumor margins of a primary mouse model of sarcoma. PLoS One 2013; 8:e68868. [PMID: 23894357 PMCID: PMC3720887 DOI: 10.1371/journal.pone.0068868] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2013] [Accepted: 06/02/2013] [Indexed: 11/25/2022] Open
Abstract
Cancer is associated with specific cellular morphological changes, such as increased nuclear size and crowding from rapidly proliferating cells. In situ tissue imaging using fluorescent stains may be useful for intraoperative detection of residual cancer in surgical tumor margins. We developed a widefield fluorescence structured illumination microscope (SIM) system with a single-shot FOV of 2.1×1.6 mm (3.4 mm2) and sub-cellular resolution (4.4 µm). The objectives of this work were to measure the relationship between illumination pattern frequency and optical sectioning strength and signal-to-noise ratio in turbid (i.e. thick) samples for selection of the optimum frequency, and to determine feasibility for detecting residual cancer on tumor resection margins, using a genetically engineered primary mouse model of sarcoma. The SIM system was tested in tissue mimicking solid phantoms with various scattering levels to determine impact of both turbidity and illumination frequency on two SIM metrics, optical section thickness and modulation depth. To demonstrate preclinical feasibility, ex vivo 50 µm frozen sections and fresh intact thick tissue samples excised from a primary mouse model of sarcoma were stained with acridine orange, which stains cell nuclei, skeletal muscle, and collagenous stroma. The cell nuclei were segmented using a high-pass filter algorithm, which allowed quantification of nuclear density. The results showed that the optimal illumination frequency was 31.7 µm−1 used in conjunction with a 4×0.1 NA objective ( = 0.165). This yielded an optical section thickness of 128 µm and an 8.9×contrast enhancement over uniform illumination. We successfully demonstrated the ability to resolve cell nuclei in situ achieved via SIM, which allowed segmentation of nuclei from heterogeneous tissues in the presence of considerable background fluorescence. Specifically, we demonstrate that optical sectioning of fresh intact thick tissues performed equivalently in regards to nuclear density quantification, to physical frozen sectioning and standard microscopy.
Collapse
Affiliation(s)
- Henry L Fu
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA.
| | | | | | | | | | | | | |
Collapse
|
44
|
Zhang H, Yuan J, Fu L. Imaging Fourier transform endospectroscopy for in vivo and in situ multispectral imaging. OPTICS EXPRESS 2012. [PMID: 23188298 DOI: 10.1364/oe.20.023349] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
We report the design and implementation of a multispectral imaging Fourier transform endospectroscopy (IFTES) system. The IFTES system employs a flexible fiber bundle catheter coupled to a home-built imaging Fourier transform spectroscope. The instrument enables the performance of non- or minimally invasive subsurface imaging and multispectral imaging at the cellular level in vivo and in situ. A maximum spectral resolution of 0.2 nm at 632.8 nm and a lateral resolution of 4.4 μm were proved. Preliminary results of a standard resolution target, ex-vivo small animal tissue, single wavelength laser, fluorescence solution, in-vivo mouse skin, microspheres mixture, and in-vivo transgenic mouse brain were given to demonstrate the potential of the technique.
Collapse
Affiliation(s)
- Hongming Zhang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, 1037 Luoyu Rd., Wuhan 430074, China
| | | | | |
Collapse
|
45
|
Michaelson J, Choi H, So P, Huang H. Depth-resolved cellular microrheology using HiLo microscopy. BIOMEDICAL OPTICS EXPRESS 2012; 3:1241-55. [PMID: 22741071 PMCID: PMC3370965 DOI: 10.1364/boe.3.001241] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2012] [Revised: 04/25/2012] [Accepted: 04/29/2012] [Indexed: 05/04/2023]
Abstract
It is increasingly important to measure cell mechanical properties in three-dimensional environments. Particle tracking microrheology (PTM) can measure cellular viscoelastic properties; however, out-of-plane data can introduce artifacts into these measurements. We developed a technique that employs HiLo microscopy to reduce out-of-plane contributions. This method eliminated signals from 90% of probes 0.5 μm or further from the focal plane, while retaining all in-plane probes. We used this technique to characterize live-cell bilayers and found that there were significant, frequency-dependent changes to the extracted cell moduli when compared to conventional analysis. Our results indicate that removal of out-of-plane information is vital for accurate assessments of cell mechanical properties.
Collapse
Affiliation(s)
- Jarett Michaelson
- Biomedical Engineering, 351 Engineering Terrace, 500 W 120th Street, Columbia University, New York, USA
| | - Heejin Choi
- Mechanical Engineering, 77 Massachusetts Ave., Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Peter So
- Mechanical Engineering, 77 Massachusetts Ave., Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Biological Engineering, 77 Massachusetts Ave., Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Hayden Huang
- Biomedical Engineering, 351 Engineering Terrace, 500 W 120th Street, Columbia University, New York, USA
| |
Collapse
|
46
|
Ford TN, Lim D, Mertz J. Fast optically sectioned fluorescence HiLo endomicroscopy. JOURNAL OF BIOMEDICAL OPTICS 2012; 17:021105. [PMID: 22463023 PMCID: PMC3382350 DOI: 10.1117/1.jbo.17.2.021105] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2011] [Revised: 11/04/2011] [Accepted: 11/07/2011] [Indexed: 05/19/2023]
Abstract
We describe a nonscanning, fiber bundle endomicroscope that performs optically sectioned fluorescence imaging with fast frame rates and real-time processing. Our sectioning technique is based on HiLo imaging, wherein two widefield images are acquired under uniform and structured illumination and numerically processed to reject out-of-focus background. This work is an improvement upon an earlier demonstration of widefield optical sectioning through a flexible fiber bundle. The improved device features lateral and axial resolutions of 2.6 and 17 μm, respectively, a net frame rate of 9.5 Hz obtained by real-time image processing with a graphics processing unit (GPU) and significantly reduced motion artifacts obtained by the use of a double-shutter camera. We demonstrate the performance of our system with optically sectioned images and videos of a fluorescently labeled chorioallantoic membrane (CAM) in the developing G. gallus embryo. HiLo endomicroscopy is a candidate technique for low-cost, high-speed clinical optical biopsies.
Collapse
Affiliation(s)
- Tim N Ford
- Boston University, Department of Biomedical Engineering, Boston, Massachusetts 02215, USA.
| | | | | |
Collapse
|
47
|
|
48
|
Muro E, Vermeulen P, Ioannou A, Skourides P, Dubertret B, Fragola A, Loriette V. Single-shot optical sectioning using two-color probes in HiLo fluorescence microscopy. Biophys J 2011; 100:2810-9. [PMID: 21641327 DOI: 10.1016/j.bpj.2011.03.047] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2010] [Revised: 03/30/2011] [Accepted: 03/30/2011] [Indexed: 10/18/2022] Open
Abstract
We describe a wide-field fluorescence microscope setup which combines HiLo microscopy technique with the use of a two-color fluorescent probe. It allows one-shot fluorescence optical sectioning of thick biological moving sample which is illuminated simultaneously with a flat and a structured pattern at two different wavelengths. Both homogenous and structured fluorescence images are spectrally separated at detection and combined similarly with the HiLo microscopy technique. We present optically sectioned full-field images of Xenopus laevis embryos acquired at 25 images/s frame rate.
Collapse
Affiliation(s)
- Eleonora Muro
- Laboratoire de Physique et d'Étude des Matériaux, Centre National de la Recherche Scientifique, UMR 8213, École Supérieure de Physique et de Chimie Industrielles, Paris, France
| | | | | | | | | | | | | |
Collapse
|
49
|
Mazzaferri J, Kunik D, Belisle JM, Singh K, Lefrançois S, Costantino S. Analyzing speckle contrast for HiLo microscopy optimization. OPTICS EXPRESS 2011; 19:14508-14517. [PMID: 21934814 DOI: 10.1364/oe.19.014508] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
HiLo microscopy is a recently developed technique that provides both optical sectioning and fast imaging with a simple implementation and at a very low cost. The methodology combines widefield and speckled illumination images to obtain one optically sectioned image. Hence, the characteristics of such speckle illumination ultimately determine the quality of HiLo images and the overall performance of the method. In this work, we study how speckle contrast influence local variations of fluorescence intensity and brightness profiles of thick samples. We present this article as a guide to adjust the parameters of the system for optimizing the capabilities of this novel technology.
Collapse
Affiliation(s)
- J Mazzaferri
- Centre de Recherche de l’Hôpital Maisonneuve-Rosemont, Canada
| | | | | | | | | | | |
Collapse
|
50
|
Lim D, Ford TN, Chu KK, Mertz J. Optically sectioned in vivo imaging with speckle illumination HiLo microscopy. JOURNAL OF BIOMEDICAL OPTICS 2011; 16:016014. [PMID: 21280920 PMCID: PMC3055591 DOI: 10.1117/1.3528656] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2010] [Revised: 11/15/2010] [Accepted: 11/30/2010] [Indexed: 05/20/2023]
Abstract
We present a simple wide-field imaging technique, called HiLo microscopy, that is capable of producing optically sectioned images in real time, comparable in quality to confocal laser scanning microscopy. The technique is based on the fusion of two raw images, one acquired with speckle illumination and another with standard uniform illumination. The fusion can be numerically adjusted, using a single parameter, to produce optically sectioned images of varying thicknesses with the same raw data. Direct comparison between our HiLo microscope and a commercial confocal laser scanning microscope is made on the basis of sectioning strength and imaging performance. Specifically, we show that HiLo and confocal 3-D imaging of a GFP-labeled mouse brain hippocampus are comparable in quality. Moreover, HiLo microscopy is capable of faster, near video rate imaging over larger fields of view than attainable with standard confocal microscopes. The goal of this paper is to advertise the simplicity, robustness, and versatility of HiLo microscopy, which we highlight with in vivo imaging of common model organisms including planaria, C. elegans, and zebrafish.
Collapse
Affiliation(s)
- Daryl Lim
- Boston University, Department of Biomedical Engineering, 44 Cummington Street, Boston, Massachusetts 02215, USA
| | | | | | | |
Collapse
|