1
|
Zhang J, Qiao W, Jin R, Li H, Gong H, Chen SC, Luo Q, Yuan J. Optical sectioning methods in three-dimensional bioimaging. LIGHT, SCIENCE & APPLICATIONS 2025; 14:11. [PMID: 39741128 DOI: 10.1038/s41377-024-01677-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2024] [Revised: 09/24/2024] [Accepted: 10/28/2024] [Indexed: 01/02/2025]
Abstract
In recent advancements in life sciences, optical microscopy has played a crucial role in acquiring high-quality three-dimensional structural and functional information. However, the quality of 3D images is often compromised due to the intense scattering effect in biological tissues, compounded by several issues such as limited spatiotemporal resolution, low signal-to-noise ratio, inadequate depth of penetration, and high phototoxicity. Although various optical sectioning techniques have been developed to address these challenges, each method adheres to distinct imaging principles for specific applications. As a result, the effective selection of suitable optical sectioning techniques across diverse imaging scenarios has become crucial yet challenging. This paper comprehensively overviews existing optical sectioning techniques and selection guidance under different imaging scenarios. Specifically, we categorize the microscope design based on the spatial relationship between the illumination and detection axis, i.e., on-axis and off-axis. This classification provides a unique perspective to compare the implementation and performances of various optical sectioning approaches. Lastly, we integrate selected optical sectioning methods on a custom-built off-axis imaging system and present a unique perspective for the future development of optical sectioning techniques.
Collapse
Affiliation(s)
- Jing Zhang
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China
| | - Wei Qiao
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China
| | - Rui Jin
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China
| | - Hongjin Li
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering, N.T, Hong Kong, China
- Department of Biomedical Engineering, City University of Hong Kong, Hong Kong, China
| | - Hui Gong
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China
- HUST-Suzhou Institute for Brainsmatics, Suzhou, China
| | - Shih-Chi Chen
- Hong Kong Center for Cerebro-Cardiovascular Health Engineering, N.T, Hong Kong, China.
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong, China.
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China.
- HUST-Suzhou Institute for Brainsmatics, Suzhou, China.
- School of Biomedical Engineering, Hainan University, Haikou, China.
| | - Jing Yuan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.
- MoE Key Laboratory for Biomedical Photonics, Innovation Institute, Huazhong University of Science and Technology, Wuhan, China.
- HUST-Suzhou Institute for Brainsmatics, Suzhou, China.
| |
Collapse
|
2
|
Qiao W, Li Y, Ning K, Luo Q, Gong H, Yuan J. Differential synthetic illumination based on multi-line detection for resolution and contrast enhancement of line confocal microscopy. OPTICS EXPRESS 2023; 31:16093-16106. [PMID: 37157695 DOI: 10.1364/oe.491422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Line confocal (LC) microscopy is a fast 3D imaging technique, but its asymmetric detection slit limits resolution and optical sectioning. To address this, we propose the differential synthetic illumination (DSI) method based on multi-line detection to enhance the spatial resolution and optical sectioning capability of the LC system. The DSI method allows the imaging process to simultaneously accomplish on a single camera, which ensures the rapidity and stability of the imaging process. DSI-LC improves X- and Z-axis resolution by 1.28 and 1.26 times, respectively, and optical sectioning by 2.6 times compared to LC. Furthermore, the spatially resolved power and contrast are also demonstrated by imaging pollen, microtubule, and the fiber of the GFP fluorescence-labeled mouse brain. Finally, Video-rate imaging of zebrafish larval heart beating in a 665.6 × 332.8 µm2 field-of-view is achieved. DSI-LC provides a promising approach for 3D large-scale and functional imaging in vivo with improved resolution, contrast, and robustness.
Collapse
|
3
|
Zhai J, Shi R, Fan K, Kong L. Background inhibited and speed-loss-free volumetric imaging in vivo based on structured-illumination Fourier light field microscopy. Front Neurosci 2022; 16:1004228. [PMID: 36248666 PMCID: PMC9558295 DOI: 10.3389/fnins.2022.1004228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Benefiting from its advantages in fast volumetric imaging for recording biodynamics, Fourier light field microscopy (FLFM) has a wide range of applications in biomedical research, especially in neuroscience. However, the imaging quality of the FLFM is always deteriorated by both the out-of-focus background and the strong scattering in biological samples. Here we propose a structured-illumination and interleaved-reconstruction based Fourier light field microscopy (SI-FLFM), in which we can filter out the background fluorescence in FLFM without sacrificing imaging speed. We demonstrate the superiority of our SI-FLFM in high-speed, background-inhibited volumetric imaging of various biodynamics in larval zebrafish and mice in vivo. The signal-to-background ratio (SBR) is improved by tens of times. And the volumetric imaging speed can be up to 40 Hz, avoiding artifacts caused by temporal under-sampling in conventional structured illumination microscopy. These suggest that our SI-FLFM is suitable for applications of weak fluorescence signals but high imaging speed requirements.
Collapse
Affiliation(s)
- Jiazhen Zhai
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Kuikui Fan
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China
- *Correspondence: Lingjie Kong,
| |
Collapse
|
4
|
Zhang Y, Kang L, Lo CTK, Tsang VTC, Wong TTW. Rapid slide-free and non-destructive histological imaging using wide-field optical-sectioning microscopy. BIOMEDICAL OPTICS EXPRESS 2022; 13:2782-2796. [PMID: 35774335 PMCID: PMC9203115 DOI: 10.1364/boe.454501] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 03/31/2022] [Accepted: 03/31/2022] [Indexed: 06/15/2023]
Abstract
Histopathology based on formalin-fixed and paraffin-embedded tissues has long been the gold standard for surgical margin assessment (SMA). However, routine pathological practice is lengthy and laborious, failing to guide surgeons intraoperatively. In this report, we propose a practical and low-cost histological imaging method with wide-field optical-sectioning microscopy (i.e., High-and-Low-frequency (HiLo) microscopy). HiLo can achieve rapid and non-destructive imaging of freshly-excised tissues at an extremely high acquisition speed of 5 cm2/min with a spatial resolution of 1.3 µm (lateral) and 5.8 µm (axial), showing great potential as an SMA tool that can provide immediate feedback to surgeons and pathologists for intraoperative decision-making. We demonstrate that HiLo enables rapid extraction of diagnostic features for different subtypes of human lung adenocarcinoma and hepatocellular carcinoma, producing surface images of rough specimens with large field-of-views and cellular features that are comparable to the clinical standard. Our results show promising clinical translations of HiLo microscopy to improve the current standard of care.
Collapse
|
5
|
Ikäheimo K, Herranen A, Iivanainen V, Lankinen T, Aarnisalo AA, Sivonen V, Patel KA, Demir K, Saarma M, Lindahl M, Pirvola U. MANF supports the inner hair cell synapse and the outer hair cell stereocilia bundle in the cochlea. Life Sci Alliance 2021; 5:5/2/e202101068. [PMID: 34815294 PMCID: PMC8616558 DOI: 10.26508/lsa.202101068] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 11/08/2021] [Accepted: 11/08/2021] [Indexed: 11/29/2022] Open
Abstract
The authors show in the mouse how the auditory hair cell structural maintenance is perturbed by the inactivation of Manf and the concomitant ER stress, causing early-onset, progressive hearing loss. Failure in the structural maintenance of the hair cell stereocilia bundle and ribbon synapse causes hearing loss. Here, we have studied how ER stress elicits hair cell pathology, using mouse models with inactivation of Manf (mesencephalic astrocyte-derived neurotrophic factor), encoding an ER-homeostasis-promoting protein. From hearing onset, Manf deficiency caused disarray of the outer hair cell stereocilia bundle and reduced cochlear sound amplification capability throughout the tonotopic axis. In high-frequency outer hair cells, the pathology ended in molecular changes in the stereocilia taper region and in strong stereocilia fusion. In high-frequency inner hair cells, Manf deficiency degraded ribbon synapses. The altered phenotype strongly depended on the mouse genetic background. Altogether, the failure in the ER homeostasis maintenance induced early-onset stereociliopathy and synaptopathy and accelerated the effect of genetic causes driving age-related hearing loss. Correspondingly, MANF mutation in a human patient induced severe sensorineural hearing loss from a young age onward. Thus, we present MANF as a novel protein and ER stress as a mechanism that regulate auditory hair cell maintenance in both mice and humans.
Collapse
Affiliation(s)
- Kuu Ikäheimo
- Molecular and Integrative Biosciences Research Programme, University of Helsinki, Helsinki, Finland
| | - Anni Herranen
- Molecular and Integrative Biosciences Research Programme, University of Helsinki, Helsinki, Finland
| | - Vilma Iivanainen
- Molecular and Integrative Biosciences Research Programme, University of Helsinki, Helsinki, Finland
| | - Tuuli Lankinen
- Molecular and Integrative Biosciences Research Programme, University of Helsinki, Helsinki, Finland
| | - Antti A Aarnisalo
- Department of Otorhinolaryngology-Head and Neck Surgery, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Ville Sivonen
- Department of Otorhinolaryngology-Head and Neck Surgery, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
| | - Kashyap A Patel
- Institute of Biomedical and Clinical Science, College of Medicine and Health, University of Exeter, Exeter, UK
| | - Korcan Demir
- Department of Paediatric Endocrinology, Dokuz Eylul University, Izmir, Turkey
| | - Mart Saarma
- Institute of Biotechnology, HILIFE Unit, University of Helsinki, Helsinki, Finland
| | - Maria Lindahl
- Institute of Biotechnology, HILIFE Unit, University of Helsinki, Helsinki, Finland
| | - Ulla Pirvola
- Molecular and Integrative Biosciences Research Programme, University of Helsinki, Helsinki, Finland
| |
Collapse
|
6
|
Park J, Brady DJ, Zheng G, Tian L, Gao L. Review of bio-optical imaging systems with a high space-bandwidth product. ADVANCED PHOTONICS 2021; 3:044001. [PMID: 35178513 PMCID: PMC8849623 DOI: 10.1117/1.ap.3.4.044001] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
Optical imaging has served as a primary method to collect information about biosystems across scales-from functionalities of tissues to morphological structures of cells and even at biomolecular levels. However, to adequately characterize a complex biosystem, an imaging system with a number of resolvable points, referred to as a space-bandwidth product (SBP), in excess of one billion is typically needed. Since a gigapixel-scale far exceeds the capacity of current optical imagers, compromises must be made to obtain either a low spatial resolution or a narrow field-of-view (FOV). The problem originates from constituent refractive optics-the larger the aperture, the more challenging the correction of lens aberrations. Therefore, it is impractical for a conventional optical imaging system to achieve an SBP over hundreds of millions. To address this unmet need, a variety of high-SBP imagers have emerged over the past decade, enabling an unprecedented resolution and FOV beyond the limit of conventional optics. We provide a comprehensive survey of high-SBP imaging techniques, exploring their underlying principles and applications in bioimaging.
Collapse
Affiliation(s)
- Jongchan Park
- University of California, Department of Bioengineering, Los Angeles, California, United States
| | - David J. Brady
- University of Arizona, James C. Wyant College of Optical Sciences, Tucson, Arizona, United States
| | - Guoan Zheng
- University of Connecticut, Department of Biomedical Engineering, Storrs, Connecticut, United States
- University of Connecticut, Department of Electrical and Computer Engineering, Storrs, Connecticut, United States
| | - Lei Tian
- Boston University, Department of Electrical and Computer Engineering, Boston, Massachusetts, United States
| | - Liang Gao
- University of California, Department of Bioengineering, Los Angeles, California, United States
| |
Collapse
|
7
|
Shi R, Li Y, Kong L. High-speed volumetric imaging in vivo based on structured illumination microscopy with interleaved reconstruction. JOURNAL OF BIOPHOTONICS 2021; 14:e202000513. [PMID: 33502121 DOI: 10.1002/jbio.202000513] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2020] [Revised: 01/21/2021] [Accepted: 01/24/2021] [Indexed: 06/12/2023]
Abstract
Wide-field fluorescence microscopy (WFFM) is widely adopted in biomedical studies, due to its high imaging speed over large field-of-views. However, WFFM is susceptible to out-of-focus background. To overcome this problem, structured illumination microscopy (SIM) was proposed as a wide-field, optical-sectioning technique, which needs multiple raw images for image reconstruction and thus has a lower imaging speed. Here we propose SIM with interleaved reconstruction, to make SIM of lossless speed. We apply this method in volumetric imaging of neural network dynamics in brains of zebrafish larva in vivo.
Collapse
Affiliation(s)
- Ruheng Shi
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Yuting Li
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
| | - Lingjie Kong
- State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing, China
- IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China
| |
Collapse
|
8
|
Qiao W, Jin R, Luo T, Li Y, Fan G, Luo Q, Yuan J. Single-scan HiLo with line-illumination strategy for optical section imaging of thick tissues. BIOMEDICAL OPTICS EXPRESS 2021; 12:2373-2383. [PMID: 33996235 PMCID: PMC8086481 DOI: 10.1364/boe.419377] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 03/18/2021] [Accepted: 03/22/2021] [Indexed: 05/25/2023]
Abstract
Optical sectioning has been widely employed for inhibiting out-of-focus backgrounds in three-dimensional (3D) imaging of biological samples. However, point scanning imaging or multiple acquisitions for wide-field optical sectioning in epi-illumination microscopy remains time-consuming for large-scale imaging. In this paper, we propose a single-scan optical sectioning method based on the hybrid illumination (HiLo) algorithm with a line-illumination strategy. Our method combines HiLo background inhibition with confocal slit detection. It thereby offers a higher optical sectioning capability than wide-field HiLo and line-confocal imaging without extra modulation and multiple data acquisition. To demonstrate the optical-sectioning capability of our system, we imaged a thin fluorescent plane and different fluorescence-labeled mouse tissue. Our method shows an excellent background inhibition in thick tissue and thus potentially provides an alternative tool for 3D imaging of large-scale biological tissue.
Collapse
Affiliation(s)
- Wei Qiao
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Rui Jin
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- These authors contributed equally
| | - Tianpeng Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Yafeng Li
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Guoqing Fan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Qingming Luo
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
- School of Biomedical Engineering, Hainan University, Haikou, China
| | - Jing Yuan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
- MOE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Innovation Institute, Huazhong University of Science and Technology, Wuhan 430074, China
- HUST-Suzhou Institute for Brainsmatics, JITRI Institute for Brainsmatics, Suzhou 215123, China
| |
Collapse
|
9
|
Zhong Q, Jiang C, Zhang D, Chen S, Jin R, Gong H, Yuan J. High-throughput optical sectioning via line-scanning imaging with digital structured modulation. OPTICS LETTERS 2021; 46:504-507. [PMID: 33528395 DOI: 10.1364/ol.412323] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2020] [Accepted: 12/10/2020] [Indexed: 06/12/2023]
Abstract
Optical sectioning with high-throughput, a high signal-to-noise ratio (SNR), and submicrometer resolution is crucial, but challenging, to three-dimensional visualization of large biological tissue samples. Here we propose line-scanning imaging with digital structured modulation for optical sectioning. Our method generates images with a significantly improved SNR, compared to wide-field structured illumination microscopy (WF-SIM), without residual modulation artifacts. We image a 14.5mm×11.5mm horizontal view of mouse brain tissue at a pixel resolution of 0.32µm×0.32µm in 101 s, which, compared to WF-SIM, represents a significant improvement on imaging throughput. These results provide development opportunities for high-throughput, high-resolution large-area optical imaging methods.
Collapse
|
10
|
New 1,3-Disubstituted Benzo[ h]Isoquinoline Cyclen-Based Ligand Platform: Synthesis, Eu 3+ Multiphoton Sensitization and Imaging Applications. Molecules 2020; 26:molecules26010058. [PMID: 33374449 PMCID: PMC7795479 DOI: 10.3390/molecules26010058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 12/15/2020] [Accepted: 12/17/2020] [Indexed: 11/17/2022] Open
Abstract
The development of lanthanide-based luminescent probes with a long emission lifetime has the potential to revolutionize imaging-based diagnostic techniques. By a rational design strategy taking advantage of computational predictions, a novel, water-soluble Eu3+ complex from a cyclen-based ligand bearing 1,3-disubstituted benzo[h]isoquinoline arms was realized. The ligand has been obtained overcoming the lack of reactivity of position 3 of the isoquinoline moiety. Notably, steric hindrance of the heteroaromatic chromophore allowed selective and stoichiometry-controlled insertion of two or three antennas on the cyclen platform without any protection strategy. The complex bears a fourth heptanoic arm for easy conjugation to biomolecules. This new chromophore allowed the sensitization of the metal center either with one or two photons excitation. The suitability as a luminescent bioprobe was validated by imaging BMI1 oncomarker in lung carcinoma cells following an established immunofluorescence approach. The use of a conventional epifluorescence microscope equipped with a linear structured illumination module disclosed a simple and inexpensive way to image confocally Ln-bioprobes by single photon excitation in the 350–400 nm window, where ordinary confocal systems have no excitation sources.
Collapse
|
11
|
Li Z, Zhang Q, Chou SW, Newman Z, Turcotte R, Natan R, Dai Q, Isacoff EY, Ji N. Fast widefield imaging of neuronal structure and function with optical sectioning in vivo. SCIENCE ADVANCES 2020; 6:eaaz3870. [PMID: 32494711 PMCID: PMC7209992 DOI: 10.1126/sciadv.aaz3870] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2019] [Accepted: 02/18/2020] [Indexed: 05/19/2023]
Abstract
Optical microscopy, owing to its noninvasiveness and subcellular resolution, enables in vivo visualization of neuronal structure and function in the physiological context. Optical-sectioning structured illumination microscopy (OS-SIM) is a widefield fluorescence imaging technique that uses structured illumination patterns to encode in-focus structures and optically sections 3D samples. However, its application to in vivo imaging has been limited. In this study, we optimized OS-SIM for in vivo neural imaging. We modified OS-SIM reconstruction algorithms to improve signal-to-noise ratio and correct motion-induced artifacts in live samples. Incorporating an adaptive optics (AO) module to OS-SIM, we found that correcting sample-induced optical aberrations was essential for achieving accurate structural and functional characterizations in vivo. With AO OS-SIM, we demonstrated fast, high-resolution in vivo imaging with optical sectioning for structural imaging of mouse cortical neurons and zebrafish larval motor neurons, and functional imaging of quantal synaptic transmission at Drosophila larval neuromuscular junctions.
Collapse
Affiliation(s)
- Ziwei Li
- Department of Physics, University of California, Berkeley, Berkeley, CA 94720, USA
- Department of Automation, Tsinghua University, Beijing 100084, China
| | - Qinrong Zhang
- Department of Physics, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Shih-Wei Chou
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Zachary Newman
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Raphaël Turcotte
- Department of Physics, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Ryan Natan
- Department of Physics, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Qionghai Dai
- Department of Automation, Tsinghua University, Beijing 100084, China
| | - Ehud Y. Isacoff
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
- Bioscience Division, Lawrence Berkeley National Laboratory, Berkeley, Berkeley, CA 94720, USA
| | - Na Ji
- Department of Physics, University of California, Berkeley, Berkeley, CA 94720, USA
- Department of Molecular and Cell Biology, University of California, Berkeley, Berkeley, CA 94720, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
- Molecular Biophysics and Integrated Bioimaging Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
- Corresponding author.
| |
Collapse
|
12
|
Thrapp AD, Hughes MR. Automatic motion compensation for structured illumination endomicroscopy using a flexible fiber bundle. JOURNAL OF BIOMEDICAL OPTICS 2020; 25:1-13. [PMID: 32100492 PMCID: PMC7040435 DOI: 10.1117/1.jbo.25.2.026501] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Accepted: 01/21/2020] [Indexed: 05/13/2023]
Abstract
SIGNIFICANCE Confocal laser scanning enables optical sectioning in clinical fiber bundle endomicroscopes, but lower-cost, simplified endomicroscopes use widefield incoherent illumination instead. Optical sectioning can be introduced in these simple systems using structured illumination microscopy (SIM), a multiframe digital subtraction process. However, SIM results in artifacts when the probe is in motion, making the technique difficult to use in vivo and preventing the use of mosaicking to synthesize a larger effective field of view (FOV). AIM We report and validate an automatic motion compensation technique to overcome motion artifacts and allow generation of mosaics in SIM endomicroscopy. APPROACH Motion compensation is achieved using image registration and real-time pattern orientation correction via a digital micromirror device. We quantify the similarity of moving probe reconstructions to those acquired with a stationary probe using the relative mean of the absolute differences (MAD). We further demonstrate mosaicking with a moving probe in mechanical and freehand operation. RESULTS Reconstructed SIM images show an improvement in the MAD from 0.85 to 0.13 for lens paper and from 0.27 to 0.12 for bovine tissue. Mosaics also show vastly reduced artifacts. CONCLUSION The reduction in motion artifacts in individual SIM reconstructions leads to mosaics that more faithfully represent the morphology of tissue, giving clinicians a larger effective FOV than the probe itself can provide.
Collapse
Affiliation(s)
- Andrew D. Thrapp
- University of Kent, School of Physical Sciences, Applied Optics Group, Canterbury, United Kingdom
- Address all correspondence to Andrew D. Thrapp, E-mail:
| | - Michael R. Hughes
- University of Kent, School of Physical Sciences, Applied Optics Group, Canterbury, United Kingdom
| |
Collapse
|
13
|
Bloygrund H, Franjy-Tal Y, Rosenzweig T, Abookasis D. Multiparameter wide-field integrated optical imaging system-based spatially modulated illumination and laser speckles in model of tissue injuries. JOURNAL OF BIOPHOTONICS 2019; 12:e201900141. [PMID: 31187933 DOI: 10.1002/jbio.201900141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Revised: 06/03/2019] [Accepted: 06/07/2019] [Indexed: 06/09/2023]
Abstract
In this report, an integrated optical platform based on spatial illumination together with laser speckle contrast technique was utilized to measure multiple parameters in live tissue including absorption, scattering, saturation, composition, metabolism, and blood flow. Measurements in three models of tissue injury including drug toxicity, artery occlusion, and acute hyperglycemia were used to test the efficacy of this system. With this hybrid apparatus, a series of structured light patterns at low and high spatial frequencies are projected onto the tissue surface and diffuse reflected light is captured by a CCD camera. A six position filter wheel, equipped with four bandpass filters centered at wavelengths of 650, 690, 800 and 880 nm is placed in front of the camera. Then, light patterns are blocked and a laser source at 650 nm illuminates the tissue while the diffusely reflected light is captured by the camera through the two remaining open holes in the wheel. In this manner, near-infrared (NIR) and laser speckle images are captured and stored together in the computer for off-line processing to reconstruct the tissue's properties. Spatial patterns are used to differentiate the effects of tissue scattering from those of absorption, allowing accurate quantification of tissue hemodynamics and morphology, while a coherent light source is used to study blood flow changes, a feature which cannot be measured with the NIR structured light. This combined configuration utilizes the strengths of each system in a complementary way, thus collecting a larger range of sample properties. In addition, once the flow and hemodynamics are measured, tissue oxygen metabolism can be calculated, a property which cannot be measured independently. Therefore, this merged platform can be considered a multiparameter wide-field imaging and spectroscopy modality. Overall, experiments demonstrate the capability of this spatially coregistered imaging setup to provide complementary, useful information of various tissue metrics in a simple and noncontact manner, making it attractive for use in a variety of biomedical applications.
Collapse
Affiliation(s)
- Hadas Bloygrund
- Department of Electrical and Electronics Engineering, Ariel University, Ariel, Israel
| | - Yarden Franjy-Tal
- Department of Electrical and Electronics Engineering, Ariel University, Ariel, Israel
| | - Tovit Rosenzweig
- Department of Molecular Biology and Nutritional Studies, Ariel University, Ariel, Israel
| | - David Abookasis
- Department of Electrical and Electronics Engineering, Ariel University, Ariel, Israel
| |
Collapse
|
14
|
Xie Z, Tang Y, Feng J, Liu J, Hu S. Accurate surface profilometry using differential optical sectioning microscopy with structured illumination. OPTICS EXPRESS 2019; 27:11721-11733. [PMID: 31053014 DOI: 10.1364/oe.27.011721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 03/28/2019] [Indexed: 06/09/2023]
Abstract
A differential optical sectioning microscopy with structured-illumination (DOSM-SI) with enhanced axial precision is explored in this paper for three-dimensional (3D) measurement. As the segment of data on the linear region of the contrast depth response curve (CDR) is very sensitive to variation of the height information, the DOSM-SI introduces a new CDR2 with an axial shift to intersect the linear region of the CDR1, which is achieved by using two charge-coupled detectors (CCDs) in the optical path. The CCD1 is located on the imaging plane and the CCD2 is displaced from the imaging plane. The difference between the CDR1 and CDR2 for each pixel is defined as the differential depth response curve (DCDR). Further, the zero-crossing point of the DCDR for each pixel is accurately extracted using the line-fitting technique, and finally, the sample surface can be reconstructed with a high resolution and precision. Since the slope around the zero-crossing point of the DCDR is apparently larger than that of near the focal position, an enhanced resolution and precision can be realized in DOSM-SI. The experiments and theoretical analysis are elaborated to demonstrate the feasibility of DOSM-SI.
Collapse
|
15
|
Kumar S, Rao R. Analytical tools for cyclodextrin nanosponges in pharmaceutical field: a review. J INCL PHENOM MACRO 2019. [DOI: 10.1007/s10847-019-00903-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
16
|
Zhang X, Chen Y, Ning K, Zhou C, Han Y, Gong H, Yuan J. Deep learning optical-sectioning method. OPTICS EXPRESS 2018; 26:30762-30772. [PMID: 30469968 DOI: 10.1364/oe.26.030762] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
Current optical-sectioning methods require complex optical system or considerable computation time to improve imaging quality. Here we propose a deep learning-based method for optical sectioning of wide-field images. This method only needs one pair of contrast images for training to facilitate reconstruction of an optically sectioned image. The removal effect of background information and resolution that is achievable with our technique is similar to traditional optical-sectioning methods, but offers lower noise levels and a higher imaging depth. Moreover, reconstruction speed can be optimized to 14 Hz. This cost-effective and convenient method enables high-throughput optical sectioning techniques to be developed.
Collapse
|
17
|
Hu B, Bolus D, Brown JQ. Improved contrast in inverted selective plane illumination microscopy of thick tissues using confocal detection and structured illumination. BIOMEDICAL OPTICS EXPRESS 2017; 8:5546-5559. [PMID: 29296487 PMCID: PMC5745102 DOI: 10.1364/boe.8.005546] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Revised: 10/26/2017] [Accepted: 11/09/2017] [Indexed: 05/08/2023]
Abstract
Inverted selective plane illumination microscopy (iSPIM) enables fast, large field-of-view, long term imaging with compatibility with conventional sample mounting. However, the imaging quality can be deteriorated in thick tissues due to sample scattering. Three strategies have been adopted in this paper to optimize the imaging performance of iSPIM on thick tissue imaging: electronic confocal slit detection (eCSD), structured illumination (SI) and the two combined. We compared the image contrast when using SPIM, confocal SPIM (using eCSD alone), SI SPIM (using SI alone) or confocal-SI SPIM (combining both methods) on images of gelatin phantom and highly-scattering fluorescently-stained human tissue. We demonstrate that all the three methods showed remarkable contrast enhancement on both samples compared to iSPIM alone, and SI SPIM and the combined confocal-SI mode outperformed confocal SPIM in contrast enhancement. Moreover, the use of SI at high pattern frequencies outperformed confocal SPIM in terms of optical sectioning capability. However, image signal-to-noise ratio (SNR) was decreased at high pattern frequencies when imaging scattering samples with SI SPIM. By combining eCSD with SI to reduce background signal and noise, the superior optical sectioning performance of SI could be achieved while also maintaining high image SNR.
Collapse
|
18
|
|
19
|
Hinsdale T, Olsovsky C, Rico-Jimenez JJ, Maitland KC, Jo JA, Malik BH. Optically sectioned wide-field fluorescence lifetime imaging microscopy enabled by structured illumination. BIOMEDICAL OPTICS EXPRESS 2017; 8:1455-1465. [PMID: 28663841 PMCID: PMC5480556 DOI: 10.1364/boe.8.001455] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2016] [Revised: 01/23/2017] [Accepted: 02/02/2017] [Indexed: 05/04/2023]
Abstract
In this paper, we demonstrate the ability of structured illumination microscopy to enhance the ability of fluorescence lifetime imaging to resolve fluorescence lifetimes in relatively thick samples that possess distinct but spectrally overlapping fluorescent layers. Structured illumination fluorescent lifetime imaging microscopy (SI-FLIM) is shown to be able to accurately reconstruct lifetime values in homogenous fluorophore samples (POPOP, NADH, and FAD) as well as accurately measure fluorescent lifetime in two layer models that are layered with NADH/FAD over POPOP, where NADH/FAD and POPOP have spectral overlap. Finally, the ability of SI-FLIM was demonstrated in a hamster cheek pouch ex vivo to show that more accurate lifetimes could be measured for each layer of interest in the oral mucosa (epithelium and submucosa).
Collapse
Affiliation(s)
- Taylor Hinsdale
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
| | - Cory Olsovsky
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
| | - Jose J. Rico-Jimenez
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
| | - Kristen C. Maitland
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
| | - Javier A. Jo
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
| | - Bilal H. Malik
- Department of Biomedical Engineering, Texas A&M University, 5045 Emerging Technologies Building, 3120 TAMU, College Station, TX 77843, USA
- QT Ultrasound Labs, 3 Hamilton Landing, Suite 160, Novato, CA 94949, USA
| |
Collapse
|
20
|
Wang M, Tulman DB, Sholl AB, Kimbrell HZ, Mandava SH, Elfer KN, Luethy S, Maddox MM, Lai W, Lee BR, Brown JQ. Gigapixel surface imaging of radical prostatectomy specimens for comprehensive detection of cancer-positive surgical margins using structured illumination microscopy. Sci Rep 2016; 6:27419. [PMID: 27257084 PMCID: PMC4891779 DOI: 10.1038/srep27419] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2016] [Accepted: 05/18/2016] [Indexed: 01/07/2023] Open
Abstract
Achieving cancer-free surgical margins in oncologic surgery is critical to reduce the need for additional adjuvant treatments and minimize tumor recurrence; however, there is a delicate balance between completeness of tumor removal and preservation of adjacent tissues critical for normal post-operative function. We sought to establish the feasibility of video-rate structured illumination microscopy (VR-SIM) of the intact removed tumor surface as a practical and non-destructive alternative to intra-operative frozen section pathology, using prostate cancer as an initial target. We present the first images of the intact human prostate surface obtained with pathologically-relevant contrast and subcellular detail, obtained in 24 radical prostatectomy specimens immediately after excision. We demonstrate that it is feasible to routinely image the full prostate circumference, generating gigapixel panorama images of the surface that are readily interpreted by pathologists. VR-SIM confirmed detection of positive surgical margins in 3 out of 4 prostates with pathology-confirmed adenocarcinoma at the circumferential surgical margin, and furthermore detected extensive residual cancer at the circumferential margin in a case post-operatively classified by histopathology as having negative surgical margins. Our results suggest that the increased surface coverage of VR-SIM could also provide added value for detection and characterization of positive surgical margins over traditional histopathology.
Collapse
Affiliation(s)
- Mei Wang
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - David B Tulman
- Bioinnovation Program, Tulane University, New Orleans, LA 70118, USA
| | - Andrew B Sholl
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Hillary Z Kimbrell
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Sree H Mandava
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Katherine N Elfer
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - Samuel Luethy
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - Michael M Maddox
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Weil Lai
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Benjamin R Lee
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - J Quincy Brown
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| |
Collapse
|
21
|
Mueller JL, Gallagher JE, Chitalia R, Krieger M, Erkanli A, Willett RM, Geradts J, Ramanujam N. Rapid staining and imaging of subnuclear features to differentiate between malignant and benign breast tissues at a point-of-care setting. J Cancer Res Clin Oncol 2016; 142:1475-86. [PMID: 27106032 DOI: 10.1007/s00432-016-2165-9] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2015] [Accepted: 04/11/2016] [Indexed: 01/01/2023]
Abstract
PURPOSE Histopathology is the clinical standard for tissue diagnosis; however, it requires tissue processing, laboratory personnel and infrastructure, and a highly trained pathologist to diagnose the tissue. Optical microscopy can provide real-time diagnosis, which could be used to inform the management of breast cancer. The goal of this work is to obtain images of tissue morphology through fluorescence microscopy and vital fluorescent stains and to develop a strategy to segment and quantify breast tissue features in order to enable automated tissue diagnosis. METHODS We combined acriflavine staining, fluorescence microscopy, and a technique called sparse component analysis to segment nuclei and nucleoli, which are collectively referred to as acriflavine positive features (APFs). A series of variables, which included the density, area fraction, diameter, and spacing of APFs, were quantified from images taken from clinical core needle breast biopsies and used to create a multivariate classification model. The model was developed using a training data set and validated using an independent testing data set. RESULTS The top performing classification model included the density and area fraction of smaller APFs (those less than 7 µm in diameter, which likely correspond to stained nucleoli).When applied to the independent testing set composed of 25 biopsy panels, the model achieved a sensitivity of 82 %, a specificity of 79 %, and an overall accuracy of 80 %. CONCLUSIONS These results indicate that our quantitative microscopy toolbox is a potentially viable approach for detecting the presence of malignancy in clinical core needle breast biopsies.
Collapse
Affiliation(s)
- Jenna L Mueller
- Department of Biomedical Engineering, Duke University, 136 Hudson Hall Box 90281, Durham, NC, 27708, USA.
| | - Jennifer E Gallagher
- Department of Surgery, Duke University Medical Center, 30 Medicine Drive White Zone, 3rd Floor, Suite 3570, Durham, NC, 27710, USA
| | - Rhea Chitalia
- Department of Biomedical Engineering, Duke University, 136 Hudson Hall Box 90281, Durham, NC, 27708, USA
| | - Marlee Krieger
- Department of Biomedical Engineering, Duke University, 136 Hudson Hall Box 90281, Durham, NC, 27708, USA
| | - Alaattin Erkanli
- Department of Biostatistics and Bioinformatics, Duke University, Brightleaf Square Suite 22B, 905 West Main Street, Durham, NC, 27701, USA
| | - Rebecca M Willett
- Department of Electrical and Computer Engineering, University of Wisconsin - Madison, 1415 Engineering Drive, Madison, WI, 53706, USA
| | - Joseph Geradts
- Department of Pathology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA
| | - Nimmi Ramanujam
- Department of Biomedical Engineering, Duke University, 136 Hudson Hall Box 90281, Durham, NC, 27708, USA
| |
Collapse
|
22
|
Abstract
Probes and biosensors that incorporate luminescent Tb(III) or Eu(III) complexes are promising for cellular imaging because time-gated microscopes can detect their long-lifetime (approximately milliseconds) emission without interference from short-lifetime (approximately nanoseconds) fluorescence background. Moreover, the discrete, narrow emission bands of Tb(III) complexes make them uniquely suited for multiplexed imaging applications because they can serve as Förster resonance energy transfer (FRET) donors to two or more differently colored acceptors. However, lanthanide complexes have low photon emission rates that can limit the image signal/noise ratio, which has a square-root dependence on photon counts. This work describes the performance of a wide-field, time-gated microscope with respect to its ability to image Tb(III) luminescence and Tb(III)-mediated FRET in cultured mammalian cells. The system employed a UV-emitting LED for low-power, pulsed excitation and an intensified CCD camera for gated detection. Exposure times of ∼1 s were needed to collect 5-25 photons per pixel from cells that contained micromolar concentrations of a Tb(III) complex. The observed photon counts matched those predicted by a theoretical model that incorporated the photophysical properties of the Tb(III) probe and the instrument's light-collection characteristics. Despite low photon counts, images of Tb(III)/green fluorescent protein FRET with a signal/noise ratio ≥ 7 were acquired, and a 90% change in the ratiometric FRET signal was measured. This study shows that the sensitivity and precision of lanthanide-based cellular microscopy can approach that of conventional FRET microscopy with fluorescent proteins. The results should encourage further development of lanthanide biosensors that can measure analyte concentration, enzyme activation, and protein-protein interactions in live cells.
Collapse
|
23
|
Chen TA, Hagen N, Gao L, Tkaczyk TS. Quantitative sectioning and noise analysis for structured illumination microscopy: erratum. OPTICS EXPRESS 2015; 23:27633-27634. [PMID: 26480424 DOI: 10.1364/oe.23.027633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
We correct an error in the original manuscript, where an unrecognized assumption was made about the relationship between the out-of-focus light and the in-focus light. We summarize the condition under which the assumption may still hold, and mention alternative methods researchers can use to obtain accurate quantitative sectioning.
Collapse
|
24
|
Abstract
The confocal fluorescence microscope has become a popular tool for life sciences researchers, primarily because of its ability to remove blur from outside of the focal plane of the image. Several different kinds of confocal microscopes have been developed, each with advantages and disadvantages. This article will cover the grid confocal, classic confocal laser-scanning microscope (CLSM), the resonant scanning-CLSM, and the spinning-disk confocal microscope. The way each microscope technique works, the best applications the technique is suited for, the limitations of the technique, and new developments for each technology will be presented. Researchers who have access to a range of different confocal microscopes (e.g., through a local core facility) should find this paper helpful for choosing the best confocal technology for specific imaging applications. Others with funding to purchase an instrument should find the article helpful in deciding which technology is ideal for their area of research.
Collapse
|
25
|
Gao L. QSIM: quantitative structured illumination microscopy image processing in ImageJ. Biomed Eng Online 2015; 14:4. [PMID: 25588495 PMCID: PMC4360942 DOI: 10.1186/1475-925x-14-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2014] [Accepted: 01/07/2015] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Structured illumination microscopy has been extensively used in biological imaging due to its low cost and easy implementation. However, the lack of quantitative imaging capability limits its application in absolute irradiance measurements. METHOD We have developed a quantitative structured illumination microscopy image processing algorithm (QSIM) as a plugin for the widely used ImageJ software. QSIM can work with the raw images acquired by a traditional structured illumination microscope and can quantitatively measure photon numbers, with noise estimates for both wide-field images and sectioned images. RESULTS AND CONCLUSION We demonstrated the quantitative image processing capability of QSIM by imaging a mouse kidney section in 3D. The results show that QSIM can transform structured illumination microscopy from qualitative to quantitative, which is essential for demanding fluorescence imaging applications.
Collapse
Affiliation(s)
- Liang Gao
- Department of Biomedical Engineering, Washington University, St, Louis, MO 63139, USA.
| |
Collapse
|
26
|
Schropp M, Uhl R. Two-dimensional structured illumination microscopy. J Microsc 2014; 256:23-36. [PMID: 25113075 DOI: 10.1111/jmi.12154] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2013] [Accepted: 06/18/2014] [Indexed: 11/27/2022]
Abstract
In widefield fluorescence microscopy, images from all but very flat samples suffer from fluorescence emission from layers above or below the focal plane of the objective lens. Structured illumination microscopy provides an elegant approach to eliminate this unwanted image contribution. To this end a line grid is projected onto the sample and phase images are taken at different positions of the line grid. Using suitable algorithms 'quasi-confocal images' can be derived from a given number of such phase-images. Here, we present an alternative structured illumination microscopy approach, which employs two-dimensional patterns instead of a one-dimensional one. While in one-dimensional structured illumination microscopy the patterns are shifted orthogonally to the pattern orientation, in our two-dimensional approach it is shifted at a single, pattern-dependent angle, yet it already achieves an isotropic power spectral density with this unidirectional shift, which otherwise would require a combination of pattern-shift and -rotation. Moreover, our two-dimensional approach also yields a better signal-to-noise ratio in the evaluated image.
Collapse
Affiliation(s)
- M Schropp
- Bio Imaging Zentrum der Ludwid-Maximilians-Universitt Mnchen, Grohaderner Street 2-4, 82152, Martinsried, Germany
| | - R Uhl
- Bio Imaging Zentrum der Ludwid-Maximilians-Universitt Mnchen, Grohaderner Street 2-4, 82152, Martinsried, Germany
| |
Collapse
|
27
|
Patorski K, Trusiak M, Tkaczyk T. Optically-sectioned two-shot structured illumination microscopy with Hilbert-Huang processing. OPTICS EXPRESS 2014; 22:9517-27. [PMID: 24787840 PMCID: PMC4083048 DOI: 10.1364/oe.22.009517] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
We introduce a fast, simple, adaptive and experimentally robust method for reconstructing background-rejected optically-sectioned images using two-shot structured illumination microscopy. Our innovative data demodulation method needs two grid-illumination images mutually phase shifted by π (half a grid period) but precise phase displacement between two frames is not required. Upon frames subtraction the input pattern with increased grid modulation is obtained. The first demodulation stage comprises two-dimensional data processing based on the empirical mode decomposition for the object spatial frequency selection (noise reduction and bias term removal). The second stage consists in calculating high contrast image using the two-dimensional spiral Hilbert transform. Our algorithm effectiveness is compared with the results calculated for the same input data using structured-illumination (SIM) and HiLo microscopy methods. The input data were collected for studying highly scattering tissue samples in reflectance mode. Results of our approach compare very favorably with SIM and HiLo techniques.
Collapse
Affiliation(s)
- Krzysztof Patorski
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Maciej Trusiak
- Warsaw University of Technology, Institute of Micromechanics and Photonics, 8 Sw. A. Boboli St., 02-525 Warsaw, Poland
| | - Tomasz Tkaczyk
- Rice University, Department of Bioengineering, 6100 Main Street, Houston, TX 77005-1892, USA
| |
Collapse
|
28
|
Dan D, Yao B, Lei M. Structured illumination microscopy for super-resolution and optical sectioning. ACTA ACUST UNITED AC 2014. [DOI: 10.1007/s11434-014-0181-1] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
|
29
|
Schlichenmeyer TC, Wang M, Elfer KN, Brown JQ. Video-rate structured illumination microscopy for high-throughput imaging of large tissue areas. BIOMEDICAL OPTICS EXPRESS 2014; 5:366-77. [PMID: 24575333 PMCID: PMC3920869 DOI: 10.1364/boe.5.000366] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2013] [Revised: 12/27/2013] [Accepted: 12/28/2013] [Indexed: 05/21/2023]
Abstract
We report the development of a structured illumination microscopy instrument specifically designed for the requirements for high-area-throughput, optically-sectioned imaging of large, fluorescently-stained tissue specimens. The system achieves optical sectioning frame-rates of up to 33 Hz (and pixel sampling rates of up to 138.4 MHz), by combining a fast, ferroelectric spatial light modulator for pattern generation with the latest large-format, high frame-rate scientific CMOS camera technology. Using a 10X 0.45 NA objective and a 7 mm/sec scan stage, we demonstrate 4.4 cm(2)/min area-throughput rates in bright tissue-simulating phantoms, and 2 cm(2)/min area-throughput rates in thick, highly-absorbing, fluorescently-stained muscle tissue, with 1.3 μm lateral resolution. We demonstrate high-contrast, high-resolution imaging of a fluorescently-stained 30.4 cm(2) bovine muscle specimen in 15 minutes comprising 7.55 gigapixels, demonstrating the feasibility of the approach for gigapixel imaging of large tissues in short timeframes, such as would be needed for intraoperative imaging of tumor resection specimens.
Collapse
|
30
|
Li C, Gao L, Liu Y, Wang LV. Optical sectioning by wide-field photobleaching imprinting microscopy. APPLIED PHYSICS LETTERS 2013; 103:183703. [PMID: 24273331 PMCID: PMC3829865 DOI: 10.1063/1.4827535] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2013] [Accepted: 10/08/2013] [Indexed: 06/02/2023]
Abstract
We present a generic wide-field optical sectioning scheme, photobleaching imprinting microscopy (PIM), for depth-resolved cross-sectional fluorescence imaging. Wide-field PIM works by extracting a nonlinear component that depends on the excitation fluence as a result of photobleaching-induced fluorescence decay. Since no specific fluorescent dyes or illumination modules are required, wide-field PIM is easy to implement on a standard microscope. Moreover, wide-field PIM is superior to deconvolution microscopy in removing background fluorescence, yielding a six-fold improvement in image contrast.
Collapse
Affiliation(s)
- Chiye Li
- Optical Imaging Laboratory, Department of Biomedical Engineering, Washington University in St. Louis, One Brookings Dr., St. Louis, Missouri 63130, USA
| | | | | | | |
Collapse
|
31
|
Fu HL, Mueller JL, Javid MP, Mito JK, Kirsch DG, Ramanujam N, Brown JQ. Optimization of a widefield structured illumination microscope for non-destructive assessment and quantification of nuclear features in tumor margins of a primary mouse model of sarcoma. PLoS One 2013; 8:e68868. [PMID: 23894357 PMCID: PMC3720887 DOI: 10.1371/journal.pone.0068868] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2013] [Accepted: 06/02/2013] [Indexed: 11/25/2022] Open
Abstract
Cancer is associated with specific cellular morphological changes, such as increased nuclear size and crowding from rapidly proliferating cells. In situ tissue imaging using fluorescent stains may be useful for intraoperative detection of residual cancer in surgical tumor margins. We developed a widefield fluorescence structured illumination microscope (SIM) system with a single-shot FOV of 2.1×1.6 mm (3.4 mm2) and sub-cellular resolution (4.4 µm). The objectives of this work were to measure the relationship between illumination pattern frequency and optical sectioning strength and signal-to-noise ratio in turbid (i.e. thick) samples for selection of the optimum frequency, and to determine feasibility for detecting residual cancer on tumor resection margins, using a genetically engineered primary mouse model of sarcoma. The SIM system was tested in tissue mimicking solid phantoms with various scattering levels to determine impact of both turbidity and illumination frequency on two SIM metrics, optical section thickness and modulation depth. To demonstrate preclinical feasibility, ex vivo 50 µm frozen sections and fresh intact thick tissue samples excised from a primary mouse model of sarcoma were stained with acridine orange, which stains cell nuclei, skeletal muscle, and collagenous stroma. The cell nuclei were segmented using a high-pass filter algorithm, which allowed quantification of nuclear density. The results showed that the optimal illumination frequency was 31.7 µm−1 used in conjunction with a 4×0.1 NA objective ( = 0.165). This yielded an optical section thickness of 128 µm and an 8.9×contrast enhancement over uniform illumination. We successfully demonstrated the ability to resolve cell nuclei in situ achieved via SIM, which allowed segmentation of nuclei from heterogeneous tissues in the presence of considerable background fluorescence. Specifically, we demonstrate that optical sectioning of fresh intact thick tissues performed equivalently in regards to nuclear density quantification, to physical frozen sectioning and standard microscopy.
Collapse
Affiliation(s)
- Henry L Fu
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA.
| | | | | | | | | | | | | |
Collapse
|