1
|
Zhang Y. Deep learning-enhanced microscopy with extended depth-of-field. LIGHT, SCIENCE & APPLICATIONS 2023; 12:284. [PMID: 37996459 PMCID: PMC10667531 DOI: 10.1038/s41377-023-01323-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2023]
Abstract
A computational imaging platform utilizing a physics-incorporated, deep-learned design of binary phase filter and a jointly optimized deconvolution neural network has been reported, achieving high-resolution, high-contrast imaging over extended depth ranges without the need for serial refocusing.
Collapse
Affiliation(s)
- Yide Zhang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA.
| |
Collapse
|
2
|
Seong B, Kim W, Kim Y, Hyun KA, Jung HI, Lee JS, Yoo J, Joo C. E2E-BPF microscope: extended depth-of-field microscopy using learning-based implementation of binary phase filter and image deconvolution. LIGHT, SCIENCE & APPLICATIONS 2023; 12:269. [PMID: 37953314 PMCID: PMC10641084 DOI: 10.1038/s41377-023-01300-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 09/09/2023] [Accepted: 10/07/2023] [Indexed: 11/14/2023]
Abstract
Several image-based biomedical diagnoses require high-resolution imaging capabilities at large spatial scales. However, conventional microscopes exhibit an inherent trade-off between depth-of-field (DoF) and spatial resolution, and thus require objects to be refocused at each lateral location, which is time consuming. Here, we present a computational imaging platform, termed E2E-BPF microscope, which enables large-area, high-resolution imaging of large-scale objects without serial refocusing. This method involves a physics-incorporated, deep-learned design of binary phase filter (BPF) and jointly optimized deconvolution neural network, which altogether produces high-resolution, high-contrast images over extended depth ranges. We demonstrate the method through numerical simulations and experiments with fluorescently labeled beads, cells and tissue section, and present high-resolution imaging capability over a 15.5-fold larger DoF than the conventional microscope. Our method provides highly effective and scalable strategy for DoF-extended optical imaging system, and is expected to find numerous applications in rapid image-based diagnosis, optical vision, and metrology.
Collapse
Affiliation(s)
- Baekcheon Seong
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Woovin Kim
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Younghun Kim
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Kyung-A Hyun
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Hyo-Il Jung
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
- The DABOM Inc, Seoul, 03722, Republic of Korea
| | - Jong-Seok Lee
- School of Integrated Technology, Yonsei University, Incheon, 21983, Republic of Korea
| | - Jeonghoon Yoo
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Chulmin Joo
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea.
| |
Collapse
|
3
|
Mac KD, Qureshi MM, Na M, Chang S, Eom TJ, Je HS, Kim YR, Kwon HS, Chung E. Fast volumetric imaging with line-scan confocal microscopy by electrically tunable lens at resonant frequency. OPTICS EXPRESS 2022; 30:19152-19164. [PMID: 36221700 PMCID: PMC9363030 DOI: 10.1364/oe.450745] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 04/25/2022] [Accepted: 04/26/2022] [Indexed: 05/20/2023]
Abstract
In microscopic imaging of biological tissues, particularly real-time visualization of neuronal activities, rapid acquisition of volumetric images poses a prominent challenge. Typically, two-dimensional (2D) microscopy can be devised into an imaging system with 3D capability using any varifocal lens. Despite the conceptual simplicity, such an upgrade yet requires additional, complicated device components and usually suffers from a reduced acquisition rate, which is critical to properly document rapid neurophysiological dynamics. In this study, we implemented an electrically tunable lens (ETL) in the line-scan confocal microscopy (LSCM), enabling the volumetric acquisition at the rate of 20 frames per second with a maximum volume of interest of 315 × 315 × 80 µm3. The axial extent of point-spread-function (PSF) was 17.6 ± 1.6 µm and 90.4 ± 2.1 µm with the ETL operating in either stationary or resonant mode, respectively, revealing significant depth axial penetration by the resonant mode ETL microscopy. We further demonstrated the utilities of the ETL system by volume imaging of both cleared mouse brain ex vivo samples and in vivo brains. The current study showed a successful application of resonant ETL for constructing a high-performance 3D axially scanning LSCM (asLSCM) system. Such advances in rapid volumetric imaging would significantly enhance our understanding of various dynamic biological processes.
Collapse
Affiliation(s)
- Khuong Duy Mac
- Department of Biomedical Science and Engineering, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| | | | - Myeongsu Na
- Department of Physiology and Biomedical Sciences, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, Republic of Korea
| | - Sunghoe Chang
- Department of Physiology and Biomedical Sciences, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, Republic of Korea
- Neuroscience Research Institute, Seoul National University College of Medicine, 103 Daehak-ro, Jongno-gu, 03080 Seoul, Republic of Korea
| | - Tae Joong Eom
- Department of Cogno-Mechatronics Engineering, Pusan National University, Busan, 46241, Republic of Korea
- Engineering Research Center (ERC) for Color-modulated Extra-sensory Perception Technology, Pusan National University, Busan, 46241, Republic of Korea
| | - Hyunsoo Shawn Je
- Signature Program in Neuroscience and Behavioural Disorders, Duke-National University of Singapore (NUS) Medical School, 8 College Road 169857, Singapore
- Advanced Bioimaging Center, Academia, Ngee Ann Kongsi Discovery Tower Level 10, 20 College Road, 169855, Singapore
| | - Young Ro Kim
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, Massachusetts 02129, USA
- Department of Radiology, Harvard Medical School, Boston, Massachusetts 02115, USA
| | - Hyuk-Sang Kwon
- Department of Biomedical Science and Engineering, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| | - Euiheon Chung
- Department of Biomedical Science and Engineering, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
- AI Graduate School, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
- Research Center for Photon Science Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| |
Collapse
|
4
|
Ebrahimi V, Tang J, Han KY. Incoherent superposition of polychromatic light enables single-shot nondiffracting light-sheet microscopy. OPTICS EXPRESS 2021; 29:32691-32699. [PMID: 34615334 PMCID: PMC8687099 DOI: 10.1364/oe.439338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 09/09/2021] [Accepted: 09/10/2021] [Indexed: 06/13/2023]
Abstract
We demonstrate single-shot nondiffracting light-sheet microscopy by the incoherent superposition of dispersed polychromatic light sources. We characterized our technique by generating a Bessel light-sheet with a supercontinuum light-source and a C-light-sheet using a diode laser, and demonstrated its applicability to fluorescence microscopy. We emphasize that our method is easily implementable and compatible with the requirements of high-resolution microscopy.
Collapse
Affiliation(s)
- Vahid Ebrahimi
- CREOL, The College of Optics and Photonics, University of Central Florida, Orlando, FL 32816, USA
- These authors contributed equally to this work
| | - Jialei Tang
- CREOL, The College of Optics and Photonics, University of Central Florida, Orlando, FL 32816, USA
- These authors contributed equally to this work
| | - Kyu Young Han
- CREOL, The College of Optics and Photonics, University of Central Florida, Orlando, FL 32816, USA
| |
Collapse
|
5
|
Deng S, Ding Z, Yuan D, Liu M, Zhou H. Investigation of the extended focusing capability of the spherical aberration to enlarge the field of view in light-sheet fluorescence microscopy. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2021; 38:19-24. [PMID: 33362148 DOI: 10.1364/josaa.410209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2020] [Accepted: 11/11/2020] [Indexed: 06/12/2023]
Abstract
In light-sheet fluorescence microscopy (LSFM), using Gaussian beams for light-sheet generation results in a trade-off between the thickness and the field of view (FOV). Here we present a theoretical analysis of using spherical aberration to enlarge the FOV while keeping the light-sheet thickness small. Such spherical aberration can arise when focusing beams through an interface between materials of mismatched refractive indices. The depth-of-focus extension of the Gaussian beam is achieved when using air objectives to focus light into the samples dipped in the immersion medium with a higher refractive index. By scanning this elongated beam, a thin light sheet with a wide FOV can be used for LSFM imaging. Meanwhile, the accompanied sidelobes with the spherical aberrated light sheet, which are mainly distributed in the rear part of the light sheet, are also discussed. Simulation results show that an extended FOV of 64.4µm is possible for an objective lens of NA=0.3, which is about 5 times that of the unaberrated case. For such an extended FOV, a comparatively thin thickness of 1.38µm as well as the first sidelobe about 11.1% of the peak intensity in the center are also demonstrated.
Collapse
|