1
|
Yamaguchi A, Wu R, McNulty P, Karagyozov D, Mihovilovic Skanata M, Gershow M. Multi-neuronal recording in unrestrained animals with all acousto-optic random-access line-scanning two-photon microscopy. Front Neurosci 2023; 17:1135457. [PMID: 37389365 PMCID: PMC10303936 DOI: 10.3389/fnins.2023.1135457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 05/18/2023] [Indexed: 07/01/2023] Open
Abstract
To understand how neural activity encodes and coordinates behavior, it is desirable to record multi-neuronal activity in freely behaving animals. Imaging in unrestrained animals is challenging, especially for those, like larval Drosophila melanogaster, whose brains are deformed by body motion. A previously demonstrated two-photon tracking microscope recorded from individual neurons in freely crawling Drosophila larvae but faced limits in multi-neuronal recording. Here we demonstrate a new tracking microscope using acousto-optic deflectors (AODs) and an acoustic GRIN lens (TAG lens) to achieve axially resonant 2D random access scanning, sampling along arbitrarily located axial lines at a line rate of 70 kHz. With a tracking latency of 0.1 ms, this microscope recorded activities of various neurons in moving larval Drosophila CNS and VNC including premotor neurons, bilateral visual interneurons, and descending command neurons. This technique can be applied to the existing two-photon microscope to allow for fast 3D tracking and scanning.
Collapse
Affiliation(s)
- Akihiro Yamaguchi
- Department of Physics, New York University, New York, NY, United States
| | - Rui Wu
- Department of Physics, New York University, New York, NY, United States
| | - Paul McNulty
- Department of Physics, New York University, New York, NY, United States
| | - Doycho Karagyozov
- Department of Physics, New York University, New York, NY, United States
| | | | - Marc Gershow
- Department of Physics, New York University, New York, NY, United States
- Center for Neural Science, New York University, New York, NY, United States
- Neuroscience Institute, New York University, New York, NY, United States
| |
Collapse
|
2
|
You X, Liu J, Li Y, Jiang Y, Liu J. 3D microscopy in industrial measurements. J Microsc 2023; 289:137-156. [PMID: 36427335 DOI: 10.1111/jmi.13161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Revised: 11/19/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
Quality control is essential to ensure the performance and yield of microdevices in industrial processing and manufacturing. In particular, 3D microscopy can be considered as a separate branch of microscopic instruments and plays a pivotal role in monitoring processing quality. For industrial measurements, 3D microscopy is mainly used for both the inspection of critical dimensions to ensure the design performance and detection of defects for improving the yield of microdevices. However, with the progress of advanced manufacturing technology and the increasing demand for high-performance microdevices, 3D microscopy has ushered in new challenges and development opportunities, such as breakthroughs in diffraction limit, 3D characterisation and calibrations of critical dimensions, high-precision detection and physical property determination of defects, and application of artificial intelligence. In this review, we provide a comprehensive survey about the state of the art and challenges in 3D microscopy for industrial measurements, and provide development ideas for future research. By describing techniques and methods with their advantages and limitations, we provide guidance to researchers and developers about the most suitable technique available for their intended industrial measurements.
Collapse
Affiliation(s)
- Xiaoyu You
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Jing Liu
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Yifei Li
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Yong Jiang
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Jian Liu
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| |
Collapse
|
3
|
Hahamovich E, Monin S, Hazan Y, Rosenthal A. Single pixel imaging at megahertz switching rates via cyclic Hadamard masks. Nat Commun 2021; 12:4516. [PMID: 34312397 PMCID: PMC8313532 DOI: 10.1038/s41467-021-24850-x] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2020] [Accepted: 06/21/2021] [Indexed: 12/12/2022] Open
Abstract
Optical imaging is commonly performed with either a camera and wide-field illumination or with a single detector and a scanning collimated beam; unfortunately, these options do not exist at all wavelengths. Single-pixel imaging offers an alternative that can be performed with a single detector and wide-field illumination, potentially enabling imaging applications in which the detection and illumination technologies are immature. However, single-pixel imaging currently suffers from low imaging rates owing to its reliance on configurable spatial light modulators, generally limited to 22 kHz rates. We develop an approach for rapid single-pixel imaging which relies on cyclic patterns coded onto a spinning mask and demonstrate it for in vivo imaging of C. elegans worms. Spatial modulation rates of up to 2.4 MHz, imaging rates of up to 72 fps, and image-reconstruction times of down to 1.5 ms are reported, enabling real-time visualization of dynamic objects.
Collapse
Affiliation(s)
| | - Sagi Monin
- Technion - Israel Institute of Technology, Haifa, Israel
| | - Yoav Hazan
- Technion - Israel Institute of Technology, Haifa, Israel
| | - Amir Rosenthal
- Technion - Israel Institute of Technology, Haifa, Israel.
| |
Collapse
|
4
|
Yamaguchi A, Karagyozov D, Gershow MH. Compact and adjustable compensator for AOD spatial and temporal dispersion using off-the-shelf components. OPTICS LETTERS 2021; 46:1644-1647. [PMID: 33793507 PMCID: PMC8281507 DOI: 10.1364/ol.419682] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 02/26/2021] [Indexed: 06/12/2023]
Abstract
Random access multiphoton microscopy using two orthogonal acousto-optic deflectors (AODs) allows sampling only particular regions of interest within a plane, greatly speeding up the sampling rate. AODs introduce spatial and temporal dispersions, which distort the point spread function and decrease the peak intensity of the pulse. Both of these effects can be compensated for with a single dispersive element placed a distance before the AODs. An additional acousto-optic modulator, a custom cut prism, and a standard prism used with additional cylindrical optics have been demonstrated. All of these introduce additional cost or complexity and require an extended path length to achieve the needed negative group delay dispersion (GDD). By introducing a telescope between a transmission grating and the AODs, we correct for spatial and temporal dispersions in a compact design using only off-the-shelf components, and we show that the GDD can be tuned by translation of the telescope without adjustment of any other elements.
Collapse
Affiliation(s)
- Akihiro Yamaguchi
- Department of Physics and Center for Soft Matter Research, New York University, New York, NY 10003, USA
| | - Doycho Karagyozov
- Department of Physics and Center for Soft Matter Research, New York University, New York, NY 10003, USA
| | - Marc H. Gershow
- Department of Physics and Center for Soft Matter Research, New York University, New York, NY 10003, USA
| |
Collapse
|
5
|
Wang SC, Yang TI, Jheng DY, Hsu CY, Yang TT, Ho TS, Huang SL. Broadband and high-brightness light source: glass-clad Ti:sapphire crystal fiber. OPTICS LETTERS 2015; 40:5594-7. [PMID: 26625059 DOI: 10.1364/ol.40.005594] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
High-brightness near-infrared broadband amplified spontaneous emission (ASE) was generated by glass-clad Ti:sapphire crystal fibers, which were developed using the co-drawing laser-heated pedestal growth method. As much as 29.2 mW of ASE power was generated using 520 nm laser diodes as the excitation source on an a-cut, 18 μm core-diameter Ti:sapphire crystal fiber (CF). The 3 dB bandwidth was 163.8 nm, and the radiance was 53.94 W·mm(-2) sr(-1). The propagation loss of the glass-clad sapphire CF measured using the cutback method was 0.017 cm(-1) at 780 nm. For single-mode applications, more than 100 μW of power was coupled into a SM600 single-mode fiber.
Collapse
|
6
|
Li H, Cui Q, Zhang Z, Fu L, Luo Q. Nonlinear optical microscopy for immunoimaging: a custom optimized system of high-speed, large-area, multicolor imaging. Quant Imaging Med Surg 2015; 5:30-9. [PMID: 25694951 DOI: 10.3978/j.issn.2223-4292.2014.11.07] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2014] [Accepted: 10/31/2014] [Indexed: 01/09/2023]
Abstract
BACKGROUND The nonlinear optical microscopy has become the current state-of-the-art for intravital imaging. Due to its advantages of high resolution, superior tissue penetration, lower photodamage and photobleaching, as well as intrinsic z-sectioning ability, this technology has been widely applied in immunoimaging for a decade. However, in terms of monitoring immune events in native physiological environment, the conventional nonlinear optical microscope system has to be optimized for live animal imaging. Generally speaking, three crucial capabilities are desired, including high-speed, large-area and multicolor imaging. Among numerous high-speed scanning mechanisms used in nonlinear optical imaging, polygon scanning is not only linearly but also dispersion-freely with high stability and tunable rotation speed, which can overcome disadvantages of multifocal scanning, resonant scanner and acousto-optical deflector (AOD). However, low frame rate, lacking large-area or multicolor imaging ability make current polygonbased nonlinear optical microscopes unable to meet the requirements of immune event monitoring. METHODS We built up a polygon-based nonlinear optical microscope system which was custom optimized for immunoimaging with high-speed, large-are and multicolor imaging abilities. RESULTS Firstly, we validated the imaging performance of the system by standard methods. Then, to demonstrate the ability to monitor immune events, migration of immunocytes observed by the system based on typical immunological models such as lymph node, footpad and dorsal skinfold chamber are shown. Finally, we take an outlook for the possible advance of related technologies such as sample stabilization and optical clearing for more stable and deeper intravital immunoimaging. CONCLUSIONS This study will be helpful for optimizing nonlinear optical microscope to obtain more comprehensive and accurate information of immune events.
Collapse
Affiliation(s)
- Hui Li
- 1 Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Britton Chance Center for Biomedical Photonics, Wuhan 430074, China ; 2 MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Quan Cui
- 1 Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Britton Chance Center for Biomedical Photonics, Wuhan 430074, China ; 2 MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Zhihong Zhang
- 1 Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Britton Chance Center for Biomedical Photonics, Wuhan 430074, China ; 2 MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Ling Fu
- 1 Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Britton Chance Center for Biomedical Photonics, Wuhan 430074, China ; 2 MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Qingming Luo
- 1 Wuhan National Laboratory for Optoelectronics-Huazhong University of Science and Technology, Britton Chance Center for Biomedical Photonics, Wuhan 430074, China ; 2 MoE Key Laboratory for Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
7
|
Haist T, Lingel C, Adler R, Osten W. Parallelized genetic optimization of spatial light modulator addressing for diffractive applications. APPLIED OPTICS 2014; 53:1413-1418. [PMID: 24663371 DOI: 10.1364/ao.53.001413] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2013] [Accepted: 01/28/2014] [Indexed: 06/03/2023]
Abstract
We describe a new technique for optimizing the addressing of spatial light modulators in dynamic holographic applications. The method utilizes 200 times parallelization using imaging of subholograms in combination with genetic optimization. Compared to a fixed linear addressing curve for all different gratings, the diffraction efficiency can be improved by up to 25% for a Holoeye Pluto LCoS modulator.
Collapse
|
8
|
Wang Z, Qin W, Shao Y, Ma S, Borg TK, Gao BZ. Pulse splitter-based nonlinear microscopy for live-cardiomyocyte imaging. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2014; 8948. [PMID: 25767692 DOI: 10.1117/12.2041845] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Second harmonic generation (SHG) microscopy is a new imaging technique used in sarcomeric-addition studies. However, during the early stage of cell culture in which sarcomeric additions occur, the neonatal cardiomyocytes that we have been working with are very sensitive to photodamage, the resulting high rate of cell death prevents systematic study of sarcomeric addition using a conventional SHG system. To address this challenge, we introduced use of the pulse-splitter system developed by Na Ji et al. in our two photon excitation fluorescence (TPEF) and SHG hybrid microscope. The system dramatically reduced photodamage to neonatal cardiomyocytes in early stages of culture, greatly increasing cell viability. Thus continuous imaging of live cardiomyocytes was achieved with a stronger laser and for a longer period than has been reported in the literature. The pulse splitter-based TPEF-SHG microscope constructed in this study was demonstrated to be an ideal imaging system for sarcomeric addition-related investigations of neonatal cardiomyocytes in early stages of culture.
Collapse
Affiliation(s)
- Zhonghai Wang
- Department of Bioengineering, COMSET, Clemson University, Clemson, SC 29631, USA
| | - Wan Qin
- Department of Bioengineering, COMSET, Clemson University, Clemson, SC 29631, USA
| | - Yonghong Shao
- Institute of Optoelectronics, Shenzhen University, Shenzhen, Guangdong 518060, PR China
| | - Siyu Ma
- Department of Bioengineering, COMSET, Clemson University, Clemson, SC 29631, USA
| | - Thomas K Borg
- Regenerative Medicine and Cell Biology, Medical University of South Carolina, Charleston, SC 29425, USA
| | - Bruce Z Gao
- Department of Bioengineering, COMSET, Clemson University, Clemson, SC 29631, USA
| |
Collapse
|
9
|
Yan W, Peng X, Qi J, Gao J, Fan S, Wang Q, Qu J, Niu H. Dynamic fluorescence lifetime imaging based on acousto-optic deflectors. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:116004. [PMID: 25375349 DOI: 10.1117/1.jbo.19.11.116004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2014] [Accepted: 10/13/2014] [Indexed: 06/04/2023]
Abstract
We report a dynamic fluorescence lifetime imaging (D-FLIM) system that is based on a pair of acousto-optic deflectors for the random regions of interest (ROI) study in the sample. The two-dimensional acousto-optic deflector devices are used to rapidly scan the femtosecond excitation laser beam across the sample, providing specific random access to the ROI. Our experimental results using standard fluorescent dyes in live cancer cells demonstrate that the D-FLIM system can dynamically monitor the changing process of the microenvironment in the ROI in live biological samples.
Collapse
|
10
|
Qi J, Shao Y, Liu L, Wang K, Chen T, Qu J, Niu H. Fast flexible multiphoton fluorescence lifetime imaging using acousto-optic deflector. OPTICS LETTERS 2013; 38:1697-9. [PMID: 23938915 DOI: 10.1364/ol.38.001697] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
We present a fast and flexible fluorescence lifetime imaging microscopy which uses a two-dimensional acousto-optic deflector to achieve fast beam scanning across the sample and provides random access to the regions of interests (ROI). Experimental results using standard fluorescent dye and biological samples show that this system can make addressable fluorescence lifetime measurements and perform fast and flexible fluorescence lifetime imaging particularly to the discontinuous ROI in the sample.
Collapse
Affiliation(s)
- Jing Qi
- Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Optoelectronic Engineering, Shenzhen University, Shenzhen, China
| | | | | | | | | | | | | |
Collapse
|
11
|
Abstract
Multiphoton microscopy has enabled unprecedented dynamic exploration in living organisms. A significant challenge in biological research is the dynamic imaging of features deep within living organisms, which permits the real-time analysis of cellular structure and function. To make progress in our understanding of biological machinery, optical microscopes must be capable of rapid, targeted access deep within samples at high resolution. In this Review, we discuss the basic architecture of a multiphoton microscope capable of such analysis and summarize the state-of-the-art technologies for the quantitative imaging of biological phenomena.
Collapse
Affiliation(s)
- Erich E. Hoover
- Center for Microintegrated Optics for Advanced Bioimaging and Control, Colorado School of Mines, 1523 Illinois Street, Golden, Colorado 80401, USA
- Department of Physics, Colorado School of Mines, 1523 Illinois Street, Golden, Colorado 80401, USA
| | - Jeff A. Squier
- Center for Microintegrated Optics for Advanced Bioimaging and Control, Colorado School of Mines, 1523 Illinois Street, Golden, Colorado 80401, USA
- Department of Physics, Colorado School of Mines, 1523 Illinois Street, Golden, Colorado 80401, USA
| |
Collapse
|