1
|
Mok AT, Wang T, Zhao S, Kolkman KE, Wu D, Ouzounov DG, Seo C, Wu C, Fetcho JR, Xu C. A Large Field-of-view, Single-cell-resolution Two- and Three-Photon Microscope for Deep Imaging. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.14.566970. [PMID: 38014101 PMCID: PMC10680773 DOI: 10.1101/2023.11.14.566970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
In vivo imaging of large-scale neuron activity plays a pivotal role in unraveling the function of the brain's network. Multiphoton microscopy, a powerful tool for deep-tissue imaging, has received sustained interest in advancing its speed, field of view and imaging depth. However, to avoid thermal damage in scattering biological tissue, field of view decreases exponentially as imaging depth increases. We present a suite of innovations to overcome constraints on the field of view in three-photon microscopy and to perform deep imaging that is inaccessible to two-photon microscopy. These innovations enable us to image neuronal activities in a ~3.5-mm diameter field-of-view at 4 Hz with single-cell resolution and in the deepest cortical layer of mouse brains. We further demonstrate simultaneous large field-of-view two-photon and three-photon imaging, subcortical imaging in the mouse brain, and whole-brain imaging in adult zebrafish. The demonstrated techniques can be integrated into any multiphoton microscope for large-field-of-view and system-level neural circuit research.
Collapse
Affiliation(s)
- Aaron T. Mok
- School of Applied Engineering Physics, Cornell University, NY, USA
- Meining School of Biomedical Engineering, Cornell University, NY, USA
| | - Tianyu Wang
- School of Applied Engineering Physics, Cornell University, NY, USA
| | - Shitong Zhao
- School of Applied Engineering Physics, Cornell University, NY, USA
| | | | - Danni Wu
- Department of Population Health, New York University, NY, USA
| | | | - Changwoo Seo
- Department of Neurobiology and Behavior, Cornell University, NY, USA
| | - Chunyan Wu
- College of Veterinary Medicine, Cornell University, NY, USA
| | - Joseph R. Fetcho
- Department of Neurobiology and Behavior, Cornell University, NY, USA
| | - Chris Xu
- School of Applied Engineering Physics, Cornell University, NY, USA
| |
Collapse
|
2
|
You X, Liu J, Li Y, Jiang Y, Liu J. 3D microscopy in industrial measurements. J Microsc 2023; 289:137-156. [PMID: 36427335 DOI: 10.1111/jmi.13161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Revised: 11/19/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
Quality control is essential to ensure the performance and yield of microdevices in industrial processing and manufacturing. In particular, 3D microscopy can be considered as a separate branch of microscopic instruments and plays a pivotal role in monitoring processing quality. For industrial measurements, 3D microscopy is mainly used for both the inspection of critical dimensions to ensure the design performance and detection of defects for improving the yield of microdevices. However, with the progress of advanced manufacturing technology and the increasing demand for high-performance microdevices, 3D microscopy has ushered in new challenges and development opportunities, such as breakthroughs in diffraction limit, 3D characterisation and calibrations of critical dimensions, high-precision detection and physical property determination of defects, and application of artificial intelligence. In this review, we provide a comprehensive survey about the state of the art and challenges in 3D microscopy for industrial measurements, and provide development ideas for future research. By describing techniques and methods with their advantages and limitations, we provide guidance to researchers and developers about the most suitable technique available for their intended industrial measurements.
Collapse
Affiliation(s)
- Xiaoyu You
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Jing Liu
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Yifei Li
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Yong Jiang
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| | - Jian Liu
- Advanced Microscopy and Instrumentation Research Centre, Harbin Institute of Technology, Harbin, Heilongjiang, China.,State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Lab of Ultra-Precision Intelligent Instrumentation Ministry of Industry and Information Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China.,Key Laboratory of Microsystems and Microstructures Manufacturing Ministry of Education, Harbin Institute of Technology, Harbin, Heilongjiang, China
| |
Collapse
|
3
|
Zhu X, Huang Q, DiSpirito A, Vu T, Rong Q, Peng X, Sheng H, Shen X, Zhou Q, Jiang L, Hoffmann U, Yao J. Real-time whole-brain imaging of hemodynamics and oxygenation at micro-vessel resolution with ultrafast wide-field photoacoustic microscopy. LIGHT, SCIENCE & APPLICATIONS 2022; 11:138. [PMID: 35577780 PMCID: PMC9110749 DOI: 10.1038/s41377-022-00836-2] [Citation(s) in RCA: 42] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Revised: 04/27/2022] [Accepted: 05/04/2022] [Indexed: 05/10/2023]
Abstract
High-speed high-resolution imaging of the whole-brain hemodynamics is critically important to facilitating neurovascular research. High imaging speed and image quality are crucial to visualizing real-time hemodynamics in complex brain vascular networks, and tracking fast pathophysiological activities at the microvessel level, which will enable advances in current queries in neurovascular and brain metabolism research, including stroke, dementia, and acute brain injury. Further, real-time imaging of oxygen saturation of hemoglobin (sO2) can capture fast-paced oxygen delivery dynamics, which is needed to solve pertinent questions in these fields and beyond. Here, we present a novel ultrafast functional photoacoustic microscopy (UFF-PAM) to image the whole-brain hemodynamics and oxygenation. UFF-PAM takes advantage of several key engineering innovations, including stimulated Raman scattering (SRS) based dual-wavelength laser excitation, water-immersible 12-facet-polygon scanner, high-sensitivity ultrasound transducer, and deep-learning-based image upsampling. A volumetric imaging rate of 2 Hz has been achieved over a field of view (FOV) of 11 × 7.5 × 1.5 mm3 with a high spatial resolution of ~10 μm. Using the UFF-PAM system, we have demonstrated proof-of-concept studies on the mouse brains in response to systemic hypoxia, sodium nitroprusside, and stroke. We observed the mouse brain's fast morphological and functional changes over the entire cortex, including vasoconstriction, vasodilation, and deoxygenation. More interestingly, for the first time, with the whole-brain FOV and micro-vessel resolution, we captured the vasoconstriction and hypoxia simultaneously in the spreading depolarization (SD) wave. We expect the new imaging technology will provide a great potential for fundamental brain research under various pathological and physiological conditions.
Collapse
Affiliation(s)
- Xiaoyi Zhu
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Qiang Huang
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
- Department of Pediatric Surgery, Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Anthony DiSpirito
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Tri Vu
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Qiangzhou Rong
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Xiaorui Peng
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Huaxin Sheng
- Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA, 90033, USA
| | - Xiling Shen
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Qifa Zhou
- Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA, 90033, USA
- Department of Biomedical Engineering, University of Southern California, Los Angeles, CA, 90089, USA
| | - Laiming Jiang
- Roski Eye Institute, Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA, 90033, USA.
- Department of Biomedical Engineering, University of Southern California, Los Angeles, CA, 90089, USA.
| | - Ulrike Hoffmann
- Department of Anesthesiology, Duke University, Durham, NC, 27708, USA.
| | - Junjie Yao
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA.
| |
Collapse
|
4
|
Tang EM, Tao YK. Modeling and optimization of galvanometric point-scanning temporal dynamics. BIOMEDICAL OPTICS EXPRESS 2021; 12:6701-6716. [PMID: 34858675 PMCID: PMC8606146 DOI: 10.1364/boe.430586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 09/21/2021] [Accepted: 09/27/2021] [Indexed: 05/02/2023]
Abstract
Galvanometers are ubiquitous in point-scanning applications in optical imaging, display, ranging, manufacturing, and therapeutic technologies. However, galvanometer performance is constrained by finite response times related to mirror size and material properties. We present a model-driven approach for optimizing galvanometer response characteristics by tuning the parameters of the closed-loop galvanometer controller and demonstrate settling time reduction by over 50%. As an imaging proof-of-concept, we implement scan waveforms that take advantage of the optimized galvanometer frequency response to increase linear field-of-view, signal-to-noise ratio, contrast-to-noise ratio, and speed. The hardware methods presented may be directly implemented on galvanometer controllers without the need for specialized equipment and used in conjunction with customized scan waveforms to further optimize scanning performance.
Collapse
|
5
|
Li Y, Lim YJ, Xu Q, Beattie L, Gardiner EE, Gaus K, Heath WR, Lee WM. Raster adaptive optics for video rate aberration correction and large FOV multiphoton imaging. BIOMEDICAL OPTICS EXPRESS 2020; 11:1032-1042. [PMID: 32206400 PMCID: PMC7041464 DOI: 10.1364/boe.377044] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/12/2019] [Revised: 01/09/2020] [Accepted: 01/13/2020] [Indexed: 05/27/2023]
Abstract
Removal of complex aberrations at millisecond time scales over millimeters in distance in multiphoton laser scanning microscopy limits the total spatiotemporal imaging throughput for deep tissue imaging. Using a single low resolution deformable mirror and time multiplexing (TM) adaptive optics, we demonstrate video rate aberration correction (5 ms update rate for a single wavefront mask) for a complex heterogeneous distribution of refractive index differences through a depth of up to 1.1 mm and an extended imaging FOV of up to 0.8 mm, with up to 167% recovery of fluorescence intensity 335 µm from the center of the FOV. The proposed approach, termed raster adaptive optics (RAO), integrates image-based aberration retrieval and video rate removal of arbitrarily defined regions of dominant, spatially varied wavefronts. The extended FOV was achieved by demonstrating rapid recovery of up to 50 distinct wavefront masks at 500 ms update rates that increased imaging throughput by 2.3-fold. Because RAO only requires a single deformable mirror with image-based aberration retrieval, it can be directly implemented on a standard laser scanning multiphoton microscope.
Collapse
Affiliation(s)
- Yongxiao Li
- Research School of Electrical, Energy and Materials Engineering, College of Engineering and Computer Science, The Australian National University, 31 North Road, Canberra, ACT, 2601, Australia
| | - Yean J. Lim
- Research School of Electrical, Energy and Materials Engineering, College of Engineering and Computer Science, The Australian National University, 31 North Road, Canberra, ACT, 2601, Australia
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, 131 Garran Road, Canberra, ACT, 2601, Australia
| | - Qiongkai Xu
- Research School of Computer Science, College of Engineering and Computer Science, The Australian National University, 31 North Road, Canberra, ACT, 2601, Australia
| | - Lynette Beattie
- Department of Microbiology and Immunology, The University of Melbourne, at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, 3000, Australia
- ARC Centre of Excellence in Advanced Molecular Imaging, The University of Melbourne, Victoria, 3010, Australia
| | - Elizabeth E. Gardiner
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, 131 Garran Road, Canberra, ACT, 2601, Australia
| | - Katharina Gaus
- EMBL Australia Node in Single Molecule Science and ARC Centre of Excellence in Advanced Molecular Imaging, The University of New South Wales, NSW, 2052, Australia
| | - William R. Heath
- Department of Microbiology and Immunology, The University of Melbourne, at the Peter Doherty Institute for Infection and Immunity, Melbourne, Victoria, 3000, Australia
- ARC Centre of Excellence in Advanced Molecular Imaging, The University of Melbourne, Victoria, 3010, Australia
| | - Woei Ming Lee
- Research School of Electrical, Energy and Materials Engineering, College of Engineering and Computer Science, The Australian National University, 31 North Road, Canberra, ACT, 2601, Australia
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, 131 Garran Road, Canberra, ACT, 2601, Australia
- ARC Centre of Excellence in Advanced Molecular Imaging, The Australian National University, ACT, 2601, Australia
| |
Collapse
|
6
|
Montague SJ, Lim YJ, Lee WM, Gardiner EE. Imaging Platelet Processes and Function-Current and Emerging Approaches for Imaging in vitro and in vivo. Front Immunol 2020; 11:78. [PMID: 32082328 PMCID: PMC7005007 DOI: 10.3389/fimmu.2020.00078] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2019] [Accepted: 01/13/2020] [Indexed: 12/22/2022] Open
Abstract
Platelets are small anucleate cells that are essential for many biological processes including hemostasis, thrombosis, inflammation, innate immunity, tumor metastasis, and wound healing. Platelets circulate in the blood and in order to perform all of their biological roles, platelets must be able to arrest their movement at an appropriate site and time. Our knowledge of how platelets achieve this has expanded as our ability to visualize and quantify discreet platelet events has improved. Platelets are exquisitely sensitive to changes in blood flow parameters and so the visualization of rapid intricate platelet processes under conditions found in flowing blood provides a substantial challenge to the platelet imaging field. The platelet's size (~2 μm), rapid activation (milliseconds), and unsuitability for genetic manipulation, means that appropriate imaging tools are limited. However, with the application of modern imaging systems to study platelet function, our understanding of molecular events mediating platelet adhesion from a single-cell perspective, to platelet recruitment and activation, leading to thrombus (clot) formation has expanded dramatically. This review will discuss current platelet imaging techniques in vitro and in vivo, describing how the advancements in imaging have helped answer/expand on platelet biology with a particular focus on hemostasis. We will focus on platelet aggregation and thrombus formation, and how platelet imaging has enhanced our understanding of key events, highlighting the knowledge gained through the application of imaging modalities to experimental models in vitro and in vivo. Furthermore, we will review the limitations of current imaging techniques, and questions in thrombosis research that remain to be addressed. Finally, we will speculate how the same imaging advancements might be applied to the imaging of other vascular cell biological functions and visualization of dynamic cell-cell interactions.
Collapse
Affiliation(s)
- Samantha J. Montague
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| | - Yean J. Lim
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
- Research School of Electrical, Energy and Materials Engineering, The Australian National University, Canberra, ACT, Australia
| | - Woei M. Lee
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
- Research School of Electrical, Energy and Materials Engineering, The Australian National University, Canberra, ACT, Australia
| | - Elizabeth E. Gardiner
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| |
Collapse
|
7
|
Weisenburger S, Vaziri A. A Guide to Emerging Technologies for Large-Scale and Whole-Brain Optical Imaging of Neuronal Activity. Annu Rev Neurosci 2018; 41:431-452. [PMID: 29709208 PMCID: PMC6037565 DOI: 10.1146/annurev-neuro-072116-031458] [Citation(s) in RCA: 66] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
The mammalian brain is a densely interconnected network that consists of millions to billions of neurons. Decoding how information is represented and processed by this neural circuitry requires the ability to capture and manipulate the dynamics of large populations at high speed and high resolution over a large area of the brain. Although the use of optical approaches by the neuroscience community has rapidly increased over the past two decades, most microscopy approaches are unable to record the activity of all neurons comprising a functional network across the mammalian brain at relevant temporal and spatial resolutions. In this review, we survey the recent development in optical technologies for Ca2+ imaging in this regard and provide an overview of the strengths and limitations of each modality and its potential for scalability. We provide guidance from the perspective of a biological user driven by the typical biological applications and sample conditions. We also discuss the potential for future advances and synergies that could be obtained through hybrid approaches or other modalities.
Collapse
Affiliation(s)
- Siegfried Weisenburger
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, New York 10065, USA
| | - Alipasha Vaziri
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, New York 10065, USA
- Kavli Neural Systems Institute, The Rockefeller University, New York, New York 10065, USA
- Research Institute of Molecular Pathology, 1030 Vienna, Austria;
| |
Collapse
|
8
|
Li Y, Montague SJ, Brüstle A, He X, Gillespie C, Gaus K, Gardiner EE, Lee WM. High contrast imaging and flexible photomanipulation for quantitative in vivo multiphoton imaging with polygon scanning microscope. JOURNAL OF BIOPHOTONICS 2018; 11:e201700341. [PMID: 29488344 DOI: 10.1002/jbio.201700341] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2017] [Accepted: 02/26/2018] [Indexed: 06/08/2023]
Abstract
In this study, we introduce two key improvements that overcome limitations of existing polygon scanning microscopes while maintaining high spatial and temporal imaging resolution over large field of view (FOV). First, we proposed a simple and straightforward means to control the scanning angle of the polygon mirror to carry out photomanipulation without resorting to high speed optical modulators. Second, we devised a flexible data sampling method directly leading to higher image contrast by over 2-fold and digital images with 100 megapixels (10 240 × 10 240) per frame at 0.25 Hz. This generates sub-diffraction limited pixels (60 nm per pixels over the FOV of 512 μm) which increases the degrees of freedom to extract signals computationally. The unique combined optical and digital control recorded fine fluorescence recovery after localized photobleaching (r ~10 μm) within fluorescent giant unilamellar vesicles and micro-vascular dynamics after laser-induced injury during thrombus formation in vivo. These new improvements expand the quantitative biological-imaging capacity of any polygon scanning microscope system.
Collapse
Affiliation(s)
- Yongxiao Li
- Research School of Engineering, College of Engineering and Computer Science, The Australian National University, Canberra, ACT, Australia
| | - Samantha J Montague
- Research School of Engineering, College of Engineering and Computer Science, The Australian National University, Canberra, ACT, Australia
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| | - Anne Brüstle
- Department of Immunology and Infectious Disease, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| | - Xuefei He
- Research School of Engineering, College of Engineering and Computer Science, The Australian National University, Canberra, ACT, Australia
| | - Cathy Gillespie
- Imaging and Cytometry Facility, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| | - Katharina Gaus
- EMBL Australia Node in Single Molecule Science, School of Medical Sciences, University of New South Wales, Sydney, NSW, Australia
- Australia Research Council Centre of Excellence in Advanced Molecular Imaging, University of New South Wales, Sydney, NSW, Australia
| | - Elizabeth E Gardiner
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
| | - Woei Ming Lee
- Research School of Engineering, College of Engineering and Computer Science, The Australian National University, Canberra, ACT, Australia
- ACRF Department of Cancer Biology and Therapeutics, The John Curtin School of Medical Research, The Australian National University, Canberra, ACT, Australia
- ARC Centre of Excellence in Advanced Molecular Imaging, The Australian National University, Canberra, ACT, Australia
| |
Collapse
|