1
|
Daetwyler S, Fiolka RP. Light-sheets and smart microscopy, an exciting future is dawning. Commun Biol 2023; 6:502. [PMID: 37161000 PMCID: PMC10169780 DOI: 10.1038/s42003-023-04857-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Accepted: 04/20/2023] [Indexed: 05/11/2023] Open
Abstract
Light-sheet fluorescence microscopy has transformed our ability to visualize and quantitatively measure biological processes rapidly and over long time periods. In this review, we discuss current and future developments in light-sheet fluorescence microscopy that we expect to further expand its capabilities. This includes smart and adaptive imaging schemes to overcome traditional imaging trade-offs, i.e., spatiotemporal resolution, field of view and sample health. In smart microscopy, a microscope will autonomously decide where, when, what and how to image. We further assess how image restoration techniques provide avenues to overcome these tradeoffs and how "open top" light-sheet microscopes may enable multi-modal imaging with high throughput. As such, we predict that light-sheet microscopy will fulfill an important role in biomedical and clinical imaging in the future.
Collapse
Affiliation(s)
- Stephan Daetwyler
- Lyda Hill Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX, USA
- Department of Cell Biology, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | - Reto Paul Fiolka
- Lyda Hill Department of Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX, USA.
- Department of Cell Biology, University of Texas Southwestern Medical Center, Dallas, TX, USA.
| |
Collapse
|
2
|
Li B, Zhu L, Li B, Feng W, Lian X, Ji X. Efficient framework of solving time-gated reflection matrix for imaging through turbid medium. OPTICS EXPRESS 2023; 31:15461-15473. [PMID: 37157647 DOI: 10.1364/oe.488257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Imaging through turbid medium is a long pursuit in many research fields, such as biomedicine, astronomy and automatic vehicle, in which the reflection matrix-based method is a promising solution. However, the epi-detection geometry suffers from round-trip distortion and it is challenging to isolate the input and output aberrations in non-ideal cases due to system imperfections and measurement noises. Here, we present an efficient framework based on single scattering accumulation together with phase unwrapping that can accurately separate input and output aberrations from the noise-affected reflection matrix. We propose to only correct the output aberration while suppressing the input aberration by incoherent averaging. The proposed method is faster in convergence and more robust against noise, avoiding precise and tedious system adjustments. In both simulations and experiments, we demonstrate the diffraction-limited resolution capability under optical thickness beyond 10 scattering mean free paths, showing the potential of applications in neuroscience and dermatology.
Collapse
|
3
|
Zhang Q, Hu Q, Berlage C, Kner P, Judkewitz B, Booth M, Ji N. Adaptive optics for optical microscopy [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:1732-1756. [PMID: 37078027 PMCID: PMC10110298 DOI: 10.1364/boe.479886] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 05/03/2023]
Abstract
Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.
Collapse
Affiliation(s)
- Qinrong Zhang
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| | - Qi Hu
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Caroline Berlage
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
- Humboldt-Universität zu Berlin, Institute for Biology, 10099 Berlin, Germany
| | - Peter Kner
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602, USA
| | - Benjamin Judkewitz
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
| | - Martin Booth
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Na Ji
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| |
Collapse
|
4
|
Vishniakou I, Seelig JD. Differentiable model-based adaptive optics with transmitted and reflected light. OPTICS EXPRESS 2020; 28:26436-26446. [PMID: 32906916 DOI: 10.1364/oe.403487] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 08/17/2020] [Indexed: 06/11/2023]
Abstract
Aberrations limit optical systems in many situations, for example when imaging in biological tissue. Machine learning offers novel ways to improve imaging under such conditions by learning inverse models of aberrations. Learning requires datasets that cover a wide range of possible aberrations, which however becomes limiting for more strongly scattering samples, and does not take advantage of prior information about the imaging process. Here, we show that combining model-based adaptive optics with the optimization techniques of machine learning frameworks can find aberration corrections with a small number of measurements. Corrections are determined in a transmission configuration through a single aberrating layer and in a reflection configuration through two different layers at the same time. Additionally, corrections are not limited by a predetermined model of aberrations (such as combinations of Zernike modes). Focusing in transmission can be achieved based only on reflected light, compatible with an epidetection imaging configuration.
Collapse
|
5
|
Badon A, Barolle V, Irsch K, Boccara AC, Fink M, Aubry A. Distortion matrix concept for deep optical imaging in scattering media. SCIENCE ADVANCES 2020; 6:eaay7170. [PMID: 32923603 PMCID: PMC7455485 DOI: 10.1126/sciadv.aay7170] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2019] [Accepted: 06/05/2020] [Indexed: 05/03/2023]
Abstract
In optical imaging, light propagation is affected by the inhomogeneities of the medium. Sample-induced aberrations and multiple scattering can strongly degrade the image resolution and contrast. On the basis of a dynamic correction of the incident and/or reflected wavefronts, adaptive optics has been used to compensate for those aberrations. However, it only applies to spatially invariant aberrations or to thin aberrating layers. Here, we propose a global and noninvasive approach based on the distortion matrix concept. This matrix basically connects any focusing point of the image with the distorted part of its wavefront in reflection. A singular value decomposition of the distortion matrix allows to correct for high-order aberrations and forward multiple scattering over multiple isoplanatic modes. Proof-of-concept experiments are performed through biological tissues including a turbid cornea. We demonstrate a Strehl ratio enhancement up to 2500 and recover a diffraction-limited resolution until a depth of 10 scattering mean free paths.
Collapse
Affiliation(s)
- Amaury Badon
- Institut Langevin, ESPCI Paris, PSL University, CNRS, 1 rue Jussieu, 75005 Paris, France
| | - Victor Barolle
- Institut Langevin, ESPCI Paris, PSL University, CNRS, 1 rue Jussieu, 75005 Paris, France
| | - Kristina Irsch
- Vision Institute/Quinze-Vingts National Eye Hospital, Sorbonne University, CNRS UMR 7210, INSERM U 068, 17 rue Moreau, 75012 Paris, France
- The Wilmer Eye Institute, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - A. Claude Boccara
- Institut Langevin, ESPCI Paris, PSL University, CNRS, 1 rue Jussieu, 75005 Paris, France
| | - Mathias Fink
- Institut Langevin, ESPCI Paris, PSL University, CNRS, 1 rue Jussieu, 75005 Paris, France
| | - Alexandre Aubry
- Institut Langevin, ESPCI Paris, PSL University, CNRS, 1 rue Jussieu, 75005 Paris, France
- Corresponding author.
| |
Collapse
|
6
|
Vishniakou I, Seelig JD. Wavefront correction for adaptive optics with reflected light and deep neural networks. OPTICS EXPRESS 2020; 28:15459-15471. [PMID: 32403573 DOI: 10.1364/oe.392794] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Light scattering and aberrations limit optical microscopy in biological tissue, which motivates the development of adaptive optics techniques. Here, we develop a method for wavefront correction in adaptive optics with reflected light and deep neural networks compatible with an epi-detection configuration. Large datasets of sample aberrations which consist of excitation and detection path aberrations as well as the corresponding reflected focus images are generated. These datasets are used for training deep neural networks. After training, these networks can disentangle and independently correct excitation and detection aberrations based on reflected light images recorded from scattering samples. A similar deep learning approach is also demonstrated with scattering guide stars. The predicted aberration corrections are validated using two photon imaging.
Collapse
|
7
|
Rajaeipour P, Dorn A, Banerjee K, Zappe H, Ataman Ç. Extended field-of-view adaptive optics in microscopy via numerical field segmentation. APPLIED OPTICS 2020; 59:3784-3791. [PMID: 32400506 DOI: 10.1364/ao.388000] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 03/19/2020] [Indexed: 06/11/2023]
Abstract
Sample-induced optical aberrations in microscopy are, in general, field dependent, limiting their correction via pupil adaptive optics (AO) to the center of the available field-of-view (FoV). This is a major hindrance, particularly for deep tissue imaging, where AO has a significant impact. We present a new wide-field AO microscopy scheme, in which the deformable element is located at the pupil plane of the objective. To maintain high-quality correction across its entirety, the FoV is partitioned into small segments, and a separate aberration estimation is performed for each via a modal-decomposition-based indirect wavefront sensing algorithm. A final full-field image is synthesized by stitching of the partitions corrected consecutively and independently via their respective measured aberrations. The performance and limitations of the method are experimentally explored on synthetic samples imaged via a custom-developed AO fluorescence microscope featuring an optofluidic refractive wavefront modulator.
Collapse
|
8
|
Zhang H, Yarinome K, Kawakami R, Otomo K, Nemoto T, Okamura Y. Nanosheet wrapping-assisted coverslip-free imaging for looking deeper into a tissue at high resolution. PLoS One 2020; 15:e0227650. [PMID: 31923215 PMCID: PMC6953877 DOI: 10.1371/journal.pone.0227650] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Accepted: 12/22/2019] [Indexed: 12/19/2022] Open
Abstract
In order to achieve deep tissue imaging, a number of optical clearing agents have been developed. However, in a conventional microscopy setup, an objective lens can only be moved until it is in contact with a coverslip, which restricts the maximum focusing depth into a cleared tissue specimen. Until now, it is still a fact that the working distance of a high magnification objective lens with a high numerical aperture is always about 100 μm. In this study, a polymer thin film (also called as nanosheet) composed of fluoropolymer with a thickness of 130 nm, less than one-thousandth that of a 170 μm thick coverslip, is employed to replace the coverslip. Owing to its excellent characteristics, such as high optical transparency, mechanical robustness, chemical resistance, and water retention ability, nanosheet is uniquely capable of providing a coverslip-free imaging. By wrapping the tissue specimen with a nanosheet, an extra distance of 170 μm for the movement of objective lens is obtained. Results show an equivalently high resolution imaging can be obtained if a homogenous refractive index between immersion liquid and mounting media is adjusted. This method will facilitate a variety of imaging tasks with off-the-shelf high magnification objectives.
Collapse
Affiliation(s)
- Hong Zhang
- Department of Applied Chemistry, School of Engineering, Tokai University, Kanagawa, Japan
- Micro/Nano Technology Center, Tokai University, Kanagawa, Japan
| | - Kenji Yarinome
- Course of Applied Science, Graduate School of Engineering, Tokai University, Kanagawa, Japan
| | - Ryosuke Kawakami
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
- Department of Molecular Medicine for Pathogenesis, Ehime University Graduate School of Medicine, Ehime, Japan
| | - Kohei Otomo
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
- Exploratory Research Center on Life and Living Systems, National Institute of Natural Sciences, Aichi, Japan
- National Institute for Physiological Sciences, Aichi, Japan
- The Graduate University for Advanced Studies (SOKENDAI), Aichi, Japan
| | - Tomomi Nemoto
- Research Institute for Electronic Science, Hokkaido University, Sapporo, Japan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
- Exploratory Research Center on Life and Living Systems, National Institute of Natural Sciences, Aichi, Japan
- National Institute for Physiological Sciences, Aichi, Japan
- The Graduate University for Advanced Studies (SOKENDAI), Aichi, Japan
| | - Yosuke Okamura
- Department of Applied Chemistry, School of Engineering, Tokai University, Kanagawa, Japan
- Micro/Nano Technology Center, Tokai University, Kanagawa, Japan
- Course of Applied Science, Graduate School of Engineering, Tokai University, Kanagawa, Japan
| |
Collapse
|
9
|
Tehrani KF, Latchoumane CV, Southern WM, Pendleton EG, Maslesa A, Karumbaiah L, Call JA, Mortensen LJ. Five-dimensional two-photon volumetric microscopy of in-vivo dynamic activities using liquid lens remote focusing. BIOMEDICAL OPTICS EXPRESS 2019; 10:3591-3604. [PMID: 31360606 PMCID: PMC6640832 DOI: 10.1364/boe.10.003591] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2019] [Revised: 05/29/2019] [Accepted: 06/04/2019] [Indexed: 05/08/2023]
Abstract
Multi-photon scanning microscopy provides a robust tool for optical sectioning, which can be used to capture fast biological events such as blood flow, mitochondrial activity, and neuronal action potentials. For many studies, it is important to visualize several different focal planes at a rate akin to the biological event frequency. Typically, a microscope is equipped with mechanical elements to move either the sample or the objective lens to capture volumetric information, but these strategies are limited due to their slow speeds or inertial artifacts. To overcome this problem, remote focusing methods have been developed to shift the focal plane axially without physical movement of the sample or the microscope. Among these methods is liquid lens technology, which adjusts the focus of the lens by changing the wettability of the liquid and hence its curvature. Liquid lenses are inexpensive active optical elements that have the potential for fast multi-photon volumetric imaging, hence a promising and accessible approach for the study of biological systems with complex dynamics. Although remote focusing using liquid lens technology can be used for volumetric point scanning multi-photon microscopy, optical aberrations and the effects of high energy laser pulses have been concerns in its implementation. In this paper, we characterize a liquid lens and validate its use in relevant biological applications. We measured optical aberrations that are caused by the liquid lens, and calculated its response time, defocus hysteresis, and thermal response to a pulsed laser. We applied this method of remote focusing for imaging and measurement of multiple in-vivo specimens, including mesenchymal stem cell dynamics, mouse tibialis anterior muscle mitochondrial electrical potential fluctuations, and mouse brain neural activity. Our system produces 5 dimensional (x,y,z,λ,t) data sets at the speed of 4.2 volumes per second over volumes as large as 160 x 160 x 35 µm3.
Collapse
Affiliation(s)
- Kayvan Forouhesh Tehrani
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Charles V. Latchoumane
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - W. Michael Southern
- Department of Kinesiology, University of Georgia, Athens, GA 30602, USA
- Currently with: Department of Biochemistry, Molecular Biology, and Biophysics, University of Minnesota, Minneapolis, MN 55455, USA
| | - Emily G. Pendleton
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Ana Maslesa
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Lohitash Karumbaiah
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Jarrod A. Call
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
- Department of Kinesiology, University of Georgia, Athens, GA 30602, USA
| | - Luke J. Mortensen
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
- School of Chemical, Materials and Biomedical Engineering, University of Georgia, Athens, GA 30602, USA
| |
Collapse
|
10
|
Shaw SL, Thoms D, Powers J. Structured illumination approaches for super-resolution in plant cells. Microscopy (Oxf) 2019; 68:37-44. [PMID: 30295787 DOI: 10.1093/jmicro/dfy043] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2018] [Revised: 09/17/2018] [Accepted: 10/01/2018] [Indexed: 11/14/2022] Open
Abstract
The advent of super-resolution techniques in biological microscopy has opened new frontiers for exploring the molecular distribution of proteins and small molecules in cells. Improvements in optical design and innovations in the approaches for the collection of fluorescence emission have produced substantial gains in signal from chemical labels and fluorescent proteins. Structuring the illumination to elicit fluorescence from specific or even random patterns allows the extraction of higher order spatial frequencies from specimens labeled with conventional probes. Application of this approach to plant systems for super-resolution imaging has been relatively slow owing in large part to aberrations incurred when imaging through the plant cell wall. In this brief review, we address the use of two prominent methods for generating super-resolution images in living plant specimens and discuss future directions for gaining better access to these techniques.
Collapse
Affiliation(s)
- Sidney L Shaw
- Department of Biology, Light Microscopy Imaging Center, Indiana University, Bloomington, IN, USA
| | - David Thoms
- Department of Biology, Light Microscopy Imaging Center, Indiana University, Bloomington, IN, USA
| | - James Powers
- Department of Biology, Light Microscopy Imaging Center, Indiana University, Bloomington, IN, USA
| |
Collapse
|
11
|
Turcotte R, Liang Y, Ji N. Adaptive optical versus spherical aberration corrections for in vivo brain imaging. BIOMEDICAL OPTICS EXPRESS 2017; 8:3891-3902. [PMID: 28856058 PMCID: PMC5560849 DOI: 10.1364/boe.8.003891] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Revised: 07/25/2017] [Accepted: 07/25/2017] [Indexed: 05/21/2023]
Abstract
Adjusting the objective correction collar is a widely used approach to correct spherical aberrations (SA) in optical microscopy. In this work, we characterized and compared its performance with adaptive optics in the context of in vivo brain imaging with two-photon fluorescence microscopy. We found that the presence of sample tilt had a deleterious effect on the performance of SA-only correction. At large tilt angles, adjusting the correction collar even worsened image quality. In contrast, adaptive optical correction always recovered optimal imaging performance regardless of sample tilt. The extent of improvement with adaptive optics was dependent on object size, with smaller objects having larger relative gains in signal intensity and image sharpness. These observations translate into a superior performance of adaptive optics for structural and functional brain imaging applications in vivo, as we confirmed experimentally.
Collapse
|
12
|
Large-field-of-view imaging by multi-pupil adaptive optics. Nat Methods 2017; 14:581-583. [PMID: 28481364 PMCID: PMC5482233 DOI: 10.1038/nmeth.4290] [Citation(s) in RCA: 57] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2016] [Accepted: 04/05/2017] [Indexed: 11/19/2022]
Abstract
For in vivo deep imaging at high spatiotemporal resolutions, we developed Multi-Pupil Adaptive Optics (MPAO) which enables simultaneous wavefront correction over a large imaging field-of-view. The current implementation improves correction area by nine times over that of conventional methods. MPAO’s capability of spatially independent wavefront control further enables 3D nonplanar imaging. We applied MPAO to in vivo structural and functional imaging of biological dynamics in mammalian brain.
Collapse
|
13
|
Tehrani KF, Sun MK, Karumbaiah L, Mortensen LJ. Fast axial scanning for 2-photon microscopy using liquid lens technology. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2017; 10070. [PMID: 29706682 DOI: 10.1117/12.2252992] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Scanning microscopy methods require movement of the focus in Z coordinates to produce an image of a 3-dimensional volume. In a typical imaging system, the optical setup is kept fixed and either the sample or the objective is translated with a mechanical stage driven by a stepper motor or a piezoelectric element. Mechanical Z scanning is precise, but its slow response and vulnerability to mechanical vibrations and stress make it disadvantageous to image dynamic, time-varying samples such as live cell structures. An alternative method less susceptible to these problems is to change the focal plane using conjugate optics. Deformable mirrors, acoustooptics, and electrically tunable lenses have been experimented with to achieve this goal and have attained very fast and precise Z-scanning without physically moving the sample. Here, we present the use of a liquid lens for fast axial scanning. Liquid lenses have a long functional life, high degree of phase shift, and low sensitivity to mechanical stress. They work on the principle of refraction at a liquid-liquid interface. At the boundary of a polar and an apolar liquid a spherical surface is formed whose curvature can be controlled by adjusting its relative wettability using electrowetting. We characterize the effects of the lens on attainable Z displacement, beam spectral characteristics, and pulse duration as compared with mechanical scanning.
Collapse
Affiliation(s)
- Kayvan Forouhesh Tehrani
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Min Kyoung Sun
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Lohitash Karumbaiah
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA
| | - Luke J Mortensen
- Regenerative Bioscience Center, Rhodes Center for ADS, University of Georgia, Athens, GA 30602, USA.,College of Engineering, University of Georgia, Athens, GA 30602, USA
| |
Collapse
|
14
|
Kong L, Tang J, Cui M. In vivo volumetric imaging of biological dynamics in deep tissue via wavefront engineering. OPTICS EXPRESS 2016; 24:1214-1221. [PMID: 26832504 PMCID: PMC4741314 DOI: 10.1364/oe.24.001214] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/13/2015] [Revised: 12/25/2015] [Accepted: 12/25/2015] [Indexed: 05/29/2023]
Abstract
Biological systems undergo dynamical changes continuously which span multiple spatial and temporal scales. To study these complex biological dynamics in vivo, high-speed volumetric imaging that can work at large imaging depth is highly desired. However, deep tissue imaging suffers from wavefront distortion, resulting in reduced Strehl ratio and image quality. Here we combine the two wavefront engineering methods developed in our lab, namely the optical phase-locked ultrasound lens based volumetric imaging and the iterative multiphoton adaptive compensation technique, and demonstrate in vivo volumetric imaging of microglial and mitochondrial dynamics at large depth in mouse brain cortex and lymph node, respectively.
Collapse
Affiliation(s)
- Lingjie Kong
- School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
| | - Jianyong Tang
- Laboratory of Systems Biology, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD 20892, USA
| | - Meng Cui
- School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
- Department of Biological Sciences, Purdue University, West Lafayette, IN 47907, USA
- Integrated imaging cluster, Purdue University, West Lafayette, IN 47907, USA
- Bindley bioscience center, Purdue University, West Lafayette, IN 47907, USA
| |
Collapse
|
15
|
Paudel HP, Taranto J, Mertz J, Bifano T. Axial range of conjugate adaptive optics in two-photon microscopy. OPTICS EXPRESS 2015; 23:20849-57. [PMID: 26367938 PMCID: PMC5802239 DOI: 10.1364/oe.23.020849] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
We describe an adaptive optics technique for two-photon microscopy in which the deformable mirror used for aberration compensation is positioned in a plane conjugate to the plane of the aberration. We demonstrate in a proof-of-principle experiment that this technique yields a large field of view advantage in comparison to standard pupil-conjugate adaptive optics. Further, we show that the extended field of view in conjugate AO is maintained over a relatively large axial translation of the deformable mirror with respect to the conjugate plane. We conclude with a discussion of limitations and prospects for the conjugate AO technique in two-photon biological microscopy.
Collapse
Affiliation(s)
- Hari P. Paudel
- Department of Electrical and Computer Engineering, Boston University, 8 Saint Marys St., Boston, MA 02215,
USA
| | - John Taranto
- Thorlabs Inc. 56 Sparta Ave, Newton, NJ 07860
USA
| | - Jerome Mertz
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, MA 02215,
USA
| | - Thomas Bifano
- Department of Mechanical Engineering, Boston University, 110 Cummington Mall, Boston, MA 02215,
USA
| |
Collapse
|
16
|
Abstract
Multiphoton microscopy is the current method of choice for in vivo deep-tissue imaging. The long laser wavelength suffers less scattering, and the 3D-confined excitation permits the use of scattered signal light. However, the imaging depth is still limited because of the complex refractive index distribution of biological tissue, which scrambles the incident light and destroys the optical focus needed for high resolution imaging. Here, we demonstrate a wavefront-shaping scheme that allows clear imaging through extremely turbid biological tissue, such as the skull, over an extended corrected field of view (FOV). The complex wavefront correction is obtained and directly conjugated to the turbid layer in a noninvasive manner. Using this technique, we demonstrate in vivo submicron-resolution imaging of neural dendrites and microglia dynamics through the intact skulls of adult mice. This is the first observation, to our knowledge, of dynamic morphological changes of microglia through the intact skull, allowing truly noninvasive studies of microglial immune activities free from external perturbations.
Collapse
|
17
|
Mertz J, Paudel H, Bifano TG. Field of view advantage of conjugate adaptive optics in microscopy applications. APPLIED OPTICS 2015; 54:3498-506. [PMID: 25967343 PMCID: PMC4629780 DOI: 10.1364/ao.54.003498] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
The imaging performance of an optical microscope can be degraded by sample-induced aberrations. A general strategy to undo the effect of these aberrations is to apply wavefront correction with a deformable mirror (DM). In most cases the DM is placed conjugate to the microscope pupil, called pupil adaptive optics (AO). When the aberrations are spatially variant an alternative configuration involves placing the DM conjugate to the main source of aberrations, called conjugate AO. We provide a theoretical and experimental comparison of both configurations for the simplified case where spatially variant aberrations are produced by a well-defined phase screen. We pay particular attention to the resulting correction field of view (FOV). Conjugate AO is found to provide a significant FOV advantage. While this result is well known in the astronomical community, our goal here is to recast it specifically for the optical microscopy community.
Collapse
Affiliation(s)
- Jerome Mertz
- Dept. of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston, MA 02215, USA
- Corresponding author:
| | - Hari Paudel
- Dept. of Electrical Engineering, Boston University, 8 Saint Mary’s St., Boston, MA 02215, USA
| | - Thomas G. Bifano
- Photonics Center, Boston University, 8 Saint Mary’s St., Boston, MA 02215, USA
| |
Collapse
|
18
|
Kner P. Phase diversity for three-dimensional imaging. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2013; 30:1980-7. [PMID: 24322853 DOI: 10.1364/josaa.30.001980] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
Phase diversity (PD) is a powerful technique for estimating wavefront aberrations from two-dimensional images of extended scenes. PD can work with extended incoherent images and, in an adaptive optics system, does not need extra hardware in addition to the deformable mirror. For these reasons, PD should be well suited to aberration measurement in microscopy applications. But, in biological widefield microscopy, the objects being imaged are frequently three-dimensional, and the images contain out-of-focus light. In this paper, we introduce multiplane PD and show that PD can be extended to widefield imaging of three-dimensional objects. This should be particularly useful in the field of biological fluorescence microscopy where the objects are very light sensitive and the aberrations cannot easily be determined.
Collapse
|
19
|
Pankajakshan P, Kam Z, Dieterlen A, Olivo-Marin JC. Characterizing the 3-D field distortions in low numerical aperture fluorescence zooming microscope. OPTICS EXPRESS 2012; 20:9876-9889. [PMID: 22535080 DOI: 10.1364/oe.20.009876] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
In this article, we characterize the lateral field distortions in a low numerical aperture and large field-of-view (FOV) fluorescence imaging system. To this end, we study a commercial fluorescence MACROscope setup, which is a zooming microscope. The versatility of this system lies in its ability to image at different zoom ranges, so that sample preparations can be examined in three-dimensions, at cellular, organ and whole body levels. Yet, we found that the imaging system's optics are optimized only for high magnifications where the observed FOV is small. When we studied the point-spread function (PSF) by using fluorescent polystyrene beads as "guide-stars", we noticed that the PSF is spatially varying due to field distortions. This variation was found to be laterally symmetrical and the distortions were found to increase with the distance from the center of the FOV. In this communication, we investigate the idea of using the field at the back focal plane of an optical system for characterizing distortions. As this field is unknown, we develop a theoretical framework to retrieve the amplitude and phase of the field at the back focal pupil plane, from the empirical bead images. By using the retrieved amplitude, we can understand and characterize the underlying cause of these distortions. We also propose a few approaches, before acquisition, to either avoid it or correct it at the optical design level.
Collapse
Affiliation(s)
- Praveen Pankajakshan
- Quantitative Image Analysis Unit, Institut Pasteur, 25 rue du Docteur Roux, 75724 Paris, France.
| | | | | | | |
Collapse
|
20
|
Arigovindan M, Sedat JW, Agard DA. Effect of depth dependent spherical aberrations in 3D structured illumination microscopy. OPTICS EXPRESS 2012; 20:6527-41. [PMID: 22418536 DOI: 10.1364/oe.20.006527] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
We model the effect of depth dependent spherical aberration caused by a refractive index mismatch between the mounting and immersion mediums in a 3D structured illumination microscope (SIM). We first derive a forward model that takes into account the effect of the depth varying aberrations on both the illumination and the detection processes. From the model, we demonstrate that depth dependent spherical aberration leads to loss of signal only due to its effect on the detection response of the system, while its effect on illumination leads to phase shifts between orders that can be handled computationally in the reconstruction process. Further, by using the model, we provide guidelines for optical corrections of aberrations with different complexities, and explain how the proposed corrections simplify the forward model. Finally, we show that it is possible to correct both illumination and detection aberrations using a deformable mirror only on the detection path of the microscope.
Collapse
Affiliation(s)
- Muthuvel Arigovindan
- Keck Advanced Microscopy Center and the Dept. of Biochem. and Biophys., University of California at San Francisco, San Francisco, USA.
| | | | | |
Collapse
|
21
|
Izeddin I, El Beheiry M, Andilla J, Ciepielewski D, Darzacq X, Dahan M. PSF shaping using adaptive optics for three-dimensional single-molecule super-resolution imaging and tracking. OPTICS EXPRESS 2012; 20:4957-67. [PMID: 22418300 DOI: 10.1364/oe.20.004957] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
We present a novel approach for three-dimensional localization of single molecules using adaptive optics. A 52-actuator deformable mirror is used to both correct aberrations and induce two-dimensional astigmatism in the point-spread-function. The dependence of the z-localization precision on the degree of astigmatism is discussed. We achieve a z-localization precision of 40 nm for fluorescent proteins and 20 nm for fluorescent dyes, over an axial depth of ~800 nm. We illustrate the capabilities of our approach for three-dimensional high-resolution microscopy with super-resolution images of actin filaments in fixed cells and single-molecule tracking of quantum-dot labeled transmembrane proteins in live HeLa cells.
Collapse
Affiliation(s)
- Ignacio Izeddin
- Laboratoire Kastler Brossel, CNRS UMR 8552, Département de Physique et Institut de Biologie de l’Ecole Normale Supérieure, Université Pierre et Marie Curie-Paris6, 46 rue d’Ulm 75230 Paris cedex 05, France
| | | | | | | | | | | |
Collapse
|
22
|
Yuan S, Preza C. Point-spread function engineering to reduce the impact of spherical aberration on 3D computational fluorescence microscopy imaging. OPTICS EXPRESS 2011; 19:23298-23314. [PMID: 22109208 DOI: 10.1364/oe.19.023298] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Wavefront encoding (WFE) with different cubic phase mask designs was investigated in engineering 3D point-spread functions (PSF) to reduce their sensitivity to depth-induced spherical aberration (SA) which affects computational complexity in 3D microscopy imaging. The sensitivity of WFE-PSFs to defocus and to SA was evaluated as a function of phase mask parameters using mean-square-error metrics to facilitate the selection of mask designs for extended-depth-of-field (EDOF) microscopy and for computational optical sectioning microscopy (COSM). Further studies on pupil phase contribution and simulated WFE-microscope images evaluated the engineered PSFs and demonstrated SA insensitivity over sample depths of 30 μm. Despite its low sensitivity to SA, the successful WFE design for COSM maintains a high sensitivity to defocus as it is desired for optical sectioning.
Collapse
Affiliation(s)
- Shuai Yuan
- Department of Electrical and Computer Engineering, the University of Memphis, Memphis, TN 38152, USA.
| | | |
Collapse
|
23
|
Aviles-Espinosa R, Andilla J, Porcar-Guezenec R, Olarte OE, Nieto M, Levecq X, Artigas D, Loza-Alvarez P. Measurement and correction of in vivo sample aberrations employing a nonlinear guide-star in two-photon excited fluorescence microscopy. BIOMEDICAL OPTICS EXPRESS 2011; 2:3135-49. [PMID: 22076274 PMCID: PMC3207382 DOI: 10.1364/boe.2.003135] [Citation(s) in RCA: 50] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2011] [Revised: 10/17/2011] [Accepted: 10/20/2011] [Indexed: 05/18/2023]
Abstract
We demonstrate that sample induced aberrations can be measured in a nonlinear microscope. This uses the fact that two-photon excited fluorescence naturally produces a localized point source inside the sample: the nonlinear guide-star (NL-GS). The wavefront emitted from the NL-GS can then be recorded using a Shack-Hartmann sensor. Compensation of the recorded sample aberrations is performed by the deformable mirror in a single-step. This technique is applied to fixed and in vivo biological samples, showing, in some cases, more than one order of magnitude improvement in the total collected signal intensity.
Collapse
|
24
|
Vermeulen P, Muro E, Pons T, Loriette V, Fragola A. Adaptive optics for fluorescence wide-field microscopy using spectrally independent guide star and markers. JOURNAL OF BIOMEDICAL OPTICS 2011; 16:076019. [PMID: 21806280 DOI: 10.1117/1.3603847] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
We describe the implementation and use of an adaptive optics loop in the imaging path of a commercial wide field microscope. We show that it is possible to maintain the optical performances of the original microscope when imaging through aberrant biological samples. The sources used for illuminating the adaptive optics loop are spectrally independent, in excitation and emission, from the sample, so they do not appear in the final image, and their use does not contribute to the sample bleaching. Results are compared with equivalent images obtained with an identical microscope devoid of adaptive optics system.
Collapse
Affiliation(s)
- Pierre Vermeulen
- Laboratoire de Physique et d'Etude des Matériaux, École Supérieure de Physique et de Chimie Industrielles, Centre National de la Recherche Scientifique UMR 8213, Université Pierre et Marie Curie, 10 rue Vauquelin, Paris 75005,France
| | | | | | | | | |
Collapse
|
25
|
Parton RM, Vallés AM, Dobbie IM, Davis I. Live cell imaging in Drosophila melanogaster. Cold Spring Harb Protoc 2010; 2010:pdb.top75. [PMID: 20360379 DOI: 10.1101/pdb.top75] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Although many of the techniques of live cell imaging in Drosophila melanogaster are also used by the greater community of cell biologists working on other model systems, studying living fly tissues presents unique difficulties with regard to keeping the cells alive, introducing fluorescent probes, and imaging through thick, hazy cytoplasm. This article outlines the major tissue types amenable to study by time-lapse cinematography and different methods for keeping the cells alive. It describes various imaging and associated techniques best suited to following changes in the distribution of fluorescently labeled molecules in real time in these tissues. Imaging, in general, is a rapidly developing discipline, and recent advances in imaging technology are able to greatly extend what can be achieved with live cell imaging of Drosophila tissues. As far as possible, this article includes the latest technical developments and discusses likely future developments in imaging methods that could have an impact on research using Drosophila.
Collapse
|
26
|
Kner P, Sedat JW, Agard DA, Kam Z. High-resolution wide-field microscopy with adaptive optics for spherical aberration correction and motionless focusing. J Microsc 2010; 237:136-47. [PMID: 20096044 DOI: 10.1111/j.1365-2818.2009.03315.x] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Live imaging in cell biology requires three-dimensional data acquisition with the best resolution and signal-to-noise ratio possible. Depth aberrations are a major source of image degradation in three-dimensional microscopy, causing a significant loss of resolution and intensity deep into the sample. These aberrations occur because of the mismatch between the sample refractive index and the immersion medium index. We have built a wide-field fluorescence microscope that incorporates a large-throw deformable mirror to simultaneously focus and correct for depth aberration in three-dimensional imaging. Imaging fluorescent beads in water and glycerol with an oil immersion lens we demonstrate a corrected point spread function and a 2-fold improvement in signal intensity. We apply this new microscope to imaging biological samples, and show sharper images and improved deconvolution.
Collapse
Affiliation(s)
- P Kner
- Keck Advanced Microscopy Laboratory and Department of Biochemistry and Biophysics, University of California, San Francisco, CA 94158, USA.
| | | | | | | |
Collapse
|
27
|
LEVOY M, ZHANG Z, MCDOWALL I. Recording and controlling the 4D light field in a microscope using microlens arrays. J Microsc 2009; 235:144-62. [DOI: 10.1111/j.1365-2818.2009.03195.x] [Citation(s) in RCA: 193] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
28
|
De Mey JR, Kessler P, Dompierre J, Cordelières FP, Dieterlen A, Vonesch JL, Sibarita JB. Fast 4D Microscopy. Methods Cell Biol 2008; 85:83-112. [PMID: 18155460 DOI: 10.1016/s0091-679x(08)85005-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Many cellular processes involve fast movements of weakly labeled cellular structures in all directions, which should be recorded in 3D time-lapse microscopy (4D microscopy). This chapter introduces fast 4D imaging, which is used for sampling the cell's volume by collecting focal planes in time-lapse mode as rapidly as possible, without perturbing the sample by strong illumination. The final images should contain sufficient contrast allowing for the isolation of structures of interest by segmentation and the analysis of their intracellular movements by tracking. Because they are the most sensitive, systems using wide-field microscopy and deconvolution techniques are discussed in greater depth. We discuss important points to consider, including system components and multifunctionality, spatial resolution and sampling conditions, and mechanical and optical stability and how to test for it. We consider image formation using high numerical aperture optics and discuss the influence of optical blur and noise on image formation of living cells. Spherical aberrations, their consequences for axial image quality, and their impact on the success of deconvolution of low intensity image stacks are explained in detail. Simple protocols for acquiring and treating point spread functions (PSFs) and live cells are provided. A compromise for counteracting spherical aberration involving the use of a kit of immersion oils for PSF and cell acquisition is illustrated. Recommendations for evaluating acquisition conditions and deconvolution parameters are given. Finally, we discuss future developments based on the use of adaptive optics which will push back many of today's limits.
Collapse
Affiliation(s)
- J R De Mey
- Ecole Supérieure de Biotechnologie de Strasbourg, UMR-7175 CNRS/Université Louis Pasteur (Strasbourg I), BP10413, 67412 IllKIRCH Cedex, France
| | | | | | | | | | | | | |
Collapse
|
29
|
Booth MJ. Adaptive optics in microscopy. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2007; 365:2829-43. [PMID: 17855218 DOI: 10.1098/rsta.2007.0013] [Citation(s) in RCA: 103] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
The imaging properties of optical microscopes are often compromised by aberrations that reduce image resolution and contrast. Adaptive optics technology has been employed in various systems to correct these aberrations and restore performance. This has required various departures from the traditional adaptive optics schemes that are used in astronomy. This review discusses the sources of aberrations, their effects and their correction with adaptive optics, particularly in confocal and two-photon microscopes. Different methods of wavefront sensing, indirect aberration measurement and aberration correction devices are discussed. Applications of adaptive optics in the related areas of optical data storage, optical tweezers and micro/nanofabrication are also reviewed.
Collapse
Affiliation(s)
- Martin J Booth
- Department of Engineering Science, University of Oxford, Parks Road, Oxford OX1 3PJ, UK.
| |
Collapse
|