1
|
Aizik D, Levin A. Non-invasive and noise-robust light focusing using confocal wavefront shaping. Nat Commun 2024; 15:5575. [PMID: 38956030 PMCID: PMC11219997 DOI: 10.1038/s41467-024-49697-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 06/11/2024] [Indexed: 07/04/2024] Open
Abstract
Wavefront-shaping is a promising approach for imaging fluorescent targets deep inside scattering tissue despite strong aberrations. It enables focusing an incoming illumination into a single spot inside tissue, as well as correcting the outgoing light scattered from the tissue. Previously, wavefront shaping modulations have been successively estimated using feedback from strong fluorescent beads, which have been manually added to a sample. However, such algorithms do not generalize to neurons whose emission is orders of magnitude weaker. We suggest a wavefront shaping approach that works with a confocal modulation of both the illumination and imaging arms. Since the aberrations are corrected in the optics before the detector, the low photon budget is directed into a single sensor spot and detected with high signal-noise ratio. We derive a score function for modulation evaluation from mathematical principles, and successfully use it to image fluorescence neurons, despite scattering through thick tissue.
Collapse
Affiliation(s)
- Dror Aizik
- Department of Electrical and Computer Engineering, Technion, Haifa, Israel.
| | - Anat Levin
- Department of Electrical and Computer Engineering, Technion, Haifa, Israel
| |
Collapse
|
2
|
Hu Q, Hailstone M, Wang J, Wincott M, Stoychev D, Atilgan H, Gala D, Chaiamarit T, Parton RM, Antonello J, Packer AM, Davis I, Booth MJ. Universal adaptive optics for microscopy through embedded neural network control. LIGHT, SCIENCE & APPLICATIONS 2023; 12:270. [PMID: 37953294 PMCID: PMC10641083 DOI: 10.1038/s41377-023-01297-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 09/24/2023] [Accepted: 10/01/2023] [Indexed: 11/14/2023]
Abstract
The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution - one that can be readily transferred between microscope modalities - has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning assisted wavefront-sensorless AO control (MLAO) method. Unlike previous ML methods, we used a specially constructed neural network (NN) architecture, designed using physical understanding of the general microscope image formation, that was embedded in the control loop of different microscope systems. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a "black box", but provided physical insights on internal workings, which could influence future designs.
Collapse
Affiliation(s)
- Qi Hu
- Department of Engineering Science, University of Oxford, Oxford, UK
| | | | - Jingyu Wang
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Matthew Wincott
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Danail Stoychev
- Department of Biochemistry, University of Oxford, Oxford, UK
| | - Huriye Atilgan
- Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford, UK
| | - Dalia Gala
- Department of Biochemistry, University of Oxford, Oxford, UK
| | - Tai Chaiamarit
- Department of Biochemistry, University of Oxford, Oxford, UK
| | | | - Jacopo Antonello
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Adam M Packer
- Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford, UK
| | - Ilan Davis
- Department of Biochemistry, University of Oxford, Oxford, UK
| | - Martin J Booth
- Department of Engineering Science, University of Oxford, Oxford, UK.
| |
Collapse
|
3
|
Zhang Q, Hu Q, Berlage C, Kner P, Judkewitz B, Booth M, Ji N. Adaptive optics for optical microscopy [Invited]. BIOMEDICAL OPTICS EXPRESS 2023; 14:1732-1756. [PMID: 37078027 PMCID: PMC10110298 DOI: 10.1364/boe.479886] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 03/06/2023] [Accepted: 03/06/2023] [Indexed: 05/03/2023]
Abstract
Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.
Collapse
Affiliation(s)
- Qinrong Zhang
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| | - Qi Hu
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Caroline Berlage
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
- Humboldt-Universität zu Berlin, Institute for Biology, 10099 Berlin, Germany
| | - Peter Kner
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602, USA
| | - Benjamin Judkewitz
- Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences, NeuroCure Cluster of Excellence, 10117 Berlin, Germany
| | - Martin Booth
- Department of Engineering Science, University of Oxford, Oxford OX1 3PJ, UK
| | - Na Ji
- Department of Physics, Department of Molecular & Cellular Biology, University of California, Berkeley, CA 94720, USA
| |
Collapse
|
4
|
Wang J, Zhang Y. Adaptive optics in super-resolution microscopy. BIOPHYSICS REPORTS 2021; 7:267-279. [PMID: 37287764 PMCID: PMC10233472 DOI: 10.52601/bpr.2021.210015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 06/23/2021] [Indexed: 06/09/2023] Open
Abstract
Fluorescence microscopy has become a routine tool in biology for interrogating life activities with minimal perturbation. While the resolution of fluorescence microscopy is in theory governed only by the diffraction of light, the resolution obtainable in practice is also constrained by the presence of optical aberrations. The past two decades have witnessed the advent of super-resolution microscopy that overcomes the diffraction barrier, enabling numerous biological investigations at the nanoscale. Adaptive optics, a technique borrowed from astronomical imaging, has been applied to correct for optical aberrations in essentially every microscopy modality, especially in super-resolution microscopy in the last decade, to restore optimal image quality and resolution. In this review, we briefly introduce the fundamental concepts of adaptive optics and the operating principles of the major super-resolution imaging techniques. We highlight some recent implementations and advances in adaptive optics for active and dynamic aberration correction in super-resolution microscopy.
Collapse
Affiliation(s)
- Jingyu Wang
- Department of Engineering Science, University of Oxford, Oxford, OX1 3PJ, UK
| | - Yongdeng Zhang
- School of Life Sciences, Westlake University, Hangzhou 310024, China
- Westlake Laboratory of Life Sciences and Biomedicine, Hangzhou 310024, China
| |
Collapse
|
5
|
Wu Z, Xu X, Xi P. Stimulated emission depletion microscopy for biological imaging in four dimensions: A review. Microsc Res Tech 2021; 84:1947-1958. [PMID: 33713513 DOI: 10.1002/jemt.23750] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 02/27/2021] [Indexed: 12/26/2022]
Abstract
Stimulated emission depletion (STED) microscopy allows high lateral and axial resolution, long term imaging in living cells. Here we review recent technical advances in STED microscopy, with emphasis on resolution and measurement range of XYZt four dimensions. Different STED technical advances and novel STED probes are discussed with their respective application in biological subcellular imaging. This review may serve as a practical guide for choosing a suitable approach to the advanced STED super-resolution imaging.
Collapse
Affiliation(s)
- Zhaoyang Wu
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Xinzhu Xu
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Peng Xi
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China.,UTS-SUSTech Joint Research Centre for Biomedical Materials and Devices, Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, 518055, China
| |
Collapse
|
6
|
Abstract
Adaptive optics (AO) is a technique that corrects for optical aberrations. It was originally proposed to correct for the blurring effect of atmospheric turbulence on images in ground-based telescopes and was instrumental in the work that resulted in the Nobel prize-winning discovery of a supermassive compact object at the centre of our galaxy. When AO is used to correct for the eye's imperfect optics, retinal changes at the cellular level can be detected, allowing us to study the operation of the visual system and to assess ocular health in the microscopic domain. By correcting for sample-induced blur in microscopy, AO has pushed the boundaries of imaging in thick tissue specimens, such as when observing neuronal processes in the brain. In this primer, we focus on the application of AO for high-resolution imaging in astronomy, vision science and microscopy. We begin with an overview of the general principles of AO and its main components, which include methods to measure the aberrations, devices for aberration correction, and how these components are linked in operation. We present results and applications from each field along with reproducibility considerations and limitations. Finally, we discuss future directions.
Collapse
|
7
|
Hall N, Titlow J, Booth MJ, Dobbie IM. Microscope-AOtools: a generalised adaptive optics implementation. OPTICS EXPRESS 2020; 28:28987-29003. [PMID: 33114806 PMCID: PMC8219375 DOI: 10.1364/oe.401117] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 08/22/2020] [Accepted: 08/25/2020] [Indexed: 06/11/2023]
Abstract
Aberrations arising from sources such as sample heterogeneity and refractive index mismatches are constant problems in biological imaging. These aberrations reduce image quality and the achievable depth of imaging, particularly in super-resolution microscopy techniques. Adaptive optics (AO) technology has been proven to be effective in correcting for these aberrations, thereby improving the image quality. However, it has not been widely adopted by the biological imaging community due, in part, to difficulty in set-up and operation of AO. The methods for doing so are not novel or unknown, but new users often waste time and effort reimplementing existing methods for their specific set-ups, hardware, sample types, etc. Microscope-AOtools offers a robust, easy-to-use implementation of the essential methods for set-up and use of AO elements and techniques. These methods are constructed in a generalised manner that can utilise a range of adaptive optics elements, wavefront sensing techniques and sensorless AO correction methods. Furthermore, the methods are designed to be easily extensible as new techniques arise, leading to a streamlined pipeline for new AO technology and techniques to be adopted by the wider microscopy community.
Collapse
Affiliation(s)
- Nicholas Hall
- Micron Advanced Bioimaging Unit, Department of Biochemistry, University of Oxford, South Parks Road, Oxford OX1 3QU, UK
| | - Josh Titlow
- Davis Lab, Department of Biochemistry, University of Oxford, South Parks Road, Oxford OX1 3QU, UK
| | - Martin J. Booth
- Micron Advanced Bioimaging Unit, Department of Biochemistry, University of Oxford, South Parks Road, Oxford OX1 3QU, UK
- Department of Engineering Science, University of Oxford, Parks Road, Oxford OX1 3PJ, UK
| | - Ian M. Dobbie
- Micron Advanced Bioimaging Unit, Department of Biochemistry, University of Oxford, South Parks Road, Oxford OX1 3QU, UK
| |
Collapse
|