Direct wavefront sensing for high-resolution in vivo imaging in scattering tissue

Neurophotonics beyond the surface: unmasking the brain's complexity exploiting optical scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Sensorless adaptive optics in the second near-infrared window for deep vascular imaging in vivo

We have experimentally validated the use of sensorless adaptive optics (AO) to enhance laser scanning confocal microscopy in the second near-infrared (NIR II) spectral range, termed as AO-NIR II confocal microscopy. This approach harnesses a NIR II fluorophore, excited by an 808 nm wavelength and emitting beyond 1000 nm, to visualize intricate structures in deep brain tissues with the intact skull. By leveraging the reduced scattering and aberrations in the NIR II spectrum, we successfully captured a three-dimensional (3D) vascular structure map extending 310 µm beneath the skull. AO typically boosts the fluorescence signal by approximately 2-3 times, leading to a superior contrast and diminished smearing effects. Consequently, small blood vessels at various depths can be clearly visualized, which might otherwise remain undetectable without AO corrections.

Closed-loop experiments and brain machine interfaces with multiphoton microscopy

In the field of neuroscience, the importance of constructing closed-loop experimental systems has increased in conjunction with technological advances in measuring and controlling neural activity in live animals. We provide an overview of recent technological advances in the field, focusing on closed-loop experimental systems where multiphoton microscopy-the only method capable of recording and controlling targeted population activity of neurons at a single-cell resolution in vivo-works through real-time feedback. Specifically, we present some examples of brain machine interfaces (BMIs) using in vivo two-photon calcium imaging and discuss applications of two-photon optogenetic stimulation and adaptive optics to real-time BMIs. We also consider conditions for realizing future optical BMIs at the synaptic level, and their possible roles in understanding the computational principles of the brain.

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to significant enhancements in image quality.

Adaptive Optics in an Oblique Plane Microscope

Adaptive optics (AO) can restore diffraction limited performance when imaging beyond superficial cell layers in vivo and in vitro, and as such is of interest for advanced 3D microscopy methods such as light-sheet fluorescence microscopy (LSFM). In a typical LSFM system, the illumination and detection paths are separate and subject to different optical aberrations. To achieve optimal microscope performance, it is necessary to sense and correct these aberrations in both light paths, resulting in a complex microscope system. Here, we show that in an oblique plane microscope (OPM), a type of LSFM with a single primary objective lens, the same deformable mirror can correct both the illumination and fluorescence detection. Besides reducing the complexity, we show that AO in OPM also restores the relative alignment of the light-sheet and focal plane, and that a projection imaging mode can stabilize and improve the wavefront correction in a sensorless AO format. We demonstrate OPM with AO on fluorescent nanospheres and by imaging the vasculature and cancer cells in zebrafish embryos embedded in a glass capillary, restoring diffraction limited resolution and improving the signal strength twofold.

Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Speed-enhanced scattering compensation method with sub-Nyquist sampling

A rapid feedback-based scattering compensation method is particularly important for guiding light precisely within turbid tissues, especially the dynamic tissues. However, the huge number of measurements that come from the underutilization of the signal frequency channel greatly limits the modulation speed. This paper introduces a rapid compensation method with the sub-Nyquist sampling which improves the channel utilization and the speed of wavefront shaping. The number of measurements is reduced to ∼1500 with 32 × 32 freedom, and the PBR of the focus reaches ∼200. The system performances are demonstrated by focusing the light through brain slices of different thicknesses.

Phase diversity-based wavefront sensing for fluorescence microscopy

Fluorescence microscopy is an invaluable tool in biology, yet its performance is compromised when the wavefront of light is distorted due to optical imperfections or the refractile nature of the sample. Such optical aberrations can dramatically lower the information content of images by degrading image contrast, resolution, and signal. Adaptive optics (AO) methods can sense and subsequently cancel the aberrated wavefront, but are too complex, inefficient, slow, or expensive for routine adoption by most labs. Here we introduce a rapid, sensitive, and robust wavefront sensing scheme based on phase diversity, a method successfully deployed in astronomy but underused in microscopy. Our method enables accurate wavefront sensing to less than λ/35 root mean square (RMS) error with few measurements, and AO with no additional hardware besides a corrective element. After validating the method with simulations, we demonstrate calibration of a deformable mirror > 100-fold faster than comparable methods (corresponding to wavefront sensing on the ~100 ms scale), and sensing and subsequent correction of severe aberrations (RMS wavefront distortion exceeding λ/2), restoring diffraction-limited imaging on extended biological samples.

Accurate piecewise centroid calculation algorithm for wavefront measurement in adaptive optics

Adaptive optics using direct wavefront sensing (direct AO) is widely used in two-photon microscopy to correct sample-induced aberrations and restore diffraction-limited performance at high speeds. In general, the direct AO method employs a Sharked-Hartman wavefront sensor (SHWS) to directly measure the aberrations through a spot array. However, the signal-to-noise ratio (SNR) of spots in SHWS varies significantly within deep tissues, presenting challenges for accurately locating spot centroids over a large SNR range, particularly under extremely low SNR conditions. To address this issue, we propose a piecewise centroid calculation algorithm called GCP, which integrates three optimal algorithms for accurate spot centroid calculations under high-, medium-, and low-SNR conditions. Simulations and experiments demonstrate that the GCP can accurately measure aberrations over a large SNR range and exhibits robustness under extremely low-SNR conditions. Importantly, GCP improves the AO working depth by 150 µm compared to the conventional algorithm.

Construction and use of an adaptive optics two-photon microscope with direct wavefront sensing

Two-photon microscopy, combined with the appropriate optical labelling, enables the measurement and tracking of submicrometer structures within brain cells, as well as the spatiotemporal mapping of spikes in individual neurons and of neurotransmitter release in individual synapses. Yet, the spatial resolution of two-photon microscopy rapidly degrades as imaging is attempted at depths of more than a few scattering lengths into tissue, i.e., below the superficial layers that constitute the top 300-400 µm of the neocortex. To obviate this limitation, we shape the focal volume, generated by the excitation beam, by modulating the incident wavefront via guidestar-assisted adaptive optics. Here, we describe the construction, calibration and operation of a two-photon microscope that incorporates adaptive optics to restore diffraction-limited resolution at depths close to 900 µm in the mouse cortex. Our setup detects a guidestar formed by the excitation of a red-shifted dye in blood serum, used to directly measure the wavefront. We incorporate predominantly commercially available optical, optomechanical, mechanical and electronic components, and supply computer-aided design models of other customized components. The resulting adaptive optics two-photon microscope is modular and allows for expanded imaging and optical excitation capabilities. We demonstrate our methodology in the mouse neocortex by imaging the morphology of somatostatin-expressing neurons that lie 700 µm beneath the pia, calcium dynamics of layer 5b projection neurons and thalamocortical glutamate transmission to L4 neurons. The protocol requires ~30 d to complete and is suitable for users with graduate-level expertise in optics.

Retinal microvascular and neuronal pathologies probed in vivo by adaptive optical two-photon fluorescence microscopy

The retina, behind the transparent optics of the eye, is the only neural tissue whose physiology and pathology can be non-invasively probed by optical microscopy. The aberrations intrinsic to the mouse eye, however, prevent high-resolution investigation of retinal structure and function in vivo. Optimizing the design of a two-photon fluorescence microscope (2PFM) and sample preparation procedure, we found that adaptive optics (AO), by measuring and correcting ocular aberrations, is essential for resolving putative synaptic structures and achieving three-dimensional cellular resolution in the mouse retina in vivo. Applying AO-2PFM to longitudinal retinal imaging in transgenic models of retinal pathology, we characterized microvascular lesions with sub-capillary details in a proliferative vascular retinopathy model, and found Lidocaine to effectively suppress retinal ganglion cell hyperactivity in a retinal degeneration model. Tracking structural and functional changes at high-resolution longitudinally, AO-2PFM enables microscopic investigations of retinal pathology and pharmacology for disease diagnosis and treatment in vivo.

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

Modern Microscopic Approaches to Astrocytes

Microscopy started as the histological analysis based on intrinsic optical properties of tissues such as the refractive index and light absorption, and is expanding to include the visualization of organelles by chemical staining, localization of molecules by immunostaining, physiological measurements such as Ca²⁺ imaging, functional manipulation by optogenetics, and comprehensive analysis of chemical composition by Raman spectra. The microscope is one of the most important tools in neuroscience, which aims to reveal the complex intercellular communications underlying brain function and pathology. Many aspects of astrocytes, including the structures of their fine processes and physiological activities in concert with neurons and blood vessels, were revealed in the course of innovations in modern microscopy. The evolution of modern microscopy is a consequence of breakthroughs in spatiotemporal resolutions and expansions in molecular and physiological targets due to the progress in optics and information technology, as well as the inventions of probes using organic chemistry and molecular biology. This review overviews the modern microscopic approach to astrocytes.

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 87.74 ± 1.12%. We also experimentally validated our single-pixel broadband diffractive network by classifying handwritten digits "0" and "1" through a random diffuser using terahertz waves and a 3D-printed diffractive network. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.

Tutorial: multiphoton microscopy to advance neuroscience research

Multiphoton microscopy (MPM) employs ultrafast infrared lasers for high-resolution deep three-dimensional imaging of live biological samples. The goal of this tutorial is to provide a practical guide to MPM imaging for novice microscopy developers and life-science users. Principles of MPM, microscope setup, and labeling strategies are discussed. Use of MPM to achieve unprecedented imaging depth of whole mounted explants and intravital imaging via implantable glass windows of the mammalian nervous system is demonstrated.

Imaging mitochondria through bone in live mice using two-photon fluorescence microscopy with adaptive optics

INTRODUCTION

Mitochondria are extremely important organelles in the regulation of bone marrow and brain activity. However, live imaging of these subcellular features with high resolution in scattering tissues like brain or bone has proven challenging.

METHODS

In this study, we developed a two-photon fluorescence microscope with adaptive optics (TPFM-AO) for high-resolution imaging, which uses a home-built Shack-Hartmann wavefront sensor (SHWFS) to correct system aberrations and a sensorless approach for correcting low order tissue aberrations.

RESULTS

Using AO increases the fluorescence intensity of the point spread function (PSF) and achieves fast imaging of subcellular organelles with 400 nm resolution through 85 μm of highly scattering tissue. We achieved ~1.55×, ~3.58×, and ~1.77× intensity increases using AO, and a reduction of the PSF width by ~0.83×, ~0.74×, and ~0.9× at the depths of 0, 50 μm and 85 μm in living mouse bone marrow respectively, allowing us to characterize mitochondrial health and the survival of functioning cells with a field of view of 67.5× 67.5 μm. We also investigate the role of initial signal and background levels in sample correction quality by varying the laser power and camera exposure time and develop an intensity-based criteria for sample correction.

DISCUSSION

This study demonstrates a promising tool for imaging of mitochondria and other organelles in optically distorting biological environments, which could facilitate the study of a variety of diseases connected to mitochondrial morphology and activity in a range of biological tissues.

Guide to the construction and use of an adaptive optics two-photon microscope with direct wavefront sensing

Two-photon microscopy, combined with appropriate optical labeling, has enabled the study of structure and function throughout nervous systems. This methodology enables, for example, the measurement and tracking of sub-micrometer structures within brain cells, the spatio-temporal mapping of spikes in individual neurons, and the spatio-temporal mapping of transmitter release in individual synapses. Yet the spatial resolution of two-photon microscopy rapidly degrades as imaging is attempted at depths more than a few scattering lengths into tissue, i.e., below the superficial layers that constitute the top 300 to 400 µm of neocortex. To obviate this limitation, we measure the wavefront at the focus of the excitation beam and utilize adaptive optics that alters the incident wavefront to achieve an improved focal volume. We describe the constructions, calibration, and operation of a two-photon microscopy that incorporates adaptive optics to restore diffraction-limited resolution throughout the nearly 900 µm depth of mouse cortex. Our realization utilizes a guide star formed by excitation of red-shifted dye within the blood serum to directly measure the wavefront. We incorporate predominantly commercial optical, optomechanical, mechanical, and electronic components; computer aided design models of the exceptional custom components are supplied. The design is modular and allows for expanded imaging and optical excitation capabilities. We demonstrate our methodology in mouse neocortex by imaging the morphology of somatostatin-expressing neurons at 700 µm beneath the pia, calcium dynamics of layer 5b projection neurons, and glutamate transmission to L4 neurons.

Three-photon excited fluorescence imaging in neuroscience: From principles to applications

The development of three-photon microscopy (3PM) has greatly expanded the capability of imaging deep within biological tissues, enabling neuroscientists to visualize the structure and activity of neuronal populations with greater depth than two-photon imaging. In this review, we outline the history and physical principles of 3PM technology. We cover the current techniques for improving the performance of 3PM. Furthermore, we summarize the imaging applications of 3PM for various brain regions and species. Finally, we discuss the future of 3PM applications for neuroscience.

Multiscale imaging informs translational mouse modeling of neurological disease

Multiscale neurophysiology reveals that simple motor actions are associated with changes in neuronal firing in virtually every brain region studied. Accordingly, the assessment of focal pathology such as stroke or progressive neurodegenerative diseases must also extend widely across brain areas. To derive mechanistic information through imaging, multiple resolution scales and multimodal factors must be included, such as the structure and function of specific neurons and glial cells and the dynamics of specific neurotransmitters. Emerging multiscale methods in preclinical animal studies that span micro- to macroscale examinations fill this gap, allowing a circuit-based understanding of pathophysiological mechanisms. Combined with high-performance computation and open-source data repositories, these emerging multiscale and large field-of-view techniques include live functional ultrasound, multi- and single-photon wide-scale light microscopy, video-based miniscopes, and tissue-penetrating fiber photometry, as well as variants of post-mortem expansion microscopy. We present these technologies and outline use cases and data pipelines to uncover new knowledge within animal models of stroke, Alzheimer's disease, and movement disorders.

Deep tissue multi-photon imaging using adaptive optics with direct focus sensing and shaping

High-resolution optical imaging deep in tissues is challenging because of optical aberrations and scattering of light caused by the complex structure of living matter. Here we present an adaptive optics three-photon microscope based on analog lock-in phase detection for focus sensing and shaping (ALPHA-FSS). ALPHA-FSS accurately measures and effectively compensates for both aberrations and scattering induced by specimens and recovers subcellular resolution at depth. A conjugate adaptive optics configuration with remote focusing enables in vivo imaging of fine neuronal structures in the mouse cortex through the intact skull up to a depth of 750 µm below the pia, enabling near-non-invasive high-resolution microscopy in cortex. Functional calcium imaging with high sensitivity and high-precision laser-mediated microsurgery through the intact skull were also demonstrated. Moreover, we achieved in vivo high-resolution imaging of the deep cortex and subcortical hippocampus up to 1.1 mm below the pia within the intact brain.

Recent advances in optical imaging through deep tissue: imaging probes and techniques

Optical imaging has been essential for scientific observations to date, however its biomedical applications has been restricted due to its poor penetration through tissues. In living tissue, signal attenuation and limited imaging depth caused by the wave distortion occur because of scattering and absorption of light by various molecules including hemoglobin, pigments, and water. To overcome this, methodologies have been proposed in the various fields, which can be mainly categorized into two stategies: developing new imaging probes and optical techniques. For example, imaging probes with long wavelength like NIR-II region are advantageous in tissue penetration. Bioluminescence and chemiluminescence can generate light without excitation, minimizing background signals. Afterglow imaging also has high a signal-to-background ratio because excitation light is off during imaging. Methodologies of adaptive optics (AO) and studies of complex media have been established and have produced various techniques such as direct wavefront sensing to rapidly measure and correct the wave distortion and indirect wavefront sensing involving modal and zonal methods to correct complex aberrations. Matrix-based approaches have been used to correct the high-order optical modes by numerical post-processing without any hardware feedback. These newly developed imaging probes and optical techniques enable successful optical imaging through deep tissue. In this review, we discuss recent advances for multi-scale optical imaging within deep tissue, which can provide reseachers multi-disciplinary understanding and broad perspectives in diverse fields including biophotonics for the purpose of translational medicine and convergence science.

Multiscale fluorescence imaging of living samples

Fluorescence microscopy is a highly effective tool for interrogating biological structure and function, particularly when imaging across multiple spatiotemporal scales. Here we survey recent innovations and applications in the relatively understudied area of multiscale fluorescence imaging of living samples. We discuss fundamental challenges in live multiscale imaging and describe successful examples that highlight the power of this approach. We attempt to synthesize general strategies from these test cases, aiming to help accelerate progress in this exciting area.

Wavefront shaping: A versatile tool to conquer multiple scattering in multidisciplinary fields

Optical techniques offer a wide variety of applications as light-matter interactions provide extremely sensitive mechanisms to probe or treat target media. Most of these implementations rely on the usage of ballistic or quasi-ballistic photons to achieve high spatial resolution. However, the inherent scattering nature of light in biological tissues or tissue-like scattering media constitutes a critical obstacle that has restricted the penetration depth of non-scattered photons and hence limited the implementation of most optical techniques for wider applications. In addition, the components of an optical system are usually designed and manufactured for a fixed function or performance. Recent advances in wavefront shaping have demonstrated that scattering- or component-induced phase distortions can be compensated by optimizing the wavefront of the input light pattern through iteration or by conjugating the transmission matrix of the scattering medium. This offers unprecedented opportunities in many applications to achieve controllable optical delivery or detection at depths or dynamically configurable functionalities by using scattering media to substitute conventional optical components. In this article, the recent progress of wavefront shaping in multidisciplinary fields is reviewed, from optical focusing and imaging with scattering media, functionalized devices, modulation of mode coupling, and nonlinearity in multimode fiber to multimode fiber-based applications. Apart from insights into the underlying principles and recent advances in wavefront shaping implementations, practical limitations and roadmap for future development are discussed in depth. Looking back and looking forward, it is believed that wavefront shaping holds a bright future that will open new avenues for noninvasive or minimally invasive optical interactions and arbitrary control inside deep tissues. The high degree of freedom with multiple scattering will also provide unprecedented opportunities to develop novel optical devices based on a single scattering medium (generic or customized) that can outperform traditional optical components.

Local aberration control to improve efficiency in multiphoton holographic projections

Optical aberrations affect the quality of light propagating through a turbid medium, where refractive index is spatially inhomogeneous. In multiphoton optical applications, such as two-photon excitation fluorescence imaging and optogenetics, aberrations non-linearly impair the efficiency of excitation. We demonstrate a sensorless adaptive optics technique to compensate aberrations in holograms projected into turbid media. We use a spatial light modulator to project custom three dimensional holographic patterns and to correct for local (anisoplanatic) distortions. The method is tested on both synthetic and biological samples to counteract aberrations arising respectively from misalignment of the optical system and from samples inhomogeneities. In both cases the anisoplanatic correction improves the intensity of the stimulation pattern at least two-fold.

Simultaneous Observation of Mouse Cortical and Hippocampal Neural Dynamics under Anesthesia through a Cranial Microprism Window

The fluorescence microscope has been widely used to explore dynamic processes in vivo in mouse brains, with advantages of a large field-of-view and high spatiotemporal resolution. However, owing to background light and tissue scattering, the single-photon wide-field microscope fails to record dynamic neural activities in the deep brain. To achieve simultaneous imaging of deep-brain regions and the superficial cortex, we combined the extended-field-of-view microscopy previously proposed with a novel prism-based cranial window to provide a longitudinal view. As well as a right-angle microprism for imaging above 1 mm, we also designed a new rectangular-trapezoidal microprism cranial window to extend the depth of observation to 1.5 mm and to reduce brain injury. We validated our method with structural imaging of microglia cells in the superficial cortex and deep-brain regions. We also recorded neuronal activity from the mouse brains in awake and anesthesitized states. The results highlight the great potential of our methods for simultaneous dynamic imaging in the superficial and deep layers of mouse brains.

The Effects of Optical Aberrations to Illumination Beam Thickness in Two-Photon Excitation Microscopes

When performing in vivo imaging of live samples, it is a big challenge to penetrate thick tissues while still maintaining high resolution and a large field of view because of the sample-induced aberrations. These requirements can be met by combining the benefits of two-photon excitation, beam modulation and adaptive optics in an illumination path. However, the relationship between aberrations and the performance of such a microscopy system has never been systematically and comprehensively assessed. Here, two-photon Gaussian and Bessel beams are modulated as illumination beams, and how aberrations affect the thickness of the illumination beams is evaluated. It is found that the thickness variation is highly related to the azimuthal order of Zernike modes. The thickness of the two-photon Gaussian beam is more sensitive to Zernike modes with lower azimuthal order, while the thickness of the two-photon Bessel beam is more sensitive to the higher-azimuthal-order Zernike modes. So, it is necessary to design a new strategy to correct aberrations according to the effects of different Zernike modes in order to maximize the correction capability of correctors and reduce the correction errors for those insensitive Zernike modes. These results may provide important guidance for the design and evaluation of adaptive optical systems in a two-photon excitation microscope.

Imaging Complex Targets through a Scattering Medium Based on Adaptive Encoding

The scattering of light after passing through a complex medium poses challenges in many fields. Any point in the collected speckle will contain information from the entire target plane because of the randomness of scattering. The detailed information of complex targets is submerged in the aliased signal caused by random scattering, and the aliased signal causes the quality of the recovered target to be degraded. In this paper, a new neural network named Adaptive Encoding Scattering Imaging ConvNet (AESINet) is constructed by analyzing the physical prior of speckle image redundancy to recover complex targets hidden behind the opaque medium. AESINet reduces the redundancy of speckle through adaptive encoding which effectively improves the separability of data; the encoded speckle makes it easier for the network to extract features, and helps restore the detailed information of the target. The necessity for adaptive encoding is analyzed, and the ability of this method to reconstruct complex targets is tested. The peak signal-to-noise ratio (PSNR) of the reconstructed target after adaptive encoding can be improved by 1.8 dB. This paper provides an effective reference for neural networks combined with other physical priors in scattering processes.

Multi-segmented feature coupling for jointly reconstructing initial pressure and speed of sound in photoacoustic computed tomography

SIGNIFICANCE

Photoacoustic computed tomography (PACT) is a fast-growing imaging modality. In PACT, the image quality is degraded due to the unknown distribution of the speed of sound (SoS). Emerging initial pressure (IP) and SoS joint-reconstruction methods promise reduced artifacts in PACT. However, previous joint-reconstruction methods have some deficiencies. A more effective method has promising prospects in preclinical applications.

AIM

We propose a multi-segmented feature coupling (MSFC) method for SoS-IP joint reconstruction in PACT.

APPROACH

In the proposed method, the ultrasound detectors were divided into multiple sub-arrays with each sub-array and its opposite counterpart considered to be a pair. The delay and sum algorithm was then used to reconstruct two images based on a subarray pair and estimated a direction-specific SoS, based on image correlation and the orientation of the subarrays. Once the data generated by all pairs of subarrays were processed, an image that was optimized in terms of minimal feature splitting in all directions was generated. Further, based on the direction-specific SoS, a model-based method was used to directly reconstruct the SoS distribution.

RESULTS

Both phantom and animal experiments demonstrated feasibility and showed promising results compared with conventional methods, with less splitting and blurring and fewer distortions.

CONCLUSIONS

The developed MSFC method shows promising results for both IP and SoS reconstruction. The MSFC method will help to optimize the image quality of PACT in clinical applications.

Advantages, Pitfalls, and Developments of All Optical Interrogation Strategies of Microcircuits in vivo

The holy grail for every neurophysiologist is to conclude a causal relationship between an elementary behaviour and the function of a specific brain area or circuit. Our effort to map elementary behaviours to specific brain loci and to further manipulate neural activity while observing the alterations in behaviour is in essence the goal for neuroscientists. Recent advancements in the area of experimental brain imaging in the form of longer wavelength near infrared (NIR) pulsed lasers with the development of highly efficient optogenetic actuators and reporters of neural activity, has endowed us with unprecedented resolution in spatiotemporal precision both in imaging neural activity as well as manipulating it with multiphoton microscopy. This readily available toolbox has introduced a so called all-optical physiology and interrogation of circuits and has opened new horizons when it comes to precisely, fast and non-invasively map and manipulate anatomically, molecularly or functionally identified mesoscopic brain circuits. The purpose of this review is to describe the advantages and possible pitfalls of all-optical approaches in system neuroscience, where by all-optical we mean use of multiphoton microscopy to image the functional response of neuron(s) in the network so to attain flexible choice of the cells to be also optogenetically photostimulated by holography, in absence of electrophysiology. Spatio-temporal constraints will be compared toward the classical reference of electrophysiology methods. When appropriate, in relation to current limitations of current optical approaches, we will make reference to latest works aimed to overcome these limitations, in order to highlight the most recent developments. We will also provide examples of types of experiments uniquely approachable all-optically. Finally, although mechanically non-invasive, all-optical electrophysiology exhibits potential off-target effects which can ambiguate and complicate the interpretation of the results. In summary, this review is an effort to exemplify how an all-optical experiment can be designed, conducted and interpreted from the point of view of the integrative neurophysiologist.

Single-Step Fast Tissue Clearing of Thick Mouse Brain Tissue for Multi-Dimensional High-Resolution Imaging

Recent advances in optical clearing techniques have dramatically improved deep tissue imaging by reducing the obscuring effects of light scattering and absorption. However, these optical clearing methods require specialized equipment or a lengthy undertaking with complex protocols that can lead to sample volume changes and distortion. In addition, the imaging of cleared tissues has limitations, such as fluorescence bleaching, harmful and foul-smelling solutions, and the difficulty of handling samples in high-viscosity refractive index (RI) matching solutions. To address the various limitations of thick tissue imaging, we developed an Aqueous high refractive Index matching and tissue Clearing solution for Imaging (termed AICI) with a one-step tissue clearing protocol that was easily made at a reasonable price in our own laboratory without any equipment. AICI can rapidly clear a 1 mm thick brain slice within 90 min with simultaneous RI matching, low viscosity, and a high refractive index (RI = 1.466), allowing the imaging of the sample without additional processing. We compared AICI with commercially available RI matching solutions, including optical clear agents (OCAs), for tissue clearing. The viscosity of AICI is closer to that of water compared with other RI matching solutions, and there was a less than 2.3% expansion in the tissue linear morphology during 24 h exposure to AICI. Moreover, AICI remained fluid over 30 days of air exposure, and the EGFP fluorescence signal was only reduced to ~65% after 10 days. AICI showed a limited clearing of brain tissue >3 mm thick. However, fine neuronal structures, such as dendritic spines and axonal boutons, could still be imaged in thick brain slices treated with AICI. Therefore, AICI is useful not only for the three-dimensional (3D) high-resolution identification of neuronal structures, but also for the examination of multiple structural imaging by neuronal distribution, projection, and gene expression in deep brain tissue. AICI is applicable beyond the imaging of fluorescent antibodies and dyes, and can clear a variety of tissue types, making it broadly useful to researchers for optical imaging applications.

Three-Photon Adaptive Optics for Mouse Brain Imaging

Three-photon microscopy (3PM) was shown to allow deeper imaging than two-photon microscopy (2PM) in scattering biological tissues, such as the mouse brain, since the longer excitation wavelength reduces tissue scattering and the higher-order non-linear excitation suppresses out-of-focus background fluorescence. Imaging depth and resolution can further be improved by aberration correction using adaptive optics (AO) techniques where a spatial light modulator (SLM) is used to correct wavefront aberrations. Here, we present and analyze a 3PM AO system for in vivo mouse brain imaging. We use a femtosecond source at 1300 nm to generate three-photon (3P) fluorescence in yellow fluorescent protein (YFP) labeled mouse brain and a microelectromechanical (MEMS) SLM to apply different Zernike phase patterns. The 3P fluorescence signal is used as feedback to calculate the amount of phase correction without direct phase measurement. We show signal improvement in the cortex and the hippocampus at greater than 1 mm depth and demonstrate close to diffraction-limited imaging in the cortical layers of the brain, including imaging of dendritic spines. In addition, we characterize the effective volume for AO correction within brain tissues, and discuss the limitations of AO correction in 3PM of mouse brain.

Single-shot quantitative aberration and scattering length measurements in mouse brain tissues using an extended-source Shack-Hartmann wavefront sensor

Deep fluorescence imaging in mammalian brain tissues remains challenging due to scattering and optical aberration-induced loss in signal and resolution. Correction of aberrations using adaptive optics (AO) requires their reliable measurement in the tissues. Here, we show that an extended-source Shack-Hartmann wavefront sensor (ESSH) allows quantitative aberration measurements through fixed brain slices with a thickness up to four times their scattering length. We demonstrate in particular that this wavefront measurement method based on image correlation is more robust to scattering compared to the standard centroid-based approach. Finally, we obtain a measurement of the tissue scattering length taking advantage of the geometry of a Shack-Hartmann sensor.

Complex-Amplitude-Modulation Vectorial Excitation Beam for High-Resolution Observation of Deep Regions in Two-Photon Microscopy

In two-photon microscopy, aberration correction is an essential technique for realizing high resolution in deep regions. A spatial light modulator (SLM) incorporated into an optical system for two-photon microscopy performs pre-compensation on the wavefront of the excitation beam, restoring the resolution close to the diffraction limit even in the deep region of a biological sample. If a spatial resolution smaller than the diffraction limit can be achieved along with aberration correction, the importance of two-photon microscopy for deep region observation will increase further. In this study, we realize higher resolution observations in the deep region by combining two resolution-enhancement methods and an aberration correction method. Therefore, a z-polarizer is added to the aberration-correction optical system, and the SLM modulates the amplitude and phase of the excitation beam; in other words, complex-amplitude modulation is performed. The lateral resolution is found to be approximately 20% higher than the diffraction limit obtained using a circularly polarized beam. Verification was conducted by simulation and experimentation using model samples and ex vivo biological samples. The proposed method has the potential to be effective for live imaging and photostimulation of the deep region of the sample, although it requires only minor changes to the conventional optical system that performs aberration correction.

Aberration Correction to Optimize the Performance of Two-Photon Fluorescence Microscopy Using the Genetic Algorithm

Due to less light scattering and a better signal-to-noise ratio in deep imaging, two-photon fluorescence microscopy (TPFM) has been widely used in biomedical photonics since its advent. However, optical aberrations degrade the performance of TPFM in terms of the signal intensity and the imaging depth and therefore restrict its application. Here, we introduce adaptive optics based on the genetic algorithm to detect the distorted wavefront of the excitation laser beam and then perform aberration correction to optimize the performance of TPFM. By using a spatial light modulator as the wavefront controller, the correction phase is obtained through a signal feedback loop and a process of natural selection. The experimental results show that the signal intensity and imaging depth of TPFM are improved after aberration correction. Finally, the method was applied to two-photon fluorescence lifetime imaging, which helps to improve the signal-to-noise ratio and the accuracy of lifetime analysis. Furthermore, the method can also be implemented in other experiments, such as three-photon microscopy, light-sheet microscopy, and super-resolution microscopy.

Improvement of spatial resolution in photoacoustic microscopy using transmissive adaptive optics with a low-frequency ultrasound transducer

Maintaining a high spatial resolution in photoacoustic microscopy (PAM) of deep tissues is difficult due to large aberration in an objective lens with high numerical aperture and photoacoustic wave attenuation. To address the issue, we integrate transmission-type adaptive optics (AO) in high-resolution PAM with a low-frequency ultrasound transducer (UT), which increases the photoacoustic wave detection efficiency. AO improves lateral resolution and depth discrimination in PAM, even for low-frequency ultrasound waves by focusing a beam spot in deep tissues. Using the proposed PAM, we increased the lateral resolution and depth discrimination for blood vessels in mouse ears.

Fluorescence imaging of large-scale neural ensemble dynamics

Recent progress in fluorescence imaging allows neuroscientists to observe the dynamics of thousands of individual neurons, identified genetically or by their connectivity, across multiple brain areas and for extended durations in awake behaving mammals. We discuss advances in fluorescent indicators of neural activity, viral and genetic methods to express these indicators, chronic animal preparations for long-term imaging studies, and microscopes to monitor and manipulate the activity of large neural ensembles. Ca²⁺ imaging studies of neural activity can track brain area interactions and distributed information processing at cellular resolution. Across smaller spatial scales, high-speed voltage imaging reveals the distinctive spiking patterns and coding properties of targeted neuron types. Collectively, these innovations will propel studies of brain function and dovetail with ongoing neuroscience initiatives to identify new neuron types and develop widely applicable, non-human primate models. The optical toolkit's growing sophistication also suggests that "brain observatory" facilities would be useful open resources for future brain-imaging studies.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Light Sheet Illumination for 3D Single-Molecule Super-Resolution Imaging of Neuronal Synapses

The function of the neuronal synapse depends on the dynamics and interactions of individual molecules at the nanoscale. With the development of single-molecule super-resolution microscopy over the last decades, researchers now have a powerful and versatile imaging tool for mapping the molecular mechanisms behind the biological function. However, imaging of thicker samples, such as mammalian cells and tissue, in all three dimensions is still challenging due to increased fluorescence background and imaging volumes. The combination of single-molecule imaging with light sheet illumination is an emerging approach that allows for imaging of biological samples with reduced fluorescence background, photobleaching, and photodamage. In this review, we first present a brief overview of light sheet illumination and previous super-resolution techniques used for imaging of neurons and synapses. We then provide an in-depth technical review of the fundamental concepts and the current state of the art in the fields of three-dimensional single-molecule tracking and super-resolution imaging with light sheet illumination. We review how light sheet illumination can improve single-molecule tracking and super-resolution imaging in individual neurons and synapses, and we discuss emerging perspectives and new innovations that have the potential to enable and improve single-molecule imaging in brain tissue.

Novel Toolboxes for the Investigation of Activity-Dependent Myelination in the Central Nervous System

Myelination is essential for signal processing within neural networks. Emerging data suggest that neuronal activity positively instructs myelin development and myelin adaptation during adulthood. However, the underlying mechanisms controlling activity-dependent myelination have not been fully elucidated. Myelination is a multi-step process that involves the proliferation and differentiation of oligodendrocyte precursor cells followed by the initial contact and ensheathment of axons by mature oligodendrocytes. Conventional end-point studies rarely capture the dynamic interaction between neurons and oligodendrocyte lineage cells spanning such a long temporal window. Given that such interactions and downstream signaling cascades are likely to occur within fine cellular processes of oligodendrocytes and their precursor cells, overcoming spatial resolution limitations represents another technical hurdle in the field. In this mini-review, we discuss how advanced genetic, cutting-edge imaging, and electrophysiological approaches enable us to investigate neuron-oligodendrocyte lineage cell interaction and myelination with both temporal and spatial precision.

Moving beyond velocity: Opportunities and challenges to quantify immune cell behavior

The analysis of cellular behavior using intravital multi-photon microscopy has contributed substantially to our understanding of the priming and effector phases of immune responses. Yet, many questions remain unanswered and unexplored. Though advancements in intravital imaging techniques and animal models continue to drive new discoveries, continued improvements in analysis methods are needed to extract detailed information about cellular behavior. Focusing on dendritic cell (DC) and T cell interactions as an exemplar, here we discuss key limitations for intravital imaging studies and review and explore alternative approaches to quantify immune cell behavior. We touch upon current developments in deep learning models, as well as established methods from unrelated fields such as ecology to detect and track objects over time. As developments in open-source software make it possible to process and interactively view larger datasets, the challenge for the field will be to determine how best to combine intravital imaging with multi-parameter imaging of larger tissue regions to discover new facets of leukocyte dynamics and how these contribute to immune responses.

In vivo volumetric imaging of calcium and glutamate activity at synapses with high spatiotemporal resolution

Studying neuronal activity at synapses requires high spatiotemporal resolution. For high spatial resolution in vivo imaging at depth, adaptive optics (AO) is required to correct sample-induced aberrations. To improve temporal resolution, Bessel focus has been combined with two-photon fluorescence microscopy (2PFM) for fast volumetric imaging at subcellular lateral resolution. To achieve both high-spatial and high-temporal resolution at depth, we develop an efficient AO method that corrects the distorted wavefront of Bessel focus at the objective focal plane and recovers diffraction-limited imaging performance. Applying AO Bessel focus scanning 2PFM to volumetric imaging of zebrafish larval and mouse brains down to 500 µm depth, we demonstrate substantial improvements in the sensitivity and resolution of structural and functional measurements of synapses in vivo. This enables volumetric measurements of synaptic calcium and glutamate activity at high accuracy, including the simultaneous recording of glutamate activity of apical and basal dendritic spines in the mouse cortex.

Extended range and aberration-free autofocusing via remote focusing and sequence-dependent learning

Rapid autofocusing over long distances is critical for tracking 3D topological variations and sample motion in real time. Taking advantage of a deformable mirror and Shack-Hartmann wavefront sensor, remote focusing can permit fast axial scanning with simultaneous correction of system-induced aberrations. Here, we report an autofocusing technique that combines remote focusing with sequence-dependent learning via a bidirectional long short term memory network. A 120 µm autofocusing range was achieved in a compact reflectance confocal microscope both in air and in refractive-index-mismatched media, with similar performance under arbitrary-thickness liquid layers up to 1 mm. The technique was validated on sample types not used for network training, as well as for tracking of continuous axial motion. These results demonstrate that the proposed technique is suitable for real-time aberration-free autofocusing over a large axial range, and provides unique advantages for biomedical, holographic and other related applications.

Angle-based wavefront sensing enabled by the near fields of flat optics

There is a long history of using angle sensors to measure wavefront. The best example is the Shack-Hartmann sensor. Compared to other methods of wavefront sensing, angle-based approach is more broadly used in industrial applications and scientific research. Its wide adoption is attributed to its fully integrated setup, robustness, and fast speed. However, there is a long-standing issue in its low spatial resolution, which is limited by the size of the angle sensor. Here we report a angle-based wavefront sensor to overcome this challenge. It uses ultra-compact angle sensor built from flat optics. It is directly integrated on focal plane array. This wavefront sensor inherits all the benefits of the angle-based method. Moreover, it improves the spatial sampling density by over two orders of magnitude. The drastically improved resolution allows angle-based sensors to be used for quantitative phase imaging, enabling capabilities such as video-frame recording of high-resolution surface topography.

Generally, wavefronts are measured using angle-based sensors like the Shack-Hartmann sensor. Here, the authors present an angle-sensitive device that uses flat optics integrated on a focal plane array for compact wavefront sensing with improved resolution.

An adaptive optics module for deep tissue multiphoton imaging in vivo

Understanding complex biological systems requires visualizing structures and processes deep within living organisms. We developed a compact adaptive optics module and incorporated it into two- and three-photon fluorescence microscopes, to measure and correct tissue-induced aberrations. We resolved synaptic structures in deep cortical and subcortical areas of the mouse brain, and demonstrated high-resolution imaging of neuronal structures and somatosensory-evoked calcium responses in the mouse spinal cord at great depths in vivo.

High-resolution structural and functional deep brain imaging using adaptive optics three-photon microscopy

Multiphoton microscopy has become a powerful tool with which to visualize the morphology and function of neural cells and circuits in the intact mammalian brain. However, tissue scattering, optical aberrations and motion artifacts degrade the imaging performance at depth. Here we describe a minimally invasive intravital imaging methodology based on three-photon excitation, indirect adaptive optics (AO) and active electrocardiogram gating to advance deep-tissue imaging. Our modal-based, sensorless AO approach is robust to low signal-to-noise ratios as commonly encountered in deep scattering tissues such as the mouse brain, and permits AO correction over large axial fields of view. We demonstrate near-diffraction-limited imaging of deep cortical spines and (sub)cortical dendrites up to a depth of 1.4 mm (the edge of the mouse CA1 hippocampus). In addition, we show applications to deep-layer calcium imaging of astrocytes, including fibrous astrocytes that reside in the highly scattering corpus callosum.

Electrically tunable lenses - eliminating mechanical axial movements during high-speed 3D live imaging

The successful investigation of photosensitive and dynamic biological events, such as those in a proliferating tissue or a dividing cell, requires non-intervening high-speed imaging techniques. Electrically tunable lenses (ETLs) are liquid lenses possessing shape-changing capabilities that enable rapid axial shifts of the focal plane, in turn achieving acquisition speeds within the millisecond regime. These human-eye-inspired liquid lenses can enable fast focusing and have been applied in a variety of cell biology studies. Here, we review the history, opportunities and challenges underpinning the use of cost-effective high-speed ETLs. Although other, more expensive solutions for three-dimensional imaging in the millisecond regime are available, ETLs continue to be a powerful, yet inexpensive, contender for live-cell microscopy.

Closed-loop wavefront sensing and correction in the mouse brain with computed optical coherence microscopy

Optical coherence microscopy (OCM) uses interferometric detection to capture the complex optical field with high sensitivity, which enables computational wavefront retrieval using back-scattered light from the sample. Compared to a conventional wavefront sensor, aberration sensing with OCM via computational adaptive optics (CAO) leverages coherence and confocal gating to obtain signals from the focus with less cross-talk from other depths or transverse locations within the field-of-view. Here, we present an investigation of the performance of CAO-based aberration sensing in simulation, bead phantoms, and ex vivo mouse brain tissue. We demonstrate that, due to the influence of the double-pass confocal OCM imaging geometry on the shape of computed pupil functions, computational sensing of high-order aberrations can suffer from signal attenuation in certain spatial-frequency bands and shape similarity with lower order counterparts. However, by sensing and correcting only low-order aberrations (astigmatism, coma, and trefoil), we still successfully corrected tissue-induced aberrations, leading to 3× increase in OCM signal intensity at a depth of ∼0.9 mm in a freshly dissected ex vivo mouse brain.

Adaptive optics for dynamic aberration compensation using parallel model-based controllers based on a field programmable gate array

Adaptive optics (AO) is an effective technique for compensating the aberrations in optical systems and restoring their performance for various applications such as image formation, laser processing, and beam shaping. To reduce the controller complexity and extend the compensation capacity from static aberrations to dynamic disturbances, the present study proposes an AO system consisting of a self-built Shack-Hartmann wavefront sensor (SHWS), a deformable mirror (DM), and field programmable gate array (FPGA)-based controllers. This AO system is developed for tracking static and dynamic disturbances and tuning the controller parameters as required to achieve rapid compensation of the incoming wavefront. In the proposed system, the FPGA estimates the coefficients of the eight Zernike modes based on the SHWS with CameraLink operated at 200 Hz. The estimated coefficients are then processed by eight parallel independent discrete controllers to generate the voltage vectors to drive the DM to compensate the aberrations. To have the DM model for controller design, the voltage vectors are identified offline and are optimized by closed-loop controllers. Furthermore, the controller parameters are tuned dynamically in accordance with the main frequency of the aberration as determined by a fast Fourier transform (FFT) process. The experimental results show that the AO system provides a low complexity and effective means of compensating both static aberrations and dynamic disturbance up to 20 Hz.

Subcellular three-dimensional imaging deep through multicellular thick samples by structured illumination microscopy and adaptive optics

Structured Illumination Microscopy enables live imaging with sub-diffraction resolution. Unfortunately, optical aberrations can lead to loss of resolution and artifacts in Structured Illumination Microscopy rendering the technique unusable in samples thicker than a single cell. Here we report on the combination of Adaptive Optics and Structured Illumination Microscopy enabling imaging with 150 nm lateral and 570 nm axial resolution at a depth of 80 µm through Caenorhabditis elegans. We demonstrate that Adaptive Optics improves the three-dimensional resolution, especially along the axial direction, and reduces artifacts, successfully realizing 3D-Structured Illumination Microscopy in a variety of biological samples.

Intravital kidney microscopy: entering a new era

The development of intravital imaging with multiphoton microscopy has had a major impact on kidney research. It provides the unique opportunity to visualize dynamic behavior of cells and organelles in their native environment and to relate this to the complex 3-dimensional structure of the organ. Moreover, changes in cell/organelle function can be followed in real time in response to physiological interventions or disease-causing insults. However, realizing the enormous potential of this exciting approach has necessitated overcoming several substantial practical hurdles. In this article, we outline the nature of these challenges and how a variety of technical advances have provided effective solutions. In particular, improvements in laser/microscope technology, fluorescent probes, transgenic animals, and abdominal windows are collectively making previously opaque processes visible. Meanwhile, the rise of machine learning-based image analysis is facilitating the rapid generation of large amounts of quantitative data, amenable to deeper statistical interrogation. Taken together, the increased capabilities of multiphoton imaging are opening up huge new possibilities to study structure-function relationships in the kidney in unprecedented detail. In addition, they are yielding important new insights into cellular mechanisms of tissue damage, repair, and adaptive remodeling during disease states. Thus, intravital microscopy is truly entering an exciting new era in translational kidney research.