Adaptive optical microscopy for neurobiology

"There's plenty of room at the bottom": deep brain imaging with holographic endo-microscopy

Significance

Over more than 300 years, microscopic imaging keeps providing fundamental insights into the mechanisms of living organisms. Seeing microscopic structures beyond the reach of free-space light-based microscopy, however, requires dissection of the tissue-an intervention seriously disturbing its physiological functions. The hunt for low-invasiveness tools has led a growing community of physicists and engineers into the realm of complex media photonics. One of its activities represents exploiting multimode optical fibers (MMFs) as ultra-thin endoscopic probes. Employing wavefront shaping, these tools only recently facilitated the first peeks at cells and their sub-cellular compartments at the bottom of the mouse brain with the impact of micro-scale tissue damage.

Aim

Here, we aim to highlight advances in MMF-based holographic endo-microscopy facilitating microscopic imaging throughout the whole depth of the mouse brain.

Approach

We summarize the important technical and methodological prerequisites for stabile high-resolution imaging in vivo.

Results

We showcase images of the microscopic building blocks of brain tissue, including neurons, neuronal processes, vessels, intracellular calcium signaling, and red blood cell velocity in individual vessels.

Conclusions

This perspective article helps to understand the complexity behind the technology of holographic endo-microscopy, summarizes its recent advances and challenges, and stimulates the mind of the reader for further exploitation of this tool in the neuroscience research.

Multiphoton fluorescence microscopy for in vivo imaging

Multiphoton fluorescence microscopy (MPFM) has been a game-changer for optical imaging, particularly for studying biological tissues deep within living organisms. MPFM overcomes the strong scattering of light in heterogeneous tissue by utilizing nonlinear excitation that confines fluorescence emission mostly to the microscope focal volume. This enables high-resolution imaging deep within intact tissue and has opened new avenues for structural and functional studies. MPFM has found widespread applications and has led to numerous scientific discoveries and insights into complex biological processes. Today, MPFM is an indispensable tool in many research communities. Its versatility and effectiveness make it a go-to technique for researchers investigating biological phenomena at the cellular and subcellular levels in their native environments. In this Review, the principles, implementations, capabilities, and limitations of MPFM are presented. Three application areas of MPFM, neuroscience, cancer biology, and immunology, are reviewed in detail and serve as examples for applying MPFM to biological research.

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to enhancements in image quality.

Adaptive optical third-harmonic generation microscopy for in vivo imaging of tissues

Third-harmonic generation microscopy is a powerful label-free nonlinear imaging technique, providing essential information about structural characteristics of cells and tissues without requiring external labelling agents. In this work, we integrated a recently developed compact adaptive optics module into a third-harmonic generation microscope, to measure and correct for optical aberrations in complex tissues. Taking advantage of the high sensitivity of the third-harmonic generation process to material interfaces and thin membranes, along with the 1,300-nm excitation wavelength used here, our adaptive optical third-harmonic generation microscope enabled high-resolution in vivo imaging within highly scattering biological model systems. Examples include imaging of myelinated axons and vascular structures within the mouse spinal cord and deep cortical layers of the mouse brain, along with imaging of key anatomical features in the roots of the model plant Brachypodium distachyon. In all instances, aberration correction led to significant enhancements in image quality.

Analysis of age-related changes in the left ventricular myocardium with multiphoton microscopy

Aging induces cardiac remodeling, resulting in an increase in the risk of suffering heart diseases, including heart failure. Collagen deposition increases with age and, together with sarcomeric changes in cardiomyocytes, may lead to ventricular stiffness. Multiphoton (MP) microscopy is a useful technique to visualize and detect variations in cardiac structures in a label free fashion. Here, we propose a method based on MP imaging (both two-photon excitation fluorescence (TPEF) and second harmonic generation (SHG) modalities) to explore and objectively quantify age-related structural differences in various components of cardiac tissues. Results in transmural porcine left ventricle (LV) sections reveal significant differences when comparing samples from young and old animals. Collagen and myosin SHG signals in old specimens are respectively 3.8x and >6-fold larger than in young ones. Differences in TPEF signals from cardiomyocyte were ∼3x. Moreover, the increased amount of collagen in old specimens results in a more organized pattern when compared to young LV tissues. Since changes in collagen and myosin are associated with cardiac dysfunction, the technique used herein might be a useful tool to accurately predict and measure changes associated with age-related myocardium fibrosis, tissue remodeling and sarcomeric alterations, with potential implications in preventing heart disease.

Three-photon excited fluorescence microscopy enables imaging of blood flow, neural structure and inflammatory response deep into mouse spinal cord in vivo

Nonlinear optical microscopy enables non-invasive imaging in scattering samples with cellular resolution. The spinal cord connects the brain with the periphery and governs fundamental behaviors such as locomotion and somatosensation. Because of dense myelination on the dorsal surface, imaging to the spinal grey matter is challenging, even with two-photon microscopy. Here we show that three-photon excited fluorescence (3PEF) microscopy enables multicolor imaging at depths of up to ~550 μm into the mouse spinal cord, in vivo. We quantified blood flow across vessel types along the spinal vascular network. We then followed the response of neurites and microglia after occlusion of a surface venule, where we observed depth-dependent structural changes in neurites and interactions of perivascular microglia with vessel branches upstream from the clot. This work establishes that 3PEF imaging enables studies of functional dynamics and cell type interactions in the top 550 μm of the murine spinal cord, in vivo.

Spherical Aberration and Scattering Compensation in Microscopy Images through a Blind Deconvolution Method

The optical quality of an image depends on both the optical properties of the imaging system and the physical properties of the medium the light passes while travelling from the object to the image plane. The computation of the point spread function (PSF) associated to the optical system is often used to assess the image quality. In a non-ideal optical system, the PSF is affected by aberrations that distort the final image. Moreover, in the presence of turbid media, the scattering phenomena spread the light at wide angular distributions that contribute to reduce contrast and sharpness. If the mathematical degradation operator affecting the recorded image is known, the image can be restored through deconvolution methods. In some scenarios, no (or partial) information on the PSF is available. In those cases, blind deconvolution approaches arise as useful solutions for image restoration. In this work, a new blind deconvolution method is proposed to restore images using spherical aberration (SA) and scatter-based kernel filters. The procedure was evaluated in different microscopy images. The results show the capability of the algorithm to detect both degradation coefficients (i.e., SA and scattering) and to restore images without information on the real PSF.

Deep-brain optical recording of neural dynamics during behavior

In vivo fluorescence recording techniques have produced landmark discoveries in neuroscience, providing insight into how single cell and circuit-level computations mediate sensory processing and generate complex behaviors. While much attention has been given to recording from cortical brain regions, deep-brain fluorescence recording is more complex because it requires additional measures to gain optical access to harder to reach brain nuclei. Here we discuss detailed considerations and tradeoffs regarding deep-brain fluorescence recording techniques and provide a comprehensive guide for all major steps involved, from project planning to data analysis. The goal is to impart guidance for new and experienced investigators seeking to use in vivo deep fluorescence optical recordings in awake, behaving rodent models.

Blind deconvolution of second harmonic microscopy images of the living human eye

Second harmonic generation (SHG) imaging microscopy of thick biological tissues is affected by the presence of aberrations and scattering within the sample. Moreover, additional problems, such as uncontrolled movements, appear when imaging in-vivo. Deconvolution methods can be used to overcome these limitations under some conditions. In particular, we present here a technique based on a marginal blind deconvolution approach for improving SHG images obtained in vivo in the human eye (cornea and sclera). Different image quality metrics are used to quantify the attained improvement. Collagen fibers in both cornea and sclera are better visualized and their spatial distributions accurately assessed. This might be a useful tool to better discriminate between healthy and pathological tissues, especially those where changes in collagen distribution occur.

Retinal microvascular and neuronal pathologies probed in vivo by adaptive optical two-photon fluorescence microscopy

The retina, behind the transparent optics of the eye, is the only neural tissue whose physiology and pathology can be non-invasively probed by optical microscopy. The aberrations intrinsic to the mouse eye, however, prevent high-resolution investigation of retinal structure and function in vivo. Optimizing the design of a two-photon fluorescence microscope (2PFM) and sample preparation procedure, we found that adaptive optics (AO), by measuring and correcting ocular aberrations, is essential for resolving putative synaptic structures and achieving three-dimensional cellular resolution in the mouse retina in vivo. Applying AO-2PFM to longitudinal retinal imaging in transgenic models of retinal pathology, we characterized microvascular lesions with sub-capillary details in a proliferative vascular retinopathy model, and found Lidocaine to effectively suppress retinal ganglion cell hyperactivity in a retinal degeneration model. Tracking structural and functional changes at high-resolution longitudinally, AO-2PFM enables microscopic investigations of retinal pathology and pharmacology for disease diagnosis and treatment in vivo.

Adaptive optics for optical microscopy [Invited]

Optical microscopy is widely used to visualize fine structures. When applied to bioimaging, its performance is often degraded by sample-induced aberrations. In recent years, adaptive optics (AO), originally developed to correct for atmosphere-associated aberrations, has been applied to a wide range of microscopy modalities, enabling high- or super-resolution imaging of biological structure and function in complex tissues. Here, we review classic and recently developed AO techniques and their applications in optical microscopy.

The effect of single-cell knockout of Fragile X Messenger Ribonucleoprotein on synaptic structural plasticity

Fragile X Syndrome (FXS) is the best-known form of inherited intellectual disability caused by the loss-of-function mutation in a single gene. The FMR1 gene mutation abolishes the expression of Fragile X Messenger Ribonucleoprotein (FMRP), which regulates the expression of many synaptic proteins. Cortical pyramidal neurons in postmortem FXS patient brains show abnormally high density and immature morphology of dendritic spines; this phenotype is replicated in the Fmr1 knockout (KO) mouse. While FMRP is well-positioned in the dendrite to regulate synaptic plasticity, intriguing in vitro and in vivo data show that wild type neurons embedded in a network of Fmr1 KO neurons or glia exhibit spine abnormalities just as neurons in Fmr1 global KO mice. This raises the question: does FMRP regulate synaptic morphology and dynamics in a cell-autonomous manner, or do the synaptic phenotypes arise from abnormal pre-synaptic inputs? To address this question, we combined viral and mouse genetic approaches to delete FMRP from a very sparse subset of cortical layer 5 pyramidal neurons (L5 PyrNs) either during early postnatal development or in adulthood. We then followed the structural dynamics of dendritic spines on these Fmr1 KO neurons by in vivo two-photon microscopy. We found that, while L5 PyrNs in adult Fmr1 global KO mice have abnormally high density of thin spines, single-cell Fmr1 KO in adulthood does not affect spine density, morphology, or dynamics. On the contrary, neurons with neonatal FMRP deletion have normal spine density but elevated spine formation at 1 month of age, replicating the phenotype in Fmr1 global KO mice. Interestingly, these neurons exhibit elevated thin spine density, but normal total spine density, by adulthood. Together, our data reveal cell-autonomous FMRP regulation of cortical synaptic dynamics during adolescence, but spine defects in adulthood also implicate non-cell-autonomous factors.

Adaptive aberration correction using an electrowetting array

We demonstrate a method that permits wavefront aberration correction using an array of electrowetting prisms. A fixed high fill factor microlens array followed by a lower fill factor adaptive electrowetting prism array is used to correct wavefront aberration. The design and simulation of such aberration correction mechanism is described. Our results show significant improvement to the Strehl ratio by using our aberration correction scheme which results in diffraction limited performance. Compactness and effectiveness of our design can be implemented in many applications that require aberration correction, such as microscopy and consumer electronics.

Local aberration control to improve efficiency in multiphoton holographic projections

Optical aberrations affect the quality of light propagating through a turbid medium, where refractive index is spatially inhomogeneous. In multiphoton optical applications, such as two-photon excitation fluorescence imaging and optogenetics, aberrations non-linearly impair the efficiency of excitation. We demonstrate a sensorless adaptive optics technique to compensate aberrations in holograms projected into turbid media. We use a spatial light modulator to project custom three dimensional holographic patterns and to correct for local (anisoplanatic) distortions. The method is tested on both synthetic and biological samples to counteract aberrations arising respectively from misalignment of the optical system and from samples inhomogeneities. In both cases the anisoplanatic correction improves the intensity of the stimulation pattern at least two-fold.

Three-Photon Adaptive Optics for Mouse Brain Imaging

Three-photon microscopy (3PM) was shown to allow deeper imaging than two-photon microscopy (2PM) in scattering biological tissues, such as the mouse brain, since the longer excitation wavelength reduces tissue scattering and the higher-order non-linear excitation suppresses out-of-focus background fluorescence. Imaging depth and resolution can further be improved by aberration correction using adaptive optics (AO) techniques where a spatial light modulator (SLM) is used to correct wavefront aberrations. Here, we present and analyze a 3PM AO system for in vivo mouse brain imaging. We use a femtosecond source at 1300 nm to generate three-photon (3P) fluorescence in yellow fluorescent protein (YFP) labeled mouse brain and a microelectromechanical (MEMS) SLM to apply different Zernike phase patterns. The 3P fluorescence signal is used as feedback to calculate the amount of phase correction without direct phase measurement. We show signal improvement in the cortex and the hippocampus at greater than 1 mm depth and demonstrate close to diffraction-limited imaging in the cortical layers of the brain, including imaging of dendritic spines. In addition, we characterize the effective volume for AO correction within brain tissues, and discuss the limitations of AO correction in 3PM of mouse brain.

Ultra-parallel label-free optophysiology of neural activity

The electrical activity of neurons has a spatiotemporal footprint that spans three orders of magnitude. Traditional electrophysiology lacks the spatial throughput to image the activity of an entire neural network; besides, labeled optical imaging using voltage-sensitive dyes and tracking Ca²⁺ ion dynamics lack the versatility and speed to capture fast-spiking activity, respectively. We present a label-free optical imaging technique to image the changes to the optical path length and the local birefringence caused by neural activity, at 4,000 Hz, across a 200 × 200 μm² region, and with micron-scale spatial resolution and 300-pm displacement sensitivity using Superfast Polarization-sensitive Off-axis Full-field Optical Coherence Microscopy (SPoOF OCM). The undulations in the optical responses from mammalian neuronal activity were matched with field-potential electrophysiology measurements and validated with channel blockers. By directly tracking the widefield neural activity at millisecond timescales and micrometer resolution, SPoOF OCM provides a framework to progress from low-throughput electrophysiology to high-throughput ultra-parallel label-free optophysiology.

Single-shot quantitative aberration and scattering length measurements in mouse brain tissues using an extended-source Shack-Hartmann wavefront sensor

Deep fluorescence imaging in mammalian brain tissues remains challenging due to scattering and optical aberration-induced loss in signal and resolution. Correction of aberrations using adaptive optics (AO) requires their reliable measurement in the tissues. Here, we show that an extended-source Shack-Hartmann wavefront sensor (ESSH) allows quantitative aberration measurements through fixed brain slices with a thickness up to four times their scattering length. We demonstrate in particular that this wavefront measurement method based on image correlation is more robust to scattering compared to the standard centroid-based approach. Finally, we obtain a measurement of the tissue scattering length taking advantage of the geometry of a Shack-Hartmann sensor.

A Model of Discovery: The Role of Imaging Established and Emerging Non-mammalian Models in Neuroscience

Rodents have been the dominant animal models in neurobiology and neurological disease research over the past 60 years. The prevalent use of rats and mice in neuroscience research has been driven by several key attributes including their organ physiology being more similar to humans, the availability of a broad variety of behavioral tests and genetic tools, and widely accessible reagents. However, despite the many advances in understanding neurobiology that have been achieved using rodent models, there remain key limitations in the questions that can be addressed in these and other mammalian models. In particular, in vivo imaging in mammals at the cell-resolution level remains technically difficult and demands large investments in time and cost. The simpler nervous systems of many non-mammalian models allow for precise mapping of circuits and even the whole brain with impressive subcellular resolution. The types of non-mammalian neuroscience models available spans vertebrates and non-vertebrates, so that an appropriate model for most cell biological questions in neurodegenerative disease likely exists. A push to diversify the models used in neuroscience research could help address current gaps in knowledge, complement existing rodent-based bodies of work, and bring new insight into our understanding of human disease. Moreover, there are inherent aspects of many non-mammalian models such as lifespan and tissue transparency that can make them specifically advantageous for neuroscience studies. Crispr/Cas9 gene editing and decreased cost of genome sequencing combined with advances in optical microscopy enhances the utility of new animal models to address specific questions. This review seeks to synthesize current knowledge of established and emerging non-mammalian model organisms with advances in cellular-resolution in vivo imaging techniques to suggest new approaches to understand neurodegeneration and neurobiological processes. We will summarize current tools and in vivo imaging approaches at the single cell scale that could help lead to increased consideration of non-mammalian models in neuroscience research.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

In vivo volumetric imaging of calcium and glutamate activity at synapses with high spatiotemporal resolution

Studying neuronal activity at synapses requires high spatiotemporal resolution. For high spatial resolution in vivo imaging at depth, adaptive optics (AO) is required to correct sample-induced aberrations. To improve temporal resolution, Bessel focus has been combined with two-photon fluorescence microscopy (2PFM) for fast volumetric imaging at subcellular lateral resolution. To achieve both high-spatial and high-temporal resolution at depth, we develop an efficient AO method that corrects the distorted wavefront of Bessel focus at the objective focal plane and recovers diffraction-limited imaging performance. Applying AO Bessel focus scanning 2PFM to volumetric imaging of zebrafish larval and mouse brains down to 500 µm depth, we demonstrate substantial improvements in the sensitivity and resolution of structural and functional measurements of synapses in vivo. This enables volumetric measurements of synaptic calcium and glutamate activity at high accuracy, including the simultaneous recording of glutamate activity of apical and basal dendritic spines in the mouse cortex.

Super-resolving Microscopy in Neuroscience

Fluorescence imaging techniques play a pivotal role in our understanding of the nervous system. The emergence of various super-resolution microscopy methods and specialized fluorescent probes enables direct insight into neuronal structure and protein arrangements in cellular subcompartments with so far unmatched resolution. Super-resolving visualization techniques in neurons unveil a novel understanding of cytoskeletal composition, distribution, motility, and signaling of membrane proteins, subsynaptic structure and function, and neuron-glia interaction. Well-defined molecular targets in autoimmune and neurodegenerative disease models provide excellent starting points for in-depth investigation of disease pathophysiology using novel and innovative imaging methodology. Application of super-resolution microscopy in human brain samples and for testing clinical biomarkers is still in its infancy but opens new opportunities for translational research in neurology and neuroscience. In this review, we describe how super-resolving microscopy has improved our understanding of neuronal and brain function and dysfunction in the last two decades.

An adaptive optics module for deep tissue multiphoton imaging in vivo

Understanding complex biological systems requires visualizing structures and processes deep within living organisms. We developed a compact adaptive optics module and incorporated it into two- and three-photon fluorescence microscopes, to measure and correct tissue-induced aberrations. We resolved synaptic structures in deep cortical and subcortical areas of the mouse brain, and demonstrated high-resolution imaging of neuronal structures and somatosensory-evoked calcium responses in the mouse spinal cord at great depths in vivo.

Zebrafish capable of generating future state prediction error show improved active avoidance behavior in virtual reality

Animals make decisions under the principle of reward value maximization and surprise minimization. It is still unclear how these principles are represented in the brain and are reflected in behavior. We addressed this question using a closed-loop virtual reality system to train adult zebrafish for active avoidance. Analysis of the neural activity of the dorsal pallium during training revealed neural ensembles assigning rules to the colors of the surrounding walls. Additionally, one third of fish generated another ensemble that becomes activated only when the real perceived scenery shows discrepancy from the predicted favorable scenery. The fish with the latter ensemble escape more efficiently than the fish with the former ensembles alone, even though both fish have successfully learned to escape, consistent with the hypothesis that the latter ensemble guides zebrafish to take action to minimize this prediction error. Our results suggest that zebrafish can use both principles of goal-directed behavior, but with different behavioral consequences depending on the repertoire of the adopted principles.

Adaptive optics in super-resolution microscopy

Fluorescence microscopy has become a routine tool in biology for interrogating life activities with minimal perturbation. While the resolution of fluorescence microscopy is in theory governed only by the diffraction of light, the resolution obtainable in practice is also constrained by the presence of optical aberrations. The past two decades have witnessed the advent of super-resolution microscopy that overcomes the diffraction barrier, enabling numerous biological investigations at the nanoscale. Adaptive optics, a technique borrowed from astronomical imaging, has been applied to correct for optical aberrations in essentially every microscopy modality, especially in super-resolution microscopy in the last decade, to restore optimal image quality and resolution. In this review, we briefly introduce the fundamental concepts of adaptive optics and the operating principles of the major super-resolution imaging techniques. We highlight some recent implementations and advances in adaptive optics for active and dynamic aberration correction in super-resolution microscopy.

Adaptive optics for dynamic aberration compensation using parallel model-based controllers based on a field programmable gate array

Adaptive optics (AO) is an effective technique for compensating the aberrations in optical systems and restoring their performance for various applications such as image formation, laser processing, and beam shaping. To reduce the controller complexity and extend the compensation capacity from static aberrations to dynamic disturbances, the present study proposes an AO system consisting of a self-built Shack-Hartmann wavefront sensor (SHWS), a deformable mirror (DM), and field programmable gate array (FPGA)-based controllers. This AO system is developed for tracking static and dynamic disturbances and tuning the controller parameters as required to achieve rapid compensation of the incoming wavefront. In the proposed system, the FPGA estimates the coefficients of the eight Zernike modes based on the SHWS with CameraLink operated at 200 Hz. The estimated coefficients are then processed by eight parallel independent discrete controllers to generate the voltage vectors to drive the DM to compensate the aberrations. To have the DM model for controller design, the voltage vectors are identified offline and are optimized by closed-loop controllers. Furthermore, the controller parameters are tuned dynamically in accordance with the main frequency of the aberration as determined by a fast Fourier transform (FFT) process. The experimental results show that the AO system provides a low complexity and effective means of compensating both static aberrations and dynamic disturbance up to 20 Hz.

Differentiable model-based adaptive optics for two-photon microscopy

Aberrations limit scanning fluorescence microscopy when imaging in scattering materials such as biological tissue. Model-based approaches for adaptive optics take advantage of a computational model of the optical setup. Such models can be combined with the optimization techniques of machine learning frameworks to find aberration corrections, as was demonstrated for focusing a laser beam through aberrations onto a camera [Opt. Express2826436 (26436)10.1364/OE.403487]. Here, we extend this approach to two-photon scanning microscopy. The developed sensorless technique finds corrections for aberrations in scattering samples and will be useful for a range of imaging application, for example in brain tissue.

Quantifying and visualising the nuances of cellular dynamics in vivo using intravital imaging

Intravital imaging is a powerful technology used to quantify and track dynamic changes in live cells and tissues within an intact environment. The ability to watch cell biology in real-time 'as it happens' has provided novel insight into tissue homeostasis, as well as disease initiation, progression and response to treatment. In this minireview, we highlight recent advances in the field of intravital microscopy, touching upon advances in awake versus anaesthesia-based approaches, as well as the integration of biosensors into intravital imaging. We also discuss current challenges that, in our opinion, need to be overcome to further advance the field of intravital imaging at the single-cell, subcellular and molecular resolution to reveal nuances of cell behaviour that can be targeted in complex disease settings.

Spatio-temporal parameters for optical probing of neuronal activity

The challenge to understand the complex neuronal circuit functions in the mammalian brain has brought about a revolution in light-based neurotechnologies and optogenetic tools. However, while recent seminal works have shown excellent insights on the processing of basic functions such as sensory perception, memory, and navigation, understanding more complex brain functions is still unattainable with current technologies. We are just scratching the surface, both literally and figuratively. Yet, the path towards fully understanding the brain is not totally uncertain. Recent rapid technological advancements have allowed us to analyze the processing of signals within dendritic arborizations of single neurons and within neuronal circuits. Understanding the circuit dynamics in the brain requires a good appreciation of the spatial and temporal properties of neuronal activity. Here, we assess the spatio-temporal parameters of neuronal responses and match them with suitable light-based neurotechnologies as well as photochemical and optogenetic tools. We focus on the spatial range that includes dendrites and certain brain regions (e.g., cortex and hippocampus) that constitute neuronal circuits. We also review some temporal characteristics of some proteins and ion channels responsible for certain neuronal functions. With the aid of the photochemical and optogenetic markers, we can use light to visualize the circuit dynamics of a functioning brain. The challenge to understand how the brain works continue to excite scientists as research questions begin to link macroscopic and microscopic units of brain circuits.

Deformable mirror-based axial scanning for two-photon mammalian brain imaging

Significance: To expand our understanding of the roles of astrocytes in neural circuits, there is a need to develop optical tools tailored specifically to capture their complex spatiotemporal Ca 2 + dynamics. This interest is not limited to 2D, but to multiple depths. Aim: The focus of our work was to design and evaluate the optical performance of an enhanced version of a two-photon (2P) microscope with the addition of a deformable mirror (DM)-based axial scanning system for live mammalian brain imaging. Approach: We used a DM to manipulate the beam wavefront by applying different defocus terms to cause a controlled axial shift of the image plane. The optical design and performance were evaluated by an analysis of the optical model, followed by an experimental characterization of the implemented instrument. Results: Key questions related to this instrument were addressed, including impact of the DM curvature change on vignetting, field of view size, image plane flatness, wavefront error, and point spread function. The instrument was used for imaging several neurobiological samples at different depths, including fixed brain slices and in vivo mouse cerebral cortex. Conclusions: Our implemented instrument was capable of recording z -stacks of 53    μ m in depth with a fine step size, parameters that make it useful for astrocyte biology research. Future work includes adaptive optics and intensity normalization.

From Neurons to Cognition: Technologies for Precise Recording of Neural Activity Underlying Behavior

Understanding how brain activity encodes information and controls behavior is a long-standing question in neuroscience. This complex problem requires converging efforts from neuroscience and engineering, including technological solutions to perform high-precision and large-scale recordings of neuronal activity in vivo as well as unbiased methods to reliably measure and quantify behavior. Thanks to advances in genetics, molecular biology, engineering, and neuroscience, in recent decades, a variety of optical imaging and electrophysiological approaches for recording neuronal activity in awake animals have been developed and widely applied in the field. Moreover, sophisticated computer vision and machine learning algorithms have been developed to analyze animal behavior. In this review, we provide an overview of the current state of technology for neuronal recordings with a focus on optical and electrophysiological methods in rodents. In addition, we discuss areas that future technological development will need to cover in order to further our understanding of the neural activity underlying behavior.

High-speed volumetric two-photon fluorescence imaging of neurovascular dynamics

Understanding the structure and function of vasculature in the brain requires us to monitor distributed hemodynamics at high spatial and temporal resolution in three-dimensional (3D) volumes in vivo. Currently, a volumetric vasculature imaging method with sub-capillary spatial resolution and blood flow-resolving speed is lacking. Here, using two-photon laser scanning microscopy (TPLSM) with an axially extended Bessel focus, we capture volumetric hemodynamics in the awake mouse brain at a spatiotemporal resolution sufficient for measuring capillary size and blood flow. With Bessel TPLSM, the fluorescence signal of a vessel becomes proportional to its size, which enables convenient intensity-based analysis of vessel dilation and constriction dynamics in large volumes. We observe entrainment of vasodilation and vasoconstriction with pupil diameter and measure 3D blood flow at 99 volumes/second. Demonstrating high-throughput monitoring of hemodynamics in the awake brain, we expect Bessel TPLSM to make broad impacts on neurovasculature research.

Microscope-AOtools: a generalised adaptive optics implementation

Aberrations arising from sources such as sample heterogeneity and refractive index mismatches are constant problems in biological imaging. These aberrations reduce image quality and the achievable depth of imaging, particularly in super-resolution microscopy techniques. Adaptive optics (AO) technology has been proven to be effective in correcting for these aberrations, thereby improving the image quality. However, it has not been widely adopted by the biological imaging community due, in part, to difficulty in set-up and operation of AO. The methods for doing so are not novel or unknown, but new users often waste time and effort reimplementing existing methods for their specific set-ups, hardware, sample types, etc. Microscope-AOtools offers a robust, easy-to-use implementation of the essential methods for set-up and use of AO elements and techniques. These methods are constructed in a generalised manner that can utilise a range of adaptive optics elements, wavefront sensing techniques and sensorless AO correction methods. Furthermore, the methods are designed to be easily extensible as new techniques arise, leading to a streamlined pipeline for new AO technology and techniques to be adopted by the wider microscopy community.

Differentiable model-based adaptive optics with transmitted and reflected light

Aberrations limit optical systems in many situations, for example when imaging in biological tissue. Machine learning offers novel ways to improve imaging under such conditions by learning inverse models of aberrations. Learning requires datasets that cover a wide range of possible aberrations, which however becomes limiting for more strongly scattering samples, and does not take advantage of prior information about the imaging process. Here, we show that combining model-based adaptive optics with the optimization techniques of machine learning frameworks can find aberration corrections with a small number of measurements. Corrections are determined in a transmission configuration through a single aberrating layer and in a reflection configuration through two different layers at the same time. Additionally, corrections are not limited by a predetermined model of aberrations (such as combinations of Zernike modes). Focusing in transmission can be achieved based only on reflected light, compatible with an epidetection imaging configuration.

Wavefront correction for adaptive optics with reflected light and deep neural networks

Light scattering and aberrations limit optical microscopy in biological tissue, which motivates the development of adaptive optics techniques. Here, we develop a method for wavefront correction in adaptive optics with reflected light and deep neural networks compatible with an epi-detection configuration. Large datasets of sample aberrations which consist of excitation and detection path aberrations as well as the corresponding reflected focus images are generated. These datasets are used for training deep neural networks. After training, these networks can disentangle and independently correct excitation and detection aberrations based on reflected light images recorded from scattering samples. A similar deep learning approach is also demonstrated with scattering guide stars. The predicted aberration corrections are validated using two photon imaging.

Extended field-of-view adaptive optics in microscopy via numerical field segmentation

Sample-induced optical aberrations in microscopy are, in general, field dependent, limiting their correction via pupil adaptive optics (AO) to the center of the available field-of-view (FoV). This is a major hindrance, particularly for deep tissue imaging, where AO has a significant impact. We present a new wide-field AO microscopy scheme, in which the deformable element is located at the pupil plane of the objective. To maintain high-quality correction across its entirety, the FoV is partitioned into small segments, and a separate aberration estimation is performed for each via a modal-decomposition-based indirect wavefront sensing algorithm. A final full-field image is synthesized by stitching of the partitions corrected consecutively and independently via their respective measured aberrations. The performance and limitations of the method are experimentally explored on synthetic samples imaged via a custom-developed AO fluorescence microscope featuring an optofluidic refractive wavefront modulator.

Frontiers in Intravital Multiphoton Microscopy of Cancer

Background

Cancer is a highly complex disease which involves the co-operation of tumor cells with multiple types of host cells and the extracellular matrix. Cancer studies which rely solely on static measurements of individual cell types are insufficient to dissect this complexity. In the last two decades, intravital microscopy has established itself as a powerful technique that can significantly improve our understanding of cancer by revealing the dynamic interactions governing cancer initiation, progression and treatment effects, in living animals. This review focuses on intravital multiphoton microscopy (IV-MPM) applications in mouse models of cancer.

Recent Findings

IV-MPM studies have already enabled a deeper understanding of the complex events occurring in cancer, at the molecular, cellular and tissue levels. Multiple cells types, present in different tissues, influence cancer cell behavior via activation of distinct signaling pathways. As a result, the boundaries in the field of IV-MPM are continuously being pushed to provide an integrated comprehension of cancer. We propose that optics, informatics and cancer (cell) biology are co-evolving as a new field. We have identified four emerging themes in this new field. First, new microscopy systems and image processing algorithms are enabling the simultaneous identification of multiple interactions between the tumor cells and the components of the tumor microenvironment. Second, techniques from molecular biology are being exploited to visualize subcellular structures and protein activities within individual cells of interest, and relate those to phenotypic decisions, opening the door for "in vivo cell biology". Third, combining IV-MPM with additional imaging modalities, or omics studies, holds promise for linking the cell phenotype to its genotype, metabolic state or tissue location. Finally, the clinical use of IV-MPM for analyzing efficacy of anti-cancer treatments is steadily growing, suggesting a future role of IV-MPM for personalized medicine.

Conclusion

IV-MPM has revolutionized visualization of tumor-microenvironment interactions in real time. Moving forward, incorporation of novel optics, automated image processing, and omics technologies, in the study of cancer biology, will not only advance our understanding of the underlying complexities but will also leverage the unique aspects of IV-MPM for clinical use.

Engineering genetically encoded fluorescent indicators for imaging of neuronal activity: Progress and prospects

Genetically encoded fluorescent indicators have transformed the way neuroscientists record neuronal activities and interrogate the nervous system in vivo. In this review, we discuss recent advances and new additions to the toolkit of indicators for calcium ion entry, membrane voltage change, neurotransmitter release, and other neuronal molecular processes. We highlight new engineering approaches for indicator design and development, and identify key areas for future improvement. From molecular tool developers' perspective, we aim to provide practical information for neuroscientists to evaluate and choose the most appropriate indicators for enabling new insights into brain function.

Reliability of wavefront shaping based on coherent optical adaptive technique in deep tissue focusing

Wavefront shaping can compensate the wavefront distortions in deep tissue focusing, leading to an improved penetration depth. However, when using the backscattered signals as the feedback, unexpected compensation bias may be introduced, resulting in focusing position deviations or even no focus in the illumination focal plane. Here we investigated the reliability of wavefront shaping based on coherent optical adaptive technique in deep tissue focusing by measuring the position deviations between the foci in the illumination focal plane and the epi-detection plane. The experimental results show that when the penetration depth reaches 150 μm in mouse brain tissue (with scattering coefficient ~22.42 mm^-1 ) using a 488 nm laser and an objective lens with 0.75 numerical aperture, the center of the real focus will deviate out of one radius range of the Airy disk while the optimized focus in the epi-detection plane maintained basically at the center. With the penetration depth increases, the peak to background ratio of the focus in the illumination focal plane decreases faster than that in the epi-detection plane. The results indicate that when the penetration depth reaches 150 μm, feedback based on backscattered signals will make wavefront shaping lose its reliability, which may provide a guidance for applications of non-invasive precise optogenetics or deep tissue optical stimulation using wavefront shaping methods. A, Intensity distribution in the epi-detection plane and the illumination focal plane before and after correction, corresponding to brain sections with 250 and 300 μm thickness, respectively. Scale bar is 2 μm. B, Averaged focusing deviations in the epi-detection plane (optimized) and the illumination focal plane (monitored) after compensation. The unit of the ordinate is one Airy disk diameter. Black dashed line represents one Airy disk radius. Bars represent the SE of each measurement set.

Advances in adaptive optics-based two-photon fluorescence microscopy for brain imaging

Deep tissue imaging using two-photon fluorescence (TPF) techniques have revolutionized the optical imaging community by providing in depth molecular information at the single-cell level. These techniques provide structural and functional aspects of mammalian brain at unprecedented depth and resolution. However, wavefront distortions introduced by the optical system as well as the biological sample (tissue) limit the achievable fluorescence signal-to-noise ratio and resolution with penetration depth. In this review, we discuss on the advances in TPF microscopy techniques for in vivo functional imaging and offer guidelines as to which technologies are best suited for different imaging applications with special reference to adaptive optics.

Machine learning guided rapid focusing with sensor-less aberration corrections

Non-invasive, real-time imaging and deep focus into tissue are in high demand in biomedical research. However, the aberration that is introduced by the refractive index inhomogeneity of biological tissue hinders the way forward. A rapid focusing with sensor-less aberration corrections, based on machine learning, is demonstrated in this paper. The proposed method applies the Convolutional Neural Network (CNN), which can rapidly calculate the low-order aberrations from the point spread function images with Zernike modes after training. The results show that approximately 90 percent correction accuracy can be achieved. The average mean square error of each Zernike coefficient in 200 repetitions is 0.06. Furthermore, the aberration induced by 1-mm-thick phantom samples and 300-µm-thick mouse brain slices can be efficiently compensated through loading a compensation phase on an adaptive element placed at the back-pupil plane. The phase reconstruction requires less than 0.2 s. Therefore, this method offers great potential for in vivo real-time imaging in biological science.