Simultaneous multiplane imaging with reverberation two-photon microscopy

Volumetric voltage imaging of neuronal populations in the mouse brain by confocal light-field microscopy

Voltage imaging measures neuronal activity directly and holds promise for understanding information processing within individual neurons and across populations. However, imaging voltage over large neuronal populations has been challenging owing to the simultaneous requirements of high imaging speed and signal-to-noise ratio, large volume coverage and low photobleaching rate. Here, to overcome this challenge, we developed a confocal light-field microscope that surpassed the traditional limits in speed and noise performance by incorporating a speed-enhanced camera, a fast and robust scanning mechanism, laser-speckle-noise elimination and optimized light efficiency. With this method, we achieved simultaneous recording from more than 300 spiking neurons within an 800-µm-diameter and 180-µm-thick volume in the mouse cortex, for more than 20 min. By integrating the spatial and voltage activity profiles, we have mapped three-dimensional neural coordination patterns in awake mouse brains. Our method is robust for routine application in volumetric voltage imaging.

Multiphoton fluorescence microscopy for in vivo imaging

Multiphoton fluorescence microscopy (MPFM) has been a game-changer for optical imaging, particularly for studying biological tissues deep within living organisms. MPFM overcomes the strong scattering of light in heterogeneous tissue by utilizing nonlinear excitation that confines fluorescence emission mostly to the microscope focal volume. This enables high-resolution imaging deep within intact tissue and has opened new avenues for structural and functional studies. MPFM has found widespread applications and has led to numerous scientific discoveries and insights into complex biological processes. Today, MPFM is an indispensable tool in many research communities. Its versatility and effectiveness make it a go-to technique for researchers investigating biological phenomena at the cellular and subcellular levels in their native environments. In this Review, the principles, implementations, capabilities, and limitations of MPFM are presented. Three application areas of MPFM, neuroscience, cancer biology, and immunology, are reviewed in detail and serve as examples for applying MPFM to biological research.

Closed-loop experiments and brain machine interfaces with multiphoton microscopy

In the field of neuroscience, the importance of constructing closed-loop experimental systems has increased in conjunction with technological advances in measuring and controlling neural activity in live animals. We provide an overview of recent technological advances in the field, focusing on closed-loop experimental systems where multiphoton microscopy-the only method capable of recording and controlling targeted population activity of neurons at a single-cell resolution in vivo-works through real-time feedback. Specifically, we present some examples of brain machine interfaces (BMIs) using in vivo two-photon calcium imaging and discuss applications of two-photon optogenetic stimulation and adaptive optics to real-time BMIs. We also consider conditions for realizing future optical BMIs at the synaptic level, and their possible roles in understanding the computational principles of the brain.

Optical constraints on two-photon voltage imaging

Significance

Genetically encoded voltage indicators (GEVIs) are a valuable tool for studying neural circuits in vivo, but the relative merits and limitations of one-photon (1P) versus two-photon (2P) voltage imaging are not well characterized.

Aim

We consider the optical and biophysical constraints particular to 1P and 2P voltage imaging and compare the imaging properties of commonly used GEVIs under 1P and 2P excitation.

Approach

We measure the brightness and voltage sensitivity of voltage indicators from commonly used classes under 1P and 2P illumination. We also measure the decrease in fluorescence as a function of depth in the mouse brain. We develop a simple model of the number of measurable cells as a function of reporter properties, imaging parameters, and desired signal-to-noise ratio (SNR). We then discuss how the performance of voltage imaging would be affected by sensor improvements and by recently introduced advanced imaging modalities.

Results

Compared with 1P excitation, 2P excitation requires ∼ 10 4 -fold more illumination power per cell to produce similar photon count rates. For voltage imaging with JEDI-2P in the mouse cortex with a target SNR of 10 (spike height to baseline shot noise), a measurement bandwidth of 1 kHz, a thermally limited laser power of 200 mW, and an imaging depth of > 300    μ m , 2P voltage imaging using an 80-MHz source can record from no more than ∼ 12 neurons simultaneously.

Conclusions

Due to the stringent photon-count requirements of voltage imaging and the modest voltage sensitivity of existing reporters, 2P voltage imaging in vivo faces a stringent tradeoff between shot noise and tissue photodamage. 2P imaging of hundreds of neurons with high SNR at a depth of > 300    μ m will require either major improvements in 2P GEVIs or qualitatively new approaches to imaging.

Speckle-enabled in vivo demixing of neural activity in the mouse brain

Functional imaging of neuronal activity in awake animals, using a combination of fluorescent reporters of neuronal activity and various types of microscopy modalities, has become an indispensable tool in neuroscience. While various imaging modalities based on one-photon (1P) excitation and parallel (camera-based) acquisition have been successfully used for imaging more transparent samples, when imaging mammalian brain tissue, due to their scattering properties, two-photon (2P) microscopy systems are necessary. In 2P microscopy, the longer excitation wavelengths reduce the amount of scattering while the diffraction-limited 3D localization of excitation largely eliminates out-of-focus fluorescence. However, this comes at the cost of time-consuming serial scanning of the excitation spot and more complex and expensive instrumentation. Thus, functional 1P imaging modalities that can be used beyond the most transparent specimen are highly desirable. Here, we transform light scattering from an obstacle into a tool. We use speckles with their unique patterns and contrast, formed when fluorescence from individual neurons propagates through rodent cortical tissue, to encode neuronal activity. Spatiotemporal demixing of these patterns then enables functional recording of neuronal activity from a group of discriminable sources. For the first time, we provide an experimental, in vivo characterization of speckle generation, speckle imaging and speckle-assisted demixing of neuronal activity signals in the scattering mammalian brain tissue. We found that despite an initial fast speckle decorrelation, substantial correlation was maintained over minute-long timescales that contributed to our ability to demix temporal activity traces in the mouse brain in vivo. Informed by in vivo quantifications of speckle patterns from single and multiple neurons excited using 2P scanning excitation, we recorded and demixed activity from several sources excited using 1P oblique illumination. In our proof-of-principle experiments, we demonstrate in vivo speckle-assisted demixing of functional signals from groups of sources in a depth range of 220-320 µm in mouse cortex, limited by available speckle contrast. Our results serve as a basis for designing an in vivo functional speckle imaging modality and for maximizing the key resource in any such modality, the speckle contrast. We anticipate that our results will provide critical quantitative guidance to the community for designing techniques that overcome light scattering as a fundamental limitation in bioimaging.

Suppression of Subpixel Jitter in Resonant Scanning Systems With Phase-locked Sampling

Resonant scanning is critical to high speed and in vivo imaging in many applications of laser scanning microscopy. However, resonant scanning suffers from well-known image artifacts due to scanner jitter, limiting adoption of high-speed imaging technologies. Here, we introduce a real-time, inexpensive and all electrical method to suppress jitter more than an order of magnitude below the diffraction limit that can be applied to most existing microscope systems with no software changes. By phase-locking imaging to the resonant scanner period, we demonstrate an 86% reduction in pixel jitter, a 15% improvement in point spread function with resonant scanning and show that this approach enables two widely used models of resonant scanners to achieve comparable accuracy to galvanometer scanners running two orders of magnitude slower. Finally, we demonstrate the versatility of this method by retrofitting a commercial two photon microscope and show that this approach enables significant quantitative and qualitative improvements in biological imaging.

Compressive sensing-based multi-focus line-scanning two-photon microscopy for fast 3D imaging

Fast 3D volume imaging methods have been playing increasingly important roles in biological studies. In this article, we present the design and characterization of a multi-focus line-scanning two-photon microscope. Specifically, a digital micromirror device (DMD) is employed to generate a randomly distributed focus array on a plane (i.e., x-z) via binary holography. Next, a galvanometric mirror scans the focus array in a direction normal to the plane (i.e., y-axis) over the imaging volume. For sparse samples, e.g., neural networks in a brain, 1-3 foci are used together with compressive sensing algorithm to achieve a volume imaging rate of 15.5 volumes/sec over 77 × 120 × 40 µm3. High-resolution optical cross-sectional images on selected planes and regions can be generated by sequentially scanning the laser focus generated on the x-z plane with good imaging speeds (e.g., 107 frames/sec over 80 × 120 × 40 µm3). In the experiments, microbeads, pollens, and mouse brain slices have been imaged to characterize the point spread function and volume image rate and quality at different sampling ratios. The results show that the multi-focus line-scanning microscope presents a fast and versatile 3D imaging platform for deep tissue imaging and dynamic live animal studies.

Removing crosstalk signals in neuron activity by time multiplexed excitations in a two-photon all-optical physiology system

The two-photon all-optical physiology system has attracted great interest in deciphering neuronal circuits in vivo, benefiting from its advantages in recording and modulating neuronal activities at single neuron resolutions. However, the interference, or crosstalk, between the imaging and photostimulation beams introduces a significant challenge and may impede the future application of voltage indicators in two-photon all-optical physiology system. Here, we propose the time multiplexed excitation method to distinguish signals from neuronal activities and crosstalks from photostimulation. In our system, the laser pulses of the imaging beam and photostimulation beam are synchronized, and a time delay is introduced into these pulses to separate the fluorescence signal generated by these two beams. We demonstrate the efficacy of our system in eliminating crosstalk signals from photostimulation and evaluate its influence on both genetically encoded calcium indicators (GECIs) and genetically encoded voltage indicators (GEVIs) through in vivo experiments.

Two-dimensional electro-optical multiphoton microscopy

Significance

The development of genetically encoded fluorescent indicators of neural activity with millisecond dynamics has generated demand for ever faster two-photon (2P) imaging systems, but acoustic and mechanical beam scanning technologies are approaching fundamental limits. We demonstrate that potassium tantalate niobate (KTN) electro-optical deflectors (EODs), which are not subject to the same fundamental limits, are capable of ultrafast two-dimensional (2D) 2P imaging in vivo.

Aim

To determine if KTN-EODs are suitable for 2P imaging, compatible with 2D scanning, and capable of ultrafast in vivo imaging of genetically encoded indicators with millisecond dynamics.

Approach

The performance of a commercially available KTN-EOD was characterized across a range of drive frequencies and laser parameters relevant to in vivo 2P microscopy. A second KTN-EOD was incorporated into a dual-axis scan module, and the system was validated by imaging signals in vivo from ASAP3, a genetically encoded voltage indicator.

Results

Optimal KTN-EOD deflection of laser light with a central wavelength of 960 nm was obtained up to the highest average powers and pulse intensities tested (power: 350 mW; pulse duration: 118 fs). Up to 32 resolvable spots per line at a 560 kHz line scan rate could be obtained with single-axis deflection. The complete dual-axis EO 2P microscope was capable of imaging a 13    μ m by 13    μ m field-of-view at over 10 kHz frame rate with ∼ 0.5    μ m lateral resolution. We demonstrate in vivo imaging of neurons expressing ASAP3 with high temporal resolution.

Conclusions

We demonstrate the suitability of KTN-EODs for ultrafast 2P cellular imaging in vivo, providing a foundation for future high-performance microscopes to incorporate emerging advances in KTN-based scanning technology.

Fast topographic optical imaging using encoded search focal scan

A central quest in optics is to rapidly extract quantitative information from a sample. Existing topographical imaging tools allow non-contact and three-dimensional measurements at the micro and nanoscales and are essential in applications including precision engineering and optical quality control. However, these techniques involve acquiring a focal stack of images, a time-consuming process that prevents measurement of moving samples. Here, we propose a method for increasing the speed of topographic imaging by orders of magnitude. Our approach involves collecting a reduced set of images, each integrated during the full focal scan, whilst the illumination is synchronously modulated during exposure. By properly designing the modulation sequence for each image, unambiguous reconstruction of the object height map is achieved using far fewer images than conventional methods. We describe the theoretical foundations of our technique, characterise its performance, and demonstrate sub-micrometric topographic imaging over 100 µm range of static and dynamic systems at rates as high as 67 topographies per second, limited by the camera frame rate. The high speed of the technique and its ease of implementation could enable a paradigm shift in optical metrology, allowing the real-time characterisation of large or rapidly moving samples.

A Deep Learning Approach for Improving Two-Photon Vascular Imaging Speeds

A potential method for tracking neurovascular disease progression over time in preclinical models is multiphoton fluorescence microscopy (MPM), which can image cerebral vasculature with capillary-level resolution. However, obtaining high-quality, three-dimensional images with traditional point scanning MPM is time-consuming and limits sample sizes for chronic studies. Here, we present a convolutional neural network-based (PSSR Res-U-Net architecture) algorithm for fast upscaling of low-resolution or sparsely sampled images and combine it with a segmentation-less vectorization process for 3D reconstruction and statistical analysis of vascular network structure. In doing so, we also demonstrate that the use of semi-synthetic training data can replace the expensive and arduous process of acquiring low- and high-resolution training pairs without compromising vectorization outcomes, and thus open the possibility of utilizing such approaches for other MPM tasks where collecting training data is challenging. We applied our approach to images with large fields of view from a mouse model and show that our method generalizes across imaging depths, disease states and other differences in neurovasculature. Our pretrained models and lightweight architecture can be used to reduce MPM imaging time by up to fourfold without any changes in underlying hardware, thereby enabling deployability across a range of settings.

Recent strategies for neural dynamics observation at a larger scale and wider scope

The tremendous technical progress in neuroscience offers opportunities to observe a more minor or/and broader dynamic picture of the brain. Moreover, the large-scale neural activity of individual neurons enables the dissection of detailed mechanistic links between neural populations and behaviors. To measure neural activity in-vivo, multi-neuron recording, and neuroimaging techniques are employed and developed to acquire more neurons. The tools introduced concurrently recorded dozens to hundreds of neurons in the coordinated brain regions and elucidated the neuronal ensembles from a massive population perspective of diverse neurons at cellular resolution. In particular, the increasing spatiotemporal resolution of neuronal monitoring across the whole brain dramatically facilitates our understanding of additional nervous system functions in health and disease. Here, we will introduce state-of-the-art neuroscience tools involving large-scale neural population recording and the long-range connections spanning multiple brain regions. Their synergic effects provide to clarify the controversial circuitry underlying neuroscience. These challenging neural tools present a promising outlook for the fundamental dynamic interplay across levels of synaptic cellular, circuit organization, and brain-wide. Hence, more observations of neural dynamics will provide more clues to elucidate brain functions and push forward innovative technology at the intersection of neural engineering disciplines. We hope this review will provide insight into the use or development of recent neural techniques considering spatiotemporal scales of brain observation.

Chasing cortical behavior: designing multiphoton microscopes for imaging neuronal populations in freely moving rodents

Imaging in the freely moving animal gives unparalleled access to circuit activity as the animal interacts with its environment in a self-guided way. Over the past few years, new imaging technologies have enabled the interrogation of neuronal populations located at any depth of the cortex in freely moving mice while preserving the animal's behavioral repertoire. This commentary gives an updated overview of the recent advances that have enabled the link between behavior and the underlying neuronal activity to be explored.

SNR enhanced high-speed two-photon microscopy using a pulse picker and time gating detection

Two-photon microscopy (TPM) is an attractive biomedical imaging method due to its large penetration depth and optical sectioning capability. In particular, label-free autofluorescence imaging offers various advantages for imaging biological samples. However, relatively low intensity of autofluorescence leads to low signal-to-noise ratio (SNR), causing practical challenges for imaging biological samples. In this study, we present TPM using a pulse picker to utilize low pulse repetition rate of femtosecond pulsed laser to increase the pulse peak power of the excitation source leading to higher emission of two-photon fluorescence with the same average illumination power. Stronger autofluorescence emission allowed us to obtain higher SNR images of arterial and liver tissues. In addition, by applying the time gating detection method to the pulse signals obtained by TPM, we were able to significantly reduce the background noise of two-photon images. As a result, our TPM system using the pulsed light source with a 19 times lower repetition rate allowed us to obtain the same SNR image more than 19 times faster with the same average power. Although high pulse energy can increase the photobleaching, we also observed that high-speed imaging with low total illumination energy can mitigate the photobleaching effect to a level similar to that of conventional illumination with a high repetition rate. We anticipate that this simple approach will provide guidance for SNR enhancement with high-speed imaging in TPM as well as other nonlinear microscopy.

High-resolution multi-z confocal microscopy with a diffractive optical element

There has been recent interest in the development of fluorescence microscopes that provide high-speed volumetric imaging for life-science applications. For example, multi-z confocal microscopy enables simultaneous optically-sectioned imaging at multiple depths over relatively large fields of view. However, to date, multi-z microscopy has been hampered by limited spatial resolution owing to its initial design. Here we present a variant of multi-z microscopy that recovers the full spatial resolution of a conventional confocal microscope while retaining the simplicity and ease of use of our initial design. By introducing a diffractive optical element in the illumination path of our microscope, we engineer the excitation beam into multiple tightly focused spots that are conjugated to axially distributed confocal pinholes. We discuss the performance of this multi-z microscope in terms of resolution and detectability and demonstrate its versatility by performing in-vivo imaging of beating cardiomyocytes in engineered heart tissues and neuronal activity in c. elegans and zebrafish brains.

Two-photon synthetic aperture microscopy for minimally invasive fast 3D imaging of native subcellular behaviors in deep tissue

Holistic understanding of physio-pathological processes requires noninvasive 3D imaging in deep tissue across multiple spatial and temporal scales to link diverse transient subcellular behaviors with long-term physiogenesis. Despite broad applications of two-photon microscopy (TPM), there remains an inevitable tradeoff among spatiotemporal resolution, imaging volumes, and durations due to the point-scanning scheme, accumulated phototoxicity, and optical aberrations. Here, we harnessed the concept of synthetic aperture radar in TPM to achieve aberration-corrected 3D imaging of subcellular dynamics at a millisecond scale for over 100,000 large volumes in deep tissue, with three orders of magnitude reduction in photobleaching. With its advantages, we identified direct intercellular communications through migrasome generation following traumatic brain injury, visualized the formation process of germinal center in the mouse lymph node, and characterized heterogeneous cellular states in the mouse visual cortex, opening up a horizon for intravital imaging to understand the organizations and functions of biological systems at a holistic level.

Dual-resonant scanning multiphoton microscope with ultrasound lens and resonant mirror for rapid volumetric imaging

A dual-resonant scanning multiphoton (DRSM) microscope incorporating a tunable acoustic gradient index of refraction lens with a resonant mirror is developed for high-speed volumetric imaging. In the proposed microscope, the pulse train signal of a femtosecond laser is used to trigger an embedded field programmable gate array to sample the multiphoton excited fluorescence signal at the rate of one pixel per laser pulse. It is shown that a frame rate of around 8000 Hz can be obtained in the x-z plane for an image region with a size of 256 × 80 pixels. Moreover, a volumetric imaging rate of over 30 Hz can be obtained for a large image volume of 343 × 343 × 120 μm3 with an image size of 256 × 256 × 80 voxels. Moreover, a volumetric imaging rate of over 30 Hz can be obtained for a large image volume of 256 × 256 × 80 voxels, which represents 343 × 343 × 120 μm3 in field-of-view. The rapid volumetric imaging rate eliminates the aliasing effect for observed temporal frequencies lower than 15 Hz. The practical feasibility of the DRSM microscope is demonstrated by observing the mushroom bodies of a drosophila brain and performing 3D dynamic observations of moving 10-μm fluorescent beads.

Three-dimensional-generator U-net for dual-resonant scanning multiphoton microscopy image inpainting and denoising

A dual-resonant scanning multiphoton (DRSM) microscope incorporating a tunable acoustic gradient index of refraction lens and a resonant mirror is developed for rapid volumetric bioimaging. It is shown that the microscope achieves a volumetric imaging rate up to 31.25 volumes per second (vps) for a scanning volume of up to 200 × 200 × 100 µm³ with 256 × 256 × 128 voxels. However, the volumetric images have a severe negative signal-to-noise ratio (SNR) as a result of a large number of missing voxels for a large scanning volume and the presence of Lissajous patterning residuals. Thus, a modified three-dimensional (3D)-generator U-Net model trained using simulated microbead images is proposed and used to inpaint and denoise the images. The performance of the 3D U-Net model for bioimaging applications is enhanced by training the model with high-SNR in-vitro drosophila brain images captured using a conventional point scanning multiphoton microscope. The trained model shows the ability to produce clear in-vitro drosophila brain images at a rate of 31.25 vps with a SNR improvement of approximately 20 dB over the original images obtained by the DRSM microscope. The training convergence time of the modified U-Net model is just half that of a general 3D U-Net model. The model thus has significant potential for 3D in-vivo bioimaging transfer learning. Through the assistance of transfer learning, the model can be extended to the restoration of in-vivo drosophila brain images with a high image quality and a rapid training time.

Volumetric Imaging of Neural Activity by Light Field Microscopy

Recording the highly diverse and dynamic activities in large populations of neurons in behaving animals is crucial for a better understanding of how the brain works. To meet this challenge, extensive efforts have been devoted to developing functional fluorescent indicators and optical imaging techniques to optically monitor neural activity. Indeed, optical imaging potentially has extremely high throughput due to its non-invasive access to large brain regions and capability to sample neurons at high density, but the readout speed, such as the scanning speed in two-photon scanning microscopy, is often limited by various practical considerations. Among different imaging methods, light field microscopy features a highly parallelized 3D fluorescence imaging scheme and therefore promises a novel and faster strategy for functional imaging of neural activity. Here, we briefly review the working principles of various types of light field microscopes and their recent developments and applications in neuroscience studies. We also discuss strategies and considerations of optimizing light field microscopy for different experimental purposes, with illustrative examples in imaging zebrafish and mouse brains.

Depth-Resolved Localization Microangiography in the NIR-II Window

Detailed characterization of microvascular alterations requires high-resolution 3D imaging methods capable of providing both morphological and functional information. Existing optical microscopy tools are routinely used for microangiography, yet offer suboptimal trade-offs between the achievable field of view and spatial resolution with the intense light scattering in biological tissues further limiting the achievable penetration depth. Herein, a new approach for volumetric deep-tissue microangiography based on stereovision combined with super-resolution localization imaging is introduced that overcomes the spatial resolution limits imposed by light diffusion and optical diffraction in wide-field imaging configurations. The method capitalizes on localization and tracking of flowing fluorescent particles in the second near-infrared window (NIR-II, ≈1000-1700 nm), with the third (depth) dimension added by triangulation and stereo-matching of images acquired with two short-wave infrared cameras operating in a dual-view mode. The 3D imaging capability enabled with the proposed method facilitates a detailed visualization of microvascular networks and an accurate blood flow quantification. Experiments performed in tissue-mimicking phantoms demonstrate that high resolution is preserved up to a depth of 4 mm in a turbid medium. Transcranial microangiography of the entire murine cortex and penetrating vessels is further demonstrated at capillary level resolution.

Review on data analysis methods for mesoscale neural imaging in vivo

Significance: Mesoscale neural imaging in vivo has gained extreme popularity in neuroscience for its capacity of recording large-scale neurons in action. Optical imaging with single-cell resolution and millimeter-level field of view in vivo has been providing an accumulated database of neuron-behavior correspondence. Meanwhile, optical detection of neuron signals is easily contaminated by noises, background, crosstalk, and motion artifacts, while neural-level signal processing and network-level coordinate are extremely complicated, leading to laborious and challenging signal processing demands. The existing data analysis procedure remains unstandardized, which could be daunting to neophytes or neuroscientists without computational background. Aim: We hope to provide a general data analysis pipeline of mesoscale neural imaging shared between imaging modalities and systems. Approach: We divide the pipeline into two main stages. The first stage focuses on extracting high-fidelity neural responses at single-cell level from raw images, including motion registration, image denoising, neuron segmentation, and signal extraction. The second stage focuses on data mining, including neural functional mapping, clustering, and brain-wide network deduction. Results: Here, we introduce the general pipeline of processing the mesoscale neural images. We explain the principles of these procedures and compare different approaches and their application scopes with detailed discussions about the shortcomings and remaining challenges. Conclusions: There are great challenges and opportunities brought by the large-scale mesoscale data, such as the balance between fidelity and efficiency, increasing computational load, and neural network interpretability. We believe that global circuits on single-neuron level will be more extensively explored in the future.

Review of data processing of functional optical microscopy for neuroscience

Functional optical imaging in neuroscience is rapidly growing with the development of optical systems and fluorescence indicators. To realize the potential of these massive spatiotemporal datasets for relating neuronal activity to behavior and stimuli and uncovering local circuits in the brain, accurate automated processing is increasingly essential. We cover recent computational developments in the full data processing pipeline of functional optical microscopy for neuroscience data and discuss ongoing and emerging challenges.

Depth random-access two-photon Bessel light-sheet imaging in brain tissue

Two-photon light-sheet fluorescence microscopy enables high-resolution imaging of neural activity in brain tissue at a high frame rate. Traditionally, light-sheet microscopy builds up a 3D stack by multiple depth scans with uniform spatial intervals, which substantially limits the volumetric imaging speed. Here, we introduce the depth random-access light-sheet microscopy, allowing rapid switching scanning depth for light-sheet imaging. With a low-cost electrically tunable lens and minimum modification of an existing two-photon light-sheet imaging instrument, we demonstrated fast random depth hopping light-sheet imaging at 100 frames per second in the live brain slice. Through depth random-access, calcium activities for an astrocyte were recorded on four user-selected detection planes at a refreshing rate of 25 Hz.

GraFT: Graph Filtered Temporal Dictionary Learning for Functional Neural Imaging

Optical imaging of calcium signals in the brain has enabled researchers to observe the activity of hundreds-to-thousands of individual neurons simultaneously. Current methods predominantly use morphological information, typically focusing on expected shapes of cell bodies, to better identify neurons in the field-of-view. The explicit shape constraints limit the applicability of automated cell identification to other important imaging scales with more complex morphologies, e.g., dendritic or widefield imaging. Specifically, fluorescing components may be broken up, incompletely found, or merged in ways that do not accurately describe the underlying neural activity. Here we present Graph Filtered Temporal Dictionary (GraFT), a new approach that frames the problem of isolating independent fluorescing components as a dictionary learning problem. Specifically, we focus on the time-traces-the main quantity used in scientific discovery-and learn a time trace dictionary with the spatial maps acting as the presence coefficients encoding which pixels the time-traces are active in. Furthermore, we present a novel graph filtering model which redefines connectivity between pixels in terms of their shared temporal activity, rather than spatial proximity. This model greatly eases the ability of our method to handle data with complex non-local spatial structure. We demonstrate important properties of our method, such as robustness to morphology, simultaneously detecting different neuronal types, and implicitly inferring number of neurons, on both synthetic data and real data examples. Specifically, we demonstrate applications of our method to calcium imaging both at the dendritic, somatic, and widefield scales.

Assessing Local and Branch-specific Activity in Dendrites

Dendrites are elaborate neural processes which integrate inputs from various sources in space and time. While decades of work have suggested an independent role for dendrites in driving nonlinear computations for the cell, only recently have technological advances enabled us to capture the variety of activity in dendrites and their coupling dynamics with the soma. Under certain circumstances, activity generated in a given dendritic branch remains isolated, such that the soma or even sister dendrites are not privy to these localized signals. Such branch-specific activity could radically increase the capacity and flexibility of coding for the cell as a whole. Here, we discuss these forms of localized and branch-specific activity, their functional relevance in plasticity and behavior, and their supporting biophysical and circuit-level mechanisms. We conclude by showcasing electrical and optical approaches in hippocampal area CA3, using original experimental data to discuss experimental and analytical methodology and key considerations to take when investigating the functional relevance of independent dendritic activity.

Axial motion estimation and correction for simultaneous multi-plane two-photon calcium imaging

Two-photon imaging in behaving animals is typically accompanied by brain motion. For functional imaging experiments, for example with genetically encoded calcium indicators, such brain motion induces changes in fluorescence intensity. These motion-related intensity changes or motion artifacts can typically not be separated from neural activity-induced signals. While lateral motion, within the focal plane, can be corrected by computationally aligning images, axial motion, out of the focal plane, cannot easily be corrected. Here, we developed an algorithm for axial motion correction for non-ratiometric calcium indicators taking advantage of simultaneous multi-plane imaging. Using temporally multiplexed beams, recording simultaneously from at least two focal planes at different z positions, and recording a z-stack for each beam as a calibration step, the algorithm separates motion-related and neural activity-induced changes in fluorescence intensity. The algorithm is based on a maximum likelihood optimisation approach; it assumes (as a first order approximation) that no distortions of the sample occurs during axial motion and that neural activity increases uniformly along the optical axis in each region of interest. The developed motion correction approach allows axial motion estimation and correction at high frame rates for isolated structures in the imaging volume in vivo, such as sparse expression patterns in the fruit fly brain.

Metasurface-based bijective illumination collection imaging provides high-resolution tomography in three dimensions

Microscopic imaging in three dimensions enables numerous biological and clinical applications. However, high-resolution optical imaging preserved in a relatively large depth range is hampered by the rapid spread of tightly confined light due to diffraction. Here, we show that a particular disposition of light illumination and collection paths liberates optical imaging from the restrictions imposed by diffraction. This arrangement, realized by metasurfaces, decouples lateral resolution from depth-of-focus by establishing a one-to-one correspondence (bijection) along a focal line between the incident and collected light. Implementing this approach in optical coherence tomography, we demonstrate tissue imaging at 1.3 μm wavelength with ~ 3.2 μm lateral resolution, maintained nearly intact over 1.25 mm depth-of-focus, with no additional acquisition or computation burden. This method, termed bijective illumination collection imaging, is general and might be adapted across various existing imaging modalities.

Evaluation of resonant scanning as a high-speed imaging technique for two-photon imaging of cortical vasculature

We demonstrate a simple, low-cost two-photon microscope design with both galvo-galvo and resonant-galvo scanning capabilities. We quantify and compare the signal-to-noise ratios and imaging speeds of the galvo-galvo and resonant-galvo scanning modes when used for murine neurovascular imaging. The two scanning modes perform as expected under shot-noise limited detection and are found to achieve comparable signal-to-noise ratios. Resonant-galvo scanning is capable of reaching desired signal-to-noise ratios using less acquisition time when higher excitation power can be used. Given equal excitation power and total pixel dwell time between the two methods, galvo-galvo scanning outperforms resonant-galvo scanning in image quality when detection deviates from being shot-noise limited.

Fluorescence imaging of large-scale neural ensemble dynamics

Recent progress in fluorescence imaging allows neuroscientists to observe the dynamics of thousands of individual neurons, identified genetically or by their connectivity, across multiple brain areas and for extended durations in awake behaving mammals. We discuss advances in fluorescent indicators of neural activity, viral and genetic methods to express these indicators, chronic animal preparations for long-term imaging studies, and microscopes to monitor and manipulate the activity of large neural ensembles. Ca2+ imaging studies of neural activity can track brain area interactions and distributed information processing at cellular resolution. Across smaller spatial scales, high-speed voltage imaging reveals the distinctive spiking patterns and coding properties of targeted neuron types. Collectively, these innovations will propel studies of brain function and dovetail with ongoing neuroscience initiatives to identify new neuron types and develop widely applicable, non-human primate models. The optical toolkit's growing sophistication also suggests that "brain observatory" facilities would be useful open resources for future brain-imaging studies.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Biophotonic tools for probing extracellular matrix mechanics

The complex, hierarchical and heterogeneous biomechanics of the extracellular matrix (ECM) are central to the health of multicellular organisms. Characterising the distribution, dynamics and above all else origins of ECM biomechanics are challenges that have captivated researchers for decades. Recently, a suite of biophotonics techniques have emerged as powerful new tools to investigate ECM biomechanics. In this mini-review, we discuss how the non-destructive, sub-micron resolution imaging capabilities of Raman spectroscopy and nonlinear microscopy are being used to interrogate the biomechanics of thick, living tissues. These high speed, label-free techniques are implemented during mechanical testing, providing unprecedented insight into the compositional and structural response of the ECM to changes in the mechanical environment.

Spectrally Gated Microscopy (SGM) with Meta Optics for Parallel Three-Dimensional Imaging

Volumetric imaging with high spatiotemporal resolution is of utmost importance for various applications ranging from aerospace and defense to real-time imaging of dynamic biological processes. To facilitate three-dimensional sectioning, current technology relies on mechanisms to reject light from adjacent out-of-focus planes either spatially or by other means. Yet, the combination of rapid acquisition time and high axial resolution is still elusive, motivating a persistent pursuit for emerging imaging approaches. Here we introduce and experimentally demonstrate a concept named spectrally gated microscopy (SGM), which enables a single-shot interrogation over the full axial dimension while maintaining a submicron sectioning resolution. SGM utilizes two important features enabled by flat optics (i.e., metalenses or diffractive lenses), namely, a short focal length and strong chromatic aberrations. Using SGM we demonstrate three-dimensional imaging of millimeter-scale samples while scanning only the lateral dimension, presenting a significant advantage over state-of-the-art technology.

Scan multiplier unit for ultrafast laser scanning beyond the inertia limit

A passive add-on greatly multiplies the sweep rate of any mechanical scanner while also enhancing throughput, enabling a single linear scanner to produce ultrafast 1D or 2D laser scans for general applications.

Diesel2p mesoscope with dual independent scan engines for flexible capture of dynamics in distributed neural circuitry

Imaging the activity of neurons that are widely distributed across brain regions deep in scattering tissue at high speed remains challenging. Here, we introduce an open-source system with Dual Independent Enhanced Scan Engines for Large field-of-view Two-Photon imaging (Diesel2p). Combining optical design, adaptive optics, and temporal multiplexing, the system offers subcellular resolution over a large field-of-view of ~25 mm2, encompassing distances up to 7 mm, with independent scan engines. We demonstrate the flexibility and various use cases of this system for calcium imaging of neurons in the living brain.

Flexible simultaneous mesoscale two-photon imaging of neural activity at high speeds

Understanding brain function requires monitoring local and global brain dynamics. Two-photon imaging of the brain across mesoscopic scales has presented trade-offs between imaging area and acquisition speed. We describe a flexible cellular resolution two-photon microscope capable of simultaneous video rate acquisition of four independently targetable brain regions spanning an approximate five-millimeter field of view. With this system, we demonstrate the ability to measure calcium activity across mouse sensorimotor cortex at behaviorally relevant timescales.

Moving beyond velocity: Opportunities and challenges to quantify immune cell behavior

The analysis of cellular behavior using intravital multi-photon microscopy has contributed substantially to our understanding of the priming and effector phases of immune responses. Yet, many questions remain unanswered and unexplored. Though advancements in intravital imaging techniques and animal models continue to drive new discoveries, continued improvements in analysis methods are needed to extract detailed information about cellular behavior. Focusing on dendritic cell (DC) and T cell interactions as an exemplar, here we discuss key limitations for intravital imaging studies and review and explore alternative approaches to quantify immune cell behavior. We touch upon current developments in deep learning models, as well as established methods from unrelated fields such as ecology to detect and track objects over time. As developments in open-source software make it possible to process and interactively view larger datasets, the challenge for the field will be to determine how best to combine intravital imaging with multi-parameter imaging of larger tissue regions to discover new facets of leukocyte dynamics and how these contribute to immune responses.

Computational optical sectioning with an incoherent multiscale scattering model for light-field microscopy

Quantitative volumetric fluorescence imaging at high speed across a long term is vital to understand various cellular and subcellular behaviors in living organisms. Light-field microscopy provides a compact computational solution by imaging the entire volume in a tomographic way, while facing severe degradation in scattering tissue or densely-labelled samples. To address this problem, we propose an incoherent multiscale scattering model in a complete space for quantitative 3D reconstruction in complicated environments, which is called computational optical sectioning. Without the requirement of any hardware modifications, our method can be generally applied to different light-field schemes with reduction in background fluorescence, reconstruction artifacts, and computational costs, facilitating more practical applications of LFM in a broad community. We validate the superior performance by imaging various biological dynamics in Drosophila embryos, zebrafish larvae, and mice.

Holographic microscope and its biological application

Holographic structured illumination combined with optogenetics enables patterned stimulation of neurons and glial cells in an intact living brain. Moreover, in vivo functional imaging of cellular activity with recent advanced microscope technologies allows for visualization of the cellular responses during learning, emotion and cognition. Integrating these techniques can be used to verify the link between cell function and behavior output. However, there are technical limitations to stimulate multiple cells with high spatial and temporal resolution with available techniques of optogenetic stimulation. Here, we summarized a two-photon microscope combined with holographic system to stimulate multiple cells with high spatial and temporal resolution for living mice and their biological application.

High-speed, cortex-wide volumetric recording of neuroactivity at cellular resolution using light beads microscopy

Two-photon microscopy has enabled high-resolution imaging of neuroactivity at depth within scattering brain tissue. However, its various realizations have not overcome the tradeoffs between speed and spatiotemporal sampling that would be necessary to enable mesoscale volumetric recording of neuroactivity at cellular resolution and speed compatible with resolving calcium transients. Here, we introduce light beads microscopy (LBM), a scalable and spatiotemporally optimal acquisition approach limited only by fluorescence lifetime, where a set of axially separated and temporally distinct foci record the entire axial imaging range near-simultaneously, enabling volumetric recording at 1.41 × 10⁸ voxels per second. Using LBM, we demonstrate mesoscopic and volumetric imaging at multiple scales in the mouse cortex, including cellular-resolution recordings within ~3 × 5 × 0.5 mm volumes containing >200,000 neurons at ~5 Hz and recordings of populations of ~1 million neurons within ~5.4 × 6 × 0.5 mm volumes at ~2 Hz, as well as higher speed (9.6 Hz) subcellular-resolution volumetric recordings. LBM provides an opportunity for discovering the neurocomputations underlying cortex-wide encoding and processing of information in the mammalian brain.

Varifocal Metalens for Optical Sectioning Fluorescence Microscopy

Fluorescence microscopy with optical sectioning capabilities is extensively utilized in biological research to obtain three-dimensional structural images of volumetric samples. Tunable lenses have been applied in microscopy for axial scanning to acquire multiplane images. However, images acquired by conventional tunable lenses suffer from spherical aberration and distortions. Here, we design, fabricate, and implement a dielectric Moiré metalens for fluorescence imaging. The Moiré metalens consists of two complementary phase metasurfaces, with variable focal length, ranging from ∼10 to ∼125 mm at 532 nm by tuning mutual angles. In addition, a telecentric configuration using the Moiré metalens is designed for high-contrast multiplane fluorescence imaging. The performance of our system is evaluated by optically sectioned images obtained from HiLo illumination of fluorescently labeled beads, as well as ex vivo mice intestine tissue samples. The compact design of the varifocal metalens may find important applications in fluorescence microscopy and endoscopy for clinical purposes.

Chronic cranial window for photoacoustic imaging: a mini review

Photoacoustic (PA) microscopy is being increasingly used to visualize the microcirculation of the brain cortex at the micron level in living rodents. By combining it with long-term cranial window techniques, vasculature can be monitored over a period of days extending to months through a field of view. To fulfill the requirements of long-term in vivo PA imaging, the cranial window must involve a simple and rapid surgical procedure, biological compatibility, and sufficient optical-acoustic transparency, which are major challenges. Recently, several cranial window techniques have been reported for longitudinal PA imaging. Here, the development of chronic cranial windows for PA imaging is reviewed and its technical details are discussed, including window installation, imaging quality, and longitudinal stability.

Real-time brain-wide multi-planar microscopy for simultaneous cortex and hippocampus imaging at the cellular resolution in mice

Interactions between the cerebral cortex and the deep cerebellar nuclei play important roles in cognitive processes. However, conventional microscopes fail to dynamically record cellular structures in distinct brain regions and at different depths, which requires high resolution, large field of view (FOV), and depth of field (DOF). Here we propose a single-photon excited fluorescence microscopy technique that performs simultaneous cortex and hippocampus imaging, enabled by a customized microscope and a chronic optical window. After we implant a glass microwindow above the hippocampus, the surface of the hippocampus is shifted to the superficial plane. We demonstrate that the proposed technique is able to image cellular structures and blood vessel dynamics in the cortex and the hippocampus in in vivo experiments, and is compatible with various mesoscopic systems.

Ultrahigh-speed point scanning two-photon microscopy using high dynamic range silicon photomultipliers

Conventional two-photon microscopes use photomultiplier tubes, which enable high sensitivity but can detect relatively few photons per second, forcing longer pixel integration times and limiting maximum imaging rates. We introduce novel detection electronics using silicon photomultipliers that greatly extend dynamic range, enabling more than an order of magnitude increased photon detection rate as compared to state-of-the-art photomultiplier tubes. We demonstrate that this capability can dramatically improve both imaging rates and signal-to-noise ratio (SNR) in two-photon microscopy using human surgical specimens. Finally, to enable wider use of more advanced detection technology, we have formed the OpenSiPM project, which aims to provide open source detector designs for high-speed two-photon and confocal microscopy.

Single-shot multi-depth full-field optical coherence tomography using spatial frequency division multiplexing

Fast 3D volumetric imaging has been essential for biology, medicine and industrial inspections, and various optical coherence tomography (OCT) methods have been developed to meet such needs. Point-scanning based approaches, such as swept-source OCT and spectral domain OCT, can obtain a depth information at once, but they require lateral scan for full 3D imaging. On the contrary, full-field OCT needs the scanning of imaging depth while it records a full lateral information at once. Here, we present a full-field OCT system that can obtain multi-depth information at once by a single-shot recording. We combine a 2D diffraction grating and a custom-made echelon to prepare multiple reference beams having different pathlengths and propagating angles. By recording a single interference image between the reflected wave from a sample and these multiple reference beams, we reconstruct full-field images at multiple depths associated with the pathlengths of the individual reference beams. We demonstrated the single-shot recording of 7 different depth images at 10 µm for biological tissues. Our method can potentially be useful for applications where high-speed recording of multiple en-face images is crucial.

Fast, multiplane line-scan confocal microscopy using axially distributed slits

The inherent constraints on resolution, speed and field of view have hindered the development of high-speed, three-dimensional microscopy techniques over large scales. Here, we present a multiplane line-scan imaging strategy, which uses a series of axially distributed reflecting slits to probe different depths within a sample volume. Our technique enables the simultaneous imaging of an optically sectioned image stack with a single camera at frame rates of hundreds of hertz, without the need for axial scanning. We demonstrate the applicability of our system to monitor fast dynamics in biological samples by performing calcium imaging of neuronal activity in mouse brains and voltage imaging of cardiomyocytes in cardiac samples.

New solution for fast axial scanning in fluorescence microscopy

A novel technique based on the remote-focusing concept, using a galvanometer scanner combined with a self-fabricated "step mirror" or "tilted mirror" to transform fast lateral scanning into axial scanning, was reported as a new solution for fast, subcellular, 3D fluorescence imaging.

Integrated Neurophotonics: Toward Dense Volumetric Interrogation of Brain Circuit Activity-at Depth and in Real Time

We propose a new paradigm for dense functional imaging of brain activity to surmount the limitations of present methodologies. We term this approach "integrated neurophotonics"; it combines recent advances in microchip-based integrated photonic and electronic circuitry with those from optogenetics. This approach has the potential to enable lens-less functional imaging from within the brain itself to achieve dense, large-scale stimulation and recording of brain activity with cellular resolution at arbitrary depths. We perform a computational study of several prototype 3D architectures for implantable probe-array modules that are designed to provide fast and dense single-cell resolution (e.g., within a 1-mm3 volume of mouse cortex comprising ∼100,000 neurons). We describe progress toward realizing integrated neurophotonic imaging modules, which can be produced en masse with current semiconductor foundry protocols for chip manufacturing. Implantation of multiple modules can cover extended brain regions.

Toric lens analysis as a focal ring and Bessel beam generator

We propose an analytical solution of the focal ring generated at the focus of a toric lens. The analytical field of the focal ring is used with a Fourier transform lens to generate a Bessel beam. A comparative analysis between the use of an illuminated annular aperture, an axicon, and a toric lens to generate a Bessel beam is performed, and the benefits and drawbacks of each are discussed. This highlights the advantages of using a toric lens with a Gaussian beam to produce a focal line of increasing intensity, which is advantageous for applications such as high depth-of-field microscopy.

Fast in vivo multiphoton light-sheet microscopy with optimal pulse frequency

Improving the imaging speed of multiphoton microscopy is an active research field. Among recent strategies, light-sheet illumination holds distinctive advantages for achieving fast imaging in vivo. However, photoperturbation in multiphoton light-sheet microscopy remains poorly investigated. We show here that the heart beat rate of zebrafish embryos is a sensitive probe of linear and nonlinear photoperturbations. By analyzing its behavior with respect to laser power, pulse frequency and wavelength, we derive guidelines to find the best balance between signal and photoperturbation. We then demonstrate one order-of-magnitude signal enhancement over previous implementations by optimizing the laser pulse frequency. These results open new opportunities for fast live tissue imaging.