A compact Acousto-Optic Lens for 2D and 3D femtosecond based 2-photon microscopy

CRASH2p: Closed-loop Two Photon Imaging in Freely Moving Animals

Direct measurement of neural activity in freely moving animals is essential for understanding how the brain controls and represents behaviors. Genetically encoded calcium indicators report neural activity as changes in fluorescence intensity, but brain motion confounds quantitative measurement of fluorescence. Translation, rotation, and deformation of the brain and the movements of intervening scattering or auto-fluorescent tissue all alter the amount of fluorescent light captured by a microscope. Compared to single-photon approaches, two photon microscopy is less sensitive to scattering and off-target fluorescence, but more sensitive to motion, and two photon imaging has always required anchoring the microscope to the brain. We developed a closed-loop resonant axial-scanning high-speed two photon (CRASH2p) microscope for real-time 3D motion correction in unrestrained animals, without implantation of reference markers. We complemented CRASH2p with a novel scanning strategy and a multistage registration pipeline. We performed volumetric ratiometrically corrected functional imaging in the CNS of freely moving Drosophila larvae and discovered previously unknown neural correlates of behavior.

Acousto-optic holography for pseudo-two-dimensional dynamic light patterning

Optical systems use acousto-optic deflectors (AODs) mostly for fast angular scanning and spectral filtering of laser beams. However, AODs may transform laser light in much broader ways. When time-locked to the pulsing of low repetition rate laser amplifiers, AODs permit the holographic reconstruction of 1D and pseudo-two-dimensional (ps2D) intensity objects of rectangular shape by controlling the amplitude and phase of the light field at high (20-200 kHz) rates for microscopic light patterning. Using iterative Fourier transformations (IFTs), we searched for AOD-compatible holograms to reconstruct the given ps2D target patterns through either phase-only or complex light field modulation. We previously showed that phase-only holograms can adequately render grid-like patterns of diffraction-limited points with non-overlapping diffraction orders, while side lobes to the target pattern can be cured with an apodization mask. Dense target patterns, in contrast, are typically encumbered by apodization-resistant speckle noise. Here, we show the denoised rendering of dense ps2D objects by complex acousto-optic holograms deriving from simultaneous optimization of the amplitude and phase of the light field. Target patterns lacking ps2D symmetry, although not translatable into single holograms, were accessed by serial holography based on a segregation into ps2D-compatible components. The holograms retrieved under different regularizations were experimentally validated in an AOD random-access microscope. IFT regularizations characterized in this work extend the versatility of acousto-optic holography for fast dynamic light patterning.

Multi-neuronal recording in unrestrained animals with all acousto-optic random-access line-scanning two-photon microscopy

To understand how neural activity encodes and coordinates behavior, it is desirable to record multi-neuronal activity in freely behaving animals. Imaging in unrestrained animals is challenging, especially for those, like larval Drosophila melanogaster, whose brains are deformed by body motion. A previously demonstrated two-photon tracking microscope recorded from individual neurons in freely crawling Drosophila larvae but faced limits in multi-neuronal recording. Here we demonstrate a new tracking microscope using acousto-optic deflectors (AODs) and an acoustic GRIN lens (TAG lens) to achieve axially resonant 2D random access scanning, sampling along arbitrarily located axial lines at a line rate of 70 kHz. With a tracking latency of 0.1 ms, this microscope recorded activities of various neurons in moving larval Drosophila CNS and VNC including premotor neurons, bilateral visual interneurons, and descending command neurons. This technique can be applied to the existing two-photon microscope to allow for fast 3D tracking and scanning.

Ultrasound-Responsive Systems as Components for Smart Materials

Smart materials can respond to stimuli and adapt their responses based on external cues from their environments. Such behavior requires a way to transport energy efficiently and then convert it for use in applications such as actuation, sensing, or signaling. Ultrasound can carry energy safely and with low losses through complex and opaque media. It can be localized to small regions of space and couple to systems over a wide range of time scales. However, the same characteristics that allow ultrasound to propagate efficiently through materials make it difficult to convert acoustic energy into other useful forms. Recent work across diverse fields has begun to address this challenge, demonstrating ultrasonic effects that provide control over physical and chemical systems with surprisingly high specificity. Here, we review recent progress in ultrasound-matter interactions, focusing on effects that can be incorporated as components in smart materials. These techniques build on fundamental phenomena such as cavitation, microstreaming, scattering, and acoustic radiation forces to enable capabilities such as actuation, sensing, payload delivery, and the initiation of chemical or biological processes. The diversity of emerging techniques holds great promise for a wide range of smart capabilities supported by ultrasound and poses interesting questions for further investigations.

Fast optical recording of neuronal activity by three-dimensional custom-access serial holography

Optical recording of neuronal activity in three-dimensional (3D) brain circuits at cellular and millisecond resolution in vivo is essential for probing information flow in the brain. While random-access multiphoton microscopy permits fast optical access to neuronal targets in three dimensions, the method is challenged by motion artifacts when recording from behaving animals. Therefore, we developed three-dimensional custom-access serial holography (3D-CASH). Built on a fast acousto-optic light modulator, 3D-CASH performs serial sampling at 40 kHz from neurons at freely selectable 3D locations. Motion artifacts are eliminated by targeting each neuron with a size-optimized pattern of excitation light covering the cell body and its anticipated displacement field. Spike rates inferred from GCaMP6f recordings in visual cortex of awake mice tracked the phase of a moving bar stimulus with higher spike correlation between intra compared to interlaminar neuron pairs. 3D-CASH offers access to the millisecond correlation structure of in vivo neuronal activity in 3D microcircuits.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Adaptive Lissajous scanning pattern design by phase modulation

This paper proposes a phase modulation method for Lissajous scanning systems, which provides adaptive scan pattern design without changing the frame rate or the field of view. Based on a rigorous analysis of Lissajous scanning, phase modulation constrains and a method for pixel calculation are derived. An accurate and simple metric for resolution calculation is proposed based on the area spanned by neighboring pixels and used for scan pattern optimization also considering the scanner dynamics. The methods are implemented using MEMS mirrors for verification of the adaptive pattern shaping, where a 5-fold resolution improvement in a defined region of interest is demonstrated.

Cerebellar granule cell axons support high-dimensional representations

In classical theories of cerebellar cortex, high-dimensional sensorimotor representations are used to separate neuronal activity patterns, improving associative learning and motor performance. Recent experimental studies suggest that cerebellar granule cell (GrC) population activity is low-dimensional. To examine sensorimotor representations from the point of view of downstream Purkinje cell 'decoders', we used three-dimensional acousto-optic lens two-photon microscopy to record from hundreds of GrC axons. Here we show that GrC axon population activity is high dimensional and distributed with little fine-scale spatial structure during spontaneous behaviors. Moreover, distinct behavioral states are represented along orthogonal dimensions in neuronal activity space. These results suggest that the cerebellar cortex supports high-dimensional representations and segregates behavioral state-dependent computations into orthogonal subspaces, as reported in the neocortex. Our findings match the predictions of cerebellar pattern separation theories and suggest that the cerebellum and neocortex use population codes with common features, despite their vastly different circuit structures.

Precompensation of 3D field distortions in remote focus two-photon microscopy

Remote focusing is widely used in 3D two-photon microscopy and 3D photostimulation because it enables fast axial scanning without moving the objective lens or specimen. However, due to the design constraints of microscope optics, remote focus units are often located in non-telecentric positions in the optical path, leading to significant depth-dependent 3D field distortions in the imaging volume. To address this limitation, we characterized 3D field distortions arising from non-telecentric remote focusing and present a method for distortion precompensation. We demonstrate its applicability for a 3D two-photon microscope that uses an acousto-optic lens (AOL) for remote focusing and scanning. We show that the distortion precompensation method improves the pointing precision of the AOL microscope to < 0.5 µm throughout the 400 × 400 × 400 µm imaging volume.

Multidimensional population activity in an electrically coupled inhibitory circuit in the cerebellar cortex

Inhibitory neurons orchestrate the activity of excitatory neurons and play key roles in circuit function. Although individual interneurons have been studied extensively, little is known about their properties at the population level. Using random-access 3D two-photon microscopy, we imaged local populations of cerebellar Golgi cells (GoCs), which deliver inhibition to granule cells. We show that population activity is organized into multiple modes during spontaneous behaviors. A slow, network-wide common modulation of GoC activity correlates with the level of whisking and locomotion, while faster (<1 s) differential population activity, arising from spatially mixed heterogeneous GoC responses, encodes more precise information. A biologically detailed GoC circuit model reproduced the common population mode and the dimensionality observed experimentally, but these properties disappeared when electrical coupling was removed. Our results establish that local GoC circuits exhibit multidimensional activity patterns that could be used for inhibition-mediated adaptive gain control and spatiotemporal patterning of downstream granule cells.

A simple, inexpensive and multi-scale 3-D fluorescent test sample for optical sectioning microscopies

Fluorescence standards allow for quality control and for the comparison of data sets across instruments and laboratories in applications of quantitative fluorescence. For example, users of microscopy core facilities can expect a homogenous and time-invariant illumination and an uniform detection sensitivity, which are prerequisites for imaging analysis, tracking or fluorimetric pH or Ca²⁺ -concentration measurements. Similarly, confirming the three-dimensional (3-D) resolution of optical sectioning microscopes calls for a regular calibration with a standardized point source. The test samples required for such measurements are typically different ones, they are often expensive and they depend much on the very microscope technique used. Similarly, the ever-increasing choice among microscope techniques and geometries increases the demand for comparison across instruments. Here, we advocate and demonstrate the multiple uses of a surprisingly versatile and simple 3-D test sample that can complement existing and much more expensive calibration samples: commercial tissue paper labeled with a fluorescent highlighter pen. We provide relevant sample characteristics and show examples ranging from the sub-μm to cm scale, acquired on epifluorescence, confocal, image scanning, two-photon (2P) and light-sheet microscopes.

Compact and adjustable compensator for AOD spatial and temporal dispersion using off-the-shelf components

Random access multiphoton microscopy using two orthogonal acousto-optic deflectors (AODs) allows sampling only particular regions of interest within a plane, greatly speeding up the sampling rate. AODs introduce spatial and temporal dispersions, which distort the point spread function and decrease the peak intensity of the pulse. Both of these effects can be compensated for with a single dispersive element placed a distance before the AODs. An additional acousto-optic modulator, a custom cut prism, and a standard prism used with additional cylindrical optics have been demonstrated. All of these introduce additional cost or complexity and require an extended path length to achieve the needed negative group delay dispersion (GDD). By introducing a telescope between a transmission grating and the AODs, we correct for spatial and temporal dispersions in a compact design using only off-the-shelf components, and we show that the GDD can be tuned by translation of the telescope without adjustment of any other elements.

Spatio-temporal parameters for optical probing of neuronal activity

The challenge to understand the complex neuronal circuit functions in the mammalian brain has brought about a revolution in light-based neurotechnologies and optogenetic tools. However, while recent seminal works have shown excellent insights on the processing of basic functions such as sensory perception, memory, and navigation, understanding more complex brain functions is still unattainable with current technologies. We are just scratching the surface, both literally and figuratively. Yet, the path towards fully understanding the brain is not totally uncertain. Recent rapid technological advancements have allowed us to analyze the processing of signals within dendritic arborizations of single neurons and within neuronal circuits. Understanding the circuit dynamics in the brain requires a good appreciation of the spatial and temporal properties of neuronal activity. Here, we assess the spatio-temporal parameters of neuronal responses and match them with suitable light-based neurotechnologies as well as photochemical and optogenetic tools. We focus on the spatial range that includes dendrites and certain brain regions (e.g., cortex and hippocampus) that constitute neuronal circuits. We also review some temporal characteristics of some proteins and ion channels responsible for certain neuronal functions. With the aid of the photochemical and optogenetic markers, we can use light to visualize the circuit dynamics of a functioning brain. The challenge to understand how the brain works continue to excite scientists as research questions begin to link macroscopic and microscopic units of brain circuits.

Adaptive optics enables aberration-free single-objective remote focusing for two-photon fluorescence microscopy

Two-photon fluorescence microscopy has been widely applied to three-dimensional (3D) imaging of complex samples. Remote focusing by controlling the divergence of excitation light is a common approach to scanning the focus axially. However, microscope objectives induce distortion to the wavefront of non-collimated excitation beams, leading to degraded imaging quality away from the natural focal plane. In this paper, using a liquid-crystal spatial light modulator to control the divergence of the excitation beam through a single objective, we systematically characterized the aberrations introduced by divergence control through microscope objectives of NA 0.45, 0.8, and 1.05. We used adaptive optics to correct the divergence-induced-aberrations and maintain diffraction-limited focal quality over up to 800-µm axial range. We further demonstrated aberration-free remote focusing for in vivo imaging of neurites and synapses in the mouse brain.

Real-time 3D movement correction for two-photon imaging in behaving animals

Two-photon microscopy is widely used to investigate brain function across multiple spatial scales. However, measurements of neural activity are compromised by brain movement in behaving animals. Brain motion-induced artifacts are typically corrected using post hoc processing of two-dimensional images, but this approach is slow and does not correct for axial movements. Moreover, the deleterious effects of brain movement on high-speed imaging of small regions of interest and photostimulation cannot be corrected post hoc. To address this problem, we combined random-access three-dimensional (3D) laser scanning using an acousto-optic lens and rapid closed-loop field programmable gate array processing to track 3D brain movement and correct motion artifacts in real time at up to 1 kHz. Our recordings from synapses, dendrites and large neuronal populations in behaving mice and zebrafish demonstrate real-time movement-corrected 3D two-photon imaging with submicrometer precision.

Five-dimensional two-photon volumetric microscopy of in-vivo dynamic activities using liquid lens remote focusing

Multi-photon scanning microscopy provides a robust tool for optical sectioning, which can be used to capture fast biological events such as blood flow, mitochondrial activity, and neuronal action potentials. For many studies, it is important to visualize several different focal planes at a rate akin to the biological event frequency. Typically, a microscope is equipped with mechanical elements to move either the sample or the objective lens to capture volumetric information, but these strategies are limited due to their slow speeds or inertial artifacts. To overcome this problem, remote focusing methods have been developed to shift the focal plane axially without physical movement of the sample or the microscope. Among these methods is liquid lens technology, which adjusts the focus of the lens by changing the wettability of the liquid and hence its curvature. Liquid lenses are inexpensive active optical elements that have the potential for fast multi-photon volumetric imaging, hence a promising and accessible approach for the study of biological systems with complex dynamics. Although remote focusing using liquid lens technology can be used for volumetric point scanning multi-photon microscopy, optical aberrations and the effects of high energy laser pulses have been concerns in its implementation. In this paper, we characterize a liquid lens and validate its use in relevant biological applications. We measured optical aberrations that are caused by the liquid lens, and calculated its response time, defocus hysteresis, and thermal response to a pulsed laser. We applied this method of remote focusing for imaging and measurement of multiple in-vivo specimens, including mesenchymal stem cell dynamics, mouse tibialis anterior muscle mitochondrial electrical potential fluctuations, and mouse brain neural activity. Our system produces 5 dimensional (x,y,z,λ,t) data sets at the speed of 4.2 volumes per second over volumes as large as 160 x 160 x 35 µm³.

Adaptive optics microspectrometer for cross-correlation measurement of microfluidic flows

Mapping flows in vivo is essential for the investigation of cardiovascular pathologies in animal models. The limitation of optical-based methods, such as space-time cross correlation, is the scattering of light by the connective and fat components and the direct wave front distortion by large inhomogeneities in the tissue. Nonlinear excitation of the sample fluorescence helps us by reducing light scattering in excitation. However, there is still a limitation on the signal-background due to the wave front distortion. We develop a diffractive optical microscope based on a single spatial light modulator (SLM) with no movable parts. We combine the correction of wave front distortions to the cross-correlation analysis of the flow dynamics. We use the SLM to shine arbitrary patterns of spots on the sample, to correct their optical aberrations, to shift the aberration corrected spot array on the sample for the collection of fluorescence images, and to measure flow velocities from the cross-correlation functions computed between couples of spots. The setup and the algorithms are tested on various microfluidic devices. By applying the adaptive optics correction algorithm, it is possible to increase up to 5 times the signal-to-background ratio and to reduce approximately of the same ratio the uncertainty of the flow speed measurement. By working on grids of spots, we can correct different aberrations in different portions of the field of view, a feature that allows for anisoplanatic aberrations correction. Finally, being more efficient in the excitation, we increase the accuracy of the speed measurement by employing a larger number of spots in the grid despite the fact that the two-photon excitation efficiency scales as the fourth power of this number: we achieve a twofold decrease of the uncertainty and a threefold increase of the accuracy in the evaluation of the flow speed.

A compact holographic projector module for high-resolution 3D multi-site two-photon photostimulation

Patterned two-photon (2P) photolysis via holographic illumination is a powerful method to investigate neuronal function because of its capability to emulate multiple synaptic inputs in three dimensions (3D) simultaneously. However, like any optical system, holographic projectors have a finite space-bandwidth product that restricts the spatial range of patterned illumination or field-of-view (FOV) for a desired resolution. Such trade-off between holographic FOV and resolution restricts the coverage within a limited domain of the neuron's dendritic tree to perform highly resolved patterned 2P photolysis on individual spines. Here, we integrate a holographic projector into a commercial 2P galvanometer-based 2D scanning microscope with an uncaging unit and extend the accessible holographic FOV by using the galvanometer scanning mirrors to reposition the holographic FOV arbitrarily across the imaging FOV. The projector system utilizes the microscope's built-in imaging functions. Stimulation positions can be selected from within an acquired 3D image stack (the volume-of-interest, VOI) and the holographic projector then generates 3D illumination patterns with multiple uncaging foci. The imaging FOV of our system is 800×800 μm2 within which a holographic VOI of 70×70×70 μm3 can be chosen at arbitrary positions and also moved during experiments without moving the sample. We describe the design and alignment protocol as well as the custom software plugin that controls the 3D positioning of stimulation sites. We demonstrate the neurobiological application of the system by simultaneously uncaging glutamate at multiple spines within dendritic domains and consequently observing summation of postsynaptic potentials at the soma, eventually resulting in action potentials. At the same time, it is possible to perform two-photon Ca2+ imaging in 2D in the dendrite and thus to monitor synaptic Ca2+ entry in selected spines and also local regenerative events such as dendritic action potentials.

Methods for Three-Dimensional All-Optical Manipulation of Neural Circuits

Optical means for modulating and monitoring neuronal activity, have provided substantial insights to neurophysiology and toward our understanding of how the brain works. Optogenetic actuators, calcium or voltage imaging probes and other molecular tools, combined with advanced microscopies have allowed an "all-optical" readout and modulation of neural circuits. Completion of this remarkable work is evolving toward a three-dimensional (3D) manipulation of neural ensembles at a high spatiotemporal resolution. Recently, original optical methods have been proposed for both activating and monitoring neurons in a 3D space, mainly through optogenetic compounds. Here, we review these methods and anticipate possible combinations among them.

Optogenetic stimulation of complex spatio-temporal activity patterns by acousto-optic light steering probes cerebellar granular layer integrative properties

Optogenetics provides tools to control afferent activity in brain microcircuits. However, this requires optical methods that can evoke asynchronous and coordinated activity within neuronal ensembles in a spatio-temporally precise way. Here we describe a light patterning method, which combines MHz acousto-optic beam steering and adjustable low numerical aperture Gaussian beams, to achieve fast 2D targeting in scattering tissue. Using mossy fiber afferents to the cerebellar cortex as a testbed, we demonstrate single fiber optogenetic stimulation with micron-scale lateral resolution, >100 µm depth-penetration and 0.1 ms spiking precision. Protracted spatio-temporal patterns of light delivered by our illumination system evoked sustained asynchronous mossy fiber activity with excellent repeatability. Combining optical and electrical stimulations, we show that the cerebellar granular layer performs nonlinear integration, whereby sustained mossy fiber activity provides a permissive context for the transmission of salient inputs, enriching combinatorial views on mossy fiber pattern separation.

High contrast imaging and flexible photomanipulation for quantitative in vivo multiphoton imaging with polygon scanning microscope

In this study, we introduce two key improvements that overcome limitations of existing polygon scanning microscopes while maintaining high spatial and temporal imaging resolution over large field of view (FOV). First, we proposed a simple and straightforward means to control the scanning angle of the polygon mirror to carry out photomanipulation without resorting to high speed optical modulators. Second, we devised a flexible data sampling method directly leading to higher image contrast by over 2-fold and digital images with 100 megapixels (10 240 × 10 240) per frame at 0.25 Hz. This generates sub-diffraction limited pixels (60 nm per pixels over the FOV of 512 μm) which increases the degrees of freedom to extract signals computationally. The unique combined optical and digital control recorded fine fluorescence recovery after localized photobleaching (r ~10 μm) within fluorescent giant unilamellar vesicles and micro-vascular dynamics after laser-induced injury during thrombus formation in vivo. These new improvements expand the quantitative biological-imaging capacity of any polygon scanning microscope system.

Gaussian beam diffraction by two-dimensional refractive index modulation for high diffraction efficiency and large deflection angle

The propagation of Gaussian beams is analyzed for an acousto-optic deflector by varying the refractive index in two-dimensions with a row of phased array piezoelectric transducers. Inhomogeneous domains of phase grating are produced by operating the transducers at different phase shifts, resulting in two-dimensional index modulation of periodic and sinc function profiles. Also different phase shifts provide a mechanism to steer the grating lobe in various directions and, therefore, the incident angle of the laser beam on the grating plane is automatically modified without moving the beam. Additionally, the acoustic frequency can be varied to achieve the Bragg condition for the new incident angle of the laser beam so that the diffraction efficiency of the deflector is maximized. The Gaussian beam is expressed in terms of planes and the second order coupled mode theory is implemented to analyze the diffraction of the beam. The diffraction efficiency is found to be nearly unity for optimal operating parameters of the acousto-optic device.

Technologies for imaging neural activity in large volumes

Neural circuitry has evolved to form distributed networks that act dynamically across large volumes. Conventional microscopy collects data from individual planes and cannot sample circuitry across large volumes at the temporal resolution relevant to neural circuit function and behaviors. Here we review emerging technologies for rapid volume imaging of neural circuitry. We focus on two critical challenges: the inertia of optical systems, which limits image speed, and aberrations, which restrict the image volume. Optical sampling time must be long enough to ensure high-fidelity measurements, but optimized sampling strategies and point-spread function engineering can facilitate rapid volume imaging of neural activity within this constraint. We also discuss new computational strategies for processing and analyzing volume imaging data of increasing size and complexity. Together, optical and computational advances are providing a broader view of neural circuit dynamics and helping elucidate how brain regions work in concert to support behavior.

Three-dimensional focusing through scattering media using conjugate adaptive optics with remote focusing (CAORF)

The small correction volume for conventional wavefront shaping methods limits their application in biological imaging through scattering media. We demonstrate large volume wavefront shaping through a scattering layer with a single correction by conjugate adaptive optics and remote focusing (CAORF). The remote focusing module can maintain the conjugation between the adaptive optical (AO) element and the scattering layer during three-dimensional scanning. This new configuration provides a wider correction volume by better utilization of the memory effect in a fast three-dimensional laser scanning microscope. Our results show that the proposed system can provide 10 times wider axial field of view compared with a conventional conjugate AO system when 16,384 segments are used on a spatial light modulator. We also demonstrate three-dimensional fluorescence imaging, multi-spot patterning through a scattering layer and two-photon imaging through mouse skull tissue.

In vivo imaging of neural activity

Since the introduction of calcium imaging to monitor neuronal activity with single-cell resolution, optical imaging methods have revolutionized neuroscience by enabling systematic recordings of neuronal circuits in living animals. The plethora of methods for functional neural imaging can be daunting to the nonexpert to navigate. Here we review advanced microscopy techniques for in vivo functional imaging and offer guidelines for which technologies are best suited for particular applications.

Volumetric two-photon imaging of neurons using stereoscopy (vTwINS)

Two-photon laser scanning microscopy of calcium dynamics using fluorescent indicators is a widely used imaging method for large scale recording of neural activity in vivo. Here we introduce volumetric Two-photon Imaging of Neurons using Stereoscopy (vTwINS), a volumetric calcium imaging method that employs an elongated, V-shaped point spread function to image a 3D brain volume. Single neurons project to spatially displaced “image pairs” in the resulting 2D image, and the separation distance between images is proportional to depth in the volume. To demix the fluorescence time series of individual neurons, we introduce a novel orthogonal matching pursuit algorithm that also infers source locations within the 3D volume. We illustrate vTwINS by imaging neural population activity in mouse primary visual cortex and hippocampus. Our results demonstrate that vTwINS provides an effective method for volumetric two-photon calcium imaging that increases the number of neurons recorded while maintaining a high frame-rate.

Imaging and Optically Manipulating Neuronal Ensembles

The neural code that relates the firing of neurons to the generation of behavior and mental states must be implemented by spatiotemporal patterns of activity across neuronal populations. These patterns engage selective groups of neurons, called neuronal ensembles, which are emergent building blocks of neural circuits. We review optical and computational methods, based on two-photon calcium imaging and two-photon optogenetics, to detect, characterize, and manipulate neuronal ensembles in three dimensions. We review data using these methods in the mammalian cortex that demonstrate the existence of neuronal ensembles in the spontaneous and evoked cortical activity in vitro and in vivo. Moreover, two-photon optogenetics enable the possibility of artificially imprinting neuronal ensembles into awake, behaving animals and of later recalling those ensembles selectively by stimulating individual cells. These methods could enable deciphering the neural code and also be used to understand the pathophysiology of and design novel therapies for neurological and mental diseases.

Fast axial scanning for 2-photon microscopy using liquid lens technology

Scanning microscopy methods require movement of the focus in Z coordinates to produce an image of a 3-dimensional volume. In a typical imaging system, the optical setup is kept fixed and either the sample or the objective is translated with a mechanical stage driven by a stepper motor or a piezoelectric element. Mechanical Z scanning is precise, but its slow response and vulnerability to mechanical vibrations and stress make it disadvantageous to image dynamic, time-varying samples such as live cell structures. An alternative method less susceptible to these problems is to change the focal plane using conjugate optics. Deformable mirrors, acoustooptics, and electrically tunable lenses have been experimented with to achieve this goal and have attained very fast and precise Z-scanning without physically moving the sample. Here, we present the use of a liquid lens for fast axial scanning. Liquid lenses have a long functional life, high degree of phase shift, and low sensitivity to mechanical stress. They work on the principle of refraction at a liquid-liquid interface. At the boundary of a polar and an apolar liquid a spherical surface is formed whose curvature can be controlled by adjusting its relative wettability using electrowetting. We characterize the effects of the lens on attainable Z displacement, beam spectral characteristics, and pulse duration as compared with mechanical scanning.

Automated Remote Focusing, Drift Correction, and Photostimulation to Evaluate Structural Plasticity in Dendritic Spines

Long-term structural plasticity of dendritic spines plays a key role in synaptic plasticity, the cellular basis for learning and memory. The biochemical step is mediated by a complex network of signaling proteins in spines. Two-photon imaging techniques combined with two-photon glutamate uncaging allows researchers to induce and quantify structural plasticity in single dendritic spines. However, this method is laborious and slow, making it unsuitable for high throughput screening of factors necessary for structural plasticity. Here we introduce a MATLAB-based module built for Scanimage to automatically track, image, and stimulate multiple dendritic spines. We implemented an electrically tunable lens in combination with a drift correction algorithm to rapidly and continuously track targeted spines and correct sample movements. With a straightforward user interface to design custom multi-position experiments, we were able to adequately image and produce targeted plasticity in multiple dendritic spines using glutamate uncaging. Our methods are inexpensive, open source, and provides up to a five-fold increase in throughput for quantifying structural plasticity of dendritic spines.

Two-dimensional refractive index modulation by phased array transducers in acousto-optic deflectors

Acousto-optic deflectors are photonic devices that are used for scanning high-power laser beams in advanced microprocessing applications such as marking and direct writing. The operation of conventional deflectors mostly relies on one-dimensional sinusoidal variation of the refractive index in an acousto-optic medium. Sometimes static phased array transducers, such as step configuration or planar configuration transducer architecture, are used to tilt the index modulation planes for achieving higher performance and higher resolution than a single transducer AO device. However, the index can be modulated in two dimensions, and the modulation plane can be tilted arbitrarily by creating dynamic phase gratings in the medium using phased array transducers. This type of dynamic two-dimensional acousto-optic deflector can provide better performance using, for example, a large deflection angle and high diffraction efficiency. This paper utilizes an ultrasonic beam steering approach to study the two-dimensional strain-induced index modulation due to the photoelastic effect. The modulation is numerically simulated, and the effects of various parameters, such as the operating radiofrequency of the transducers, the ultrasonic beam steering angle, and different combinations of pressure on each element of the transducer array, are demonstrated.

Fast volumetric calcium imaging across multiple cortical layers using sculpted light

Although whole-organism calcium imaging in small and semi-transparent animals has been demonstrated, capturing the functional dynamics of large-scale neuronal circuits in awake behaving mammals at high speed and resolution has remained one of the main frontiers in systems neuroscience. Here we present a method based on light sculpting that enables unbiased single- and dual-plane high-speed (up to 160 Hz) calcium imaging as well as in vivo volumetric calcium imaging of a mouse cortical column (0.5 mm × 0.5 mm × 0.5 mm) at single-cell resolution and fast volume rates (3-6 Hz). We achieved this by tailoring the point-spread function of our microscope to the structures of interest while maximizing the signal-to-noise ratio using a home-built fiber laser amplifier with pulses that are synchronized to the imaging voxel speed. This enabled in vivo recording of calcium dynamics of several thousand neurons across cortical layers and in the hippocampus of awake behaving mice.

Random-access scanning microscopy for 3D imaging in awake behaving animals

Understanding how neural circuits process information requires rapid measurements of activity from identified neurons distributed in 3D space. Here we describe an acousto-optic lens two-photon microscope that performs high-speed focusing and line scanning within a volume spanning hundreds of micrometers. We demonstrate its random-access functionality by selectively imaging cerebellar interneurons sparsely distributed in 3D space and by simultaneously recording from the soma, proximal and distal dendrites of neocortical pyramidal cells in awake behaving mice.

Dynamic wavefront shaping with an acousto-optic lens for laser scanning microscopy

Acousto-optic deflectors (AODs) arranged in series and driven with linearly chirped frequencies can rapidly focus and tilt optical wavefronts, enabling high-speed 3D random access microscopy. Non-linearly chirped acoustic drive frequencies can also be used to shape the optical wavefront allowing a range of higher-order aberrations to be generated. However, to date, wavefront shaping with AODs has been achieved by using single laser pulses for strobed illumination to 'freeze' the moving acoustic wavefront, limiting voxel acquisition rates. Here we show that dynamic wavefront shaping can be achieved by applying non-linear drive frequencies to a pair of AODs with counter-propagating acoustic waves, which comprise a cylindrical acousto-optic lens (AOL). Using a cylindrical AOL we demonstrate high-speed continuous axial line scanning and the first experimental AOL-based correction of a cylindrical lens aberration at 30 kHz, accurate to 1/35^th of a wave at 800 nm. Furthermore, we develop a model to show how spherical aberration, which is the major aberration in AOL-based remote-focusing systems, can be partially or fully corrected with AOLs consisting of four or six AODs, respectively.

Simultaneous Multi-plane Imaging of Neural Circuits

Recording the activity of large populations of neurons is an important step toward understanding the emergent function of neural circuits. Here we present a simple holographic method to simultaneously perform two-photon calcium imaging of neuronal populations across multiple areas and layers of mouse cortex in vivo. We use prior knowledge of neuronal locations, activity sparsity, and a constrained nonnegative matrix factorization algorithm to extract signals from neurons imaged simultaneously and located in different focal planes or fields of view. Our laser multiplexing approach is simple and fast, and could be used as a general method to image the activity of neural circuits in three dimensions across multiple areas in the brain.

Extracting quantal properties of transmission at central synapses

Chemical synapses enable neurons to communicate rapidly, process and filter signals and to store information. However, studying their functional properties is difficult because synaptic connections typically consist of multiple synaptic contacts that release vesicles stochastically and exhibit time-dependent behavior. Moreover, most central synapses are small and inaccessible to direct measurements. Estimation of synaptic properties from responses recorded at the soma is complicated by the presence of nonuniform release probability and nonuniform quantal properties. The presence of multivesicular release and postsynaptic receptor saturation at some synapses can also complicate the interpretation of quantal parameters. Multiple-probability fluctuation analysis (MPFA; also known as variance-mean analysis) is a method that has been developed for estimating synaptic parameters from the variance and mean amplitude of synaptic responses recorded at different release probabilities. This statistical approach, which incorporates nonuniform synaptic properties, has become widely used for studying synaptic transmission. In this chapter, we describe the statistical models used to extract quantal parameters and discuss their interpretation when applying MPFA.

Fast spatial beam shaping by acousto-optic diffraction for 3D non-linear microscopy

Acousto-optic deflection (AOD) devices offer unprecedented fast control of the entire spatial structure of light beams, most notably their phase. AOD light modulation of ultra-short laser pulses, however, is not straightforward to implement because of intrinsic chromatic dispersion and non-stationarity of acousto-optic diffraction. While schemes exist to compensate chromatic dispersion, non-stationarity remains an obstacle. In this work we demonstrate an efficient AOD light modulator for stable phase modulation using time-locked generation of frequency-modulated acoustic waves at the full repetition rate of a high power laser pulse amplifier of 80 kHz. We establish the non-local relationship between the optical phase and the generating acoustic frequency function and verify the system for temporal stability, phase accuracy and generation of non-linear two-dimensional phase functions.

Improved two-photon imaging of living neurons in brain tissue through temporal gating

We optimize two-photon imaging of living neurons in brain tissue by temporally gating an incident laser to reduce the photon flux while optimizing the maximum fluorescence signal from the acquired images. Temporal gating produces a bunch of ~10 femtosecond pulses and the fluorescence signal is improved by increasing the bunch-pulse energy. Gating is achieved using an acousto-optic modulator with a variable gating frequency determined as integral multiples of the imaging sampling frequency. We hypothesize that reducing the photon flux minimizes the photo-damage to the cells. Our results, however, show that despite producing a high fluorescence signal, cell viability is compromised when the gating and sampling frequencies are equal (or effectively one bunch-pulse per pixel). We found an optimum gating frequency range that maintains the viability of the cells while preserving a pre-set fluorescence signal of the acquired two-photon images. The neurons are imaged while under whole-cell patch, and the cell viability is monitored as a change in the membrane's input resistance.

Method to quantify accuracy of position feedback signals of a three-dimensional two-photon laser-scanning microscope

Two-photon laser-scanning microscopy enables to record neuronal network activity in three-dimensional space while maintaining single-cellular resolution. One of the proposed approaches combines galvanometric x-y scanning with piezo-driven objective movements and employs hardware feedback signals for position monitoring. However, readily applicable methods to quantify the accuracy of those feedback signals are currently lacking. Here we provide techniques based on contact-free laser reflection and laser triangulation for the quantification of positioning accuracy of each spatial axis. We found that the lateral feedback signals are sufficiently accurate (defined as <2.5 µm) for a wide range of scan trajectories and frequencies. We further show that axial positioning accuracy does not only depend on objective acceleration and mass but also its geometry. We conclude that the introduced methods allow a reliable quantification of position feedback signals in a cost-efficient, easy-to-install manner and should be applicable for a wide range of two-photon laser scanning microscopes.

Development and application of a ray-based model of light propagation through a spherical acousto-optic lens

A spherical acousto-optic lens (AOL) consists of four acousto-optic deflectors (AODs) that can rapidly and precisely control the focal position of an optical beam in 3D space. Development and application of AOLs has increased the speed at which 3D random access point measurements can be performed with a two-photon microscope. This has been particularly useful for measuring brain activity with fluorescent reporter dyes because neuronal signalling is rapid and sparsely distributed in 3D space. However, a theoretical description of light propagation through AOLs has lagged behind their development, resulting in only a handful of simplified principles to guide AOL design and optimization. To address this we have developed a ray-based computer model of an AOL incorporating acousto-optic diffraction and refraction by anisotropic media. We extended an existing model of a single AOD with constant drive frequency to model a spherical AOL: four AODs in series driven with linear chirps. AOL model predictions of the relationship between optical transmission efficiency and acoustic drive frequency including second order diffraction effects closely matched experimental measurements from a 3D two-photon AOL microscope. Moreover, exploration of different AOL drive configurations identified a new simple rule for maximizing the field of view of our compact AOL design. By providing a theoretical basis for understanding optical transmission through spherical AOLs, our open source model is likely to be useful for comparing and improving different AOL designs, as well as identifying the acoustic drive configurations that provide the best transmission performance over the 3D focal region.

Beam deformation within an acousto-optic lens

The acousto-optic lens (AOL) is becoming a popular tool in the neuroscience field. Here we analyzed the deformation of the diffraction beam after passage through an AOL consisting of a pair of acousto-optic deflectors using both theoretical and experimental data. The results showed that, because of the high sensitivity of optical spatial frequencies of acousto-optic deflectors, the boundary strength of the diffraction beam of the AOL decreases significantly. When the focal length of AOL diminishes, the deformation of the diffraction beam becomes more serious with a smaller beam size. This deformation of the diffraction beam finally leads to a decreased illuminative numerical aperture, which worsens the image's spatial resolution.

High-throughput spatial light modulation two-photon microscopy for fast functional imaging

The optical monitoring of multiple single neuron activities requires high-throughput parallel acquisition of signals at millisecond temporal resolution. To this aim, holographic two-photon microscopy (2PM) based on spatial light modulators (SLMs) has been developed in combination with standard laser scanning microscopes. This requires complex coordinate transformations for the generation of holographic patterns illuminating the points of interest. We present a simpler and fully digital setup (SLM-2PM) which collects three-dimensional two-photon images by only exploiting the SLM. This configuration leads to an accurate placement of laser beamlets over small focal volumes, eliminating mechanically moving parts and making the system stable over long acquisition times. Fluorescence signals are diffraction limited and are acquired through a pixelated detector, setting the actual limit to the acquisition rate. High-resolution structural images were acquired by raster-scanning the sample with a regular grid of excitation focal volumes. These images allowed the selection of the structures to be further investigated through an interactive operator-guided selection process. Functional signals were collected by illuminating all the preselected points with a single hologram. This process is exemplified for high-speed (up to 1 kHz) two-photon calcium imaging on acute cerebellar slices.

Longitudinal in vivo two-photon fluorescence imaging

Fluorescence microscopy is an essential technique for the basic sciences, especially biomedical research. Since the invention of laser scanning confocal microscopy in the 1980s, which enabled imaging both fixed and living biological tissue with 3D precision, high-resolution fluorescence imaging has revolutionized biological research. Confocal microscopy, by its very nature, has one fundamental limitation. Due to the confocal pinhole, deep tissue fluorescence imaging is not practical. In contrast (no pun intended), two-photon fluorescence microscopy allows, in principle, the collection of all emitted photons from fluorophores in the imaged voxel, dramatically extending our ability to see deep into living tissue. Since the development of transgenic mice with genetically encoded fluorescent protein in neocortical cells in 2000, two-photon imaging has enabled the dynamics of individual synapses to be followed for up to 2 years. Since the initial landmark contributions to this field in 2002, the technique has been used to understand how neuronal structure are changed by experience, learning, and memory and various diseases. Here we provide a basic summary of the crucial elements that are required for such studies, and discuss many applications of longitudinal two-photon fluorescence microscopy that have appeared since 2002.

Dynamic particle tracking via temporal focusing multiphoton microscopy with astigmatism imaging

A three-dimensional (3D) single fluorescent particle tracking strategy based on temporal focusing multiphoton excitation microscopy (TFMPEM) combined with astigmatism imaging is proposed for delivering nanoscale-level axial information that reveals 3D trajectories of single fluorospheres in the axially-resolved multiphoton excitation volume without z-axis scanning. Whereas other scanning spatial focusing multiphoton excitation schemes induce optical trapping interference, temporal focusing multiphoton excitation produces widefield illumination with minimum optical trapping force on the fluorospheres. Currently, the lateral and axial positioning resolutions of the dynamic particle tracking approach are about 14 nm and 21 nm in standard deviation, respectively. Furthermore, the motion behavior and diffusion coefficients of fluorospheres in glycerol solutions with different concentrations are dynamically measured at a frame rate up to 100 Hz. This TFMPEM with astigmatism imaging holds great promise for exploring dynamic molecular behavior deep inside biotissues via its superior penetration, reduced trapping effect, fast frame rate, and nanoscale-level positioning.

Quantifying distortions in two-photon remote focussing microscope images using a volumetric calibration specimen

Remote focussing microscopy allows sharp, in-focus images to be acquired at high speed from outside of the focal plane of an objective lens without any agitation of the specimen. However, without careful optical alignment, the advantages of remote focussing microscopy could be compromised by the introduction of depth-dependent scaling artifacts. To achieve an ideal alignment in a point-scanning remote focussing microscope, the lateral (XY) scan mirror pair must be imaged onto the back focal plane of both the reference and imaging objectives, in a telecentric arrangement. However, for many commercial objective lenses, it can be difficult to accurately locate the position of the back focal plane. This paper investigates the impact of this limitation on the fidelity of three-dimensional data sets of living cardiac tissue, specifically the introduction of distortions. These distortions limit the accuracy of sarcomere measurements taken directly from raw volumetric data. The origin of the distortion is first identified through simulation of a remote focussing microscope. Using a novel three-dimensional calibration specimen it was then possible to quantify experimentally the size of the distortion as a function of objective misalignment. Finally, by first approximating and then compensating the distortion in imaging data from whole heart rodent studies, the variance of sarcomere length (SL) measurements was reduced by almost 50%.

In vivo fast variable focus photoacoustic microscopy using an electrically tunable lens

Fast focusing scan over a large depth range is challenging in photoacoustic microscopic imaging. In this paper, a fast variable focus photoacoustic microscopy (VF-PAM) with a large range of imaging depth was presented by using an electrically tunable lens (ETL). The ETL controlled the divergence angle of the laser beam for fast and continuous focus-shifting in depth direction with the shifting time of 15 ms, and 2.82 mm focus-shifting range with a 1 µm shifting accuracy was achieved by combining the ETL with a 0.3 NA plan microscope objective lens. Carbon fibers imaging verified the depth imaging ability of the system, in vivo microvasculature of mouse ear and brain tissues of the mouse imaging further demonstrated the focusing scan ability in biomedical application. The fast VF-PAM system allows substantial shortening of the focus-shifting time, which will be more conducive to studying living biological tissue, and will promote the development of in vivo noninvasive PA depth imaging without mechanical scan.

High-throughput nonlinear optical microscopy

High-resolution microscopy methods based on different nonlinear optical (NLO) contrast mechanisms are finding numerous applications in biology and medicine. While the basic implementations of these microscopy methods are relatively mature, an important direction of continuing technological innovation lies in improving the throughput of these systems. Throughput improvement is expected to be important for studying fast kinetic processes, for enabling clinical diagnosis and treatment, and for extending the field of image informatics. This review will provide an overview of the fundamental limitations on NLO microscopy throughput. We will further cover several important classes of high-throughput NLO microscope designs with discussions on their strengths and weaknesses and their key biomedical applications. Finally, this review will close with a perspective of potential future technological improvements in this field.

The spatiotemporal organization of cerebellar network activity resolved by two-photon imaging of multiple single neurons

In order to investigate the spatiotemporal organization of neuronal activity in local microcircuits, techniques allowing the simultaneous recording from multiple single neurons are required. To this end, we implemented an advanced spatial-light modulator two-photon microscope (SLM-2PM). A critical issue for cerebellar theory is the organization of granular layer activity in the cerebellum, which has been predicted by single-cell recordings and computational models. With SLM-2PM, calcium signals could be recorded from different network elements in acute cerebellar slices including granule cells (GrCs), Purkinje cells (PCs) and molecular layer interneurons. By combining WCRs with SLM-2PM, the spike/calcium relationship in GrCs and PCs could be extrapolated toward the detection of single spikes. The SLM-2PM technique made it possible to monitor activity of over tens to hundreds neurons simultaneously. GrC activity depended on the number of spikes in the input mossy fiber bursts. PC and molecular layer interneuron activity paralleled that in the underlying GrC population revealing the spread of activity through the cerebellar cortical network. Moreover, circuit activity was increased by the GABA-A receptor blocker, gabazine, and reduced by the AMPA and NMDA receptor blockers, NBQX and APV. The SLM-2PM analysis of spatiotemporal patterns lent experimental support to the time-window and center-surround organizing principles of the granular layer.

Dynamic fluorescence lifetime imaging based on acousto-optic deflectors

We report a dynamic fluorescence lifetime imaging (D-FLIM) system that is based on a pair of acousto-optic deflectors for the random regions of interest (ROI) study in the sample. The two-dimensional acousto-optic deflector devices are used to rapidly scan the femtosecond excitation laser beam across the sample, providing specific random access to the ROI. Our experimental results using standard fluorescent dyes in live cancer cells demonstrate that the D-FLIM system can dynamically monitor the changing process of the microenvironment in the ROI in live biological samples.