Closed-loop all-optical interrogation of neural circuits in vivo

Recent advances in light patterned optogenetic photostimulation in freely moving mice

Optogenetics opened the door to a new era of neuroscience. New optical developments are under way to enable high-resolution neuronal activity imaging and selective photostimulation of neuronal ensembles in freely moving animals. These advancements could allow researchers to interrogate, with cellular precision, functionally relevant neuronal circuits in the framework of naturalistic brain activity. We provide an overview of the current state-of-the-art of imaging and photostimulation in freely moving rodents and present a road map for future optical and engineering developments toward miniaturized microscopes that could reach beyond the currently existing systems.

Large field-of-view metabolic profiling of murine brain tissue following morphine incubation using label-free multiphoton microscopy

BACKGROUND

Although the effects on neural activation and glucose consumption caused by opiates such as morphine are known, the metabolic machinery underlying opioid use and misuse is not fully explored. Multiphoton microscopy (MPM) techniques have been developed for optical imaging at high spatial resolution. Despite the increased use of MPM for neural imaging, the use of intrinsic optical contrast has seen minimal use in neuroscience.

NEW METHOD

We present a label-free, multimodal microscopy technique for metabolic profiling of murine brain tissue following incubation with morphine sulfate (MSO4). We evaluate two- and three-photon excited autofluorescence, and second and third harmonic generation to determine meaningful intrinsic contrast mechanisms in brain tissue using simultaneous label-free, autofluorescence multi-harmonic (SLAM) microscopy.

RESULTS

Regional differences quantified in the cortex, caudate, and thalamus of the brain demonstrate region-specific changes to metabolic profiles measured from FAD intensity, along with brain-wide quantification. While the overall intensity of FAD signal significantly decreased after morphine incubation, this metabolic molecule accumulated near the nucleus accumbens.

COMPARISON WITH EXISTING METHODS

Histopathology requires tissue fixation and staining to determine cell type and morphology, lacking information about cellular metabolism. Tools such as fMRI or PET imaging have been widely used, but lack cellular resolution. SLAM microscopy obviates the need for tissue preparation, permitting immediate use and imaging of tissue with subcellular resolution in its native environment.

CONCLUSIONS

This study demonstrates the utility of SLAM microscopy for label-free investigations of neural metabolism, especially the intensity changes in FAD autofluorescence and structural morphology from third-harmonic generation.

Closed-loop experiments and brain machine interfaces with multiphoton microscopy

In the field of neuroscience, the importance of constructing closed-loop experimental systems has increased in conjunction with technological advances in measuring and controlling neural activity in live animals. We provide an overview of recent technological advances in the field, focusing on closed-loop experimental systems where multiphoton microscopy-the only method capable of recording and controlling targeted population activity of neurons at a single-cell resolution in vivo-works through real-time feedback. Specifically, we present some examples of brain machine interfaces (BMIs) using in vivo two-photon calcium imaging and discuss applications of two-photon optogenetic stimulation and adaptive optics to real-time BMIs. We also consider conditions for realizing future optical BMIs at the synaptic level, and their possible roles in understanding the computational principles of the brain.

Stimulus information guides the emergence of behavior-related signals in primary somatosensory cortex during learning

Neurons in the primary cortex carry sensory- and behavior-related information, but it remains an open question how this information emerges and intersects together during learning. Current evidence points to two possible learning-related changes: sensory information increases in the primary cortex or sensory information remains stable, but its readout efficiency in association cortices increases. We investigated this question by imaging neuronal activity in mouse primary somatosensory cortex before, during, and after learning of an object localization task. We quantified sensory- and behavior-related information and estimated how much sensory information was used to instruct perceptual choices as learning progressed. We find that sensory information increases from the start of training, while choice information is mostly present in the later stages of learning. Additionally, the readout of sensory information becomes more efficient with learning as early as in the primary sensory cortex. Together, our results highlight the importance of primary cortical neurons in perceptual learning.

Real-time analysis of large-scale neuronal imaging enables closed-loop investigation of neural dynamics

Large-scale imaging of neuronal activities is crucial for understanding brain functions. However, it is challenging to analyze large-scale imaging data in real time, preventing closed-loop investigation of neural circuitry. Here we develop a real-time analysis system with a field programmable gate array-graphics processing unit design for an up to 500-megabyte-per-second image stream. Adapted to whole-brain imaging of awake larval zebrafish, the system timely extracts activity from up to 100,000 neurons and enables closed-loop perturbations of neural dynamics.

Multimodal Technologies for Closed-Loop Neural Modulation and Sensing

Existing methods for studying neural circuits and treating neurological disorders are typically based on physical and chemical cues to manipulate and record neural activities. These approaches often involve predefined, rigid, and unchangeable signal patterns, which cannot be adjusted in real time according to the patient's condition or neural activities. With the continuous development of neural interfaces, conducting in vivo research on adaptive and modifiable treatments for neurological diseases and neural circuits is now possible. In this review, current and potential integration of various modalities to achieve precise, closed-loop modulation, and sensing in neural systems are summarized. Advanced materials, devices, or systems that generate or detect electrical, magnetic, optical, acoustic, or chemical signals are highlighted and utilized to interact with neural cells, tissues, and networks for closed-loop interrogation. Further, the significance of developing closed-loop techniques for diagnostics and treatment of neurological disorders such as epilepsy, depression, rehabilitation of spinal cord injury patients, and exploration of brain neural circuit functionality is elaborated.

Multicolor two-photon light-patterning microscope exploiting the spatio-temporal properties of a fiber bundle

The development of efficient genetically encoded indicators and actuators has opened up the possibility of reading and manipulating neuronal activity in living tissues with light. To achieve precise and reconfigurable targeting of large numbers of neurons with single-cell resolution within arbitrary volumes, different groups have recently developed all-optical strategies based on two-photon excitation and spatio-temporal shaping of ultrashort laser pulses. However, such techniques are often complex to set up and typically operate at a single wavelength only. To address these issues, we have developed a novel optical approach that uses a fiber bundle and a spatial light modulator to achieve simple and dual-color two-photon light patterning in three dimensions. By leveraging the core-to-core temporal delay and the wavelength-independent divergence characteristics of fiber bundles, we have demonstrated the capacity to generate high-resolution excitation spots in a 3D region with two distinct laser wavelengths simultaneously, offering a suitable and simple alternative for precise multicolor cell targeting.

Shining Light in Mechanobiology: Optical Tweezers, Scissors, and Beyond

Mechanobiology helps us to decipher cell and tissue functions by looking at changes in their mechanical properties that contribute to development, cell differentiation, physiology, and disease. Mechanobiology sits at the interface of biology, physics and engineering. One of the key technologies that enables characterization of properties of cells and tissue is microscopy. Combining microscopy with other quantitative measurement techniques such as optical tweezers and scissors, gives a very powerful tool for unraveling the intricacies of mechanobiology enabling measurement of forces, torques and displacements at play. We review the field of some light based studies of mechanobiology and optical detection of signal transduction ranging from optical micromanipulation-optical tweezers and scissors, advanced fluorescence techniques and optogenentics. In the current perspective paper, we concentrate our efforts on elucidating interesting measurements of forces, torques, positions, viscoelastic properties, and optogenetics inside and outside a cell attained when using structured light in combination with optical tweezers and scissors. We give perspective on the field concentrating on the use of structured light in imaging in combination with tweezers and scissors pointing out how novel developments in quantum imaging in combination with tweezers and scissors can bring to this fast growing field.

Wireless closed-loop deep brain stimulation using microelectrode array probes

Deep brain stimulation (DBS), including optical stimulation and electrical stimulation, has been demonstrated considerable value in exploring pathological brain activity and developing treatments for neural disorders. Advances in DBS microsystems based on implantable microelectrode array (MEA) probes have opened up new opportunities for closed-loop DBS (CL-DBS) in situ. This technology can be used to detect damaged brain circuits and test the therapeutic potential for modulating the output of these circuits in a variety of diseases simultaneously. Despite the success and rapid utilization of MEA probe-based CL-DBS microsystems, key challenges, including excessive wired communication, need to be urgently resolved. In this review, we considered recent advances in MEA probe-based wireless CL-DBS microsystems and outlined the major issues and promising prospects in this field. This technology has the potential to offer novel therapeutic options for psychiatric disorders in the future.

Optogenetics 2.0: challenges and solutions towards a quantitative probing of neural circuits

To exploit the full potential of optogenetics, we need to titrate and tailor optogenetic methods to emulate naturalistic circuit function. For that, the following prerequisites need to be met: first, we need to target opsin expression not only to genetically defined neurons per se, but to specifically target a functional node. Second, we need to assess the scope of optogenetic modulation, i.e. the fraction of optogenetically modulated neurons. Third, we need to integrate optogenetic control in a closed loop setting. Fourth, we need to further safe and stable gene expression and light delivery to bring optogenetics to the clinics. Here, we review these concepts for the human and rodent brain.

All-optical interrogation of brain-wide activity in freely swimming larval zebrafish

We introduce an all-optical technique that enables volumetric imaging of brain-wide calcium activity and targeted optogenetic stimulation of specific brain regions in unrestrained larval zebrafish. The system consists of three main components: a 3D tracking module, a dual-color fluorescence imaging module, and a real-time activity manipulation module. Our approach uses a sensitive genetically encoded calcium indicator in combination with a long Stokes shift red fluorescence protein as a reference channel, allowing the extraction of Ca2+ activity from signals contaminated by motion artifacts. The method also incorporates rapid 3D image reconstruction and registration, facilitating real-time selective optogenetic stimulation of different regions of the brain. By demonstrating that selective light activation of the midbrain regions in larval zebrafish could reliably trigger biased turning behavior and changes of brain-wide neural activity, we present a valuable tool for investigating the causal relationship between distributed neural circuit dynamics and naturalistic behavior.

Contribution of optical resolution to the spatial precision of two-photon optogenetic photostimulation in vivo

Significance

Two-photon optogenetics combines nonlinear excitation with noninvasive activation of neurons to enable the manipulation of neural circuits with a high degree of spatial precision. Combined with two-photon population calcium imaging, these approaches comprise a flexible platform for all-optical interrogation of neural circuits. However, a multitude of optical and biological factors dictate the exact precision of this approach in vivo, where it is most usefully applied.

Aim

We aimed to assess how the optical point spread function (OPSF) contributes to the spatial precision of two-photon photostimulation in neurobiology.

Approach

We altered the axial spread of the OPSF of the photostimulation beam using a spatial light modulator. Subsequently, calcium imaging was used to monitor the axial spatial precision of two-photon photostimulation of layer 2 neurons in the mouse neocortex.

Results

We found that optical resolution is not always the limiting factor of the spatial precision of two-photon optogenetic photostimulation and, by doing so, reveal the key factors that must be improved to achieve maximal precision.

Conclusions

Our results enable future work to focus on the optimal factors by providing key insight from controlled experiments in a manner not previously reported. This research can be applied to advance the state-of-the-art of all-optical interrogation, extending the toolkit for neuroscience research to achieve spatiotemporal precision at the crucial levels in which neural circuits operate.

Opto-electronic feedback control of membrane potential for real-time control of action potentials

To unlock new research possibilities by acquiring control of action potential (AP) morphologies in excitable cells, we developed an opto-electronic feedback loop-based system integrating cellular electrophysiology, real-time computing, and optogenetic approaches and applied it to monolayers of heart muscle cells. This allowed accurate restoration and preservation of cardiac AP morphologies in the presence of electrical perturbations of different origin in an unsupervised, self-regulatory manner, without any prior knowledge of the disturbance. Moreover, arbitrary AP waveforms could be enforced onto these cells. Collectively, these results set the stage for the refinement and application of opto-electronic control systems to enable in-depth investigation into the regulatory role of membrane potential in health and disease.

Single cell in vivo optogenetic stimulation by two-photon excitation fluorescence transfer

Optogenetic manipulation with single-cell resolution can be achieved by two-photon excitation. However, this frequently requires relatively high laser powers. Here, we developed a novel strategy that can improve the efficiency of current two-photon stimulation technologies by positioning fluorescent proteins or small fluorescent molecules with high two-photon cross-sections in the vicinity of opsins. This generates a highly localized source of endogenous single-photon illumination that can be tailored to match the optimal opsin absorbance. Through neuronal and vascular stimulation in the live mouse brain, we demonstrate the utility of this technique to achieve efficient opsin stimulation, without loss of cellular resolution. We also provide a theoretical framework for understanding the potential advantages and constrains of this methodology, with directions for future improvements. Altogether, this fluorescence transfer illumination method opens new possibilities for experiments difficult to implement in the live brain such as all-optical neural interrogation and control of regional cerebral blood flow.

Illuminating the Brain: Advances and Perspectives in Optoelectronics for Neural Activity Monitoring and Modulation

Optogenetic modulation of brain neural activity that combines optical and electrical modes in a unitary neural system has recently gained robust momentum. Controlling illumination spatial coverage, designing light-activated modulators, and developing wireless light delivery and data transmission are crucial for maximizing the use of optical neuromodulation. To this end, biocompatible electrodes with enhanced optoelectrical performance, device integration for multiplexed addressing, wireless transmission, and multimodal operation in soft systems have been developed. This review provides an outlook for uniformly illuminating large brain areas while spatiotemporally imaging the neural responses upon optoelectrical stimulation with little artifacts. Representative concepts and important breakthroughs, such as head-mounted illumination, multiple implanted optical fibers, and micro-light-delivery devices, are discussed. Examples of techniques that incorporate electrophysiological monitoring and optoelectrical stimulation are presented. Challenges and perspectives are posed for further research efforts toward high-density optoelectrical neural interface modulation, with the potential for nonpharmacological neurological disease treatments and wireless optoelectrical stimulation.

FIOLA: an accelerated pipeline for fluorescence imaging online analysis

Optical microscopy methods such as calcium and voltage imaging enable fast activity readout of large neuronal populations using light. However, the lack of corresponding advances in online algorithms has slowed progress in retrieving information about neural activity during or shortly after an experiment. This gap not only prevents the execution of real-time closed-loop experiments, but also hampers fast experiment-analysis-theory turnover for high-throughput imaging modalities. Reliable extraction of neural activity from fluorescence imaging frames at speeds compatible with indicator dynamics and imaging modalities poses a challenge. We therefore developed FIOLA, a framework for fluorescence imaging online analysis that extracts neuronal activity from calcium and voltage imaging movies at speeds one order of magnitude faster than state-of-the-art methods. FIOLA exploits algorithms optimized for parallel processing on GPUs and CPUs. We demonstrate reliable and scalable performance of FIOLA on both simulated and real calcium and voltage imaging datasets. Finally, we present an online experimental scenario to provide guidance in setting FIOLA parameters and to highlight the trade-offs of our approach.

All-optical recreation of naturalistic neural activity with a multifunctional transgenic reporter mouse

Determining which features of the neural code drive behavior requires the ability to simultaneously read out and write in neural activity patterns with high precision across many neurons. All-optical systems that combine two-photon calcium imaging and targeted photostimulation enable the activation of specific, functionally defined groups of neurons. However, these techniques are unable to test how patterns of activity across a population contribute to computation because of an inability to both read and write cell-specific firing rates. To overcome this challenge, we make two advances: first, we introduce a genetic line of mice for Cre-dependent co-expression of a calcium indicator and a potent soma-targeted microbial opsin. Second, using this line, we develop a method for read-out and write-in of precise population vectors of neural activity by calibrating the photostimulation to each cell. These advances offer a powerful and convenient platform for investigating the neural codes of computation and behavior.

Whole-brain mapping of effective connectivity by fMRI with cortex-wide patterned optogenetics

Functional magnetic resonance imaging (fMRI) with optogenetic neural manipulation is a powerful tool that enables brain-wide mapping of effective functional networks. To achieve flexible manipulation of neural excitation throughout the mouse cortex, we incorporated spatiotemporal programmable optogenetic stimuli generated by a digital micromirror device into an MRI scanner via an optical fiber bundle. This approach offered versatility in space and time in planning the photostimulation pattern, combined with in situ optical imaging and cell-type-specific or circuit-specific genetic targeting in individual mice. Brain-wide effective connectivity obtained by fMRI with optogenetic stimulation of atlas-based cortical regions is generally congruent with anatomically defined axonal tracing data but is affected by the types of anesthetics that act selectively on specific connections. fMRI combined with flexible optogenetics opens a new path to investigate dynamic changes in functional brain states in the same animal through high-throughput brain-wide effective connectivity mapping.

A distributed and efficient population code of mixed selectivity neurons for flexible navigation decisions

Decision-making requires flexibility to rapidly switch one's actions in response to sensory stimuli depending on information stored in memory. We identified cortical areas and neural activity patterns underlying this flexibility during virtual navigation, where mice switched navigation toward or away from a visual cue depending on its match to a remembered cue. Optogenetics screening identified V1, posterior parietal cortex (PPC), and retrosplenial cortex (RSC) as necessary for accurate decisions. Calcium imaging revealed neurons that can mediate rapid navigation switches by encoding a mixture of a current and remembered visual cue. These mixed selectivity neurons emerged through task learning and predicted the mouse's choices by forming efficient population codes before correct, but not incorrect, choices. They were distributed across posterior cortex, even V1, and were densest in RSC and sparsest in PPC. We propose flexibility in navigation decisions arises from neurons that mix visual and memory information within a visual-parietal-retrosplenial network.

FPGA-Based In-Vivo Calcium Image Decoding for Closed-Loop Feedback Applications

Miniaturized calcium imaging is an emerging neural recording technique that has been widely used for monitoring neural activity on a large scale at a specific brain region of rats or mice. Most existing calcium-image analysis pipelines operate offline. This results in long processing latency, making it difficult to realize closed-loop feedback stimulation for brain research. In recent work, we have proposed an FPGA-based real-time calcium image processing pipeline for closed-loop feedback applications. It can perform real-time calcium image motion correction, enhancement, fast trace extraction, and real-time decoding from extracted traces. Here, we extend this work by proposing a variety of neural network based methods for real-time decoding and evaluate the tradeoff among these decoding methods and accelerator designs. We introduce the implementation of the neural network based decoders on the FPGA, and show their speedup against the implementation on the ARM processor. Our FPGA implementation enables the real-time calcium image decoding with sub-ms processing latency for closed-loop feedback applications.

Wireless and battery-free technologies for neuroengineering

Tethered and battery-powered devices that interface with neural tissues can restrict natural motions and prevent social interactions in animal models, thereby limiting the utility of these devices in behavioural neuroscience research. In this Review Article, we discuss recent progress in the development of miniaturized and ultralightweight devices as neuroengineering platforms that are wireless, battery-free and fully implantable, with capabilities that match or exceed those of wired or battery-powered alternatives. Such classes of advanced neural interfaces with optical, electrical or fluidic functionality can also combine recording and stimulation modalities for closed-loop applications in basic studies or in the practical treatment of abnormal physiological processes.

Cortical VIP neurons locally control the gain but globally control the coherence of gamma band rhythms

Gamma band synchronization can facilitate local and long-range neural communication. In the primary visual cortex, visual stimulus properties within a specific location determine local synchronization strength, while the match of stimulus properties between distant locations controls long-range synchronization. The neural basis for the differential control of local and global gamma band synchronization is unknown. Combining electrophysiology, optogenetics, and computational modeling, we found that VIP disinhibitory interneurons in mouse cortex linearly scale gamma power locally without changing its stimulus tuning. Conversely, they suppress long-range synchronization when two regions process non-matched stimuli, tuning gamma coherence globally. Modeling shows that like-to-like connectivity across space and specific VIP→SST inhibition capture these opposing effects. VIP neurons thus differentially impact local and global properties of gamma rhythms depending on visual stimulus statistics. They may thereby construct gamma-band filters for spatially extended but continuous image features, such as contours, facilitating the downstream generation of coherent visual percepts.

A hardware system for real-time decoding of in vivo calcium imaging data

Epifluorescence miniature microscopes ('miniscopes') are widely used for in vivo calcium imaging of neural population activity. Imaging data are typically collected during a behavioral task and stored for later offline analysis, but emerging techniques for online imaging can support novel closed-loop experiments in which neural population activity is decoded in real time to trigger neurostimulation or sensory feedback. To achieve short feedback latencies, online imaging systems must be optimally designed to maximize computational speed and efficiency while minimizing errors in population decoding. Here we introduce DeCalciOn, an open-source device for real-time imaging and population decoding of in vivo calcium signals that is hardware compatible with all miniscopes that use the UCLA Data Acquisition (DAQ) interface. DeCalciOn performs online motion stabilization, neural enhancement, calcium trace extraction, and decoding of up to 1024 traces per frame at latencies of <50 ms after fluorescence photons arrive at the miniscope image sensor. We show that DeCalciOn can accurately decode the position of rats (n = 12) running on a linear track from calcium fluorescence in the hippocampal CA1 layer, and can categorically classify behaviors performed by rats (n = 2) during an instrumental task from calcium fluorescence in orbitofrontal cortex. DeCalciOn achieves high decoding accuracy at short latencies using innovations such as field-programmable gate array hardware for real-time image processing and contour-free methods to efficiently extract calcium traces from sensor images. In summary, our system offers an affordable plug-and-play solution for real-time calcium imaging experiments in behaving animals.

A flexible two-photon fiberscope for fast activity imaging and precise optogenetic photostimulation of neurons in freely moving mice

We developed a flexible two-photon microendoscope (2P-FENDO) capable of all-optical brain investigation at near cellular resolution in freely moving mice. The system performs fast two-photon (2P) functional imaging and 2P holographic photostimulation of single and multiple cells using axially confined extended spots. Proof-of-principle experiments were performed in freely moving mice co-expressing jGCaMP7s and the opsin ChRmine in the visual or barrel cortex. On a field of view of 250 μm in diameter, we demonstrated functional imaging at a frame rate of up to 50 Hz and precise photostimulation of selected groups of cells. With the capability to simultaneously image and control defined neuronal networks in freely moving animals, 2P-FENDO will enable a precise investigation of neuronal functions in the brain during naturalistic behaviors.

Transcranial low-intensity ultrasound stimulation for treating central nervous system disorders: A promising therapeutic application

Transcranial ultrasound stimulation is a neurostimulation technique that has gradually attracted the attention of researchers, especially as a potential therapy for neurological disorders, because of its high spatial resolution, its good penetration depth, and its non-invasiveness. Ultrasound can be categorized as high-intensity and low-intensity based on the intensity of its acoustic wave. High-intensity ultrasound can be used for thermal ablation by taking advantage of its high-energy characteristics. Low-intensity ultrasound, which produces low energy, can be used as a means to regulate the nervous system. The present review describes the current status of research on low-intensity transcranial ultrasound stimulation (LITUS) in the treatment of neurological disorders, such as epilepsy, essential tremor, depression, Parkinson's disease (PD), and Alzheimer's disease (AD). This review summarizes preclinical and clinical studies using LITUS to treat the aforementioned neurological disorders and discusses their underlying mechanisms.

Stretchable Surface Electrode Arrays Using an Alginate/PEDOT:PSS-Based Conductive Hydrogel for Conformal Brain Interfacing

An electrocorticogram (ECoG) is the electrical activity obtainable from the cerebral cortex and an informative source with considerable potential for future advanced applications in various brain-interfacing technologies. Considerable effort has been devoted to developing biocompatible, conformal, soft, and conductive interfacial materials for bridging devices and brain tissue; however, the implementation of brain-adaptive materials with optimized electrical and mechanical characteristics remains challenging. Herein, we present surface electrode arrays using the soft tough ionic conductive hydrogel (STICH). The newly proposed STICH features brain-adaptive softness with Young's modulus of ~9.46 kPa, which is sufficient to form a conformal interface with the cortex. Additionally, the STICH has high toughness of ~36.85 kJ/mm³, highlighting its robustness for maintaining the solid structure during interfacing with wet brain tissue. The stretchable metal electrodes with a wavy pattern printed on the elastomer were coated with the STICH as an interfacial layer, resulting in an improvement of the impedance from 60 kΩ to 10 kΩ at 1 kHz after coating. Acute in vivo experiments for ECoG monitoring were performed in anesthetized rodents, thereby successfully realizing conformal interfacing to the animal's cortex and the sensitive recording of electrical activity using the STICH-coated electrodes, which exhibited a higher visual-evoked potential (VEP) amplitude than that of the control device.

Extrasynaptic signaling enables an asymmetric juvenile motor circuit to produce symmetric undulation

In many animals, there is a direct correspondence between the motor patterns that drive locomotion and the motor neuron innervation. For example, the adult C. elegans moves with symmetric and alternating dorsal-ventral bending waves arising from symmetric motor neuron input onto the dorsal and ventral muscles. In contrast to the adult, the C. elegans motor circuit at the juvenile larval stage has asymmetric wiring between motor neurons and muscles but still generates adult-like bending waves with dorsal-ventral symmetry. We show that in the juvenile circuit, wiring between excitatory and inhibitory motor neurons coordinates the contraction of dorsal muscles with relaxation of ventral muscles, producing dorsal bends. However, ventral bending is not driven by analogous wiring. Instead, ventral muscles are excited uniformly by premotor interneurons through extrasynaptic signaling. Ventral bends occur in anti-phasic entrainment to activity of the same motor neurons that drive dorsal bends. During maturation, the juvenile motor circuit is replaced by two motor subcircuits that separately drive dorsal and ventral bending. Modeling reveals that the juvenile's immature motor circuit is an adequate solution to generate adult-like dorsal-ventral bending before the animal matures. Developmental rewiring between functionally degenerate circuit solutions, which both generate symmetric bending patterns, minimizes behavioral disruption across maturation.

Advances in computer-generated holography for targeted neuronal modulation

Genetically encoded calcium indicators and optogenetics have revolutionized neuroscience by enabling the detection and modulation of neural activity with single-cell precision using light. To fully leverage the immense potential of these techniques, advanced optical instruments that can place a light on custom ensembles of neurons with a high level of spatial and temporal precision are required. Modern light sculpting techniques that have the capacity to shape a beam of light are preferred because they can precisely target multiple neurons simultaneously and modulate the activity of large ensembles of individual neurons at rates that match natural neuronal dynamics. The most versatile approach, computer-generated holography (CGH), relies on a computer-controlled light modulator placed in the path of a coherent laser beam to synthesize custom three-dimensional (3D) illumination patterns and illuminate neural ensembles on demand. Here, we review recent progress in the development and implementation of fast and spatiotemporally precise CGH techniques that sculpt light in 3D to optically interrogate neural circuit functions.

Two-photon calcium imaging of neuronal activity

In vivo two-photon calcium imaging (2PCI) is a technique used for recording neuronal activity in the intact brain. It is based on the principle that, when neurons fire action potentials, intracellular calcium levels rise, which can be detected using fluorescent molecules that bind to calcium. This Primer is designed for scientists who are considering embarking on experiments with 2PCI. We provide the reader with a background on the basic concepts behind calcium imaging and on the reasons why 2PCI is an increasingly powerful and versatile technique in neuroscience. The Primer explains the different steps involved in experiments with 2PCI, provides examples of what ideal preparations should look like and explains how data are analysed. We also discuss some of the current limitations of the technique, and the types of solutions to circumvent them. Finally, we conclude by anticipating what the future of 2PCI might look like, emphasizing some of the analysis pipelines that are being developed and international efforts for data sharing.

Behaviorally relevant decision coding in primary somatosensory cortex neurons

Primary sensory cortex is thought to process incoming sensory information, while decision variables important for driving behavior are assumed to arise downstream in the processing hierarchy. Here, we used population two-photon calcium imaging and targeted two-photon optogenetic stimulation of neurons in layer 2/3 of mouse primary somatosensory cortex (S1) during a texture discrimination task to test for the presence of decision signals and probe their behavioral relevance. Small but distinct populations of neurons carried information about the stimulus irrespective of the behavioral outcome (stimulus neurons), or about the choice irrespective of the presented stimulus (decision neurons). Decision neurons show categorical coding that develops during learning, and lack a conclusive decision signal in Miss trials. All-optical photostimulation of decision neurons during behavior improves behavioral performance, establishing a causal role in driving behavior. The fact that stimulus and decision neurons are intermingled challenges the idea of S1 as a purely sensory area, and causal perturbation suggests a direct involvement of S1 decision neurons in the decision-making process.

Contribution of behavioural variability to representational drift

Neuronal responses to similar stimuli change dynamically over time, raising the question of how internal representations can provide a stable substrate for neural coding. Recent work has suggested a large degree of drift in neural representations even in sensory cortices, which are believed to store stable representations of the external world. While the drift of these representations is mostly characterized in relation to external stimuli, the behavioural state of the animal (for instance, the level of arousal) is also known to strongly modulate the neural activity. We therefore asked how the variability of such modulatory mechanisms can contribute to representational changes. We analysed large-scale recording of neural activity from the Allen Brain Observatory, which was used before to document representational drift in the mouse visual cortex. We found that, within these datasets, behavioural variability significantly contributes to representational changes. This effect was broadcasted across various cortical areas in the mouse, including the primary visual cortex, higher order visual areas, and even regions not primarily linked to vision like hippocampus. Our computational modelling suggests that these results are consistent with independent modulation of neural activity by behaviour over slower timescales. Importantly, our analysis suggests that reliable but variable modulation of neural representations by behaviour can be misinterpreted as representational drift if neuronal representations are only characterized in the stimulus space and marginalized over behavioural parameters.

A one-photon endoscope for simultaneous patterned optogenetic stimulation and calcium imaging in freely behaving mice

Optogenetics and calcium imaging can be combined to simultaneously stimulate and record neural activity in vivo. However, this usually requires two-photon microscopes, which are not portable nor affordable. Here we report the design and implementation of a miniaturized one-photon endoscope for performing simultaneous optogenetic stimulation and calcium imaging. By integrating digital micromirrors, the endoscope makes it possible to activate any neuron of choice within the field of view, and to apply arbitrary spatiotemporal patterns of photostimulation while imaging calcium activity. We used the endoscope to image striatal neurons from either the direct pathway or the indirect pathway in freely moving mice while activating any chosen neuron in the field of view. The endoscope also allows for the selection of neurons based on their relationship with specific animal behaviour, and to recreate the behaviour by mimicking the natural neural activity with photostimulation. The miniaturized endoscope may facilitate the study of how neural activity gives rise to behaviour in freely moving animals.

Activating parvalbumin-expressing interneurons produces iceberg effects in mouse primary visual cortex neurons

In the primary visual cortex (V1) inhibitory interneurons form a local circuit with excitatory pyramidal cells to produce distinct receptive field properties. Parvalbumin-expressing interneurons (Pvalb+) are the most common subclass of V1 interneurons, and studies of orientation tuning indicate they shape pyramidal stimulus selectivity by balancing excitation with inhibition relative to the spike threshold. The iceberg effect, where subthreshold responses have broader tuning than spiking responses, predicts that other receptive field properties besides orientation tuning should also be affected by this balance mediated by Pvalb+ cells. To test this, we measured receptive field size and visual latency of pyramidal cells while Pvalb+ activity was optogenetically increased. We found that amplifying Pvalb+ input to pyramidal cells significantly increased their latency and decreased their receptive field size, which corroborates the proposed role of Pvalb+ interneurons in sculpting pyramidal tuning by controlling cortical gain.

Multiple-Timescale Representations of Space: Linking Memory to Navigation

When navigating through space, we must maintain a representation of our position in real time; when recalling a past episode, a memory can come back in a flash. Interestingly, the brain's spatial representation system, including the hippocampus, supports these two distinct timescale functions. How are neural representations of space used in the service of both real-world navigation and internal mnemonic processes? Recent progress has identified sequences of hippocampal place cells, evolving at multiple timescales in accordance with either navigational behaviors or internal oscillations, that underlie these functions. We review experimental findings on experience-dependent modulation of these sequential representations and consider how they link real-world navigation to time-compressed memories. We further discuss recent work suggesting the prevalence of these sequences beyond hippocampus and propose that these multiple-timescale mechanisms may represent a general algorithm for organizing cell assemblies, potentially unifying the dual roles of the spatial representation system in memory and navigation.

Real-Time Image Processing Toolbox for All-Optical Closed-Loop Control of Neuronal Activities

The development of in vivo imaging and optogenetic tools makes it possible to control neural circuit activities in an all-optical, closed-loop manner, but such applications are limited by the lack of software for online analysis of neuronal imaging data. We developed an analysis software ORCA (Online Real-time activity and offline Cross-session Analysis), which performs image registration, neuron segmentation, and activity extraction at over 100 frames per second, fast enough to support real-time detection and readout of neural activity. Our active neuron detection algorithm is purely statistical, achieving a much higher speed than previous methods. We demonstrated closed-loop control of neurons that were identified on the fly, without prior recording or image processing. ORCA also includes a cross-session alignment module that efficiently tracks neurons across multiple sessions. In summary, ORCA is a powerful toolbox for fast imaging data analysis and provides a solution for all-optical closed-loop control of neuronal activity.

All-optical interrogation of neural circuits in behaving mice

Recent advances combining two-photon calcium imaging and two-photon optogenetics with computer-generated holography now allow us to read and write the activity of large populations of neurons in vivo at cellular resolution and with high temporal resolution. Such 'all-optical' techniques enable experimenters to probe the effects of functionally defined neurons on neural circuit function and behavioral output with new levels of precision. This greatly increases flexibility, resolution, targeting specificity and throughput compared with alternative approaches based on electrophysiology and/or one-photon optogenetics and can interrogate larger and more densely labeled populations of neurons than current voltage imaging-based implementations. This protocol describes the experimental workflow for all-optical interrogation experiments in awake, behaving head-fixed mice. We describe modular procedures for the setup and calibration of an all-optical system (~3 h), the preparation of an indicator and opsin-expressing and task-performing animal (~3-6 weeks), the characterization of functional and photostimulation responses (~2 h per field of view) and the design and implementation of an all-optical experiment (achievable within the timescale of a normal behavioral experiment; ~3-5 h per field of view). We discuss optimizations for efficiently selecting and targeting neuronal ensembles for photostimulation sequences, as well as generating photostimulation response maps from the imaging data that can be used to examine the impact of photostimulation on the local circuit. We demonstrate the utility of this strategy in three brain areas by using different experimental setups. This approach can in principle be adapted to any brain area to probe functional connectivity in neural circuits and investigate the relationship between neural circuit activity and behavior.

Connecting the dots between cell populations, whole-brain activity, and behavior

Simultaneously manipulating and monitoring both microscopic and macroscopic brain activity in vivo and identifying the linkage to behavior are powerful tools in neuroscience research. These capabilities have been realized with the recent technical advances of optogenetics and its combination with fMRI, here termed "opto-fMRI." Opto-fMRI allows for targeted brain region-, cell-type-, or projection-specific manipulation and targeted Ca 2 + activity measurement to be linked with global brain signaling and behavior. We cover the history, technical advances, applications, and important considerations of opto-fMRI in anesthetized and awake rodents and the future directions of the combined techniques in neuroscience and neuroimaging.

Advantages, Pitfalls, and Developments of All Optical Interrogation Strategies of Microcircuits in vivo

The holy grail for every neurophysiologist is to conclude a causal relationship between an elementary behaviour and the function of a specific brain area or circuit. Our effort to map elementary behaviours to specific brain loci and to further manipulate neural activity while observing the alterations in behaviour is in essence the goal for neuroscientists. Recent advancements in the area of experimental brain imaging in the form of longer wavelength near infrared (NIR) pulsed lasers with the development of highly efficient optogenetic actuators and reporters of neural activity, has endowed us with unprecedented resolution in spatiotemporal precision both in imaging neural activity as well as manipulating it with multiphoton microscopy. This readily available toolbox has introduced a so called all-optical physiology and interrogation of circuits and has opened new horizons when it comes to precisely, fast and non-invasively map and manipulate anatomically, molecularly or functionally identified mesoscopic brain circuits. The purpose of this review is to describe the advantages and possible pitfalls of all-optical approaches in system neuroscience, where by all-optical we mean use of multiphoton microscopy to image the functional response of neuron(s) in the network so to attain flexible choice of the cells to be also optogenetically photostimulated by holography, in absence of electrophysiology. Spatio-temporal constraints will be compared toward the classical reference of electrophysiology methods. When appropriate, in relation to current limitations of current optical approaches, we will make reference to latest works aimed to overcome these limitations, in order to highlight the most recent developments. We will also provide examples of types of experiments uniquely approachable all-optically. Finally, although mechanically non-invasive, all-optical electrophysiology exhibits potential off-target effects which can ambiguate and complicate the interpretation of the results. In summary, this review is an effort to exemplify how an all-optical experiment can be designed, conducted and interpreted from the point of view of the integrative neurophysiologist.

A deep-learning approach for online cell identification and trace extraction in functional two-photon calcium imaging

In vivo two-photon calcium imaging is a powerful approach in neuroscience. However, processing two-photon calcium imaging data is computationally intensive and time-consuming, making online frame-by-frame analysis challenging. This is especially true for large field-of-view (FOV) imaging. Here, we present CITE-On (Cell Identification and Trace Extraction Online), a convolutional neural network-based algorithm for fast automatic cell identification, segmentation, identity tracking, and trace extraction in two-photon calcium imaging data. CITE-On processes thousands of cells online, including during mesoscopic two-photon imaging, and extracts functional measurements from most neurons in the FOV. Applied to publicly available datasets, the offline version of CITE-On achieves performance similar to that of state-of-the-art methods for offline analysis. Moreover, CITE-On generalizes across calcium indicators, brain regions, and acquisition parameters in anesthetized and awake head-fixed mice. CITE-On represents a powerful tool to speed up image analysis and facilitate closed-loop approaches, for example in combined all-optical imaging and manipulation experiments.

Processing of two-photon calcium imaging data is generally time-consuming, especially for large fields of view. Here, the authors present CITE-On, a tool based on a convolutional neural network, enabling online automatic cell identification, segmentation, identity tracking, and trace extraction.

Revisiting horizontal connectivity rules in V1: from like-to-like towards like-to-all

Horizontal connections in the primary visual cortex of carnivores, ungulates and primates organize on a near-regular lattice. Given the similar length scale for the regularity found in cortical orientation maps, the currently accepted theoretical standpoint is that these maps are underpinned by a like-to-like connectivity rule: horizontal axons connect preferentially to neurons with similar preferred orientation. However, there is reason to doubt the rule's explanatory power, since a growing number of quantitative studies show that the like-to-like connectivity preference and bias mostly observed at short-range scale, are highly variable on a neuron-to-neuron level and depend on the origin of the presynaptic neuron. Despite the wide availability of published data, the accepted model of visual processing has never been revised. Here, we review three lines of independent evidence supporting a much-needed revision of the like-to-like connectivity rule, ranging from anatomy to population functional measures, computational models and to theoretical approaches. We advocate an alternative, distance-dependent connectivity rule that is consistent with new structural and functional evidence: from like-to-like bias at short horizontal distance to like-to-all at long horizontal distance. This generic rule accounts for the observed high heterogeneity in interactions between the orientation and retinotopic domains, that we argue is necessary to process non-trivial stimuli in a task-dependent manner.

High-performance microbial opsins for spatially and temporally precise perturbations of large neuronal networks

The biophysical properties of existing optogenetic tools constrain the scale, speed, and fidelity of precise optogenetic control. Here, we use structure-guided mutagenesis to engineer opsins that exhibit very high potency while retaining fast kinetics. These new opsins enable large-scale, temporally and spatially precise control of population neural activity. We extensively benchmark these new opsins against existing optogenetic tools and provide a detailed biophysical characterization of a diverse family of opsins under two-photon illumination. This establishes a resource for matching the optimal opsin to the goals and constraints of patterned optogenetics experiments. Finally, by combining these new opsins with optimized procedures for holographic photostimulation, we demonstrate the simultaneous coactivation of several hundred spatially defined neurons with a single hologram and nearly double that number by temporally interleaving holograms at fast rates. These newly engineered opsins substantially extend the capabilities of patterned illumination optogenetic paradigms for addressing neural circuits and behavior.

Heterogeneity of glutamatergic synapses: cellular mechanisms and network consequences

Chemical synapses are commonly known as a structurally and functionally highly diverse class of cell-cell contacts specialized to mediate communication between neurons. They represent the smallest "computational" unit of the brain and are typically divided into excitatory and inhibitory as well as modulatory categories. These categories are subdivided into diverse types, each representing a different structure-function repertoire that in turn are thought to endow neuronal networks with distinct computational properties. The diversity of structure and function found among a given category of synapses is referred to as heterogeneity. The main building blocks for this heterogeneity are synaptic vesicles, the active zone, the synaptic cleft, the postsynaptic density, and glial processes associated with the synapse. Each of these five structural modules entails a distinct repertoire of functions, and their combination specifies the range of functional heterogeneity at mammalian excitatory synapses, which are the focus of this review. We describe synapse heterogeneity that is manifested on different levels of complexity ranging from the cellular morphology of the pre- and postsynaptic cells toward the expression of different protein isoforms at individual release sites. We attempt to define the range of structural building blocks that are used to vary the basic functional repertoire of excitatory synaptic contacts and discuss sources and general mechanisms of synapse heterogeneity. Finally, we explore the possible impact of synapse heterogeneity on neuronal network function.

Closed-loop Modulation of the Self-regulating Brain: A Review on Approaches, Emerging Paradigms, and Experimental Designs

Closed-loop approaches, setups, and experimental designs have been applied within the field of neuroscience to enhance the understanding of basic neurophysiology principles (closed-loop neuroscience; CLNS) and to develop improved procedures for modulating brain circuits and networks for clinical purposes (closed-loop neuromodulation; CLNM). The contents of this review are thus arranged into the following sections. First, we describe basic research findings that have been made using CLNS. Next, we provide an overview of the application, rationale, and therapeutic aspects of CLNM for clinical purposes. Finally, we summarize methodological concerns and critics in clinical practice of neurofeedback and novel applications of closed-loop perspective and techniques to improve and optimize its experiments. Moreover, we outline the theoretical explanations and experimental ideas to test animal models of neurofeedback and discuss technical issues and challenges associated with implementing closed-loop systems. We hope this review is helpful for both basic neuroscientists and clinical/ translationally-oriented scientists interested in applying closed-loop methods to improve mental health and well-being.

Bubblewrap: Online tiling and real-time flow prediction on neural manifolds

While most classic studies of function in experimental neuroscience have focused on the coding properties of individual neurons, recent developments in recording technologies have resulted in an increasing emphasis on the dynamics of neural populations. This has given rise to a wide variety of models for analyzing population activity in relation to experimental variables, but direct testing of many neural population hypotheses requires intervening in the system based on current neural state, necessitating models capable of inferring neural state online. Existing approaches, primarily based on dynamical systems, require strong parametric assumptions that are easily violated in the noise-dominated regime and do not scale well to the thousands of data channels in modern experiments. To address this problem, we propose a method that combines fast, stable dimensionality reduction with a soft tiling of the resulting neural manifold, allowing dynamics to be approximated as a probability flow between tiles. This method can be fit efficiently using online expectation maximization, scales to tens of thousands of tiles, and outperforms existing methods when dynamics are noise-dominated or feature multi-modal transition probabilities. The resulting model can be trained at kiloHertz data rates, produces accurate approximations of neural dynamics within minutes, and generates predictions on submillisecond time scales. It retains predictive performance throughout many time steps into the future and is fast enough to serve as a component of closed-loop causal experiments.

Brain neural patterns and the memory function of sleep

[Figure: see text].

Probing neural codes with two-photon holographic optogenetics

Optogenetics ushered in a revolution in how neuroscientists interrogate brain function. Because of technical limitations, the majority of optogenetic studies have used low spatial resolution activation schemes that limit the types of perturbations that can be made. However, neural activity manipulations at finer spatial scales are likely to be important to more fully understand neural computation. Spatially precise multiphoton holographic optogenetics promises to address this challenge and opens up many new classes of experiments that were not previously possible. More specifically, by offering the ability to recreate extremely specific neural activity patterns in both space and time in functionally defined ensembles of neurons, multiphoton holographic optogenetics could allow neuroscientists to reveal fundamental aspects of the neural codes for sensation, cognition and behavior that have been beyond reach. This Review summarizes recent advances in multiphoton holographic optogenetics that substantially expand its capabilities, highlights outstanding technical challenges and provides an overview of the classes of experiments it can execute to test and validate key theoretical models of brain function. Multiphoton holographic optogenetics could substantially accelerate the pace of neuroscience discovery by helping to close the loop between experimental and theoretical neuroscience, leading to fundamental new insights into nervous system function and disorder.

Segmentation of Neurons from Fluorescence Calcium Recordings Beyond Real-time

Fluorescent genetically encoded calcium indicators and two-photon microscopy help understand brain function by generating large-scale in vivo recordings in multiple animal models. Automatic, fast, and accurate active neuron segmentation is critical when processing these videos. In this work, we developed and characterized a novel method, Shallow U-Net Neuron Segmentation (SUNS), to quickly and accurately segment active neurons from two-photon fluorescence imaging videos. We used temporal filtering and whitening schemes to extract temporal features associated with active neurons, and used a compact shallow U-Net to extract spatial features of neurons. Our method was both more accurate and an order of magnitude faster than state-of-the-art techniques when processing multiple datasets acquired by independent experimental groups; the difference in accuracy was enlarged when processing datasets containing few manually marked ground truths. We also developed an online version, potentially enabling real-time feedback neuroscience experiments.