Miniscope-LFOV: A large-field-of-view, single-cell-resolution, miniature microscope for wired and wire-free imaging of neural dynamics in freely behaving animals

Recent advances in light patterned optogenetic photostimulation in freely moving mice

Optogenetics opened the door to a new era of neuroscience. New optical developments are under way to enable high-resolution neuronal activity imaging and selective photostimulation of neuronal ensembles in freely moving animals. These advancements could allow researchers to interrogate, with cellular precision, functionally relevant neuronal circuits in the framework of naturalistic brain activity. We provide an overview of the current state-of-the-art of imaging and photostimulation in freely moving rodents and present a road map for future optical and engineering developments toward miniaturized microscopes that could reach beyond the currently existing systems.

Protocol for calcium imaging and analysis of hippocampal CA1 activity evoked by non-spatial stimuli

The hippocampus has a major role in processing spatial information but has been found to encode non-spatial information from multisensory modalities in recent studies. Here, we present a protocol for recording non-spatial stimuli (visual, auditory, and a combination) that evoked calcium activity of hippocampal CA1 neuronal ensembles in C57BL/6 mice using a miniaturized fluorescence microscope. We describe steps for experimental apparatus setup, surgical procedures, software development, and neuronal population activity analysis. For complete details on the use and execution of this protocol, please refer to Sun et al.1.

A miniaturized mesoscope for the large-scale single-neuron-resolved imaging of neuronal activity in freely behaving mice

Exploring the relationship between neuronal dynamics and ethologically relevant behaviour involves recording neuronal-population activity using technologies that are compatible with unrestricted animal behaviour. However, head-mounted microscopes that accommodate weight limits to allow for free animal behaviour typically compromise field of view, resolution or depth range, and are susceptible to movement-induced artefacts. Here we report a miniaturized head-mounted fluorescent mesoscope that we systematically optimized for calcium imaging at single-neuron resolution, for increased fields of view and depth of field, and for robustness against motion-generated artefacts. Weighing less than 2.5 g, the mesoscope enabled recordings of neuronal-population activity at up to 16 Hz, with 4 μm resolution over 300 μm depth-of-field across a field of view of 3.6 × 3.6 mm2 in the cortex of freely moving mice. We used the mesoscope to record large-scale neuronal-population activity in socially interacting mice during free exploration and during fear-conditioning experiments, and to investigate neurovascular coupling across multiple cortical regions.

A modular, cost-effective, versatile, open-source operant box solution for long-term miniscope imaging, 3D tracking, and deep learning behavioral analysis

In this procedure we have included an open-source method for a customized operant chamber optimized for long-term miniature microscope (miniscope) recordings. •The miniscope box is designed to function with custom or typical med-associates style accessories (e.g., houselights, levers, etc.).•The majority of parts can be directly purchased which minimizes the need for skilled and time-consuming labor.•We include designs and estimated pricing for a single box but it is recommended to build these in larger batches to efficiently utilize bulk ordering of certain components.

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

A head-mounted photoacoustic fiberscope for hemodynamic imaging in mobile mice

A miniaturized photoacoustic fiberscope has been developed, featuring a lateral resolution of 9 microns and a lightweight design at 4.5 grams. Engineered to capture hemodynamic processes at single-blood-vessel resolution at a rate of 0.2 Hz, this device represents an advancement in head-mounted tools for exploring intricate brain activities in mobile animals.

Imaging Single-Cell Ca2+ Dynamics of Brainstem Neurons and Glia in Freely Behaving Mice

In vivo brain imaging, using a combination of genetically encoded Ca2+ indicators and gradient refractive index (GRIN) lens, is a transformative technology that has become an increasingly potent research tool over the last decade. It allows direct visualisation of the dynamic cellular activity of deep brain neurons and glia in conscious animals and avoids the effect of anaesthesia on the network. This technique provides a step change in brain imaging where fibre photometry combines the whole ensemble of cellular activity, and multiphoton microscopy is limited to imaging superficial brain structures either under anaesthesia or in head-restrained conditions. We have refined the intravital imaging technique to image deep brain nuclei in the ventral medulla oblongata, one of the most difficult brain structures to image due to the movement of brainstem structures outside the cranial cavity during free behaviour (head and neck movement), whose targeting requires GRIN lens insertion through the cerebellum-a key structure for balance and movement. Our protocol refines the implantation method of GRIN lenses, giving the best possible approach to image deep extracranial brainstem structures in awake rodents with improved cell rejection/acceptance criteria during analysis. We have recently reported this method for imaging the activity of retrotrapezoid nucleus and raphe neurons to outline their chemosensitive characteristics. This revised method paves the way to image challenging brainstem structures to investigate their role in complex behaviours such as breathing, circulation, sleep, digestion, and swallowing, and could be extended to image and study the role of cerebellum in balance, movement, motor learning, and beyond. Key features • We developed a protocol that allows imaging from brainstem neurons and glia in freely behaving rodents. • Our refined method of GRIN lenses implantation and cell sorting approach gives the highest number of cells with the least postoperative complications. • The revised deep brainstem imaging method paves way to understand complex behaviours such as cardiorespiratory regulation, sleep, swallowing, and digestion. • Our protocol can be implemented to image cerebellar structures to understand their role in key functions such as balance, movement, motor learning, and more.

Toward a brighter constellation: multiorgan neuroimaging of neural and vascular dynamics in the spinal cord and brain

Significance

Pain comprises a complex interaction between motor action and somatosensation that is dependent on dynamic interactions between the brain and spinal cord. This makes understanding pain particularly challenging as it involves rich interactions between many circuits (e.g., neural and vascular) and signaling cascades throughout the body. As such, experimentation on a single region may lead to an incomplete and potentially incorrect understanding of crucial underlying mechanisms.

Aim

We aimed to develop and validate tools to enable detailed and extended observation of neural and vascular activity in the brain and spinal cord. The first key set of innovations was targeted to developing novel imaging hardware that addresses the many challenges of multisite imaging. The second key set of innovations was targeted to enabling bioluminescent (BL) imaging, as this approach can address limitations of fluorescent microscopy including photobleaching, phototoxicity, and decreased resolution due to scattering of excitation signals.

Approach

We designed 3D-printed brain and spinal cord implants to enable effective surgical implantations and optical access with wearable miniscopes or an open window (e.g., for one- or two-photon microscopy or optogenetic stimulation). We also tested the viability for BL imaging and developed a novel modified miniscope optimized for these signals (BLmini).

Results

We describe "universal" implants for acute and chronic simultaneous brain-spinal cord imaging and optical stimulation. We further describe successful imaging of BL signals in both foci and a new miniscope, the "BLmini," which has reduced weight, cost, and form-factor relative to standard wearable miniscopes.

Conclusions

The combination of 3D-printed implants, advanced imaging tools, and bioluminescence imaging techniques offers a coalition of methods for understanding spinal cord-brain interactions. Our work has the potential for use in future research into neuropathic pain and other sensory disorders and motor behavior.

Liquid lens based holographic camera for real 3D scene hologram acquisition using end-to-end physical model-driven network

With the development of artificial intelligence, neural network provides unique opportunities for holography, such as high fidelity and dynamic calculation. How to obtain real 3D scene and generate high fidelity hologram in real time is an urgent problem. Here, we propose a liquid lens based holographic camera for real 3D scene hologram acquisition using an end-to-end physical model-driven network (EEPMD-Net). As the core component of the liquid camera, the first 10 mm large aperture electrowetting-based liquid lens is proposed by using specially fabricated solution. The design of the liquid camera ensures that the multi-layers of the real 3D scene can be obtained quickly and with great imaging performance. The EEPMD-Net takes the information of real 3D scene as the input, and uses two new structures of encoder and decoder networks to realize low-noise phase generation. By comparing the intensity information between the reconstructed image after depth fusion and the target scene, the composite loss function is constructed for phase optimization, and the high-fidelity training of hologram with true depth of the 3D scene is realized for the first time. The holographic camera achieves the high-fidelity and fast generation of the hologram of the real 3D scene, and the reconstructed experiment proves that the holographic image has the advantage of low noise. The proposed holographic camera is unique and can be used in 3D display, measurement, encryption and other fields.

Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope

Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body of literature suggests that neural activity can be different when animals are free to move compared to when they are restrained. Unfortunately, existing systems for imaging calcium dynamics over large areas in non-human primates (NHPs) are table-top devices that require restraint of the animal's head. Here, we demonstrate an imaging device capable of imaging mesoscale calcium activity in a head-unrestrained male non-human primate. We successfully miniaturize our system by replacing lenses with an optical mask and computational algorithms. The resulting lensless microscope can fit comfortably on an NHP, allowing its head to move freely while imaging. We are able to measure orientation columns maps over a 20 mm2 field-of-view in a head-unrestrained macaque. Our work establishes mesoscopic imaging using a lensless microscope as a powerful approach for studying neural activity under more naturalistic conditions.

Geometric transformation adaptive optics (GTAO) for volumetric deep brain imaging through gradient-index lenses

The advance of genetic function indicators has enabled the observation of neuronal activities at single-cell resolutions. A major challenge for the applications on mammalian brains is the limited optical access depth. Currently, the method of choice to access deep brain structures is to insert miniature optical components. Among these validated miniature optics, the gradient-index (GRIN) lens has been widely employed for its compactness and simplicity. However, due to strong fourth-order astigmatism, GRIN lenses suffer from a small imaging field of view, which severely limits the measurement throughput and success rate. To overcome these challenges, we developed geometric transformation adaptive optics (GTAO), which enables adaptable achromatic large-volume correction through GRIN lenses. We demonstrate its major advances through in vivo structural and functional imaging of mouse brains. The results suggest that GTAO can serve as a versatile solution to enable large-volume recording of deep brain structures and activities through GRIN lenses.

MiniMounter: A low-cost miniaturized microscopy development toolkit for image quality control and enhancement

Head-mounted miniaturized fluorescence microscopy (Miniscope) has emerged as a significant tool in neuroscience, particularly for behavioral studies in awake rodents. However, the challenges of image quality control and standardization persist for both Miniscope users and developers. In this study, we propose a cost-effective and comprehensive toolkit named MiniMounter. This toolkit comprises a hardware platform that offers customized grippers and four-degree-of-freedom adjustment for Miniscope, along with software that integrates displacement control, image quality evaluation, and enhancement of 3D visualization. Our toolkit makes it feasible to accurately characterize Miniscope. Furthermore, MiniMounter enables auto-focusing and 3D imaging for Miniscope prototypes that possess solely a 2D imaging function, as demonstrated in phantom and animal experiments. Overall, the implementation of MiniMounter effectively enhances image quality, reduces the time required for experimental operations and image evaluation, and consequently accelerates the development and research cycle for both users and developers within the Miniscope community.

Multi-region calcium imaging in freely behaving mice with ultra-compact head-mounted fluorescence microscopes

To investigate the circuit-level neural mechanisms of behavior, simultaneous imaging of neuronal activity in multiple cortical and subcortical regions is highly desired. Miniature head-mounted microscopes offer the capability of calcium imaging in freely behaving animals. However, implanting multiple microscopes on a mouse brain remains challenging due to space constraints and the cumbersome weight of the equipment. Here, we present TINIscope, a Tightly Integrated Neuronal Imaging microscope optimized for electronic and opto-mechanical design. With its compact and lightweight design of 0.43 g, TINIscope enables unprecedented simultaneous imaging of behavior-relevant activity in up to four brain regions in mice. Proof-of-concept experiments with TINIscope recorded over 1000 neurons in four hippocampal subregions and revealed concurrent activity patterns spanning across these regions. Moreover, we explored potential multi-modal experimental designs by integrating additional modules for optogenetics, electrical stimulation or local field potential recordings. Overall, TINIscope represents a timely and indispensable tool for studying the brain-wide interregional coordination that underlies unrestrained behaviors.

Towards a Brighter Constellation: Multi-Organ Neuroimaging of Neural and Vascular Dynamics in the Spinal Cord and Brain

Significance

Pain is comprised of a complex interaction between motor action and somatosensation that is dependent on dynamic interactions between the brain and spinal cord. This makes understanding pain particularly challenging as it involves rich interactions between many circuits (e.g., neural and vascular) and signaling cascades throughout the body. As such, experimentation on a single region may lead to an incomplete and potentially incorrect understanding of crucial underlying mechanisms.

Aim

Here, we aimed to develop and validate new tools to enable detailed and extended observation of neural and vascular activity in the brain and spinal cord. The first key set of innovations were targeted to developing novel imaging hardware that addresses the many challenges of multi-site imaging. The second key set of innovations were targeted to enabling bioluminescent imaging, as this approach can address limitations of fluorescent microscopy including photobleaching, phototoxicity and decreased resolution due to scattering of excitation signals.

Approach

We designed 3D-printed brain and spinal cord implants to enable effective surgical implantations and optical access with wearable miniscopes or an open window (e.g., for one- or two-photon microscopy or optogenetic stimulation). We also tested the viability for bioluminescent imaging, and developed a novel modified miniscope optimized for these signals (BLmini).

Results

Here, we describe novel 'universal' implants for acute and chronic simultaneous brain-spinal cord imaging and optical stimulation. We further describe successful imaging of bioluminescent signals in both foci, and a new miniscope, the 'BLmini,' which has reduced weight, cost and form-factor relative to standard wearable miniscopes.

Conclusions

The combination of 3D printed implants, advanced imaging tools, and bioluminescence imaging techniques offers a new coalition of methods for understanding spinal cord-brain interactions. This work has the potential for use in future research into neuropathic pain and other sensory disorders and motor behavior.

Deep-brain optical recording of neural dynamics during behavior

In vivo fluorescence recording techniques have produced landmark discoveries in neuroscience, providing insight into how single cell and circuit-level computations mediate sensory processing and generate complex behaviors. While much attention has been given to recording from cortical brain regions, deep-brain fluorescence recording is more complex because it requires additional measures to gain optical access to harder to reach brain nuclei. Here we discuss detailed considerations and tradeoffs regarding deep-brain fluorescence recording techniques and provide a comprehensive guide for all major steps involved, from project planning to data analysis. The goal is to impart guidance for new and experienced investigators seeking to use in vivo deep fluorescence optical recordings in awake, behaving rodent models.

Recent strategies for neural dynamics observation at a larger scale and wider scope

The tremendous technical progress in neuroscience offers opportunities to observe a more minor or/and broader dynamic picture of the brain. Moreover, the large-scale neural activity of individual neurons enables the dissection of detailed mechanistic links between neural populations and behaviors. To measure neural activity in-vivo, multi-neuron recording, and neuroimaging techniques are employed and developed to acquire more neurons. The tools introduced concurrently recorded dozens to hundreds of neurons in the coordinated brain regions and elucidated the neuronal ensembles from a massive population perspective of diverse neurons at cellular resolution. In particular, the increasing spatiotemporal resolution of neuronal monitoring across the whole brain dramatically facilitates our understanding of additional nervous system functions in health and disease. Here, we will introduce state-of-the-art neuroscience tools involving large-scale neural population recording and the long-range connections spanning multiple brain regions. Their synergic effects provide to clarify the controversial circuitry underlying neuroscience. These challenging neural tools present a promising outlook for the fundamental dynamic interplay across levels of synaptic cellular, circuit organization, and brain-wide. Hence, more observations of neural dynamics will provide more clues to elucidate brain functions and push forward innovative technology at the intersection of neural engineering disciplines. We hope this review will provide insight into the use or development of recent neural techniques considering spatiotemporal scales of brain observation.

Perceptual learning deficits mediated by somatostatin releasing inhibitory interneurons of olfactory bulb in an early life stress mouse model

Early life adversity (ELA) causes aberrant functioning of neural circuits affecting the health of an individual. While ELA-induced behavioural disorders resulting from sensory and cognitive disabilities can be assessed clinically, the neural mechanisms need to be probed using animal models by employing multi-pronged experimental approaches. As ELA can alter sensory perception, we investigated the effect of early weaning on murine olfaction. By implementing go/no-go odour discrimination paradigm, we observed olfactory learning and memory impairments in early life stressed (ELS) male mice. As olfactory bulb (OB) circuitry plays a critical role in odour learning, we studied the plausible changes in the OB of ELS mice. Lowered c-Fos activity in the external plexiform layer and a reduction in the number of dendritic processes of somatostatin-releasing, GABAergic interneurons (SOM-INs) in the ELS mice led us to hypothesise the underlying circuit. We recorded reduced synaptic inhibitory feedback on mitral/tufted (M/T) cells, in the OB slices from ELS mice, explaining the learning deficiency caused by compromised refinement of OB output. The reduction in synaptic inhibition was nullified by the photo-activation of ChR2-expressing SOM-INs in ELS mice. The role of SOM-INs was revealed by learning-dependent refinement of Ca2+dynamics quantified by GCaMP6f signals, which was absent in ELS mice. Further, the causal role of SOM-INs involving circuitry was investigated by optogenetic modulation during the odour discrimination learning. Photo-activating these neurons rescued the ELA-induced learning deficits. Conversely, photo-inhibition caused learning deficiency in control animals, while it completely abolished the learning in ELS mice, confirming the adverse effects mediated by SOM-INs. Our results thus establish the role of specific inhibitory circuit in pre-cortical sensory area in orchestrating ELA-dependent changes.

Large-scale recording of neuronal activity in freely-moving mice at cellular resolution

Current methods for recording large-scale neuronal activity from behaving mice at single-cell resolution require either fixing the mouse head under a microscope or attachment of a recording device to the animal's skull. Both of these options significantly affect the animal behavior and hence also the recorded brain activity patterns. Here, we introduce a different method to acquire snapshots of single-cell cortical activity maps from freely-moving mice using a calcium sensor called CaMPARI. CaMPARI has a unique property of irreversibly changing its color from green to red inside active neurons when illuminated with 400 nm light. We capitalize on this property to demonstrate cortex-wide activity recording without any head fixation, tethering, or attachment of a miniaturized device to the mouse's head. Multiple cortical regions were recorded while the mouse was performing a battery of behavioral and cognitive tests. We identified task-dependent activity patterns across motor and somatosensory cortices, with significant differences across sub-regions of the motor cortex and correlations across several activity patterns and task parameters. This CaMPARI-based recording method expands the capabilities of recording neuronal activity from freely-moving and behaving mice under minimally-restrictive experimental conditions and provides large-scale volumetric data that are currently not accessible otherwise.

Advances in cellular resolution microscopy for brain imaging in rats

Rats are used in neuroscience research because of their physiological similarities with humans and accessibility as model organisms, trainability, and behavioral repertoire. In particular, rats perform a wide range of sophisticated social, cognitive, motor, and learning behaviors within the contexts of both naturalistic and laboratory environments. Further progress in neuroscience can be facilitated by using advanced imaging methods to measure the complex neural and physiological processes during behavior in rats. However, compared with the mouse, the rat nervous system offers a set of challenges, such as larger brain size, decreased neuron density, and difficulty with head restraint. Here, we review recent advances in in vivo imaging techniques in rats with a special focus on open-source solutions for calcium imaging. Finally, we provide suggestions for both users and developers of in vivo imaging systems for rats.

Pupil engineering for extended depth-of-field imaging in a fluorescence miniscope

Significance

Fluorescence head-mounted microscopes, i.e., miniscopes, have emerged as powerful tools to analyze in-vivo neural populations but exhibit a limited depth-of-field (DoF) due to the use of high numerical aperture (NA) gradient refractive index (GRIN) objective lenses.

Aim

We present extended depth-of-field (EDoF) miniscope, which integrates an optimized thin and lightweight binary diffractive optical element (DOE) onto the GRIN lens of a miniscope to extend the DoF by 2.8× between twin foci in fixed scattering samples.

Approach

We use a genetic algorithm that considers the GRIN lens' aberration and intensity loss from scattering in a Fourier optics-forward model to optimize a DOE and manufacture the DOE through single-step photolithography. We integrate the DOE into EDoF-Miniscope with a lateral accuracy of 70  μm to produce high-contrast signals without compromising the speed, spatial resolution, size, or weight.

Results

We characterize the performance of EDoF-Miniscope across 5- and 10-μm fluorescent beads embedded in scattering phantoms and demonstrate that EDoF-Miniscope facilitates deeper interrogations of neuronal populations in a 100-μm-thick mouse brain sample and vessels in a whole mouse brain sample.

Conclusions

Built from off-the-shelf components and augmented by a customizable DOE, we expect that this low-cost EDoF-Miniscope may find utility in a wide range of neural recording applications.

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

The optical microscope is customarily an instrument of substantial size and expense but limited performance. Here we report an integrated microscope that achieves optical performance beyond a commercial microscope with a 5×, NA 0.1 objective but only at 0.15 cm³ and 0.5 g, whose size is five orders of magnitude smaller than that of a conventional microscope. To achieve this, a progressive optimization pipeline is proposed which systematically optimizes both aspherical lenses and diffractive optical elements with over 30 times memory reduction compared to the end-to-end optimization. By designing a simulation-supervision deep neural network for spatially varying deconvolution during optical design, we accomplish over 10 times improvement in the depth-of-field compared to traditional microscopes with great generalization in a wide variety of samples. To show the unique advantages, the integrated microscope is equipped in a cell phone without any accessories for the application of portable diagnostics. We believe our method provides a new framework for the design of miniaturized high-performance imaging systems by integrating aspherical optics, computational optics, and deep learning.

FPGA-Based In-Vivo Calcium Image Decoding for Closed-Loop Feedback Applications

Miniaturized calcium imaging is an emerging neural recording technique that has been widely used for monitoring neural activity on a large scale at a specific brain region of rats or mice. Most existing calcium-image analysis pipelines operate offline. This results in long processing latency, making it difficult to realize closed-loop feedback stimulation for brain research. In recent work, we have proposed an FPGA-based real-time calcium image processing pipeline for closed-loop feedback applications. It can perform real-time calcium image motion correction, enhancement, fast trace extraction, and real-time decoding from extracted traces. Here, we extend this work by proposing a variety of neural network based methods for real-time decoding and evaluate the tradeoff among these decoding methods and accelerator designs. We introduce the implementation of the neural network based decoders on the FPGA, and show their speedup against the implementation on the ARM processor. Our FPGA implementation enables the real-time calcium image decoding with sub-ms processing latency for closed-loop feedback applications.