MATRIEX imaging: multiarea two-photon real-time in vivo explorer

Multi-region calcium imaging in freely behaving mice with ultra-compact head-mounted fluorescence microscopes

To investigate the circuit-level neural mechanisms of behavior, simultaneous imaging of neuronal activity in multiple cortical and subcortical regions is highly desired. Miniature head-mounted microscopes offer the capability of calcium imaging in freely behaving animals. However, implanting multiple microscopes on a mouse brain remains challenging due to space constraints and the cumbersome weight of the equipment. Here, we present TINIscope, a Tightly Integrated Neuronal Imaging microscope optimized for electronic and opto-mechanical design. With its compact and lightweight design of 0.43 g, TINIscope enables unprecedented simultaneous imaging of behavior-relevant activity in up to four brain regions in mice. Proof-of-concept experiments with TINIscope recorded over 1000 neurons in four hippocampal subregions and revealed concurrent activity patterns spanning across these regions. Moreover, we explored potential multi-modal experimental designs by integrating additional modules for optogenetics, electrical stimulation or local field potential recordings. Overall, TINIscope represents a timely and indispensable tool for studying the brain-wide interregional coordination that underlies unrestrained behaviors.

Deep-brain optical recording of neural dynamics during behavior

In vivo fluorescence recording techniques have produced landmark discoveries in neuroscience, providing insight into how single cell and circuit-level computations mediate sensory processing and generate complex behaviors. While much attention has been given to recording from cortical brain regions, deep-brain fluorescence recording is more complex because it requires additional measures to gain optical access to harder to reach brain nuclei. Here we discuss detailed considerations and tradeoffs regarding deep-brain fluorescence recording techniques and provide a comprehensive guide for all major steps involved, from project planning to data analysis. The goal is to impart guidance for new and experienced investigators seeking to use in vivo deep fluorescence optical recordings in awake, behaving rodent models.

Logarithmically scaled, gamma distributed neuronal spiking

Naturally log-scaled quantities abound in the nervous system. Distributions of these quantities have non-intuitive properties, which have implications for data analysis and the understanding of neural circuits. Here, we review the log-scaled statistics of neuronal spiking and the relevant analytical probability distributions. Recent work using log-scaling revealed that interspike intervals of forebrain neurons segregate into discrete modes reflecting spiking at different timescales and are each well-approximated by a gamma distribution. Each neuron spends most of the time in an irregular spiking 'ground state' with the longest intervals, which determines the mean firing rate of the neuron. Across the entire neuronal population, firing rates are log-scaled and well approximated by the gamma distribution, with a small number of highly active neurons and an overabundance of low rate neurons (the 'dark matter'). These results are intricately linked to a heterogeneous balanced operating regime, which confers upon neuronal circuits multiple computational advantages and has evolutionarily ancient origins.

Daily two-photon neuronal population imaging with targeted single-cell electrophysiology and subcellular imaging in auditory cortex of behaving mice

Quantitative and mechanistic understanding of learning and long-term memory at the level of single neurons in living brains require highly demanding techniques. A specific need is to precisely label one cell whose firing output property is pinpointed amidst a functionally characterized large population of neurons through the learning process and then investigate the distribution and properties of dendritic inputs. Here, we disseminate an integrated method of daily two-photon neuronal population Ca²⁺ imaging through an auditory associative learning course, followed by targeted single-cell loose-patch recording and electroporation of plasmid for enhanced chronic Ca²⁺ imaging of dendritic spines in the targeted cell. Our method provides a unique solution to the demand, opening a solid path toward the hard-cores of how learning and long-term memory are physiologically carried out at the level of single neurons and synapses.

Simultaneous Observation of Mouse Cortical and Hippocampal Neural Dynamics under Anesthesia through a Cranial Microprism Window

The fluorescence microscope has been widely used to explore dynamic processes in vivo in mouse brains, with advantages of a large field-of-view and high spatiotemporal resolution. However, owing to background light and tissue scattering, the single-photon wide-field microscope fails to record dynamic neural activities in the deep brain. To achieve simultaneous imaging of deep-brain regions and the superficial cortex, we combined the extended-field-of-view microscopy previously proposed with a novel prism-based cranial window to provide a longitudinal view. As well as a right-angle microprism for imaging above 1 mm, we also designed a new rectangular-trapezoidal microprism cranial window to extend the depth of observation to 1.5 mm and to reduce brain injury. We validated our method with structural imaging of microglia cells in the superficial cortex and deep-brain regions. We also recorded neuronal activity from the mouse brains in awake and anesthesitized states. The results highlight the great potential of our methods for simultaneous dynamic imaging in the superficial and deep layers of mouse brains.

Neural System Identification With Spike-Triggered Non-Negative Matrix Factorization

Neuronal circuits formed in the brain are complex with intricate connection patterns. Such complexity is also observed in the retina with a relatively simple neuronal circuit. A retinal ganglion cell (GC) receives excitatory inputs from neurons in previous layers as driving forces to fire spikes. Analytical methods are required to decipher these components in a systematic manner. Recently a method called spike-triggered non-negative matrix factorization (STNMF) has been proposed for this purpose. In this study, we extend the scope of the STNMF method. By using retinal GCs as a model system, we show that STNMF can detect various computational properties of upstream bipolar cells (BCs), including spatial receptive field, temporal filter, and transfer nonlinearity. In addition, we recover synaptic connection strengths from the weight matrix of STNMF. Furthermore, we show that STNMF can separate spikes of a GC into a few subsets of spikes, where each subset is contributed by one presynaptic BC. Taken together, these results corroborate that STNMF is a useful method for deciphering the structure of neuronal circuits.

Robust Transcoding Sensory Information With Neural Spikes

Neural coding, including encoding and decoding, is one of the key problems in neuroscience for understanding how the brain uses neural signals to relate sensory perception and motor behaviors with neural systems. However, most of the existed studies only aim at dealing with the continuous signal of neural systems, while lacking a unique feature of biological neurons, termed spike, which is the fundamental information unit for neural computation as well as a building block for brain-machine interface. Aiming at these limitations, we propose a transcoding framework to encode multi-modal sensory information into neural spikes and then reconstruct stimuli from spikes. Sensory information can be compressed into 10% in terms of neural spikes, yet re-extract 100% of information by reconstruction. Our framework can not only feasibly and accurately reconstruct dynamical visual and auditory scenes, but also rebuild the stimulus patterns from functional magnetic resonance imaging (fMRI) brain activities. More importantly, it has a superb ability of noise immunity for various types of artificial noises and background signals. The proposed framework provides efficient ways to perform multimodal feature representation and reconstruction in a high-throughput fashion, with potential usage for efficient neuromorphic computing in a noisy environment.

Advanced high resolution three-dimensional imaging to visualize the cerebral neurovascular network in stroke

As an important method to accurately and timely diagnose stroke and study physiological characteristics and pathological mechanism in it, imaging technology has gone through more than a century of iteration. The interaction of cells densely packed in the brain is three-dimensional (3D), but the flat images brought by traditional visualization methods show only a few cells and ignore connections outside the slices. The increased resolution allows for a more microscopic and underlying view. Today's intuitive 3D imagings of micron or even nanometer scale are showing its essentiality in stroke. In recent years, 3D imaging technology has gained rapid development. With the overhaul of imaging mediums and the innovation of imaging mode, the resolution has been significantly improved, endowing researchers with the capability of holistic observation of a large volume, real-time monitoring of tiny voxels, and quantitative measurement of spatial parameters. In this review, we will summarize the current methods of high-resolution 3D imaging applied in stroke.

Representing the dynamics of high-dimensional data with non-redundant wavelets

A crucial question in data science is to extract meaningful information embedded in high-dimensional data into a low-dimensional set of features that can represent the original data at different levels. Wavelet analysis is a pervasive method for decomposing time-series signals into a few levels with detailed temporal resolution. However, obtained wavelets are intertwined and over-represented across levels for each sample and across different samples within one population. Here, using neuroscience data of simulated spikes, experimental spikes, calcium imaging signals, and human electrocorticography signals, we leveraged conditional mutual information between wavelets for feature selection. The meaningfulness of selected features was verified to decode stimulus or condition with high accuracy yet using only a small set of features. These results provide a new way of wavelet analysis for extracting essential features of the dynamics of spatiotemporal neural data, which then enables to support novel model design of machine learning with representative features.

•

WCMI can extract meaningful information from high-dimensional data

•

Extracted features from neural signals are non-redundant

•

Simple decoders can read out these features with superb accuracy

One of the essential questions in data science is to extract meaningful information from high-dimensional data. A useful approach is to represent data using a few features that maintain the crucial information. The leading property of spatiotemporal data is foremost ever-changing dynamics in time. Wavelet analysis, as a classical method for disentangling time series, can capture temporal dynamics with detail. Here, we leveraged conditional mutual information between wavelets to select a small subset of non-redundant features. We demonstrated the efficiency and effectiveness of features using various types of neuroscience data with different sampling frequencies at the level of the single cell, cell population, and coarse-scale brain activity. Our results shed new insights into representing the dynamics of spatiotemporal data using a few fundamental features extracted by wavelet analysis, which may have wide implications to other types of data with rich temporal dynamics.

Fluorescence imaging of large-scale neural ensemble dynamics

Recent progress in fluorescence imaging allows neuroscientists to observe the dynamics of thousands of individual neurons, identified genetically or by their connectivity, across multiple brain areas and for extended durations in awake behaving mammals. We discuss advances in fluorescent indicators of neural activity, viral and genetic methods to express these indicators, chronic animal preparations for long-term imaging studies, and microscopes to monitor and manipulate the activity of large neural ensembles. Ca²⁺ imaging studies of neural activity can track brain area interactions and distributed information processing at cellular resolution. Across smaller spatial scales, high-speed voltage imaging reveals the distinctive spiking patterns and coding properties of targeted neuron types. Collectively, these innovations will propel studies of brain function and dovetail with ongoing neuroscience initiatives to identify new neuron types and develop widely applicable, non-human primate models. The optical toolkit's growing sophistication also suggests that "brain observatory" facilities would be useful open resources for future brain-imaging studies.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Dissecting cascade computational components in spiking neural networks

Finding out the physical structure of neuronal circuits that governs neuronal responses is an important goal for brain research. With fast advances for large-scale recording techniques, identification of a neuronal circuit with multiple neurons and stages or layers becomes possible and highly demanding. Although methods for mapping the connection structure of circuits have been greatly developed in recent years, they are mostly limited to simple scenarios of a few neurons in a pairwise fashion; and dissecting dynamical circuits, particularly mapping out a complete functional circuit that converges to a single neuron, is still a challenging question. Here, we show that a recent method, termed spike-triggered non-negative matrix factorization (STNMF), can address these issues. By simulating different scenarios of spiking neural networks with various connections between neurons and stages, we demonstrate that STNMF is a persuasive method to dissect functional connections within a circuit. Using spiking activities recorded at neurons of the output layer, STNMF can obtain a complete circuit consisting of all cascade computational components of presynaptic neurons, as well as their spiking activities. For simulated simple and complex cells of the primary visual cortex, STNMF allows us to dissect the pathway of visual computation. Taken together, these results suggest that STNMF could provide a useful approach for investigating neuronal systems leveraging recorded functional neuronal activity.

It is well known that the computation of neuronal circuits is carried out through the staged and cascade structure of different types of neurons. Nevertheless, the information, particularly sensory information, is processed in a network primarily with feedforward connections through different pathways. A peculiar example is the early visual system, where light is transcoded by the retinal cells, routed by the lateral geniculate nucleus, and reached the primary visual cortex. One meticulous interest in recent years is to map out these physical structures of neuronal pathways. However, most methods so far are limited to taking snapshots of a static view of connections between neurons. It remains unclear how to obtain a functional and dynamical neuronal circuit beyond the simple scenarios of a few randomly sampled neurons. Using simulated spiking neural networks of visual pathways with different scenarios of multiple stages, mixed cell types, and natural image stimuli, we demonstrate that a recent computational tool, named spike-triggered non-negative matrix factorization, can resolve these issues. It enables us to recover the entire structural components of neural networks underlying the computation, together with the functional components of each individual neuron. Utilizing it for complex cells of the primary visual cortex allows us to reveal every underpinning of the nonlinear computation. Our results, together with other recent experimental and computational efforts, show that it is possible to systematically dissect neural circuitry with detailed structural and functional components.

Marmosets: a promising model for probing the neural mechanisms underlying complex visual networks such as the frontal-parietal network

The technology, methodology and models used by visual neuroscientists have provided great insights into the structure and function of individual brain areas. However, complex cognitive functions arise in the brain due to networks comprising multiple interacting cortical areas that are wired together with precise anatomical connections. A prime example of this phenomenon is the frontal–parietal network and two key regions within it: the frontal eye fields (FEF) and lateral intraparietal area (area LIP). Activity in these cortical areas has independently been tied to oculomotor control, motor preparation, visual attention and decision-making. Strong, bidirectional anatomical connections have also been traced between FEF and area LIP, suggesting that the aforementioned visual functions depend on these inter-area interactions. However, advancements in our knowledge about the interactions between area LIP and FEF are limited with the main animal model, the rhesus macaque, because these key regions are buried in the sulci of the brain. In this review, we propose that the common marmoset is the ideal model for investigating how anatomical connections give rise to functionally-complex cognitive visual behaviours, such as those modulated by the frontal–parietal network, because of the homology of their cortical networks with humans and macaques, amenability to transgenic technology, and rich behavioural repertoire. Furthermore, the lissencephalic structure of the marmoset brain enables application of powerful techniques, such as array-based electrophysiology and optogenetics, which are critical to bridge the gaps in our knowledge about structure and function in the brain.

Emerging imaging methods to study whole-brain function in rodent models

In the past decade, the idea that single populations of neurons support cognition and behavior has gradually given way to the realization that connectivity matters and that complex behavior results from interactions between remote yet anatomically connected areas that form specialized networks. In parallel, innovation in brain imaging techniques has led to the availability of a broad set of imaging tools to characterize the functional organization of complex networks. However, each of these tools poses significant technical challenges and faces limitations, which require careful consideration of their underlying anatomical, physiological, and physical specificity. In this review, we focus on emerging methods for measuring spontaneous or evoked activity in the brain. We discuss methods that can measure large-scale brain activity (directly or indirectly) with a relatively high temporal resolution, from milliseconds to seconds. We further focus on methods designed for studying the mammalian brain in preclinical models, specifically in mice and rats. This field has seen a great deal of innovation in recent years, facilitated by concomitant innovation in gene-editing techniques and the possibility of more invasive recordings. This review aims to give an overview of currently available preclinical imaging methods and an outlook on future developments. This information is suitable for educational purposes and for assisting scientists in choosing the appropriate method for their own research question.

Simultaneous Detection of Viability and Concentration of Microalgae Cells Based on Chlorophyll Fluorescence and Bright Field Dual Imaging

Ship ballast water contains high concentration of plankton, bacteria, and other microorganisms. If the huge amount of ballast water is discharged without being inactivated, it will definitely spell disaster to the marine environment. Microalgae is the most common species exiting in ballast water, so the detection of the concentration and viability of microalgae is a very important issue. The traditional methods of detecting microalgae in ballast water were costly and need the help of bulky equipment. Herein, a novel method based on microalgae cell intracellular chlorophyll fluorescence (CF) imaging combines with cell bright field (BF) microscopy was proposed. The geometric features of microalgae cells were obtained by BF image, and the cell viability was obtained by CF image. The two images were fused through the classic image registration algorithm to achieve simultaneous detection of the viability and concentration of microalgae cells. Furthermore, a low-cost, miniaturized CF/BF microscopy imaging prototype system based on the above principles was designed. In order to verify the effectiveness of the proposed method, four typical microalgae in ballast water (Platymonas, Pyramimonas sp., Chrysophyta, and Prorocentrum lima) were selected as the samples. The experimental results show that the self-developed prototype can quickly and accurately determine the concentration and the viability of microalgae cells in ship ballast water based on the dual images of BF and CF, and the detection accuracy is equivalent to that of commercial microscope. It was the first time to simultaneously detect the viability and concentration of microalgae cells in ship ballast water using the method that combining the fluorescence and bright field images; moreover, a miniaturized microscopic imaging prototype was developed. Those findings expected to contribute to the microalgae detection and ship ballast water management.

Head-mounted microendoscopic calcium imaging in dorsal premotor cortex of behaving rhesus macaque

Microendoscopic calcium imaging with one-photon miniature microscopes enables unprecedented readout of neural circuit dynamics during active behavior in rodents. In this study, we describe successful application of this technology in the rhesus macaque, demonstrating plug-and-play, head-mounted recordings of cellular-resolution calcium dynamics from large populations of neurons simultaneously in bilateral dorsal premotor cortices during performance of a naturalistic motor reach task. Imaging is stable over several months, allowing us to longitudinally track individual neurons and monitor their relationship to motor behavior over time. We observe neuronal calcium dynamics selective for reach direction, which we could use to decode the animal's trial-by-trial motor behavior. This work establishes head-mounted microendoscopic calcium imaging in macaques as a powerful approach for studying the neural circuit mechanisms underlying complex and clinically relevant behaviors, and it promises to greatly advance our understanding of human brain function, as well as its dysfunction in neurological disease.

Restoration of Two-Photon Ca2+ Imaging Data Through Model Blind Spatiotemporal Filtering

Two-photon Ca²⁺ imaging is a leading technique for recording neuronal activities in vivo with cellular or subcellular resolution. However, during experiments, the images often suffer from corruption due to complex noises. Therefore, the analysis of Ca²⁺ imaging data requires preprocessing steps, such as denoising, to extract biologically relevant information. We present an approach that facilitates imaging data restoration through image denoising performed by a neural network combining spatiotemporal filtering and model blind learning. Tests with synthetic and real two-photon Ca²⁺ imaging datasets demonstrate that the proposed approach enables efficient restoration of imaging data. In addition, we demonstrate that the proposed approach outperforms the current state-of-the-art methods by evaluating the qualities of the denoising performance of the models quantitatively. Therefore, our method provides an invaluable tool for denoising two-photon Ca²⁺ imaging data by model blind spatiotemporal processing.

Intrinsic and Synaptic Properties Shaping Diverse Behaviors of Neural Dynamics

The majority of neurons in the neuronal system of the brain have a complex morphological structure, which diversifies the dynamics of neurons. In the granular layer of the cerebellum, there exists a unique cell type, the unipolar brush cell (UBC), that serves as an important relay cell for transferring information from outside mossy fibers to downstream granule cells. The distinguishing feature of the UBC is that it has a simple morphology, with only one short dendritic brush connected to its soma. Based on experimental evidence showing that UBCs exhibit a variety of dynamic behaviors, here we develop two simple models, one with a few detailed ion channels for simulation and the other one as a two-variable dynamical system for theoretical analysis, to characterize the intrinsic dynamics of UBCs. The reasonable values of the key channel parameters of the models can be determined by analysis of the stability of the resting membrane potential and the rebound firing properties of UBCs. Considered together with a large variety of synaptic dynamics installed on UBCs, we show that the simple-structured UBCs, as relay cells, can extend the range of dynamics and information from input mossy fibers to granule cells with low-frequency resonance and transfer stereotyped inputs to diverse amplitudes and phases of the output for downstream granule cells. These results suggest that neuronal computation, embedded within intrinsic ion channels and the diverse synaptic properties of single neurons without sophisticated morphology, can shape a large variety of dynamic behaviors to enhance the computational ability of local neuronal circuits.