Probing neural codes with two-photon holographic optogenetics

Linking brain activity across scales with simultaneous opto- and electrophysiology

The brain enables adaptive behavior via the dynamic coordination of diverse neuronal signals across spatial and temporal scales: from fast action potential patterns in microcircuits to slower patterns of distributed activity in brain-wide networks. Understanding principles of multiscale dynamics requires simultaneous monitoring of signals in multiple, distributed network nodes. Combining optical and electrical recordings of brain activity is promising for collecting data across multiple scales and can reveal aspects of coordinated dynamics invisible to standard, single-modality approaches. We review recent progress in combining opto- and electrophysiology, focusing on mouse studies that shed new light on the function of single neurons by embedding their activity in the context of brain-wide activity patterns. Optical and electrical readouts can be tailored to desired scales to tackle specific questions. For example, fast dynamics in single cells or local populations recorded with multi-electrode arrays can be related to simultaneously acquired optical signals that report activity in specified subpopulations of neurons, in non-neuronal cells, or in neuromodulatory pathways. Conversely, two-photon imaging can be used to densely monitor activity in local circuits while sampling electrical activity in distant brain areas at the same time. The refinement of combined approaches will continue to reveal previously inaccessible and under-appreciated aspects of coordinated brain activity.

Recent advances in light patterned optogenetic photostimulation in freely moving mice

Optogenetics opened the door to a new era of neuroscience. New optical developments are under way to enable high-resolution neuronal activity imaging and selective photostimulation of neuronal ensembles in freely moving animals. These advancements could allow researchers to interrogate, with cellular precision, functionally relevant neuronal circuits in the framework of naturalistic brain activity. We provide an overview of the current state-of-the-art of imaging and photostimulation in freely moving rodents and present a road map for future optical and engineering developments toward miniaturized microscopes that could reach beyond the currently existing systems.

Optogenetic Brain-Computer Interfaces

The brain-computer interface (BCI) is one of the most powerful tools in neuroscience and generally includes a recording system, a processor system, and a stimulation system. Optogenetics has the advantages of bidirectional regulation, high spatiotemporal resolution, and cell-specific regulation, which expands the application scenarios of BCIs. In recent years, optogenetic BCIs have become widely used in the lab with the development of materials and software. The systems were designed to be more integrated, lightweight, biocompatible, and power efficient, as were the wireless transmission and chip-level embedded BCIs. The software is also constantly improving, with better real-time performance and accuracy and lower power consumption. On the other hand, as a cutting-edge technology spanning multidisciplinary fields including molecular biology, neuroscience, material engineering, and information processing, optogenetic BCIs have great application potential in neural decoding, enhancing brain function, and treating neural diseases. Here, we review the development and application of optogenetic BCIs. In the future, combined with other functional imaging techniques such as near-infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI), optogenetic BCIs can modulate the function of specific circuits, facilitate neurological rehabilitation, assist perception, establish a brain-to-brain interface, and be applied in wider application scenarios.

Non-convex optimization for inverse problem solving in computer-generated holography

Computer-generated holography is a promising technique that modulates user-defined wavefronts with digital holograms. Computing appropriate holograms with faithful reconstructions is not only a problem closely related to the fundamental basis of holography but also a long-standing challenge for researchers in general fields of optics. Finding the exact solution of a desired hologram to reconstruct an accurate target object constitutes an ill-posed inverse problem. The general practice of single-diffraction computation for synthesizing holograms can only provide an approximate answer, which is subject to limitations in numerical implementation. Various non-convex optimization algorithms are thus designed to seek an optimal solution by introducing different constraints, frameworks, and initializations. Herein, we overview the optimization algorithms applied to computer-generated holography, incorporating principles of hologram synthesis based on alternative projections and gradient descent methods. This is aimed to provide an underlying basis for optimized hologram generation, as well as insights into the cutting-edge developments of this rapidly evolving field for potential applications in virtual reality, augmented reality, head-up display, data encryption, laser fabrication, and metasurface design.

Bridging model and experiment in systems neuroscience with Cleo: the Closed-Loop, Electrophysiology, and Optophysiology simulation testbed

Systems neuroscience has experienced an explosion of new tools for reading and writing neural activity, enabling exciting new experiments such as all-optical or closed-loop control that effect powerful causal interventions. At the same time, improved computational models are capable of reproducing behavior and neural activity with increasing fidelity. Unfortunately, these advances have drastically increased the complexity of integrating different lines of research, resulting in the missed opportunities and untapped potential of suboptimal experiments. Experiment simulation can help bridge this gap, allowing model and experiment to better inform each other by providing a low-cost testbed for experiment design, model validation, and methods engineering. Specifically, this can be achieved by incorporating the simulation of the experimental interface into our models, but no existing tool integrates optogenetics, two-photon calcium imaging, electrode recording, and flexible closed-loop processing with neural population simulations. To address this need, we have developed Cleo: the Closed-Loop, Electrophysiology, and Optophysiology experiment simulation testbed. Cleo is a Python package enabling injection of recording and stimulation devices as well as closed-loop control with realistic latency into a Brian spiking neural network model. It is the only publicly available tool currently supporting two-photon and multi-opsin/wavelength optogenetics. To facilitate adoption and extension by the community, Cleo is open-source, modular, tested, and documented, and can export results to various data formats. Here we describe the design and features of Cleo, validate output of individual components and integrated experiments, and demonstrate its utility for advancing optogenetic techniques in prospective experiments using previously published systems neuroscience models.

Closed-loop experiments and brain machine interfaces with multiphoton microscopy

In the field of neuroscience, the importance of constructing closed-loop experimental systems has increased in conjunction with technological advances in measuring and controlling neural activity in live animals. We provide an overview of recent technological advances in the field, focusing on closed-loop experimental systems where multiphoton microscopy-the only method capable of recording and controlling targeted population activity of neurons at a single-cell resolution in vivo-works through real-time feedback. Specifically, we present some examples of brain machine interfaces (BMIs) using in vivo two-photon calcium imaging and discuss applications of two-photon optogenetic stimulation and adaptive optics to real-time BMIs. We also consider conditions for realizing future optical BMIs at the synaptic level, and their possible roles in understanding the computational principles of the brain.

Rapid rebalancing of co-tuned ensemble activity in the auditory cortex

Sensory information is represented by small neuronal ensembles in sensory cortices. Neuronal activity shows high trial-by-trial variability in that repeated presentation of the same stimulus, e. g., multiple presentations of the same sound activate differing ensembles in the auditory cortex (AC). How the differing ensembles interact to selectively activate to process incoming sound inputs with reduced energy is unknown. Efficient processing of complex acoustic signals requires that these sparsely distributed neuronal ensembles actively interact in order to provide a constant percept. Here, we probe interactions within and across ensembles by combining in vivo 2-photon Ca2+ imaging and holographic optogenetic stimulation to study how increased activity of single cells level affects the cortical network. We stimulated a small number of neurons sharing the same frequency preference alongside the presentation of a target pure tone, further increasing their tone-evoked activity. We found that other non-stimulated co-tuned neurons decreased their tone-evoked activity while non co-tuned neurons were unaffected. This shows that co-tuned ensembles communicated and balanced their total activity across the network. The rebalanced activity due to external stimulation remained constant. These effects suggest that co-tuned ensembles in AC interact and rapidly rebalance their activity to maintain encoding homeostasis, and that the rebalanced network is persistent.

Implantable photonic neural probes with out-of-plane focusing grating emitters

We have designed, fabricated, and characterized implantable silicon neural probes with nanophotonic grating emitters that focus the emitted light at a specified distance above the surface of the probe for spatially precise optogenetic targeting of neurons. Using the holographic principle, we designed gratings for wavelengths of 488 and 594 nm, targeting the excitation spectra of the optogenetic actuators Channelrhodopsin-2 and Chrimson, respectively. The measured optical emission pattern of these emitters in non-scattering medium and tissue matched well with simulations. To our knowledge, this is the first report of focused spots with the size scale of a neuron soma in brain tissue formed from implantable neural probes.

Coexistence of state, choice, and sensory integration coding in barrel cortex LII/III

During perceptually guided decisions, correlates of choice are found as upstream as in the primary sensory areas. However, how well these choice signals align with early sensory representations, a prerequisite for their interpretation as feedforward substrates of perception, remains an open question. We designed a two alternative forced choice task (2AFC) in which male mice compared stimulation frequencies applied to two adjacent vibrissae. The optogenetic silencing of individual columns in the primary somatosensory cortex (wS1) resulted in predicted shifts of psychometric functions, demonstrating that perception depends on focal, early sensory representations. Functional imaging of layer II/III single neurons revealed mixed coding of stimuli, choices and engagement in the task. Neurons with multi-whisker suppression display improved sensory discrimination and had their activity increased during engagement in the task, enhancing selectively representation of the signals relevant to solving the task. From trial to trial, representation of stimuli and choice varied substantially, but mostly orthogonally to each other, suggesting that perceptual variability does not originate from wS1 fluctuations but rather from downstream areas. Together, our results highlight the role of primary sensory areas in forming a reliable sensory substrate that could be used for flexible downstream decision processes.

Nano-optogenetics for Disease Therapies

Optogenetic, known as the method of 21 centuries, combines optic and genetic engineering to precisely control photosensitive proteins for manipulation of a broad range of cellular functions, such as flux of ions, protein oligomerization and dissociation, cellular intercommunication, and so on. In this technique, light is conventionally delivered to targeted cells through optical fibers or micro light-emitting diodes, always suffering from high invasiveness, wide-field illumination facula, strong absorption, and scattering by nontargeted endogenous substance. Light-transducing nanomaterials with advantages of high spatiotemporal resolution, abundant wireless-excitation manners, and easy functionalization for recognition of specific cells, recently have been widely explored in the field of optogenetics; however, there remain a few challenges to restrain its clinical applications. This review summarized recent progress on light-responsive genetically encoded proteins and the myriad of activation strategies by use of light-transducing nanomaterials and their disease-treatment applications, which is expected for sparking helpful thought to push forward its preclinical and translational uses.

Correlations reveal the hierarchical organization of biological networks with latent variables

Deciphering the functional organization of large biological networks is a major challenge for current mathematical methods. A common approach is to decompose networks into largely independent functional modules, but inferring these modules and their organization from network activity is difficult, given the uncertainties and incompleteness of measurements. Typically, some parts of the overall functional organization, such as intermediate processing steps, are latent. We show that the hidden structure can be determined from the statistical moments of observable network components alone, as long as the functional relevance of the network components lies in their mean values and the mean of each latent variable maps onto a scaled expectation of a binary variable. Whether the function of biological networks permits a hierarchical modularization can be falsified by a correlation-based statistical test that we derive. We apply the test to gene regulatory networks, dendrites of pyramidal neurons, and networks of spiking neurons.

The mouse motor system contains multiple premotor areas and partially follows human organizational principles

While humans are known to have several premotor cortical areas, secondary motor cortex (M2) is often considered to be the only higher-order motor area of the mouse brain and is thought to combine properties of various human premotor cortices. Here, we show that axonal tracer, functional connectivity, myelin mapping, gene expression, and optogenetics data contradict this notion. Our analyses reveal three premotor areas in the mouse, anterior-lateral motor cortex (ALM), anterior-lateral M2 (aM2), and posterior-medial M2 (pM2), with distinct structural, functional, and behavioral properties. By using the same techniques across mice and humans, we show that ALM has strikingly similar functional and microstructural properties to human anterior ventral premotor areas and that aM2 and pM2 amalgamate properties of human pre-SMA and cingulate cortex. These results provide evidence for the existence of multiple premotor areas in the mouse and chart a comparative map between the motor systems of humans and mice.

An integrative view of the role of prefrontal cortex in consciousness

The involvement of the prefrontal cortex (PFC) in consciousness is an ongoing focus of intense investigation. An important question is whether representations of conscious contents and experiences in the PFC are confounded by post-perceptual processes related to cognitive functions. Here, I review recent findings suggesting that neuronal representations of consciously perceived contents-in the absence of post-perceptual processes-can indeed be observed in the PFC. Slower ongoing fluctuations in the electrophysiological state of the PFC seem to control the stability and updates of these prefrontal representations of conscious awareness. In addition to conscious perception, the PFC has been shown to play a critical role in controlling the levels of consciousness as observed during anesthesia, while prefrontal lesions can result in severe loss of perceptual awareness. Together, the convergence of these processes in the PFC suggests its integrative role in consciousness and highlights the complex nature of consciousness itself.

Removing crosstalk signals in neuron activity by time multiplexed excitations in a two-photon all-optical physiology system

The two-photon all-optical physiology system has attracted great interest in deciphering neuronal circuits in vivo, benefiting from its advantages in recording and modulating neuronal activities at single neuron resolutions. However, the interference, or crosstalk, between the imaging and photostimulation beams introduces a significant challenge and may impede the future application of voltage indicators in two-photon all-optical physiology system. Here, we propose the time multiplexed excitation method to distinguish signals from neuronal activities and crosstalks from photostimulation. In our system, the laser pulses of the imaging beam and photostimulation beam are synchronized, and a time delay is introduced into these pulses to separate the fluorescence signal generated by these two beams. We demonstrate the efficacy of our system in eliminating crosstalk signals from photostimulation and evaluate its influence on both genetically encoded calcium indicators (GECIs) and genetically encoded voltage indicators (GEVIs) through in vivo experiments.

In vivo imaging of the neuronal response to spinal cord injury: a narrative review

Deciphering the neuronal response to injury in the spinal cord is essential for exploring treatment strategies for spinal cord injury (SCI). However, this subject has been neglected in part because appropriate tools are lacking. Emerging in vivo imaging and labeling methods offer great potential for observing dynamic neural processes in the central nervous system in conditions of health and disease. This review first discusses in vivo imaging of the mouse spinal cord with a focus on the latest imaging techniques, and then analyzes the dynamic biological response of spinal cord sensory and motor neurons to SCI. We then summarize and compare the techniques behind these studies and clarify the advantages of in vivo imaging compared with traditional neuroscience examinations. Finally, we identify the challenges and possible solutions for spinal cord neuron imaging.

Multicolor two-photon light-patterning microscope exploiting the spatio-temporal properties of a fiber bundle

The development of efficient genetically encoded indicators and actuators has opened up the possibility of reading and manipulating neuronal activity in living tissues with light. To achieve precise and reconfigurable targeting of large numbers of neurons with single-cell resolution within arbitrary volumes, different groups have recently developed all-optical strategies based on two-photon excitation and spatio-temporal shaping of ultrashort laser pulses. However, such techniques are often complex to set up and typically operate at a single wavelength only. To address these issues, we have developed a novel optical approach that uses a fiber bundle and a spatial light modulator to achieve simple and dual-color two-photon light patterning in three dimensions. By leveraging the core-to-core temporal delay and the wavelength-independent divergence characteristics of fiber bundles, we have demonstrated the capacity to generate high-resolution excitation spots in a 3D region with two distinct laser wavelengths simultaneously, offering a suitable and simple alternative for precise multicolor cell targeting.

More than double the fun with two-photon excitation microscopy

For generations researchers have been observing the dynamic processes of life through the lens of a microscope. This has offered tremendous insights into biological phenomena that span multiple orders of time- and length-scales ranging from the pure magic of molecular reorganization at the membrane of immune cells, to cell migration and differentiation during development or wound healing. Standard fluorescence microscopy techniques offer glimpses at such processes in vitro, however, when applied in intact systems, they are challenged by reduced signal strengths and signal-to-noise ratios that result from deeper imaging. As a remedy, two-photon excitation (TPE) microscopy takes a special place, because it allows us to investigate processes in vivo, in their natural environment, even in a living animal. Here, we review the fundamental principles underlying TPE aimed at basic and advanced microscopy users interested in adopting TPE for intravital imaging. We focus on applications in neurobiology, present current trends towards faster, wider and deeper imaging, discuss the combination with photon counting technologies for metabolic imaging and spectroscopy, as well as highlight outstanding issues and drawbacks in development and application of these methodologies.

Shining Light in Mechanobiology: Optical Tweezers, Scissors, and Beyond

Mechanobiology helps us to decipher cell and tissue functions by looking at changes in their mechanical properties that contribute to development, cell differentiation, physiology, and disease. Mechanobiology sits at the interface of biology, physics and engineering. One of the key technologies that enables characterization of properties of cells and tissue is microscopy. Combining microscopy with other quantitative measurement techniques such as optical tweezers and scissors, gives a very powerful tool for unraveling the intricacies of mechanobiology enabling measurement of forces, torques and displacements at play. We review the field of some light based studies of mechanobiology and optical detection of signal transduction ranging from optical micromanipulation-optical tweezers and scissors, advanced fluorescence techniques and optogenentics. In the current perspective paper, we concentrate our efforts on elucidating interesting measurements of forces, torques, positions, viscoelastic properties, and optogenetics inside and outside a cell attained when using structured light in combination with optical tweezers and scissors. We give perspective on the field concentrating on the use of structured light in imaging in combination with tweezers and scissors pointing out how novel developments in quantum imaging in combination with tweezers and scissors can bring to this fast growing field.

Entangled brains and the experience of pains

The International Association for the Study of Pain (IASP) revised its definition of pain to "an unpleasant sensory and emotional experience." Three recent recommendations for understanding pain if there are no clear brain correlates include eliminativism, multiple realizability, and affordance-based approaches. I adumbrate a different path forward. Underlying each of the proposed approaches and the new IASP definition is the suspicion that there are no specific correlates for pain. I suggest that this basic assumption is misguided. As we learn more about brain function, it is becoming clear that many areas process many different types of information at the same time. In this study, I analogize how animal brains navigate in three-dimensional space with how the brain creates pain. Underlying both cases is a large-scale combinatorial system that feeds back on itself through a diversity of convergent and divergent bi-directional connections. Brains are not like combustion engines, with energy driving outputs via the structure of the machine, but are instead more like whirlpools, which are essentially dynamic patterns in some substrates. We should understand pain experiences as context-dependent, spatiotemporal trajectories that reflect heterogeneous, multiplex, and dynamically adaptive brain cells.

Biohybrid Photonic Platform for Subcellular Stimulation and Readout of In Vitro Neurons

Targeted manipulation of neural activity via light has become an indispensable tool for gaining insights into the intricate processes governing single neurons and complex neural networks. To shed light onto the underlying interaction mechanisms, it is crucial to achieve precise control of individual neural activity, as well as a spatial read-out resolution on the nanoscale. Here, a versatile photonic platform with subcellular resolution for stimulation and monitoring of in-vitro neurons is demonstrated. Low-loss photonic waveguides are fabricated on glass substrates using nanoimprint lithography and featuring a loss of only -0.9 ± 0.2 dB cm-1 at 489 nm and are combined with optical fiber-based waveguide-access and backside total internal reflection fluorescence microscopy. Neurons are grown on the bio-functionalized photonic chip surface and, expressing the light-sensitive ion channel Channelrhodopsin-2, are stimulated within the evanescent field penetration depth of 57 nm of the biocompatible waveguides. The versatility and cost-efficiency of the platform, along with the possible subcellular resolution, enable tailor-made investigations of neural interaction dynamics with defined spatial control and high throughput.

All-optical interrogation of millimeter-scale networks and application to developing ferret cortex

BACKGROUND

Perception and behavior require coordinated activity of thousands of neurons operating in networks that span millimeters of brain area. In vivo calcium imaging approaches have proven exceptionally powerful for examining the structure of these networks at large scales, and optogenetics can allow for causal manipulations of large populations of neurons. However, realizing the full potential of these techniques requires the ability to simultaneously measure and manipulate distinct circuit elements on the scale of millimeters.

NEW METHOD

We describe an opto-macroscope, an artifact-free, all-optical system capable of delivering patterned optogenetic stimulation with high spatial and temporal resolution across millimeters of brain while simultaneously imaging functional neural activity.

RESULTS

We find that this approach provides direct manipulation of cortical regions ranging from hundreds of microns to several millimeters in area, allowing for the perturbation of individual brain areas or networks of functional domains. Using this system we find that spatially complex endogenous networks in the developing ferret visual cortex can be readily reactivated by precisely designed patterned optogenetic stimuli.

COMPARISON WITH EXISTING METHODS

Our opto-macroscope extends current all-optical optogenetic approaches which operate on a cellular scale with multiphoton stimulation, and are poorly suited to investigate the millimeter-scale of many functional networks. It also builds upon other mesoscopic optogenetic techniques that lack simultaneous optical readouts of neural activity.

CONCLUSIONS

The large-scale all-optical capabilities of our system make it a powerful new tool for investigating the contribution of cortical domains and brain areas to the functional neural networks that underlie perception and behavior.

Holographic stimulation of opposing amygdala ensembles bidirectionally modulates valence-specific behavior via mutual inhibition

The basolateral amygdala (BLA) is an evolutionarily conserved brain region, well known for valence processing. Despite this central role, the relationship between activity of BLA neuronal ensembles in response to appetitive and aversive stimuli and the subsequent expression of valence-specific behavior has remained elusive. Here, we leverage two-photon calcium imaging combined with single-cell holographic photostimulation through an endoscopic lens to demonstrate a direct causal role for opposing ensembles of BLA neurons in the control of oppositely valenced behavior in mice. We report that targeted photostimulation of either appetitive or aversive BLA ensembles results in mutual inhibition and shifts behavioral responses to promote consumption of an aversive tastant or reduce consumption of an appetitive tastant, respectively. Here, we identify that neuronal encoding of valence in the BLA is graded and relies on the relative proportion of individual BLA neurons recruited in a stable appetitive or quinine ensemble.

From connectome to effectome: learning the causal interaction map of the fly brain

A long-standing goal of neuroscience is to obtain a causal model of the nervous system. This would allow neuroscientists to explain animal behavior in terms of the dynamic interactions between neurons. The recently reported whole-brain fly connectome [1-7] specifies the synaptic paths by which neurons can affect each other but not whether, or how, they do affect each other in vivo. To overcome this limitation, we introduce a novel combined experimental and statistical strategy for efficiently learning a causal model of the fly brain, which we refer to as the "effectome". Specifically, we propose an estimator for a dynamical systems model of the fly brain that uses stochastic optogenetic perturbation data to accurately estimate causal effects and the connectome as a prior to drastically improve estimation efficiency. We then analyze the connectome to propose circuits that have the greatest total effect on the dynamics of the fly nervous system. We discover that, fortunately, the dominant circuits significantly involve only relatively small populations of neurons-thus imaging, stimulation, and neuronal identification are feasible. Intriguingly, we find that this approach also re-discovers known circuits and generates testable hypotheses about their dynamics. Overall, our analyses of the connectome provide evidence that global dynamics of the fly brain are generated by a large collection of small and often anatomically localized circuits operating, largely, independently of each other. This in turn implies that a causal model of a brain, a principal goal of systems neuroscience, can be feasibly obtained in the fly.

Dynamic Multiplex Tissue Imaging in Inflammation Research

Inflammation is a highly dynamic process with immune cells that continuously interact with each other and parenchymal components as they migrate through tissue. The dynamic cellular responses and interaction patterns are a function of the complex tissue environment that cannot be fully reconstructed ex vivo, making it necessary to assess cell dynamics and changing spatial patterning in vivo. These dynamics often play out deep within tissues, requiring the optical focus to be placed far below the surface of an opaque organ. With the emergence of commercially available two-photon excitation lasers that can be combined with existing imaging systems, new avenues for imaging deep tissues over long periods of time have become available. We discuss a selected subset of studies illustrating how two-photon microscopy (2PM) has helped to relate the dynamics of immune cells to their in situ function and to understand the molecular patterns that govern their behavior in vivo. We also review some key practical aspects of 2PM methods and point out issues that can confound the results, so that readers can better evaluate the reliability of conclusions drawn using this technology.

All-optical interrogation of brain-wide activity in freely swimming larval zebrafish

We introduce an all-optical technique that enables volumetric imaging of brain-wide calcium activity and targeted optogenetic stimulation of specific brain regions in unrestrained larval zebrafish. The system consists of three main components: a 3D tracking module, a dual-color fluorescence imaging module, and a real-time activity manipulation module. Our approach uses a sensitive genetically encoded calcium indicator in combination with a long Stokes shift red fluorescence protein as a reference channel, allowing the extraction of Ca2+ activity from signals contaminated by motion artifacts. The method also incorporates rapid 3D image reconstruction and registration, facilitating real-time selective optogenetic stimulation of different regions of the brain. By demonstrating that selective light activation of the midbrain regions in larval zebrafish could reliably trigger biased turning behavior and changes of brain-wide neural activity, we present a valuable tool for investigating the causal relationship between distributed neural circuit dynamics and naturalistic behavior.

Neural circuit models for evidence accumulation through choice-selective sequences

Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.

Three-Photon Infrared Stimulation of Endogenous Neuroreceptors in Vivo

To interrogate neural circuits and crack their codes, in vivo brain activity imaging must be combined with spatiotemporally precise stimulation in three dimensions using genetic or pharmacological specificity. This challenge requires deep penetration and focusing as provided by infrared light and multiphoton excitation, and has promoted two-photon photopharmacology and optogenetics. However, three-photon brain stimulation in vivo remains to be demonstrated. We report the regulation of neuronal activity in zebrafish larvae by three-photon excitation of a photoswitchable muscarinic agonist at 50 pM, a billion-fold lower concentration than used for uncaging, and with mid-infrared light of 1560 nm, the longest reported photoswitch wavelength. Robust, physiologically relevant photoresponses allow modulating brain activity in wild-type animals with spatiotemporal and pharmacological precision. Computational calculations predict that azobenzene-based ligands have high three-photon absorption cross-section and can be used directly with pulsed infrared light. The expansion of three-photon pharmacology will deeply impact basic neurobiology and neuromodulation phototherapies.

Approaches and considerations of studying neuronal ensembles: a brief review

First theorized by Hebb, neuronal ensembles have provided a framework for understanding how the mammalian brain operates, especially regarding learning and memory. Neuronal ensembles are discrete, sparsely distributed groups of neurons that become activated in response to a specific stimulus and are thought to provide an internal representation of the world. Beyond the study of region-wide or projection-wide activation, the study of ensembles offers increased specificity and resolution to identify and target specific memories or associations. Neuroscientists interested in the neurobiology of learning, memory, and motivated behavior have used electrophysiological-, calcium-, and protein-based proxies of neuronal activity in preclinical models to better understand the neurobiology of learned and motivated behaviors. Although these three approaches may be used to pursue the same general goal of studying neuronal ensembles, technical differences lead to inconsistencies in the output and interpretation of data. This mini-review highlights some of the methodologies used in electrophysiological-, calcium-, and protein-based studies of neuronal ensembles and discusses their strengths and weaknesses.

Descanned fast light targeting (deFLiT) two-photon optogenetics

Two-photon light-targeting optogenetics allows controlling selected subsets of neurons with near single-cell resolution and high temporal precision. To push forward this approach, we recently proposed a fast light-targeting strategy (FLiT) to rapidly scan multiple holograms tiled on a spatial light modulator (SLM). This allowed generating sub-ms timely-controlled switch of light patterns enabling to reduce the power budget for multi-target excitation and increase the temporal precision for relative spike tuning in a circuit. Here, we modified the optical design of FLiT by including a de-scan unit (deFLiT) to keep the holographic illumination centered at the middle of the objective pupil independently of the position of the tiled hologram on the SLM. This enables enlarging the number of usable holograms and reaching extended on-axis excitation volumes, and therefore increasing even further the power gain and temporal precision of conventional FLiT.

A micro-LED array based platform for spatio-temporal optogenetic control of various cardiac models

Optogenetics relies on dynamic spatial and temporal control of light to address emerging fundamental and therapeutic questions in cardiac research. In this work, a compact micro-LED array, consisting of 16 × 16 pixels, is incorporated in a widefield fluorescence microscope for controlled light stimulation. We describe the optical design of the system that allows the micro-LED array to fully cover the field of view regardless of the imaging objective used. Various multicellular cardiac models are used in the experiments such as channelrhodopsin-2 expressing aggregates of cardiomyocytes, termed cardiac bodies, and bioartificial cardiac tissues derived from human induced pluripotent stem cells. The pacing efficiencies of the cardiac bodies and bioartificial cardiac tissues were characterized as a function of illumination time, number of switched-on pixels and frequency of stimulation. To demonstrate dynamic stimulation, steering of calcium waves in HL-1 cell monolayer expressing channelrhodopsin-2 was performed by applying different configurations of patterned light. This work shows that micro-LED arrays are powerful light sources for optogenetic control of contraction and calcium waves in cardiac monolayers, multicellular bodies as well as three-dimensional artificial cardiac tissues.

Bayesian target optimisation for high-precision holographic optogenetics

Two-photon optogenetics has transformed our ability to probe the structure and function of neural circuits. However, achieving precise optogenetic control of neural ensemble activity has remained fundamentally constrained by the problem of off-target stimulation (OTS): the inadvertent activation of nearby non-target neurons due to imperfect confinement of light onto target neurons. Here we propose a novel computational approach to this problem called Bayesian target optimisation. Our approach uses nonparametric Bayesian inference to model neural responses to optogenetic stimulation, and then optimises the laser powers and optical target locations needed to achieve a desired activity pattern with minimal OTS. We validate our approach in simulations and using data from in vitro experiments, showing that Bayesian target optimisation considerably reduces OTS across all conditions we test. Together, these results establish our ability to overcome OTS, enabling optogenetic stimulation with substantially improved precision.

Fast non-iterative algorithm for 3D point-cloud holography

Recently developed iterative and deep learning-based approaches to computer-generated holography (CGH) have been shown to achieve high-quality photorealistic 3D images with spatial light modulators. However, such approaches remain overly cumbersome for patterning sparse collections of target points across a photoresponsive volume in applications including biological microscopy and material processing. Specifically, in addition to requiring heavy computation that cannot accommodate real-time operation in mobile or hardware-light settings, existing sampling-dependent 3D CGH methods preclude the ability to place target points with arbitrary precision, limiting accessible depths to a handful of planes. Accordingly, we present a non-iterative point cloud holography algorithm that employs fast deterministic calculations in order to efficiently allocate patches of SLM pixels to different target points in the 3D volume and spread the patterning of all points across multiple time frames. Compared to a matched-performance implementation of the iterative Gerchberg-Saxton algorithm, our algorithm's relative computation speed advantage was found to increase with SLM pixel count, reaching >100,000x at 512 × 512 array format.

Sparse and distributed cortical populations mediate sensorimotor integration

Touch information is central to sensorimotor integration, yet little is known about how cortical touch and movement representations interact. Touch- and movement-related activity is present in both somatosensory and motor cortices, making both candidate sites for touch-motor interactions. We studied touch-motor interactions in layer 2/3 of the primary vibrissal somatosensory and motor cortices of behaving mice. Volumetric two-photon calcium imaging revealed robust responses to whisker touch, whisking, and licking in both areas. Touch activity was dominated by a sparse population of broadly tuned neurons responsive to multiple whiskers that exhibited longitudinal stability and disproportionately influenced interareal communication. Movement representations were similarly dominated by sparse, stable, reciprocally projecting populations. In both areas, many broadly tuned touch cells also produced robust licking or whisking responses. These touch-licking and touch-whisking neurons showed distinct dynamics suggestive of specific roles in shaping movement. Cortical touch-motor interactions are thus mediated by specialized populations of highly responsive, broadly tuned neurons.

All-optical recreation of naturalistic neural activity with a multifunctional transgenic reporter mouse

Determining which features of the neural code drive behavior requires the ability to simultaneously read out and write in neural activity patterns with high precision across many neurons. All-optical systems that combine two-photon calcium imaging and targeted photostimulation enable the activation of specific, functionally defined groups of neurons. However, these techniques are unable to test how patterns of activity across a population contribute to computation because of an inability to both read and write cell-specific firing rates. To overcome this challenge, we make two advances: first, we introduce a genetic line of mice for Cre-dependent co-expression of a calcium indicator and a potent soma-targeted microbial opsin. Second, using this line, we develop a method for read-out and write-in of precise population vectors of neural activity by calibrating the photostimulation to each cell. These advances offer a powerful and convenient platform for investigating the neural codes of computation and behavior.

Color multilayer holographic near-eye augmented reality display

This study demonstrates a full-color near-eye holographic display capable of superimposing color virtual scenes with 2D, 3D, and multiple objects with extended depth upon a real scene, which also has the ability to present different 3D information depending on the focus of the user's eyes using a single computer-generated hologram per color channel. Our setup makes use of a hologram generation method based on two-step propagation and the singular value decomposition of the Fresnel transform impulse response function to efficiently generate the holograms of the target scene. Then, we test our proposal by implementing a holographic display that makes use of a phase-only spatial light modulator and time-division multiplexing for color reproduction. We demonstrate the superior quality and computation speed of this approach compared with other hologram generation techniques with both numerical and experimental results.

Behavioral optogenetics in nonhuman primates; a psychological perspective

Optogenetics has been a promising and developing technology in systems neuroscience throughout the past decade. It has been difficult though to reliably establish the potential behavioral effects of optogenetic perturbation of the neural activity in nonhuman primates. This poses a challenge on the future of optogenetics in humans as the concepts and technology need to be developed in nonhuman primates first. Here, I briefly summarize the viable approaches taken to improve nonhuman primate behavioral optogenetics, then focus on one approach: improvements in the measurement of behavior. I bring examples from visual behavior and show how the choice of method of measurement might conceal large behavioral effects. I will then discuss the "cortical perturbation detection" task in detail as an example of a sensitive task that can record the behavioral effects of optogenetic cortical stimulation with high fidelity. Finally, encouraged by the rich scientific landscape ahead of behavioral optogenetics, I invite technology developers to improve the chronically implantable devices designed for simultaneous neural recording and optogenetic intervention in nonhuman primates.

Whole-brain mapping of effective connectivity by fMRI with cortex-wide patterned optogenetics

Functional magnetic resonance imaging (fMRI) with optogenetic neural manipulation is a powerful tool that enables brain-wide mapping of effective functional networks. To achieve flexible manipulation of neural excitation throughout the mouse cortex, we incorporated spatiotemporal programmable optogenetic stimuli generated by a digital micromirror device into an MRI scanner via an optical fiber bundle. This approach offered versatility in space and time in planning the photostimulation pattern, combined with in situ optical imaging and cell-type-specific or circuit-specific genetic targeting in individual mice. Brain-wide effective connectivity obtained by fMRI with optogenetic stimulation of atlas-based cortical regions is generally congruent with anatomically defined axonal tracing data but is affected by the types of anesthetics that act selectively on specific connections. fMRI combined with flexible optogenetics opens a new path to investigate dynamic changes in functional brain states in the same animal through high-throughput brain-wide effective connectivity mapping.

Optogenetics in primate cortical networks

The implementation of optogenetics in studies on non-human primates has generally proven quite difficult, but recent successes have paved the way for its rapid increase. Limitations in the genetic tractability in primates, have been somewhat overcome by implementing tailored vectors and promoters to maximize expression and specificity in primates. More recently, implantable devices, including microLED arrays, have made it possible to deliver light deeper into brain tissue, allowing targeting of deeper structures. However, the greatest limitation in applying optogenetics to the primate brain is the complex connections that exist within many neural circuits. In the past, relatively cruder methods such as cooling or pharmacological blockade have been used to examine neural circuit functions, though their limitations were well recognized. In some ways, similar shortcomings remain for optogenetics, with the ability to target a single component of complex neural circuits being the greatest challenge in applying optogenetics to systems neuroscience in primate brains. Despite this, some recent approaches combining Cre-expressing and Cre-dependent vectors have overcome some of these limitations. Here we suggest that optogenetics provides its greatest advantage to systems neuroscientists when applied as a specific tool to complement the techniques of the past, rather than necessarily replacing them.

Probing inter-areal computations with a cellular resolution two-photon holographic mesoscope

Brain computation depends on intricately connected yet highly distributed neural networks. Due to the absence of the requisite technologies, causally testing fundamental hypotheses on the nature of inter-areal processing have remained largely out-of-each. Here we developed the first two photon holographic mesoscope, a system capable of simultaneously reading and writing neural activity patterns with single cell resolution across large regions of the brain. We demonstrate the precise photo-activation of spatial and temporal sequences of neurons in one brain area while reading out the downstream effect in several other regions. Investigators can use this new platform to understand feed-forward and feed-back processing in distributed neural circuits with single cell precision for the first time.

Resolving the prefrontal mechanisms of adaptive cognitive behaviors: A cross-species perspective

The prefrontal cortex (PFC) enables a staggering variety of complex behaviors, such as planning actions, solving problems, and adapting to new situations according to external information and internal states. These higher-order abilities, collectively defined as adaptive cognitive behavior, require cellular ensembles that coordinate the tradeoff between the stability and flexibility of neural representations. While the mechanisms underlying the function of cellular ensembles are still unclear, recent experimental and theoretical studies suggest that temporal coordination dynamically binds prefrontal neurons into functional ensembles. A so far largely separate stream of research has investigated the prefrontal efferent and afferent connectivity. These two research streams have recently converged on the hypothesis that prefrontal connectivity patterns influence ensemble formation and the function of neurons within ensembles. Here, we propose a unitary concept that, leveraging a cross-species definition of prefrontal regions, explains how prefrontal ensembles adaptively regulate and efficiently coordinate multiple processes in distinct cognitive behaviors.

Optogenetic termination of atrial tachyarrhythmias by brief pulsed light stimulation

AIMS

The most efficient way to acutely restore sinus rhythm from atrial fibrillation (AF) is electrical cardioversion, which is painful without adequate sedation. Recent studies in various experimental models have indicated that optogenetic termination of AF using light-gated ion channels may provide a myocardium-specific and potentially painless alternative future therapy. However, its underlying mechanism(s) remain(s) incompletely understood. As brief pulsed light stimulation, even without global illumination, can achieve optogenetic AF termination, besides direct conduction block also modulation of action potential (AP) properties may be involved in the termination mechanism. We studied the relationship between optogenetic AP duration (APD) and effective refractory period (ERP) prolongation by brief pulsed light stimulation and termination of atrial tachyarrhythmia (AT).

METHODS AND RESULTS

Hearts from transgenic mice expressing the H134R variant of channelrhodopsin-2 in atrial myocytes were explanted and perfused retrogradely. AT induced by electrical stimulation was terminated by brief pulsed blue light stimulation (470 nm, 10 ms, 16 mW/mm²) with 68% efficacy. The termination rate was dependent on pulse duration and light intensity. Optogenetically imposed APD and ERP changes were systematically examined and optically monitored. Brief pulsed light stimulation (10 ms, 6 mW/mm²) consistently prolonged APD and ERP when light was applied at different phases of the cardiac action potential. Optical tracing showed light-induced APD prolongation during the termination of AT.

CONCLUSION

Our results directly demonstrate that cationic channelrhodopsin activation by brief pulsed light stimulation prolongs the atrial refractory period suggesting that this is one of the key mechanisms of optogenetic termination of AT.

Modular-designed engineered bacteria for precision tumor immunotherapy via spatiotemporal manipulation by magnetic field

Micro-nano biorobots based on bacteria have demonstrated great potential for tumor diagnosis and treatment. The bacterial gene expression and drug release should be spatiotemporally controlled to avoid drug release in healthy tissues and undesired toxicity. Herein, we describe an alternating magnetic field-manipulated tumor-homing bacteria developed by genetically modifying engineered Escherichia coli with Fe₃O₄@lipid nanocomposites. After accumulating in orthotopic colon tumors in female mice, the paramagnetic Fe₃O₄ nanoparticles enable the engineered bacteria to receive and convert magnetic signals into heat, thereby initiating expression of lysis proteins under the control of a heat-sensitive promoter. The engineered bacteria then lyse, releasing its anti-CD47 nanobody cargo, that is pre-expressed and within the bacteria. The robust immunogenicity of bacterial lysate cooperates with anti-CD47 nanobody to activate both innate and adaptive immune responses, generating robust antitumor effects against not only orthotopic colon tumors but also distal tumors in female mice. The magnetically engineered bacteria also enable the constant magnetic field-controlled motion for enhanced tumor targeting and increased therapeutic efficacy. Thus, the gene expression and drug release behavior of tumor-homing bacteria can be spatiotemporally manipulated in vivo by a magnetic field, achieving tumor-specific CD47 blockage and precision tumor immunotherapy.

Bicistronic Expression of a High-Performance Calcium Indicator and Opsin for All-Optical Stimulation and Imaging at Cellular Resolution

State-of-the-art all-optical systems promise unprecedented access to neural activity in vivo, using multiphoton optogenetics to allow simultaneous imaging and control of activity in selected neurons at cellular resolution. However, to achieve wide use of all-optical stimulation and imaging, simple strategies are needed to robustly and stably express opsins and indicators in the same cells. Here, we describe a bicistronic adeno-associated virus (AAV) that expresses both the fast and bright calcium indicator jGCaMP8s, and a soma-targeted (st) and two-photon-activatable opsin, ChrimsonR. With this method, stChrimsonR stimulation with two-photon holography in the visual cortex of mice drives robust spiking in targeted cells, and neural responses to visual sensory stimuli and spontaneous activity are strong and stable. Cells expressing this bicistronic construct show responses to both photostimulation and visual stimulation that are similar to responses measured from cells expressing the same opsin and indicator via separate viruses. This approach is a simple and robust way to prepare neurons in vivo for two-photon holography and imaging.

Physiological Needs: Sensations and Predictions in the Insular Cortex

Physiological needs create powerful motivations (e.g., thirst and hunger). Studies in humans and animal models have implicated the insular cortex in the neural regulation of physiological needs and need-driven behavior. We review prominent mechanistic models of how the insular cortex might achieve this regulation and present a conceptual and analytical framework for testing these models in healthy and pathological conditions.

A flexible two-photon fiberscope for fast activity imaging and precise optogenetic photostimulation of neurons in freely moving mice

We developed a flexible two-photon microendoscope (2P-FENDO) capable of all-optical brain investigation at near cellular resolution in freely moving mice. The system performs fast two-photon (2P) functional imaging and 2P holographic photostimulation of single and multiple cells using axially confined extended spots. Proof-of-principle experiments were performed in freely moving mice co-expressing jGCaMP7s and the opsin ChRmine in the visual or barrel cortex. On a field of view of 250 μm in diameter, we demonstrated functional imaging at a frame rate of up to 50 Hz and precise photostimulation of selected groups of cells. With the capability to simultaneously image and control defined neuronal networks in freely moving animals, 2P-FENDO will enable a precise investigation of neuronal functions in the brain during naturalistic behaviors.

Consciousness: Matter or EMF?

Conventional theories of consciousness (ToCs) that assume that the substrate of consciousness is the brain's neuronal matter fail to account for fundamental features of consciousness, such as the binding problem. Field ToC's propose that the substrate of consciousness is the brain's best accounted by some kind of field in the brain. Electromagnetic (EM) ToCs propose that the conscious field is the brain's well-known EM field. EM-ToCs were first proposed only around 20 years ago primarily to account for the experimental discovery that synchronous neuronal firing was the strongest neural correlate of consciousness (NCC). Although EM-ToCs are gaining increasing support, they remain controversial and are often ignored by neurobiologists and philosophers and passed over in most published reviews of consciousness. In this review I examine EM-ToCs against established criteria for distinguishing between ToCs and demonstrate that they outperform all conventional ToCs and provide novel insights into the nature of consciousness as well as a feasible route toward building artificial consciousnesses.

SCN1A channelopathies: Navigating from genotype to neural circuit dysfunction

The SCN1A gene is strongly associated with epilepsy and plays a central role for supporting cortical excitation-inhibition balance through the expression of Na_V1.1 within inhibitory interneurons. The phenotype of SCN1A disorders has been conceptualized as driven primarily by impaired interneuron function that predisposes to disinhibition and cortical hyperexcitability. However, recent studies have identified SCN1A gain-of-function variants associated with epilepsy, and the presence of cellular and synaptic changes in mouse models that point toward homeostatic adaptations and complex network remodeling. These findings highlight the need to understand microcircuit-scale dysfunction in SCN1A disorders to contextualize genetic and cellular disease mechanisms. Targeting the restoration of microcircuit properties may be a fruitful strategy for the development of novel therapies.

Emerging approaches for decoding neuropeptide transmission

Neuropeptides produce robust effects on behavior across species, and recent research has benefited from advances in high-resolution techniques to investigate peptidergic transmission and expression throughout the brain in model systems. Neuropeptides exhibit distinct characteristics which includes their post-translational processing, release from dense core vesicles, and ability to activate G-protein-coupled receptors (GPCRs). These complex properties have driven the need for development of specialized tools that can sense neuropeptide expression, cell activity, and release. Current research has focused on isolating when and how neuropeptide transmission occurs, as well as the conditions in which neuropeptides directly mediate physiological and adaptive behavioral states. Here we describe the current technological landscape in which the field is operating to decode key questions regarding these dynamic neuromodulators.

A kinetic-optimized CoChR variant with enhanced high-frequency spiking fidelity

Channelrhodopsins are a promising toolset for noninvasive optical manipulation of genetically identifiable neuron populations. Existing channelrhodopsins have generally suffered from a trade-off between two desired properties: fast channel kinetics and large photocurrent. Such a trade-off hinders spatiotemporally precise optogenetic activation during both one-photon and two-photon photostimulation. Furthermore, the simultaneous use of spectrally separated genetically encoded indicators and channelrhodopsins has generally suffered from non-negligible crosstalk in photocurrent or fluorescence. These limitations have hindered crosstalk-free dual-channel experiments needed to establish relationships between multiple neural populations. Recent large-scale transcriptome sequencing revealed one potent optogenetic actuator, the channelrhodopsin from species Chloromonas oogama (CoChR), which possessed high cyan light-driven photocurrent but slow channel kinetics. We rationally designed and engineered a kinetic-optimized CoChR variant that was faster than native CoChR while maintaining large photocurrent amplitude. When expressed in cultured hippocampal pyramidal neurons, our CoChR variant improved high-frequency spiking fidelity under one-photon illumination. Our CoChR variant's blue-shifted excitation spectrum enabled simultaneous cyan photostimulation and red calcium imaging with negligible photocurrent crosstalk.

Cell image reconstruction using digital holography with an improved GS algorithm

Digital holography is an effective technology in image reconstruction as amplitude and phase information of cells can be acquired without any staining. In this paper, we propose a holographic technique with an improved Gerchberg-Saxton (GS) algorithm to reconstruct cell imaging based on phase reconstruction information. Comparative experiments are conducted on four specific models to investigate the effectiveness of the proposed method. The morphological parameters (such as shape, volume, and sphericity) of abnormal erythrocytes can be obtained by reconstructing cell hologram of urinary sediment. Notably, abnormal red blood cells can also be detected in mussy circumstances by the proposed method, owing to the significantly biophysical contrast (refractive index distribution and mass density) between two different cells. Therefore, this proposed method has a broad application prospect in cell image reconstruction and cell dynamic detection.