Zebrafish capable of generating future state prediction error show improved active avoidance behavior in virtual reality

Adult zebrafish can learn Morris water maze-like tasks in a two-dimensional virtual reality system

Virtual reality (VR) has emerged as a powerful tool for investigating neural mechanisms of decision-making, spatial cognition, and navigation. In many head-fixed VRs for rodents, animals locomote on spherical treadmills that provide rotation information in two axes to calculate two-dimensional (2D) movement. On the other hand, zebrafish in a submerged head-fixed VR can move their tail to enable movement in 2D VR environment. This motivated us to create a VR system for adult zebrafish to enable 2D movement consisting of forward translation and rotations calculated from tail movement. Besides presenting the VR system, we show that zebrafish can learn a virtual Morris water maze-like (VMWM) task in which finding an invisible safe zone was necessary for the zebrafish to avoid an aversive periodic mild electric shock. Results show high potential for our VR system to be combined with optical imaging for future studies to investigate spatial learning and navigation.

EVIDENCE FOR AUDITORY STIMULUS-SPECIFIC ADAPTATION BUT NOT DEVIANCE DETECTION IN LARVAL ZEBRAFISH BRAINS

Animals receive a constant stream of sensory input, and detecting changes in this sensory landscape is critical to their survival. One signature of change detection in humans is the auditory mismatch negativity (MMN), a neural response to unexpected stimuli that deviate from a predictable sequence. This process requires the auditory system to adapt to specific repeated stimuli while remaining sensitive to novel input (stimulus-specific adaptation). MMN was originally described in humans, and equivalent responses have been found in other mammals and birds, but it is not known to what extent this deviance detection circuitry is evolutionarily conserved. Here we present the first evidence for stimulus-specific adaptation in the brain of a teleost fish, using whole-brain calcium imaging of larval zebrafish at single-neuron resolution with selective plane illumination microscopy. We found frequency-specific responses across the brain with variable response amplitudes for frequencies of the same volume, and created a loudness curve to model this effect. We presented an auditory 'oddball' stimulus in an otherwise predictable train of pure tone stimuli, and did not find a population of neurons with specific responses to deviant tones that were not otherwise explained by stimulus-specific adaptation. Further, we observed no deviance responses to an unexpected omission of a sound in a repetitive sequence of white noise bursts. These findings extend the known scope of auditory adaptation and deviance responses across the evolutionary tree, and lay groundwork for future studies to describe the circuitry underlying auditory adaptation at the level of individual neurons.

Transgenic tools targeting the basal ganglia reveal both evolutionary conservation and specialization of neural circuits in zebrafish

The cortico-basal ganglia circuit mediates decision making. Here, we generated transgenic tools for adult zebrafish targeting specific subpopulations of the components of this circuit and utilized them to identify evolutionary homologs of the mammalian direct- and indirect-pathway striatal neurons, which respectively project to the homologs of the internal and external segment of the globus pallidus (dorsal entopeduncular nucleus [dEN] and lateral nucleus of the ventral telencephalic area [Vl]) as in mammals. Unlike in mammals, the Vl mainly projects to the dEN directly, not by way of the subthalamic nucleus. Further single-cell RNA sequencing analysis reveals two pallidal output pathways: a major shortcut pathway directly connecting the dEN with the pallium and the evolutionarily conserved closed loop by way of the thalamus. Our resources and circuit map provide the common basis for the functional study of the basal ganglia in a small and optically tractable zebrafish brain for the comprehensive mechanistic understanding of the cortico-basal ganglia circuit.

Diving into the zebrafish brain: exploring neuroscience frontiers with genetic tools, imaging techniques, and behavioral insights

The zebrafish (Danio rerio) is increasingly used in neuroscience research. Zebrafish are relatively easy to maintain, and their high fecundity makes them suitable for high-throughput experiments. Their small, transparent embryos and larvae allow for easy microscopic imaging of the developing brain. Zebrafish also share a high degree of genetic similarity with humans, and are amenable to genetic manipulation techniques, such as gene knockdown, knockout, or knock-in, which allows researchers to study the role of specific genes relevant to human brain development, function, and disease. Zebrafish can also serve as a model for behavioral studies, including locomotion, learning, and social interactions. In this review, we present state-of-the-art methods to study the brain function in zebrafish, including genetic tools for labeling single neurons and neuronal circuits, live imaging of neural activity, synaptic dynamics and protein interactions in the zebrafish brain, optogenetic manipulation, and the use of virtual reality technology for behavioral testing. We highlight the potential of zebrafish for neuroscience research, especially regarding brain development, neuronal circuits, and genetic-based disorders and discuss its certain limitations as a model.

Whole-brain neural substrates of behavioral variability in the larval zebrafish

Animals engaged in naturalistic behavior can exhibit a large degree of behavioral variability even under sensory invariant conditions. Such behavioral variability can include not only variations of the same behavior, but also variability across qualitatively different behaviors driven by divergent cognitive states, such as fight-or-flight decisions. However, the neural circuit mechanisms that generate such divergent behaviors across trials are not well understood. To investigate this question, here we studied the visual-evoked responses of larval zebrafish to moving objects of various sizes, which we found exhibited highly variable and divergent responses across repetitions of the same stimulus. Given that the neuronal circuits underlying such behaviors span sensory, motor, and other brain areas, we built a novel Fourier light field microscope which enables high-resolution, whole-brain imaging of larval zebrafish during behavior. This enabled us to screen for neural loci which exhibited activity patterns correlated with behavioral variability. We found that despite the highly variable activity of single neurons, visual stimuli were robustly encoded at the population level, and the visual-encoding dimensions of neural activity did not explain behavioral variability. This robustness despite apparent single neuron variability was due to the multi-dimensional geometry of the neuronal population dynamics: almost all neural dimensions that were variable across individual trials, i.e. the "noise" modes, were orthogonal to those encoding for sensory information. Investigating this neuronal variability further, we identified two sparsely-distributed, brain-wide neuronal populations whose pre-motor activity predicted whether the larva would respond to a stimulus and, if so, which direction it would turn on a single-trial level. These populations predicted single-trial behavior seconds before stimulus onset, indicating they encoded time-varying internal modulating behavior, perhaps organizing behavior over longer timescales or enabling flexible behavior routines dependent on the animal's internal state. Our results provide the first whole-brain confirmation that sensory, motor, and internal variables are encoded in a highly mixed fashion throughout the brain and demonstrate that de-mixing each of these components at the neuronal population level is critical to understanding the mechanisms underlying the brain's remarkable flexibility and robustness.

Predictive neural computations in the cerebellum contribute to motor planning and faster behavioral responses in larval zebrafish

The ability to predict the future based on past experience lies at the core of the brain's ability to adapt behavior. However, the neural mechanisms that participate in generating and updating predictions are not clearly understood. Further, the evolutionary antecedents and the prevalence of predictive processing among vertebrates are even less explored. Here, we show evidence of predictive processing via the involvement of cerebellar circuits in larval zebrafish. We presented stereotyped optic flow stimuli to larval zebrafish to evoke swims and discovered that lesioning the cerebellum abolished prediction-dependent modulation of swim latency. When expectations of optic flow direction did not match with reality, error signals arrive at Purkinje cells via the olivary climbing fibers, whereas granule cells and Purkinje cells encode signals of expectation. Strong neural representations of expectation correlate with faster swim responses and vice versa. In sum, our results show evidence for predictive processing in nonmammalian vertebrates with the involvement of cerebellum, an evolutionarily conserved brain structure.

Pose analysis in free-swimming adult zebrafish, Danio rerio : "fishy" origins of movement design

Movement requires maneuvers that generate thrust to either make turns or move the body forward in physical space. The computational space for perpetually controlling the relative position of every point on the body surface can be vast. We hypothesize the evolution of efficient design for movement that minimizes active (neural) control by leveraging the passive (reactive) forces between the body and the surrounding medium at play. To test our hypothesis, we investigate the presence of stereotypical postures during free-swimming in adult zebrafish, Danio rerio . We perform markerless tracking using DeepLabCut, a deep learning pose estimation toolkit, to track geometric relationships between body parts. To identify putative clusters of postural configurations obtained from twelve freely behaving zebrafish, we use unsupervised multivariate time-series analysis (B-SOiD machine learning software). When applied to single individuals, this method reveals a best-fit for 36 to 50 clusters in contrast 86 clusters for data pooled from all 12 animals. The centroids of each cluster obtained over 14,000 sequential frames recorded for a single fish represent an apriori classification into relatively stable "target body postures" and inter-pose "transitional postures" that lead to and away from a target pose. We use multidimensional scaling of mean parameter values for each cluster to map cluster-centroids within two dimensions of postural space. From a post-priori visual analysis, we condense neighboring postural variants into 15 superclusters or core body configurations. We develop a nomenclature specifying the anteroposterior level/s (upper, mid and lower) and degree of bending. Our results suggest that constraining bends to mainly three levels in adult zebrafish preempts the neck, fore- and hindlimb design for maneuverability in land vertebrates.

Experimental validation of the free-energy principle with in vitro neural networks

Empirical applications of the free-energy principle are not straightforward because they entail a commitment to a particular process theory, especially at the cellular and synaptic levels. Using a recently established reverse engineering technique, we confirm the quantitative predictions of the free-energy principle using in vitro networks of rat cortical neurons that perform causal inference. Upon receiving electrical stimuli-generated by mixing two hidden sources-neurons self-organised to selectively encode the two sources. Pharmacological up- and downregulation of network excitability disrupted the ensuing inference, consistent with changes in prior beliefs about hidden sources. As predicted, changes in effective synaptic connectivity reduced variational free energy, where the connection strengths encoded parameters of the generative model. In short, we show that variational free energy minimisation can quantitatively predict the self-organisation of neuronal networks, in terms of their responses and plasticity. These results demonstrate the applicability of the free-energy principle to in vitro neural networks and establish its predictive validity in this setting.

Whole-brain imaging of freely-moving zebrafish

One of the holy grails of neuroscience is to record the activity of every neuron in the brain while an animal moves freely and performs complex behavioral tasks. While important steps forward have been taken recently in large-scale neural recording in rodent models, single neuron resolution across the entire mammalian brain remains elusive. In contrast the larval zebrafish offers great promise in this regard. Zebrafish are a vertebrate model with substantial homology to the mammalian brain, but their transparency allows whole-brain recordings of genetically-encoded fluorescent indicators at single-neuron resolution using optical microscopy techniques. Furthermore zebrafish begin to show a complex repertoire of natural behavior from an early age, including hunting small, fast-moving prey using visual cues. Until recently work to address the neural bases of these behaviors mostly relied on assays where the fish was immobilized under the microscope objective, and stimuli such as prey were presented virtually. However significant progress has recently been made in developing brain imaging techniques for zebrafish which are not immobilized. Here we discuss recent advances, focusing particularly on techniques based on light-field microscopy. We also draw attention to several important outstanding issues which remain to be addressed to increase the ecological validity of the results obtained.

Extended reality for biomedicine

Extended reality (XR) refers to an umbrella of methods that allows users to be immersed in a three-dimensional (3D) or a 4D (spatial + temporal) virtual environment to different extents, including virtual reality (VR), augmented reality (AR), and mixed reality (MR). While VR allows a user to be fully immersed in a virtual environment, AR and MR overlay virtual objects over the real physical world. The immersion and interaction of XR provide unparalleled opportunities to extend our world beyond conventional lifestyles. While XR has extensive applications in fields such as entertainment and education, its numerous applications in biomedicine create transformative opportunities in both fundamental research and healthcare. This Primer outlines XR technology from instrumentation to software computation methods, delineating the biomedical applications that have been advanced by state-of-the-art techniques. We further describe the technical advances overcoming current limitations in XR and its applications, providing an entry point for professionals and trainees to thrive in this emerging field.

Neural mechanism underlying depressive-like state associated with social status loss

Downward social mobility is a well-known mental risk factor for depression, but its neural mechanism remains elusive. Here, by forcing mice to lose against their subordinates in a non-violent social contest, we lower their social ranks stably and induce depressive-like behaviors. These rank-decline-associated depressive-like behaviors can be reversed by regaining social status. In vivo fiber photometry and single-unit electrophysiological recording show that forced loss, but not natural loss, generates negative reward prediction error (RPE). Through the lateral hypothalamus, the RPE strongly activates the brain's anti-reward center, the lateral habenula (LHb). LHb activation inhibits the medial prefrontal cortex (mPFC) that controls social competitiveness and reinforces retreats in contests. These results reveal the core neural mechanisms mutually promoting social status loss and depressive behaviors. The intertwined neuronal signaling controlling mPFC and LHb activities provides a mechanistic foundation for the crosstalk between social mobility and psychological disorder, unveiling a promising target for intervention.

An Overview of In Vitro Biological Neural Networks for Robot Intelligence

In vitro biological neural networks (BNNs) interconnected with robots, so-called BNN-based neurorobotic systems, can interact with the external world, so that they can present some preliminary intelligent behaviors, including learning, memory, robot control, etc. This work aims to provide a comprehensive overview of the intelligent behaviors presented by the BNN-based neurorobotic systems, with a particular focus on those related to robot intelligence. In this work, we first introduce the necessary biological background to understand the 2 characteristics of the BNNs: nonlinear computing capacity and network plasticity. Then, we describe the typical architecture of the BNN-based neurorobotic systems and outline the mainstream techniques to realize such an architecture from 2 aspects: from robots to BNNs and from BNNs to robots. Next, we separate the intelligent behaviors into 2 parts according to whether they rely solely on the computing capacity (computing capacity-dependent) or depend also on the network plasticity (network plasticity-dependent), which are then expounded respectively, with a focus on those related to the realization of robot intelligence. Finally, the development trends and challenges of the BNN-based neurorobotic systems are discussed.

The psychology of natural history

Natural history observations are an integral part of ecology and evolution. However, they can be underappreciated because they operate independent of the scientific method. Here, we illustrate that the science of natural history has its own methodology based on a well-known psychological paradigm that describes how the human mind learns.

A Mini-Review Regarding the Modalities to Study Neurodevelopmental Disorders-Like Impairments in Zebrafish—Focussing on Neurobehavioural and Psychological Responses

Neurodevelopmental disorders (NDDs) are complex disorders which can be associated with many comorbidities and exhibit multifactorial-dependent phenotypes. An important characteristic is represented by the early onset of the symptoms, during childhood or young adulthood, with a great impact on the socio-cognitive functioning of the affected individuals. Thus, the aim of our review is to describe and to argue the necessity of early developmental stages zebrafish models, focusing on NDDs, especially autism spectrum disorders (ASD) and also on schizophrenia. The utility of the animal models in NDDs or schizophrenia research remains quite controversial. Relevant discussions can be opened regarding the specific characteristics of the animal models and the relationship with the etiologies, physiopathology, and development of these disorders. The zebrafish models behaviors displayed as early as during the pre-hatching embryo stage (locomotor activity prone to repetitive behavior), and post-hatching embryo stage, such as memory, perception, affective-like, and social behaviors can be relevant in ASD and schizophrenia research. The neurophysiological processes impaired in both ASD and schizophrenia are generally highly conserved across all vertebrates. However, the relatively late individual development and conscious social behavior exhibited later in the larval stage are some of the most important limitations of these model animal species.

Integrated Behavioral, Genetic and Brain Circuit Visualization Methods to Unravel Functional Anatomy of Zebrafish Amygdala

The mammalian amygdala is a complex forebrain structure consisting of a heterogeneous group of nuclei derived from the pallial and subpallial telencephalon. It plays a critical role in a broad range of behaviors such as emotion, cognition, and social behavior; within the amygdala each nucleus has a distinct role in these behavioral processes. Topological, hodological, molecular, and functional studies suggest the presence of an amygdala-like structure in the zebrafish brain. It has been suggested that the pallial amygdala homolog corresponds to the medial zone of the dorsal telencephalon (Dm) and the subpallial amygdala homolog corresponds to the nuclei in the ventral telencephalon located close to and topographically basal to Dm. However, these brain regions are broad and understanding the functional anatomy of the zebrafish amygdala requires investigating the role of specific populations of neurons in brain function and behavior. In zebrafish, the highly efficient Tol2 transposon-mediated transgenesis method together with the targeted gene expression by the Gal4-UAS system has been a powerful tool in labeling, visualizing, and manipulating the function of specific cell types in the brain. The transgenic resource combined with neuronal activity imaging, optogenetics, pharmacology, and quantitative behavioral analyses enables functional analyses of neuronal circuits. Here, we review earlier studies focused on teleost amygdala anatomy and function and discuss how the transgenic resource and tools can help unravel the functional anatomy of the zebrafish amygdala.

Validation of Candidate Sleep Disorder Risk Genes Using Zebrafish

Sleep disorders and chronic sleep disturbances are common and are associated with cardio-metabolic diseases and neuropsychiatric disorders. Several genetic pathways and neuronal mechanisms that regulate sleep have been described in animal models, but the genes underlying human sleep variation and sleep disorders are largely unknown. Identifying these genes is essential in order to develop effective therapies for sleep disorders and their associated comorbidities. To address this unmet health problem, genome-wide association studies (GWAS) have identified numerous genetic variants associated with human sleep traits and sleep disorders. However, in most cases, it is unclear which gene is responsible for a sleep phenotype that is associated with a genetic variant. As a result, it is necessary to experimentally validate candidate genes identified by GWAS using an animal model. Rodents are ill-suited for this endeavor due to their poor amenability to high-throughput sleep assays and the high costs associated with generating, maintaining, and testing large numbers of mutant lines. Zebrafish (Danio rerio), an alternative vertebrate model for studying sleep, allows for the rapid and cost-effective generation of mutant lines using the CRISPR/Cas9 system. Numerous zebrafish mutant lines can then be tested in parallel using high-throughput behavioral assays to identify genes whose loss affects sleep. This process identifies a gene associated with each GWAS hit that is likely responsible for the human sleep phenotype. This strategy is a powerful complement to GWAS approaches and holds great promise to identify the genetic basis for common human sleep disorders.

The evolution of brain architectures for predictive coding and active inference

This article considers the evolution of brain architectures for predictive processing. We argue that brain mechanisms for predictive perception and action are not late evolutionary additions of advanced creatures like us. Rather, they emerged gradually from simpler predictive loops (e.g. autonomic and motor reflexes) that were a legacy from our earlier evolutionary ancestors-and were key to solving their fundamental problems of adaptive regulation. We characterize simpler-to-more-complex brains formally, in terms of generative models that include predictive loops of increasing hierarchical breadth and depth. These may start from a simple homeostatic motif and be elaborated during evolution in four main ways: these include the multimodal expansion of predictive control into an allostatic loop; its duplication to form multiple sensorimotor loops that expand an animal's behavioural repertoire; and the gradual endowment of generative models with hierarchical depth (to deal with aspects of the world that unfold at different spatial scales) and temporal depth (to select plans in a future-oriented manner). In turn, these elaborations underwrite the solution to biological regulation problems faced by increasingly sophisticated animals. Our proposal aligns neuroscientific theorising-about predictive processing-with evolutionary and comparative data on brain architectures in different animal species. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Active inference leads to Bayesian neurophysiology

The neuronal substrates that implement the free-energy principle and ensuing active inference at the neuron and synapse level have not been fully elucidated. This Review considers possible neuronal substrates underlying the principle. First, the foundations of the free-energy principle are introduced, and then its ability to empirically explain various brain functions and psychological and biological phenomena in terms of Bayesian inference is described. Mathematically, the dynamics of neural activity and plasticity that minimise a cost function can be cast as performing Bayesian inference that minimises variational free energy. This equivalence licenses the adoption of the free-energy principle as a universal characterisation of neural networks. Further, the neural network structure itself represents a generative model under which an agent operates. A virtue of this perspective is that it enables the formal association of neural network properties with prior beliefs that regulate inference and learning. The possible neuronal substrates that implement prior beliefs and how to empirically examine the theory are discussed. This perspective renders brain activity explainable, leading to a deeper understanding of the neuronal mechanisms underlying basic psychology and psychiatric disorders in terms of an implicit generative model.