Automated synapse-level reconstruction of neural circuits in the larval zebrafish brain

A robust transformer-based pipeline of 3D cell alignment, denoise and instance segmentation on electron microscopy sequence images

Germline cells are critical for transmitting genetic information to subsequent generations in biological organisms. While their differentiation from somatic cells during embryonic development is well-documented in most animals, the regulatory mechanisms initiating plant germline cells are not well understood. To thoroughly investigate the complex morphological transformations of their ultrastructure over developmental time, nanoscale 3D reconstruction of entire plant tissues is necessary, achievable exclusively through electron microscopy imaging. This paper presents a full-process framework designed for reconstructing large-volume plant tissue from serial electron microscopy images. The framework ensures end-to-end direct output of reconstruction results, including topological networks and morphological analysis. The proposed 3D cell alignment, denoise, and instance segmentation pipeline (3DCADS) leverages deep learning to provide a cell instance segmentation workflow for electron microscopy image series, ensuring accurate and robust 3D cell reconstructions with high computational efficiency. The pipeline involves five stages: the registration of electron microscopy serial images; image enhancement and denoising; semantic segmentation using a Transformer-based neural network; instance segmentation through a supervoxel-based clustering algorithm; and an automated analysis and statistical assessment of the reconstruction results, with the mapping of topological connections. The 3DCADS model's precision was validated on a plant tissue ground-truth dataset, outperforming traditional baseline models and deep learning baselines in overall accuracy. The framework was applied to the reconstruction of early meiosis stages in the anthers of Arabidopsis thaliana, resulting in a topological connectivity network and analysis of morphological parameters and characteristics of cell distribution. The experiment underscores the 3DCADS model's potential for biological tissue identification and its significance in quantitative analysis of plant cell development, crucial for examining samples across different genetic phenotypes and mutations in plant development. Additionally, the paper discusses the regulatory mechanisms of Arabidopsis thaliana's germline cells and the development of stamen cells before meiosis, offering new insights into the transition from somatic to germline cell fate in plants.

Neurotransmitter classification from electron microscopy images at synaptic sites in Drosophila melanogaster

High-resolution electron microscopy of nervous systems has enabled the reconstruction of synaptic connectomes. However, we do not know the synaptic sign for each connection (i.e., whether a connection is excitatory or inhibitory), which is implied by the released transmitter. We demonstrate that artificial neural networks can predict transmitter types for presynapses from electron micrographs: a network trained to predict six transmitters (acetylcholine, glutamate, GABA, serotonin, dopamine, octopamine) achieves an accuracy of 87% for individual synapses, 94% for neurons, and 91% for known cell types across a D. melanogaster whole brain. We visualize the ultrastructural features used for prediction, discovering subtle but significant differences between transmitter phenotypes. We also analyze transmitter distributions across the brain and find that neurons that develop together largely express only one fast-acting transmitter (acetylcholine, glutamate, or GABA). We hope that our publicly available predictions act as an accelerant for neuroscientific hypothesis generation for the fly.

Zebrafish and nematodes as whole organism models to measure developmental neurotoxicity

Despite the growing epidemiological evidence of an association between toxin exposure and developmental neurotoxicity (DNT), systematic testing of DNT is not mandatory in international regulations for admission of pharmaceuticals or industrial chemicals. However, to date around 200 compounds, ranging from pesticides, pharmaceuticals and industrial chemicals, have been tested for DNT in the current OECD test guidelines (TG-443 or TG-426). There are calls for the development of new approach methodologies (NAMs) for DNT, which has resulted in a DNT testing battery using in vitro human cell-based assays. These assays provide a means to elucidate the molecular mechanisms of toxicity in humans which is lacking in animal-based toxicity tests. However, cell-based assays do not represent all steps of the complex process leading to DNT. Validated models with a multi-organ network of pathways that interact at the molecular, cellular and tissue level at very specific timepoints in a life cycle are currently missing. Consequently, whole model organisms are being developed to screen for, and causally link, new molecular targets of DNT compounds and how they affect whole brain development and neurobehavioral endpoints. Given the practical and ethical restraints associated with vertebrate testing, lower animal models that qualify as 3 R (reduce, refine and replace) models, including the nematode (Caenorhabditis elegans) and the zebrafish (Danio rerio) will prove particularly valuable for unravelling toxicity pathways leading to DNT. Although not as complex as the human brain, these 3 R-models develop a complete functioning brain with numerous neurodevelopmental processes overlapping with human brain development. Importantly, the main signalling pathways relating to (neuro)development, metabolism and growth are highly conserved in these models. We propose the use of whole model organisms specifically zebrafish and C. elegans for DNT relevant endpoints.

Photoemission electron microscopy for connectomics

Detailing the physical basis of neural circuits with large-volume serial electron microscopy (EM), 'connectomics', has emerged as an invaluable tool in the neuroscience armamentarium. However, imaging synaptic resolution connectomes is currently limited to either transmission electron microscopy (TEM) or scanning electron microscopy (SEM). Here, we describe a third way, using photoemission electron microscopy (PEEM) which illuminates ultra-thin brain slices collected on solid substrates with UV light and images the photoelectron emission pattern with a wide-field electron microscope. PEEM works with existing sample preparations for EM and routinely provides sufficient resolution and contrast to reveal myelinated axons, somata, dendrites, and sub-cellular organelles. Under optimized conditions, PEEM provides synaptic resolution; and simulation and experiments show that PEEM can be transformatively fast, at Gigahertz pixel rates. We conclude that PEEM imaging leverages attractive aspects of SEM and TEM, namely reliable sample collection on robust substrates combined with fast wide-field imaging, and could enable faster data acquisition for next-generation circuit mapping.

Integrating cellular electron microscopy with multimodal data to explore biology across space and time

Biology spans a continuum of length and time scales. Individual experimental methods only glimpse discrete pieces of this spectrum but can be combined to construct a more holistic view. In this Review, we detail the latest advancements in volume electron microscopy (vEM) and cryo-electron tomography (cryo-ET), which together can visualize biological complexity across scales from the organization of cells in large tissues to the molecular details inside native cellular environments. In addition, we discuss emerging methodologies for integrating three-dimensional electron microscopy (3DEM) imaging with multimodal data, including fluorescence microscopy, mass spectrometry, single-particle analysis, and AI-based structure prediction. This multifaceted approach fills gaps in the biological continuum, providing functional context, spatial organization, molecular identity, and native interactions. We conclude with a perspective on incorporating diverse data into computational simulations that further bridge and extend length scales while integrating the dimension of time.

Visually guided and context-dependent spatial navigation in the translucent fish Danionella cerebrum

Danionella cerebrum (DC) is a promising vertebrate animal model for systems neuroscience due to its small adult brain volume and inherent optical transparency, but the scope of their cognitive abilities remains an area of active research. In this work, we established a behavioral paradigm to study visual spatial navigation in DC and investigate their navigational capabilities and strategies. We initially observed that adult DC exhibit strong negative phototaxis in groups but less so as individuals. Using their dark preference as a motivator, we designed a spatial navigation task inspired by the Morris water maze. Through a series of environmental cue manipulations, we found that DC utilize visual cues to anticipate a reward location and found evidence for landmark-based navigational strategies wherein DC could use both proximal and distal visual cues. When subsets of proximal visual cues were occluded, DC were capable of using distant contextual visual information to solve the task, providing evidence for allocentric spatial navigation. Without proximal visual cues, DC tended to seek out a direct line of sight with at least one distal visual cue while maintaining a positional bias toward the reward location. In total, our behavioral results suggest that DC can be used to study the neural mechanisms underlying spatial navigation with cellular resolution imaging across an adult vertebrate brain.

Whole-brain Optical Imaging: A Powerful Tool for Precise Brain Mapping at the Mesoscopic Level

The mammalian brain is a highly complex network that consists of millions to billions of densely-interconnected neurons. Precise dissection of neural circuits at the mesoscopic level can provide important structural information for understanding the brain. Optical approaches can achieve submicron lateral resolution and achieve "optical sectioning" by a variety of means, which has the natural advantage of allowing the observation of neural circuits at the mesoscopic level. Automated whole-brain optical imaging methods based on tissue clearing or histological sectioning surpass the limitation of optical imaging depth in biological tissues and can provide delicate structural information in a large volume of tissues. Combined with various fluorescent labeling techniques, whole-brain optical imaging methods have shown great potential in the brain-wide quantitative profiling of cells, circuits, and blood vessels. In this review, we summarize the principles and implementations of various whole-brain optical imaging methods and provide some concepts regarding their future development.

STED microscopy reveals dendrite-specificity of spines in turtle cortex

Dendritic spines are key structures for neural communication, learning and memory. Spine size and shape probably reflect synaptic strength and learning. Imaging with superresolution STED microscopy the detailed shape of the majority of the spines of individual neurons in turtle cortex (Trachemys scripta elegans) revealed several distinguishable shape classes. Dendritic spines of a given class were not distributed randomly, but rather decorated significantly more often some dendrites than others. The individuality of dendrites was corroborated by significant inter-dendrite differences in other parameters such as spine density and length. In addition, many spines were branched or possessed spinules. These findings may have implications for the role of individual dendrites in this cortex.

Studying zebrafish nervous system structure and function in health and disease with electron microscopy

Zebrafish (Danio rerio) is a well-established model for studying the nervous system. Findings in zebrafish often inform studies on human diseases of the nervous system and provide crucial insight into disease mechanisms. The functions of the nervous system often rely on communication between neurons. Signal transduction is achieved via release of signaling molecules in the form of neuropeptides or neurotransmitters at synapses. Snapshots of membrane dynamics of these processes are imaged by electron microscopy. Electron microscopy can reveal ultrastructure and thus synaptic processes. This is crucial both for mapping synaptic connections and for investigating synaptic functions. In addition, via volumetric electron microscopy, the overall architecture of the nervous system becomes accessible, where structure can inform function. Electron microscopy is thus of particular value for studying the nervous system. However, today a plethora of electron microscopy techniques and protocols exist. Which technique is most suitable highly depends on the research question and scope as well as on the type of tissue that is examined. This review gives an overview of the electron microcopy techniques used on the zebrafish nervous system. It aims to give researchers a guide on which techniques are suitable for their specific questions and capabilities as well as an overview of the capabilities of electron microscopy in neurobiological research in the zebrafish model.

Zebrafish brain atlases: a collective effort for a tiny vertebrate brain

In the past two decades, digital brain atlases have emerged as essential tools for sharing and integrating complex neuroscience datasets. Concurrently, the larval zebrafish has become a prominent vertebrate model offering a strategic compromise for brain size, complexity, transparency, optogenetic access, and behavior. We provide a brief overview of digital atlases recently developed for the larval zebrafish brain, intersecting neuroanatomical information, gene expression patterns, and connectivity. These atlases are becoming pivotal by centralizing large datasets while supporting the generation of circuit hypotheses as functional measurements can be registered into an atlas' standard coordinate system to interrogate its structural database. As challenges persist in mapping neural circuits and incorporating functional measurements into zebrafish atlases, we emphasize the importance of collaborative efforts and standardized protocols to expand these resources to crack the complex codes of neuronal activity guiding behavior in this tiny vertebrate brain.

Retina-derived signals control pace of neurogenesis in visual brain areas but not circuit assembly

Brain development is orchestrated by both innate and experience-dependent mechanisms, but their relative contributions are difficult to disentangle. Here we asked if and how central visual areas are altered in a vertebrate brain depleted of any and all signals from retinal ganglion cells throughout development. We transcriptionally profiled neurons in pretectum, thalamus and other retinorecipient areas of larval zebrafish and searched for changes in lakritz mutants that lack all retinal connections. Although individual genes are dysregulated, the complete set of 77 neuronal types develops in apparently normal proportions, at normal locations, and along normal differentiation trajectories. Strikingly, the cell-cycle exits of proliferating progenitors in these areas are delayed, and a greater fraction of early postmitotic precursors remain uncommitted or are diverted to a pre-glial fate. Optogenetic stimulation targeting groups of neurons normally involved in processing visual information evokes behaviors indistinguishable from wildtype. In conclusion, we show that signals emitted by retinal axons influence the pace of neurogenesis in visual brain areas, but do not detectably affect the specification or wiring of downstream neurons.

Dense 4D nanoscale reconstruction of living brain tissue

Three-dimensional (3D) reconstruction of living brain tissue down to an individual synapse level would create opportunities for decoding the dynamics and structure-function relationships of the brain's complex and dense information processing network; however, this has been hindered by insufficient 3D resolution, inadequate signal-to-noise ratio and prohibitive light burden in optical imaging, whereas electron microscopy is inherently static. Here we solved these challenges by developing an integrated optical/machine-learning technology, LIONESS (live information-optimized nanoscopy enabling saturated segmentation). This leverages optical modifications to stimulated emission depletion microscopy in comprehensively, extracellularly labeled tissue and previous information on sample structure via machine learning to simultaneously achieve isotropic super-resolution, high signal-to-noise ratio and compatibility with living tissue. This allows dense deep-learning-based instance segmentation and 3D reconstruction at a synapse level, incorporating molecular, activity and morphodynamic information. LIONESS opens up avenues for studying the dynamic functional (nano-)architecture of living brain tissue.

CAVE: Connectome Annotation Versioning Engine

Advances in Electron Microscopy, image segmentation and computational infrastructure have given rise to large-scale and richly annotated connectomic datasets which are increasingly shared across communities. To enable collaboration, users need to be able to concurrently create new annotations and correct errors in the automated segmentation by proofreading. In large datasets, every proofreading edit relabels cell identities of millions of voxels and thousands of annotations like synapses. For analysis, users require immediate and reproducible access to this constantly changing and expanding data landscape. Here, we present the Connectome Annotation Versioning Engine (CAVE), a computational infrastructure for immediate and reproducible connectome analysis in up-to petascale datasets (~1mm3) while proofreading and annotating is ongoing. For segmentation, CAVE provides a distributed proofreading infrastructure for continuous versioning of large reconstructions. Annotations in CAVE are defined by locations such that they can be quickly assigned to the underlying segment which enables fast analysis queries of CAVE's data for arbitrary time points. CAVE supports schematized, extensible annotations, so that researchers can readily design novel annotation types. CAVE is already used for many connectomics datasets, including the largest datasets available to date.

Sequential Chromogenic IHC: Spatial Analysis of Lymph Nodes Identifies Contact Interactions between Plasmacytoid Dendritic Cells and Plasmablasts

Recent clinical observations have emphasized the critical role that the spatial organization of immune cells in lymphoid structures plays in the success of cancer immunotherapy and patient survival. However, implementing sequential chromogenic IHC (scIHC) to analyze multiple biomarkers on a single tissue section has been limited because of a lack of a standardized, rigorous guide to the development of customized biomarker panels and a need for user-friendly analysis pipelines that can extract meaningful data. In this context, we provide a comprehensive guide for the development of novel biomarker panels for scIHC, using practical examples and illustrations to highlight the most common complications that can arise during the setup of a new biomarker panel, and provide detailed instructions on how to prevent and detect cross-reactivity between secondary reagents and carryover between detection antibodies. We also developed a novel analysis pipeline based on non-rigid tissue deformation correction, Cellpose-inspired automated cell segmentation, and computational network masking of low-quality data. We applied this biomarker panel and pipeline to study regional lymph nodes from patients with head and neck cancer, identifying novel contact interactions between plasmablasts and plasmacytoid dendritic cells in vivo. Given that Toll-like receptors, which are highly expressed in plasmacytoid dendritic cells, play a key role in vaccine efficacy, the significance of this cell-cell interaction decisively warrants further studies. In summary, this work provides a streamlined approach to the development of customized biomarker panels for scIHC that will ultimately improve our understanding of immune responses in cancer.

Significance

We present a comprehensive guide for developing customized biomarker panels to investigate cell-cell interactions in the context of immune responses in cancer. This approach revealed novel contact interactions between plasmablasts and plasmacytoid dendritic cells in lymph nodes from patients with head and neck cancer.

High-Speed Automated Reconstruction of Drosophila Larval Brain from Volumetric EM Data

To uncover the relationship between neural activity and behavior, it is essential to reconstruct neural circuits. However, methods typically used for neuron reconstruction from volumetric electron microscopy (EM) dataset are often time-consuming and require extensive manual proofreading, making it difficult to reproduce in a typical laboratory setting. To address this challenge, we have developed a set of acceleration techniques that build upon the Flood Filling Network (FFN), significantly reducing the time required for this task. These techniques can be easily adapted to other similar datasets and laboratory settings. To validate our approach, we tested our pipeline on a dataset of Drosophila larval brain serial section EM images at synaptic-resolution level. Our results demonstrate that our pipeline significantly reduces the inference time compared to the FFN baseline method and greatly reduces the time required for reconstructing the 3D morphology of neurons.

Imaging Approaches to Investigate Pathophysiological Mechanisms of Brain Disease in Zebrafish

Zebrafish has become an essential model organism in modern biomedical research. Owing to its distinctive features and high grade of genomic homology with humans, it is increasingly employed to model diverse neurological disorders, both through genetic and pharmacological intervention. The use of this vertebrate model has recently enhanced research efforts, both in the optical technology and in the bioengineering fields, aiming at developing novel tools for high spatiotemporal resolution imaging. Indeed, the ever-increasing use of imaging methods, often combined with fluorescent reporters or tags, enable a unique chance for translational neuroscience research at different levels, ranging from behavior (whole-organism) to functional aspects (whole-brain) and down to structural features (cellular and subcellular). In this work, we present a review of the imaging approaches employed to investigate pathophysiological mechanisms underlying functional, structural, and behavioral alterations of human neurological diseases modeled in zebrafish.

Structure and function in artificial, zebrafish and human neural networks

Network science provides a set of tools for the characterization of the structure and functional behavior of complex systems. Yet a major problem is to quantify how the structural domain is related to the dynamical one. In other words, how the diversity of dynamical states of a system can be predicted from the static network structure? Or the reverse problem: starting from a set of signals derived from experimental recordings, how can one discover the network connections or the causal relations behind the observed dynamics? Despite the advances achieved over the last two decades, many challenges remain concerning the study of the structure-dynamics interplay of complex systems. In neuroscience, progress is typically constrained by the low spatio-temporal resolution of experiments and by the lack of a universal inferring framework for empirical systems. To address these issues, applications of network science and artificial intelligence to neural data have been rapidly growing. In this article, we review important recent applications of methods from those fields to the study of the interplay between structure and functional dynamics of human and zebrafish brain. We cover the selection of topological features for the characterization of brain networks, inference of functional connections, dynamical modeling, and close with applications to both the human and zebrafish brain. This review is intended to neuroscientists who want to become acquainted with techniques from network science, as well as to researchers from the latter field who are interested in exploring novel application scenarios in neuroscience.

Neural dynamics and architecture of the heading direction circuit in zebrafish

Animals generate neural representations of their heading direction. Notably, in insects, heading direction is topographically represented by the activity of neurons in the central complex. Although head direction cells have been found in vertebrates, the connectivity that endows them with their properties is unknown. Using volumetric lightsheet imaging, we find a topographical representation of heading direction in a neuronal network in the zebrafish anterior hindbrain, where a sinusoidal bump of activity rotates following directional swims of the fish and is otherwise stable over many seconds. Electron microscopy reconstructions show that, although the cell bodies are located in a dorsal region, these neurons arborize in the interpeduncular nucleus, where reciprocal inhibitory connectivity stabilizes the ring attractor network that encodes heading. These neurons resemble those found in the fly central complex, showing that similar circuit architecture principles may underlie the representation of heading direction across the animal kingdom and paving the way to an unprecedented mechanistic understanding of these networks in vertebrates.

Whole-brain imaging of freely-moving zebrafish

One of the holy grails of neuroscience is to record the activity of every neuron in the brain while an animal moves freely and performs complex behavioral tasks. While important steps forward have been taken recently in large-scale neural recording in rodent models, single neuron resolution across the entire mammalian brain remains elusive. In contrast the larval zebrafish offers great promise in this regard. Zebrafish are a vertebrate model with substantial homology to the mammalian brain, but their transparency allows whole-brain recordings of genetically-encoded fluorescent indicators at single-neuron resolution using optical microscopy techniques. Furthermore zebrafish begin to show a complex repertoire of natural behavior from an early age, including hunting small, fast-moving prey using visual cues. Until recently work to address the neural bases of these behaviors mostly relied on assays where the fish was immobilized under the microscope objective, and stimuli such as prey were presented virtually. However significant progress has recently been made in developing brain imaging techniques for zebrafish which are not immobilized. Here we discuss recent advances, focusing particularly on techniques based on light-field microscopy. We also draw attention to several important outstanding issues which remain to be addressed to increase the ecological validity of the results obtained.

Recurrent network interactions explain tectal response variability and experience-dependent behavior

Response variability is an essential and universal feature of sensory processing and behavior. It arises from fluctuations in the internal state of the brain, which modulate how sensory information is represented and transformed to guide behavioral actions. In part, brain state is shaped by recent network activity, fed back through recurrent connections to modulate neuronal excitability. However, the degree to which these interactions influence response variability and the spatial and temporal scales across which they operate, are poorly understood. Here, we combined population recordings and modeling to gain insights into how neuronal activity modulates network state and thereby impacts visually evoked activity and behavior. First, we performed cellular-resolution calcium imaging of the optic tectum to monitor ongoing activity, the pattern of which is both a cause and consequence of changes in network state. We developed a minimal network model incorporating fast, short range, recurrent excitation and long-lasting, activity-dependent suppression that reproduced a hallmark property of tectal activity - intermittent bursting. We next used the model to estimate the excitability state of tectal neurons based on recent activity history and found that this explained a portion of the trial-to-trial variability in visually evoked responses, as well as spatially selective response adaptation. Moreover, these dynamics also predicted behavioral trends such as selective habituation of visually evoked prey-catching. Overall, we demonstrate that a simple recurrent interaction motif can be used to estimate the effect of activity upon the incidental state of a neural network and account for experience-dependent effects on sensory encoding and visually guided behavior.

A single-cell resolution gene expression atlas of the larval zebrafish brain

The advent of multimodal brain atlases promises to accelerate progress in neuroscience by allowing in silico queries of neuron morphology, connectivity, and gene expression. We used multiplexed fluorescent in situ RNA hybridization chain reaction (HCR) technology to generate expression maps across the larval zebrafish brain for a growing set of marker genes. The data were registered to the Max Planck Zebrafish Brain (mapzebrain) atlas, thus allowing covisualization of gene expression, single-neuron tracings, and expertly curated anatomical segmentations. Using post hoc HCR labeling of the immediate early gene cfos, we mapped responses to prey stimuli and food ingestion across the brain of freely swimming larvae. This unbiased approach revealed, in addition to previously described visual and motor areas, a cluster of neurons in the secondary gustatory nucleus, which express the marker calb2a, as well as a specific neuropeptide Y receptor, and project to the hypothalamus. This discovery exemplifies the power of this new atlas resource for zebrafish neurobiology.

A medley of gene expression adds new depth to zebrafish brain maps

The integration of large-scale gene expression mapping into a multifaceted larval zebrafish brain atlas accelerates the characterization of neurons in behaviorally relevant circuits.

A brainstem integrator for self-location memory and positional homeostasis in zebrafish

To track and control self-location, animals integrate their movements through space. Representations of self-location are observed in the mammalian hippocampal formation, but it is unknown if positional representations exist in more ancient brain regions, how they arise from integrated self-motion, and by what pathways they control locomotion. Here, in a head-fixed, fictive-swimming, virtual-reality preparation, we exposed larval zebrafish to a variety of involuntary displacements. They tracked these displacements and, many seconds later, moved toward their earlier location through corrective swimming ("positional homeostasis"). Whole-brain functional imaging revealed a network in the medulla that stores a memory of location and induces an error signal in the inferior olive to drive future corrective swimming. Optogenetically manipulating medullary integrator cells evoked displacement-memory behavior. Ablating them, or downstream olivary neurons, abolished displacement corrections. These results reveal a multiregional hindbrain circuit in vertebrates that integrates self-motion and stores self-location to control locomotor behavior.

SyConn2: dense synaptic connectivity inference for volume electron microscopy

The ability to acquire ever larger datasets of brain tissue using volume electron microscopy leads to an increasing demand for the automated extraction of connectomic information. We introduce SyConn2, an open-source connectome analysis toolkit, which works with both on-site high-performance compute environments and rentable cloud computing clusters. SyConn2 was tested on connectomic datasets with more than 10 million synapses, provides a web-based visualization interface and makes these data amenable to complex anatomical and neuronal connectivity queries.

SyConn2 is a machine learning-based framework for inferring and analyzing the connectomes contained in a volume electron microscopy dataset of brain tissue, for example from the zebra finch.