Accurate Automatic Detection of Densely Distributed Cell Nuclei in 3D Space

Automated segmentation and recognition of C. elegans whole-body cells

MOTIVATION

Accurate segmentation and recognition of C.elegans cells are critical for various biological studies, including gene expression, cell lineages, and cell fates analysis at single-cell level. However, the highly dense distribution, similar shapes, and inhomogeneous intensity profiles of whole-body cells in 3D fluorescence microscopy images make automatic cell segmentation and recognition a challenging task. Existing methods either rely on additional fiducial markers or only handle a subset of cells. Given the difficulty or expense associated with generating fiducial features in many experimental settings, a marker-free approach capable of reliably segmenting and recognizing C.elegans whole-body cells is highly desirable.

RESULTS

We report a new pipeline, called automated segmentation and recognition (ASR) of cells, and applied it to 3D fluorescent microscopy images of L1-stage C.elegans with 558 whole-body cells. A novel displacement vector field based deep learning model is proposed to address the problem of reliable segmentation of highly crowded cells with blurred boundary. We then realize the cell recognition by encoding and exploiting statistical priors on cell positions and structural similarities of neighboring cells. To the best of our knowledge, this is the first method successfully applied to the segmentation and recognition of C.elegans whole-body cells. The ASR-segmentation module achieves an F1-score of 0.8956 on a dataset of 116 C.elegans image stacks with 64 728 cells (accuracy 0.9880, AJI 0.7813). Based on the segmentation results, the ASR recognition module achieved an average accuracy of 0.8879. We also show ASR's applicability to other cell types, e.g. platynereis and rat kidney cells.

AVAILABILITY AND IMPLEMENTATION

The code is available at https://github.com/reaneyli/ASR.

See Elegans: Simple-to-use, accurate, and automatic 3D detection of neural activity from densely packed neurons

In the emerging field of whole-brain imaging at single-cell resolution, which represents one of the new frontiers to investigate the link between brain activity and behavior, the nematode Caenorhabditis elegans offers one of the most characterized models for systems neuroscience. Whole-brain recordings consist of 3D time series of volumes that need to be processed to obtain neuronal traces. Current solutions for this task are either computationally demanding or limited to specific acquisition setups. Here, we propose See Elegans, a direct programming algorithm that combines different techniques for automatic neuron segmentation and tracking without the need for the RFP channel, and we compare it with other available algorithms. While outperforming them in most cases, our solution offers a novel method to guide the identification of a subset of head neurons based on position and activity. The built-in interface allows the user to follow and manually curate each of the processing steps. See Elegans is thus a simple-to-use interface aimed at speeding up the post-processing of volumetric calcium imaging recordings while maintaining a high level of accuracy and low computational demands. (Contact: enrico.lanza@iit.it).

Ensemble dynamics and information flow deduction from whole-brain imaging data

The recent advancements in large-scale activity imaging of neuronal ensembles offer valuable opportunities to comprehend the process involved in generating brain activity patterns and understanding how information is transmitted between neurons or neuronal ensembles. However, existing methodologies for extracting the underlying properties that generate overall dynamics are still limited. In this study, we applied previously unexplored methodologies to analyze time-lapse 3D imaging (4D imaging) data of head neurons of the nematode Caenorhabditis elegans. By combining time-delay embedding with the independent component analysis, we successfully decomposed whole-brain activities into a small number of component dynamics. Through the integration of results from multiple samples, we extracted common dynamics from neuronal activities that exhibit apparent divergence across different animals. Notably, while several components show common cooperativity across samples, some component pairs exhibited distinct relationships between individual samples. We further developed time series prediction models of synaptic communications. By combining dimension reduction using the general framework, gradient kernel dimension reduction, and probabilistic modeling, the overall relationships of neural activities were incorporated. By this approach, the stochastic but coordinated dynamics were reproduced in the simulated whole-brain neural network. We found that noise in the nervous system is crucial for generating realistic whole-brain dynamics. Furthermore, by evaluating synaptic interaction properties in the models, strong interactions within the core neural circuit, variable sensory transmission and importance of gap junctions were inferred. Virtual optogenetics can be also performed using the model. These analyses provide a solid foundation for understanding information flow in real neural networks.

Deep Learning-Based Cell Tracking in Deforming Organs and Moving Animals

Cell tracking is an essential step in extracting cellular signals from moving cells, which is vital for understanding the mechanisms underlying various biological functions and processes, particularly in organs such as the brain and heart. However, cells in living organisms often exhibit extensive and complex movements caused by organ deformation and whole-body motion. These movements pose a challenge in obtaining high-quality time-lapse cell images and tracking the intricate cell movements in the captured images. Recent advances in deep learning techniques provide powerful tools for detecting cells in low-quality images with densely packed cell populations, as well as estimating cell positions for cells undergoing large nonrigid movements. This chapter introduces the challenges of cell tracking in deforming organs and moving animals, outlines the solutions to these challenges, and presents a detailed protocol for data preparation, as well as for performing cell segmentation and tracking using the latest version of 3DeeCellTracker. This protocol is expected to enable researchers to gain deeper insights into organ dynamics and biological processes.

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional neural network with ground-truth (GT) annotations of images representing different brain postures. For 3D images, this is very labor intensive. We introduce 'targeted augmentation', a method to automatically synthesize artificial annotations from a few manual annotations. Our method ('Targettrack') learns the internal deformations of the brain to synthesize annotations for new postures by deforming GT annotations. This reduces the need for manual annotation and proofreading. A graphical user interface allows the application of the method end-to-end. We demonstrate Targettrack on recordings where neurons are labeled as key points or 3D volumes. Analyzing freely moving animals exposed to odor pulses, we uncover rich patterns in interneuron dynamics, including switching neuronal entrainment on and off.

Statistically unbiased prediction enables accurate denoising of voltage imaging data

Here we report SUPPORT (statistically unbiased prediction utilizing spatiotemporal information in imaging data), a self-supervised learning method for removing Poisson-Gaussian noise in voltage imaging data. SUPPORT is based on the insight that a pixel value in voltage imaging data is highly dependent on its spatiotemporal neighboring pixels, even when its temporally adjacent frames alone do not provide useful information for statistical prediction. Such dependency is captured and used by a convolutional neural network with a spatiotemporal blind spot to accurately denoise voltage imaging data in which the existence of the action potential in a time frame cannot be inferred by the information in other frames. Through simulations and experiments, we show that SUPPORT enables precise denoising of voltage imaging data and other types of microscopy image while preserving the underlying dynamics within the scene.

Principles for coding associative memories in a compact neural network

A major goal in neuroscience is to elucidate the principles by which memories are stored in a neural network. Here, we have systematically studied how four types of associative memories (short- and long-term memories, each as positive and negative associations) are encoded within the compact neural network of Caenorhabditis elegans worms. Interestingly, sensory neurons were primarily involved in coding short-term, but not long-term, memories, and individual sensory neurons could be assigned to coding either the conditioned stimulus or the experience valence (or both). Moreover, when considering the collective activity of the sensory neurons, the specific training experiences could be decoded. Interneurons integrated the modulated sensory inputs and a simple linear combination model identified the experience-specific modulated communication routes. The widely distributed memory suggests that integrated network plasticity, rather than changes to individual neurons, underlies the fine behavioral plasticity. This comprehensive study reveals basic memory-coding principles and highlights the central roles of sensory neurons in memory formation.

A comprehensive review of computational and image analysis techniques for quantitative evaluation of striated muscle tissue architecture

Unbiased evaluation of morphology is crucial to understanding development, mechanics, and pathology of striated muscle tissues. Indeed, the ability of striated muscles to contract and the strength of their contraction is dependent on their tissue-, cellular-, and cytoskeletal-level organization. Accordingly, the study of striated muscles often requires imaging and assessing aspects of their architecture at multiple different spatial scales. While an expert may be able to qualitatively appraise tissues, it is imperative to have robust, repeatable tools to quantify striated myocyte morphology and behavior that can be used to compare across different labs and experiments. There has been a recent effort to define the criteria used by experts to evaluate striated myocyte architecture. In this review, we will describe metrics that have been developed to summarize distinct aspects of striated muscle architecture in multiple different tissues, imaged with various modalities. Additionally, we will provide an overview of metrics and image processing software that needs to be developed. Importantly to any lab working on striated muscle platforms, characterization of striated myocyte morphology using the image processing pipelines discussed in this review can be used to quantitatively evaluate striated muscle tissues and contribute to a robust understanding of the development and mechanics of striated muscles.

Rapid detection and recognition of whole brain activity in a freely behaving Caenorhabditis elegans

Advanced volumetric imaging methods and genetically encoded activity indicators have permitted a comprehensive characterization of whole brain activity at single neuron resolution in Caenorhabditis elegans. The constant motion and deformation of the nematode nervous system, however, impose a great challenge for consistent identification of densely packed neurons in a behaving animal. Here, we propose a cascade solution for long-term and rapid recognition of head ganglion neurons in a freely moving C. elegans. First, potential neuronal regions from a stack of fluorescence images are detected by a deep learning algorithm. Second, 2-dimensional neuronal regions are fused into 3-dimensional neuron entities. Third, by exploiting the neuronal density distribution surrounding a neuron and relative positional information between neurons, a multi-class artificial neural network transforms engineered neuronal feature vectors into digital neuronal identities. With a small number of training samples, our bottom-up approach is able to process each volume—1024 × 1024 × 18 in voxels—in less than 1 second and achieves an accuracy of 91% in neuronal detection and above 80% in neuronal tracking over a long video recording. Our work represents a step towards rapid and fully automated algorithms for decoding whole brain activity underlying naturalistic behaviors.

An important question in neuroscience is to understand the relationship between brain dynamics and naturalistic behaviors when an animal is freely exploring its environment. In the last decade, it has become possible to genetically engineer animals whose neurons produce fluorescence reporters that change their brightness in response to brain activity. In small animals such as the nematode C. elegans, we can now record the fluorescence changes in and thereby infer neural activity from most neurons in the head of a worm, when the animal is freely moving. These neurons are densely packed in a small volume. Since the brain and body are moving and its shape undergoes significant deformation, a human expert, even after long hours of inspection, may still have difficulty to tell where the neurons are and who they are.

We sought to develop an automatic method for rapidly detecting and tracking most of these neurons in a moving animal. To do this, we asked a human expert to annotate all head neurons—their locations and digital identities—across a small number of volumes. Then, we trained a computer to learn the locations and digital identities of these neurons across different imaging volumes. Our machine inference method is fast and accurate. While it takes a human expert several hours to complete a sequence of volumes, a machine can finish the task in a few minutes. We hope our method provides a better and more efficient engine for extracting knowledge from whole brain imaging datasets and animal behaviors.

Fast, efficient, and accurate neuro-imaging denoising via supervised deep learning

Volumetric functional imaging is widely used for recording neuron activities in vivo, but there exist tradeoffs between the quality of the extracted calcium traces, imaging speed, and laser power. While deep-learning methods have recently been applied to denoise images, their applications to downstream analyses, such as recovering high-SNR calcium traces, have been limited. Further, these methods require temporally-sequential pre-registered data acquired at ultrafast rates. Here, we demonstrate a supervised deep-denoising method to circumvent these tradeoffs for several applications, including whole-brain imaging, large-field-of-view imaging in freely moving animals, and recovering complex neurite structures in C. elegans. Our framework has 30× smaller memory footprint, and is fast in training and inference (50–70 ms); it is highly accurate and generalizable, and further, trained with only small, non-temporally-sequential, independently-acquired training datasets (∼500 pairs of images). We envision that the framework will enable faster and long-term imaging experiments necessary to study neuronal mechanisms of many behaviors.

Volumetric functional imaging is widely used for recording neuron activities in vivo for many experimental organisms. Here the authors report supervised deep-denoising methods for improved whole-brain imaging, large field-of-view imaging in freely moving animals, and recovering complex neurite structures in C. elegans.

Efficient automatic 3D segmentation of cell nuclei for high-content screening

BACKGROUND

High-content screening (HCS) is a pre-clinical approach for the assessment of drug efficacy. On modern platforms, it involves fluorescent image capture using three-dimensional (3D) scanning microscopy. Segmentation of cell nuclei in 3D images is an essential prerequisite to quantify captured fluorescence in cells for screening. However, this segmentation is challenging due to variabilities in cell confluency, drug-induced alterations in cell morphology, and gradual degradation of fluorescence with the depth of scanning. Despite advances in algorithms for segmenting nuclei for HCS, robust 3D methods that are insensitive to these conditions are still lacking.

RESULTS

We have developed an algorithm which first generates a 3D nuclear mask in the original images. Next, an iterative 3D marker-controlled watershed segmentation is applied to downsized images to segment adjacent nuclei under the mask. In the last step, borders of segmented nuclei are adjusted in the original images based on local nucleus and background intensities. The method was developed using a set of 10 3D images. Extensive tests on a separate set of 27 3D images containing 2,367 nuclei demonstrated that our method, in comparison with 6 reference methods, achieved the highest precision (PR = 0.97), recall (RE = 0.88) and F1-score (F1 = 0.93) of nuclei detection. The Jaccard index (JI = 0.83), which reflects the accuracy of nuclei delineation, was similar to that yielded by all reference approaches. Our method was on average more than twice as fast as the reference method that produced the best results. Additional tests carried out on three stacked 3D images comprising heterogenous nuclei yielded average PR = 0.96, RE = 0.84, F1 = 0.89, and JI = 0.80.

CONCLUSIONS

The high-performance metrics yielded by the proposed approach suggest that it can be used to reliably delineate nuclei in 3D images of monolayered and stacked cells exposed to cytotoxic drugs.

A novel jamming phase diagram links tumor invasion to non-equilibrium phase separation

It is well established that the early malignant tumor invades surrounding extracellular matrix (ECM) in a manner that depends upon material properties of constituent cells, surrounding ECM, and their interactions. Recent studies have established the capacity of the invading tumor spheroids to evolve into coexistent solid-like, fluid-like, and gas-like phases. Using breast cancer cell lines invading into engineered ECM, here we show that the spheroid interior develops spatial and temporal heterogeneities in material phase which, depending upon cell type and matrix density, ultimately result in a variety of phase separation patterns at the invasive front. Using a computational approach, we further show that these patterns are captured by a novel jamming phase diagram. We suggest that non-equilibrium phase separation based upon jamming and unjamming transitions may provide a unifying physical picture to describe cellular migratory dynamics within, and invasion from, a tumor.

Methods for analyzing neuronal structure and activity in Caenorhabditis elegans

The model research animal Caenorhabditis elegans has unique properties making it particularly advantageous for studies of the nervous system. The nervous system is composed of a stereotyped complement of neurons connected in a consistent manner. Here, we describe methods for studying nervous system structure and function. The transparency of the animal makes it possible to visualize and identify neurons in living animals with fluorescent probes. These methods have been recently enhanced for the efficient use of neuron-specific reporter genes. Because of its simple structure, for a number of years, C. elegans has been at the forefront of connectomic studies defining synaptic connectivity by electron microscopy. This field is burgeoning with new, more powerful techniques, and recommended up-to-date methods are here described that encourage the possibility of new work in C. elegans. Fluorescent probes for single synapses and synaptic connections have allowed verification of the EM reconstructions and for experimental approaches to synapse formation. Advances in microscopy and in fluorescent reporters sensitive to Ca2+ levels have opened the way to observing activity within single neurons across the entire nervous system.

Automatic wavelet-based 3D nuclei segmentation and analysis for multicellular embryo quantification

Identification of individual cells in tissues, organs, and in various developing systems is a well-studied problem because it is an essential part of objectively analyzing quantitative images in numerous biological contexts. We developed a size-dependent wavelet-based segmentation method that provides robust segmentation without any preprocessing, filtering or fine-tuning steps, and is robust to the signal-to-noise ratio. The wavelet-based method achieves robust segmentation results with respect to True Positive rate, Precision, and segmentation accuracy compared with other commonly used methods. We applied the segmentation program to zebrafish embryonic development IN TOTO for nuclei segmentation, image registration, and nuclei shape analysis. These new approaches to segmentation provide a means to carry out quantitative patterning analysis with single-cell precision throughout three dimensional tissues and embryos and they have a high tolerance for non-uniform and noisy image data sets.

3DeeCellTracker, a deep learning-based pipeline for segmenting and tracking cells in 3D time lapse images

Despite recent improvements in microscope technologies, segmenting and tracking cells in three-dimensional time-lapse images (3D + T images) to extract their dynamic positions and activities remains a considerable bottleneck in the field. We developed a deep learning-based software pipeline, 3DeeCellTracker, by integrating multiple existing and new techniques including deep learning for tracking. With only one volume of training data, one initial correction, and a few parameter changes, 3DeeCellTracker successfully segmented and tracked ~100 cells in both semi-immobilized and 'straightened' freely moving worm's brain, in a naturally beating zebrafish heart, and ~1000 cells in a 3D cultured tumor spheroid. While these datasets were imaged with highly divergent optical systems, our method tracked 90-100% of the cells in most cases, which is comparable or superior to previous results. These results suggest that 3DeeCellTracker could pave the way for revealing dynamic cell activities in image datasets that have been difficult to analyze.

Graphical-model framework for automated annotation of cell identities in dense cellular images

Although identifying cell names in dense image stacks is critical in analyzing functional whole-brain data enabling comparison across experiments, unbiased identification is very difficult, and relies heavily on researchers' experiences. Here, we present a probabilistic-graphical-model framework, CRF_ID, based on Conditional Random Fields, for unbiased and automated cell identification. CRF_ID focuses on maximizing intrinsic similarity between shapes. Compared to existing methods, CRF_ID achieves higher accuracy on simulated and ground-truth experimental datasets, and better robustness against challenging noise conditions common in experimental data. CRF_ID can further boost accuracy by building atlases from annotated data in highly computationally efficient manner, and by easily adding new features (e.g. from new strains). We demonstrate cell annotation in Caenorhabditis elegans images across strains, animal orientations, and tasks including gene-expression localization, multi-cellular and whole-brain functional imaging experiments. Together, these successes demonstrate that unbiased cell annotation can facilitate biological discovery, and this approach may be valuable to annotation tasks for other systems.

OrganoidTracker: Efficient cell tracking using machine learning and manual error correction

Time-lapse microscopy is routinely used to follow cells within organoids, allowing direct study of division and differentiation patterns. There is an increasing interest in cell tracking in organoids, which makes it possible to study their growth and homeostasis at the single-cell level. As tracking these cells by hand is prohibitively time consuming, automation using a computer program is required. Unfortunately, organoids have a high cell density and fast cell movement, which makes automated cell tracking difficult. In this work, a semi-automated cell tracker has been developed. To detect the nuclei, we use a machine learning approach based on a convolutional neural network. To form cell trajectories, we link detections at different time points together using a min-cost flow solver. The tracker raises warnings for situations with likely errors. Rapid changes in nucleus volume and position are reported for manual review, as well as cases where nuclei divide, appear and disappear. When the warning system is adjusted such that virtually error-free lineage trees can be obtained, still less than 2% of all detected nuclei positions are marked for manual analysis. This provides an enormous speed boost over manual cell tracking, while still providing tracking data of the same quality as manual tracking.

Software tools for 3D nuclei segmentation and quantitative analysis in multicellular aggregates

Today, we are fully immersed into the era of 3D biology. It has been extensively demonstrated that 3D models: (a) better mimic the physiology of human tissues; (b) can effectively replace animal models; (c) often provide more reliable results than 2D ones. Accordingly, anti-cancer drug screenings and toxicology studies based on multicellular 3D biological models, the so-called "-oids" (e.g. spheroids, tumoroids, organoids), are blooming in the literature. However, the complex nature of these systems limit the manual quantitative analyses of single cells' behaviour in the culture. Accordingly, the demand for advanced software tools that are able to perform phenotypic analysis is fundamental. In this work, we describe the freely accessible tools that are currently available for biologists and researchers interested in analysing the effects of drugs/treatments on 3D multicellular -oids at a single-cell resolution level. In addition, using publicly available nuclear stained datasets we quantitatively compare the segmentation performance of 9 specific tools.

Neuron ID dataset facilitates neuronal annotation for whole-brain activity imaging of C. elegans

BACKGROUND

Annotation of cell identity is an essential process in neuroscience that allows comparison of cells, including that of neural activities across different animals. In Caenorhabditis elegans, although unique identities have been assigned to all neurons, the number of annotatable neurons in an intact animal has been limited due to the lack of quantitative information on the location and identity of neurons.

RESULTS

Here, we present a dataset that facilitates the annotation of neuronal identities, and demonstrate its application in a comprehensive analysis of whole-brain imaging. We systematically identified neurons in the head region of 311 adult worms using 35 cell-specific promoters and created a dataset of the expression patterns and the positions of the neurons. We found large positional variations that illustrated the difficulty of the annotation task. We investigated multiple combinations of cell-specific promoters driving distinct fluorescence and generated optimal strains for the annotation of most head neurons in an animal. We also developed an automatic annotation method with human interaction functionality that facilitates annotations needed for whole-brain imaging.

CONCLUSION

Our neuron ID dataset and optimal fluorescent strains enable the annotation of most neurons in the head region of adult C. elegans, both in full-automated fashion and a semi-automated version that includes human interaction functionalities. Our method can potentially be applied to model species used in research other than C. elegans, where the number of available cell-type-specific promoters and their variety will be an important consideration.

Multi-Domain Networks Association for Biological Data Using Block Signed Graph Clustering

Multi-domain biological network association and clustering have attracted a lot of attention in biological data integration and understanding, which can provide a more global and accurate understanding of biological phenomenon. In many problems, different domains may have different cluster structures. Due to rapid growth of data collection from different sources, some domains may be strongly or weakly associated with the other domains. A key challenge is how to determine the degree of association among different domains, and to achieve accurate clustering results by data integration. In this paper, we propose an unsupervised learning approach for multi-domain network association by using block signed graph clustering. In particular, with consistency weights calculation, the proposed algorithm automatically identify domains relevant to each other strongly (or weakly) by assigning them larger (or smaller) weights. This approach not only significantly improve clustering accuracy but also understand multi-domain networks association. In each iteration of the proposed algorithm, we update consistency weights based on cluster structure of each domain, and then make use of different sets of eigenvectors to obtain different cluster structures in each domain. Experimental results on both synthetic data sets and real data sets (including neuron activity data and gene expression data) empirically demonstrate the effectiveness of the proposed algorithm in clustering performance and in domain association capability.

Routine Optical Clearing of 3D-Cell Cultures: Simplicity Forward

Three-dimensional cell cultures, such as spheroids and organoids, serve as increasingly important models in fundamental and applied research and start to be used for drug screening purposes. Optical tissue clearing procedures are employed to enhance visualization of fluorescence-stained organs, tissues, and three-dimensional cell cultures. To get a more systematic overview about the effects and applicability of optical tissue clearing on three-dimensional cell cultures, we compared six different clearing/embedding protocols on seven types of spheroid- and chip-based three-dimensional cell cultures of approximately 300 μm in size that were stained with nuclear dyes, immunofluorescence, cell trackers, and cyan fluorescent protein. Subsequent whole mount confocal microscopy and semi-automated image analysis were performed to quantify the effects. Quantitative analysis included fluorescence signal intensity and signal-to-noise ratio as a function of z-depth as well as segmentation and counting of nuclei and immunopositive cells. In general, these analyses revealed five key points, which largely confirmed current knowledge and were quantified in this study. First, there was a massive variability of effects of different clearing protocols on sample transparency and shrinkage as well as on dye quenching. Second, all tested clearing protocols worked more efficiently on samples prepared with one cell type than on co-cultures. Third, z-compensation was imperative to minimize variations in signal-to-noise ratio. Fourth, a combination of sample-inherent cell density, sample shrinkage, uniformity of signal-to-noise ratio, and image resolution had a strong impact on data segmentation, cell counts, and relative numbers of immunofluorescence-positive cells. Finally, considering all mentioned aspects and including a wish for simplicity and speed of protocols - in particular, for screening purposes - clearing with 88% Glycerol appeared to be the most promising option amongst the ones tested.

DeepSynth: Three-dimensional nuclear segmentation of biological images using neural networks trained with synthetic data

The scale of biological microscopy has increased dramatically over the past ten years, with the development of new modalities supporting collection of high-resolution fluorescence image volumes spanning hundreds of microns if not millimeters. The size and complexity of these volumes is such that quantitative analysis requires automated methods of image processing to identify and characterize individual cells. For many workflows, this process starts with segmentation of nuclei that, due to their ubiquity, ease-of-labeling and relatively simple structure, make them appealing targets for automated detection of individual cells. However, in the context of large, three-dimensional image volumes, nuclei present many challenges to automated segmentation, such that conventional approaches are seldom effective and/or robust. Techniques based upon deep-learning have shown great promise, but enthusiasm for applying these techniques is tempered by the need to generate training data, an arduous task, particularly in three dimensions. Here we present results of a new technique of nuclear segmentation using neural networks trained on synthetic data. Comparisons with results obtained using commonly-used image processing packages demonstrate that DeepSynth provides the superior results associated with deep-learning techniques without the need for manual annotation.

Three-Dimensional Segmentation and Reconstruction of Neuronal Nuclei in Confocal Microscopic Images

The detailed architectural examination of the neuronal nuclei in any brain region, using confocal microscopy, requires quantification of fluorescent signals in three-dimensional stacks of confocal images. An essential prerequisite to any quantification is the segmentation of the nuclei which are typically tightly packed in the tissue, the extreme being the hippocampal dentate gyrus (DG), in which nuclei frequently appear to overlap due to limitations in microscope resolution. Segmentation in DG is a challenging task due to the presence of a significant amount of image artifacts and densely packed nuclei. Accordingly, we established an algorithm based on continuous boundary tracing criterion aiming to reconstruct the nucleus surface and to separate the adjacent nuclei. The presented algorithm neither uses a pre-built nucleus model, nor performs image thresholding, which makes it robust against variations in image intensity and poor contrast. Further, the reconstructed surface is used to study morphology and spatial arrangement of the nuclear interior. The presented method is generally dedicated to segmentation of crowded, overlapping objects in 3D space. In particular, it allows us to study quantitatively the architecture of the neuronal nucleus using confocal-microscopic approach.

Irrational behavior in C. elegans arises from asymmetric modulatory effects within single sensory neurons

C. elegans worms exhibit a natural chemotaxis towards food cues. This provides a potential platform to study the interactions between stimulus valence and innate behavioral preferences. Here we perform a comprehensive set of choice assays to measure worms' relative preference towards various attractants. Surprisingly, we find that when facing a combination of choices, worms' preferences do not always follow value-based hierarchy. In fact, the innate chemotaxis behavior in worms robustly violates key rationality paradigms of transitivity, independence of irrelevant alternatives and regularity. These violations arise due to asymmetric modulatory effects between the presented options. Functional analysis of the entire chemosensory system at a single-neuron resolution, coupled with analyses of mutants, defective in individual neurons, reveals that these asymmetric effects originate in specific sensory neurons.

Digging deeper: methodologies for high-content phenotyping in Caenorhabditis elegans

Deep phenotyping is an emerging conceptual paradigm and experimental approach aimed at measuring and linking many aspects of a phenotype to understand its underlying biology. To date, deep phenotyping has been applied mostly in cultured cells and used less in multicellular organisms. However, in the past decade, it has increasingly been recognized that deep phenotyping could lead to a better understanding of how genetics, environment and stochasticity affect the development, physiology and behavior of an organism. The nematode Caenorhabditis elegans is an invaluable model system for studying how genes affect a phenotypic trait, and new technologies have taken advantage of the worm's physical attributes to increase the throughput and informational content of experiments. Coupling of these technical advancements with computational and analytical tools has enabled a boom in deep-phenotyping studies of C. elegans. In this Review, we highlight how these new technologies and tools are digging into the biological origins of complex, multidimensional phenotypes.

Diffuse light-sheet microscopy for stripe-free calcium imaging of neural populations

Light-sheet microscopy is used extensively in developmental biology and neuroscience. One limitation of this approach is that absorption and scattering produces shadows in the illuminating light sheet, resulting in stripe artifacts. Here, we introduce diffuse light-sheet microscopes that use a line diffuser to randomize the light propagation within the image plane, allowing the light sheets to reform after obstacles. We incorporate diffuse light sheets in two existing configurations: selective plane illumination microscopy in which the sample is illuminated with a static sheet of light, and digitally scanned light sheet (DSLS) in which a thin Gaussian beam is scanned across the image plane during each acquisition. We compare diffuse light-sheet microscopes to their conventional counterparts for calcium imaging of neural activity in larval zebrafish. We show that stripe artifacts can cast deep shadows that conceal some neurons, and that the stripes can flicker, producing spurious signals that could be interpreted as biological activity. Diffuse light-sheets mitigate these problems, illuminating the blind spots produced by stripes and removing artifacts produced by the stripes' movements. The upgrade to diffuse light sheets is simple and inexpensive, especially in the case of DSLS, where it requires the addition of one optical element.

Ratiometric Calcium Imaging of Individual Neurons in Behaving Caenorhabditis Elegans

It has become increasingly clear that neural circuit activity in behaving animals differs substantially from that seen in anesthetized or immobilized animals. Highly sensitive, genetically encoded fluorescent reporters of Ca²⁺ have revolutionized the recording of cell and synaptic activity using non-invasive optical approaches in behaving animals. When combined with genetic and optogenetic techniques, the molecular mechanisms that modulate cell and circuit activity during different behavior states can be identified. Here we describe methods for ratiometric Ca²⁺ imaging of single neurons in freely behaving Caenorhabditis elegans worms. We demonstrate a simple mounting technique that gently overlays worms growing on a standard Nematode Growth Media (NGM) agar block with a glass coverslip, permitting animals to be recorded at high-resolution during unrestricted movement and behavior. With this technique, we use the sensitive Ca²⁺ reporter GCaMP5 to record changes in intracellular Ca²⁺ in the serotonergic Hermaphrodite Specific Neurons (HSNs) as they drive egg-laying behavior. By co-expressing mCherry, a Ca²⁺-insensitive fluorescent protein, we can track the position of the HSN within ~ 1 µm and correct for fluctuations in fluorescence caused by changes in focus or movement. Simultaneous, infrared brightfield imaging allows for behavior recording and animal tracking using a motorized stage. By integrating these microscopic techniques and data streams, we can record Ca²⁺ activity in the C. elegans egg-laying circuit as it progresses between inactive and active behavior states over tens of minutes.

Automatically tracking neurons in a moving and deforming brain

Advances in optical neuroimaging techniques now allow neural activity to be recorded with cellular resolution in awake and behaving animals. Brain motion in these recordings pose a unique challenge. The location of individual neurons must be tracked in 3D over time to accurately extract single neuron activity traces. Recordings from small invertebrates like C. elegans are especially challenging because they undergo very large brain motion and deformation during animal movement. Here we present an automated computer vision pipeline to reliably track populations of neurons with single neuron resolution in the brain of a freely moving C. elegans undergoing large motion and deformation. 3D volumetric fluorescent images of the animal's brain are straightened, aligned and registered, and the locations of neurons in the images are found via segmentation. Each neuron is then assigned an identity using a new time-independent machine-learning approach we call Neuron Registration Vector Encoding. In this approach, non-rigid point-set registration is used to match each segmented neuron in each volume with a set of reference volumes taken from throughout the recording. The way each neuron matches with the references defines a feature vector which is clustered to assign an identity to each neuron in each volume. Finally, thin-plate spline interpolation is used to correct errors in segmentation and check consistency of assigned identities. The Neuron Registration Vector Encoding approach proposed here is uniquely well suited for tracking neurons in brains undergoing large deformations. When applied to whole-brain calcium imaging recordings in freely moving C. elegans, this analysis pipeline located 156 neurons for the duration of an 8 minute recording and consistently found more neurons more quickly than manual or semi-automated approaches.