Efficient Shape Priors for Spline-Based Snakes

3D Interactive Segmentation With Semi-Implicit Representation and Active Learning

Segmenting complex 3D geometry is a challenging task due to rich structural details and complex appearance variations of target object. Shape representation and foreground-background delineation are two of the core components of segmentation. Explicit shape models, such as mesh based representations, suffer from poor handling of topological changes. On the other hand, implicit shape models, such as level-set based representations, have limited capacity for interactive manipulation. Fully automatic segmentation for separating foreground objects from background generally utilizes non-interoperable machine learning methods, which heavily rely on the off-line training dataset and are limited to the discrimination power of the chosen model. To address these issues, we propose a novel semi-implicit representation method, namely Non-Uniform Implicit B-spline Surface (NU-IBS), which adaptively distributes parametrically blended patches according to geometrical complexity. Then, a two-stage cascade classifier is introduced to carry out efficient foreground and background delineation, where a simplistic Naïve-Bayesian model is trained for fast background elimination, followed by a stronger pseudo-3D Convolutional Neural Network (CNN) multi-scale classifier to precisely identify the foreground objects. A localized interactive and adaptive segmentation scheme is incorporated to boost the delineation accuracy by utilizing the information iteratively gained from user intervention. The segmentation result is obtained via deforming an NU-IBS according to the probabilistic interpretation of delineated regions, which also imposes a homogeneity constrain for individual segments. The proposed method is evaluated on a 3D cardiovascular Computed Tomography Angiography (CTA) image dataset and Brain Tumor Image Segmentation Benchmark 2015 (BraTS2015) 3D Magnetic Resonance Imaging (MRI) dataset.

Active Subdivision Surfaces for the Semiautomatic Segmentation of Biomedical Volumes

We present a new family of active surfaces for the semiautomatic segmentation of volumetric objects in 3D biomedical images. We represent our deformable model by a subdivision surface encoded by a small set of control points and generated through a geometric refinement process. The subdivision operator confers important properties to the surface such as smoothness, reproduction of desirable shapes and interpolation of the control points. We deform the subdivision surface through the minimization of suitable gradient-based and region-based energy terms that we have designed for that purpose. In addition, we provide an easy way to combine these energies with convolutional neural networks. Our active subdivision surface satisfies the property of multiresolution, which allows us to adopt a coarse-to-fine optimization strategy. This speeds up the computations and decreases its dependence on initialization compared to singleresolution active surfaces. Performance evaluations on both synthetic and real biomedical data show that our active subdivision surface is robust in the presence of noise and outperforms current state-of-the-art methods. In addition, we provide a software that gives full control over the active subdivision surface via an intuitive manipulation of the control points.

Morphologically constrained and data informed cell segmentation of budding yeast

Motivation

Although high-content image cytometry is becoming increasingly routine, processing the large amount of data acquired during time-lapse experiments remains a challenge. The majority of approaches for automated single-cell segmentation focus on flat, uniform fields of view covered with a single layer of cells. In the increasingly popular microfluidic devices that trap individual cells for long term imaging, these conditions are not met. Consequently, most techniques for segmentation perform poorly. Although potentially constraining the generalizability of software, incorporating information about the microfluidic features, flow of media and the morphology of the cells can substantially improve performance.

Results

Here we present DISCO (Data Informed Segmentation of Cell Objects), a framework for using the physical constraints imposed by microfluidic traps, the shape based morphological constraints of budding yeast and temporal information about cell growth and motion to allow tracking and segmentation of cells in microfluidic devices. Using manually curated datasets, we demonstrate substantial improvements in both tracking and segmentation when compared with existing software.

Availability and implementation

The MATLAB code for the algorithm and for measuring performance is available at https://github.com/pswain/segmentation-software and the test images and the curated ground-truth results used for comparing the algorithms are available at http://datashare.is.ed.ac.uk/handle/10283/2002.

Contact

mcrane2@uw.edu.

Supplementary information

Supplementary data are available at Bioinformatics online.

Automated Region of Interest Detection Method in Scintigraphic Glomerular Filtration Rate Estimation

The glomerular filtration rate (GFR) is a crucial index to measure renal function. In daily clinical practice, the GFR can be estimated using the Gates method, which requires the clinicians to define the region of interest (ROI) for the kidney and the corresponding background in dynamic renal scintigraphy. The manual placement of ROIs to estimate the GFR is subjective and labor-intensive, however, making it an undesirable and unreliable process. This work presents a fully automated ROI detection method to achieve accurate and robust GFR estimations. After image preprocessing, the ROI for each kidney was delineated using a shape prior constrained level set (spLS) algorithm and then the corresponding background ROIs were obtained according to the defined kidney ROIs. In computer simulations, the spLS method had the best performance in kidney ROI detection compared with the previous threshold method (threshold) and the Chan-Vese level set (cvLS) method. In further clinical applications, 223 sets of ^99mTc-diethylenetriaminepentaacetic acid renal scintigraphic images from patients with abnormal renal function were reviewed. Compared with the former ROI detection methods (threshold and cvLS), the GFR estimations based on the ROIs derived by the spLS method had the highest consistency and correlations (r = 0.98, p < 0.001) with the reference estimated by experienced physicians. The results indicate that the proposed automated ROI detection method has great potential in automated ROI detection for accurate and robust GFR estimation in dynamic renal scintigraphy.

Landmark-Based Shape Encoding and Sparse-Dictionary Learning in the Continuous Domain

We provide a generic framework to learn shape dictionaries of landmark-based curves that are defined in the continuous domain. We first present an unbiased alignment method that involves the construction of a mean shape as well as training sets whose elements are subspaces that contain all affine transformations of the training samples. The alignment relies on orthogonal projection operators that have a closed form. We then present algorithms to learn shape dictionaries according to the structure of the data that needs to be encoded: 1) projection-based functional principal-component analysis for homogeneous data and 2) continuous-domain sparse shape encoding to learn dictionaries that contain imbalanced data, outliers, or different types of shape structures. Through parametric spline curves, we provide a detailed and exact implementation of our method. We demonstrate that it requires fewer parameters than purely discrete methods and that it is computationally more efficient and accurate. We illustrate the use of our framework for dictionary learning of structures in biomedical images as well as for shape analysis in bioimaging.

FlyLimbTracker: An active contour based approach for leg segment tracking in unmarked, freely behaving Drosophila

Understanding the biological underpinnings of movement and action requires the development of tools for quantitative measurements of animal behavior. Drosophila melanogaster provides an ideal model for developing such tools: the fly has unparalleled genetic accessibility and depends on a relatively compact nervous system to generate sophisticated limbed behaviors including walking, reaching, grooming, courtship, and boxing. Here we describe a method that uses active contours to semi-automatically track body and leg segments from video image sequences of unmarked, freely behaving D. melanogaster. We show that this approach yields a more than 6-fold reduction in user intervention when compared with fully manual annotation and can be used to annotate videos with low spatial or temporal resolution for a variety of locomotor and grooming behaviors. FlyLimbTracker, the software implementation of this method, is open-source and our approach is generalizable. This opens up the possibility of tracking leg movements in other species by modifications of underlying active contour models.