A fully automatic vertebra segmentation method using 3D deformable fences

Are current machine learning applications comparable to radiologist classification of degenerate and herniated discs and Modic change? A systematic review and meta-analysis

INTRODUCTION

Low back pain is the leading contributor to disability burden globally. It is commonly due to degeneration of the lumbar intervertebral discs (LDD). Magnetic resonance imaging (MRI) is the current best tool to visualize and diagnose LDD, but places high time demands on clinical radiologists. Automated reading of spine MRIs could improve speed, accuracy, reliability and cost effectiveness in radiology departments. The aim of this review and meta-analysis was to determine if current machine learning algorithms perform well identifying disc degeneration, herniation, bulge and Modic change compared to radiologists.

METHODS

A PRISMA systematic review protocol was developed and four electronic databases and reference lists were searched. Strict inclusion and exclusion criteria were defined. A PROBAST risk of bias and applicability analysis was performed.

RESULTS

1350 articles were extracted. Duplicates were removed and title and abstract searching identified original research articles that used machine learning (ML) algorithms to identify disc degeneration, herniation, bulge and Modic change from MRIs. 27 studies were included in the review; 25 and 14 studies were included multi-variate and bivariate meta-analysis, respectively. Studies used machine learning algorithms to assess LDD, disc herniation, bulge and Modic change. Models using deep learning, support vector machine, k-nearest neighbors, random forest and naïve Bayes algorithms were included. Meta-analyses found no differences in algorithm or classification performance. When algorithms were tested in replication or external validation studies, they did not perform as well as when assessed in developmental studies. Data augmentation improved algorithm performance when compared to models used with smaller datasets, there were no performance differences between augmented data and large datasets.

DISCUSSION

This review highlights several shortcomings of current approaches, including few validation attempts or use of large sample sizes. To the best of the authors' knowledge, this is the first systematic review to explore this topic. We suggest the utilization of deep learning coupled with semi- or unsupervised learning approaches. Use of all information contained in MRI data will improve accuracy. Clear and complete reporting of study design, statistics and results will improve the reliability and quality of published literature.

Addressing Challenges of Opportunistic Computed Tomography Bone Mineral Density Analysis

Computed tomography (CT) offers advanced biomedical imaging of the body and is broadly utilized for clinical diagnosis. Traditionally, clinical CT scans have not been used for volumetric bone mineral density (vBMD) assessment; however, computational advances can now leverage clinically obtained CT data for the secondary analysis of bone, known as opportunistic CT analysis. Initial applications focused on using clinically acquired CT scans for secondary osteoporosis screening, but opportunistic CT analysis can also be applied to answer research questions related to vBMD changes in response to various disease states. There are several considerations for opportunistic CT analysis, including scan acquisition, contrast enhancement, the internal calibration technique, and bone segmentation, but there remains no consensus on applying these methods. These factors may influence vBMD measures and therefore the robustness of the opportunistic CT analysis. Further research and standardization efforts are needed to establish a consensus and optimize the application of opportunistic CT analysis for accurate and reliable assessment of vBMD in clinical and research settings. This review summarizes the current state of opportunistic CT analysis, highlighting its potential and addressing the associated challenges.

A deep learning framework for vertebral morphometry and Cobb angle measurement with external validation

PURPOSE

To propose a fully automated deep learning (DL) framework for the vertebral morphometry and Cobb angle measurement from three-dimensional (3D) computed tomography (CT) images of the spine, and validate the proposed framework on an external database.

METHODS

The vertebrae were first localized and segmented in each 3D CT image using a DL architecture based on an ensemble of U-Nets, and then automated vertebral morphometry in the form of vertebral body (VB) and intervertebral disk (IVD) heights, and spinal curvature measurements in the form of coronal and sagittal Cobb angles (thoracic kyphosis and lumbar lordosis) were performed using dedicated machine learning techniques. The framework was trained on 1725 vertebrae from 160 CT images and validated on an external database of 157 vertebrae from 15 CT images.

RESULTS

The resulting mean absolute errors (± standard deviation) between the obtained DL and corresponding manual measurements were 1.17 ± 0.40 mm for VB heights, 0.54 ± 0.21 mm for IVD heights, and 3.42 ± 1.36° for coronal and sagittal Cobb angles, with respective maximal absolute errors of 2.51 mm, 1.64 mm, and 5.52°. Linear regression revealed excellent agreement, with Pearson's correlation coefficient of 0.943, 0.928, and 0.996, respectively.

CONCLUSION

The obtained results are within the range of values, obtained by existing DL approaches without external validation. The results therefore confirm the scalability of the proposed DL framework from the perspective of application to external data, and time and computational resource consumption required for framework training.

SVseg: Stacked Sparse Autoencoder-Based Patch Classification Modeling for Vertebrae Segmentation

Precise vertebrae segmentation is essential for the image-related analysis of spine pathologies such as vertebral compression fractures and other abnormalities, as well as for clinical diagnostic treatment and surgical planning. An automatic and objective system for vertebra segmentation is required, but its development is likely to run into difficulties such as low segmentation accuracy and the requirement of prior knowledge or human intervention. Recently, vertebral segmentation methods have focused on deep learning-based techniques. To mitigate the challenges involved, we propose deep learning primitives and stacked Sparse autoencoder-based patch classification modeling for Vertebrae segmentation (SVseg) from Computed Tomography (CT) images. After data preprocessing, we extract overlapping patches from CT images as input to train the model. The stacked sparse autoencoder learns high-level features from unlabeled image patches in an unsupervised way. Furthermore, we employ supervised learning to refine the feature representation to improve the discriminability of learned features. These high-level features are fed into a logistic regression classifier to fine-tune the model. A sigmoid classifier is added to the network to discriminate the vertebrae patches from non-vertebrae patches by selecting the class with the highest probabilities. We validated our proposed SVseg model on the publicly available MICCAI Computational Spine Imaging (CSI) dataset. After configuration optimization, our proposed SVseg model achieved impressive performance, with 87.39% in Dice Similarity Coefficient (DSC), 77.60% in Jaccard Similarity Coefficient (JSC), 91.53% in precision (PRE), and 90.88% in sensitivity (SEN). The experimental results demonstrated the method’s efficiency and significant potential for diagnosing and treating clinical spinal diseases.

Spine and Individual Vertebrae Segmentation in Computed Tomography Images Using Geometric Flows and Shape Priors

The surgical treatment of injuries to the spine often requires the placement of pedicle screws. To prevent damage to nearby blood vessels and nerves, the individual vertebrae and their surrounding tissue must be precisely localized. To aid surgical planning in this context we present a clinically applicable geometric flow based method to segment the human spinal column from computed tomography (CT) scans. We first apply anisotropic diffusion and flux computation to mitigate the effects of region inhomogeneities and partial volume effects at vertebral boundaries in such data. The first pipeline of our segmentation approach uses a region-based geometric flow, requires only a single manually identified seed point to initiate, and runs efficiently on a multi-core central processing unit (CPU). A shape-prior formulation is employed in a separate second pipeline to segment individual vertebrae, using both region and boundary based terms to augment the initial segmentation. We validate our method on four different clinical databases, each of which has a distinct intensity distribution. Our approach obviates the need for manual segmentation, significantly reduces inter- and intra-observer differences, runs in times compatible with use in a clinical workflow, achieves Dice scores that are comparable to the state of the art, and yields precise vertebral surfaces that are well within the acceptable 2 mm mark for surgical interventions.

A semi-automatic seed point-based method for separation of individual vertebrae in 3D surface meshes: a proof of principle study

PURPOSE

The purpose of this paper is to present and validate a new semi-automated 3D surface mesh segmentation approach that optimizes the laborious individual human vertebrae separation in the spinal virtual surgical planning workflow and make a direct accuracy and segmentation time comparison with current standard segmentation method.

METHODS

The proposed semi-automatic method uses the 3D bone surface derived from CT image data for seed point-based 3D mesh partitioning. The accuracy of the proposed method was evaluated on a representative patient dataset. In addition, the influence of the number of used seed points was studied. The investigators analyzed whether there was a reduction in segmentation time when compared to manual segmentation. Surface-to-surface accuracy measurements were applied to assess the concordance with the manual segmentation.

RESULTS

The results demonstrated a statically significant reduction in segmentation time, while maintaining a high accuracy compared to the manual segmentation. A considerably smaller error was found when increasing the number of seed points. Anatomical regions that include articulating areas tend to show the highest errors, while the posterior laminar surface yielded an almost negligible error.

CONCLUSION

A novel seed point initiated surface based segmentation method for the laborious individual human vertebrae separation was presented. This proof-of-principle study demonstrated the accuracy of the proposed method on a clinical CT image dataset and its feasibility for spinal virtual surgical planning applications.

Fully automated 3D segmentation and separation of multiple cervical vertebrae in CT images using a 2D convolutional neural network

BACKGROUND AND OBJECTIVE

We investigated a novel method using a 2D convolutional neural network (CNN) to identify superior and inferior vertebrae in a single slice of CT images, and a post-processing for 3D segmentation and separation of cervical vertebrae.

METHODS

The cervical spines of patients (N == 17, 1684 slices) from Severance and Gangnam Severance Hospitals (S/GSH) and healthy controls (N == 24, 3490 slices) from Seoul National University Bundang Hospital (SNUBH) were scanned by using various volumetric CT protocols. To prepare gold standard masks of cervical spine in CT images, each spine was segmented by using conventional image-processing methods and manually corrected by an expert. The gold standard masks were preprocessed and labeled into superior and inferior cervical vertebrae separately in the axial slices. The 2D U-Net model was trained by using the disease dataset (S/GSH) and additional validation was performed by using the healthy control dataset (SNUBH), and then the training and validation were repeated by switching the two datasets.

RESULTS

In case of the model was trained with the disease dataset (S/GSH) and validated with the healthy control (SNUBH), the mean and standard deviation (SD) of the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD) were 94.37%% ± 1.45%, 89.47%% ± 2.55%, 0.33 ± 0.12 mm and 20.89 ± 3.98 mm, and 88.67%% ± 5.82%, 80.83%% ± 8.09%, 1.05 ± 0.63 mm and 29.17 ± 19.74 mm, respectively. In case of the model was trained with the healthy control (SNUBH) and validated with the disease dataset (S/GSH), the mean and SD of DSC, JSC, MSD, and HSD were 96.23%% ± 1.55%, 92.95%% ± 2.58%, 0.39 ± 0.20 mm and 16.23 ± 6.72 mm, and 93.15%% ± 3.09%, 87.54%% ± 5.11%, 0.38 ± 0.17 mm and 20.85 ± 7.11 mm, respectively.

CONCLUSIONS

The results demonstrated that our fully automated method achieved comparable accuracies with inter- and intra-observer variabilities of manual segmentation by human experts, which is time consuming.

Machine learning for automated 3-dimensional segmentation of the spine and suggested placement of pedicle screws based on intraoperative cone-beam computer tomography

OBJECTIVE

The goal of this study was to develop and validate a system for automatic segmentation of the spine, pedicle identification, and screw path suggestion for use with an intraoperative 3D surgical navigation system.

METHODS

Cone-beam CT (CBCT) images of the spines of 21 cadavers were obtained. An automated model-based approach was used for segmentation. Using machine learning methodology, the algorithm was trained and validated on the image data sets. For measuring accuracy, surface area errors of the automatic segmentation were compared to the manually outlined reference surface on CBCT. To further test both technical and clinical accuracy, the algorithm was applied to a set of 20 clinical cases. The authors evaluated the system's accuracy in pedicle identification by measuring the distance between the user-defined midpoint of each pedicle and the automatically segmented midpoint. Finally, 2 independent surgeons performed a qualitative evaluation of the segmentation to judge whether it was adequate to guide surgical navigation and whether it would have resulted in a clinically acceptable pedicle screw placement.

RESULTS

The clinically relevant pedicle identification and automatic pedicle screw planning accuracy was 86.1%. By excluding patients with severe spinal deformities (i.e., Cobb angle > 75° and severe spinal degeneration) and previous surgeries, a success rate of 95.4% was achieved. The mean time (± SD) for automatic segmentation and screw planning in 5 vertebrae was 11 ± 4 seconds.

CONCLUSIONS

The technology investigated has the potential to aid surgeons in navigational planning and improve surgical navigation workflow while maintaining patient safety.

N-Net: 3D Fully Convolution Network-Based Vertebrae Segmentation from CT Spinal Images

Accurate vertebrae segmentation from CT spinal images is crucial for the clinical tasks of diagnosis, surgical planning, and post-operative assessment. This paper describes an [Formula: see text]-shaped 3D fully convolution network (FCN) for vertebrae segmentation: [Formula: see text]-net. In this network, a global structure guidance pathway is designed for fusing the high-level semantic features with the global structure information. Moreover, the residual structure and the skip connection are introduced into traditional 3D FCN framework. These schemes can significantly improve the accuracy of vertebrae segmentation. Experimental results demonstrate the effectiveness and robustness of our method. A high average DICE score of 0.9499 [Formula: see text] 0.02 can be obtained, which is better than those of existing methods.

Automatic Deep Feature Learning via Patch-Based Deep Belief Network for Vertebrae Segmentation in CT Images

Precise automatic vertebra segmentation in computed tomography (CT) images is important for the quantitative analysis of vertebrae-related diseases but remains a challenging task due to high variation in spinal anatomy among patients. In this paper, we propose a deep learning approach for automatic CT vertebra segmentation named patch-based deep belief networks (PaDBNs). Our proposed PaDBN model automatically selects the features from image patches and then measures the differences between classes and investigates performance. The region of interest (ROI) is obtained from CT images. Unsupervised feature reduction contrastive divergence algorithm is applied for weight initialization, and the weights are optimized by layers in a supervised fine-tuning procedure. The discriminative learning features obtained from the steps above are used as input of a classifier to obtain the likelihood of the vertebrae. Experimental results demonstrate that the proposed PaDBN model can considerably reduce computational cost and produce an excellent performance in vertebra segmentation in terms of accuracy compared with state-of-the-art methods.

Automatic Global Level Set Approach for Lumbar Vertebrae CT Image Segmentation

Vertebrae computed tomography (CT) image automatic segmentation is an essential step for Image-guided minimally invasive spine surgery. However, most of state-of-the-art methods still require human intervention due to the inherent limitations of vertebrae CT image, such as topological variation, irregular boundaries (double boundary, weak boundary), and image noise. Therefore, this paper intentionally designed an automatic global level set approach (AGLSA), which is capable of dealing with these issues for lumbar vertebrae CT image segmentation. Unlike the traditional level set methods, we firstly propose an automatically initialized level set function (AILSF) that comprises hybrid morphological filter (HMF) and Gaussian mixture model (GMM) to automatically generate a smooth initial contour which is precisely adjacent to the object boundary. Secondly, a regularized level set formulation is introduced to overcome the weak boundary leaking problem, which utilizes the region correlation of histograms inside and outside the level set contour as a global term. Ultimately, a gradient vector flow (GVF) based edge-stopping function is employed to guarantee a fast convergence rate of the level set evolution and to avoid level set function oversegmentation at the same time. Our proposed approach has been tested on 115 vertebrae CT volumes of various patients. Quantitative comparisons validate that our proposed AGLSA is more accurate in segmenting lumbar vertebrae CT images with irregular boundaries and more robust to various levels of salt-and-pepper noise.

Automatic segmentation of vertebrae in 3D CT images using adaptive fast 3D pulse coupled neural networks

Two systems are presented for segmentation of vertebrae in a 3D computed tomography (CT) image. The first method extracts seven features from each voxel and uses a multi-layer perceptron neural network (MLPNN) to classify the voxel as vertebrae or background. In the second method, the segmentation is completed in two steps: first, a newly developed adaptive pulse coupled neural network (APCNN) directly applied to a given image segments vertebrae, then the result is refined using a median filter. In the developed APCNN, the values for the user-defined parameters of the pulse coupled neural networks (PCNN) are adaptively adjusted for each image individually, instead of using one value for all images as in conventional PCNN. The performance of both systems in terms of Dice index (DI) was evaluated and compared against the state-of-the-art segmentation methods using seventeen clinical and standard CT images. Overall, both systems demonstrated statistically similar and promising performance with average DI > 95%. Compared to existing PCNN-based segmentation algorithms, the accuracy of the proposed APCNN improved by 29.3% on average. The developed APCNN-based system is more accurate than MLPNN-based system and existing PCNN-based algorithms in segmentation of vertebrae with blurred and weak boundaries and in the images contaminated by salt- and- pepper noise. In terms of computation time, the APCNN-based system is 16 times faster than the MLPNN-based system. Consequently, the presented APCNN-based algorithm is both accurate and fast and could be used in clinical environment for segmentation of vertebrae in 3D CT images.

Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation

With the advent of fully automated image analysis and modern machine learning methods, there is a need for very large image datasets having documented segmentations for both computer algorithm training and evaluation. This paper presents a method and implementation for facilitating such datasets that addresses the critical issue of size scaling for algorithm validation and evaluation; current evaluation methods that are usually used in academic studies do not scale to large datasets. This method includes protocols for the documentation of many regions in very large image datasets; the documentation may be incrementally updated by new image data and by improved algorithm outcomes. This method has been used for 5 years in the context of chest health biomarkers from low-dose chest CT images that are now being used with increasing frequency in lung cancer screening practice. The lung scans are segmented into over 100 different anatomical regions, and the method has been applied to a dataset of over 20,000 chest CT images. Using this framework, the computer algorithms have been developed to achieve over 90% acceptable image segmentation on the complete dataset.

Vertebra segmentation based on two-step refinement

Knowledge of vertebra location, shape, and orientation is crucial in many medical applications such as orthopedics or interventional procedures. Computed tomography (CT) offers a high contrast between bone and soft tissues, but automatic vertebra segmentation remains difficult. Hence, the wide range of shapes, aging, and degenerative joint disease alterations as well as the variety of pathological cases encountered in an aging population make automatic segmentation sometimes challenging. Besides, daily practice implies a need for affordable computation time.

This paper aims to present a new automated vertebra segmentation method (using a first bounding box for initialization) for CT 3D data which tackles these problems. This method is based on two consecutive steps. The first one is a new coarse-to-fine method efficiently reducing the data amount to obtain a coarse shape of the vertebra. The second step consists in a hidden Markov chain (HMC) segmentation using a specific volume transformation within a Bayesian framework. Our method does not introduce any prior on the expected shape of the vertebra within the bounding box and thus deals with the most frequent pathological cases encountered in daily practice.

We experiment this method on a set of standard lumbar, thoracic, and cervical vertebrae and on a public dataset, on pathological cases, and in a simple integration example. Quantitative and qualitative results show that our method is robust to changes in shapes and luminance and provides correct segmentation with respect to pathological cases.

Automatic Lumbar Spondylolisthesis Measurement in CT Images

Lumbar spondylolisthesis is one of the most common spinal diseases. It is caused by the anterior shift of a lumbar vertebrae relative to subjacent vertebrae. In current clinical practices, staging of spondylolisthesis is often conducted in a qualitative way. Although meyerding grading opens the door to stage spondylolisthesis in a more quantitative way, it relies on the manual measurement, which is time consuming and irreproducible. Thus, an automatic measurement algorithm becomes desirable for spondylolisthesis diagnosis and staging. However, there are two challenges. 1) Accurate detection of the most anterior and posterior points on the superior and inferior surfaces of each lumbar vertebrae. Due to the small size of the vertebrae, slight errors of detection may lead to significant measurement errors, hence, wrong disease stages. 2) Automatic localize and label each lumbar vertebrae is required to provide the semantic meaning of the measurement. It is difficult since different lumbar vertebraes have high similarity of both shape and image appearance. To resolve these challenges, a new auto measurement framework is proposed with two major contributions: First, a learning based spine labeling method that integrates both the image appearance and spine geometry information is designed to detect lumbar vertebrae. Second, a hierarchical method using both the population information from atlases and domain-specific information in the target image is proposed for most anterior and posterior points positioning. Validated on 258 CT spondylolisthesis patients, our method shows very similar results to manual measurements by radiologists and significantly increases the measurement efficiency.

Geometric-attributes-based segmentation of cortical bone slides using optimized neural networks

In cortical bone, solid (lamellar and interstitial) matrix occupies space left over by porous microfeatures such as Haversian canals, lacunae, and canaliculi-containing clusters. In this work, pulse-coupled neural networks (PCNN) were used to automatically distinguish the microfeatures present in histology slides of cortical bone. The networks' parameters were optimized using particle swarm optimization (PSO). When forming the fitness functions for the PSO, we considered the microfeatures' geometric attributes-namely, their size (based on measures of elliptical perimeter or area), shape (based on measures of compactness or the ratio of minor axis length to major axis length), and a two-way combination of these two geometric attributes. This hybrid PCNN-PSO method was further enhanced for pulse evaluation by combination with yet another method, adaptive threshold (AT), where the PCNN algorithm is repeated until the best threshold is found corresponding to the maximum variance between two segmented regions. Together, this framework of using PCNN-PSO-AT constitutes, we believe, a novel framework in biomedical imaging. Using this framework and extracting microfeatures from only one training image, we successfully extracted microfeatures from other test images. The high fidelity of all resultant segments was established using quantitative metrics such as precision, specificity, and Dice indices.

Augmenting Surgery via Multi-scale Modeling and Translational Systems Biology in the Era of Precision Medicine: A Multidisciplinary Perspective

In this era of tremendous technological capabilities and increased focus on improving clinical outcomes, decreasing costs, and increasing precision, there is a need for a more quantitative approach to the field of surgery. Multiscale computational modeling has the potential to bridge the gap to the emerging paradigms of Precision Medicine and Translational Systems Biology, in which quantitative metrics and data guide patient care through improved stratification, diagnosis, and therapy. Achievements by multiple groups have demonstrated the potential for (1) multiscale computational modeling, at a biological level, of diseases treated with surgery and the surgical procedure process at the level of the individual and the population; along with (2) patient-specific, computationally-enabled surgical planning, delivery, and guidance and robotically-augmented manipulation. In this perspective article, we discuss these concepts, and cite emerging examples from the fields of trauma, wound healing, and cardiac surgery.

A multi-center milestone study of clinical vertebral CT segmentation

A multiple center milestone study of clinical vertebra segmentation is presented in this paper. Vertebra segmentation is a fundamental step for spinal image analysis and intervention. The first half of the study was conducted in the spine segmentation challenge in 2014 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) Workshop on Computational Spine Imaging (CSI 2014). The objective was to evaluate the performance of several state-of-the-art vertebra segmentation algorithms on computed tomography (CT) scans using ten training and five testing dataset, all healthy cases; the second half of the study was conducted after the challenge, where additional 5 abnormal cases are used for testing to evaluate the performance under abnormal cases. Dice coefficients and absolute surface distances were used as evaluation metrics. Segmentation of each vertebra as a single geometric unit, as well as separate segmentation of vertebra substructures, was evaluated. Five teams participated in the comparative study. The top performers in the study achieved Dice coefficient of 0.93 in the upper thoracic, 0.95 in the lower thoracic and 0.96 in the lumbar spine for healthy cases, and 0.88 in the upper thoracic, 0.89 in the lower thoracic and 0.92 in the lumbar spine for osteoporotic and fractured cases. The strengths and weaknesses of each method as well as future suggestion for improvement are discussed. This is the first multi-center comparative study for vertebra segmentation methods, which will provide an up-to-date performance milestone for the fast growing spinal image analysis and intervention.

Intraoperative CT as a registration benchmark for intervertebral motion compensation in image-guided open spinal surgery

PURPOSE

An accurate and reliable benchmark of registration accuracy and intervertebral motion compensation is important for spinal image guidance. In this study, we evaluated the utility of intraoperative CT (iCT) in place of bone-implanted screws as the ground-truth registration and illustrated its use to benchmark the performance of intraoperative stereovision (iSV).

METHODS

A template-based, multi-body registration scheme was developed to individually segment and pair corresponding vertebrae between preoperative CT and iCT of the spine. Intervertebral motion was determined from the resulting vertebral pair-wise registrations. The accuracy of the image-driven registration was evaluated using surface-to-surface distance error (SDE) based on segmented bony features and was independently verified using point-to-point target registration error (TRE) computed from bone-implanted mini-screws. Both SDE and TRE were used to assess the compensation accuracy using iSV.

RESULTS

The iCT-based technique was evaluated on four explanted porcine spines (20 vertebral pairs) with artificially induced motion. We report a registration accuracy of 0.57 [Formula: see text] 0.32 mm (range 0.34-1.14 mm) and 0.29 [Formula: see text] 0.15 mm (range 0.14-0.78 mm) in SDE and TRE, respectively, for all vertebrae pooled, with an average intervertebral rotation of [Formula: see text] (range 1.5[Formula: see text]-7.9[Formula: see text]). The iSV-based compensation accuracy for one sample (four vertebrae) was 1.32 [Formula: see text] 0.19 mm and 1.72 [Formula: see text] 0.55 mm in SDE and TRE, respectively, exceeding the recommended accuracy of 2 mm.

CONCLUSION

This study demonstrates the effectiveness of iCT in place of invasive fiducials as a registration ground truth. These findings are important for future development of on-demand spinal image guidance using radiation-free images such as stereovision and ultrasound on human subjects.

Accurate Segmentation of Vertebral Bodies and Processes Using Statistical Shape Decomposition and Conditional Models

Detailed segmentation of the vertebrae is an important pre-requisite in various applications of image-based spine assessment, surgery and biomechanical modeling. In particular, accurate segmentation of the processes is required for image-guided interventions, for example for optimal placement of bone grafts between the transverse processes. Furthermore, the geometry of the processes is now required in musculoskeletal models due to their interaction with the muscles and ligaments. In this paper, we present a new method for detailed segmentation of both the vertebral bodies and processes based on statistical shape decomposition and conditional models. The proposed technique is specifically developed with the aim to handle the complex geometry of the processes and the large variability between individuals. The key technical novelty in this work is the introduction of a part-based statistical decomposition of the vertebrae, such that the complexity of the subparts is effectively reduced, and model specificity is increased. Subsequently, in order to maintain the statistical and anatomic coherence of the ensemble, conditional models are used to model the statistical inter-relationships between the different subparts. For shape reconstruction and segmentation, a robust model fitting procedure is used to exclude improbable inter-part relationships in the estimation of the shape parameters. Segmentation results based on a dataset of 30 healthy CT scans and a dataset of 10 pathological scans show a point-to-surface error improvement of 20% and 17% respectively, and the potential of the proposed technique for detailed vertebral modeling.

A Framework for Automated Spine and Vertebrae Interpolation-Based Detection and Model-Based Segmentation

Automated and semi-automated detection and segmentation of spinal and vertebral structures from computed tomography (CT) images is a challenging task due to a relatively high degree of anatomical complexity, presence of unclear boundaries and articulation of vertebrae with each other, as well as due to insufficient image spatial resolution, partial volume effects, presence of image artifacts, intensity variations and low signal-to-noise ratio. In this paper, we describe a novel framework for automated spine and vertebrae detection and segmentation from 3-D CT images. A novel optimization technique based on interpolation theory is applied to detect the location of the whole spine in the 3-D image and, using the obtained location of the whole spine, to further detect the location of individual vertebrae within the spinal column. The obtained vertebra detection results represent a robust and accurate initialization for the subsequent segmentation of individual vertebrae, which is performed by an improved shape-constrained deformable model approach. The framework was evaluated on two publicly available CT spine image databases of 50 lumbar and 170 thoracolumbar vertebrae. Quantitative comparison against corresponding reference vertebra segmentations yielded an overall mean centroid-to-centroid distance of 1.1 mm and Dice coefficient of 83.6% for vertebra detection, and an overall mean symmetric surface distance of 0.3 mm and Dice coefficient of 94.6% for vertebra segmentation. The results indicate that by applying the proposed automated detection and segmentation framework, vertebrae can be successfully detected and accurately segmented in 3-D from CT spine images.

A Predictive Model of Vertebral Trabecular Anisotropy From Ex Vivo Micro-CT

Spine-related disorders are amongst the most frequently encountered problems in clinical medicine. For several applications such as 1) to improve the assessment of the strength of the spine, as well as 2) to optimize the personalization of spinal interventions, image-based biomechanical modeling of the vertebrae is expected to play an important predictive role. However, this requires the construction of computational models that are subject-specific and comprehensive. In particular, they need to incorporate information about the vertebral anisotropic micro-architecture, which plays a central role in the biomechanical function of the vertebrae. In practice, however, accurate personalization of the vertebral trabeculae has proven to be difficult as its imaging in vivo is currently infeasible. Consequently, this paper presents a statistical approach for accurate prediction of the vertebral fabric tensors based on a training sample of ex vivo micro-CT images. To the best of our knowledge, this is the first predictive model proposed and validated for vertebral datasets. The method combines features selection and partial least squares regression in order to derive optimal latent variables for the prediction of the fabric tensors based on the more easily extracted shape and density information. Detailed validation with 20 ex vivo T12 vertebrae demonstrates the accuracy and consistency of the approach for the personalization of trabecular anisotropy.

Statistical Interspace Models (SIMs): Application to Robust 3D Spine Segmentation

Statistical shape models (SSM) are used to introduce shape priors in the segmentation of medical images. However, such models require large training datasets in the case of multi-object structures, since it is required to obtain not only the individual shape variations but also the relative position and orientation among objects. A solution to overcome this limitation is to model each individual shape independently. However, this approach does not take into account the relative position, orientations and shapes among the parts of an articulated object, which may result in unrealistic geometries, such as with object overlaps. In this article, we propose a new Statistical Model, the Statistical Interspace Model (SIM), which provides information about the interaction of all the individual structures by modeling the interspace between them. The SIM is described using relative position vectors between pair of points that belong to different objects that are facing each other. These vectors are divided into their magnitude and direction, each of these groups modeled as independent manifolds. The SIM was included in a segmentation framework that contains an SSM per individual object. This framework was tested using three distinct types of datasets of CT images of the spine. Results show that the SIM completely eliminated the inter-process overlap while improving the segmentation accuracy.

A fully automated method for spinal canal detection in computed tomography images

This work presents a new automated method for spinal canal detection in Computed Tomography (CT) images. It uses both 2D and 3D information and the algorithm extracts the spinal canal automatically. The procedure can be divided into three main steps. Firstly, a thresholding and a set of morphological operations were applied. Secondly, 3D connectivity analysis was defined to extract the objects forming part of the spinal canal. Finally, the centroid of each slice constituting the spinal canal object was computed. Furthermore, interpolation and extrapolation of data were performed, if required. The method was applied on two different groups, each one coming from different acquisition systems. A total of 25 patients and 8704 images were used. An experienced radiologist evaluated the method qualitatively supporting the utility of it, as all extracted points fell into the spinal canal. Therefore, our method was able to reduce the workload and detect spinal canal objectively. We expect to carry out a quantitative evaluation in our future research. The qualitative outcome of this work suggests promising results.

A fully automated level-set based segmentation method of thoracic and lumbar vertebral bodies in Computed Tomography images

Spine is a structure commonly involved in several diseases. Identification and segmentation of the vertebral structures are of relevance to many medical applications related to the spine such as diagnosis, therapy or surgical intervention. However, the development of automatic and reliable methods are an unmet need. This work presents a fully automatic segmentation method of thoracic and lumbar vertebral bodies from Computed Tomography images. The procedure can be divided into four main stages: firstly, seed points were detected in the spinal canal in order to generate initial contours in the segmentation process, automating the whole process. Secondly, a processing step is performed to improve image quality. Third step was to carry out the segmentation using the Selective Binary Gaussian Filtering Regularized Level Set method and, finally, two morphological operations were applied in order to refine the segmentation result. The method was tested in clinical data coming from 10 trauma patients. To evaluate the result the average value of the DICE coefficient was calculated, obtaining a 90.86 ± 1.87% in the whole spine (thoracic and lumbar regions), a 86.08 ± 1.73% in the thoracic region and a 95,61 ±2,25% in the lumbar region. The results are highly competitive when compared to the results obtained in previous methods, especially for the lumbar region.

Shape representation for efficient landmark-based segmentation in 3-d

In this paper, we propose a novel approach to landmark-based shape representation that is based on transportation theory, where landmarks are considered as sources and destinations, all possible landmark connections as roads, and established landmark connections as goods transported via these roads. Landmark connections, which are selectively established, are identified through their statistical properties describing the shape of the object of interest, and indicate the least costly roads for transporting goods from sources to destinations. From such a perspective, we introduce three novel shape representations that are combined with an existing landmark detection algorithm based on game theory. To reduce computational complexity, which results from the extension from 2-D to 3-D segmentation, landmark detection is augmented by a concept known in game theory as strategy dominance. The novel shape representations, game-theoretic landmark detection and strategy dominance are combined into a segmentation framework that was evaluated on 3-D computed tomography images of lumbar vertebrae and femoral heads. The best shape representation yielded symmetric surface distance of 0.75 mm and 1.11 mm, and Dice coefficient of 93.6% and 96.2% for lumbar vertebrae and femoral heads, respectively. By applying strategy dominance, the computational costs were further reduced for up to three times.

Segmentation of histology slides of cortical bone using pulse coupled neural networks optimized by particle-swarm optimization

The aim of this study is to automatically discern the micro-features in histology slides of cortical bone using pulse coupled neural networks (PCNN). To the best knowledge of the authors, utilizing PCNN in such an application has not been reported in the literature and, as such, constitutes a novel application. The network parameters are optimized using particle swarm optimization (PSO) where the PSO fitness function was introduced as the entropy and energy of the bone micro-constituents extracted from a training image. Another novel contribution is combining the above with the method of adaptive threshold (T) where the PCNN algorithm is repeated until the best threshold T is found corresponding to the maximum variance between two segmented regions. To illustrate the quality of resulting segmentation according to this methodology, a comparison of the entropy/energy obtained of each pulse is reported. Suitable quality metrics (precision rate, sensitivity, specificity, accuracy, and dice) were used to benchmark the resulting segments against those found by a more traditional method namely K-means. The quality of the segments revealed by this methodology was found to be of much superior quality. Another testament to the quality of this methodology was that the images resulting from testing pulses were found to be of similarly good quality to those of the training images.

Spine segmentation in medical images using manifold embeddings and higher-order MRFs

We introduce a novel approach for segmenting articulated spine shape models from medical images. A nonlinear low-dimensional manifold is created from a training set of mesh models to establish the patterns of global shape variations. Local appearance is captured from neighborhoods in the manifold once the overall representation converges. Inference with respect to the manifold and shape parameters is performed using a higher-order Markov random field (HOMRF). Singleton and pairwise potentials measure the support from the global data and shape coherence in manifold space respectively, while higher-order cliques encode geometrical modes of variation to segment each localized vertebra models. Generic feature functions learned from ground-truth data assigns costs to the higher-order terms. Optimization of the model parameters is achieved using efficient linear programming and duality. The resulting model is geometrically intuitive, captures the statistical distribution of the underlying manifold and respects image support. Clinical experiments demonstrated promising results in terms of spine segmentation. Quantitative comparison to expert identification yields an accuracy of 1.6 ± 0.6 mm for CT imaging and of 2.0 ± 0.8 mm for MR imaging, based on the localization of anatomical landmarks.

An improved level set method for vertebra CT image segmentation

Background

Clinical diagnosis and therapy for the lumbar disc herniation requires accurate vertebra segmentation. The complex anatomical structure and the degenerative deformations of the vertebrae makes its segmentation challenging.

Methods

An improved level set method, namely edge- and region-based level set method (ERBLS), is proposed for vertebra CT images segmentation. By considering the gradient information and local region characteristics of images, the proposed model can efficiently segment images with intensity inhomogeneity and blurry or discontinuous boundaries. To reduce the dependency on manual initialization in many active contour models and for an automatic segmentation, a simple initialization method for the level set function is built, which utilizes the Otsu threshold. In addition, the need of the costly re-initialization procedure is completely eliminated.

Results

Experimental results on both synthetic and real images demonstrated that the proposed ERBLS model is very robust and efficient. Compared with the well-known local binary fitting (LBF) model, our method is much more computationally efficient and much less sensitive to the initial contour. The proposed method has also applied to 56 patient data sets and produced very promising results.

Conclusions

An improved level set method suitable for vertebra CT images segmentation is proposed. It has the flexibility of segmenting the vertebra CT images with blurry or discontinuous edges, internal inhomogeneity and no need of re-initialization.

Fully automatic measurements of axial vertebral rotation for assessment of spinal deformity in idiopathic scoliosis

Reliable measurements of spinal deformities in idiopathic scoliosis are vital, since they are used for assessing the degree of scoliosis, deciding upon treatment and monitoring the progression of the disease. However, commonly used two dimensional methods (e.g. the Cobb angle) do not fully capture the three dimensional deformity at hand in scoliosis, of which axial vertebral rotation (AVR) is considered to be of great importance. There are manual methods for measuring the AVR, but they are often time-consuming and related with a high intra- and inter-observer variability. In this paper, we present a fully automatic method for estimating the AVR in images from computed tomography. The proposed method is evaluated on four scoliotic patients with 17 vertebrae each and compared with manual measurements performed by three observers using the standard method by Aaro-Dahlborn. The comparison shows that the difference in measured AVR between automatic and manual measurements are on the same level as the inter-observer difference. This is further supported by a high intraclass correlation coefficient (0.971-0.979), obtained when comparing the automatic measurements with the manual measurements of each observer. Hence, the provided results and the computational performance, only requiring approximately 10 to 15 s for processing an entire volume, demonstrate the potential clinical value of the proposed method.

Variability of manual lumbar spine segmentation

Background

The application of kinematic data acquired during biomechanical testing to specimen-specific, three-dimensional models of the spine has emerged as a useful tool in spine biomechanics research. However, the development of these models is subject to segmentation error because of complex morphology and pathologic changes of the spine. This error has not been previously characterized.

Methods

Eight cadaveric lumbar spines were prepared and underwent computed tomography (CT) scanning. After disarticulation and soft-tissue removal, 5 individual vertebrae from these specimens were scanned a second time. The CT images of the full lumbar specimens were segmented twice each by 2 operators, and the images of the individual vertebrae with soft tissue removed were segmented as well. The solid models derived from these differing segmentation sessions were registered, and the distribution of distances between nearest neighboring points was calculated to evaluate the accuracy and precision of the segmentation technique.

Results

Manual segmentation yielded root-mean-square errors below 0.39 mm for accuracy, 0.33 mm for intrauser precision, and 0.35 mm for interuser precision. Furthermore, the 95th percentile of all distances was below 0.75 mm for all analyses of accuracy and precision.

Conclusions

These findings indicate that such models are highly accurate and that a high level of intrauser and interuser precision can be achieved. The magnitude of the error presented here should inform the design and interpretation of future studies using manual segmentation techniques to derive models of the lumbar spine.

Automated detection, 3D segmentation and analysis of high resolution spine MR images using statistical shape models

Recent advances in high resolution magnetic resonance (MR) imaging of the spine provide a basis for the automated assessment of intervertebral disc (IVD) and vertebral body (VB) anatomy. High resolution three-dimensional (3D) morphological information contained in these images may be useful for early detection and monitoring of common spine disorders, such as disc degeneration. This work proposes an automated approach to extract the 3D segmentations of lumbar and thoracic IVDs and VBs from MR images using statistical shape analysis and registration of grey level intensity profiles. The algorithm was validated on a dataset of volumetric scans of the thoracolumbar spine of asymptomatic volunteers obtained on a 3T scanner using the relatively new 3D T2-weighted SPACE pulse sequence. Manual segmentations and expert radiological findings of early signs of disc degeneration were used in the validation. There was good agreement between manual and automated segmentation of the IVD and VB volumes with the mean Dice scores of 0.89 ± 0.04 and 0.91 ± 0.02 and mean absolute surface distances of 0.55 ± 0.18 mm and 0.67 ± 0.17 mm respectively. The method compares favourably to existing 3D MR segmentation techniques for VBs. This is the first time IVDs have been automatically segmented from 3D volumetric scans and shape parameters obtained were used in preliminary analyses to accurately classify (100% sensitivity, 98.3% specificity) disc abnormalities associated with early degenerative changes.

Automated detection of spinal centrelines, vertebral bodies and intervertebral discs in CT and MR images of lumbar spine

We propose a completely automated algorithm for the detection of the spinal centreline and the centres of vertebral bodies and intervertebral discs in images acquired by computed tomography (CT) and magnetic resonance (MR) imaging. The developed methods are based on the analysis of the geometry of spinal structures and the characteristics of CT and MR images and were evaluated on 29 CT and 13 MR images of lumbar spine. The overall mean distance between the obtained and the ground truth spinal centrelines and centres of vertebral bodies and intervertebral discs were 1.8 +/- 1.1 mm and 2.8 +/- 1.9 mm, respectively, and no considerable differences were detected among the results for CT, T(1)-weighted MR and T(2)-weighted MR images. The knowledge of the location of the spinal centreline and the centres of vertebral bodies and intervertebral discs is valuable for the analysis of the spine. The proposed method may therefore be used to initialize the techniques for labelling and segmentation of vertebrae.