Landmark-guided diffeomorphic demons algorithm and its application to automatic segmentation of the whole spine and pelvis in CT images

Segmentation methods for quantifying X-ray Computed Tomography based biomarkers to assess hip fracture risk: a systematic literature review

Background

The success of using bone mineral density and/or FRAX to predict femoral osteoporotic fracture risk is modest since they do not account for mechanical determinants that affect bone fracture risk. Computed Tomography (CT)-based geometric, densitometric, and finite element-derived biomarkers have been developed and used as parameters for assessing fracture risk. However, to quantify these biomarkers, segmentation of CT data is needed. Doing this manually or semi-automatically is labor-intensive, preventing the adoption of these biomarkers into clinical practice. In recent years, fully automated methods for segmenting CT data have started to emerge. Quantifying the accuracy, robustness, reproducibility, and repeatability of these segmentation tools is of major importance for research and the potential translation of CT-based biomarkers into clinical practice.

Methods

A comprehensive literature search was performed in PubMed up to the end of July 2024. Only segmentation methods that were quantitatively validated on human femurs and/or pelvises and on both clinical and non-clinical CT were included. The accuracy, robustness, reproducibility, and repeatability of these segmentation methods were investigated, reporting quantitatively the metrics used to evaluate these aspects of segmentation. The studies included were evaluated for the risk of, and sources of bias, that may affect the results reported.

Findings

A total of 54 studies fulfilled the inclusion criteria. The analysis of the included papers showed that automatic segmentation methods led to accurate results, however, there may exist a need to standardize reporting of accuracy across studies. Few works investigated robustness to allow for detailed conclusions on this aspect. Finally, it seems that the bone segmentation field has only addressed the concept of reproducibility and repeatability to a very limited extent, which entails that most of the studies are at high risk of bias.

Interpretation

Based on the studies analyzed, some recommendations for future studies are made for advancing the development of a standardized segmentation protocol. Moreover, standardized metrics are proposed to evaluate accuracy, robustness, reproducibility, and repeatability of segmentation methods, to ease comparison between different approaches.

Systematic Review of Tumor Segmentation Strategies for Bone Metastases

Purpose: To investigate the segmentation approaches for bone metastases in differentiating benign from malignant bone lesions and characterizing malignant bone lesions. Method: The literature search was conducted in Scopus, PubMed, IEEE and MedLine, and Web of Science electronic databases following the guidelines of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). A total of 77 original articles, 24 review articles, and 1 comparison paper published between January 2010 and March 2022 were included in the review. Results: The results showed that most studies used neural network-based approaches (58.44%) and CT-based imaging (50.65%) out of 77 original articles. However, the review highlights the lack of a gold standard for tumor boundaries and the need for manual correction of the segmentation output, which largely explains the absence of clinical translation studies. Moreover, only 19 studies (24.67%) specifically mentioned the feasibility of their proposed methods for use in clinical practice. Conclusion: Development of tumor segmentation techniques that combine anatomical information and metabolic activities is encouraging despite not having an optimal tumor segmentation method for all applications or can compensate for all the difficulties built into data limitations.

Complete region of interest reconstruction by fusing multiview deformable three-dimensional transesophageal echocardiography images

BACKGROUND

While three-dimensional transesophageal echocardiography (3D TEE) has been increasingly used for assessing cardiac anatomy and function, it still suffers from a limited field of view (FoV) of the ultrasound transducer. Therefore, it is difficult to examine a complete region of interest without moving the transducer. Existing methods extend the FoV of 3D TEE images by mosaicing multiview static images, which requires synchronization between 3D TEE images and electrocardiogram (ECG) signal to avoid deformations in the images and can only get the widened image at a specific phase.

PURPOSE

This work aims to develop a novel multiview nonrigid registration and fusion method to extend the FoV of 3D TEE images at different cardiac phases, avoiding the bias toward the specifically chosen phase.

METHODS

A multiview nonrigid registration and fusion method is proposed to enlarge the FoV of 3D TEE images by fusing dynamic images captured from different viewpoints sequentially. The deformation field for registering images is defined by a collection of affine transformations organized in a graph structure and is estimated by a direct (intensity-based) method. The accuracy of the proposed method is evaluated by comparing it with two B-spline-based methods, two Demons-based methods, and one learning-based method VoxelMorph. Twenty-nine sequences of in vivo 3D TEE images captured from four patients are used for the comparative experiments. Four performance metrics including checkerboard volumes, signed distance, mean absolute distance (MAD), and Dice similarity coefficient (DSC) are used jointly to evaluate the accuracy of the results. Additionally, paired t-tests are performed to examine the significance of the results.

RESULTS

The qualitative results show that the proposed method can align images more accurately and obtain the fused images with higher quality than the other five methods. Additionally, in the evaluation of the segmented left atrium (LA) walls for the pairwise registration and sequential fusion experiments, the proposed method achieves the MAD of (0.07 ± 0.03) mm for pairwise registration and (0.19 ± 0.02) mm for sequential fusion. Paired t-tests indicate that the results obtained from the proposed method are more accurate than those obtained by the state-of-the-art VoxelMorph and the diffeomorphic Demons methods at the significance level of 0.05. In the evaluation of left ventricle (LV) segmentations for the sequential fusion experiments, the proposed method achieves a DSC of (0.88 ± 0.08), which is also significantly better than diffeomorphic Demons at the 0.05 level. The FoVs of the final fused 3D TEE images obtained by our method are enlarged around two times compared with the original images.

CONCLUSIONS

Without selecting the static (ECG-gated) images from the same cardiac phase, this work addressed the problem of limited FoV of 3D TEE images in the deformable scenario, obtaining the fused images with high accuracy and good quality. The proposed method could provide an alternative to the conventional fusion methods that are biased toward the specifically chosen phase.

Machine learning for image analysis in the cervical spine: Systematic review of the available models and methods

•Neural network approaches show the most potential for automated image analysis of thecervical spine.•Fully automatic convolutional neural network (CNN) models are promising Deep Learning methods for segmentation.•In cervical spine analysis, the biomechanical features are most often studied using finiteelement models.•The application of artificial neural networks and support vector machine models looks promising for classification purposes.•This article provides an overview of the methods for research on computer aided imaging diagnostics of the cervical spine.

Effectiveness of temporal subtraction computed tomography images using deep learning in detecting vertebral bone metastases

PURPOSE

To assess the clinical effectiveness of temporal subtraction computed tomography (TS CT) using deep learning to improve vertebral bone metastasis detection.

METHOD

This retrospective study used TS CT comprising bony landmark detection, bone segmentation with a multi-atlas-based method, and spatial registration of two images by a log-domain diffeomorphic Demons algorithm. Paired current and past CT images of 50 patients without vertebral metastasis, recorded during June 2011-September 2016, were included as training data. A deep learning-based method estimated registration errors and suppressed false positives. Thereafter, paired CT images of 40 cancer patients with newly developed vertebral metastases and 40 control patients without vertebral metastases were evaluated. Six board-certified radiologists and five radiology residents independently interpreted 80 paired CT images with and without TS CT.

RESULTS

Records of 40 patients in the metastasis group (median age: 64.5 years; 20 males) and 40 patients in the control group (median age: 64.0 years; 20 males) were evaluated. With TS CT, the overall figure of merit (FOM) of the board-certified radiologist and resident groups improved from 0.848 to 0.876 (p = 0.01) and from 0.752 to 0.799 (p = 0.02), respectively. The sub-analysis focusing on attenuation changes in lesions revealed that the FOM of osteoblastic lesions significantly improved in both the board-certified radiologist and resident groups using TS CT. The sub-analysis focusing on lesion location showed that the FOM of the resident group significantly improved in the vertebral arch (p = 0.04).

CONCLUSIONS

TS CT was effective in detecting bone metastasis by both board-certified radiologists and radiology residents.

Clinical utility of convolutional neural networks for treatment planning in radiotherapy for spinal metastases

•

We presented a CNN workflow for segmentation and labeling of vertebrae on CT.

•

This approach proved to be robust in a majority of cases with spinal metastases.

•

The presented workflow can save time in a clinical radiotherapy setting.

•

The approach also allows for more advanced quantitative image analysis of vertebrae.

Background and purpose

Spine delineation is essential for high quality radiotherapy treatment planning of spinal metastases. However, manual delineation is time-consuming and prone to interobserver variability. Automatic spine delineation, especially using deep learning, has shown promising results in healthy subjects. We aimed to evaluate the clinical utility of deep learning-based vertebral body delineations for radiotherapy planning purposes.

Materials and methods

A multi-scale convolutional neural network (CNN) was used for automatic segmentation and labeling. Two approaches were tested: the combined approach using one CNN for both segmentation and labeling, and the sequential approach using separate CNN’s for these tasks. Training and internal validation data included 580 vertebrae, external validation data included 202 vertebrae. For quantitative assessment, Dice similarity coefficient (DSC) and Hausdorff distance (HD) were used. Axial slices from external images were presented to radiation oncologists for subjective evaluation.

Results

Both approaches performed comparably during the internal validation (DSC: 96.7%, HD: 3.6 mm), but the sequential approach proved more robust during the external validation (DSC: 94.5% vs 94.4%, p < 0.001, HD: 4.5 vs 7.1 mm, p < 0.001). Subsequently, subjective evaluation of this sequential approach showed that experienced radiation oncologists could distinguish automatic from human-made contours in 63% of cases. They rated automatic contours clinically acceptable in 77% of cases, compared to 88% of human-made contours.

Conclusion

We present a feasible approach for automatic vertebral body delineation using two variants of a multi-scale CNN. This approach generates high quality automatic delineations, which can save time in a clinical radiotherapy workflow.

Automated Segmentation of Tissues Using CT and MRI: A Systematic Review

RATIONALE AND OBJECTIVES

The automated segmentation of organs and tissues throughout the body using computed tomography and magnetic resonance imaging has been rapidly increasing. Research into many medical conditions has benefited greatly from these approaches by allowing the development of more rapid and reproducible quantitative imaging markers. These markers have been used to help diagnose disease, determine prognosis, select patients for therapy, and follow responses to therapy. Because some of these tools are now transitioning from research environments to clinical practice, it is important for radiologists to become familiar with various methods used for automated segmentation.

MATERIALS AND METHODS

The Radiology Research Alliance of the Association of University Radiologists convened an Automated Segmentation Task Force to conduct a systematic review of the peer-reviewed literature on this topic.

RESULTS

The systematic review presented here includes 408 studies and discusses various approaches to automated segmentation using computed tomography and magnetic resonance imaging for neurologic, thoracic, abdominal, musculoskeletal, and breast imaging applications.

CONCLUSION

These insights should help prepare radiologists to better evaluate automated segmentation tools and apply them not only to research, but eventually to clinical practice.

Clinical usefulness of temporal subtraction CT in detecting vertebral bone metastases

PURPOSE

The purpose of this study was to determine whether temporal subtraction (TS) computed tomography (CT) contributes to the detection of vertebral bone metastases.

METHOD

The calculation of TS CT was composed of bony landmark detection, bone segmentation with a multiatlas-based method, and spatial registration. Temporal increase and decrease of the CT values were visualized in blue and red, respectively. Paired CT images of 20 patients with cancer and newly-developed vertebral metastases were analyzed. Control CT examinations of 20 different patients were also included. The presence of vertebral metastases on the TS CT was evaluated by two board-certified radiologists. Five additional board-certified radiologists and five radiology residents independently interpreted the 40 paired CT images with and without TS CT.

RESULTS

In the lesion conspicuity evaluation, 96% of vertebral metastases were scored as excellent or good. In the image interpretation examination, according to free-response receiver operating characteristics analysis, the overall figure of merit (FOM) of the board-certified radiologist group was 0.892 and 0.898 with and without TS CT, respectively. The FOM of the resident group improved from 0.849 to 0.902 with viewing TS CT. In the sub-analysis focusing on the location of the lesion, the FOM of the resident group significantly improved from 0.75 to 0.92 in vertebral arch lesions (p = 0.001).

CONCLUSIONS

The TS CT may be useful to detect vertebral metastases because almost all the vertebral metastases were shown to be favorable visualization. The TS CT was proven to be especially helpful for radiology residents in detecting vertebral arch metastases.

Quasi-automatic 3D reconstruction of the full spine from low-dose biplanar X-rays based on statistical inferences and image analysis

PURPOSE

To design a quasi-automated three-dimensional reconstruction method of the spine from biplanar X-rays as the daily used method in clinical routine is based on manual adjustments of a trained operator and the reconstruction time is more than 10 min per patient.

METHODS

The proposed method of 3D reconstruction of the spine (C3-L5) relies first on a new manual input strategy designed to fit clinicians' skills. Then, a parametric model of the spine is computed using statistical inferences, image analysis techniques and fast manual rigid registration.

RESULTS

An agreement study with the clinically used method on a cohort of 57 adolescent scoliotic subjects has shown that both methods have similar performance on vertebral body position and axial rotation (null bias in both cases and standard deviation of signed differences of 1 mm and 3.5° around, respectively). In average, the solution could be computed in less than 5 min of operator time, even for severe scoliosis.

CONCLUSION

The proposed method allows fast and accurate 3D reconstruction of the spine for wide clinical applications and represents a significant step towards full automatization of 3D reconstruction of the spine. Moreover, it is to the best of our knowledge the first method including also the cervical spine. These slides can be retrieved under electronic supplementary material.

An automatic segmentation method of a parameter-adaptive PCNN for medical images

PURPOSE

Since pre-processing and initial segmentation steps in medical images directly affect the final segmentation results of the regions of interesting, an automatic segmentation method of a parameter-adaptive pulse-coupled neural network is proposed to integrate the above-mentioned two segmentation steps into one. This method has a low computational complexity for different kinds of medical images and has a high segmentation precision.

METHODS

The method comprises four steps. Firstly, an optimal histogram threshold is used to determine the parameter [Formula: see text] for different kinds of images. Secondly, we acquire the parameter [Formula: see text] according to a simplified pulse-coupled neural network (SPCNN). Thirdly, we redefine the parameter V of the SPCNN model by sub-intensity distribution range of firing pixels. Fourthly, we add an offset [Formula: see text] to improve initial segmentation precision.

RESULTS

Compared with the state-of-the-art algorithms, the new method achieves a comparable performance by the experimental results from ultrasound images of the gallbladder and gallstones, magnetic resonance images of the left ventricle, and mammogram images of the left and the right breast, presenting the overall metric UM of 0.9845, CM of 0.8142, TM of 0.0726.

CONCLUSION

The algorithm has a great potential to achieve the pre-processing and initial segmentation steps in various medical images. This is a premise for assisting physicians to detect and diagnose clinical cases.