Automatic segmentation of thoracic and pelvic CT images for radiotherapy planning using implicit anatomic knowledge and organ-specific segmentation strategies

Automatic detection and recognition of nasopharynx gross tumour volume (GTVnx) by deep learning for nasopharyngeal cancer radiotherapy through magnetic resonance imaging

BACKGROUND

In this study, we propose the deep learning model-based framework to automatically delineate nasopharynx gross tumor volume (GTVnx) in MRI images.

METHODS

MRI images from 200 patients were collected for training-validation and testing set. Three popular deep learning models (FCN, U-Net, Deeplabv3) are proposed to automatically delineate GTVnx. FCN was the first and simplest fully convolutional model. U-Net was proposed specifically for medical image segmentation. In Deeplabv3, the proposed Atrous Spatial Pyramid Pooling (ASPP) block, and fully connected Conditional Random Field(CRF) may improve the detection of the small scattered distributed tumor parts due to its different scale of spatial pyramid layers. The three models are compared under same fair criteria, except the learning rate set for the U-Net. Two widely applied evaluation standards, mIoU and mPA, are employed for the detection result evaluation.

RESULTS

The extensive experiments show that the results of FCN and Deeplabv3 are promising as the benchmark of automatic nasopharyngeal cancer detection. Deeplabv3 performs best with the detection of mIoU 0.8529 ± 0.0017 and mPA 0.9103 ± 0.0039. FCN performs slightly worse in term of detection accuracy. However, both consume similar GPU memory and training time. U-Net performs obviously worst in both detection accuracy and memory consumption. Thus U-Net is not suggested for automatic GTVnx delineation.

CONCLUSIONS

The proposed framework for automatic target delineation of GTVnx in nasopharynx bring us the desirable and promising results, which could not only be labor-saving, but also make the contour evaluation more objective. This preliminary results provide us with clear directions for further study.

Texture appearance model, a new model-based segmentation paradigm, application on the segmentation of lung nodule in the CT scan of the chest

Lung cancer causes more than one million deaths worldwide each year. Averages of 5-year survival rate of patients with Non-small cell lung cancer (NSCLC), which is the most common type of lung cancer, is 15%. Computer-Aided Detection (CAD) is a very important tool for identifying lung lesions in medical imaging. In general, the process line of a CAD system can be divided into four main stages: preprocessing, localization, feature extraction, and classification. As segmentation is required for localization in computer vision and medical image analysis, this step has become a major and challenging problem, and much research has been done on new segmentation techniques. In recent years, interest in model-based segmentation methods has increased, and the reason for this is even if some object information is lost, such gaps can be filled by using the previous information in the model. This paper proposed Texture Appearance Model (TAM), which is a new model-based method and segments all types of nodule areas accurately and efficiently, including juxta-pleural nodules, without separating the lung from the surrounding area in a CT scan of the lung. In this method, Texture Representation of Image (TRI) is obtained using tissue texture feature extraction and feature selection algorithms. The proposed method has been evaluated in 85 nodules of the dataset, received from the Iranian hospital, in which the ground-truth annotation by physicians and CT imaging data were provided. The results show that the proposed algorithm has an encouraging performance for distinguishing different types of nodules, including pleural, cavity and non-solid nodules, achieving an average dice similarity coefficient (DSC) of 84.75%.

Automatic Segmentation of Pelvic Cancers Using Deep Learning: State-of-the-Art Approaches and Challenges

The recent rise of deep learning (DL) and its promising capabilities in capturing non-explicit detail from large datasets have attracted substantial research attention in the field of medical image processing. DL provides grounds for technological development of computer-aided diagnosis and segmentation in radiology and radiation oncology. Amongst the anatomical locations where recent auto-segmentation algorithms have been employed, the pelvis remains one of the most challenging due to large intra- and inter-patient soft-tissue variabilities. This review provides a comprehensive, non-systematic and clinically-oriented overview of 74 DL-based segmentation studies, published between January 2016 and December 2020, for bladder, prostate, cervical and rectal cancers on computed tomography (CT) and magnetic resonance imaging (MRI), highlighting the key findings, challenges and limitations.

Deep learning to segment pelvic bones: large-scale CT datasets and baseline models

PURPOSE

Pelvic bone segmentation in CT has always been an essential step in clinical diagnosis and surgery planning of pelvic bone diseases. Existing methods for pelvic bone segmentation are either hand-crafted or semi-automatic and achieve limited accuracy when dealing with image appearance variations due to the multi-site domain shift, the presence of contrasted vessels, coprolith and chyme, bone fractures, low dose, metal artifacts, etc. Due to the lack of a large-scale pelvic CT dataset with annotations, deep learning methods are not fully explored.

METHODS

In this paper, we aim to bridge the data gap by curating a large pelvic CT dataset pooled from multiple sources, including 1184 CT volumes with a variety of appearance variations. Then, we propose for the first time, to the best of our knowledge, to learn a deep multi-class network for segmenting lumbar spine, sacrum, left hip, and right hip, from multiple-domain images simultaneously to obtain more effective and robust feature representations. Finally, we introduce a post-processor based on the signed distance function (SDF).

RESULTS

Extensive experiments on our dataset demonstrate the effectiveness of our automatic method, achieving an average Dice of 0.987 for a metal-free volume. SDF post-processor yields a decrease of 15.1% in Hausdorff distance compared with traditional post-processor.

CONCLUSION

We believe this large-scale dataset will promote the development of the whole community and open source the images, annotations, codes, and trained baseline models at https://github.com/ICT-MIRACLE-lab/CTPelvic1K .

Dose-escalated volumetric modulated arc therapy for total marrow irradiation: A feasibility dosimetric study with 4DCT planning and simultaneous integrated boost

PURPOSE

To evaluate the planning feasibility of dose-escalated total marrow irradiation (TMI) with simultaneous integrated boost (SIB) to the active bone marrow (ABM) using volumetric modulated arc therapy (VMAT), and to assess the impact of using planning organs at risk (OAR) volumes (PRV) accounting for breathing motion in the optimization.

METHODS

Five patients underwent whole-body CT and thoraco-abdominal 4DCT. A planning target volume (PTV) including all bones and ABM was contoured on each whole-body CT. PRV of selected OAR (liver, heart, kidneys, lungs, spleen, stomach) were determined with 4DCT. Planning consisted of 9-10 full 6 MV photon VMAT arcs. Four plans were created for each patient with 12 Gy prescribed to the PTV, with or without an additional 4 Gy SIB to the ABM. Planning dose constraints were set on the OAR or on the PRV. Planning objective was a PTV D_mean < 110% of the prescribed dose, a PTV V_110% < 50%, and OAR D_mean ≤ 50-60%.

RESULTS

PTV D_mean < 110% was accomplished for most plans (n = 18/20), while all achieved V_110%<50%. SIB plans succeeded to optimally cover the boost volume (median ABM D_mean = 16.3 Gy) and resulted in similar OAR sparing compared to plans without SIB (median OAR D_mean = 40-54% of the ABM prescribed dose). No statistically significant differences between plans optimized with constraints on OAR or PRV were found.

CONCLUSIONS

Adding a 4 Gy SIB to the ABM for TMI is feasible with VMAT technique, and results in OAR sparing similar to plans without SIB. Setting dose constraints on PRV does not impair PTV dosimetric parameters.

Automatic delineation of the clinical target volume and organs at risk by deep learning for rectal cancer postoperative radiotherapy

BACKGROUND AND PURPOSE

Manual delineation of clinical target volumes (CTVs) and organs at risk (OARs) is time-consuming, and automatic contouring tools lack clinical validation. We aimed to construct and validate the use of convolutional neural networks (CNNs) to set better contouring standards for rectal cancer radiotherapy.

MATERIALS AND METHODS

We retrospectively collected and evaluated computed tomography (CT) scans of 199 rectal cancer patients treated at our hospital from February 2018 to April 2019. Two CNNs-DeepLabv3+ for extracting high-level semantic information and ResUNet for extracting low-level visual features-were used for the CTV and small intestine contouring, and bladder and femoral head contouring, respectively. Contouring quality was compared using the paired t test. Five-point objective grading was performed independently by two experienced radiation oncologists and verified by a third. The CNN manual correction time was recorded.

RESULTS

CTVs calculated using DeepLabv3+ (CTV_DeepLabv3+) had significant quantitative parameter advantages over CTV_ResUNet (volumetric Dice coefficient, 0.88 vs 0.87, P = 0.0005; surface Dice coefficient, 0.79 vs 0.78, P = 0.008). Among 315 graded cases, DeepLabv3+ obtained the highest scores with 284 cases, consistent with the objective criteria, whereas CTV_ResUNet had the minimum mean manual correction time (7.29 min). DeepLabv3+ performed better than ResUNet for small intestine contouring and ResUNet performed better for bladder and femoral head contouring. The manual correction time for OARs was <4 min for both models.

CONCLUSION

CNNs at various feature resolution levels well delineate rectal cancer CTVs and OARs, displaying high quality and requiring shorter computation and manual correction time.

Impact of CT reconstruction algorithm on auto-segmentation performance

Model‐based iterative reconstruction (MBIR) reduces CT imaging dose while maintaining image quality. However, MBIR reduces noise while preserving edges which may impact intensity‐based tasks such as auto‐segmentation. This work evaluates the sensitivity of an auto‐contouring prostate atlas across multiple MBIR reconstruction protocols and benchmarks the results against filtered back projection (FBP). Images were created from raw projection data for 11 prostate cancer cases using FBP and nine different MBIR reconstructions (3 protocols/3 noise reduction levels) yielding 10 reconstructions/patient. Five bony structures, bladder, rectum, prostate, and seminal vesicles (SVs) were segmented using an auto‐segmentation pipeline that renders 3D binary masks for analysis. Performance was evaluated for volume percent difference (VPD) and Dice similarity coefficient (DSC), using FBP as the gold standard. Nonparametric Friedman tests plus post hoc all pairwise comparisons were employed to test for significant differences (P < 0.05) for soft tissue organs and protocol/level combinations. A physician performed qualitative grading of 396 MBIR contours across the prostate, bladder, SVs, and rectum in comparison to FBP using a six‐point scale. MBIR contours agreed with FBP for bony anatomy (DSC ≥ 0.98), bladder (DSC ≥ 0.94, VPD < 8.5%), and prostate (DSC = 0.94 ± 0.03, VPD = 4.50 ± 4.77% (range: 0.07–26.39%). Increased variability was observed for rectum (VPD = 7.50 ± 7.56% and DSC = 0.90 ± 0.08) and SVs (VPD and DSC of 8.23 ± 9.86% range (0.00–35.80%) and 0.87 ± 0.11, respectively). Over the all protocol/level comparisons, a significant difference was observed for the prostate VPD between BSPL1 and BSTL2 (adjusted P‐value = 0.039). Nevertheless, 300 of 396 (75.8%) of the four soft tissue structures using MBIR were graded as equivalent or better than FBP, suggesting that MBIR offered potential improvements in auto‐segmentation performance when compared to FBP. Future work may involve tuning organ‐specific MBIR parameters to further improve auto‐segmentation performance. Running title: Impact of CT Reconstruction Algorithm on Auto‐segmentation Performance.

CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation

Accurate segmentation of the prostate and organs at risk (e.g., bladder and rectum) in CT images is a crucial step for radiation therapy in the treatment of prostate cancer. However, it is a very challenging task due to unclear boundaries, large intra- and inter-patient shape variability, and uncertain existence of bowel gases and fiducial markers. In this paper, we propose a novel automatic segmentation framework using fully convolutional networks with boundary sensitive representation to address this challenging problem. Our novel segmentation framework contains three modules. First, an organ localization model is designed to focus on the candidate segmentation region of each organ for better performance. Then, a boundary sensitive representation model based on multi-task learning is proposed to represent the semantic boundary information in a more robust and accurate manner. Finally, a multi-label cross-entropy loss function combining boundary sensitive representation is introduced to train a fully convolutional network for the organ segmentation. The proposed method is evaluated on a large and diverse planning CT dataset with 313 images from 313 prostate cancer patients. Experimental results show that the performance of our proposed method outperforms the baseline fully convolutional networks, as well as other state-of-the-art methods in CT male pelvic organ segmentation.

Automatic image segmentation based on synthetic tissue model for delineating organs at risk in spinal metastasis treatment planning

Purpose

One of the main goals in software solutions for treatment planning is to automatize delineation of organs at risk (OARs). In this pilot feasibility study a clinical validation was made of computed tomography (CT)-based extracranial auto-segmentation (AS) using the Brainlab Anatomical Mapping tool (AM).

Methods

The delineation of nine extracranial OARs (lungs, kidneys, trachea, heart, liver, spinal cord, esophagus) from clinical datasets of 24 treated patients was retrospectively evaluated. Manual delineation of OARs was conducted in clinical routine and compared with AS datasets using AM. The Dice similarity coefficient (DSC) and maximum Hausdorff distance (HD) were used as statistical and geometrical measurements, respectively. Additionally, all AS structures were validated using a subjective qualitative scoring system.

Results

All patient datasets investigated were successfully processed with the evaluated AS software. For the left lung (0.97 ± 0.03), right lung (0.97 ± 0.05), left kidney (0.91 ± 0.07), and trachea (0.93 ± 0.04), the DSC was high with low variability. The DSC scores of other organs (right kidney, heart, liver, spinal cord), except the esophagus, ranged between 0.7 and 0.9. The calculated HD values yielded comparable results. Qualitative assessment showed a general acceptance in more than 85% of AS OARs—except for the esophagus.

Conclusions

The Brainlab AM software is ready for clinical use in most of the OARs evaluated in the thoracic and abdominal region. The software generates highly conformal structure sets compared to manual contouring. The current study design needs revision for further research.

An evaluation of techniques for dose calculation on cone beam computed tomography

OBJECTIVE:

To assess the accuracy and efficiency of four different techniques, thus determining the optimum method for recalculating dose on cone beam CT (CBCT) images acquired during radiotherapy treatments.

METHODS:

Four established techniques were investigated and their accuracy assessed via dose calculations: (1) applying a standard planning CT (pCT) calibration curve, (2) applying a CBCT site-specific calibration curve, (3) performing a density override and (4) using deformable registration. Each technique was applied to 15 patients receiving volumetric modulated arc therapy to one of three treatment sites, head and neck, lung and prostate. Differences between pCT and CBCT recalculations were determined with dose volume histogram metrics and 2.0%/0.1 mm gamma analysis using the pCT dose distribution as a reference.

RESULTS:

Dose volume histogram analysis indicated that all techniques yielded differences from expected results between 0.0 and 2.3% for both target volumes and organs at risk. With volumetric gamma analysis, the dose recalculation on deformed images yielded the highest pass-rates. The median pass-rate ranges at 50% threshold were 99.6-99.9%, 94.6-96.0%, and 94.8.0-96.0% for prostate, head and neck and lung patients, respectively.

CONCLUSION:

Deformable registration, HU override and site-specific calibration curves were all identified as dosimetrically accurate and efficient methods for dose calculation on CBCT images.

ADVANCES IN KNOWLEDGE:

With the increasing adoption of CBCT, this study provides clinical radiotherapy departments with invaluable information regarding the comparison of dose reconstruction methods, enabling a more accurate representation of a patient's treatment. It can also integrate studies in which CBCT is used in image-guided radiation therapy and for adaptive radiotherapy planning processes.

Data integrity systems for organ contours in radiation therapy planning

The purpose of this research is to develop effective data integrity models for contoured anatomy in a radiotherapy workflow for both real-time and retrospective analysis. Within this study, two classes of contour integrity models were developed: data driven models and contiguousness models. The data driven models aim to highlight contours which deviate from a gross set of contours from similar disease sites and encompass the following regions of interest (ROI): bladder, femoral heads, spinal cord, and rectum. The contiguousness models, which individually analyze the geometry of contours to detect possible errors, are applied across many different ROI's and are divided into two metrics: Extent and Region Growing over volume. After analysis, we found that 70% of detected bladder contours were verified as suspicious. The spinal cord and rectum models verified that 73% and 80% of contours were suspicious respectively. The contiguousness models were the most accurate models and the Region Growing model was the most accurate submodel. 100% of the detected noncontiguous contours were verified as suspicious, but in the cases of spinal cord, femoral heads, bladder, and rectum, the Region Growing model detected additional two to five suspicious contours that the Extent model failed to detect. When conducting a blind review to detect false negatives, it was found that all the data driven models failed to detect all suspicious contours. The Region Growing contiguousness model produced zero false negatives in all regions of interest other than prostate. With regards to runtime, the contiguousness via extent model took an average of 0.2 s per contour. On the other hand, the region growing method had a longer runtime which was dependent on the number of voxels in the contour. Both contiguousness models have potential for real-time use in clinical radiotherapy while the data driven models are better suited for retrospective use.

Automatic bladder segmentation from CT images using deep CNN and 3D fully connected CRF-RNN

PURPOSE

Automatic approach for bladder segmentation from computed tomography (CT) images is highly desirable in clinical practice. It is a challenging task since the bladder usually suffers large variations of appearance and low soft-tissue contrast in CT images. In this study, we present a deep learning-based approach which involves a convolutional neural network (CNN) and a 3D fully connected conditional random fields recurrent neural network (CRF-RNN) to perform accurate bladder segmentation. We also propose a novel preprocessing method, called dual-channel preprocessing, to further advance the segmentation performance of our approach.

METHODS

The presented approach works as following: first, we apply our proposed preprocessing method on the input CT image and obtain a dual-channel image which consists of the CT image and an enhanced bladder density map. Second, we exploit a CNN to predict a coarse voxel-wise bladder score map on this dual-channel image. Finally, a 3D fully connected CRF-RNN refines the coarse bladder score map and produce final fine-localized segmentation result.

RESULTS

We compare our approach to the state-of-the-art V-net on a clinical dataset. Results show that our approach achieves superior segmentation accuracy, outperforming the V-net by a significant margin. The Dice Similarity Coefficient of our approach (92.24%) is 8.12% higher than that of the V-net. Moreover, the bladder probability maps performed by our approach present sharper boundaries and more accurate localizations compared with that of the V-net.

CONCLUSION

Our approach achieves higher segmentation accuracy than the state-of-the-art method on clinical data. Both the dual-channel processing and the 3D fully connected CRF-RNN contribute to this improvement. The united deep network composed of the CNN and 3D CRF-RNN also outperforms a system where the CRF model acts as a post-processing method disconnected from the CNN.

Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer

BACKGROUND AND PURPOSE

Contouring of organs at risk (OARs) is an important but time consuming part of radiotherapy treatment planning. The aim of this study was to investigate whether using institutional created software-generated contouring will save time if used as a starting point for manual OAR contouring for lung cancer patients.

MATERIAL AND METHODS

Twenty CT scans of stage I-III NSCLC patients were used to compare user adjusted contours after an atlas-based and deep learning contour, against manual delineation. The lungs, esophagus, spinal cord, heart and mediastinum were contoured for this study. The time to perform the manual tasks was recorded.

RESULTS

With a median time of 20 min for manual contouring, the total median time saved was 7.8 min when using atlas-based contouring and 10 min for deep learning contouring. Both atlas based and deep learning adjustment times were significantly lower than manual contouring time for all OARs except for the left lung and esophagus of the atlas based contouring.

CONCLUSIONS

User adjustment of software generated contours is a viable strategy to reduce contouring time of OARs for lung radiotherapy while conforming to local clinical standards. In addition, deep learning contouring shows promising results compared to existing solutions.

Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation

With the advent of fully automated image analysis and modern machine learning methods, there is a need for very large image datasets having documented segmentations for both computer algorithm training and evaluation. This paper presents a method and implementation for facilitating such datasets that addresses the critical issue of size scaling for algorithm validation and evaluation; current evaluation methods that are usually used in academic studies do not scale to large datasets. This method includes protocols for the documentation of many regions in very large image datasets; the documentation may be incrementally updated by new image data and by improved algorithm outcomes. This method has been used for 5 years in the context of chest health biomarkers from low-dose chest CT images that are now being used with increasing frequency in lung cancer screening practice. The lung scans are segmented into over 100 different anatomical regions, and the method has been applied to a dataset of over 20,000 chest CT images. Using this framework, the computer algorithms have been developed to achieve over 90% acceptable image segmentation on the complete dataset.

Evaluation of segmentation methods on head and neck CT: Auto-segmentation challenge 2015

PURPOSE

Automated delineation of structures and organs is a key step in medical imaging. However, due to the large number and diversity of structures and the large variety of segmentation algorithms, a consensus is lacking as to which automated segmentation method works best for certain applications. Segmentation challenges are a good approach for unbiased evaluation and comparison of segmentation algorithms.

METHODS

In this work, we describe and present the results of the Head and Neck Auto-Segmentation Challenge 2015, a satellite event at the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 conference. Six teams participated in a challenge to segment nine structures in the head and neck region of CT images: brainstem, mandible, chiasm, bilateral optic nerves, bilateral parotid glands, and bilateral submandibular glands.

RESULTS

This paper presents the quantitative results of this challenge using multiple established error metrics and a well-defined ranking system. The strengths and weaknesses of the different auto-segmentation approaches are analyzed and discussed.

CONCLUSIONS

The Head and Neck Auto-Segmentation Challenge 2015 was a good opportunity to assess the current state-of-the-art in segmentation of organs at risk for radiotherapy treatment. Participating teams had the possibility to compare their approaches to other methods under unbiased and standardized circumstances. The results demonstrate a clear tendency toward more general purpose and fewer structure-specific segmentation algorithms.

A robust method to extract the anterior pelvic plane from CT volume independent of pelvic pose

PURPOSE

The anterior pelvic plane (APP) is commonly used as a reference plane to assess acetabular orientation. However, conventional methods for determining the APP may not be accurate and are prone to user variability. To overcome these issues, we developed a robust method to accurately extract the APP independent of pelvic pose using three-dimensional pelvic computed tomography (CT).

MATERIALS AND METHODS

Twenty-eight studies for suspected nonmusculoskeletal conditions were obtained. The APP was determined by four landmarks that were automatically extracted from user-defined regions of interest (ROIs) with compensation of pelvic pose. The APP defined from these landmarks was quantitatively compared to the APPs determined by an expert and an unskilled. Intraobserver reliability was measured to evaluate the time-interval variability. Finally, we evaluate the robustness of this method to patient posture using an arbitrarily rotated volume. The intraclass correlation coefficients (ICCs) were calculated to determine the interobserver and intraobserver reliabilities.

RESULTS

The ICC values for the four landmarks and the APP were similar between the semiautomated method and expert determination (ICC >0.937). The ICC values for intraobserver reliability over time for our method were all 1, demonstrating high reliability. Furthermore, agreement between the parameters determined from the original volume and the rotated volume was nearly perfect.

CONCLUSIONS

Our method is a useful measurement tool for the APP as it is robust, and the results were similar to an experienced surgeon's determination. Furthermore, it was independent to the direction of the CT slice and more robust than a measurement by an unskilled.

Improved prostate delineation in prostate HDR brachytherapy with TRUS-CT deformable registration technology: A pilot study with MRI validation

Accurate prostate delineation is essential to ensure proper target coverage and normal-tissue sparing in prostate HDR brachytherapy. We have developed a prostate HDR brachytherapy technology that integrates intraoperative TRUS-based prostate contour into HDR treatment planning through TRUS-CT deformable registration (TCDR) to improve prostate contour accuracy. In a perspective study of 16 patients, we investigated the clinical feasibility as well as the performance of this TCDR-based HDR approach. We compared the performance of the TCDR-based approach with the conventional CT-based HDR in terms of prostate contour accuracy using MRI as the gold standard. For all patients, the average Dice prostate volume overlap was 91.1 ± 2.3% between the TCDR-based and the MRI-defined prostate volumes. In a subset of eight patients, inter and intro-observer reliability study was conducted among three experienced physicians (two radiation oncologists and one radiologist) for the TCDR-based HDR approach. Overall, a 10 to 40% improvement in prostate volume accuracy can be achieved with the TCDR-based approach as compared with the conventional CT-based prostate volumes. The TCDR-based prostate volumes match closely to the MRI-defined prostate volumes for all 3 observers (mean volume difference: 0.5 ± 7.2%, 1.8 ± 7.2%, and 3.5 ± 5.1%); while CT-based contours overestimated prostate volumes by 10.9 ± 28.7%, 13.7 ± 20.1%, and 44.7 ± 32.1%. This study has shown that the TCDR-based HDR brachytherapy is clinically feasible and can significantly improve prostate contour accuracy over the conventional CT-based prostate contour. We also demonstrated the reliability of the TCDR-based prostate delineation. This TCDR-based HDR approach has the potential to enable accurate dose planning and delivery, and potentially enhance prostate HDR treatment outcome.

Accuracy of patient-specific organ dose estimates obtained using an automated image segmentation algorithm

The overall goal of this work is to develop a rapid, accurate, and automated software tool to estimate patient-specific organ doses from computed tomography (CT) scans using simulations to generate dose maps combined with automated segmentation algorithms. This work quantified the accuracy of organ dose estimates obtained by an automated segmentation algorithm. We hypothesized that the autosegmentation algorithm is sufficiently accurate to provide organ dose estimates, since small errors delineating organ boundaries will have minimal effect when computing mean organ dose. A leave-one-out validation study of the automated algorithm was performed with 20 head-neck CT scans expertly segmented into nine regions. Mean organ doses of the automatically and expertly segmented regions were computed from Monte Carlo-generated dose maps and compared. The automated segmentation algorithm estimated the mean organ dose to be within 10% of the expert segmentation for regions other than the spinal canal, with the median error for each organ region below 2%. In the spinal canal region, the median error was [Formula: see text], with a maximum absolute error of 28% for the single-atlas approach and 11% for the multiatlas approach. The results demonstrate that the automated segmentation algorithm can provide accurate organ dose estimates despite some segmentation errors.

Tissue segmentation of computed tomography images using a Random Forest algorithm: a feasibility study

There is a need for robust, fully automated whole body organ segmentation for diagnostic CT. This study investigates and optimizes a Random Forest algorithm for automated organ segmentation; explores the limitations of a Random Forest algorithm applied to the CT environment; and demonstrates segmentation accuracy in a feasibility study of pediatric and adult patients. To the best of our knowledge, this is the first study to investigate a trainable Weka segmentation (TWS) implementation using Random Forest machine-learning as a means to develop a fully automated tissue segmentation tool developed specifically for pediatric and adult examinations in a diagnostic CT environment. Current innovation in computed tomography (CT) is focused on radiomics, patient-specific radiation dose calculation, and image quality improvement using iterative reconstruction, all of which require specific knowledge of tissue and organ systems within a CT image. The purpose of this study was to develop a fully automated Random Forest classifier algorithm for segmentation of neck-chest-abdomen-pelvis CT examinations based on pediatric and adult CT protocols. Seven materials were classified: background, lung/internal air or gas, fat, muscle, solid organ parenchyma, blood/contrast enhanced fluid, and bone tissue using Matlab and the TWS plugin of FIJI. The following classifier feature filters of TWS were investigated: minimum, maximum, mean, and variance evaluated over a voxel radius of 2 (n) , (n from 0 to 4), along with noise reduction and edge preserving filters: Gaussian, bilateral, Kuwahara, and anisotropic diffusion. The Random Forest algorithm used 200 trees with 2 features randomly selected per node. The optimized auto-segmentation algorithm resulted in 16 image features including features derived from maximum, mean, variance Gaussian and Kuwahara filters. Dice similarity coefficient (DSC) calculations between manually segmented and Random Forest algorithm segmented images from 21 patient image sections, were analyzed. The automated algorithm produced segmentation of seven material classes with a median DSC of 0.86  ±  0.03 for pediatric patient protocols, and 0.85  ±  0.04 for adult patient protocols. Additionally, 100 randomly selected patient examinations were segmented and analyzed, and a mean sensitivity of 0.91 (range: 0.82-0.98), specificity of 0.89 (range: 0.70-0.98), and accuracy of 0.90 (range: 0.76-0.98) were demonstrated. In this study, we demonstrate that this fully automated segmentation tool was able to produce fast and accurate segmentation of the neck and trunk of the body over a wide range of patient habitus and scan parameters.

Iterative-cuts: longitudinal and scale-invariant segmentation via user-defined templates for rectosigmoid colon in gynecological brachytherapy

Among all types of cancer, gynecological malignancies belong to the fourth most frequent type of cancer among women. In addition to chemotherapy and external beam radiation, brachytherapy is the standard procedure for the treatment of these malignancies. In the progress of treatment planning, localization of the tumor as the target volume and adjacent organs of risks by segmentation is crucial to accomplish an optimal radiation distribution to the tumor while simultaneously preserving healthy tissue. Segmentation is performed manually and represents a time-consuming task in clinical daily routine. This study focuses on the segmentation of the rectum/sigmoid colon as an organ-at-risk in gynecological brachytherapy. The proposed segmentation method uses an interactive, graph-based segmentation scheme with a user-defined template. The scheme creates a directed two-dimensional graph, followed by the minimal cost closed set computation on the graph, resulting in an outlining of the rectum. The graph's outline is dynamically adapted to the last calculated cut. Evaluation was performed by comparing manual segmentations of the rectum/sigmoid colon to results achieved with the proposed method. The comparison of the algorithmic to manual result yielded a dice similarity coefficient value of [Formula: see text], in comparison to [Formula: see text] for the comparison of two manual segmentations by the same physician. Utilizing the proposed methodology resulted in a median time of [Formula: see text], compared to 300 s needed for pure manual segmentation.

Progress in Fully Automated Abdominal CT Interpretation

OBJECTIVE

Automated analysis of abdominal CT has advanced markedly over just the last few years. Fully automated assessment of organs, lymph nodes, adipose tissue, muscle, bowel, spine, and tumors are some examples where tremendous progress has been made. Computer-aided detection of lesions has also improved dramatically.

CONCLUSION

This article reviews the progress and provides insights into what is in store in the near future for automated analysis for abdominal CT, ultimately leading to fully automated interpretation.

Improving thoracic four-dimensional cone-beam CT reconstruction with anatomical-adaptive image regularization (AAIR)

Total-variation (TV) minimization reconstructions can significantly reduce noise and streaks in thoracic four-dimensional cone-beam computed tomography (4D CBCT) images compared to the Feldkamp-Davis-Kress (FDK) algorithm currently used in practice. TV minimization reconstructions are, however, prone to over-smoothing anatomical details and are also computationally inefficient. The aim of this study is to demonstrate a proof of concept that these disadvantages can be overcome by incorporating the general knowledge of the thoracic anatomy via anatomy segmentation into the reconstruction. The proposed method, referred as the anatomical-adaptive image regularization (AAIR) method, utilizes the adaptive-steepest-descent projection-onto-convex-sets (ASD-POCS) framework, but introduces an additional anatomy segmentation step in every iteration. The anatomy segmentation information is implemented in the reconstruction using a heuristic approach to adaptively suppress over-smoothing at anatomical structures of interest. The performance of AAIR depends on parameters describing the weighting of the anatomy segmentation prior and segmentation threshold values. A sensitivity study revealed that the reconstruction outcome is not sensitive to these parameters as long as they are chosen within a suitable range. AAIR was validated using a digital phantom and a patient scan and was compared to FDK, ASD-POCS and the prior image constrained compressed sensing (PICCS) method. For the phantom case, AAIR reconstruction was quantitatively shown to be the most accurate as indicated by the mean absolute difference and the structural similarity index. For the patient case, AAIR resulted in the highest signal-to-noise ratio (i.e. the lowest level of noise and streaking) and the highest contrast-to-noise ratios for the tumor and the bony anatomy (i.e. the best visibility of anatomical details). Overall, AAIR was much less prone to over-smoothing anatomical details compared to ASD-POCS and did not suffer from residual noise/streaking and motion blur migrated from the prior image as in PICCS. AAIR was also found to be more computationally efficient than both ASD-POCS and PICCS, with a reduction in computation time of over 50% compared to ASD-POCS. The use of anatomy segmentation was, for the first time, demonstrated to significantly improve image quality and computational efficiency for thoracic 4D CBCT reconstruction. Further developments are required to facilitate AAIR for practical use.

Automatic segmentation of anatomical structures from CT scans of thorax for RTP

Modern radiotherapy techniques are vulnerable to delineation inaccuracies owing to the steep dose gradient around the target. In this aspect, accurate contouring comprises an indispensable part of optimal radiation treatment planning (RTP). We suggest a fully automated method to segment the lungs, trachea/main bronchi, and spinal canal accurately from computed tomography (CT) scans of patients with lung cancer to use for RTP. For this purpose, we developed a new algorithm for inclusion of excluded pathological areas into the segmented lungs and a modified version of the fuzzy segmentation by morphological reconstruction for spinal canal segmentation and implemented some image processing algorithms along with them. To assess the accuracy, we performed two comparisons between the automatically obtained results and the results obtained manually by an expert. The average volume overlap ratio values range between 94.30 ± 3.93% and 99.11 ± 0.26% on the two different datasets. We obtained the average symmetric surface distance values between the ranges of 0.28 ± 0.21 mm and 0.89 ± 0.32 mm by using the same datasets. Our method provides favorable results in the segmentation of CT scans of patients with lung cancer and can avoid heavy computational load and might offer expedited segmentation that can be used in RTP.

Prostate CT segmentation method based on nonrigid registration in ultrasound-guided CT-based HDR prostate brachytherapy

PURPOSE

The technological advances in real-time ultrasound image guidance for high-dose-rate (HDR) prostate brachytherapy have placed this treatment modality at the forefront of innovation in cancer radiotherapy. Prostate HDR treatment often involves placing the HDR catheters (needles) into the prostate gland under the transrectal ultrasound (TRUS) guidance, then generating a radiation treatment plan based on CT prostate images, and subsequently delivering high dose of radiation through these catheters. The main challenge for this HDR procedure is to accurately segment the prostate volume in the CT images for the radiation treatment planning. In this study, the authors propose a novel approach that integrates the prostate volume from 3D TRUS images into the treatment planning CT images to provide an accurate prostate delineation for prostate HDR treatment.

METHODS

The authors' approach requires acquisition of 3D TRUS prostate images in the operating room right after the HDR catheters are inserted, which takes 1-3 min. These TRUS images are used to create prostate contours. The HDR catheters are reconstructed from the intraoperative TRUS and postoperative CT images, and subsequently used as landmarks for the TRUS-CT image fusion. After TRUS-CT fusion, the TRUS-based prostate volume is deformed to the CT images for treatment planning. This method was first validated with a prostate-phantom study. In addition, a pilot study of ten patients undergoing HDR prostate brachytherapy was conducted to test its clinical feasibility. The accuracy of their approach was assessed through the locations of three implanted fiducial (gold) markers, as well as T2-weighted MR prostate images of patients.

RESULTS

For the phantom study, the target registration error (TRE) of gold-markers was 0.41 ± 0.11 mm. For the ten patients, the TRE of gold markers was 1.18 ± 0.26 mm; the prostate volume difference between the authors' approach and the MRI-based volume was 7.28% ± 0.86%, and the prostate volume Dice overlap coefficient was 91.89% ± 1.19%.

CONCLUSIONS

The authors have developed a novel approach to improve prostate contour utilizing intraoperative TRUS-based prostate volume in the CT-based prostate HDR treatment planning, demonstrated its clinical feasibility, and validated its accuracy with MRIs. The proposed segmentation method would improve prostate delineations, enable accurate dose planning and treatment delivery, and potentially enhance the treatment outcome of prostate HDR brachytherapy.

Prostate segmentation based on variant scale patch and local independent projection

Accurate segmentation of the prostate in computed tomography (CT) images is important in image-guided radiotherapy; however, difficulties remain associated with this task. In this study, an automatic framework is designed for prostate segmentation in CT images. We propose a novel image feature extraction method, namely, variant scale patch, which can provide rich image information in a low dimensional feature space. We assume that the samples from different classes lie on different nonlinear submanifolds and design a new segmentation criterion called local independent projection (LIP). In our method, a dictionary containing training samples is constructed. To utilize the latest image information, we use an online updated strategy to construct this dictionary. In the proposed LIP, locality is emphasized rather than sparsity; local anchor embedding is performed to determine the dictionary coefficients. Several morphological operations are performed to improve the achieved results. The proposed method has been evaluated based on 330 3-D images of 24 patients. Results show that the proposed method is robust and effective in segmenting prostate in CT images.

Vision 20/20: perspectives on automated image segmentation for radiotherapy

Due to rapid advances in radiation therapy (RT), especially image guidance and treatment adaptation, a fast and accurate segmentation of medical images is a very important part of the treatment. Manual delineation of target volumes and organs at risk is still the standard routine for most clinics, even though it is time consuming and prone to intra- and interobserver variations. Automated segmentation methods seek to reduce delineation workload and unify the organ boundary definition. In this paper, the authors review the current autosegmentation methods particularly relevant for applications in RT. The authors outline the methods' strengths and limitations and propose strategies that could lead to wider acceptance of autosegmentation in routine clinical practice. The authors conclude that currently, autosegmentation technology in RT planning is an efficient tool for the clinicians to provide them with a good starting point for review and adjustment. Modern hardware platforms including GPUs allow most of the autosegmentation tasks to be done in a range of a few minutes. In the nearest future, improvements in CT-based autosegmentation tools will be achieved through standardization of imaging and contouring protocols. In the longer term, the authors expect a wider use of multimodality approaches and better understanding of correlation of imaging with biology and pathology.

Shape representation for efficient landmark-based segmentation in 3-d

In this paper, we propose a novel approach to landmark-based shape representation that is based on transportation theory, where landmarks are considered as sources and destinations, all possible landmark connections as roads, and established landmark connections as goods transported via these roads. Landmark connections, which are selectively established, are identified through their statistical properties describing the shape of the object of interest, and indicate the least costly roads for transporting goods from sources to destinations. From such a perspective, we introduce three novel shape representations that are combined with an existing landmark detection algorithm based on game theory. To reduce computational complexity, which results from the extension from 2-D to 3-D segmentation, landmark detection is augmented by a concept known in game theory as strategy dominance. The novel shape representations, game-theoretic landmark detection and strategy dominance are combined into a segmentation framework that was evaluated on 3-D computed tomography images of lumbar vertebrae and femoral heads. The best shape representation yielded symmetric surface distance of 0.75 mm and 1.11 mm, and Dice coefficient of 93.6% and 96.2% for lumbar vertebrae and femoral heads, respectively. By applying strategy dominance, the computational costs were further reduced for up to three times.

Incremental learning with selective memory (ILSM): towards fast prostate localization for image guided radiotherapy

Image-guided radiotherapy (IGRT) requires fast and accurate localization of the prostate in 3-D treatment-guided radiotherapy, which is challenging due to low tissue contrast and large anatomical variation across patients. On the other hand, the IGRT workflow involves collecting a series of computed tomography (CT) images from the same patient under treatment. These images contain valuable patient-specific information yet are often neglected by previous works. In this paper, we propose a novel learning framework, namely incremental learning with selective memory (ILSM), to effectively learn the patient-specific appearance characteristics from these patient-specific images. Specifically, starting with a population-based discriminative appearance model, ILSM aims to "personalize" the model to fit patient-specific appearance characteristics. The model is personalized with two steps: backward pruning that discards obsolete population-based knowledge and forward learning that incorporates patient-specific characteristics. By effectively combining the patient-specific characteristics with the general population statistics, the incrementally learned appearance model can localize the prostate of a specific patient much more accurately. This work has three contributions: 1) the proposed incremental learning framework can capture patient-specific characteristics more effectively, compared to traditional learning schemes, such as pure patient-specific learning, population-based learning, and mixture learning with patient-specific and population data; 2) this learning framework does not have any parametric model assumption, hence, allowing the adoption of any discriminative classifier; and 3) using ILSM, we can localize the prostate in treatment CTs accurately (DSC  ∼ 0.89 ) and fast (  ∼ 4 s), which satisfies the real-world clinical requirements of IGRT.

Automated Lung Segmentation and Image Quality Assessment for Clinical 3D/4D Computed Tomography

Four-dimensional computed tomography (4DCT) provides not only a new dimension of patient-specific information for radiation therapy planning and treatment but also a challenging scale of data volume to process and analyze. Manual analysis using existing 3D tools is unable to keep up with vastly increased 4D data volume, automated processing and analysis are thus needed to process 4DCT data effectively and efficiently. In this work, we applied ideas and algorithms from image/signal processing, computer vision and machine learning to 4DCT lung data so that lungs can be reliably segmented in a fully-automated manner, lung features can be visualized and measured on-the-fly via user interactions, and data quality classifications can be computed in a robust manner. Comparisons of our results with an established treatment planning system and calculation by experts demonstrated negligible discrepancies (within ±2%) for volume assessment but one to two orders of magnitude performance enhancement. An empirical Fourier-analysis-based quality measure delivered performances closely emulating human experts. Three machine learners are inspected to justify the viability of machine learning techniques used to robustly identify data quality of 4DCT images in the scalable manner. The resultant system provides tools that speeds up 4D tasks in the clinic and facilitates clinical research to improve current clinical practice.

Sparse patch-based label propagation for accurate prostate localization in CT images

In this paper, we propose a new prostate computed tomography (CT) segmentation method for image guided radiation therapy. The main contributions of our method lie in the following aspects. 1) Instead of using voxel intensity information alone, patch-based representation in the discriminative feature space with logistic sparse LASSO is used as anatomical signature to deal with low contrast problem in prostate CT images. 2) Based on the proposed patch-based signature, a new multi-atlases label fusion method formulated under sparse representation framework is designed to segment prostate in the new treatment images, with guidance from the previous segmented images of the same patient. This method estimates the prostate likelihood of each voxel in the new treatment image from its nearby candidate voxels in the previous segmented images, based on the nonlocal mean principle and sparsity constraint. 3) A hierarchical labeling strategy is further designed to perform label fusion, where voxels with high confidence are first labeled for providing useful context information in the same image for aiding the labeling of the remaining voxels. 4) An online update mechanism is finally adopted to progressively collect more patient-specific information from newly segmented treatment images of the same patient, for adaptive and more accurate segmentation. The proposed method has been extensively evaluated on a prostate CT image database consisting of 24 patients where each patient has more than 10 treatment images, and further compared with several state-of-the-art prostate CT segmentation algorithms using various evaluation metrics. Experimental results demonstrate that the proposed method consistently achieves higher segmentation accuracy than any other methods under comparison.

Prostate segmentation by sparse representation based classification

PURPOSE

The segmentation of prostate in CT images is of essential importance to external beam radiotherapy, which is one of the major treatments for prostate cancer nowadays. During the radiotherapy, the prostate is radiated by high-energy x rays from different directions. In order to maximize the dose to the cancer and minimize the dose to the surrounding healthy tissues (e.g., bladder and rectum), the prostate in the new treatment image needs to be accurately localized. Therefore, the effectiveness and efficiency of external beam radiotherapy highly depend on the accurate localization of the prostate. However, due to the low contrast of the prostate with its surrounding tissues (e.g., bladder), the unpredicted prostate motion, and the large appearance variations across different treatment days, it is challenging to segment the prostate in CT images. In this paper, the authors present a novel classification based segmentation method to address these problems.

METHODS

To segment the prostate, the proposed method first uses sparse representation based classification (SRC) to enhance the prostate in CT images by pixel-wise classification, in order to overcome the limitation of poor contrast of the prostate images. Then, based on the classification results, previous segmented prostates of the same patient are used as patient-specific atlases to align onto the current treatment image and the majority voting strategy is finally adopted to segment the prostate. In order to address the limitations of the traditional SRC in pixel-wise classification, especially for the purpose of segmentation, the authors extend SRC from the following four aspects: (1) A discriminant subdictionary learning method is proposed to learn a discriminant and compact representation of training samples for each class so that the discriminant power of SRC can be increased and also SRC can be applied to the large-scale pixel-wise classification. (2) The L1 regularized sparse coding is replaced by the elastic net in order to obtain a smooth and clear prostate boundary in the classification result. (3) Residue-based linear regression is incorporated to improve the classification performance and to extend SRC from hard classification to soft classification. (4) Iterative SRC is proposed by using context information to iteratively refine the classification results.

RESULTS

The proposed method has been comprehensively evaluated on a dataset consisting of 330 CT images from 24 patients. The effectiveness of the extended SRC has been validated by comparing it with the traditional SRC based on the proposed four extensions. The experimental results show that our extended SRC can obtain not only more accurate classification results but also smoother and clearer prostate boundary than the traditional SRC. Besides, the comparison with other five state-of-the-art prostate segmentation methods indicates that our method can achieve better performance than other methods under comparison.

CONCLUSIONS

The authors have proposed a novel prostate segmentation method based on the sparse representation based classification, which can achieve considerably accurate segmentation results in CT prostate segmentation.

Semantic localization-driven partial image retrieval in CT series

BACKGROUND

Picture archiving and communication systems (PACS) contain very large amounts of computed tomography (CT) data. When querying a PACS for a particular series, the user is often not interested in the complete series but in a certain region of interest (ROI), described e.g. by an example view in another series or an anatomical concept.

OBJECTIVES

Restricting a retrieval query to such an ROI saves both loading time and navigational effort. In this paper, we propose an efficient method for defining and retrieving ROIs.

METHODS

We employ interpolation and regression techniques for mapping the slices of a series to a newly generated standardized height atlas of the human body.

RESULTS

Examinations of the accuracy and the saved input/output (I/O) costs of our new method on a repository of 1,360 CT series demonstrate the advantages of our system. Depending on the scope of the retrieval query, we can economize up to 99% of the total loading time.

CONCLUSION

Our proposed method for flexible, context-based, partial image retrieval enables the user to directly focus on the relevant portion of the image material and it targets the high potential of I/O cost reduction of a common PACS.

A feature-based learning framework for accurate prostate localization in CT images

Automatic segmentation of prostate in CT images plays an important role in medical image analysis and image guided radiation therapy. It remains as a challenging problem mainly due to three issues: First, the image contrast between the prostate and its surrounding tissues is low in prostate CT images and no obvious boundaries can be observed. Second, the unpredictable prostate motion causes large position variations of the prostate in the treatment images scanned at different treatment days. Third, the uncertainty of the existence of bowel gas in treatment images significantly changes the image appearance even for images taken from the same patient. To address these issues, in this paper we are motivated to propose a feature based learning framework for accurate prostate localization in CT images. The main contributions of the proposed method lie in the following aspects: (1) Anatomical features are extracted from input images and adopted as signatures for each voxel. The most robust and informative features are identified by the feature selection process to help localize the prostate. (2) Regions with salient features but irrelevant to the localization of prostate, such as regions filled with bowel gas are automatically filtered out by the proposed method. (3) An online update mechanism is adopted in this paper to adaptively combine both population information and patient-specific information to localize the prostate. The proposed method is evaluated on a CT prostate dataset of 24 patients to localize the prostate, where each patient has more than 10 longitudinal images scanned at different treatment times. It is also compared with several state-of- the-art prostate localization algorithms in CT images, and the experimental results demonstrate that the proposed method achieves the highest localization accuracy among all the methods under comparison.

Concurrent segmentation of the prostate on MRI and CT via linked statistical shape models for radiotherapy planning

PURPOSE

Prostate gland segmentation is a critical step in prostate radiotherapy planning, where dose plans are typically formulated on CT. Pretreatment MRI is now beginning to be acquired at several medical centers. Delineation of the prostate on MRI is acknowledged as being significantly simpler to perform, compared to delineation on CT. In this work, the authors present a novel framework for building a linked statistical shape model (LSSM), a statistical shape model (SSM) that links the shape variation of a structure of interest (SOI) across multiple imaging modalities. This framework is particularly relevant in scenarios where accurate boundary delineations of the SOI on one of the modalities may not be readily available, or difficult to obtain, for training a SSM. In this work the authors apply the LSSM in the context of multimodal prostate segmentation for radiotherapy planning, where the prostate is concurrently segmented on MRI and CT.

METHODS

The framework comprises a number of logically connected steps. The first step utilizes multimodal registration of MRI and CT to map 2D boundary delineations of the prostate from MRI onto corresponding CT images, for a set of training studies. Hence, the scheme obviates the need for expert delineations of the gland on CT for explicitly constructing a SSM for prostate segmentation on CT. The delineations of the prostate gland on MRI and CT allows for 3D reconstruction of the prostate shape which facilitates the building of the LSSM. In order to perform concurrent prostate MRI and CT segmentation using the LSSM, the authors employ a region-based level set approach where the authors deform the evolving prostate boundary to simultaneously fit to MRI and CT images in which voxels are classified to be either part of the prostate or outside the prostate. The classification is facilitated by using a combination of MRI-CT probabilistic spatial atlases and a random forest classifier, driven by gradient and Haar features.

RESULTS

The authors acquire a total of 20 MRI-CT patient studies and use the leave-one-out strategy to train and evaluate four different LSSMs. First, a fusion-based LSSM (fLSSM) is built using expert ground truth delineations of the prostate on MRI alone, where the ground truth for the gland on CT is obtained via coregistration of the corresponding MRI and CT slices. The authors compare the fLSSM against another LSSM (xLSSM), where expert delineations of the gland on both MRI and CT are employed in the model building; xLSSM representing the idealized LSSM. The authors also compare the fLSSM against an exclusive CT-based SSM (ctSSM), built from expert delineations of the gland on CT alone. In addition, two LSSMs trained using trainee delineations (tLSSM) on CT are compared with the fLSSM. The results indicate that the xLSSM, tLSSMs, and the fLSSM perform equivalently, all of them out-performing the ctSSM.

CONCLUSIONS

The fLSSM provides an accurate alternative to SSMs that require careful expert delineations of the SOI that may be difficult or laborious to obtain. Additionally, the fLSSM has the added benefit of providing concurrent segmentations of the SOI on multiple imaging modalities.

Assessment of accuracy and efficiency of atlas-based autosegmentation for prostate radiotherapy in a variety of clinical conditions

BACKGROUND AND PURPOSE

The goal of the current study was to evaluate the commercially available atlas-based autosegmentation software for clinical use in prostate radiotherapy. The accuracy was benchmarked against interobserver variability.

MATERIAL AND METHODS

A total of 20 planning computed tomographs (CTs) and 10 cone-beam CTs (CBCTs) were selected for prostate, rectum, and bladder delineation. The images varied regarding to individual (age, body mass index) and setup parameters (contrast agent, rectal balloon, implanted markers). Automatically created contours with ABAS(®) and iPlan(®) were compared to an expert's delineation by calculating the Dice similarity coefficient (DSC) and conformity index.

RESULTS

Demo-atlases of both systems showed different results for bladder (DSC(ABAS) 0.86 ± 0.17, DSC(iPlan) 0.51 ± 0.30) and prostate (DSC(ABAS) 0.71 ± 0.14, DSC(iPlan) 0.57 ± 0.19). Rectum delineation (DSC(ABAS) 0.78 ± 0.11, DSC(iPlan) 0.84 ± 0.08) demonstrated differences between the systems but better correlation of the automatically drawn volumes. ABAS(®) was closest to the interobserver benchmark. Autosegmentation with iPlan(®), ABAS(®) and manual segmentation took 0.5, 4 and 15-20 min, respectively. Automatic contouring on CBCT showed high dependence on image quality (DSC bladder 0.54, rectum 0.42, prostate 0.34).

CONCLUSION

For clinical routine, efforts are still necessary to either redesign algorithms implemented in autosegmentation or to optimize image quality for CBCT to guarantee required accuracy and time savings for adaptive radiotherapy.

A statistical modeling approach for evaluating auto-segmentation methods for image-guided radiotherapy

We proposed a statistical modeling method for the quantitative evaluation of segmentation methods used in image guided radiotherapy. A statistical model parameterized on a Beta distribution was built upon the observations of the volume overlap between the segmented structure and the referenced structure. A statistical performance profile (SPP) was then estimated from the model using the generalized maximum likelihood approach. The SPP defines the probability density function characterizing the distribution of performance values and provides a graphical visualization of the segmentation performance. Different segmentation approaches may be influenced by image quality or observer variability. Our statistical model was able to quantify the impact of these variations and displays the underlying statistical performance of the segmentation algorithm. We demonstrated the efficacy of this statistical model using both simulated data and clinical evaluation studies in head and neck radiotherapy. Furthermore, the resulting SPP facilitates the measurement of the correlation between quantitative metrics and clinical experts' decision, and ultimately is able to guide the clinicians in selecting segmentation methods for radiotherapy.

Medical image segmentation by combining graph cuts and oriented active appearance models

In this paper, we propose a novel method based on a strategic combination of the active appearance model (AAM), live wire (LW), and graph cuts (GCs) for abdominal 3-D organ segmentation. The proposed method consists of three main parts: model building, object recognition, and delineation. In the model building part, we construct the AAM and train the LW cost function and GC parameters. In the recognition part, a novel algorithm is proposed for improving the conventional AAM matching method, which effectively combines the AAM and LW methods, resulting in the oriented AAM (OAAM). A multiobject strategy is utilized to help in object initialization. We employ a pseudo-3-D initialization strategy and segment the organs slice by slice via a multiobject OAAM method. For the object delineation part, a 3-D shape-constrained GC method is proposed. The object shape generated from the initialization step is integrated into the GC cost computation, and an iterative GC-OAAM method is used for object delineation. The proposed method was tested in segmenting the liver, kidneys, and spleen on a clinical CT data set and also on the MICCAI 2007 Grand Challenge liver data set. The results show the following: 1) The overall segmentation accuracy of true positive volume fraction TPVF > 94.3% and false positive volume fraction can be achieved; 2) the initialization performance can be improved by combining the AAM and LW; 3) the multiobject strategy greatly facilitates initialization; 4) compared with the traditional 3-D AAM method, the pseudo-3-D OAAM method achieves comparable performance while running 12 times faster; and 5) the performance of the proposed method is comparable to state-of-the-art liver segmentation algorithm. The executable version of the 3-D shape-constrained GC method with a user interface can be downloaded from http://xinjianchen.wordpress.com/research/.

The effect of delineation method and observer variability on bladder dose-volume histograms for prostate intensity modulated radiotherapy

PURPOSE

To quantify the effect of delineation method on bladder DVH, observer variability (OV) and contouring time for prostate IMRT plans.

MATERIALS AND METHODS

Planning CT scans and IMRT plans of 30 prostate cancer patients were anonymized. For 20 patients, 1 observer delineated the bladder using 9 methods. The effect of delineation method on the DVH curve, discrete dose levels and delineation time was quantified. For the 10 remaining CTs, 6 observers delineated bladder wall using 4 methods. Observer-based volume variation and intraclass correlation coefficient (ICC) were used to describe the dosimetric effects of OV.

RESULTS

Manual delineation of the bladder wall (BW_m) was significantly slower than any other method (mean: 20 min vs. ≤ 13 min) and the dosimetric effect of OV was significantly larger (V70 Gy ICC: 0.78 vs. 0.98). Only volumes created using a 2.5mm contraction from the outer surface, and a method providing a consistent wall volume, showed no notable dosimetric differences from BW_m in both absolute and relative volume.

CONCLUSIONS

Automatic contractions from the outer surface provide quicker, more reproducible and reasonably accurate substitutes for BW_m. The widespread use of automatic contractions to create a bladder wall volume would assist in the consistent application of IMRT dose constraints and the interpretation of reported dose.

[Automatic image segmentation for treatment planning in radiotherapy]

One drawback of the growth in conformal radiotherapy and image-guided radiotherapy is the increased time needed to define the volumes of interest. This also results in inter- and intra-observer variability. However, developments in computing and image processing have enabled these tasks to be partially or totally automated. This article will provide a detailed description of the main principles of image segmentation in radiotherapy, its applications and the most recent results in a clinical context.