Clinical evaluation of multi-atlas based segmentation of lymph node regions in head and neck and prostate cancer patients

Performance analysis and knowledge-based quality assurance of critical organ auto-segmentation for pediatric craniospinal irradiation

Craniospinal irradiation (CSI) is a vital therapeutic approach utilized for young patients suffering from central nervous system disorders such as medulloblastoma. The task of accurately outlining the treatment area is particularly time-consuming due to the presence of several sensitive organs at risk (OAR) that can be affected by radiation. This study aimed to assess two different methods for automating the segmentation process: an atlas technique and a deep learning neural network approach. Additionally, a novel method was devised to prospectively evaluate the accuracy of automated segmentation as a knowledge-based quality assurance (QA) tool. Involving a patient cohort of 100, ranging in ages from 2 to 25 years with a median age of 8, this study employed quantitative metrics centered around overlap and distance calculations to determine the most effective approach for practical clinical application. The contours generated by two distinct methods of atlas and neural network were compared to ground truth contours approved by a radiation oncologist, utilizing 13 distinct metrics. Furthermore, an innovative QA tool was conceptualized, designed for forthcoming cases based on the baseline dataset of 100 patient cases. The calculated metrics indicated that, in the majority of cases (60.58%), the neural network method demonstrated a notably higher alignment with the ground truth. Instances where no difference was observed accounted for 31.25%, while utilization of the atlas method represented 8.17%. The QA tool results showed that the two approaches achieved 100% agreement in 39.4% of instances for the atlas method and in 50.6% of instances for the neural network auto-segmentation. The results indicate that the neural network approach showcases superior performance, and its significantly closer physical alignment to ground truth contours in the majority of cases. The metrics derived from overlap and distance measurements have enabled clinicians to discern the optimal choice for practical clinical application.

Clinical evaluation of atlas-based auto-segmentation in breast and nodal radiotherapy

OBJECTIVES

Accurate contouring of anatomical structures allows for high-precision radiotherapy planning, targeting the dose at treatment volumes and avoiding organs at risk. Manual contouring is time-consuming with significant user variability, whereas auto-segmentation (AS) has proven efficiency benefits but requires editing before treatment planning. This study investigated whether atlas-based AS (ABAS) accuracy improves with template atlas group size and character-specific atlas and test case selection.

METHODS AND MATERIALS

One clinician retrospectively contoured the breast, nodes, lung, heart, and brachial plexus on 100 CT scans, adhering to peer-reviewed guidelines. Atlases were clustered in group sizes, treatment positions, chest wall separations, and ASs created with Mirada software. The similarity of ASs compared to reference contours was described by the Jaccard similarity coefficient (JSC) and centroid distance variance (CDV).

RESULTS

Across group sizes, for all structures combined, the mean JSC was 0.6 (SD 0.3, p = .999). Across atlas-specific groups, 0.6 (SD 0.3, p = 1.000). The correlation between JSC and structure volume was weak in both scenarios (adjusted R2-0.007 and 0.185).Mean CDV was similar across groups but varied up to 1.2 cm for specific structures.

CONCLUSIONS

Character-specific atlas groups and test case selection did not improve accuracy outcomes. High-quality ASs were obtained from groups containing as few as ten atlases, subsequently simplifying the application of ABAS. CDV measures indicating auto-segmentation variations on the x, y, and z axes can be utilised to decide on the clinical relevance of variations and reduce AS editing.

ADVANCES IN KNOWLEDGE

High-quality ABASs can be obtained from as few as ten template atlases.Atlas and test case selection do not improve AS accuracy.Unlike well-known quantitative similarity indices, volume displacement metrics provide information on the location of segmentation variations, helping assessment of the clinical relevance of variations and reducing clinician editing. Volume displacement metrics combined with the qualitative measure of clinician assessment could reduce user variability.

The clinical evaluation of atlas-based auto-segmentation for automatic contouring during cervical cancer radiotherapy

Purpose

Our purpose was to investigate the influence of atlas library size and CT cross-slice number on the accuracy and efficiency of the atlas-based auto-segmentation (ABAS) method for the automatic contouring of clinical treatment volume (CTV) and organs at risk (OARs) during cervical cancer radiotherapy.

Methods

Of 140 cervical cancer patients, contours from 20, 40, 60, 80, 100, and 120 patients were selected incrementally to create six atlas library groups in ABAS. Another 20 tested patients were automatically contoured with the ABAS method and manually contoured by the same professional oncologist. Contours included CTV, bladder, rectum, femoral head-L, femoral head-R, and spinal cord. The CT cross-slice numbers of the 20 tested patients included 61, 65, 72, 75, 81, and 84. The index of dice similarity coefficients (DSCs) and Hausdorff distance (HD) were used to assess the consistency between ABAS automatic contouring and manual contouring. The randomized block analysis of variance and paired t-test were used for statistical analysis.

Results

The mean DSC values of “CTV, bladder, femoral head, and spinal cord” were all larger than 0.8. The femoral head and spinal cord showed a high degree of agreement between ABAS automatic contouring and manual contouring, with a mean DC >0.80 and HD <1 cm in all atlas library groups. A post-hoc least significant difference comparison indicated that no significant difference had been found between different atlas library sizes with DSC and HD values. For ABAS efficiency, the atlas library size had no effect on the time of ABAS automatic contouring. The time of automatic contouring increased slightly with the increase in CT cross-slice numbers, which were 99.9, 106.8, 114.0, 120.6, 127.9, and 134.8 s with CT cross-slices of 61, 65, 72, 75, 81, and 84, respectively.

Conclusion

A total of 20 atlas library sizes and a minimum CT cross-slice number including CTV and OARs are enough for ensuring the accuracy and efficiency of ABAS automatic contouring during cervical cancer radiotherapy.

Clinical validation of an automatic atlas‐based segmentation tool for male pelvis CT images

Purpose

This retrospective work aims to evaluate the possible impact on intra‐ and inter‐observer variability, contouring time, and contour accuracy of introducing a pelvis computed tomography (CT) auto‐segmentation tool in radiotherapy planning workflow.

Methods

Tests were carried out on five structures (bladder, rectum, pelvic lymph‐nodes, and femoral heads) of six previously treated subjects, enrolling five radiation oncologists (ROs) to manually re‐contour and edit auto‐contours generated with a male pelvis CT atlas created with the commercial software MIM MAESTRO. The ROs first delineated manual contours (M). Then they modified the auto‐contours, producing automatic‐modified (AM) contours. The procedure was repeated to evaluate intra‐observer variability, producing M1, M2, AM1, and AM2 contour sets (each comprising 5 structures × 6 test patients × 5 ROs = 150 contours), for a total of 600 contours. Potential time savings was evaluated by comparing contouring and editing times. Structure contours were compared to a reference standard by means of Dice similarity coefficient (DSC) and mean distance to agreement (MDA), to assess intra‐ and inter‐observer variability. To exclude any automation bias, ROs evaluated both M and AM sets as “clinically acceptable” or “to be corrected” in a blind test.

Results

Comparing AM to M sets, a significant reduction of both inter‐observer variability (p < 0.001) and contouring time (‐45% whole pelvis, p < 0.001) was obtained. Intra‐observer variability reduction was significant only for bladder and femoral heads (p < 0.001). The statistical test showed no significant bias.

Conclusion

Our atlas‐based workflow proved to be effective for clinical practice as it can improve contour reproducibility and generate time savings. Based on these findings, institutions are encouraged to implement their auto‐segmentation method.

Quantitative Comparisons of Deep-learning-based and Atlas-based Auto-segmentation of the Intermediate Risk Clinical Target Volume for Nasopharyngeal Carcinoma

BACKGROUND

Manual segment target volumes were time-consuming and inter-observer variability couldn't be avoided. With the development of computer science, auto-segmentation had the potential to solve this problem.

OBJECTIVE

To evaluate the accuracy and stability of Atlas-based and deep-learning-based auto-segmentation of the intermediate risk clinical target volume, composed of CTV2 and CTVnd, for nasopharyngeal carcinoma quantitatively.

METHODS AND MATERIALS

A cascade-deep-residual neural network was constructed to automatically segment CTV2 and CTVnd by deep learning method. Meanwhile, a commercially available software was used to automatically segment the same regions by Atlas-based method. The datasets included contrast computed tomography scans from 102 patients. For each patient, the two regions were manually delineated by one experienced physician. The similarity between the two auto-segmentation methods was quantitatively evaluated by Dice similarity coefficient, the 95th Hausdorff distance, volume overlap error and relative volume difference, respectively. Statistical analyses were performed using the ranked Wilcoxon test.

RESULTS

The average Dice similarity coefficient (±standard deviation) given by the deep-learning-based and Atlas-based auto-segmentation were 0.84(±0.03) and 0.74(±0.04) for CTV2, 0.79(±0.02) and 0.68(±0.03) for CTVnd, respectively. For the 95th Hausdorff distance, the corresponding values were 6.30±3.55mm and 9.34±3.39mm for CTV2, 7.09±2.27mm and 14.33±3.98mm for CTVnd. Besides, volume overlap error and relative volume difference could also predict the same situations. Statistical analyses showed significant difference between the two auto-segmentation methods (p<0.01).

CONCLUSIONS

Compared with the Atlas-based segmentation approach, the deep-learning-based segmentation method performed better both in accuracy and stability for meaningful anatomical areas other than organs at risk.

Development of in-house fully residual deep convolutional neural network-based segmentation software for the male pelvic CT

BACKGROUND

This study aimed to (1) develop a fully residual deep convolutional neural network (CNN)-based segmentation software for computed tomography image segmentation of the male pelvic region and (2) demonstrate its efficiency in the male pelvic region.

METHODS

A total of 470 prostate cancer patients who had undergone intensity-modulated radiotherapy or volumetric-modulated arc therapy were enrolled. Our model was based on FusionNet, a fully residual deep CNN developed to semantically segment biological images. To develop the CNN-based segmentation software, 450 patients were randomly selected and separated into the training, validation and testing groups (270, 90, and 90 patients, respectively). In Experiment 1, to determine the optimal model, we first assessed the segmentation accuracy according to the size of the training dataset (90, 180, and 270 patients). In Experiment 2, the effect of varying the number of training labels on segmentation accuracy was evaluated. After determining the optimal model, in Experiment 3, the developed software was used on the remaining 20 datasets to assess the segmentation accuracy. The volumetric dice similarity coefficient (DSC) and the 95th-percentile Hausdorff distance (95%HD) were calculated to evaluate the segmentation accuracy for each organ in Experiment 3.

RESULTS

In Experiment 1, the median DSC for the prostate were 0.61 for dataset 1 (90 patients), 0.86 for dataset 2 (180 patients), and 0.86 for dataset 3 (270 patients), respectively. The median DSCs for all the organs increased significantly when the number of training cases increased from 90 to 180 but did not improve upon further increase from 180 to 270. The number of labels applied during training had a little effect on the DSCs in Experiment 2. The optimal model was built by 270 patients and four organs. In Experiment 3, the median of the DSC and the 95%HD values were 0.82 and 3.23 mm for prostate; 0.71 and 3.82 mm for seminal vesicles; 0.89 and 2.65 mm for the rectum; 0.95 and 4.18 mm for the bladder, respectively.

CONCLUSIONS

We have developed a CNN-based segmentation software for the male pelvic region and demonstrated that the CNN-based segmentation software is efficient for the male pelvic region.

Automated atlas-based segmentation for skull base surgical planning

PURPOSE

Computational surgical planning tools could help develop novel skull base surgical approaches that improve safety and patient outcomes. This defines a need for automated skull base segmentation to improve the usability of surgical planning software. The objective of this work was to design and validate an algorithm for atlas-based automated segmentation of skull base structures in individual image sets for skull base surgical planning.

METHODS

Advanced Normalization Tools software was used to construct a synthetic CT template from 6 subjects, and skull base structures were manually segmented to create a reference atlas. Landmark registration followed by Elastix deformable registration was applied to the template to register it to each of the 30 trusted reference image sets. Dice coefficient, average Hausdorff distance, and clinical usability scoring were used to compare the atlas segmentations to those of the trusted reference image sets.

RESULTS

The mean for average Hausdorff distance for all structures was less than 2 mm (mean for 95th percentile Hausdorff distance was less than 5 mm). For structures greater than 2.5 mL in volume, the average Dice coefficient was 0.73 (range 0.59-0.82), and for structures less than 2.5 mL in volume the Dice coefficient was less than 0.7. The usability scoring survey was completed by three experts, and all structures met the criteria for acceptable effort except for the foramen spinosum, rotundum, and carotid artery, which required more than minor corrections.

CONCLUSION

Currently available open-source algorithms, such as the Elastix deformable algorithm, can be used for automated atlas-based segmentation of skull base structures with acceptable clinical accuracy and minimal corrections with the use of the proposed atlas. The first publicly available CT template and anterior skull base segmentation atlas being released (available at this link: http://hdl.handle.net/1773/46259 ) with this paper will allow for general use of automated atlas-based segmentation of the skull base.

Generating High-Quality Lymph Node Clinical Target Volumes for Head and Neck Cancer Radiation Therapy Using a Fully Automated Deep Learning-Based Approach

PURPOSE

To develop a deep learning model that generates consistent, high-quality lymph node clinical target volumes (CTV) contours for head and neck cancer (HNC) patients, as an integral part of a fully automated radiation treatment planning workflow.

METHODS AND MATERIALS

Computed tomography (CT) scans from 71 HNC patients were retrospectively collected and split into training (n = 51), cross-validation (n = 10), and test (n = 10) data sets. All had target volume delineations covering lymph node levels Ia through V (Ia-V), Ib through V (Ib-V), II through IV (II-IV), and retropharyngeal (RP) nodes, which were previously approved by a radiation oncologist specializing in HNC. Volumes of interest (VOIs) about nodal levels were automatically identified using computer vision techniques. The VOI (cropped CT image) and approved contours were used to train a U-Net autosegmentation model. Each lymph node level was trained independently, with model parameters optimized by assessing performance on the cross-validation data set. Once optimal model parameters were identified, overlap and distance metrics were calculated between ground truth and autosegmentations on the test set. Lastly, this final model was used on 32 additional patient scans (not included in original 71 cases) and autosegmentations visually rated by 3 radiation oncologists as being "clinically acceptable without requiring edits," "requiring minor edits," or "requiring major edits."

RESULTS

When comparing ground truths to autosegmentations on the test data set, median Dice Similarity Coefficients were 0.90, 0.90, 0.89, and 0.81, and median mean surface distance values were 1.0 mm, 1.0 mm, 1.1 mm, and 1.3 mm for node levels Ia-V, Ib-V, II-IV, and RP nodes, respectively. Qualitative scoring varied among physicians. Overall, 99% of autosegmented target volumes were either scored as being clinically acceptable or requiring minor edits (ie, stylistic recommendations, <2 minutes).

CONCLUSIONS

We developed a fully automated artificial intelligence approach to autodelineate nodal CTVs for patients with intact HNC. Most autosegmentations were found to be clinically acceptable after qualitative review when considering recommended stylistic edits. This promising work automatically delineates nodal CTVs in a robust and consistent manner; this approach can be implemented in ongoing efforts for fully automated radiation treatment planning.

Methodological approach to create an atlas using a commercial auto-contouring software

PURPOSE

The aim of this work was to establish a methodological approach for creation and optimization of an atlas for auto-contouring, using the commercial software MIM MAESTRO (MIM Software Inc. Cleveland OH).

METHODS

A computed tomography (CT) male pelvis atlas was created and optimized to evaluate how different tools and options impact on the accuracy of automatic segmentation. Pelvic lymph nodes (PLN), rectum, bladder, and femurs of 55 subjects were reviewed for consistency by a senior consultant radiation oncologist with 15 yr of experience. Several atlas and workflow options were tuned to optimize the accuracy of auto-contours. The deformable image registration (DIR), the finalization method, the k number of atlas best matching subjects, and several post-processing options were studied. To test our atlas performances, automatic and reference manual contours of 20 test subjects were statistically compared based on dice similarity coefficient (DSC) and mean distance to agreement (MDA) indices. The effect of field of view (FOV) reduction on auto-contouring time was also investigated.

RESULTS

With the optimized atlas and workflow, DSC and MDA median values of bladder, rectum, PLN, and femurs were 0.91 and 1.6 mm, 0.85 and 1.6 mm, 0.85 and 1.8 mm, and 0.96 and 0.5 mm, respectively. Auto-contouring time was more than halved by strictly cropping the FOV of the subject to be contoured to the pelvic region.

CONCLUSION

A statistically significant improvement of auto-contours accuracy was obtained using our atlas and optimized workflow instead of the MIM Software pelvic atlas.

A Deep Learning-Based Automated CT Segmentation of Prostate Cancer Anatomy for Radiation Therapy Planning-A Retrospective Multicenter Study

A commercial deep learning (DL)-based automated segmentation tool (AST) for computed tomography (CT) is evaluated for accuracy and efficiency gain within prostate cancer patients. Thirty patients from six clinics were reviewed with manual- (MC), automated- (AC) and automated and edited (AEC) contouring methods. In the AEC group, created contours (prostate, seminal vesicles, bladder, rectum, femoral heads and penile bulb) were edited, whereas the MC group included empty datasets for MC. In one clinic, lymph node CTV delineations were evaluated for interobserver variability. Compared to MC, the mean time saved using the AST was 12 min for the whole data set (46%) and 12 min for the lymph node CTV (60%), respectively. The delineation consistency between MC and AEC groups according to the Dice similarity coefficient (DSC) improved from 0.78 to 0.94 for the whole data set and from 0.76 to 0.91 for the lymph nodes. The mean DSCs between MC and AC for all six clinics were 0.82 for prostate, 0.72 for seminal vesicles, 0.93 for bladder, 0.84 for rectum, 0.69 for femoral heads and 0.51 for penile bulb. This study proves that using a general DL-based AST for CT images saves time and improves consistency.

Automatic multi-organ segmentation in computed tomography images using hierarchical convolutional neural network

Purpose: Accurate segmentation of treatment planning computed tomography (CT) images is important for radiation therapy (RT) planning. However, low soft tissue contrast in CT makes the segmentation task challenging. We propose a two-step hierarchical convolutional neural network (CNN) segmentation strategy to automatically segment multiple organs from CT. Approach: The first step generates a coarse segmentation from which organ-specific regions of interest (ROIs) are produced. The second step produces detailed segmentation of each organ. The ROIs are generated using UNet, which automatically identifies the area of each organ and improves computational efficiency by eliminating irrelevant background information. For the fine segmentation step, we combined UNet with a generative adversarial network. The generator is designed as a UNet that is trained to segment organ structures and the discriminator is a fully convolutional network, which distinguishes whether the segmentation is real or generator-predicted, thus improving the segmentation accuracy. We validated the proposed method on male pelvic and head and neck (H&N) CTs used for RT planning of prostate and H&N cancer, respectively. For the pelvic structure segmentation, the network was trained to segment the prostate, bladder, and rectum. For H&N, the network was trained to segment the parotid glands (PG) and submandibular glands (SMG). Results: The trained segmentation networks were tested on 15 pelvic and 20 H&N independent datasets. The H&N segmentation network was also tested on a public domain dataset ( N = 38 ) and showed similar performance. The average dice similarity coefficients ( mean ± SD ) of pelvic structures are 0.91 ± 0.05 (prostate), 0.95 ± 0.06 (bladder), 0.90 ± 0.09 (rectum), and H&N structures are 0.87 ± 0.04 (PG) and 0.86 ± 0.05 (SMG). The segmentation for each CT takes < 10    s on average. Conclusions: Experimental results demonstrate that the proposed method can produce fast, accurate, and reproducible segmentation of multiple organs of different sizes and shapes and show its potential to be applicable to different disease sites.

Atlas-based auto-segmentation for postoperative radiotherapy planning in endometrial and cervical cancers

Background

Since intensity-modulated radiation therapy (IMRT) has become popular for the treatment of gynecologic cancers, the contouring process has become more critical. This study evaluated the feasibility of atlas-based auto-segmentation (ABAS) for contouring in patients with endometrial and cervical cancers.

Methods

A total of 75 sets of planning CT images from 75 patients were collected. Contours for the pelvic nodal clinical target volume (CTV), femur, and bladder were carefully generated by two skilled radiation oncologists. Of 75 patients, 60 were randomly registered in three different atlas libraries for ABAS in groups of 20, 40, or 60. ABAS was conducted in 15 patients, followed by manual correction (ABAS_c). The time required to generate all contours was recorded, and the accuracy of segmentation was assessed using Dice’s coefficient (DC) and the Hausdorff distance (HD) and compared to those of manually delineated contours.

Results

For ABAS-CTV, the best results were achieved with groups of 60 patients (DC, 0.79; HD, 19.7 mm) and the worst results with groups of 20 patients (DC, 0.75; p = 0.012; HD, 21.3 mm; p = 0.002). ABAS_c-CTV performed better than ABAS-CTV in terms of both HD and DC (ABAS_c [n = 60]; DC, 0.84; HD, 15.6 mm; all p < 0.017). ABAS required an average of 45.1 s, whereas ABAS_c required 191.1 s; both methods required less time than the manual methods (p < 0.001). Both ABAS-Femur and simultaneous ABAS-Bilateral-femurs showed satisfactory performance, regardless of the atlas library used (DC > 0.9 and HD ≤10.0 mm), with significant time reduction compared to that needed for manual delineation (p < 0.001). However, ABAS-Bladder did not prove to be feasible, with inferior results regardless of library size (DC < 0.6 and HD > 40 mm). Furthermore, ABAS_c-Bladder required a longer processing time than manual contouring to achieve the same accuracy.

Conclusions

ABAS could help physicians to delineate the CTV and organs-at-risk (e.g., femurs) in IMRT planning considering its consistency, efficacy, and accuracy.

CNN-based hierarchical coarse-to-fine segmentation of pelvic CT images for prostate cancer radiotherapy

Accurate segmentation of organs-at-risk is important inprostate cancer radiation therapy planning. However, poor soft tissue contrast in CT makes the segmentation task very challenging. We propose a deep convolutional neural network approach to automatically segment the prostate, bladder, and rectum from pelvic CT. A hierarchical coarse-to-fine segmentation strategy is used where the first step generates a coarse segmentation from which an organ-specific region of interest (ROI) localization map is produced. The second step produces detailed and accurate segmentation of the organs. The ROI localization map is generated using a 3D U-net. The localization map helps adjusting the ROI of each organ that needs to be segmented and hence improves computational efficiency by eliminating irrelevant background information. For the fine segmentation step, we designed a fully convolutional network (FCN) by combining a generative adversarial network (GAN) with a U-net. Specifically, the generator is a 3D U-net that is trained to predict individual pelvic structures, and the discriminator is an FCN which fine-tunes the generator predicted segmentation map by comparing it with the ground truth. The network was trained using 100 CT datasets and tested on 15 datasets to segment the prostate, bladder and rectum. The average Dice similarity (mean±SD) of the prostate, bladder and rectum are 0.90±0.05, 0.96±0.06 and 0.91±0.09, respectively, and Hausdorff distances of these three structures are 5.21±1.17, 4.37±0.56 and 6.11±1.47(mm), respectively. The proposed method produces accurate and reproducible segmentation of pelvic structures, which can be potentially valuable for prostate cancer radiotherapy treatment planning.

Comparative clinical evaluation of atlas and deep-learning-based auto-segmentation of organ structures in liver cancer

BACKGROUND

Accurate and standardized descriptions of organs at risk (OARs) are essential in radiation therapy for treatment planning and evaluation. Traditionally, physicians have contoured patient images manually, which, is time-consuming and subject to inter-observer variability. This study aims to a) investigate whether customized, deep-learning-based auto-segmentation could overcome the limitations of manual contouring and b) compare its performance against a typical, atlas-based auto-segmentation method organ structures in liver cancer.

METHODS

On-contrast computer tomography image sets of 70 liver cancer patients were used, and four OARs (heart, liver, kidney, and stomach) were manually delineated by three experienced physicians as reference structures. Atlas and deep learning auto-segmentations were respectively performed with MIM Maestro 6.5 (MIM Software Inc., Cleveland, OH) and, with a deep convolution neural network (DCNN). The Hausdorff distance (HD) and, dice similarity coefficient (DSC), volume overlap error (VOE), and relative volume difference (RVD) were used to quantitatively evaluate the four different methods in the case of the reference set of the four OAR structures.

RESULTS

The atlas-based method yielded the following average DSC and standard deviation values (SD) for the heart, liver, right kidney, left kidney, and stomach: 0.92 ± 0.04 (DSC ± SD), 0.93 ± 0.02, 0.86 ± 0.07, 0.85 ± 0.11, and 0.60 ± 0.13 respectively. The deep-learning-based method yielded corresponding values for the OARs of 0.94 ± 0.01, 0.93 ± 0.01, 0.88 ± 0.03, 0.86 ± 0.03, and 0.73 ± 0.09. The segmentation results show that the deep learning framework is superior to the atlas-based framwork except in the case of the liver. Specifically, in the case of the stomach, the DSC, VOE, and RVD showed a maximum difference of 21.67, 25.11, 28.80% respectively.

CONCLUSIONS

In this study, we demonstrated that a deep learning framework could be used more effectively and efficiently compared to atlas-based auto-segmentation for most OARs in human liver cancer. Extended use of the deep-learning-based framework is anticipated for auto-segmentations of other body sites.

Auto-segmentation of head and neck organs at risk in radiotherapy and its dependence on anatomic similarity

Purpose

The aim is to study the dependence of deformable based auto-segmentation of head and neck organs-at-risks (OAR) on anatomy matching for a single atlas based system and generate an acceptable set of contours.

Methods

A sample of ten patients in neutral neck position and three atlas sets consisting of ten patients each in different head and neck positions were utilized to generate three scenarios representing poor, average and perfect anatomy matching respectively and auto-segmentation was carried out for each scenario. Brainstem, larynx, mandible, cervical oesophagus, oral cavity, pharyngeal muscles, parotids, spinal cord, and trachea were the structures selected for the study. Automatic and oncologist reference contours were compared using the dice similarity index (DSI), Hausdroff distance and variation in the centre of mass (COM).

Results

The mean DSI scores for brainstem was good irrespective of the anatomy matching scenarios. The scores for mandible, oral cavity, larynx, parotids, spinal cord, and trachea were unacceptable with poor matching but improved with enhanced bony matching whereas cervical oesophagus and pharyngeal muscles had less than acceptable scores for even perfect matching scenario. HD value and variation in COM decreased with better matching for all the structures.

Conclusion

Improved anatomy matching resulted in better segmentation. At least a similar setup can help generate an acceptable set of automatic contours in systems employing single atlas method. Automatic contours from average matching scenario were acceptable for most structures. Importance should be given to head and neck position during atlas generation for a single atlas based system.

Realizing the potential of magnetic resonance image guided radiotherapy in gynaecological and rectal cancer

CT-based radiotherapy workflow is limited by poor soft tissue definition in the pelvis and reliance on rigid registration methods. Current image-guided radiotherapy and adaptive radiotherapy models therefore have limited ability to improve clinical outcomes. The advent of MRI-guided radiotherapy solutions provides the opportunity to overcome these limitations with the potential to deliver online real-time MRI-based plan adaptation on a daily basis, a true "plan of the day." This review describes the application of MRI guided radiotherapy in two pelvic tumour sites likely to benefit from this approach.

Advances in Auto-Segmentation

Manual image segmentation is a time-consuming task routinely performed in radiotherapy to identify each patient's targets and anatomical structures. The efficacy and safety of the radiotherapy plan requires accurate segmentations as these regions of interest are generally used to optimize and assess the quality of the plan. However, reports have shown that this process can be subject to significant inter- and intraobserver variability. Furthermore, the quality of the radiotherapy treatment, and subsequent analyses (ie, radiomics, dosimetric), can be subject to the accuracy of these manual segmentations. Automatic segmentation (or auto-segmentation) of targets and normal tissues is, therefore, preferable as it would address these challenges. Previously, auto-segmentation techniques have been clustered into 3 generations of algorithms, with multiatlas based and hybrid techniques (third generation) being considered the state-of-the-art. More recently, however, the field of medical image segmentation has seen accelerated growth driven by advances in computer vision, particularly through the application of deep learning algorithms, suggesting we have entered the fourth generation of auto-segmentation algorithm development. In this paper, the authors review traditional (nondeep learning) algorithms particularly relevant for applications in radiotherapy. Concepts from deep learning are introduced focusing on convolutional neural networks and fully-convolutional networks which are generally used for segmentation tasks. Furthermore, the authors provide a summary of deep learning auto-segmentation radiotherapy applications reported in the literature. Lastly, considerations for clinical deployment (commissioning and QA) of auto-segmentation software are provided.

Clinical Evaluation of Commercial Atlas-Based Auto-Segmentation in the Head and Neck Region

Background: While atlas segmentation (AS) has proven to be a time-saving and promising method for radiation therapy contouring, optimal methods for its use have not been well-established. Therefore, we investigated the relationship between the size of the atlas patient population and the atlas segmentation auto contouring (AC) performance.

Methods: A total of 110 patients' head planning CT images were selected. The mandible and thyroid were selected for this study. The mandibles and thyroids of the patient population were carefully segmented by two skilled clinicians. Of the 110 patients, 100 random patients were registered to 5 different atlas libraries as atlas patients, in groups of 20 to 100, with increments of 20. AS was conducted for each of the remaining 10 patients, either by simultaneous atlas segmentation (SAS) or independent atlas segmentation (IAS). The AS duration of each target patient was recorded. To validate the accuracy of the generated contours, auto contours were compared to manually generated contours (MC) using a volume-overlap-dependent metric, Dice Similarity Coefficient (DSC), and a distance-dependent metric, Hausdorff Distance (HD).

Results: In both organs, as the population increased from n = 20 to n = 60, the results showed better convergence. Generally, independent cases produced better performance than simultaneous cases. For the mandible, the best performance was achieved by n = 60 [DSC = 0.92 (0.01) and HD = 6.73 (1.31) mm] and the worst by n = 100 [DSC = 0.90 (0.03) and HD = 10.10 (6.52) mm] atlas libraries. Similar results were achieved with the thyroid; the best performance was achieved by n = 60 [DSC = 0.79 (0.06) and HD = 10.17 (2.89) mm] and the worst by n = 100 [DSC = 0.72 (0.13) and HD = 12.88 (3.94) mm] atlas libraries. Both IAS and SAS showed similar results. Manual contouring of the mandible and thyroid required an average of 1,044 (±170.15) seconds, while AS required an average of 46.4 (±2.8) seconds.

Conclusions: The performance of AS AC generally increased as the population of the atlas library increased. However, the performance does not drastically vary in the larger atlas libraries in contrast to the logic that bigger atlas library should lead to better results. In fact, the results do not vary significantly toward the larger atlas library. It is necessary for the institutions to independently research the optimal number of subjects.

Comparative evaluation of autocontouring in clinical practice: A practical method using the Turing test

PURPOSE

Automated techniques for estimating the contours of organs and structures in medical images have become more widespread and a variety of measures are available for assessing their quality. Quantitative measures of geometric agreement, for example, overlap with a gold-standard delineation, are popular but may not predict the level of clinical acceptance for the contouring method. Therefore, surrogate measures that relate more directly to the clinical judgment of contours, and to the way they are used in routine workflows, need to be developed. The purpose of this study is to propose a method (inspired by the Turing Test) for providing contour quality measures that directly draw upon practitioners' assessments of manual and automatic contours. This approach assumes that an inability to distinguish automatically produced contours from those of clinical experts would indicate that the contours are of sufficient quality for clinical use. In turn, it is anticipated that such contours would receive less manual editing prior to being accepted for clinical use. In this study, an initial assessment of this approach is performed with radiation oncologists and therapists.

METHODS

Eight clinical observers were presented with thoracic organ-at-risk contours through a web interface and were asked to determine if they were automatically generated or manually delineated. The accuracy of the visual determination was assessed, and the proportion of contours for which the source was misclassified recorded. Contours of six different organs in a clinical workflow were for 20 patient cases. The time required to edit autocontours to a clinically acceptable standard was also measured, as a gold standard of clinical utility. Established quantitative measures of autocontouring performance, such as Dice similarity coefficient with respect to the original clinical contour and the misclassification rate accessed with the proposed framework, were evaluated as surrogates of the editing time measured.

RESULTS

The misclassification rates for each organ were: esophagus 30.0%, heart 22.9%, left lung 51.2%, right lung 58.5%, mediastinum envelope 43.9%, and spinal cord 46.8%. The time savings resulting from editing the autocontours compared to the standard clinical workflow were 12%, 25%, 43%, 77%, 46%, and 50%, respectively, for these organs. The median Dice similarity coefficients between the clinical contours and the autocontours were 0.46, 0.90, 0.98, 0.98, 0.94, and 0.86, respectively, for these organs.

CONCLUSIONS

A better correspondence with time saving was observed for the misclassification rate than the quantitative contour measures explored. From this, we conclude that the inability to accurately judge the source of a contour indicates a reduced need for editing and therefore a greater time saving overall. Hence, task-based assessments of contouring performance may be considered as an additional way of evaluating the clinical utility of autosegmentation methods.

Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images

BACKGROUND

Radiotherapy is one of the main treatment methods for nasopharyngeal carcinoma (NPC). It requires exact delineation of the nasopharynx gross tumor volume (GTVnx), the metastatic lymph node gross tumor volume (GTVnd), the clinical target volume (CTV), and organs at risk in the planning computed tomography images. However, this task is time-consuming and operator dependent. In the present study, we developed an end-to-end deep deconvolutional neural network (DDNN) for segmentation of these targets.

METHODS

The proposed DDNN is an end-to-end architecture enabling fast training and testing. It consists of two important components: an encoder network and a decoder network. The encoder network was used to extract the visual features of a medical image and the decoder network was used to recover the original resolution by deploying deconvolution. A total of 230 patients diagnosed with NPC stage I or stage II were included in this study. Data from 184 patients were chosen randomly as a training set to adjust the parameters of DDNN, and the remaining 46 patients were the test set to assess the performance of the model. The Dice similarity coefficient (DSC) was used to quantify the segmentation results of the GTVnx, GTVnd, and CTV. In addition, the performance of DDNN was compared with the VGG-16 model.

RESULTS

The proposed DDNN method outperformed the VGG-16 in all the segmentation. The mean DSC values of DDNN were 80.9% for GTVnx, 62.3% for the GTVnd, and 82.6% for CTV, whereas VGG-16 obtained 72.3, 33.7, and 73.7% for the DSC values, respectively.

CONCLUSION

DDNN can be used to segment the GTVnx and CTV accurately. The accuracy for the GTVnd segmentation was relatively low due to the considerable differences in its shape, volume, and location among patients. The accuracy is expected to increase with more training data and combination of MR images. In conclusion, DDNN has the potential to improve the consistency of contouring and streamline radiotherapy workflows, but careful human review and a considerable amount of editing will be required.

Atlas ranking and selection for automatic segmentation of the esophagus from CT scans

In radiation treatment planning, the esophagus is an important organ-at-risk that should be spared in patients with head and neck cancer or thoracic cancer who undergo intensity-modulated radiation therapy. However, automatic segmentation of the esophagus from CT scans is extremely challenging because of the structure's inconsistent intensity, low contrast against the surrounding tissues, complex and variable shape and location, and random air bubbles. The goal of this study is to develop an online atlas selection approach to choose a subset of optimal atlases for multi-atlas segmentation to the delineate esophagus automatically. We performed atlas selection in two phases. In the first phase, we used the correlation coefficient of the image content in a cubic region between each atlas and the new image to evaluate their similarity and to rank the atlases in an atlas pool. A subset of atlases based on this ranking was selected, and deformable image registration was performed to generate deformed contours and deformed images in the new image space. In the second phase of atlas selection, we used Kullback-Leibler divergence to measure the similarity of local-intensity histograms between the new image and each of the deformed images, and the measurements were used to rank the previously selected atlases. Deformed contours were overlapped sequentially, from the most to the least similar, and the overlap ratio was examined. We further identified a subset of optimal atlases by analyzing the variation of the overlap ratio versus the number of atlases. The deformed contours from these optimal atlases were fused together using a modified simultaneous truth and performance level estimation algorithm to produce the final segmentation. The approach was validated with promising results using both internal data sets (21 head and neck cancer patients and 15 thoracic cancer patients) and external data sets (30 thoracic patients).

Probabilistic liver atlas construction

BACKGROUND

Anatomical atlases are 3D volumes or shapes representing an organ or structure of the human body. They contain either the prototypical shape of the object of interest together with other shapes representing its statistical variations (statistical atlas) or a probability map of belonging to the object (probabilistic atlas). Probabilistic atlases are mostly built with simple estimations only involving the data at each spatial location.

RESULTS

A new method for probabilistic atlas construction that uses a generalized linear model is proposed. This method aims to improve the estimation of the probability to be covered by the liver. Furthermore, all methods to build an atlas involve previous coregistration of the sample of shapes available. The influence of the geometrical transformation adopted for registration in the quality of the final atlas has not been sufficiently investigated. The ability of an atlas to adapt to a new case is one of the most important quality criteria that should be taken into account. The presented experiments show that some methods for atlas construction are severely affected by the previous coregistration step.

CONCLUSION

We show the good performance of the new approach. Furthermore, results suggest that extremely flexible registration methods are not always beneficial, since they can reduce the variability of the atlas and hence its ability to give sensible values of probability when used as an aid in segmentation of new cases.

Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck

BACKGROUND

Manual delineation of structures in head and neck cancers is an extremely time-consuming and labor-intensive procedure. With centers worldwide moving towards the use of intensity-modulated radiotherapy and adaptive radiotherapy, there is a need to explore and analyze auto-segmentation (AS) software, in the search for a faster yet accurate method of structure delineation.

MATERIAL AND METHODS

A search for studies published after 2005 comparing AS and manual delineation in contouring organ at risks (OARs) and target volume for head and neck patients was conducted. The reviewed results were then categorized into arguments proposing and opposing the review title.

RESULTS

Ten studies were reviewed and derived results were assessed in terms of delineation time-saving ability and extent of delineation accuracy. The influence of other external factors (observer variability, AS strategies adopted and stage of disease) were also considered. Results were conflicting with some studies demonstrating great potential in replacing manual delineation whereas other studies illustrated otherwise. Six of 10 studies investigated time saving; the largest time saving reported being 59%. However, one study found that additional time of 15.7% was required for AS. Four studies reported AS contours to be between 'reasonably good' and 'better quality' than the clinically used contours. Remaining studies cited lack of contrast, AS strategy used and the need for physician intervention as limitations in the standardized use of AS.

DISCUSSION

The studies demonstrated significant potential of AS as a useful delineation tool in contouring target volumes and OARs in head and neck cancers. However, it is evident that AS cannot totally replace manual delineation in contouring some structures in the head and neck and cannot be used independently without human intervention. It is also emphasized that delineation studies should be conducted locally so as to evaluate the true value of AS in head and neck cancers in a specific center.

Importance of Radiation Oncologist Experience Among Patients With Head-and-Neck Cancer Treated With Intensity-Modulated Radiation Therapy

PURPOSE

Over the past decade, intensity-modulated radiation therapy (IMRT) has replaced conventional radiation techniques in the management of head-and-neck cancers (HNCs). We conducted this population-based study to evaluate the influence of radiation oncologist experience on outcomes in patients with HNC treated with IMRT compared with patients with HNC treated with conventional radiation therapy.

METHODS

We identified radiation providers from Medicare claims of 6,212 Medicare beneficiaries with HNC treated between 2000 and 2009. We analyzed the impact of provider volume on all-cause mortality, HNC mortality, and toxicity end points after treatment with either conventional radiation therapy or IMRT. All analyses were performed by using either multivariable Cox proportional hazards or Fine-Gray regression models controlling for potential confounding variables.

RESULTS

Among patients treated with conventional radiation, we found no significant relationship between provider volume and patient survival or any toxicity end point. Among patients receiving IMRT, those treated by higher-volume radiation oncologists had improved survival compared with those treated by low-volume providers. The risk of all-cause mortality decreased by 21% for every additional five patients treated per provider per year (hazard ratio [HR], 0.79; 95% CI, 0.67 to 0.94). Patients treated with IMRT by higher-volume providers had decreased HNC-specific mortality (subdistribution HR, 0.68; 95% CI, 0.50 to 0.91) and decreased risk of aspiration pneumonia (subdistribution HR, 0.72; 95% CI, 0.52 to 0.99).

CONCLUSION

Patients receiving IMRT for HNC had improved outcomes when treated by higher-volume providers. These findings will better inform patients and providers when making decisions about treatment, and emphasize the critical importance of high-quality radiation therapy for optimal treatment of HNC.

Multi-atlas segmentation of biomedical images: A survey

Multi-atlas segmentation (MAS), first introduced and popularized by the pioneering work of Rohlfing, et al. (2004), Klein, et al. (2005), and Heckemann, et al. (2006), is becoming one of the most widely-used and successful image segmentation techniques in biomedical applications. By manipulating and utilizing the entire dataset of "atlases" (training images that have been previously labeled, e.g., manually by an expert), rather than some model-based average representation, MAS has the flexibility to better capture anatomical variation, thus offering superior segmentation accuracy. This benefit, however, typically comes at a high computational cost. Recent advancements in computer hardware and image processing software have been instrumental in addressing this challenge and facilitated the wide adoption of MAS. Today, MAS has come a long way and the approach includes a wide array of sophisticated algorithms that employ ideas from machine learning, probabilistic modeling, optimization, and computer vision, among other fields. This paper presents a survey of published MAS algorithms and studies that have applied these methods to various biomedical problems. In writing this survey, we have three distinct aims. Our primary goal is to document how MAS was originally conceived, later evolved, and now relates to alternative methods. Second, this paper is intended to be a detailed reference of past research activity in MAS, which now spans over a decade (2003-2014) and entails novel methodological developments and application-specific solutions. Finally, our goal is to also present a perspective on the future of MAS, which, we believe, will be one of the dominant approaches in biomedical image segmentation.

How much will linked deformable registrations decrease the quality of multi-atlas segmentation fusions?

BACKGROUND AND PURPOSE

Multi-atlas segmentation can yield better results than single atlas segmentation, but practical applications are limited by long calculation times for deformable registration. To shorten the calculation time pre-calculated registrations of atlases could be linked via a single atlas registered in runtime to the current patient. The primary purpose of this work is to investigate and quantify segmentation quality changes introduced by such linked registrations. We also determine the optimal parameters for fusing linked multi-atlas labels using probabilistic weighted fusion.

MATERIAL AND METHODS

Computed tomography images of 10 head and neck cancer patients were used as atlases, with parotid glands, submandibular glands, the mandible and lymph node levels II-IV segmented by an experienced radiation oncologist following published consensus guidelines. The change in segmentation quality scored by Dice similarity coefficient (DSC) for linking free-form deformable registrations, modeled by B-splines, was investigated for both single- and multi-atlas label fusion by using a leave-one-out approach.

RESULTS

The median decrease of the DSC was in the range 2.8% to 8.4% compared to direct registrations for all structures while reducing the computer calculation time to that of a single deformable registration. Linking several registrations showed a DSC decrease almost linear to the number of links, suggesting that extrapolation to zero links provides an observer independent measure of the inherent precision with which the segmentation guidelines can be applied.

CONCLUSIONS

Linking pre-made registrations of multiple atlases via a runtime registration of a single atlas provides a feasible method for reducing computation time in multi-atlas registration.

Vision 20/20: perspectives on automated image segmentation for radiotherapy

Due to rapid advances in radiation therapy (RT), especially image guidance and treatment adaptation, a fast and accurate segmentation of medical images is a very important part of the treatment. Manual delineation of target volumes and organs at risk is still the standard routine for most clinics, even though it is time consuming and prone to intra- and interobserver variations. Automated segmentation methods seek to reduce delineation workload and unify the organ boundary definition. In this paper, the authors review the current autosegmentation methods particularly relevant for applications in RT. The authors outline the methods' strengths and limitations and propose strategies that could lead to wider acceptance of autosegmentation in routine clinical practice. The authors conclude that currently, autosegmentation technology in RT planning is an efficient tool for the clinicians to provide them with a good starting point for review and adjustment. Modern hardware platforms including GPUs allow most of the autosegmentation tasks to be done in a range of a few minutes. In the nearest future, improvements in CT-based autosegmentation tools will be achieved through standardization of imaging and contouring protocols. In the longer term, the authors expect a wider use of multimodality approaches and better understanding of correlation of imaging with biology and pathology.