1
|
Sarria GR, Kugel F, Roehner F, Layer J, Dejonckheere C, Scafa D, Koeksal M, Leitzen C, Schmeel LC. Artificial Intelligence-Based Autosegmentation: Advantages in Delineation, Absorbed Dose-Distribution, and Logistics. Adv Radiat Oncol 2024; 9:101394. [PMID: 38292888 PMCID: PMC10823084 DOI: 10.1016/j.adro.2023.101394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 10/09/2023] [Indexed: 02/01/2024] Open
Abstract
Purpose The study's purpose was to compare the performance of artificial intelligence (AI) in auto-contouring compared with a human practitioner in terms of precision, differences in dose distribution, and time consumption. Methods and Materials Datasets of previously irradiated patients in 3 different segments (head and neck, breast, and prostate cancer) were retrospectively collected. An experienced radiation oncologist (MD) performed organs-at-risk (OARs) and standard clinical target volume delineations as baseline structures for comparison. AI-based autocontours were generated in 2 additional CT copies; therefore, 3 groups were assessed: MD alone, AI alone, and AI plus MD corrections (AI+C). Differences in Dice similarity coefficient (DSC) and person-hour burden were assessed. Furthermore, changes in clinically relevant dose-volume parameters were evaluated and compared. Results Seventy-five previously treated cases were collected (25 per segment) for the analysis. Compared with MD contours, the mean DSC scores were higher than 0.7 for 74% and 80% of AI and AI+C, respectively. After corrections, 17.1% structures presented DSC score deviations higher than 0.1 and 10.4% dose-volume parameters significantly changed in AI-contoured structures. The time consumption assessment yielded mean person-hour reductions of 68%, 51%, and 71% for breast, prostate, and head and neck cancer, respectively. Conclusions In great extent, AI yielded clinically acceptable OARs and certain clinical target volumes in the explored anatomic segments. Sparse correction and assessment requirements place AI+C as a standard workflow. Minimal clinically relevant differences in OAR exposure were identified. A substantial amount of person-hours could be repurposed with this technology.
Collapse
Affiliation(s)
| | | | | | - Julian Layer
- Department of Radiation Oncology
- Institute of Experimental Oncology, University Hospital Bonn, University of Bonn, Bonn, Germany
| | | | | | | | | | | |
Collapse
|
2
|
Maes D, Gates EDH, Meyer J, Kang J, Nguyen BNT, Lavilla M, Melancon D, Weg ES, Tseng YD, Lim A, Bowen SR. Framework for Radiation Oncology Department-wide Evaluation and Implementation of Commercial Artificial Intelligence Autocontouring. Pract Radiat Oncol 2024; 14:e150-e158. [PMID: 37935308 DOI: 10.1016/j.prro.2023.10.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 10/19/2023] [Accepted: 10/22/2023] [Indexed: 11/09/2023]
Abstract
PURPOSE Artificial intelligence (AI)-based autocontouring in radiation oncology has potential benefits such as standardization and time savings. However, commercial AI solutions require careful evaluation before clinical integration. We developed a multidimensional evaluation method to test pretrained AI-based automated contouring solutions across a network of clinics. METHODS AND MATERIALS Curated data included 121 patient planning computed tomography (CT) scans with a total of 859 clinically approved contours used for treatment from 4 clinics. Regions of interest (ROIs) were generated with 3 commercial AI-based automated contouring software solutions (AI1, AI2, AI3) spanning the following disease sites: brain, head and neck (H&N), thorax, abdomen, and pelvis. Quantitative agreement between AI-generated and clinical contours was measured by Dice similarity coefficient (DSC) and Hausdorff distance (HD). Qualitative assessment was performed by multiple experts scoring blinded AI-contours using a Likert scale. Workflow and usability surveying was also conducted. RESULTS AI1, AI2, and AI3 contours had high quantitative agreement in 27.8%, 32.8%, and 34.1% of cases (DSC >0.9), performing well in pelvis (median DSC = 0.86/0.88/0.91) and thorax (median DSC = 0.91/0.89/0.91). All 3 solutions had low quantitative agreement in 7.4%, 8.8%, and 6.1% of cases (DSC <0.5), performing worse in brain (median DSC = 0.65/0.78/0.75) and H&N (median DSC = 0.76/0.80/0.81). Qualitatively, AI1 and AI2 contours were acceptable (rated 1-2) with at most minor edits in 70.7% and 74.6% of ROIs (2906 ratings), higher for abdomen (AI1: 79.2%) and thorax (AI2: 90.2%), and lower for H&N (29.0/35.6%). An end-user survey showed strong user preference for full automation and mixed preferences for accuracy versus total number of structures generated. CONCLUSIONS Our evaluation method provided a comprehensive analysis of both quantitative and qualitative measures of commercially available pretrained AI autocontouring algorithms. The evaluation framework served as a roadmap for clinical integration that aligned with user workflow preference.
Collapse
Affiliation(s)
- Dominic Maes
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington; Department of Radiation Oncology, University of Washington, Seattle, Washington.
| | - Evan D H Gates
- Department of Radiation Oncology, University of Washington, Seattle, Washington
| | - Juergen Meyer
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington; Department of Radiation Oncology, University of Washington, Seattle, Washington
| | - John Kang
- Department of Radiation Oncology, University of Washington, Seattle, Washington
| | - Bao-Ngoc Thi Nguyen
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington
| | - Myra Lavilla
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington
| | - Dustin Melancon
- Department of Radiation Oncology, University of Washington, Seattle, Washington
| | - Emily S Weg
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington; Department of Radiation Oncology, University of Washington, Seattle, Washington
| | - Yolanda D Tseng
- Department of Radiation Oncology, University of Washington, Seattle, Washington; Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, Washington
| | - Andrew Lim
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington; Department of Radiation Oncology, University of Washington, Seattle, Washington; Department of Radiation Oncology, University of Southern California, Los Angeles, California
| | - Stephen R Bowen
- Department of Radiation Oncology, Fred Hutchinson Cancer Center, Seattle, Washington; Department of Radiation Oncology, University of Washington, Seattle, Washington; Department of Radiology, University of Washington, Seattle, Washington
| |
Collapse
|
3
|
Brooks J, Tryggestad E, Anand A, Beltran C, Foote R, Lucido JJ, Laack NN, Routman D, Patel SH, Seetamsetty S, Moseley D. Knowledge-based quality assurance of a comprehensive set of organ at risk contours for head and neck radiotherapy. Front Oncol 2024; 14:1295251. [PMID: 38487718 PMCID: PMC10937434 DOI: 10.3389/fonc.2024.1295251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 02/05/2024] [Indexed: 03/17/2024] Open
Abstract
Introduction Manual review of organ at risk (OAR) contours is crucial for creating safe radiotherapy plans but can be time-consuming and error prone. Statistical and deep learning models show the potential to automatically detect improper contours by identifying outliers using large sets of acceptable data (knowledge-based outlier detection) and may be able to assist human reviewers during review of OAR contours. Methods This study developed an automated knowledge-based outlier detection method and assessed its ability to detect erroneous contours for all common head and neck (HN) OAR types used clinically at our institution. We utilized 490 accurate CT-based HN structure sets from unique patients, each with forty-two HN OAR contours when anatomically present. The structure sets were distributed as 80% for training, 10% for validation, and 10% for testing. In addition, 190 and 37 simulated contours containing errors were added to the validation and test sets, respectively. Single-contour features, including location, shape, orientation, volume, and CT number, were used to train three single-contour feature models (z-score, Mahalanobis distance [MD], and autoencoder [AE]). Additionally, a novel contour-to-contour relationship (CCR) model was trained using the minimum distance and volumetric overlap between pairs of OAR contours to quantify overlap and separation. Inferences from single-contour feature models were combined with the CCR model inferences and inferences evaluating the number of disconnected parts in a single contour and then compared. Results In the test dataset, before combination with the CCR model, the area under the curve values were 0.922/0.939/0.939 for the z-score, MD, and AE models respectively for all contours. After combination with CCR model inferences, the z-score, MD, and AE had sensitivities of 0.838/0.892/0.865, specificities of 0.922/0.907/0.887, and balanced accuracies (BA) of 0.880/0.900/0.876 respectively. In the validation dataset, with similar overall performance and no signs of overfitting, model performance for individual OAR types was assessed. The combined AE model demonstrated minimum, median, and maximum BAs of 0.729, 0.908, and 0.980 across OAR types. Discussion Our novel knowledge-based method combines models utilizing single-contour and CCR features to effectively detect erroneous OAR contours across a comprehensive set of 42 clinically used OAR types for HN radiotherapy.
Collapse
Affiliation(s)
- Jamison Brooks
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - Erik Tryggestad
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - Aman Anand
- Department of Radiation Oncology, Mayo Clinic Arizona, Phoenix, AZ, United States
| | - Chris Beltran
- Department of Radiation Oncology, Mayo Clinic Florida, Jacksonville, FL, United States
| | - Robert Foote
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - J. John Lucido
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - Nadia N. Laack
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - David Routman
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - Samir H. Patel
- Department of Radiation Oncology, Mayo Clinic Arizona, Phoenix, AZ, United States
| | - Srinivas Seetamsetty
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| | - Douglas Moseley
- Department of Radiation Oncology, Mayo Clinic Rochester, Rochester, MN, United States
| |
Collapse
|
4
|
Gay SS, Cardenas CE, Nguyen C, Netherton TJ, Yu C, Zhao Y, Skett S, Patel T, Adjogatse D, Guerrero Urbano T, Naidoo K, Beadle BM, Yang J, Aggarwal A, Court LE. Fully-automated, CT-only GTV contouring for palliative head and neck radiotherapy. Sci Rep 2023; 13:21797. [PMID: 38066074 PMCID: PMC10709623 DOI: 10.1038/s41598-023-48944-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 12/01/2023] [Indexed: 12/18/2023] Open
Abstract
Planning for palliative radiotherapy is performed without the advantage of MR or PET imaging in many clinics. Here, we investigated CT-only GTV delineation for palliative treatment of head and neck cancer. Two multi-institutional datasets of palliative-intent treatment plans were retrospectively acquired: a set of 102 non-contrast-enhanced CTs and a set of 96 contrast-enhanced CTs. The nnU-Net auto-segmentation network was chosen for its strength in medical image segmentation, and five approaches separately trained: (1) heuristic-cropped, non-contrast images with a single GTV channel, (2) cropping around a manually-placed point in the tumor center for non-contrast images with a single GTV channel, (3) contrast-enhanced images with a single GTV channel, (4) contrast-enhanced images with separate primary and nodal GTV channels, and (5) contrast-enhanced images along with synthetic MR images with separate primary and nodal GTV channels. Median Dice similarity coefficient ranged from 0.6 to 0.7, surface Dice from 0.30 to 0.56, and 95th Hausdorff distance from 14.7 to 19.7 mm across the five approaches. Only surface Dice exhibited statistically-significant difference across these five approaches using a two-tailed Wilcoxon Rank-Sum test (p ≤ 0.05). Our CT-only results met or exceeded published values for head and neck GTV autocontouring using multi-modality images. However, significant edits would be necessary before clinical use in palliative radiotherapy.
Collapse
Affiliation(s)
- Skylar S Gay
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA.
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA.
| | - Carlos E Cardenas
- Department of Radiation Oncology, The University of Alabama at Birmingham, Birmingham, AL, USA
| | - Callistus Nguyen
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
| | - Tucker J Netherton
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
| | - Cenji Yu
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
| | - Yao Zhao
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
| | | | | | | | | | | | | | - Jinzhong Yang
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
| | | | - Laurence E Court
- Unit 1472, Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Houston, TX, 77030, USA
| |
Collapse
|
5
|
Duan J, Bernard ME, Rong Y, Castle JR, Feng X, Johnson JD, Chen Q. Contour subregion error detection methodology using deep learning auto-segmentation. Med Phys 2023; 50:6673-6683. [PMID: 37793103 DOI: 10.1002/mp.16768] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 07/26/2023] [Accepted: 09/17/2023] [Indexed: 10/06/2023] Open
Abstract
BACKGROUND Inaccurate manual organ delineation is one of the high-risk failure modes in radiation treatment. Numerous automated contour quality assurance (QA) systems have been developed to assess contour acceptability; however, manual inspection of flagged cases is a time-consuming and challenging process, and can lead to users overlooking the exact error location. PURPOSE Our aim is to develop and validate a contour QA system that can effectively detect and visualize subregional contour errors, both qualitatively and quantitatively. METHODS/MATERIALS A novel contour subregion error detection (CSED) system was developed using subregional surface distance discrepancies between manual and deep learning auto-segmentation (DLAS) contours. A validation study was conducted using a head and neck public dataset containing 339 cases and evaluated according to knowledge-based pass criteria derived from a clinical training dataset of 60 cases. A blind qualitative evaluation was conducted, comparing the results from the CSED system with manual labels. Subsequently, the CSED-flagged cases were re-examined by a radiation oncologist. RESULTS The CSED system could visualize the diverse types of subregional contour errors qualitatively and quantitatively. In the validation dataset, the CSED system resulted in true positive rates (TPR) of 0.814, 0.800, and 0.771; false positive rates (FPR) of 0.310, 0.267, and 0.298; and accuracies of 0.735, 0.759, and 0.730, for brainstem and left and right parotid contours, respectively. The CSED-assisted manual review caught 13 brainstem, 19 left parotid, and 21 right parotid contour errors missed by conventional human review. The TPR/FPR/accuracy of the CSED-assisted manual review improved to 0.836/0.253/0.784, 0.831/0.171/0.830, and 0.808/0.193/0.807 for each structure, respectively. Further, the time savings achieved through CSED-assisted review improved by 75%, with the time for review taking 24.81 ± 12.84, 26.75 ± 10.41, and 28.71 ± 13.72 s for each structure, respectively. CONCLUSIONS The CSED system enables qualitative and quantitative detection, localization, and visualization of manual segmentation subregional errors utilizing DLAS contours as references. The use of this system has been shown to help reduce the risk of high-risk failure modes resulting from inaccurate organ segmentation.
Collapse
Affiliation(s)
- Jingwei Duan
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Mark E Bernard
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Yi Rong
- Department of Radiation Oncology, Mayo Clinic, Phoenix, Arizona, USA
| | - James R Castle
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Xue Feng
- Carina Medical LLC, Lexington, Kentucky, USA
| | - Jeremiah D Johnson
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Quan Chen
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
- Department of Radiation Oncology, City of Hope Comprehensive Cancer Center, Duarte, California, USA
| |
Collapse
|
6
|
Baroudi H, Huy Minh Nguyen CI, Maroongroge S, Smith BD, Niedzielski JS, Shaitelman SF, Melancon A, Shete S, Whitaker TJ, Mitchell MP, Yvonne Arzu I, Duryea J, Hernandez S, El Basha D, Mumme R, Netherton T, Hoffman K, Court L. Automated contouring and statistical process control for plan quality in a breast clinical trial. Phys Imaging Radiat Oncol 2023; 28:100486. [PMID: 37712064 PMCID: PMC10498301 DOI: 10.1016/j.phro.2023.100486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 08/21/2023] [Accepted: 08/21/2023] [Indexed: 09/16/2023] Open
Abstract
Background and purpose Automatic review of breast plan quality for clinical trials is time-consuming and has some unique challenges due to the lack of target contours for some planning techniques. We propose using an auto-contouring model and statistical process control to independently assess planning consistency in retrospective data from a breast radiotherapy clinical trial. Materials and methods A deep learning auto-contouring model was created and tested quantitatively and qualitatively on 104 post-lumpectomy patients' computed tomography images (nnUNet; train/test: 80/20). The auto-contouring model was then applied to 127 patients enrolled in a clinical trial. Statistical process control was used to assess the consistency of the mean dose to auto-contours between plans and treatment modalities by setting control limits within three standard deviations of the data's mean. Two physicians reviewed plans outside the limits for possible planning inconsistencies. Results Mean Dice similarity coefficients comparing manual and auto-contours was above 0.7 for breast clinical target volume, supraclavicular and internal mammary nodes. Two radiation oncologists scored 95% of contours as clinically acceptable. The mean dose in the clinical trial plans was more variable for lymph node auto-contours than for breast, with a narrower distribution for volumetric modulated arc therapy than for 3D conformal treatment, requiring distinct control limits. Five plans (5%) were flagged and reviewed by physicians: one required editing, two had clinically acceptable variations in planning, and two had poor auto-contouring. Conclusions An automated contouring model in a statistical process control framework was appropriate for assessing planning consistency in a breast radiotherapy clinical trial.
Collapse
Affiliation(s)
- Hana Baroudi
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Callistus I. Huy Minh Nguyen
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Sean Maroongroge
- Department of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Benjamin D. Smith
- Department of Breast Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Joshua S. Niedzielski
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Simona F. Shaitelman
- Department of Breast Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Adam Melancon
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Sanjay Shete
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
| | - Thomas J. Whitaker
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Melissa P. Mitchell
- Department of Breast Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Isidora Yvonne Arzu
- Department of Breast Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Jack Duryea
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Soleil Hernandez
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Daniel El Basha
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Raymond Mumme
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Tucker Netherton
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Karen Hoffman
- Department of Breast Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Laurence Court
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, USA
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
7
|
Hernandez S, Burger H, Nguyen C, Paulino AC, Lucas JT, Faught AM, Duryea J, Netherton T, Rhee DJ, Cardenas C, Howell R, Fuentes D, Pollard-Larkin J, Court L, Parkes J. Validation of an automated contouring and treatment planning tool for pediatric craniospinal radiation therapy. Front Oncol 2023; 13:1221792. [PMID: 37810961 PMCID: PMC10556471 DOI: 10.3389/fonc.2023.1221792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 09/06/2023] [Indexed: 10/10/2023] Open
Abstract
Purpose Treatment planning for craniospinal irradiation (CSI) is complex and time-consuming, especially for resource-constrained centers. To alleviate demanding workflows, we successfully automated the pediatric CSI planning pipeline in previous work. In this work, we validated our CSI autosegmentation and autoplanning tool on a large dataset from St. Jude Children's Research Hospital. Methods Sixty-three CSI patient CT scans were involved in the study. Pre-planning scripts were used to automatically verify anatomical compatibility with the autoplanning tool. The autoplanning pipeline generated 15 contours and a composite CSI treatment plan for each of the compatible test patients (n=51). Plan quality was evaluated quantitatively with target coverage and dose to normal tissue metrics and qualitatively with physician review, using a 5-point Likert scale. Three pediatric radiation oncologists from 3 institutions reviewed and scored 15 contours and a corresponding composite CSI plan for the final 51 test patients. One patient was scored by 3 physicians, resulting in 53 plans scored total. Results The algorithm automatically detected 12 incompatible patients due to insufficient junction spacing or head tilt and removed them from the study. Of the 795 autosegmented contours reviewed, 97% were scored as clinically acceptable, with 92% requiring no edits. Of the 53 plans scored, all 51 brain dose distributions were scored as clinically acceptable. For the spine dose distributions, 92%, 100%, and 68% of single, extended, and multiple-field cases, respectively, were scored as clinically acceptable. In all cases (major or minor edits), the physicians noted that they would rather edit the autoplan than create a new plan. Conclusions We successfully validated an autoplanning pipeline on 51 patients from another institution, indicating that our algorithm is robust in its adjustment to differing patient populations. We automatically generated 15 contours and a comprehensive CSI treatment plan for each patient without physician intervention, indicating the potential for increased treatment planning efficiency and global access to high-quality radiation therapy.
Collapse
Affiliation(s)
- Soleil Hernandez
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Hester Burger
- Department Medical Physics, Groote Schuur Hospital and University of Cape Town, Cape Town, South Africa
| | - Callistus Nguyen
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Arnold C. Paulino
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - John T. Lucas
- Department of Radiation Oncology, St. Jude Children’s Research Hospital, Memphis, TN, United States
| | - Austin M. Faught
- Department of Radiation Oncology, St. Jude Children’s Research Hospital, Memphis, TN, United States
| | - Jack Duryea
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Tucker Netherton
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Dong Joo Rhee
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Carlos Cardenas
- Department of Radiation Oncology, University of Alabama at Birmingham, Birmingham, AL, United States
| | - Rebecca Howell
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - David Fuentes
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Julianne Pollard-Larkin
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Laurence Court
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX, United States
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Jeannette Parkes
- Department of Radiation Oncology, Groote Schuur Hospital and University of Cape Town, Cape Town, South Africa
| |
Collapse
|
8
|
Court L, Aggarwal A, Burger H, Cardenas C, Chung C, Douglas R, du Toit M, Jaffray D, Jhingran A, Mejia M, Mumme R, Muya S, Naidoo K, Ndumbalo J, Nealon K, Netherton T, Nguyen C, Olanrewaju N, Parkes J, Shaw W, Trauernicht C, Xu M, Yang J, Zhang L, Simonds H, Beadle BM. Addressing the Global Expertise Gap in Radiation Oncology: The Radiation Planning Assistant. JCO Glob Oncol 2023; 9:e2200431. [PMID: 37471671 PMCID: PMC10581646 DOI: 10.1200/go.22.00431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 02/08/2023] [Accepted: 04/24/2023] [Indexed: 07/22/2023] Open
Abstract
PURPOSE Automation, including the use of artificial intelligence, has been identified as a possible opportunity to help reduce the gap in access and quality for radiotherapy and other aspects of cancer care. The Radiation Planning Assistant (RPA) project was conceived in 2015 (and funded in 2016) to use automated contouring and treatment planning algorithms to support the efforts of oncologists in low- and middle-income countries, allowing them to scale their efforts and treat more patients safely and efficiently (to increase access). DESIGN In this review, we discuss the development of the RPA, with a particular focus on clinical acceptability and safety/risk across jurisdictions as these are important indicators for the successful future deployment of the RPA to increase radiotherapy availability and ameliorate global disparities in access to radiation oncology. RESULTS RPA tools will be offered through a webpage, where users can upload computed tomography data sets and download automatically generated contours and treatment plans. All interfaces have been designed to maximize ease of use and minimize risk. The current version of the RPA includes automated contouring and planning for head and neck cancer, cervical cancer, breast cancer, and metastases to the brain. CONCLUSION The RPA has been designed to bring high-quality treatment planning to more patients across the world, and it may encourage greater investment in treatment devices and other aspects of cancer treatment.
Collapse
Affiliation(s)
- Laurence Court
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Ajay Aggarwal
- Guy's and St Thomas' Hospital, London, United Kingdom
| | - Hester Burger
- Groote Schuur Hospital, University of Cape Town, Cape Town, South Africa
| | | | - Christine Chung
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Raphael Douglas
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Monique du Toit
- Tygerberg Hospital, Stellenbosch University, Cape Town, South Africa
| | - David Jaffray
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Anuja Jhingran
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Michael Mejia
- Benavides Cancer Institute, University of Santo Tomas, Manila, Philippines
| | - Raymond Mumme
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | | | - Komeela Naidoo
- Tygerberg Hospital, Stellenbosch University, Cape Town, South Africa
| | | | - Kelly Nealon
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | | | | | - Niki Olanrewaju
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Jeannette Parkes
- Groote Schuur Hospital, University of Cape Town, Cape Town, South Africa
| | - Willie Shaw
- University of the Free State, Bloemfontein, South Africa
| | | | - Melody Xu
- University of California San Francisco, San Francisco, CA
| | - Jinzhong Yang
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | - Lifei Zhang
- The University of Texas MD Anderson Cancer Center, Houston, TX
| | | | | |
Collapse
|
9
|
Baroudi H, Brock KK, Cao W, Chen X, Chung C, Court LE, El Basha MD, Farhat M, Gay S, Gronberg MP, Gupta AC, Hernandez S, Huang K, Jaffray DA, Lim R, Marquez B, Nealon K, Netherton TJ, Nguyen CM, Reber B, Rhee DJ, Salazar RM, Shanker MD, Sjogreen C, Woodland M, Yang J, Yu C, Zhao Y. Automated Contouring and Planning in Radiation Therapy: What Is 'Clinically Acceptable'? Diagnostics (Basel) 2023; 13:diagnostics13040667. [PMID: 36832155 PMCID: PMC9955359 DOI: 10.3390/diagnostics13040667] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Revised: 01/21/2023] [Accepted: 01/30/2023] [Indexed: 02/12/2023] Open
Abstract
Developers and users of artificial-intelligence-based tools for automatic contouring and treatment planning in radiotherapy are expected to assess clinical acceptability of these tools. However, what is 'clinical acceptability'? Quantitative and qualitative approaches have been used to assess this ill-defined concept, all of which have advantages and disadvantages or limitations. The approach chosen may depend on the goal of the study as well as on available resources. In this paper, we discuss various aspects of 'clinical acceptability' and how they can move us toward a standard for defining clinical acceptability of new autocontouring and planning tools.
Collapse
Affiliation(s)
- Hana Baroudi
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Kristy K. Brock
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Wenhua Cao
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Xinru Chen
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Caroline Chung
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Laurence E. Court
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Correspondence:
| | - Mohammad D. El Basha
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Maguy Farhat
- Department of Radiation Oncology, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Skylar Gay
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Mary P. Gronberg
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Aashish Chandra Gupta
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Soleil Hernandez
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Kai Huang
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - David A. Jaffray
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Rebecca Lim
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Barbara Marquez
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Kelly Nealon
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Tucker J. Netherton
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Callistus M. Nguyen
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Brandon Reber
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Dong Joo Rhee
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Ramon M. Salazar
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Mihir D. Shanker
- The University of Queensland, Saint Lucia 4072, Australia
- The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Carlos Sjogreen
- Department of Physics, University of Houston, Houston, TX 77004, USA
| | - McKell Woodland
- Department of Imaging Physics, Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Department of Computer Science, Rice University, Houston, TX 77005, USA
| | - Jinzhong Yang
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Cenji Yu
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| | - Yao Zhao
- Department of Radiation Physics, University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, USA
| |
Collapse
|
10
|
Chung SY, Chang JS, Kim YB. Comprehensive clinical evaluation of deep learning-based auto-segmentation for radiotherapy in patients with cervical cancer. Front Oncol 2023; 13:1119008. [PMID: 37188180 PMCID: PMC10175826 DOI: 10.3389/fonc.2023.1119008] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Accepted: 04/13/2023] [Indexed: 05/17/2023] Open
Abstract
Background and purpose Deep learning-based models have been actively investigated for various aspects of radiotherapy. However, for cervical cancer, only a few studies dealing with the auto-segmentation of organs-at-risk (OARs) and clinical target volumes (CTVs) exist. This study aimed to train a deep learning-based auto-segmentation model for OAR/CTVs for patients with cervical cancer undergoing radiotherapy and to evaluate the model's feasibility and efficacy with not only geometric indices but also comprehensive clinical evaluation. Materials and methods A total of 180 abdominopelvic computed tomography images were included (training set, 165; validation set, 15). Geometric indices such as the Dice similarity coefficient (DSC) and the 95% Hausdorff distance (HD) were analyzed. A Turing test was performed and physicians from other institutions were asked to delineate contours with and without using auto-segmented contours to assess inter-physician heterogeneity and contouring time. Results The correlation between the manual and auto-segmented contours was acceptable for the anorectum, bladder, spinal cord, cauda equina, right and left femoral heads, bowel bag, uterocervix, liver, and left and right kidneys (DSC greater than 0.80). The stomach and duodenum showed DSCs of 0.67 and 0.73, respectively. CTVs showed DSCs between 0.75 and 0.80. Turing test results were favorable for most OARs and CTVs. No auto-segmented contours had large, obvious errors. The median overall satisfaction score of the participating physicians was 7 out of 10. Auto-segmentation reduced heterogeneity and shortened contouring time by 30 min among radiation oncologists from different institutions. Most participants favored the auto-contouring system. Conclusion The proposed deep learning-based auto-segmentation model may be an efficient tool for patients with cervical cancer undergoing radiotherapy. Although the current model may not completely replace humans, it can serve as a useful and efficient tool in real-world clinics.
Collapse
Affiliation(s)
- Seung Yeun Chung
- Department of Radiation Oncology, Yonsei University College of Medicine, Seoul, Republic of Korea
- Department of Radiation Oncology, Ajou University School of Medicine, Suwon, Republic of Korea
| | - Jee Suk Chang
- Department of Radiation Oncology, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Yong Bae Kim
- Department of Radiation Oncology, Yonsei University College of Medicine, Seoul, Republic of Korea
- *Correspondence: Yong Bae Kim,
| |
Collapse
|
11
|
Taasti VT, Hazelaar C, Vaassen F, Vaniqui A, Verhoeven K, Hoebers F, van Elmpt W, Canters R, Unipan M. Clinical implementation and validation of an automated adaptive workflow for proton therapy. Phys Imaging Radiat Oncol 2022; 24:59-64. [PMID: 36193239 PMCID: PMC9525894 DOI: 10.1016/j.phro.2022.09.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 09/22/2022] [Accepted: 09/22/2022] [Indexed: 11/17/2022] Open
Abstract
Background and purpose Treatment quality of proton therapy can be monitored by repeat-computed tomography scans (reCTs). However, manual re-delineation of target contours can be time-consuming. To improve the workflow, we implemented an automated reCT evaluation, and assessed if automatic target contour propagation would lead to the same clinical decision for plan adaptation as the manual workflow. Materials and methods This study included 79 consecutive patients with a total of 250 reCTs which had been manually evaluated. To assess the feasibility of automated reCT evaluation, we propagated the clinical target volumes (CTVs) deformably from the planning-CT to the reCTs in a commercial treatment planning system. The dose-volume-histogram parameters were extracted for manually re-delineated (CTVmanual) and deformably mapped target contours (CTVauto). It was compared if CTVmanual and CTVauto both satisfied/failed the clinical constraints. Duration of the reCT workflows was also recorded. Results In 92% (N = 229) of the reCTs correct flagging was obtained. Only 4% (N = 9) of the reCTs presented with false negatives (i.e., at least one clinical constraint failed for CTVmanual, but all constraints were satisfied for CTVauto), while 5% (N = 12) of the reCTs led to a false positive. Only for one false negative reCT a plan adaption was made in clinical practice, i.e., only one adaptation would have been missed, suggesting that automated reCT evaluation was possible. Clinical introduction hereof led to a time reduction of 49 h (from 65 to 16 h). Conclusion Deformable target contour propagation was clinically acceptable. A script-based automatic reCT evaluation workflow has been introduced in routine clinical practice.
Collapse
|
12
|
Rhee DJ, Jhingran A, Huang K, Netherton TJ, Fakie N, White I, Sherriff A, Cardenas CE, Zhang L, Prajapati S, Kry SF, Beadle BM, Shaw W, O'Reilly F, Parkes J, Burger H, Trauernicht C, Simonds H, Court LE. Clinical acceptability of fully automated external beam radiotherapy for cervical cancer with three different beam delivery techniques. Med Phys 2022; 49:5742-5751. [PMID: 35866442 PMCID: PMC9474595 DOI: 10.1002/mp.15868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 06/16/2022] [Accepted: 07/12/2022] [Indexed: 12/02/2022] Open
Abstract
Purpose To fully automate CT‐based cervical cancer radiotherapy by automating contouring and planning for three different treatment techniques. Methods We automated three different radiotherapy planning techniques for locally advanced cervical cancer: 2D 4‐field‐box (4‐field‐box), 3D conformal radiotherapy (3D‐CRT), and volumetric modulated arc therapy (VMAT). These auto‐planning algorithms were combined with a previously developed auto‐contouring system. To improve the quality of the 4‐field‐box and 3D‐CRT plans, we used an in‐house, field‐in‐field (FIF) automation program. Thirty‐five plans were generated for each technique on CT scans from multiple institutions and evaluated by five experienced radiation oncologists from three different countries. Every plan was reviewed by two of the five radiation oncologists and scored using a 5‐point Likert scale. Results Overall, 87%, 99%, and 94% of the automatically generated plans were found to be clinically acceptable without modification for the 4‐field‐box, 3D‐CRT, and VMAT plans, respectively. Some customizations of the FIF configuration were necessary on the basis of radiation oncologist preference. Additionally, in some cases, it was necessary to renormalize the plan after it was generated to satisfy radiation oncologist preference. Conclusion Approximately, 90% of the automatically generated plans were clinically acceptable for all three planning techniques. This fully automated planning system has been implemented into the radiation planning assistant for further testing in resource‐constrained radiotherapy departments in low‐ and middle‐income countries.
Collapse
Affiliation(s)
- Dong Joo Rhee
- The University of Texas Graduate School of Biomedical Sciences at Houston, Houston, Texas, USA.,Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Anuja Jhingran
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Kai Huang
- The University of Texas Graduate School of Biomedical Sciences at Houston, Houston, Texas, USA.,Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Tucker J Netherton
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Nazia Fakie
- Division of Radiation Oncology and Medical Physics, University of Cape Town and Groote Schuur Hospital, Cape Town, South Africa
| | - Ingrid White
- Radiotherapy Department, Guy's and St Thomas' NHS Foundation Trust, London, United Kingdom
| | - Alicia Sherriff
- Department of Oncology, University of the Free State, Bloemfontein, South Africa
| | - Carlos E Cardenas
- Department of Radiation Oncology, The University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Lifei Zhang
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Surendra Prajapati
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Stephen F Kry
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Beth M Beadle
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California, USA
| | - William Shaw
- Department of Medical Physics (G68), University of the Free State, Bloemfontein, South Africa
| | - Frederika O'Reilly
- Department of Medical Physics (G68), University of the Free State, Bloemfontein, South Africa
| | - Jeannette Parkes
- Division of Radiation Oncology and Medical Physics, University of Cape Town and Groote Schuur Hospital, Cape Town, South Africa
| | - Hester Burger
- Division of Radiation Oncology and Medical Physics, University of Cape Town and Groote Schuur Hospital, Cape Town, South Africa
| | - Chris Trauernicht
- Division of Medical Physics, Stellenbosch University, Tygerberg Academic Hospital, Cape Town, South Africa
| | - Hannah Simonds
- Division of Radiation Oncology, Stellenbosch University, Tygerberg Academic Hospital, Cape Town, South Africa
| | - Laurence E Court
- Department of Radiation Physics, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| |
Collapse
|