1
|
Forde E, Leech M, Robert C, Herron E, Marignol L. Influence of inter-observer delineation variability on radiomic features of the parotid gland. Phys Med 2021; 82:240-248. [PMID: 33677385 DOI: 10.1016/j.ejmp.2021.01.084] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 01/06/2021] [Accepted: 01/29/2021] [Indexed: 12/14/2022] Open
Abstract
PURPOSE This study aimed to quantify the variability in the values of radiomic features extracted from a right parotid gland (RPG) delineated by a series of independent observers. METHODS This was a secondary analysis of anonymous data from a delineation workshop. Inter-observer variability of the RPG from 40 participants was quantified using DICE similarity coefficient (DSC) and Hausdorff distance (HD). An additional contour was generated using Varian SmartSegmentation. Radiomic features extracted include four shape features, six histogram features, and 32 texture features. The absolute mean paired percentage difference (PPD) in feature values from the expert and participants were ranked . Feature robustness was classified using pre- determined thresholds. RESULTS 63% of participants achieved a DSC > 0.7, the auto- segmentation DSC was 0.76. The average HD for the participants was 16.16 mm ± 0.66 mm, and 15.16 mm for the auto-segmentation. 48% (n = 20) and 33% (n = 14) of features were deemed to be robust with a mean absolute PPD < 5%, for the auto-segmentation and manual delineations respectively; the majority of which were from the grey-run length matrix family. 7% (n = 3) of features from the auto- segmentation and 10% (n = 4) from the manual contours were deemed to be unstable with a mean absolute PPD > 50%. The value of the most robust feature was not related to DSC and HD. CONCLUSION Inter-observer delineation variability affects the value of the radiomic features extracted from the RPG. This study identifies the radiomic features least sensitive to these uncertainties. Further investigation of the clinical relevance of these features in prediction of xerostomia is warranted.
Collapse
Affiliation(s)
- E Forde
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland.
| | - M Leech
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland
| | - C Robert
- Molecular Radiotherapy and Innovative Therapeutics, INSERM UMR1030, Gustave Roussy Cancer Campus, Université Paris Salcay, Villejuif, France
| | - E Herron
- Department of Psychiatry School of Medicine, Trinity College Dublin, Dublin, Ireland
| | - L Marignol
- Applied Radiation Therapy Trinity, Discipline of Radiation Therapy, Trinity St James' Cancer Institute, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
2
|
Dowling JA, O’Connor LM. Deformable image registration in radiation therapy. J Med Radiat Sci 2020; 67:257-259. [PMID: 33104276 PMCID: PMC7753986 DOI: 10.1002/jmrs.446] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Accepted: 10/03/2020] [Indexed: 01/07/2023] Open
Abstract
Deformable image registration is an increasingly important method to account for soft tissue deformation between image acquisitions. This editorial discusses the clinical need and current status of deformable image registration.
Collapse
Affiliation(s)
- Jason A Dowling
- CSIRO Australian E‐Health Research CentreHerstonQueenslandAustralia
- School of Mathematical and Physical SciencesUniversity of NewcastleNewcastleNew South WalesAustralia
- School of Information Technology and Electrical EngineeringUniversity of QueenslandSt LuciaQueenslandAustralia
- School of Information Technology and SystemsUniversity of CanberraCanberraAustralian Capital TerritoryAustralia
- Faculty of MedicineUniversity of New South WalesSydneyNew South WalesAustralia
- Centre for Medical Radiation PhysicsUniversity of WollongongWollongongNew South WalesAustralia
- Institute of Medical PhysicsUniversity of SydneySydneyNew South WalesAustralia
| | - Laura M O’Connor
- Department of Radiation OncologyCalvary Mater Newcastle HospitalNewcastleNew South WalesAustralia
- School of Health SciencesUniversity of NewcastleNewcastleNew South WalesAustralia
| |
Collapse
|
3
|
Gerlich AS, van der Velden JM, Kotte ANTJ, Tseng CL, Fanetti G, Eppinga WSC, Kasperts N, Intven MPW, Pameijer FA, Philippens MEP, Verkooijen HM, Seravalli E. Inter-observer agreement in GTV delineation of bone metastases on CT and impact of MR imaging: A multicenter study. Radiother Oncol 2017; 126:534-540. [PMID: 28919003 DOI: 10.1016/j.radonc.2017.08.030] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2017] [Revised: 08/25/2017] [Accepted: 08/30/2017] [Indexed: 11/18/2022]
Abstract
BACKGROUND AND PURPOSE The use of Stereotactic Body Radiotherapy (SBRT) for bone metastases is increasing rapidly. Therefore, knowledge of the inter-observer differences in tumor volume delineation is essential to guarantee precise dose delivery. The aim of this study is to compare inter-observer agreement in bone metastases delineated on different imaging modalities. MATERIAL AND METHODS Twenty consecutive patients with bone metastases treated with SBRT were selected. All patients received CT and MR imaging in treatment position prior to SBRT. Five observers from three institutions independently delineated gross tumor volume (GTV) on CT alone, CT with co-registered MRI and MRI alone. Four contours per imaging modality per patient were available, as one set of contours was shared by 2 observers. Inter-observer agreement, expressed in generalized conformity index [CIgen], volumes of contours and contours center of mass (COM) were calculated per patient and imaging modality. RESULTS Mean GTV delineated on MR (45.9±52.0cm3) was significantly larger compared to CT-MR (40.2±49.4cm3) and CT (34.8±41.8cm3). A considerable variation in CIgen was found on CT (mean 0.46, range 0.15-0.75) and CT-MRI (mean 0.54, range 0.17-0.71). The highest agreement was found on MRI (mean 0.56, range 0.20-0.77). The largest variations of COM were found in anterior-posterior direction for all imaging modalities. CONCLUSIONS Large inter-observer variation in GTV delineation exists for CT, CT-MRI and MRI. MRI-based GTV delineation resulted in larger volumes and highest consistency between observers.
Collapse
Affiliation(s)
- A S Gerlich
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - J M van der Velden
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - A N T J Kotte
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - C L Tseng
- Department of Radiation Oncology, Sunnybrook Health Sciences Centre, University of Toronto, Canada
| | - G Fanetti
- Department of Radiation Oncology, European Institute of Oncology, Milan, Italy
| | - W S C Eppinga
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - N Kasperts
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - M P W Intven
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - F A Pameijer
- Department of Radiology, University Medical Center Utrecht, The Netherlands
| | - M E P Philippens
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands
| | - H M Verkooijen
- Trial Office Imaging Division, University Medical Center Utrecht, The Netherlands
| | - E Seravalli
- Department of Radiation Oncology, University Medical Center Utrecht, The Netherlands.
| |
Collapse
|
4
|
Gong G, Kong X, Wang X, Zheng C, Guo Y, Yin Y. Finding of dose evaluation for organs at risk in intensity-modulated radiation therapy for nasopharyngeal carcinoma using magnetic resonance imaging. PRECISION RADIATION ONCOLOGY 2017. [DOI: 10.1002/pro6.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Affiliation(s)
- Guanzhong Gong
- Biomedical and Multimedia Information Technology (BMIT) research group, School of Information Technologies (SIT); The University of Sydney; New South Wales Australia
- Shandong Cancer Hospital and Institute; Jinan Shandong China
| | - Xudong Kong
- The No. 4 Hospital of Wuxi; Wuxi Jiang Su province China
| | - Xiuying Wang
- Biomedical and Multimedia Information Technology (BMIT) research group, School of Information Technologies (SIT); The University of Sydney; New South Wales Australia
| | - Chaojie Zheng
- Biomedical and Multimedia Information Technology (BMIT) research group, School of Information Technologies (SIT); The University of Sydney; New South Wales Australia
| | - Yujie Guo
- Shandong Cancer Hospital and Institute; Jinan Shandong China
| | - Yong Yin
- Shandong Cancer Hospital and Institute; Jinan Shandong China
| |
Collapse
|
5
|
Broggi S, Scalco E, Belli ML, Logghe G, Verellen D, Moriconi S, Chiara A, Palmisano A, Mellone R, Fiorino C, Rizzo G. A Comparative Evaluation of 3 Different Free-Form Deformable Image Registration and Contour Propagation Methods for Head and Neck MRI: The Case of Parotid Changes During Radiotherapy. Technol Cancer Res Treat 2017; 16:373-381. [PMID: 28168934 PMCID: PMC5616054 DOI: 10.1177/1533034617691408] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Purpose: To validate and compare the deformable image registration and parotid contour propagation process for head and neck magnetic resonance imaging in patients treated with radiotherapy using 3 different approaches—the commercial MIM, the open-source Elastix software, and an optimized version of it. Materials and Methods: Twelve patients with head and neck cancer previously treated with radiotherapy were considered. Deformable image registration and parotid contour propagation were evaluated by considering the magnetic resonance images acquired before and after the end of the treatment. Deformable image registration, based on free-form deformation method, and contour propagation available on MIM were compared to Elastix. Two different contour propagation approaches were implemented for Elastix software, a conventional one (DIR_Trx) and an optimized homemade version, based on mesh deformation (DIR_Mesh). The accuracy of these 3 approaches was estimated by comparing propagated to manual contours in terms of average symmetric distance, maximum symmetric distance, Dice similarity coefficient, sensitivity, and inclusiveness. Results: A good agreement was generally found between the manual contours and the propagated ones, without differences among the 3 methods; in few critical cases with complex deformations, DIR_Mesh proved to be more accurate, having the lowest values of average symmetric distance and maximum symmetric distance and the highest value of Dice similarity coefficient, although nonsignificant. The average propagation errors with respect to the reference contours are lower than the voxel diagonal (2 mm), and Dice similarity coefficient is around 0.8 for all 3 methods. Conclusion: The 3 free-form deformation approaches were not significantly different in terms of deformable image registration accuracy and can be safely adopted for the registration and parotid contour propagation during radiotherapy on magnetic resonance imaging. More optimized approaches (as DIR_Mesh) could be preferable for critical deformations.
Collapse
Affiliation(s)
- Sara Broggi
- 1 Medical Physics Department, San Raffaele Scientific Institute, Milan, Italy
| | - Elisa Scalco
- 2 Institute of Molecular Bioimaging and Physiology (IBFM), CNR, Segrate, Milan, Italy
| | - Maria Luisa Belli
- 1 Medical Physics Department, San Raffaele Scientific Institute, Milan, Italy
| | | | - Dirk Verellen
- 4 Vrije Universiteit Brussel, Brussels, Belgium.,5 GZA Sint Augustinus - Iridium Kankernetwerk Antwerpen, Antwerp, Belgium
| | - Stefano Moriconi
- 2 Institute of Molecular Bioimaging and Physiology (IBFM), CNR, Segrate, Milan, Italy
| | - Anna Chiara
- 6 Radiotherapy Department, San Raffaele Scientific Institute, Milan, Italy
| | - Anna Palmisano
- 7 Clinical and Experimental Radiology, Experimental Imaging Center, San Raffaele Scientific Institute, Milan, Italy
| | - Renata Mellone
- 7 Clinical and Experimental Radiology, Experimental Imaging Center, San Raffaele Scientific Institute, Milan, Italy
| | - Claudio Fiorino
- 1 Medical Physics Department, San Raffaele Scientific Institute, Milan, Italy
| | - Giovanna Rizzo
- 2 Institute of Molecular Bioimaging and Physiology (IBFM), CNR, Segrate, Milan, Italy
| |
Collapse
|
6
|
Eisbruch A. Can xerostomia be further reduced by sparing parotid stem cells? ANNALS OF TRANSLATIONAL MEDICINE 2016; 4:S16. [PMID: 27867984 DOI: 10.21037/atm.2016.10.25] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Avraham Eisbruch
- Department of radiation Oncology, University of Michigan, MI, USA
| |
Collapse
|
7
|
Vinod SK, Jameson MG, Min M, Holloway LC. Uncertainties in volume delineation in radiation oncology: A systematic review and recommendations for future studies. Radiother Oncol 2016; 121:169-179. [PMID: 27729166 DOI: 10.1016/j.radonc.2016.09.009] [Citation(s) in RCA: 209] [Impact Index Per Article: 26.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2016] [Revised: 08/27/2016] [Accepted: 09/25/2016] [Indexed: 12/25/2022]
Abstract
BACKGROUND AND PURPOSE Volume delineation is a well-recognised potential source of error in radiotherapy. Whilst it is important to quantify the degree of interobserver variability (IOV) in volume delineation, the resulting impact on dosimetry and clinical outcomes is a more relevant endpoint. We performed a literature review of studies evaluating IOV in target volume and organ-at-risk (OAR) delineation in order to analyse these with respect to the metrics used, reporting of dosimetric consequences, and use of statistical tests. METHODS AND MATERIALS Medline and Pubmed databases were queried for relevant articles using keywords. We included studies published in English between 2000 and 2014 with more than two observers. RESULTS 119 studies were identified covering all major tumour sites. CTV (n=47) and GTV (n=38) were most commonly contoured. Median number of participants and data sets were 7 (3-50) and 9 (1-132) respectively. There was considerable heterogeneity in the use of metrics and methods of analysis. Statistical analysis of results was reported in 68% (n=81) and dosimetric consequences in 21% (n=25) of studies. CONCLUSION There is a lack of consistency in conducting and reporting analyses from IOV studies. We suggest a framework to use for future studies evaluating IOV.
Collapse
Affiliation(s)
- Shalini K Vinod
- Cancer Therapy Centre, Liverpool Hospital, Australia; South Western Sydney Clinical School, University of New South Wales, Australia; Western Sydney University, Australia.
| | - Michael G Jameson
- Cancer Therapy Centre, Liverpool Hospital, Australia; Ingham Institute of Applied Medical Research, Liverpool Hospital, Australia; Centre for Medical Radiation Physics, University of Wollongong, Australia
| | - Myo Min
- Cancer Therapy Centre, Liverpool Hospital, Australia; South Western Sydney Clinical School, University of New South Wales, Australia; Ingham Institute of Applied Medical Research, Liverpool Hospital, Australia
| | - Lois C Holloway
- Cancer Therapy Centre, Liverpool Hospital, Australia; South Western Sydney Clinical School, University of New South Wales, Australia; Ingham Institute of Applied Medical Research, Liverpool Hospital, Australia; Centre for Medical Radiation Physics, University of Wollongong, Australia
| |
Collapse
|
8
|
Vinod SK, Min M, Jameson MG, Holloway LC. A review of interventions to reduce inter-observer variability in volume delineation in radiation oncology. J Med Imaging Radiat Oncol 2016; 60:393-406. [DOI: 10.1111/1754-9485.12462] [Citation(s) in RCA: 95] [Impact Index Per Article: 11.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2015] [Accepted: 03/16/2016] [Indexed: 12/25/2022]
Affiliation(s)
- Shalini K Vinod
- Cancer Therapy Centre; Liverpool Hospital; Liverpool New South Wales Australia
- South Western Sydney Clinical School; University of NSW; Sydney New South Wales Australia
- Western Sydney University; Sydney New South Wales Australia
| | - Myo Min
- Cancer Therapy Centre; Liverpool Hospital; Liverpool New South Wales Australia
- South Western Sydney Clinical School; University of NSW; Sydney New South Wales Australia
| | - Michael G Jameson
- Cancer Therapy Centre; Liverpool Hospital; Liverpool New South Wales Australia
- Ingham Institute of Applied Medical Research; Liverpool Hospital; Liverpool New South Wales Australia
- Centre for Medical Radiation Physics; University of Wollongong; Wollongong New South Wales Australia
| | - Lois C Holloway
- Cancer Therapy Centre; Liverpool Hospital; Liverpool New South Wales Australia
- South Western Sydney Clinical School; University of NSW; Sydney New South Wales Australia
- Western Sydney University; Sydney New South Wales Australia
- Ingham Institute of Applied Medical Research; Liverpool Hospital; Liverpool New South Wales Australia
| |
Collapse
|