Robustness and reproducibility of radiomics in T2 weighted images from magnetic resonance image guided linear accelerator in a phantom study

Reproducibility Analysis of Radiomic Features on T2-weighted MR Images after Processing and Segmentation Alterations in Neuroblastoma Tumors

Purpose To evaluate the reproducibility of radiomics features extracted from T2-weighted MR images in patients with neuroblastoma. Materials and Methods A retrospective study included 419 patients (mean age, 29 months ± 34 [SD]; 220 male, 199 female) with neuroblastic tumors diagnosed between 2002 and 2023, within the scope of the PRedictive In-silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers (ie, PRIMAGE) project, involving 746 T2/T2*-weighted MRI sequences at diagnosis and/or after initial chemotherapy. Images underwent processing steps (denoising, inhomogeneity bias field correction, normalization, and resampling). Tumors were automatically segmented, and 107 shape, first-order, and second-order radiomics features were extracted, considered as the reference standard. Subsequently, the previous image processing settings were modified, and volumetric masks were applied. New radiomics features were extracted and compared with the reference standard. Reproducibility was assessed using the concordance correlation coefficient (CCC); intrasubject repeatability was measured using the coefficient of variation (CoV). Results When normalization was omitted, only 5% of the radiomics features demonstrated high reproducibility. Statistical analysis revealed significant changes in the normalization and resampling processes (P < .001). Inhomogeneities removal had the least impact on radiomics (83% of parameters remained stable). Shape features remained stable after mask modifications, with a CCC greater than 0.90. Mask modifications were the most favorable changes for achieving high CCC values, with a radiomics features stability of 70%. Only 7% of second-order radiomics features showed an excellent CoV of less than 0.10. Conclusion Modifications in the T2-weighted MRI preparation process in patients with neuroblastoma resulted in changes in radiomics features, with normalization identified as the most influential factor for reproducibility. Inhomogeneities removal had the least impact on radiomics features. Keywords: Pediatrics, MR Imaging, Oncology, Radiomics, Reproducibility, Repeatability, Neuroblastic Tumors Supplemental material is available for this article. © RSNA, 2024 See also the commentary by Safdar and Galaria in this issue.

Radiomics analysis from magnetic resonance imaging in predicting the grade of nonfunctioning pancreatic neuroendocrine tumors: a multicenter study

OBJECTIVES

To explore the potential of radiomics features to predict the histologic grade of nonfunctioning pancreatic neuroendocrine tumor (NF-PNET) patients using non-contrast sequence based on MRI.

METHODS

Two hundred twenty-eight patients with NF-PNETs undergoing MRI at 5 centers were retrospectively analyzed. Data from center 1 (n = 115) constituted the training cohort, and data from centers 2-5 (n = 113) constituted the testing cohort. Radiomics features were extracted from T2-weighted images and the apparent diffusion coefficient. The least absolute shrinkage and selection operator was applied to select the most important features and to develop radiomics signatures. The area under receiver operating characteristic curve (AUC) was performed to assess models.

RESULTS

Tumor boundary, enhancement homogeneity, and vascular invasion were used to construct the radiological model to stratify NF-PNET patients into grade 1 and 2/3 groups, which yielded AUC of 0.884 and 0.684 in the training and testing groups. A radiomics model including 4 features was constructed, with an AUC of 0.941 and 0.871 in the training and testing cohorts. The fusion model combining the radiomics signature and radiological characteristics showed good performance in the training set (AUC = 0.956) and in the testing set (AUC = 0.864), respectively.

CONCLUSION

The developed model that integrates radiomics features with radiological characteristics could be used as a non-invasive, dependable, and accurate tool for the preoperative prediction of grade in NF-PNETs.

CLINICAL RELEVANCE STATEMENT

Our study revealed that the fusion model based on a non-contrast MR sequence can be used to predict the histologic grade before operation. The radiomics model may be a new and effective biological marker in NF-PNETs.

KEY POINTS

The diagnostic performance of the radiomics model and fusion model was better than that of the model based on clinical information and radiological features in predicting grade 1 and 2/3 of nonfunctioning pancreatic neuroendocrine tumors (NF-PNETs). Good performance of the model in the four external testing cohorts indicated that the radiomics model and fusion model for predicting the grades of NF-PNETs were robust and reliable, indicating the two models could be used in the clinical setting and facilitate the surgeons' decision on risk stratification. The radiomics features were selected from non-contrast T2-weighted images (T2WI) and diffusion-weighted imaging (DWI) sequence, which means that the administration of contrast agent was not needed in grading the NF-PNETs.

A Review on the Use of Imaging Biomarkers in Oncology Clinical Trials: Quality Assurance Strategies for Technical Validation

Imaging biomarkers (IBs) have been proposed in medical literature that exploit images in a quantitative way, going beyond the visual assessment by an imaging physician. These IBs can be used in the diagnosis, prognosis, and response assessment of several pathologies and are very often used for patient management pathways. In this respect, IBs to be used in clinical practice and clinical trials have a requirement to be precise, accurate, and reproducible. Due to limitations in imaging technology, an error can be associated with their value when considering the entire imaging chain, from data acquisition to data reconstruction and subsequent analysis. From this point of view, the use of IBs in clinical trials requires a broadening of the concept of quality assurance and this can be a challenge for the responsible medical physics experts (MPEs). Within this manuscript, we describe the concept of an IB, examine some examples of IBs currently employed in clinical practice/clinical trials and analyze the procedure that should be carried out to achieve better accuracy and reproducibility in their use. We anticipate that this narrative review, written by the components of the EFOMP working group on "the role of the MPEs in clinical trials"-imaging sub-group, can represent a valid reference material for MPEs approaching the subject.

Advancements in MRI-Based Radiomics and Artificial Intelligence for Prostate Cancer: A Comprehensive Review and Future Prospects

The use of multiparametric magnetic resonance imaging (mpMRI) has become a common technique used in guiding biopsy and developing treatment plans for prostate lesions. While this technique is effective, non-invasive methods such as radiomics have gained popularity for extracting imaging features to develop predictive models for clinical tasks. The aim is to minimize invasive processes for improved management of prostate cancer (PCa). This study reviews recent research progress in MRI-based radiomics for PCa, including the radiomics pipeline and potential factors affecting personalized diagnosis. The integration of artificial intelligence (AI) with medical imaging is also discussed, in line with the development trend of radiogenomics and multi-omics. The survey highlights the need for more data from multiple institutions to avoid bias and generalize the predictive model. The AI-based radiomics model is considered a promising clinical tool with good prospects for application.

Radiomic feature repeatability and its impact on prognostic model generalizability: A multi-institutional study on nasopharyngeal carcinoma patients

BACKGROUND AND PURPOSE

To investigate the radiomic feature (RF) repeatability via perturbation and its impact on cross-institutional prognostic model generalizability in Nasopharyngeal Carcinoma (NPC) patients.

MATERIALS AND METHODS

286 and 183 NPC patients from two institutions were included for model training and validation. Perturbations with random translations and rotations were applied to contrast-enhanced T1-weighted (CET1-w) MR images. RFs were extracted from primary tumor volume under a wide range of image filtering and discretization settings. RF repeatability was assessed by intraclass correlation coefficient (ICC), which was used to equally separate the RFs into low- and high-repeatable groups by the median value. After feature selection, multivariate Cox regression and Kaplan-Meier analysis were independently employed to develop and analyze prognostic models. Concordance index (C-index) and P-value from log-rank test were used to assess model performance.

RESULTS

Most textural RFs from high-pass wavelet-filtered images were susceptible to image perturbations. It was more prominent when a smaller discretization bin number was used (e.g., 8, mean ICC = 0.69). Using high-repeatable RFs for model development yielded a significantly higher C-index (0.63) in the validation cohort than when only low-repeatable RFs were used (0.57, P = 0.024), suggesting higher model generalizability. Besides, significant risk stratification in the validation cohort was observed only when high-repeatable RFs were used (P < 0.001).

CONCLUSION

Repeatability of RFs from high-pass wavelet-filtered CET1-w MR images of primary NPC tumor was poor, particularly when a smaller bin number was used. Exclusive use of high-repeatable RFs is suggested to safeguard model generalizability for wide-spreading clinical utilization.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

Largest diameter delineations can substitute 3D tumor volume delineations for radiomics prediction of human papillomavirus status on MRI's of oropharyngeal cancer

PURPOSE

Laborious and time-consuming tumor segmentations are one of the factors that impede adoption of radiomics in the clinical routine. This study investigates model performance using alternative tumor delineation strategies in models predictive of human papillomavirus (HPV) in oropharyngeal squamous cell carcinoma (OPSCC).

METHODS

Of 153 OPSCC patients, HPV status was determined using p16/p53 immunohistochemistry. MR-based radiomic features were extracted within 3D delineations by an inexperienced observer, experienced radiologist or radiation oncologist, and within a 2D delineation of the largest axial tumor diameter and 3D spheres within the tumor. First, logistic regression prediction models were constructed and tested separately for each of these six delineation strategies. Secondly, the model trained on experienced delineations was tested using these delineation strategies. The latter methodology was repeated with the omission of shape features. Model performance was evaluated using area under the curve (AUC), sensitivity and specificity.

RESULTS

Models constructed and tested using single-slice delineations (AUC/Sensitivity/Specificity: 0.84/0.75/0.84) perform better compared to 3D experienced observer delineations (AUC/Sensitivity/Specificity: 0.76/0.76/0.71), where models based on 4 mm sphere delineations (AUC/Sensitivity/Specificity: 0.77/0.59/0.71) show similar performance. Similar performance was found when experienced and largest diameter delineations (AUC/Sens/Spec: 0.76/0.75/0.65 vs 0.76/0.69/0.69) was used to test the model constructed using experienced delineations without shape features.

CONCLUSION

Alternative delineations can substitute labor and time intensive full tumor delineations in a model that predicts HPV status in OPSCC. These faster delineations may improve adoption of radiomics in the clinical setting. Future research should evaluate whether these alternative delineations are valid in other radiomics models.

Robustness Assessment of Images From a 0.35T Scanner of an Integrated MRI-Linac: Characterization of Radiomics Features in Phantom and Patient Data

Purpose: Radiomics entails the extraction of quantitative imaging biomarkers (or radiomics features) hypothesized to provide additional pathophysiological and/or clinical information compared to qualitative visual observation and interpretation. This retrospective study explores the variability of radiomics features extracted from images acquired with the 0.35 T scanner of an integrated MRI-Linac. We hypothesized we would be able to identify features with high repeatability and reproducibility over various imaging conditions using phantom and patient imaging studies. We also compared findings from the literature relevant to our results. Methods: Eleven scans of a Magphan^® RT phantom over 13 months and 11 scans of a ViewRay Daily QA phantom over 11 days constituted the phantom data. Patient datasets included 50 images from ten anonymized stereotactic body radiation therapy (SBRT) pancreatic cancer patients (50 Gy in 5 fractions). A True Fast Imaging with Steady-State Free Precession (TRUFI) pulse sequence was selected, using a voxel resolution of 1.5 mm × 1.5 mm × 1.5 mm and 1.5 mm × 1.5 mm × 3.0 mm for phantom and patient data, respectively. A total of 1087 shape-based, first, second, and higher order features were extracted followed by robustness analysis. Robustness was assessed with the Coefficient of Variation (CoV < 5%). Results: We identified 130 robust features across the datasets. Robust features were found within each category, except for 2 second-order sub-groups, namely, Gray Level Size Zone Matrix (GLSZM) and Neighborhood Gray Tone Difference Matrix (NGTDM). Additionally, several robust features agreed with findings from other stability assessments or predictive performance studies in the literature. Conclusion: We verified the stability of the 0.35 T scanner of an integrated MRI-Linac for longitudinal radiomics phantom studies and identified robust features over various imaging conditions. We conclude that phantom measurements can be used to identify robust radiomics features. More stability assessment research is warranted.