Radiomic feature stability across 4D respiratory phases and its impact on lung tumor prognosis prediction

Radiomics of pericoronary adipose tissue on computed tomography angiography predicts coronary heart disease in patients with type 2 diabetes mellitus

BACKGROUND

Diabetes is a common chronic metabolic disease. The progression of the disease promotes vascular inflammation and the formation of atherosclerosis, leading to cardiovascular disease. The coronary artery perivascular adipose tissue attenuation index based on CCTA is a new noninvasive imaging biomarker that reflects the spatial changes in perivascular adipose tissue attenuation in CCTA images and the inflammation around the coronary arteries. In this study, a radiomics approach is proposed to extract a large number of image features from CCTA in a high-throughput manner and combined with clinical diagnostic data to explore the predictive ability of vascular perivascular adipose imaging data based on CCTA for coronary heart disease in diabetic patients.

METHODS

R language was used for statistical analysis to screen the variables with significant differences. A presegmentation model was used for CCTA vessel segmentation, and the pericoronary adipose region was screened out. PyRadiomics was used to calculate the radiomics features of pericoronary adipose tissue, and SVM, DT and RF were used to model and analyze the clinical data and radiomics data. Model performance was evaluated using indicators such as PPV, FPR, AAC, and ROC.

RESULTS

The results indicate that there are significant differences in age, blood pressure, and some biochemical indicators between diabetes patients with and without coronary heart disease. Among 1037 calculated radiomic parameters, 18.3% showed significant differences in imaging omics features. Three modeling methods were used to analyze different combinations of clinical information, internal vascular radiomics information and pericoronary vascular fat radiomics information. The results showed that the dataset of full data had the highest ACC values under different machine learning models. The support vector machine method showed the best specificity, sensitivity, and accuracy for this dataset.

CONCLUSIONS

In this study, the clinical data and pericoronary radiomics data of CCTA were fused to predict the occurrence of coronary heart disease in diabetic patients. This provides information for the early detection of coronary heart disease in patients with diabetes and allows for timely intervention and treatment.

Technical and clinical considerations of a physical liver phantom for CT radiomics analysis

OBJECTIVE

This study identifies key characteristics to help build a physical liver computed tomography (CT) phantom for radiomics harmonization; particularly, the higher-order texture metrics.

MATERIALS AND METHODS

CT scans of a radiomics phantom comprising of 18 novel 3D printed inserts with varying size, shape, and material combinations were acquired on a 64-slice CT scanner (Brilliance 64, Philips Healthcare). The images were acquired at 120 kV, 250 mAs, CTDIvol of 16.36 mGy, 2 mm slice thickness, and iterative noise-reduction reconstruction (iDose, Philips Healthcare, Andover, MA). Radiomics analysis was performed using the Cancer Imaging Phenomics Toolkit (CaPTk), following automated segmentation of 3D regions of interest (ROI) of the 18 inserts. The findings were compared to three additional ROI obtained of an anthropomorphic liver phantom, a patient liver CT scan, and a water phantom, at comparable imaging settings. Percentage difference in radiomic metrics values between phantom and tissue was used to assess the biological equivalency and <10% was used to claim equivalent.

RESULTS

The HU for all 18 ROI from the phantom ranged from -30 to 120 which is within clinically observed HU range of the liver, showing that our phantom material (T3-6B) is representative of biological CT tissue densities (liver) with >50% radiomic features having <10% difference from liver tissue. Based on the assessment of the Neighborhood Gray Tone Difference Matrix (NGTDM) metrics it is evident that the water phantom ROI show extreme values compared to the ROIs from the phantom. This result may further reinforce the difference between a structureless quantity such as water HU values and tissue HU values found in liver.

CONCLUSION

The 3-D printed patterns of the constructed radiomics phantom cover a wide span of liver tissue textures seen in CT images. Using our results, texture metrics can be selectively harmonized to establish clinically relevant and reliable radiomics panels.

The Use of MRI-Derived Radiomic Models in Prostate Cancer Risk Stratification: A Critical Review of Contemporary Literature

The development of precise medical imaging has facilitated the establishment of radiomics, a computer-based method of quantitatively analyzing subvisual imaging characteristics. The present review summarizes the current literature on the use of diagnostic magnetic resonance imaging (MRI)-derived radiomics in prostate cancer (PCa) risk stratification. A stepwise literature search of publications from 2017 to 2022 was performed. Of 218 articles on MRI-derived prostate radiomics, 33 (15.1%) generated models for PCa risk stratification. Prediction of Gleason score (GS), adverse pathology, postsurgical recurrence, and postradiation failure were the primary endpoints in 15 (45.5%), 11 (33.3%), 4 (12.1%), and 3 (9.1%) studies. In predicting GS and adverse pathology, radiomic models differentiated well, with receiver operator characteristic area under the curve (ROC-AUC) values of 0.50–0.92 and 0.60–0.92, respectively. For studies predicting post-treatment recurrence or failure, ROC-AUC for radiomic models ranged from 0.73 to 0.99 in postsurgical and radiation cohorts. Finally, of the 33 studies, 7 (21.2%) included external validation. Overall, most investigations showed good to excellent prediction of GS and adverse pathology with MRI-derived radiomic features. Direct prediction of treatment outcomes, however, is an ongoing investigation. As these studies mature and reach potential for clinical integration, concerted effort to validate these radiomic models must be undertaken.

Machine learning for predicting accuracy of lung and liver tumor motion tracking using radiomic features

Background

Internal tumor motion is commonly predicted using external respiratory signals. However, the internal/external correlation is complex and patient-specific. The purpose of this study was to develop various models based on the radiomic features of computed tomography (CT) images to predict the accuracy of tumor motion tracking using external surrogates and to find accurate and reliable tracking algorithms.

Methods

Images obtained from a total of 108 and 71 patients pathologically diagnosed with lung and liver cancers, respectively, were examined. Real-time position monitoring motion was fitted to tumor motion, and samples with fitting errors greater than 2 mm were considered positive. Radiomic features were extracted from internal target volumes of average intensity projections, and cross-validation least absolute shrinkage and selection operator (LassoCV) was used to conduct feature selection. Based on the radiomic features, a total of 26 separate models (13 for the lung and 13 for the liver) were trained and tested. Area under the receiver operating characteristic curve (AUC), sensitivity, and specificity were used to assess performance. Relative standard deviation was used to assess stability.

Results

Thirty-three and 22 radiomic features were selected for the lung and liver, respectively. For the lung, the AUC varied from 0.848 (decision tree) to 0.941 [support vector classifier (SVC), logistic regression]; sensitivity varied from 0.723 (extreme gradient boosting) to 0.848 [linear support vector classifier (linearSVC)]; specificity varied from 0.834 (gaussian naive bayes) to 0.936 [multilayer perceptron (MLP), wide and deep (W&D)]; and MLP and W&D had better performance and stability than the median. For the liver, the AUC varied from 0.677 [light gradient boosting machine (Light)] to 0.892 (logistic regression); sensitivity varied from 0.717 (W&D) to 0.862 (MLP); specificity varied from 0.566 (Light) to 0.829 (linearSVC); and logistic regression, MLP, and SVC had better performance and stability than the median.

Conclusions

Respiratory-sensitive radiomic features extracted from CT images of lung and liver tumors were proved to contain sufficient information to establish an external/internal motion relationship. We developed a rapid and accurate method based on radiomics to classify the accuracy of monitoring a patient's external surface for lung and liver tumor tracking. Several machine learning algorithms-in particular, MLP-demonstrated excellent classification performance and stability.

Machine Learning Radiomics Model for External and Internal Respiratory Motion Correlation Prediction in Lung Tumor

Objectives: The complexity and specificity of lung tumor motion render it necessary to determine the external and internal correlation individually before applying indirect tumor tracking. However, the correlation cannot be determined from patient respiratory and tumor clinical characteristics before treatment. The purpose of this study is to present a machine learning model for an external/internal correlation prediction that is based on computed tomography (CT) radiomic features. Methods: 4-dimensional computed tomography (4DCT) images of 67 patients were collected retrospectively, and the external/internal correlation of lung tumor was calculated based on Spearman's rank correlation coefficient. Radiomic features were extracted from average intensity projection and the light gradient boosting machine (LightGBM)-based cross-validation (the recursive elimination method) was used for feature selection. The LightGBM framework forecasting models with classification thresholds 0.7, 0.8, and 0.9 are established using stratified 5-fold cross-validation. Model performance was assessed using receiver operating characteristics, sensitivity, and specificity. Results: There were 16, 18, and 13 features selected for models 0.7, 0.8, and 0.9, respectively. Texture features are of great importance in external/internal correlation prediction compared to other features in all models. The sensitivities of the predictions in models 0.7, 0.8, and 0.9 were 0.800 ± 0.126, 0.829 ± 0.140, and 0.864 ± 0.086, respectively. The specificities were 0.771 ± 0.114, 0.936 ± 0.0581, and 0.839 ± 0.101, whereas the area under the curve (AUC) was 0.837, 0.946, and 0.877, respectively. Conclusions: Our findings indicate that radiomics is an effective tool for respiratory motion correlation prediction, which can extract tumor motion characteristics. We proposed a machine learning framework for correlation prediction in the motion management strategy for lung tumor patients.

Prediction of radiation-induced acute skin toxicity in breast cancer patients using data encapsulation screening and dose-gradient-based multi-region radiomics technique: A multicenter study

Purpose

Radiation-induced dermatitis is one of the most common side effects for breast cancer patients treated with radiation therapy (RT). Acute complications can have a considerable impact on tumor control and quality of life for breast cancer patients. In this study, we aimed to develop a novel quantitative high-accuracy machine learning tool for prediction of radiation-induced dermatitis (grade ≥ 2) (RD 2+) before RT by using data encapsulation screening and multi-region dose-gradient-based radiomics techniques, based on the pre-treatment planning computed tomography (CT) images, clinical and dosimetric information of breast cancer patients.

Methods and Materials

214 patients with breast cancer who underwent RT between 2018 and 2021 were retrospectively collected from 3 cancer centers in China. The CT images, as well as the clinical and dosimetric information of patients were retrieved from the medical records. 3 PTV dose related ROIs, including irradiation volume covered by 100%, 105%, and 108% of prescribed dose, combined with 3 skin dose-related ROIs, including irradiation volume covered by 20-Gy, 30-Gy, 40-Gy isodose lines within skin, were contoured for radiomics feature extraction. A total of 4280 radiomics features were extracted from all 6 ROIs. Meanwhile, 29 clinical and dosimetric characteristics were included in the data analysis. A data encapsulation screening algorithm was applied for data cleaning. Multiple-variable logistic regression and 5-fold-cross-validation gradient boosting decision tree (GBDT) were employed for modeling training and validation, which was evaluated by using receiver operating characteristic analysis.

Results

The best predictors for symptomatic RD 2+ were the combination of 20 radiomics features, 8 clinical and dosimetric variables, achieving an area under the curve (AUC) of 0.998 [95% CI: 0.996-1.0] and an AUC of 0.911 [95% CI: 0.838-0.983] in the training and validation dataset, respectively, in the 5-fold-cross-validation GBDT model. Meanwhile, the top 12 most important characteristics as well as their corresponding importance measures for RD 2+ prediction in the GBDT machine learning process were identified and calculated.

Conclusions

A novel multi-region dose-gradient-based GBDT machine learning framework with a random forest based data encapsulation screening method integrated can achieve a high-accuracy prediction of acute RD 2+ in breast cancer patients.

Deterministic small-scale undulations of image-based risk predictions from the deep learning of lung tumors in motion

INTRODUCTION

Deep learning (DL) models that use medical images to predict clinical outcomes are poised for clinical translation. For tumors that reside in organs that move, however, the impact of motion (i.e., degenerated object appearance or blur) on DL model accuracy remains unclear. We examine the impact of tumor motion on an image-based DL framework that predicts local failure risk after lung stereotactic body radiotherapy (SBRT).

METHODS

We input pre-therapy free breathing (FB) computed tomography (CT) images from 849 patients treated with lung SBRT into a multitask deep neural network to generate an image fingerprint signature (or DL score) that predicts time-to-event local failure outcomes. The network includes a convolutional neural network encoder for extracting imaging features and building a task-specific fingerprint, a decoder for estimating handcrafted radiomic features, and a task-specific network for generating image signature for radiotherapy outcome prediction. The impact of tumor motion on the DL scores was then examined for a holdout set of 468 images from 39 patients comprising: (1) FB CT, (2) four-dimensional (4D) CT, and (3) maximum-intensity projection (MIP) images. Tumor motion was estimated using a 3D vector of the maximum distance traveled, and its association with DL score variance was assessed by linear regression.

FINDINGS

The variance and amplitude in 4D CT image-derived DL scores were associated with tumor motion (R²  = 0.48 and 0.46, respectively). Specifically, DL score variance was deterministic and represented by sinusoidal undulations in phase with the respiratory cycle. DL scores, but not tumor volumes, peaked near end-exhalation. The mean of the scores derived from 4D CT images and the score obtained from FB CT images were highly associated (Pearson r = 0.99). MIP-derived DL scores were significantly higher than 4D- or FB-derived risk scores (p < 0.0001).

INTERPRETATION

An image-based DL risk score derived from a series of 4D CT images varies in a deterministic, sinusoidal trajectory in a phase with the respiratory cycle. These results indicate that DL models of tumors in motion can be robust to fluctuations in object appearance due to movement and can guide standardization processes in the clinical translation of DL models for patients with lung cancer.

Radiomic and Volumetric Measurements as Clinical Trial Endpoints—A Comprehensive Review

Simple Summary

The extraction of quantitative data from standard-of-care imaging modalities offers opportunities to improve the relevance and salience of imaging biomarkers used in drug development. This review aims to identify the challenges and opportunities for discovering new imaging-based biomarkers based on radiomic and volumetric assessment in the single-site solid tumor sites: breast cancer, rectal cancer, lung cancer and glioblastoma. Developing approaches to harmonize three essential areas: segmentation, validation and data sharing may expedite regulatory approval and adoption of novel cancer imaging biomarkers.

Abstract

Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas—segmentation, validation and data sharing strategies—where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.

Development and Validation of a Machine Learning-Based Radiomics Model on Cardiac Computed Tomography of Epicardial Adipose Tissue in Predicting Characteristics and Recurrence of Atrial Fibrillation

Purpose

This study aimed to evaluate the feasibility of differentiating the atrial fibrillation (AF) subtype and preliminary explore the prognostic value of AF recurrence after ablation using radiomics models based on epicardial adipose tissue around the left atrium (LA-EAT) of cardiac CT images.

Method

The cardiac CT images of 314 patients were collected wherein 251 and 63 cases were randomly enrolled in the training and validation cohorts, respectively. Mutual information and the random forest algorithm were used to screen for the radiomic features and construct the radiomics signature. Radiomics models reflecting the features of LA-EAT were built to differentiate the AF subtype, and the multivariable logistic regression model was adopted to integrate the radiomics signature and volume information. The same methodology and algorithm were applied to the radiomic features to explore the ability for predicting AF recurrence.

Results

The predictive model constructed by integrating the radiomic features and volume information using a radiomics nomogram showed the best ability in differentiating AF subtype in the training [AUC, 0.915; 95% confidence interval (CI), 0.880–0.951] and validation (AUC, 0.853; 95% CI, 0.755–0.951) cohorts. The radiomic features have shown convincible predictive ability of AF recurrence in both training (AUC, 0.808; 95% CI, 0.750–0.866) and validation (AUC, 0.793; 95% CI, 0.654–0.931) cohorts.

Conclusions

The LA-EAT radiomic signatures are a promising tool in the differentiation of AF subtype and prediction of AF recurrence, which may have clinical implications in the early diagnosis of AF subtype and disease management.

Vulnerabilities of radiomic features to respiratory motion on four-dimensional computed tomography-based average intensity projection images: A phantom study

PURPOSE

To evaluate the influence of respiratory motion on the robustness of radiomic features on four-dimensional computed tomography (4DCT)-based average intensity projection (AIP) images by employing an anthropomorphic chest phantom.

METHODS

Three spherical objects (φ30 mm), namely, acrylic (100 Hounsfield unit [HU], homogeneous), rubber (-140 HU, homogeneous), and cork (-630 HU, heterogeneous), were moved with motion amplitudes of 0, 1, 2.5, 4, 6, 8, and 10 mm in the phantom, and 4DCT scans were repeated at four different locations. Thereafter, the AIP images were generated considering the average of the 10 respiratory phases of the 4DCT images. Further, the targets were manually delineated on the AIP images in the lung window setting. A total of 851 radiomic features, including 107 unfiltered features and 744 wavelet filter-based features, were extracted from the region of interest for each material. The feature robustness among the different target motion amplitude (ε) was evaluated by normalizing the feature variability of the target motion relative to the variability of data from 573 patients with early-stage non-small cell lung cancer. The features with absolute ε values ≤0.5 were considered highly robust to target motions.

RESULTS

The percentage of robust unfiltered and wavelet filter-based features with a motion amplitude of 1 mm was greater than 83.2% and 93.4%, respectively; however, the percentage decreased by more than 24.3% and 17.6%, respectively, for motion amplitudes greater than 2.5 mm. The movement of cork had a small effect on the feature robustness compared to that of acrylic and rubber, regardless of the target motion amplitudes.

CONCLUSIONS

Our phantom study demonstrated that target motion amplitudes ≤1 mm led to the robustness of radiomic features on the 4DCT-based AIP images of thoracic regions. The frequency components and directions of the wavelet filters may be essential factors in 4DCT-based radiomic analysis.

Radiomics for Predicting Lung Cancer Outcomes Following Radiotherapy: A Systematic Review

Lung cancer's radiomic phenotype may potentially inform clinical decision-making with respect to radical radiotherapy. At present there are no validated biomarkers available for the individualisation of radical radiotherapy in lung cancer and the mortality rate of this disease remains the highest of all other solid tumours. MEDLINE was searched using the terms 'radiomics' and 'lung cancer' according to the Preferred Reporting Items for Systematic Reviews and Met-Analyses (PRISMA) guidance. Radiomics studies were defined as those manuscripts describing the extraction and analysis of at least 10 quantifiable imaging features. Only those studies assessing disease control, survival or toxicity outcomes for patients with lung cancer following radical radiotherapy ± chemotherapy were included. Study titles and abstracts were reviewed by two independent reviewers. The Radiomics Quality Score was applied to the full text of included papers. Of 244 returned results, 44 studies met the eligibility criteria for inclusion. End points frequently reported were local (17%), regional (17%) and distant control (31%), overall survival (79%) and pulmonary toxicity (4%). Imaging features strongly associated with clinical outcomes include texture features belonging to the subclasses Gray level run length matrix, Gray level co-occurrence matrix and kurtosis. The median cohort size for model development was 100 (15-645); in the 11 studies with external validation in a separate independent population, the median cohort size was 84 (21-295). The median number of imaging features extracted was 184 (10-6538). The median Radiomics Quality Score was 11% (0-47). Patient-reported outcomes were not incorporated within any studies identified. No studies externally validated a radiomics signature in a registered prospective study. Imaging-derived indices attained through radiomic analyses could equip thoracic oncologists with biomarkers for treatment response, patterns of failure, normal tissue toxicity and survival in lung cancer. Based on routine scans, their non-invasive nature and cost-effectiveness are major advantages over conventional pathological assessment. Improved tools are required for the appraisal of radiomics studies, as significant barriers to clinical implementation remain, such as standardisation of input scan data, quality of reporting and external validation of signatures in randomised, interventional clinical trials.

On dose cube pixel spacing pre-processing for features extraction stability in dosiomic studies

PURPOSE

Dosiomics allows to parameterize regions of interest (ROIs) and to produce quantitative dose features encoding the spatial and statistical distribution of radiotherapy dose. The stability of dosiomics features extraction on dose cube pixel spacing variation has been investigated in this study.

MATERIAL AND METHODS

Based on 17 clinical delivered dose distributions (P_n), dataset has been generated considering all the possible combinations of four dose grid resolutions and two calculation algorithms. Each dose voxel cube has been post-processed considering 4 different dose cube pixel spacing values: 1x1x1, 2x2x2, 3x3x3 mm³ and the one equal to the planning CT. Dosiomics features extraction has been performed from four different ROIs. The stability of each extracted dosiomic feature has been analyzed in terms of coefficient of variation (CV) intraclass correlation coefficient (ICC).

RESULTS

The highest CV mean values were observed for PTV ROI and for the grey level size zone matrix features family. On the other hand, the lowest CV mean values have been found for RING ROI for the grey level co-occurrence matrix features family. P₃ showed the highest percentage of CV >1 (1.14%) followed by P₁₅ (0.41%), P₁ (0.29%) and P13 (0.19%). ICC analysis leads to identify features with an ICC >0.95 that could be considered stable to use in dosiomic studies when different dose cube pixel spacing are considered, especially the features in common among the seventeen plans.

CONCLUSION

Considering the observed variability, dosiomic studies should always provide a report not only on grid resolution and algorithm dose calculation, but also on dose cube pixel spacing.

Radiomics in Oncology: A Practical Guide

Radiomics refers to the extraction of mineable data from medical imaging and has been applied within oncology to improve diagnosis, prognostication, and clinical decision support, with the goal of delivering precision medicine. The authors provide a practical approach for successfully implementing a radiomic workflow from planning and conceptualization through manuscript writing. Applications in oncology typically are either classification tasks that involve computing the probability of a sample belonging to a category, such as benign versus malignant, or prediction of clinical events with a time-to-event analysis, such as overall survival. The radiomic workflow is multidisciplinary, involving radiologists and data and imaging scientists, and follows a stepwise process involving tumor segmentation, image preprocessing, feature extraction, model development, and validation. Images are curated and processed before segmentation, which can be performed on tumors, tumor subregions, or peritumoral zones. Extracted features typically describe the distribution of signal intensities and spatial relationship of pixels within a region of interest. To improve model performance and reduce overfitting, redundant and nonreproducible features are removed. Validation is essential to estimate model performance in new data and can be performed iteratively on samples of the dataset (cross-validation) or on a separate hold-out dataset by using internal or external data. A variety of noncommercial and commercial radiomic software applications can be used. Guidelines and artificial intelligence checklists are useful when planning and writing up radiomic studies. Although interest in the field continues to grow, radiologists should be familiar with potential pitfalls to ensure that meaningful conclusions can be drawn.

Online supplemental material is available for this article.

Published under a CC BY 4.0 license.

Effects of interobserver and interdisciplinary segmentation variabilities on CT-based radiomics for pancreatic cancer

Radiomics is a method to mine large numbers of quantitative imaging features and develop predictive models. It has shown exciting promise for improved cancer decision support from early detection to personalized precision treatment, and therefore offers a desirable new direction for pancreatic cancer where the mortality remains high despite the current care and intense research. For radiomics, interobserver segmentation variability and its effect on radiomic feature stability is a crucial consideration. While investigations have been reported for high-contrast cancer sites such as lung cancer, no studies to date have investigated it on CT-based radiomics for pancreatic cancer. With three radiation oncology observers and three radiology observers independently contouring on the contrast CT of 21 pancreatic cancer patients, we conducted the first interobserver segmentation variability study on CT-based radiomics for pancreatic cancer. Moreover, our novel investigation assessed whether there exists an interdisciplinary difference between the two disciplines. For each patient, a consensus tumor volume was generated using the simultaneous truth and performance level expectation algorithm, using the dice similarity coefficient (DSC) to assess each observer's delineation against the consensus volume. Radiation oncology observers showed a higher average DSC of 0.81 ± 0.06 than the radiology observers at 0.69 ± 0.16 (p = 0.002). On a panel of 1277 radiomic features, the intraclass correlation coefficients (ICC) was calculated for all observers and those of each discipline. Large variations of ICCs were observed for different radiomic features, but ICCs were generally higher for the radiation oncology group than for the radiology group. Applying a threshold of ICC > 0.75 for considering a feature as stable, 448 features (35%) were found stable for the radiation oncology group and 214 features (16%) were stable from the radiology group. Among them, 205 features were found stable for both groups. Our results provide information for interobserver segmentation variability and its effect on CT-based radiomics for pancreatic cancer. An interesting interdisciplinary variability found in this study also introduces new considerations for the deployment of radiomics models.

Evaluation and optimization of radiomics features stability to respiratory motion in 18 F-FDG 3D PET imaging

PURPOSE

To evaluate the impact of respiratory motion on radiomics features in ¹⁸ F-fluoro-2-deoxy-D-glucose three dimensional positron emission tomography (¹⁸ F-FDG 3D PET) imaging and optimize feature stability by combining preprocessing configurations and aggregation strategies.

METHODS

An in-house developed respiratory motion phantom was imaged in 3D PET scanner under nine respiratory patterns including one reference pattern. In total, 487 radiomics features were extracted for each respiratory pattern. Feature stability to respiratory motion was first evaluated by metrics of coefficient of variation (COV) and relative difference (RD) in a fixed preprocessing configuration. Further, one-way ANOVA and trend analysis were performed to evaluate the impact of preprocessing configuration (voxel size, discretization scheme) and aggregation strategy on feature stability. Finally, an optimization framework was proposed by selected feature-specific configurations with minimum COV value, and the diagnostic performance was validated in stable versus unstable features and fixed versus optimal features by a set of 46 patients with lung disease.

RESULTS

PET radiomics features were sensitive to respiratory motion, only 79/487 (16%) features were identified to be very stable in the fixed configuration. Preprocessing configuration and aggregation strategy had an impact on feature stability. For different voxel size, bin number, bin size and aggregation strategy, 188/487 (39%), 70/487 (15%), 148/487 (30%), and 38/95 (29%) features appeared significant changes in feature stability. The optimized configuration had the potential to improve feature stability compared to fixed configuration, with the COV decreased from 22% ±24% to 16% ±20%. Regarding the diagnostic performance, the stable and optimal configuration features outperformed the unstable and fixed configuration features, respectively (AUC 0.88, 0.87 vs. 0.83, 0.85).

CONCLUSIONS

Respiratory motion shows considerable impact on feature stability in 3D PET imaging, while optimizing preprocessing configuration may improve feature stability and diagnostic performance.

Optimising use of 4D-CT phase information for radiomics analysis in lung cancer patients treated with stereotactic body radiotherapy

Purpose. 4D-CT is routine imaging for lung cancer patients treated with stereotactic body radiotherapy. No studies have investigated optimal 4D phase selection for radiomics. We aim to determine how phase data should be used to identify prognostic biomarkers for distant failure, and test whether stability assessment is required. A phase selection approach will be developed to aid studies with different 4D protocols and account for patient differences. Methods. 186 features were extracted from the tumour and peritumour on all phases for 258 patients. Feature values were selected from phase features using four methods: (A) mean across phases, (B) median across phases, (C) 50% phase, and (D) the most stable phase (closest in value to two neighbours), coined personalised selection. Four levels of stability assessment were also analysed, with inclusion of: (1) all features, (2) stable features across all phases, (3) stable features across phase and neighbour phases, and (4) features averaged over neighbour phases. Clinical-radiomics models were built for twelve combinations of feature type and assessment method. Model performance was assessed by concordance index (c-index) and fraction of new information from radiomic features. Results. The most stable phase spanned the whole range but was most often near exhale. All radiomic signatures provided new information for distant failure prediction. The personalised model had the highest c-index (0.77), and 58% of new information was provided by radiomic features when no stability assessment was performed. Conclusion. The most stable phase varies per-patient and selecting this improves model performance compared to standard methods. We advise the single most stable phase should be determined by minimising feature differences to neighbour phases. Stability assessment over all phases decreases performance by excessively removing features. Instead, averaging of neighbour phases should be used when stability is of concern. The models suggest that higher peritumoural intensity predicts distant failure.

The impact of the variation of imaging parameters on the robustness of Computed Tomography radiomic features: A review

The field of radiomics is at the forefront of personalized medicine. However, there is concern that high variation in imaging parameters will impact robustness of radiomic features and subsequently the performance of the predictive models built upon them. Therefore, our review aims to evaluate the impact of imaging parameters on the robustness of radiomic features. We also provide insights into the validity and discrepancy of different methodologies applied to investigate the robustness of radiomic features. We selected 47 papers based on our predefined inclusion criteria and grouped these papers by the imaging parameter under investigation: (i) scanner parameters, (ii) acquisition parameters and (iii) reconstruction parameters. Our review highlighted that most of the imaging parameters are disruptive parameters, and shape along with First order statistics were reported as the most robust radiomic features against variation in imaging parameters. This review identified inconsistencies related to the methodology of the reviewed studies such as the metrics used for robustness, the feature extraction techniques, the reporting style, and their outcome inclusion. We hope this review will aid the scientific community in conducting research in a way that is more reproducible and avoids the pitfalls of previous analyses.

Understanding Sources of Variation to Improve the Reproducibility of Radiomics

Radiomics is the method of choice for investigating the association between cancer imaging phenotype, cancer genotype and clinical outcome prediction in the era of precision medicine. The fast dispersal of this new methodology has benefited from the existing advances of the core technologies involved in radiomics workflow: image acquisition, tumor segmentation, feature extraction and machine learning. However, despite the rapidly increasing body of publications, there is no real clinical use of a developed radiomics signature so far. Reasons are multifaceted. One of the major challenges is the lack of reproducibility and generalizability of the reported radiomics signatures (features and models). Sources of variation exist in each step of the workflow; some are controllable or can be controlled to certain degrees, while others are uncontrollable or even unknown. Insufficient transparency in reporting radiomics studies further prevents translation of the developed radiomics signatures from the bench to the bedside. This review article first addresses sources of variation, which is illustrated using demonstrative examples. Then, it reviews a number of published studies and progresses made to date in the investigation and improvement of feature reproducibility and model performance. Lastly, it discusses potential strategies and practical considerations to reduce feature variability and improve the quality of radiomics study. This review focuses on CT image acquisition, tumor segmentation, quantitative feature extraction, and the disease of lung cancer.

Identification of robust and reproducible CT-texture metrics using a customized 3D-printed texture phantom

OBJECTIVE

The objective of this study was to evaluate the robustness and reproducibility of computed tomography-based texture analysis (CTTA) metrics extracted from CT images of a customized texture phantom built for assessing the association of texture metrics to three-dimensional (3D) printed progressively increasing textural heterogeneity.

MATERIALS AND METHODS

A custom-built 3D-printed texture phantom comprising of six texture patterns was used to evaluate the robustness and reproducibility of a radiomics panel under a variety of routine abdominal imaging protocols. The phantom was scanned on four CT scanners (Philips, Canon, GE, and Siemens) to assess reproducibility. The robustness assessment was conducted by imaging the texture phantom across different CT imaging parameters such as slice thickness, field of view (FOV), tube voltage, and tube current for each scanner. The texture panel comprised of 387 features belonging to 15 subgroups of texture extraction methods (e.g., Gray-level Co-occurrence Matrix: GLCM). Twelve unique image settings were tested on all the four scanners (e.g., FOV125). Interclass correlation two-way mixed with absolute agreement (ICC3) was used to assess the robustness and reproducibility of radiomic features. Linear regression was used to test the association between change in radiomic features and increased texture heterogeneity. Results were summarized in heat maps.

RESULTS

A total of 5612 (23.2%) of 24 090 features showed excellent robustness and reproducibility (ICC ≥ 0.9). Intensity, GLCM 3D, and gray-level run length matrix (GLRLM) 3D features showed best performance. Among imaging variables, changes in slice thickness affected all metrics more intensely compared to other imaging variables in reducing the ICC3. From the analysis of linear trend effect of the CTTA metrics, the top three metrics with high linear correlations across all scanners and scanning settings were from the GLRLM 2D/3D and discrete cosine transform (DCT) texture family.

CONCLUSION

The choice of scanner and imaging protocols affect texture metrics. Furthermore, not all CTTA metrics have a linear association with linearly varying texture patterns.

A systematic review and meta-analysis of the prognostic value of radiomics based models in non-small cell lung cancer treated with curative radiotherapy

BACKGROUND AND PURPOSE

Radiomics allows extraction of quantifiable features from imaging. This study performs a systematic review and meta-analysis of the performance of radiomics based prognostic models in non-small cell lung cancer (NSCLC).

MATERIALS AND METHODS

A literature review was performed following PRISMA guidelines. Medline, EMBASE and Cochrane databases were searched for articles investigating radiomics features predictive of overall survival (OS) in NSCLC treated with curative intent radiotherapy. A random-effects meta-analysis of Harrell's Concordance Index (C-index) was performed on the performance of radiomics models.

RESULTS

Of the 2746 articles retrieved, 40 studies of 55 datasets and 6223 patients were eligible for inclusion in the systematic review. There was significant heterogeneity in the methodology for feature selection and model development. Twelve datasets reported the C-index of radiomics based models in predicting OS and were included in the meta-analysis. The C-index random effects estimate was 0.57 (95% CI 0.53-0.62). There was significant heterogeneity (I² = 70.3%).

CONCLUSIONS

Based on this review, radiomics based models for lung cancer have to date demonstrated modest prognostic capabilities. Future research should consider using standardised radiomics features, robust feature selection and model development, and deep learning techniques, absolving the need for pre-defined features, to improve imaging-based models.

The influence of cardiac motion on radiomics features: radiomics features of non-enhanced CMR cine images greatly vary through the cardiac cycle

OBJECTIVES

The cardiac cycle might impair the reproducibility of radiomics features of cardiac magnetic resonance (CMR) cine images, yet this issue has not been addressed in the previous research. We aim to evaluate whether radiomics features of CMR cine images vary during the cardiac cycle and investigate the reproducibility of radiomics features of CMR cine images.

METHODS

This retrospective study enrolled 59 healthy adults who underwent CMR examination. Two observers segmented the myocardium on a 4D stack of three consecutive mid-ventricular short-axis cine images covering the cardiac cycle. A total of 352 radiomics features were extracted. The coefficient of variation and intraclass correlation coefficient were used to assess the feature variability through the cycle and inter-observer reproducibility, respectively.

RESULTS

Approximately 55% of radiomics features showed large variability through the cardiac cycle. The original features showed more variability than the Laplacian of Gaussian-filtered features (73.8% vs. 48%). The features of 4D stack cine images had a higher proportion of reproducible features (92.0%, 87.7%, and 76.1%) compared with the end-diastolic (77.8%, 62.2%, and 41.7%) and the end-systolic images (81.5%, 74.1%, and 58.8%) for intraclass correlation cut-off values of ³0.80, > 0.85, and > 0.90, respectively.

CONCLUSIONS

Radiomics features of CMR cine images greatly vary during the cardiac cycle. The radiomics features of 4D stack of cine images are more robust compared with end-diastolic and end-systolic cine images in terms of reproducibility. The impact of the cardiac cycle on the reproducibility of the features should be considered when employing CMR cine images radiomics.

KEY POINTS

• There is limited evidence on the impact of cardiac motion on radiomics features of CMR cine images and the reproducibility of the radiomics features of CMR cine images. • Radiomics features of non-enhanced CMR cine images greatly vary during the cardiac cycle, and the number of "reproducible" features shows significant variations according to the cardiac phases. • The impact of cardiac cycle on the reproducibility of the radiomics features should be considered when employing CMR cine images radiomics.

Radiomics in Lung Cancer from Basic to Advanced: Current Status and Future Directions

Ideally, radiomics features and radiomics signatures can be used as imaging biomarkers for diagnosis, staging, prognosis, and prediction of tumor response. Thus, the number of published radiomics studies is increasing exponentially, leading to a myriad of new radiomics-based evidence for lung cancer. Consequently, it is challenging for radiologists to keep up with the development of radiomics features and their clinical applications. In this article, we review the basics to advanced radiomics in lung cancer to guide young researchers who are eager to start exploring radiomics investigations. In addition, we also include technical issues of radiomics, because knowledge of the technical aspects of radiomics supports a well-informed interpretation of the use of radiomics in lung cancer.

Shape and texture-based radiomics signature on CT effectively discriminates benign from malignant renal masses

OBJECTIVES

Using a radiomics framework to quantitatively analyze tumor shape and texture features in three dimensions, we tested its ability to objectively and robustly distinguish between benign and malignant renal masses. We assessed the relative contributions of shape and texture metrics separately and together in the prediction model.

MATERIALS AND METHODS

Computed tomography (CT) images of 735 patients with 539 malignant and 196 benign masses were segmented in this retrospective study. Thirty-three shape and 760 texture metrics were calculated per tumor. Tumor classification models using shape, texture, and both metrics were built using random forest and AdaBoost with tenfold cross-validation. Sensitivity analyses on five sub-cohorts with respect to the acquisition phase were conducted. Additional sensitivity analyses after multiple imputation were also conducted. Model performance was assessed using AUC.

RESULTS

Random forest classifier showed shape metrics featuring within the top 10% performing metrics regardless of phase, attaining the highest variable importance in the corticomedullary phase. Convex hull perimeter ratio is a consistently high-performing shape feature. Shape metrics alone achieved an AUC ranging 0.64-0.68 across multiple classifiers, compared with 0.67-0.75 and 0.68-0.75 achieved by texture-only and combined models, respectively.

CONCLUSION

Shape metrics alone attain high prediction performance and high variable importance in the combined model, while being independent of the acquisition phase (unlike texture). Shape analysis therefore should not be overlooked in its potential to distinguish benign from malignant tumors, and future radiomics platforms powered by machine learning should harness both shape and texture metrics.

KEY POINTS

• Current radiomics research is heavily weighted towards texture analysis, but quantitative shape metrics should not be ignored in their potential to distinguish benign from malignant renal tumors. • Shape metrics alone can attain high prediction performance and demonstrate high variable importance in the combined shape and texture radiomics model. • Any future radiomics platform powered by machine learning should harness both shape and texture metrics, especially since tumor shape (unlike texture) is independent of the acquisition phase and more robust from the imaging variations.

Radiomics in medical imaging-"how-to" guide and critical reflection

Radiomics is a quantitative approach to medical imaging, which aims at enhancing the existing data available to clinicians by means of advanced mathematical analysis. Through mathematical extraction of the spatial distribution of signal intensities and pixel interrelationships, radiomics quantifies textural information by using analysis methods from the field of artificial intelligence. Various studies from different fields in imaging have been published so far, highlighting the potential of radiomics to enhance clinical decision-making. However, the field faces several important challenges, which are mainly caused by the various technical factors influencing the extracted radiomic features.The aim of the present review is twofold: first, we present the typical workflow of a radiomics analysis and deliver a practical "how-to" guide for a typical radiomics analysis. Second, we discuss the current limitations of radiomics, suggest potential improvements, and summarize relevant literature on the subject.

Radiomics as a personalized medicine tool in lung cancer: Separating the hope from the hype

Radiomics has become a popular image analysis method in the last few years. Its key hypothesis is that medical images harbor biological, prognostic and predictive information that is not revealed upon visual inspection. In contrast to previous work with a priori defined imaging biomarkers, radiomics instead calculates image features at scale and uses statistical methods to identify those most strongly associated to outcome. This builds on years of research into computer aided diagnosis and pattern recognition. While the potential of radiomics to aid personalized medicine is widely recognized, several technical limitations exist which hinder biomarker translation. Aspects of the radiomic workflow lack repeatability or reproducibility under particular circumstances, which is a key requirement for the translation of imaging biomarkers into clinical practice. One of the most commonly studied uses of radiomics is for personalized medicine applications in Non-Small Cell Lung Cancer (NSCLC). In this review, we summarize reported methodological limitations in CT based radiomic analyses together with suggested solutions. We then evaluate the current NSCLC radiomics literature to assess the risk associated with accepting the published conclusions with respect to these limitations. We review different complementary scoring systems and initiatives that can be used to critically appraise data from radiomics studies. Wider awareness should improve the quality of ongoing and future radiomics studies and advance their potential as clinically relevant biomarkers for personalized medicine in patients with NSCLC.

Radiomics and deep learning in lung cancer

Lung malignancies have been extensively characterized through radiomics and deep learning. By providing a three-dimensional characterization of the lesion, models based on radiomic features from computed tomography (CT) and positron-emission tomography (PET) have been developed to detect nodules, distinguish malignant from benign lesions, characterize their histology, stage, and genotype. Deep learning models have been applied to automatically segment organs at risk in lung cancer radiotherapy, stratify patients according to the risk for local and distant recurrence, and identify patients candidate for molecular targeted therapy and immunotherapy. Moreover, radiomics has also been applied successfully to predict side effects such as radiation- and immunotherapy-induced pneumonitis and differentiate lung injury from recurrence. Radiomics could also untap the potential for further use of the cone beam CT acquired for treatment image guidance, four-dimensional CT, and dose-volume data from radiotherapy treatment plans. Radiomics is expected to increasingly affect the clinical practice of treatment of lung tumors, optimizing the end-to-end diagnosis-treatment-follow-up chain. The main goal of this article is to provide an update on the current status of lung cancer radiomics.

How to develop a meaningful radiomic signature for clinical use in oncologic patients

During the last decade, there is an increasing usage of quantitative methods in Radiology in an effort to reduce the diagnostic variability associated with a subjective manner of radiological interpretation. Combined approaches where visual assessment made by the radiologist is augmented by quantitative imaging biomarkers are gaining attention. Advances in machine learning resulted in the rise of radiomics that is a new methodology referring to the extraction of quantitative information from medical images. Radiomics are based on the development of computational models, referred to as “Radiomic Signatures”, trying to address either unmet clinical needs, mostly in the field of oncologic imaging, or to compare radiomics performance with that of radiologists. However, to explore this new technology, initial publications did not consider best practices in the field of machine learning resulting in publications with questionable clinical value. In this paper, our effort was concentrated on how to avoid methodological mistakes and consider critical issues in the workflow of the development of clinically meaningful radiomic signatures.