Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study

Impact of harmonization on the reproducibility of MRI radiomic features when using different scanners, acquisition parameters, and image pre-processing techniques: a phantom study

This study investigated the impact of ComBat harmonization on the reproducibility of radiomic features extracted from magnetic resonance images (MRI) acquired on different scanners, using various data acquisition parameters and multiple image pre-processing techniques using a dedicated MRI phantom. Four scanners were used to acquire an MRI of a nonanatomic phantom as part of the TCIA RIDER database. In fast spin-echo inversion recovery (IR) sequences, several inversion durations were employed, including 50, 100, 250, 500, 750, 1000, 1500, 2000, 2500, and 3000 ms. In addition, a 3D fast spoiled gradient recalled echo (FSPGR) sequence was used to investigate several flip angles (FA): 2, 5, 10, 15, 20, 25, and 30 degrees. Nineteen phantom compartments were manually segmented. Different approaches were used to pre-process each image: Bin discretization, Wavelet filter, Laplacian of Gaussian, logarithm, square, square root, and gradient. Overall, 92 first-, second-, and higher-order statistical radiomic features were extracted. ComBat harmonization was also applied to the extracted radiomic features. Finally, the Intraclass Correlation Coefficient (ICC) and Kruskal-Wallis's (KW) tests were implemented to assess the robustness of radiomic features. The number of non-significant features in the KW test ranged between 0-5 and 29-74 for various scanners, 31-91 and 37-92 for three times tests, 0-33 to 34-90 for FAs, and 3-68 to 65-89 for IRs before and after ComBat harmonization, with different image pre-processing techniques, respectively. The number of features with ICC over 90% ranged between 0-8 and 6-60 for various scanners, 11-75 and 17-80 for three times tests, 3-83 to 9-84 for FAs, and 3-49 to 3-63 for IRs before and after ComBat harmonization, with different image pre-processing techniques, respectively. The use of various scanners, IRs, and FAs has a great impact on radiomic features. However, the majority of scanner-robust features is also robust to IR and FA. Among the effective parameters in MR images, several tests in one scanner have a negligible impact on radiomic features. Different scanners and acquisition parameters using various image pre-processing might affect radiomic features to a large extent. ComBat harmonization might significantly impact the reproducibility of MRI radiomic features.

Test-retest repeatability of myocardial radiomic features from quantitative cardiac magnetic resonance T1 and T2 mapping

Radiomics of cardiac magnetic resonance (MR) imaging has proved to be potentially useful in the study of various myocardial diseases. Therefore, assessing the repeatability degree in radiomic features measurement is of fundamental importance. The aim of this study was to assess test-retest repeatability of myocardial radiomic features extracted from quantitative T1 and T2 maps. A representative group of 24 subjects (mean age 54 ± 18 years) referred for clinical cardiac MR imaging were enrolled in the study. For each subject, T1 and T2 mapping through MOLLI and T2-prepared TrueFISP acquisition sequences, respectively, were performed at 1.5 T. Then, 98 radiomic features of different classes (shape, first-order, second-order) were extracted from a region of interest encompassing the whole left ventricle myocardium in a short axis slice. The repeatability was assessed performing different and complementary analyses: intraclass correlation coefficient (ICC) and limits of agreement (LOA) (i.e., the interval within which 95% of the percentage differences between two repeated measures are expected to lie). Radiomic features were characterized by a relatively wide range of repeatability degree in terms of both ICC and LOA. Overall, 44.9% and 38.8% of radiomic features showed ICC values >0.75 for T1 and T2 maps, respectively, while 25.5% and 23.4% of radiomic features showed LOA between ±10%. A subset of radiomic features for T1 (Mean, Median, 10Percentile, 90Percentile, RootMeanSquared, Imc2, RunLengthNonUniformityNormalized, RunPercentage and ShortRunEmphasis) and T2 (MaximumDiameter, RunLengthNonUniformityNormalized, RunPercentage, ShortRunEmphasis) maps presented both ICC > 0.75 and LOA between ±5%. Overall, radiomic features extracted from T1 maps showed better repeatability performance than those extracted from T2 maps, with shape features characterized by better repeatability than first-order and textural features. Moreover, only a limited subset of 9 and 4 radiomic features for T1 and T2 maps, respectively, showed high repeatability degree in terms of both ICC and LOA. These results confirm the importance of assessing test-retest repeatability degree in radiomic feature estimation and might be useful for a more effective/reliable use of myocardial T1 and T2 mapping radiomics in clinical or research studies.

Stability of Radiomic Features against Variations in Lesion Segmentations Computed on Apparent Diffusion Coefficient Maps of Breast Lesions

Diffusion-weighted imaging (DWI) combined with radiomics can aid in the differentiation of breast lesions. Segmentation characteristics, however, might influence radiomic features. To evaluate feature stability, we implemented a standardized pipeline featuring shifts and shape variations of the underlying segmentations. A total of 103 patients were retrospectively included in this IRB-approved study after multiparametric diagnostic breast 3T MRI with a spin-echo diffusion-weighted sequence with echoplanar readout (b-values: 50, 750 and 1500 s/mm2). Lesion segmentations underwent shifts and shape variations, with >100 radiomic features extracted from apparent diffusion coefficient (ADC) maps for each variation. These features were then compared and ranked based on their stability, measured by the Overall Concordance Correlation Coefficient (OCCC) and Dynamic Range (DR). Results showed variation in feature robustness to segmentation changes. The most stable features, excluding shape-related features, were FO (Mean, Median, RootMeanSquared), GLDM (DependenceNonUniformity), GLRLM (RunLengthNonUniformity), and GLSZM (SizeZoneNonUniformity), which all had OCCC and DR > 0.95 for both shifting and resizing the segmentation. Perimeter, MajorAxisLength, MaximumDiameter, PixelSurface, MeshSurface, and MinorAxisLength were the most stable features in the Shape category with OCCC and DR > 0.95 for resizing. Considering the variability in radiomic feature stability against segmentation variations is relevant when interpreting radiomic analysis of breast DWI data.

Multivariate testing and effect size measures for batch effect evaluation in radiomic features

While precision medicine applications of radiomics analysis are promising, differences in image acquisition can cause "batch effects" that reduce reproducibility and affect downstream predictive analyses. Harmonization methods such as ComBat have been developed to correct these effects, but evaluation methods for quantifying batch effects are inconsistent. In this study, we propose the use of the multivariate statistical test PERMANOVA and the Robust Effect Size Index (RESI) to better quantify and characterize batch effects in radiomics data. We evaluate these methods in both simulated and real radiomics features extracted from full-field digital mammography (FFDM) data. PERMANOVA demonstrated higher power than standard univariate statistical testing, and RESI was able to interpretably quantify the effect size of site at extremely large sample sizes. These methods show promise as more powerful and interpretable methods for the detection and quantification of batch effects in radiomics studies.

Sexual Dimorphism of Radiomic Features in the Brain: An Exploratory Study Using 700 μm MP2RAGE MRI at 7 T

OBJECTIVES

The aim of this study was to determine whether MRI radiomic features of key cerebral structures differ between women and men, and whether detection of such differences depends on the image resolution.

MATERIALS AND METHODS

Ultrahigh resolution (UHR) 3D MP2RAGE (magnetization-prepared 2 rapid acquisition gradient echo) T1-weighted MR images (voxel size, 0.7 × 0.7 × 0.7 mm3) of the brain of 30 subjects (18 women and 12 men; mean age, 39.0 ± 14.8 years) without abnormal findings on MRI were retrospectively included. MRI was performed on a whole-body 7 T MR system. A convolutional neural network was used to segment the following structures: frontal cortex, frontal white matter, thalamus, putamen, globus pallidus, caudate nucleus, and corpus callosum. Eighty-seven radiomic features were extracted respectively: gray-level histogram (n = 18), co-occurrence matrix (n = 24), run-length matrix (n = 16), size-zone matrix (n = 16), and dependence matrix (n = 13). Feature extraction was performed at UHR and, additionally, also after resampling to 1.4 × 1.4 × 1.4 mm3 voxel size (standard clinical resolution). Principal components (PCs) of radiomic features were calculated, and independent samples t tests with Cohen d as effect size measure were used to assess differences in PCs between women and men for the different cerebral structures.

RESULTS

At UHR, at least a single PC differed significantly between women and men in 6/7 cerebral structures: frontal cortex (d = -0.79, P = 0.042 and d = -1.01, P = 0.010), frontal white matter (d = -0.81, P = 0.039), thalamus (d = 1.43, P < 0.001), globus pallidus (d = 0.92, P = 0.020), caudate nucleus (d = -0.83, P = 0.039), and corpus callosum (d = -0.97, P = 0.039). At standard clinical resolution, only a single PC extracted from the corpus callosum differed between sexes (d = 1.05, P = 0.009).

CONCLUSIONS

Nonnegligible differences in radiomic features of several key structures of the brain exist between women and men, and need to be accounted for. Very high spatial resolution may be required to uncover and further investigate the sexual dimorphism of brain structures on MRI.

Perfect Match: Radiomics and Artificial Intelligence in Cardiac Imaging

Cardiovascular diseases remain a significant health burden, with imaging modalities like echocardiography, cardiac computed tomography, and cardiac magnetic resonance imaging playing a crucial role in diagnosis and prognosis. However, the inherent heterogeneity of these diseases poses challenges, necessitating advanced analytical methods like radiomics and artificial intelligence. Radiomics extracts quantitative features from medical images, capturing intricate patterns and subtle variations that may elude visual inspection. Artificial intelligence techniques, including deep learning, can analyze these features to generate knowledge, define novel imaging biomarkers, and support diagnostic decision-making and outcome prediction. Radiomics and artificial intelligence thus hold promise for significantly enhancing diagnostic and prognostic capabilities in cardiac imaging, paving the way for more personalized and effective patient care. This review explores the synergies between radiomics and artificial intelligence in cardiac imaging, following the radiomics workflow and introducing concepts from both domains. Potential clinical applications, challenges, and limitations are discussed, along with solutions to overcome them.

Automated Data Transformation and Feature Extraction for Oxygenation-Sensitive Cardiovascular Magnetic Resonance Images

Oxygenation-sensitive cardiovascular magnetic resonance (OS-CMR) is a novel, powerful tool for assessing coronary function in vivo. The data extraction and analysis however are labor-intensive. The objective of this study was to provide an automated approach for the extraction, visualization, and biomarker selection of OS-CMR images. We created a Python-based tool to automate extraction and export of raw patient data, featuring 3336 attributes per participant, into a template compatible with common data analytics frameworks, including the functionality to select predictive features for the given disease state. Each analysis was completed in about 2 min. The features selected by both ANOVA and MIC significantly outperformed (p < 0.001) the null set and complete set of features in two datasets, with mean AUROC scores of 0.89eatures f 0.94lete set of features in two datasets, with mean AUROC scores that our tool is suitable for automated data extraction and analysis of OS-CMR images.

Reproducible Radiomics Features from Multi-MRI-Scanner Test-Retest-Study: Influence on Performance and Generalizability of Models

BACKGROUND

Radiomics models trained on data from one center typically show a decline of performance when applied to data from external centers, hindering their introduction into large-scale clinical practice. Current expert recommendations suggest to use only reproducible radiomics features isolated by multiscanner test-retest experiments, which might help to overcome the problem of limited generalizability to external data.

PURPOSE

To evaluate the influence of using only a subset of robust radiomics features, defined in a prior in vivo multi-MRI-scanner test-retest-study, on the performance and generalizability of radiomics models.

STUDY TYPE

Retrospective.

POPULATION

Patients with monoclonal plasma cell disorders. Training set (117 MRIs from center 1); internal test set (42 MRIs from center 1); external test set (143 MRIs from center 2-8).

FIELD STRENGTH/SEQUENCE

1.5T and 3.0T; T1-weighted turbo spin echo.

ASSESSMENT

The task for the radiomics models was to predict plasma cell infiltration, determined by bone marrow biopsy, noninvasively from MRI. Radiomics machine learning models, including linear regressor, support vector regressor (SVR), and random forest regressor (RFR), were trained on data from center 1, using either all radiomics features, or using only reproducible radiomics features. Models were tested on an internal (center 1) and a multicentric external data set (center 2-8).

STATISTICAL TESTS

Pearson correlation coefficient r and mean absolute error (MAE) between predicted and actual plasma cell infiltration. Fisher's z-transformation, Wilcoxon signed-rank test, Wilcoxon rank-sum test; significance level P < 0.05.

RESULTS

When using only reproducible features compared with all features, the performance of the SVR on the external test set significantly improved (r = 0.43 vs. r = 0.18 and MAE = 22.6 vs. MAE = 28.2). For the RFR, the performance on the external test set deteriorated when using only reproducible instead of all radiomics features (r = 0.33 vs. r = 0.44, P = 0.29 and MAE = 21.9 vs. MAE = 20.5, P = 0.10).

CONCLUSION

Using only reproducible radiomics features improves the external performance of some, but not all machine learning models, and did not automatically lead to an improvement of the external performance of the overall best radiomics model.

LEVEL OF EVIDENCE: 3

TECHNICAL EFFICACY

Stage 2.

Predicting postoperative rehemorrhage in hypertensive intracerebral hemorrhage using noncontrast CT radiomics and clinical data with an interpretable machine learning approach

In hypertensive intracerebral hemorrhage (HICH) patients, while emergency surgeries effectively reduce intracranial pressure and hematoma volume, their significant risk of causing postoperative rehemorrhage necessitates early detection and management to improve patient prognosis. This study sought to develop and validate machine learning (ML) models leveraging clinical data and noncontrast CT radiomics to pinpoint patients at risk of postoperative rehemorrhage, equipping clinicians with an early detection tool for prompt intervention. The study conducted a retrospective analysis on 609 HICH patients, dividing them into training and external verification cohorts. These patients were categorized into groups with and without postoperative rehemorrhage. Radiomics features from noncontrast CT images were extracted, standardized, and employed to create several ML models. These models underwent internal validation using both radiomics and clinical data, with the best model's feature significance assessed via the Shapley additive explanations (SHAP) method, then externally validated. In the study of 609 patients, postoperative rehemorrhage rates were similar in the training (18.8%, 80/426) and external verification (17.5%, 32/183) cohorts. Six significant noncontrast CT radiomics features were identified, with the support vector machine (SVM) model outperforming others in both internal and external validations. SHAP analysis highlighted five critical predictors of postoperative rehemorrhage risk, encompassing three radiomics features from noncontrast CT and two clinical data indicators. This study highlights the effectiveness of an SVM model combining radiomics features from noncontrast CT and clinical parameters in predicting postoperative rehemorrhage among HICH patients. This approach enables timely and effective interventions, thereby improving patient outcomes.

Achieving imaging and computational reproducibility on multiparametric MRI radiomics features in brain tumor diagnosis: phantom and clinical validation

OBJECTIVES

The Image Biomarker Standardization Initiative has helped improve the computational reproducibility of MRI radiomics features. Nonetheless, the MRI sequences and features with high imaging reproducibility are yet to be established. To determine reproducible multiparametric MRI radiomics features across test-retest, multi-scanner, and computational reproducibility comparisons, and to evaluate their clinical value in brain tumor diagnosis.

METHODS

To assess reproducibility, T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), and diffusion-weighted imaging (DWI) were acquired from three 3-T MRI scanners using standardized phantom, and radiomics features were extracted using two computational algorithms. Reproducible radiomics features were selected when the concordance correlation coefficient value above 0.9 across multiple sessions, scanners, and computational algorithms. Random forest classifiers were trained with reproducible features (n = 117) and validated in a clinical cohort (n = 50) to evaluate whether features with high reproducibility improved the differentiation of glioblastoma from primary central nervous system lymphomas (PCNSLs).

RESULTS

Radiomics features from T2WI demonstrated higher repeatability (65-94%) than those from DWI (38-48%) or T1WI (2-92%). Across test-retest, multi-scanner, and computational comparisons, T2WI provided 41 reproducible features, DWI provided six, and T1WI provided two. The performance of the classification model with reproducible features was higher than that using non-reproducible features in both training set (AUC, 0.916 vs. 0.877) and validation set (AUC, 0.957 vs. 0.869).

CONCLUSION

Radiomics features with high reproducibility across multiple sessions, scanners, and computational algorithms were identified, and they showed higher diagnostic performance than non-reproducible radiomics features in the differentiation of glioblastoma from PCNSL.

CLINICAL RELEVANCE STATEMENT

By identifying the radiomics features showing higher multi-machine reproducibility, our results also demonstrated higher radiomics diagnostic performance in the differentiation of glioblastoma from PCNSL, paving the way for further research designs and clinical application in neuro-oncology.

KEY POINTS

• Highly reproducible radiomics features across multiple sessions, scanners, and computational algorithms were identified using phantom and applied to clinical diagnosis. • Radiomics features from T2-weighted imaging were more reproducible than those from T1-weighted and diffusion-weighted imaging. • Radiomics features with good reproducibility had better diagnostic performance for brain tumors than features with poor reproducibility.

Radiomics from multisite MRI and clinical data to predict clinically significant prostate cancer

BACKGROUND

Magnetic resonance imaging (MRI) is useful in the diagnosis of clinically significant prostate cancer (csPCa). MRI-derived radiomics may support the diagnosis of csPCa.

PURPOSE

To investigate whether adding radiomics from biparametric MRI to predictive models based on clinical and MRI parameters improves the prediction of csPCa in a multisite-multivendor setting.

MATERIAL AND METHODS

Clinical information (PSA, PSA density, prostate volume, and age), MRI reviews (PI-RADS 2.1), and radiomics (histogram and texture features) were retrieved from prospectively included patients examined at different radiology departments and with different MRI systems, followed by MRI-ultrasound fusion guided biopsies of lesions PI-RADS 3-5. Predictive logistic regression models of csPCa (Gleason score ≥7) for the peripheral (PZ) and transition zone (TZ), including clinical data and PI-RADS only, and combined with radiomics, were built and compared using receiver operating characteristic (ROC) curves.

RESULTS

In total, 456 lesions in 350 patients were analyzed. In PZ and TZ, PI-RADS 4-5 and PSA density, and age in PZ, were independent predictors of csPCa in models without radiomics. In models including radiomics, PI-RADS 4-5, PSA density, age, and ADC energy were independent predictors in PZ, and PI-RADS 5, PSA density and ADC mean in TZ. Comparison of areas under the ROC curve (AUC) for the models without radiomics (PZ: AUC = 0.82, TZ: AUC = 0.80) versus with radiomics (PZ: AUC = 0.82, TZ: AUC = 0.82) showed no significant differences (PZ: P = 0.366; TZ: P = 0.171).

CONCLUSION

PSA density and PI-RADS are potent predictors of csPCa. Radiomics do not add significant information to our multisite-multivendor dataset.

MRI-based automated machine learning model for preoperative identification of variant histology in muscle-invasive bladder carcinoma

OBJECTIVES

It is essential yet highly challenging to preoperatively diagnose variant histologies such as urothelial carcinoma with squamous differentiation (UC w/SD) from pure UC in patients with muscle-invasive bladder carcinoma (MIBC), as their treatment strategy varies significantly. We developed a non-invasive automated machine learning (AutoML) model to preoperatively differentiate UC w/SD from pure UC in patients with MIBC.

METHODS

A total of 119 MIBC patients who underwent baseline bladder MRI were enrolled in this study, including 38 patients with UC w/SD and 81 patients with pure UC. These patients were randomly assigned to a training set or a test set (3:1). An AutoML model was built from the training set, using 13 selected radiomic features from T2-weighted imaging, semantic features (ADC values), and clinical features (tumor length, tumor stage, lymph node metastasis status), and subsequent ten-fold cross-validation was performed. A test set was used to validate the proposed model. The AUC of the ROC curve was then calculated for the model.

RESULTS

This AutoML model enabled robust differentiation of UC w/SD and pure UC in patients with MIBC in both training set (ten-fold cross-validation AUC = 0.955, 95% confidence interval [CI]: 0.944-0.965) and test set (AUC = 0.932, 95% CI: 0.812-1.000).

CONCLUSION

The presented AutoML model, that incorporates the radiomic, semantic, and clinical features from baseline MRI, could be useful for preoperative differentiation of UC w/SD and pure UC.

CLINICAL RELEVANCE STATEMENT

This MRI-based automated machine learning (AutoML) study provides a non-invasive and low-cost preoperative prediction tool to identify the muscle-invasive bladder cancer patients with variant histology, which may serve as a useful tool for clinical decision-making.

KEY POINTS

• It is important to preoperatively diagnose variant histology from urothelial carcinoma in patients with muscle-invasive bladder carcinoma (MIBC), as their treatment strategy varies significantly. • An automated machine learning (AutoML) model based on baseline bladder MRI can identify the variant histology (squamous differentiation) from urothelial carcinoma preoperatively in patients with MIBC. • The developed AutoML model is a non-invasive and low-cost preoperative prediction tool, which may be useful for clinical decision-making.

State of the art: radiomics and radiomics-related artificial intelligence on the road to clinical translation

Radiomics and artificial intelligence carry the promise of increased precision in oncologic imaging assessments due to the ability of harnessing thousands of occult digital imaging features embedded in conventional medical imaging data. While powerful, these technologies suffer from a number of sources of variability that currently impede clinical translation. In order to overcome this impediment, there is a need to control for these sources of variability through harmonization of imaging data acquisition across institutions, construction of standardized imaging protocols that maximize the acquisition of these features, harmonization of post-processing techniques, and big data resources to properly power studies for hypothesis testing. For this to be accomplished, it will be critical to have multidisciplinary and multi-institutional collaboration.

Radiomics of Late Gadolinium Enhancement Reveals Prognostic Value of Myocardial Scar Heterogeneity in Hypertrophic Cardiomyopathy

BACKGROUND

Late gadolinium enhancement (LGE) scar burden by cardiac magnetic resonance is a major risk factor for sudden cardiac death (SCD) in hypertrophic cardiomyopathy (HCM). However, there is currently limited data on the incremental prognostic value of integrating myocardial LGE radiomics (ie, shape and texture features) into SCD risk stratification models.

OBJECTIVES

The purpose of this study was to investigate the incremental prognostic value of myocardial LGE radiomics beyond current European Society of Cardiology (ESC) and American College of Cardiology (ACC)/American Heart Association (AHA) models for SCD risk prediction in HCM.

METHODS

A total of 1,229 HCM patients (62% men; age 52 ± 16 years) from 3 medical centers were included. Left ventricular myocardial radiomic features were calculated from LGE images. Principal component analysis was used to reduce the radiomic features and calculate 3 principal radiomics (PrinRads). Cox and logistic regression analyses were then used to evaluate the significance of the extracted PrinRads of LGE images, alone or in combination with ESC or ACC/AHA models, to predict SCD risk. The ACC/AHA risk markers include LGE burden using a dichotomized 15% threshold of LV scar.

RESULTS

SCD events occurred in 30 (2.4%) patients over a follow-up period of 49 ± 28 months. Risk prediction using PrinRads resulted in higher c-statistics than the ESC (0.69 vs 0.57; P = 0.02) and the ACC/AHA (0.69 vs 0.67; P = 0.75) models. Risk predictions were improved by combining the 3 PrinRads with ESC (0.73 vs 0.57; P < 0.01) or ACC/AHA (0.76 vs 0.67; P < 0.01) risk scores. The net reclassification index was improved by combining the PrinRads with ESC (0.25 [95% CI: 0.08-0.43]; P = 0.005) or ACC/AHA (0.05 [95% CI: -0.07 to 0.16]; P = 0.42) models. One PrinRad was a significant predictor of SCD risk (HR: 0.57 [95% CI: 0.39-0.84]; P = 0.01). LGE heterogeneity was a major component of PrinRads and a significant predictor of SCD risk (HR: 0.07 [95% CI: 0.01-0.75]; P = 0.03).

CONCLUSIONS

Myocardial LGE radiomics are strongly associated with SCD risk in HCM and provide incremental risk stratification beyond current ESC or AHA/ACC risk models. Our proof-of-concept study warrants further validation.

Reproducibility and location-stability of radiomic features derived from cone-beam computed tomography: a phantom study

OBJECTIVES

This study aims to determine the reproducibility and location-stability of cone-beam computed tomography (CBCT) radiomic features.

METHODS

Centrifugal tubes with six concentrations of K2HPO4 solutions (50, 100, 200, 400, 600, and 800 mg ml-1) were imaged within a customized phantom. For each concentration, images were captured twice as test and retest sets. Totally, 69 radiomic features were extracted by LIFEx. The reproducibility was assessed between the test and retest sets. We used the concordance correlation coefficient (CCC) to screen qualified features and then compared the differences in the numbers of them under 24 series (four locations groups * six concentrations). The location-stability was assessed using the Kruskal-Wallis test under different concentration sets; likewise, the numbers of qualified features under six test sets were analyzed.

RESULTS

There were 20 and 23 qualified features in the reproducibility and location-stability experiments, respectively. In the reproducibility experiment, the performance of the peripheral groups and high-concentration sets was significantly better than the center groups and low-concentration sets. The effect of concentration on the location-stability of features was not monotonic, and the number of qualified features in the low-concentration sets was greater than that in the high-concentration sets. No features were qualified in both experiments.

CONCLUSIONS

The density and location of the target object can affect the number of reproducible radiomic features, and its density can also affect the number of location-stable radiomic features. The problem of feature reliability should be treated cautiously in radiomic research on CBCT.

Comparing effectiveness of image perturbation and test retest imaging in improving radiomic model reliability

Image perturbation is a promising technique to assess radiomic feature repeatability, but whether it can achieve the same effect as test-retest imaging on model reliability is unknown. This study aimed to compare radiomic model reliability based on repeatable features determined by the two methods using four different classifiers. A 191-patient public breast cancer dataset with 71 test-retest scans was used with pre-determined 117 training and 74 testing samples. We collected apparent diffusion coefficient images and manual tumor segmentations for radiomic feature extraction. Random translations, rotations, and contour randomizations were performed on the training images, and intra-class correlation coefficient (ICC) was used to filter high repeatable features. We evaluated model reliability in both internal generalizability and robustness, which were quantified by training and testing AUC and prediction ICC. Higher testing performance was found at higher feature ICC thresholds, but it dropped significantly at ICC = 0.95 for the test-retest model. Similar optimal reliability can be achieved with testing AUC = 0.7-0.8 and prediction ICC > 0.9 at the ICC threshold of 0.9. It is recommended to include feature repeatability analysis using image perturbation in any radiomic study when test-retest is not feasible, but care should be taken when deciding the optimal feature repeatability criteria.

Photon-counting detector CT-based virtual monoenergetic reconstructions: repeatability and reproducibility of radiomics features of an organic phantom and human myocardium

BACKGROUND

Photon-counting detector computed tomography (PCD-CT) may influence imaging characteristics for various clinical conditions due to higher signal and contrast-to-noise ratio in virtual monoenergetic images (VMI). Radiomics analysis relies on quantification of image characteristics. We evaluated the impact of different VMI reconstructions on radiomic features in in vitro and in vivo PCD-CT datasets.

METHODS

An organic phantom consisting of twelve samples (four oranges, four onions, and four apples) was scanned five times. Twenty-three patients who had undergone coronary computed tomography angiography on a first generation PCD-CT system with the same image acquisitions were analyzed. VMIs were reconstructed at 6 keV levels (40, 55, 70, 90, 120, and 190 keV). The phantoms and the patients' left ventricular myocardium (LVM) were segmented for all reconstructions. Ninety-three original radiomic features were extracted. Repeatability and reproducibility were evaluated through intraclass correlations coefficient (ICC) and post hoc paired samples ANOVA t test.

RESULTS

There was excellent repeatability for radiomic features in phantom scans (all ICC = 1.00). Among all VMIs, 36/93 radiomic features (38.7%) in apples, 28/93 (30.1%) in oranges, and 33/93 (35.5%) in onions were not significantly different. For LVM, the percentage of stable features was high between VMIs ≥ 90 keV (90 versus 120 keV, 77.4%; 90 versus 190 keV, 83.9%; 120 versus 190 keV, 89.3%), while comparison to lower VMI levels led to fewer reproducible features (40 versus 55 keV, 8.6%).

CONCLUSIONS

VMI levels influence the stability of radiomic features in an organic phantom and patients' LVM; stability decreases considerably below 90 keV.

RELEVANCE STATEMENT

Spectral reconstructions significantly influence radiomic features in vitro and in vivo, necessitating standardization and careful attention to these reconstruction parameters before clinical implementation.

KEY POINTS

• Radiomic features have an excellent repeatability within the same PCD-CT acquisition and reconstruction. • Differences in VMI lead to decreased reproducibility for radiomic features. • VMI ≥ 90 keV increased the reproducibility of the radiomic features.

Segmentation methods applied to MRI-derived radiomic analysis for the prediction of placenta accreta spectrum in patients with placenta previa

PURPOSE

To retrospectively evaluate the performance of different manual segmentation methods of placenta MR images for predicting Placenta Accreta Spectrum (PAS) disorders in patients with placenta previa (PP) using a Machine Learning (ML) Radiomics analysis.

METHODS

64 patients (n=41 with PAS and n= 23 without PAS) with PP who underwent MRI examination for suspicion of PAS were retrospectively selected. All MRI examinations were acquired on a 1.5 T using T2-weighted (T2w) sequences on axial, sagittal and coronal planes. Ten different manual segmentation methods were performed on sagittal placental T2-weighted images obtaining five sets of 2D regions of interest (ROIs) and five sets of 3D volumes of interest (VOIs) from each patient. In detail, ROIs and VOIs were positioned on the following areas: placental tissue, retroplacental myometrium, cervix, placenta with underneath myometrium, placenta with underneath myometrium and cervix. For feature stability testing, the same process was repeated on 30 randomly selected placental MRI examinations by two additional radiologists, working independently and blinded to the original segmentation. Radiomic features were extracted from all available ROIs and VOIs. 100 iterations of 5-fold cross-validation with nested feature selection, based on recursive feature elimination, were subsequently run on each ROI/VOI to identify the best-performing method to classify instances correctly.

RESULTS

Among the segmentation methods, the best performance in predicting PAS was obtained by the VOIs covering the retroplacental myometrium (Mean validation score: 0.761, standard deviation: 0.116).

CONCLUSION

Our preliminary results show that the VOI including the retroplacental myometrium using T2w images seems to be the best method when segmenting images for the development of ML radiomics predictive models to identify PAS in patients with PP.

CT-derived textural analysis parameters discriminate high-attenuation renal cysts from solid renal neoplasms

AIM

To assess the utility of textural features on computed tomography (CT) to differentiate high-attenuation cysts from solid renal neoplasms among indeterminate renal lesions detected incidentally on CT.

MATERIALS AND METHODS

Patients were included if they had an indeterminate renal lesion on CT that was subsequently characterised on ultrasound or magnetic resonance imaging (MRI). Up to three lesions per patient were included if they had a size ≥10 mm and density of 20-70 HU on unenhanced CT or any single phase of contrast-enhanced CT. Cases were categorised as benign or most likely benign cysts (Bosniak II and IIF) versus indeterminate (Bosniak III), mixed solid and cystic (Bosniak IV), or solid renal lesions. A random forest model was generated using 95 textural parameters and four clinical parameters for each lesion.

RESULTS

Two hundred and thirty-four patients were included who had a total of 278 lesions. Of these, 193 (69%) were benign or most likely benign cysts and 85 (31%) were indeterminate, mixed cystic and solid, or solid renal lesions. The random forest model had an area under the curve of 0.71 (95% confidence interval [CI]: 0.65, 0.78), with a sensitivity and specificity of 81.2% and 38.9%, respectively.

CONCLUSION

A multivariate model including textural and clinical parameters had moderate overall performance for discriminating benign or likely benign cysts from indeterminate, mixed solid and cystic, or solid renal lesions. This study serves as a proof of concept and may reduce the need for further follow-up by characterising a significant portion of indeterminate lesions on CT as benign.

Radiomic features from multiparametric magnetic resonance imaging predict molecular subgroups of pediatric low-grade gliomas

BACKGROUND

We aimed to develop machine learning models for prediction of molecular subgroups (low-risk group and intermediate/high-risk group) and molecular marker (KIAA1549-BRAF fusion) of pediatric low-grade gliomas (PLGGs) based on radiomic features extracted from multiparametric MRI.

METHODS

61 patients with PLGGs were included in this retrospective study, which were divided into a training set and an internal validation set at a ratio of 2:1 based on the molecular subgroups or the molecular marker. The patients were classified into low-risk and intermediate/high-risk groups, BRAF fusion positive and negative groups, respectively. We extracted 5929 radiomic features from multiparametric MRI. Thereafter, we removed redundant features, trained random forest models on the training set for predicting the molecular subgroups or the molecular marker, and validated their performance on the internal validation set. The performance of the prediction model was verified by 3-fold cross-validation.

RESULTS

We constructed the classification model differentiating low-risk PLGGs from intermediate/high-risk PLGGs using 4 relevant features, with an AUC of 0.833 and an accuracy of 76.2% in the internal validation set. In the prediction model for predicting KIAA1549-BRAF fusion using 4 relevant features, an AUC of 0.818 and an accuracy of 81.0% were achieved in the internal validation set.

CONCLUSIONS

The current study demonstrates that MRI radiomics is able to predict molecular subgroups of PLGGs and KIAA1549-BRAF fusion with satisfying sensitivity.

TRIAL REGISTRATION

This study was retrospectively registered at clinicaltrials.gov (NCT04217018).

One Model to Synthesize Them All: Multi-Contrast Multi-Scale Transformer for Missing Data Imputation

Multi-contrast magnetic resonance imaging (MRI) is widely used in clinical practice as each contrast provides complementary information. However, the availability of each imaging contrast may vary amongst patients, which poses challenges to radiologists and automated image analysis algorithms. A general approach for tackling this problem is missing data imputation, which aims to synthesize the missing contrasts from existing ones. While several convolutional neural networks (CNN) based algorithms have been proposed, they suffer from the fundamental limitations of CNN models, such as the requirement for fixed numbers of input and output channels, the inability to capture long-range dependencies, and the lack of interpretability. In this work, we formulate missing data imputation as a sequence-to-sequence learning problem and propose a multi-contrast multi-scale Transformer (MMT), which can take any subset of input contrasts and synthesize those that are missing. MMT consists of a multi-scale Transformer encoder that builds hierarchical representations of inputs combined with a multi-scale Transformer decoder that generates the outputs in a coarse-to-fine fashion. The proposed multi-contrast Swin Transformer blocks can efficiently capture intra- and inter-contrast dependencies for accurate image synthesis. Moreover, MMT is inherently interpretable as it allows us to understand the importance of each input contrast in different regions by analyzing the in-built attention maps of Transformer blocks in the decoder. Extensive experiments on two large-scale multi-contrast MRI datasets demonstrate that MMT outperforms the state-of-the-art methods quantitatively and qualitatively.

Artificial Intelligence in Lung Cancer Screening: The Future Is Now

Lung cancer has one of the worst morbidity and fatality rates of any malignant tumour. Most lung cancers are discovered in the middle and late stages of the disease, when treatment choices are limited, and patients' survival rate is low. The aim of lung cancer screening is the identification of lung malignancies in the early stage of the disease, when more options for effective treatments are available, to improve the patients' outcomes. The desire to improve the efficacy and efficiency of clinical care continues to drive multiple innovations into practice for better patient management, and in this context, artificial intelligence (AI) plays a key role. AI may have a role in each process of the lung cancer screening workflow. First, in the acquisition of low-dose computed tomography for screening programs, AI-based reconstruction allows a further dose reduction, while still maintaining an optimal image quality. AI can help the personalization of screening programs through risk stratification based on the collection and analysis of a huge amount of imaging and clinical data. A computer-aided detection (CAD) system provides automatic detection of potential lung nodules with high sensitivity, working as a concurrent or second reader and reducing the time needed for image interpretation. Once a nodule has been detected, it should be characterized as benign or malignant. Two AI-based approaches are available to perform this task: the first one is represented by automatic segmentation with a consequent assessment of the lesion size, volume, and densitometric features; the second consists of segmentation first, followed by radiomic features extraction to characterize the whole abnormalities providing the so-called "virtual biopsy". This narrative review aims to provide an overview of all possible AI applications in lung cancer screening.

Morphometry-based radiomics for predicting therapeutic response in patients with gliomas following radiotherapy

Introduction

Gliomas are still considered as challenging in oncologic management despite the developments in treatment approaches. The complete elimination of a glioma might not be possible even after a treatment and assessment of therapeutic response is important to determine the future course of actions for patients with such cancers. In the recent years radiomics has emerged as a promising solution with potential applications including prediction of therapeutic response. Hence, this study was focused on investigating whether morphometry-based radiomics signature could be used to predict therapeutic response in patients with gliomas following radiotherapy.

Methods

105 magnetic resonance (MR) images including segmented and non-segmented images were used to extract morphometric features and develop a morphometry-based radiomics signature. After determining the appropriate machine learning algorithm, a prediction model was developed to predict the therapeutic response eliminating the highly correlated features as well as without eliminating the highly correlated features. Then the model performance was evaluated.

Results

Tumor grade had the highest contribution to develop the morphometry-based signature. Random forest provided the highest accuracy to train the prediction model derived from the morphometry-based radiomics signature. An accuracy of 86% and area under the curve (AUC) value of 0.91 were achieved for the prediction model evaluated without eliminating the highly correlated features whereas accuracy and AUC value were 84% and 0.92 respectively for the prediction model evaluated after eliminating the highly correlated features.

Discussion

Nonetheless, the developed morphometry-based radiomics signature could be utilized as a noninvasive biomarker for therapeutic response in patients with gliomas following radiotherapy.

Identification of radiomic biomarkers in a set of four skeletal muscle groups on Dixon MRI of the NAKO MR study

In this work, we propose a processing pipeline for the extraction and identification of meaningful radiomics biomarkers in skeletal muscle tissue as displayed using Dixon-weighted MRI. Diverse and robust radiomics features can be identified that may be of aid in the accurate quantification e.g. varying degrees of sarcopenia in respective muscles of large cohorts. As such, the approach comprises the texture feature extraction from raw data based on well established approaches, such as a nnU-Net neural network and the Pyradiomics toolbox, a subsequent selection according to adequate conditions for the muscle tissue of the general population, and an importance-based ranking to further narrow the amount of meaningful features with respect to auxiliary targets. The performance was investigated with respect to the included auxiliary targets, namely age, body mass index (BMI), and fat fraction (FF). Four skeletal muscles with different fiber architecture were included: the mm. glutaei, m. psoas, as well as the extensors and adductors of the thigh. The selection allowed for a reduction from 1015 available texture features to 65 for age, 53 for BMI, and 36 for FF from the available fat/water contrast images considering all muscles jointly. Further, the dependence of the importance rankings calculated for the auxiliary targets on validation sets (in a cross-validation scheme) was investigated by boxplots. In addition, significant differences between subgroups of respective auxiliary targets as well as between both sexes were shown to be present within the ten lowest ranked features by means of Kruskal-Wallis H-tests and Mann-Whitney U-tests. The prediction performance for the selected features and the ranking scheme were verified on validation sets by a random forest based multi-class classification, with strong area under the curve (AUC) values of the receiver operator characteristic (ROC) of 73.03 ± 0.70 % and 73.63 ± 0.70 % for the water and fat images in age, 80.68 ± 0.30 % and 88.03 ± 0.89 % in BMI, as well as 98.36 ± 0.03 % and 98.52 ± 0.09 % in FF.

Artificial intelligence CT radiomics to predict early recurrence of intrahepatic cholangiocarcinoma: a multicenter study

OBJECTIVES

In this multicenter study, we sought to develop and validate a preoperative model for predicting early recurrence (ER) risk after curative resection of intrahepatic cholangiocarcinoma (ICC) through artificial intelligence (AI)-based CT radiomics approach.

MATERIALS AND METHODS

A total of 311 patients (Derivation: 160; Internal and two external validations: 36, 74 and 61) from 8 medical centers who underwent curative resection were collected retrospectively. In derivation cohort, radiomics and clinical-radiomics models for ER prediction were constructed by LightGBM (a machine learning algorithm). A clinical model was also developed for comparison. Model performance was validated in internal and two external cohorts by ROC. In addition, we investigated the interpretability of the LightGBM model.

RESULTS

The combined clinical-radiomics model that included 15 radiomic features and 3 clinical features (CA19-9 > 1000 U/ml, vascular invasion and tumor margin), resulting in the area under the curves (AUCs) of 0.974 (95% CI 0.946-1.000) in the derivation cohort, and 0.871-0.882 (95% CI 0.672-0.962) in the internal and external validation cohorts, respectively, which are higher than the AJCC 8th TNM staging system (AUCs: 0.686-0.717, p all < 0.05). Especially, the sensitivity of this machine learning model could reach 94.6% on average for all the cohorts.

CONCLUSIONS

This AI-driven combined radiomics model may provide as a useful tool to preoperatively predict ER and improve therapeutic management of ICC patients.

Multiparametric MRI: From Simultaneous Rapid Acquisition Methods and Analysis Techniques Using Scoring, Machine Learning, Radiomics, and Deep Learning to the Generation of Novel Metrics

ABSTRACT

With the recent advancements in rapid imaging methods, higher numbers of contrasts and quantitative parameters can be acquired in less and less time. Some acquisition models simultaneously obtain multiparametric images and quantitative maps to reduce scan times and avoid potential issues associated with the registration of different images. Multiparametric magnetic resonance imaging (MRI) has the potential to provide complementary information on a target lesion and thus overcome the limitations of individual techniques. In this review, we introduce methods to acquire multiparametric MRI data in a clinically feasible scan time with a particular focus on simultaneous acquisition techniques, and we discuss how multiparametric MRI data can be analyzed as a whole rather than each parameter separately. Such data analysis approaches include clinical scoring systems, machine learning, radiomics, and deep learning. Other techniques combine multiple images to create new quantitative maps associated with meaningful aspects of human biology. They include the magnetic resonance g-ratio, the inner to the outer diameter of a nerve fiber, and the aerobic glycolytic index, which captures the metabolic status of tumor tissues.

Radiomics for the detection of diffusely impaired myocardial perfusion: A proof-of-concept study using 13N-ammonia positron emission tomography

AIM

The current proof-of-concept study investigates the value of radiomic features from normal 13N-ammonia positron emission tomography (PET) myocardial retention images to identify patients with reduced global myocardial flow reserve (MFR).

METHODS

Data from 100 patients with normal retention 13N-ammonia PET scans were divided into two groups, according to global MFR (i.e., < 2 and ≥ 2), as derived from quantitative PET analysis. We extracted radiomic features from retention images at each of five different gray-level (GL) discretization (8, 16, 32, 64, and 128 bins). Outcome independent and dependent feature selection and subsequent univariate and multivariate analyses was performed to identify image features predicting reduced global MFR.

RESULTS

A total of 475 radiomic features were extracted per patient. Outcome independent and dependent feature selection resulted in a remainder of 35 features. Discretization at 16 bins (GL16) yielded the highest number of significant predictors of reduced MFR and was chosen for the final analysis. GLRLM_GLNU was the most robust parameter and at a cut-off of 948 yielded an accuracy, sensitivity, specificity, negative and positive predictive value of 67%, 74%, 58%, 64%, and 69%, respectively, to detect diffusely impaired myocardial perfusion.

CONCLUSION

A single radiomic feature (GLRLM_GLNU) extracted from visually normal 13N-ammonia PET retention images independently predicts reduced global MFR with moderate accuracy. This concept could potentially be applied to other myocardial perfusion imaging modalities based purely on relative distribution patterns to allow for better detection of diffuse disease.

Advancements in MRI-Based Radiomics and Artificial Intelligence for Prostate Cancer: A Comprehensive Review and Future Prospects

The use of multiparametric magnetic resonance imaging (mpMRI) has become a common technique used in guiding biopsy and developing treatment plans for prostate lesions. While this technique is effective, non-invasive methods such as radiomics have gained popularity for extracting imaging features to develop predictive models for clinical tasks. The aim is to minimize invasive processes for improved management of prostate cancer (PCa). This study reviews recent research progress in MRI-based radiomics for PCa, including the radiomics pipeline and potential factors affecting personalized diagnosis. The integration of artificial intelligence (AI) with medical imaging is also discussed, in line with the development trend of radiogenomics and multi-omics. The survey highlights the need for more data from multiple institutions to avoid bias and generalize the predictive model. The AI-based radiomics model is considered a promising clinical tool with good prospects for application.

Associations between Vertebral Localized Contrast Changes and Adjacent Annular Fissures in Patients with Low Back Pain: A Radiomics Approach

Low back pain (LBP) is multifactorial and associated with various spinal tissue changes, including intervertebral disc fissures, vertebral pathology, and damaged endplates. However, current radiological markers lack specificity and individualized diagnostic capability, and the interactions between the various markers are not fully clear. Radiomics, a data-driven analysis of radiological images, offers a promising approach to improve evaluation and deepen the understanding of spinal changes related to LBP. This study investigated possible associations between vertebral changes and annular fissures using radiomics. A dataset of 61 LBP patients who underwent conventional magnetic resonance imaging followed by discography was analyzed. Radiomics features were extracted from segmented vertebrae and carefully reduced to identify the most relevant features associated with annular fissures. The results revealed three important texture features that display concentrated high-intensity gray levels, extensive regions with elevated gray levels, and localized areas with reduced gray levels within the vertebrae. These features highlight patterns within vertebrae that conventional classification systems cannot reflect on distinguishing between vertebrae adjacent to an intervertebral disc with or without an annular fissure. As such, the present study reveals associations that contribute to the understanding of pathophysiology and may provide improved diagnostics of LBP.

Stability of Multi-Parametric Prostate MRI Radiomic Features to Variations in Segmentation

Stability analysis remains a fundamental step in developing a successful imaging biomarker to personalize oncological strategies. This study proposes an in silico contour generation method for simulating segmentation variations to identify stable radiomic features. Ground-truth annotation provided for the whole prostate gland on the multi-parametric MRI sequences (T2w, ADC, and SUB-DCE) were perturbed to mimic segmentation differences observed among human annotators. In total, we generated 15 synthetic contours for a given image-segmentation pair. One thousand two hundred twenty-four unfiltered/filtered radiomic features were extracted applying Pyradiomics, followed by stability assessment using ICC(1,1). Stable features identified in the internal population were then compared with an external population to discover and report robust features. Finally, we also investigated the impact of a wide range of filtering strategies on the stability of features. The percentage of unfiltered (filtered) features that remained robust subjected to segmentation variations were T2w-36% (81%), ADC-36% (94%), and SUB-43% (93%). Our findings suggest that segmentation variations can significantly impact radiomic feature stability but can be mitigated by including pre-filtering strategies as part of the feature extraction pipeline.

External validation of an MR-based radiomic model predictive of locoregional control in oropharyngeal cancer

OBJECTIVES

To externally validate a pre-treatment MR-based radiomics model predictive of locoregional control in oropharyngeal squamous cell carcinoma (OPSCC) and to assess the impact of differences between datasets on the predictive performance.

METHODS

Radiomic features, as defined in our previously published radiomics model, were extracted from the primary tumor volumes of 157 OPSCC patients in a different institute. The developed radiomics model was validated using this cohort. Additionally, parameters influencing performance, such as patient subgroups, MRI acquisition, and post-processing steps on prediction performance will be investigated. For this analysis, matched subgroups (based on human papillomavirus (HPV) status of the tumor, T-stage, and tumor subsite) and a subgroup with only patients with 4-mm slice thickness were studied. Also the influence of harmonization techniques (ComBat harmonization, quantile normalization) and the impact of feature stability across observers and centers were studied. Model performances were assessed by area under the curve (AUC), sensitivity, and specificity.

RESULTS

Performance of the published model (AUC/sensitivity/specificity: 0.74/0.75/0.60) drops when applied on the validation cohort (AUC/sensitivity/specificity: 0.64/0.68/0.60). The performance of the full validation cohort improves slightly when the model is validated using a patient group with comparable HPV status of the tumor (AUC/sensitivity/specificity: 0.68/0.74/0.60), using patients acquired with a slice thickness of 4 mm (AUC/sensitivity/specificity: 0.67/0.73/0.57), or when quantile harmonization was performed (AUC/sensitivity/specificity: 0.66/0.69/0.60).

CONCLUSION

The previously published model shows its generalizability and can be applied on data acquired from different vendors and protocols. Harmonization techniques and subgroup definition influence performance of predictive radiomics models.

KEY POINTS

• Radiomics, a noninvasive quantitative image analysis technique, can support the radiologist by enhancing diagnostic accuracy and/or treatment decision-making. • A previously published model shows its generalizability and could be applied on data acquired from different vendors and protocols.

Textural Features of Mouse Glioma Models Measured by Dynamic Contrast-Enhanced MR Images with 3D Isotropic Resolution

This paper investigates the effect of anisotropic resolution on the image textural features of pharmacokinetic (PK) parameters of a murine glioma model using dynamic contrast-enhanced (DCE) MR images acquired with an isotropic resolution at 7T with pre-contrast T1 mapping. The PK parameter maps of whole tumors at isotropic resolution were generated using the two-compartment exchange model combined with the three-site-two-exchange model. The textural features of these isotropic images were compared with those of simulated, thick-slice, anisotropic images to assess the influence of anisotropic voxel resolution on the textural features of tumors. The isotropic images and parameter maps captured distributions of high pixel intensity that were absent in the corresponding anisotropic images with thick slices. A significant difference was observed in 33% of the histogram and textural features extracted from anisotropic images and parameter maps, compared to those extracted from corresponding isotropic images. Anisotropic images in different orthogonal orientations demonstrated 42.1% of the histogram and textural features to be significantly different from those of isotropic images. This study demonstrates that the anisotropy of voxel resolution needs to be carefully considered when comparing the textual features of tumor PK parameters and contrast-enhanced images.

Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging

OBJECTIVE

Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability.

MATERIALS AND METHODS

Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient.

RESULTS

Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins.

CONCLUSION

Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.

Radiomic Features Associated with Lymphoma Development in the Parotid Glands of Patients with Primary Sjögren's Syndrome

Non-Hodgkin Lymphoma (NHL) represents a severe complication and the main cause of morbidity in patients with primary Sjögren's syndrome (pSS). This study aimed to assess the role of textural analysis (TA) in revealing lymphoma-associated imaging parameters in the parotid gland (PG) parenchyma of patients with pSS. This retrospective study included a total of 36 patients (54.93 ± 13.34 years old; 91.6% females) diagnosed with pSS according to the American College of Rheumatology and the European League Against Rheumatism criteria (24 subjects with pSS and no lymphomatous proliferation; 12 subjects with pSS and NHL development in the PG, confirmed by the histopathological analysis). All subjects underwent MR scanning between January 2018 and October 2022. The coronal STIR PROPELLER sequence was employed to segment PG and perform TA using the MaZda5 software. A total of 65 PGs underwent segmentation and texture feature extraction (48 PGs were included in the pSS control group, and 17 PGs were included in the pSS NHL group). Following parameter reduction techniques, univariate analysis, multivariate regression, and receiver operating characteristics (ROC) analysis, the following TA parameters proved to be independently associated with NHL development in pSS: CH4S6_Sum_Variance and CV4S6_Inverse_Difference_Moment, with an area under ROC of 0.800 and 0.875, respectively. The radiomic model (resulting by combining the two previously independent TA features), presented 94.12% sensitivity and 85.42% specificity in differentiating between the two studied groups, reaching the highest area under ROC of 0.931 for the chosen cutoff value of 1.556. This study suggests the potential role of radiomics in revealing new imaging biomarkers that might serve as useful predictors for lymphoma development in patients with pSS. Further research on multicentric cohorts is warranted to confirm the obtained results and the added benefit of TA in risk stratification for patients with pSS.

How Radiomics Can Improve Breast Cancer Diagnosis and Treatment

Recent technological advances in the field of artificial intelligence hold promise in addressing medical challenges in breast cancer care, such as early diagnosis, cancer subtype determination and molecular profiling, prediction of lymph node metastases, and prognostication of treatment response and probability of recurrence. Radiomics is a quantitative approach to medical imaging, which aims to enhance the existing data available to clinicians by means of advanced mathematical analysis using artificial intelligence. Various published studies from different fields in imaging have highlighted the potential of radiomics to enhance clinical decision making. In this review, we describe the evolution of AI in breast imaging and its frontiers, focusing on handcrafted and deep learning radiomics. We present a typical workflow of a radiomics analysis and a practical "how-to" guide. Finally, we summarize the methodology and implementation of radiomics in breast cancer, based on the most recent scientific literature to help researchers and clinicians gain fundamental knowledge of this emerging technology. Alongside this, we discuss the current limitations of radiomics and challenges of integration into clinical practice with conceptual consistency, data curation, technical reproducibility, adequate accuracy, and clinical translation. The incorporation of radiomics with clinical, histopathological, and genomic information will enable physicians to move forward to a higher level of personalized management of patients with breast cancer.

Repeatability and reproducibility of MRI-radiomic features: A phantom experiment on a 1.5 T scanner

PURPOSE

Aim of this study is to assess the repeatability of radiomic features on magnetic resonance images (MRI) and their stability to variations in time of repetition (TR), time of echo (TE), slice thickness (ST), and pixel spacing (PS) using vegetable phantoms.

METHODS

The organic phantom was realized using two cucumbers placed inside a cylindrical container, and the analysis was performed using T1-weighted (T1w), T2-weighted (T2w), and diffusion-weighted images. One dataset was used to test the repeatability of the radiomic features, whereas other four datasets were used to test the sensitivity of the different MRI sequences to image acquisition parameters (TR, TE, ST, and PS). Four regions of interest (ROIs) were segmented: two for the central part of each cucumber and two for the external parts. Radiomic features were extracted from each ROI using Pyradiomics. To assess the effect of preprocessing on the reduction of variability, features were extracted both before and after the preprocessing. The coefficient of variation (CV) and intra-class correlation coefficient (ICC) were used to evaluate variability.

RESULTS

The use of intensity standardization increased the stability for the first-order statistics features. Shape and size features were always stable for all the analyses. Textural features were particularly sensitive to changes in ST and PS, although some increase in stability could be obtained by voxel size resampling. When images underwent image preprocessing, the number of stable features (ICC > 0.75 and mean absolute CV < 0.3) was 33 for apparent diffusion coefficient (ADC), 52 for T1w, and 73 for T2w.

CONCLUSIONS

The most critical source of variability is related to changes in voxel size (either caused by changes in ST or PS). Preprocessing increases features stability to both test-retest and variation of the image acquisition parameters for all the types of analyzed MRI (T1w, T2w, and ADC), except for ST.

AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging

Rapid advances in artificial intelligence (AI) and machine learning, and specifically in deep learning (DL) techniques, have enabled broad application of these methods in health care. The promise of the DL approach has spurred further interest in computer-aided diagnosis (CAD) development and applications using both "traditional" machine learning methods and newer DL-based methods. We use the term CAD-AI to refer to this expanded clinical decision support environment that uses traditional and DL-based AI methods. Numerous studies have been published to date on the development of machine learning tools for computer-aided, or AI-assisted, clinical tasks. However, most of these machine learning models are not ready for clinical deployment. It is of paramount importance to ensure that a clinical decision support tool undergoes proper training and rigorous validation of its generalizability and robustness before adoption for patient care in the clinic. To address these important issues, the American Association of Physicists in Medicine (AAPM) Computer-Aided Image Analysis Subcommittee (CADSC) is charged, in part, to develop recommendations on practices and standards for the development and performance assessment of computer-aided decision support systems. The committee has previously published two opinion papers on the evaluation of CAD systems and issues associated with user training and quality assurance of these systems in the clinic. With machine learning techniques continuing to evolve and CAD applications expanding to new stages of the patient care process, the current task group report considers the broader issues common to the development of most, if not all, CAD-AI applications and their translation from the bench to the clinic. The goal is to bring attention to the proper training and validation of machine learning algorithms that may improve their generalizability and reliability and accelerate the adoption of CAD-AI systems for clinical decision support.

Predicting Soft Tissue Sarcoma Response to Neoadjuvant Chemotherapy Using an MRI-Based Delta-Radiomics Approach

OBJECTIVES

To evaluate the performance of machine learning-augmented MRI-based radiomics models for predicting response to neoadjuvant chemotherapy (NAC) in soft tissue sarcomas.

METHODS

Forty-four subjects were identified retrospectively from patients who received NAC at our institution for pathologically proven soft tissue sarcomas. Only subjects who had both a baseline MRI prior to initiating chemotherapy and a post-treatment scan at least 2 months after initiating chemotherapy and prior to surgical resection were included. 3D ROIs were used to delineate whole-tumor volumes on pre- and post-treatment scans, from which 1708 radiomics features were extracted. Delta-radiomics features were calculated by subtraction of baseline from post-treatment values and used to distinguish treatment response through univariate analyses as well as machine learning-augmented radiomics analyses.

RESULTS

Though only 4.74% of variables overall reached significance at p ≤ 0.05 in univariate analyses, Laws Texture Energy (LTE)-derived metrics represented 46.04% of all such features reaching statistical significance. ROC analyses similarly failed to predict NAC response, with AUCs of 0.40 (95% CI 0.22-0.58) and 0.44 (95% CI 0.26-0.62) for RF and AdaBoost, respectively.

CONCLUSION

Overall, while our result was not able to separate NAC responders from non-responders, our analyses did identify a subset of LTE-derived metrics that show promise for further investigations. Future studies will likely benefit from larger sample size constructions so as to avoid the need for data filtering and feature selection techniques, which have the potential to significantly bias the machine learning procedures.

CT-radiomics and clinical risk scores for response and overall survival prognostication in TACE HCC patients

We aimed to identify hepatocellular carcinoma (HCC) patients who will respond to repetitive transarterial chemoembolization (TACE) to improve the treatment algorithm. Retrospectively, 61 patients (mean age, 65.3 years ± 10.0 [SD]; 49 men) with 94 HCC mRECIST target-lesions who had three consecutive TACE between 01/2012 and 01/2020 were included. Robust and non-redundant radiomics features were extracted from the 24 h post-embolization CT. Five different clinical TACE-scores were assessed. Seven different feature selection methods and machine learning models were used. Radiomics, clinical and combined models were built to predict response to TACE on a lesion-wise and patient-wise level as well as its impact on overall-survival prognostication. 29 target-lesions of 19 patients were evaluated in the test set. Response rates were 37.9% (11/29) on the lesion-level and 42.1% (8/19) on the patient-level. Radiomics top lesion-wise response prognostications was AUC 0.55-0.67. Clinical scores revealed top AUCs of 0.65-0.69. The best working model combined the radiomic feature LargeDependenceHighGrayLevelEmphasis and the clinical score mHAP_II_score_group with AUC = 0.70, accuracy = 0.72. We transferred this model on a patient-level to achieve AUC = 0.62, CI = 0.41-0.83. The two radiomics-clinical features revealed overall-survival prognostication of C-index = 0.67. In conclusion, a random forest model using the radiomic feature LargeDependenceHighGrayLevelEmphasis and the clinical mHAP-II-score-group seems promising for TACE response prognostication.

Ultrasound Histogram Assessment of Acute Breast Toxicity After Breast Cancer Radiation Therapy: A Prospective Longitudinal Study

Accurate assessment of radiation-induced breast toxicity is crucial for the management of breast radiation therapy (RT). Standard assessment of breast toxicity based on clinicians' visual inspection and palpation has considerable inter- and intra-observer variability. To overcome this challenge, we present an ultrasound histogram method that objectively evaluates radiation-induced breast toxicity longitudinally. In a prospective study, patients enrolled (n = 67) received ultrasound scans at four time points: prior to RT, last day of RT, 3-4 wk post-RT and 9-12-wk post-RT. Ultrasound scans were acquired at five locations (tumor bed and 3, 6, 9 and 12 o'clock) on both breasts. Two hundred sixty-four ultrasound scans and 2640 B-mode images were analyzed. The histogram differences between irradiated and contralateral breasts were calculated to evaluate radiation-induced breast changes. On the basis of the B-mode images, the severity of breast toxicity was graded as absent, mild, moderate or severe. The performance of the histogram method was assessed with the receiver operating characteristic (ROC) curve. The areas under the ROC curve ranged from 0.78 to 0.9 (sensitivity: 0.88-0.96, specificity: 0.53-0.83) at the lower quadrant for differentiating absent/mild from moderate/severe toxicity at various time points. This study provides preliminary evidence that ultrasound histogram differences can serve as an imaging biomarker to longitudinally assess radiation-induced acute toxicity.

A review of radiomics and genomics applications in cancers: the way towards precision medicine

The application of radiogenomics in oncology has great prospects in precision medicine. Radiogenomics combines large volumes of radiomic features from medical digital images, genetic data from high-throughput sequencing, and clinical-epidemiological data into mathematical modelling. The amalgamation of radiomics and genomics provides an approach to better study the molecular mechanism of tumour pathogenesis, as well as new evidence-supporting strategies to identify the characteristics of cancer patients, make clinical decisions by predicting prognosis, and improve the development of individualized treatment guidance. In this review, we summarized recent research on radiogenomics applications in solid cancers and presented the challenges impeding the adoption of radiomics in clinical practice. More standard guidelines are required to normalize radiomics into reproducible and convincible analyses and develop it as a mature field.

Radiomics in clinical trials: perspectives on standardization

The term biomarker is used to describe a biological measure of the disease behavior. The existing imaging biomarkers are associated with the known tissue biological characteristics and follow a well-established roadmap to be implemented in routine clinical practice. Recently, a new quantitative imaging analysis approach named radiomics has emerged. It refers to the extraction of a large number of advanced imaging features with high-throughput computing. Extensive research has demonstrated its value in predicting disease behavior, progression, and response to therapeutic options. However, there are numerous challenges to establishing it as a clinically viable solution, including lack of reproducibility and transparency. The data-driven nature also does not offer insights into the underpinning biology of the observed relationships. As such, additional effort is needed to establish it as a qualified biomarker to inform clinical decisions. Here we review the technical difficulties encountered in the clinical applications of radiomics and current effort in addressing some of these challenges in clinical trial designs. By addressing these challenges, the true potential of radiomics can be unleashed.

MRI Radiomics for Predicting Survival in Patients with Locally Advanced Hypopharyngeal Cancer Treated with Concurrent Chemoradiotherapy

A reliable prognostic stratification of patients with locally advanced hypopharyngeal cancer who had been treated with concurrent chemoradiotherapy (CCRT) is crucial for informing tailored management strategies. The purpose of this retrospective study was to develop robust and objective magnetic resonance imaging (MRI) radiomics-based models for predicting overall survival (OS) and progression-free survival (PFS) in this patient population. The study participants included 198 patients (median age: 52.25 years (interquartile range = 46.88-59.53 years); 95.96% men) who were randomly divided into a training cohort (n = 132) and a testing cohort (n = 66). Radiomic parameters were extracted from post-contrast T1-weighted MR images. Radiomic features for model construction were selected from the training cohort using least absolute shrinkage and selection operator-Cox regression models. Prognostic performances were assessed by calculating the integrated area under the receiver operating characteristic curve (iAUC). The ability of radiomic models to predict OS (iAUC = 0.580, 95% confidence interval (CI): 0.558-0.591) and PFS (iAUC = 0.625, 95% CI = 0.600-0.633) was validated in the testing cohort. The combination of radiomic signatures with traditional clinical parameters outperformed clinical variables alone in the prediction of survival outcomes (observed iAUC increments = 0.279 [95% CI = 0.225-0.334] and 0.293 [95% CI = 0.232-0.351] for OS and PFS, respectively). In summary, MRI radiomics has value for predicting survival outcomes in patients with hypopharyngeal cancer treated with CCRT, especially when combined with clinical prognostic variables.

Evaluation of radiomics feature stability in abdominal monoenergetic photon counting CT reconstructions

Feature stability and standardization remain challenges that impede the clinical implementation of radiomics. This study investigates the potential of spectral reconstructions from photon-counting computed tomography (PCCT) regarding organ-specific radiomics feature stability. Abdominal portal-venous phase PCCT scans of 10 patients in virtual monoenergetic (VM) (keV 40-120 in steps of 10), polyenergetic, virtual non-contrast (VNC), and iodine maps were acquired. Two 2D and 3D segmentations measuring 1 and 2 cm in diameter of the liver, lung, spleen, psoas muscle, subcutaneous fat, and air were obtained for spectral reconstructions. Radiomics features were extracted with pyradiomics. The calculation of feature-specific intraclass correlation coefficients (ICC) was performed by comparing all segmentation approaches and organs. Feature-wise and organ-wise correlations were evaluated. Segmentation-resegmentation stability was evaluated by concordance correlation coefficient (CCC). Compared to non-VM, VM-reconstruction features tended to be more stable. For VM reconstructions, 3D 2 cm segmentation showed the highest average ICC with 0.63. Based on a criterion of ≥ 3 stable organs and an ICC of ≥ 0.75, 12-mainly non-first-order features-are shown to be stable between the VM reconstructions. In a segmentation-resegmentation analysis in 3D 2 cm, three features were identified as stable based on a CCC of > 0.6 in ≥ 3 organs in ≥ 6 VM reconstructions. Certain radiomics features vary between monoenergetic reconstructions and depend on the ROI size. Feature stability was also shown to differ between different organs. Yet, glcm_JointEntropy, gldm_GrayLevelNonUniformity, and firstorder_Entropy could be identified as features that could be interpreted as energy-independent and segmentation-resegmentation stable in this PCCT collective. PCCT may support radiomics feature standardization and comparability between sites.

Harmonization Strategies in Multicenter MRI-Based Radiomics

Radiomics analysis is a powerful tool aiming to provide diagnostic and prognostic patient information directly from images that are decoded into handcrafted features, comprising descriptors of shape, size and textural patterns. Although radiomics is gaining momentum since it holds great promise for accelerating digital diagnostics, it is susceptible to bias and variation due to numerous inter-patient factors (e.g., patient age and gender) as well as inter-scanner ones (different protocol acquisition depending on the scanner center). A variety of image and feature based harmonization methods has been developed to compensate for these effects; however, to the best of our knowledge, none of these techniques has been established as the most effective in the analysis pipeline so far. To this end, this review provides an overview of the challenges in optimizing radiomics analysis, and a concise summary of the most relevant harmonization techniques, aiming to provide a thorough guide to the radiomics harmonization process.

Robustness of radiomics to variations in segmentation methods in multimodal brain MRI

Radiomics in neuroimaging uses fully automatic segmentation to delineate the anatomical areas for which radiomic features are computed. However, differences among these segmentation methods affect radiomic features to an unknown extent. A scan-rescan dataset (n = 46) of T1-weighted and diffusion tensor images was used. Subjects were split into a sleep-deprivation and a control group. Scans were segmented using four segmentation methods from which radiomic features were computed. First, we measured segmentation agreement using the Dice-coefficient. Second, robustness and reproducibility of radiomic features were measured using the intraclass correlation coefficient (ICC). Last, difference in predictive power was assessed using the Friedman-test on performance in a radiomics-based sleep deprivation classification application. Segmentation agreement was generally high (interquartile range = 0.77–0.90) and median feature robustness to segmentation method variation was higher (ICC > 0.7) than scan-rescan reproducibility (ICC 0.3–0.8). However, classification performance differed significantly among segmentation methods (p < 0.001) ranging from 77 to 84%. Accuracy was higher for more recent deep learning-based segmentation methods. Despite high agreement among segmentation methods, subtle differences significantly affected radiomic features and their predictive power. Consequently, the effect of differences in segmentation methods should be taken into account when designing and evaluating radiomics-based research methods.

Intensity standardization of MRI prior to radiomic feature extraction for artificial intelligence research in glioma-a systematic review

OBJECTIVES

Radiomics is a promising avenue in non-invasive characterisation of diffuse glioma. Clinical translation is hampered by lack of reproducibility across centres and difficulty in standardising image intensity in MRI datasets. The study aim was to perform a systematic review of different methods of MRI intensity standardisation prior to radiomic feature extraction.

METHODS

MEDLINE, EMBASE, and SCOPUS were searched for articles meeting the following eligibility criteria: MRI radiomic studies where one method of intensity normalisation was compared with another or no normalisation, and original research concerning patients diagnosed with diffuse gliomas. Using PRISMA criteria, data were extracted from short-listed studies including number of patients, MRI sequences, validation status, radiomics software, method of segmentation, and intensity standardisation. QUADAS-2 was used for quality appraisal.

RESULTS

After duplicate removal, 741 results were returned from database and reference searches and, from these, 12 papers were eligible. Due to a lack of common pre-processing and different analyses, a narrative synthesis was sought. Three different intensity standardisation techniques have been studied: histogram matching (5/12), limiting or rescaling signal intensity (8/12), and deep learning (1/12)-only two papers compared different methods. From these studies, histogram matching produced the more reliable features compared to other methods of altering MRI signal intensity.

CONCLUSION

Multiple methods of intensity standardisation have been described in the literature without clear consensus. Further research that directly compares different methods of intensity standardisation on glioma MRI datasets is required.

KEY POINTS

• Intensity standardisation is a key pre-processing step in the development of robust radiomic signatures to evaluate diffuse glioma. • A minority of studies compared the impact of two or more methods. • Further research is required to directly compare multiple methods of MRI intensity standardisation on glioma datasets.

Inferring FDG-PET-positivity of lymph node metastases in proven lung cancer from contrast-enhanced CT using radiomics and machine learning

Background

We evaluated the role of radiomics applied to contrast-enhanced computed tomography (CT) in the detection of lymph node (LN) metastases in patients with known lung cancer compared to ¹⁸F-fluorodeoxyglucose positron emission tomography (PET)/CT as a reference.

Methods

This retrospective analysis included 381 patients with 1,799 lymph nodes (450 malignant, 1,349 negative). The data set was divided into a training and validation set. A radiomics analysis with 4 filters and 6 algorithms resulting in 24 different radiomics signatures and a bootstrap algorithm (Bagging) with 30 bootstrap iterations was performed. A decision curve analysis was applied to generate a net benefit to compare the radiomics signature to two expert radiologists as one-by-one and as a prescreening tool in combination with the respective radiologist and only the radiologists.

Results

All 24 modeling methods showed good and reliable discrimination for malignant/benign LNs (area under the curve 0.75−0.87). The decision curve analysis showed a net benefit for the least absolute shrinkage and selection operator (LASSO) classifier for the entire probability range and outperformed the expert radiologists except for the high probability range. Using the radiomics signature as a prescreening tool for the radiologists did not improve net benefit.

Conclusions

Radiomics showed good discrimination power irrespective of the modeling technique in detecting LN metastases in patients with known lung cancer. The LASSO classifier was a suitable diagnostic tool and even outperformed the expert radiologists, except for high probabilities. Radiomics failed to improve clinical benefit as a prescreening tool.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41747-022-00296-8.